SharePoint Server 2010 Search Architecture March 16, 2013

http://allcomputers.us/windows_server/sharepoint-2010—-search-server-2010-and-fast-search—search-architecture.aspx

depositing each URL of each content  item in the MSSCrawlQueue table

a new process under Msssearch.exe  named Mssdmn.exe is spawned, and it is under this process that the  content source is both enumerated and then crawled

In Search 2010, the  number of crawl components across multiple servers can be increased as  the workload increases, with automatic distribution of addresses, or if  desired, specific addresses assigned to specific crawl components  through Host Distribution Rules.

The current propagation information is stored in the  Search_Service_Application database in the MSSPropagationTasks table, and the MSSPropagationLog table keeps records of past events and the query  components populate the MSSPropagationTaskCompletions table in response. The MSSPropagationErrors table will reflect any current deficiency, and the information there is entered every 10 minutes in a warning level event on the search admin  component’s server.

Since no single query component holds the complete index, the Query Processor service must manage disbursing the queries and processing the multiple results lists returned. This is accomplished, using a  round-robin load-balanced method, by one of the servers running the Search Query and Site Settings service (an Internet Information Services [IIS] service).

 

Various TroubleShooting For SharePoint Fixes August 20, 2012

stsadm -o execadmsvcjobs

stsadm.exe -o deleteconfigurationobject -id <objectId>

SELECT     Id, Name, Status, Properties

FROM       Objects

WHERE (Name LIKE ‘SharePoint – 80′)

Stsadm –o osearch –action stop
Run iisreset / noforce
stsadm –o osearch – action start

Sharepoint 2010 SQL Maintenance July 21, 2011

http://technet.microsoft.com/en-us/library/cc262731.aspx

Database maintenance white paper.

http://technet.microsoft.com/en-us/library/cc298801.aspx

Database specifics for Sharepoint 2010

 

SQL Compile Error and Sharepoint Queries July 19, 2011

http://blogs.msdn.com/b/spses/archive/2011/07/19/sharepoint-and-sql-server-s-error-8628.aspx

Gateway and tp_RowOrdinal

 

Social Computing December 24, 2010

http://blogs.msdn.com/b/spses/archive/2010/12/23/social-computing-part-1-overview.aspx

There are many existing components in market, which is grouped together for Social Computing.

· My Sites

· Blogs

· Wikis

· RSS Feed

2. Socially-Enhanced information management.

Below is an example of how user information converts into social data.

User Data

Social Computing

Timer Job Roles:

SharePoint Social Computing is largely a Timer Job driven process. Behind these Jobs there are new databases and a series of tables involved. The below table lists all the timer jobs that influence Social Computing. The Jobs are prefixed with the name of their User Profile Application (UPA).

Timer Job Name	Timer Job jobs
My Site Cleanup Job	Handles the deletion of user profiles and My Sites of those users.
Activity Feed Cleanup Job	Cleans up pre-computed activities used in activity feeds which are older than 14 days. This job does not affect the User Profile Change Log. Daily by default.
Activity Feed Job	Pre-computes activities shown in the user’s activity feeds. Hourly by default.
My Site Suggestions Email Job	Sends out emails with colleague and keyword suggestions to people who don’t update their profiles often, prompt them to update their profiles. Monthly on the 15th.
Social Data Maintenance Job	Aggregate the social tags and ratings and cleans up the Social data change log. Every hour.
Social Rating Synchronization Job	Timer job to synchronize rating values between Social database and content database. Hourly.
System Job to Manage User Profile Synchronization	Timer job manages provision, run sets and additional tasks related to user profile synchronization. Do not change the information or frequency of this job. If you need to change how often incremental synchronization is done, access the user interface through the User profile service admin page, and click on the schedule incremental user profile synchronization link under the synchronization category. Every minute.
User Profile Change Cleanup Job	Cleans up data which is 14 days old from the User Profile Change Log. Daily by default.
User Profile Change Job	Processes changes to the user profile. Hourly by default.
User Profile Incremental Synchronization	Timer job will run at the specific interval to synchronize user, group, and group membership changes between the user profile application and specified directory sources such as AD or LDAP. Synchronization will look for changes since the last time this job was run and only perform these changes for AD and LDAP Sources. Daily by default.
User Profile Language Synchronization Job	Looks for new language pack installation and makes sure that strings related to user profile service are localized properly.
User Profile to SharePoint Full Synchronization	Synchronizes user information from the user profile application to SharePoint user and synchronizes site memberships from SharePoint to the user profile application. Hourly by default.
User Profile to SharePoint Quick Synchronization	Synchronizes user information from the user profile application to SharePoint users recently added to a site. This is set to run every 5 minutes by default. This updates the ProfileSweep table Change Token.

Other notable features:

· MySite

· Colleagues mined from your Outlook e-mail and Communicator ‘buddies’ will automatically be suggested to you.

· You can rate sites for relevance/usefulness.

http://blogs.msdn.com/b/spses/archive/2010/12/23/social-computing-part-2-user-profile-application-overview.aspx

Manage User Profiles:

Once user profiles imported from AD, it get stored in [Profile DB]; the following query will help you to get the list of property value of a particular user.

USE [Profile DB]

SELECT upf.NTName, pl.PropertyName, upv.PropertyVal FROM UserProfile_Full upf WITH(NOLOCK)

JOIN userProfileValue upv ON upv.RecordID = upf.RecordID

JOIN PropertyList pl ON pl.PropertyID = upv.PropertyID

WHERE upf.NTName = ‘Domain\alias’

select * from UserProfile_Full

select * from UserProfileValue

select * from PropertyList

Timer Jobs:

 

User Profile Change Job:

Whenever there is a change in user profile, either thru Central Administration->User Profile Application->Manage User Profiles or AD import there will be a changelog entry added into UserProfileEventLog table. Newly added entries will be processed thru this timer job. The “User Profile Change Job” has been scheduled for every hour.

User Profile Change Cleanup Job:

This job has been scheduled for Daily; it will clean up 14 days old data from UserProfileEventLog table.

User Profile Incremental Synchronization:

This job is to synchronize the new and updated Users, groups and group membership from AD, incremental sync will synchronize only the newly created or updated data.

User Profile to SharePoint Full Synchronization:

This job is to synchronize the user information from UPA to SharePoint sites, scheduled hourly by default.

User Profile to SharePoint Quick Synchronization:

This job is to synchronize the user information from UPA to SharePoint sites, it scheduled for every 5 minutes, it updates ProfileSweep table change token.

User Info Table Deletes Using Code November 3, 2010

http://nikspatel.wordpress.com/2010/08/10/delete-orphaned-ad-users-from-the-site-collection/

The best approach to delete the orphaned AD users from the User Information List, you should write a custom code and remove the user using the SPWeb.SiteUsers API. This will delete the users from the top level site collection. If you are inheriting the site membership in the sub sites, deleting users from the top level site will delete the users from the sub site making sure deleted users are not available in the sub site’s people picker. If you have broken the site membership inheritance, you have to manually write a extra code to delete the users using the SPWeb.Users API.

BUT

This still leaves the user in the UserInfo table flagged as deleted tp_Deleted = 24.

Sharepoint 2010 SQL For SPField When Compressed August 13, 2010

http://social.technet.microsoft.com/Forums/en-US/sharepoint2010programming/thread/27e47732-9528-446c-9c09-7ab968e11e42

tCompressedString

Figured it out.

Skip the first 12 bytes based on http://msdn.microsoft.com/en-us/library/dd973866(PROT.13).aspx, then skip another 2 bytes based on http://connect.microsoft.com/VisualStudio/feedback/ViewFeedback.aspx?FeedbackID=97064, then use System.IO.Compression.DeflateStream to decompress the remaining bytes and voila — readable text.

Of course this means you’ll need to use some .Net code for this — it can’t be done in raw TSql.

There is a company called Sharpest Tool Software that has a product called SPViews that generates SQL Views that do this for you. They put their 2010 beta version out there and it is working for me. Then you don’t have to deal with the compressed string or trying to parse the list XML.

http://blog.cloudsiders.com/2010/02/sharepoint-2007-vs-2010-how-do-my-list-content-types-policies-customxsn-look-like/

Powershell for tCompressedString.

Sharepoint SQL For Documents

http://turnoncomputer.blogspot.com/2009/07/data-access-with-sharepoint-query.html

– Fields

Each SharePoint site will have the data content of various types of data and queries, we also obtained data using the query as follows:

select tp_title from alllists
select tp_fields, tp_contenttypes from alllists

Retrieving Data Format Content

Once we see the list of data content in a SharePoint site, then we can also see the data format of the data content is, eg we want to see the data format Product_Price. Then we can also see the data format via a query. The format of data content is listed on the label AllList on the column tp_Fields and tp_ContentTypes. Tp_Fields column provides information on the field what they have on the data content. Meanwhile, the columns contain information tp_ContentTypes type daytanya. Mendaatkan following query to format the data content Product_Price:

select tp_fields, tp_contenttypes from alllists where tp_title = ‘Product_Price’

– Documents

select * from [dbo].[AllUserData] where master.dbo.fn_varbintohexstr(tp_ContentTypeId) not like ’0×0120%’ and master.dbo.fn_varbintohexstr(tp_DeleteTransactionId) is null and tp_IsCurrent = 1

Viewing Data Deleted

Any data or documents from the list will be stored by SharePoint to AllUserData in the table. If you want to get the data that are currently active, then we must add a filter, namely:

tp_iscurrent = 1 and tp_deletetransactionid = 0

When we want to get the data off, but the status is deleted, then we add a filtering as follows:

tp_iscurrent = 1 and tp_deletetransactionid 0

Each data item is removed from the document list or the value of the transaction will be recorded by SharePoint. For example, we have the data that are currently active and the status of the erased portal CMS Product_Price as follows:

select tp_id, tp_dirname, nvarchar3, nvarchar4, float1, tp_deletetransactionid from alluserdata
where tp_dirname like ‘cmdb / lists / product_price%’ and tp_iscurrent = 1 and tp_deletetransactionid 0

Sharepoint SQL For File Size June 12, 2010

http://www.codeproject.com/Articles/14232/Useful-SQL-Queries-to-Analyze-and-Monitor-SharePoi

select [DirName],[LeafName],
CAST((CAST(CAST(Size as decimal(10,2))/1024 As
decimal(10,2))/1024) AS Decimal(10,2)) AS ‘Size in MB’
FROM [WSS_Content_Intranet].[dbo].[AllDocs]
WHERE
DirName Like ‘%1 Salisbury Sq 8 Salisbury Crt%’

http://www.calvinirwin.net/2009/07/26/getting-file-size-for-documents-in-sharepoint/

select [filename],
sum(CAST((CAST(CAST(filesize as decimal(38,2))/1024 As
decimal(38,2))/1024) AS Decimal(38,2))) AS ‘Size in MB’
from (
select dirname + ‘/’ + leafname as [filename],
size as filesize,
siteid,
webid,
ExtensionForFile
from alldocs
union
select d.dirname + ‘/’ + d.leafname as [filename],
v.size as filesize,
d.siteid,
d.webid,
ExtensionForFile
from alldocs d
inner join alldocversions v on d.siteid = v.siteid
and d.id = v.id
) as results
inner join webs s on s.siteid = results.siteid
and s.id = results.webid
where (filesize is not null
and filesize > 0)
and ExtensionForFile not like ‘%aspx%’ — Not Include Certian File Types
group by
[Filename]
order by 2 desc

Content Deployment Feature Missing June 11, 2010

http://blogs.msdn.com/b/russmax/archive/2010/06/11/content-deployment-throws-system-cannot-find-the-file-specified-error.aspx

select * from features with (NOLOCK) where Properties like ‘%nameofcustomfeature%’

May also be present within the objects table in the Configuration database.