The document discusses hybrid search in SharePoint. Hybrid search allows searching across both on-premises and Office 365 environments. It addresses the complexity and productivity issues that arise when content is distributed across multiple locations. Hybrid search provides a single search experience and enterprise search center to search all SharePoint content. Various hybrid search topologies are presented, including one-way and two-way configurations with the ability to search in both directions. The document also covers tuning search results using query rules, the query builder, and ranking models.

1. Mike Maadarani

2. Thanks to our Sponsors!







3. TriState SharePoint User Group





 www.TriStateSharePoint.org

4. 




mike@maadarani.com
www.maadarani.com/blog

5. Configuring SSA
and PS
Topology
Scenarios
Agenda
Closing and
Q&A
Relevancy, Query Builder, &
Optimization
SharePoint 2013
Search Overview
Architecture and Resource Utilization
Hybrid… Say
What?

6. Crawl Component
Query Component
SharePoint 2010 Search Service Application
Query
Engine
Property
Store
(SQL)

7. FAST
Content
SSA
FAST
Query
SSA
FAST back-end components
(managed separately)
Extensibility:
• Sandbox
• Entity
Extraction

8. SharePoint 2013 Search Service Application
Index
Component
Query
Engine
Content
Pipeline
Content
Processing
Component
Crawl
Component
Query
Processing
Component
Analytics
Processing
Component
Query
Pipeline
Search
Admin
Admin
Component
Entire index on
local disk
Property
Store
(SQL)
Analysis
Engine
Crawl Indexing
Engine
Link/query analysis &
recommendations
Separate crawl
and indexing
Extensibility:
• Web callout
• Entity
Extraction

9. SharePoint
SP Apps
Devices
Non-SP UX
HTTP
File shares
SharePoint
User profiles
Lotus Notes
Documentum
Exchange folders
Custom - BCS
Public API
Search topology components

10. I just uploaded a document.
Make it searchable, quick!
FAST

11. EASY

12. EASY

13. Search Driven Applications

14. noderunner.exe noderunner.exe noderunner.exe noderunner.exe
Windows services
SharePointSearchHostControllerservice
Runtime/lifecycle controlofsearch
components(exceptcrawler)
hostcontrollerservice.exe
SharePointServerSearchservice
CrawlComponent
mssearch.exe
mssdmn.exe
Processes
Noderunner.exe
Runtimeenvironmentforsearch
components(exceptcrawler)
msseearch.exe
mssdmn.exe
Crawl
Componentnoderunner.exe
Search Runtime Environment
hostcontrollerservice.exe
Host Controller
SharePointAppServer
Search Service Instance: Provisioning of the
search service on each box
Search Service Application: SharePoint
Configuration entity
Still there, but only
Crawl Component
Admin
Component
Query
Processing
Component
Content
Processing
Component
Index
Component
Analytics
Processing
Component

15. Where do I host my components?

16. CPU load
 Drivingfactors
 QPS
 Querytransformations
Networkload
 Drivingfactors
 Numberofindexpartitions
 Sizeofqueriesandresults
 Example:
 20indexpartitions@20qps=>200/100Mbit/s
in/outbound
Item
count
DPS QPS
Load impact (relative)
CPU Network Disk
http://social.technet.microsoft.com/wiki/contents/articles/16002.sharepoint-2013-capacity-planning-sizing-and-high-availability-for-search-in-spc172.aspx

17. CPUload
 Drivingfactors
 QPSanditemcount
 Guidelinesperindexcomponent@2GHzCPU
 1Mitems:5QPSperCPUcore
 5Mitems:2QPSperCPUcore
 10Mitems:1QPSperCPUcore
Diskload
 Drivingfactors
 QPSanditemcount
 Newcontentinvalidatescaches
 Disksize:500GB@10Mitemsperindexcomponent
Item
count
DPS QPS
Load impact (relative)
CPU Network Disk

18. CPU load
 Drivingfactors
 Documentspersecond
 Linkdiscovery
 Crawlmanagement
Networkload
 Drivingfactors
 Downloadingitemsfromcontentsources
 PassingitemsontoCPC
 Crawlmanagement
Disk load
 Alldocumentsaretemporarilystoredindatafolder
Item
count
DPS QPS
Load impact (relative)
CPU Network Disk

19. CPU load
 Drivingfactors
 Documentspersecond
 Documentsizeandcomplexity
 Featureextraction
 Estimate:5-10DPSperCPUcore
Networkload
 Drivingfactors
 Documentspersecond
 Documentsize
Item
count
DPS QPS
Load impact (relative)
CPU Network Disk

20. CPU load
 Drivingfactors
 Numberofitems
 Siteactivity
Disk load
 Localdiskusedfortemporarystorage
 Bulkload,primacyconcernisloadisolation
Networkload
 SameasforCPUload
 PLUS:NetworktrafficincreaseswhendistributingAPC
acrossmultiplemachines
Item
count
DPS QPS
Load impact (relative)
CPU Network Disk

21.  Low CPUand networkload
 Loadincreasewith more componentsin
the search topology
Item
count
DPS QPS
Load impact (relative)
CPU Network Disk

24. Host
VM
Index QPC
VM
Admin
Crawl
CPC
APC
Host
VM
Index QPC
VM
Admin
Crawl
CPC
APC

25. Other
SharePoint
applications
Web front
end
Admin
Crawl
CPC
APC
Index
QPC

26. Adm
Adm

29. Hybrid Search

30. Hybrid SharePoint environment
Pieces of content distributed across multiple
environments
Complexity due to multiplelocations
No single Enterprise Search Center for findingcontent
Lost user productivity and added frustration while trying to
locate relevant content

31. Provide integrated search results allowing for a single place
to find content
One Enterprise Search center to reduce User Interface
complexity
Query all of your SharePoint content at the same time
Allow O365 and On-Premises solutions to coexist
Provides a solution allowing customers to move to the cloud
on their own terms
Reduce operation cost
Take advantage of newer SharePoint feature updates in
O365
Hybrid search solves many problems as data is moving
from on-premises to O365

32. One-way outbound topology
WFE
SharePoint Online
Local search
results only
Site collection
Office365 tenant SharePoint Server 2013 Farm
Hybrid search
results
Outbound
Inbound
SharePointOnlinecan NOT query SharePointOn-prem
Internet
Microsoft data center On-premises
SharePointServer can query SharePoint Online

33. One-way inbound topology
WFE
SharePoint Online
Local search
results only
Site collection
Office365 tenant SharePoint Server 2013 Farm
Hybrid search
results
Outbound
Inbound
SharePointOnlinecan query
SharePointOn-prem
Internet
Microsoft data center On-premises
SharePointServer can NOT query
SharePointOnline
Reverse Proxy
DMZ

34. Inbound/Outbound Topology
WFE
SharePoint Online
Local search
results only
Site collection
Office365 tenant SharePoint Server 2013 Farm
Hybrid search
results
Outbound
Inbound
SharePointOnlinecan query
SharePointOn-prem
Internet
Microsoft data center On-premises
SharePointServer can query
SharePointOnline
Reverse Proxy
DMZ

35. Tweaking Your results

36. Where is my talk
Project Plan?
Are Documents held at the
same place?
I wonder if there are
references from previous
projects?Different people have different intents
Query Rules help you handle intents
There is rarely a single right answer
Infrastructure Project

37. Sites that are important
Sites with low intrinsic relevance
Takes ~24hrs to
propagate

39. Setting an authority affects all sites connected through hyperlinks
Sites are weighted
by distance to
the authority

40. Query Rules
Tune Search Results
Created at the SSA, Tenant, Site Collection or Site
SSA
Site Collection
Site

41. Query Rules
Condition
When Do I apply the rule?
Action
What to do when the rule is matched?
Publishing
When should the rule be active?

42. Query Rules
 Exact match, beginning or end
 Ad-hoc or term store dictionary
 Match a regex (advanced)
 Is this query more likely aimed at the
following source…?
 Do people mostly click on result of the
following type…?
 Show a promoted result
 Show a block of results
 Replace the core results with a
different query

43. Query Builder
Dynamically Ranking Change
Part of the query
Results Ranking

44. Query Builder

45. For all queries:
Authorities: Level 1: http://employment
Ranking model: {incorporate user ratings}
Query:
HR Employment
quarterly
report
Search
Web Part
Query Processing Engine
Document
Collection
Thesaurus: HR  Human Resources
(WORDS HR, Human Resources) AND
(WORDS employees, employed) AND
(WORDS quarterly, quarterlies) AND
(WORDS report, reports, reported)
Mixed Results for:
• HR Employment best bet
• HR Employment quarterly report
• HR Employment
ContentType=reports
Dynamic Reordering Rules:
Quarterly Report 
{prefer docs from http://reports}
Query Rule:
{Terms} Quarterly Report 
{Terms} ContentType=“reports”

46. 


47. Results from
SharePoint
Online
Results
from
SharePoint
Server

48. High Availability and Performance
Better Search Quality
Better management
Friendly results and tools

49. Thank You!
mike@maadarani.com , @mikemaadarani
www.slideshare.net/maadarani