Search Technologies' CEO Kamran Khan presents about Search for Big Data, and Big Data for Search at the May 2014 Enterprise Search and Discovery Conference in New York.

1. The expert in the search space
Kamran Khan, President & CEO
Search: The Enabler for Big Data

2. Big Data for Search
How can Big Data technologies help
us to create better search systems?
Search for Big Data
How can search help to democratize
traditional Big Data?
“THE AVERAGE
PERSON TODAY
PROCESSES MORE
DATA IN A SINGLE
DAY THAN A PERSON
IN THE 1500’S DID
IN AN ENTIRE
LIFETIME.”

3. Search Technologies Overview
Herndon
San Diego
Ascot
Cincinnati
San Jose
Frankfurt
• The leading company
dedicated to Enterprise
Search & Big Data Solutions
• Implementation,
Consulting,
Managed Services,
Technology
• 150 employees
and growing
• Independent, working
with all of the leading
software vendors, and
open source alternatives

4. 500+
Customers

5. What is Big Data?
DATA
DATA
DATA
DATA
DATA
DATADATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA
DATA

6. What is Big Data?
 Too Big For A Single Machine
 Data Aggregation & Analysis
 Batch Processing
Message: Lots of Data  “Big Data”
CLICK HERE TO VIEW VIDEO…

7. Tomorrow’s Enterprise Search Architecture
r
r
r
r
rConnector
Staging
Area
Big Data
Search
&
Analytics
Content
Processing
Machine
Knowledge
Source
s
Content
Sources
Source
s
Source
s
Source
s
Content
Sources
Content
Processing
ADVANTAGES
• Agility, flexibility, scalability
• A platform for Big Data
enabled search and analytics
applications
• Fully embraces structured &
unstructured content Big Data for Search

8. • More diligent, and detailed
Content Processing delivers
better search, plus automated
matching of CVs to job
descriptions.
• Improved “fill-rates” add
directly to the bottom line.
Example: Big Data for
Search in Recruitment
Big Data
(Hadoop)
New CVs & Jobs
Store
vectors
Top 4K
vectors
Filter Query +
Target SCIP

9. THESE ARE EXCITING TIMES
CLICK HERE TO READ MORE…

10. A
Traditional
Big Data
Approach
Come up with the question

11. HDFS
Hadoop
A Traditional Big Data Approach
 Decide what data to use from the Data Warehouse
and other sources (Data Analyst)
 Write the required data to HDFS (Data Administrator)
 Run a batch job to produce results
MapReduce

12. A Traditional Big Data Approach
RESULTS ARE VISUALIZED

13. PROS
• Able to be very precise
• Analysis is in highly-
trained hands
Traditional Method: PROS AND CONS
CONS
• Need to know the
question ahead of time
• Limited bandwidth –
requires specialist skills
• Lengthy iterations mean
slow discovery, and lack of
agility

14. HDFS
Hadoop
A Search Approach
Write all meaningful data to HDFS
Search for Big Data

15. A Search Approach
Run Content Processing jobs to create schema-free content
objects (XML or JSON)
Search for Big Data
HDFS
Hadoop
ContentProcessingwithMapReduce

16. A Search Approach
Feed JSON Objects to a search engine
Search for Big Data
HDFS
Hadoop
ContentProcessingwithMapReduce

17. A Search Approach
Use search, supported by interactive user interfaces
Search for Big Data

18. PROS
• Everyone knows search
• Everyone can securely access
Big Data capabilities
• Short, iterative, agile cycles —
Innovation
• Unifies the analysis of structured
data & unstructured content
• The democratization of
Big Data
Search For Big Data: PROS AND CONS
CONS
• This is new, and evolving
• Not an out-of-the-box solution
• Expertise, experience, & not
just technology, are needed

19. Insurance
Fraud Example
• Search provides interactive
exploration capabilities
across a large set of records,
and supporting unstructured
content
• Investigators can
interactively follow hunches,
check things at low cost, find
and pursue outliers that
indicate fraudulent activity
Search for Big Data

20. CONCLUSION
Whichever way you look at it,
technologies, expertise, and
experience from the enterprise
search industry have a big part
to play in the Big Data world.
As the leading services company
in the sector, we look forward to
further engaging with customers
on these projects.
Big Data for Search
Search for Big Data

21. The expert in the search space
Kamran Khan, President & CEO
kkhan@searchtechnologies.com
QUESTIONS?
SEE US AT BOOTH 9