SlideShare uma empresa Scribd logo
1 de 46
Skills, Reputation, and Search
Pete Skomoroch
Principal Data Scientist, LinkedIn
Vision: Create Economic Opportunity for Every Professional
2
Location
LinkedIn: The Professional Profile of Record
©2012 LinkedIn Corporation. All Rights Reserved. 3
200+MMembers 200M Member
Profiles
LinkedIn Search: Connecting Talent with Opportunity
4
Skills Correlated with the Job Title “Data Scientist”
5
Skills Related to “Big Data”
6
Information Retrieval
7
Soul Retrieval
8
9
Lucene on LinkedIn
10
Lucene Endorsement Graph
11
Solr on LinkedIn
12
Solr Endorsement Graph
13
Reputation: Building the Endorsement Graph
14
15
Viral Growth: 1 Billion Endorsements in 5 Months
How Did We Gather this Data?
16
1. Desire + Social Proof
2. Viral Loops + Network Effects
3. Data Foundation + Recommendation Algorithms
17
1) Desire & Social Proof
A
endorses
B
B
notified
B “accepts”
endorsement
B
endorses
C
B
endorses
D
Endorsement
recommendations
Email NotificationNews Feed
2) Viral Loops & Network Effects
3) Data Foundation: Skills & Suggested Skills
19
Data Foundation: LinkedIn Skills
20
Social Tagging Accelerates Adoption
Suggested
endorsements
Skill recommendations
Skill marketing
©2012 LinkedIn Cororation. All Rights Reserved.
Virality only
Outline
22
Skill discovery
Skill tagging
Skill recommendations
Suggested endorsements
Skill Discovery: Unsupervised Topics from Profiles
23
Extract
Topic Clustering & Phrase Sense Disambiguation
24
Deduplication Signals from Mechanical Turk
25
Sample Task for Mechanical Turk Workers
26
Skill Phrase Deduplication
27
Outline
28
Skill discovery
Skill tagging
Skill recommendations
Suggested endorsements
Lead designer and engineer for the implementation of a user-
centric, fully-configurable UI for data aggregation and reporting.
Developed over 20 SaaS custom applications using Python,
Javascript and RoR.
Tagging Skill Phrases
 Tagging: Extract potential skill phrases from text
 Standardize unambiguous phrase variants
29
JavaScript RoR SaaS Python
ror
rubyonrails
ruby on rails development
ruby rails
ruby on rail
Ruby on Rails
Document
(ex: Profile)
Tokenization
Skills Tagger
Phrases
(up to 6 words)
Skills Classifier
Skills
(unordered)
Skills
(ranked by relevance)
Outline
30
Skill discovery
Skill tagging
Skill recommendations
Suggested endorsements
Skill Inference
 How suggested/inferred skills work:
– The skill likelihood is a conditional model
– Probabilities are combined using a Naïve Bayes
Classifier
 If you are an engineer at Apple, you probably know
about iPhone Development.
31
Profile
Extract
attributes
- Company ID
- Title ID
- Groups ID
- Industry ID
- …
Skills Classifier
Skills
(ranked by likelihood)
Feature
Vectors
Skill Recommendations for Your LinkedIn Profile
37
49% Conversion
4% Conversion
Outline
38
Skill discovery
Skill tagging
Skill recommendations
Suggested endorsements
Social Tagging via Skill Endorsements
39
Social Tagging Accelerates Adoption
Skill endorsements
Skill recommendations
Skill marketing
©2012 LinkedIn Cororation. All Rights Reserved.
Data Amplifies Desire
41
1. Desire + Social Proof
2. Viral Loops + Network Effects
3. Data Catalyst + Recommendation Algorithms
Over 58 Million Profiles are now Tagged with Skills
42
All This Data Flows Back Into Our Lucene Index
43
Helping us Connect Talent & Opportunity
44
Location
Questions?
We’re hiring: data.linkedin.com
@peteskomoroch
©2012 LinkedIn Corporation. All Rights Reserved. 45
CONTACT
Pete Skomoroch
@peteskomoroch
http://data.linkedin.com

Mais conteúdo relacionado

Mais procurados

E2.0 fmw for apps ro 2010 11-30 v.02
E2.0 fmw for apps ro 2010 11-30 v.02E2.0 fmw for apps ro 2010 11-30 v.02
E2.0 fmw for apps ro 2010 11-30 v.02
Doina Draganescu
 
Tamm & kitt
Tamm & kittTamm & kitt
Tamm & kitt
Jeff Roy
 
2017 06-14-getting started with data science
2017 06-14-getting started with data science2017 06-14-getting started with data science
2017 06-14-getting started with data science
Thinkful
 
II-SDV 2012 Merging Information from Structured and Unstructured Information ...
II-SDV 2012 Merging Information from Structured and Unstructured Information ...II-SDV 2012 Merging Information from Structured and Unstructured Information ...
II-SDV 2012 Merging Information from Structured and Unstructured Information ...
Dr. Haxel Consult
 
II-SDV 2012 Actionable Intelligence for the Whole Enterprise
II-SDV 2012 Actionable Intelligence for the Whole EnterpriseII-SDV 2012 Actionable Intelligence for the Whole Enterprise
II-SDV 2012 Actionable Intelligence for the Whole Enterprise
Dr. Haxel Consult
 
Getting started in ds (july 17) atlanta
Getting started in ds (july 17)   atlantaGetting started in ds (july 17)   atlanta
Getting started in ds (july 17) atlanta
Thinkful
 

Mais procurados (20)

Chief Data Officer Agenda Webinar: How CDOs Should Work with Lawyers
Chief Data Officer Agenda Webinar: How CDOs Should Work with LawyersChief Data Officer Agenda Webinar: How CDOs Should Work with Lawyers
Chief Data Officer Agenda Webinar: How CDOs Should Work with Lawyers
 
Artificial Intelligence Beyond Theory & Concepts - Our AI Summer Academy Empo...
Artificial Intelligence Beyond Theory & Concepts - Our AI Summer Academy Empo...Artificial Intelligence Beyond Theory & Concepts - Our AI Summer Academy Empo...
Artificial Intelligence Beyond Theory & Concepts - Our AI Summer Academy Empo...
 
Democratizing Intelligence - Sri Ambati, CEO & Co-Founder, H2O.ai
Democratizing Intelligence - Sri Ambati, CEO & Co-Founder, H2O.aiDemocratizing Intelligence - Sri Ambati, CEO & Co-Founder, H2O.ai
Democratizing Intelligence - Sri Ambati, CEO & Co-Founder, H2O.ai
 
1. The Importance of Graphs in Government
1. The Importance of Graphs in Government1. The Importance of Graphs in Government
1. The Importance of Graphs in Government
 
E2.0 fmw for apps ro 2010 11-30 v.02
E2.0 fmw for apps ro 2010 11-30 v.02E2.0 fmw for apps ro 2010 11-30 v.02
E2.0 fmw for apps ro 2010 11-30 v.02
 
Tamm & kitt
Tamm & kittTamm & kitt
Tamm & kitt
 
2017 06-14-getting started with data science
2017 06-14-getting started with data science2017 06-14-getting started with data science
2017 06-14-getting started with data science
 
Sql Relay Nottingham Keynote Oct 7th 2015
Sql Relay Nottingham Keynote Oct 7th 2015 Sql Relay Nottingham Keynote Oct 7th 2015
Sql Relay Nottingham Keynote Oct 7th 2015
 
Successfully Kickstarting Data Governance's Social Dynamics: Define, Collabor...
Successfully Kickstarting Data Governance's Social Dynamics: Define, Collabor...Successfully Kickstarting Data Governance's Social Dynamics: Define, Collabor...
Successfully Kickstarting Data Governance's Social Dynamics: Define, Collabor...
 
Kush stats alpha
Kush stats alpha Kush stats alpha
Kush stats alpha
 
Is Data Scientist still the Sexiest job of the 21st century?
Is Data Scientist still the Sexiest job of the 21st century?Is Data Scientist still the Sexiest job of the 21st century?
Is Data Scientist still the Sexiest job of the 21st century?
 
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...
AI Foundations Course Module 1 - Shifting to the Next Step in Your AI Transfo...
 
Data & Services / Service Lab London
Data & Services / Service Lab LondonData & Services / Service Lab London
Data & Services / Service Lab London
 
II-SDV 2012 Merging Information from Structured and Unstructured Information ...
II-SDV 2012 Merging Information from Structured and Unstructured Information ...II-SDV 2012 Merging Information from Structured and Unstructured Information ...
II-SDV 2012 Merging Information from Structured and Unstructured Information ...
 
Employment trends 2011 by zylog
Employment trends 2011 by zylogEmployment trends 2011 by zylog
Employment trends 2011 by zylog
 
II-SDV 2012 Actionable Intelligence for the Whole Enterprise
II-SDV 2012 Actionable Intelligence for the Whole EnterpriseII-SDV 2012 Actionable Intelligence for the Whole Enterprise
II-SDV 2012 Actionable Intelligence for the Whole Enterprise
 
Ds.ai applied ai-workshop-
Ds.ai applied ai-workshop-Ds.ai applied ai-workshop-
Ds.ai applied ai-workshop-
 
Colossal Data for Dramatic Effect
Colossal Data for Dramatic EffectColossal Data for Dramatic Effect
Colossal Data for Dramatic Effect
 
Getting started in ds (july 17) atlanta
Getting started in ds (july 17)   atlantaGetting started in ds (july 17)   atlanta
Getting started in ds (july 17) atlanta
 
Conversational Architecture, CAVE Language, Data Stewardship
Conversational Architecture, CAVE Language, Data StewardshipConversational Architecture, CAVE Language, Data Stewardship
Conversational Architecture, CAVE Language, Data Stewardship
 

Semelhante a Skills, Reputation, and Search

Keynote Peter Skomoroch - skills, reputation, and search
Keynote   Peter Skomoroch - skills, reputation, and searchKeynote   Peter Skomoroch - skills, reputation, and search
Keynote Peter Skomoroch - skills, reputation, and search
lucenerevolution
 
Linked in corporate presentation [2aug'12]
Linked in corporate presentation [2aug'12]Linked in corporate presentation [2aug'12]
Linked in corporate presentation [2aug'12]
G Annabel Hahn...
 
Free tips march 2013 staffing deck
Free tips march 2013 staffing deckFree tips march 2013 staffing deck
Free tips march 2013 staffing deck
Mike Driscoll
 
Free tips march 2013 staffing deck
Free tips march 2013 staffing deckFree tips march 2013 staffing deck
Free tips march 2013 staffing deck
Mike Driscoll
 
Agency tips finalv3 092013
Agency tips finalv3 092013Agency tips finalv3 092013
Agency tips finalv3 092013
Chris Castrence
 
Gaps May 2011 Presentation1
Gaps May 2011 Presentation1Gaps May 2011 Presentation1
Gaps May 2011 Presentation1
Steve Rath
 

Semelhante a Skills, Reputation, and Search (20)

Keynote Peter Skomoroch - skills, reputation, and search
Keynote   Peter Skomoroch - skills, reputation, and searchKeynote   Peter Skomoroch - skills, reputation, and search
Keynote Peter Skomoroch - skills, reputation, and search
 
KEYNOTE: Skills, Reputation and Search
KEYNOTE: Skills, Reputation and SearchKEYNOTE: Skills, Reputation and Search
KEYNOTE: Skills, Reputation and Search
 
Talentbin Sales Deck
Talentbin Sales DeckTalentbin Sales Deck
Talentbin Sales Deck
 
Talent Bin
Talent BinTalent Bin
Talent Bin
 
Find the 'Unfindable' with TalentBin by Monster!
Find the 'Unfindable' with TalentBin by Monster!Find the 'Unfindable' with TalentBin by Monster!
Find the 'Unfindable' with TalentBin by Monster!
 
Keeping It Professional: Relevance, Recommendations, and Reputation at LinkedIn
Keeping It Professional: Relevance, Recommendations, and Reputation at LinkedInKeeping It Professional: Relevance, Recommendations, and Reputation at LinkedIn
Keeping It Professional: Relevance, Recommendations, and Reputation at LinkedIn
 
LinkedIn Data Cleansing-converted.pdf
LinkedIn Data Cleansing-converted.pdfLinkedIn Data Cleansing-converted.pdf
LinkedIn Data Cleansing-converted.pdf
 
Sla canada student nov 25 2021
Sla canada student nov 25 2021Sla canada student nov 25 2021
Sla canada student nov 25 2021
 
Next generation linked in talent search
Next generation linked in talent searchNext generation linked in talent search
Next generation linked in talent search
 
Linked in corporate presentation [2aug'12]
Linked in corporate presentation [2aug'12]Linked in corporate presentation [2aug'12]
Linked in corporate presentation [2aug'12]
 
Free tips march 2013 staffing deck
Free tips march 2013 staffing deckFree tips march 2013 staffing deck
Free tips march 2013 staffing deck
 
Startds9.19.17sd
Startds9.19.17sdStartds9.19.17sd
Startds9.19.17sd
 
Data sci sd-11.6.17
Data sci sd-11.6.17Data sci sd-11.6.17
Data sci sd-11.6.17
 
Free tips march 2013 staffing deck
Free tips march 2013 staffing deckFree tips march 2013 staffing deck
Free tips march 2013 staffing deck
 
Using LinkedIn for Job Search
Using LinkedIn for Job SearchUsing LinkedIn for Job Search
Using LinkedIn for Job Search
 
Getstarteddssd12717sd
Getstarteddssd12717sdGetstarteddssd12717sd
Getstarteddssd12717sd
 
Agency tips finalv3 092013
Agency tips finalv3 092013Agency tips finalv3 092013
Agency tips finalv3 092013
 
LinkedIn as the Ultimate Weapon for Business [Josef Kadlec]
LinkedIn as the Ultimate Weapon for Business [Josef Kadlec]LinkedIn as the Ultimate Weapon for Business [Josef Kadlec]
LinkedIn as the Ultimate Weapon for Business [Josef Kadlec]
 
Gaps May 2011 Presentation1
Gaps May 2011 Presentation1Gaps May 2011 Presentation1
Gaps May 2011 Presentation1
 
LinkedIn Frisco Connect Career Search Network
LinkedIn Frisco Connect Career Search NetworkLinkedIn Frisco Connect Career Search Network
LinkedIn Frisco Connect Career Search Network
 

Mais de Peter Skomoroch

Executive Briefing: Why managing machines is harder than you think
Executive Briefing: Why managing machines is harder than you thinkExecutive Briefing: Why managing machines is harder than you think
Executive Briefing: Why managing machines is harder than you think
Peter Skomoroch
 

Mais de Peter Skomoroch (13)

Bridging the AI Gap: Building Stakeholder Support
Bridging the AI Gap: Building Stakeholder SupportBridging the AI Gap: Building Stakeholder Support
Bridging the AI Gap: Building Stakeholder Support
 
Managing Machines: The New AI Dev Stack
Managing Machines: The New AI Dev StackManaging Machines: The New AI Dev Stack
Managing Machines: The New AI Dev Stack
 
Product Management for AI
Product Management for AIProduct Management for AI
Product Management for AI
 
Executive Briefing: Why managing machines is harder than you think
Executive Briefing: Why managing machines is harder than you thinkExecutive Briefing: Why managing machines is harder than you think
Executive Briefing: Why managing machines is harder than you think
 
O'Reilly Strata: Distilling Data Exhaust
O'Reilly Strata: Distilling Data ExhaustO'Reilly Strata: Distilling Data Exhaust
O'Reilly Strata: Distilling Data Exhaust
 
LinkedIn Endorsements: Reputation, Virality, and Social Tagging
LinkedIn Endorsements: Reputation, Virality, and Social TaggingLinkedIn Endorsements: Reputation, Virality, and Social Tagging
LinkedIn Endorsements: Reputation, Virality, and Social Tagging
 
Practical Problem Solving with Data - Onlab Data Conference, Tokyo
Practical Problem Solving with Data - Onlab Data Conference, TokyoPractical Problem Solving with Data - Onlab Data Conference, Tokyo
Practical Problem Solving with Data - Onlab Data Conference, Tokyo
 
Street Fighting Data Science
Street Fighting Data ScienceStreet Fighting Data Science
Street Fighting Data Science
 
Data Mashups -Data Science Summit
Data Mashups -Data Science SummitData Mashups -Data Science Summit
Data Mashups -Data Science Summit
 
Geo Analytics Tutorial - Where 2.0 2011
Geo Analytics Tutorial - Where 2.0 2011Geo Analytics Tutorial - Where 2.0 2011
Geo Analytics Tutorial - Where 2.0 2011
 
Rapid Data Exploration With Hadoop
Rapid Data Exploration With HadoopRapid Data Exploration With Hadoop
Rapid Data Exploration With Hadoop
 
Prototyping Data Intensive Apps: TrendingTopics.org
Prototyping Data Intensive Apps: TrendingTopics.orgPrototyping Data Intensive Apps: TrendingTopics.org
Prototyping Data Intensive Apps: TrendingTopics.org
 
Elasticwulf Pycon Talk
Elasticwulf Pycon TalkElasticwulf Pycon Talk
Elasticwulf Pycon Talk
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 

Skills, Reputation, and Search