SlideShare uma empresa Scribd logo

Meta-Prod2Vec: Simple Product Embeddings with Side-Information

•
•
R
recsysfr

Talk given by Flavian Vasile, Criteo, during the RecsysFR meetup on October 6th 2016.

Internet
1 de 50
Baixar para ler offline
    Meta-­‐Prod2Vec:  Simple  Product   Embeddings  with  Side-­‐Informa:on               Flavian  Vasile,  Elena  Smirnova  @Criteo   Alexis  Conneau  @FAIR  
Contents   •  Product  Embeddings  for  Recommenda:on     •  Embedding  CF  signal:  Word2Vec  and  Prod2Vec   •  Meta-­‐Prod2vec:  Embedding  with  Side-­‐Informa:on     •  Experimental  Results   •  Conclusions  
Product  Embeddings  for   Recommenda5on      
Product  Embeddings  for   Recommenda5on       Represent  items  (and  some/mes  users)  as   vectors  in  the  same  space  and  use  their   distances  to  compute  recommenda/ons.  
•  At  a  certain  level,  nothing  new!   •  We  already  had  Matrix  Factoriza/on   •  It  is  yet  another  way  of  crea/ng  latent   representa/ons  for  Recommenda/on  
Some  of  the  NN  methods  can  be   translated  back  into  MF  techniques.       Differences:   •  new  ways  to  compute  matrix  entries     •  new  loss  func/ons  
Where  do  we  fit?   •  Hybrid  model  that  uses  CF  with  content   side-­‐informa/on   •  Incursion  on  the  embedding  methods   using  side  info  
Embedding  CF  signal:     Word2Vec  and  Prod2Vec    
(Word-­‐to-­‐hidden  matrix)  x  (Hidden-­‐to-­‐Word  context  matrix)       Word2Vec:  Skip-­‐gram  
  Word2Vec   In  this  space,  words  that  appear  in  similar  contexts   will  tend  to  be  close:    
  The  same  idea  can  be  applied  to  other  sequen:al   data,  such  as  user  shopping  sessions  -­‐  Prod2vec.    
Words  =  products   Sentences  =  shopping  sessions   Grbovic  et  al.  E-­‐commerce  in  Your  Inbox:  Product  RecommendaBons  at  Scale,  WWW  2013     Prod2Vec  
Prod2Vec   The  resul:ng  embedding  will  co-­‐locate  products   that  appear  in  the  vicinity  of  the  same  products.    
Prod2Vec  loss  func5on        
Meta-­‐Prod2vec:  Embedding  with  Side-­‐ Informa5on      
Meta-­‐Prod2vec:  Embedding  with  Side-­‐ Informa5on       Idea:  Use  not  only  the  product  sequence   informa:on,  but  also  product  meta-­‐data.    
Where  is  it  useful?   Product  cold-­‐start,  when  sequence   informa:on  is  sparse.  
How  can  it  help?   We  place  addi:onal  constraints  on   product  co-­‐occurrences  using  external   info.     We  can  create  more  noise-­‐robust   embeddings  for  products  suffering  from   cold-­‐start.  
Type  of  product  side-­‐informa5on:     •  Categories   •  Brands   •  Title  &  Descrip:on   •  Tags  
How  does  Meta-­‐Prod2Vec  leverage  this   informa5on  for  cold-­‐start?  
Mo5va5ng  example:  
Let’s  say  we  are  trying  to  build  a   recommender  system  for  songs...    
We  want  to  build  a  very  simple  solu5on   that  based  on  the  last  song  the  user   heard,  recommends  the  next  song.    
Two  different  recommenda:on  situa:ons:     •  Simple:  the  previous  song  is  popular   •  Hard  one:  the  previous  song  is   rela:vely  unknown  (suffers  from  cold   start).    
Simple  case:               Query  song:  Shake  It  Off  by  Taylor  SwiL.     Best  next  song:  It’s  all  about  the  Bass  by  Meghan  Trainor.       CF  and  Prod2Vec  both  work!  
Hard  case:               Query  song:  S/ll  by  Taylor  SwiL,  but  is  one  of  her  earlier  songs,   e.g.  You’re  Not  Sorry.     Best  next  song:  ?      ?  
Hard  case  +  unlucky:     •  Just  one  user  listened  to  You’re  Not  Sorry   •  He  also  listened  to  Rammstein’s  Du  Hast!  
Hard  case  +  unlucky:               Your  Recommenda5on  Is  Not  Working!  
This  is  where  Meta-­‐Prod2Vec  comes  in   handy!  
When  compu:ng  how  plausible  it  is  for  a   user  to  like  a  pair  of  songs,  you  can  place   addi5onal  constraints  by  taking  into   account  the  song  ar5sts.    
Prod2Vec  constraints                   You’re  not  sorry   Du  Hast   P(Du  Hast|Youʹ′re  Not  Sorry)  -­‐>  the  next  song  depends  on  the  current   song  
Prod2Vec  constraints                   You’re  not  sorry   Du  Hast   Youʹ′re  Not  Sorry  is  a  fringe  song  -­‐>  low  evidence  for  the  posi/ve  and   nega/ve  pairs    
Ar5st  metadata  constraints                   You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   However,  the  associated  singer  is  popular  -­‐>  good  evidence  that  Taylor   SwiL  and  Rammstein  do  not  really  co-­‐occur  (have  distant  vectors)    
Ar5st  and  Song  constraints  (1)                   You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   Furthermore,  we  can  enforce  that  the  songs  and  their  ar5sts  should  be   close...    
Ar5st  and  Song  constraints  (2)               You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   Finally,  we  add  two  more  constraints  between  the  ar/sts  and  the   previous/next  song  (they  s/ll  have  more  support  than  the  original  pairs)  
Meta-­‐Prod2Vec  constraints                   You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   #1.  P(Rammstein  |  Youʹ′re  Not  Sorry)   the  ar/st  of  the  next  song  should  be  plausible     given  the  current  song     #2.  P(Du  Hast  |  Taylor  SwiW)   the  next  song  should  depend  on  the     current  ar/st  selec/on     #3.  P(Youʹ′re  Not  Sorry  |Taylor  SwiW)     and  P(Du  Hast  |  Rammstein)     the  current  ar/st  selec/on  should  also  influence     the  current  song  selec/on     #4.  P(Rammstein  |  Taylor  SwiW)   the  probability  of  the  next  ar/st  should     be  high  given  the  current  ar/st.    
PuXng  it  all  together:     Meta-­‐Prod2Vec  loss        
  Rela5onship  with  MF  with  Side-­‐Info:    
MP2V  Implementa5on     •  No  changes  in  the  Word2Vec  code!   •  Changes  just  in  the  input  pairs:  we  generate   (propor:onally  to  the  importance   hyperparameter)  4  addi:onal  types  of  pairs.  
Experimental  Results    
  Task  &  Metrics     Task:  Next  Event  Predic:on     Metrics:   •  Hit  ra:o  at  K  (HR@K)     •  Normalized  Discounted  Cumula:ve  Gain   (NDCG@K)    
  Methods     BestOf:  (rank  by)  popularity   CoCounts:  cosine  similarity  of  candidate  item  to  query  item     Prod2Vec:  cosine  similarity  of  item  embedding  vectors   Meta-­‐Prod2Vec:  cosine  similarity  of  improved  embedding   vectors   Mix(Prod2Vec,  CoCounts):  linear  combina:on  of  the  two  scores   Mix(Meta-­‐Prod2Vec,  CoCounts):  same  as  previous  
  Dataset:  30Music  Dataset     •  playlists  data  from  Last.fm  API   •  sample  of  100k  user  sessions     •  resul:ng  vocabulary  size:  433k  songs   and  67k  ar:sts.      
  Global  Results     Method   Type   HR@20   NDCG@20   BestOf   Head   0.0003   0.002   CoCounts   Head   0.0160   0.141   Prod2Vec   Tail   0.0101   0.113   MetaProd2Vec   Tail   0.0124   0.125   Mix(Prod2Vec,  CoCounts)   Global   0.0158   0.152   Mix(MetaProd2Vec,  CoCounts)   Global   0.0180   0.161  
  Results  on  Cold  Start  (HR@20)       Method   Type   Pair  freq  =  0   Pair  freq  <  3   BestOf   Head   0.0002   0.0002   CoCounts   Head   0.0000   0.0197   Prod2Vec   Tail   0.0003   0.0078   MetaProd2Vec   Tail   0.0013   0.0198   Mix(Prod2Vec,  CoCounts)   Global   0.0002   0.0200   Mix(MetaProd2Vec,  CoCounts)   Global   0.0007   0.0291  
Conclusions  and     Next  Steps  
Conclusions  and     Next  Steps     Using  side-­‐info  for  product  embeddings   helps,  especially  on  cold-­‐start.    
Conclusions  and     Next  Steps   •  Beeer  ways  to  mix  Head  and  Tail   recommenda:on  methods   •  Mix  CF  and  Meta-­‐Data  at  test  :me    -­‐  product   embeddings  using  all  available  signal  (CF,   categorical,  text  and  image  product   informa:on)  
  Thanks!    
  Ques5ons?  

Recomendados

word2vec, LDA, and introducing a new hybrid algorithm: lda2vec
word2vec, LDA, and introducing a new hybrid algorithm: lda2vecword2vec, LDA, and introducing a new hybrid algorithm: lda2vec
word2vec, LDA, and introducing a new hybrid algorithm: lda2vec👋 Christopher Moody
 
Scala Data Pipelines @ Spotify
Scala Data Pipelines @ SpotifyScala Data Pipelines @ Spotify
Scala Data Pipelines @ SpotifyNeville Li
 
What is word2vec?
What is word2vec?What is word2vec?
What is word2vec?Traian Rebedea
 
Word2Vec
Word2VecWord2Vec
Word2Vechyunyoung Lee
 
Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Alexandros Karatzoglou
 
Building Data Pipelines for Music Recommendations at Spotify
Building Data Pipelines for Music Recommendations at SpotifyBuilding Data Pipelines for Music Recommendations at Spotify
Building Data Pipelines for Music Recommendations at SpotifyVidhya Murali
 
A Simple Introduction to Word Embeddings
A Simple Introduction to Word EmbeddingsA Simple Introduction to Word Embeddings
A Simple Introduction to Word EmbeddingsBhaskar Mitra
 
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018Massimo Quadrana
 

Recomendados

word2vec, LDA, and introducing a new hybrid algorithm: lda2vec
word2vec, LDA, and introducing a new hybrid algorithm: lda2vecword2vec, LDA, and introducing a new hybrid algorithm: lda2vec
word2vec, LDA, and introducing a new hybrid algorithm: lda2vec👋 Christopher Moody
 
Scala Data Pipelines @ Spotify
Scala Data Pipelines @ SpotifyScala Data Pipelines @ Spotify
Scala Data Pipelines @ SpotifyNeville Li
 
What is word2vec?
What is word2vec?What is word2vec?
What is word2vec?Traian Rebedea
 
Word2Vec
Word2VecWord2Vec
Word2Vechyunyoung Lee
 
Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Alexandros Karatzoglou
 
Building Data Pipelines for Music Recommendations at Spotify
Building Data Pipelines for Music Recommendations at SpotifyBuilding Data Pipelines for Music Recommendations at Spotify
Building Data Pipelines for Music Recommendations at SpotifyVidhya Murali
 
A Simple Introduction to Word Embeddings
A Simple Introduction to Word EmbeddingsA Simple Introduction to Word Embeddings
A Simple Introduction to Word EmbeddingsBhaskar Mitra
 
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018
Tutorial on Sequence Aware Recommender Systems - ACM RecSys 2018Massimo Quadrana
 
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingYoung Seok Kim
 
Vector databases and neural search
Vector databases and neural searchVector databases and neural search
Vector databases and neural searchDmitry Kan
 
NLP using transformers
NLP using transformers NLP using transformers
NLP using transformers Arvind Devaraj
 
GPT-2: Language Models are Unsupervised Multitask Learners
GPT-2: Language Models are Unsupervised Multitask LearnersGPT-2: Language Models are Unsupervised Multitask Learners
GPT-2: Language Models are Unsupervised Multitask LearnersYoung Seok Kim
 
Best Practices for Building and Deploying Data Pipelines in Apache Spark
Best Practices for Building and Deploying Data Pipelines in Apache SparkBest Practices for Building and Deploying Data Pipelines in Apache Spark
Best Practices for Building and Deploying Data Pipelines in Apache SparkDatabricks
 
[PAP] 실무자를 위한 인과추론 활용 : Best Practices
[PAP] 실무자를 위한 인과추론 활용 : Best Practices[PAP] 실무자를 위한 인과추론 활용 : Best Practices
[PAP] 실무자를 위한 인과추론 활용 : Best PracticesBokyung Choi
 
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...Databricks
 
Neural Text Embeddings for Information Retrieval (WSDM 2017)
Neural Text Embeddings for Information Retrieval (WSDM 2017)Neural Text Embeddings for Information Retrieval (WSDM 2017)
Neural Text Embeddings for Information Retrieval (WSDM 2017)Bhaskar Mitra
 
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022Jim Dowling
 
Word embedding
Word embedding Word embedding
Word embedding ShivaniChoudhary74
 
Text generation and_advanced_topics
Text generation and_advanced_topicsText generation and_advanced_topics
Text generation and_advanced_topicsankit_ppt
 
NLTK in 20 minutes
NLTK in 20 minutesNLTK in 20 minutes
NLTK in 20 minutesJacob Perkins
 
Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Hady Elsahar
 
Deep Learning for Search
Deep Learning for SearchDeep Learning for Search
Deep Learning for SearchBhaskar Mitra
 
Collaborative Filtering with Spark
Collaborative Filtering with SparkCollaborative Filtering with Spark
Collaborative Filtering with SparkChris Johnson
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDevashish Shanker
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTSuman Debnath
 
A Review of Deep Contextualized Word Representations (Peters+, 2018)
A Review of Deep Contextualized Word Representations (Peters+, 2018)A Review of Deep Contextualized Word Representations (Peters+, 2018)
A Review of Deep Contextualized Word Representations (Peters+, 2018)Shuntaro Yada
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsOVHcloud
 
NLTK
NLTKNLTK
NLTKGirish Khanzode
 
Recommendation @ Meetic
Recommendation @ MeeticRecommendation @ Meetic
Recommendation @ Meeticrecsysfr
 
Pulpix - Video Recommendation at Scale
Pulpix - Video Recommendation at ScalePulpix - Video Recommendation at Scale
Pulpix - Video Recommendation at Scalerecsysfr
 

Mais conteúdo relacionado

Mais procurados

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingYoung Seok Kim
 
Vector databases and neural search
Vector databases and neural searchVector databases and neural search
Vector databases and neural searchDmitry Kan
 
NLP using transformers
NLP using transformers NLP using transformers
NLP using transformers Arvind Devaraj
 
GPT-2: Language Models are Unsupervised Multitask Learners
GPT-2: Language Models are Unsupervised Multitask LearnersGPT-2: Language Models are Unsupervised Multitask Learners
GPT-2: Language Models are Unsupervised Multitask LearnersYoung Seok Kim
 
Best Practices for Building and Deploying Data Pipelines in Apache Spark
Best Practices for Building and Deploying Data Pipelines in Apache SparkBest Practices for Building and Deploying Data Pipelines in Apache Spark
Best Practices for Building and Deploying Data Pipelines in Apache SparkDatabricks
 
[PAP] 실무자를 위한 인과추론 활용 : Best Practices
[PAP] 실무자를 위한 인과추론 활용 : Best Practices[PAP] 실무자를 위한 인과추론 활용 : Best Practices
[PAP] 실무자를 위한 인과추론 활용 : Best PracticesBokyung Choi
 
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...Databricks
 
Neural Text Embeddings for Information Retrieval (WSDM 2017)
Neural Text Embeddings for Information Retrieval (WSDM 2017)Neural Text Embeddings for Information Retrieval (WSDM 2017)
Neural Text Embeddings for Information Retrieval (WSDM 2017)Bhaskar Mitra
 
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022Jim Dowling
 
Text generation and_advanced_topics
Text generation and_advanced_topicsText generation and_advanced_topics
Text generation and_advanced_topicsankit_ppt
 
Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Hady Elsahar
 
Deep Learning for Search
Deep Learning for SearchDeep Learning for Search
Deep Learning for SearchBhaskar Mitra
 
Collaborative Filtering with Spark
Collaborative Filtering with SparkCollaborative Filtering with Spark
Collaborative Filtering with SparkChris Johnson
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDevashish Shanker
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTSuman Debnath
 
A Review of Deep Contextualized Word Representations (Peters+, 2018)
A Review of Deep Contextualized Word Representations (Peters+, 2018)A Review of Deep Contextualized Word Representations (Peters+, 2018)
A Review of Deep Contextualized Word Representations (Peters+, 2018)Shuntaro Yada
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsOVHcloud
 

Mais procurados (20)

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language UnderstandingBERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
 
Vector databases and neural search
Vector databases and neural searchVector databases and neural search
Vector databases and neural search
 
NLP using transformers
NLP using transformers NLP using transformers
NLP using transformers
 
GPT-2: Language Models are Unsupervised Multitask Learners
GPT-2: Language Models are Unsupervised Multitask LearnersGPT-2: Language Models are Unsupervised Multitask Learners
GPT-2: Language Models are Unsupervised Multitask Learners
 
Best Practices for Building and Deploying Data Pipelines in Apache Spark
Best Practices for Building and Deploying Data Pipelines in Apache SparkBest Practices for Building and Deploying Data Pipelines in Apache Spark
Best Practices for Building and Deploying Data Pipelines in Apache Spark
 
[PAP] 실무자를 위한 인과추론 활용 : Best Practices
[PAP] 실무자를 위한 인과추론 활용 : Best Practices[PAP] 실무자를 위한 인과추론 활용 : Best Practices
[PAP] 실무자를 위한 인과추론 활용 : Best Practices
 
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
Building a Pipeline for State-of-the-Art Natural Language Processing Using Hu...
 
Neural Text Embeddings for Information Retrieval (WSDM 2017)
Neural Text Embeddings for Information Retrieval (WSDM 2017)Neural Text Embeddings for Information Retrieval (WSDM 2017)
Neural Text Embeddings for Information Retrieval (WSDM 2017)
 
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
Real-Time Recommendations with Hopsworks and OpenSearch - MLOps World 2022
 
Word embedding
Word embedding Word embedding
Word embedding
 
Text generation and_advanced_topics
Text generation and_advanced_topicsText generation and_advanced_topics
Text generation and_advanced_topics
 
NLTK in 20 minutes
NLTK in 20 minutesNLTK in 20 minutes
NLTK in 20 minutes
 
Word Embeddings, why the hype ?
Word Embeddings, why the hype ? Word Embeddings, why the hype ?
Word Embeddings, why the hype ?
 
Deep Learning for Search
Deep Learning for SearchDeep Learning for Search
Deep Learning for Search
 
Collaborative Filtering with Spark
Collaborative Filtering with SparkCollaborative Filtering with Spark
Collaborative Filtering with Spark
 
Deep Learning for Natural Language Processing
Deep Learning for Natural Language ProcessingDeep Learning for Natural Language Processing
Deep Learning for Natural Language Processing
 
An introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERTAn introduction to the Transformers architecture and BERT
An introduction to the Transformers architecture and BERT
 
A Review of Deep Contextualized Word Representations (Peters+, 2018)
A Review of Deep Contextualized Word Representations (Peters+, 2018)A Review of Deep Contextualized Word Representations (Peters+, 2018)
A Review of Deep Contextualized Word Representations (Peters+, 2018)
 
Fine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP modelsFine tune and deploy Hugging Face NLP models
Fine tune and deploy Hugging Face NLP models
 
NLTK
NLTKNLTK
NLTK
 

Destaque

Recommendation @ Meetic
Recommendation @ MeeticRecommendation @ Meetic
Recommendation @ Meeticrecsysfr
 
Pulpix - Video Recommendation at Scale
Pulpix - Video Recommendation at ScalePulpix - Video Recommendation at Scale
Pulpix - Video Recommendation at Scalerecsysfr
 
Predictive quality metrics @ tinyclues - Artem Kozhevnikov - Tinyclues
Predictive quality metrics @ tinyclues - Artem Kozhevnikov - TinycluesPredictive quality metrics @ tinyclues - Artem Kozhevnikov - Tinyclues
Predictive quality metrics @ tinyclues - Artem Kozhevnikov - Tinycluesrecsysfr
 
CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...
CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...
CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...recsysfr
 
Sequential Learning in the Position-Based Model
Sequential Learning in the Position-Based ModelSequential Learning in the Position-Based Model
Sequential Learning in the Position-Based Modelrecsysfr
 
RecsysFR: Criteo presentation
RecsysFR: Criteo presentationRecsysFR: Criteo presentation
RecsysFR: Criteo presentationrecsysfr
 
Injecting semantic links into a graph-based recommender system
Injecting semantic links into a graph-based recommender systemInjecting semantic links into a graph-based recommender system
Injecting semantic links into a graph-based recommender systemrecsysfr
 
Dictionary Learning for Massive Matrix Factorization
Dictionary Learning for Massive Matrix FactorizationDictionary Learning for Massive Matrix Factorization
Dictionary Learning for Massive Matrix Factorizationrecsysfr
 
What can bring library metadata to the web? Trust, links and love
What can bring library metadata to the web? Trust, links and loveWhat can bring library metadata to the web? Trust, links and love
What can bring library metadata to the web? Trust, links and loverecsysfr
 
Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...
Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...
Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...recsysfr
 

Destaque (10)

Recommendation @ Meetic
Recommendation @ MeeticRecommendation @ Meetic
Recommendation @ Meetic
 
Pulpix - Video Recommendation at Scale
Pulpix - Video Recommendation at ScalePulpix - Video Recommendation at Scale
Pulpix - Video Recommendation at Scale
 
Predictive quality metrics @ tinyclues - Artem Kozhevnikov - Tinyclues
Predictive quality metrics @ tinyclues - Artem Kozhevnikov - TinycluesPredictive quality metrics @ tinyclues - Artem Kozhevnikov - Tinyclues
Predictive quality metrics @ tinyclues - Artem Kozhevnikov - Tinyclues
 
CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...
CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...
CONTENT2VEC: a Joint Architecture to use Product Image and Text for the task ...
 
Sequential Learning in the Position-Based Model
Sequential Learning in the Position-Based ModelSequential Learning in the Position-Based Model
Sequential Learning in the Position-Based Model
 
RecsysFR: Criteo presentation
RecsysFR: Criteo presentationRecsysFR: Criteo presentation
RecsysFR: Criteo presentation
 
Injecting semantic links into a graph-based recommender system
Injecting semantic links into a graph-based recommender systemInjecting semantic links into a graph-based recommender system
Injecting semantic links into a graph-based recommender system
 
Dictionary Learning for Massive Matrix Factorization
Dictionary Learning for Massive Matrix FactorizationDictionary Learning for Massive Matrix Factorization
Dictionary Learning for Massive Matrix Factorization
 
What can bring library metadata to the web? Trust, links and love
What can bring library metadata to the web? Trust, links and loveWhat can bring library metadata to the web? Trust, links and love
What can bring library metadata to the web? Trust, links and love
 
Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...
Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...
Highlights on most interesting RecSys papers - Elena Smirnova, Lowik Chanusso...
 

Semelhante a Meta-Prod2Vec: Simple Product Embeddings with Side-Information

Perl DBI Scripting with the ILS
Perl DBI Scripting with the ILSPerl DBI Scripting with the ILS
Perl DBI Scripting with the ILSRoy Zimmer
 
Machine learning @ Spotify - Madison Big Data Meetup
Machine learning @ Spotify - Madison Big Data MeetupMachine learning @ Spotify - Madison Big Data Meetup
Machine learning @ Spotify - Madison Big Data MeetupAndy Sloane
 
Music Personalization At Spotify
Music Personalization At SpotifyMusic Personalization At Spotify
Music Personalization At SpotifyVidhya Murali
 
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016MLconf
 
Atlanta MLconf Machine Learning Conference 09-23-2016
Atlanta MLconf Machine Learning Conference 09-23-2016Atlanta MLconf Machine Learning Conference 09-23-2016
Atlanta MLconf Machine Learning Conference 09-23-2016Chris Fregly
 
Music recommendations @ MLConf 2014
Music recommendations @ MLConf 2014Music recommendations @ MLConf 2014
Music recommendations @ MLConf 2014Erik Bernhardsson
 
Programming the Semantic Web
Programming the Semantic WebProgramming the Semantic Web
Programming the Semantic WebSteffen Staab
 
Presentation confoo optimization_sherifzaroubi
Presentation confoo optimization_sherifzaroubiPresentation confoo optimization_sherifzaroubi
Presentation confoo optimization_sherifzaroubiValtech Canada
 
Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)
Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)
Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)Massimo Menichinelli
 
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...Data Con LA
 
The Why and What of Pattern Lab
The Why and What of Pattern LabThe Why and What of Pattern Lab
The Why and What of Pattern LabDave Olsen
 
Is there anybody out there? Reactive Systems Hamburg
Is there anybody out there? Reactive Systems HamburgIs there anybody out there? Reactive Systems Hamburg
Is there anybody out there? Reactive Systems HamburgManuel Bernhardt
 
Transformer_Clustering_PyData_2022.pdf
Transformer_Clustering_PyData_2022.pdfTransformer_Clustering_PyData_2022.pdf
Transformer_Clustering_PyData_2022.pdfChristopherLennan
 
Gossip & Key Value Store
Gossip & Key Value StoreGossip & Key Value Store
Gossip & Key Value StoreSajeev P
 
DevOps Naughties Style - How We DevOps at MP3.com in the Early 2000's
DevOps Naughties Style - How We DevOps at MP3.com in the Early 2000'sDevOps Naughties Style - How We DevOps at MP3.com in the Early 2000's
DevOps Naughties Style - How We DevOps at MP3.com in the Early 2000'stechopsguru
 
Abstract An overview of the whole report and what it is about..docx
Abstract An overview of the whole report and what it is about..docxAbstract An overview of the whole report and what it is about..docx
Abstract An overview of the whole report and what it is about..docxbartholomeocoombs
 
Aspect Detection for Sentiment / Emotion Analysis
Aspect Detection for Sentiment / Emotion AnalysisAspect Detection for Sentiment / Emotion Analysis
Aspect Detection for Sentiment / Emotion AnalysisSeth Grimes
 
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”Dakiry
 

Semelhante a Meta-Prod2Vec: Simple Product Embeddings with Side-Information (20)

Perl DBI Scripting with the ILS
Perl DBI Scripting with the ILSPerl DBI Scripting with the ILS
Perl DBI Scripting with the ILS
 
Machine learning @ Spotify - Madison Big Data Meetup
Machine learning @ Spotify - Madison Big Data MeetupMachine learning @ Spotify - Madison Big Data Meetup
Machine learning @ Spotify - Madison Big Data Meetup
 
Music Personalization At Spotify
Music Personalization At SpotifyMusic Personalization At Spotify
Music Personalization At Spotify
 
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
Chris Fregly, Research Scientist, PipelineIO at MLconf ATL 2016
 
Atlanta MLconf Machine Learning Conference 09-23-2016
Atlanta MLconf Machine Learning Conference 09-23-2016Atlanta MLconf Machine Learning Conference 09-23-2016
Atlanta MLconf Machine Learning Conference 09-23-2016
 
Music recommendations @ MLConf 2014
Music recommendations @ MLConf 2014Music recommendations @ MLConf 2014
Music recommendations @ MLConf 2014
 
Christian Jakenfelds
Christian JakenfeldsChristian Jakenfelds
Christian Jakenfelds
 
Programming the Semantic Web
Programming the Semantic WebProgramming the Semantic Web
Programming the Semantic Web
 
Presentation confoo optimization_sherifzaroubi
Presentation confoo optimization_sherifzaroubiPresentation confoo optimization_sherifzaroubi
Presentation confoo optimization_sherifzaroubi
 
rlhf.pdf
rlhf.pdfrlhf.pdf
rlhf.pdf
 
Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)
Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)
Open P2P Design: Workshop @ Pixelversity, Helsinki (16/09/2011)
 
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...
Big Data Day LA 2016/ Hadoop/ Spark/ Kafka track - Real-time Aggregations, Ap...
 
The Why and What of Pattern Lab
The Why and What of Pattern LabThe Why and What of Pattern Lab
The Why and What of Pattern Lab
 
Is there anybody out there? Reactive Systems Hamburg
Is there anybody out there? Reactive Systems HamburgIs there anybody out there? Reactive Systems Hamburg
Is there anybody out there? Reactive Systems Hamburg
 
Transformer_Clustering_PyData_2022.pdf
Transformer_Clustering_PyData_2022.pdfTransformer_Clustering_PyData_2022.pdf
Transformer_Clustering_PyData_2022.pdf
 
Gossip & Key Value Store
Gossip & Key Value StoreGossip & Key Value Store
Gossip & Key Value Store
 
DevOps Naughties Style - How We DevOps at MP3.com in the Early 2000's
DevOps Naughties Style - How We DevOps at MP3.com in the Early 2000'sDevOps Naughties Style - How We DevOps at MP3.com in the Early 2000's
DevOps Naughties Style - How We DevOps at MP3.com in the Early 2000's
 
Abstract An overview of the whole report and what it is about..docx
Abstract An overview of the whole report and what it is about..docxAbstract An overview of the whole report and what it is about..docx
Abstract An overview of the whole report and what it is about..docx
 
Aspect Detection for Sentiment / Emotion Analysis
Aspect Detection for Sentiment / Emotion AnalysisAspect Detection for Sentiment / Emotion Analysis
Aspect Detection for Sentiment / Emotion Analysis
 
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
Igor Kostiuk “Как приручить музыкальную рекомендательную систему”
 

Mais de recsysfr

Multi Task DPP for Basket Completion by Romain WARLOP, Fifty Five
Multi Task DPP for Basket Completion by Romain WARLOP, Fifty FiveMulti Task DPP for Basket Completion by Romain WARLOP, Fifty Five
Multi Task DPP for Basket Completion by Romain WARLOP, Fifty Fiverecsysfr
 
Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...
Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...
Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...recsysfr
 
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...recsysfr
 
Recommendations @ Rakuten Group
Recommendations @ Rakuten GroupRecommendations @ Rakuten Group
Recommendations @ Rakuten Grouprecsysfr
 
Data-Driven Recommender Systems
Data-Driven Recommender SystemsData-Driven Recommender Systems
Data-Driven Recommender Systemsrecsysfr
 
Recommender systems
Recommender systemsRecommender systems
Recommender systemsrecsysfr
 
Recommendation @Deezer
Recommendation @DeezerRecommendation @Deezer
Recommendation @Deezerrecsysfr
 
Flexible recommender systems based on graphs
Flexible recommender systems based on graphsFlexible recommender systems based on graphs
Flexible recommender systems based on graphsrecsysfr
 
Using Neural Networks to predict user ratings
Using Neural Networks to predict user ratingsUsing Neural Networks to predict user ratings
Using Neural Networks to predict user ratingsrecsysfr
 
Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?
Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?
Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?recsysfr
 
Recommendation @ PriceMinister-Rakuten - Road to personalization
Recommendation @ PriceMinister-Rakuten - Road to personalizationRecommendation @ PriceMinister-Rakuten - Road to personalization
Recommendation @ PriceMinister-Rakuten - Road to personalizationrecsysfr
 
Rakuten Institute of Technology Paris
Rakuten Institute of Technology ParisRakuten Institute of Technology Paris
Rakuten Institute of Technology Parisrecsysfr
 
Tailor-made personalization and recommendation - Sailendra
Tailor-made personalization and recommendation - SailendraTailor-made personalization and recommendation - Sailendra
Tailor-made personalization and recommendation - Sailendrarecsysfr
 
New tools from the bandit literature to improve A/B Testing
New tools from the bandit literature to improve A/B TestingNew tools from the bandit literature to improve A/B Testing
New tools from the bandit literature to improve A/B Testingrecsysfr
 
Story of the algorithms behind Deezer Flow
Story of the algorithms behind Deezer FlowStory of the algorithms behind Deezer Flow
Story of the algorithms behind Deezer Flowrecsysfr
 

Mais de recsysfr (15)

Multi Task DPP for Basket Completion by Romain WARLOP, Fifty Five
Multi Task DPP for Basket Completion by Romain WARLOP, Fifty FiveMulti Task DPP for Basket Completion by Romain WARLOP, Fifty Five
Multi Task DPP for Basket Completion by Romain WARLOP, Fifty Five
 
Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...
Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...
Building a recommender system with Annoy and Word2Vec by Cristian PEREZ, Kern...
 
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
An Homophily-based Approach for Fast Post Recommendation in Microblogging Sys...
 
Recommendations @ Rakuten Group
Recommendations @ Rakuten GroupRecommendations @ Rakuten Group
Recommendations @ Rakuten Group
 
Data-Driven Recommender Systems
Data-Driven Recommender SystemsData-Driven Recommender Systems
Data-Driven Recommender Systems
 
Recommender systems
Recommender systemsRecommender systems
Recommender systems
 
Recommendation @Deezer
Recommendation @DeezerRecommendation @Deezer
Recommendation @Deezer
 
Flexible recommender systems based on graphs
Flexible recommender systems based on graphsFlexible recommender systems based on graphs
Flexible recommender systems based on graphs
 
Using Neural Networks to predict user ratings
Using Neural Networks to predict user ratingsUsing Neural Networks to predict user ratings
Using Neural Networks to predict user ratings
 
Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?
Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?
Preference Elicitation in Mangaki: Is Your Taste Kinda Weird?
 
Recommendation @ PriceMinister-Rakuten - Road to personalization
Recommendation @ PriceMinister-Rakuten - Road to personalizationRecommendation @ PriceMinister-Rakuten - Road to personalization
Recommendation @ PriceMinister-Rakuten - Road to personalization
 
Rakuten Institute of Technology Paris
Rakuten Institute of Technology ParisRakuten Institute of Technology Paris
Rakuten Institute of Technology Paris
 
Tailor-made personalization and recommendation - Sailendra
Tailor-made personalization and recommendation - SailendraTailor-made personalization and recommendation - Sailendra
Tailor-made personalization and recommendation - Sailendra
 
New tools from the bandit literature to improve A/B Testing
New tools from the bandit literature to improve A/B TestingNew tools from the bandit literature to improve A/B Testing
New tools from the bandit literature to improve A/B Testing
 
Story of the algorithms behind Deezer Flow
Story of the algorithms behind Deezer FlowStory of the algorithms behind Deezer Flow
Story of the algorithms behind Deezer Flow
 

Último

SCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is prediSCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is predieusebiomeyer
 
ETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptxETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptxNIMMANAGANTI RAMAKRISHNA
 
Cybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best PracticesCybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best PracticesLumiverse Solutions Pvt Ltd
 
TRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptxTRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptxAndrieCagasanAkio
 
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书rnrncn29
 
Unidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptxUnidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptxmibuzondetrabajo
 
Company Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptxCompany Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptxMario
 
IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119APNIC
 
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书rnrncn29
 

Último (9)

SCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is prediSCM Symposium PPT Format Customer loyalty is predi
SCM Symposium PPT Format Customer loyalty is predi
 
ETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptxETHICAL HACKING dddddddddddddddfnandni.pptx
ETHICAL HACKING dddddddddddddddfnandni.pptx
 
Cybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best PracticesCybersecurity Threats and Cybersecurity Best Practices
Cybersecurity Threats and Cybersecurity Best Practices
 
TRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptxTRENDS Enabling and inhibiting dimensions.pptx
TRENDS Enabling and inhibiting dimensions.pptx
 
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
『澳洲文凭』买詹姆士库克大学毕业证书成绩单办理澳洲JCU文凭学位证书
 
Unidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptxUnidad 4 – Redes de ordenadores (en inglés).pptx
Unidad 4 – Redes de ordenadores (en inglés).pptx
 
Company Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptxCompany Snapshot Theme for Business by Slidesgo.pptx
Company Snapshot Theme for Business by Slidesgo.pptx
 
IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119IP addressing and IPv6, presented by Paul Wilson at IETF 119
IP addressing and IPv6, presented by Paul Wilson at IETF 119
 
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
『澳洲文凭』买拉筹伯大学毕业证书成绩单办理澳洲LTU文凭学位证书
 

Meta-Prod2Vec: Simple Product Embeddings with Side-Information

  • 1.     Meta-­‐Prod2Vec:  Simple  Product   Embeddings  with  Side-­‐Informa:on               Flavian  Vasile,  Elena  Smirnova  @Criteo   Alexis  Conneau  @FAIR  
  • 2. Contents   •  Product  Embeddings  for  Recommenda:on     •  Embedding  CF  signal:  Word2Vec  and  Prod2Vec   •  Meta-­‐Prod2vec:  Embedding  with  Side-­‐Informa:on     •  Experimental  Results   •  Conclusions  
  • 3. Product  Embeddings  for   Recommenda5on      
  • 4. Product  Embeddings  for   Recommenda5on       Represent  items  (and  some/mes  users)  as   vectors  in  the  same  space  and  use  their   distances  to  compute  recommenda/ons.  
  • 5. •  At  a  certain  level,  nothing  new!   •  We  already  had  Matrix  Factoriza/on   •  It  is  yet  another  way  of  crea/ng  latent   representa/ons  for  Recommenda/on  
  • 6. Some  of  the  NN  methods  can  be   translated  back  into  MF  techniques.       Differences:   •  new  ways  to  compute  matrix  entries     •  new  loss  func/ons  
  • 7. Where  do  we  fit?   •  Hybrid  model  that  uses  CF  with  content   side-­‐informa/on   •  Incursion  on  the  embedding  methods   using  side  info  
  • 8. Embedding  CF  signal:     Word2Vec  and  Prod2Vec    
  • 9. (Word-­‐to-­‐hidden  matrix)  x  (Hidden-­‐to-­‐Word  context  matrix)       Word2Vec:  Skip-­‐gram  
  • 10.   Word2Vec   In  this  space,  words  that  appear  in  similar  contexts   will  tend  to  be  close:    
  • 11.   The  same  idea  can  be  applied  to  other  sequen:al   data,  such  as  user  shopping  sessions  -­‐  Prod2vec.    
  • 12. Words  =  products   Sentences  =  shopping  sessions   Grbovic  et  al.  E-­‐commerce  in  Your  Inbox:  Product  RecommendaBons  at  Scale,  WWW  2013     Prod2Vec  
  • 13. Prod2Vec   The  resul:ng  embedding  will  co-­‐locate  products   that  appear  in  the  vicinity  of  the  same  products.    
  • 15. Meta-­‐Prod2vec:  Embedding  with  Side-­‐ Informa5on      
  • 16. Meta-­‐Prod2vec:  Embedding  with  Side-­‐ Informa5on       Idea:  Use  not  only  the  product  sequence   informa:on,  but  also  product  meta-­‐data.    
  • 17. Where  is  it  useful?   Product  cold-­‐start,  when  sequence   informa:on  is  sparse.  
  • 18. How  can  it  help?   We  place  addi:onal  constraints  on   product  co-­‐occurrences  using  external   info.     We  can  create  more  noise-­‐robust   embeddings  for  products  suffering  from   cold-­‐start.  
  • 19. Type  of  product  side-­‐informa5on:     •  Categories   •  Brands   •  Title  &  Descrip:on   •  Tags  
  • 20. How  does  Meta-­‐Prod2Vec  leverage  this   informa5on  for  cold-­‐start?  
  • 22. Let’s  say  we  are  trying  to  build  a   recommender  system  for  songs...    
  • 23. We  want  to  build  a  very  simple  solu5on   that  based  on  the  last  song  the  user   heard,  recommends  the  next  song.    
  • 24. Two  different  recommenda:on  situa:ons:     •  Simple:  the  previous  song  is  popular   •  Hard  one:  the  previous  song  is   rela:vely  unknown  (suffers  from  cold   start).    
  • 25. Simple  case:               Query  song:  Shake  It  Off  by  Taylor  SwiL.     Best  next  song:  It’s  all  about  the  Bass  by  Meghan  Trainor.       CF  and  Prod2Vec  both  work!  
  • 26. Hard  case:               Query  song:  S/ll  by  Taylor  SwiL,  but  is  one  of  her  earlier  songs,   e.g.  You’re  Not  Sorry.     Best  next  song:  ?      ?  
  • 27. Hard  case  +  unlucky:     •  Just  one  user  listened  to  You’re  Not  Sorry   •  He  also  listened  to  Rammstein’s  Du  Hast!  
  • 28. Hard  case  +  unlucky:               Your  Recommenda5on  Is  Not  Working!  
  • 29. This  is  where  Meta-­‐Prod2Vec  comes  in   handy!  
  • 30. When  compu:ng  how  plausible  it  is  for  a   user  to  like  a  pair  of  songs,  you  can  place   addi5onal  constraints  by  taking  into   account  the  song  ar5sts.    
  • 31. Prod2Vec  constraints                   You’re  not  sorry   Du  Hast   P(Du  Hast|Youʹ′re  Not  Sorry)  -­‐>  the  next  song  depends  on  the  current   song  
  • 32. Prod2Vec  constraints                   You’re  not  sorry   Du  Hast   Youʹ′re  Not  Sorry  is  a  fringe  song  -­‐>  low  evidence  for  the  posi/ve  and   nega/ve  pairs    
  • 33. Ar5st  metadata  constraints                   You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   However,  the  associated  singer  is  popular  -­‐>  good  evidence  that  Taylor   SwiL  and  Rammstein  do  not  really  co-­‐occur  (have  distant  vectors)    
  • 34. Ar5st  and  Song  constraints  (1)                   You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   Furthermore,  we  can  enforce  that  the  songs  and  their  ar5sts  should  be   close...    
  • 35. Ar5st  and  Song  constraints  (2)               You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   Finally,  we  add  two  more  constraints  between  the  ar/sts  and  the   previous/next  song  (they  s/ll  have  more  support  than  the  original  pairs)  
  • 36. Meta-­‐Prod2Vec  constraints                   You’re  not  sorry   Du  Hast   Taylor  SwiU   Rammstein   #1.  P(Rammstein  |  Youʹ′re  Not  Sorry)   the  ar/st  of  the  next  song  should  be  plausible     given  the  current  song     #2.  P(Du  Hast  |  Taylor  SwiW)   the  next  song  should  depend  on  the     current  ar/st  selec/on     #3.  P(Youʹ′re  Not  Sorry  |Taylor  SwiW)     and  P(Du  Hast  |  Rammstein)     the  current  ar/st  selec/on  should  also  influence     the  current  song  selec/on     #4.  P(Rammstein  |  Taylor  SwiW)   the  probability  of  the  next  ar/st  should     be  high  given  the  current  ar/st.    
  • 37. PuXng  it  all  together:     Meta-­‐Prod2Vec  loss        
  • 38.   Rela5onship  with  MF  with  Side-­‐Info:    
  • 39. MP2V  Implementa5on     •  No  changes  in  the  Word2Vec  code!   •  Changes  just  in  the  input  pairs:  we  generate   (propor:onally  to  the  importance   hyperparameter)  4  addi:onal  types  of  pairs.  
  • 41.   Task  &  Metrics     Task:  Next  Event  Predic:on     Metrics:   •  Hit  ra:o  at  K  (HR@K)     •  Normalized  Discounted  Cumula:ve  Gain   (NDCG@K)    
  • 42.   Methods     BestOf:  (rank  by)  popularity   CoCounts:  cosine  similarity  of  candidate  item  to  query  item     Prod2Vec:  cosine  similarity  of  item  embedding  vectors   Meta-­‐Prod2Vec:  cosine  similarity  of  improved  embedding   vectors   Mix(Prod2Vec,  CoCounts):  linear  combina:on  of  the  two  scores   Mix(Meta-­‐Prod2Vec,  CoCounts):  same  as  previous  
  • 43.   Dataset:  30Music  Dataset     •  playlists  data  from  Last.fm  API   •  sample  of  100k  user  sessions     •  resul:ng  vocabulary  size:  433k  songs   and  67k  ar:sts.      
  • 44.   Global  Results     Method   Type   HR@20   NDCG@20   BestOf   Head   0.0003   0.002   CoCounts   Head   0.0160   0.141   Prod2Vec   Tail   0.0101   0.113   MetaProd2Vec   Tail   0.0124   0.125   Mix(Prod2Vec,  CoCounts)   Global   0.0158   0.152   Mix(MetaProd2Vec,  CoCounts)   Global   0.0180   0.161  
  • 45.   Results  on  Cold  Start  (HR@20)       Method   Type   Pair  freq  =  0   Pair  freq  <  3   BestOf   Head   0.0002   0.0002   CoCounts   Head   0.0000   0.0197   Prod2Vec   Tail   0.0003   0.0078   MetaProd2Vec   Tail   0.0013   0.0198   Mix(Prod2Vec,  CoCounts)   Global   0.0002   0.0200   Mix(MetaProd2Vec,  CoCounts)   Global   0.0007   0.0291  
  • 46. Conclusions  and     Next  Steps  
  • 47. Conclusions  and     Next  Steps     Using  side-­‐info  for  product  embeddings   helps,  especially  on  cold-­‐start.    
  • 48. Conclusions  and     Next  Steps   •  Beeer  ways  to  mix  Head  and  Tail   recommenda:on  methods   •  Mix  CF  and  Meta-­‐Data  at  test  :me    -­‐  product   embeddings  using  all  available  signal  (CF,   categorical,  text  and  image  product   informa:on)