SlideShare a Scribd company logo
1 of 10
Download to read offline
Empowering Conversational Agents with Situated Natural Language
Communication Skills by Exploiting Deep Reinforcement Learning
Techniques
Alessandro Suglia
Heriot-Watt University, Edinburgh Centre for
Robotics, Edinburgh, Scotland, UK
D o c t o ra l C o n s o r t i u m A I * I A 2 0 1 7 , B a r i
Supervisor: Prof. Oliver Lemon
Director of the Interaction Lab,
Heriot-Watt University
Dynamic Temporal Contextualized
The answer provided
by one of the
interlocutor affects
the state of the
dialogue
What is dialogue?
The interpretation of
each utterance
depends incredibly on
different environment
conditions
Different topics are
discussed in a given
conversation without
a specific order
[1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven methodology
for dialogue management and natural language generation. Springer Science & Business Media, 2011.
Goal-directed learning from interaction with an
environment by learning to map situations to actions
by exploiting Deep Neural Networks models
Deep Reinforcement Learning
Deep Reinforcement Learning
Successfully applied to different games such as Go [2] or Poker [3]
Incrementally abstract representations learned from training data
Learning to behave by interacting with the environment
Learning in an incremental and online fashion
Inability to generalise due to the domain specific design
Handsome quantity of data required to effectively learn a policy
[2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I.,
Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural networks and tree search. Nature
529(7587) (2016) 484–489
[3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv preprint arXiv:
1701.01724 (2017).
RQ1 : Is it possible to train a conversational agent to interact
within real world contexts consisting of embodied agents and
situated objects?
RQ2: Is it possible to train a conversational agent to generate
accurate contextualized responses for the user?
RQ3: Is the system able to adapt seemly to different domains by
exploiting what it has previously learned?
Natural Language
interaction
Multi-modal
interaction
Agent
embodiment
Thanks!
You can find me at the poster session
@ale_suglia
as247@hw.ac.uk
Any questions?
References
[1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven
methodology for dialogue management and natural language generation. Springer Science &
Business Media, 2011.
[2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J.,
Antonoglou, I., Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural
networks and tree search. Nature 529(7587) (2016) 484–489
[3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv
preprint arXiv:1701.01724 (2017).

More Related Content

Similar to Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques

Engineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worldsEngineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worldsMichael Vallance
 
No.257 miaomiao ding-erc poster
No.257  miaomiao ding-erc posterNo.257  miaomiao ding-erc poster
No.257 miaomiao ding-erc poster苗苗 丁
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processingpunedevscom
 
11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...Alexander Decker
 
Language and Intelligence
Language and IntelligenceLanguage and Intelligence
Language and Intelligencebutest
 
Rise of AI through DL
Rise of AI through DLRise of AI through DL
Rise of AI through DLRehan Guha
 
Do We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ HarvardDo We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ HarvardHumanity Plus
 
Timo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and MachinesTimo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and MachinesTimo Honkela
 
An Overview Of Natural Language Processing
An Overview Of Natural Language ProcessingAn Overview Of Natural Language Processing
An Overview Of Natural Language ProcessingScott Faria
 
how humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign languagehow humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign languageEstefy Feijoo
 
David Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualismDavid Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualismPilar Torres
 
Russian english workshop world-call2013
Russian english workshop world-call2013Russian english workshop world-call2013
Russian english workshop world-call2013Konstantin Shestakov
 
Teoria suunnittelu a_otvt
Teoria suunnittelu a_otvtTeoria suunnittelu a_otvt
Teoria suunnittelu a_otvtJari Laru
 
A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...Scott Bou
 
A Survey on Word Sense Disambiguation
A Survey on Word Sense DisambiguationA Survey on Word Sense Disambiguation
A Survey on Word Sense DisambiguationIOSR Journals
 
Eurocall 2011, Nottingham
Eurocall 2011, NottinghamEurocall 2011, Nottingham
Eurocall 2011, Nottinghamelinatapio
 
CLaSIC 2016 presentation
CLaSIC 2016 presentationCLaSIC 2016 presentation
CLaSIC 2016 presentationTakeshi Sato
 
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...paperpublications3
 

Similar to Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques (20)

Engineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worldsEngineering active learning: LEGO robots & 3D virtual worlds
Engineering active learning: LEGO robots & 3D virtual worlds
 
No.257 miaomiao ding-erc poster
No.257  miaomiao ding-erc posterNo.257  miaomiao ding-erc poster
No.257 miaomiao ding-erc poster
 
Natural Language Processing
Natural Language ProcessingNatural Language Processing
Natural Language Processing
 
11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...11.the theoretician and the practitioner represent a language community or it...
11.the theoretician and the practitioner represent a language community or it...
 
Language and Intelligence
Language and IntelligenceLanguage and Intelligence
Language and Intelligence
 
Rise of AI through DL
Rise of AI through DLRise of AI through DL
Rise of AI through DL
 
Do We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ HarvardDo We Click? - Laurent Silbert - H+ Summit @ Harvard
Do We Click? - Laurent Silbert - H+ Summit @ Harvard
 
Timo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and MachinesTimo Honkela: Multimodally Grounded Translation by Humans and Machines
Timo Honkela: Multimodally Grounded Translation by Humans and Machines
 
An Overview Of Natural Language Processing
An Overview Of Natural Language ProcessingAn Overview Of Natural Language Processing
An Overview Of Natural Language Processing
 
SLALS526_MUVEs
SLALS526_MUVEsSLALS526_MUVEs
SLALS526_MUVEs
 
how humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign languagehow humans learn in general and how they learn a foreign language
how humans learn in general and how they learn a foreign language
 
David Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualismDavid Marsh: Benefits of bilingualism
David Marsh: Benefits of bilingualism
 
Russian english workshop world-call2013
Russian english workshop world-call2013Russian english workshop world-call2013
Russian english workshop world-call2013
 
Teoria suunnittelu a_otvt
Teoria suunnittelu a_otvtTeoria suunnittelu a_otvt
Teoria suunnittelu a_otvt
 
A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...A Comprehensive Study On Natural Language Processing And Natural Language Int...
A Comprehensive Study On Natural Language Processing And Natural Language Int...
 
A Survey on Word Sense Disambiguation
A Survey on Word Sense DisambiguationA Survey on Word Sense Disambiguation
A Survey on Word Sense Disambiguation
 
Eurocall 2011, Nottingham
Eurocall 2011, NottinghamEurocall 2011, Nottingham
Eurocall 2011, Nottingham
 
CLaSIC 2016 presentation
CLaSIC 2016 presentationCLaSIC 2016 presentation
CLaSIC 2016 presentation
 
Using ontology for natural language processing
Using ontology for natural language processingUsing ontology for natural language processing
Using ontology for natural language processing
 
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
LANGUAGE ASSIMILATION THROUGH TYPE-2 FUZZY GRAMMARS: AN APPLICATION IN COMPUT...
 

Recently uploaded

Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...amitlee9823
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...SUHANI PANDEY
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightDelhi Call girls
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsJoseMangaJr1
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxolyaivanovalion
 
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night StandCall Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
hybrid Seed Production In Chilli & Capsicum.pptx
hybrid Seed Production In Chilli & Capsicum.pptxhybrid Seed Production In Chilli & Capsicum.pptx
hybrid Seed Production In Chilli & Capsicum.pptx9to5mart
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Researchmichael115558
 
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24  Building Real-Time Pipelines With FLaNKDATA SUMMIT 24  Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNKTimothy Spann
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...amitlee9823
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...amitlee9823
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...amitlee9823
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...amitlee9823
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...amitlee9823
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...amitlee9823
 

Recently uploaded (20)

Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Hsr Layout ☎ 7737669865 🥵 Book Your One night Stand
 
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night StandCall Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Nandini Layout ☎ 7737669865 🥵 Book Your One night Stand
 
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men  🔝Dindigul🔝   Escor...
➥🔝 7737669865 🔝▻ Dindigul Call-girls in Women Seeking Men 🔝Dindigul🔝 Escor...
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 nightCheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
Cheap Rate Call girls Sarita Vihar Delhi 9205541914 shot 1500 night
 
Probability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter LessonsProbability Grade 10 Third Quarter Lessons
Probability Grade 10 Third Quarter Lessons
 
Midocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFxMidocean dropshipping via API with DroFx
Midocean dropshipping via API with DroFx
 
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night StandCall Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Attibele ☎ 7737669865 🥵 Book Your One night Stand
 
hybrid Seed Production In Chilli & Capsicum.pptx
hybrid Seed Production In Chilli & Capsicum.pptxhybrid Seed Production In Chilli & Capsicum.pptx
hybrid Seed Production In Chilli & Capsicum.pptx
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24  Building Real-Time Pipelines With FLaNKDATA SUMMIT 24  Building Real-Time Pipelines With FLaNK
DATA SUMMIT 24 Building Real-Time Pipelines With FLaNK
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
Call Girls Bannerghatta Road Just Call 👗 7737669865 👗 Top Class Call Girl Ser...
 
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men  🔝Mathura🔝   Escorts...
➥🔝 7737669865 🔝▻ Mathura Call-girls in Women Seeking Men 🔝Mathura🔝 Escorts...
 
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
Call Girls Hsr Layout Just Call 👗 7737669865 👗 Top Class Call Girl Service Ba...
 
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
Escorts Service Kumaraswamy Layout ☎ 7737669865☎ Book Your One night Stand (B...
 
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts ServiceCall Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service
 
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Rabindra Nagar  (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Rabindra Nagar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 

Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques

  • 1. Empowering Conversational Agents with Situated Natural Language Communication Skills by Exploiting Deep Reinforcement Learning Techniques Alessandro Suglia Heriot-Watt University, Edinburgh Centre for Robotics, Edinburgh, Scotland, UK D o c t o ra l C o n s o r t i u m A I * I A 2 0 1 7 , B a r i Supervisor: Prof. Oliver Lemon Director of the Interaction Lab, Heriot-Watt University
  • 2. Dynamic Temporal Contextualized The answer provided by one of the interlocutor affects the state of the dialogue What is dialogue? The interpretation of each utterance depends incredibly on different environment conditions Different topics are discussed in a given conversation without a specific order [1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven methodology for dialogue management and natural language generation. Springer Science & Business Media, 2011.
  • 3. Goal-directed learning from interaction with an environment by learning to map situations to actions by exploiting Deep Neural Networks models Deep Reinforcement Learning
  • 4. Deep Reinforcement Learning Successfully applied to different games such as Go [2] or Poker [3] Incrementally abstract representations learned from training data Learning to behave by interacting with the environment Learning in an incremental and online fashion Inability to generalise due to the domain specific design Handsome quantity of data required to effectively learn a policy [2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural networks and tree search. Nature 529(7587) (2016) 484–489 [3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv preprint arXiv: 1701.01724 (2017).
  • 5. RQ1 : Is it possible to train a conversational agent to interact within real world contexts consisting of embodied agents and situated objects?
  • 6. RQ2: Is it possible to train a conversational agent to generate accurate contextualized responses for the user?
  • 7. RQ3: Is the system able to adapt seemly to different domains by exploiting what it has previously learned?
  • 9. Thanks! You can find me at the poster session @ale_suglia as247@hw.ac.uk Any questions?
  • 10. References [1]: Rieser, V., and O. Lemon. Reinforcement learning for adaptive dialogue systems: a data-driven methodology for dialogue management and natural language generation. Springer Science & Business Media, 2011. [2]: Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., Van Den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., et al.: Mastering the game of Go with deep neural networks and tree search. Nature 529(7587) (2016) 484–489 [3]: Moravčík, Matej, et al. "Deepstack: Expert-level artificial intelligence in no-limit poker." arXiv preprint arXiv:1701.01724 (2017).