The Shitposting AI With Thomas Endres & Jonas Mayer | Current 2022
•
0 gostou•390 visualizações
Using modern AI approaches such as GPT-2, Tacotron and Conformers, we created fully autonomous robot heads that engage in heated social media discussions, completely taking the human out of the loop. The TNG Innovation Hacking Team created a prototype of an end-to-end natural language understanding system, employing techniques such as Speech-to-Text (STT), Conditional Text Generation and Text-To-Speech (TTS). Social media comments have become the predominant medium for public discussion. However, discussions on Facebook, Twitter and Reddit are notorious for their poor debate culture and missing conclusiveness. The obvious solution to this tremendous waste of time is automation of such fruitless discussions using a bot. In this talk, we will give an introduction to NLP, focussing on the concepts of STT, Text Generation and TTS. Using live demos, we will guide you through the process of scraping social media comments, training a text generation model, synthesizing millions of voices and building IoT robot heads.
Recomendados
Recomendados
Mais conteúdo relacionado
Semelhante a The Shitposting AI With Thomas Endres & Jonas Mayer | Current 2022
Semelhante a The Shitposting AI With Thomas Endres & Jonas Mayer | Current 2022 (20)
Mais de HostedbyConfluent
Mais de HostedbyConfluent (20)
Último
Último (20)
The Shitposting AI With Thomas Endres & Jonas Mayer | Current 2022
- 1. An Ironic Solution to Fruitless Online Debate The The Shitposting Shitposting AI AI
- 2. Speakers Speakers Partner Thomas Endres Oracle® JavaOne Rockstar Intel® Black Belt Software Developer Intel® Software Innovator Intel® Top Innovator 2014 - 2019 Principal Consultant Martin Förtsch Oracle® JavaOne Rockstar Intel® Black Belt Software Developer Intel® Software Innovator Intel® Top Innovator 2014 - 2019 Software Consultant Jonas Mayer Bedroom DJ Teakwondo Black Belt GameStar Certified Hacker Intel® Software Innovator
- 3. Ernst von Oelsen Hannes Perrot Kai Guther Laura Jehn Leonard Husmann Ma hias Beuerle Sandro Bauer UVM! Shitposting Team TNG Innovation Hacking TNG Innovation Hacking ●
- 4. Learn Motivate Just Because Why? Innovation Hacking Innovation Hacking
- 5. Going Public Innovation Hacking Innovation Hacking ●
- 6. Going Public Innovation Hacking Innovation Hacking ●
- 7. Going Public Innovation Hacking Innovation Hacking ●
- 8. ...and bearing the consequences Innovation Hacking Innovation Hacking
- 9. A Typical Shitpost Innovation Hacking Innovation Hacking ●
- 10. Our Typical Reaction Innovation Hacking Innovation Hacking ●
- 11. The Shitposting Circle Jerk How online discussion works How online discussion works ●
- 12. The Jonas Simulator (2020) First Automization Experiments First Automization Experiments ●
- 13. Automate Reply Generation with AI First Idea First Idea ●
- 14. A Huge Waste of Human Resources This is a global problem This is a global problem ●
- 15. Industrial Revolution Inspiration from History Inspiration from History ●
- 16. Taking the Human out of the Loop The Solution: The Shitposting AI The Solution: The Shitposting AI ●
- 17. Rehumanizing the AI Discussion Robot Heads Robot Heads ●
- 18. Agenda Agenda Introduction Generating Social Media Comments Creating Human Voices Building Robot Heads Putting it all together
- 19. NLP-Powered Robot Discussions What is this all about? What is this all about? ▲
- 20. What is NLP? NLP in a nutshell NLP in a nutshell ▲
- 21. NLP is everywhere! NLP in a nutshell NLP in a nutshell ▲
- 22. Automatic Summarization NLP in a nutshell NLP in a nutshell ▲
- 23. Sentiment Analysis NLP in a nutshell NLP in a nutshell ▲
- 24. The Biological Neuron By BruceBlaus - Own work, CC BY 3.0, h ps:/ /commons.wikimedia.org/w/index.php?curid=28761830 Original by en:User:Chris 73, updated by en:User:Diberri, converted to SVG by Zom - Own work, CC BY-SA 3.0 Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 25. The Artificial Neuron axon from a neuron dendrite output axon f ω0x0 x0 ω0x0 + b f(ω0x0 + b) synapse activation function Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 26. Neural Cell Activation activate bias sum weight ω=0.7 ω=1.4 ω=0.3 f f(u) = max(0, u) u Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 27. Turning text into numbers: Tokenization Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 28. Byte-Pair Tokenizer Demo Input Please start the demo! Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 29. A Neural Network Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 30. A Neural Network Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 31. A Neural Network Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 32. Easy Right? Neural Networks in a Nutshell Neural Networks in a Nutshell ▲
- 33. Neural Networks think in Distances Neural Networks in a Nutshell Neural Networks in a Nutshell ■
- 34. Neural Networks think in Distances Neural Networks in a Nutshell Neural Networks in a Nutshell ■
- 35. Neural Networks think in Distances Neural Networks in a Nutshell Neural Networks in a Nutshell ■
- 36. Neural Networks think in Distances Neural Networks in a Nutshell Neural Networks in a Nutshell ■
- 37. Agenda Agenda Introduction Generating Social Media Comments Creating Human Voices Building Robot Heads Putting it all together
- 38. Overview Generating Social Media Comments Generating Social Media Comments ■
- 39. OpenAI GPT Generating Social Media Comments Generating Social Media Comments ■
- 40. Generative Pretrained Transformer Generating Social Media Comments Generating Social Media Comments ■
- 41. GPT Demo Input Please start the demo! Generating Social Media Comments Generating Social Media Comments ■
- 42. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 43. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 44. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 45. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 46. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 47. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 48. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 49. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 50. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 51. Next Word Prediction Generating Social Media Comments Generating Social Media Comments ■
- 52. GPT Architecture Generating Social Media Comments Generating Social Media Comments ●
- 53. Masked Self-Attention Generating Social Media Comments Generating Social Media Comments ●
- 54. Masked Self-Attention Generating Social Media Comments Generating Social Media Comments ●
- 55. Masked Self-Attention Generating Social Media Comments Generating Social Media Comments ●
- 56. Masked Self-Attention Generating Social Media Comments Generating Social Media Comments ●
- 57. Masked Self-Attention Generating Social Media Comments Generating Social Media Comments ●
- 58. Masked Self-Attention Generating Social Media Comments Generating Social Media Comments ●
- 59. Decoder Layer Generating Social Media Comments Generating Social Media Comments ●
- 60. GPT in Detail Generating Social Media Comments Generating Social Media Comments ●
- 61. Training GPT Generating Social Media Comments Generating Social Media Comments ▲
- 62. Training GPT Generating Social Media Comments Generating Social Media Comments ▲
- 63. Training GPT Generating Social Media Comments Generating Social Media Comments ▲
- 64. Training GPT Generating Social Media Comments Generating Social Media Comments ▲
- 65. Training GPT Generating Social Media Comments Generating Social Media Comments ▲
- 66. Choosing a Model Generating Social Media Comments Generating Social Media Comments ▲
- 67. GPT-2 Sizes Generating Social Media Comments Generating Social Media Comments ▲
- 68. Training Data Generating Social Media Comments Generating Social Media Comments ▲
- 69. Choosing a Platform Collecting a Comment Dataset Collecting a Comment Dataset ■
- 70. Python Reddit API Wrapper Collecting a Comment Dataset Collecting a Comment Dataset ■ import praw reddit = praw.Reddit("user") subreddit = reddit.subreddit("all") for submission in subreddit.top("day", limit=None): comments = submission.comments.list()
- 71. Twitter API Collecting a Comment Dataset Collecting a Comment Dataset ■ import searchtweets root_tweet = self.search_for_root_tweet(keyword) query = searchtweets.gen_request_parameters(f"conversation_id results = searchtweets.ResultStream(request_parameters=query, for page in result.stream(): tweets = page['data']
- 72. A Typical Social Media Thread Collecting a Comment Dataset Collecting a Comment Dataset ■
- 73. But we Need a Text File! Collecting a Comment Dataset Collecting a Comment Dataset ■
- 74. Converting Threads to Text Files Collecting a Comment Dataset Collecting a Comment Dataset ■
- 75. Continuous Trainer Collecting a Comment Dataset Collecting a Comment Dataset ■
- 76. Continuous Trainer Collecting a Comment Dataset Collecting a Comment Dataset ■
- 77. Continuous Trainer Collecting a Comment Dataset Collecting a Comment Dataset ■
- 78. Comments Generator Demo Input Please start the demo! Generating Social Media Comments Generating Social Media Comments ■
- 79. Agenda Agenda Introduction Generating Social Media Comments Creating Human Voices Building Robot Heads Putting it all together
- 81. Overview Creating Human Voices Creating Human Voices ●
- 82. Text to Speech: A known Problem Creating Human Voices Creating Human Voices ●
- 83. Tacotron Creating Human Voices Creating Human Voices ●
- 84. Tacotron Creating Human Voices Creating Human Voices ●
- 85. Tacotron 2 (2017) Audio Deepfakes Audio Deepfakes ●
- 86. Multispeaker Tacotron Creating Human Voices Creating Human Voices ●
- 87. Demo Multispeaker Creating Human Voices Creating Human Voices
- 88. CoquiAI 🐸GlowTTS Creating Human Voices Creating Human Voices
- 89. Agenda Agenda Introduction Generating Social Media Comments Creating Human Voices Building Robot Heads Putting it all together
- 90. Overview Building Robot Heads Building Robot Heads
- 91. We're Pretty Experienced with Robots Building Robot Heads Building Robot Heads
- 92. Hardware Setup Building Robot Heads Building Robot Heads
- 93. Head Chassis Building Robot Heads Building Robot Heads
- 94. Electronics Mount Building Robot Heads Building Robot Heads
- 95. Electronics Mount Building Robot Heads Building Robot Heads
- 96. Hardware Hacking at it's Finest! Building Robot Heads Building Robot Heads
- 97. Expectation Building Robot Heads Building Robot Heads
- 98. Reality Building Robot Heads Building Robot Heads
- 99. Agenda Agenda Introduction Generating Social Media Comments Creating Human Voices Building Robot Heads Putting it all together
- 100. Overview Putting it all together Putting it all together
- 101. Overview Putting it all together Putting it all together
- 102. Overview Putting it all together Putting it all together
- 103. Overview Putting it all together Putting it all together
- 104. NLP Has Huge GPU Requirements Putting it all together Putting it all together
- 105. Client-Server Architecture Putting it all together Putting it all together
- 106. Client-Server Architecture Putting it all together Putting it all together
- 107. Client-Server Architecture Putting it all together Putting it all together
- 108. Client-Server Architecture Putting it all together Putting it all together
- 109. Client-Server Architecture Putting it all together Putting it all together
- 110. Client-Server Architecture Putting it all together Putting it all together
- 111. Client-Server Architecture Putting it all together Putting it all together
- 112. Client-Server Architecture Putting it all together Putting it all together
- 113. Client-Server Architecture Putting it all together Putting it all together
- 114. Full Robot Discussion Demo Putting it all together Putting it all together
- 115. We Solved The Biggest Problem of the 21st Century Summary Summary
- 116. Let User Interact with Robot Heads Future Work Future Work
- 117. Partner Thomas Endres Oracle® JavaOne Rockstar Intel® Black Belt Software Developer Intel® Software Innovator Intel® Top Innovator 2014 - 2018 Principal Consultant Martin Förtsch Oracle® JavaOne Rockstar Intel® Black Belt Software Developer Intel® Software Innovator Intel® Top Innovator 2014 - 2018 Software Consultant Jonas Mayer Bedroom DJ Teakwondo Black Belt GameStar Certified Hacker Intel® Software Innovator Speakers Speakers