1. The Future of AI:
Open Technology, Innovation,
and Service System Evolution
Jim Spohrer (IBM)
UCLA BIT Conference, Los Angeles, CA July 19, 2018
http://slideshare.net/spohrer/future-of-ai-20180619-v9
7/19/2018 IBM Code #OpenTechAI 1
2. Today’s talk
• AI at the peak of the hype cycle
• What’s really going on?
• Part 1: Solving AI
• Roadmap and Implications
• Open Technologies, Innovation
• Part 2: Service System Evolution
• Better Building Blocks
• Trust and Resilience
7/19/2018 IBM Code #OpenTechAI 2
4. Smartphones pass entrance exams? When?
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 4
… when will
your smartphone
be able to take and
pass any online
course? And then
be your coach, so
you can pass too?
5. IBM-MIT $240M
over 10 year AI mission
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 5
7. Questions
• What is the timeline for solving AI and IA?
• Who are the leaders driving AI progress?
• What will the biggest benefits from AI be?
• What are the biggest risks associated with AI, and are they real?
• What other technologies may have a bigger impact than AI?
• What are the implications for stakeholders?
• How should we prepare to get the benefits and avoid the risks?
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 7
9. Timeline: Every 20 years,
compute costs are down by 1000x
• Cost of Digital Workers
• Moore’s Law can be thought of as
lowering costs by a factor of a…
• Thousand times lower
in 20 years
• Million times lower
in 40 years
• Billion times lower
in 60 years
• Smarter Tools (Terascale)
• Terascale (2017) = $3K
• Terascale (2020) = ~$1K
• Narrow Worker (Petascale)
• Recognition (Fast)
• Petascale (2040) = ~$1K
• Broad Worker (Exascale)
• Reasoning (Slow)
• Exascale (2060) = ~$1K
97/19/2018 (c) IBM 2017, Cognitive Opentech Group
2080204020001960
$1K
$1M
$1B
$1T
206020201980
+/- 10 years
$1
Person Average
Annual Salary
(Living Income)
Super Computer
Cost
Mainframe Cost
Smartphone Cost
T
P
E
T P E
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
10. Timeline: GDP/Employee
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 10
(Source)
Lower compute costs translate into increasing productivity and GDP/employees for nations
Increasing productivity and GDP/employees should translate into wealthier citizens
AI Progress on Open Leaderboards
Benchmark Roadmap to solve AI/IA
11. Timeline: Leaderboards Framework
AI Progress on Open Leaderboards - Benchmark Roadmap
Perceive World Develop Cognition Build Relationships Fill Roles
Pattern
recognition
Video
understanding
Memory Reasoning Social
interactions
Fluent
conversation
Assistant &
Collaborator
Coach &
Mediator
Speech Actions Declarative Deduction Scripts Speech Acts Tasks Institutions
Chime Thumos SQuAD SAT ROC Story ConvAI
Images Context Episodic Induction Plans Intentions Summarizatio
n
Values
ImageNet VQA DSTC RALI General-AI
Translation Narration Dynamic Abductive Goals Cultures Debate Negotiation
WMT DeepVideo Alexa Prize ICCMA AT
Learning from Labeled Training Data and Searching (Optimization)
Learning by Watching and Reading (Education)
Learning by Doing and being Responsible (Exploration)
2015 2018 2021 2024 2027 2030 2033 2036
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 11
Which experts would be really surprised if it takes less time… and which experts really surprised if it takes longer?
Approx.
Year
Human
Level ->
12. Leaders and Leaderboards:
Who is winning
• How to Measure Leadership?
• Publications or Patents
• Regions China vs USA vs EU vs ROW
• Companies Microsoft vs Google vs IBM
• How to Measure Progress?
• One capability or all leaderboards?
• SQuAD – Question Answering
• EFF Measuring AI Progress
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 12
13. AI Benefits
• Access to expertise
• “Insanely great” labor productivity for trusted service providers
• Digital workers for healthcare, education, finance, etc.
• Better choices
• ”Insanely great” collaborations with others on what matters most
• AI for IA = Augmented Intelligence and higher value co-creation interactions
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 13
14. AI Risks
• Job Loss
• Shorter term
bigger risk
= de-skilling
• Super-intelligence
• Shorter term
bigger risk
= bad actors
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 14
https://maliciousaireport.com/
https://www.wsj.com/articles/automation-makes-us-dumb-1416589342
15. Huang and Rust, JSR
• test
7/19/2018 IBM Code #OpenTechAI 15
16. Robots by Country
• Industrial robots per
10,000 people by country
7/19/2018 IBM #OpenTechAI 16
19. Brian Arthur - Economist
• The term “technological unemployment” is from John Maynard Keynes’s 1930 lecture,
“Economic possibilities for our grandchildren,” where he predicted that in the future, around
2030, the production problem would be solved and there would be enough for everyone, but
machines (robots, he thought) would cause “technological unemployment.” There would be
plenty to go around, but the means of getting a share in it, jobs, might be scarce. We are not quite
at 2030, but I believe we have reached the “Keynes point,” where indeed enough is produced by
the economy, both physical and virtual, for all of us. (If total US household income of $8.495
trillion were shared by America’s 116 million households, each would earn $73,000, enough for
a decent middle-class life.) And we have reached a point where technological unemployment is
becoming a reality. The problem in this new phase we’ve entered is not quite jobs, it is access to
what’s produced. Jobs have been the main means of access for only 200 or 300 years. Before
that, farm labor, small craft workshops, voluntary piecework, or inherited wealth provided access.
Now access needs to change again. However this happens, we have entered a different phase for
the economy, a new era where production matters less and what matters more is access to that
production: distribution, in other words—who gets what and how they get it. We have entered
the distributive era.
7/19/2018 IBM #OpenTechAI 19
20. Other Technologies: Bigger impact? Yes.
• Augmented Reality (AR)/
Virtual Reality (VR)
• Game worlds
grow-up
• Blockchain/
Security Systems
• Trust and security
immutable
• Advanced Materials/
Energy Systems
• Manufacturing as cheap,
local recycling service
(utility fog, artificial leaf, etc.)
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 20
21. Artificial Leaf
• Daniel Nocera, a professor of energy
science at Harvard who pioneered the
use of artificial photosynthesis, says that
he and his colleague Pamela Silver have
devised a system that completes the
process of making liquid fuel from
sunlight, carbon dioxide, and water. And
they’ve done it at an efficiency of 10
percent, using pure carbon dioxide—in
other words, one-tenth of the energy in
sunlight is captured and turned into fuel.
That is much higher than natural
photosynthesis, which converts about 1
percent of solar energy into the
carbohydrates used by plants, and it
could be a milestone in the shift away
from fossil fuels. The new system is
described in a new paper in Science.
7/19/2018 IBM Code #OpenTechAI 21
22. Food from Air
• Although the technology is in its infancy,
researchers hope the "protein reactor"
could become a household item.
• Juha-Pekka Pitkänen, a scientist at VTT,
said: "In practice, all the raw materials
are available from the air. In the future,
the technology can be transported to,
for instance, deserts and other areas
facing famine.
• "One possible alternative is a home
reactor, a type of domestic appliance
that the consumer can use to produce
the needed protein."
• According to the researchers, the
process of creating food from electricity
can be nearly 10 times as energy
efficient as photosynthesis, the process
used by plants.
7/19/2018 IBM Code #OpenTechAI 22
23. Exoskeletons for Elderly
• A walker is a “very cost-effective”
solution for people with limited
mobility, but “it completely
disempowers, removes dignity,
removes freedom, and causes a
whole host of other psychological
problems,” SRI Ventures president
Manish Kothari says. “Superflex’s
goal is to remove all of those areas
that cause psychological-type
encumbrances and, ultimately,
redignify the individual."
7/19/2018 IBM Code #OpenTechAI 23
24. Stakeholders
• Individuals
• Families
• Businesses and
other Organizations
• Industry Groups
• Regional
Governments:
• Cities
• States
• Nations
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 24
25. “The best way to predict the future is to inspire the
next generation of students to build it better”
Digital Natives Transportation Water Manufacturing
Energy Construction ICT Retail
Finance Healthcare Education Government
26. Be Prepared
• Understand open AI code + data +
models + stacks + communities
• Leaderboards
• Ethical conduct
• Learn 3 R’s of IBM’s Cognitive
Opentech Group (COG)
• Read arXiv
• Redo with Github
• Report with Jupyter notebooks on
DSX and/or leaderboards
• Improve your team’s skills of rapidly
rebuilding from scratch
• Build your open code eminence
• Understand open innovation
• Communities + Leaderboards
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 26
1972 used
Punch cards
2016 used
IBM Watson
Open APIs to win…
28. Courses
• 2015
• “How to build a cognitive system for Q&A task.”
• 9 months to 40% question answering accuracy
• 1-2 years for 90% accuracy, which questions to reject
• 2025
• “How to use a cognitive system to be a better professional X.”
• Tools to build a student level Q&A from textbook in 1 week
• 2035
• “How to use your cognitive mediator to build a startup.”
• Tools to build faculty level Q&A for textbook in one day
• Cognitive mediator knows a person better than they know themselves
• 2055
• “How to manage your workforce of digital workers.”
• Most people have 100 digital workers.
7/19/2018 28
Take free online cognitive classes today at cognitiveclass.ai
30. Step Comment
GitHub Get an account and read the guide
Learn 3 R's - Read, Redo, Report Read (Medium/arXiv), Redo (GitHub), Report (Jupyter Notebook)
Kaggle Compete in a Kaggle competition
Leaderboards Compete to advance AI progress
Figure Eight Generate a set of labeled data (also Mechanical Turk)
Design New Challenges build an AI system that can take and pass any online course, then
switch to tutor-mode and help you pass
Open Source Guide Establish open source culture in your organization
7/19/2018 IBM Code #OpenTechAI 30
41. Cupertino Teens
• IBM Watson on Bluemix
7/19/2018 (c) IBM 2017, Cognitive Opentech Group 41
AI for NLP
entity identification
42. Build: 10 million minutes of experience
7/19/2018 Understanding Cognitive Systems 42
43. Build: 2 million minutes of experience
7/19/2018 Understanding Cognitive Systems 43
44. Hardware < Software < Data < Experience < Transformation
7/19/2018 Understanding Cognitive Systems 44
Value migrates
Pine & Gilmore (1999)
Transformation
Roy et al (2006)
Data
Osati (2014)
Experience
Life Log
49. Trust: Two Communities
7/19/2018 IBM Code #OpenTechAI 49
Service
Science
OpenTech
AI
Trust:
Value Co-Creation,
Transdisciplinary
Trust:
Ethical, Safe, Explainable,
Open Communities
Special Issue
AI Magazine?
Handbook of
OpenTech AI?
50. Resilience:
Rapidly Rebuilding From Scratch
• Dartnell L (2012) The Knowledge: How to
Rebuild Civilization in the Aftermath of a
Cataclysm. Westminster London: Penguin
Books.
7/19/2018 IBM Code #OpenTechAI 50
Please reuse –spohrer@us.ibm.com
Reference:
Spohrer, J (2018) The Future of AI: Open Technology, Innovation, and Service System Evolution. UCAL BIT Conference. Los Angeles, CA. Thursday July 19, 2018 URL Slides: http://slideshare.net/spohrer/future-of-ai-20180719-v9
Uday asked for: The topic could be anything to do with services, technology, innovation and evolution. Would be great if you could convey your vision of where things are going with services, as well as the critical role of technology (esp. AI and “cogs” and their disruptive potential for knowledge intensive services). But of course, the content is up to you.Title: The Future of AI: Open Technology, Innovation, and Service System EvolutionSpeakers: Jim Spohrer, Director, IBM Cognitive OpenTech Group Abstract: AI is driving service system evolution, and open technology and innovation is playing a key role. AI is at the peak of the hype-cycle, so this talk begins by providing an outline and rationale for the twenty-year roadmap for solving AI. The roadmap makes use of open source AI leaderboards sequenced in order of complexity, with links to articles that surveys experts on AI capability timelines. Smart phone apps are evolving into low-cost digital workers over the next two decades, providing a miniature expert service economy in the palm of your hand. As costs drop, there will be more parallel entrepreneurs, for sure, but not that many more. Businesses, universities, governments all still around with lots of employees. Because human nature changes slowly, things don't really change that much in terms of how hard we work to attain quality-of-life for our families, which is the core service system. In sum, no utopia, no dystopia, just good and bad things happening, and people muddling along. Bio: Jim Spohrer directs IBM’s open source Artificial Intelligence (AI) efforts. Previously at IBM, he led Global University Programs, co-founded Almaden Service Research, and was CTO Venture Capital Group. After his MIT BS in Physics, he developed speech recognition systems at Verbex, an Exxon company, before receiving his Yale PhD in Computer Science/Artificial Intelligence. In the 1990’s, he attained Apple Computers’ Distinguished Engineer Scientist and Technology title for next generation learning platforms. With over ninety publications and nine patents, he won the Gummesson Service Research award, Vargo and Lusch Service-Dominant Logic award, and a PICMET Fellow for advancing service science.Online Sample Downloadable Presentations: Future of AI: https://www.slideshare.net/spohrer/germany-20180424-v8 OpenTechAI: https://www.slideshare.net/spohrer/open-techai-20180429-v1Online Short Bio: Jim Spohrer: http://service-science.info/archives/2233 Linkiedin: https://www.linkedin.com/in/spohrer/
1950 Nathaniel Rochester (IBM) 701 first commercial computer that did super-human levels of numeric calculations routinely. He worked at MIT on arithmetic unit of WhirlWind I programmable computer.
Dota 2 is most recent August 11, 2017 as a super-human game player in Valve Dota 2 competition – Elon Musk’s OpenAI result.
Miles Bundage tracks gaming progress: http://www.milesbrundage.com/blog-posts/my-ai-forecasts-past-present-and-future-main-post
DOTA2: https://blog.openai.com/more-on-dota-2/
What is beyond Exascale? Zetta (21), Yotta (24)
Time dimension (x-axis) is plus or minus 10 years….
Daniel Pakkala (VTT)
URL: https://aiimpacts.org/preliminary-prices-for-human-level-hardware/
Dan Gruhl:
https://www.washingtonpost.com/archive/business/1983/11/06/in-pursuit-of-the-10-gigaflop-machine/012c995a-2b16-470b-96df-d823c245306e/?utm_term=.d4bde5652826
In 1983 10 GF was ~10 million.
That's 24.55 million in today's dollars.
or 2.4 billion for 1 TF in 1983
Today 1 TF is about $3k http://www.popsci.com/intel-teraflop-chip
ROW – Rest of World
Who is winning: https://www.technologyreview.com/s/608112/who-is-winning-the-ai-race/
Leaderboards and reproducibility:
Hugo Larochelle (Google Brain) (@hugo_larochelle) 8/21/17, 7:36 AM
My slides for my talk at ICML 2017 Reproducibility Workshop, on incentives for open source and on open research:
https://drive.google.com/file/d/0B8lLzpxgRHNQZ0paZWQ0cTcxMlNYYnc0TnpHekMxMjVBckVR/view
Slide 20: Conclusions: "Open source is the key to better reproducibility"
The nature of reality changes when there is more than one intelligent species, and we are not the smartest.
The nature of reality also changes when the cost of exploring alternate experience pathways are made less risky – the notions of time and identity changes as a result.
Mitigate risks and harvest benefits of existence, by learning to evermore efficiently and rapidly rebuild from scratch to higher states of value and capability of entities.
The evolving ecology of service system entities their value co-creation and capability co-elevation mechanisms, as well as their capabilities, constraints, rights, and responsibilities at each stage in time. Human progress as well as the development of individuals, and the arc of institutions can be viewed in this way. Entities exist as individuals and populations. Generations of entities, generations of species (populations), generations of individuals (cohorts).
By 2036, there will be an accumulation of knowledge as well as a distribution of knowledge in service systems globally. We need to ensure as there is knowledge accumulation that service systems at all scale become more resilient. Leading to the capability of rapid rebuilding of service systems across scales, by T-shaped people who understand how to rapidly rebuild – knowledge has been chunked, modularized, and put into networks that support rapid rebuilding.
IBM’s approach to open technologies: URL https://www.ibm.com/developerworks/cloud/library/cl-open-architecture-update/index.html
The weakest link is what needs to be improved – according to system scientists. Accessing help, service, experts is the weakest link in most systems.
By 2035 the phone may have the power of one human brain – by 2055 the phone may have the power of all human brains.
Before trying to answer the question about which types of sciences are more important – the ones that try to explain the external world or the ones that try to explain the internal world – consider this, slide that shows the different telephones that I have used in my life. I grew up in rural Maine, where we had a party line telephone because we were somewhat remote on our farm in Newburgh, Maine.
However, over the years phones got much better…. So in 2035 or 2055, who are you going to call when you need help?
Free online cognitive classe URL: https://cognitiveclass.ai/
Here is what I tell students....
... to try to provoke their thinking about the cognitive era:
(0) 2015 - about 9 months to build a formative Q&A system - 40% accuracy;
- another 1-2 years and a team of 10-20, can get it to 90% accuracy, by reducing the scope ("sorry that question is out of scope")
- today's systems can only answer questions, if the answers are already existing in the text explicitly
- debater is an example of where we would like to get to though in 5 years: https://www.youtube.com/watch?v=7g59PJxbGhY
- more about the ambitions at http://cognitive-science.info
(1) 2025: Watson will be able to rapidly ingest just about any textbooks and produce a Q&A system
- the Q&A system will rival C-grade (average) student performance on questions
(2) 2035 - above, but rivals C-level (average) faculty performance on questions
(3) 2035 - an exascale of compute power costs about $1000
- an exascale is the equivalent compute of one person's brain power (at 20W power)
(4) 2035 - nearly everyone has a cognitive mediator that knows them in many ways better than they know themselves
- memory of all health information, memory of everyone you have ever interacted with, executive assistant, personal coach, process and memory aid, etc.
(5) 2055 - nearly everyone has 100 cognitive assistants that "work for them"
- better management of your cognitive assistant workforce is a course taught at university
In 2015, we are at the beginning of the beginning or the cognitive era...
In 2025, we will be middle of beginning... easy to generate average student level performance on questions in textbook....
In 2035, we will be end of beginning (one brain power equivalent)... easy to generate average faculty level performance on questions in textbook....
http://www.slideshare.net/spohrer/spohrer-ubi-learn-20151103-v2
By 2055, roughly 2x 20 year generations out, the cognitive era will be in full force.
Cellphones will likely become body suits - with burst-mode super-strength and super-safety features:
Suits - body suit cell phones
Cognitive Mediators will read everything for us, and relate the information to us - and what we know and our goals.
Think combined personal coach, executive assistant, personal research team....
The key is knowing which problem to work on next - see this long video for the answer - energy, water, food, wellness - and note especially the wellness suit at the end:
https://www.youtube.com/watch?v=YY7f1t9y9a0&index=10&list=WL
Do not be put off by the beginning of the video - it is a bit over hyped and trivial, to say the leasat... but the projects are really good if you have the patience to watch.
Github registration URL: https://github.com/
Lukas Kaiser – one model that can do all leaderboard best - https://www.youtube.com/watch?v=8FpdEmySsuc
T2T URL: https://github.com/tensorflow/tensor2tensor
T2T iPython Notebook URL: https://colab.research.google.com/notebook#fileId=/v2/external/notebooks/t2t/hello_t2t.ipynb
One favorite that can do them all: https://www.youtube.com/watch?v=8FpdEmySsuc
URLs
Github: code, content (data), community – http://github.com
Kaggle: competition and leaderboards - http://Kaggle.com
Figure-Eight: lots of labeled data – http://figure-eight.com
Rapidly Rebuild: Danko Nicolic - AI Kindergarten (Practopoesis) - https://www.youtube.com/watch?v=aMQCi3Sn2mE
Lukas Kaiser wants to get one model that can do all leaderboards – one model to do them all
Danko Nicolic wants to rapidly rebuild from scratch intelligent agents (that behave well socially with people)– rapid rebuilding
GitHub – open source code – http://github.com
Kaggle – data and competitions – http://Kaggle.com
Leaderboard – AI an competitions - https://www.slideshare.net/spohrer/leaderboards-80909263
Figure Eight – label data - https://en.wikipedia.org/wiki/Figure_Eight_Inc.
Open Source Guides – reader, contributor, committer, governance - https://opensource.guide/
GitHub is to knowledge in action (writing code) as Wikidedia is to knowledge in text (writing text)
Source: Vijay Bommireddipally (CODAIT Director) and Fred Reiss (CODAIT Chief Architect)
IBM Code – http://ibm.com/code
Today’s talk will explore two questions
What should we know how to make?
What might programming education become?
If we look at history we see a time when people could make only simple things, and often a single person could make them.
Would it ever be possible for a single person to know and make complex things? And what role might programming education play?
Will the cognitive era – the coming era of smart machines – make people more capable or less capable to know and make complex things?
In the 1940’s IBM started teaching computer science at Columbia.
My first program – punch cards 1972.
Wendy Murphy’s dog – hard for AI to recognize in 2016, easy in 2018…
URL: http://www.mercurynews.com/2016/08/04/cupertino-teens-score-20000-for-24-hours-of-work/
Karan Mehta and Anish Krishnan
Where is the variety? Hardware and even software standardizing into modules and algorithms…. Data will standardize next into categories and types…. Experience is where the uniqueness is, and variety and variability, and identity.
Pine and Gilmore – Experience Economy Book – Chapter 10 – Transformation Economy - https://www.amazon.com/Experience-Economy-Theater-Every-Business/dp/0875848192#reader_0875848192
Pine II, B. J. & Gilmore, J. H. (1999). The experience economy: work is theatre & every business a stage. Harvard Business Press. pp: 186-189. (Chapter 10 is about the transformation economy)
Osati, Sohrab (Dec 18, 2014) Sony Lifelog App Gains GPS Support for Android Wear. SonyRumors.net
http://www.sonyrumors.net/2014/12/18/sony-lifelog-app-gains-gps-support-for-android-wear/
Roy, D., Patel, R., DeCamp, P., Kubat, R., Fleischman, M., Roy, B., ... & Levit, M. (2006). The human speechome project. In Symbol Grounding and Beyond (pp. 192-196). Springer, Berlin, Heidelberg.
O*NET Online is the occupation network online, started by the US Dept of Labor in the 1990’s – it now represents one of the most comprehensive lists of occupations along with a great deal of information about each occupation, including skills, tasks, certifications, demand for these jobs, etc.
O*NET lists about 1000 occupations from Accountants to Zoologists – and many job families in between. O*NET updates the descriptions of the occupations as well as adding new occupations over time.
Source:
http://www.onetonline.org/find/family?f=0
URL Amazon: https://www.amazon.com/Knowledge-Rebuild-Civilization-Aftermath-Cataclysm-ebook/dp/B00DMCV5YS/
URL TED Talk: https://www.youtube.com/watch?v=CdTzsbqQyhY
Citation: Dartnell L (2012) The Knowledge: How to Rebuild Civilization in the Aftermath of a Cataclysm. Westminster London: Penguin Books.
Jim Spohrer Blogs:
Grand Challenge: http://service-science.info/archives/2189
Re-readings: http://service-science.info/archives/4416