O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.
The Soul in The Machine - Developing for Humans
Chris Heilmann @codepo8 - May 2017
PROLOGUE
“VISIONS OF THE FUTURE”
Arthur C
Clarke
Aldous
Huxley
George
Orwell
Alan
Moore
http://www.independent.co.uk/life-style/gadgets-and-tech/news/theresa-may-internet-conservatives-government-a7744176.html
https://www.newscientist.com/article/2113299-
googles-deepmind-ai-can-lip-read-tv-shows-
better-than-a-pro/?sf43896303=1
h...
Technological progress
has merely provided
us with more efficient
means for going
backwards.
— Aldous Huxley
Duophonix @ Deviantart http://duophonix.deviantart.com/art/Ihal-9000-184254683
CHRIS HEILMANN
@CODEPO8
HTTPS://CHRISTIANHEILMANN.COM
ACT ONE
“CREATURE COMFORTS WE ALL ENJOY”
Things machines and software can do for humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
Things machines and
software can do for
humans:
• Prevent us from making mistakes
• Do boring, repetitive tasks
• Fill gap...
ACT TWO
“ENTER THE ENABLERS”
A few years ago all this was pure science
fiction…
And even today it feels like it is too hard
to do, right?
Wrong. The trick is to understand that we
live in a world of services, clouds,
databases and products.
All players are doing a great job giving you access…
https://www.youtube.com/watch?v=ETeeSYMGZn0
Almost every company offers APIs for this.
REST endpoints with support for Node or
even client-side JavaScript.
Images
Audio
Video
(Foreign) Text
Gestures
Faces
Emotions
…
build-stuff.json
A lot of work went into these APIs, work
you might not want to do yourself…
Machines, corporations, services and
products have harvested tons and tons of
data over the last years.
The biggest problem was to understand
the data – as it was a mess.
So we trained machines in thousands of
iterations to get the best information out
of a small set of fata.
What’s in a sentence?
Word dependencies
Labels
Speech / Language Syntax
Language stems
Morphology / Grammar
Better translation through sentences vs. words
Better translation through sentences vs. words
Better translation through sentences vs. words
Bad results? Use the same platforms to
train your own data according to your
specifications.
Add quality by filtering with context…
https://www.microsoft.com/cognitive-services/en-us/custom-recognition-intelligent-s...
The good news for us is that we can now
use these findings to build better
interfaces.
ACT THREE
“GO FORTH AND DO SOME GOOD”
The interfaces we
build today condition
the users of now and
of tomorrow…
The interfaces we
build today condition
the users of now and
of tomorrow…
It is time for us to use and build better, more
human interfaces…
There is no such thing as a perfect user - think inclusive.
https://www.microsoft.com/en-us/Design/inclusive
It isn’t abou...
Our job right now is to
create interfaces that are
simple, human and fun
to use…
What we can do with technology for us and our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
What we can do with
technology for us and
our users…
• Prevent mistakes before they happen
• Do boring, repetitive tasks
•...
EPILOGUE
“OH THE PLACES YOU WILL GO…”
The saddest aspect of
life right now is that
science gathers
knowledge faster than
society gathers wisdom.
— Isaac Asimov
The future is already
here – it’s just not very
evenly distributed.
— William Gibson
Let’s fix that! Right now!
CHRIS HEILMANN
@CODEPO8
CHRISTIANHEILMANN.COM
THANKS!
The Soul in The Machine - Developing for Humans (FrankenJS edition)
The Soul in The Machine - Developing for Humans (FrankenJS edition)
The Soul in The Machine - Developing for Humans (FrankenJS edition)
Próximos SlideShares
Carregando em…5
×

The Soul in The Machine - Developing for Humans (FrankenJS edition)

Wuerschdla gabs

  • Seja o primeiro a comentar

  • Seja a primeira pessoa a gostar disto

The Soul in The Machine - Developing for Humans (FrankenJS edition)

  1. 1. The Soul in The Machine - Developing for Humans Chris Heilmann @codepo8 - May 2017
  2. 2. PROLOGUE “VISIONS OF THE FUTURE”
  3. 3. Arthur C Clarke Aldous Huxley George Orwell Alan Moore
  4. 4. http://www.independent.co.uk/life-style/gadgets-and-tech/news/theresa-may-internet-conservatives-government-a7744176.html
  5. 5. https://www.newscientist.com/article/2113299- googles-deepmind-ai-can-lip-read-tv-shows- better-than-a-pro/?sf43896303=1 https://arxiv.org/pdf/1611.05358v1.pdf 46.8% vs 12.4% success rate
  6. 6. Technological progress has merely provided us with more efficient means for going backwards. — Aldous Huxley
  7. 7. Duophonix @ Deviantart http://duophonix.deviantart.com/art/Ihal-9000-184254683
  8. 8. CHRIS HEILMANN @CODEPO8 HTTPS://CHRISTIANHEILMANN.COM
  9. 9. ACT ONE “CREATURE COMFORTS WE ALL ENJOY”
  10. 10. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  11. 11. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  12. 12. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://www.bloomberg.com/news/articles/ 2017-02-28/jpmorgan-marshals-an-army-of- developers-to-automate-high-finance
  13. 13. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  14. 14. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://arxiv.org/abs/1702.00783
  15. 15. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://gwmt.nvidia.com/ http://www.trustedreviews.com/news/ nvidia-super-resolution-tool-launch
  16. 16. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  17. 17. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  18. 18. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  19. 19. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  20. 20. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  21. 21. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm Image may contain: dog, outdoor and nature
  22. 22. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://blogs.office.com/2016/12/02/accessibility-in- office-365-enabling-greater-digital-inclusion/
  23. 23. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm http://captionbot.ai
  24. 24. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://www.youtube.com/watch?v=XMdct-5bERQ
  25. 25. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  26. 26. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm https://research.googleblog.com/2016/05/aw-so-cute- allo-helps-you-respond-to.html
  27. 27. Things machines and software can do for humans: • Prevent us from making mistakes • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise for us • Make us understand better • Allow us to communicate more • Protect us from harm
  28. 28. ACT TWO “ENTER THE ENABLERS”
  29. 29. A few years ago all this was pure science fiction…
  30. 30. And even today it feels like it is too hard to do, right?
  31. 31. Wrong. The trick is to understand that we live in a world of services, clouds, databases and products.
  32. 32. All players are doing a great job giving you access… https://www.youtube.com/watch?v=ETeeSYMGZn0
  33. 33. Almost every company offers APIs for this.
  34. 34. REST endpoints with support for Node or even client-side JavaScript.
  35. 35. Images Audio Video (Foreign) Text Gestures Faces Emotions … build-stuff.json
  36. 36. A lot of work went into these APIs, work you might not want to do yourself…
  37. 37. Machines, corporations, services and products have harvested tons and tons of data over the last years.
  38. 38. The biggest problem was to understand the data – as it was a mess.
  39. 39. So we trained machines in thousands of iterations to get the best information out of a small set of fata.
  40. 40. What’s in a sentence?
  41. 41. Word dependencies
  42. 42. Labels
  43. 43. Speech / Language Syntax
  44. 44. Language stems
  45. 45. Morphology / Grammar
  46. 46. Better translation through sentences vs. words
  47. 47. Better translation through sentences vs. words
  48. 48. Better translation through sentences vs. words
  49. 49. Bad results? Use the same platforms to train your own data according to your specifications.
  50. 50. Add quality by filtering with context… https://www.microsoft.com/cognitive-services/en-us/custom-recognition-intelligent-service-cris
  51. 51. The good news for us is that we can now use these findings to build better interfaces.
  52. 52. ACT THREE “GO FORTH AND DO SOME GOOD”
  53. 53. The interfaces we build today condition the users of now and of tomorrow…
  54. 54. The interfaces we build today condition the users of now and of tomorrow…
  55. 55. It is time for us to use and build better, more human interfaces…
  56. 56. There is no such thing as a perfect user - think inclusive. https://www.microsoft.com/en-us/Design/inclusive It isn’t about allowing access but about avoiding barriers.
  57. 57. Our job right now is to create interfaces that are simple, human and fun to use…
  58. 58. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  59. 59. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  60. 60. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  61. 61. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  62. 62. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  63. 63. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users http://code.visualstudio.com/
  64. 64. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users https://channel9.msdn.com/Events/Build/2017/T6078
  65. 65. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users JSON: { "language": "en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89", "words": [ { "boundingBox": "41,102,225,64", "text": "LIFE" }, { "boundingBox": "356,89,94,62", "text": "IS" }, { "boundingBox": "539,77,225,64", "text": "LIKE" } . . . TEXT: LIFE IS LIKE RIDING A BICYCLE TO KEEP YOUR BALANCE YOU MUST KEEP MOVING JSON: { "language": "en", "orientation": "Up", "regions": [ { "boundingBox": "41,77,918,440", "lines": [ { "boundingBox": "41,77,723,89" "words": [ { "boundingBox": "41,102,225,6 "text": "LIFE" }, { "boundingBox": "356,89,94,62 "text": "IS" }, { "boundingBox": "539,77,225,6 "text": "LIKE" } . . . TO KEEP YOUR BALANCE YOU MUST KEEP MOVING
  66. 66. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  67. 67. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users http://cloudinary.com/blog/ automatically_art_directed_responsive_images
  68. 68. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  69. 69. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  70. 70. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users https://www.videobreakdown.com/
  71. 71. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  72. 72. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  73. 73. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  74. 74. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  75. 75. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  76. 76. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  77. 77. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  78. 78. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  79. 79. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  80. 80. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users 🎙" 🔊$
  81. 81. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  82. 82. What we can do with technology for us and our users… • Prevent mistakes before they happen • Do boring, repetitive tasks • Fill gaps in information • Remember and categorise • Allow for better understanding • Offer new ways to communicate • Protect us and our end users
  83. 83. EPILOGUE “OH THE PLACES YOU WILL GO…”
  84. 84. The saddest aspect of life right now is that science gathers knowledge faster than society gathers wisdom. — Isaac Asimov
  85. 85. The future is already here – it’s just not very evenly distributed. — William Gibson
  86. 86. Let’s fix that! Right now!
  87. 87. CHRIS HEILMANN @CODEPO8 CHRISTIANHEILMANN.COM THANKS!

×