This is our presentation from the WebDirections #Reality17 event. It provides an overview of the Mixed/Extended Reality landscape and looks at what's coming next. It concludes by showing where #WebAR is up to right now and what's possible in your browser today.

1. Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
The Landscape of Reality – Extended Remix
Image Credit

2. Who am I?
Rob Manson, CEO & co-founder
https://awe.media

3. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards

4. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert

5. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C

6. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group

7. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
ISO

8. A brief history of our journey…

9. How did we get here?

10. How did we get here?

11. How did we get here?

12. How did we get here?

13. How did we get here?

14. How did we get here?

15. How did we get here?

16. How did we get here?
2016
awe.media
went live

17. How did we get here?
2017
The web got
Computer Vision!

18. What predictions did we get right?
Mixed Reality will be possible in the web

19. What predictions did we get right?
Mixed Reality will be possible in the web
ARStandards Workshop Seoul, 2010

20. What predictions did we get right?
Mixed Reality Web Standards test harness

21. What predictions did we get right?
Mixed Reality Web Standards test harness
isweb3here.com, 2011

22. What predictions did we get right?
OS-level pose tracking would be released

23. What predictions did we get right?
OS-level pose tracking would be released
W3C WebVR Workshop, 2016

24. But getting the timing right
is really hard…

26. But Tim is only right
if you give up too soon!

27. Where are we up to now?

28. What is Virtual Reality?
The terms virtual worlds, virtual cockpits, and virtual workstations
were used to describe specific projects.
In 1989, Jaron Lanier, CEO of VPL, coined the term virtual reality
to bring all of the virtual projects under a single rubric.
The term therefore typically refers to three-dimensional realities implemented
with stereo viewing goggles and reality gloves.
Myron Krueger - 1991
Image Credit Image CreditImage Credit

29. What is Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon or composited with the real world.
1. Combines the real and virtual, 2. Is interactive in real time, 3. Is registered in 3D
Ron Azuma - 1997
Image Credit

30. What is Mixed Reality?
Image Credit
Paul Milgram - 1994

31. But Microsoft Marketing did too good a job!
Image Credit

32. What is XR?
Image Credit

33. Now WebXR = ‘on top of ARKit & ARCore’?!
Image Credit

34. Image Credit

36. How do you “Create” VR & AR?
MOBILE ONLY APPs WEB APPSHMD ONLY APPS
Hire or be a developer
v
1
2
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target platform
3 Develop your app/s
4
v
Test it on the target HMD
vendor platform/s
5
Convert media and
3D assets to the
app/s format
6
Sign & submit your
app/s to the app store/s
& wait for approval/s
v
7
Publish & distribute
links to one or more
app stores
!
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target mobile OS
v
1
2
Develop your app/s
3
Test it on the target HMD
vendor platform/s 4
v
Convert media and
3D assets to the
app/s format
5
Sign & submit your app/s
to the app store/s & wait
for approval/s
6
Publish & distribute
links to one or more
app stores
v
7
Hire or be a developer
8
Create promotional web
content to drive people
to the app/s ! 8
Create promotional web
content to drive people
to the app/s
Get an account with
awe.media
*blatant plug J
v
1
2
Upload any types of
common media you
need (photos, videos,
3D & more)
3
Manipulate these objects
and add rich interactions
to create your VR & AR
experiences
4
Open your browser on
any type of device
v
5 Share a single link that
points directly to your web-
based VR/AR experience

37. How do you “View” VR & AR?
Have a suitable HMD
v
1
2Have a valid account
with the HMD vendor's
app store
3
Complete the HMD
vendor's first use
4
v
Search for & find the app
in their app store
5 Download/install
the app through
their app store
6Often requires system
or app updates also
v
7 Select/play the
downloaded app
!
MOBILE ONLY APP
Have a valid account
with the Mobile OS
vendor's app store
v
1
2
Find the app in
their app store3
Download/install the
app through their
app store
4
v
Often requires
system or app
updates also
5
Download/install
the app through
their app store
6
Select/play the
downloaded app
v
7 !
View promo for app on
their website
WEB APP
1 Click on a web link to
open it in your
browser on any
device
HMD ONLY APP

39. Here are the different ways
people can interact with Mixed Reality

40. Mixed Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution

41. Mixed Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution

42. Mixed Reality Interaction Mode – Private
- Extremeties or head in fov
- 1-2 direct participants
- Wider distribution & locations

43. Mixed Reality Interaction Mode – Intimate
- Only extremeties in fov
- 1 direct participant
- Pervasive but currently limited distribution

44. Mixed Reality Interaction Mode – Intimate x 3
Tethered VR

45. Mobile VR
Mixed Reality Interaction Mode – Intimate x 3
Tethered VR

46. Mobile VR Mobile AR/MR/XR
Mixed Reality Interaction Mode – Intimate x 3
Tethered VR

47. What’s evolving as we speak?

48. Depth sensing is spreading
Depth Sensing is starting to become commonplace
Image Credit

49. Geolocation is about to get better
Image Credit

50. OS-level pose tracking has everyone’s attention
Image Credit

51. WebVR is stabilising
Image Credit

52. WebVR -> WebAR (Google’s proposal)
Image Credit

53. WebVR -> WebXR (Mozilla’s proposal)
Image Credit

54. Deep/Machine Learning is improving fast
Image Credit

55. More sensors!
Image Credit

56. More cameras!
Image Credit

57. What’s needed in the future?
(The missing pieces of the web)

58. Camera intrinsics web API
Image Credit
A more accurate underlying geometry for Computer Vision

59. Camera controls web API
A more complete API to control cameras for Computer Vision
Image Credit

60. One API to work across ARKit and ARCore
A unified Pose/Plane API
Image Credit

61. Optimised pixel access
Zero copy texture transfer that’s actually faster in workers
Image Credit

62. Lets compare the ‘Reality hype’
to the ‘Reality of the market’

63. Why has VR exploded recently?
VR has things to sell
Image Credit

64. Why has VR exploded recently?
The power of the s-curve
Image Credit

65. Where are we now?
In reality, VR headsets are a tiny tiny market right now

66. Where are we now?
In reality, VR headsets are a tiny tiny market right now
More iPhone 8s than HMDs by the end of the year!

67. What’s happening in the global mobile market?
Image Credit

68. The good news for iOS is the majority are now iOS11
Image Credit

69. Immersive Computing will become Pervasive
Image Credit
What is likely in the future?

70. What are the real market trends?
This will take more than 3-5 years
Image Credit

71. Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?

72. What will drive market changes between now & then?
Convenient multi-use mobile form factors are the key today
Image Credit

74. #WebVR is here now
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

75. #WebAR is here now
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

76. We’re removing all the friction
from creating & viewing VR/AR
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

77. Mixed Reality now runs
in the browser on your
iPhone, Android & Computer!
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

78. Thanks…
Questions?
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor