This presentation was part of the ISMAR17 Workshop on "Standards for Mixed & Augmented Reality" in Nantes, France (https://arstandardsworkshop17.wordpress.com/program/). It provides an overview of the latest developments in web based Mixed Reality including the newly released Natural Feature Tracking from awe.media (see the intro video here https://youtu.be/5_HWgrcWWts). It takes a look at developments & APIs that are currently forming. It takes a look at what is still needed and how these API gaps may be dealt with. And it explores what is currently playing out in the market and how this is likely to evolve in the near-to-midterm future.
Machine Learning Model Validation (Aijun Zhang 2024).pdf
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
1. Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Augmenting, Mixing & Extending
Reality on the web
2. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
3. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
4. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
5. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
6. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
7. Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
ISO
33. What is Mixed Reality?
Image Credit
Paul Milgram - 1994
34. What is Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon
or composited with the real world.
Ron Azuma - 1997
Augmented Reality…
1. Combines the real and virtual
2. Is interactive in real time
3. Is registered in 3D
41. How do you “View” VR & AR?
Have a suitable HMD
v
1
2Have a valid account
with the HMD vendor's
app store
3
Complete the HMD
vendor's first use
4
v
Search for & find the app
in their app store
5 Download/install
the app through
their app store
6Often requires system
or app updates also
v
7 Select/play the
downloaded app
!
MOBILE ONLY APP
Have a valid account
with the Mobile OS
vendor's app store
v
1
2
Find the app in
their app store3
Download/install the
app through their
app store
4
v
Often requires
system or app
updates also
5
Download/install
the app through
their app store
6
Select/play the
downloaded app
v
7 !
View promo for app on
their website
WEB APP
1 Click on a web link to
open it in your
browser on any
device
HMD ONLY APP
42. How do you “Create” VR & AR?
MOBILE ONLY APPs WEB APPSHMD ONLY APPS
Hire or be a developer
v
1
2
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target platform
3 Develop your app/s
4
v
Test it on the target HMD
vendor platform/s
5
Convert media and
3D assets to the
app/s format
6
Sign & submit your
app/s to the app store/s
& wait for approval/s
v
7
Publish & distribute
links to one or more
app stores
!
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target mobile OS
v
1
2
Develop your app/s
3
Test it on the target HMD
vendor platform/s 4
v
Convert media and
3D assets to the
app/s format
5
Sign & submit your app/s
to the app store/s & wait
for approval/s
6
Publish & distribute
links to one or more
app stores
v
7
Hire or be a developer
8
Create promotional web
content to drive people
to the app/s ! 8
Create promotional web
content to drive people
to the app/s
Get an account with
awe.media
*blatant plug J
v
1
2
Upload any types of
common media you
need (photos, videos,
3D & more)
3
Manipulate these objects
and add rich interactions
to create your VR & AR
experiences
4
Open your browser on
any type of device
v
5 Share a single link that
points directly to your web-
based VR/AR experience
59. The good news for iOS is the majority are now iOS11
Image Credit
60. Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
61. Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
62. Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
63. Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only