SlideShare uma empresa Scribd logo
1 de 69
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor
Augmenting, Mixing & Extending
Reality on the web
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
Who am I?
Rob Manson, CEO & co-founder
https://awe.media
The original evangelist for Mixed Reality using open Web Standards
Invited Expert
W3C
Khronos Group
ISO
A brief history…
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
How did we get here?
2017
The web gets
Computer Vision!
What predictions did we get right?
Mixed Reality will be possible in the web
What predictions did we get right?
Mixed Reality will be possible in the web
ARStandards Workshop Seoul, 2010
What predictions did we get right?
Mixed Reality Web Standards test harness
What predictions did we get right?
Mixed Reality Web Standards test harness
isweb3here.com, 2011
What predictions did we get right?
OS-level spatial tracking would be released
What predictions did we get right?
OS-level spatial tracking would be released
W3C WebVR Workshop, 2016
But getting the timing right
is really hard…
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
But Tim is only right
if you give up too soon!
Here are the different ways
people can interact with Mixed Reality
Mixed Reality Interaction Mode – Public
- Whole body in fov
- More spectators
- Limited distribution
Mixed Reality Interaction Mode – Personal
- Upper/whole body in fov
- Fewer spectators
- Wider distribution
Mixed Reality Interaction Mode – Private
- Extremeties or head in fov
- 1-2 direct participants
- Wider distribution & locations
Mixed Reality Interaction Mode – Intimate
- Only extremeties in fov
- 1 direct participant
- Pervasive but currently limited distribution
Where are we up to now?
What is Mixed Reality?
Image Credit
Paul Milgram - 1994
What is Augmented Reality?
Augmented Reality allows the user to see the real world,
with virtual objects superimposed upon
or composited with the real world.
Ron Azuma - 1997
Augmented Reality…
1. Combines the real and virtual
2. Is interactive in real time
3. Is registered in 3D
What is Extended Reality?
Image Credit
What is Extended Reality?
Image Credit
What is Extended Reality?
Image Credit
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
Image Credit
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
How do you “View” VR & AR?
Have a suitable HMD
v
1
2Have a valid account
with the HMD vendor's
app store
3
Complete the HMD
vendor's first use
4
v
Search for & find the app
in their app store
5 Download/install
the app through
their app store
6Often requires system
or app updates also
v
7 Select/play the
downloaded app
!
MOBILE ONLY APP
Have a valid account
with the Mobile OS
vendor's app store
v
1
2
Find the app in
their app store3
Download/install the
app through their
app store
4
v
Often requires
system or app
updates also
5
Download/install
the app through
their app store
6
Select/play the
downloaded app
v
7 !
View promo for app on
their website
WEB APP
1 Click on a web link to
open it in your
browser on any
device
HMD ONLY APP
How do you “Create” VR & AR?
MOBILE ONLY APPs WEB APPSHMD ONLY APPS
Hire or be a developer
v
1
2
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target platform
3 Develop your app/s
4
v
Test it on the target HMD
vendor platform/s
5
Convert media and
3D assets to the
app/s format
6
Sign & submit your
app/s to the app store/s
& wait for approval/s
v
7
Publish & distribute
links to one or more
app stores
!
Download & get to know (&
deal with the various
issues/quirks) the developer
SDK for the target mobile OS
v
1
2
Develop your app/s
3
Test it on the target HMD
vendor platform/s 4
v
Convert media and
3D assets to the
app/s format
5
Sign & submit your app/s
to the app store/s & wait
for approval/s
6
Publish & distribute
links to one or more
app stores
v
7
Hire or be a developer
8
Create promotional web
content to drive people
to the app/s ! 8
Create promotional web
content to drive people
to the app/s
Get an account with
awe.media
*blatant plug J
v
1
2
Upload any types of
common media you
need (photos, videos,
3D & more)
3
Manipulate these objects
and add rich interactions
to create your VR & AR
experiences
4
Open your browser on
any type of device
v
5 Share a single link that
points directly to your web-
based VR/AR experience
What’s evolving as we speak?
Depth sensing
Depth Sensing is starting to become commonplace
Image Credit
OS-level pose tracking
Image Credit
WebVR/WebAR
Image Credit
WebVR/WebXR
Image Credit
Deep/Machine Learning
Image Credit
More cameras!
Image Credit
What’s needed in the future?
(The missing pieces)
Camera intrinsics web API
Image Credit
A more accurate underlying geometry for Computer Vision
Optimised pixel access
Zero copy texture transfer & faster workers
Image Credit
Lets look at how this is all
playing out in the market
Why has VR exploded recently?
VR has things to sell
Image Credit
Why has VR exploded recently?
The power of the s-curve
Image Credit
Where are we now?
In reality, VR is a tiny tiny market right now
Where are we now?
In reality, VR is a tiny tiny market right now
More iPhone 8s than HMDs by the end of the year!
What’s happening in the global mobile market?
Image Credit
The good news for iOS is the majority are now iOS11
Image Credit
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Where are we now?
Installed web browsers
20 MILLION (END 2017)
Includes both the mobile and
HMD users above
2 BILLION
3 BILLION
Mobile devices
HMD only
Immersive Computing will become Pervasive
Image Credit
What is likely in the future?
What are the real market trends?
This will take more than 3-5 years
Image Credit
Mainstream adoption won’t “start” until at least 2020
Image Credit
How long until we get our magic glasses?
What will drive market changes between now & then?
Convenient multi-use mobile form factors are the key today
Image Credit
ISMAR17 - Augmenting, Mixing & Extending Reality on the web
Questions? / Discussion
Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor

Mais conteúdo relacionado

Semelhante a ISMAR17 - Augmenting, Mixing & Extending Reality on the web

The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17Rob Manson
 
The UX of Mixed Reality
The UX of Mixed RealityThe UX of Mixed Reality
The UX of Mixed RealityAlex Young
 
Social & SEO Trends 2017 Bulgaria/World - Webit 2017
Social & SEO Trends 2017 Bulgaria/World - Webit 2017Social & SEO Trends 2017 Bulgaria/World - Webit 2017
Social & SEO Trends 2017 Bulgaria/World - Webit 2017Katya Todorova
 
Leen Segers: Customers Wanted - TSD17
Leen Segers: Customers Wanted - TSD17Leen Segers: Customers Wanted - TSD17
Leen Segers: Customers Wanted - TSD17StartUps.be
 
Deep linking at App Promotion Summit
Deep linking at App Promotion SummitDeep linking at App Promotion Summit
Deep linking at App Promotion SummitAlexandre Jubien
 
Hack Reality - awe
Hack Reality - aweHack Reality - awe
Hack Reality - aweAlex Young
 
Surviving (and Thriving in) the Online Identity Wars
Surviving (and Thriving in) the Online Identity WarsSurviving (and Thriving in) the Online Identity Wars
Surviving (and Thriving in) the Online Identity WarsJohn McCrea
 
Appsplash'16 session(1) "Introduction to mobile application"
Appsplash'16 session(1) "Introduction to mobile application"Appsplash'16 session(1) "Introduction to mobile application"
Appsplash'16 session(1) "Introduction to mobile application"Hany Halim
 
Immersive - Sydney July 2017
Immersive - Sydney July 2017Immersive - Sydney July 2017
Immersive - Sydney July 2017Rob Manson
 
Ba Session3
Ba Session3Ba Session3
Ba Session3CMoz
 
Boris Krstović - News 3.0 : Online Publishing And Semantic Web
Boris Krstović - News 3.0 : Online Publishing And Semantic WebBoris Krstović - News 3.0 : Online Publishing And Semantic Web
Boris Krstović - News 3.0 : Online Publishing And Semantic WebbiZbuZZ
 
Android DevConference - Realidade aumentada para Android: crie seu próprio Po...
Android DevConference - Realidade aumentada para Android: crie seu próprio Po...Android DevConference - Realidade aumentada para Android: crie seu próprio Po...
Android DevConference - Realidade aumentada para Android: crie seu próprio Po...iMasters
 
Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)
Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)
Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)Hai Dongkixot
 
Riot slides gd 1.8.2
Riot slides gd 1.8.2Riot slides gd 1.8.2
Riot slides gd 1.8.2fsachs
 
its changing, so must you
its changing, so must youits changing, so must you
its changing, so must youmarkmedia
 
Spotlight on Media & Entertainment: Virtual Reality
Spotlight on Media & Entertainment: Virtual RealitySpotlight on Media & Entertainment: Virtual Reality
Spotlight on Media & Entertainment: Virtual RealityL.E.K. Consulting
 
Reelgenius deck slideshare
Reelgenius deck slideshareReelgenius deck slideshare
Reelgenius deck slideshareDan Goikhman
 

Semelhante a ISMAR17 - Augmenting, Mixing & Extending Reality on the web (20)

The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17The Extended Reality Landscape #Reality17
The Extended Reality Landscape #Reality17
 
The UX of Mixed Reality
The UX of Mixed RealityThe UX of Mixed Reality
The UX of Mixed Reality
 
Alex jubien-think mobile
Alex jubien-think mobileAlex jubien-think mobile
Alex jubien-think mobile
 
Social & SEO Trends 2017 Bulgaria/World - Webit 2017
Social & SEO Trends 2017 Bulgaria/World - Webit 2017Social & SEO Trends 2017 Bulgaria/World - Webit 2017
Social & SEO Trends 2017 Bulgaria/World - Webit 2017
 
Leen Segers: Customers Wanted - TSD17
Leen Segers: Customers Wanted - TSD17Leen Segers: Customers Wanted - TSD17
Leen Segers: Customers Wanted - TSD17
 
Deep linking at App Promotion Summit
Deep linking at App Promotion SummitDeep linking at App Promotion Summit
Deep linking at App Promotion Summit
 
Hack Reality - awe
Hack Reality - aweHack Reality - awe
Hack Reality - awe
 
Surviving (and Thriving in) the Online Identity Wars
Surviving (and Thriving in) the Online Identity WarsSurviving (and Thriving in) the Online Identity Wars
Surviving (and Thriving in) the Online Identity Wars
 
Appsplash'16 session(1) "Introduction to mobile application"
Appsplash'16 session(1) "Introduction to mobile application"Appsplash'16 session(1) "Introduction to mobile application"
Appsplash'16 session(1) "Introduction to mobile application"
 
Immersive - Sydney July 2017
Immersive - Sydney July 2017Immersive - Sydney July 2017
Immersive - Sydney July 2017
 
Ba Session3
Ba Session3Ba Session3
Ba Session3
 
Boris Krstović - News 3.0 : Online Publishing And Semantic Web
Boris Krstović - News 3.0 : Online Publishing And Semantic WebBoris Krstović - News 3.0 : Online Publishing And Semantic Web
Boris Krstović - News 3.0 : Online Publishing And Semantic Web
 
Android DevConference - Realidade aumentada para Android: crie seu próprio Po...
Android DevConference - Realidade aumentada para Android: crie seu próprio Po...Android DevConference - Realidade aumentada para Android: crie seu próprio Po...
Android DevConference - Realidade aumentada para Android: crie seu próprio Po...
 
Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)
Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)
Western Digital - Communication Plans 2013 (Conducted by eBrand Vietnam)
 
Riot slides gd 1.8.2
Riot slides gd 1.8.2Riot slides gd 1.8.2
Riot slides gd 1.8.2
 
its changing, so must you
its changing, so must youits changing, so must you
its changing, so must you
 
Spotlight on Media & Entertainment: Virtual Reality
Spotlight on Media & Entertainment: Virtual RealitySpotlight on Media & Entertainment: Virtual Reality
Spotlight on Media & Entertainment: Virtual Reality
 
TheTrendWatch #02
TheTrendWatch #02TheTrendWatch #02
TheTrendWatch #02
 
Reelgenius deck slideshare
Reelgenius deck slideshareReelgenius deck slideshare
Reelgenius deck slideshare
 
Sam Headhunting V4
Sam Headhunting V4Sam Headhunting V4
Sam Headhunting V4
 

Mais de Rob Manson

Build your own reality
Build your own realityBuild your own reality
Build your own realityRob Manson
 
Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13Rob Manson
 
The future is un-Real
The future is un-RealThe future is un-Real
The future is un-RealRob Manson
 
The Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the massesThe Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the massesRob Manson
 
Augmented Reality is just a feature!
Augmented Reality is just a feature!Augmented Reality is just a feature!
Augmented Reality is just a feature!Rob Manson
 
Introduction to AR
Introduction to ARIntroduction to AR
Introduction to ARRob Manson
 
Web Standards adoption in the AR market
Web Standards adoption in the AR marketWeb Standards adoption in the AR market
Web Standards adoption in the AR marketRob Manson
 
Now here is everywhere
Now here is everywhereNow here is everywhere
Now here is everywhereRob Manson
 
AR is the UI for Pervasive Computing
AR is the UI for Pervasive ComputingAR is the UI for Pervasive Computing
AR is the UI for Pervasive ComputingRob Manson
 
Your browser can see and hear and ...
Your browser can see and hear and ...Your browser can see and hear and ...
Your browser can see and hear and ...Rob Manson
 
Web Standards based Augmented Reality
Web Standards based Augmented RealityWeb Standards based Augmented Reality
Web Standards based Augmented RealityRob Manson
 
Is that sense-able?
Is that sense-able?Is that sense-able?
Is that sense-able?Rob Manson
 
streetARt case study for ARE2011
streetARt case study for ARE2011streetARt case study for ARE2011
streetARt case study for ARE2011Rob Manson
 
ARSyd March 2011
ARSyd March 2011ARSyd March 2011
ARSyd March 2011Rob Manson
 
Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010Rob Manson
 
ARSyd September 2010
ARSyd September 2010ARSyd September 2010
ARSyd September 2010Rob Manson
 
Future of mobile in local Government
Future of mobile in local GovernmentFuture of mobile in local Government
Future of mobile in local GovernmentRob Manson
 
The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010Rob Manson
 
XMediaLab Sydney 2010 (Scott & Rob)
XMediaLab Sydney 2010 (Scott & Rob)XMediaLab Sydney 2010 (Scott & Rob)
XMediaLab Sydney 2010 (Scott & Rob)Rob Manson
 

Mais de Rob Manson (20)

Build your own reality
Build your own realityBuild your own reality
Build your own reality
 
Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13Web Standards for AR workshop at ISMAR13
Web Standards for AR workshop at ISMAR13
 
The future is un-Real
The future is un-RealThe future is un-Real
The future is un-Real
 
The Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the massesThe Augmented Web delivers AR to the masses
The Augmented Web delivers AR to the masses
 
Augmented Reality is just a feature!
Augmented Reality is just a feature!Augmented Reality is just a feature!
Augmented Reality is just a feature!
 
Introduction to AR
Introduction to ARIntroduction to AR
Introduction to AR
 
Web Standards adoption in the AR market
Web Standards adoption in the AR marketWeb Standards adoption in the AR market
Web Standards adoption in the AR market
 
Now here is everywhere
Now here is everywhereNow here is everywhere
Now here is everywhere
 
AR is the UI for Pervasive Computing
AR is the UI for Pervasive ComputingAR is the UI for Pervasive Computing
AR is the UI for Pervasive Computing
 
Your browser can see and hear and ...
Your browser can see and hear and ...Your browser can see and hear and ...
Your browser can see and hear and ...
 
Web Standards based Augmented Reality
Web Standards based Augmented RealityWeb Standards based Augmented Reality
Web Standards based Augmented Reality
 
Is that sense-able?
Is that sense-able?Is that sense-able?
Is that sense-able?
 
What is web3?
What is web3?What is web3?
What is web3?
 
streetARt case study for ARE2011
streetARt case study for ARE2011streetARt case study for ARE2011
streetARt case study for ARE2011
 
ARSyd March 2011
ARSyd March 2011ARSyd March 2011
ARSyd March 2011
 
Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010Patterns of Interest - ISWAR Seoul 2010
Patterns of Interest - ISWAR Seoul 2010
 
ARSyd September 2010
ARSyd September 2010ARSyd September 2010
ARSyd September 2010
 
Future of mobile in local Government
Future of mobile in local GovernmentFuture of mobile in local Government
Future of mobile in local Government
 
The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010The Pervasive Experience - project review July 2010
The Pervasive Experience - project review July 2010
 
XMediaLab Sydney 2010 (Scott & Rob)
XMediaLab Sydney 2010 (Scott & Rob)XMediaLab Sydney 2010 (Scott & Rob)
XMediaLab Sydney 2010 (Scott & Rob)
 

Último

20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-pyJamie (Taka) Wang
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?IES VE
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6DianaGray10
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URLRuncy Oommen
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsSeth Reyes
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesDavid Newbury
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UbiTrack UK
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarPrecisely
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 

Último (20)

20230202 - Introduction to tis-py
20230202 - Introduction to tis-py20230202 - Introduction to tis-py
20230202 - Introduction to tis-py
 
How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?How Accurate are Carbon Emissions Projections?
How Accurate are Carbon Emissions Projections?
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6UiPath Studio Web workshop series - Day 6
UiPath Studio Web workshop series - Day 6
 
Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Designing A Time bound resource download URL
Designing A Time bound resource download URLDesigning A Time bound resource download URL
Designing A Time bound resource download URL
 
Computer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and HazardsComputer 10: Lesson 10 - Online Crimes and Hazards
Computer 10: Lesson 10 - Online Crimes and Hazards
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Linked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond OntologiesLinked Data in Production: Moving Beyond Ontologies
Linked Data in Production: Moving Beyond Ontologies
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
UWB Technology for Enhanced Indoor and Outdoor Positioning in Physiological M...
 
AI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity WebinarAI You Can Trust - Ensuring Success with Data Integrity Webinar
AI You Can Trust - Ensuring Success with Data Integrity Webinar
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 

ISMAR17 - Augmenting, Mixing & Extending Reality on the web

  • 1. Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor Augmenting, Mixing & Extending Reality on the web
  • 2. Who am I? Rob Manson, CEO & co-founder https://awe.media
  • 3. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards
  • 4. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert
  • 5. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C
  • 6. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C Khronos Group
  • 7. Who am I? Rob Manson, CEO & co-founder https://awe.media The original evangelist for Mixed Reality using open Web Standards Invited Expert W3C Khronos Group ISO
  • 9. How did we get here?
  • 10. How did we get here?
  • 11. How did we get here?
  • 12. How did we get here?
  • 13. How did we get here?
  • 14. How did we get here?
  • 15. How did we get here?
  • 16. How did we get here?
  • 17. How did we get here? 2017 The web gets Computer Vision!
  • 18. What predictions did we get right? Mixed Reality will be possible in the web
  • 19. What predictions did we get right? Mixed Reality will be possible in the web ARStandards Workshop Seoul, 2010
  • 20. What predictions did we get right? Mixed Reality Web Standards test harness
  • 21. What predictions did we get right? Mixed Reality Web Standards test harness isweb3here.com, 2011
  • 22. What predictions did we get right? OS-level spatial tracking would be released
  • 23. What predictions did we get right? OS-level spatial tracking would be released W3C WebVR Workshop, 2016
  • 24. But getting the timing right is really hard…
  • 26. But Tim is only right if you give up too soon!
  • 27. Here are the different ways people can interact with Mixed Reality
  • 28. Mixed Reality Interaction Mode – Public - Whole body in fov - More spectators - Limited distribution
  • 29. Mixed Reality Interaction Mode – Personal - Upper/whole body in fov - Fewer spectators - Wider distribution
  • 30. Mixed Reality Interaction Mode – Private - Extremeties or head in fov - 1-2 direct participants - Wider distribution & locations
  • 31. Mixed Reality Interaction Mode – Intimate - Only extremeties in fov - 1 direct participant - Pervasive but currently limited distribution
  • 32. Where are we up to now?
  • 33. What is Mixed Reality? Image Credit Paul Milgram - 1994
  • 34. What is Augmented Reality? Augmented Reality allows the user to see the real world, with virtual objects superimposed upon or composited with the real world. Ron Azuma - 1997 Augmented Reality… 1. Combines the real and virtual 2. Is interactive in real time 3. Is registered in 3D
  • 35. What is Extended Reality? Image Credit
  • 36. What is Extended Reality? Image Credit
  • 37. What is Extended Reality? Image Credit
  • 41. How do you “View” VR & AR? Have a suitable HMD v 1 2Have a valid account with the HMD vendor's app store 3 Complete the HMD vendor's first use 4 v Search for & find the app in their app store 5 Download/install the app through their app store 6Often requires system or app updates also v 7 Select/play the downloaded app ! MOBILE ONLY APP Have a valid account with the Mobile OS vendor's app store v 1 2 Find the app in their app store3 Download/install the app through their app store 4 v Often requires system or app updates also 5 Download/install the app through their app store 6 Select/play the downloaded app v 7 ! View promo for app on their website WEB APP 1 Click on a web link to open it in your browser on any device HMD ONLY APP
  • 42. How do you “Create” VR & AR? MOBILE ONLY APPs WEB APPSHMD ONLY APPS Hire or be a developer v 1 2 Download & get to know (& deal with the various issues/quirks) the developer SDK for the target platform 3 Develop your app/s 4 v Test it on the target HMD vendor platform/s 5 Convert media and 3D assets to the app/s format 6 Sign & submit your app/s to the app store/s & wait for approval/s v 7 Publish & distribute links to one or more app stores ! Download & get to know (& deal with the various issues/quirks) the developer SDK for the target mobile OS v 1 2 Develop your app/s 3 Test it on the target HMD vendor platform/s 4 v Convert media and 3D assets to the app/s format 5 Sign & submit your app/s to the app store/s & wait for approval/s 6 Publish & distribute links to one or more app stores v 7 Hire or be a developer 8 Create promotional web content to drive people to the app/s ! 8 Create promotional web content to drive people to the app/s Get an account with awe.media *blatant plug J v 1 2 Upload any types of common media you need (photos, videos, 3D & more) 3 Manipulate these objects and add rich interactions to create your VR & AR experiences 4 Open your browser on any type of device v 5 Share a single link that points directly to your web- based VR/AR experience
  • 43. What’s evolving as we speak?
  • 44. Depth sensing Depth Sensing is starting to become commonplace Image Credit
  • 50. What’s needed in the future? (The missing pieces)
  • 51. Camera intrinsics web API Image Credit A more accurate underlying geometry for Computer Vision
  • 52. Optimised pixel access Zero copy texture transfer & faster workers Image Credit
  • 53. Lets look at how this is all playing out in the market
  • 54. Why has VR exploded recently? VR has things to sell Image Credit
  • 55. Why has VR exploded recently? The power of the s-curve Image Credit
  • 56. Where are we now? In reality, VR is a tiny tiny market right now
  • 57. Where are we now? In reality, VR is a tiny tiny market right now More iPhone 8s than HMDs by the end of the year!
  • 58. What’s happening in the global mobile market? Image Credit
  • 59. The good news for iOS is the majority are now iOS11 Image Credit
  • 60. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 61. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 62. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 63. Where are we now? Installed web browsers 20 MILLION (END 2017) Includes both the mobile and HMD users above 2 BILLION 3 BILLION Mobile devices HMD only
  • 64. Immersive Computing will become Pervasive Image Credit What is likely in the future?
  • 65. What are the real market trends? This will take more than 3-5 years Image Credit
  • 66. Mainstream adoption won’t “start” until at least 2020 Image Credit How long until we get our magic glasses?
  • 67. What will drive market changes between now & then? Convenient multi-use mobile form factors are the key today Image Credit
  • 69. Questions? / Discussion Rob Manson, CEO & co-founder - https://awe.media - follow me on twitter @nambor