Lecture 1 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture is the Introduction to the course. Look for the other 9 lectures in the course.
3. About Us
â˘âŻMark
â˘âŻPhD University of Washington
â˘âŻFounder, HIT Lab NZ
â˘âŻProfessor, University South Australia
â˘âŻZi Siang
â˘âŻResearcher, HIT Lab NZ
â˘âŻCreative Director, Reina Imaging
â˘âŻAcademic, University Tunku Abdul Rahman
4. Course Outline - Saturday
â˘âŻMorning
â˘âŻ 9:00 am Welcome
â˘âŻ 9:30 am 1: Introduction to Augmented Reality
â˘âŻ 11:00 am 2: Rapid Prototyping for Mobile AR
â˘âŻ 12:30 pm Lunch
â˘âŻAfternoon
â˘âŻ 1:30 pm 3: Visual Programming for Mobile AR
â˘âŻ 3:00 pm 4: Location Based AR
â˘âŻ 3:45 pm Break
â˘âŻ 4:00 pm 4: ARML Scripting
â˘âŻ 5:00 pm Finish
5. Course Outline - Sunday
â˘âŻMorning
â˘âŻ9:00 am 5: Mobile AR Interaction
â˘âŻ10:30 am 6: Introduction to Unity3D
â˘âŻ11:30 am 7: Introduction to Vuforia
â˘âŻ12:30 pm Lunch
â˘âŻAfternoon
â˘âŻ1:30 pm 8: Interactive AR Applications
â˘âŻ3:00 pm 9: AR using HDRI Panorama
â˘âŻ4:30 pm 10: Research Directions
â˘âŻ5:00 pm Finish
6. What You Will Learn
â˘âŻOverview of Augmented Reality
â˘âŻFoundation of mobile Augmented Reality
â˘âŻPrototyping methods for mobile AR
â˘âŻVisual design tools for mobile AR
â˘âŻMaking image based and geo located Mobile AR
â˘âŻInteraction methods for Mobile AR
â˘âŻBasics of Unity3D
â˘âŻOverview of Vuforia tracking library
â˘âŻResearch directions in Mobile AR
8. A Brief History ofTime
â˘âŻTrend
â˘âŻsmaller, cheaper, more functions, more intimate
â˘âŻTechnology becomes invisible
â˘âŻIntuitive to use
â˘âŻInterface over internals
â˘âŻForm more important than function
â˘âŻHuman centered design
9. A Brief History of Computing
â˘âŻTrend
â˘âŻsmaller, cheaper, faster, more intimate, intelligent objects
â˘âŻComputers need to become invisible
â˘âŻhide the computer in the real world
â˘âŻ Ubiquitous / Tangible Computing
â˘âŻput the user inside the computer
â˘âŻ Virtual Reality
10. Making Interfaces Invisible
Rekimoto, J. and Nagao, K. 1995. The world through the computer: computer augmented
interaction with real world environments. In Proceedings of the 8th Annual ACM Symposium on
User interface and Software Technology. UIST '95. ACM, New York, NY, 29-36.
12. Ubiquitous computing is the method of
enhancing computer use by making many
computers available throughout the physical
environment, but making them effectively
invisible to the user.
â Mark Weiser
20. Augmented Reality Definition
â˘âŻDefining Characteristics [Azuma 97]
â˘âŻCombines Real andVirtual Images
â˘âŻBoth can be seen at the same time
â˘âŻInteractive in real-time
â˘âŻThe virtual content can be interacted with
â˘âŻRegistered in 3D
â˘âŻVirtual objects appear fixed in space
Azuma, R. T. (1997). A survey of augmented reality. Presence, 6(4), 355-385.
26. Milgramâs Reality-Virtuality continuum
Mixed Reality
Reality - Virtuality (RV) Continuum
Real
Environment
Augmented
Reality (AR)
Augmented
Virtuality (AV)
Virtual
Environment
"...anywhere between the extrema of the virtuality continuum."
P. Milgram and A. F. Kishino, Taxonomy of Mixed Reality Visual Displays
IEICE Transactions on Information and Systems, E77-D(12), pp. 1321-1329, 1994.
28. Metaverse Dimensions
⢠Augmentation technologies that layer information
onto our perception of the physical environment.
⢠Simulation refers to technologies that model
reality
⢠Intimate technologies are focused inwardly, on
the identity and actions of the individual or
object;
⢠External technologies are focused outwardly,
towards the world at large;
31. MirrorWorlds
â˘âŻ Mirror worlds are informationally-enhanced virtual models or
âreflectionsâ of the physical world.
â˘âŻ Google Earth, MS StreetView, Google Maps
35. Summary
â˘âŻAugmented Reality has three key features
â˘âŻCombines Real andVirtual Images
â˘âŻInteractive in real-time
â˘âŻRegistered in 3D
â˘âŻAR can be classified alongside other technologies
â˘âŻInvisible Interfaces
â˘âŻMilgramâs Mixed Reality continuum
â˘âŻStephensonâs MetaVerse
42. Early Industrial Research
â˘âŻEarly 1990âs: Boeing coined the term âAR.â Wire
harness assembly application begun (T. Caudell, D. Mizell).
â˘âŻEarly to mid 1990âs: UNC ultrasound visualization project
43. EarlyAcademic Research
â˘âŻ1994: Motion stabilized display [Azuma]
â˘âŻ1995: Fiducial tracking in video see-through [Bajura]
â˘âŻ1996: UNC hybrid magnetic-vision tracker
44. SpreadingAR Research
â˘âŻ1996: MIT Wearable Computing efforts
â˘âŻ1998: Dedicated conferences begin
â˘âŻLate 90âs: Collaboration, outdoor, interaction
â˘âŻLate 90âs:Augmented sports broadcasts
â˘âŻ1998 - 2001: Mixed Reality Systems Lab
46. Evolution of MobileAR
Wearable AR
Handheld
AR Displays
Camera phone
1995 1997 2001 2003 2004
Camera phone
- Self contained AR
Wearable
Computers
PDAs
-Thin client AR
PDAs
-Self contained AR
Camera phone
- Thin client AR
48. HandheldAR Display -Tethered
1995, 1996 Handheld AR
â˘âŻ ARPad, Cameleon
â˘âŻ Rekimotoâs NaviCam,Transvision
â˘âŻTethered LCD
â˘âŻPC Processing and Tracking
49. NaviCam (Rekimoto,1995)
Information is registered to
real-world context
â˘âŻ Hand held AR displays
Interaction
â˘âŻ Manipulation of a window
into information space
Applications
â˘âŻ Context-aware information displays
50. NaviCamArchitecture
Jun Rekimoto and Katashi Nagao, "TheWorld through the Computer: Computer
Augmented Interaction with RealWorld Environments", User Interface Software and
Technology (UIST '95)
51. MobileAR:Touring Machine (1997)
â˘âŻUniversity of Columbia
â˘âŻFeiner, MacIntyre, HĂśllerer,Webster
â˘âŻCombines
â˘âŻSee through head mounted display
â˘âŻGPS tracking
â˘âŻOrientation sensor
â˘âŻBackpack PC (custom)
â˘âŻTablet input
54. PCI 3D Graphics Board
Hard Drive
Serial
Ports
CPU
PC104 Sound Card
PC104 PCMCIA
GPS
Antenna
RTK correction Antenna
HMD
Controller
Tracker
Controller
DC to DC
Converter
Battery
Wearable
Computer
GPS RTK
correction
Radio
Example self-built working
solution with PCI-based 3D graphics
Columbia Touring Machine
Mobile AR - Hardware
55. First Camera Phone
â˘âŻ 1997 Philip Kahn invents camera phone
â˘âŻ 1999 First commercial camera phone
Sharp J-SH04
56. Millions of Camera Phones
0
200
400
600
800
1000
1200
2002 2003 2004 2005 2006 2007 2008 2009 2010
DSC
Phone
58. 2003 ARphone (Univ. of Sydney)
â˘âŻ Transfer images via Bluetooth (slow â 30 sec/image)
â˘âŻ Remote processing â AR Server
â˘âŻ
â˘âŻ
Mobile PhoneAR âThin Client
59. Early Phone ComputerVisionApps
2003 â Mozzies Game - Best mobile game
Optical motion flow detecting phone orientation
Siemens SX1 â Symbian, 120Mhz,VGA Camera
2005 â Marble Revolution (Bit-Side GmbH)
Winner of Nokia's Series 60 Challenge 2005
2005 â SymBall (VTT)
60. HandheldAR â Self Contained
2003 PDA-based AR
â˘âŻ ARToolKit port to PDA
â˘âŻ Studierstube ported to PDA
â˘âŻ AR Kanji Educational App.
â˘âŻ MrVirtuoso AR character
â˘âŻ Wagnerâs Invisible Train
â˘âŻ Collaborative AR
61. Mobile PhoneAR â Self Contained
2004 Mobile Phone AR
â˘âŻMoehring, Bimber
â˘âŻHenrysson (ARToolKit)
â˘âŻCamera, processor, display together
62. AR Enters Mainstream (2007- )
â˘âŻMagazines
â˘âŻMIT Tech. Review (Mar 2007)
â˘âŻ 10 most exciting technologies
â˘âŻEconomist (Dec. 2007)
â˘âŻ Reality, only better
â˘âŻGames
â˘âŻSony âEye of Judgementâ
â˘âŻ 300,000+ units shipped
â˘âŻBroadcast TV
â˘âŻSports broadcasting
64. Browser BasedAR (2008 - )
â˘âŻFlash + Camera + 3D graphics
â˘âŻHigh impact
â˘âŻHigh marketing value
â˘âŻLarge potential install base
â˘âŻ1.6 Billion web users
â˘âŻEase of development
â˘âŻLots of developers, mature tools
â˘âŻLow cost of entry
â˘âŻBrowser, web camera
65. MobileAR (2005 - )
â˘âŻMobile Phones
â˘âŻCamera, processor, display
â˘âŻComputer vision based AR
â˘âŻAdvertising
â˘âŻHIT Lab NZ (2007)
â˘âŻAR print advertisement
â˘âŻTxt to download app
66. Mobile OutdoorAR (2009 - )
â˘âŻMobile phones with GPS
â˘âŻTag real world locations
â˘âŻGPS + Compass input
â˘âŻOverlay graphics data on live video
â˘âŻApplications
â˘âŻTravel guide,Advertising, etc
â˘âŻWikitude, Layar, Junaio, etc..
â˘âŻAndroid/iOS based, Public API released
Motorola Droid
70. Wearable Computing
âŞâŻComputer on the body that is:
âŞâŻAlways on
âŞâŻAlways accessible
âŞâŻAlways connected
âŞâŻOther attributes
âŞâŻAugmenting user actions
âŞâŻAware of user and surroundings
75. â˘âŻVuzix M100
â˘âŻ $1000
â˘âŻRecon Jet
â˘âŻ $600, more sensors, sports
â˘âŻOptinvent ORA
â˘âŻ 500 Euro, multi-view mode
â˘âŻEpson Moverio BT-200
â˘âŻ $700 Binocular, stereoscopic 3D
Display Competitors
76. ARToday
â˘âŻKey Technologies Available
â˘âŻRobust tracking (ComputerVision, GPS/sensors)
â˘âŻDisplay (Handheld, HMDs)
â˘âŻInput Devices (Kinect, etc)
â˘âŻDeveloper tools (PTC,Wikitude)
â˘âŻCommercial Business Growing
â˘âŻThousands mobile AR apps
â˘âŻGaming, GPS/Mobile, Online Advertisement
â˘âŻ>$5 Billion USD by 2016 (Markets andMarkets)
â˘âŻ>$600 Million USD in Mobile AR in 2014 (Juniper Research)
88. Summary
â˘âŻAugmented Reality has a long history going
back to the 1960âs
â˘âŻInterest in AR has exploded over the last few
years and is being commercialized quickly
â˘âŻSmart Phones with sensors/cameras
â˘âŻMobile AR is growing in a number of areas
â˘âŻGaming,Tourism, Marketing experiences