Augmented Reality: Technology and Applications

1. Augmented Reality: Technology & Applications
Jithu Sunny
November 20, 2011
Jithu Sunny Augmented Reality: Technology & Applications

2. What is Augmented Reality?
Jithu Sunny Augmented Reality: Technology & Applications

3. What is Augmented Reality?
A Picture is worth a 1000 words..!
Jithu Sunny Augmented Reality: Technology & Applications

4. What is Augmented Reality?
A Picture is worth a 1000 words..!
Figure: Wikitude drive, an Augmented Reality Navigation system for
smart phones.
Jithu Sunny Augmented Reality: Technology & Applications

5. Overview of Session
Description
Hardware
How Stuff Works?
Software & Algorithms
A Sample Algorithm
Software Toolkits
Applications
Future
Conclusion
Q&A and TY!
Jithu Sunny Augmented Reality: Technology & Applications

6. Formal Description
Augmented reality (AR) is a term for a live direct or an
indirect view of a physical, real-world environment whose
elements are augmented by computer-generated sensory
input such as sound, video, graphics or GPS data.
Artificial information about the environment and its objects
can be overlaid on the real world.
Enhances ones current perception of reality.
By contrast, virtual reality replaces the real world with a
simulated one.
Jithu Sunny Augmented Reality: Technology & Applications

7. Hardware
- Processor, camera, display & sensors such as accelerometer, GPS,
solid state compass.
Display
HMD
Handheld
Spatial
Tracking
Input Devices
Jithu Sunny Augmented Reality: Technology & Applications

8. Display Technique
Head Mounted Display(HMD)
Places AR over the
user’s view of the world.
Either optical seethrough
or video seethrough.
Optical see-through
employs half-silver mirrors
to pass images through
the lens and overlay
information to be reflected
into the user’s eyes.
Increased immersive
experience.
Jithu Sunny Augmented Reality: Technology & Applications

9. Display Techniques
Handheld Devices
A small
display in user’s hand.
Apt for portability
and video see-through.
Disadvantage
is that in most cases user
have to hold the device
out in front of them.
Jithu Sunny Augmented Reality: Technology & Applications

10. Display Techniques
Spatial Augmented Reality
Uses digital projectors to display graphical information on
physical objects.
The tangible nature of SAR provides the passive haptic
sensation.
The user is not required to carry equipment or wear the
display over their eyes.
This makes it a perfect candidate for collaboration.
MIT-ian Pranav Mistry’s Sixth sense is all about SAR.
Jithu Sunny Augmented Reality: Technology & Applications

11. Pranav Mistry Sixth Sense
Figure: Pranav Mistry, Sixth Sense Technology
Jithu Sunny Augmented Reality: Technology & Applications

12. Tracking
Tracking is following.
May use: Digital cameras, accelerometers, GPS, gyroscopes,
compasses, RFID, wireless sensors.
The users can interact with the system using Pinch gloves.
In Sixth sense the finger caps is basically pinch gloves.
Jithu Sunny Augmented Reality: Technology & Applications

13. Dream come true..!
Jithu Sunny Augmented Reality: Technology & Applications

14. Dream come true..!
Jithu Sunny Augmented Reality: Technology & Applications

15. Dream come true..!
Jithu Sunny Augmented Reality: Technology & Applications

16. How stuff works? - Overview
1 Capture video of the real world.
2 Search through each video frame for markers/target object.
3 Calculate the position of the camera relative to the marker.
4 Draw a computer graphics model from that position.
5 Model is drawn on top of the video of the real world and so
appears stuck on the marker.
6 The final output is shown back in the display.
Jithu Sunny Augmented Reality: Technology & Applications

17. Sample Algorithm
Jithu Sunny Augmented Reality: Technology & Applications

18. Sample Algorithm Contd.
Jithu Sunny Augmented Reality: Technology & Applications

19. Software Toolkits
ARToolKit, an open source (dual-license: GPL, commercial)
C-library to create augmented reality applications; was ported
to many different languages and platforms like Android, Flash
or Silverlight.
ArUco, a minimal library for augmented reality applications
based on OpenCv; licenses: BSD, Linux, Windows mixare,
Open-source (GPLv3) augmented reality engine for Android
and iPhone.
OpenMAR, Open Mobile Augmented Reality component
framework for the Symbian platform, released under EPL
Jithu Sunny Augmented Reality: Technology & Applications

20. Applications
Jithu Sunny Augmented Reality: Technology & Applications

21. Applications
Advertising
Task support - Surgery, Underground pipe layout, see the
fetus inside the womb..!
Navigation
Industrial - simulate models, reduce real time prototypes.
Military and emergency services - provide info such as
maps, enemy locations, etc.
Architecture - simulate planned construction projects.
Entertainment and education - virtual objects, immersive
ambience, deepen the level of perception.
Jithu Sunny Augmented Reality: Technology & Applications

22. AR in Hollywood!
Jithu Sunny Augmented Reality: Technology & Applications

23. Future
Augmented reality has the potential to change the way
we see the world in future.
Jithu Sunny Augmented Reality: Technology & Applications

24. Future
Augmented reality has the potential to change the way
we see the world in future.
Jithu Sunny Augmented Reality: Technology & Applications

25. Conclusion
Has the potential
Undergoing active development.
Open libraries like ARToolKit.
Yet to witness applications that are so cool AND convenient.
Jithu Sunny Augmented Reality: Technology & Applications

26. References
Sorce, S.; Augello, A.; Santangelo, A.; Gentile, A.; Genco, A.;
Gaglio, S.; Pilato, G.; Interacting with Augmented
Environments Pervasive Computing, IEEE Journals 2010
Livingston, Mark A.; Behringer, Reinhold; Kato, Hirokazu;
Drummond, Tom; Guest Editors’ Introduction: Special
Section on The International Symposium on Mixed and
Augmented Reality (ISMAR) Visualization and Computer
Graphics, IEEE Journals 2009
Henderson, S.; Feiner, S.; Opportunistic Tangible User
Interfaces for Augmented Reality Visualization and Computer
Graphics, IEEE Journals 2010
Harders, M.; Bianchi, G.; Knoerlein, B.; Szekely, G.;
Calibration, Registration, and Synchronization for High
Precision Augmented Reality Haptics Visualization and
Computer Graphics, IEEE Journals 2009
Wikipedia.org http://www.wikipedia.org/
Jithu Sunny Augmented Reality: Technology & Applications

27. Jithu Sunny Augmented Reality: Technology & Applications

28. Jithu Sunny Augmented Reality: Technology & Applications