O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

VR/AR needs to be multi-modal and multi-format

315 visualizações

Publicada em

Multi-Format VR and AR
Video at https://www.youtube.com/watch?v=4tRmDDM8lTs
You can download the free book on Spatial Augmented Reality at http://raskar.info/book/

Publicada em: Tecnologia

VR/AR needs to be multi-modal and multi-format

  1. 1. Spatial Augmented Reality | Raskar | MIT Media Lab Ramesh Raskar MIT Media Lab Cambridge, MA Spatial Augmented Reality: Overlay Inserting in the Real World
  2. 2. Spatial Augmented Reality | Raskar | MIT Media Lab Multi-ModeMulti-Format
  3. 3. Spatial Augmented Reality | Raskar | MIT Media Lab Multi-ModeMulti-Format
  4. 4. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) Augmented Human: Beyond X-ray vision © Andrei State
  5. 5. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Sense beyond human ability Abstract Present within human comprehensibility
  6. 6. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction
  7. 7. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Henry FuchsCyborg, Bionic Eye, HMD
  8. 8. Spatial Augmented Reality | Raskar | MIT Media Lab Bits Photons CV/Machine Learning Optics Sensors Computational Imaging Computational Photography AR – Imaging Centric View Signal Processing Light Transport Displays
  9. 9. Spatial Augmented Reality | Raskar | MIT Media Lab MR Laboratory’s COASTAR HMD (Co-Optical Axis See-Through Augmented Reality) Parallax-free video see-through HMD Camera + Viewmaster LCD Display
  10. 10. Spatial Augmented Reality | Raskar | MIT Media Lab MicroOptical display Courtesy: Sam Ogden Nomad display Courtesy: Microvision Courtesy: Azuma 1995 Near Eye Displays
  11. 11. Spatial Augmented Reality | Raskar | MIT Media Lab Real world, Tracking free, Gear free, Multi person, All 3D Cues
  12. 12. Spatial Augmented Reality | Raskar | MIT Media Lab Head-mounted Display Projectors © Andrei State Multi-Mode Augmented Reality
  13. 13. Spatial Augmented Reality | Raskar | MIT Media Lab hand-held display spatial see-through display head- mounted display retinal display Head-attached Body-attached spatial projector Spatial Augmented Reality 1998 Multi-Mode AR Real Object
  14. 14. Spatial Augmented Reality | Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination InteractionVirtual Motion ShaderLamps 1997 - 2000
  15. 15. Spatial Augmented Reality | Raskar | MIT Media Lab Virtual Reflectance Virtual Illumination Lamps for Colorfully Shading the World 1997 - 2000
  16. 16. Spatial Augmented Reality | Raskar | MIT Media Lab Shader Lamps on a Saturn
  17. 17. Spatial Augmented Reality | Raskar | MIT Media Lab Guerilla Marketing FHM Magazine
  18. 18. Spatial Augmented Reality | Raskar | MIT Media Lab VienViewer (Luminetx) Near-IR camera locates subcutaneous veins and project their location onto surface of the skin. Coaxial IR camera + Projector
  19. 19. Spatial Augmented Reality | Raskar | MIT Media Lab Hong Hua, U of Arizona Projective HMD Jannick Rolland (U. Central Florida) Frank Biocca (Michigan St. U.)
  20. 20. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Self-ID (barcodes)
  21. 21. Spatial Augmented Reality | Raskar | MIT Media Lab AR Issues • Preprocessing: – Authoring • Runtime: – Identification: Recognition of objects • Using markers and visual tags – Registration: Finding relative pose of display device • Dynamic estimate of translation and rotation • Render/Warp images – Interaction: • Widgets, Gesture recognition, Visual feedback
  22. 22. Spatial Augmented Reality | Raskar | MIT Media Lab Siggraph 2004 Where are products about to expire ?
  23. 23. Spatial Augmented Reality | Raskar | MIT Media Lab ARToolKit [Kato and Billinghurst 1999] ARTag [Fiala 2005] Self-ID via Barcodes for Camera Phones
  24. 24. Spatial Augmented Reality | Raskar | MIT Media Lab Bokode
  25. 25. Spatial Augmented Reality | Raskar | MIT Media Lab Defocus blur of Bokode
  26. 26. Spatial Augmented Reality | Raskar | MIT Media Lab Pieces of the Puzzle Actuated Surfaces Actuated Workbench [Pangaro, Maynes-Aminzade, Ishii UIST 2002]
  27. 27. Spatial Augmented Reality | Raskar | MIT Media Lab Bits Photons CV/Machine Learning Optics Sensors Computational Imaging Computational Photography AR Centric View Signal Processing Light Transport Displays
  28. 28. Spatial Augmented Reality | Raskar | MIT Media Lab Augmented Reality (AR) World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Self-ID
  29. 29. Spatial Augmented Reality | Raskar | MIT Media Lab Materials: Displays Contenders Organic LED Light Emitting Polymers E-Ink
  30. 30. Spatial Augmented Reality | Raskar | MIT Media Lab Dream Material: Sticky Pixels Project Once, pixels persist, day/night Phosphorescent Photochromic + Saakes, Chiu, Hutchinson, Naoya, Inami, Raskar 2010, slowdisplay.org
  31. 31. Spatial Augmented Reality | Raskar | MIT Media Lab Oliver Bimber Projecting on Holograms Hologram Projected + Hologram
  32. 32. Spatial Augmented Reality | Raskar | MIT Media Lab Spatial Augmented Reality World Input Process Output World Camera, Location Sensors Identify, Track, Abstract Display, Overlay Interaction Shape & Appearance Morphing Self-Id
  33. 33. Spatial Augmented Reality | Raskar | MIT Media Lab John Fan Don’t overwhelm Pattie Maes: Monocle Hiroshi Ishii Tangible Bits Mark Billinghurst Fundamentals! Steve Feiner 50 Years since Sutherland
  34. 34. Spatial Augmented Reality | Raskar | MIT Media Lab Poor Man’s Palace
  35. 35. Spatial Augmented Reality | Raskar | MIT Media Lab Poor Man’s Palace Augment the world, projectors and proxy geometry, controlling light every millimeter at every millisecond.
  36. 36. Spatial Augmented Reality | Raskar | MIT Media Lab hand-held display spatial see-through display head- mounted display retinal display Head-attached Body-attached spatial projector Spatial Augmented Reality 1998 Multi-Mode AR Real Object
  37. 37. Spatial Augmented Reality | Raskar | MIT Media Lab Acknowledgements • Camera Culture Group, MIT Media Lab • MERL • Amit Agrawal, Ashok Veeraraghavan, Ankit Mohan, Jack Tumblin, Jeroen van Baar, Paul Beardsley, Remo Ziegler, Thomas Willwacher, Srinivas Rao, Cliff Forlines, Paul Dietz, Joe Marks, Darren Leigh • Office of the Future group at UNC Chapel Hill • Greg Welch, Kok-lim Low, Deepak B’padhyay, Aditi Majumder, Michael Brown, Ruigang Yang • Henry Fuchs, Herman Towles • Wei-chao Chen • Organizers • + John Werner
  38. 38. Spatial Augmented Reality | Raskar | MIT Media Lab Spatial Augmented Reality • Special Effects in Real World – Poor Man’s Palace – Beyond Flat Displays – Upgrade the world • Tools – Untethered solution for fusion – Geometry, Photometry, Id – Sense, Control, Compensate – Projectors, RFID, Sensors • Open Problems – All senses: haptic, olfactory, proprioception – Natural phenomenon, complex BRDF, other displays – Signal Processing: Efficient overlays exploiting rank – Materials: display, sticky pixels • Next Challenge: Photorealistic AR around us

×