Augmented TelePortation
•
1 gostou•1,030 visualizações
This is a presentation on how Augmented Reality can be used for new types of remote collaboration, given by Mark Billinghurst at the AWE 2018 conference on May 30th 2018.
Recomendados
Recomendados
Mais conteúdo relacionado
Mais procurados
Mais procurados (20)
Semelhante a Augmented TelePortation
Semelhante a Augmented TelePortation (20)
Mais de Mark Billinghurst
Mais de Mark Billinghurst (20)
Último
Último (20)
Augmented TelePortation
- 1. AUGMENTED TELEPORTATION Mark Billinghurst University of South Australia
- 2. Face to Face Collaboration
- 3. Face to Face Collaboration Task Space Communication Space
- 4. Technology Supported Collaboration Task Space Communication Space
- 6. Communication Seam • da Task Space Communication Space
- 7. Augmented Reality Collaboration • Using AR to break communication seams • Natural conversation • Gesture/gaze cues • Task space subset of communication space Task Space Communication Space
- 8. AR For Remote Conferencing • Bringing remote users into the real world Room2Room ObjectTheory HoloPortation
- 10. Changing Perspective • View from remote user’s perspective • Wearable Teleconferencing • audio, video, pointing • send task space video • CamNet (1992) • British Telecom • Similar CMU study (1996) • cut performance time in half
- 11. Google Glass • Camera + Processing + Display + Connectivity • Ego-Vision Collaboration (But with FixedView)
- 13. Current Collaboration onWearables • First person remote conferencing/hangouts • Limitations • View fixed to sender, Lack of spatial understanding • Few communication cues, Limited situational awareness
- 14. Social Panoramas (2014) • Capture and share social spaces in real time • Supports independent views into Panorama
- 15. Implementation • Google Glass • Capture live image panorama (compass + camera) • Remote device (tablet) • Immersive viewing, live annotation
- 16. User Interfaces Glass View Tablet View
- 18. Inexpensive 360 Cameras Kodak 360 Fly 360 Gear 360 Theta S Nikon LG 360 Pointgrey Ladybug Panono 360 Bublcam
- 20. Shared Sphere System Features • AR / VR view collaboration • VR user feels that they are in AR users location • View independence • Allow one user to look around independently from another • View awareness cues • Show where the other user is looking • Hand gesture communication cues • Sharing hand gesture cues
- 24. View Independence Guest user’s view
- 25. View Independence Guest user’s view
- 26. View Awareness Cues • View Frame Rectangle • Optional high-resolution camera inset on guest user Guest user’s viewHost user’s view
- 27. View Awareness Cues • Arrow indicating the view frame out of FOV Guest user’s view
- 28. View Awareness Cues • Arrow size proportional to the angular distance Host user’s view
- 29. Hand Gestures • One of the key non-verbal communication cues Guest user’s view Host user’s view
- 30. Hand Gestures
- 32. Shared Sphere Version 2.0 (2018) • Features added • Remote pointing • Remote annotation • Audio streaming • Backpack VR setup • HoloLens AR display • HTC Vive VR display • Improved capture hardware • Testing with industry
- 34. Technology Trends • Advanced displays • Wide FOV, high resolution • Real time space capture • 3D scanning, stitching, segmentation • Natural gesture interaction • Hand tracking, pose recognition • Robust eye-tracking • Gaze points, focus depth • Emotion sensing/sharing • Physiological sensing, emotion mapping
- 35. Empathy Glasses (2016) • Combine together eye-tracking, display, face expression • Implicit cues – eye gaze, face expression ++ Pupil Labs Epson BT-200 AffectiveWear
- 39. Technology Trends • Advanced displays • Real time space capture • Natural gesture interaction • Robust eye-tracking • Emotion sensing/sharing Augmented Teleportation
- 40. Conclusions and Future Work • Augmented Teleportation • Using AR to remove communication seams • View independence and awareness cues • Using natural communication cues (drawing, pointing, etc) • Future work • Richer non-verbal communication cues (eye gaze, face exp.) • Scaling up to 1-to-many sharing • Better scene capture – 3D capture