Recommended
Recommended
More Related Content
Similar to AES Berlin 2017
Similar to AES Berlin 2017 (20)
Recently uploaded
Recently uploaded (20)
AES Berlin 2017
- 1. Evolving VR Trends and Audio Solutions Henney Oh, Ph.D.May 20 2017142nd International Convention AES BERLIN 2017
- 2. | 2 • Who we are • Our past and current work in the VR industry • Trends and open issues My talk covers
- 3. | 3 Who are we?
- 4. | 4 MPEG-H 3D Audio
- 5. | 5 Project Gaudi - Named after Antoni Gaudí, prodigious Spanish architect - MPEG 108 meeting held in Valencia, Spain in April 2014 Binaural Rendering Engine MPEG-H Technology + Interactivity VR Headsets
- 6. | 6 • Building end-to-end solutions from scratch: Renderer ▶ Production tools ▶ Delivery format ▶ Workflow ▶ … • Project Gaudi → Company Gaudio → • Securing funding • Growing the team: 28 total (6 Ph.D.’s and 2 Master’s in audio) • Moving: Seoul → LA
- 7. | 7 G’Audio Solutions 360 Works is a spatial audio plugin for Digital Audio Workstations that empowers creatives to design realistic and immersive entertainment experiences, bringing cinematic and 360 video projects to life. Sol is a high performance 3D audio renderer designed to play cinematic VR and 360 videos in the most immersive, interactive, and lifelike way possible. Full VR Craft is a spatial audio plugin for 3D game engines that effortlessly intensifies realistic sound modeling with minimal CPU requirements. Sound Capturing Production Consumption Post-production Transmission Playing / Rendering (Mixing , mastering) 360 Video GAO
- 8. | 8 Interactive 3D Audio Plugin for DAWs
- 9. | 9 A sound scene is best represented with a combination of the 3 following formats Mixed format representation Channel Ambisonics Object
- 10. | 10 Other FOA Players Interactive 3D Audio Plugin for DAWs Any 360 Video Player Object, Channel, Ambisonics GAO FOA
- 11. | 11 • Software SDK integrable with any platform • Supports GAO (Object, Channel, Ambisonics) • Low complexity enables mobile use Premium binaural renderer for Cinematic VR Other plugins or Ambisonics recordings Any 360 Video PlayerGAO FOA
- 12. | 12 Works & Sol Other FOA Players Other plugins or Ambisonics recordings Any 360 Video PlayerGAO FOA FOA
- 13. | 13 Interactive 3D Audio Plugin for Game Engines • Consistent sound experience • Integrable with existing projects • Universal compatibility
- 14. | 14 Why Los Angeles?
- 16. | 16 What have we done?
- 17. | 17 Promoting how important audio is in VR !
- 18. | 18 Pouring information online about how important audio is in VR!
- 19. | 19 Demo Demo Demo
- 20. | 20 Trends & Open Issues
- 21. | 21 #1. Rapidly shifting to 6DOF content 3DOF 6DOF
- 22. | 22 • Audio engineers want to be able to mix inside an HMD • Also want to use multiple tools at the same time • Need for 6DOF Content Creation Tool #2. Desire for effective creation tool Sound Studio Digital Audio Workstation Linear / Non-interactive Sound Engineer Game Studio Game Engine Non-linear / Interactive Software Engineer 6DOF Full VR3DOF 360 Video2D Legacy Sound Studio Digital Audio Workstation Linear / Interactive Sound Engineer ?
- 23. | 23 #3. Growing demand for live 360 Consumer / Social Sports Music Concerts News / Documentary
- 24. | 24 #4. Emerging VR music http://blog.gaudiolab.com/index.php/2017/05/16/reinventing-music-with-vr-personal-and- interactive-audio-in-full-3d-space/
- 25. | 25 #5. Resolving VR monitoring issues Resistance Conventional VR • Hard to wear all day • Not as well facilitated • No reference headphones
- 26. | 26 • Currently no standard / universal format • The best format for VR audio will be Object + Channel + Ambisonics #6. Format for VR audio ChannelObject Ambisonics MPEG-H GAO
- 27. www.gaudiolab.com | info@gaudiolab.com | 555 W 5th St, 35th Fl., Los Angeles, 90013, CA