SlideShare uma empresa Scribd logo
1 de 22
Baixar para ler offline
INNOVATING WITH AMD
MULTIMEDIA TECHNOLOGIES
AMIT MOOKERJEE
SENIOR MANAGER, MEDIA SOFTWARE SOLUTIONS, AMD
CARL WAKELAND
FELLOW DESIGN ENGINEER, AMD
AMD Media SDK
Enabling Developers to Provide the
Best Multimedia Experiences on the
AMD platform
Multimedia Experiences on AMD
Video Editing/Transcode

Cloud Gaming

Wireless Display

Video Conferencing

Remote Desktop

Video Playback

3 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
AMD MULTIMEDIA SOFTWARE STACK
Applications

ISV

ISV

MFT

MFT

ISV

MFT

Media SDK

AMD Media Framework (AMF)

DirectX

OpenCL

Driver
AMD HW
4 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

OpenGL
MEDIA SDK1.0 SUMMARY
MFTs for leveraging Media HW accelerator blocks for video encoding/decoding

Video Quality MFT for video pre/post processing

AMF-DEM library for use in low latency applications
Support for Windows 7/8 Desktop as well as Windows 8 Store Application*

* AMF-DEM library only supports classic desktop applications

5 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
MEDIA SDK1.0 VALUE FOR DEVELOPERS
 Leverage AMD’s industry leading multimedia IP
‒ Leverage well known video processing features like AMD Steady VideoTM
‒ Leverage the unique VCE-DEM feature on AMD APUs/dGPUs in low latency applications
like wireless display and remote desktop

 Optimal use of Heterogeneous Compute in Multimedia Apps
‒ eg. Buffer sharing on GPU, DX to OpenCL inter-op

 Reduce Time to Market for Multimedia ISVs
‒ Optimized sample code for targeted application use cases
‒ Developer collateral and support via forum

6 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
MEDIA SDK ROADMAP
Q4

Q1

Q2

Q3

APU13

2013

2014
Media
SDKv1.0
Beta

Media
SDKv1.0
GA

Media
SDKv1.1

Nov

Jan

Jun

MediaSDKv1.0:

MediaSDKv1.1:

-

-

-

Video quality MFT for
video processing
AMF-DEM library for low
latency apps
Windows 8 Store
Support

7 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

-

AMF library for video
encode/decode/processing
Multi-GPU support
Cloud gaming support

Q4
Beta Announcement
&
Demos
ADDITIONAL INFORMATION
Fast, easy mobile computing and gaming; Victor Chin @ Splashtop; 2:45-3:30pm, Nov 12

ScreenMirror – A Unified screen mirroring solution; Nao Yoshikawa @ ArcSoft;11:0011:45am,Nov 12
Miracast with AMD Wireless Display Technology; Daryl Sartain @ AMD ; 5:00-5:45pm,Nov 12

RapidFire API; Dmitry Kozlov @ AMD ; 4:00-4:45pm, Nov 12
Bay Area Multimedia Meetup - http://www.meetup.com/Bay-Area-MultimediaMeetup-Group/

9 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
AMD TRUEAUDIO
PROCESSOR
CARL WAKELAND
FELLOW DESIGN ENGINEER, AMD
BENEFITS OF AMD TRUEAUDIO ACCELERATION FOR GAMERS
 Raising the bar for the audio gaming experience on
PC
‒ More audio objects and higher-resolution sound
environments, with minimal workload added to the CPU
‒ Eliminate the workload uncertainty factor sound designers
have when relying completely on CPU-based offload
‒ TrueAudio provides a baseline of bonus audio processing
throughput that sound designers can add to their typical
10% CPU utilization budget

 Enhanced headset experience
‒ Implement enhanced environmental 3D object positioning
using position information from the game engine
‒ TrueAudio works inside the game application itself. OS
audio stack is not involved
** All features above are dependent on 3rd Party ISVs such as game developers, audio middleware, etc..
11 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
OTHER POTENTIAL TRUEAUDIO USES
 Content management
‒Audio search pre and post-processing
‒ Quickly navigate through hundreds of sounds to
find just the one you want
‒ Pick distinct songs out of your library just by
pointing the mouse and listening

 Professional Audio Processing
‒Client digital audio workstation
applications
‒Use TrueAudio to accelerate :
‒ Music creation with complete control over
every aspect of the sound and add custom
effects
‒ Add dozens of layers of sound, music and
dialogue to your movie masterpiece
** All features above are dependent on 3rd Party ISVs, audio middleware, etc..

12 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
AMD TRUEAUDIO HARDWARE ARCHITECTURE
Tensilica HiFi EP Subsystem

Bus Routing and Bridging

DSP0

Address Translation

Interrupt Routing

GPU Interrupt

Clock/Reset/Pwr Control
I-Cache
32KB

D-Cache
32KB

8 KB
Scratch
RAM

AMD TRUEAUDIO Registers
Semaphore I/F

Sync
Memory

Client/Target MMIO

MMIO

Debug

JTAG

Bus Bridging

Tensilica HiFi EP Subsystem
Address Translation

DSP1
I-Cache
32KB

D-Cache
32KB

8 KB
Scratch
RAM

Routing and Arbitration

Streaming DMA Engine

Address Translation

Memory Bus Interface with scattergather Translation Apertures

Tensilica HiFi EP Subsystem
DSP2
I-Cache
32KB

D-Cache
32KB

8 KB
Scratch
RAM

13 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

384 K Shared Instruction/Data RAM

Memory
AMD TRUEAUDIO DSP FEATURES
Tensilica HiFi EP Subsystem

 Tensilica HiFi EP instruction set

DSP0
I-Cache
32KB

D-Cache
32KB

8 KB
Scratch
RAM

Tensilica HiFi EP Subsystem

D-Cache
32KB

 Tensilica Xtensa SP float support, DP assistance
(also supports some transcendentals)
 32 KB instruction and data caches

 8 KB of scratch RAM used for fast local operations

DSP1
I-Cache
32KB

 Three Audio Optimized DSP cores

8 KB
Scratch
RAM

Tensilica HiFi EP Subsystem

 External power/clock management for clock
freq/voltage
(up to 900 MHz)

DSP2
I-Cache
32KB

D-Cache
32KB

8 KB
Scratch
RAM

14 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
AMD TRUEAUDIO SPECIFIC HARDWARE FEATURES
 Streaming DMA engine
‒ Multichannel with
programmable descriptors, IOC
‒ Scatter gather architecture

 Internal Shared memory
‒ 384 KB of shared internal
memory, 8 KB banks
‒ Independently arbitrated for
con concurrent access of DMA
and each DSP

Bus Routing and Bridging

‒ Up to 64 MB addressable space
in frame buffer

GPU Interrupt

Address Translation
Clock/Reset/Pwr Control
AMD TRUEAUDIO Registers
Semaphore I/F

Sync
Memory

Client/Target MMIO

MMIO

Debug

JTAG

Bus Bridging

Address Translation

 Bus interface to frame
buffer/system memory
‒ High performance, low latency
access to frame buffer memory

Interrupt Routing

Routing and Arbitration

Streaming DMA Engine

Address Translation

Memory Bus Interface with scattergather Translation Apertures

‒ Windowed into internal AMD
TRUEAUDIO system memory
space

15 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

384 K Shared Instruction/Data RAM

Memory
AUDIO ALGORITHMS COMPLETED AND IN DEVELOPMENT
 AMD is engaged with tools and plugin developers to accelerate the following
with TrueAudio:
‒AudioKinetic
‒ Convolution reverb
‒ GenAudio AstoundSound RTI positional audio

‒FMOD
‒ FMOD Reverb
‒ ML1 Limiter from McDSP

‒ Others to be announced

16 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
ACCESSING AMD TRUEAUDIO FUNCTIONALITY FROM APPLICATIONS
Apps & Game Engines
w/ Middleware
Support

Game Engines w/
Integrated Sound
Engine

Middleware API

Audio Middleware
Higher-Level API

Optional API Abstraction
Layer(s)

AMD Audio
API

TrueAudio User-mode Services Library

17 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

AMD Audio
API

 Audio Middleware
‒ Audio Middleware is responsible
for audio engine framework
‒ Audio algorithms typically ship
with middleware - these can be
accelerated with TrueAudio
accessible through AMD Audio
API

 Game Engines
‒ Game engines can integrate
sound engine, but most work
with audio middleware vendors
such as FMOD, AudioKinetic
TRUEAUDIO ENABLEMENT FOR DEVELOPERS
 3rd Party Middleware
Integration
‒ Less integration
work required
‒ Use existing high level
Middleware API to
accelerate plugins w/
TrueAudio

 Choose from native
middleware plugins or 3rd party
‒ Middleware
licensing
required

18 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

Game Engine

Middleware API
Middleware
Plugins
(ie. FMOD,
AudioKinetic)

3rd Party Plugins
(ie. McDSP)

Middleware
AMD Audio API

AMD TrueAudio
AUDIO DATA FLOW & OUTPUT SUPPORT

Application / Game

Audio Middleware
Effects & Algorithms

AMD
TRUEAUDIO

19 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

Sound
Card
Driver

OS Driver Stack

Audio
Assets

3.5mm Audio Jack

USB
Audio
Driver

USB

HDMI/D
P Audio
Driver

HDMI/DP
SUMMARY
 Programmable audio pipeline grants artistic
freedom to game audio engineers for sound
processing
 Easy to access through popular audio libraries
used by top game developers
 Fundamentally redefines the nature of a
modern PC graphics card
 Spatialization, reverb, mastering limiters and
simultaneous voice decode are only the
beginning

20 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
DISCLAIMER & ATTRIBUTION
The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical
errors.
The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and
roadmap changes, component and motherboard version changes, new model and/or product releases, product differences between differing
manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. AMD assumes no obligation to update or otherwise correct or
revise this information. However, AMD reserves the right to revise this information and to make changes from time to time to the content hereof
without obligation of AMD to notify any person of such revisions or changes.
AMD MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY
INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION.
AMD SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL
AMD BE LIABLE TO ANY PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY
INFORMATION CONTAINED HEREIN, EVEN IF AMD IS EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES.
ATTRIBUTION
© 2013 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo and combinations thereof are trademarks of Advanced Micro
Devices, Inc. in the United States and/or other jurisdictions. Windows is a registered trademark of Microsoft Corporation. Other names are for
informational purposes only and may be trademarks of their respective owners.
21 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
DISCLAIMER & ATTRIBUTION
Images used in this presentation are courtesy of CyberLink, Irrational Games and Square Enix
©2013 Take - Two Interactive Software, Inc. Developed by Irrational Games. BioShock, BioShock Infinite, Irrational Games, 2K
Games, Take - Two Interactive Software and their respective logos are all trademarks of Take-Two Interactive Software, Inc. The
ratings icon is a trademark of the Entertainment Software Association. All other trademarks are property of their respective owners.
All rights reserved.
©2013 Tomb Raider © SQUARE ENIX, Ltd. SQUARE ENIX and the SQUARE ENIX logo are registered trademarks or trademarks of
Square Enix Holdings Co., Ltd. Lara Croft, Tomb Raider, Crystal Dynamics, the Crystal Dynamics logo, Eidos, and the Eidos logo are
trademarks of SQUARE ENIX, Ltd. All other trademarks are the property of their respective owners. All rights reserved.

22 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013

Mais conteúdo relacionado

Mais de AMD Developer Central

DX12 & Vulkan: Dawn of a New Generation of Graphics APIs
DX12 & Vulkan: Dawn of a New Generation of Graphics APIsDX12 & Vulkan: Dawn of a New Generation of Graphics APIs
DX12 & Vulkan: Dawn of a New Generation of Graphics APIsAMD Developer Central
 
Leverage the Speed of OpenCL™ with AMD Math Libraries
Leverage the Speed of OpenCL™ with AMD Math LibrariesLeverage the Speed of OpenCL™ with AMD Math Libraries
Leverage the Speed of OpenCL™ with AMD Math LibrariesAMD Developer Central
 
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware Webinar
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware WebinarAn Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware Webinar
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware WebinarAMD Developer Central
 
Webinar: Whats New in Java 8 with Develop Intelligence
Webinar: Whats New in Java 8 with Develop IntelligenceWebinar: Whats New in Java 8 with Develop Intelligence
Webinar: Whats New in Java 8 with Develop IntelligenceAMD Developer Central
 
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...AMD Developer Central
 
TressFX The Fast and The Furry by Nicolas Thibieroz
TressFX The Fast and The Furry by Nicolas ThibierozTressFX The Fast and The Furry by Nicolas Thibieroz
TressFX The Fast and The Furry by Nicolas ThibierozAMD Developer Central
 
Rendering Battlefield 4 with Mantle by Yuriy ODonnell
Rendering Battlefield 4 with Mantle by Yuriy ODonnellRendering Battlefield 4 with Mantle by Yuriy ODonnell
Rendering Battlefield 4 with Mantle by Yuriy ODonnellAMD Developer Central
 
Low-level Shader Optimization for Next-Gen and DX11 by Emil Persson
Low-level Shader Optimization for Next-Gen and DX11 by Emil PerssonLow-level Shader Optimization for Next-Gen and DX11 by Emil Persson
Low-level Shader Optimization for Next-Gen and DX11 by Emil PerssonAMD Developer Central
 
Direct3D12 and the Future of Graphics APIs by Dave Oldcorn
Direct3D12 and the Future of Graphics APIs by Dave OldcornDirect3D12 and the Future of Graphics APIs by Dave Oldcorn
Direct3D12 and the Future of Graphics APIs by Dave OldcornAMD Developer Central
 
Introduction to Direct 3D 12 by Ivan Nevraev
Introduction to Direct 3D 12 by Ivan NevraevIntroduction to Direct 3D 12 by Ivan Nevraev
Introduction to Direct 3D 12 by Ivan NevraevAMD Developer Central
 
Holy smoke! Faster Particle Rendering using Direct Compute by Gareth Thomas
Holy smoke! Faster Particle Rendering using Direct Compute by Gareth ThomasHoly smoke! Faster Particle Rendering using Direct Compute by Gareth Thomas
Holy smoke! Faster Particle Rendering using Direct Compute by Gareth ThomasAMD Developer Central
 
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Ha...
Computer Vision Powered by Heterogeneous System Architecture (HSA) by  Dr. Ha...Computer Vision Powered by Heterogeneous System Architecture (HSA) by  Dr. Ha...
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Ha...AMD Developer Central
 
Productive OpenCL Programming An Introduction to OpenCL Libraries with Array...
Productive OpenCL Programming An Introduction to OpenCL Libraries  with Array...Productive OpenCL Programming An Introduction to OpenCL Libraries  with Array...
Productive OpenCL Programming An Introduction to OpenCL Libraries with Array...AMD Developer Central
 
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14AMD Developer Central
 

Mais de AMD Developer Central (20)

DX12 & Vulkan: Dawn of a New Generation of Graphics APIs
DX12 & Vulkan: Dawn of a New Generation of Graphics APIsDX12 & Vulkan: Dawn of a New Generation of Graphics APIs
DX12 & Vulkan: Dawn of a New Generation of Graphics APIs
 
Leverage the Speed of OpenCL™ with AMD Math Libraries
Leverage the Speed of OpenCL™ with AMD Math LibrariesLeverage the Speed of OpenCL™ with AMD Math Libraries
Leverage the Speed of OpenCL™ with AMD Math Libraries
 
Introduction to Node.js
Introduction to Node.jsIntroduction to Node.js
Introduction to Node.js
 
Media SDK Webinar 2014
Media SDK Webinar 2014Media SDK Webinar 2014
Media SDK Webinar 2014
 
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware Webinar
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware WebinarAn Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware Webinar
An Introduction to OpenCL™ Programming with AMD GPUs - AMD & Acceleware Webinar
 
DirectGMA on AMD’S FirePro™ GPUS
DirectGMA on AMD’S  FirePro™ GPUSDirectGMA on AMD’S  FirePro™ GPUS
DirectGMA on AMD’S FirePro™ GPUS
 
Webinar: Whats New in Java 8 with Develop Intelligence
Webinar: Whats New in Java 8 with Develop IntelligenceWebinar: Whats New in Java 8 with Develop Intelligence
Webinar: Whats New in Java 8 with Develop Intelligence
 
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...
The Small Batch (and other) solutions in Mantle API, by Guennadi Riguer, Mant...
 
Inside XBox- One, by Martin Fuller
Inside XBox- One, by Martin FullerInside XBox- One, by Martin Fuller
Inside XBox- One, by Martin Fuller
 
TressFX The Fast and The Furry by Nicolas Thibieroz
TressFX The Fast and The Furry by Nicolas ThibierozTressFX The Fast and The Furry by Nicolas Thibieroz
TressFX The Fast and The Furry by Nicolas Thibieroz
 
Rendering Battlefield 4 with Mantle by Yuriy ODonnell
Rendering Battlefield 4 with Mantle by Yuriy ODonnellRendering Battlefield 4 with Mantle by Yuriy ODonnell
Rendering Battlefield 4 with Mantle by Yuriy ODonnell
 
Low-level Shader Optimization for Next-Gen and DX11 by Emil Persson
Low-level Shader Optimization for Next-Gen and DX11 by Emil PerssonLow-level Shader Optimization for Next-Gen and DX11 by Emil Persson
Low-level Shader Optimization for Next-Gen and DX11 by Emil Persson
 
Gcn performance ftw by stephan hodes
Gcn performance ftw by stephan hodesGcn performance ftw by stephan hodes
Gcn performance ftw by stephan hodes
 
Inside XBOX ONE by Martin Fuller
Inside XBOX ONE by Martin FullerInside XBOX ONE by Martin Fuller
Inside XBOX ONE by Martin Fuller
 
Direct3D12 and the Future of Graphics APIs by Dave Oldcorn
Direct3D12 and the Future of Graphics APIs by Dave OldcornDirect3D12 and the Future of Graphics APIs by Dave Oldcorn
Direct3D12 and the Future of Graphics APIs by Dave Oldcorn
 
Introduction to Direct 3D 12 by Ivan Nevraev
Introduction to Direct 3D 12 by Ivan NevraevIntroduction to Direct 3D 12 by Ivan Nevraev
Introduction to Direct 3D 12 by Ivan Nevraev
 
Holy smoke! Faster Particle Rendering using Direct Compute by Gareth Thomas
Holy smoke! Faster Particle Rendering using Direct Compute by Gareth ThomasHoly smoke! Faster Particle Rendering using Direct Compute by Gareth Thomas
Holy smoke! Faster Particle Rendering using Direct Compute by Gareth Thomas
 
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Ha...
Computer Vision Powered by Heterogeneous System Architecture (HSA) by  Dr. Ha...Computer Vision Powered by Heterogeneous System Architecture (HSA) by  Dr. Ha...
Computer Vision Powered by Heterogeneous System Architecture (HSA) by Dr. Ha...
 
Productive OpenCL Programming An Introduction to OpenCL Libraries with Array...
Productive OpenCL Programming An Introduction to OpenCL Libraries  with Array...Productive OpenCL Programming An Introduction to OpenCL Libraries  with Array...
Productive OpenCL Programming An Introduction to OpenCL Libraries with Array...
 
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14
Rendering Battlefield 4 with Mantle by Johan Andersson - AMD at GDC14
 

Último

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 

Último (20)

Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 

MM-4095, Innovating with AMD Multimedia Technologies, by Amit Mookerjee and Carl Wakeland

  • 1. INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES AMIT MOOKERJEE SENIOR MANAGER, MEDIA SOFTWARE SOLUTIONS, AMD CARL WAKELAND FELLOW DESIGN ENGINEER, AMD
  • 2. AMD Media SDK Enabling Developers to Provide the Best Multimedia Experiences on the AMD platform
  • 3. Multimedia Experiences on AMD Video Editing/Transcode Cloud Gaming Wireless Display Video Conferencing Remote Desktop Video Playback 3 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 4. AMD MULTIMEDIA SOFTWARE STACK Applications ISV ISV MFT MFT ISV MFT Media SDK AMD Media Framework (AMF) DirectX OpenCL Driver AMD HW 4 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 OpenGL
  • 5. MEDIA SDK1.0 SUMMARY MFTs for leveraging Media HW accelerator blocks for video encoding/decoding Video Quality MFT for video pre/post processing AMF-DEM library for use in low latency applications Support for Windows 7/8 Desktop as well as Windows 8 Store Application* * AMF-DEM library only supports classic desktop applications 5 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 6. MEDIA SDK1.0 VALUE FOR DEVELOPERS  Leverage AMD’s industry leading multimedia IP ‒ Leverage well known video processing features like AMD Steady VideoTM ‒ Leverage the unique VCE-DEM feature on AMD APUs/dGPUs in low latency applications like wireless display and remote desktop  Optimal use of Heterogeneous Compute in Multimedia Apps ‒ eg. Buffer sharing on GPU, DX to OpenCL inter-op  Reduce Time to Market for Multimedia ISVs ‒ Optimized sample code for targeted application use cases ‒ Developer collateral and support via forum 6 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 7. MEDIA SDK ROADMAP Q4 Q1 Q2 Q3 APU13 2013 2014 Media SDKv1.0 Beta Media SDKv1.0 GA Media SDKv1.1 Nov Jan Jun MediaSDKv1.0: MediaSDKv1.1: - - - Video quality MFT for video processing AMF-DEM library for low latency apps Windows 8 Store Support 7 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 - AMF library for video encode/decode/processing Multi-GPU support Cloud gaming support Q4
  • 9. ADDITIONAL INFORMATION Fast, easy mobile computing and gaming; Victor Chin @ Splashtop; 2:45-3:30pm, Nov 12 ScreenMirror – A Unified screen mirroring solution; Nao Yoshikawa @ ArcSoft;11:0011:45am,Nov 12 Miracast with AMD Wireless Display Technology; Daryl Sartain @ AMD ; 5:00-5:45pm,Nov 12 RapidFire API; Dmitry Kozlov @ AMD ; 4:00-4:45pm, Nov 12 Bay Area Multimedia Meetup - http://www.meetup.com/Bay-Area-MultimediaMeetup-Group/ 9 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 11. BENEFITS OF AMD TRUEAUDIO ACCELERATION FOR GAMERS  Raising the bar for the audio gaming experience on PC ‒ More audio objects and higher-resolution sound environments, with minimal workload added to the CPU ‒ Eliminate the workload uncertainty factor sound designers have when relying completely on CPU-based offload ‒ TrueAudio provides a baseline of bonus audio processing throughput that sound designers can add to their typical 10% CPU utilization budget  Enhanced headset experience ‒ Implement enhanced environmental 3D object positioning using position information from the game engine ‒ TrueAudio works inside the game application itself. OS audio stack is not involved ** All features above are dependent on 3rd Party ISVs such as game developers, audio middleware, etc.. 11 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 12. OTHER POTENTIAL TRUEAUDIO USES  Content management ‒Audio search pre and post-processing ‒ Quickly navigate through hundreds of sounds to find just the one you want ‒ Pick distinct songs out of your library just by pointing the mouse and listening  Professional Audio Processing ‒Client digital audio workstation applications ‒Use TrueAudio to accelerate : ‒ Music creation with complete control over every aspect of the sound and add custom effects ‒ Add dozens of layers of sound, music and dialogue to your movie masterpiece ** All features above are dependent on 3rd Party ISVs, audio middleware, etc.. 12 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 13. AMD TRUEAUDIO HARDWARE ARCHITECTURE Tensilica HiFi EP Subsystem Bus Routing and Bridging DSP0 Address Translation Interrupt Routing GPU Interrupt Clock/Reset/Pwr Control I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM AMD TRUEAUDIO Registers Semaphore I/F Sync Memory Client/Target MMIO MMIO Debug JTAG Bus Bridging Tensilica HiFi EP Subsystem Address Translation DSP1 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM Routing and Arbitration Streaming DMA Engine Address Translation Memory Bus Interface with scattergather Translation Apertures Tensilica HiFi EP Subsystem DSP2 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM 13 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 384 K Shared Instruction/Data RAM Memory
  • 14. AMD TRUEAUDIO DSP FEATURES Tensilica HiFi EP Subsystem  Tensilica HiFi EP instruction set DSP0 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM Tensilica HiFi EP Subsystem D-Cache 32KB  Tensilica Xtensa SP float support, DP assistance (also supports some transcendentals)  32 KB instruction and data caches  8 KB of scratch RAM used for fast local operations DSP1 I-Cache 32KB  Three Audio Optimized DSP cores 8 KB Scratch RAM Tensilica HiFi EP Subsystem  External power/clock management for clock freq/voltage (up to 900 MHz) DSP2 I-Cache 32KB D-Cache 32KB 8 KB Scratch RAM 14 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 15. AMD TRUEAUDIO SPECIFIC HARDWARE FEATURES  Streaming DMA engine ‒ Multichannel with programmable descriptors, IOC ‒ Scatter gather architecture  Internal Shared memory ‒ 384 KB of shared internal memory, 8 KB banks ‒ Independently arbitrated for con concurrent access of DMA and each DSP Bus Routing and Bridging ‒ Up to 64 MB addressable space in frame buffer GPU Interrupt Address Translation Clock/Reset/Pwr Control AMD TRUEAUDIO Registers Semaphore I/F Sync Memory Client/Target MMIO MMIO Debug JTAG Bus Bridging Address Translation  Bus interface to frame buffer/system memory ‒ High performance, low latency access to frame buffer memory Interrupt Routing Routing and Arbitration Streaming DMA Engine Address Translation Memory Bus Interface with scattergather Translation Apertures ‒ Windowed into internal AMD TRUEAUDIO system memory space 15 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 384 K Shared Instruction/Data RAM Memory
  • 16. AUDIO ALGORITHMS COMPLETED AND IN DEVELOPMENT  AMD is engaged with tools and plugin developers to accelerate the following with TrueAudio: ‒AudioKinetic ‒ Convolution reverb ‒ GenAudio AstoundSound RTI positional audio ‒FMOD ‒ FMOD Reverb ‒ ML1 Limiter from McDSP ‒ Others to be announced 16 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 17. ACCESSING AMD TRUEAUDIO FUNCTIONALITY FROM APPLICATIONS Apps & Game Engines w/ Middleware Support Game Engines w/ Integrated Sound Engine Middleware API Audio Middleware Higher-Level API Optional API Abstraction Layer(s) AMD Audio API TrueAudio User-mode Services Library 17 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 AMD Audio API  Audio Middleware ‒ Audio Middleware is responsible for audio engine framework ‒ Audio algorithms typically ship with middleware - these can be accelerated with TrueAudio accessible through AMD Audio API  Game Engines ‒ Game engines can integrate sound engine, but most work with audio middleware vendors such as FMOD, AudioKinetic
  • 18. TRUEAUDIO ENABLEMENT FOR DEVELOPERS  3rd Party Middleware Integration ‒ Less integration work required ‒ Use existing high level Middleware API to accelerate plugins w/ TrueAudio  Choose from native middleware plugins or 3rd party ‒ Middleware licensing required 18 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 Game Engine Middleware API Middleware Plugins (ie. FMOD, AudioKinetic) 3rd Party Plugins (ie. McDSP) Middleware AMD Audio API AMD TrueAudio
  • 19. AUDIO DATA FLOW & OUTPUT SUPPORT Application / Game Audio Middleware Effects & Algorithms AMD TRUEAUDIO 19 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013 Sound Card Driver OS Driver Stack Audio Assets 3.5mm Audio Jack USB Audio Driver USB HDMI/D P Audio Driver HDMI/DP
  • 20. SUMMARY  Programmable audio pipeline grants artistic freedom to game audio engineers for sound processing  Easy to access through popular audio libraries used by top game developers  Fundamentally redefines the nature of a modern PC graphics card  Spatialization, reverb, mastering limiters and simultaneous voice decode are only the beginning 20 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 21. DISCLAIMER & ATTRIBUTION The information presented in this document is for informational purposes only and may contain technical inaccuracies, omissions and typographical errors. The information contained herein is subject to change and may be rendered inaccurate for many reasons, including but not limited to product and roadmap changes, component and motherboard version changes, new model and/or product releases, product differences between differing manufacturers, software changes, BIOS flashes, firmware upgrades, or the like. AMD assumes no obligation to update or otherwise correct or revise this information. However, AMD reserves the right to revise this information and to make changes from time to time to the content hereof without obligation of AMD to notify any person of such revisions or changes. AMD MAKES NO REPRESENTATIONS OR WARRANTIES WITH RESPECT TO THE CONTENTS HEREOF AND ASSUMES NO RESPONSIBILITY FOR ANY INACCURACIES, ERRORS OR OMISSIONS THAT MAY APPEAR IN THIS INFORMATION. AMD SPECIFICALLY DISCLAIMS ANY IMPLIED WARRANTIES OF MERCHANTABILITY OR FITNESS FOR ANY PARTICULAR PURPOSE. IN NO EVENT WILL AMD BE LIABLE TO ANY PERSON FOR ANY DIRECT, INDIRECT, SPECIAL OR OTHER CONSEQUENTIAL DAMAGES ARISING FROM THE USE OF ANY INFORMATION CONTAINED HEREIN, EVEN IF AMD IS EXPRESSLY ADVISED OF THE POSSIBILITY OF SUCH DAMAGES. ATTRIBUTION © 2013 Advanced Micro Devices, Inc. All rights reserved. AMD, the AMD Arrow logo and combinations thereof are trademarks of Advanced Micro Devices, Inc. in the United States and/or other jurisdictions. Windows is a registered trademark of Microsoft Corporation. Other names are for informational purposes only and may be trademarks of their respective owners. 21 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013
  • 22. DISCLAIMER & ATTRIBUTION Images used in this presentation are courtesy of CyberLink, Irrational Games and Square Enix ©2013 Take - Two Interactive Software, Inc. Developed by Irrational Games. BioShock, BioShock Infinite, Irrational Games, 2K Games, Take - Two Interactive Software and their respective logos are all trademarks of Take-Two Interactive Software, Inc. The ratings icon is a trademark of the Entertainment Software Association. All other trademarks are property of their respective owners. All rights reserved. ©2013 Tomb Raider © SQUARE ENIX, Ltd. SQUARE ENIX and the SQUARE ENIX logo are registered trademarks or trademarks of Square Enix Holdings Co., Ltd. Lara Croft, Tomb Raider, Crystal Dynamics, the Crystal Dynamics logo, Eidos, and the Eidos logo are trademarks of SQUARE ENIX, Ltd. All other trademarks are the property of their respective owners. All rights reserved. 22 | INNOVATING WITH AMD MULTIMEDIA TECHNOLOGIES | NOVEMBER 13, 2013