TADSummit 2022 8/9 Nov Aveiro Portugal Advancing Cloud Communications Well Beyond the Basics – Leveraging AI and ML in all aspects of programmable communications applications and media analytics Adnan Saleem, CTO – Software and Cloud Solutions at Radisys Corporation Programmable cloud communications to date, though well adopted, providing predominantly only basic calling and messaging services Advancements in AI and ML technologies enable a broad range of new rich and immersive digital engagement experiences, including AR/MR/XR and spatial codecs AI/ML driven virtual assistants with speech and interactive computer generated video technology and computer vision capabilities are complex and compute intensive Video and speech analytics from live media streams with NLU and computer vision technologies enable a wide range of new applications in numerous verticals Radisys Engage Digital platform streamlines and accelerates the creation and deployment of these sophisticated applications with low-code to no-code based APIs/SDKs and Visual Design Tools

1. Radisys Engage Digital Platform
Radisys Corporation - CONFIDENTIAL
Adnan Saleem – CTO Software & Cloud Solutions
Nov 8, 2022
Advancing Cloud Communications Beyond the Basics
AI / ML in programmable communications applications and media analytics

2. 2
Radisys Corporation - CONFIDENTIAL
Programmable Communications (The Basics)
CPaaS UCaaS CCaaS
Voice/Video Calling
P2P, P2A, A2P
SMS, Messaging
2FA, Authentication
Group Meetings
Collaboration Apps
Multi-model Access
Omni Channel
Contact Center Solutions
Interactive Voice Response
Customer Experience
Chat Bots / Assistants
On-Prem / Private DC Public / Hybrid Cloud Operator Networks
APIs SDKs
Enterprise Apps Consumer Apps Operator Apps
Dev Community Abstracting Complexity Modernizing Telecom Dev Rapid Dev2Deploy Innovation

3. 3
Radisys Corporation - CONFIDENTIAL
Programmable Communications (Beyond the Basics)
So, what’s Beyond the Basics ?

4. 4
Radisys Corporation - CONFIDENTIAL
Programmable Industry 4.0 and Immersive Experiences
Digital Devices
Drones /
Vehicles
Cameras
Kiosks
Smart Phone/
Tablet
Sensors
Wearables
Digital Experiences
Programmable
Voice & Video
Programmable
Messaging
Programmable
Media Analytics
Simple APIs, SDKs, Low code / No
code visual interface and Off-the-shelf
Applications
Augmented
and Mixer
Reality
Speech Analytics
and Natural
Language
IoT Triggered
Real Time
Communication
Computer
Vision Face /
Object Video
Recognition
AI-based Programmable Communication & Digital Engagement
Real Time Communications a key enabler for 5G, Industry 4.0, and Immersive Experiences
Enabling service providers and enterprises to offer
innovative services that combine the best of cloud
communications, media analytics, and mobile network assets
to solve real-world customer problems
engagedigital.ai
Immersive
Communication
& Collaboration

5. 5
Radisys Corporation - CONFIDENTIAL
Engage Digital Platform Functional Architecture & Building Blocks
Customer’s
Application
Server
(Business Logic)
Fetch EML
Response
Notify / Update
Response
Inbound Call
Outbound Call
End User
PSTN MOBILE SIP
Engage
REST API
Response
Browser Web Client SDK
Mobile Client SDK
Engage
Client SDK
(Web, Android, iOS)
App
WebRTC
signaling & media
Engage
Server SDK
(helper function)
Cloud-Native Microservices
Prompt &
Collect
Keyword
Spotting
Video Overlay
Speech
Translation
Computer
Vision #
SMS
Recording
Call Transfer
Speech
Authentication #
Face
Authentication #
Email
Conference
Dial Out
Noise
Reduction #
Voice Quality
Enhancement #
OTT Messaging
Voice Video Text
Dialogs Contextual
External Integration Hooks
AI / NLU
Intent Server
Visual Design Tool – IVR and Bot Engage Markup
Language (EML)
Engage Digital Portal
Design, Develop & Deploy
Virtual
or
Dedicated
Phone
Number
Application
Development
Enablers
Programmable APIs (voice, video, messaging, analytics)
Programmable Apps (EVA, IVR)
Sandbox & Pre-
Launch Tools
Speech-to-Text
Text-to-Speech
Programmable UC
Conversational AI
Media Analytics
Legend:
Multiple
Languages
Programmable
Communications
Speech and Video
Analytics &
Conversational AI
PSTN MOBILE SIP

6. 6
Radisys Corporation – CONFIDENTIAL
Computer Vision & Analytics – Real-time Video Inferencing
Source: Intel

7. 7
Radisys Corporation - CONFIDENTIAL
Programmable Media Analytics (Computer Vision) Pipeline
Media
Stream
Ingest
Decode
Scale
Transform
Inference
Inference
Inference
Track Inference
Crop /
Scale
Overlay
AR, MR
Record
Encode
Publish
Stream
Event
Trigger
Event Application
- SMS Alert
- Out-dial Call
- Live Call / Conf
- CRM
- ERP
live viewable streams
archive recordings
archive
viewing
Event Triggered
Engage Application
Ingest / Pre-process Multiple
Streams, Multiple Endpoints
Apply Multiple Inference
Engines sequential/parallel
(Classification / Scenes)
Post-process Video (XR) and
Live Stream Publishing
Event Triggered
Application Biz Logic
Programmable Media Analytics Applications APIs / SDKs
Complete Application Solution (Mobile, Web, Network)
Object Detection
Object Classification
Object Counts
Object Tracking
Scene Detection
Face Recognition
Face Attributes
Biometric Authentication
CPaaS

8. 8
Engage
Media Analyzer
(EMA)
Live steam
Engage
Media Analyzer
(EMA)
Live steam
Engage
Media Analyzer
(EMA)
Live steam
Distributed site1
Distributed site2
Distributed siteN
Engage
Media Analytics Core
Services
Engage
Communication
Services
Engage
Service Management
Engage Core Services
(central site, main DC, cloud location)
Engage
Media Analyzer
(EMA)
Live
steam
Clip (customer
http location)
Communication & Media
Analytics
REST APIs
Live steam
Live steam
Live steam
Live
steam
Radisys Corporation - CONFIDENTIAL
5G Edge Media: Distributed Site / Edge Deployment

9. 9
Radisys Corporation - CONFIDENTIAL
Programmable AI/ML Based Speech Analytics
• Programmable Key Word or Phrase Detection and Event Triggers
• Trainable Domain Specific Natural Language Understanding
• ML based Speech Recognition (multiple languages / dialects)
• Trainable Noise Reduction (eg: keyboard clicking, background chatter)
• ML based Sound Detection (eg: dog barking, siren, glass-break, gun shot)
• Speech/Text based Sentiment Analysis (eg: angry, happy, positive, negative)
• Trainable Speech Based Bio-metric Authentication
• Live In-call Real-time Language Translation

10. 10
Radisys Corporation - CONFIDENTIAL
Programmable Immersive Experiences (AR, MR, XR)
Numerous Industry 4.0 Use Cases
• Product Feature Training
• Immersive Education
• Safety and Security
• Field Workforce Expertise
• Remote Healthcare
• Product Support & Promotions
• Hospitality & Travel Experience
• Factory and Service Automation
• Remote Expertise Support

11. 11
Radisys Corporation - CONFIDENTIAL
Programmable Application Toolkit
No Code: Visual Design Tool
Low Code: Engage Markup Language (EML)
Develop with Rest API
Develop with WebRTC SDK

12. 12
Radisys Corporation - CONFIDENTIAL
Radisys Engage Digital Platform: Beyond the Basics
Audio / Video /
Messaging
Call Control
Messaging
Group Collaboration
Multi-modal
Omni-channel
Video Analytics Computer Vision Speech Analytics / NLU Immersive / Augmented (MR)
APIs &
SDKs
Dev Tools
& Pipelines
Test &
Deployment
Tools
Metrics &
KPIs
Dev
Community
CPaaS, UCaaS, CCaaS

13. 13
Radisys Corporation - CONFIDENTIAL
Radisys Engage Digital Platform: Beyond the Basics
https://www.engagedigital.ai/tadhack22
proof is in the pudding Apps

14. Thank You
14
Radisys Corporation - CONFIDENTIAL