Live Automatic Captioning Workshop

1. Live Auto Captioning with 3Play Media ✋ Type questions in the Q&A window during the presentation ⏺ This webinar is being recorded & will be available for replay 💬 This webinar is live captioned 📱 www.3playmedia.com l @3playmedia l #a11y John Slocum 3Play Media

2. On today’s agenda... What is 3Play’s Live Auto Captioning solution? 🔬 How to add 3Play auto captions to live streams 💬 How it works 🔧 Accessibility laws & compliance ⚖ How captions benefit all users 👍 Quality of live auto captions 💯 Post-event video accessibility tips 🖥 Q&A

3. What is 3Play’s Live Auto Captioning Solution?

4. 3Play’s Live Auto Captioning In real time For live events like webinars or meetings Automatic Best in class automatic speech recognition (ASR) technology Integrations Top live streaming video and meeting platforms Wordlists Glossary of terms to improve visual accuracy of the ASR Upgrade Paths Ensure a fully compliant, 99%+ accurate caption file on the recording Scheduling Interface Schedule upcoming events & track past events

5. Poll: What do you want learn about captioning live events?

6. So, how do I add 3Play auto captions to my live stream?

7. RTMP/RTSP *

8. How it Works Create a live event Create a live event in any of our integrated live stream video platforms: Zoom, YouTube, Brightcove, JW Player, Facebook, OR for any* standard RTMP/RTSP stream. Schedule 3Play auto captions In the 3Play account system, schedule auto captions for your corresponding live event. Submit a Wordlist Submit a glossary of terms, phrases, or acronyms to improve the visual accuracy of the ASR on those words. Start Streaming Your captions will post back directly to your live stream. Upgrade your Live Transcript Access the live transcript immediately post-event for editing, downloading, or upgrading to our full transcription service with human editing and review.

9. How it REALLY Works... Behind the scenes... For Zoom Meetings and Webinars... ZOOM CAPTIONS GUESTS HOST 3PLAY RT ASR WOWZA

10. How it REALLY Works... Behind the scenes... For JW Player or any* standard RTMP/RTSP stream... ENCODER PLATFORM PLAYER CAPTIONS EMBED www.eventpage.com RTM/SP 3PLAY RT ASR RTMP/RTSP RTM/SP

11. How it REALLY Works... Behind the scenes... For Brightcove... ENCODER PLATFORM PLAYER 3PLAY RT ASR CAPTIONS EMBED www.eventpage.com WOWZA

12. How it REALLY Works... Behind the scenes... For Youtube... ENCODER 3PLAY RT ASR WOWZA YT LIVE CAPTIONS

13. How it REALLY Works... Behind the scenes... For Facebook - coming in June ENCODER 3PLAY RT ASR WOWZA FB LIVE CAPTIONS EMBED www.eventpage.com CAPTIONS

14. Why should you caption live streams?

15. ACCESSIBILITY A11y

16. 41% of videos are incomprehensible without sound or captions.

17. Captions improve brand recall, verbal memory, and behavioral intent.

18. Video accessibility also benefits students 98.6% Of students find captions helpful 65% Of students use captions to help them focus 75% Of students that use captions said they use them as a learning aid

19. Poll: Why are you interested in live captioning your events?

21. Laws Around Live Captioning Rehabilitation Act Section 508 Americans with Disabilities Act Not a written requirement WCAG Live captions are a WCAG 2.0/2.1 AA guideline FCC Live captioning is required by the FCC

23. Let’s talk quality.

24. Caption Quality Matters 90%+ accurate Ranges depending on ‘live’ environment Latency Live captions typically appear with a slight latency between the spoken words and the captioned output No governing body for live captioning

25. Best Practices for Live Captioning Strong Network Connection Good Quality Audio Little to No Background Noise No overlapping speech Clear Speech and Pronunciation

26. Poll: What are you typically doing with your live recordings post-event?

27. What should you do post-event?

28. DIY Your live transcript is available in the 3Play account system immediately after your event. From there, you can edit the transcript yourself, and download in the appropriate caption format. Upgrade in 3Play Upgrade your live transcript to 3Play’s full transcription service with human editing and human review. Upgrading ensures a fully accessible, and compliant solution with 99%+ accuracy. Publish recorded ASR?

29. Questions about Live? Contact us! livecaptioning@3playmedia.com Support Documentation to Get Started: https://support.3playmedia.com/hc/en-us/categories/360001804494-Live-Auto-Captioning Learn More on the Website: https://www.3playmedia.com/solutions/services/liveautocaptioning/ Zoom How-To-Guide: https://www.3playmedia.com/solutions/how-it-works/how-to-guides/zoom-live-auto-captions/ Youtube How-To-Guide https://www.3playmedia.com/solutions/how-it-works/how-to-guides/youtube-live-auto-captio ns/create-live-event/

30. Questions? Comments?

31. ✋ Type questions in the Q&A window during the presentation ⏺ This webinar is being recorded & will be available for replay 💬 This webinar is live captioned 📱 www.3playmedia.com l @3playmedia l #a11y Georgia McGoldrick Product Marketing | 3Play Media Workshop: Live Auto Captioning in Zoom

32. On today’s agenda... Getting started with Zoom live captions ⚙ How to live caption Zoom meetings 📅 How to live caption Zoom webinars 🎙 Retrieving Captions after completion of a Zoom Event 🎞 Tips for live captioning 🎬 Benefits of captioning live events 👍 Q&A

33. Poll #1: Are you currently using zoom?

34. Poll #2: How are you using zoom?

35. Getting started with Zoom live captions

36. Requirements to Get Started Linked Zoom Account Paid, Pro Zoom account linked to a 3Play project Admin/Owner privileges Must be an admin or owner in Zoom account to link to 3Play 3Play Pro Account Pro account with the Live Auto Captioning module turned ON

37. Zoom Integration Setup 1. Log into 3Play 2. Navigate to New Linked Account 3. Select Zoom 4. Sign in to Zoom and confirm to authorize the installation of the 3Play Media app within your Zoom account. 1 2 3 4

38. For Hosts (Meetings) ● Sign in to zoom and navigate to My Account -> Settings -> In Meeting (Advanced). ● Turn on “Allow live streaming the meetings” and check “Custom Live Streaming Service.” Then click Save. Zoom Settings: Meetings

39. For Hosts (Webinars) ● Sign in to zoom and navigate to My Account -> Account Management -> Webinar Settings -> In Webinar Settings ->Edit -> Allow Hosts to Live Stream their Webinar. ● Make sure to also click “Custom Live Streaming Service.” then click Save Changes. Zoom Settings: Webinars

40. For Participants (Meetings & Webinars) ● All hosts and participants must have the closed captions button turned ON in order to set up or view captions in Zoom events. ● This setting is turned on by default for all Zoom users, and can also be found in My Account > Settings > In Meeting (Advanced). Zoom Settings: All Participants

41. Discussion Topic: How has COVID-19 changed your live video needs in general?

42. How to Set Up Live Auto Captions for Zoom Meetings

43. Step 1: Schedule The Meeting Within the Zoom Web Client ● Login to zoom.us and schedule a meeting. ● Schedule the meeting for the right time, adding any other information and settings necessary. ○ Only the meeting ID will have an impact on the necessary steps to get live captions. ○ For example, there’s an additional step if “Personal Meeting ID” is selected rather than if “Generate Automatically” is selected.

44. Step 2 (part one): Schedule the Live Auto Captioning Event in 3Play ● Navigate to your 3Play Media account and click Live Auto Captioning in the top navigation bar. ● Under the Schedule New Event section on the right, select your Zoom integration. ● Click the dropdown menu and select the appropriate user. ● All of the scheduled meetings for that user will display. Check the box of the Zoom meeting that needs Live Auto Captioning, enter a start time and date, and click Schedule. ● The time selected here will be the earliest that 3Play live auto captions can be used on this meeting. It is best to schedule the 3Play captioning event 5 to 15 minutes before the scheduled time of the Zoom meeting.

45. Step 2 (part two): Schedule the Live Auto Captioning Event in 3Play ● If ‘Generate Automatically’ was the setting selected when setting up the Zoom Meeting in Step 1, you can skip to the next slide. ○ After both the Zoom meeting and the 3Play Captioning event are scheduled, a Stream URL and a Stream Key need to be added to the Zoom meeting in order to use live captions with a personal meeting ID. ○ The correct Stream URL and Stream Key can be found in the pending 3Play Live Auto Captioning Event. ● Next, navigate to the scheduled Zoom meeting in zoom.us. Navigate to My Account > Meetings and click on the appropriate meeting. ● Navigate to the bottom of the meeting details and click Configure Live Stream Settings. Enter the Stream URL and Stream Key into the window that appears. ● The Live streaming page URL is required by Zoom, but the value has no effect on the zoom meeting or the live captions.

46. Step 3: Starting the Zoom Meeting and Copying the API Token ● After both the Zoom meeting is scheduled and the 3Play captioning event is ready and the time for the meeting has arrived, start the Zoom meeting. ● Once the Zoom meeting has begun, select the Closed Caption button. ● Click “Copy the API token“.

47. Step 4: Paste the Zoom API Token for the Zoom Meeting into the 3Play Live Event ● You should now see this meeting under the Scheduled and In Progress Live Auto Captioning Events section of the Live Auto Captioning page. ● Paste the API Token from Step 3 into the Zoom API Token field, then click Update.

48. Step 5: Begin Live Streaming the Meeting ● Return to your Zoom Meeting. On the bottom bar, click More > Live on Custom Live Streaming Service. ● This should be done at or shortly after the Live Event start time scheduled in 3Play. ● As a warning, going Live on Custom Live Streaming Service will open a web page to indicate that the meeting is in the process of going live. The Zoom meeting will persist, and that window can be closed at any time after the meeting has successfully gone live. ● Captions should now appear within 5-10 seconds.

49. Poll #3 Are you currently live captioning zoom meetings or webinars?

50. Poll #4 How are you live captioning zoom meetings or webinars?

51. How to Set Up Live Auto Captions for Zoom Webinars

52. Step 1: Schedule The Webinar Within the Zoom Web Client ● Login to zoom.us and schedule a webinar. ● Schedule the webinar for the right time, adding any other information and settings necessary.

53. Step 2: Schedule the Live Auto Captioning Event in 3Play ● Navigate to your 3Play Media account and click Live Auto Captioning in the top navigation bar. ● Under the Schedule New Event section on the right, select your Zoom integration. ● Click the dropdown menu and select the appropriate user. ● All of the scheduled webinars for that user will display. Check the box of the Zoom webinar that needs Live Auto Captioning, enter a start time and date, and click Schedule. ● The time selected here will be the earliest that 3Play live auto captions can be used on this webinar. It is best to schedule the 3Play captioning event 5 to 15 minutes before the scheduled time of the Zoom webinar.

54. Step 3: Starting the Zoom Webinar and Copying the API Token ● After scheduling both the Zoom webinar and the 3Play Live Captioning Event, start the webinar and click the CC Closed Caption button. ● Click “Copy the API token“.

55. Step 4: Paste the Zoom API Token for the Zoom Webinar into the 3Play Live Event ● This webinar should appear under the Scheduled and In Progress Live Auto Captioning Events section of the Live Auto Captioning page. ● Paste the API Token from Step 1 into the Caption Ingest URL field and click Update.

56. Step 5: Live Stream Webinar and Begin Captioning ● Once it’s time to begin the webinar, initialize the webinar in Zoom and once the client is active, click More > Live on Custom Live Streaming Service. ● Important: You must do this at or shortly after the Live Event start time scheduled in 3Play. If the event in 3Play is scheduled for 3:00 pm but you attempt to go live at 2:58 pm, the 3Play live server will not be ready and the webinar will not be able to go live. Please wait until the 3Play Live captioning event start time to try again, and refer to the instructions in Step 2 of this guide.

57. Step 6: Enter Live Stream Credentials When Prompted ● You will be prompted for a Stream URL and Stream Key, which can be found on your Live Event Details page in your 3Play account. After going live, a web page will open up and ask for these details, which can be found on the 3Play Live event in the 3Play account system. For Live streaming page URL, enter 3playmedia.com or any website. This field is required by zoom, but the value has no effect on the zoom webinar or the live captions. ● Captions should now appear within 5-10 seconds.

58. Poll #5 What do you do after your zoom event ends?

59. Poll #6 If you caption zoom events, do you retrieve captions after the event?

60. 3 ways to retrieve a caption file after a meeting or webinar Cloud Download from Zoom If a meeting or webinar was recorded in the cloud, it will record to the host’s device From 3Play Media’s account system View, download, edit, or upgrade the live auto captions to full transcription Local Download from Zoom If a meeting or webinar was recorded locally, it will record to the host’s device

61. Local Download from Zoom While scheduling a meeting or webinar, navigate to meeting/webinar options and record the meeting/webinar automatically on the local computer. After the conclusion of the meeting or webinar, a local download will be started that will include an .mp4 of the meeting or webinar, an .m4a of the audio, a .txt of the chat text, a .txt of the captions, and a .vtt of the captions.

62. Cloud Download from Zoom While scheduling a meeting or webinar, navigate to meeting/webinar options and record the meeting/webinar automatically in the cloud. After the conclusion of the meeting, navigate to My Account > Recordings. Navigate to the desired recording, and click the download button.

63. Download from 3Play’s Account System Once the Zoom events ends, navigate to the Live Auto Captioning page in the 3Play account system, click previous Live Auto Captioning Events, then click view file. From there, you can view the file, edit the transcript, download, or order more services on the transcript.

64. Discussion Topic: For those who are captioning, how has your audience responded?

65. Tips for Live Captioning!

66. Best Practices for Live Captioning Strong Network Connection Good Quality Audio Little to No Background Noise Single Speaker Clear Speech and Pronunciation

67. Why should you caption live streams?

68. ACCESSIBILITY A11y

69. 41% of videos are incomprehensible without sound or captions.

70. Captions improve brand recall, verbal memory, and behavioral intent.

71. Captions also benefit students 98.6% Of students find captions helpful 65% Of students use captions to help them focus 75% Of students that use captions said they use them as a learning aid

72. Questions about Live? Contact us! livecaptioning@3playmedia.com Support Documentation to Get Started: https://support.3playmedia.com/hc/en-us/categories/360001804494-Live-Auto-Captioning Learn More on the Website: https://www.3playmedia.com/solutions/services/liveautocaptioning/ Zoom How-To-Guide: https://www.3playmedia.com/solutions/how-it-works/how-to-guides/zoom-live-auto-captions/

73. Questions? Comments?

74. Live Automatic Captioning www.3playmedia.com @3playmedia

75. Agenda ● Why did 3Play build a live captioning solution? ● What distinguishes 3Play from other live (CART) solutions? ● Live event best practices ● Process: YouTube live ● Product demonstration ○ Upgrade to full 99% accurate transcription post-event ● Q&A

76. I am Ryan Martinez 👨 Senior Implementation Specialist ✍ Design workﬂow solutions that meet accessibility requirements 💻 I love working with customers! I moved to CO for 3 years to chase snow in the Rockies Hello!

77. Why live? You’ve been talking and we’ve been listening! Over the past year, we focused on building a “live” captioning solution that suits your streaming needs. We currently offer four out-of-the-box options: (coming soon)

78. Benefits: Live > CART 1 H igh accuracy In an idealrecording environm ent,in w hich the speakers are m ic’d up, >80-90% accuracy is entirely attainable. 2 Inexpensive vs.traditionalm ethods H istorically,live captions require hum ans to physically transcribe contentand hourly rates can be upw ards of$200 perhour. 3 Edits & upgrades are seam less The 3Play accountsystem m akes editing yourraw transcripts easy and ifyou need 99% accuracy,the upgrade path is as sim ple as a few clicks. 4 Efﬁcient& scalable W ith bestin class A SR technology and custom features,w e’re able to delivera highly efﬁcient,cost-effective and scalable solution forcaptioning live events ofallsorts!

79. Live event best practices The demand for live online events has increased substantially. More than 67% of people globally have streamed live video content and 47% say that their consumption of live streaming has increased in the past year. As more people and organizations shift to online platforms for live events, it’s important to keep these best practices in mind in order to achieve high-quality live captions. ❏ Strong network connection 💻 ❏ Clear speech & pronunciation 💬 ❏ High-quality audio 🎧 ❏ Little to no background noise 🗣 ❏ Single speaker, if possible 🎙 ❏ Add wordlists ☑ ❏ Upgrade to full transcription 💡

80. YouTube live solution *In order to live caption YouTube events, you’ll need an encoder that accepts a RTMP URL/key, such as OBS.

81. Live Captioning Demonstration

82. Any questions? Thank you for your time today! We’re happy you’re interested in live captions and hope our tools can help you meet your accessibility initiatives. Please type questions in the Q&A menu in your meeting controls. I’ll give you a minute before I jump in and answer as many as I can. Remember, 3Play’s ACCESS At Home is happening all week! If you haven’t already, be sure to check out some of the many upcoming sessions by visiting 3playmedia.com/access/.

83. Live Auto Captioning - accuracy, wordlists, and RTMP streams Nick Moutis www.3playmedia.com @3playmedia

84. Agenda ● Brief overview of speech recognition ● What are wordlists? ● 3Play Live Auto Captioning event scheduling walkthrough for RTMP streams

85. Who has used live captions, or wants to add them to their own live events? Question #1

86. Who has experienced low-accuracy live captions? Question #2

87. Speech Recognition: How does it work? ASR ≅ acoustic modeling + language modeling “I saw a van...” “Eyes awe of an...”

88. Wordlists: What are they? Wordlists allow you to inﬂuence what ASR “expects to hear” Lists of words!

89. Quick Example “The I.R.S is responsible for collecting taxes.” “The iris is responsible for collecting taxes.”

90. Wordlists: What to include? ● Proper nouns ● Technical terms ● Multi-word phrases

91. Wordlists: What not to include? ● Short words ● Multiple similar words

92. Questions?

93. How does 3Play incorporate wordlists? ● You can add a wordlist to any Live Auto Captioning event ● 3Play may edit your wordlist to increase accuracy

94. Walkthrough: scheduling Live Auto Captions in 3Play ● RTMP stream ● Event hosted on a webpage

95. Event information

96. Configuration

97. Configuration

98. Add a Wordlist

99. Add captions embed to your web page

100. At event time... ● Start your RTMP stream ● 3Play will start to caption your event

101. Questions?

Live Automatic Captioning Workshop

Live Automatic Captioning Workshop

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados(16)

Similar a Live Automatic Captioning Workshop

Similar a Live Automatic Captioning Workshop(20)

Mais de 3Play Media

Mais de 3Play Media(20)

Último

Último(20)

Live Automatic Captioning Workshop