Voice Controlled SL Robots by Quincy Dagger. Voice Controlled Robots Learn how to make your Plain Old Telephone Service (POTS) or cell phone into a voice controller for your virtual world robots. Using your landline or cell phone, your voice can control your robots hands free, while allowing you to use the SecondLife Viewer for text chatting. The tools you will learn about are FreeSwitch, an open source voice switch for voice-over-IP (VoIP), and PocketSphinx, an open source continuous speech recognition system. When: 3-4 PM SLT/PST Where: AILC at IEEE2 Island, Second Life http://slurl.com/secondlife/IEEE%202/56/162/27

1. Voice Controlled Robots Robert Daniel SL: Quincey Dagger

2. Introduction Adjunct Professor at GWU 10 Teaching Telecommunications SecondLife 4 years OpenSim for the past 3 years FreeSwitch for the past 2 year Intelligence Training Using AI for training 1st winner at the FVWC 2011 for AI Concepts

3. Description Voice Controlled Robots Learn how to make your Plain Old Telephone Service (POTS) or cell phone into a voice controller for your virtual world robots. Using your landline or cell phone, your voice can control your robots hands free, while allowing you to use the SecondLife Viewer for text chatting. The tools you will learn about are FreeSwitch, an open source voice switch for voice-over-IP (VoIP), and PocketSphinx, an open source continuous speech recognition system. [1] Dyna 1984 [2] iPhone Reference: [1]http://en.wikipedia.org/wiki/File:DynaTAC8000X.jpg [2] http://en.wikipedia.org/wiki/File:Apple_iPhone_3G_front.jpg

4. Plain Old Telephone Service & Voice Over IP “More than 18 billion minutes of voice chat have been used in Second Life since voice was introduced in 2007. Voice minutes grew 44% year-over-year from Q2 2008 to Q2 2009, and more than 6 billion minutes of voice have been delivered in 2009 alone, making Linden Lab a major VoIP provider.” [1] Posted Sept 23, 2009 by James Brightman INDUSTRY GAMERS [2]A Telephone Exchange operator 1900 Second Life Clients with built-in VoIP Reference: [1] http://www.industrygamers.com/news/second-life-transactions-reach-1-billion/ [2] http://en.wikipedia.org/wiki/File:TexasRichardson_telephoneExchangeOperator.jpg

5. FreeSWITCH Architecture Very Module We are using Dial Plans Route Plans ASR/TTS SPHINX Reference: [1]from freeswitchwebsite http://wiki.freeswitch.org

6. PocketSphinx Architecture Voice Recognition adjustable, modifiable recognizer written in Java Reference: http://cmusphinx.sourceforge.net/2010/03/pocketsphinx-0-6-release/

7. PocketSphinx Architecture Voice Recognition adjustable, modifiable recognizer written in Java Reference: http://cmusphinx.sourceforge.net/2010/03/pocketsphinx-0-6-release/ http://wiki.freeswitch.org/wiki/Mod_pocketsphinx

8. Voice Architecture Second Life Remote User SL Client Land Line Cell Phone Robot FreeSwitch Database Voice Commands 0 NOTHING 1 EAST 2 WEST 3 SOUTH 4 NORTH 5 REVERSE 6 FORWARD 7 FAST 8 FASTER 9 SLOW 10 SLOWER Apache PocketSphinx llHTTPrequest PHP http_response

9. Phone: Dial 571-490-8981 Dialplan File: /usr/local/freeswitch/conf/dialplan/public/public.xml <extension name=“vitel-inbound”> <condition field=“destination_number” expression=“”/> <action application=“transfer” data=“74992 XML default“/> </condition> </extension> File: /usr/local/freeswitch/conf/dialplan/default.xml <extension name=“vitel-outbound”> <condition field=“destination_number” expression=“^({10})$”> <action application=“set” data=“effective_caller_id_number=“5714908981” /> <action application=“bridge” data =“sofia/gateway/vitelity-outbound/$1” /> </condition> </extension> File: conf/dialplan/default/00_pizza_demo.xml <extension name=“pizza_demo”> <condition field=“destination_number” experssion=“^(pizza|74992)$”/> <condition field=“${module_exists(mod_spidermonkey)}” expression=“true”/> <condition field=“${module_exists(mod_pocketsphinx)}” expression=“true”> <action application=“javascript” data=“ps_pizza2.js “/> </condition> </extension> File: /usr/local/freeswitch/conf/dialplan/default/01_UAV_demo.xml <extension name=“pizza_demo”> <condition field=“destination_number” experssion=“^(pizza|74993)$”/> <condition field=“${module_exists(mod_spidermonkey)}” expression=“true”/> <condition field=“${module_exists(mod_pocketsphinx)}” expression=“true”> <action application=“javascript” data=“uav_demo.js “/> </condition> </extension> Directory: /usr/local/freeeswitch/scripts/ Js_modules/ ps_pizza2.js ps_pizza.js uav_demo.js Directory: /usr/local/freeeswitch/sounds/en/us/callie/en/us/pizza/ WelcomeGovGrid_8.wav ConfirmUp.wav ConfirmDown.wav Directory: /usr/local/freeeswitch/grammar/ default.dic uav_leftright.gram

10. Java Speech Grammar Format JSGF Grammar File: pizza_yesno.gram #JSGF V1.0; /* JSGF Grammer for pizza_size */ grammar pizza_yes_no; <yes> = [ yes | yep | correct ]; <no> = [ no | nope ]; Public <yesno> = <yes> <no>; File: pizza_crust.gram #JSGF V1.0; /* JSGF Grammer for pizza_crust */ grammar pizza_crust; <handtossed> = [ hand [ tossed] ]; <deepdish> = [ [ chicago style ] | deep [dish] ]; <panbaked> = [ pan [ baked] [ pizza] ]; <thin> = [ thin [crust] | new york [ style] ]; Public <crust> = <handtossed> <deepdish> <panbaked> <thin>; File: pizza_order.gram #JSGF V1.0; /* JSGF Grammer for pizza_order */ grammar pizza_order; public <delivery> = [takeout | pickup | delivery ]; File: pizza_arso.gram #JSGF V1.0; /* JSGF Grammer for pizza_type*/ grammar pizza_type; <arso> = [ deliver | start over | crust | add [ a ] topping | remove [ a ] topping ]; Public <type> = <arso>; File: uav_control.gram #JSGF V1.0; /* JSGF Grammer for uav_control */ grammar uav_control; public <delivery> = [up | down | left | right | forward | backward ]; File: pizza_type.gram #JSGF V1.0; /* JSGF Grammer for pizza_type */ grammar pizza_type; <specialty> = [ specialty [ pizza] ]; <custom> = [ pick [ my own] [ pizza] ]; public <type> = <specialty> <custom>; Reference: http://wiki.freeswitch.org/wiki/Mod_pocketsphinx http://java.sun.com/products/java-media/speech/forDevelopers/JSGF/

11. Let’s test the Voice Robot Call Me: 571 – 490 - 8981