This presentation is an updated version of my earlier presentation of the new concept of augemented audio. This concept interesting for both mobile adepts as well as visually impaired.

1. Creating an audio augmented
reality
By Ronald Huizer
Ronald Huizer huizerronald@gmail.com CC-BY

2. Vision on Mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

3.  The interface for mobile internet has evolved from small displays and
small (numeric) keyboards to large touchscreen with full qwerty
keyboards.
 Basically, the devices have the same interface as a traditional PC; a
display and a keyboard, with a mouse, a stylus or touchscreen
 These devices enable you have access to the internet at all places…
 …but when you are walking, biking, driving, talking or listening, these
interfaces are difficult to handle, or even dangerous (f.i. 7 pounds)…
 Device batteries are limited to a few hours of intensive usage; most
of the power is used by displays…
 That’s doesn’t sounds very mobile at all, is it?
Tradidional interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

4. Orientation and navigation,
Handsfree!
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

5. So, how can we make applications
using mobile internet,
without a keyboard and display,
without the use of hands and eyes?
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

6. The new interface;
a headset that creates a
virtual (audio) reality
 The headset is a (bluetooth) headset that:
 mixes the line out from your device with
exterior sounds/noises;
 enables you to listen to music, podcasts, text or
calls
 while still being able to hear and to
communicate (audio) as usual
 This device, that is already on the market
(from Plantronics)
 It will enable visual impaired to listen to any
audio device, and still having normal use of
hearing
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

7. Optimized version of this
headset has additional
features:
 White noise modus – completely filters
out all backround noises
 External modus – 80% external audio
 Internal modus – 20% external audio
 Mute modus - 100% external audio
 Voice activated; when your
speaking, automatically switch to
external modus
* I will be in contact with several companies to discuss further development of such a product.
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

8. Audiotwitter :
Listening to your tweets and music
at the same time!
 A twitter app using a twitter API captures
tweets from your account
 A text-to-speech application (f.i. Siri, or
Acapela) procudes spoken tweets.
 Hyperlinks are mentioned, but not spoken
 The app can also mix the spoken tweets
with music from your iPhone; when
tweets are spoken music is pauzed, or
lowered in volume.
 Tweets can be pauzed
 Fase II developments:
◦ Audiotwitter for desktop to enable visually impaired
to use twitter
◦ Speech2text interface for twitter
◦ The app recognizes the language of a tweet and
selects the applicable voice/voccabulaire
◦ Multiple voices (male, female) based on gender in Easy to use with the
profile of tweet author v.a.r. headset
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

9. Audio navigation with Google Maps
With a GPS-smartphone users can navigate and
be aware of all points of interest, without
having to held and to view a handset
 Using a speech-to-text application (f.i. Yap)
that captures input from user about
destination of a searched object
 Use Google Maps (API) to produce route
instructions and information on nearby objects
likes stores and difficult situations
 A text-to-speech application (f.i. Acapela ) will
produce instructions
 Special maps/layers for target groups can be
developped and maintained by communities.
 “Safe routes” for visually impaired, of wheelchair users.
 Fastes routes for bike-couriers Easy to use with the
 Nices routes for tourists v.a.r. headset
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

10. Additional product concepts
 An orientation headset* with a compass
functionality (similar to Android G1/iPhone 3Gs)
will enhance the opportunities for mobile
orientation to an even more detailled level.
 Based on your GPS position and viewing
direction, an augmented reality application
(to be developped) can reveil every information
about locations, business, people etcetera.
◦ Look at a buddy and find out who he is doing (with Google
latitude)
◦ Look at a star and hear what star it is (Google Stardroid)
 Nonverbal communicator: In addiction to
speech-to-text, a movement sensor (built in
headset) can interpreter nonverbal
communication, like nodding “yes” or “no” .
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

11. “Turn left”
“Navigate
to home”
“There is a bookshop
with Lonely Planet
Iceland in that store on
your right hand”
“Skip
commercial”
“You’re buddy Paul
“Find Paul” is 1 mile close to
you, do you want
directions?”
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

12. Additional product concepts
 Nonverbal communicator: In addiction to
speech-to-text, a movement
sensor/accelerator can interpreter
nonverbal communication, like nodding
left, right, up or down.
 Commands like confirm, stop/skip, left &
right, up & down, or customized commands
can be given
 This can be used in addition to manual and
speech-to-text interfaces
 This interface will also decrease the use of
keyboard/touchscreens
Audio interface on mobile internet
Ronald Huizer huizerronald@gmail.com CC-BY

13. Augmented Video* Augmented Audio
Heavy battery usage Lite battery usage, long
endurance
Blocks/troubles normal sight Normale sight remains
Looks silly! Headsets are cool!
Costs 350 euro Costs 80 euro
Tablet or pda requires use of Totally handsfree
hands
Need good working eyes (no Suitable for everybody, especially
glasses when using VR glasses) visually impaired. Not for hearing
impaired.
* (with VR glasses, pda or tablet)
Comparison

14.  Please preview and discuss my
presentation;
 I will be happy to answer questions and
give additional explanation, and get
feedback from you
 Contact me huizerronald@gmail.com
Next steps
Ronald Huizer huizerronald@gmail.com CC-BY