The document describes a system for controlling spatial sound in a virtual environment using an iOS device. Spatial sound allows for direction, distance, and elevation of sounds. The system improves upon previous work using a Yamaha Tenori-on interface by allowing for smoother and freer movement of sounds. It works by sending touch positional data from an iOS app via Wi-Fi to a CVE server, then to a control PC which adjusts the spatial sound in real-time based on the received data. The research involves developing apps for iOS-CVE communication and using Pure Data for real-time spatial sound control.

1. Spatial Sound V irtual E nvironm ent
Control w ith iOS D evice
S1170144 Ryo K anno
Supervised by M ichael Cohen

2. A bstract
In m y thesis, I describe the system for controlling
“ Spatial sound ” w ith the iOS device. A sm artphone or
tablet, such as iOS device, has a touch panel on its
display, and can quantify the location w here w e touch as
a com bination of x and y coordinates. Based on this
captured inform ation, I aim to establish a new system
for controlling spatial sound and enable iOS devices to be
a new interface of virtual reality.

3. Spatial Sound
Spatial sound is one of the im portant sound
expression in virtual reality, and has sam e m eaning of
“ stereophony ” or “ 3D surround ” . It includes the
sound of direction, range, yaw , elevation, and so on.
In virtual reality, w e can enjoy m ore realistic sound
by com binating these features effectively.

4. Previous W ork
Tw o years ago, a previous thesis, “ Spatial Sound
Control w ith the Yam aha Tenori - on ” w as published.
M y research succeeds and extends this, aim ing to
allow the sound m ore
sm oothly and freely
m ovem ent around a space.
Figure: Yam aha Tenori - on, the new
type of m usical interface

5. Research A rchitecture
Spatial Sound Control is
realized via W i - Fi. The
quantified positional
inform ation is sent from
iOS device to CV E server
through the iOS - CV E bridge,
and also sent from CV E to
Control PC. ( iOS - CV E bridge
is the program for helping
com m unication betw een iOS
and CV E server.)
Finally, control PC changes spatial sound in realtim e based on received positional
Inform ation.

6. Flow of Research 1
M y experim ent is divided into three part.
1, Com m unication betw een iOS device and CV E server
2, Com m unication betw een CV E server and control PC
3, Spatial sound control based on sent positional data
First, I create a application for sending positional
inform ation from touch panel. To achieve this, a
source code of draw ing application w ill be leveraged.
These application are w ritten by objective - C.

7. Flow of Research 2
A s I said, a com m unication betw een iOS device
and CV E server is realized by leveraging iOS - CV E
bridge. This system has alm ost been com pleted in
previous research, so I use and extend it.
For com m unication, W i - Fi transm ission is used.

8. Flow of Research 3
Finally, I create a program
for controlling spatial
sound based on captured
positional data from CV E
server. A program m ing
language, "Pure D ata",
real - tim e graphical
program m ing environm ent
for m ultim edia, supports
the function to control
spatial sound in real - tim e.
Thanks to this program , w e
can control spatial sound
m ore freely, sm oothly, and
intuitively.