1. Integrated Development Environment
of
Software design and Space design.
Yasuto Nakanishi
Keio University / JST Presto
中西 泰人
慶應義塾大学/ 科学技術振興機構

2. Research Area
• Interaction Design at Mobile / Ubiquitous / Urban Computing,
and Interactive Art
• as System of Systems : Information Systems ＊ Space
Operation, Action, Inter-action
Space
(City, Architecture)
Information Systems
( Computer, Network,
Smart Phone etc.)
Integration of
Software Design and Space Design

3. Research Area
Operation, Action, Inter-action
Space
(City, Architecture)
Information Systems
( Computer, Network,
Smart Phone etc.)
Interaction Design
Creative Work Support
CityCompiler

4. EnhancedDesk/Table/Movie
（1998 - ）
• Augmented desk interface system using Finger Tracking System
• Direct operation of digital objects
• Integration real objects and virtual objects

5. EnhancedDesk/Table/Movie
（1998 - ）
• Using Larger space
• Using a table : from Personal tool to Group tool
• Using a Larger desk : moving an arm as an input
EnhancedTable EnhancedMovie

6. Same Technology,
Different Space : Different Interaction
Finger Tracking
System
Personal Desk
EnhancedDesk
Finger Tracking
System
Large Desk
(for movie editing)
EnhancedMovie
Finger Tracking
System
Table
EnhancedTable

7. EnhancedWall
（2002 -）
• Perceptual User Interface using Face Tracking System
• tracking 3D position and orientation of a user s face
• using the face as a pointing device

8. EnhancedWall
（2002 -）
• Using Larger Space
• 19 inch -> 100 inch
• from Personal tool to Public tool

9. Same Technology,
Different Space : Different Interaction
Head Tracking
System
19 inch Display
19 inch
Enhanced Wall
Head Tracking
System
100 inch Screen
100 inch
EnhancedWall
on a Desk
on a Wall

10. Afterglow
• a laser drawing system designed by takram design
• It consists of a projector, a camera, a laser pointer,
• enables to drawing a illustration on a projected image.
• http://takram.com/#/portfolio/Afterglow

11. LaserTag
• a laser drawing system designed by Graffiti Research Laboratory
• It consists of a projector, a camera, a laser pointer,
• enables to drawing a illustration on a projected image.
• http://graffitiresearchlab.com/
•

12. Same Technology,
Different Space : Different Interaction
Laser, Camera,
Projector, Image Processing
LaserTag
Laser, Camera,
Projector, Image Processing
a Screen
Afterglow
a Wall
in a Room
of a Building

13. View
Controller
Model
5. 出力
1.入力
３. 呼び出し
4. 参照
2. 命令
• Spatial Information Systems: Model View＊Space Controller Model
Spatial Information System
Software design ＊ Space Design
• WMP systems with GUI : Model View Controller Model
View
Model
5. 出力
1.入力
３. 呼び出し
4. 参照
2. 命令Controller

14. CityCompiler : Overview
Google
Sketch Up
A(t+1)Cs(1)
Ci(1)
Cs(2)
Ci(2)
Compile
編集
Ci(3)
Cs(3)
Software
Design
Space
Design
Model, View・Space, Controller
Java
Monkey
Engine
A(t+1)
C(1.5)
E(t+1)
an integrated environment for iteration-based
development of spatial interactive systems
installation
into the real world
Processing

15. CityCompiler : Class Diagram
CityCompiler
SimpleGame
DisplayTest
Sensor
Manager
Camera DistanceSensor
SensorDisplay ProjectorModel
Node
Class Library of CityCompiler
PApplet
3D model
NodeController

16. CityCompiler : Demo
• Beijing National Aquatics Center, Water Cube, 北京国家游泳中心
• Blue Big Bubbles
• Light Up at night.
• Projecting of more bubbles in CityCompiler.

17. GreenPix
The Zero energy Media wall by by Simone Giostra & Partners and Arup
• a media wall in Beijing
• http://www.greenpix.org/
• each pixel : LED + solar battery
• integration of sustainable technology and media technology

18. Operation, Action, Inter-action
Space
(City, Architecture)
Information Systems
( Computer, Network,
Smart Phone etc.)
Integration of
Software Design and Space Design
Model, View,
Controller
Space
Space
CityCompiler