Bodily Interaction Lecture Notes 31.3.2011 by Ferhat Sen Aalto University, School of Art and Design Media Lab

1. Bodily Interaction
Lecture 3, 31.3.2011
by Ferhat Sen

2. Two Paths for Kinect
• OpenKinect (libfreenect)
• OpenNI/NITE

3. TUIOKinect
• simple hand gestures using the
Kinect
• depth filtering method
• blob detection
• sends control data based on the
TUIO protocol (based on OSC)
• libfreenect by the OpenKinect
• Mac Only, needs to be compiled
for other platforms

4. TUIO

5. OpenNI2TUIO
• uses OpenNI
• skeletal tracking method
• sends only active hands
• thru TUIO protocol
• sends it to localhost on
port 3333. to change:
modify the code and
compile.
• Mac Only, needs to be
compiled for other
platforms http://vimeo.com/20557107

6. KinectCoreVision
• Depth Filtering Method
• Finger tracking (fingertip
detection)
• Not robust yet
• Sends through TUIO
http://vimeo.com/20904879

7. KinectTouch
• multitouch pad
out of any surface
• depth filter
• touch pad area
can be defined
manually.
• touch points are
mapped to TUIO
cursors
http://www.youtube.com/watch?v=4zXtV66cFDY

8. pix_freekinect
• uses libfreenect-OpenKinect
• Tilt Head
• change Led Color
• get RGB (not worked on mine)
• getDepth (not worked on mine)
• getIR(not worked on Mine)

9. Receive TUIO in PD
http://www.tuio.org/?software
• sessionID cursorID xPos yPos xSpeed ySpeed acceleration
• Pure Data: TUIO_PureData.zip

10. Skeletal Tracking in PD
• on monday :)