Recomendados
Mais conteúdo relacionado
Destaque
Destaque (19)
Semelhante a Motion Sensors + Audio Visual Performance
Semelhante a Motion Sensors + Audio Visual Performance (20)
Último
Último (15)
Motion Sensors + Audio Visual Performance
- 1. Motion Sensors + Audio Visual Performance: Using Kinect to Control Live Visuals and Sound by Joey Bargsten, Ph.D. Florida Atlantic University • SCMS • MTEn
- 3. Format/Overview: • Presentation / Demo (noon – 12:40) • Questions? (12:40 – 12:50) • Break (10 min) • Workshop on PureData (1pm – 2pm)
- 5. Background on Kinect • Released November 2010
- 6. Background on Kinect • Released November 2010 • Sold 8M units in 60 days
- 7. Background on Kinect • Released November 2010 • Sold 8M units in 60 days • SDK Drama!
- 8. Kinect (Development) Community • Gaming and Virtuality
- 9. Kinect (Development) Community • Gaming and Virtuality • Medicine
- 10. Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition
- 11. Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition • Robotics
- 12. Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition • Robotics • 3D Scanning and Printing
- 13. Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition • Robotics • 3D Scanning and Printing • Avant-Garde Art, Music, and Performance
- 15. My Configuration • Kinect Sensor (2011); Model 1414, EN/ES US HD (this is the most ‘open’ one!) • Synapse Middleware (converts skeleton to OSC) • PureData v. 0.43.4-Extended (incl. MrPeach library) • Quartz Composer v. 4.0 (+ old FW400 SD camcorder) • 2011 MBP, 2.4mHz, running OSX 7.5 “Lion”.
- 16. Approaches to Performance • One-Person Band (virtuoso!) – One person, one controller – Controls both audio and visual Video on YouTube http://www.youtube.com/watch?v=1ge7RcIBWsc
- 17. Approaches to Performance • Division of Labor (conventional ensembles)
- 18. Approaches to Performance • Division of Labor (conventional ensembles) “For every new technology that comes along, make an ensemble out of it!”—JB, EMV (2011)
- 19. Approaches to Performance • Division of Labor (conventional ensembles) “For every new technology that comes along, make an ensemble out of it!”—JB, EMV (2011) • Applied to Kinect: –Multiple controllers –Dedicate separate software to audio and visuals –Multiple performers for audio and visuals
- 20. What Do You Want to Control? SONIC COMPONENTS Background: ambient • sustained • slow rate of change • non-pitched (environments) or pitched (“harmonic”) Middleground: active • patterned /predictable rates of change • motor rhythm + overlays + articulation points (“rhythmic”) Foreground: solo • draws attention • contrasting ‘change vocabulary’ • contrasting timbre (“melodic”) VISUAL COMPONENTS Background: abstract • blurry, fuzzy, indistinct • textures • slow rate of change Middleground: referential, pictoral images • abstractions of geometry or biology • text / motion graphics • Foreground: interactive visuals (may also be referential, pictoral, live, connected to sound events)
- 21. How Do You Want To Control It? • Discontinuous, trigger events – model: keyboard • Continuous, gradual events – model: theremin • Hybrid Control: multiple parameters – model: sample player
- 23. Kinect Kombo™: Quad Theremin + Sample Player • Built in PureData • Free, cc-by-d-nc
- 24. Kinect Kombo™: Skeleton View + Performer Interface
- 25. Kinect Kombo™
- 26. Kinect Kombo™
- 29. Variations • Figure – Simple Camera Figure and Skeleton – Primitives, 3D Objects, Video Mapped to Skeleton • Paint Brush/Image Hose (Effects Mapped to Skeleton) • Background (Texture or Stylized Video Controlled by Skeleton)
- 30. “My Profundis (2012)” Video on YouTube http://www.youtube.com/watch?v=gT1lbhR1Qj8
- 31. Resources • OpenKinect.org • V002.info (vade & bangnoise) • OpenNI.org • Cycling74.com • PureData.info • IdeaChannel ‘Kinect’ Episode • Synapsekinect.tumblr.com • CreateDigitalMusic.com • CreateDigitalMotion.com • OffBook ‘Creative Coding’ Episode • www.fau.edu/scms (MFA - MTEn) • www.badmindtime.com • Melancholalaland™ (my multimedia opera)
Notas do Editor
- ----- Meeting Notes (2/1/14 16:06) ----- A quick word of thanks to Dileana Alexander and everyone at Filmgate for hosting a really fantastic array of events in this conference, Also thanks to Lolo Resnick and eveyone at Sweat Records for hosting this event!
- ----- Meeting Notes (2/1/14 16:06) ----- In the domain of sound, I'm trying to use a language that can be applied across a wide spectrum of genres—pop, jazz, world music, classical, electronic, experimental, avant-garde, etc. Kinect has already found its way into the world of dubstep and experimental eletronic performance.