SlideShare uma empresa Scribd logo
1 de 34
Visions Project K.1.0
     A DIY interactive 3-D device
             by Francesca Mereu and Javier Villarroel
(VLAB4D Visualization Advanced Group)




                                          http://visionlab4d.com.ar
Visions Project K.



The Visions Project K. is a volumetric device that allows
pseudo visualization of 3-D objects and their interaction
with the user.
Visions Project K.




VISIONS Poject K. 1.0 (Interactive video hologram ), is research project on the
video holograms and interactive 3D devices, which was presented at the Medialab- Prado
Center for Digital Art Culture in Madrid in February 2012.



                 TO RESEARCH ON 3-D DISPLAY DEVICE AND DEVELOP A LOW COST
                 PROTOTYPE, EASY TO ASSEMBLE, THAT USE A OPEN SOURCE
 AIMS:           SOFTWARE;

                 TO VISUALIZE 3-D IMAGE AS VIDEOHOLOGRAMS;

                 TO EXPERIMENT USER INTERACTION as EXPERIENCE WITH
                 3-D IMAGE FLOATING IN THE AIR: HAPTIC INTERACTION AND VISUAL
                 INTERACTION.
Firstprototype: Medialab-Prado 2009
Visions Project K.


How visualize 3-D images
Objects are projected onto a pyramidal structure with a LCD monitor, and due
to the special geometry of the structure, it looks like real 3-D objects floating
inside the pyramid for any observer from any direction.
Visions Project K.


Optical System
Visions Project K.


                                    How does it work?
The device use a Kinect camera to
capture the interaction;

 a LCD monitor to projecting the 3-D
image;

 a PC to process and control the
device;
 a pyramidal structure where the
image is projected;

 a external structure to support the
monitor and protect the pyramid;




                      There are 2 types of interaction user: visual and haptica
Visions Project K.




DIY
a digital fabrication
Visions Project K.



• This project has been
  conceived like a low cost DIY
  portable device;

• The structure is light and easy
  of build and dismantle;



• all the information necessary
  to create, build and how to
  make that work isshare by a
  Creative Commons License
Visions Project K.


OPEN DESIGN: Sketchup

The materials to build the
entire device are:

8 plastic tubes (45 cm).
4 plastic tubes (20 cm).
4 plastic triangles to build the
pyramid
4 corners to support the
pyramid and the structure.
4 corners to support the
monitor.
Visions Project K.

      DIY
   DIGITAL FABRICATION




You can download Sketchup 3-D
model

                                           The elements of the structure are
http://sketchup.google.com/3dwarehouse/d   printing by a Makerbot machine
etails?mid=f20afc7c51f36aace20f58bc12c     (OpenFab, Medialab-Prado)
e37ce
Visions Project K.




Hardware
Kinect sensor
Visions Project K.


Hardware:
               CPU:
LCD Monitor    Linux
                Mac
              Windows




                 3D sensor
                  (Kinect)
Visions Project K.


   Hardware:

             Kinect


Microphone                Microphone
     Láser IR
       CMOS RGB     CMOS IR

                Motor


                                       IR pattern proyection
Visions Project K.


Hardware:

  Kinect applications
            1. 3D Scene
            2. RGB Image
            3. Body and objects recognition
            4. Gesture Recognition
            5. Voice command recognition
            6. Tilt control
Visions Project K.




 HACKING KINECT by


FLOSS
Visions Project K.


    Software: Processing in multiplatform
• The device use a Kinect camera, in order to visualize people in 3-D
  space; It use an open source drivers

• The OpenNI framework provides a set of open source APIs. These APIs are
  intended to become a standard for applications to access natural
  interaction devices.


•   The APIs provide support for Voice and voice command recognition; Hand
    gestures; Body; Motion Tracking

• The software was developed with the OpenNI library for
  Processing;
Visions Project K.


Software:
    Open Libraries
    1. OpenKinect    Processing, others

    2. SimpleOpenNIProcessing
    3. dLibsProcessing
    4. OfxKinectOpenFrameworks
    5. Kinect Cinder Block       C/C++
Visions Project K.


Software:   OpenKinect




               Point Cloud
Visions Project K.


Software:             OpenKinect




            Average Point Tracking
Visions Project K.


Software:
        OpenKinect
 Advantage             Disadvantages
  1. Easy to install   1. No recognition

  2. Multiplataform    2. No Alignment

  3. Easy to use
Visions Project K.


Software:
            SimpleOpenNI




             Hands
Visions Project K.


Software:
            SimpleOpenNI




            Gestures
Visions Project K.


VLAB4D development


 OpenKinect          3D Video for VP


 Processing          háptic interaction
                          for VP

                     Telepresence for
 SimpleOpenNI               VP
Visions Project K.




Single projection/videohologram
3D projection/Point Cloud
Visions Project K.



3D Reconstruction/ Full Color
Visions Project K.




Haptic interaction
Visions Project K.


Futures possibilities

1. Increasing the number of applications

2. Mini version for Tablet Pc, Ipad, etc..

3.Use    as    scientific  display     (biology,
   arquitecture, engineering..etc..)
Visions Project K.
Visions Project K.




 THANKS

http://vlab4d.wix.com
           http://visionlab4d.com.ar

        francesca@visionlab4d.com.ar
        desarrollo@visionlab4d.com.ar

Mais conteúdo relacionado

Semelhante a Vision pk1

Vipul divyanshu documentation on Kinect and Motion Tracking
Vipul divyanshu documentation  on Kinect and Motion TrackingVipul divyanshu documentation  on Kinect and Motion Tracking
Vipul divyanshu documentation on Kinect and Motion Tracking
Vipul Divyanshu
 
Corey.Berry.Portfolio.2016
Corey.Berry.Portfolio.2016Corey.Berry.Portfolio.2016
Corey.Berry.Portfolio.2016
Corey Berry
 
Kinect kunkuk final_
Kinect kunkuk final_Kinect kunkuk final_
Kinect kunkuk final_
Yunkyu Choi
 

Semelhante a Vision pk1 (20)

Vipul divyanshu documentation on Kinect and Motion Tracking
Vipul divyanshu documentation  on Kinect and Motion TrackingVipul divyanshu documentation  on Kinect and Motion Tracking
Vipul divyanshu documentation on Kinect and Motion Tracking
 
Nui e biometrics in windows 10
Nui e biometrics in windows 10Nui e biometrics in windows 10
Nui e biometrics in windows 10
 
Corey.Berry.Portfolio.2016
Corey.Berry.Portfolio.2016Corey.Berry.Portfolio.2016
Corey.Berry.Portfolio.2016
 
Natural User Interface Microsoft Kinect and Surface Computing
Natural User Interface Microsoft Kinect and Surface ComputingNatural User Interface Microsoft Kinect and Surface Computing
Natural User Interface Microsoft Kinect and Surface Computing
 
Sketching in Code
Sketching in CodeSketching in Code
Sketching in Code
 
Concerto motionsummer2011week1
Concerto motionsummer2011week1Concerto motionsummer2011week1
Concerto motionsummer2011week1
 
kinetechArts_20150605
kinetechArts_20150605kinetechArts_20150605
kinetechArts_20150605
 
Kinetech Arts Selected Interactive Installations
Kinetech Arts Selected Interactive InstallationsKinetech Arts Selected Interactive Installations
Kinetech Arts Selected Interactive Installations
 
Augmented Reality Application - Final Year Project
Augmented Reality Application - Final Year ProjectAugmented Reality Application - Final Year Project
Augmented Reality Application - Final Year Project
 
Sandeep-portfolio-2016
Sandeep-portfolio-2016Sandeep-portfolio-2016
Sandeep-portfolio-2016
 
Screenless pd presentation
Screenless pd presentationScreenless pd presentation
Screenless pd presentation
 
EoT slides presented at the Road2CPS “Smart-Cyber-Physical Systems Clustering...
EoT slides presented at the Road2CPS “Smart-Cyber-Physical Systems Clustering...EoT slides presented at the Road2CPS “Smart-Cyber-Physical Systems Clustering...
EoT slides presented at the Road2CPS “Smart-Cyber-Physical Systems Clustering...
 
MERLINO2015
MERLINO2015MERLINO2015
MERLINO2015
 
Making Augmented Reality Applications with Android NDK
Making Augmented Reality Applications with Android NDKMaking Augmented Reality Applications with Android NDK
Making Augmented Reality Applications with Android NDK
 
Kinect kunkuk final_
Kinect kunkuk final_Kinect kunkuk final_
Kinect kunkuk final_
 
Microsoft IT Academy Summit 2011
Microsoft IT Academy Summit 2011Microsoft IT Academy Summit 2011
Microsoft IT Academy Summit 2011
 
Microsoft Kinect
Microsoft Kinect Microsoft Kinect
Microsoft Kinect
 
CGV Project Report.pdf
CGV Project Report.pdfCGV Project Report.pdf
CGV Project Report.pdf
 
Concerto motionsummer2011week1
Concerto motionsummer2011week1Concerto motionsummer2011week1
Concerto motionsummer2011week1
 
Kinect on Android Pandaboard
Kinect on Android PandaboardKinect on Android Pandaboard
Kinect on Android Pandaboard
 

Mais de FRANCESCA MEREU (6)

Art&nuove tecnologie
Art&nuove tecnologieArt&nuove tecnologie
Art&nuove tecnologie
 
ALLA SCOPERTA DEI DRONI
ALLA SCOPERTA DEI DRONIALLA SCOPERTA DEI DRONI
ALLA SCOPERTA DEI DRONI
 
The Fabulous printer
 The Fabulous printer The Fabulous printer
The Fabulous printer
 
3d prostehtic hand
3d prostehtic hand3d prostehtic hand
3d prostehtic hand
 
Disegno per la stampa 3 d
Disegno per la stampa 3 dDisegno per la stampa 3 d
Disegno per la stampa 3 d
 
Lilypad arduino y textiles intel1
Lilypad arduino y textiles intel1Lilypad arduino y textiles intel1
Lilypad arduino y textiles intel1
 

Vision pk1

  • 1. Visions Project K.1.0 A DIY interactive 3-D device by Francesca Mereu and Javier Villarroel (VLAB4D Visualization Advanced Group) http://visionlab4d.com.ar
  • 2. Visions Project K. The Visions Project K. is a volumetric device that allows pseudo visualization of 3-D objects and their interaction with the user.
  • 3.
  • 4. Visions Project K. VISIONS Poject K. 1.0 (Interactive video hologram ), is research project on the video holograms and interactive 3D devices, which was presented at the Medialab- Prado Center for Digital Art Culture in Madrid in February 2012. TO RESEARCH ON 3-D DISPLAY DEVICE AND DEVELOP A LOW COST PROTOTYPE, EASY TO ASSEMBLE, THAT USE A OPEN SOURCE AIMS: SOFTWARE; TO VISUALIZE 3-D IMAGE AS VIDEOHOLOGRAMS; TO EXPERIMENT USER INTERACTION as EXPERIENCE WITH 3-D IMAGE FLOATING IN THE AIR: HAPTIC INTERACTION AND VISUAL INTERACTION.
  • 6.
  • 7. Visions Project K. How visualize 3-D images Objects are projected onto a pyramidal structure with a LCD monitor, and due to the special geometry of the structure, it looks like real 3-D objects floating inside the pyramid for any observer from any direction.
  • 9. Visions Project K. How does it work? The device use a Kinect camera to capture the interaction;  a LCD monitor to projecting the 3-D image;  a PC to process and control the device;  a pyramidal structure where the image is projected;  a external structure to support the monitor and protect the pyramid; There are 2 types of interaction user: visual and haptica
  • 10. Visions Project K. DIY a digital fabrication
  • 11. Visions Project K. • This project has been conceived like a low cost DIY portable device; • The structure is light and easy of build and dismantle; • all the information necessary to create, build and how to make that work isshare by a Creative Commons License
  • 12. Visions Project K. OPEN DESIGN: Sketchup The materials to build the entire device are: 8 plastic tubes (45 cm). 4 plastic tubes (20 cm). 4 plastic triangles to build the pyramid 4 corners to support the pyramid and the structure. 4 corners to support the monitor.
  • 13. Visions Project K. DIY DIGITAL FABRICATION You can download Sketchup 3-D model The elements of the structure are http://sketchup.google.com/3dwarehouse/d printing by a Makerbot machine etails?mid=f20afc7c51f36aace20f58bc12c (OpenFab, Medialab-Prado) e37ce
  • 15. Visions Project K. Hardware: CPU: LCD Monitor Linux Mac Windows 3D sensor (Kinect)
  • 16. Visions Project K. Hardware: Kinect Microphone Microphone Láser IR CMOS RGB CMOS IR Motor IR pattern proyection
  • 17. Visions Project K. Hardware: Kinect applications 1. 3D Scene 2. RGB Image 3. Body and objects recognition 4. Gesture Recognition 5. Voice command recognition 6. Tilt control
  • 18.
  • 19. Visions Project K. HACKING KINECT by FLOSS
  • 20. Visions Project K. Software: Processing in multiplatform • The device use a Kinect camera, in order to visualize people in 3-D space; It use an open source drivers • The OpenNI framework provides a set of open source APIs. These APIs are intended to become a standard for applications to access natural interaction devices. • The APIs provide support for Voice and voice command recognition; Hand gestures; Body; Motion Tracking • The software was developed with the OpenNI library for Processing;
  • 21. Visions Project K. Software: Open Libraries 1. OpenKinect Processing, others 2. SimpleOpenNIProcessing 3. dLibsProcessing 4. OfxKinectOpenFrameworks 5. Kinect Cinder Block C/C++
  • 22. Visions Project K. Software: OpenKinect Point Cloud
  • 23. Visions Project K. Software: OpenKinect Average Point Tracking
  • 24. Visions Project K. Software: OpenKinect Advantage Disadvantages 1. Easy to install 1. No recognition 2. Multiplataform 2. No Alignment 3. Easy to use
  • 25. Visions Project K. Software: SimpleOpenNI Hands
  • 26. Visions Project K. Software: SimpleOpenNI Gestures
  • 27. Visions Project K. VLAB4D development OpenKinect 3D Video for VP Processing háptic interaction for VP Telepresence for SimpleOpenNI VP
  • 28. Visions Project K. Single projection/videohologram
  • 30. Visions Project K. 3D Reconstruction/ Full Color
  • 32. Visions Project K. Futures possibilities 1. Increasing the number of applications 2. Mini version for Tablet Pc, Ipad, etc.. 3.Use as scientific display (biology, arquitecture, engineering..etc..)
  • 34. Visions Project K. THANKS http://vlab4d.wix.com http://visionlab4d.com.ar francesca@visionlab4d.com.ar desarrollo@visionlab4d.com.ar

Notas do Editor

  1. Good afternoon, Hi,I’m Francesca Mereu, and I ‘m an Architect, artist and digital art researcher., coordinating VLAB 4D (viulab fordi), an advanced visualization experimental group at Medialab-Prado, focused on projects that links art and technology: Hologramms, 3-D spaces, inmersive reality I’m the creator of M-Artech Platform (Women in art and technology), too I’m a member of MAV, (mujeres en lasartesvisuales), the Spanish association of Women in Visual Arts.
  2. I’m presenting the VISIONS ProjectA volumetric device that allows 3-D pseudo hologram Objects are projected onto a pyramidal structure with a LCD monitor, and due to the special geometry of the structure, it looks like real 3-D objects floating inside the pyramid for any observer from any direction.
  3. Perspecta uses a screen vertical instead of a helical, where images are projected at high speed. The eye merges these images to create a 3D image without seams. Possibly the most advanced of such systems provides a resolution of over 100 million voxels. It consists of a spherical transparent dome gives it a characteristic of "crystal ball" inside a flat screen which rotates at 730 rpm ( seventy, thirstyerre, pi, em). a projector lights on the screen with up to 198 images of 768x768 pixels each, showing one or the other depending on the angle of rotation of the screen.RealFiction is Danish company composed by Peter Simonsen and ClasDyrholm both have educations and professional experience from film, TV and radio production. In 2002 they ventured out on a new journey, inspired by an idea about breaking the frame and forsaking the traditional film and TV-formats, in order to tell stories with video holographic illusions, where fiction and reality merges into a new and powerful world of mixed-reality.
  4. The device uses a Kinect camera, to capture the outward movement of people and allow interaction with the user-object in real time.
  5. The objects are projected onto a pyramidal structure with an LCD monitor, and due to the special geometry of the structure, it looks like real 3-D objects that float inside the pyramid for any observer from any direction without glasses.
  6. 3D Communication software for Design and Engineering Professionals.
  7. Makerbot machine is an affordable, open source 3D printer. It's a machine that can make things. We Used the ABS plastic which is the same thing Lego is made out of
  8. Processing is an open source programming language and environment for people who want to program images, animation, and interactions. It is an open project initiated by Ben Fry and Casey Reas.
  9. The Kinect sensor is a horizontal bar connected to a small base with a motorized pivot and is designed to be positioned lengthwise above or below the video display. The device features an "RGB camera, depth sensor and multi-array microphone running proprietary software", which provide full-body 3D motion capture, facial recognition and voice recognition capabilities.The depth sensor consists of an infrared laser projector combined with a monochrome CMOS sensor, which captures video data in 3D under any ambient light conditions. The sensing range of the depth sensor is adjustable, and the Kinect software is capable of automatically calibrating the sensor based on gameplay and the player's physical environment, accommodating for the presence of furniture or other obstacles
  10. Processing is an open source programming language and environment for people who want to program images, animation, and interactions. It is an open project initiated by Ben Fry and Casey Reas.
  11. Easy to installMultiplataformEasy to useDIsadvantagesNo recognitionNo Alignment
  12. The PCL framework contains numerous state-of-the art algorithms including filtering, feature estimation, surface reconstruction, registration, model fitting and segmentation, as well as higher level tools for performing mapping and object recognition. Think of it as the Boost of 3D point cloud processing.PCL is released under the terms of the BSD license. It is free for commercial and research use.
  13. This structure uses a Kinect camera, in order to capture the external movement of the people and permit the interaction user-object in real time.The user can move the 3-D object with a illusion to “touch” the projected imageBasically, the people are placed around the structure to observe the imageHaptics: haptic Greek: touchPeople have to be positioned a distance of from 0.50 to 100 cm Camerato capture the images. The image can be viewed from all sides EN360 º. There are two types of user interaction: visual and haptic visual. Through estaúltima experienced the illusion that we can "touch" the object 3D.La visual interaction is related to the concept of telepresence as laspopulares images in the Star Wars movies.