SlideShare uma empresa Scribd logo
1 de 47
Baixar para ler offline
Computer Vision for Microscopes       -1-         Modelling Research Centre, 16th Dec 2005




                  Computer Vision for Microscopes

                Microsystem & Machine Vision Laboratory

                                    16th Dec 2005




   MMVL       http://vision.eng.shu.ac.uk/mmvl/ (vision/www)
   MRC        http://www.shu.ac.uk/research/meri/modelling_rc.html
   MERI       http://www.shu.ac.uk/research/meri/
   SHU        http://www.shu.ac.uk/




                                                              Microsystem & Machine Vision
Sheffield Hallam University
                                                                       Laboratory
Computer Vision for Microscopes    -2-       Modelling Research Centre, 16th Dec 2005




                                    MiCRoN
                        European Union IST project
      Uppsala, Lausanne, St. Ingbert, Athens, Pisa, Barcelona, Karlsruhe


                                               project goals
                                                 • Manipulate µm-sized
                                                   objects
                                                 • Closed-loop control of
                                                   robots
                                                 • 3D object recognition
                                                   and tracking
                                               image acquisition
                                                 • micro-camera
 http://wwwipr.ira.uka.de/~micron/               • microscope
 http://www.cordis.lu/ist/



                                                         Microsystem & Machine Vision
Sheffield Hallam University
                                                                  Laboratory
Computer Vision for Microscopes    -3-     Modelling Research Centre, 16th Dec 2005




                                    MiCRoN




                                                       Microsystem & Machine Vision
Sheffield Hallam University
                                                                Laboratory
Computer Vision for Microscopes    -4-     Modelling Research Centre, 16th Dec 2005




                              MiCRoN hardware (i)
                                    camera




                                                       Microsystem & Machine Vision
Sheffield Hallam University
                                                                Laboratory
Computer Vision for Microscopes        -5-       Modelling Research Centre, 16th Dec 2005




                                    test hardware (i)
                                    test environment




                                                             Microsystem & Machine Vision
Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes      -6-          Modelling Research Centre, 16th Dec 2005




                             MiCRoN hardware (ii)
                                    first pictures




           video


                                                              Microsystem & Machine Vision
Sheffield Hallam University
                                                                       Laboratory
Computer Vision for Microscopes         -7-            Modelling Research Centre, 16th Dec 2005




                                    test hardware (ii)
                            microscope environment




  camera sensor                                 actors




                                                                   Microsystem & Machine Vision
Sheffield Hallam University
                                                                            Laboratory
Computer Vision for Microscopes         -8-       Modelling Research Centre, 16th Dec 2005




                                      software
                         Mimas computer vision toolkit
                            open source computer vision library
                        deliver solution    ⇐    restrict vision domain
                                            ⇐    develop reusable toolset
• Sensor data: V4L, gstreamer-interface
• Segmentation: LSI-filters, morphology, disparity-estimator, DFT,
  image-processing
• Feature-extraction: edges, corners, ...
• Feature-matching: optic flow, SVD-correspondence, correlation, champfer
  matching, PGH, fast POL
• pose-estimation: particle filter, hough transform
         http://vision.eng.shu.ac.uk/mediawiki/index.php/Mimas




                                                               Microsystem & Machine Vision
Sheffield Hallam University
                                                                        Laboratory
Computer Vision for Microscopes    -9-        Modelling Research Centre, 16th Dec 2005




                            Canny-like edge detector




 video                                  edges




                                                          Microsystem & Machine Vision
Sheffield Hallam University
                                                                   Laboratory
Computer Vision for Microscopes        - 10 -    Modelling Research Centre, 16th Dec 2005




                                    geometric hashing
                            1988, Lamdan & Wolfson




                                                             Microsystem & Machine Vision
Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes        - 11 -      Modelling Research Centre, 16th Dec 2005




                                    geometric hashing



 preprocessing                                recognition




                                                               Microsystem & Machine Vision
Sheffield Hallam University
                                                                        Laboratory
Computer Vision for Microscopes        - 12 -     Modelling Research Centre, 16th Dec 2005




                                    geometric hashing
                                      2-D / 2 DOF




                                                              Microsystem & Machine Vision
Sheffield Hallam University
                                                                       Laboratory
Computer Vision for Microscopes        - 13 -     Modelling Research Centre, 16th Dec 2005




                                    geometric hashing
                                      2-D / 2 DOF



                                     
                                     t1                                    
                                     
                                    t2  = s − m                          1
                                                                    VM (  , m)
                                                                           1
                                     0

                             s
                                                                       0 5 5
                                                                       1
                                                                       3
                                                                          m


             m




                                                              Microsystem & Machine Vision
Sheffield Hallam University
                                                                       Laboratory
Computer Vision for Microscopes     - 14 (i) -    Modelling Research Centre, 16th Dec 2005




                                  geometric hashing
                                    2-D / 3 DOF
     scene features




                                                             Microsystem & Machine Vision
   Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes                      - 14 (ii) -       Modelling Research Centre, 16th Dec 2005




                                                   geometric hashing
                                                     2-D / 3 DOF
     scene features                                                hash table




                                  pose (3 DOF)
                                     misses hits
                                                    80


                                                    120




                                                                                  Microsystem & Machine Vision
   Sheffield Hallam University
                                                                                           Laboratory
Computer Vision for Microscopes                      - 14 (iii) -         Modelling Research Centre, 16th Dec 2005




                                                   geometric hashing
                                                     2-D / 3 DOF
     scene features                                                 hash table




                                  pose (3 DOF)
                                     misses hits
                                                    80              10


                                                    120             190




                                                                                     Microsystem & Machine Vision
   Sheffield Hallam University
                                                                                              Laboratory
Computer Vision for Microscopes                      - 14 (iv) -         Modelling Research Centre, 16th Dec 2005




                                                   geometric hashing
                                                     2-D / 3 DOF
     scene features                                                hash table




                                  pose (3 DOF)
                                     misses hits
                                                    80             10             50


                                                    120            190            150




                                                                                    Microsystem & Machine Vision
   Sheffield Hallam University
                                                                                             Laboratory
Computer Vision for Microscopes                      - 14 (v) -         Modelling Research Centre, 16th Dec 2005




                                                   geometric hashing
                                                     2-D / 3 DOF
     scene features                                               hash table




                                  pose (3 DOF)
                                     misses hits
                                                    80            10             50             200∗


                                                    120           190            150            0∗




                                                                                   Microsystem & Machine Vision
   Sheffield Hallam University
                                                                                            Laboratory
Computer Vision for Microscopes        - 15 -       Modelling Research Centre, 16th Dec 2005




                                    geometric hashing
                                      2-D / 3 DOF




 test on artificial sequence                   test on pipette




                                                                Microsystem & Machine Vision
Sheffield Hallam University
                                                                         Laboratory
Computer Vision for Microscopes        - 16 -    Modelling Research Centre, 16th Dec 2005




                                    geometric hashing
                        focus stacks as model database




                                                             Microsystem & Machine Vision
Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes        - 17 -    Modelling Research Centre, 16th Dec 2005




                                    geometric hashing
                                       3-D/4 DOF




           test on povray sequence (time lapse)



                                                             Microsystem & Machine Vision
Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes   - 18 -    Modelling Research Centre, 16th Dec 2005




                            bounded hough transform
               2001/2004, Greenspan, Shang & Jasiobedzki




                                                        Microsystem & Machine Vision
Sheffield Hallam University
                                                                 Laboratory
Computer Vision for Microscopes   - 19 -    Modelling Research Centre, 16th Dec 2005




                            bounded hough transform
               2001/2004, Greenspan, Shang & Jasiobedzki




                                                        Microsystem & Machine Vision
Sheffield Hallam University
                                                                 Laboratory
Computer Vision for Microscopes     - 20 -    Modelling Research Centre, 16th Dec 2005




                            bounded hough transform
                              inverse transformation




                                                          Microsystem & Machine Vision
Sheffield Hallam University
                                                                   Laboratory
Computer Vision for Microscopes       - 21 -    Modelling Research Centre, 16th Dec 2005




                             bounded hough transform
                            houghspace for relative shifts




                                                             Microsystem & Machine Vision
Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes    - 22 -    Modelling Research Centre, 16th Dec 2005




                            bounded hough transform
                             focus stacks for 4 DOF




                                                         Microsystem & Machine Vision
Sheffield Hallam University
                                                                  Laboratory
Computer Vision for Microscopes         - 23 -    Modelling Research Centre, 16th Dec 2005




                               software architecture
                                    application layers




                                                              Microsystem & Machine Vision
Sheffield Hallam University
                                                                       Laboratory
Computer Vision for Microscopes     - 24 -     Modelling Research Centre, 16th Dec 2005




                               software architecture
                              UML static structure




                                                           Microsystem & Machine Vision
Sheffield Hallam University
                                                                    Laboratory
Computer Vision for Microscopes     - 25 -     Modelling Research Centre, 16th Dec 2005




                               software architecture
                            UML collaboration diagram




                                                           Microsystem & Machine Vision
Sheffield Hallam University
                                                                    Laboratory
Computer Vision for Microscopes    - 26 -    Modelling Research Centre, 16th Dec 2005




                                command-line tool




                                                         Microsystem & Machine Vision
Sheffield Hallam University
                                                                  Laboratory
Computer Vision for Microscopes      - 27 -      Modelling Research Centre, 16th Dec 2005




                                       tests
                                    syringe-chip




           video


                                                             Microsystem & Machine Vision
Sheffield Hallam University
                                                                      Laboratory
Computer Vision for Microscopes   - 28 -    Modelling Research Centre, 16th Dec 2005




                                     tests
                                    gripper




           video


                                                        Microsystem & Machine Vision
Sheffield Hallam University
                                                                 Laboratory
Computer Vision for Microscopes    - 29 -    Modelling Research Centre, 16th Dec 2005




                                     tests
                                    gripper2




           video


                                                         Microsystem & Machine Vision
Sheffield Hallam University
                                                                  Laboratory
Computer Vision for Microscopes       - 30 -       Modelling Research Centre, 16th Dec 2005




                                         tests
                                    full automation




 video                                       video




                                                               Microsystem & Machine Vision
Sheffield Hallam University
                                                                        Laboratory
Computer Vision for Microscopes    - 31 -   Modelling Research Centre, 16th Dec 2005




                                MiCRoN setup (i)




                                                        Microsystem & Machine Vision
Sheffield Hallam University
                                                                 Laboratory
Computer Vision for Microscopes    - 32 -    Modelling Research Centre, 16th Dec 2005




                                MiCRoN setup (ii)




                                                         Microsystem & Machine Vision
Sheffield Hallam University
                                                                  Laboratory
Computer Vision for Microscopes     - 33 -    Modelling Research Centre, 16th Dec 2005




                                MiCRoN setup (iii)




                                                          Microsystem & Machine Vision
Sheffield Hallam University
                                                                   Laboratory
Computer Vision for Microscopes    - 34 -    Modelling Research Centre, 16th Dec 2005




                                MiCRoN setup (iv)




                                                         Microsystem & Machine Vision
Sheffield Hallam University
                                                                  Laboratory
Computer Vision for Microscopes        - 35 -   Modelling Research Centre, 16th Dec 2005




                                       MiCRoN
                                    assembly mockup




           video


                                                            Microsystem & Machine Vision
Sheffield Hallam University
                                                                     Laboratory
Computer Vision for Microscopes        - 36 -   Modelling Research Centre, 16th Dec 2005




                                       MiCRoN
                                    assembly mockup




           video


                                                            Microsystem & Machine Vision
Sheffield Hallam University
                                                                     Laboratory
Computer Vision for Microscopes      - 37 -       Modelling Research Centre, 16th Dec 2005




                                    demonstration




           macro-scale demonstration



                                                              Microsystem & Machine Vision
Sheffield Hallam University
                                                                       Laboratory
Computer Vision for Microscopes        - 38 -   Modelling Research Centre, 16th Dec 2005




                                    acknowledgements




• Jon Travis: technical suggestions, administrative support
• Fabio Caparrelli: camera drive/electronics/driver software, electronics setup,
  PI driver software, management
• Balasundram Amavasai: proposal, computer vision suggestions, mimas
  long-term strategy
• Arul Selvan: students supervision, telecentric optics, shift estimation
• Manuel Boissenin: realtime tracking of multiple micro-objects, parallelisation
• Jan Wedekind: software architecture and integration, realtime recognition of
  multiple micro-objects




                                                            Microsystem & Machine Vision
Sheffield Hallam University
                                                                     Laboratory
Computer Vision for Microscopes   - 39 -   Modelling Research Centre, 16th Dec 2005




                                                       Microsystem & Machine Vision
Sheffield Hallam University
                                                                Laboratory
Computer Vision for Microscopes   - 40 -   Modelling Research Centre, 16th Dec 2005




                                                       Microsystem & Machine Vision
Sheffield Hallam University
                                                                Laboratory
Computer Vision for Microscopes   - 41 -   Modelling Research Centre, 16th Dec 2005




                                                       Microsystem & Machine Vision
Sheffield Hallam University
                                                                Laboratory
Computer Vision for Microscopes   - 42 -   Modelling Research Centre, 16th Dec 2005




                                                       Microsystem & Machine Vision
Sheffield Hallam University
                                                                Laboratory
Computer Vision for Microscopes        - 43 -   Modelling Research Centre, 16th Dec 2005




                                    Happy Christmas!
                  http://vision.eng.shu.ac.uk/mediawiki/




                      Upcoming: MiCRoN public final report



                                                            Microsystem & Machine Vision
Sheffield Hallam University
                                                                     Laboratory

Mais conteúdo relacionado

Mais procurados

Foreground algorithms for detection and extraction of an object in multimedia...
Foreground algorithms for detection and extraction of an object in multimedia...Foreground algorithms for detection and extraction of an object in multimedia...
Foreground algorithms for detection and extraction of an object in multimedia...
IJECEIAES
 
03 history of cv - a personal perspective
03  history of cv - a personal perspective03  history of cv - a personal perspective
03 history of cv - a personal perspective
zukun
 

Mais procurados (13)

Hyperspectral Retinal Imaging
Hyperspectral Retinal ImagingHyperspectral Retinal Imaging
Hyperspectral Retinal Imaging
 
Purkinje imaging for crystalline lens density measurement
Purkinje imaging for crystalline lens density measurementPurkinje imaging for crystalline lens density measurement
Purkinje imaging for crystalline lens density measurement
 
Advanced Retinal Imaging
Advanced Retinal ImagingAdvanced Retinal Imaging
Advanced Retinal Imaging
 
Multispectral Purkinje Imaging
 Multispectral Purkinje Imaging Multispectral Purkinje Imaging
Multispectral Purkinje Imaging
 
Optical Designs for Fundus Cameras
Optical Designs for Fundus CamerasOptical Designs for Fundus Cameras
Optical Designs for Fundus Cameras
 
Portable Multispectral Fundus Camera
Portable Multispectral Fundus CameraPortable Multispectral Fundus Camera
Portable Multispectral Fundus Camera
 
Practical Considerations in the design of Embedded Ophthalmic Devices
Practical Considerations in the design of Embedded Ophthalmic DevicesPractical Considerations in the design of Embedded Ophthalmic Devices
Practical Considerations in the design of Embedded Ophthalmic Devices
 
Time-resolved biomedical sensing through scattering medium
Time-resolved biomedical sensing through scattering mediumTime-resolved biomedical sensing through scattering medium
Time-resolved biomedical sensing through scattering medium
 
Analyzing and integrating probabilistic and deterministic computational model...
Analyzing and integrating probabilistic and deterministic computational model...Analyzing and integrating probabilistic and deterministic computational model...
Analyzing and integrating probabilistic and deterministic computational model...
 
Foreground algorithms for detection and extraction of an object in multimedia...
Foreground algorithms for detection and extraction of an object in multimedia...Foreground algorithms for detection and extraction of an object in multimedia...
Foreground algorithms for detection and extraction of an object in multimedia...
 
Smartphone-powered Ophthalmic Diagnostics
Smartphone-powered Ophthalmic DiagnosticsSmartphone-powered Ophthalmic Diagnostics
Smartphone-powered Ophthalmic Diagnostics
 
Future of Retinal Diagnostics
Future of Retinal DiagnosticsFuture of Retinal Diagnostics
Future of Retinal Diagnostics
 
03 history of cv - a personal perspective
03  history of cv - a personal perspective03  history of cv - a personal perspective
03 history of cv - a personal perspective
 

Destaque

comparison of light and electron microscopes
comparison of  light and electron microscopescomparison of  light and electron microscopes
comparison of light and electron microscopes
Samith Senadeera
 
Microscopes and microscopy
Microscopes and microscopyMicroscopes and microscopy
Microscopes and microscopy
Dakota Boswell
 
Polarization
PolarizationPolarization
Polarization
zieyraa
 
Scanning electron microscopy mubbu
Scanning electron microscopy mubbuScanning electron microscopy mubbu
Scanning electron microscopy mubbu
Mubashshir Arif
 

Destaque (20)

Chapter 2 1 (microscopes)
Chapter 2 1 (microscopes)Chapter 2 1 (microscopes)
Chapter 2 1 (microscopes)
 
The cell theory and the microscopes 4º ESO IES Pedro de Luna -ZARAGOZA
The cell theory and the microscopes 4º ESO IES Pedro de Luna -ZARAGOZAThe cell theory and the microscopes 4º ESO IES Pedro de Luna -ZARAGOZA
The cell theory and the microscopes 4º ESO IES Pedro de Luna -ZARAGOZA
 
Microscopes
MicroscopesMicroscopes
Microscopes
 
comparison of light and electron microscopes
comparison of  light and electron microscopescomparison of  light and electron microscopes
comparison of light and electron microscopes
 
the light_electron microscopy]
 the light_electron microscopy] the light_electron microscopy]
the light_electron microscopy]
 
Microscopes and microscopy
Microscopes and microscopyMicroscopes and microscopy
Microscopes and microscopy
 
Magnification and microscopes
Magnification and microscopesMagnification and microscopes
Magnification and microscopes
 
Anatomy and histology types of microscopes ppt
Anatomy and histology types of microscopes pptAnatomy and histology types of microscopes ppt
Anatomy and histology types of microscopes ppt
 
Polarized microscopy seminar/prosthodontic courses
Polarized microscopy seminar/prosthodontic coursesPolarized microscopy seminar/prosthodontic courses
Polarized microscopy seminar/prosthodontic courses
 
TRANSMISSION ELECTRON MICROSCOPY
TRANSMISSION ELECTRON MICROSCOPYTRANSMISSION ELECTRON MICROSCOPY
TRANSMISSION ELECTRON MICROSCOPY
 
Polarization
PolarizationPolarization
Polarization
 
Uses of Polarized Light
Uses of Polarized LightUses of Polarized Light
Uses of Polarized Light
 
Transmission electron microscopy
Transmission electron microscopyTransmission electron microscopy
Transmission electron microscopy
 
Polarization
PolarizationPolarization
Polarization
 
Phase contrast microscopy
Phase contrast microscopyPhase contrast microscopy
Phase contrast microscopy
 
Bright field microscopes
Bright field microscopesBright field microscopes
Bright field microscopes
 
Scanning electron microscopy mubbu
Scanning electron microscopy mubbuScanning electron microscopy mubbu
Scanning electron microscopy mubbu
 
phase contrast microscope
phase contrast microscopephase contrast microscope
phase contrast microscope
 
Types of Microscope
Types of MicroscopeTypes of Microscope
Types of Microscope
 
Scanning Electron Microscopy (SEM) lecture
Scanning Electron Microscopy (SEM) lectureScanning Electron Microscopy (SEM) lecture
Scanning Electron Microscopy (SEM) lecture
 

Semelhante a Computer vision for microscopes

modelling-and-simulation-made-easy-with-simulink.pdf
modelling-and-simulation-made-easy-with-simulink.pdfmodelling-and-simulation-made-easy-with-simulink.pdf
modelling-and-simulation-made-easy-with-simulink.pdf
GBBarrios
 
Team29-Presentation Final
Team29-Presentation FinalTeam29-Presentation Final
Team29-Presentation Final
Zhentao Xu
 

Semelhante a Computer vision for microscopes (20)

Face recognition system
Face recognition systemFace recognition system
Face recognition system
 
Towards Cyber-Physical System technologies over Apache VCL
Towards Cyber-Physical System technologies over Apache VCLTowards Cyber-Physical System technologies over Apache VCL
Towards Cyber-Physical System technologies over Apache VCL
 
modelling-and-simulation-made-easy-with-simulink.pdf
modelling-and-simulation-made-easy-with-simulink.pdfmodelling-and-simulation-made-easy-with-simulink.pdf
modelling-and-simulation-made-easy-with-simulink.pdf
 
Anatomical Model Database
Anatomical Model DatabaseAnatomical Model Database
Anatomical Model Database
 
Rapid Prototyping and its Applications
Rapid Prototyping and its ApplicationsRapid Prototyping and its Applications
Rapid Prototyping and its Applications
 
MMV Research Laboratory :A Retrospective Around Multimedia and Computer Visio...
MMV Research Laboratory :A Retrospective Around Multimedia and Computer Visio...MMV Research Laboratory :A Retrospective Around Multimedia and Computer Visio...
MMV Research Laboratory :A Retrospective Around Multimedia and Computer Visio...
 
OSG(a)i: because AI needs a runtime - Tim Verbelen (imec)
OSG(a)i: because AI needs a runtime - Tim Verbelen (imec)OSG(a)i: because AI needs a runtime - Tim Verbelen (imec)
OSG(a)i: because AI needs a runtime - Tim Verbelen (imec)
 
DIP Course Projects (HCR)
DIP Course Projects (HCR)DIP Course Projects (HCR)
DIP Course Projects (HCR)
 
Delegate Showcase - Davide Zilli
Delegate Showcase - Davide ZilliDelegate Showcase - Davide Zilli
Delegate Showcase - Davide Zilli
 
Research Training Group METRIK
Research Training Group METRIKResearch Training Group METRIK
Research Training Group METRIK
 
Team29-Presentation Final
Team29-Presentation FinalTeam29-Presentation Final
Team29-Presentation Final
 
Introducing Set Of Internal Parameters For Laplacian Faces
Introducing Set Of Internal Parameters For Laplacian FacesIntroducing Set Of Internal Parameters For Laplacian Faces
Introducing Set Of Internal Parameters For Laplacian Faces
 
CV of Rahman
CV of RahmanCV of Rahman
CV of Rahman
 
Career reflections ICCBR 2011 Doctoral Consortium
Career reflections ICCBR 2011 Doctoral ConsortiumCareer reflections ICCBR 2011 Doctoral Consortium
Career reflections ICCBR 2011 Doctoral Consortium
 
Simulation experiment descriptions and management
Simulation experiment descriptions and managementSimulation experiment descriptions and management
Simulation experiment descriptions and management
 
Bridging Concepts and Practice in eScience via Simulation-driven Engineering
Bridging Concepts and Practice in eScience via Simulation-driven EngineeringBridging Concepts and Practice in eScience via Simulation-driven Engineering
Bridging Concepts and Practice in eScience via Simulation-driven Engineering
 
Next Gen Computational Ophthalmic Imaging for Neurodegenerative Diseases and ...
Next Gen Computational Ophthalmic Imaging for Neurodegenerative Diseases and ...Next Gen Computational Ophthalmic Imaging for Neurodegenerative Diseases and ...
Next Gen Computational Ophthalmic Imaging for Neurodegenerative Diseases and ...
 
Night vision technology applications
Night vision technology applicationsNight vision technology applications
Night vision technology applications
 
Open Cv – An Introduction To The Vision
Open Cv – An Introduction To The VisionOpen Cv – An Introduction To The Vision
Open Cv – An Introduction To The Vision
 
Thesis presentation
Thesis presentationThesis presentation
Thesis presentation
 

Mais de Jan Wedekind

Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...
Jan Wedekind
 
Focus set based reconstruction of micro-objects
Focus set based reconstruction of micro-objectsFocus set based reconstruction of micro-objects
Focus set based reconstruction of micro-objects
Jan Wedekind
 
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Jan Wedekind
 
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Jan Wedekind
 

Mais de Jan Wedekind (16)

The SOLID Principles for Software Design
The SOLID Principles for Software DesignThe SOLID Principles for Software Design
The SOLID Principles for Software Design
 
Fundamentals of Computing
Fundamentals of ComputingFundamentals of Computing
Fundamentals of Computing
 
Using Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration GridUsing Generic Image Processing Operations to Detect a Calibration Grid
Using Generic Image Processing Operations to Detect a Calibration Grid
 
Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...Efficient implementations of machine vision algorithms using a dynamically ty...
Efficient implementations of machine vision algorithms using a dynamically ty...
 
Focus set based reconstruction of micro-objects
Focus set based reconstruction of micro-objectsFocus set based reconstruction of micro-objects
Focus set based reconstruction of micro-objects
 
Machine vision and device integration with the Ruby programming language (2008)
Machine vision and device integration with the Ruby programming language (2008)Machine vision and device integration with the Ruby programming language (2008)
Machine vision and device integration with the Ruby programming language (2008)
 
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
Reconstruction (of micro-objects) based on focus-sets using blind deconvoluti...
 
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
Fokus-serien basierte Rekonstruktion von Mikroobjekten (2002)
 
Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011
Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011
Play Squash with Ruby, OpenGL, and a Wiimote - ShRUG Feb 2011
 
Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...
Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...
Digital Imaging with Free Software - Talk at Sheffield Astronomical Society J...
 
Machine Vision made easy with Ruby - ShRUG June 2010
Machine Vision made easy with Ruby - ShRUG June 2010Machine Vision made easy with Ruby - ShRUG June 2010
Machine Vision made easy with Ruby - ShRUG June 2010
 
Computer Vision using Ruby and libJIT - RubyConf 2009
Computer Vision using Ruby and libJIT - RubyConf 2009Computer Vision using Ruby and libJIT - RubyConf 2009
Computer Vision using Ruby and libJIT - RubyConf 2009
 
Real-time Computer Vision With Ruby - OSCON 2008
Real-time Computer Vision With Ruby - OSCON 2008Real-time Computer Vision With Ruby - OSCON 2008
Real-time Computer Vision With Ruby - OSCON 2008
 
Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006
Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006
Object Recognition and Real-Time Tracking in Microscope Imaging - IMVIP 2006
 
Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...
Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...
Steerable Filters generated with the Hypercomplex Dual-Tree Wavelet Transform...
 
Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009
Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009
Ruby & Machine Vision - Talk at Sheffield Hallam University Feb 2009
 

Último

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Último (20)

A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 

Computer vision for microscopes

  • 1. Computer Vision for Microscopes -1- Modelling Research Centre, 16th Dec 2005 Computer Vision for Microscopes Microsystem & Machine Vision Laboratory 16th Dec 2005 MMVL http://vision.eng.shu.ac.uk/mmvl/ (vision/www) MRC http://www.shu.ac.uk/research/meri/modelling_rc.html MERI http://www.shu.ac.uk/research/meri/ SHU http://www.shu.ac.uk/ Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 2. Computer Vision for Microscopes -2- Modelling Research Centre, 16th Dec 2005 MiCRoN European Union IST project Uppsala, Lausanne, St. Ingbert, Athens, Pisa, Barcelona, Karlsruhe project goals • Manipulate µm-sized objects • Closed-loop control of robots • 3D object recognition and tracking image acquisition • micro-camera http://wwwipr.ira.uka.de/~micron/ • microscope http://www.cordis.lu/ist/ Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 3. Computer Vision for Microscopes -3- Modelling Research Centre, 16th Dec 2005 MiCRoN Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 4. Computer Vision for Microscopes -4- Modelling Research Centre, 16th Dec 2005 MiCRoN hardware (i) camera Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 5. Computer Vision for Microscopes -5- Modelling Research Centre, 16th Dec 2005 test hardware (i) test environment Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 6. Computer Vision for Microscopes -6- Modelling Research Centre, 16th Dec 2005 MiCRoN hardware (ii) first pictures video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 7. Computer Vision for Microscopes -7- Modelling Research Centre, 16th Dec 2005 test hardware (ii) microscope environment camera sensor actors Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 8. Computer Vision for Microscopes -8- Modelling Research Centre, 16th Dec 2005 software Mimas computer vision toolkit open source computer vision library deliver solution ⇐ restrict vision domain ⇐ develop reusable toolset • Sensor data: V4L, gstreamer-interface • Segmentation: LSI-filters, morphology, disparity-estimator, DFT, image-processing • Feature-extraction: edges, corners, ... • Feature-matching: optic flow, SVD-correspondence, correlation, champfer matching, PGH, fast POL • pose-estimation: particle filter, hough transform http://vision.eng.shu.ac.uk/mediawiki/index.php/Mimas Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 9. Computer Vision for Microscopes -9- Modelling Research Centre, 16th Dec 2005 Canny-like edge detector video edges Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 10. Computer Vision for Microscopes - 10 - Modelling Research Centre, 16th Dec 2005 geometric hashing 1988, Lamdan & Wolfson Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 11. Computer Vision for Microscopes - 11 - Modelling Research Centre, 16th Dec 2005 geometric hashing preprocessing recognition Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 12. Computer Vision for Microscopes - 12 - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 2 DOF Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 13. Computer Vision for Microscopes - 13 - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 2 DOF   t1     t2  = s − m 1   VM (  , m) 1 0 s 0 5 5 1 3 m m Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 14. Computer Vision for Microscopes - 14 (i) - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 3 DOF scene features Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 15. Computer Vision for Microscopes - 14 (ii) - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 3 DOF scene features hash table pose (3 DOF) misses hits 80 120 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 16. Computer Vision for Microscopes - 14 (iii) - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 3 DOF scene features hash table pose (3 DOF) misses hits 80 10 120 190 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 17. Computer Vision for Microscopes - 14 (iv) - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 3 DOF scene features hash table pose (3 DOF) misses hits 80 10 50 120 190 150 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 18. Computer Vision for Microscopes - 14 (v) - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 3 DOF scene features hash table pose (3 DOF) misses hits 80 10 50 200∗ 120 190 150 0∗ Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 19. Computer Vision for Microscopes - 15 - Modelling Research Centre, 16th Dec 2005 geometric hashing 2-D / 3 DOF test on artificial sequence test on pipette Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 20. Computer Vision for Microscopes - 16 - Modelling Research Centre, 16th Dec 2005 geometric hashing focus stacks as model database Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 21. Computer Vision for Microscopes - 17 - Modelling Research Centre, 16th Dec 2005 geometric hashing 3-D/4 DOF test on povray sequence (time lapse) Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 22. Computer Vision for Microscopes - 18 - Modelling Research Centre, 16th Dec 2005 bounded hough transform 2001/2004, Greenspan, Shang & Jasiobedzki Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 23. Computer Vision for Microscopes - 19 - Modelling Research Centre, 16th Dec 2005 bounded hough transform 2001/2004, Greenspan, Shang & Jasiobedzki Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 24. Computer Vision for Microscopes - 20 - Modelling Research Centre, 16th Dec 2005 bounded hough transform inverse transformation Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 25. Computer Vision for Microscopes - 21 - Modelling Research Centre, 16th Dec 2005 bounded hough transform houghspace for relative shifts Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 26. Computer Vision for Microscopes - 22 - Modelling Research Centre, 16th Dec 2005 bounded hough transform focus stacks for 4 DOF Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 27. Computer Vision for Microscopes - 23 - Modelling Research Centre, 16th Dec 2005 software architecture application layers Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 28. Computer Vision for Microscopes - 24 - Modelling Research Centre, 16th Dec 2005 software architecture UML static structure Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 29. Computer Vision for Microscopes - 25 - Modelling Research Centre, 16th Dec 2005 software architecture UML collaboration diagram Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 30. Computer Vision for Microscopes - 26 - Modelling Research Centre, 16th Dec 2005 command-line tool Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 31. Computer Vision for Microscopes - 27 - Modelling Research Centre, 16th Dec 2005 tests syringe-chip video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 32. Computer Vision for Microscopes - 28 - Modelling Research Centre, 16th Dec 2005 tests gripper video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 33. Computer Vision for Microscopes - 29 - Modelling Research Centre, 16th Dec 2005 tests gripper2 video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 34. Computer Vision for Microscopes - 30 - Modelling Research Centre, 16th Dec 2005 tests full automation video video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 35. Computer Vision for Microscopes - 31 - Modelling Research Centre, 16th Dec 2005 MiCRoN setup (i) Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 36. Computer Vision for Microscopes - 32 - Modelling Research Centre, 16th Dec 2005 MiCRoN setup (ii) Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 37. Computer Vision for Microscopes - 33 - Modelling Research Centre, 16th Dec 2005 MiCRoN setup (iii) Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 38. Computer Vision for Microscopes - 34 - Modelling Research Centre, 16th Dec 2005 MiCRoN setup (iv) Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 39. Computer Vision for Microscopes - 35 - Modelling Research Centre, 16th Dec 2005 MiCRoN assembly mockup video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 40. Computer Vision for Microscopes - 36 - Modelling Research Centre, 16th Dec 2005 MiCRoN assembly mockup video Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 41. Computer Vision for Microscopes - 37 - Modelling Research Centre, 16th Dec 2005 demonstration macro-scale demonstration Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 42. Computer Vision for Microscopes - 38 - Modelling Research Centre, 16th Dec 2005 acknowledgements • Jon Travis: technical suggestions, administrative support • Fabio Caparrelli: camera drive/electronics/driver software, electronics setup, PI driver software, management • Balasundram Amavasai: proposal, computer vision suggestions, mimas long-term strategy • Arul Selvan: students supervision, telecentric optics, shift estimation • Manuel Boissenin: realtime tracking of multiple micro-objects, parallelisation • Jan Wedekind: software architecture and integration, realtime recognition of multiple micro-objects Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 43. Computer Vision for Microscopes - 39 - Modelling Research Centre, 16th Dec 2005 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 44. Computer Vision for Microscopes - 40 - Modelling Research Centre, 16th Dec 2005 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 45. Computer Vision for Microscopes - 41 - Modelling Research Centre, 16th Dec 2005 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 46. Computer Vision for Microscopes - 42 - Modelling Research Centre, 16th Dec 2005 Microsystem & Machine Vision Sheffield Hallam University Laboratory
  • 47. Computer Vision for Microscopes - 43 - Modelling Research Centre, 16th Dec 2005 Happy Christmas! http://vision.eng.shu.ac.uk/mediawiki/ Upcoming: MiCRoN public final report Microsystem & Machine Vision Sheffield Hallam University Laboratory