SlideShare uma empresa Scribd logo
1 de 28
Spectral Imaging


            Ivo Ihrke
Saarland University/MPI Informatik
The spectral data cube

                         • spectrometer
Principle of Operation - Dispersion




disadvantage:
• dispersion relation is nonlinear
advantage:
• light efficient
Diffraction Grating
                                      Diffraction Order   Percentage of transmitted
                                                          Light
– At center, no diffraction           0                   25%

                                      1                   20.26%
– For higher orders, diffraction is   2                   10.13%

                                      3                    2.25%
  taking place
                                      4                    0%

                                      remainder            9.72%



 disadvantage:
 • low light efficiency
 advantage:
 • linear relation
   pixel pos. <-> wavelength
Diffraction-Based Systems

– Diffraction-based example ->
– Spectrometer calibration (all types)
1. mapping
  pixel <–> wavelength
2. relative intensity of wavelengths
The spectral data cube

• Spatial Scanning        • E.g. in satellite imaging
 (2D sensor)                – Pushbroom scanning
Spatial Scanning
 • Generalized Mosaics [Schechner & Nayar]




 • linear filter
 • each pixel column filtered differently
 • rotational motion & registration to assemble image stack
The spectral data cube

• Spectral scanning
Frequency Scanning

                     • Michelson Interferometer with
                       moving mirror - Fourier Transform
                       Imaging Spectroscopy (FTIS)
Imaging Spectrometers
The quest for the instantaneous spectral data cube
                  (4D Imaging)
Multiplexing - Image slicers




[WiFeS – Wide Field
Spectrometer]
Multiplexing - Image slicers




[SPIFFI - SPectrometer for
Infrared Faint Field Imaging]
Fiber Optical cables (OKSI)

300 “pixels”




2D -> 1D reformatting
Multiplexing: Prism-Mask Based System




            [Du’09]
Computational Imaging Spectrometers
The quest for the instantaneous spectral data cube
CTIS –
Computed Tomography Imaging Spectrometry
 • Original method [Descour’95]
 • Image a full diffraction pattern
 • Perform “CT”




                  spectral image      diffraction pattern
CTIS in graphics




  • HDR imaging
    for CTIS                                 [Habel’12]
  (not snapshot due to HDR exposure stack)
CTIS in graphics


  • Spatial resolution 124x124, 54 bands




                                           [Habel’12]
CASSI – Coded Aperture Snapshot Spectral Imaging
CASSI – Coded Aperture Snapshot Spectral Imaging




               Implementation with prisms
CASSI – Coded Aperture Snapshot Spectral Imaging

 • Resolution: spatial ~200 x 200 pixels
                spectral ~30 bands




 projection       reconstruction (stack)   spectra
Spectral Transfer

 • Transfer low-res spectra to high res RGB
    image [Rump’10,Cao’11]
Applications
Applications
  • automatic white balancing
Spatially uniform illumination




raw from RGB   tungsten WB   `greyworld WB   spectral WB   spectra




 Spatially varying illumination                             [Cao11]
Applications
  • improved tracking



               RGB –           spectral –
               tracking lost   tracking OK




  • real and fake skin detection             [Cao11]
Applications


  • analyze / restore paintings




                                  [Calit]
Applications


  • Satellite-Based Remote Sensing




vegetation mapping   urban land use   pollution monitoring

                                         [DigitalGlobe’10]
• Multispectral at Siggraph’12
  – Kim, Harvey, Kittle, Rushmeier, Dorsey, O’Prum, and Brady “3D
    Imaging Spectroscopy for Measuring Hyperspectral Patterns on
    Solid Objects”, Monday, 3:45 - 5:35 – “Appearance”
  – Hosek and Wilkie, “An Analytic Model for Full Spectral Sky-Dome
    Radiance”, Wednesday 3:45-5:35 pm – “Physics and Mathematics
    for Light”

Mais conteúdo relacionado

Mais procurados

RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterRIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterKevin Nouri
 
Lytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million businessLytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million businessWeili Shi
 
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019StanfordComputationalImaging
 
HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast Barco
 
Digital Radiography
Digital RadiographyDigital Radiography
Digital Radiographyricksw78
 
Particle image velocimetry
Particle image velocimetryParticle image velocimetry
Particle image velocimetryMohsin Siddique
 
3 d imaging super resolution
3 d imaging super resolution3 d imaging super resolution
3 d imaging super resolutionredsea3h
 
194Martin LeungUnerd Poster
194Martin LeungUnerd Poster194Martin LeungUnerd Poster
194Martin LeungUnerd PosterMartin Leung
 
Single photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor FusionSingle photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor FusionDavid Lindell
 
Improved single image dehazing by fusion
Improved single image dehazing by fusionImproved single image dehazing by fusion
Improved single image dehazing by fusioneSAT Publishing House
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)Matthew O'Toole
 
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Barco
 
Object Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online LearningObject Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online LearningJui-Hsin (Larry) Lai
 

Mais procurados (20)

Coded Photography - Ramesh Raskar
Coded Photography - Ramesh RaskarCoded Photography - Ramesh Raskar
Coded Photography - Ramesh Raskar
 
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley PosterRIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
RIM Poster Optics r2.1 - 2-OP-05 Glatzel_Tinsley Poster
 
Raskar Banff
Raskar BanffRaskar Banff
Raskar Banff
 
CORNAR: Looking Around Corners using Trillion FPS Imaging
CORNAR: Looking Around Corners using Trillion FPS ImagingCORNAR: Looking Around Corners using Trillion FPS Imaging
CORNAR: Looking Around Corners using Trillion FPS Imaging
 
Lytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million businessLytro Light Field Camera: from scientific research to a $50-million business
Lytro Light Field Camera: from scientific research to a $50-million business
 
Introduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh RaskarIntroduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh Raskar
 
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
Non-line-of-sight Imaging with Partial Occluders and Surface Normals | TOG 2019
 
HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast HDR in Cinema: Achievable Contrast
HDR in Cinema: Achievable Contrast
 
Digital Radiography
Digital RadiographyDigital Radiography
Digital Radiography
 
Particle image velocimetry
Particle image velocimetryParticle image velocimetry
Particle image velocimetry
 
3 d imaging super resolution
3 d imaging super resolution3 d imaging super resolution
3 d imaging super resolution
 
194Martin LeungUnerd Poster
194Martin LeungUnerd Poster194Martin LeungUnerd Poster
194Martin LeungUnerd Poster
 
Single photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor FusionSingle photon 3D Imaging with Deep Sensor Fusion
Single photon 3D Imaging with Deep Sensor Fusion
 
Dual photography
Dual photographyDual photography
Dual photography
 
Digital Imaging
Digital ImagingDigital Imaging
Digital Imaging
 
Improved single image dehazing by fusion
Improved single image dehazing by fusionImproved single image dehazing by fusion
Improved single image dehazing by fusion
 
Digital Holography
Digital HolographyDigital Holography
Digital Holography
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 3)
 
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
Demystifying laser projection for cinema: 5 frequently asked questions, 125+ ...
 
Object Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online LearningObject Tracking with Instance Matching and Online Learning
Object Tracking with Instance Matching and Online Learning
 

Destaque

SIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionSIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionMatt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionSIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionGordon Wetzstein
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingSIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingGordon Wetzstein
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...Gordon Wetzstein
 
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysSIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysMatt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...Matt Hirsch - MIT Media Lab
 
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...Matt Hirsch - MIT Media Lab
 

Destaque (7)

SIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introductionSIGGRAPH 2012 Computational Display Course - 1 introduction
SIGGRAPH 2012 Computational Display Course - 1 introduction
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 IntroductionSIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 1 Introduction
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren ImagingSIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 7 Schlieren Imaging
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 2 High Dynamic Range I...
 
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational DisplaysSIGGRAPH 2012 Computational Display Course - 2 Computational Displays
SIGGRAPH 2012 Computational Display Course - 2 Computational Displays
 
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
SIGGRAPH 2012 Computational Display Course - 4 Perceptually Driven Computatio...
 
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
SIGGRAPH 2012 Computational Display Course - 3 Computational Light Field Disp...
 

Semelhante a Spectral Imaging Techniques

Physics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generationsPhysics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generationsNeetuMeena56
 
12intraoral digital radiography
12intraoral digital radiography12intraoral digital radiography
12intraoral digital radiographyNarmathaN2
 
RS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptxRS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptxDrAbhishekPandey9
 
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technologyDIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technologyDilshanDillu1
 
Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Adrian Waltho
 
Digital Radiography PHYSICS
Digital Radiography PHYSICSDigital Radiography PHYSICS
Digital Radiography PHYSICSShubhankar Mitra
 
Rendering Algorithms.pptx
Rendering Algorithms.pptxRendering Algorithms.pptx
Rendering Algorithms.pptxSherinRappai
 
5.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,20135.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,2013Bhargav Veepuri
 
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...Christian Gabriel Gomez
 
Digital Image Fundamentals
Digital Image FundamentalsDigital Image Fundamentals
Digital Image FundamentalsKalyan Acharjya
 
Cone beam computed tomography
Cone beam computed tomographyCone beam computed tomography
Cone beam computed tomographyVashi Narula
 
Radiometric Calibration of Digital Images
Radiometric Calibration of Digital ImagesRadiometric Calibration of Digital Images
Radiometric Calibration of Digital ImagesSean Thibert
 
Digital Image Correlation Presentation
Digital Image Correlation PresentationDigital Image Correlation Presentation
Digital Image Correlation Presentationtrilionqualitysystems
 
Cloud shadow detection over water
Cloud shadow detection over waterCloud shadow detection over water
Cloud shadow detection over waterDivyansh Jha
 

Semelhante a Spectral Imaging Techniques (20)

Cbct
CbctCbct
Cbct
 
Cbct
CbctCbct
Cbct
 
Voxel based global-illumination
Voxel based global-illuminationVoxel based global-illumination
Voxel based global-illumination
 
Physics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generationsPhysics_of_CT , CT machine and it’s parts, ct generations
Physics_of_CT , CT machine and it’s parts, ct generations
 
12intraoral digital radiography
12intraoral digital radiography12intraoral digital radiography
12intraoral digital radiography
 
RS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptxRS - Presentation by AP2023.pptx
RS - Presentation by AP2023.pptx
 
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technologyDIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
DIGITAL RADIOGRAPHY FOR bachelor of science in medical imaging technology
 
Summerresearch2011
Summerresearch2011Summerresearch2011
Summerresearch2011
 
Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3Multispectral imaging in Plant Sciences with VideometerLab 3
Multispectral imaging in Plant Sciences with VideometerLab 3
 
Digital Radiography PHYSICS
Digital Radiography PHYSICSDigital Radiography PHYSICS
Digital Radiography PHYSICS
 
Rendering Algorithms.pptx
Rendering Algorithms.pptxRendering Algorithms.pptx
Rendering Algorithms.pptx
 
5.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,20135.2. lithography 3,4,5 final,2013
5.2. lithography 3,4,5 final,2013
 
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
IAA-LA2-10-01 Spectral and Radiometric Calibration Procedure for a SWIR Hyper...
 
Dr,system abhishek
Dr,system abhishekDr,system abhishek
Dr,system abhishek
 
Digital Image Fundamentals
Digital Image FundamentalsDigital Image Fundamentals
Digital Image Fundamentals
 
Radar Image Processing
Radar Image ProcessingRadar Image Processing
Radar Image Processing
 
Cone beam computed tomography
Cone beam computed tomographyCone beam computed tomography
Cone beam computed tomography
 
Radiometric Calibration of Digital Images
Radiometric Calibration of Digital ImagesRadiometric Calibration of Digital Images
Radiometric Calibration of Digital Images
 
Digital Image Correlation Presentation
Digital Image Correlation PresentationDigital Image Correlation Presentation
Digital Image Correlation Presentation
 
Cloud shadow detection over water
Cloud shadow detection over waterCloud shadow detection over water
Cloud shadow detection over water
 

Último

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdfSoniaTolstoy
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentInMediaRes1
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeThiyagu K
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionSafetyChain Software
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...EduSkills OECD
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon AUnboundStockton
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsanshu789521
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdfssuser54595a
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Celine George
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAssociation for Project Management
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptxPoojaSen20
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxOH TEIK BIN
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxmanuelaromero2013
 

Último (20)

BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdfBASLIQ CURRENT LOOKBOOK  LOOKBOOK(1) (1).pdf
BASLIQ CURRENT LOOKBOOK LOOKBOOK(1) (1).pdf
 
Alper Gobel In Media Res Media Component
Alper Gobel In Media Res Media ComponentAlper Gobel In Media Res Media Component
Alper Gobel In Media Res Media Component
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Measures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and ModeMeasures of Central Tendency: Mean, Median and Mode
Measures of Central Tendency: Mean, Median and Mode
 
Mastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory InspectionMastering the Unannounced Regulatory Inspection
Mastering the Unannounced Regulatory Inspection
 
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
Presentation by Andreas Schleicher Tackling the School Absenteeism Crisis 30 ...
 
Crayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon ACrayon Activity Handout For the Crayon A
Crayon Activity Handout For the Crayon A
 
Staff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSDStaff of Color (SOC) Retention Efforts DDSD
Staff of Color (SOC) Retention Efforts DDSD
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Presiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha electionsPresiding Officer Training module 2024 lok sabha elections
Presiding Officer Training module 2024 lok sabha elections
 
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
Model Call Girl in Tilak Nagar Delhi reach out to us at 🔝9953056974🔝
 
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
18-04-UA_REPORT_MEDIALITERAСY_INDEX-DM_23-1-final-eng.pdf
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
Incoming and Outgoing Shipments in 1 STEP Using Odoo 17
 
APM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across SectorsAPM Welcome, APM North West Network Conference, Synergies Across Sectors
APM Welcome, APM North West Network Conference, Synergies Across Sectors
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
PSYCHIATRIC History collection FORMAT.pptx
PSYCHIATRIC   History collection FORMAT.pptxPSYCHIATRIC   History collection FORMAT.pptx
PSYCHIATRIC History collection FORMAT.pptx
 
Solving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptxSolving Puzzles Benefits Everyone (English).pptx
Solving Puzzles Benefits Everyone (English).pptx
 
How to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptxHow to Make a Pirate ship Primary Education.pptx
How to Make a Pirate ship Primary Education.pptx
 

Spectral Imaging Techniques

  • 1. Spectral Imaging Ivo Ihrke Saarland University/MPI Informatik
  • 2. The spectral data cube • spectrometer
  • 3. Principle of Operation - Dispersion disadvantage: • dispersion relation is nonlinear advantage: • light efficient
  • 4. Diffraction Grating Diffraction Order Percentage of transmitted Light – At center, no diffraction 0 25% 1 20.26% – For higher orders, diffraction is 2 10.13% 3 2.25% taking place 4 0% remainder 9.72% disadvantage: • low light efficiency advantage: • linear relation pixel pos. <-> wavelength
  • 5. Diffraction-Based Systems – Diffraction-based example -> – Spectrometer calibration (all types) 1. mapping pixel <–> wavelength 2. relative intensity of wavelengths
  • 6. The spectral data cube • Spatial Scanning • E.g. in satellite imaging (2D sensor) – Pushbroom scanning
  • 7. Spatial Scanning • Generalized Mosaics [Schechner & Nayar] • linear filter • each pixel column filtered differently • rotational motion & registration to assemble image stack
  • 8. The spectral data cube • Spectral scanning
  • 9. Frequency Scanning • Michelson Interferometer with moving mirror - Fourier Transform Imaging Spectroscopy (FTIS)
  • 10. Imaging Spectrometers The quest for the instantaneous spectral data cube (4D Imaging)
  • 11. Multiplexing - Image slicers [WiFeS – Wide Field Spectrometer]
  • 12. Multiplexing - Image slicers [SPIFFI - SPectrometer for Infrared Faint Field Imaging]
  • 13. Fiber Optical cables (OKSI) 300 “pixels” 2D -> 1D reformatting
  • 14. Multiplexing: Prism-Mask Based System [Du’09]
  • 15. Computational Imaging Spectrometers The quest for the instantaneous spectral data cube
  • 16. CTIS – Computed Tomography Imaging Spectrometry • Original method [Descour’95] • Image a full diffraction pattern • Perform “CT” spectral image diffraction pattern
  • 17. CTIS in graphics • HDR imaging for CTIS [Habel’12] (not snapshot due to HDR exposure stack)
  • 18. CTIS in graphics • Spatial resolution 124x124, 54 bands [Habel’12]
  • 19. CASSI – Coded Aperture Snapshot Spectral Imaging
  • 20. CASSI – Coded Aperture Snapshot Spectral Imaging Implementation with prisms
  • 21. CASSI – Coded Aperture Snapshot Spectral Imaging • Resolution: spatial ~200 x 200 pixels spectral ~30 bands projection reconstruction (stack) spectra
  • 22. Spectral Transfer • Transfer low-res spectra to high res RGB image [Rump’10,Cao’11]
  • 24. Applications • automatic white balancing Spatially uniform illumination raw from RGB tungsten WB `greyworld WB spectral WB spectra Spatially varying illumination [Cao11]
  • 25. Applications • improved tracking RGB – spectral – tracking lost tracking OK • real and fake skin detection [Cao11]
  • 26. Applications • analyze / restore paintings [Calit]
  • 27. Applications • Satellite-Based Remote Sensing vegetation mapping urban land use pollution monitoring [DigitalGlobe’10]
  • 28. • Multispectral at Siggraph’12 – Kim, Harvey, Kittle, Rushmeier, Dorsey, O’Prum, and Brady “3D Imaging Spectroscopy for Measuring Hyperspectral Patterns on Solid Objects”, Monday, 3:45 - 5:35 – “Appearance” – Hosek and Wilkie, “An Analytic Model for Full Spectral Sky-Dome Radiance”, Wednesday 3:45-5:35 pm – “Physics and Mathematics for Light”

Notas do Editor

  1. Table: formulas from Born &amp; Wolf “Principles of Optics”, 7th ed., p. 450s = slit widthd = spacing between slitsAssume s/d = ¼ as in their figurek = 2pi / lambdaMaxima of diffraction pattern are at p = m lambda / d Evaluate Fig. 8.19 (b) at position of the maximaI = const. * Sin^2(ksp/2) / (ksp/2)^2ksp = 2pi/lambda * s * m lambda /d = pi *s/d * m = pi * ¼ * mThis gives a sequence of numbers S_m and lim_{m \\goesto \\infty } \\sum_{-m..m} S_m = 4The limit lim_{s/d \\goesto 0} I = 1.The percentages in the table are computed w.r.t. this limit. They will change if the ratio of slit width to slit spacing (s/d) is changed. In particular, the diffraction order 4 with 0 intensity results from s/d being a proper fraction 1/4.You can achieve higher light efficiency by moving the peaks closer together , i.e. letting the fraction s/d go to zero, however, then the orders m=1..N move closer together and consequently there is less space for the spectrum -&gt; spectral resolution is decreased.
  2. Pushbroom illustration from http://www.laserfocusworld.com/articles/print/volume-40/issue-8/features/imaging-spectroscopy/spectral-data-adds-a-new-dimension-to-remote-imaging-of-earth.html
  3. 6-filter wheel – Thorlabs Inc. CFW6Big filter wheel – MPI Astronomy – part of the James Web Space telescope(http://www.jwst.nasa.gov/) is MIRI http://www.roe.ac.uk/ukatc/consortium/miri/overview/instrument_design.htmlLCTF (Liquid Crystal Tunable Filter) = programmable wavelength bandpass filter – LOT-Oriel group: http://www.lot-oriel.com/uk/en/home/tunable-filters/
  4. Wiki page: http://en.wikipedia.org/wiki/Fourier_transform_spectroscopyMain purpose – increase light throughput – multiplexing advantage
  5. Example: WiFES Wide Field Spectrograph - 3 degrees of an arc fov, extremely large for telesopesImages from http://rsaa.anu.edu.au/research/highlights/wifes-and-fine-art-spectroscopy
  6. SPIFFI: SPectrometer for Infrared Faint Field Imaginghttp://www.eso.org/sci/facilities/paranal/instruments/sinfoni/inst/instrument.htmlSlicer closeup from:http://www.astro.ufl.edu/~raines/snr-fisica.html
  7. Development of four-dimensional imaging spectrometers (4D-IS)Nahum Gat, Gordon Scriven, John Garman, Ming De Li, Jingyi ZhangOpto-Knowledge Systems, Inc. (OKSI)
  8. Also Bodkin design 2006 (res 100x100x20)Snapshot Hyperspectral Imaging – the Hyperpixel Array™ CameraAndrew Bodkin, A. Sheinis, A. Norton, J. Daly, S. Beaven and J. WeinheimerHao Du, Xin Tong, Xun Cao and Stephen Lin. A Prism-based System for Multispectral Video Acquisition. In Proceedings of IEEE International Conference on Computer Vision (ICCV), 2009http://www.cs.washington.edu/homes/duhao/Projects/MultiSpectral/MultiSpectralwebsite.html
  9. Computed-tomography imaging spectrometer: experimental calibration and reconstruction resultsDescour, M. Dereniak, E. APPLIED OPTICS,1995, VOL 34; NUMBER 22, pages 4817Example from:http://www.optics.arizona.edu/descour/computed.htmRaw image 1024x1024; result 75x75 spatial resolution, 30 spectral bands (around 1997/1998), computed on Pentium II 450 MHz. spectral resolution: \\Delta\\lambda = (710-420) / 30 = 9.6Max R = 74 (at 710)
  10. 54 slices computed, assuming they are resolved, this gives a max. resolution at 700 nm of \\Delta\\lambda = (666-422) / 54 = 4.5 nmR = 700 / 4.5 = 156
  11. Gehm et al., &quot;Single-shot compressive spectral imaging with a dual-disperser architecture,&quot; Optics Express, October 2007.Wagadarikar et al. &quot;Single disperser design for coded aperture snapshot spectral imaging,&quot; feature issue on Computational Optical Sensing and Imaging, Applied Optics 47 (10), B44-51 (2008). 
  12. 35 bands, spatial approx. 200x200 pixels (judging from image qaulity, actual resolution appears to be lower be a factor at least two), no specifics provided in paper. SDCASSI (Wagadarikar’08) input image resolution 1040 x 1392 pixels. Result: 128 x 128 x 28 is claimed to be higher spectral res. than DDCASSI above, lower spatial res.
  13. Spectralization: Reconstructing spectra from sparse dataMartin Rump and Reinhard KleinIn proceedings of SR &apos;10 Rendering Techniques, pages 1347-1354, Eurographics Association, June 2010Xun Cao, Xin Tong, Qionghai Dai and Stephen Lin, &quot;High Resolution Multispectral Video Capture with a Hybrid Camera System&quot;, IEEE international Conference on Computer Vision and Pattern Recognition (CVPR), 2011