SlideShare a Scribd company logo
1 of 22
Incident Light Field
The distribution of light in a static scene with a fixed illumination
Dr. Kurt Debattista
Prof. Alan Chalmers
Debmalya Sinha
Courtesy: J. Unger / Linköping University
Synthetic objects on a physical table with real life lighting
Acquisition
Dynamic or Static
Large Camera Array, Mirror
sphere, Plane Mirror, HDR
video, SfM (structure from
motion)
Physical
Scene
Representation
2PP
PDP
2SP
DPP
Rendering
Storage
Virtual
Scene
1. Image Based Lighting
2. Light Field
Incident Light Field
We require an Environment Map
A Panoramic image of the
environment that envelops the object
space we’re about to Render.
1. Image Based Lighting
2. Light Field
Incident Light Field
Courtesy: nVidia
1. Image Based Lighting
2. Light Field
Incident Light Field
We take several pictures from spatially
varying points on the camera plane.
Each of the pictures differ a little by angle
Courtesy: Pat Hanrahan / Stanford University
1. Image Based Lighting
2. Light Field
Incident Light Field
1. Image Based Lighting
2. Light Field
Incident Light Field
1. Image Based Lighting
2. Light Field
Incident Light Field
The distribution of light in a static scene with a
fixed illumination
We take separate environment map of each
little segments of the space to record the
incident light rays on the entire object space
we are about to render.
Courtesy: J. Unger / Linköping University
Acquisition
Dynamic or Static
Large Camera Array, Mirror
sphere, Plane Mirror, HDR
video, SfM (structure from
motion)
Physical
Scene
Representation
2PP
PDP
2SP
DPP
Rendering
Storage
Virtual
Scene
Representation
Represented by 7 dimension Plenoptic function on a point P
θ,φ -> direction of light ray from P,
λ -> wavelength of incident light,
t -> time
Vx,Vy,Vz -> Cartesian coordinate of P.
P = P(θ,φ,λ,t,Vx,Vy,Vz)
Which can be reduced to a 4D function
P = P(θ,φ,u,v)
Assuming, the incident light only comes from the
upper hemisphere of the surface [Vx,Vy] ([u,v]).
0 ≤ φ ≤ π/2 and -π ≤ θ ≤ π
Plenoptic parameterization
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Representation
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
2PP
PDP
2SP
DPP
Line Space parameterization
Two Points on Two Planes
A Point and a Direction
Two Points on a Sphere
A Direction and a Point
2PP
2SP
PDP
DPP
Courtesy: Camahort et al.
Acquisition
Dynamic or Static
Large Camera Array, Mirror
sphere, Plane Mirror, HDR
video, SfM (structure from
motion)
Physical
Scene
Representation
2PP
PDP
2SP
DPP
Rendering
Storage
Virtual
Scene
Acquisition
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Light Probes
A Light Probe is an omni-directional (360° panoramic) high-dynamic range image. (Debevec et al.)
• Typically a highly reflective silvered ball is used.
• An HDR Image is taken of the ball.
Problems:
• The image has the reflection of the camera itself.
• Has to take two images from different direction to get rid
of the reflection of camera.
• The edges are stretched badly and needs efficient warping.
Acquisition
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Light Probes for ILF
Techniques
• Single HDR image of Light probe
• HDR video of a moving Light Probe
• HDR video from fisheye lens
• Light Probe Array
• Plain Mirror (edge coded)
Edge coded plain mirror - Courtesy: Ihrke et al. / INRIA Labs
Mirror Sphere array - Courtesy: Dr. J. Unger
HDR video with fisheye lens - Courtesy: Dr. J. Unger
Acquisition
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Light Probes for ILF
Problems of mirror sphere array
• Reflection from other Mirrors
• Camera reflection
Problems of HDR Video setup
• Impractical for big space
AcquisitionProposals
1. Bowls are better than Balls:
Concave light probes to eliminate mutual reflection
2. 3D space coverage:
45* angle concave probe plane to capture uneven
surface such as race tracks
Far fetched idea:
probe fitted in a Quadraptor!
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Blocked for obvious reasons !
AcquisitionProposals
1. Bowls are better than Balls:
Concave light probes to eliminate mutual reflection
2. 3D space coverage:
45* angle concave probe plane to capture uneven
surface such as race tracks
Far fetched idea:
probe fitted in a Quadraptor!
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
1 2 3 4 5 6 7
Move Direction
Blocked for obvious reasons !
AcquisitionProposals
1. Bowls are better than Balls:
Concave light probes to eliminate mutual reflection
2. 3D space coverage:
45* angle concave probe plane to capture uneven surface such as
race tracks
Far fetched idea:
probe with a gimbal fitted in a Quadraptor!
Acq
uisit
ion
Physical
Scene
Repres
entatio
n
Renderin
g
Stora
ge
Virtual
Scene
Little inefficient for
covering large space
provides much more mobility
than a fixed camera setup
Blocked for obvious reasons !
Acquisition
Physical
Scene
Representation
Rendering
Storage
Virtual
Scene
ToDoin the next months
• Re-creating the ILF acquisition with spherical probe.
• Implementing it into PARC
• Comparing to original results in terms of Rendering
Artifacts
• Seam
• Hair
• Pixelation
• Ghosting
• Disparity problem
Questions?

More Related Content

What's hot

SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)Matthew O'Toole
 
Ultimate astronomicalimaging
Ultimate astronomicalimagingUltimate astronomicalimaging
Ultimate astronomicalimagingClifford Stone
 
Introduction to Remote Sensing_2014
Introduction to Remote Sensing_2014Introduction to Remote Sensing_2014
Introduction to Remote Sensing_2014Atiqa khan
 
Noise from stray light in interferometric GWs detectors
Noise from stray light in interferometric GWs detectorsNoise from stray light in interferometric GWs detectors
Noise from stray light in interferometric GWs detectorsJose Gonzalez
 
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016StanfordComputationalImaging
 
Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16Ravi Prathipati
 
Solar resource measurements and sattelite data
Solar resource measurements and sattelite dataSolar resource measurements and sattelite data
Solar resource measurements and sattelite dataSolarReference
 
Nikon system configuration & application
Nikon system configuration & applicationNikon system configuration & application
Nikon system configuration & applicationDutsadee Settaboot
 
Telescopes
TelescopesTelescopes
Telescopeswphaneuf
 
20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kongekwtsang
 
FDL 2017 Long Period Comets Final Presentation
FDL 2017 Long Period Comets Final PresentationFDL 2017 Long Period Comets Final Presentation
FDL 2017 Long Period Comets Final PresentationLeonard Silverberg
 
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...ekwtsang
 
Semi-Analytic Modeling: Creation of the Far-IR Populations
Semi-Analytic Modeling: Creation of the Far-IR PopulationsSemi-Analytic Modeling: Creation of the Far-IR Populations
Semi-Analytic Modeling: Creation of the Far-IR Populationsabenson
 
FDL 2017 Solar Storm Prediction Presentation
FDL 2017 Solar Storm Prediction PresentationFDL 2017 Solar Storm Prediction Presentation
FDL 2017 Solar Storm Prediction PresentationLeonard Silverberg
 
FDL 2017 Solar Terrestrial Interactions
FDL 2017 Solar Terrestrial InteractionsFDL 2017 Solar Terrestrial Interactions
FDL 2017 Solar Terrestrial InteractionsLeonard Silverberg
 
20th. Single Molecule Workshop Picoquant 2014
20th. Single Molecule Workshop Picoquant 201420th. Single Molecule Workshop Picoquant 2014
20th. Single Molecule Workshop Picoquant 2014Dirk Hähnel
 
Diffoot fayful
Diffoot fayfulDiffoot fayful
Diffoot fayfulNASAPMC
 

What's hot (20)

SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 2)
 
Ultimate astronomicalimaging
Ultimate astronomicalimagingUltimate astronomicalimaging
Ultimate astronomicalimaging
 
Introduction to Remote Sensing_2014
Introduction to Remote Sensing_2014Introduction to Remote Sensing_2014
Introduction to Remote Sensing_2014
 
Noise from stray light in interferometric GWs detectors
Noise from stray light in interferometric GWs detectorsNoise from stray light in interferometric GWs detectors
Noise from stray light in interferometric GWs detectors
 
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
Multi-camera Time-of-Flight Systems | SIGGRAPH 2016
 
Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16Prathipati_Ravi_Poster15-16
Prathipati_Ravi_Poster15-16
 
1316 ditto[1]
1316 ditto[1]1316 ditto[1]
1316 ditto[1]
 
Solar resource measurements and sattelite data
Solar resource measurements and sattelite dataSolar resource measurements and sattelite data
Solar resource measurements and sattelite data
 
Nikon system configuration & application
Nikon system configuration & applicationNikon system configuration & application
Nikon system configuration & application
 
Telescopes
TelescopesTelescopes
Telescopes
 
FDL 2017 3D Shape Modeling
FDL 2017 3D Shape ModelingFDL 2017 3D Shape Modeling
FDL 2017 3D Shape Modeling
 
20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong20120328 Technical Seminar on Daylighting Environment in Hong Kong
20120328 Technical Seminar on Daylighting Environment in Hong Kong
 
Large telescope
Large telescopeLarge telescope
Large telescope
 
FDL 2017 Long Period Comets Final Presentation
FDL 2017 Long Period Comets Final PresentationFDL 2017 Long Period Comets Final Presentation
FDL 2017 Long Period Comets Final Presentation
 
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
20120417 IMechE YMS Seminar on Daylighting modeling technique in built-enviro...
 
Semi-Analytic Modeling: Creation of the Far-IR Populations
Semi-Analytic Modeling: Creation of the Far-IR PopulationsSemi-Analytic Modeling: Creation of the Far-IR Populations
Semi-Analytic Modeling: Creation of the Far-IR Populations
 
FDL 2017 Solar Storm Prediction Presentation
FDL 2017 Solar Storm Prediction PresentationFDL 2017 Solar Storm Prediction Presentation
FDL 2017 Solar Storm Prediction Presentation
 
FDL 2017 Solar Terrestrial Interactions
FDL 2017 Solar Terrestrial InteractionsFDL 2017 Solar Terrestrial Interactions
FDL 2017 Solar Terrestrial Interactions
 
20th. Single Molecule Workshop Picoquant 2014
20th. Single Molecule Workshop Picoquant 201420th. Single Molecule Workshop Picoquant 2014
20th. Single Molecule Workshop Picoquant 2014
 
Diffoot fayful
Diffoot fayfulDiffoot fayful
Diffoot fayful
 

Viewers also liked

HaiXiu: Emotion Recognition from Movements
HaiXiu: Emotion Recognition from MovementsHaiXiu: Emotion Recognition from Movements
HaiXiu: Emotion Recognition from MovementsDebmalya Sinha
 
Whither Software Engineering Research? (keynote talk at APSEC 2012)
Whither Software Engineering Research? (keynote talk at APSEC 2012)Whither Software Engineering Research? (keynote talk at APSEC 2012)
Whither Software Engineering Research? (keynote talk at APSEC 2012)David Rosenblum
 
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...David Rosenblum
 
Street photogrpahy workshop
Street photogrpahy workshopStreet photogrpahy workshop
Street photogrpahy workshopDebmalya Sinha
 
The Power of Probabilistic Thinking (keynote talk at ASE 2016)
The Power of Probabilistic Thinking (keynote talk at ASE 2016)The Power of Probabilistic Thinking (keynote talk at ASE 2016)
The Power of Probabilistic Thinking (keynote talk at ASE 2016)David Rosenblum
 
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)David Rosenblum
 
Jogging While Driving, and Other Software Engineering Research Problems (invi...
Jogging While Driving, and Other Software Engineering Research Problems (invi...Jogging While Driving, and Other Software Engineering Research Problems (invi...
Jogging While Driving, and Other Software Engineering Research Problems (invi...David Rosenblum
 
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...David Rosenblum
 
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...David Rosenblum
 
Career Management (invited talk at ICSE 2014 NFRS)
Career Management (invited talk at ICSE 2014 NFRS)Career Management (invited talk at ICSE 2014 NFRS)
Career Management (invited talk at ICSE 2014 NFRS)David Rosenblum
 

Viewers also liked (10)

HaiXiu: Emotion Recognition from Movements
HaiXiu: Emotion Recognition from MovementsHaiXiu: Emotion Recognition from Movements
HaiXiu: Emotion Recognition from Movements
 
Whither Software Engineering Research? (keynote talk at APSEC 2012)
Whither Software Engineering Research? (keynote talk at APSEC 2012)Whither Software Engineering Research? (keynote talk at APSEC 2012)
Whither Software Engineering Research? (keynote talk at APSEC 2012)
 
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
Applications and Abstractions: A Cautionary Tale (invited talk at a DIMACS Wo...
 
Street photogrpahy workshop
Street photogrpahy workshopStreet photogrpahy workshop
Street photogrpahy workshop
 
The Power of Probabilistic Thinking (keynote talk at ASE 2016)
The Power of Probabilistic Thinking (keynote talk at ASE 2016)The Power of Probabilistic Thinking (keynote talk at ASE 2016)
The Power of Probabilistic Thinking (keynote talk at ASE 2016)
 
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
Probability and Uncertainty in Software Engineering (keynote talk at NASAC 2013)
 
Jogging While Driving, and Other Software Engineering Research Problems (invi...
Jogging While Driving, and Other Software Engineering Research Problems (invi...Jogging While Driving, and Other Software Engineering Research Problems (invi...
Jogging While Driving, and Other Software Engineering Research Problems (invi...
 
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
Felicitous Computing (invited Talk for UC Irvine ISR Distinguished Speaker Se...
 
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
Known Unknowns: Testing in the Presence of Uncertainty (talk at ACM SIGSOFT F...
 
Career Management (invited talk at ICSE 2014 NFRS)
Career Management (invited talk at ICSE 2014 NFRS)Career Management (invited talk at ICSE 2014 NFRS)
Career Management (invited talk at ICSE 2014 NFRS)
 

Similar to Incident light field 1

study Dappled Photography
study Dappled Photographystudy Dappled Photography
study Dappled PhotographyChiamin Hsu
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)Matthew O'Toole
 
U tokyo 2019
U tokyo 2019U tokyo 2019
U tokyo 2019Jinze Yu
 
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21DrPArivalaganASSTPRO
 
Night vision technology
Night vision technologyNight vision technology
Night vision technologygy_manish
 
637125main strekalov presentation
637125main strekalov presentation637125main strekalov presentation
637125main strekalov presentationClifford Stone
 
Optical Instruments.ppt
Optical Instruments.pptOptical Instruments.ppt
Optical Instruments.pptMinanjal1
 
UC Berkeley 4.19
UC Berkeley 4.19UC Berkeley 4.19
UC Berkeley 4.19Shiyu Tan
 
Measurement of corneal curvature
Measurement of corneal curvatureMeasurement of corneal curvature
Measurement of corneal curvatureGauriSShrestha
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light FieldsSIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light FieldsGordon Wetzstein
 
CR (Computed Radiography) System
CR (Computed Radiography) SystemCR (Computed Radiography) System
CR (Computed Radiography) SystemJNDRSHD
 
Types of scanners
Types of scannersTypes of scanners
Types of scannersPramoda Raj
 
Tv transmitters & receiver
Tv transmitters & receiverTv transmitters & receiver
Tv transmitters & receiverPravin Shirke
 

Similar to Incident light field 1 (20)

Optics group research overview
Optics group research overviewOptics group research overview
Optics group research overview
 
study Dappled Photography
study Dappled Photographystudy Dappled Photography
study Dappled Photography
 
Raskar COSI invited talk Oct 2009
Raskar COSI invited talk Oct 2009Raskar COSI invited talk Oct 2009
Raskar COSI invited talk Oct 2009
 
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
SIGGRAPH 2014 Course on Computational Cameras and Displays (part 4)
 
Goddard 2015: Mark Clampin, NASA
Goddard 2015: Mark Clampin, NASAGoddard 2015: Mark Clampin, NASA
Goddard 2015: Mark Clampin, NASA
 
Night vision technology by shudhanshu agarwal
Night vision technology by shudhanshu agarwalNight vision technology by shudhanshu agarwal
Night vision technology by shudhanshu agarwal
 
U tokyo 2019
U tokyo 2019U tokyo 2019
U tokyo 2019
 
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
ArtStar-Talk_PPT_V2 ArtStar-Talk_PPT_V21
 
Night vision technology
Night vision technologyNight vision technology
Night vision technology
 
637125main strekalov presentation
637125main strekalov presentation637125main strekalov presentation
637125main strekalov presentation
 
Night vision
Night visionNight vision
Night vision
 
Optical Instruments.ppt
Optical Instruments.pptOptical Instruments.ppt
Optical Instruments.ppt
 
UC Berkeley 4.19
UC Berkeley 4.19UC Berkeley 4.19
UC Berkeley 4.19
 
Mit Museum Talk
Mit Museum TalkMit Museum Talk
Mit Museum Talk
 
Measurement of corneal curvature
Measurement of corneal curvatureMeasurement of corneal curvature
Measurement of corneal curvature
 
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light FieldsSIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
SIGGRAPH 2012 Computational Plenoptic Imaging Course - 4 Light Fields
 
CR (Computed Radiography) System
CR (Computed Radiography) SystemCR (Computed Radiography) System
CR (Computed Radiography) System
 
Svr Raskar
Svr RaskarSvr Raskar
Svr Raskar
 
Types of scanners
Types of scannersTypes of scanners
Types of scanners
 
Tv transmitters & receiver
Tv transmitters & receiverTv transmitters & receiver
Tv transmitters & receiver
 

Recently uploaded

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)Gabriella Davis
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 

Recently uploaded (20)

A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 

Incident light field 1

  • 1. Incident Light Field The distribution of light in a static scene with a fixed illumination Dr. Kurt Debattista Prof. Alan Chalmers Debmalya Sinha
  • 2. Courtesy: J. Unger / Linköping University Synthetic objects on a physical table with real life lighting
  • 3. Acquisition Dynamic or Static Large Camera Array, Mirror sphere, Plane Mirror, HDR video, SfM (structure from motion) Physical Scene Representation 2PP PDP 2SP DPP Rendering Storage Virtual Scene
  • 4. 1. Image Based Lighting 2. Light Field Incident Light Field We require an Environment Map A Panoramic image of the environment that envelops the object space we’re about to Render.
  • 5. 1. Image Based Lighting 2. Light Field Incident Light Field Courtesy: nVidia
  • 6. 1. Image Based Lighting 2. Light Field Incident Light Field We take several pictures from spatially varying points on the camera plane. Each of the pictures differ a little by angle Courtesy: Pat Hanrahan / Stanford University
  • 7. 1. Image Based Lighting 2. Light Field Incident Light Field
  • 8. 1. Image Based Lighting 2. Light Field Incident Light Field
  • 9. 1. Image Based Lighting 2. Light Field Incident Light Field The distribution of light in a static scene with a fixed illumination We take separate environment map of each little segments of the space to record the incident light rays on the entire object space we are about to render.
  • 10. Courtesy: J. Unger / Linköping University
  • 11. Acquisition Dynamic or Static Large Camera Array, Mirror sphere, Plane Mirror, HDR video, SfM (structure from motion) Physical Scene Representation 2PP PDP 2SP DPP Rendering Storage Virtual Scene
  • 12. Representation Represented by 7 dimension Plenoptic function on a point P θ,φ -> direction of light ray from P, λ -> wavelength of incident light, t -> time Vx,Vy,Vz -> Cartesian coordinate of P. P = P(θ,φ,λ,t,Vx,Vy,Vz) Which can be reduced to a 4D function P = P(θ,φ,u,v) Assuming, the incident light only comes from the upper hemisphere of the surface [Vx,Vy] ([u,v]). 0 ≤ φ ≤ π/2 and -π ≤ θ ≤ π Plenoptic parameterization Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene
  • 13. Representation Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene 2PP PDP 2SP DPP Line Space parameterization Two Points on Two Planes A Point and a Direction Two Points on a Sphere A Direction and a Point 2PP 2SP PDP DPP Courtesy: Camahort et al.
  • 14. Acquisition Dynamic or Static Large Camera Array, Mirror sphere, Plane Mirror, HDR video, SfM (structure from motion) Physical Scene Representation 2PP PDP 2SP DPP Rendering Storage Virtual Scene
  • 15. Acquisition Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Light Probes A Light Probe is an omni-directional (360° panoramic) high-dynamic range image. (Debevec et al.) • Typically a highly reflective silvered ball is used. • An HDR Image is taken of the ball. Problems: • The image has the reflection of the camera itself. • Has to take two images from different direction to get rid of the reflection of camera. • The edges are stretched badly and needs efficient warping.
  • 16. Acquisition Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Light Probes for ILF Techniques • Single HDR image of Light probe • HDR video of a moving Light Probe • HDR video from fisheye lens • Light Probe Array • Plain Mirror (edge coded) Edge coded plain mirror - Courtesy: Ihrke et al. / INRIA Labs Mirror Sphere array - Courtesy: Dr. J. Unger HDR video with fisheye lens - Courtesy: Dr. J. Unger
  • 17. Acquisition Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Light Probes for ILF Problems of mirror sphere array • Reflection from other Mirrors • Camera reflection Problems of HDR Video setup • Impractical for big space
  • 18. AcquisitionProposals 1. Bowls are better than Balls: Concave light probes to eliminate mutual reflection 2. 3D space coverage: 45* angle concave probe plane to capture uneven surface such as race tracks Far fetched idea: probe fitted in a Quadraptor! Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Blocked for obvious reasons !
  • 19. AcquisitionProposals 1. Bowls are better than Balls: Concave light probes to eliminate mutual reflection 2. 3D space coverage: 45* angle concave probe plane to capture uneven surface such as race tracks Far fetched idea: probe fitted in a Quadraptor! Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene 1 2 3 4 5 6 7 Move Direction Blocked for obvious reasons !
  • 20. AcquisitionProposals 1. Bowls are better than Balls: Concave light probes to eliminate mutual reflection 2. 3D space coverage: 45* angle concave probe plane to capture uneven surface such as race tracks Far fetched idea: probe with a gimbal fitted in a Quadraptor! Acq uisit ion Physical Scene Repres entatio n Renderin g Stora ge Virtual Scene Little inefficient for covering large space provides much more mobility than a fixed camera setup Blocked for obvious reasons !
  • 21. Acquisition Physical Scene Representation Rendering Storage Virtual Scene ToDoin the next months • Re-creating the ILF acquisition with spherical probe. • Implementing it into PARC • Comparing to original results in terms of Rendering Artifacts • Seam • Hair • Pixelation • Ghosting • Disparity problem