SlideShare uma empresa Scribd logo
1 de 9
Baixar para ler offline
Developing the
“True HDR” app
for iPhone
Why HDR?
Often, you see a beautiful
scene but you cannot capture
it on camera.
You get the sky but the rest of
the picture is too dark...
Why HDR?
Or, you get the shadows but
the sky is washed out.
Your eyes perceive high
dynamic range but most
cameras have low dynamic
range.
Capture what your eyes see, via
computational means
Capture what your eyes see, via
computational means
A bit of history
● Released in 2009 after Apple introduced the 3GS with “auto-focus”
feature.
● At the time, there were several apps with “HDR” in their names but
all they did was single-image contrast enhancement.
● Initially version was low-resolution (1 MP); current version supports
up to 19 MP.
● Apple’s introduction of built-in HDR in 2010 didn’t kill the app. Not
all HDR’s are created equal; many like our results better.
Challenges
● Automatically aligning photos with drastically different
exposures
● The merge should be as natural-looking as possible.
We don’t want halo artifacts.
● Image processing can need a LOT of memory but
memory is a prized resource on mobile
● Doing things fast
The Ups and Downs of App
Development
Highlights
● Appreciative users
● Was #1 in Japan and #3 in the US, for a short time
● Was inaugural member of Apple’s “App Store Hall of Fame”
Setbacks
● 8-month period when updates kept getting rejected by Apple
Lessons & Anecdotes
Contact me:
Yuanzhen Li
yzli@csail.mit.edu
Interested in computational photo
app projects?

Mais conteúdo relacionado

Destaque

Raskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 NovemberRaskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 November
Camera Culture Group, MIT Media Lab
 
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh RaskarWhat is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
Camera Culture Group, MIT Media Lab
 

Destaque (19)

Introduction to Light Fields
Introduction to Light FieldsIntroduction to Light Fields
Introduction to Light Fields
 
Raskar TEDMED 2013
Raskar TEDMED 2013Raskar TEDMED 2013
Raskar TEDMED 2013
 
Google Glass Breakdown
Google Glass BreakdownGoogle Glass Breakdown
Google Glass Breakdown
 
Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)Leap Motion Development (Rohan Puri)
Leap Motion Development (Rohan Puri)
 
Raskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 NovemberRaskar UIST Keynote 2015 November
Raskar UIST Keynote 2015 November
 
What is Media in MIT Media Lab, Why 'Camera Culture'
What is Media in MIT Media Lab, Why 'Camera Culture'What is Media in MIT Media Lab, Why 'Camera Culture'
What is Media in MIT Media Lab, Why 'Camera Culture'
 
Multiview Imaging HW Overview
Multiview Imaging HW OverviewMultiview Imaging HW Overview
Multiview Imaging HW Overview
 
Stereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt HirschStereo and 3D Displays - Matt Hirsch
Stereo and 3D Displays - Matt Hirsch
 
Coded Photography - Ramesh Raskar
Coded Photography - Ramesh RaskarCoded Photography - Ramesh Raskar
Coded Photography - Ramesh Raskar
 
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh RaskarWhat is SIGGRAPH NEXT? Intro by Ramesh Raskar
What is SIGGRAPH NEXT? Intro by Ramesh Raskar
 
Introduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh RaskarIntroduction to Camera Challenges - Ramesh Raskar
Introduction to Camera Challenges - Ramesh Raskar
 
Google Glass Overview
Google Glass OverviewGoogle Glass Overview
Google Glass Overview
 
Raskar stanfordextremecompuimagingapr2016
Raskar stanfordextremecompuimagingapr2016Raskar stanfordextremecompuimagingapr2016
Raskar stanfordextremecompuimagingapr2016
 
Kinect Tutorial
Kinect Tutorial Kinect Tutorial
Kinect Tutorial
 
Compressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta KadambiCompressed Sensing - Achuta Kadambi
Compressed Sensing - Achuta Kadambi
 
Light Field Photography Introduction
Light Field Photography IntroductionLight Field Photography Introduction
Light Field Photography Introduction
 
Introduction to Photography
Introduction to PhotographyIntroduction to Photography
Introduction to Photography
 
Time of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael WhyteTime of Flight Cameras - Refael Whyte
Time of Flight Cameras - Refael Whyte
 
Computer Vision Introduction
Computer Vision IntroductionComputer Vision Introduction
Computer Vision Introduction
 

Semelhante a Developing "True HDR" for the iPhone

Untapped Cities iPhoneography Workshop
Untapped Cities iPhoneography WorkshopUntapped Cities iPhoneography Workshop
Untapped Cities iPhoneography Workshop
untappedcities
 
16 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s516 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s5
Samson Lam
 
Technical skills
Technical skillsTechnical skills
Technical skills
nathesa
 

Semelhante a Developing "True HDR" for the iPhone (20)

Android VS apple
Android VS apple Android VS apple
Android VS apple
 
Teen Photography Class
Teen Photography ClassTeen Photography Class
Teen Photography Class
 
Gopro case study
Gopro case studyGopro case study
Gopro case study
 
Equipment list
Equipment listEquipment list
Equipment list
 
Android vs. IOS: Comparing features & functions
Android vs. IOS: Comparing features & functionsAndroid vs. IOS: Comparing features & functions
Android vs. IOS: Comparing features & functions
 
iPhone 14 Versus iPhone 12 2022_23.pdf
iPhone 14 Versus iPhone 12 2022_23.pdfiPhone 14 Versus iPhone 12 2022_23.pdf
iPhone 14 Versus iPhone 12 2022_23.pdf
 
iOS 13 Every New Feature iPhone You Need To Know About
iOS 13 Every New Feature iPhone You Need To Know AboutiOS 13 Every New Feature iPhone You Need To Know About
iOS 13 Every New Feature iPhone You Need To Know About
 
Untapped Cities iPhoneography Workshop
Untapped Cities iPhoneography WorkshopUntapped Cities iPhoneography Workshop
Untapped Cities iPhoneography Workshop
 
Shoot to thrill
Shoot to thrillShoot to thrill
Shoot to thrill
 
Why apple i phone 12 pro is people's first choice
Why apple i phone 12 pro is people's first choiceWhy apple i phone 12 pro is people's first choice
Why apple i phone 12 pro is people's first choice
 
Adopt i os 13 dark mode in your ios app
Adopt i os 13 dark mode in your ios appAdopt i os 13 dark mode in your ios app
Adopt i os 13 dark mode in your ios app
 
Apple iPhone 5 review
 Apple iPhone 5 review  Apple iPhone 5 review
Apple iPhone 5 review
 
16 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s516 apr dl(print) samsung galaxy s5
16 apr dl(print) samsung galaxy s5
 
Gopro case study
Gopro case studyGopro case study
Gopro case study
 
Confused - Updating your iPhone to iOS 13 ??
Confused - Updating your iPhone to iOS 13 ??Confused - Updating your iPhone to iOS 13 ??
Confused - Updating your iPhone to iOS 13 ??
 
Technical skills
Technical skillsTechnical skills
Technical skills
 
Special features of iphone 13
Special features of iphone 13Special features of iphone 13
Special features of iphone 13
 
Apple i os 13 features and version release updates
Apple i os 13 features and version release updatesApple i os 13 features and version release updates
Apple i os 13 features and version release updates
 
Apple iPhone 6 Plus review
Apple iPhone 6 Plus reviewApple iPhone 6 Plus review
Apple iPhone 6 Plus review
 
Apple iPhone 6 review in pictures
Apple iPhone 6 review in picturesApple iPhone 6 review in pictures
Apple iPhone 6 review in pictures
 

Mais de Camera Culture Group, MIT Media Lab

God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
Camera Culture Group, MIT Media Lab
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Camera Culture Group, MIT Media Lab
 
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Camera Culture Group, MIT Media Lab
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
Camera Culture Group, MIT Media Lab
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Camera Culture Group, MIT Media Lab
 

Mais de Camera Culture Group, MIT Media Lab (11)

Raskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award TalkRaskar Sig2017 Siggraph Achievement Award Talk
Raskar Sig2017 Siggraph Achievement Award Talk
 
Lost Decade of Computational Photography
Lost Decade of Computational PhotographyLost Decade of Computational Photography
Lost Decade of Computational Photography
 
Covid Safe Paths
Covid Safe PathsCovid Safe Paths
Covid Safe Paths
 
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
God’s Eye View: Will global AI empower us or destroy us? | Ramesh Raskar
 
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
Dont follow the rainbow: How to avoid career traps that can lead you to fail,...
 
Raskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis GuidanceRaskar PhD and MS Thesis Guidance
Raskar PhD and MS Thesis Guidance
 
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
Making Invisible Visible, Ramesh Raskar Keynote at Embedded Vision 2019
 
Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019
Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019
Augmented Surgeons: AI AR for Anatome, Raskar Aria 2019
 
Geo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to SynthesisGeo-spatial Research: Transition from Analysis to Synthesis
Geo-spatial Research: Transition from Analysis to Synthesis
 
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
Split Learning versus Federated Learning for Data Transparent ML, Camera Cult...
 
Unspoken Challenges in AR and XR
Unspoken Challenges in AR and XRUnspoken Challenges in AR and XR
Unspoken Challenges in AR and XR
 

Último

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
Earley Information Science
 

Último (20)

2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 

Developing "True HDR" for the iPhone

  • 2. Why HDR? Often, you see a beautiful scene but you cannot capture it on camera. You get the sky but the rest of the picture is too dark...
  • 3. Why HDR? Or, you get the shadows but the sky is washed out. Your eyes perceive high dynamic range but most cameras have low dynamic range.
  • 4. Capture what your eyes see, via computational means
  • 5. Capture what your eyes see, via computational means
  • 6. A bit of history ● Released in 2009 after Apple introduced the 3GS with “auto-focus” feature. ● At the time, there were several apps with “HDR” in their names but all they did was single-image contrast enhancement. ● Initially version was low-resolution (1 MP); current version supports up to 19 MP. ● Apple’s introduction of built-in HDR in 2010 didn’t kill the app. Not all HDR’s are created equal; many like our results better.
  • 7. Challenges ● Automatically aligning photos with drastically different exposures ● The merge should be as natural-looking as possible. We don’t want halo artifacts. ● Image processing can need a LOT of memory but memory is a prized resource on mobile ● Doing things fast
  • 8. The Ups and Downs of App Development Highlights ● Appreciative users ● Was #1 in Japan and #3 in the US, for a short time ● Was inaugural member of Apple’s “App Store Hall of Fame” Setbacks ● 8-month period when updates kept getting rejected by Apple Lessons & Anecdotes
  • 9. Contact me: Yuanzhen Li yzli@csail.mit.edu Interested in computational photo app projects?