SlideShare uma empresa Scribd logo
1 de 23
Baixar para ler offline
CREATIVE AI MEETUP - 18.04.18
"Can you make this image more neoclassical?"
Practical uses of Style Transfer in the creative industry
Marco Marchesi
Head of Technology
Happy Finish
CREATIVE AI MEETUP - 18.04.18
Summary
● So far…
● Yinka Shonibare VR
● Other approaches: GAN’s
● Deep Retouching
● This year
● Conclusions
from “Come Swim” (2017)
CREATIVE AI MEETUP - 18.04.18
So far...
Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015).
https://harishnarayanan.org/writing/artistic-style-transfer
CREATIVE AI MEETUP - 18.04.18
So far...
Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
“The Townley Venus”
(1-2 century AD)
Shonibare’s
“Townley Venus”
(2017)
Gavin Hamilton’s “Venus
giving Helen to Paris as his
wife” (1782-1784)
CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
CREATIVE AI MEETUP - 18.04.18
Texture Synthesis
Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint
arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
CREATIVE AI MEETUP - 18.04.18
First Tests
Test 1 Test 2 Test 3
Style Mask
Mask Content
CREATIVE AI MEETUP - 18.04.18
Image Analogy...
Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768
(2016).https://github.com/DmitryUlyanov/fast-neural-doodle
Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017).
https://github.com/awentzonline/image-analogies
CREATIVE AI MEETUP - 18.04.18
...that actually makes art!
CREATIVE AI MEETUP - 18.04.18
Our Process
CONTENT
TEXTURE IMAGE
STYLE
IMAGE
CONTENT
MASK
STYLE
MASK
NEURAL STYLE TRANSFER
TARGET
IMAGE
CONTENT
MASK
TARGET
TEXTURE IMAGE
video
CREATIVE AI MEETUP - 18.04.18
Final Result
video
CREATIVE AI MEETUP - 18.04.18
Another Approach: Generative Adversarial Networks
Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017).
https://github.com/junyanz/CycleGAN
Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT
CycleGAN (2017) MUNIT (2018)
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
CREATIVE AI MEETUP - 18.04.18
This year: Deep Painterly Harmonization
(Cornell U., Adobe, 2018)
Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
CREATIVE AI MEETUP - 18.04.18
This year: Fast Photo Style (NVIDIA, 2018)
Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
CREATIVE AI MEETUP - 18.04.18
The semantic limitations of style transfer
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
CREATIVE AI MEETUP - 18.04.18
Conclusions
Patent Pending
● Semantically consistent results
● Really Hi-Res
● More content transformation
What’s next?
www.happyfinish.com Everything is possible.
Marco Marchesi| Head of Technology
marco.marchesi@happyfinish.com

Mais conteúdo relacionado

Semelhante a Marco Marchesi - Practical uses of style transfer in the creative industry

Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic Creation
FITC
 

Semelhante a Marco Marchesi - Practical uses of style transfer in the creative industry (6)

UXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin TrederUXPin: State of the Union Product Keynote by Marcin Treder
UXPin: State of the Union Product Keynote by Marcin Treder
 
Resume
ResumeResume
Resume
 
Roadmap - SiriusCon2016
Roadmap - SiriusCon2016Roadmap - SiriusCon2016
Roadmap - SiriusCon2016
 
Using AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic CreationUsing AI as a Tool in Artistic Creation
Using AI as a Tool in Artistic Creation
 
Exploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approachExploring platform boundary resources with a data-driven approach
Exploring platform boundary resources with a data-driven approach
 
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS CommunityLeveraging the Crowd: Supporting Newcomers to Build an OSS Community
Leveraging the Crowd: Supporting Newcomers to Build an OSS Community
 

Mais de Luba Elliott

Mais de Luba Elliott (20)

Luba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV ConferenceLuba Elliott - AI art - ICCV Conference
Luba Elliott - AI art - ICCV Conference
 
Luba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - OxfordLuba Elliott - AI in contemporary art practice - Oxford
Luba Elliott - AI in contemporary art practice - Oxford
 
Luba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML PragueLuba Elliott - AI in recent art practice - ML Prague
Luba Elliott - AI in recent art practice - ML Prague
 
Three Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetupThree Images of the New - Richard Hames - Creative AI meetup
Three Images of the New - Richard Hames - Creative AI meetup
 
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity WorkshopAI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
AI Art Gallery Overview - Luba Elliott - NeurIPS Creativity Workshop
 
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity WorkshopCreativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
Creativity is Intelligence - Kenneth Stanley - NeurIPS Creativity Workshop
 
Seen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC ArchiveSeen by machine: Computational Spectatorship in the BBC Archive
Seen by machine: Computational Spectatorship in the BBC Archive
 
Luba Elliott AI art overview
Luba Elliott AI art overview Luba Elliott AI art overview
Luba Elliott AI art overview
 
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetupNatasha Jaques - Learning via Social Awareness - Creative AI meetup
Natasha Jaques - Learning via Social Awareness - Creative AI meetup
 
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetupSander Dieleman - Generating music in the raw audio domain - Creative AI meetup
Sander Dieleman - Generating music in the raw audio domain - Creative AI meetup
 
Design in AI
Design in AIDesign in AI
Design in AI
 
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to SkyHooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
Hooman Shayani - CAD/CAM in the Age of AI: Designers’ Journey from Earth to Sky
 
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetupLucas Theis - Compressing Images with Neural Networks - Creative AI meetup
Lucas Theis - Compressing Images with Neural Networks - Creative AI meetup
 
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
Emily Denton - Unsupervised Learning of Disentangled Representations from Vid...
 
Luba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through ArtLuba Elliott - Seeing AI through Art
Luba Elliott - Seeing AI through Art
 
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetupGeorgia Ward Dyer - O Time thy pyramids - Creative AI meetup
Georgia Ward Dyer - O Time thy pyramids - Creative AI meetup
 
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
Daniel Berio - Graffiti synthesis, a motion centric approach - Creative AI me...
 
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
Ali Eslami - Artificial Intelligence and Computer Aided Design - Creative AI ...
 
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetupDaghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
Daghan Cam - Adaptive Autonomous Manufacturing with AI - Creative AI meetup
 
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetupMartin Arjovsky - Wasserstein GAN - Creative AI meetup
Martin Arjovsky - Wasserstein GAN - Creative AI meetup
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Último (20)

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 

Marco Marchesi - Practical uses of style transfer in the creative industry

  • 1. CREATIVE AI MEETUP - 18.04.18 "Can you make this image more neoclassical?" Practical uses of Style Transfer in the creative industry Marco Marchesi Head of Technology Happy Finish
  • 2. CREATIVE AI MEETUP - 18.04.18 Summary ● So far… ● Yinka Shonibare VR ● Other approaches: GAN’s ● Deep Retouching ● This year ● Conclusions from “Come Swim” (2017)
  • 3. CREATIVE AI MEETUP - 18.04.18 So far... Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015). https://harishnarayanan.org/writing/artistic-style-transfer
  • 4. CREATIVE AI MEETUP - 18.04.18 So far... Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 5. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR “The Townley Venus” (1-2 century AD) Shonibare’s “Townley Venus” (2017) Gavin Hamilton’s “Venus giving Helen to Paris as his wife” (1782-1784)
  • 6. CREATIVE AI MEETUP - 18.04.18 Royal Academy - Yinka Shonibare VR
  • 7. CREATIVE AI MEETUP - 18.04.18 Texture Synthesis Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
  • 8. CREATIVE AI MEETUP - 18.04.18 First Tests Test 1 Test 2 Test 3 Style Mask Mask Content
  • 9. CREATIVE AI MEETUP - 18.04.18 Image Analogy... Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768 (2016).https://github.com/DmitryUlyanov/fast-neural-doodle Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017). https://github.com/awentzonline/image-analogies
  • 10. CREATIVE AI MEETUP - 18.04.18 ...that actually makes art!
  • 11. CREATIVE AI MEETUP - 18.04.18 Our Process CONTENT TEXTURE IMAGE STYLE IMAGE CONTENT MASK STYLE MASK NEURAL STYLE TRANSFER TARGET IMAGE CONTENT MASK TARGET TEXTURE IMAGE video
  • 12. CREATIVE AI MEETUP - 18.04.18 Final Result video
  • 13. CREATIVE AI MEETUP - 18.04.18 Another Approach: Generative Adversarial Networks Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017). https://github.com/junyanz/CycleGAN Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT CycleGAN (2017) MUNIT (2018)
  • 14. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 15. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 16. CREATIVE AI MEETUP - 18.04.18 Deep Retouching (Happy Finish, 2017) Patent Pending
  • 17. CREATIVE AI MEETUP - 18.04.18 This year: Deep Painterly Harmonization (Cornell U., Adobe, 2018) Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
  • 18. CREATIVE AI MEETUP - 18.04.18 This year: Fast Photo Style (NVIDIA, 2018) Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
  • 19. CREATIVE AI MEETUP - 18.04.18 The semantic limitations of style transfer
  • 20. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 21. CREATIVE AI MEETUP - 18.04.18 This year: Photo Style Transfer (theprintspace, 2018) Patent Pending ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
  • 22. CREATIVE AI MEETUP - 18.04.18 Conclusions Patent Pending ● Semantically consistent results ● Really Hi-Res ● More content transformation What’s next?
  • 23. www.happyfinish.com Everything is possible. Marco Marchesi| Head of Technology marco.marchesi@happyfinish.com