This talk by Marco Marchesi from Happy Finish on "Can you make this image more neoclassical? Practical uses of Style Transfer in the creative industry" was presented at the Style Transfer event on 18th April at TechHub as part of the Creative AI meetup.
Marco Marchesi - Practical uses of style transfer in the creative industry
1. CREATIVE AI MEETUP - 18.04.18
"Can you make this image more neoclassical?"
Practical uses of Style Transfer in the creative industry
Marco Marchesi
Head of Technology
Happy Finish
2. CREATIVE AI MEETUP - 18.04.18
Summary
● So far…
● Yinka Shonibare VR
● Other approaches: GAN’s
● Deep Retouching
● This year
● Conclusions
from “Come Swim” (2017)
3. CREATIVE AI MEETUP - 18.04.18
So far...
Gatys, Leon A., Alexander S. Ecker, and Matthias Bethge. "A neural algorithm of artistic style." arXiv preprint arXiv:1508.06576 (2015).
https://harishnarayanan.org/writing/artistic-style-transfer
4. CREATIVE AI MEETUP - 18.04.18
So far...
Jing, Yongcheng, et al. "Neural style transfer: A review." arXiv preprint arXiv:1705.04058 (2018). https://github.com/ycjing/Neural-Style-Transfer-Papers
5. CREATIVE AI MEETUP - 18.04.18
Royal Academy - Yinka Shonibare VR
“The Townley Venus”
(1-2 century AD)
Shonibare’s
“Townley Venus”
(2017)
Gavin Hamilton’s “Venus
giving Helen to Paris as his
wife” (1782-1784)
7. CREATIVE AI MEETUP - 18.04.18
Texture Synthesis
Wilmot, Pierre, Eric Risser, and Connelly Barnes. "Stable and controllable neural texture synthesis and style transfer using histogram losses." arXiv preprint
arXiv:1701.08893 (2017). https://github.com/ycjing/Neural-Style-Transfer-Papers
8. CREATIVE AI MEETUP - 18.04.18
First Tests
Test 1 Test 2 Test 3
Style Mask
Mask Content
9. CREATIVE AI MEETUP - 18.04.18
Image Analogy...
Champandard, Alex J. "Semantic style transfer and turning two-bit doodles into fine artworks." arXiv preprint arXiv:1603.01768
(2016).https://github.com/DmitryUlyanov/fast-neural-doodle
Liao, Jing, et al. "Visual attribute transfer through deep image analogy." arXiv preprint arXiv:1705.01088 (2017).
https://github.com/awentzonline/image-analogies
13. CREATIVE AI MEETUP - 18.04.18
Another Approach: Generative Adversarial Networks
Zhu, Jun-Yan, et al. "Unpaired image-to-image translation using cycle-consistent adversarial networks." arXiv preprint arXiv:1703.10593 (2017).
https://github.com/junyanz/CycleGAN
Huang, Xun, et al. “Multimodal Unsupervised Image-to-Image Translation”. arXiv preprint arXiv:1804.04732 (2018)) https://github.com/NVlabs/MUNIT
CycleGAN (2017) MUNIT (2018)
14. CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
15. CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
16. CREATIVE AI MEETUP - 18.04.18
Deep Retouching (Happy Finish, 2017)
Patent Pending
17. CREATIVE AI MEETUP - 18.04.18
This year: Deep Painterly Harmonization
(Cornell U., Adobe, 2018)
Luan, Fujun, et al. "Deep Painterly Harmonization." arXiv preprint arXiv:1804.03189 (2018). https://github.com/luanfujun/deep-painterly-harmonization
18. CREATIVE AI MEETUP - 18.04.18
This year: Fast Photo Style (NVIDIA, 2018)
Li, Yijun, et al. "A Closed-form Solution to Photorealistic Image Stylization." arXiv preprint arXiv:1802.06474 (2018). https://github.com/NVIDIA/FastPhotoStyle
19. CREATIVE AI MEETUP - 18.04.18
The semantic limitations of style transfer
20. CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018
21. CREATIVE AI MEETUP - 18.04.18
This year: Photo Style Transfer (theprintspace, 2018)
Patent Pending
ContentStyle Cornell U., Adobe 2017 NVIDIA 2018 theprintspace 2018