Presentation of our paper called "Dynamic Solid Textures for Real-Time Coherent Stylization" published at I3D 2009

1. Laboratoire Jean Kuntzmann Pierre Bénard, Adrien Bousseau, Joëlle Thollot Dynamic Solid Texturesfor Real-Time Coherent Stylisation

2. Introduction 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 2 Team Forteress 2 Okami Prince of Persia Jet Grind Radio

3. Introduction 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 3

4. Problem Statement 3D scene  2D appearance Stylized color regions Simulation of a 2D medium Temporal coherence 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 4 Paint strokes Pencil strokes paper Watercolor pigments

5. Problem Statement 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 5 « Il pleut bergère », Jérémy Depuydt (2005)

7. Temporal continuity

8. 3D motion

10. Temporal continuity

11. 3D motion

13. Temporal continuity

14. 3D motion

15. 2D characteristics of the mediumProblem Statement 3 artifacts Popping and flickering Sliding Medium deformations 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 10  Contradictory requirement: How to conciliate them?

16. Problem Statement 3 requirements 2 applicative constraints Real-time Flexibility  variety of styles 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 11 2D characteristics  Popping  Shower-door  3D motion Temporal continuity Traditional mapping Interactive Real-Time

17. Previous Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 12

18. Previous Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 13 2D characteristics Interactive Real-Time [Mei96] Primitives distribution [Mei96,VBTS07]  Popping  Shower-door  Temporalcontinuity  Traditional mapping 3D motion

19. Previous Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 14 2D characteristics Interactive Real-Time Screen-space texture mapping[CTP*03,CDH06,BSM*07] Primitives distribution [Mei96,VBTS07]  Popping  Shower-door   [CTP*03] Temporalcontinuity  Traditional mapping 3D motion

21. Infinite zoom mechanism (Dynamic Canvas)

22. Approximated 3D motions  sliding2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 15 [BSM*07]

23. Previous Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 16 2D characteristics [FMS01] Interactive Real-Time Screen-space texture mapping[CTP*03,CDH06,BSM*07] Screen-space texture mapping[CTP*03,CDH06,BSM*07] Primitives distribution [Mei96,VBTS07]  Popping  Shower-door    Temporalcontinuity  Traditional mapping 3D motion Object-space texture mapping[KLK*00,PHWF01,FMS01]

25. MIP-mapping

26. Perspective distortions

27. Limited styles2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 17 [PHWF01]

28. Previous Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 18 2D characteristics Interactive Real-Time Screen-space texture mapping[CTP*03,CDH06,BSM*07] Primitives distribution [Mei96,VBTS07]  Popping  Shower-door   our approach   Temporalcontinuity  Traditional mapping 3D motion Object-space texture mapping[KLK*00,PHWF01,FMS01]

29. Previous Work Our approach Real-time  texture-based approach Accurate 3D motion  object space Infinite zoom Dynamic Canvas Easy parameterization solid textures [Per85] 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 19

30. Dynamic Solid Textures 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 20

32. Dynamic Solid Textures Texture building Texture “Fractalization” [Per85]  1 solid texture : 4 octaves 2/28/2009 22 freq. x2 freq. x2 freq. x2 octave 2 octave 1 octave 3 octave 4 weightedsum Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot

33. Dynamic Solid Textures Texture building Zoom cycle 2/28/2009 23 octave 2 octave 1 octave 3 octave 4 weighted sum Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot

34. Dynamic Solid Textures 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 24

35. Dynamic Solid Textures Implementation Reference volume + 3D texture coordinates GLSL shaders(available in the paper) Procedural textures [Per85, Ola05] or 3D textures synthesized from 2D exemplars [KFCO*07] 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 25

36. Dynamic Solid Textures Performance Additional cost: 10% of Gouraud shading 65-70 fps for the city scene (135k tris) Rendering engine: OGRE (www.ogre3d.org) 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 26

37. Dynamic Solid Textures Results and comparisons Traditional 3D textures Dynamic Canvas [CTP*03] Texture Advection [BNTS07] 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 27 2D characteristics Dynamic Solid Textures   Traditional 3D textures Temporalcontinuity 3D motion Interactive Real-Time

38. Dynamic Solid Textures 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 28

39. Dynamic Solid Textures Results and comparisons Traditional 3D textures Dynamic Canvas [CTP*03] Texture Advection [BNTS07] 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 29 2D characteristics Dynamic Canvas   Dynamic Solid Textures Temporalcontinuity 3D motion Interactive Real-Time

40. Dynamic Solid Textures 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 30

41. Dynamic Solid Textures Results and comparisons Traditional 3D textures DynamicCanvas[CTP*03] Texture Advection [BNTS07] 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 31 2D characteristics Texture advection   Dynamic Solid Textures Temporalcontinuity 3D motion Interactive Real-Time

42. Dynamic Solid Textures 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 32

43. Application to temporally coherent stylization 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 33

44. Application to temporally coherent stylization Watercolor Extension of the Bousseauetal. [BKTS06]pipeline Textures = pigments and paper 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 34

45. Application to temporally coherent stylization 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 35

46. Application to timecoherent stylization Binary style Similar to Durand et al. [DOM*01] approach Threshold texture = binary mark 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 36

47. Application to temporally coherent stylization 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 37

48. Application to temporally coherent stylization 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 38

49. Application to temporally coherent stylization Collage 1 texture = 1 tone strip white border between tone strips 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 39

50. Application to temporally coherent stylization 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 40

51. Discussion and Future Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 41

53. Discussion and Future Work 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 43

54. Discussion and Future Work Infinite zoom mechanism Trade-off: Medium fidelity vs. Temporal continuity Linear blending new frequencies contrast loss 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 44

55. Discussion and Future Work Infinite zoom mechanism Linear blending Feature aware blending [GVWD06,WY04] 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 45 Texture Feature Map

56. Conclusions Simplicity Strong temporal coherence Real-time animation Variety of styles 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 46

57. Thank you for your attention I will be pleased to answer your questions. 2/28/2009 Dynamic Solid Textures for Real-Time Coherent Stylization - P. Bénard, A. Bousseau, J. Thollot 47 Paper, shaders and solid textures gallery: http://artis.inrialpes.fr/Publications/2009/BBT09/