SlideShare uma empresa Scribd logo
1 de 17
Baixar para ler offline
M a n g a C o lo r iza t io n
            Y in g g e Q u
        T ie n -Ts in W o n g
       Ph e n g - A n n H e n g

   The Chinese University of Hong Kong




         MXMLLN Montgomery
Introduction   Contributions           Results   Critique


                         O u t lin e
                               Paper
               •Introduction
                   – Motivation
                   – Previous Work
               •Contributions
                   – Pattern Segmentation
                   – Colorization
               ●
                Results
                          Critique
               •Motivation
               •Technique Generalization




                       MXMLLN Montgomery
Introduction       Contributions         Results         Critique



                          M o t iv a t io n

Problem
I. Manga are seldom colored due to the time and labor involved.
II. The fine artistic details used to create the visual content and
atmosphere are ill-suited for digital colorization techniques, i.e.,
                                    b
  I.Half-toning
  II.Screening
  III.Hatching




                            MXMLLN Montgomery
Introduction   Contributions         Results         Critique


                    Pr e v io u s W o r k
    User-Directed Colorization
●
 User scribbles color in desired regions
●
 Using constraint quadratic optimization problem, colorization is
achieved under the assumption that adjacent pixels with similar
intensities should be similarly colored




                           MXMLLN Montgomery
Introduction   Contributions         Results         Critique


                    Pr e v io u s W o r k

    Semi-Automated Colorization
●
 Colorization by matching swatches of greyscale image to
reference color image
●
 Auto regression filtering from the relationship between A and A',
applied to input image B to create B'
●
 Colorization by transferring color from an example segmented
image using high-level pixel context




                           MXMLLN Montgomery
Introduction   Contributions         Results        Critique


                     Pr e v io u s W o r k




    Limitations
●
 Works for intensity continuity, like photographs and videos
●
 Is unable to handle pattern continuity, like illustrations

                           MXMLLN Montgomery
Introduction   Contributions         Results      Critique


                    Pr e v io u s W o r k
    Texture-Based Segmentation
●
 Texture is classified, segmented, and synthesized based on
texture properties of repeated elements:
  ●
    Size
  ●
    Aspect ratio
  ●
    Orientation
  ●
    Brightness
  ●
    Density




                           MXMLLN Montgomery
Introduction      Contributions          Results           Critique


                   Im p le m e n t a t io n


    Color propagation employs a zero surface, geometric,
   level set method


    For more details, please refer to the text




                          MXMLLN Montgomery
Introduction      Contributions         Results   Critique


                         C o n t r ib u t io n s

Pattern-continuous regions
●
  Uniformly sample along user
scribble to compute pattern
features:
  ●
    Cluster feature patterns
  ●
    Identify major cluster
  ●
    Find average of major cluster

●
 Allows some error in scribbling
over unintended areas


                              MXMLLN Montgomery
Introduction      Contributions         Results   Critique


                         C o n t r ib u t io n s


Pattern-continuous regions
●
  Propagate color until pattern
reaches abrupt change
●
  This step allows both splitting
and merging between boundaries
  ●
    Disjoint regions can be colored
    with single scribble




                              MXMLLN Montgomery
Introduction     Contributions         Results   Critique


                       C o n t r ib u t io n s




Intensity-continuous regions
●
  Leak proofing prevents
propagation from leaking
through gaps




                            MXMLLN Montgomery
Introduction      Contributions         Results   Critique


                       C o n t r ib u t io n s




Colorization
●
  Stroke-preserving
colorization
  ●
    Colorization is achieved by
    bleeding out from strokes
    and patterns




                            MXMLLN Montgomery
Introduction        Contributions         Results   Critique


                           C o n t r ib u t io n s



Colorization
●
  Pattern-to-shading
  ●
    Hatching and
    screening shading
    effects can be
    portrayed
    smoothly by color
    shading



                                MXMLLN Montgomery
Introduction      Contributions           Results   Critique


                       C o n t r ib u t io n s



Colorization
●
  Multi-color transition
  ●
    Colors are blended
    together based on their
    distance from the user
    scribble




                              MXMLLN Montgomery
Introduction     Contributions            Results   Critique


                              Re s u lt s




Limitations
●
  System regards overlapped
patterns as distinct




                           MXMLLN Montgomery
Introduction       Contributions         Results   Critique


                                C r it iq u e

Motivation
●
  Mangas are not
colored because of
the extensive
printing cost
●
  Many techniques,
such as hatching and
screening shading,
may actually be less
labor intensive in
color


                               MXMLLN Montgomery
Introduction           Contributions         Results             Critique


                                C r it iq u e


               Technique generalization
               ●
                 The authors never identify other applications
               of their technique
                 ●
                   More broadly than manga, their work is
                   suitable for any intensity-homogenous
                   images and videos.
               ●
                 Including additional applications broadens
               the scope and reader base of a publication




                               MXMLLN Montgomery

Mais conteúdo relacionado

Destaque

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Applitools
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at WorkGetSmarter
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...DevGAMM Conference
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationErica Santiago
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellSaba Software
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming LanguageSimplilearn
 

Destaque (20)

How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
Unlocking the Power of ChatGPT and AI in Testing - A Real-World Look, present...
 
12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work12 Ways to Increase Your Influence at Work
12 Ways to Increase Your Influence at Work
 
ChatGPT webinar slides
ChatGPT webinar slidesChatGPT webinar slides
ChatGPT webinar slides
 
More than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike RoutesMore than Just Lines on a Map: Best Practices for U.S Bike Routes
More than Just Lines on a Map: Best Practices for U.S Bike Routes
 
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
Ride the Storm: Navigating Through Unstable Periods / Katerina Rudko (Belka G...
 
Barbie - Brand Strategy Presentation
Barbie - Brand Strategy PresentationBarbie - Brand Strategy Presentation
Barbie - Brand Strategy Presentation
 
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them wellGood Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
Good Stuff Happens in 1:1 Meetings: Why you need them and how to do them well
 
Introduction to C Programming Language
Introduction to C Programming LanguageIntroduction to C Programming Language
Introduction to C Programming Language
 

Manga Colorization

  • 1. M a n g a C o lo r iza t io n Y in g g e Q u T ie n -Ts in W o n g Ph e n g - A n n H e n g The Chinese University of Hong Kong MXMLLN Montgomery
  • 2. Introduction Contributions Results Critique O u t lin e Paper •Introduction – Motivation – Previous Work •Contributions – Pattern Segmentation – Colorization ● Results Critique •Motivation •Technique Generalization MXMLLN Montgomery
  • 3. Introduction Contributions Results Critique M o t iv a t io n Problem I. Manga are seldom colored due to the time and labor involved. II. The fine artistic details used to create the visual content and atmosphere are ill-suited for digital colorization techniques, i.e., b I.Half-toning II.Screening III.Hatching MXMLLN Montgomery
  • 4. Introduction Contributions Results Critique Pr e v io u s W o r k User-Directed Colorization ● User scribbles color in desired regions ● Using constraint quadratic optimization problem, colorization is achieved under the assumption that adjacent pixels with similar intensities should be similarly colored MXMLLN Montgomery
  • 5. Introduction Contributions Results Critique Pr e v io u s W o r k Semi-Automated Colorization ● Colorization by matching swatches of greyscale image to reference color image ● Auto regression filtering from the relationship between A and A', applied to input image B to create B' ● Colorization by transferring color from an example segmented image using high-level pixel context MXMLLN Montgomery
  • 6. Introduction Contributions Results Critique Pr e v io u s W o r k Limitations ● Works for intensity continuity, like photographs and videos ● Is unable to handle pattern continuity, like illustrations MXMLLN Montgomery
  • 7. Introduction Contributions Results Critique Pr e v io u s W o r k Texture-Based Segmentation ● Texture is classified, segmented, and synthesized based on texture properties of repeated elements: ● Size ● Aspect ratio ● Orientation ● Brightness ● Density MXMLLN Montgomery
  • 8. Introduction Contributions Results Critique Im p le m e n t a t io n Color propagation employs a zero surface, geometric, level set method For more details, please refer to the text MXMLLN Montgomery
  • 9. Introduction Contributions Results Critique C o n t r ib u t io n s Pattern-continuous regions ● Uniformly sample along user scribble to compute pattern features: ● Cluster feature patterns ● Identify major cluster ● Find average of major cluster ● Allows some error in scribbling over unintended areas MXMLLN Montgomery
  • 10. Introduction Contributions Results Critique C o n t r ib u t io n s Pattern-continuous regions ● Propagate color until pattern reaches abrupt change ● This step allows both splitting and merging between boundaries ● Disjoint regions can be colored with single scribble MXMLLN Montgomery
  • 11. Introduction Contributions Results Critique C o n t r ib u t io n s Intensity-continuous regions ● Leak proofing prevents propagation from leaking through gaps MXMLLN Montgomery
  • 12. Introduction Contributions Results Critique C o n t r ib u t io n s Colorization ● Stroke-preserving colorization ● Colorization is achieved by bleeding out from strokes and patterns MXMLLN Montgomery
  • 13. Introduction Contributions Results Critique C o n t r ib u t io n s Colorization ● Pattern-to-shading ● Hatching and screening shading effects can be portrayed smoothly by color shading MXMLLN Montgomery
  • 14. Introduction Contributions Results Critique C o n t r ib u t io n s Colorization ● Multi-color transition ● Colors are blended together based on their distance from the user scribble MXMLLN Montgomery
  • 15. Introduction Contributions Results Critique Re s u lt s Limitations ● System regards overlapped patterns as distinct MXMLLN Montgomery
  • 16. Introduction Contributions Results Critique C r it iq u e Motivation ● Mangas are not colored because of the extensive printing cost ● Many techniques, such as hatching and screening shading, may actually be less labor intensive in color MXMLLN Montgomery
  • 17. Introduction Contributions Results Critique C r it iq u e Technique generalization ● The authors never identify other applications of their technique ● More broadly than manga, their work is suitable for any intensity-homogenous images and videos. ● Including additional applications broadens the scope and reader base of a publication MXMLLN Montgomery