TaketoFujikawa_KES2023

Estimating Story-events of Comics
Based on Characteristic Words
◯Taketo Fujikawaa, Mitsunori Matsushitaa
a Kansai University, Ryozenji 2-1-1, Takatsuki, 569-1095, Osaka, Japan
27th International Conference on Knowledge-Based and Intelligent Information & Engineering Systems
Athens, Greece, 06-08 September 2023

GENRES OF STORY CONTENT
Story content usually categorized into patterned genres.
• Story content: novels, comics, animations
• Patterned genres: action, fantasy, mystery
Stories categorized into the same genre.
Story compositions are not necessarily the same.
1

STORY COMPOSITION
Genres are rough categorizing story contents.
Ex) these are in the same “action” genre, but …
A hero is the
strongest from
the beginning of
the story!
© ONE, Yusuke Murata, Shueisha INC., 2012
Initially, a hero is
not strong, but
he becomes
strong!
© Kohei Horikoshi，Shueisha INC.，2014
2

STORY COMPOSITION
Genres are rough categorizing story contents.
Ex) these are in the same “action” genre, but …
A hero is the
strongest from
the beginning of
the story!
© ONE, Yusuke Murata, Shueisha INC., 2012
Initially, a hero is
not strong, but
he becomes
strong!
© Kohei Horikoshi，Shueisha INC.，2014
2
Classify the story contents so that users can search by
composition rather than genre.
Our goal

UNDERSTANDING STORY COMPOSITION
Event 1 Event 2
“When” and “what” occurred in the story
Needed information to understand the story composition
3
A A A
B
B

“WHEN” AND “WHAT” OCCURS IN THE STORY
What will occur in the story?
changes in a character
- change in the abilities of a character
- change in the internal/external characteristics of a character
- change in the relationships between characters
When are the points of these changes?
Focus on story-events occurring in the story
4

WHAT IS STORY-EVENT?
Features
- specific to each genre
- often occurs
Ex.)
• Action genre
- battles
- training
• School-themed genre
- school events (e.g., sports festivals and periodic examinations)
- annual events (e.g., Christmas and St. Valentine’s Day)
5
© “Dragon Ball”, Akira Toriyama, Shueisha INC., 1985

OUR PURPOSE
• To help computers understand a story is need information about the story.
• Information about the story has
changes in characters (abilities, internal/external characteristics, relationships).
• To extract these changes is important and needs the status of the character
before/after the change.
• Look for the point of change.
• Estimate story-events which are often used as points of change.
Estimate story-events to help computers understand story composition easier.
6

IN ORDER TO ESTIMATE STORY-EVENTS
Expected to contain many strongly related words in each story-event.
Ex.) school-themed genre
• Christmas
- “Santa Claus”
- “present”
- “Christmas tree”
7
These characterized words about a story-event = “Story-event words”
• Halloween
- “Candy”
- “Costume”
- “pumpkin”

RESEARCH STEP
1. Clarified the kinds and the number of story-events
in the target genres of story contents.
2. Gathered story-event words and created
a story-event words dictionary to estimate the story-events.
3. Estimated the story-events in comics by every episode with the
dictionary.
8

THE FEATURE OF COMIC CONTENT
Not suitable for picking story-event words.
• Both illustrations and text are used in a complementary manner.
• The illustration complements information that
describes a situation and scene about
the backgrounds and visual expressions of characters.
Ø Make comics have less text.
9
Textual information in comics is insufficient for collecting words
for story-event estimation.

IDEA: USING LIGHT NOVELS
Light novels: Young adult novels that primarily target teenagers.
• are literature written in text, describing content similar to that in comics.
• are divided into genres using the same categories as comics.
- e.g., battle, fantasy, and romantic comedy
• have often been adapted to comics.
10
Similar content to comics

RESEARCH QUESTION
• Descriptive texts in light novels are pictured as illustrations in comics.
• Makes it easier to collect vocabulary from light novels than from comics.
11
Can a computer estimate story-events with serif text in comics
using story-event words collected from light novels?

TARGET GENRE
Target: school-themed genre
• Concerned the school lives of characters in modern times.
• Works belonging to genres such as action and science fiction are excluded.
Ø Contain words and scenes that are not used in daily life.
Why adopt the school-themed genre?
• Include more story-events.
• Can be easily differentiated from other story-events.
12

STEP 1: CHOOSING TARGET WORKS
1. Chose 40 light novels and comics in the school-themed genre.
2. identified the kinds of story-events in the 40 works
and counted the number of the frequency occurred them.
Employed conditions
− The time of stories is in the present day.
− The story occurs in a school, such as a junior high school and high school.
− The timeframe of the story spans more than one year, or the story is
complete as of October 10, 2022.
13

STEP2: MAKING STORY-EVENT WORDS DICTIONARY
1. Labeled text with the names of the top 20 story-events that occurred
frequently in the 11 light novels.
Ø These story-events occurred more than three times.
2. Conducted a morphological analysis with MeCab of texts corresponding to the
20 story-events to extract nouns.
Ø Dictionary for a morphological analysis: ipadic-NEologd
3. Extract story-event words by TF-IDF.
Ø These words frequently only appear in some story-events.
14

TWO TYPES OF STORY-EVENT WORDS DICTIONARY
Ex.) Summer festival
• Contains the top 50 words with the highest
TF-IDF values calculated for each
story-event.
Ø Non-refined dictionary
• manually selected story-event words
considered relevant to the story-event
from the top 50 words.
Ø Refined dictionary
Refined dictionary: average 18.3 words
for every story-event
(Max: 31 words, Min: 9 words).
15
Words The value of TF-IDF
wheelchair 0.413
boy 0.344
firework 0.332
yukata 0.219
Summer festival 0.205
red 0.196
Hyottoko 0.189
festival 0.174
Food stall 0.165
Senior 0.123

THE STORY-EVENTS TARGETED FOR ESTIMATION
Estimated 10 story-events
the frequency top 10 story-event of 11 light novels
which is used in creating the story-event words dictionary
16
“school festival,” “Valentine’s day,” “summer festival,”
“Christmas,” “study group,” “birthday,” “sports festival,”
“school trip,” “shopping,” “New Year’s shrine visit”

PROPOSED METHOD (1)
1. Split the text contained in each episode into morphemes and
extract nouns.
morphological analyzer: MeCab, dictionary for a
morphological analysis: ipadic-NEologd
2. Identified the story-events to which the extracted nouns
belonged by referring to a story-event words dictionary.
3. Counted the number of appearances of the nouns identified
as a story-event, allowing for duplication.
17

PROPOSED METHOD (2)
4. Created a 10-dimensional vector of 10 different story-events
every episode.
5. Normalized the obtained vectors such that the sum of their
elements was 1.0.
6. Adopted the highest value among the vector element as the
story-event estimation when it exceeded the threshold.
18

EXPERIMENT 1: COMPARE TWO DICTIONARIES
Made two dictionaries the non-refined dictionary and the refined dictionary.
Need to decide which dictionary we use for estimating story-events.
Compare the accuracy of story-event estimation between two dictionaries.
Calculated the harmonic average as the accuracy.
Result
The non-refined dictionary: 0.325
The refined dictionary: 0.415
19
use the refined dictionary as the story-event words dictionary
1.27 times

EXPERIMENT 2: STORY-EVENT ESTIMATION IN COMICS
Conducted targeting two comics to evaluate the accuracy of story-event estimation.
Result
Recall: 0.409, Precision: 0.450, F-score: 0.429
20
The proposed method can provide a certain degree
of story-event estimation for comics.

DISCUSSION
Correct estimation (190/210)
• Story-event estimation accuracy was high for two events, Valentine's Day and sports festivals.
Ø Story-event words that belonged to the story-event appeared more frequently in the
episodes.
Incorrect estimation (20/210)
• Two story-events, Christmas (2 episodes) and birthdays (2 episodes), were not estimated.
Ø The low story-event words for Christmas and birthdays corresponding stories.
• The story-events of the study group (4 episodes), school trip (1 episode), and New Year's shrine
visit (1 episode), not occurring in the two comics, were estimated.
Ø Story-event words that are also used daily.
21

DISCUSSION
Correct estimation (190/210)
• Story-event estimation accuracy was high for two events, Valentine's Day and sports festivals.
Ø Story-event words that belonged to the story-event appeared more frequently in the
episodes.
Incorrect estimation (20/210)
• Two story-events, Christmas (2 episodes) and birthdays (2 episodes), were not estimated.
Ø The low story-event words for Christmas and birthdays corresponding stories.
• The story-events of the study group (4 episodes), school trip (1 episode), and New Year's shrine
visit (1 episode), not occurring in the two comics, were estimated.
Ø Story-event words that are also used daily.
21
Using co-occurrence relationships
with other story-event words.
Improvement Plan

CONCLUSIONS
1. Clarified story-events according to the categorization of events in the school-themed genre.
2. Gathered words related to story-events from light novels.
3. Making a dictionary including these words.
4. Estimating story-events using the dictionary.
22
Can estimate story-events with serif text of comics
using story-event words collected from light novels.

SUMMARY
Background:
Even if stories are categorized into the same genre, their compositions are not
necessarily the same.
Purpose: Clarify the composition of story content to help computers understand
stories.
Method: estimate story-events using the tendency of story-event words.
Conclusion: Can estimate story-events using a story-event words dictionary.

TaketoFujikawa_KES2023

TaketoFujikawa_KES2023

Recomendados

Mais conteúdo relacionado

Similar a TaketoFujikawa_KES2023

Similar a TaketoFujikawa_KES2023(20)

Mais de Matsushita Laboratory

Mais de Matsushita Laboratory(20)

Último

Último(20)

TaketoFujikawa_KES2023