SlideShare uma empresa Scribd logo
1 de 26
Baixar para ler offline
Markov Chain and Classification
of Difficulty Levels Enhances
the Learning Path in
One Digit Multiplication
Behnam Taraghi, Anna Saranti, Martin Ebner, Martin Schön
What it is about ?
!
Learning Analytics is the use of
intelligent data, learner-produced data,
and analysis models to discover
information and social connections, and
to predict and advise on learning.
Learning Analytics
Georg Siemens (2010) http://www.elearnspace.org/blog/2010/08/25/what-are-learning-analytics/
!
Learning Analytics is about collecting
traces that learners leave behind and
using those traces to improve learning.	

Learning Analytics
Erik Duval (2012) http://www.slideshare.net/erik.duval/learning-analytics-13050389
http://www.flickr.com/photos/neeravbhatt/6995946039
http://schule.tugraz.at
http://einmaleins.tugraz.at/
http://mathe.tugraz.at
Schön, M., Ebner, M., Kothmeier, G. (2012) It's Just About
Learning the Multiplication Table, In Proceedings of the 2nd
International Conference on Learning Analytics and
Knowledge (LAK '12), Simon Buckingham Shum, Dragan
Gasevic, and Rebecca Ferguson (Eds.). ACM, New York, NY,
USA, 73-81	

Algorithm
What is done as next step ?
!
!
- ... collect data: more than 500,000 calculations
!
- ... pupils from different primary schools
!
-... analyze preprocessed data
!
- ... cluster arithmetic questions according to their difficulty
!
- ... identify influential structures in each user’s answers
!
- ... offer personalized recommendation for each pupil
One Digit Multiplication
Answer Type Preceding Answer Current Answer
R - R
W - W
RR R R
RW R W
WR W R
WW W W
Answer Types
!
Question Difficulty: R & W
Question Difficulty: RW, WR & WW
!
Question Difficulty: RW, WR & WW
! !
Question Difficulty Clusters
(8 - 22 - 60)
!
!
!
- states: answer types to each question
!
- transition links: probability to the answer type of the
subsequent same posed question in the sequence
!
- for each 90 questions the MC model is applied individually
!
!
Markov Chain Analysis
(per Question)
Markov Chain Analysis (per Question)
!
!
- states: answer types to each question
!
- transition links: probability to the answer type of the
subsequent posed question in the sequence
Markov Chain Analysis
(over all Questions)
Markov Chain Analysis
(over all Questions)
k = 1 k = 3k = 2 k = 5Answer types k = 4
RW
WR
46.0
25.30
70.69
61.02
76.88
84.77
77.20
86.92
78.79
92.52
not observable in the set of easy questions
Markov Chain Analysis
(over all Questions)
Answer types
k = 2k = 1 k = 3 k = 4 k = 5
R
W
69.66
30.44
RR
12.8
87.2
RW
53.29
46.71
WR
7.11
92.89
WW
10.15
89.85
Others
31.01
68.99
71.52
28.48
23.03
76.97
77.59
22.41
9.37
90.63
16.14
83.86
55.29
44.71
72.26
27.74
42.28
57.72
89.02
10.98
7.69
92.31
29.30
70.70
66.51
33.49
72.66
27.34
51.38
48.62
92.48
7.52
0
100
39.13
60.87
74.98
25.02
72.92
27.08
50.00
50.00
93.57
6.43
0
100
41.67
58.33
80.63
19.37
Which question to pose
as next ?
- Question q from cluster c is answered correctly
- take Q = q+1 out of cluster C = c or c+1
!
- Question q from cluster c is answered incorrectly
- take Q = q+1 out of cluster C = c or c-1
!
!
- adapt the algorithm used to pose a question according to
identified difficulty levels
- choose question Q from cluster C that owns the highest
proportion rate referring to answer type WR or RR
!
!
- 1x1 multiplications were classified into 6 optimal difficulty
clusters
!
- most difficult questions: 6*8, 7*8, 8*6, 8*7, 8*4, 8*8, 6*7, 4*8
!
- the multiplications where 1, 2, 5, 10 occur as operands can be
classified as easy to learn
!
- 3, 4, 6, 9, and especially 7, 8 operands build multiplications
that can be classified as difficult
!
- adapt the algorithm used to pose a question according to
identified difficulty levels
!
- use the detected patterns to let teachers intervene if required.
Conclusions
Graz University of Technology
SOCIAL LEARNING
Computer and Information Services
Graz University of Technology
Behnam Taraghi
Slides available at: http://elearningblog.tugraz.at
behi_at

Mais conteúdo relacionado

Semelhante a Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication

Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Vitomir Kovanovic
 
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
ArchiLab 7
 

Semelhante a Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication (20)

The Importance of Being Structured
The Importance of Being StructuredThe Importance of Being Structured
The Importance of Being Structured
 
Research Poster (2015-16)
Research Poster (2015-16)Research Poster (2015-16)
Research Poster (2015-16)
 
Matrix Factorization
Matrix FactorizationMatrix Factorization
Matrix Factorization
 
Unsupervised learning with Spark
Unsupervised learning with SparkUnsupervised learning with Spark
Unsupervised learning with Spark
 
Methodological study of opinion mining and sentiment analysis techniques
Methodological study of opinion mining and sentiment analysis techniquesMethodological study of opinion mining and sentiment analysis techniques
Methodological study of opinion mining and sentiment analysis techniques
 
Role of technology to make teaching, learning & assessment convenient
Role of technology to make teaching, learning & assessment convenientRole of technology to make teaching, learning & assessment convenient
Role of technology to make teaching, learning & assessment convenient
 
Mobile App Recommendations Using Deep Learning and Big Data
Mobile App Recommendations Using Deep Learning and Big DataMobile App Recommendations Using Deep Learning and Big Data
Mobile App Recommendations Using Deep Learning and Big Data
 
FUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSIS
FUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSISFUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSIS
FUNCTION OF RIVAL SIMILARITY IN A COGNITIVE DATA ANALYSIS
 
prototypes-AMALEA.pdf
prototypes-AMALEA.pdfprototypes-AMALEA.pdf
prototypes-AMALEA.pdf
 
MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...
MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...
MOOCEOLOGY - Honing in on Social Learning in MOOC Forums: Examining Critical ...
 
Introduction to Linear Discriminant Analysis
Introduction to Linear Discriminant AnalysisIntroduction to Linear Discriminant Analysis
Introduction to Linear Discriminant Analysis
 
1574
15741574
1574
 
Lausanne 2019 #4
Lausanne 2019 #4Lausanne 2019 #4
Lausanne 2019 #4
 
BASIC STATISTICS AND PROBABILITY.pptx
BASIC STATISTICS AND PROBABILITY.pptxBASIC STATISTICS AND PROBABILITY.pptx
BASIC STATISTICS AND PROBABILITY.pptx
 
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
The Open Academy Initiative: Fostering an Innovation Culture with a Local Fla...
 
Poster CELePro for the eScience Network Conference 06/2013
Poster CELePro for the eScience Network Conference 06/2013Poster CELePro for the eScience Network Conference 06/2013
Poster CELePro for the eScience Network Conference 06/2013
 
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
Towards Automated Classification of Discussion Transcripts: A Cognitive Prese...
 
Work completion seminar defence
Work completion seminar defenceWork completion seminar defence
Work completion seminar defence
 
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
Fessant aknin oukhellou_midenet_2001:comparison_of_supervised_self_organizing...
 
Numerical solutions of linear algebraic systems using matlab
Numerical solutions of linear algebraic systems using matlabNumerical solutions of linear algebraic systems using matlab
Numerical solutions of linear algebraic systems using matlab
 

Mais de Educational Technology

Mais de Educational Technology (20)

The use of programming tasks in interactive videos to increase learning effec...
The use of programming tasks in interactive videos to increase learning effec...The use of programming tasks in interactive videos to increase learning effec...
The use of programming tasks in interactive videos to increase learning effec...
 
Analysis of students' behavior watching iMooX courses with interactive elements
Analysis of students' behavior watching iMooX courses with interactive elementsAnalysis of students' behavior watching iMooX courses with interactive elements
Analysis of students' behavior watching iMooX courses with interactive elements
 
Portability of Mobile Applications
Portability of Mobile ApplicationsPortability of Mobile Applications
Portability of Mobile Applications
 
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...
Erhebung von Lernaktivitäten in einem Pop-Up-Makerspace mit einer technischen...
 
Mixed Reality im Distance Learning in der Hochschullehre
Mixed Reality im Distance Learning in der HochschullehreMixed Reality im Distance Learning in der Hochschullehre
Mixed Reality im Distance Learning in der Hochschullehre
 
Development of a WCAG theme for a learning management system
Development of a WCAG theme for a learning management systemDevelopment of a WCAG theme for a learning management system
Development of a WCAG theme for a learning management system
 
Math trainer as a chatbot via system(push) messages for Android
Math trainer as a chatbot via system(push) messages for AndroidMath trainer as a chatbot via system(push) messages for Android
Math trainer as a chatbot via system(push) messages for Android
 
Empirical Analysis of Automated Editing of Raw Learning Video Footage
Empirical Analysis of Automated Editing of Raw Learning Video FootageEmpirical Analysis of Automated Editing of Raw Learning Video Footage
Empirical Analysis of Automated Editing of Raw Learning Video Footage
 
Fächerintegrativer Unterricht am Beispiel der Leichtathletik
Fächerintegrativer Unterricht am Beispiel der LeichtathletikFächerintegrativer Unterricht am Beispiel der Leichtathletik
Fächerintegrativer Unterricht am Beispiel der Leichtathletik
 
DENKEN UND TECHNIK Über manipulative Auswirkungen von Internettechnologien
DENKEN UND TECHNIK Über manipulative Auswirkungen von InternettechnologienDENKEN UND TECHNIK Über manipulative Auswirkungen von Internettechnologien
DENKEN UND TECHNIK Über manipulative Auswirkungen von Internettechnologien
 
Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...
Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...
Empfehlungen für den Unterricht im Fach Informatik für Menschen mit Autismus-...
 
Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...
Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...
Entwicklung eines Online-Kurses für digitale Kompetenzen für Studienanfänger:...
 
School Start Screening Tool
School Start Screening ToolSchool Start Screening Tool
School Start Screening Tool
 
Development of a mobile French language learning platform
Development of a mobile French language learning platformDevelopment of a mobile French language learning platform
Development of a mobile French language learning platform
 
Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...
Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...
Learning Analytics and Spelling Acquisition in German - the Path to Indivdual...
 
Learning Analytics and MOOCs
Learning Analytics and MOOCsLearning Analytics and MOOCs
Learning Analytics and MOOCs
 
Fächerintegrativer Unterricht am Beispiel des Lernroboters Thymio
Fächerintegrativer Unterricht am Beispiel des Lernroboters ThymioFächerintegrativer Unterricht am Beispiel des Lernroboters Thymio
Fächerintegrativer Unterricht am Beispiel des Lernroboters Thymio
 
Einsatz von Mixed Reality im Klassenzimmer
Einsatz von Mixed Reality im KlassenzimmerEinsatz von Mixed Reality im Klassenzimmer
Einsatz von Mixed Reality im Klassenzimmer
 
Chatbots for Brand Representation in Comparison with Traditional Websites
Chatbots for Brand Representation in Comparison with Traditional WebsitesChatbots for Brand Representation in Comparison with Traditional Websites
Chatbots for Brand Representation in Comparison with Traditional Websites
 
Development of a learning diary for a MOOC platform
Development of a learning diary for a MOOC platformDevelopment of a learning diary for a MOOC platform
Development of a learning diary for a MOOC platform
 

Último

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Último (20)

TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
Google Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptxGoogle Gemini An AI Revolution in Education.pptx
Google Gemini An AI Revolution in Education.pptx
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Python Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docxPython Notes for mca i year students osmania university.docx
Python Notes for mca i year students osmania university.docx
 
Plant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptxPlant propagation: Sexual and Asexual propapagation.pptx
Plant propagation: Sexual and Asexual propapagation.pptx
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
SOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning PresentationSOC 101 Demonstration of Learning Presentation
SOC 101 Demonstration of Learning Presentation
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
2024-NATIONAL-LEARNING-CAMP-AND-OTHER.pptx
 
ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.ICT role in 21st century education and it's challenges.
ICT role in 21st century education and it's challenges.
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 
Single or Multiple melodic lines structure
Single or Multiple melodic lines structureSingle or Multiple melodic lines structure
Single or Multiple melodic lines structure
 

Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication

  • 1. Markov Chain and Classification of Difficulty Levels Enhances the Learning Path in One Digit Multiplication Behnam Taraghi, Anna Saranti, Martin Ebner, Martin Schön
  • 2.
  • 3. What it is about ?
  • 4. ! Learning Analytics is the use of intelligent data, learner-produced data, and analysis models to discover information and social connections, and to predict and advise on learning. Learning Analytics Georg Siemens (2010) http://www.elearnspace.org/blog/2010/08/25/what-are-learning-analytics/
  • 5. ! Learning Analytics is about collecting traces that learners leave behind and using those traces to improve learning. Learning Analytics Erik Duval (2012) http://www.slideshare.net/erik.duval/learning-analytics-13050389
  • 10. Schön, M., Ebner, M., Kothmeier, G. (2012) It's Just About Learning the Multiplication Table, In Proceedings of the 2nd International Conference on Learning Analytics and Knowledge (LAK '12), Simon Buckingham Shum, Dragan Gasevic, and Rebecca Ferguson (Eds.). ACM, New York, NY, USA, 73-81 Algorithm
  • 11. What is done as next step ?
  • 12. ! ! - ... collect data: more than 500,000 calculations ! - ... pupils from different primary schools ! -... analyze preprocessed data ! - ... cluster arithmetic questions according to their difficulty ! - ... identify influential structures in each user’s answers ! - ... offer personalized recommendation for each pupil One Digit Multiplication
  • 13. Answer Type Preceding Answer Current Answer R - R W - W RR R R RW R W WR W R WW W W Answer Types
  • 18. ! ! - states: answer types to each question ! - transition links: probability to the answer type of the subsequent same posed question in the sequence ! - for each 90 questions the MC model is applied individually ! ! Markov Chain Analysis (per Question)
  • 19. Markov Chain Analysis (per Question)
  • 20. ! ! - states: answer types to each question ! - transition links: probability to the answer type of the subsequent posed question in the sequence Markov Chain Analysis (over all Questions)
  • 21. Markov Chain Analysis (over all Questions) k = 1 k = 3k = 2 k = 5Answer types k = 4 RW WR 46.0 25.30 70.69 61.02 76.88 84.77 77.20 86.92 78.79 92.52 not observable in the set of easy questions
  • 22. Markov Chain Analysis (over all Questions) Answer types k = 2k = 1 k = 3 k = 4 k = 5 R W 69.66 30.44 RR 12.8 87.2 RW 53.29 46.71 WR 7.11 92.89 WW 10.15 89.85 Others 31.01 68.99 71.52 28.48 23.03 76.97 77.59 22.41 9.37 90.63 16.14 83.86 55.29 44.71 72.26 27.74 42.28 57.72 89.02 10.98 7.69 92.31 29.30 70.70 66.51 33.49 72.66 27.34 51.38 48.62 92.48 7.52 0 100 39.13 60.87 74.98 25.02 72.92 27.08 50.00 50.00 93.57 6.43 0 100 41.67 58.33 80.63 19.37
  • 23. Which question to pose as next ?
  • 24. - Question q from cluster c is answered correctly - take Q = q+1 out of cluster C = c or c+1 ! - Question q from cluster c is answered incorrectly - take Q = q+1 out of cluster C = c or c-1 ! ! - adapt the algorithm used to pose a question according to identified difficulty levels - choose question Q from cluster C that owns the highest proportion rate referring to answer type WR or RR
  • 25. ! ! - 1x1 multiplications were classified into 6 optimal difficulty clusters ! - most difficult questions: 6*8, 7*8, 8*6, 8*7, 8*4, 8*8, 6*7, 4*8 ! - the multiplications where 1, 2, 5, 10 occur as operands can be classified as easy to learn ! - 3, 4, 6, 9, and especially 7, 8 operands build multiplications that can be classified as difficult ! - adapt the algorithm used to pose a question according to identified difficulty levels ! - use the detected patterns to let teachers intervene if required. Conclusions
  • 26. Graz University of Technology SOCIAL LEARNING Computer and Information Services Graz University of Technology Behnam Taraghi Slides available at: http://elearningblog.tugraz.at behi_at