SlideShare uma empresa Scribd logo
1 de 83
Baixar para ler offline
Multimodal Learning
Analytics
Xavier Ochoa
Escuela Superior Politécnica del Litoral
http://www.slideshare.net/xaoch
Download this presentation
(Multimodal)
Learning Analytics
Learning analytics is the measurement,
collection, analysis and reporting of data
about learners and their contexts, for
purposes of understanding and
optimising learning and the
environments in which it occurs.
Examining engagement: analysing
learner subpopulations in massive
open online courses (MOOCs)
Using transaction-level data to
diagnose knowledge gaps and
misconceptions
Likelihood analysis of student
enrollment outcomes using learning
environment variables: a case study
approach
Tracking student progress in a game-
like learning environment with a
Monte Carlo Bayesian knowledge
tracing model
Strong focus on online data
Based on the papers it should be called
Online-Learning Analytics
Streetlight effect
Where learning is
happening?
Multimodal Learning Analytics
Multimodal Learning Analytics
Multimodal Learning Analytics
Multimodal Learning Analytics
Multimodal Learning Analytics
Multimodal Learning Analytics
Why
Multimodal Learning Analytics?
We should be looking where it is useful to look,
not where it is easy
There is learning outside the
LMS
But it is very messy!
Who is learning?
Who is learning?
Who is learning?
Who is learning? – Traditional way
But there are better ways to
assess learning
At least theoretically
Who is learning? – Educational Research
Multimodal Learning Analytics
How can we approach the
problem from a
Learning Analytics perspective
Measure, collect, analyze and report
to understand and optimize
We need to capture learning
traces from the real world
Look ma, no log files!
In the real world, humans
communicate (and leave traces)
in several modalities
What you say is as important as
how you say it
We need to analyze the traces
with variable degrees of
sophistication
And we have to do it automatically as
humans are not scalable
We need to provide
feedback in the real world
Often in a multimodal way too
But…
Which modes are important to
understand the learning
process?
We do not know yet…
Possibilities
• What we see
• What we hear
• How we move
• How we write
• How we blink
• Our pulse
• Brain activity?
• Our hormones?
What are the relevant
features of those signals
We do not know yet…
Our current analysis tools are
good enough?
We do not know yet…
How to present the information
(and uncertainty)
in a way that is actually useful?
We do not know yet…
It is an open
(but very dark) field
One feels like an explorer
This particular flavor of Learning
Analytics is what we called
Multimodal Learning Analytics
Multimodal Learning Analytics is related to:
• Behaviorism
• Cognitive Science
• Multimodal Interaction (HCI)
• Educational Research (old school one)
• Computer Vision
• Natural Language Processing
• Biosignals Processing
• And as many fields as modes you can think of...
Examples
Multimodal Learning Analytics
Math Data Corpus
How to (easily) obtain
multimodal features?
What is already there?
Three Approaches
• Literature-based features
• Common-sense-based features
• “Why not?”-based features
All approaches proved useful
Proof that we are in an early stage
Video: Calculator Use (NTCU)
et s of
s was
t , on
t hat
eived
so in-
n and
lving
ed by
udent
e was
score
given
diffi-
ssion,
n ex-
Mat h
at t et
direct ion in which it was point ing at using t he rigid t rans-
format ions capabilit ies provided by OpenCV . W hile t here
were some frames in which t his mat ching was not possible
due t o object occlusions or changes in t he illuminat ion of
t he calculat or, in general t he described det ect ion t echnique
was robust and provided useful posit ion and direct ion dat a.
F igur e 1: D et er m in at ion of w hich st udent is usin g
Video: Calculator Use (NTCU)
• Idea:
• Calculator user is the one solving the problem
• Procedure:
• Obtain a picture of the calculator
• Track the position and angle of the image in the video
using SURF + FLANN + Rigid Object Transformation
(OpenCV)
• Determine to which student the calculator is pointing in
each frame
Video: Total Movement (TM)
fined as t he number of whit e pixels cont ained in t he binary
image out put by t he Codebook algorit hm. T his magnit ude,
when comput ed for t he ent ire problem solving session, re-
sult s from summing up it s individual values obt ained from
each frame t hat compose a problem recording.
(a) Original frame (b) Difference frame
F igur e 2: R esult s of t he C odeb ook algor it hm .
Video: Total Movement (TM)
• Idea:
• Most active student is the leader/expert?
• Procedure:
• Subtract current frame from previous frame
• Codebook algorithm to eliminate noise-movement
• Add the number of remaining pixels
Video: Distance from center table
(DHT)
he de-
oblem
ed t o
calcu-
par-
a spe-
ed as
e pre-
Code-
ficant
small
ondi-
where
ained
s de-
inary
t ude,
n, re-
from
each head cent roid t o t he cent er of t he t able is calculat ed
and t hen, t he average of t hese dist ances is obt ained by prob-
lem (see Figure 3). A ddit ionally, t he variance of t he average
dist ance head t o t able (SD-DHT ), was calculat ed t o det er-
mine if a part icipant remains most ly st at ic or varies his or
her dist ance t o t he t able.
F igur e 3: C alculat ion of t he dist ance of t he st udent ’s
Video: Distance from center table
(DHT)
• Idea:
• If the head is near the table (over paper) the student is
working on the problem
• Procedure:
• Identify image of heads
• Use TLD algorithm to track heads
• Determine the distance from head to center of table
Audio: Processing
Audio: Features
• Number of Interventions (NOI)
• Total Speech Duration (TSD)
• Times Numbers were Mentioned (TNM)
• Times Math Terms were Mentioned (TMTM)
• Times Commands were Pronounced (TCP)
Digital Pen: Basic Features
Digital Pen: Basic Features
• Total Number of Strokes (TNS)
• Average Number of Points (ANP)
• Average Stroke Path Length (ASPL)
• Average Stroke Displacement (ASD)
• Average Stroke Pressure (ASP)
Digital Pen: Shape Recognition
Stronium – Sketch Recognition Libraries
Digital Pen: Shape Recognition
• Number of Lines (NOL)
• Number of Rectangles (NOR)
• Number of Circles (NOC)
• Number of Ellipses (NOE)
• Number of Arrows (NOA)
• Number of Figures (NOF)
Analysis at Problem level
Solving Problem Correctly
• Logistic Regression to model Student Solving Problem
Correctly
• Resulting model was significantly reliable
• 60,9% of the problem solving student was identified
• 71,8% of incorrectly solved problems were identified
Analysis at problem level
effi cient s of t he L ogist ic M odel Predict ing Odds for a St udent Solving Correct ly
Predictor Variable B W ald df p value exp(B )
Number of Interventions (N OI ) 0.068 24.019 1 0.001 0.934
Times numbers were mentioned (TN M ) 0.175 23.816 1 0.001 1.192
Times commands were pronounced (TCP) 0.329 4.956 1 0.026 1.390
Proportion of Calculator Usage (PCU) 1.287 25.622 1 0.001 3.622
Fastest Student in the Group (F W ) 0.924 18.889 1 0.001 2.519
Constant 1.654 53.462 1 0.001 0.191
mber of Point s (AN P): Represents, in
mber of points that compose each stroke
sub-sets. Classification Trees, provided by
in the R statistical software [21] for Mac, w
second part of the analysis.
Analysis at Group Level
Expertise Estimation
• Features were feed to a Classification Tree algorithm
• Several variables had a high discrimination power between
expert and non-experts
• Best discrimination result in 80% expert prediction and 90%
non-expert prediction
Analysis at Group Level
Expertise Estimation
1)
he
le
M
s-
in
ed
0).
es
or
x-
es
he
le
n-
as
0
AN P L P Lowest value
ASD M D Highest value
AST L F W Lowest value
ASP M P Highest value
T able 4: C l assifi cat ion t r ee split s w it h nor m alized
and non-nor m al ized feat ur es
Variable Value for Expert s Discriminat ion Power
F W > 0.5 6.53
L P > 34.74 6.53
P CU > 38.05 4.44
M N > 0.13 4.03
P N M > 6.25 3.19
classificat ion is maint ained and plat eau at t he final value
around t he 12t h problem.
5. DISCUSSION
Expert Estimation over Problems
Plateau reached after
just 4 problems
Main conclusion: Simple
features could identify expertise
Faster Writer (Digital Pen)
Percentage of Calculator Use (Video)
Times Numbers were Mentioned (Audio)
Multimodal Learning Analytics
Oral Presentation Quality Corpus
Video Features
• 66 facial features were
extracted using Luxand
software including both eyes
and nose tip to estimate the
presenter’s gaze.
Kinect features
• Identify Common postures
Kinect features
• Identify Common postures
Kinect Features
Laban’s theory helps to describe human movement using non-verbal
characteristics:
Spatial aspects of movement
Temporal aspects of movement
Fluency, smoothness, impulsivity
Energy and power
Overall activity
EVALUATION METHODOLOGY
Extracted
Features
Human coded
Criterion
Video
Kinect
Body and Posture
Language
Eye Contact
Results: less than 50%
accuracy
What we were measuring was not was
humans were measuring
What is next in MLA?
Mode integration framework
for MLA
Currently pioneered by Marcelo Worsley
Developing
Multimodal Measuring Devices
Our Fitbits
Multimodal Learning Analytics
Multimodal Learning Analytics
Multimodal Learning Analytics
Record different learning
settings
And share them with the community
System to
Support and Monitor
Collaborative Design
Automatic Feedback for
Oral Presentations
Conclusions
Multimodal Learning Analytics is
not a subset of Learning
Analytics
Current Learning Analytics is a subset of MLA

Some problems are easy,
some hard
But we do not know until we try to solve them
There is a lot of
exploring to do
And we need explorers
Gracias / Thank you
Questions?
Xavier Ochoa
xavier@cti.espol.edu.ec
http://ariadne.cti.espol.edu.ec/xavier
Twitter: @xaoch
Interested?

Mais conteúdo relacionado

Mais procurados

A Machine Learning Primer,
A Machine Learning Primer,A Machine Learning Primer,
A Machine Learning Primer,Eirini Ntoutsi
 
BIG2016- Lessons Learned from building real-life user-focused Big Data systems
BIG2016- Lessons Learned from building real-life user-focused Big Data systemsBIG2016- Lessons Learned from building real-life user-focused Big Data systems
BIG2016- Lessons Learned from building real-life user-focused Big Data systemsXavier Amatriain
 
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...Xavier Amatriain
 
A Friendly Introduction to Machine Learning
A Friendly Introduction to Machine LearningA Friendly Introduction to Machine Learning
A Friendly Introduction to Machine LearningHaptik
 
Machine learning Presentation
Machine learning PresentationMachine learning Presentation
Machine learning PresentationManish Singh
 
Michael Gage SOED 2016
Michael Gage SOED 2016Michael Gage SOED 2016
Michael Gage SOED 2016Colleen Ganley
 
Introduction to Deep Learning | CloudxLab
Introduction to Deep Learning | CloudxLabIntroduction to Deep Learning | CloudxLab
Introduction to Deep Learning | CloudxLabCloudxLab
 
Machine Learning for Q&A Sites: The Quora Example
Machine Learning for Q&A Sites: The Quora ExampleMachine Learning for Q&A Sites: The Quora Example
Machine Learning for Q&A Sites: The Quora ExampleXavier Amatriain
 
Barga Data Science lecture 4
Barga Data Science lecture 4Barga Data Science lecture 4
Barga Data Science lecture 4Roger Barga
 
Cikm 2013 - Beyond Data From User Information to Business Value
Cikm 2013 - Beyond Data From User Information to Business ValueCikm 2013 - Beyond Data From User Information to Business Value
Cikm 2013 - Beyond Data From User Information to Business ValueXavier Amatriain
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine LearningEng Teong Cheah
 
Helping Students to Learn Matehmatics Beyond LMS
Helping Students to Learn Matehmatics Beyond LMSHelping Students to Learn Matehmatics Beyond LMS
Helping Students to Learn Matehmatics Beyond LMSMartin Homik
 
Barga Data Science lecture 9
Barga Data Science lecture 9Barga Data Science lecture 9
Barga Data Science lecture 9Roger Barga
 
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)Manjunath Sindagi
 
Model Evaluation in the land of Deep Learning
Model Evaluation in the land of Deep LearningModel Evaluation in the land of Deep Learning
Model Evaluation in the land of Deep LearningPramit Choudhary
 

Mais procurados (20)

Machine Learning
Machine LearningMachine Learning
Machine Learning
 
A Machine Learning Primer,
A Machine Learning Primer,A Machine Learning Primer,
A Machine Learning Primer,
 
BIG2016- Lessons Learned from building real-life user-focused Big Data systems
BIG2016- Lessons Learned from building real-life user-focused Big Data systemsBIG2016- Lessons Learned from building real-life user-focused Big Data systems
BIG2016- Lessons Learned from building real-life user-focused Big Data systems
 
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
Recsys 2016 tutorial: Lessons learned from building real-life recommender sys...
 
A Friendly Introduction to Machine Learning
A Friendly Introduction to Machine LearningA Friendly Introduction to Machine Learning
A Friendly Introduction to Machine Learning
 
Machine Learning
Machine LearningMachine Learning
Machine Learning
 
Machine learning Presentation
Machine learning PresentationMachine learning Presentation
Machine learning Presentation
 
Michael Gage SOED 2016
Michael Gage SOED 2016Michael Gage SOED 2016
Michael Gage SOED 2016
 
Introduction to Deep Learning | CloudxLab
Introduction to Deep Learning | CloudxLabIntroduction to Deep Learning | CloudxLab
Introduction to Deep Learning | CloudxLab
 
Active learning
Active learningActive learning
Active learning
 
Machine Learning for Q&A Sites: The Quora Example
Machine Learning for Q&A Sites: The Quora ExampleMachine Learning for Q&A Sites: The Quora Example
Machine Learning for Q&A Sites: The Quora Example
 
Barga Data Science lecture 4
Barga Data Science lecture 4Barga Data Science lecture 4
Barga Data Science lecture 4
 
Cikm 2013 - Beyond Data From User Information to Business Value
Cikm 2013 - Beyond Data From User Information to Business ValueCikm 2013 - Beyond Data From User Information to Business Value
Cikm 2013 - Beyond Data From User Information to Business Value
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
 
Helping Students to Learn Matehmatics Beyond LMS
Helping Students to Learn Matehmatics Beyond LMSHelping Students to Learn Matehmatics Beyond LMS
Helping Students to Learn Matehmatics Beyond LMS
 
Barga Data Science lecture 9
Barga Data Science lecture 9Barga Data Science lecture 9
Barga Data Science lecture 9
 
Machine Learning Algorithms (Part 1)
Machine Learning Algorithms (Part 1)Machine Learning Algorithms (Part 1)
Machine Learning Algorithms (Part 1)
 
Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)Introduction to machine learning and applications (1)
Introduction to machine learning and applications (1)
 
Machine learning
Machine learning Machine learning
Machine learning
 
Model Evaluation in the land of Deep Learning
Model Evaluation in the land of Deep LearningModel Evaluation in the land of Deep Learning
Model Evaluation in the land of Deep Learning
 

Destaque

Education as the meta-problem: Opportunities for Technology R&D
Education as the meta-problem: Opportunities for Technology R&DEducation as the meta-problem: Opportunities for Technology R&D
Education as the meta-problem: Opportunities for Technology R&DXavier Ochoa
 
Openness as a Tool
Openness as a ToolOpenness as a Tool
Openness as a ToolXavier Ochoa
 
Expert estimation from Multimodal Features
Expert estimation from Multimodal FeaturesExpert estimation from Multimodal Features
Expert estimation from Multimodal FeaturesXavier Ochoa
 
Latin American Open Textbook Initiative (LATIn Project)
Latin American Open Textbook Initiative (LATIn Project)Latin American Open Textbook Initiative (LATIn Project)
Latin American Open Textbook Initiative (LATIn Project)Xavier Ochoa
 
Analitica del Aprendizaje
Analitica del AprendizajeAnalitica del Aprendizaje
Analitica del AprendizajeXavier Ochoa
 
Open Data Repositories
Open Data RepositoriesOpen Data Repositories
Open Data RepositoriesXavier Ochoa
 
Multimodal Learning Analytics
Multimodal Learning AnalyticsMultimodal Learning Analytics
Multimodal Learning AnalyticsXavier Ochoa
 
Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...
Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...
Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...Xavier Ochoa
 
Analisis de Algoritmos Multihilo
Analisis de Algoritmos MultihiloAnalisis de Algoritmos Multihilo
Analisis de Algoritmos MultihiloXavier Ochoa
 

Destaque (10)

Education as the meta-problem: Opportunities for Technology R&D
Education as the meta-problem: Opportunities for Technology R&DEducation as the meta-problem: Opportunities for Technology R&D
Education as the meta-problem: Opportunities for Technology R&D
 
Globe seminar
Globe seminarGlobe seminar
Globe seminar
 
Openness as a Tool
Openness as a ToolOpenness as a Tool
Openness as a Tool
 
Expert estimation from Multimodal Features
Expert estimation from Multimodal FeaturesExpert estimation from Multimodal Features
Expert estimation from Multimodal Features
 
Latin American Open Textbook Initiative (LATIn Project)
Latin American Open Textbook Initiative (LATIn Project)Latin American Open Textbook Initiative (LATIn Project)
Latin American Open Textbook Initiative (LATIn Project)
 
Analitica del Aprendizaje
Analitica del AprendizajeAnalitica del Aprendizaje
Analitica del Aprendizaje
 
Open Data Repositories
Open Data RepositoriesOpen Data Repositories
Open Data Repositories
 
Multimodal Learning Analytics
Multimodal Learning AnalyticsMultimodal Learning Analytics
Multimodal Learning Analytics
 
Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...
Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...
Medir para Entender y Mejorar: la Analítica del Aprendizaje como nuevo paradi...
 
Analisis de Algoritmos Multihilo
Analisis de Algoritmos MultihiloAnalisis de Algoritmos Multihilo
Analisis de Algoritmos Multihilo
 

Semelhante a Multimodal Learning Analytics

Understand students’ self-reflections through learning analytics
Understand students’ self-reflections through learning analyticsUnderstand students’ self-reflections through learning analytics
Understand students’ self-reflections through learning analyticsVitomir Kovanovic
 
Deep Learning, an interactive introduction for NLP-ers
Deep Learning, an interactive introduction for NLP-ersDeep Learning, an interactive introduction for NLP-ers
Deep Learning, an interactive introduction for NLP-ersRoelof Pieters
 
Deep Learning Introduction - WeCloudData
Deep Learning Introduction - WeCloudDataDeep Learning Introduction - WeCloudData
Deep Learning Introduction - WeCloudDataWeCloudData
 
EssentialsOfMachineLearning.pdf
EssentialsOfMachineLearning.pdfEssentialsOfMachineLearning.pdf
EssentialsOfMachineLearning.pdfAnkita Tiwari
 
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learningAmr Rashed
 
An analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classificationAn analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classificationSubhashis Hazarika
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverviewMotaz El-Saban
 
2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf
2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf
2023-08-22 CoLLAs Tutorial - Beyond CIL.pdfVincenzo Lomonaco
 
Deep Learning for NLP: An Introduction to Neural Word Embeddings
Deep Learning for NLP: An Introduction to Neural Word EmbeddingsDeep Learning for NLP: An Introduction to Neural Word Embeddings
Deep Learning for NLP: An Introduction to Neural Word EmbeddingsRoelof Pieters
 
Deep Learning: a birds eye view
Deep Learning: a birds eye viewDeep Learning: a birds eye view
Deep Learning: a birds eye viewRoelof Pieters
 
INTRO TO ML.pptx
INTRO TO ML.pptxINTRO TO ML.pptx
INTRO TO ML.pptxGDSCACEM
 
Deep learning: the future of recommendations
Deep learning: the future of recommendationsDeep learning: the future of recommendations
Deep learning: the future of recommendationsBalázs Hidasi
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine LearningAI Summary
 

Semelhante a Multimodal Learning Analytics (20)

Understand students’ self-reflections through learning analytics
Understand students’ self-reflections through learning analyticsUnderstand students’ self-reflections through learning analytics
Understand students’ self-reflections through learning analytics
 
Deep Learning, an interactive introduction for NLP-ers
Deep Learning, an interactive introduction for NLP-ersDeep Learning, an interactive introduction for NLP-ers
Deep Learning, an interactive introduction for NLP-ers
 
Deep Learning Introduction - WeCloudData
Deep Learning Introduction - WeCloudDataDeep Learning Introduction - WeCloudData
Deep Learning Introduction - WeCloudData
 
Presentation MaSE 18-102012
Presentation MaSE 18-102012Presentation MaSE 18-102012
Presentation MaSE 18-102012
 
Chounta@paws
Chounta@pawsChounta@paws
Chounta@paws
 
EssentialsOfMachineLearning.pdf
EssentialsOfMachineLearning.pdfEssentialsOfMachineLearning.pdf
EssentialsOfMachineLearning.pdf
 
Deep learning - a primer
Deep learning - a primerDeep learning - a primer
Deep learning - a primer
 
Deep learning - a primer
Deep learning - a primerDeep learning - a primer
Deep learning - a primer
 
Introduction to deep learning
Introduction to deep learningIntroduction to deep learning
Introduction to deep learning
 
An analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classificationAn analysis of_machine_and_human_analytics_in_classification
An analysis of_machine_and_human_analytics_in_classification
 
TechnicalBackgroundOverview
TechnicalBackgroundOverviewTechnicalBackgroundOverview
TechnicalBackgroundOverview
 
Dip
DipDip
Dip
 
2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf
2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf
2023-08-22 CoLLAs Tutorial - Beyond CIL.pdf
 
Deep Learning for NLP: An Introduction to Neural Word Embeddings
Deep Learning for NLP: An Introduction to Neural Word EmbeddingsDeep Learning for NLP: An Introduction to Neural Word Embeddings
Deep Learning for NLP: An Introduction to Neural Word Embeddings
 
Deep Learning: a birds eye view
Deep Learning: a birds eye viewDeep Learning: a birds eye view
Deep Learning: a birds eye view
 
INTRO TO ML.pptx
INTRO TO ML.pptxINTRO TO ML.pptx
INTRO TO ML.pptx
 
Hci and psychology
Hci and psychologyHci and psychology
Hci and psychology
 
Deep learning: the future of recommendations
Deep learning: the future of recommendationsDeep learning: the future of recommendations
Deep learning: the future of recommendations
 
AI and Deep Learning
AI and Deep Learning AI and Deep Learning
AI and Deep Learning
 
Introduction to Machine Learning
Introduction to Machine LearningIntroduction to Machine Learning
Introduction to Machine Learning
 

Mais de Xavier Ochoa

Multimodal Learning Analytics
Multimodal Learning AnalyticsMultimodal Learning Analytics
Multimodal Learning AnalyticsXavier Ochoa
 
Supporting the Acquisition of 21st Century Skills through Multimodal Learning...
Supporting the Acquisition of 21st Century Skills through Multimodal Learning...Supporting the Acquisition of 21st Century Skills through Multimodal Learning...
Supporting the Acquisition of 21st Century Skills through Multimodal Learning...Xavier Ochoa
 
Educational Technologies
Educational TechnologiesEducational Technologies
Educational TechnologiesXavier Ochoa
 
Developing 21st-Century Skills with  Multimodal Learning Analytics
Developing 21st-Century Skills with Multimodal Learning AnalyticsDeveloping 21st-Century Skills with Multimodal Learning Analytics
Developing 21st-Century Skills with  Multimodal Learning AnalyticsXavier Ochoa
 
Educational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial IntelligenceEducational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial IntelligenceXavier Ochoa
 
Analiticas de Aprendizaje: Nuevo paradigma en la investigación educativa
Analiticas de Aprendizaje: Nuevo paradigma en la investigación educativaAnaliticas de Aprendizaje: Nuevo paradigma en la investigación educativa
Analiticas de Aprendizaje: Nuevo paradigma en la investigación educativaXavier Ochoa
 
Analítica del Aprendizaje como Nuevo Paradigma de la Investigación Educativa
Analítica del Aprendizaje como Nuevo Paradigma de la Investigación EducativaAnalítica del Aprendizaje como Nuevo Paradigma de la Investigación Educativa
Analítica del Aprendizaje como Nuevo Paradigma de la Investigación EducativaXavier Ochoa
 
Automatic Feedback for Oral Presentations
Automatic Feedback for Oral PresentationsAutomatic Feedback for Oral Presentations
Automatic Feedback for Oral PresentationsXavier Ochoa
 
LAK-18 Program in Numbers
LAK-18 Program in NumbersLAK-18 Program in Numbers
LAK-18 Program in NumbersXavier Ochoa
 
Introduccion Algoritmos Multihilo
Introduccion Algoritmos MultihiloIntroduccion Algoritmos Multihilo
Introduccion Algoritmos MultihiloXavier Ochoa
 
Analitica aprendizaje
Analitica aprendizajeAnalitica aprendizaje
Analitica aprendizajeXavier Ochoa
 
Visualizing Uncertainty in the Prediction of Academic Risk
Visualizing Uncertainty in the Prediction of Academic RiskVisualizing Uncertainty in the Prediction of Academic Risk
Visualizing Uncertainty in the Prediction of Academic RiskXavier Ochoa
 
Openness as a Tool
Openness as a ToolOpenness as a Tool
Openness as a ToolXavier Ochoa
 
Techniques for Data-Driven Curriculum Analysis
Techniques for Data-Driven Curriculum AnalysisTechniques for Data-Driven Curriculum Analysis
Techniques for Data-Driven Curriculum AnalysisXavier Ochoa
 
Medidas de Repositorios y Tendencias Actuales
Medidas de Repositorios y Tendencias ActualesMedidas de Repositorios y Tendencias Actuales
Medidas de Repositorios y Tendencias ActualesXavier Ochoa
 
Normas para la Creación de Recursos Educativos Abiertos
Normas para la Creación de Recursos Educativos AbiertosNormas para la Creación de Recursos Educativos Abiertos
Normas para la Creación de Recursos Educativos AbiertosXavier Ochoa
 

Mais de Xavier Ochoa (17)

Multimodal Learning Analytics
Multimodal Learning AnalyticsMultimodal Learning Analytics
Multimodal Learning Analytics
 
Supporting the Acquisition of 21st Century Skills through Multimodal Learning...
Supporting the Acquisition of 21st Century Skills through Multimodal Learning...Supporting the Acquisition of 21st Century Skills through Multimodal Learning...
Supporting the Acquisition of 21st Century Skills through Multimodal Learning...
 
Educational Technologies
Educational TechnologiesEducational Technologies
Educational Technologies
 
Developing 21st-Century Skills with  Multimodal Learning Analytics
Developing 21st-Century Skills with Multimodal Learning AnalyticsDeveloping 21st-Century Skills with Multimodal Learning Analytics
Developing 21st-Century Skills with  Multimodal Learning Analytics
 
Educational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial IntelligenceEducational Technologies: Learning Analytics and Artificial Intelligence
Educational Technologies: Learning Analytics and Artificial Intelligence
 
Analiticas de Aprendizaje: Nuevo paradigma en la investigación educativa
Analiticas de Aprendizaje: Nuevo paradigma en la investigación educativaAnaliticas de Aprendizaje: Nuevo paradigma en la investigación educativa
Analiticas de Aprendizaje: Nuevo paradigma en la investigación educativa
 
Analítica del Aprendizaje como Nuevo Paradigma de la Investigación Educativa
Analítica del Aprendizaje como Nuevo Paradigma de la Investigación EducativaAnalítica del Aprendizaje como Nuevo Paradigma de la Investigación Educativa
Analítica del Aprendizaje como Nuevo Paradigma de la Investigación Educativa
 
Automatic Feedback for Oral Presentations
Automatic Feedback for Oral PresentationsAutomatic Feedback for Oral Presentations
Automatic Feedback for Oral Presentations
 
LAK-18 Program in Numbers
LAK-18 Program in NumbersLAK-18 Program in Numbers
LAK-18 Program in Numbers
 
Introduccion Algoritmos Multihilo
Introduccion Algoritmos MultihiloIntroduccion Algoritmos Multihilo
Introduccion Algoritmos Multihilo
 
Analitica aprendizaje
Analitica aprendizajeAnalitica aprendizaje
Analitica aprendizaje
 
Visualizing Uncertainty in the Prediction of Academic Risk
Visualizing Uncertainty in the Prediction of Academic RiskVisualizing Uncertainty in the Prediction of Academic Risk
Visualizing Uncertainty in the Prediction of Academic Risk
 
Openness as a Tool
Openness as a ToolOpenness as a Tool
Openness as a Tool
 
Techniques for Data-Driven Curriculum Analysis
Techniques for Data-Driven Curriculum AnalysisTechniques for Data-Driven Curriculum Analysis
Techniques for Data-Driven Curriculum Analysis
 
Pilot analysis
Pilot analysisPilot analysis
Pilot analysis
 
Medidas de Repositorios y Tendencias Actuales
Medidas de Repositorios y Tendencias ActualesMedidas de Repositorios y Tendencias Actuales
Medidas de Repositorios y Tendencias Actuales
 
Normas para la Creación de Recursos Educativos Abiertos
Normas para la Creación de Recursos Educativos AbiertosNormas para la Creación de Recursos Educativos Abiertos
Normas para la Creación de Recursos Educativos Abiertos
 

Último

Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Commit University
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdfPaige Cruz
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1DianaGray10
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostMatt Ray
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemAsko Soukka
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5DianaGray10
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Websitedgelyza
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXTarek Kalaji
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaborationbruanjhuli
 
The Kubernetes Gateway API and its role in Cloud Native API Management
The Kubernetes Gateway API and its role in Cloud Native API ManagementThe Kubernetes Gateway API and its role in Cloud Native API Management
The Kubernetes Gateway API and its role in Cloud Native API ManagementNuwan Dias
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDELiveplex
 
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"DianaGray10
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 

Último (20)

Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)Crea il tuo assistente AI con lo Stregatto (open source python framework)
Crea il tuo assistente AI con lo Stregatto (open source python framework)
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf99.99% of Your Traces  Are (Probably) Trash (SRECon NA 2024).pdf
99.99% of Your Traces Are (Probably) Trash (SRECon NA 2024).pdf
 
Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1Secure your environment with UiPath and CyberArk technologies - Session 1
Secure your environment with UiPath and CyberArk technologies - Session 1
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCostKubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
KubeConEU24-Monitoring Kubernetes and Cloud Spend with OpenCost
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
Bird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystemBird eye's view on Camunda open source ecosystem
Bird eye's view on Camunda open source ecosystem
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5UiPath Studio Web workshop series - Day 5
UiPath Studio Web workshop series - Day 5
 
201610817 - edge part1
201610817 - edge part1201610817 - edge part1
201610817 - edge part1
 
COMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a WebsiteCOMPUTER 10 Lesson 8 - Building a Website
COMPUTER 10 Lesson 8 - Building a Website
 
VoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBXVoIP Service and Marketing using Odoo and Asterisk PBX
VoIP Service and Marketing using Odoo and Asterisk PBX
 
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online CollaborationCOMPUTER 10: Lesson 7 - File Storage and Online Collaboration
COMPUTER 10: Lesson 7 - File Storage and Online Collaboration
 
The Kubernetes Gateway API and its role in Cloud Native API Management
The Kubernetes Gateway API and its role in Cloud Native API ManagementThe Kubernetes Gateway API and its role in Cloud Native API Management
The Kubernetes Gateway API and its role in Cloud Native API Management
 
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDEADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
ADOPTING WEB 3 FOR YOUR BUSINESS: A STEP-BY-STEP GUIDE
 
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
UiPath Clipboard AI: "A TIME Magazine Best Invention of 2023 Unveiled"
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 

Multimodal Learning Analytics

  • 1. Multimodal Learning Analytics Xavier Ochoa Escuela Superior Politécnica del Litoral
  • 4. Learning analytics is the measurement, collection, analysis and reporting of data about learners and their contexts, for purposes of understanding and optimising learning and the environments in which it occurs.
  • 5. Examining engagement: analysing learner subpopulations in massive open online courses (MOOCs) Using transaction-level data to diagnose knowledge gaps and misconceptions Likelihood analysis of student enrollment outcomes using learning environment variables: a case study approach Tracking student progress in a game- like learning environment with a Monte Carlo Bayesian knowledge tracing model
  • 6. Strong focus on online data Based on the papers it should be called Online-Learning Analytics
  • 15. Why Multimodal Learning Analytics? We should be looking where it is useful to look, not where it is easy
  • 16. There is learning outside the LMS But it is very messy!
  • 20. Who is learning? – Traditional way
  • 21. But there are better ways to assess learning At least theoretically
  • 22. Who is learning? – Educational Research
  • 24. How can we approach the problem from a Learning Analytics perspective Measure, collect, analyze and report to understand and optimize
  • 25. We need to capture learning traces from the real world Look ma, no log files!
  • 26. In the real world, humans communicate (and leave traces) in several modalities What you say is as important as how you say it
  • 27. We need to analyze the traces with variable degrees of sophistication And we have to do it automatically as humans are not scalable
  • 28. We need to provide feedback in the real world Often in a multimodal way too
  • 30. Which modes are important to understand the learning process? We do not know yet…
  • 31. Possibilities • What we see • What we hear • How we move • How we write • How we blink • Our pulse • Brain activity? • Our hormones?
  • 32. What are the relevant features of those signals We do not know yet…
  • 33. Our current analysis tools are good enough? We do not know yet…
  • 34. How to present the information (and uncertainty) in a way that is actually useful? We do not know yet…
  • 35. It is an open (but very dark) field One feels like an explorer
  • 36. This particular flavor of Learning Analytics is what we called Multimodal Learning Analytics
  • 37. Multimodal Learning Analytics is related to: • Behaviorism • Cognitive Science • Multimodal Interaction (HCI) • Educational Research (old school one) • Computer Vision • Natural Language Processing • Biosignals Processing • And as many fields as modes you can think of...
  • 41. How to (easily) obtain multimodal features? What is already there?
  • 42. Three Approaches • Literature-based features • Common-sense-based features • “Why not?”-based features
  • 43. All approaches proved useful Proof that we are in an early stage
  • 44. Video: Calculator Use (NTCU) et s of s was t , on t hat eived so in- n and lving ed by udent e was score given diffi- ssion, n ex- Mat h at t et direct ion in which it was point ing at using t he rigid t rans- format ions capabilit ies provided by OpenCV . W hile t here were some frames in which t his mat ching was not possible due t o object occlusions or changes in t he illuminat ion of t he calculat or, in general t he described det ect ion t echnique was robust and provided useful posit ion and direct ion dat a. F igur e 1: D et er m in at ion of w hich st udent is usin g
  • 45. Video: Calculator Use (NTCU) • Idea: • Calculator user is the one solving the problem • Procedure: • Obtain a picture of the calculator • Track the position and angle of the image in the video using SURF + FLANN + Rigid Object Transformation (OpenCV) • Determine to which student the calculator is pointing in each frame
  • 46. Video: Total Movement (TM) fined as t he number of whit e pixels cont ained in t he binary image out put by t he Codebook algorit hm. T his magnit ude, when comput ed for t he ent ire problem solving session, re- sult s from summing up it s individual values obt ained from each frame t hat compose a problem recording. (a) Original frame (b) Difference frame F igur e 2: R esult s of t he C odeb ook algor it hm .
  • 47. Video: Total Movement (TM) • Idea: • Most active student is the leader/expert? • Procedure: • Subtract current frame from previous frame • Codebook algorithm to eliminate noise-movement • Add the number of remaining pixels
  • 48. Video: Distance from center table (DHT) he de- oblem ed t o calcu- par- a spe- ed as e pre- Code- ficant small ondi- where ained s de- inary t ude, n, re- from each head cent roid t o t he cent er of t he t able is calculat ed and t hen, t he average of t hese dist ances is obt ained by prob- lem (see Figure 3). A ddit ionally, t he variance of t he average dist ance head t o t able (SD-DHT ), was calculat ed t o det er- mine if a part icipant remains most ly st at ic or varies his or her dist ance t o t he t able. F igur e 3: C alculat ion of t he dist ance of t he st udent ’s
  • 49. Video: Distance from center table (DHT) • Idea: • If the head is near the table (over paper) the student is working on the problem • Procedure: • Identify image of heads • Use TLD algorithm to track heads • Determine the distance from head to center of table
  • 51. Audio: Features • Number of Interventions (NOI) • Total Speech Duration (TSD) • Times Numbers were Mentioned (TNM) • Times Math Terms were Mentioned (TMTM) • Times Commands were Pronounced (TCP)
  • 52. Digital Pen: Basic Features
  • 53. Digital Pen: Basic Features • Total Number of Strokes (TNS) • Average Number of Points (ANP) • Average Stroke Path Length (ASPL) • Average Stroke Displacement (ASD) • Average Stroke Pressure (ASP)
  • 54. Digital Pen: Shape Recognition Stronium – Sketch Recognition Libraries
  • 55. Digital Pen: Shape Recognition • Number of Lines (NOL) • Number of Rectangles (NOR) • Number of Circles (NOC) • Number of Ellipses (NOE) • Number of Arrows (NOA) • Number of Figures (NOF)
  • 56. Analysis at Problem level Solving Problem Correctly • Logistic Regression to model Student Solving Problem Correctly • Resulting model was significantly reliable • 60,9% of the problem solving student was identified • 71,8% of incorrectly solved problems were identified
  • 57. Analysis at problem level effi cient s of t he L ogist ic M odel Predict ing Odds for a St udent Solving Correct ly Predictor Variable B W ald df p value exp(B ) Number of Interventions (N OI ) 0.068 24.019 1 0.001 0.934 Times numbers were mentioned (TN M ) 0.175 23.816 1 0.001 1.192 Times commands were pronounced (TCP) 0.329 4.956 1 0.026 1.390 Proportion of Calculator Usage (PCU) 1.287 25.622 1 0.001 3.622 Fastest Student in the Group (F W ) 0.924 18.889 1 0.001 2.519 Constant 1.654 53.462 1 0.001 0.191 mber of Point s (AN P): Represents, in mber of points that compose each stroke sub-sets. Classification Trees, provided by in the R statistical software [21] for Mac, w second part of the analysis.
  • 58. Analysis at Group Level Expertise Estimation • Features were feed to a Classification Tree algorithm • Several variables had a high discrimination power between expert and non-experts • Best discrimination result in 80% expert prediction and 90% non-expert prediction
  • 59. Analysis at Group Level Expertise Estimation 1) he le M s- in ed 0). es or x- es he le n- as 0 AN P L P Lowest value ASD M D Highest value AST L F W Lowest value ASP M P Highest value T able 4: C l assifi cat ion t r ee split s w it h nor m alized and non-nor m al ized feat ur es Variable Value for Expert s Discriminat ion Power F W > 0.5 6.53 L P > 34.74 6.53 P CU > 38.05 4.44 M N > 0.13 4.03 P N M > 6.25 3.19 classificat ion is maint ained and plat eau at t he final value around t he 12t h problem. 5. DISCUSSION
  • 60. Expert Estimation over Problems Plateau reached after just 4 problems
  • 61. Main conclusion: Simple features could identify expertise Faster Writer (Digital Pen) Percentage of Calculator Use (Video) Times Numbers were Mentioned (Audio)
  • 64. Video Features • 66 facial features were extracted using Luxand software including both eyes and nose tip to estimate the presenter’s gaze.
  • 65. Kinect features • Identify Common postures
  • 66. Kinect features • Identify Common postures
  • 67. Kinect Features Laban’s theory helps to describe human movement using non-verbal characteristics: Spatial aspects of movement Temporal aspects of movement Fluency, smoothness, impulsivity Energy and power Overall activity
  • 69. Results: less than 50% accuracy What we were measuring was not was humans were measuring
  • 70. What is next in MLA?
  • 71. Mode integration framework for MLA Currently pioneered by Marcelo Worsley
  • 76. Record different learning settings And share them with the community
  • 77. System to Support and Monitor Collaborative Design
  • 80. Multimodal Learning Analytics is not a subset of Learning Analytics Current Learning Analytics is a subset of MLA 
  • 81. Some problems are easy, some hard But we do not know until we try to solve them
  • 82. There is a lot of exploring to do And we need explorers
  • 83. Gracias / Thank you Questions? Xavier Ochoa xavier@cti.espol.edu.ec http://ariadne.cti.espol.edu.ec/xavier Twitter: @xaoch Interested?