SlideShare uma empresa Scribd logo
1 de 21
Developing a  Multimodal Transcription  to account for Interaction in 3D Virtual Worlds:  the  3M method Joan Tomàs Pujolà Cristina Palomeque
3M transcription M ULTI-  M ODAL M UVE 3
index ,[object Object],[object Object],[object Object],[object Object],[object Object]
3D muves Social dimension Interaction: environment, objects, avatars Immersive experience Multimodal communication
senses ,[object Object],presence immersiveness creativity gaming
interact ,[object Object],interaction (n) –  interactional (adj)
channels ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],multitasking
video example   ,[object Object],[object Object],[object Object],[object Object],[object Object]
aim ,[object Object]
multimodal transcriptions ,[object Object],[object Object],[object Object],[object Object]
multimodal transcriptions ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]
 
 
 
[object Object],[object Object],[object Object],[object Object],transcription levels
macro level
multimodal transcription
3M transcription
tagging system TYPES Body posture <bp> Sitting <bps> Laying <bpl> Kneeling <kpl> Standing (default, not tagged)  Kinesics <k> ,[object Object],[object Object],[object Object],[object Object],[object Object],Proxemics <p> Facing <pf> Backing <pb>  Haptics <h> Touching <ht> Pointing <hp>  Chronemics <c> Wating <cw> Short / medium / long pause waiting <cspw>, <cmpw>, <clpw>  Thinking <ct> Short / medium / long pause thinking  <cspt>, <cmpt>, <clpt>
future directions Transcription on the  web - trying to visualize the multiplicity of channels  Video streaming - trying to visualize the spatial dimension
3M M UVE of a m ultimodality  to describe the m ultimodal transcription We are pursuing a

Mais conteúdo relacionado

Mais procurados

The nature of learner language
The nature of learner languageThe nature of learner language
The nature of learner languageNandu Prakoso
 
Social aspects of interlanguage
Social aspects of interlanguageSocial aspects of interlanguage
Social aspects of interlanguageLina Andriani
 
Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system. Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system. Ana Stefanelli
 
Models of tla
Models of tlaModels of tla
Models of tlaCameliaN
 
L2 acquisition
L2 acquisitionL2 acquisition
L2 acquisitionCameliaN
 

Mais procurados (8)

Interlanguage in SLA
Interlanguage in SLAInterlanguage in SLA
Interlanguage in SLA
 
Tenses
TensesTenses
Tenses
 
The nature of learner language
The nature of learner languageThe nature of learner language
The nature of learner language
 
Linguistic factors presentation
Linguistic factors presentationLinguistic factors presentation
Linguistic factors presentation
 
Social aspects of interlanguage
Social aspects of interlanguageSocial aspects of interlanguage
Social aspects of interlanguage
 
Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system. Fossilization of the Interlanguage system.
Fossilization of the Interlanguage system.
 
Models of tla
Models of tlaModels of tla
Models of tla
 
L2 acquisition
L2 acquisitionL2 acquisition
L2 acquisition
 

Destaque

Europa, quale futuro?
Europa, quale futuro? Europa, quale futuro?
Europa, quale futuro? Federico Gobbo
 
What can we know of computational inforgs?
What can we know of computational inforgs?What can we know of computational inforgs?
What can we know of computational inforgs?Federico Gobbo
 
Achieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worldsAchieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worldsCristina Palomeque
 
From simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learningFrom simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learningCristina Palomeque
 
Communication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactionsCommunication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactionsCristina Palomeque
 
Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...Federico Gobbo
 
FinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech FenyegetettségFinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech Fenyegetettséglemakg
 

Destaque (8)

Europa, quale futuro?
Europa, quale futuro? Europa, quale futuro?
Europa, quale futuro?
 
What can we know of computational inforgs?
What can we know of computational inforgs?What can we know of computational inforgs?
What can we know of computational inforgs?
 
Achieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worldsAchieveing the Ying-Yang in language teaching and learning in virtual worlds
Achieveing the Ying-Yang in language teaching and learning in virtual worlds
 
From simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learningFrom simulations to (3D) virtuality: Mirorring tasks from language learning
From simulations to (3D) virtuality: Mirorring tasks from language learning
 
Communication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactionsCommunication Strategies in synchronous CMC and face-to-face interactions
Communication Strategies in synchronous CMC and face-to-face interactions
 
Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...Measuring Computational Complexity the qualitative and quantitative intertwin...
Measuring Computational Complexity the qualitative and quantitative intertwin...
 
FinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech FenyegetettségFinTechGroup: FinTech Fenyegetettség
FinTechGroup: FinTech Fenyegetettség
 
Time andspacecomplexity
Time andspacecomplexityTime andspacecomplexity
Time andspacecomplexity
 

Semelhante a Developing a Multimodal Transcription to account for Interaction in 3D Virtual Worlds: the 3M method

Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409lamericaana
 
Ijaia040203
Ijaia040203Ijaia040203
Ijaia040203ijaia
 
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for Jens Grubert
 
UXD Multimedia output
UXD Multimedia outputUXD Multimedia output
UXD Multimedia outputrolfHRO
 
A Transliteracy Conversation
A Transliteracy ConversationA Transliteracy Conversation
A Transliteracy ConversationBruce Mason
 
HCI 3e - Ch 10: Universal design
HCI 3e - Ch 10:  Universal designHCI 3e - Ch 10:  Universal design
HCI 3e - Ch 10: Universal designAlan Dix
 
Cognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithmsCognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithmsAndré Karpištšenko
 
The Uses of Transliteracy
The Uses of TransliteracyThe Uses of Transliteracy
The Uses of TransliteracyDr Sue Thomas
 

Semelhante a Developing a Multimodal Transcription to account for Interaction in 3D Virtual Worlds: the 3M method (11)

Hands and Speech in Space
Hands and Speech in SpaceHands and Speech in Space
Hands and Speech in Space
 
Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409Cmc Sig Leon Workshop Mh Rh 200409
Cmc Sig Leon Workshop Mh Rh 200409
 
Ijaia040203
Ijaia040203Ijaia040203
Ijaia040203
 
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
ACM NordiCHI 2012: Exploring the Design of Hybrid Interfaces for
 
UXD Multimedia output
UXD Multimedia outputUXD Multimedia output
UXD Multimedia output
 
A Transliteracy Conversation
A Transliteracy ConversationA Transliteracy Conversation
A Transliteracy Conversation
 
HCI 3e - Ch 10: Universal design
HCI 3e - Ch 10:  Universal designHCI 3e - Ch 10:  Universal design
HCI 3e - Ch 10: Universal design
 
Cognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithmsCognitive plausibility in learning algorithms
Cognitive plausibility in learning algorithms
 
Txting Disasters
Txting DisastersTxting Disasters
Txting Disasters
 
universaldesign
 universaldesign universaldesign
universaldesign
 
The Uses of Transliteracy
The Uses of TransliteracyThe Uses of Transliteracy
The Uses of Transliteracy
 

Mais de Cristina Palomeque

Interaction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual WorldsInteraction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual WorldsCristina Palomeque
 
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...Cristina Palomeque
 
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...Cristina Palomeque
 
Task Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of ReferenceTask Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of ReferenceCristina Palomeque
 
The use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment processThe use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment processCristina Palomeque
 

Mais de Cristina Palomeque (6)

Interaction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual WorldsInteraction and Language Leraning in 3D Virtual Worlds
Interaction and Language Leraning in 3D Virtual Worlds
 
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
Analyzing MUVE Tasks in Action - XVIIth International CALL Research Conferenc...
 
Sedll 2010 multimodalitat
Sedll 2010 multimodalitatSedll 2010 multimodalitat
Sedll 2010 multimodalitat
 
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
La multimodalidad en los blogs de enseñanza/aprendizade de LE: Una propuesta ...
 
Task Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of ReferenceTask Design in Virtual Worlds: Towards a Frame of Reference
Task Design in Virtual Worlds: Towards a Frame of Reference
 
The use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment processThe use of ICT tools to involve students in their learning/assessment process
The use of ICT tools to involve students in their learning/assessment process
 

Último

Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfAdmir Softic
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin ClassesCeline George
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.MateoGardella
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17Celine George
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfChris Hunter
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxiammrhaywood
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxVishalSingh1417
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfagholdier
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfAyushMahapatra5
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxVishalSingh1417
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterMateoGardella
 

Último (20)

Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17  How to Extend Models Using Mixin ClassesMixin Classes in Odoo 17  How to Extend Models Using Mixin Classes
Mixin Classes in Odoo 17 How to Extend Models Using Mixin Classes
 
Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024Mehran University Newsletter Vol-X, Issue-I, 2024
Mehran University Newsletter Vol-X, Issue-I, 2024
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptxSOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
SOCIAL AND HISTORICAL CONTEXT - LFTVD.pptx
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Unit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptxUnit-IV- Pharma. Marketing Channels.pptx
Unit-IV- Pharma. Marketing Channels.pptx
 
Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 

Developing a Multimodal Transcription to account for Interaction in 3D Virtual Worlds: the 3M method

Notas do Editor

  1. Virtual worlds in learning are becoming increasingly popular and there is an extended belief that VW can be used as VLEs basically for 4 reasons. VW allow for multimodal communication: voice chat, text chat, private and public. There is a strong social dimension as users are represented by avatars. The residents of VW are usually quite friendly and willing to help newcomers. Apart from interacting with other avatars, you can interact with objects (e.g. when you open a door) or with the environment itself (you can contribute to create the environment). It is an immersive experience: the environment really makes you feel like if you really were in that place.