O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.
S C I E N C E P A S S I O N T E C H N O L O G Y
www.tugraz.at
Automatic Authentication of
Students at an Interactive
Learn...
2
Content
1. Introduction
2. LIVE: Interactive Video Platform
3. Automatic Authentication
4. Course Design
5. Evaluation
6...
3
Graz University of Technology
Educational Technology
Working Group Sustainable Construction, Institute of
Technology and...
4
Introduction
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
June 26, 2019
5
Introduction
Motivation
authentication required for attendance monitoring and
assessment
many positive effects of compul...
6
Introduction
Why Interactions?
help to ensure the accuracy of attendance monitoring
missing interactions are leading to ...
7
Introduction
Research Question
a video platform was used for some years with
manual authentication
now automatic authent...
8
LIVE: Interactive Video Platform
Interactive Video Platform
LIVE: Live Interaction in Virtual learning
Environments
http...
9
LIVE: Interactive Video Platform
Interactive Components in Videos
different methods of interaction:
automatically asked ...
10
LIVE: Interactive Video Platform
Video is Interrupted by a MC-Question
Josef Wachtler, Marco Scherz, Martin Ebner and M...
11
LIVE: Interactive Video Platform
Attendance Monitoring
registered and authenticated users
for each student who attends ...
12
LIVE: Interactive Video Platform
Timeline Analysis
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educati...
13
LIVE: Interactive Video Platform
List of All Attendees
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Edu...
14
LIVE: Interactive Video Platform
User Details
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational ...
15
LIVE: Interactive Video Platform
Calculation of an Attention-Level
calculation of an attention-level which is based on ...
16
Automatic Authentication
Automatic Authentication
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educatio...
17
Automatic Authentication
Learning Tools Interoperability (LTI)
a standard of the IMS Global Learning Consortium to
conn...
18
Automatic Authentication
LTI Authentication at a Tool through a Platform
Josef Wachtler, Marco Scherz, Martin Ebner and...
19
Automatic Authentication
Developed LTI Tools
for the Django-Web-Framework
MIT license
Django LTI Provider with Authenti...
20
Course Design
Course Design
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Gr...
21
Course Design
Setting
course: “Building Materials Basics - Laboratory
Practicals”
bachelor program: “Civil Engineering ...
22
Course Design
Flow of Events
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU G...
23
Evaluation
Evaluation
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
Jun...
24
Evaluation
Automatic Authentication
before automatic authentication
students had to register manually at LIVE
had to us...
25
Evaluation
Multiple-Choice Questions
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technolog...
26
Evaluation
Multiple-Choice Questions by Subject
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educationa...
27
Evaluation
Multiple-Choice Questions
high correctness rate at all subjects
more problems at
Aggregate
Hardened Concrete...
28
Evaluation
Proposed Multiple-Choice Questions
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational ...
29
Evaluation
Proposed Multiple-Choice Questions
31 out of 121 students submitted multiple-choice
questions for all subjec...
30
Discussion
Discussion
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz
Jun...
31
Discussion
General
students show a better grade point average after than
before using LIVE
reduced workload of the teac...
32
Discussion
Learning Approach
high correctness rate at the questions because
students could watch the videos multiple ti...
33
Discussion
Proposed Multiple-Choice Questions
broad range of proposed questions
could help to identify the interests of...
34
Outlook & Conclusion
Outlook & Conclusion
Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Tech...
35
Outlook & Conclusion
Outlook
the lecture is anchored in the bachelor program for
the next years
it will be held again i...
36
Outlook & Conclusion
Conclusion
automatic authentication through a third-party
learning platform
a web-platform records...
37
Thank you!
Questions?
Josef Wachtler, josef.wachtler@tugraz.at
Marco Scherz, marco.scherz@tugraz.at
Martin Ebner, marti...
Próximos SlideShares
Carregando em…5
×

Automatic Authentication of Students at an Interactive Learning-Video Platform

274 visualizações

Publicada em

ED-Media 2019 conference, Amsterdam, June 2019

Publicada em: Educação
  • Seja o primeiro a comentar

  • Seja a primeira pessoa a gostar disto

Automatic Authentication of Students at an Interactive Learning-Video Platform

  1. 1. S C I E N C E P A S S I O N T E C H N O L O G Y www.tugraz.at Automatic Authentication of Students at an Interactive Learning-Video Platform Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl Educational Technology - TU Graz June 26, 2019
  2. 2. 2 Content 1. Introduction 2. LIVE: Interactive Video Platform 3. Automatic Authentication 4. Course Design 5. Evaluation 6. Discussion 7. Outlook & Conclusion Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  3. 3. 3 Graz University of Technology Educational Technology Working Group Sustainable Construction, Institute of Technology and Testing of Construction Materials Europe, Austria, Graz http://www.tugraz.at Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  4. 4. 4 Introduction Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  5. 5. 5 Introduction Motivation authentication required for attendance monitoring and assessment many positive effects of compulsory attendance compulsory attendance at online videos needs a detailed monitoring and additional safety parameters to ensure the accuracy Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  6. 6. 6 Introduction Why Interactions? help to ensure the accuracy of attendance monitoring missing interactions are leading to passive learners and to a much more surficial work avoid that learners become tired or annoyed increase the attention and the contribution feedback for teachers: Is it possible for the learners to follow the content? Is the speed appropriate? ... Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  7. 7. 7 Introduction Research Question a video platform was used for some years with manual authentication now automatic authentication through the learning platform of the university is possible evaluating the automatic authentication at a platform for learning-videos in combination with interactive components Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  8. 8. 8 LIVE: Interactive Video Platform Interactive Video Platform LIVE: Live Interaction in Virtual learning Environments https://live.learninglab.tugraz.at/ Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  9. 9. 9 LIVE: Interactive Video Platform Interactive Components in Videos different methods of interaction: automatically asked questions and captchas asking questions to the lecturer asking text-based questions to the attendees multiple-choice questions at pre-defined positions post video polls analysis features for the teacher Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  10. 10. 10 LIVE: Interactive Video Platform Video is Interrupted by a MC-Question Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  11. 11. 11 LIVE: Interactive Video Platform Attendance Monitoring registered and authenticated users for each student who attends a video the following values are recorded Absolute time of joining (e.g. 2018-05-11 13:45:27) Relative time of joining (e.g. 00:00) Absolute time of leaving (e.g. 2018-05-11 13:48:49) Relative time of leaving (e.g. 03:22) Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  12. 12. 12 LIVE: Interactive Video Platform Timeline Analysis Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  13. 13. 13 LIVE: Interactive Video Platform List of All Attendees Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  14. 14. 14 LIVE: Interactive Video Platform User Details Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  15. 15. 15 LIVE: Interactive Video Platform Calculation of an Attention-Level calculation of an attention-level which is based on the reaction-times of the attendees to the interactions maxim: if the attendee reacts slower the attention-level decreases result ranges from 0% (completely absent) to 100% (fully attentive) Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  16. 16. 16 Automatic Authentication Automatic Authentication Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  17. 17. 17 Automatic Authentication Learning Tools Interoperability (LTI) a standard of the IMS Global Learning Consortium to connect learning applications one platform could use content offered by a second platform entities: student learning platform (LTI consumer): moodle, TeachCenter, ... learning tool (LTI provider): LIVE, ... Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  18. 18. 18 Automatic Authentication LTI Authentication at a Tool through a Platform Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  19. 19. 19 Automatic Authentication Developed LTI Tools for the Django-Web-Framework MIT license Django LTI Provider with Authentication https://github.com/wachjose88/django-lti-provider- auth Local LTI Consumer https://github.com/wachjose88/local-lti-consumer Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  20. 20. 20 Course Design Course Design Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  21. 21. 21 Course Design Setting course: “Building Materials Basics - Laboratory Practicals” bachelor program: “Civil Engineering Sciences and Construction Management” large number of students in summer term 8 subjects of practical demonstrations 16 groups (two groups/videos per subject) each group is responsible for filming one demonstration small number of students in winter term videos of the summer term are used Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  22. 22. 22 Course Design Flow of Events Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  23. 23. 23 Evaluation Evaluation Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  24. 24. 24 Evaluation Automatic Authentication before automatic authentication students had to register manually at LIVE had to use a username which was assigned by the teacher 8% (12 out of 150) did not use the assigned username and received a negative grade with automatic authentication no technical problems no unidentifiable students Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  25. 25. 25 Evaluation Multiple-Choice Questions Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  26. 26. 26 Evaluation Multiple-Choice Questions by Subject Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  27. 27. 27 Evaluation Multiple-Choice Questions high correctness rate at all subjects more problems at Aggregate Hardened Concrete 1 and 2 Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  28. 28. 28 Evaluation Proposed Multiple-Choice Questions Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  29. 29. 29 Evaluation Proposed Multiple-Choice Questions 31 out of 121 students submitted multiple-choice questions for all subjects not many questions were congruent with the questions of the teacher if questions of the teacher were submitted, these questions were among the best Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  30. 30. 30 Discussion Discussion Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  31. 31. 31 Discussion General students show a better grade point average after than before using LIVE reduced workload of the teacher students could focus on the content of the videos and not on administrative tasks like using an assigned username Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  32. 32. 32 Discussion Learning Approach high correctness rate at the questions because students could watch the videos multiple times students reported that they worked according this workflow: 1. watching the videos 2. answering the multiple-choice questions 3. re-reading the teaching materials, if the student was uncertain about the answer 4. re-watching the videos 5. answering the multiple-choice question with additional knowledge Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  33. 33. 33 Discussion Proposed Multiple-Choice Questions broad range of proposed questions could help to identify the interests of the students adapt lecture accordingly Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  34. 34. 34 Outlook & Conclusion Outlook & Conclusion Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  35. 35. 35 Outlook & Conclusion Outlook the lecture is anchored in the bachelor program for the next years it will be held again in this form minor adaptions according the proposed questions Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  36. 36. 36 Outlook & Conclusion Conclusion automatic authentication through a third-party learning platform a web-platform records the time of watching of each individual student and adds some interactive components students were asked to submit questions which helped them understand the lecture content to identify topics of interest Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019
  37. 37. 37 Thank you! Questions? Josef Wachtler, josef.wachtler@tugraz.at Marco Scherz, marco.scherz@tugraz.at Martin Ebner, martin.ebner@tugraz.at Maria Grandl, maria.grandl@tugraz.at Graz University of Technology Educational Technology M¨unzgrabenstraße 36/I, A-8010 Graz http://elearningblog.tugraz.at Josef Wachtler, Marco Scherz, Martin Ebner and Maria Grandl, Educational Technology - TU Graz June 26, 2019

×