O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

Csedu2019 Towards a functionnal and technical architecture for e-exames

73 visualizações

Publicada em

presentation at CSEDU 2019 conference
a proof of concept of portable e-exam solution

Publicada em: Educação
  • Seja o primeiro a comentar

Csedu2019 Towards a functionnal and technical architecture for e-exames

  1. 1. TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS NOUR EL MAWAS - JEAN-MARIE GILLIOT MARIA-TERESA SEGARRA - MARINE KARMANN SERGE GARLATTI
  2. 2. MOTIVATION RELATED WORK OUR SOLUTION CASE STUDY CONCLUSION AND PERSPECTIVES SUMMARY
  3. 3. MOTIVATION
  4. 4. CONTEXT LifeLong Learning (LLL) is an important asset Assessment is a support of LLL, and initial training Formative (Boud 2000) Summative Certification opportunities become more accessible  employability impact 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 4
  5. 5. DOUBLE MOTIVATION • (1) LLL E-learning: social and blended • Third places - DIY • How to propose e-Exams in :  Third places  Exam rooms • (2) Develop institutional acceptance of e-Exams 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 5
  6. 6. A CLASSICAL E-EXAMS CLASSROOM 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 6 “Every University Should Have a Computer-Based Testing Facility” Zilles et al. – CSEDU 2019 Making Testing Less Trying: Lessons Learned from Operating a Computer-Based Testing Facility Zilles et al. – FIE 2018
  7. 7. A PROOF OF CONCEPT: A PORTABLE EXAM-BOX 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 7 AttendeeProctor Object Oriented Programming Exam LMS Synchronized with global server
  8. 8. RELATED WORKS
  9. 9. DIMENSIONS OF E-EXAMS • Space : ►Fixed: exam rooms defined by organization ►Free - At home: specific needs, online proctoring - Third place: learning friendly space, human invigilation • Time ►Fixed: defined by organization: exam ►Free, Open sessions: flexible pace 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 9 Rytkönen, A. and Myyry, L. (2014)
  10. 10. IMPORTANT FEATURES (1) – ACADEMIC INTEGRITY ►No improper access to resources ►No plagiarism ►No contract cheating, ie. no surrogate  F1: control access to the internet / local resource  F2: authentication  F3: learner’s identity verification 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 10 (Casey et al. 2005)
  11. 11. IMPORTANT FEATURES (2) – RICH ENVIRONMENT ►Equitable Access ►Problems protection ►Higher Order Thinking - Rich media documents - Professional software  Specific hardware  Extra time allowance  F4: regular backup of learner’s answers  F5: same software environment than during practice 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 11 (Fluck, 2018)
  12. 12. OUR SOLUTION
  13. 13. FUNCTIONAL ARCHITECTURE (OVERVIEW) 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 13 LMS NFC Reader Classroom Server Browser Rich environment Device Attendee Proctor Teacher
  14. 14. FUNCTIONAL ARCHITECTURE (TEACHER) 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 14 LMS NFC Reader Classroom Server Elaborate exams grade exams Teacher
  15. 15. FUNCTIONAL ARCHITECTURE (PROCTOR) TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 15 LMS NFC Reader Classroom Server Proctor authenticate
  16. 16. FUNCTIONAL ARCHITECTURE (ATTENDEE 1/3) 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 16 LMS NFC Reader Classroom Server Attendee authenticate Proctor
  17. 17. FUNCTIONAL ARCHITECTURE (ATTENDEE 2/3) 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 17 LMS NFC Reader Classroom Server Browser Rich environment Device Attendee authenticate Proctor
  18. 18. FUNCTIONAL ARCHITECTURE (ATTENDEE 3/3) 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 18 LMS NFC Reader Classroom Server Browser Rich environment Device Attendee elaborate answers post answers Proctor
  19. 19. ASSESSMENT DEPLOYMENT PROTOTYPE ARCHITECTURE 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 20 VM-Ubuntu14 Result code Browser DocsSubject Applicant PC: Ubuntu14 Browser SubjectLMS Subject Quizzes Exam storage Sync repository Classroom Server Docs Device Controlled Access (Access list)
  20. 20. ASSESSMENT DEPLOYMENT PROTOTYPE ARCHITECTURE 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 21 VM-Ubuntu14 Result code Browser DocsSubject Applicant PC: Ubuntu14 Browser SubjectLMS Subject Quizzes Exam storage Sync repository Classroom Server Docs Device Controlled Access (Access list)
  21. 21. ASSESSMENT DEPLOYMENT PROTOTYPE ARCHITECTURE 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 22 VM-Ubuntu14 Result code Browser DocsSubject Applicant PC: Ubuntu14 Browser SubjectLMS Subject Quizzes Exam storage Sync repository Classroom Server Docs Device Controlled Access (Access list)
  22. 22. ASSESSMENT DEPLOYMENT PROTOTYPE ARCHITECTURE 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 23 VM-Ubuntu14 Result code Browser DocsSubject Applicant PC: Ubuntu14 Browser SubjectLMS Subject Quizzes Exam storage Sync repository Classroom Server Docs Device Controlled Access (Access list)
  23. 23. CASE STUDY : OBJECT ORIENTED PROGRAMMING AND DATABASE FINAL ASSESSMENT • Teacher Objective: refactor traditional paper exam • Evaluate: ►Knowledge: MCQ ►Problem analysis and Solution design  Graphical design (remain paper-based) ►Programming and database utilization  Same practical work environment proposed - Write code from a program design (improved) - Solution to a particular compilation error (new) - Write code to access a database (improved) 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 25
  24. 24. CASE STUDY SETTING: INITIAL TEST ►Survey: affordance, acceptability, overall experience ►Interview  4 volunteer students - Globally positive - Difficulties: related to a new LMS and new expectations - Approve to have the same environment - Recommend to extend to other exams 03/05/2019 TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 26
  25. 25. CONCLUSION AND PERSPECTIVES
  26. 26. FLEXIBLE SYSTEM TO PASS PROCTORED EXAMS  Portable solution  Multiple exams support  In many places - With proctor support  Ensure academic integrity  And higher order thinking  Positive feedback from initial education engineering students ►Acceptance in our institution ►Deploy and test in other test fields ►Collect and analyze traces of exams ►Export evidence to external portfolio 03/05/2019TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E-EXAMS 28
  27. 27. THANK YOU ! Contact emails: nour.el-mawas@univ-lille.fr jm.gilliot@imt-atlantique.fr TOWARDS A FUNCTIONAL AND TECHNICAL ARCHITECTURE FOR E- EXAMS

×