1.
Learning Object Virtualization Allowing for Learning Object Assessments and Suggestions for Use Olivier CATTEAU, Philippe VIDAL, Julien BROISIN Institut de Recherche en Informatique de Toulouse

2.
Outline <ul><li>Learning Object Assessments and Suggestions for Use </li></ul><ul><li>Research Issues </li></ul><ul><li>Proposed Approach </li></ul><ul><li>Implementation </li></ul><ul><li>Conclusion and perspectives </li></ul>

3.
Annotations <ul><li>LOM Annotation Category </li></ul><ul><ul><li>« enable educators to share their assessments of learning objects, suggestions for use, etc. » </li></ul></ul><ul><ul><li>IEEE-LTSC, 1484.12.1-2002, IEEE Standard for Learning Object Metadata </li></ul></ul>

4.
LO & Metadata Lifecycle Production Diffusion Use Re-Authoring Termination [ICALT ’ 06] Why assesments?

5.
Production Ready-to-use Learning Object Are annotations objective? Production Diffusion Use Re-Authoring Termination Authoring Tools Metadata Author + Annotations LOR

6.
Diffusion LOR <ul><li>Learning Object Assessments </li></ul><ul><ul><li>Help teachers to build a curriculum </li></ul></ul>Production Diffusion Use Re-Authoring Termination Learning Management System Editing teacher

7.
Diffusion & Use LOR <ul><li>Learning Object Assessments </li></ul><ul><ul><li>Help teachers to build a curriculum </li></ul></ul><ul><li>Suggestions for Use </li></ul><ul><ul><li>Avoid pedagogical mistakes </li></ul></ul><ul><ul><li>Help building a learning design </li></ul></ul>Production Diffusion Use Re-Authoring Termination Learning Management System Teacher

8.
Re-authoring (Feedback step) LOR User comments Improve Learning Object content, form or description Production Diffusion Use Re-Authoring Termination Teacher Student Learning Management System Subject Matter Expert Peer reviewing Suggestions for Use

9.
What ’ s in the reality?

10.
Existing Reviewing Systems MemoNote Azouaou & Desmoulins, A Flexible and Extensible Architecture for Context-Aware Annotation in E-Learning, ICALT ’ 06 LOR

11.
Existing Reviewing Systems

12.
Existing Reviewing Systems

13.
Existing Reviewing Systems

14.
Existing Reviewing Systems

15.
Existing Reviewing Systems

16.
Existing Reviewing Systems

17.
Existing Reviewing Systems

18.
Existing Reviewing Systems Qualitative &/or quantitative peer review with criteria by a domain expert User comments &/or quantitative evaluation Suggestions for use Evaluation Criteria according to LO types LOR Learning Management System

19.
Existing Reviewing Systems Synthesis LOR Quantitative Review Qualitative Review Evalutech NO Peer review by domain expert Harvey Project NO Peer review + Classroom testing LORI Peer review MERLOT Peer review (2 domain experts) Member comments Wisconsin Online Public comments

20.
Issues <ul><li>Need for sharing and reusing peer reviews, comments and suggestions for use </li></ul><ul><ul><li> Information stored in metadata </li></ul></ul><ul><ul><li> The LOM Annotation Category has to be improved </li></ul></ul>8. Annotation 8.3 Description 8.2 Date 8.1 Entity Teacher ? Student ? Subject Matter Expert? Global ? Criterion? Suggestion for Use? Quantitative evaluation?

21.
Issues <ul><li>Systems elaborated to manage assessments differ from the system used to learn and teach </li></ul>

22.
Proposed approach <ul><li>Collection of annotations through a LMS </li></ul><ul><li>Storage of annotations within metadata and LOR </li></ul>LOR Learning Management System

23.
Modified Annotation Category 8. Annotation 8.3 Description 8.2 Date 8.1 Entity 8. Annotation 8.3 Description 8.2 Date 8.1 ’ Contribute 8.1 ’.1 Entity 8.4 Annotation Type 8.5 Quality Level 8.1 ’.2 Role

24.
Closer to the end user The LOV Design Search Importation Indexation Generation Specific API 1 Federation Layer Integration Layer Virtualization Layer Specific API 2 LOR 1 LOR 2 LOR WEB SERVICES PHP Storage of Learning Objects & Metadata PHP LOM ++ LOM ++ LMS 1 LMS 2 SOAP/HTTP Annotation ● Peer review ● Comments ● Comments ● Suggestion for use Subject Matter Expert ● Import ● Import Teacher ● LO selection Student ● Use ● Use

25.
Benefits <ul><li>Annotations: </li></ul><ul><ul><li>are added when they become relevant </li></ul></ul><ul><ul><li>can be shared from several LMS </li></ul></ul><ul><ul><li>can be stored on multiple LOR </li></ul></ul><ul><li>Criteria can be customized depending on the user role </li></ul><ul><li>LO selection can be improved (quality-based sorting) to build a courseware </li></ul><ul><li>Teachers avoid pedagogical mistakes </li></ul>

26.
Implementation Search Importation Indexation Generation Specific API Federation Layer Integration Layer Virtualization Layer KPS ARIADNE WEB SERVICES PHP Storage of Learning Objects & Metadata LOM Annotation Moodle Roles: ● administrator ● course creator ● editing teacher ● teacher ● student ● guest + subject matter expert SOAP/HTTP

27.
LO evaluations within the LMS Fast global evaluation Detailed evaluation Annotation Types: ● global ● suggestion for use ● content quality ● effectiveness ● ease to use

28.
Annotation submission sequence : USER LMS AMS AWS KPS 1. Fill annotation form 2. Deliver annotation 3. Generate vCard, role, LOR location, LO id 4. Send annotation information 5. Update LO metadata

29.
Conclusion <ul><li>Share and reuse of annotations </li></ul><ul><ul><li>An open architecture that facilitates LO assessments & suggestions for use </li></ul></ul><ul><ul><li>Annotations are submitted and retrieved when and where they become relevant </li></ul></ul><ul><li>June, 26 th 2008 </li></ul><ul><ul><li>19798 materials </li></ul></ul><ul><ul><li>2599 peer reviews </li></ul></ul><ul><ul><li>5736 comments </li></ul></ul><ul><ul><li>1218 assignments </li></ul></ul>

30.
Perspectives <ul><li>Modifications applied to the Annotation category should be adopted by consensus </li></ul><ul><li>Annotation types adapted to the user role </li></ul><ul><li>Criteria customized according to the LO type </li></ul><ul><li>In situ annotations </li></ul><ul><li>Personal Annotations </li></ul>

31.
Thanks for your attention