A webinar about harvesting metadata in the context of the ASPECT project

1. Harvesting Metadata
Dr. Joris Klerkx
http://bit.ly/c6mRZC
1

2. More!
http://bit.ly/c6mRZC
2

3. Metadata & Learning Objects
IEEE LTSC
IMS ILOX
LOM
3

4. 166.637 131.436
HTTP://PORTAL.MACE-PROJECT.EU/ HTTP://LREFORSCHOOLS.EUN.ORG/
124.954 16.454
HTTP://PORTAL.ASPECT-PROJECT.ORG/ HTTP://WWW.ICOPER.ORG/
4

5. GLOBE
>1.000.000
“Alliance to make shared online learning resources available to
educators and students around the world”
HTTP://WWW.GLOBE-INFO.ORG/
5

6. Key Technologies
Metadata (IEEE LOM, IMS ILOX)
describe learning resources
Harvesting Metadata (OAI-PMH)
get learning resource metadata and copy locally
Federated Search (SQI, SRU/W)
distribute issued queries to remote repositories
Publishing Metadata (SPI)
add new learning resources in ‘a’ repository
6

7. ASPECT
INFRASTRUCTURE
&
TOOLSET
7

8. http://bit.ly/cGdsYd
Learning Object
Repository Registry
8

9. LORs
Examples
The Learning Resources Exchange (http://lre.eun.org)
The ARIADNE KPS (http://ariadne.cs.kuleuven.be)
Merlot (www.merlot.org)
LORNET (http://ares.licef.teluq.uqam.ca/Lornet/tabid/246/language/en-US/Default.aspx)
.... (many more)
(Open) Standards & Specifications
IEEE LOM - IMS ILOX - SQI - PLQL - SPI - OAI-PMH - RSS - CAM
- ...
9

10. Objectives LOR registry
Enable the interconnection of learning object repositories
(LORs)
To increase LORs impact in making relevant content available
CEN WS-LT Project Team on Registries
Specifies how a network of registries can be set up with
existing standards and specifications
http://bit.ly/b7YgbV
10

11. LOR Registry Data Model
Defines what data the registry will hold about the
repositories
IMS LODE registry data model, which is itself an
application profile of ISO2146 - Registry Services
for Libraries and Related Organizations.
Full description
http://imsglobal.org/LODE/spec/imsLODEv1p0bd
11

12. Currently
Specification Targets
SQI 14
OAI-PMH 38
SRU 1
SPI 1
TOTAL 54
TOTAL Objects Exposed +/- 1.151.000
PROJECTS INVOLVED/INTERESTED
ASPECT, ICOPER, ORGANIC.EDUNET,
SHARE.TEC, OPENSCOUT, GLOBE, ...
12

13. Harvest
13

14. Harvest
13

15. How OAI-PMH works
OAI “VERBS” SERVICE PROVIDER METADATA
PROVIDER
Identify R
H
A
HTTP REQUEST E
ListMetadataFormats (OAI VERB) P
R
V O
GetRecord
E OAI OAI S
S I
ListIdentifiers
T T
E
HTTP RESPONSE O
ListRecords
R
(VALID XML) R
ListSets Y
14

16. OAI-PMH Target Software
2. Mapping Process
Repository metadata Repository LOM metadata
1. Get metadata - identifier - lom.general.identifier
out of database - title - lom.general.title
- url - lom.general.description
- project description - lom.technical.location
- ... - ...
3. Copy results in
OAI-PMH service
Repository OAI-PMH result
DYNAMO LOM 4. Serve results ARIADNE
DYNAMO LOM
metadata LOM Harvester
DYNAMO
metadata
Repository LOM
metadata
metadata
OAI-PMH
VERBS
15

17. Example verb: ListRecords
Purpose
Retrieves metadata records for multiple items
Parameters
from – start date (O)
greater than or equal to
until – end date (O)
less than or equal to
16

18. Example verb: GetRecord
Purpose
Returns the metadata for a single item in the
form of an OAI record
Parameters
identifier – unique id for item (R)
metadataPrefix – metadata format for the
record (R)
17

19. Example OAI-PMH Calls
Identify
http://ariadne.cs.kuleuven.be/ariadne-partners/services/oai?verb=Identify
ListMetadataFormats
http://ariadne.cs.kuleuven.be/ariadne-partners/services/oai?
verb=ListMetadataFormats
ListRecords
http://ariadne.cs.kuleuven.be/ariadne-partners/services/oai?
verb=ListRecords&metadataPrefix=oai_lom
http://ariadne.cs.kuleuven.be/ariadne-partners/services/oai?
verb=ListRecords&resumptionToken=
GetRecord
http://ariadne.cs.kuleuven.be/ariadne-partners/services/oai?verb=GetRecord
&identifier=oai:ariadne.cs.kuleuven.be:BLKLKP1382&metadataPrefix=oai_lom
...
18

20. ARIADNE Harvester
Incremental, scheduled harvesting
Supports SPI specification
Integrated with Registry, Validation, Identification, Transformation
RSS Alerts
http://bit.ly/azDFyY
19

21. ARIADNE Harvester
Incremental, scheduled harvesting
Supports SPI specification
Integrated with Registry, Validation, Identification, Transformation
RSS Alerts
http://bit.ly/azDFyY
19

22. Harvesting Infrastructure
LEARNING
ARIADNE HARVESTER RESOURCE
EXCHANGE
OAI-PMH
SPI SQI
EXTERNAL REPOSITORY
LOM
LOM
LOM
6
OAI
2
LOM
OAI-PMH
1
Validation
LOM
Msg
LOM
LOM
LOM
4
5 3
Validation Validation
LOM
Msg Msg
HARVESTER LOG
VALIDATION SERVICE
20

23. Integration of tools (e.g Harvester)
21

24. http://bit.ly/90va7d
Validation
22

25. Why?
Manual check is very time consuming
Tool for enforcing an validation scheme
A set of validation rules
Based on XSD Schema & Schematron Rules
23

26. Online
Validation
http://bit.ly/90va7d
Paste metadata record
e.g LOM instance
Select validation scheme uri
e.g http://ltsc.ieee.org/xsd/LOM/strict
Validate & Consult Validation Errors
24

27. http://bit.ly/cmLygj
Vocabulary Bank of
Education
25

28. What?
Repository for controlled vocabularies
Standard formats & specifications
Multi-lingual
Integrated with Validation Service
Integrated with Transformation Service
http://bit.ly/cmLygj
26

29. Transformation MD MD
Service
LREv3.0 to LREv4.0 transformation
LREv4.0 to LOM Loose transformation
DC to IEEE LOM
...
http://bit.ly/daFAXY
27

30. Identify
Create
Read
Update
Delete
28

31. Putting it all Together...
29

32. Typical
Workflow
30

33. Typical Harvesting Workflow
31

34. WHAT YOU END UP WITH...
BMBWK EUN MEC RVP
SQI UDDI OAI
SQI Client LOR Registry
OAI-PMH
Registry SQI ARIADNE C-H FWU MESC TLF
Harvester
OAI
ASPECT
CFL INDIRE MSU UL-FRI
MELT
SQI SQI
Federated EDUCATIO KUL NCTE XTEC
GLOBE Search
SPI OAI
OAI-PMH
ARIADNE
SQI Harvester
WINDS DYNAMO
ARIADNE
Harvester
MACE
MACE IRB CuminCAD
OAI OAI OAI SQI SQI SQI SQI
SQI SQI SQI
LACLO NIME EUN EdNA CGIAR Pubelo Merlot
OAI OAI SQI SQI SQI SQI
SQI SQI
ISKME KERIS III COSL LORNET Ariadne
32

35. WHAT YOU END UP WITH...
BMBWK EUN MEC RVP
SQI UDDI OAI
SQI Client LOR Registry
OAI-PMH
Registry SQI ARIADNE C-H FWU MESC TLF
Harvester
OAI
ASPECT
CFL INDIRE MSU UL-FRI
MELT
SQI SQI
Federated EDUCATIO KUL NCTE XTEC
>1.000.000
GLOBE Search
SPI OAI
OAI-PMH
ARIADNE
SQI Harvester
WINDS DYNAMO
ARIADNE
Harvester
MACE
MACE IRB CuminCAD
OAI OAI OAI SQI SQI SQI SQI
SQI SQI SQI
LACLO NIME EUN EdNA CGIAR Pubelo Merlot
OAI OAI SQI SQI SQI SQI
SQI SQI
ISKME KERIS III COSL LORNET Ariadne
32

36. How to Access these
Resources?
Some Examples...
33

37. ASPECT Portal
http://bit.ly/cghBuB
34

38. ARIADNE Finder
http://bit.ly/a0n6Nm
35

39. ARIADNE Finder
http://bit.ly/a0n6Nm
35

40. ARIADNE Moodle Bridge
36

41. ARIADNE Moodle Bridge
36

42. ALOCOM
Aggregation & Disaggregation of content
Import & Export Powerpoint & Open-office
Export to SCORM
http://bit.ly/azhfqh
37

43. Elastic Lists
Maeve Installation
http://bit.ly/dkC5jh
38

44. Elastic Lists
Maeve Installation
http://bit.ly/dkC5jh
38

45. Visual Access Tools
http://bit.ly/cekoue
39

46. Visual Access Tools
http://bit.ly/cekoue
39

47. Visual Access Tools
http://bit.ly/cekoue
39

48. Augmented Reality
http://sharetec.celstec.org/gddf/mace_AR.mov
40

49. Metadata
Analysis
http://bit.ly/cvlDcw
HTTP://SLIDESHA.RE/DLJEMT
41

50. Conclusion
42

51. Conclusion
ASPECT (Harvesting) Infrastructure
Open Standards & Specifications
allow the integration & management of LOs.
Existing toolset for Accessing Material
42

52. Interested in our work?
Become an ASPECT Associated
Partner!
http://www.aspect-project.org/node/23

53. Thanks! Questions?
HTTP://BTER.ME/O5L8
http://bit.ly/c6mRZC
44