SlideShare uma empresa Scribd logo
1 de 17
Validation Framework
API

Method name :    validateMetadata()

 Return type :          void
 Parameters :          Name            Datatype
                     metadata           String
                 validationScheme       String

       Fault :   validationException
empty attribute                                                       core schematron                         Legend
     fields                    vocabulary bank        IMS ILOX
                                                                             rules                                            uses
 recommended                                                                                                                 extends
schematron rules
                                                                                                   MACEv1.0             validationScheme

                                                                                                vcard validator        validation component
 ASPECTv1.0/                             ASPECTv1.0/
 recommended                                core                                             - empty attribute fields          rules
                                                                                             - empty fields




            MELTv1.0/
             minimal                                                 LOM loose            lomloose.xsd

                                                                                                     classification
                                                                                                     vocab service
melt.xsd



                                                                     MACEv1.0/
                                        vcard validator                                              MACEv1.0/strict
                                                                       loose
           MELTv1.0/full




                                                                    maceLoose                         maceStrict
                                                mace.xsd
                                                                  Schematron.xml                    Schematron.xml
 conditional       LRE taxon field
 fields check         numerical                                  - empty attribute fields       - add. mandatory fields
                                                                - empty fields                 - conditional fields
                                                                - mandatory fields             - mace namespace fields
empty attribute                                                       core schematron                         Legend
     fields                    vocabulary bank        IMS ILOX
                                                                             rules                                            uses
 recommended                                                                                                                 extends
schematron rules
                                                                                                   MACEv1.0             validationScheme

                                                                                                vcard validator        validation component
 ASPECTv1.0/                             ASPECTv1.0/
 recommended                                core                                             - empty attribute fields          rules
                                                                                             - empty fields




            MELTv1.0/
             minimal                                                 LOM loose            lomloose.xsd

                                                                                                     classification
                                                                                                     vocab service
melt.xsd



                                                                     MACEv1.0/
                                        vcard validator                                              MACEv1.0/strict
                                                                       loose
           MELTv1.0/full




                                                                    maceLoose                         maceStrict
                                                mace.xsd
                                                                  Schematron.xml                    Schematron.xml
 conditional       LRE taxon field
 fields check         numerical                                  - empty attribute fields       - add. mandatory fields
                                                                - empty fields                 - conditional fields
                                                                - mandatory fields             - mace namespace fields
Integration

• Java library (see integration with harvester)
• REST web-service
• web application
Maintenance

• Adding a new schema
   • configuration
• Adding a new custom component
   • implementation
   • configuration
• Deploying
• New Validation Schema :
     • add id
     • properties : URI, components, (type)
     • component
        • properties
• Create the schemas
     • structure
     • vocabulary
     • additional rules
• New custom component
     • Extend ValidationComponent
	   void validate(String metadata) throws ValidationException;

	 void init(String name, Hashtable<String,String> table) throws
InitialisationException;


    •   config :

        •   componentType

        •   schemaLocation
ARIADNE Harvester
Metadata
Provider                        Harvester
    OAI-PMH



    LOM
     LOM                               Validation
      XML

                             Mapping




              Storage
               SPI Target
               File System
               Lucene
               ...
Installation

• Java 5 or higher
• Tomcat 5 or higher
• build using apache ant
• drop in tomcat and done
Configuration

• http://ariadne.cs.kuleuven.be/nateur-
  harvester/
• Init
• OAI Targets
• Scheduling
Mapping

• Extend GenericMapper
•   public abstract Element map(Record record);

•   config :

•   mapper.mapperClassName.<identifier> =
    org.ariadne.mapping.BSOMapper
Mapping
Validation

• Integrated ARIADNE validator
• Default scheme
• Target specific scheme
• Validation Reports
Maintenance
•   Checking if              •   Installations :
    harvesting still             •  GLOBE
    running                      •  MACE
•   Follow up validation         •  MELT
    reports                      •  ASPECT
•   Contact content              •  Organic Edunet
    providers if target is       •  Natural Europe
    down
                                 •  ICOPER
•   Assist in solving            •  ARIADNE
    validation errors            •  ...
•   ...
Information

• http://ariadne.cs.kuleuven.be/lomi/
  index.php/Harvesting_Metadata
• http://ariadne.cs.kuleuven.be/lomi/
  index.php/Setting_Up_OAI-PMH

Mais conteúdo relacionado

Mais de Bram Vandeputte

Mais de Bram Vandeputte (15)

Android presentation 2011
Android presentation 2011Android presentation 2011
Android presentation 2011
 
Icoper webinar
Icoper webinar Icoper webinar
Icoper webinar
 
Multi-touch introduction
Multi-touch introductionMulti-touch introduction
Multi-touch introduction
 
Android intro 2010
Android intro 2010Android intro 2010
Android intro 2010
 
Exploring the research world
Exploring the research worldExploring the research world
Exploring the research world
 
Research20
Research20Research20
Research20
 
Metadata Harvesting And Validationv2
Metadata Harvesting And Validationv2Metadata Harvesting And Validationv2
Metadata Harvesting And Validationv2
 
Ariadne Overview
Ariadne OverviewAriadne Overview
Ariadne Overview
 
Multi Touch Introduction
Multi Touch IntroductionMulti Touch Introduction
Multi Touch Introduction
 
Multi Touch Hands On
Multi Touch Hands OnMulti Touch Hands On
Multi Touch Hands On
 
Oai Workshop Extended
Oai Workshop ExtendedOai Workshop Extended
Oai Workshop Extended
 
Metadata Harvesting And Validation
Metadata Harvesting And ValidationMetadata Harvesting And Validation
Metadata Harvesting And Validation
 
IEEE LOM
IEEE LOMIEEE LOM
IEEE LOM
 
Android Presentation
Android PresentationAndroid Presentation
Android Presentation
 
Ariadne Harvesting
Ariadne HarvestingAriadne Harvesting
Ariadne Harvesting
 

Último

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 

Último (20)

EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 

Validate metadata and map to storage using validation framework API

  • 2. API Method name : validateMetadata() Return type : void Parameters : Name Datatype metadata String validationScheme String Fault : validationException
  • 3. empty attribute core schematron Legend fields vocabulary bank IMS ILOX rules uses recommended extends schematron rules MACEv1.0 validationScheme vcard validator validation component ASPECTv1.0/ ASPECTv1.0/ recommended core - empty attribute fields rules - empty fields MELTv1.0/ minimal LOM loose lomloose.xsd classification vocab service melt.xsd MACEv1.0/ vcard validator MACEv1.0/strict loose MELTv1.0/full maceLoose maceStrict mace.xsd Schematron.xml Schematron.xml conditional LRE taxon field fields check numerical - empty attribute fields - add. mandatory fields - empty fields - conditional fields - mandatory fields - mace namespace fields
  • 4. empty attribute core schematron Legend fields vocabulary bank IMS ILOX rules uses recommended extends schematron rules MACEv1.0 validationScheme vcard validator validation component ASPECTv1.0/ ASPECTv1.0/ recommended core - empty attribute fields rules - empty fields MELTv1.0/ minimal LOM loose lomloose.xsd classification vocab service melt.xsd MACEv1.0/ vcard validator MACEv1.0/strict loose MELTv1.0/full maceLoose maceStrict mace.xsd Schematron.xml Schematron.xml conditional LRE taxon field fields check numerical - empty attribute fields - add. mandatory fields - empty fields - conditional fields - mandatory fields - mace namespace fields
  • 5. Integration • Java library (see integration with harvester) • REST web-service • web application
  • 6. Maintenance • Adding a new schema • configuration • Adding a new custom component • implementation • configuration • Deploying
  • 7. • New Validation Schema : • add id • properties : URI, components, (type) • component • properties • Create the schemas • structure • vocabulary • additional rules
  • 8. • New custom component • Extend ValidationComponent void validate(String metadata) throws ValidationException; void init(String name, Hashtable<String,String> table) throws InitialisationException; • config : • componentType • schemaLocation
  • 10. Metadata Provider Harvester OAI-PMH LOM LOM Validation XML Mapping Storage SPI Target File System Lucene ...
  • 11. Installation • Java 5 or higher • Tomcat 5 or higher • build using apache ant • drop in tomcat and done
  • 12. Configuration • http://ariadne.cs.kuleuven.be/nateur- harvester/ • Init • OAI Targets • Scheduling
  • 13. Mapping • Extend GenericMapper • public abstract Element map(Record record); • config : • mapper.mapperClassName.<identifier> = org.ariadne.mapping.BSOMapper
  • 15. Validation • Integrated ARIADNE validator • Default scheme • Target specific scheme • Validation Reports
  • 16. Maintenance • Checking if • Installations : harvesting still • GLOBE running • MACE • Follow up validation • MELT reports • ASPECT • Contact content • Organic Edunet providers if target is • Natural Europe down • ICOPER • Assist in solving • ARIADNE validation errors • ... • ...
  • 17. Information • http://ariadne.cs.kuleuven.be/lomi/ index.php/Harvesting_Metadata • http://ariadne.cs.kuleuven.be/lomi/ index.php/Setting_Up_OAI-PMH

Notas do Editor

  1. \n
  2. \n
  3. \n
  4. \n
  5. \n
  6. \n
  7. \n
  8. \n
  9. \n
  10. \n
  11. \n
  12. \n
  13. \n
  14. \n
  15. \n
  16. \n
  17. \n
  18. \n
  19. \n
  20. \n
  21. \n
  22. \n