Franco Niccolucci: Example for an EOSCpilot Science Demonstrator - TextCrowd (EOSC hub week, Malaga, 16 - 20 April 2018)

1. Franco Niccolucci & Achille Felicetti
(PIN, University of Florence, Italy)
EOSC-hub Week 2018
Malaga, 16/4/2018

2. EOSCpilot is a project funded by the EC H2020 programme
 Domain: Archaeology
 Goal: semantic enrichment of texts
 Archaeological documentation largely based on texts
◦ Excavation diaries, reports, surveys, grey literature
◦ Literary/historical sources. research articles, monographs …
◦ Huge number of small (<100Kb) files in different languages
 Registry of 2,000,000 archaeological datasets (70% texts) in ARIADNE
 ARIADNE’s data infrastructure popular among archaeologists
◦ ARIADNE users in 2016: 25-30% of the European research community
◦ Strong support by
 Professional associations (EAA, EAC) & national archaeological/cultural heritage authorities
 National research institutions (CNR, CNRS, CAS, ÖAW, KNAW, BAS, ATHENA RC, FORTH)
 International recognition (USA, Mexico, Japan, Argentina)
 Needed for cloud-based data infrastructure to be developed in ARIADNEplus
◦ Deeper integration between texts, databases, GIS etc.
◦ Advanced services & VREs for data-centric archaeological research
2

3. EOSCpilot is a project funded by the EC H2020 programme
 NLP & NER OS engine
 Syntactic rules (tailored to specific writing style)
 Texts stating facts, not stories
◦ Data fuzziness, provenance, reliability, reasoning
 Domain ontology: CIDOC CRM (ISO 21127:2006)
◦ ... and not TEI
 Terminology
◦ Specialized vocabularies
 Terra sigillata is not just “sealed earth”
◦ Gazetteers for modern (Geonames) and ancient (Pleiades) place names
 Málaga (modern) vs Màlaka (Phoenician) vs Màlaca (Roman)
◦ Named time period management
 Bronze Age (∼ 3200-600 BC), Recent Orientalizing Period (∼ 630-570 BC)

4. EOSCpilot is a project funded by the EC H2020 programme
 Modular framework based on GATE toolchain: https://gate.ac.uk
◦ Advanced stemming/lemmatization components
 OpenNLP (https://opennlp.apache.org) : sentence segmentation and part of
speech (POS) tagging
 OpeNER (http://www.opener-project.eu) neuronal network for advanced
named entities recognition (NER), developed in OpeNER FP7 project
◦ Machine learning framework for auto education
 Annotated corpus required
 Ontology: CRMarcheo (CRM extension for archaeology)
 Vocabularies, gazetteers and terminological tools
◦ ICCD vocabularies for Italian archaeology, augmented with term lists
created on purpose
◦ Geonames (modern places), Pleiades (historical places)
◦ Timespan and named period component based on PeriodO
4

5. EOSCpilot is a project funded by the EC H2020 programme
 TextCrowd detects:
◦ Artefacts
◦ Colours
◦ Materials
◦ Time periods
◦ Persons
◦ Places
◦ Sites
◦ Time spans
◦ Techniques
 Target output formats:
◦ Textual documents automatically annotated and enriched
◦ CIDOC CRM semantic triples (RDF)
5

6. EOSCpilot is a project funded by the EC H2020 programme
 No annotated text corpora available in Italian to be used as training data for
machine learning algorithms
◦ Manual annotation of 400 pages of Italian archaeology reports (< 1 Person-Month)
 Preparation and adaptation of vocabularies
 Availability of user-friendly cloud-based environments and of necessary tools, to
migrate standalone prototype to cloud
◦ Several cloud solutions tested in early development, limited support provided except in
D4Science
◦ Implementation in D4Science infrastructure, but portable to other cloud services if support and
required modules available
 Authentication and Authorization
◦ No access control to metadata/data implemented so far
◦ Demonstrator focused on freely accessible textual documents
◦ Fasti Online used (http://www.fastionline.org) Open Access collection of archaeological reports
6

7. EOSCpilot is a project funded by the EC H2020 programme
 Operated and maintained by CNR-ISTI on the D4Science platform
https://www.d4science.org
 Modular engine based on GATE toolchain + OpenNLP-OpeNER
modules, natively provided by D4Science
 Web-based user interface for
◦ User and access management
◦ Cloud storage (private and shared files)
◦ Results available for other Virtual Research Environments (VRE) within D4Science
 Released for open use, for tests & comments
 No fancy interface produced, also to adapt to any Look-and-Feel
7

8. EOSCpilot is a project funded by the EC H2020 programme
 Machine-readable results: RDF encoding produced
 Human-readable results: color-encoded text (for testing)
 Interoperability of extracted knowledge
◦ Semantic information in CRM format: full integration and interoperability with
other archaeological semantic data (to be fully implemented in ARIADNEplus)
 Supporting FAIR Principles implementation
◦ Metadata to be stored in various registries for easy findability and accessibility
◦ Results ready to be reused within the same environment or consumed by other
services and/or in different scenarios
8

9. EOSCpilot is a project funded by the EC H2020 programme
 TEXTCROWD has shown to be useful for its main purpose: to demonstrate
the importance and usefulness of EOSC for scientific research in the cultural
heritage domain
 Adoption by other research teams in the EOSCpilot framework
◦ Integration of TEXTCROWD with new VisualMedia Demonstrator: a service for
sharing and visualizing visual media files on the web - automatic metadata extraction
from controlled lists or textual documents for 2D and 3D models
 Testing on real use cases in progress
◦ Open Access papers of the Italian Journal Archeologia e Calcolatori, ongoing
 Clean visualization
 Language extension
◦ English, Dutch: from standalone to cloud-based (annotated corpora available)
◦ French, Spanish, German: new from scratch (annotated corpora to be prepared)
◦ Other EU languages: OpeNER extension required
 Additional work required to suit it to everyday use – but not too much
9

10. EOSCpilot is a project funded by the EC H2020 programme
 TEXTCROWD Official Pages:
https://eoscpilot.eu/science-demos/textcrowd
https://textcrowd.d4science.org
 TEXTCROWD Pilot:
https://services.d4science.org/group/textcrowd/data-miner
(registration required)
10

11. EOSCpilot is a project funded by the EC H2020 programme
1. Upload the file(s) to analyze
2. Launch TextCrowd
3. Select the file(s) to process
4. Collect the results

12. EOSCpilot is a project funded by the EC H2020 programme

13. EOSCpilot is a project funded by the EC H2020 programme

14. EOSCpilot is a project funded by the EC H2020 programme

15. EOSCpilot is a project funded by the EC H2020 programme

16. EOSCpilot is a project funded by the EC H2020 programme

17. EOSCpilot is a project funded by the EC H2020 programme

18. EOSCpilot is a project funded by the EC H2020 programme
Franco Niccolucci: franco.niccolucci@gmail.com – Achille Felicetti: achille.felicetti@pin.unifi.it