SlideShare uma empresa Scribd logo
1 de 7
Baixar para ler offline
FROM DATA SILOS TO
MULTI-SOURCES AND MULTI-AGENTS
COGNITIVE PLATFORMS
AYMERIC BRISSE
XLDB 2017 – LIGHTNING TALK
Big Data
| Applications
• NoSQL & distributed FS address the storage and access issues (Cassandra, CephFS, etc.)
• Data scientist & Machine Learning address the valuable information extraction issues
• This allows awesome services to be built (image recognition, recommandation, etc.)
• How to make these different services & data silos interoperable to cross-reference the data?
• How to make intelligible the mass of data now available to meet specific business needs?
2
| New challenges
Use case
| Example
• A TV Channel receives various content (footages, pictures, wires) from dozens of news agencies
• Automate the valuable information extraction
• Retrieve structured & intelligible information (who, where, what)
3
Cognitive Platform
4
| Workflow driven, based on multi-agents
Knowledge Graph
5
| Exploitable & Interoperable information
Stack
| Under the hood
6
• Base - Openshift (Kubernetes with Docker containers & DevOps tools)
• Runtime - One Docker image per Agent
• Communication - RabbitMQ for message delivery
• Databases - Various
• Storage - Ceph
• DevOps Philosophy - « 12-Factor App » (https://12factor.net/)
Aymeric BRISSE - CTO
aymeric.brisse@perfect-memory.com

Mais conteúdo relacionado

Mais procurados

Cloud computing big data
Cloud computing   big dataCloud computing   big data
Cloud computing big data
racsor
 
Collaborative Knowledge Management in Drupal
Collaborative Knowledge Management in DrupalCollaborative Knowledge Management in Drupal
Collaborative Knowledge Management in Drupal
David Geerts
 

Mais procurados (19)

Build an Open Source Data Lake For Data Scientists
Build an Open Source Data Lake For Data ScientistsBuild an Open Source Data Lake For Data Scientists
Build an Open Source Data Lake For Data Scientists
 
Governance model for cloud computing in building information management
Governance model for cloud computing in building information managementGovernance model for cloud computing in building information management
Governance model for cloud computing in building information management
 
Cloud Viz 2 Viz Libraries: A Study
Cloud Viz 2 Viz Libraries: A StudyCloud Viz 2 Viz Libraries: A Study
Cloud Viz 2 Viz Libraries: A Study
 
Useful data presentation from DataShaka
Useful data presentation from DataShakaUseful data presentation from DataShaka
Useful data presentation from DataShaka
 
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
MongoDB IoT City Tour LONDON: Managing the Database Complexity, by Arthur Vie...
 
Cloud computing big data
Cloud computing   big dataCloud computing   big data
Cloud computing big data
 
OpenLayers for Drupal: The 10,000 Foot View
OpenLayers for Drupal: The 10,000 Foot ViewOpenLayers for Drupal: The 10,000 Foot View
OpenLayers for Drupal: The 10,000 Foot View
 
Usecase IIIF at the National Archives
Usecase IIIF at the National ArchivesUsecase IIIF at the National Archives
Usecase IIIF at the National Archives
 
A Gentle Introduction to Big Data
A Gentle Introduction to Big DataA Gentle Introduction to Big Data
A Gentle Introduction to Big Data
 
Planet lab : cloud vs grid computing
Planet lab : cloud vs grid computingPlanet lab : cloud vs grid computing
Planet lab : cloud vs grid computing
 
Mundi Presentation - A Space of New Opportunities
Mundi Presentation - A Space of New OpportunitiesMundi Presentation - A Space of New Opportunities
Mundi Presentation - A Space of New Opportunities
 
HPC as a Service
HPC as a ServiceHPC as a Service
HPC as a Service
 
[Nuxeo World 2013] CREATE AN IOS APPLICATION WITH NUXEO - JEAN-MARC ORLIAGUET...
[Nuxeo World 2013] CREATE AN IOS APPLICATION WITH NUXEO - JEAN-MARC ORLIAGUET...[Nuxeo World 2013] CREATE AN IOS APPLICATION WITH NUXEO - JEAN-MARC ORLIAGUET...
[Nuxeo World 2013] CREATE AN IOS APPLICATION WITH NUXEO - JEAN-MARC ORLIAGUET...
 
Tran Minh: big data platform in high performance computing at NISCI
Tran Minh: big data platform in high performance computing at NISCITran Minh: big data platform in high performance computing at NISCI
Tran Minh: big data platform in high performance computing at NISCI
 
TYPO3 and CMIS
TYPO3 and CMISTYPO3 and CMIS
TYPO3 and CMIS
 
TCO Services
TCO ServicesTCO Services
TCO Services
 
Physical design relational_db_devanshu
Physical design relational_db_devanshuPhysical design relational_db_devanshu
Physical design relational_db_devanshu
 
Few Things You Should Know About Payday Loans
Few Things You Should Know About Payday LoansFew Things You Should Know About Payday Loans
Few Things You Should Know About Payday Loans
 
Collaborative Knowledge Management in Drupal
Collaborative Knowledge Management in DrupalCollaborative Knowledge Management in Drupal
Collaborative Knowledge Management in Drupal
 

Semelhante a XLDB2017 : From Data Silos to Multi-Sources and Multi-Agents Cognitive Platforms

Data Tactics dhs introduction to cloud technologies wtc
Data Tactics dhs introduction to cloud technologies wtcData Tactics dhs introduction to cloud technologies wtc
Data Tactics dhs introduction to cloud technologies wtc
DataTactics
 
Clould Computing and its application in Libraries
Clould Computing and its application in LibrariesClould Computing and its application in Libraries
Clould Computing and its application in Libraries
Amit Shaw
 
Getting to 1.5M Ads/sec: How DataXu manages Big Data
Getting to 1.5M Ads/sec: How DataXu manages Big DataGetting to 1.5M Ads/sec: How DataXu manages Big Data
Getting to 1.5M Ads/sec: How DataXu manages Big Data
Qubole
 

Semelhante a XLDB2017 : From Data Silos to Multi-Sources and Multi-Agents Cognitive Platforms (20)

Big data and cloud computing 9 sep-2017
Big data and cloud computing 9 sep-2017Big data and cloud computing 9 sep-2017
Big data and cloud computing 9 sep-2017
 
Data Tactics dhs introduction to cloud technologies wtc
Data Tactics dhs introduction to cloud technologies wtcData Tactics dhs introduction to cloud technologies wtc
Data Tactics dhs introduction to cloud technologies wtc
 
Big data and cloud
Big data and cloudBig data and cloud
Big data and cloud
 
CC Notes.pdf of jdjejwiwu22u28938ehdh3y2u2838e
CC Notes.pdf of jdjejwiwu22u28938ehdh3y2u2838eCC Notes.pdf of jdjejwiwu22u28938ehdh3y2u2838e
CC Notes.pdf of jdjejwiwu22u28938ehdh3y2u2838e
 
Introduction to Cloud Computing
Introduction to Cloud ComputingIntroduction to Cloud Computing
Introduction to Cloud Computing
 
Unit-I: Introduction to Cloud Computing
Unit-I: Introduction to Cloud ComputingUnit-I: Introduction to Cloud Computing
Unit-I: Introduction to Cloud Computing
 
fundamentals of iot cloud computing.pptx
fundamentals of iot cloud computing.pptxfundamentals of iot cloud computing.pptx
fundamentals of iot cloud computing.pptx
 
Cloud101-Introduction to cloud
Cloud101-Introduction to cloud Cloud101-Introduction to cloud
Cloud101-Introduction to cloud
 
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
Advanced Spark and TensorFlow Meetup - Dec 12 2017 - Dong Meng, MapR + Kubern...
 
Cloud computing 13 principal enabling technologies
Cloud computing 13 principal  enabling technologiesCloud computing 13 principal  enabling technologies
Cloud computing 13 principal enabling technologies
 
Planning for the Cloud
Planning for the CloudPlanning for the Cloud
Planning for the Cloud
 
Clould Computing and its application in Libraries
Clould Computing and its application in LibrariesClould Computing and its application in Libraries
Clould Computing and its application in Libraries
 
Getting to 1.5M Ads/sec: How DataXu manages Big Data
Getting to 1.5M Ads/sec: How DataXu manages Big DataGetting to 1.5M Ads/sec: How DataXu manages Big Data
Getting to 1.5M Ads/sec: How DataXu manages Big Data
 
Cloud computingjun28
Cloud computingjun28Cloud computingjun28
Cloud computingjun28
 
Cloud computingjun28
Cloud computingjun28Cloud computingjun28
Cloud computingjun28
 
Mahika cloud services
Mahika cloud servicesMahika cloud services
Mahika cloud services
 
Supporting Research through "Desktop as a Service" models of e-infrastructure...
Supporting Research through "Desktop as a Service" models of e-infrastructure...Supporting Research through "Desktop as a Service" models of e-infrastructure...
Supporting Research through "Desktop as a Service" models of e-infrastructure...
 
Bringing Structure, Scalability, and Services to Cloud-Scale Storage
Bringing Structure, Scalability, and Services to Cloud-Scale StorageBringing Structure, Scalability, and Services to Cloud-Scale Storage
Bringing Structure, Scalability, and Services to Cloud-Scale Storage
 
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
Manage Microservices & Fast Data Systems on One Platform w/ DC/OSManage Microservices & Fast Data Systems on One Platform w/ DC/OS
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
 
Gridnetworks.ppt
Gridnetworks.pptGridnetworks.ppt
Gridnetworks.ppt
 

Último

Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...
Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...
Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...
Lovely Professional University
 
Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..
MaherOthman7
 
ALCOHOL PRODUCTION- Beer Brewing Process.pdf
ALCOHOL PRODUCTION- Beer Brewing Process.pdfALCOHOL PRODUCTION- Beer Brewing Process.pdf
ALCOHOL PRODUCTION- Beer Brewing Process.pdf
Madan Karki
 

Último (20)

Low rpm Generator for efficient energy harnessing from a two stage wind turbine
Low rpm Generator for efficient energy harnessing from a two stage wind turbineLow rpm Generator for efficient energy harnessing from a two stage wind turbine
Low rpm Generator for efficient energy harnessing from a two stage wind turbine
 
Involute of a circle,Square, pentagon,HexagonInvolute_Engineering Drawing.pdf
Involute of a circle,Square, pentagon,HexagonInvolute_Engineering Drawing.pdfInvolute of a circle,Square, pentagon,HexagonInvolute_Engineering Drawing.pdf
Involute of a circle,Square, pentagon,HexagonInvolute_Engineering Drawing.pdf
 
Theory for How to calculation capacitor bank
Theory for How to calculation capacitor bankTheory for How to calculation capacitor bank
Theory for How to calculation capacitor bank
 
BORESCOPE INSPECTION for engins CFM56.pdf
BORESCOPE INSPECTION for engins CFM56.pdfBORESCOPE INSPECTION for engins CFM56.pdf
BORESCOPE INSPECTION for engins CFM56.pdf
 
Research Methodolgy & Intellectual Property Rights Series 2
Research Methodolgy & Intellectual Property Rights Series 2Research Methodolgy & Intellectual Property Rights Series 2
Research Methodolgy & Intellectual Property Rights Series 2
 
AI in Healthcare Innovative use cases and applications.pdf
AI in Healthcare Innovative use cases and applications.pdfAI in Healthcare Innovative use cases and applications.pdf
AI in Healthcare Innovative use cases and applications.pdf
 
Filters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility ApplicationsFilters for Electromagnetic Compatibility Applications
Filters for Electromagnetic Compatibility Applications
 
Electrical shop management system project report.pdf
Electrical shop management system project report.pdfElectrical shop management system project report.pdf
Electrical shop management system project report.pdf
 
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
The battle for RAG, explore the pros and cons of using KnowledgeGraphs and Ve...
 
Electrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission lineElectrostatic field in a coaxial transmission line
Electrostatic field in a coaxial transmission line
 
Seismic Hazard Assessment Software in Python by Prof. Dr. Costas Sachpazis
Seismic Hazard Assessment Software in Python by Prof. Dr. Costas SachpazisSeismic Hazard Assessment Software in Python by Prof. Dr. Costas Sachpazis
Seismic Hazard Assessment Software in Python by Prof. Dr. Costas Sachpazis
 
Piping and instrumentation diagram p.pdf
Piping and instrumentation diagram p.pdfPiping and instrumentation diagram p.pdf
Piping and instrumentation diagram p.pdf
 
Insurance management system project report.pdf
Insurance management system project report.pdfInsurance management system project report.pdf
Insurance management system project report.pdf
 
Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...
Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...
Activity Planning: Objectives, Project Schedule, Network Planning Model. Time...
 
Research Methodolgy & Intellectual Property Rights Series 1
Research Methodolgy & Intellectual Property Rights Series 1Research Methodolgy & Intellectual Property Rights Series 1
Research Methodolgy & Intellectual Property Rights Series 1
 
How to Design and spec harmonic filter.pdf
How to Design and spec harmonic filter.pdfHow to Design and spec harmonic filter.pdf
How to Design and spec harmonic filter.pdf
 
analog-vs-digital-communication (concept of analog and digital).pptx
analog-vs-digital-communication (concept of analog and digital).pptxanalog-vs-digital-communication (concept of analog and digital).pptx
analog-vs-digital-communication (concept of analog and digital).pptx
 
Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..Maher Othman Interior Design Portfolio..
Maher Othman Interior Design Portfolio..
 
ALCOHOL PRODUCTION- Beer Brewing Process.pdf
ALCOHOL PRODUCTION- Beer Brewing Process.pdfALCOHOL PRODUCTION- Beer Brewing Process.pdf
ALCOHOL PRODUCTION- Beer Brewing Process.pdf
 
Module-III Varried Flow.pptx GVF Definition, Water Surface Profile Dynamic Eq...
Module-III Varried Flow.pptx GVF Definition, Water Surface Profile Dynamic Eq...Module-III Varried Flow.pptx GVF Definition, Water Surface Profile Dynamic Eq...
Module-III Varried Flow.pptx GVF Definition, Water Surface Profile Dynamic Eq...
 

XLDB2017 : From Data Silos to Multi-Sources and Multi-Agents Cognitive Platforms

  • 1. FROM DATA SILOS TO MULTI-SOURCES AND MULTI-AGENTS COGNITIVE PLATFORMS AYMERIC BRISSE XLDB 2017 – LIGHTNING TALK
  • 2. Big Data | Applications • NoSQL & distributed FS address the storage and access issues (Cassandra, CephFS, etc.) • Data scientist & Machine Learning address the valuable information extraction issues • This allows awesome services to be built (image recognition, recommandation, etc.) • How to make these different services & data silos interoperable to cross-reference the data? • How to make intelligible the mass of data now available to meet specific business needs? 2 | New challenges
  • 3. Use case | Example • A TV Channel receives various content (footages, pictures, wires) from dozens of news agencies • Automate the valuable information extraction • Retrieve structured & intelligible information (who, where, what) 3
  • 4. Cognitive Platform 4 | Workflow driven, based on multi-agents
  • 5. Knowledge Graph 5 | Exploitable & Interoperable information
  • 6. Stack | Under the hood 6 • Base - Openshift (Kubernetes with Docker containers & DevOps tools) • Runtime - One Docker image per Agent • Communication - RabbitMQ for message delivery • Databases - Various • Storage - Ceph • DevOps Philosophy - « 12-Factor App » (https://12factor.net/)
  • 7. Aymeric BRISSE - CTO aymeric.brisse@perfect-memory.com