SlideShare uma empresa Scribd logo
1 de 40
Baixar para ler offline
H Y P E R S C A L E D I G I T A L A S S E T P L A T F O R M
U S I N G M O N G O D B T O B U I L D
A F A S T A N D S C A L A B L E
C O N T E N T R E P O S I T O R Y
N U X E O
P L AT F O R M
We provide a platform that
organisations can use to
drive digital transformation by
unlocking the full value of digital assets.
https://www.nuxeo.com
LEADER ON DIGITAL LOCAL INFORMATION MANAGEMENT:
Addresses, Phone Numbers, Activities of local businesses
USING NUXEO AS A CATALOG FOR INFORMATION ASSETS
HUNDREDS OF MILLIONS DOCUMENTS
AND UP TO DAILY 1 M BULK UPDATE
ADAPT THE BUSINESS / INCREASE MARKET POSITION
INFORMATION UPDATE DELIVERY REDUCED
FROM 1 YEAR TO 1H
N U X E O
P L AT F O R M
B E N E F I T S
SIMPLE SOFTWARE ARCHITECTURE
EASY SCALABILITY
HYPERSCALE PERFORMANCE
TRANSACTION MANAGEMENT
The Nuxeo + MongoDB Benefits
Large stream - Large storage
attached blobs
Flexible Schema - Write Once/Read Many
Audit Log, activity log
Complex structures - R/W synchronous
Document properties and hierarchy
Flexible Schema - Search
Search index
S I M P L E
A R C H I T E C T U R E
S I M P L E
A R C H I T E C T U R E
Large stream - Large storage
attached blobs
Flexible Schema - Write Once/Read Many
Audit Log, activity log
Complex structures - R/W synchronous
Document properties and hierarchy
Flexible Schema - Search
Search index
S C A L A B I L I T Y
H Y P E R S C A L E
P E R F O R M A N C E
The One Billion Benchmark
• 1 billion documents import in 8.5 hours
• 32,680 docs/s with peak at 40,400 docs/s
S I M P L E A R C H I T E C T U R E
N U X E O
P L AT F O R M
DOCUMENT REPOSITORY
No ORM Hell
S I M P L I C I T Y ?
Single
consolidated
storage
Out of the box
robust
deployment
I M P E D A N C E
M I S M AT C H
I S S U E
I M P E D A N C E
M I S M AT C H
I S S U E
I M P E D A N C E
M I S M AT C H
I S S U E
I M P E D A N C E
M I S M AT C H
I S S U E
NO LAZY LOADING
NO CACHE
NO INVALIDATION
A LOT OF COMPLEXITY AND PROBLEMS AVOIDED !
I M PA C T O N
D E P L O Y M E N T
I M PA C T O N
D E P L O Y M E N T
C O N S O L I D AT E D
S T O R A G E
Structures
AuditBlobs
Indexes
SINGLE CONSOLIDATED STORAGE
Structure, Blobs, Audit & Index
FEWER BUILDING BLOCKS TO PROVISION & CONFIGURE
Easier to deploy
E A S Y
D E P L O Y M E N T
"BUILT-IN" - DATA REDUNDANCY & FAULT TOLERANCE
Active
Active
S C A L A B I L I T Y
WILL I SCALE BETTER
WITH MONGODB ?
S C A L A B I L I T Y
S C A L E O U T R E A D S
S C A L E O U T W R I T E S
•Leverage sharding
•Spread Writes
•Leverages replicasets
•Read from secondaries
S C A L A B I L I T Y
S C A L E O U T T E S T
Use massive read operations and queries.
2 Nuxeo nodes + 1 MongoDB
node
1850 docs/s
MongoDB CPU is the
bottleneck (800%)
S C A L E O U T T E S T
Use massive read operations and queries.
2 Nuxeo nodes + 2 MongoDB nodes
3400 docs/s
(using read preferences)
S C A L A B I L I T Y
S C A L A B I L I T Y
S H A R D I N G T E S T
2 Nuxeo nodes
+
1 MongoDB ReplicaSet
11,000 docs/s
S C A L A B I L I T Y
S H A R D I N G T E S T
2 Nuxeo nodes
+
3 MongoDB Sharded ReplicaSet
27,400 docs/s
H Y P E R S C A L E
P E R F O R M A N C E
WILL I BE FASTER
WITH MONGODB ?
B U I LT F O R
S P E E D
N O I M P E D A N C E I S S U E
D O C U M E N T L E V E L L O C K I N G
• No table level concurrency
• Fewer backend calls
• No invalidation costs
N AT I V E D I S T R I B U T E D A R C H I T E C T U R E
• Easy scale out
S P E E D
https://benchmarks.nuxeo.com/continuous/index.html
Significant RAW Speed improvements for all use cases
More importantly: some use cases are much better handled
M O R E T H A N
R A W
P E R F O R M A N C E
• No cache
• Less Memory per connection
• Can handle more connection
• Can handle more concurrent users
Handle more concurrent connections
M O R E T H A N
R A W
P E R F O R M A N C E
With SQL, Read and Write operation are competing
M O R E T H A N
R A W
P E R F O R M A N C E
Writes are not blocked by Reads
With MongoDB writes operations are not blocked
M O R E T H A N
R A W
P E R F O R M A N C E
Large object processing improved
lazy loading
cache trashing
750 documents/s 11,500 documents/s
T R A N S A C T I O N M A N A G E M E N T
MEANS
• Different transaction paradigms
• Provide shared mitigation policies for critical use c
NEW STORAGE MODEL
• Document Level transaction
• No MVCC isolation
T R A N S A C T I O N
M A N A G E M E N T
C O N S I S T E N C Y
I N O U R C O N T E X T
Transactions can not span across multiple documents
• Atomic Document Operations are safe
• Large batch updates can not be Atomic
Multi-documents transactions can be problematic
Workflows or custom event handlers
FIND A WAY TO MITIGATE APPLICATION LEVEL IMPACT
C O N S I S T E N C Y
C O N S I S T E N C Y
TRANSIENT STATE MANAGER
Run all operations in Memory
Populate an Undo Log
Recover Application level Transaction Management
• Commit / Rollback model
"Read uncommited" isolation
• Need to flush transient state for queries
• "uncommited" changes are visible to others
TA K E A W AY S
Nuxeo
+
MongoDB
Simple
Architecture
Scalable &
Performant
Transaction
Management
Content Management + MongoDB
You should try Nuxeo !
A N Y Q U E S T I O N S ?
T H A N K Y O U !
https://github.com/nuxeo nuxeo.com/careers/ @damienmetzler

Mais conteúdo relacionado

Mais procurados

SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
Redis Labs
 
An Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDBAn Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDB
William LaForest
 
HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...
HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...
HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...
Michael Stack
 
An afternoon with mongo db new delhi
An afternoon with mongo db new delhiAn afternoon with mongo db new delhi
An afternoon with mongo db new delhi
Rajnish Verma
 

Mais procurados (20)

When to Use MongoDB
When to Use MongoDBWhen to Use MongoDB
When to Use MongoDB
 
The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...
The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...
The Happy Marriage of Redis and Protobuf by Scott Haines of Twilio - Redis Da...
 
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
SQL, Redis and Kubernetes by Paul Stanton of Windocks - Redis Day Seattle 2020
 
NoSQL and MongoDB Introdction
NoSQL and MongoDB IntrodctionNoSQL and MongoDB Introdction
NoSQL and MongoDB Introdction
 
Mongo db 3.4 Overview
Mongo db 3.4 OverviewMongo db 3.4 Overview
Mongo db 3.4 Overview
 
MongoDB Europe 2016 - Powering Microservices with Docker, Kubernetes, and Kafka
MongoDB Europe 2016 - Powering Microservices with Docker, Kubernetes, and KafkaMongoDB Europe 2016 - Powering Microservices with Docker, Kubernetes, and Kafka
MongoDB Europe 2016 - Powering Microservices with Docker, Kubernetes, and Kafka
 
GridFS: The Perfect Solution for Media Storage
GridFS: The Perfect Solution for Media StorageGridFS: The Perfect Solution for Media Storage
GridFS: The Perfect Solution for Media Storage
 
An Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDBAn Introduction to Big Data, NoSQL and MongoDB
An Introduction to Big Data, NoSQL and MongoDB
 
HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...
HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...
HBaseConAsia2018 Track2-3: Bringing MySQL Compatibility to HBase using Databa...
 
Sizing Your MongoDB Cluster
Sizing Your MongoDB ClusterSizing Your MongoDB Cluster
Sizing Your MongoDB Cluster
 
SQL To NoSQL - Top 6 Questions Before Making The Move
SQL To NoSQL - Top 6 Questions Before Making The MoveSQL To NoSQL - Top 6 Questions Before Making The Move
SQL To NoSQL - Top 6 Questions Before Making The Move
 
Power Real Estate Property Analytics with MongoDB + Spark
Power Real Estate Property Analytics with MongoDB + SparkPower Real Estate Property Analytics with MongoDB + Spark
Power Real Estate Property Analytics with MongoDB + Spark
 
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data StoresPresto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
Presto: Fast SQL-on-Anything Across Data Lakes, DBMS, and NoSQL Data Stores
 
MongoDB Administration 101
MongoDB Administration 101MongoDB Administration 101
MongoDB Administration 101
 
An afternoon with mongo db new delhi
An afternoon with mongo db new delhiAn afternoon with mongo db new delhi
An afternoon with mongo db new delhi
 
How Thermo Fisher is Reducing Data Analysis Times from Days to Minutes with M...
How Thermo Fisher is Reducing Data Analysis Times from Days to Minutes with M...How Thermo Fisher is Reducing Data Analysis Times from Days to Minutes with M...
How Thermo Fisher is Reducing Data Analysis Times from Days to Minutes with M...
 
Webinar : Nouveautés de MongoDB 3.2
Webinar : Nouveautés de MongoDB 3.2Webinar : Nouveautés de MongoDB 3.2
Webinar : Nouveautés de MongoDB 3.2
 
Introduction to MongoDB Enterprise
Introduction to MongoDB EnterpriseIntroduction to MongoDB Enterprise
Introduction to MongoDB Enterprise
 
Practical Design Patterns for Building Applications Resilient to Infrastructu...
Practical Design Patterns for Building Applications Resilient to Infrastructu...Practical Design Patterns for Building Applications Resilient to Infrastructu...
Practical Design Patterns for Building Applications Resilient to Infrastructu...
 
OpenIO ServerLess Storage
OpenIO ServerLess StorageOpenIO ServerLess Storage
OpenIO ServerLess Storage
 

Destaque

Destaque (20)

Accelerate Digital Transformation with Enterprise DAM
Accelerate Digital Transformation with Enterprise DAMAccelerate Digital Transformation with Enterprise DAM
Accelerate Digital Transformation with Enterprise DAM
 
Digital Asset Management in Nuxeo Platform LTS 2015
Digital Asset Management in Nuxeo Platform LTS 2015Digital Asset Management in Nuxeo Platform LTS 2015
Digital Asset Management in Nuxeo Platform LTS 2015
 
Recommendations for Complex Digital Asset Management
Recommendations for Complex Digital Asset ManagementRecommendations for Complex Digital Asset Management
Recommendations for Complex Digital Asset Management
 
Building our App with React Native
Building our App with React NativeBuilding our App with React Native
Building our App with React Native
 
New Tools for Developers
New Tools for DevelopersNew Tools for Developers
New Tools for Developers
 
Faiveley Transport: Nuxeo Platform, Socle Central des Besoins ECM du Groupe
Faiveley Transport: Nuxeo Platform, Socle Central des Besoins ECM du GroupeFaiveley Transport: Nuxeo Platform, Socle Central des Besoins ECM du Groupe
Faiveley Transport: Nuxeo Platform, Socle Central des Besoins ECM du Groupe
 
Best Practices in Enterprise Video and Digital Asset Management
Best Practices in Enterprise Video and Digital Asset ManagementBest Practices in Enterprise Video and Digital Asset Management
Best Practices in Enterprise Video and Digital Asset Management
 
Best Practices for Implementing a Product Information Management (PIM) System
Best Practices for Implementing a Product Information Management (PIM) SystemBest Practices for Implementing a Product Information Management (PIM) System
Best Practices for Implementing a Product Information Management (PIM) System
 
Nuxeo & React Native
Nuxeo & React Native Nuxeo & React Native
Nuxeo & React Native
 
Redefine Your Digital Asset Strategy for 2017
Redefine Your Digital Asset Strategy for 2017Redefine Your Digital Asset Strategy for 2017
Redefine Your Digital Asset Strategy for 2017
 
Comparing the code quality of ECMs
Comparing the code quality of ECMsComparing the code quality of ECMs
Comparing the code quality of ECMs
 
[Nuxeo World 2013] USING VAADIN TO INTEGRATE LIFERAY AND THE NUXEO PLATFORM -...
[Nuxeo World 2013] USING VAADIN TO INTEGRATE LIFERAY AND THE NUXEO PLATFORM -...[Nuxeo World 2013] USING VAADIN TO INTEGRATE LIFERAY AND THE NUXEO PLATFORM -...
[Nuxeo World 2013] USING VAADIN TO INTEGRATE LIFERAY AND THE NUXEO PLATFORM -...
 
5 Ways to Transform your Digital Content into Valuable Digital Assets
5 Ways to Transform your Digital Content into Valuable Digital Assets5 Ways to Transform your Digital Content into Valuable Digital Assets
5 Ways to Transform your Digital Content into Valuable Digital Assets
 
Release 8.1 - Breakfast Paris
Release 8.1 - Breakfast ParisRelease 8.1 - Breakfast Paris
Release 8.1 - Breakfast Paris
 
Manage Complex Digital Assets at Massive Scale
Manage Complex Digital Assets at Massive ScaleManage Complex Digital Assets at Massive Scale
Manage Complex Digital Assets at Massive Scale
 
Nuxeo Platform LTS 2015 - Opening Keynote Event 2015-10
Nuxeo Platform LTS 2015 - Opening Keynote Event 2015-10Nuxeo Platform LTS 2015 - Opening Keynote Event 2015-10
Nuxeo Platform LTS 2015 - Opening Keynote Event 2015-10
 
Nuxeo Platform LTS 2016 - Roadmap
Nuxeo Platform LTS 2016 - RoadmapNuxeo Platform LTS 2016 - Roadmap
Nuxeo Platform LTS 2016 - Roadmap
 
Managing Content with the Nuxeo Platform - CXP ECM Event
Managing Content with the Nuxeo Platform - CXP ECM EventManaging Content with the Nuxeo Platform - CXP ECM Event
Managing Content with the Nuxeo Platform - CXP ECM Event
 
Nuxeo Platform LTS 2015 Highlights
Nuxeo Platform LTS 2015 HighlightsNuxeo Platform LTS 2015 Highlights
Nuxeo Platform LTS 2015 Highlights
 
Nuxeo Fact Sheet
Nuxeo Fact SheetNuxeo Fact Sheet
Nuxeo Fact Sheet
 

Semelhante a Using MongoDB to Build a Fast and Scalable Content Repository

RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
Databricks
 
Big Data & Oracle Technologies
Big Data & Oracle TechnologiesBig Data & Oracle Technologies
Big Data & Oracle Technologies
Oleksii Movchaniuk
 
AWS reInvent 2018 Recap - Solutions Updates Part 2
AWS reInvent 2018 Recap - Solutions Updates Part 2AWS reInvent 2018 Recap - Solutions Updates Part 2
AWS reInvent 2018 Recap - Solutions Updates Part 2
Amazon Web Services
 

Semelhante a Using MongoDB to Build a Fast and Scalable Content Repository (20)

MongoDB Europe 2016 - Using MongoDB to Build a Fast and Scalable Content Repo...
MongoDB Europe 2016 - Using MongoDB to Build a Fast and Scalable Content Repo...MongoDB Europe 2016 - Using MongoDB to Build a Fast and Scalable Content Repo...
MongoDB Europe 2016 - Using MongoDB to Build a Fast and Scalable Content Repo...
 
The 12 Factor App
The 12 Factor AppThe 12 Factor App
The 12 Factor App
 
Azure Cosmos DB - NoSQL Strikes Back (An introduction to the dark side of you...
Azure Cosmos DB - NoSQL Strikes Back (An introduction to the dark side of you...Azure Cosmos DB - NoSQL Strikes Back (An introduction to the dark side of you...
Azure Cosmos DB - NoSQL Strikes Back (An introduction to the dark side of you...
 
SOA Latam 2015
SOA Latam 2015SOA Latam 2015
SOA Latam 2015
 
Containers: Don't Skeu Them Up (LinuxCon Dublin)
Containers: Don't Skeu Them Up (LinuxCon Dublin)Containers: Don't Skeu Them Up (LinuxCon Dublin)
Containers: Don't Skeu Them Up (LinuxCon Dublin)
 
Nebula Cloud9 Public Cloud (IaaS)
Nebula Cloud9 Public Cloud (IaaS)Nebula Cloud9 Public Cloud (IaaS)
Nebula Cloud9 Public Cloud (IaaS)
 
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
RubiOne: Apache Spark as the Backbone of a Retail Analytics Development Envir...
 
Delivering Rich Content Applications at Scale with Nuxeo & MongoDB Atlas
Delivering Rich Content Applications at Scale with Nuxeo & MongoDB AtlasDelivering Rich Content Applications at Scale with Nuxeo & MongoDB Atlas
Delivering Rich Content Applications at Scale with Nuxeo & MongoDB Atlas
 
Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview
Keynote 1: AWS re:Invent 2017 Recap - Solutions OverviewKeynote 1: AWS re:Invent 2017 Recap - Solutions Overview
Keynote 1: AWS re:Invent 2017 Recap - Solutions Overview
 
Building a Data Ingestion & Processing Pipeline with Spark & Airflow
Building a Data Ingestion & Processing Pipeline with Spark & AirflowBuilding a Data Ingestion & Processing Pipeline with Spark & Airflow
Building a Data Ingestion & Processing Pipeline with Spark & Airflow
 
Blockchain Scalability - Themes, Tools and Techniques
Blockchain Scalability - Themes, Tools and TechniquesBlockchain Scalability - Themes, Tools and Techniques
Blockchain Scalability - Themes, Tools and Techniques
 
Introducing Hyperleger
Introducing HyperlegerIntroducing Hyperleger
Introducing Hyperleger
 
Creating Modern Metadata Systems [FutureStack16 NYC]
Creating Modern Metadata Systems [FutureStack16 NYC]Creating Modern Metadata Systems [FutureStack16 NYC]
Creating Modern Metadata Systems [FutureStack16 NYC]
 
What is CRATE?
What is CRATE?What is CRATE?
What is CRATE?
 
Azure Cosmos DB L100 Pitch Deck
Azure Cosmos DB L100 Pitch DeckAzure Cosmos DB L100 Pitch Deck
Azure Cosmos DB L100 Pitch Deck
 
Big Data & Oracle Technologies
Big Data & Oracle TechnologiesBig Data & Oracle Technologies
Big Data & Oracle Technologies
 
Microservices Delivery Platform. Tips & Tricks
Microservices Delivery Platform. Tips & TricksMicroservices Delivery Platform. Tips & Tricks
Microservices Delivery Platform. Tips & Tricks
 
Azure Comsos DB Use Cases
Azure Comsos DB Use CasesAzure Comsos DB Use Cases
Azure Comsos DB Use Cases
 
AWS reInvent 2018 Recap - Solutions Updates Part 2
AWS reInvent 2018 Recap - Solutions Updates Part 2AWS reInvent 2018 Recap - Solutions Updates Part 2
AWS reInvent 2018 Recap - Solutions Updates Part 2
 
Creating Modern Metadata Systems with New Relic, Dow Jones [FutureStack16]
Creating Modern Metadata Systems with New Relic, Dow Jones [FutureStack16]Creating Modern Metadata Systems with New Relic, Dow Jones [FutureStack16]
Creating Modern Metadata Systems with New Relic, Dow Jones [FutureStack16]
 

Mais de Nuxeo

Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...
Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...
Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...
Nuxeo
 

Mais de Nuxeo (20)

Own the Digital Shelf Strategies Food and Beverage Companies
Own the Digital Shelf Strategies Food and Beverage CompaniesOwn the Digital Shelf Strategies Food and Beverage Companies
Own the Digital Shelf Strategies Food and Beverage Companies
 
How DAM Librarians Can Get Ready for the Uncertain Future
How DAM Librarians Can Get Ready for the Uncertain FutureHow DAM Librarians Can Get Ready for the Uncertain Future
How DAM Librarians Can Get Ready for the Uncertain Future
 
How Insurers Fueled Transformation During a Pandemic
How Insurers Fueled Transformation During a PandemicHow Insurers Fueled Transformation During a Pandemic
How Insurers Fueled Transformation During a Pandemic
 
Manage your Content at Scale with MongoDB and Nuxeo
Manage your Content at Scale with MongoDB and NuxeoManage your Content at Scale with MongoDB and Nuxeo
Manage your Content at Scale with MongoDB and Nuxeo
 
Accelerate the Digital Supply Chain From Idea to Support
Accelerate the Digital Supply Chain From Idea to SupportAccelerate the Digital Supply Chain From Idea to Support
Accelerate the Digital Supply Chain From Idea to Support
 
Where are you in the DAM Continuum
Where are you in the DAM ContinuumWhere are you in the DAM Continuum
Where are you in the DAM Continuum
 
Customer Experience in 2021
Customer Experience in 2021Customer Experience in 2021
Customer Experience in 2021
 
L’IA personnalisée, clé d’une gestion de l’information innovante
L’IA personnalisée, clé d’une gestion de l’information innovanteL’IA personnalisée, clé d’une gestion de l’information innovante
L’IA personnalisée, clé d’une gestion de l’information innovante
 
Gérer ses contenus avec MongoDB et Nuxeo
Gérer ses contenus avec MongoDB et NuxeoGérer ses contenus avec MongoDB et Nuxeo
Gérer ses contenus avec MongoDB et Nuxeo
 
Le DAM en 2021 : Tendances, points clés et critères d'évaluation
Le DAM en 2021 : Tendances, points clés et critères d'évaluationLe DAM en 2021 : Tendances, points clés et critères d'évaluation
Le DAM en 2021 : Tendances, points clés et critères d'évaluation
 
Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...
Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...
Enabling Digital Transformation Amidst a Global Pandemic | Low-Code, Cloud, A...
 
Elevate your Customer's Experience and Stay Ahead of the Competition
Elevate your Customer's Experience and Stay Ahead of the CompetitionElevate your Customer's Experience and Stay Ahead of the Competition
Elevate your Customer's Experience and Stay Ahead of the Competition
 
Driving Brand Loyalty Through Superior Customer Experience
Driving Brand Loyalty Through Superior Customer Experience Driving Brand Loyalty Through Superior Customer Experience
Driving Brand Loyalty Through Superior Customer Experience
 
Drive Enterprise Speed and Scale with A Cloud-Native DAM
Drive Enterprise Speed and Scale with A Cloud-Native DAMDrive Enterprise Speed and Scale with A Cloud-Native DAM
Drive Enterprise Speed and Scale with A Cloud-Native DAM
 
The Big Picture: the Role of Video, Photography, and Content in Enhancing the...
The Big Picture: the Role of Video, Photography, and Content in Enhancing the...The Big Picture: the Role of Video, Photography, and Content in Enhancing the...
The Big Picture: the Role of Video, Photography, and Content in Enhancing the...
 
How Creatives Are Getting Creative in 2020 and Beyond
How Creatives Are Getting Creative in 2020 and BeyondHow Creatives Are Getting Creative in 2020 and Beyond
How Creatives Are Getting Creative in 2020 and Beyond
 
Digitalisation : Améliorez la collaboration et l’expérience client grâce au DAM
Digitalisation : Améliorez la collaboration et l’expérience client grâce au DAMDigitalisation : Améliorez la collaboration et l’expérience client grâce au DAM
Digitalisation : Améliorez la collaboration et l’expérience client grâce au DAM
 
Reimagine Your Claims Process with Future-Proof Technologies
Reimagine Your Claims Process with Future-Proof TechnologiesReimagine Your Claims Process with Future-Proof Technologies
Reimagine Your Claims Process with Future-Proof Technologies
 
Comment le Centre Hospitalier Laborit dématérialise ses processus administratifs
Comment le Centre Hospitalier Laborit dématérialise ses processus administratifsComment le Centre Hospitalier Laborit dématérialise ses processus administratifs
Comment le Centre Hospitalier Laborit dématérialise ses processus administratifs
 
Accelerating the Packaging Design Process with Artificial Intelligence
Accelerating the Packaging Design Process with Artificial IntelligenceAccelerating the Packaging Design Process with Artificial Intelligence
Accelerating the Packaging Design Process with Artificial Intelligence
 

Último

Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
chiefasafspells
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
masabamasaba
 
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
masabamasaba
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
masabamasaba
 
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg
 

Último (20)

Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...
 
WSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go PlatformlessWSO2CON2024 - It's time to go Platformless
WSO2CON2024 - It's time to go Platformless
 
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park %in kempton park+277-882-255-28 abortion pills for sale in kempton park
%in kempton park+277-882-255-28 abortion pills for sale in kempton park
 
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park %in ivory park+277-882-255-28 abortion pills for sale in ivory park
%in ivory park+277-882-255-28 abortion pills for sale in ivory park
 
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
%in Rustenburg+277-882-255-28 abortion pills for sale in Rustenburg
 
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
%+27788225528 love spells in Huntington Beach Psychic Readings, Attraction sp...
 
WSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - KeynoteWSO2Con204 - Hard Rock Presentation - Keynote
WSO2Con204 - Hard Rock Presentation - Keynote
 
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...
 
AI & Machine Learning Presentation Template
AI & Machine Learning Presentation TemplateAI & Machine Learning Presentation Template
AI & Machine Learning Presentation Template
 
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
MarTech Trend 2024 Book : Marketing Technology Trends (2024 Edition) How Data...
 
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With SimplicityWSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
WSO2Con2024 - Enabling Transactional System's Exponential Growth With Simplicity
 
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
WSO2CON 2024 - API Management Usage at La Poste and Its Impact on Business an...
 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
 
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...
 
Announcing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK SoftwareAnnouncing Codolex 2.0 from GDK Software
Announcing Codolex 2.0 from GDK Software
 
WSO2CON 2024 - How to Run a Security Program
WSO2CON 2024 - How to Run a Security ProgramWSO2CON 2024 - How to Run a Security Program
WSO2CON 2024 - How to Run a Security Program
 
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
%+27788225528 love spells in Toronto Psychic Readings, Attraction spells,Brin...
 
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...
 
%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand%in Midrand+277-882-255-28 abortion pills for sale in midrand
%in Midrand+277-882-255-28 abortion pills for sale in midrand
 
WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?WSO2CON 2024 - Does Open Source Still Matter?
WSO2CON 2024 - Does Open Source Still Matter?
 

Using MongoDB to Build a Fast and Scalable Content Repository

  • 1. H Y P E R S C A L E D I G I T A L A S S E T P L A T F O R M
  • 2. U S I N G M O N G O D B T O B U I L D A F A S T A N D S C A L A B L E C O N T E N T R E P O S I T O R Y
  • 3. N U X E O P L AT F O R M We provide a platform that organisations can use to drive digital transformation by unlocking the full value of digital assets. https://www.nuxeo.com
  • 4. LEADER ON DIGITAL LOCAL INFORMATION MANAGEMENT: Addresses, Phone Numbers, Activities of local businesses USING NUXEO AS A CATALOG FOR INFORMATION ASSETS HUNDREDS OF MILLIONS DOCUMENTS AND UP TO DAILY 1 M BULK UPDATE ADAPT THE BUSINESS / INCREASE MARKET POSITION INFORMATION UPDATE DELIVERY REDUCED FROM 1 YEAR TO 1H
  • 5. N U X E O P L AT F O R M B E N E F I T S SIMPLE SOFTWARE ARCHITECTURE EASY SCALABILITY HYPERSCALE PERFORMANCE TRANSACTION MANAGEMENT The Nuxeo + MongoDB Benefits
  • 6. Large stream - Large storage attached blobs Flexible Schema - Write Once/Read Many Audit Log, activity log Complex structures - R/W synchronous Document properties and hierarchy Flexible Schema - Search Search index S I M P L E A R C H I T E C T U R E
  • 7. S I M P L E A R C H I T E C T U R E Large stream - Large storage attached blobs Flexible Schema - Write Once/Read Many Audit Log, activity log Complex structures - R/W synchronous Document properties and hierarchy Flexible Schema - Search Search index
  • 8. S C A L A B I L I T Y
  • 9. H Y P E R S C A L E P E R F O R M A N C E The One Billion Benchmark • 1 billion documents import in 8.5 hours • 32,680 docs/s with peak at 40,400 docs/s
  • 10. S I M P L E A R C H I T E C T U R E
  • 11. N U X E O P L AT F O R M DOCUMENT REPOSITORY
  • 12. No ORM Hell S I M P L I C I T Y ? Single consolidated storage Out of the box robust deployment
  • 13. I M P E D A N C E M I S M AT C H I S S U E
  • 14. I M P E D A N C E M I S M AT C H I S S U E
  • 15. I M P E D A N C E M I S M AT C H I S S U E
  • 16. I M P E D A N C E M I S M AT C H I S S U E NO LAZY LOADING NO CACHE NO INVALIDATION A LOT OF COMPLEXITY AND PROBLEMS AVOIDED !
  • 17. I M PA C T O N D E P L O Y M E N T
  • 18. I M PA C T O N D E P L O Y M E N T
  • 19. C O N S O L I D AT E D S T O R A G E Structures AuditBlobs Indexes SINGLE CONSOLIDATED STORAGE Structure, Blobs, Audit & Index FEWER BUILDING BLOCKS TO PROVISION & CONFIGURE Easier to deploy
  • 20. E A S Y D E P L O Y M E N T "BUILT-IN" - DATA REDUNDANCY & FAULT TOLERANCE Active Active
  • 21. S C A L A B I L I T Y WILL I SCALE BETTER WITH MONGODB ?
  • 22. S C A L A B I L I T Y S C A L E O U T R E A D S S C A L E O U T W R I T E S •Leverage sharding •Spread Writes •Leverages replicasets •Read from secondaries
  • 23. S C A L A B I L I T Y S C A L E O U T T E S T Use massive read operations and queries. 2 Nuxeo nodes + 1 MongoDB node 1850 docs/s MongoDB CPU is the bottleneck (800%)
  • 24. S C A L E O U T T E S T Use massive read operations and queries. 2 Nuxeo nodes + 2 MongoDB nodes 3400 docs/s (using read preferences) S C A L A B I L I T Y
  • 25. S C A L A B I L I T Y S H A R D I N G T E S T 2 Nuxeo nodes + 1 MongoDB ReplicaSet 11,000 docs/s
  • 26. S C A L A B I L I T Y S H A R D I N G T E S T 2 Nuxeo nodes + 3 MongoDB Sharded ReplicaSet 27,400 docs/s
  • 27. H Y P E R S C A L E P E R F O R M A N C E WILL I BE FASTER WITH MONGODB ?
  • 28. B U I LT F O R S P E E D N O I M P E D A N C E I S S U E D O C U M E N T L E V E L L O C K I N G • No table level concurrency • Fewer backend calls • No invalidation costs N AT I V E D I S T R I B U T E D A R C H I T E C T U R E • Easy scale out
  • 29. S P E E D https://benchmarks.nuxeo.com/continuous/index.html Significant RAW Speed improvements for all use cases More importantly: some use cases are much better handled
  • 30. M O R E T H A N R A W P E R F O R M A N C E • No cache • Less Memory per connection • Can handle more connection • Can handle more concurrent users Handle more concurrent connections
  • 31. M O R E T H A N R A W P E R F O R M A N C E With SQL, Read and Write operation are competing
  • 32. M O R E T H A N R A W P E R F O R M A N C E Writes are not blocked by Reads With MongoDB writes operations are not blocked
  • 33. M O R E T H A N R A W P E R F O R M A N C E Large object processing improved lazy loading cache trashing 750 documents/s 11,500 documents/s
  • 34. T R A N S A C T I O N M A N A G E M E N T
  • 35. MEANS • Different transaction paradigms • Provide shared mitigation policies for critical use c NEW STORAGE MODEL • Document Level transaction • No MVCC isolation T R A N S A C T I O N M A N A G E M E N T
  • 36. C O N S I S T E N C Y I N O U R C O N T E X T Transactions can not span across multiple documents • Atomic Document Operations are safe • Large batch updates can not be Atomic Multi-documents transactions can be problematic Workflows or custom event handlers FIND A WAY TO MITIGATE APPLICATION LEVEL IMPACT
  • 37. C O N S I S T E N C Y
  • 38. C O N S I S T E N C Y TRANSIENT STATE MANAGER Run all operations in Memory Populate an Undo Log Recover Application level Transaction Management • Commit / Rollback model "Read uncommited" isolation • Need to flush transient state for queries • "uncommited" changes are visible to others
  • 39. TA K E A W AY S Nuxeo + MongoDB Simple Architecture Scalable & Performant Transaction Management Content Management + MongoDB You should try Nuxeo !
  • 40. A N Y Q U E S T I O N S ? T H A N K Y O U ! https://github.com/nuxeo nuxeo.com/careers/ @damienmetzler