SlideShare uma empresa Scribd logo
1 de 20
Baixar para ler offline
Slide 1 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Diane Burley
MarkLogic
Jason Hunter
MarkLogic
Databases, CAP, ACID, BASE, NoSQL... Oh My!
#MarkLogic
Slide 2 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
What we can agree NoSQL is …
 It’s Not Only SQL
 A Break from
Relational Model
 Solves a different
type of problem
Slide 3 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
NoSQL MarkLogic
 Schema-
agnostic
 Massive Scale
 Commodity
hardware
 Rapid
development
 Hadoop
sink/source
 “Free”
 Community
 Search
 Universal
Indexes
 Transactional
 Security
 Enterprise
hardened
Examples:
• MongoDB
• Couchbase
• HBase
• Cassandra
• Accumulo
• Riak
• …
Slide 4 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
RDBMS MarkLogic
 Secure
 Enterprise
hardened
 Indexes
(tabular)
 SQL
 Analytics
 Incumbent
 “Free”
 Career path
 Search
 Scale-out on
Commodity
hardware
 Rapid
development
 Schema-
agnostic
 Universal
Indexes
Examples:
• Oracle
• SQLServer
• DB2
• MySQL
• Postgres
• …
Slide 5 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Search
Engine
MarkLogic
 Indexes
(text, fields)
 Schema-
agnostic
 Community
 “Free”
 Real-time
 Structure aware
 Rapid
development
 Consistency
 Transactional
 Scale-out
 Enterprise
hardened
 AnalyticsExamples:
• ElasticSearch
• Solr
• Lucene
• FAST
Slide 6 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Hadoop MarkLogic
 Commodity
hardware
 Scale-out
 “SQL”
 HDFS
 Real-time &
batch analytics
 “Free”
 Community
 Batch
 Real-time
 Indexes
 Secure
 Consistent
 Enterprise
hardened
Examples:
• Cloudera
• Hortonworks
• MapR
• Apache
• …
Slide 7 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
ATOM vs BASE
ATOM BASE
Strong Consistency Weak Consistency – stale data OK
Isolation Last Write Wins
Transaction Programmer Managed
Available/Consistent Available/Partition-Tolerant
Robust Database/Simpler Code Simpler database, harder code
Slide 8 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Real Value From Big Data
Make The World More Secure
Provide Access To Valuable Information
Create New Revenue Streams
Gain Insights to Increase Market Share
Reduce Bottom Line Expense
The FAA enhances airline safety
with real-time monitoring.
Slide 10 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
The FAA enhances airline safety with
real-time monitoring & dashboards.
Monitor and track emergencies and severe
weather, and update a real-time dashboard for
crisis management.
Goals
Proof of concept complete in 2 weeks. Entire
system went from purchase to Beta in 6
months. Able to deliver mission-critical system
that had previously failed on RDBMS.
Benefits
ChallengesRepository for multi-source, complex, multi-
structured data; supports geospatial enrichment,
faceted navigation & search; integrated with
Google Earth, Microsoft SharePoint & internal
systems.
Solution
Weather
reports
Social
media
Share
Point
Airline
informa
tion
GEMSInternal
System
s
Load data “as is”
SEARCH
“Global Oil Co.” makes real-time trading decisions
based on real-time, global information.
Slide 12 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
We help “Global Oil Co.” maximise their price
advantage when buying or selling oil.
Get a complete picture of oil and gas market
influencers to maximise profits.
Goals
ChallengesSystem pulls in real-time political, weather,
vessel data, location, terminal data and trading
data, and sends alerts to traders to notify them
of noteworthy issues, so they can make fastest
decisions possible.
Solution
Traders use the system to ensure they are
able to get the best price on the market.
Reduced Total Cost of Ownership (TCO) by
75%
BenefitsNotify me if…..
 More than “mmm” barrels of crude
are in transit in the Gulf of Arabia
 Severe weather in excess of force
8 scheduled to hit Gulf of Mexico
Medicare and Medicaid (CMS) helps customers easily
research, select and enroll in the right insurance plan...
while ensuring that the systems are
future-proof and can adapt to change.
Slide 14 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
CMS has a future-proof system that can easily
adapt to change.
Citizens, providers,
payers can identify, verify
and enroll in selected
insurance plan
Different insurance, eligibility sources from 50 states, federal agencies,
medical providers and payers, and potentially 30-50 million citizens
Load data “as is”
UNIFIED DATA
Slide 15 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
New Generation Fraud Prevention
Analytics
Profile Configuration
Tools
Profile Data Extracted
from Claims Data
Provider and
Beneficiary
Profiles
The Press Association & BBC let you connect to your
favorite team – even from thousands of miles away.
Slide 17 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
BBC Sport Video Supply Chain
Slide 18 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
Global browsers across the games
Some Numbers Behind the Olympics
55 Million
Record of global browsers in single day9.5 Million
Requests for BBC Olympic video content106 Million
UK browsers from Mobile Devices9.2 Million
Requests for Mobile Video12 Million
Data delivered in the busiest day2.8 Petabytes
Data requests over the 2 Olympics45 Billion
Daily average queries against web and mobile services2,160,000,000
Average transactions PER SECOND25,000
Slide 19 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
What is Coming Next?
Slide 20 Copyright © 2013 MarkLogic® Corporation. All rights reserved.
To Find Out More
Jason Hunter <Jason.Hunter@marklogic.com>
Diane Burley <Diane.Burley@marklogic.com>
Paper:

Mais conteúdo relacionado

Mais procurados

StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)
StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)
StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)NUMOSYS
 
The State of the Cloud Report 2017
The State of the Cloud Report 2017 The State of the Cloud Report 2017
The State of the Cloud Report 2017 Anna Khan
 
Bessemer Venture Partners' 2015 State of the Cloud
Bessemer Venture Partners' 2015 State of the CloudBessemer Venture Partners' 2015 State of the Cloud
Bessemer Venture Partners' 2015 State of the CloudBessemer Venture Partners
 
Wayfair.com Q2 2015 Results Presentation
Wayfair.com Q2 2015 Results PresentationWayfair.com Q2 2015 Results Presentation
Wayfair.com Q2 2015 Results PresentationArmand Tiphonnet
 
Optimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEO
Optimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEOOptimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEO
Optimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEOsaastr
 
SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)
SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)
SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)prashant.sachdev
 
Numbers that Actually Matter. Finding Your North Star
Numbers that Actually Matter. Finding Your North Star Numbers that Actually Matter. Finding Your North Star
Numbers that Actually Matter. Finding Your North Star Mamoon Hamid
 
AWS #3 Storage Vendor in 2017 | #1 in 2020
AWS #3 Storage Vendor in 2017 | #1 in 2020AWS #3 Storage Vendor in 2017 | #1 in 2020
AWS #3 Storage Vendor in 2017 | #1 in 2020IT Brand Pulse
 
"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)
"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)
"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)Ian Gertler
 
Mobile Software Market Update & Ecosystem: 2Q13
Mobile Software Market Update & Ecosystem: 2Q13Mobile Software Market Update & Ecosystem: 2Q13
Mobile Software Market Update & Ecosystem: 2Q13Brad Weekes
 
Brief Real Estate Technology Market Update & Ecosystem
Brief Real Estate Technology Market Update & EcosystemBrief Real Estate Technology Market Update & Ecosystem
Brief Real Estate Technology Market Update & EcosystemKristopher Beible
 
Bvp 10 laws of cloud computing 2012 release
Bvp 10 laws of cloud computing 2012 releaseBvp 10 laws of cloud computing 2012 release
Bvp 10 laws of cloud computing 2012 releaseEd Cushing
 
Zuora's 2017 CFO Summit SaaS Benchmark Slides
Zuora's 2017 CFO Summit SaaS Benchmark SlidesZuora's 2017 CFO Summit SaaS Benchmark Slides
Zuora's 2017 CFO Summit SaaS Benchmark Slidessroger10
 
How I shifted My Business One Subscription At A Time (Subscribed13)
How I shifted My Business One Subscription At A Time (Subscribed13) How I shifted My Business One Subscription At A Time (Subscribed13)
How I shifted My Business One Subscription At A Time (Subscribed13) Zuora, Inc.
 

Mais procurados (15)

Bessemer's 2016 State of the Cloud
Bessemer's 2016 State of the Cloud Bessemer's 2016 State of the Cloud
Bessemer's 2016 State of the Cloud
 
StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)
StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)
StartupJam: SaaS | Jan 2021 | Thiyagarajan Maruthavanan (Rajan)
 
The State of the Cloud Report 2017
The State of the Cloud Report 2017 The State of the Cloud Report 2017
The State of the Cloud Report 2017
 
Bessemer Venture Partners' 2015 State of the Cloud
Bessemer Venture Partners' 2015 State of the CloudBessemer Venture Partners' 2015 State of the Cloud
Bessemer Venture Partners' 2015 State of the Cloud
 
Wayfair.com Q2 2015 Results Presentation
Wayfair.com Q2 2015 Results PresentationWayfair.com Q2 2015 Results Presentation
Wayfair.com Q2 2015 Results Presentation
 
Optimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEO
Optimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEOOptimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEO
Optimizing SaaS Productivity for CEOs, CFOs & CIOs with LeanIX's CEO
 
SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)
SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)
SaaStr Annual 2017 - Learnings from B2B SaaS (SaaStr101)
 
Numbers that Actually Matter. Finding Your North Star
Numbers that Actually Matter. Finding Your North Star Numbers that Actually Matter. Finding Your North Star
Numbers that Actually Matter. Finding Your North Star
 
AWS #3 Storage Vendor in 2017 | #1 in 2020
AWS #3 Storage Vendor in 2017 | #1 in 2020AWS #3 Storage Vendor in 2017 | #1 in 2020
AWS #3 Storage Vendor in 2017 | #1 in 2020
 
"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)
"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)
"State of the Cloud" Report -- Bessemer Venture Partners (June 2015)
 
Mobile Software Market Update & Ecosystem: 2Q13
Mobile Software Market Update & Ecosystem: 2Q13Mobile Software Market Update & Ecosystem: 2Q13
Mobile Software Market Update & Ecosystem: 2Q13
 
Brief Real Estate Technology Market Update & Ecosystem
Brief Real Estate Technology Market Update & EcosystemBrief Real Estate Technology Market Update & Ecosystem
Brief Real Estate Technology Market Update & Ecosystem
 
Bvp 10 laws of cloud computing 2012 release
Bvp 10 laws of cloud computing 2012 releaseBvp 10 laws of cloud computing 2012 release
Bvp 10 laws of cloud computing 2012 release
 
Zuora's 2017 CFO Summit SaaS Benchmark Slides
Zuora's 2017 CFO Summit SaaS Benchmark SlidesZuora's 2017 CFO Summit SaaS Benchmark Slides
Zuora's 2017 CFO Summit SaaS Benchmark Slides
 
How I shifted My Business One Subscription At A Time (Subscribed13)
How I shifted My Business One Subscription At A Time (Subscribed13) How I shifted My Business One Subscription At A Time (Subscribed13)
How I shifted My Business One Subscription At A Time (Subscribed13)
 

Semelhante a Databases, CAP, ACID, BASE, NoSQL... oh my!

Big data vendor panel - MarkLogic
Big data vendor panel - MarkLogicBig data vendor panel - MarkLogic
Big data vendor panel - MarkLogicMikan Associates
 
As You Seek – How Search Enables Big Data Analytics
As You Seek – How Search Enables Big Data AnalyticsAs You Seek – How Search Enables Big Data Analytics
As You Seek – How Search Enables Big Data AnalyticsInside Analysis
 
Integrating Structure and Analytics with Unstructured Data
Integrating Structure and Analytics with Unstructured DataIntegrating Structure and Analytics with Unstructured Data
Integrating Structure and Analytics with Unstructured DataDATAVERSITY
 
Michel de Ru (MarkLogic), New Generation Databases - Data Donderdag
Michel de Ru (MarkLogic), New Generation Databases - Data DonderdagMichel de Ru (MarkLogic), New Generation Databases - Data Donderdag
Michel de Ru (MarkLogic), New Generation Databases - Data DonderdagCre-Aid
 
Hybrid Data Pipeline for SQL and REST
Hybrid Data Pipeline for SQL and RESTHybrid Data Pipeline for SQL and REST
Hybrid Data Pipeline for SQL and RESTSumit Sarkar
 
The LCG Digital Transformation Maturity Model
The LCG Digital Transformation Maturity ModelThe LCG Digital Transformation Maturity Model
The LCG Digital Transformation Maturity ModelLima Consulting Group
 
Cisco IoT World Forum 2014: Airwatch Breakout Session
Cisco IoT World Forum 2014: Airwatch Breakout SessionCisco IoT World Forum 2014: Airwatch Breakout Session
Cisco IoT World Forum 2014: Airwatch Breakout SessionBasil Hashem
 
T-Bytes Hybrid cloud infrastructure
T-Bytes Hybrid cloud infrastructure T-Bytes Hybrid cloud infrastructure
T-Bytes Hybrid cloud infrastructure EGBG Services
 
Cloud Computing and CDO (April 29).pdf
 Cloud Computing and CDO (April 29).pdf Cloud Computing and CDO (April 29).pdf
Cloud Computing and CDO (April 29).pdfPablo Junco
 
What's Next with Government Big Data
What's Next with Government Big Data What's Next with Government Big Data
What's Next with Government Big Data GovLoop
 
Supporting Data Services Marketplace using Data Virtualization
Supporting Data Services Marketplace using Data VirtualizationSupporting Data Services Marketplace using Data Virtualization
Supporting Data Services Marketplace using Data VirtualizationDenodo
 
Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?Sridhar Karnam
 
Bhadale group of companies google industrial services catalogue
Bhadale group of companies google industrial services catalogueBhadale group of companies google industrial services catalogue
Bhadale group of companies google industrial services catalogueVijayananda Mohire
 
United States Cloud Storage Market by Product Type, Distribution Channel, End...
United States Cloud Storage Market by Product Type, Distribution Channel, End...United States Cloud Storage Market by Product Type, Distribution Channel, End...
United States Cloud Storage Market by Product Type, Distribution Channel, End...IMARC Group
 
Empowering you with Democratized Data Access, Data Science and Machine Learning
Empowering you with Democratized Data Access, Data Science and Machine LearningEmpowering you with Democratized Data Access, Data Science and Machine Learning
Empowering you with Democratized Data Access, Data Science and Machine LearningDataWorks Summit
 
Current State of the Drone Industry - Skylogic Research
Current State of the Drone Industry - Skylogic ResearchCurrent State of the Drone Industry - Skylogic Research
Current State of the Drone Industry - Skylogic ResearchColin Snow
 
Guardium Triples Bookings and Installed Base in 2006
Guardium Triples Bookings and Installed Base in 2006Guardium Triples Bookings and Installed Base in 2006
Guardium Triples Bookings and Installed Base in 2006pneray
 

Semelhante a Databases, CAP, ACID, BASE, NoSQL... oh my! (20)

Big data vendor panel - MarkLogic
Big data vendor panel - MarkLogicBig data vendor panel - MarkLogic
Big data vendor panel - MarkLogic
 
As You Seek – How Search Enables Big Data Analytics
As You Seek – How Search Enables Big Data AnalyticsAs You Seek – How Search Enables Big Data Analytics
As You Seek – How Search Enables Big Data Analytics
 
Integrating Structure and Analytics with Unstructured Data
Integrating Structure and Analytics with Unstructured DataIntegrating Structure and Analytics with Unstructured Data
Integrating Structure and Analytics with Unstructured Data
 
Mark logic for dita
Mark logic for ditaMark logic for dita
Mark logic for dita
 
Michel de Ru (MarkLogic), New Generation Databases - Data Donderdag
Michel de Ru (MarkLogic), New Generation Databases - Data DonderdagMichel de Ru (MarkLogic), New Generation Databases - Data Donderdag
Michel de Ru (MarkLogic), New Generation Databases - Data Donderdag
 
Hybrid Data Pipeline for SQL and REST
Hybrid Data Pipeline for SQL and RESTHybrid Data Pipeline for SQL and REST
Hybrid Data Pipeline for SQL and REST
 
The LCG Digital Transformation Maturity Model
The LCG Digital Transformation Maturity ModelThe LCG Digital Transformation Maturity Model
The LCG Digital Transformation Maturity Model
 
Cisco IoT World Forum 2014: Airwatch Breakout Session
Cisco IoT World Forum 2014: Airwatch Breakout SessionCisco IoT World Forum 2014: Airwatch Breakout Session
Cisco IoT World Forum 2014: Airwatch Breakout Session
 
T-Bytes Hybrid cloud infrastructure
T-Bytes Hybrid cloud infrastructure T-Bytes Hybrid cloud infrastructure
T-Bytes Hybrid cloud infrastructure
 
Cloud Computing and CDO (April 29).pdf
 Cloud Computing and CDO (April 29).pdf Cloud Computing and CDO (April 29).pdf
Cloud Computing and CDO (April 29).pdf
 
What's Next with Government Big Data
What's Next with Government Big Data What's Next with Government Big Data
What's Next with Government Big Data
 
Supporting Data Services Marketplace using Data Virtualization
Supporting Data Services Marketplace using Data VirtualizationSupporting Data Services Marketplace using Data Virtualization
Supporting Data Services Marketplace using Data Virtualization
 
Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?Are your Cloud Services Secure and Compliant today?
Are your Cloud Services Secure and Compliant today?
 
Bhadale group of companies google industrial services catalogue
Bhadale group of companies google industrial services catalogueBhadale group of companies google industrial services catalogue
Bhadale group of companies google industrial services catalogue
 
United States Cloud Storage Market by Product Type, Distribution Channel, End...
United States Cloud Storage Market by Product Type, Distribution Channel, End...United States Cloud Storage Market by Product Type, Distribution Channel, End...
United States Cloud Storage Market by Product Type, Distribution Channel, End...
 
IBM Z for the Digital Enterprise 2018 - Z Keynote
IBM Z for the Digital Enterprise 2018 - Z KeynoteIBM Z for the Digital Enterprise 2018 - Z Keynote
IBM Z for the Digital Enterprise 2018 - Z Keynote
 
Empowering you with Democratized Data Access, Data Science and Machine Learning
Empowering you with Democratized Data Access, Data Science and Machine LearningEmpowering you with Democratized Data Access, Data Science and Machine Learning
Empowering you with Democratized Data Access, Data Science and Machine Learning
 
Adstuck United States
Adstuck United States  Adstuck United States
Adstuck United States
 
Current State of the Drone Industry - Skylogic Research
Current State of the Drone Industry - Skylogic ResearchCurrent State of the Drone Industry - Skylogic Research
Current State of the Drone Industry - Skylogic Research
 
Guardium Triples Bookings and Installed Base in 2006
Guardium Triples Bookings and Installed Base in 2006Guardium Triples Bookings and Installed Base in 2006
Guardium Triples Bookings and Installed Base in 2006
 

Mais de DATAVERSITY

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...DATAVERSITY
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceDATAVERSITY
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data LiteracyDATAVERSITY
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsDATAVERSITY
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for YouDATAVERSITY
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?DATAVERSITY
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?DATAVERSITY
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling FundamentalsDATAVERSITY
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectDATAVERSITY
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at ScaleDATAVERSITY
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?DATAVERSITY
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...DATAVERSITY
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?DATAVERSITY
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsDATAVERSITY
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayDATAVERSITY
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise AnalyticsDATAVERSITY
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best PracticesDATAVERSITY
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?DATAVERSITY
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best PracticesDATAVERSITY
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageDATAVERSITY
 

Mais de DATAVERSITY (20)

Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
Architecture, Products, and Total Cost of Ownership of the Leading Machine Le...
 
Data at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and GovernanceData at the Speed of Business with Data Mastering and Governance
Data at the Speed of Business with Data Mastering and Governance
 
Exploring Levels of Data Literacy
Exploring Levels of Data LiteracyExploring Levels of Data Literacy
Exploring Levels of Data Literacy
 
Building a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business GoalsBuilding a Data Strategy – Practical Steps for Aligning with Business Goals
Building a Data Strategy – Practical Steps for Aligning with Business Goals
 
Make Data Work for You
Make Data Work for YouMake Data Work for You
Make Data Work for You
 
Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?Data Catalogs Are the Answer – What is the Question?
Data Catalogs Are the Answer – What is the Question?
 
Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?Data Catalogs Are the Answer – What Is the Question?
Data Catalogs Are the Answer – What Is the Question?
 
Data Modeling Fundamentals
Data Modeling FundamentalsData Modeling Fundamentals
Data Modeling Fundamentals
 
Showing ROI for Your Analytic Project
Showing ROI for Your Analytic ProjectShowing ROI for Your Analytic Project
Showing ROI for Your Analytic Project
 
How a Semantic Layer Makes Data Mesh Work at Scale
How a Semantic Layer Makes  Data Mesh Work at ScaleHow a Semantic Layer Makes  Data Mesh Work at Scale
How a Semantic Layer Makes Data Mesh Work at Scale
 
Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?Is Enterprise Data Literacy Possible?
Is Enterprise Data Literacy Possible?
 
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
The Data Trifecta – Privacy, Security & Governance Race from Reactivity to Re...
 
Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?Emerging Trends in Data Architecture – What’s the Next Big Thing?
Emerging Trends in Data Architecture – What’s the Next Big Thing?
 
Data Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and ForwardsData Governance Trends - A Look Backwards and Forwards
Data Governance Trends - A Look Backwards and Forwards
 
Data Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement TodayData Governance Trends and Best Practices To Implement Today
Data Governance Trends and Best Practices To Implement Today
 
2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics2023 Trends in Enterprise Analytics
2023 Trends in Enterprise Analytics
 
Data Strategy Best Practices
Data Strategy Best PracticesData Strategy Best Practices
Data Strategy Best Practices
 
Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?Who Should Own Data Governance – IT or Business?
Who Should Own Data Governance – IT or Business?
 
Data Management Best Practices
Data Management Best PracticesData Management Best Practices
Data Management Best Practices
 
MLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive AdvantageMLOps – Applying DevOps to Competitive Advantage
MLOps – Applying DevOps to Competitive Advantage
 

Último

SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024Lorenzo Miniero
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .Alan Dix
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demoHarshalMandlekar2
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Manik S Magar
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rick Flair
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersRaghuram Pandurangan
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningLars Bell
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsNathaniel Shimoni
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfMounikaPolabathina
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteDianaGray10
 

Último (20)

SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024SIP trunking in Janus @ Kamailio World 2024
SIP trunking in Janus @ Kamailio World 2024
 
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
 
Sample pptx for embedding into website for demo
Sample pptx for embedding into website for demoSample pptx for embedding into website for demo
Sample pptx for embedding into website for demo
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...Rise of the Machines: Known As Drones...
Rise of the Machines: Known As Drones...
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Generative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information DevelopersGenerative AI for Technical Writer or Information Developers
Generative AI for Technical Writer or Information Developers
 
DSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine TuningDSPy a system for AI to Write Prompts and Do Fine Tuning
DSPy a system for AI to Write Prompts and Do Fine Tuning
 
Time Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directionsTime Series Foundation Models - current state and future directions
Time Series Foundation Models - current state and future directions
 
What is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdfWhat is DBT - The Ultimate Data Build Tool.pdf
What is DBT - The Ultimate Data Build Tool.pdf
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test SuiteTake control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
 

Databases, CAP, ACID, BASE, NoSQL... oh my!

  • 1. Slide 1 Copyright © 2013 MarkLogic® Corporation. All rights reserved. Diane Burley MarkLogic Jason Hunter MarkLogic Databases, CAP, ACID, BASE, NoSQL... Oh My! #MarkLogic
  • 2. Slide 2 Copyright © 2013 MarkLogic® Corporation. All rights reserved. What we can agree NoSQL is …  It’s Not Only SQL  A Break from Relational Model  Solves a different type of problem
  • 3. Slide 3 Copyright © 2013 MarkLogic® Corporation. All rights reserved. NoSQL MarkLogic  Schema- agnostic  Massive Scale  Commodity hardware  Rapid development  Hadoop sink/source  “Free”  Community  Search  Universal Indexes  Transactional  Security  Enterprise hardened Examples: • MongoDB • Couchbase • HBase • Cassandra • Accumulo • Riak • …
  • 4. Slide 4 Copyright © 2013 MarkLogic® Corporation. All rights reserved. RDBMS MarkLogic  Secure  Enterprise hardened  Indexes (tabular)  SQL  Analytics  Incumbent  “Free”  Career path  Search  Scale-out on Commodity hardware  Rapid development  Schema- agnostic  Universal Indexes Examples: • Oracle • SQLServer • DB2 • MySQL • Postgres • …
  • 5. Slide 5 Copyright © 2013 MarkLogic® Corporation. All rights reserved. Search Engine MarkLogic  Indexes (text, fields)  Schema- agnostic  Community  “Free”  Real-time  Structure aware  Rapid development  Consistency  Transactional  Scale-out  Enterprise hardened  AnalyticsExamples: • ElasticSearch • Solr • Lucene • FAST
  • 6. Slide 6 Copyright © 2013 MarkLogic® Corporation. All rights reserved. Hadoop MarkLogic  Commodity hardware  Scale-out  “SQL”  HDFS  Real-time & batch analytics  “Free”  Community  Batch  Real-time  Indexes  Secure  Consistent  Enterprise hardened Examples: • Cloudera • Hortonworks • MapR • Apache • …
  • 7. Slide 7 Copyright © 2013 MarkLogic® Corporation. All rights reserved. ATOM vs BASE ATOM BASE Strong Consistency Weak Consistency – stale data OK Isolation Last Write Wins Transaction Programmer Managed Available/Consistent Available/Partition-Tolerant Robust Database/Simpler Code Simpler database, harder code
  • 8. Slide 8 Copyright © 2013 MarkLogic® Corporation. All rights reserved. Real Value From Big Data Make The World More Secure Provide Access To Valuable Information Create New Revenue Streams Gain Insights to Increase Market Share Reduce Bottom Line Expense
  • 9. The FAA enhances airline safety with real-time monitoring.
  • 10. Slide 10 Copyright © 2013 MarkLogic® Corporation. All rights reserved. The FAA enhances airline safety with real-time monitoring & dashboards. Monitor and track emergencies and severe weather, and update a real-time dashboard for crisis management. Goals Proof of concept complete in 2 weeks. Entire system went from purchase to Beta in 6 months. Able to deliver mission-critical system that had previously failed on RDBMS. Benefits ChallengesRepository for multi-source, complex, multi- structured data; supports geospatial enrichment, faceted navigation & search; integrated with Google Earth, Microsoft SharePoint & internal systems. Solution Weather reports Social media Share Point Airline informa tion GEMSInternal System s Load data “as is” SEARCH
  • 11. “Global Oil Co.” makes real-time trading decisions based on real-time, global information.
  • 12. Slide 12 Copyright © 2013 MarkLogic® Corporation. All rights reserved. We help “Global Oil Co.” maximise their price advantage when buying or selling oil. Get a complete picture of oil and gas market influencers to maximise profits. Goals ChallengesSystem pulls in real-time political, weather, vessel data, location, terminal data and trading data, and sends alerts to traders to notify them of noteworthy issues, so they can make fastest decisions possible. Solution Traders use the system to ensure they are able to get the best price on the market. Reduced Total Cost of Ownership (TCO) by 75% BenefitsNotify me if…..  More than “mmm” barrels of crude are in transit in the Gulf of Arabia  Severe weather in excess of force 8 scheduled to hit Gulf of Mexico
  • 13. Medicare and Medicaid (CMS) helps customers easily research, select and enroll in the right insurance plan... while ensuring that the systems are future-proof and can adapt to change.
  • 14. Slide 14 Copyright © 2013 MarkLogic® Corporation. All rights reserved. CMS has a future-proof system that can easily adapt to change. Citizens, providers, payers can identify, verify and enroll in selected insurance plan Different insurance, eligibility sources from 50 states, federal agencies, medical providers and payers, and potentially 30-50 million citizens Load data “as is” UNIFIED DATA
  • 15. Slide 15 Copyright © 2013 MarkLogic® Corporation. All rights reserved. New Generation Fraud Prevention Analytics Profile Configuration Tools Profile Data Extracted from Claims Data Provider and Beneficiary Profiles
  • 16. The Press Association & BBC let you connect to your favorite team – even from thousands of miles away.
  • 17. Slide 17 Copyright © 2013 MarkLogic® Corporation. All rights reserved. BBC Sport Video Supply Chain
  • 18. Slide 18 Copyright © 2013 MarkLogic® Corporation. All rights reserved. Global browsers across the games Some Numbers Behind the Olympics 55 Million Record of global browsers in single day9.5 Million Requests for BBC Olympic video content106 Million UK browsers from Mobile Devices9.2 Million Requests for Mobile Video12 Million Data delivered in the busiest day2.8 Petabytes Data requests over the 2 Olympics45 Billion Daily average queries against web and mobile services2,160,000,000 Average transactions PER SECOND25,000
  • 19. Slide 19 Copyright © 2013 MarkLogic® Corporation. All rights reserved. What is Coming Next?
  • 20. Slide 20 Copyright © 2013 MarkLogic® Corporation. All rights reserved. To Find Out More Jason Hunter <Jason.Hunter@marklogic.com> Diane Burley <Diane.Burley@marklogic.com> Paper: