NoSQL - Vital Open Source Ingredient for Modern Success at All Things Open 2015

1. NoSQL – the Vital Open Source
Ingredient for Modern Success
Arun Gupta
VP, Developer Advocacy, Couchbase
@arungupta
arun@couchbase.com

2. ©2015 Couchbase Inc. 2@arungupta
Who am I?

3. ©2015 Couchbase Inc. 3
The Big Picture:
Companies across
industries are “going
digital” in a big way

4. ©2015 Couchbase Inc. 4@arungupta
The shift to digital is driving new database requirements

5. ©2015 Couchbase Inc. 5@arungupta
How much unstructured data?
90%
When connected and used properly, such information
typically can help increase revenue, reduce costs,
respond to customer needs more quickly and accurately,
or bring products to market faster
http://www.idc.com/getdoc.jsp?containerId=prUS24993814

6. ©2015 Couchbase Inc. 6@arungupta
Responsive Scalable Agile
Mobile Geo-­‐distributed Easy to Manage
Requirements for modern web, mobile & IoT applications

7. ©2015 Couchbase Inc. 7@arungupta
NoSQL is often a better fit for web, mobile & IoT applications
RDBMS NoSQL
1960’s -­‐ 1970’s origin Mid-­‐2000’s origin
Mainframe / Client-­‐Server era Internet / Mobile / Big Data era
Rigid schema Flexible
Structured data Structured, semi-­‐structured, unstructured
Scale up Scale out

8. ©2015 Couchbase Inc. 8@arungupta
Origin and evolution of NoSQL
2000
2003
2004-2006
2008
2009
2011
Releases Couchbase
Server
2012
Merger of
CouchOne (CouchDB) &
Membase (memcached)

9. ©2015 Couchbase Inc. 9@arungupta
Who’s using NoSQL?
Internet companies were the originators and early adopters.

10. ©2015 Couchbase Inc. 10@arungupta
Who’s using NoSQL?
Today, NoSQL is mainstream!
Industrial Equipment
Internet of Things
Communications Hospitality Airlines Financial Services
Customer Data Mgmt Reservation Systems Mobile Application Fraud Detection
Tax Preparation Media Metadata Mgmt Content Mgmt System Product Catalog
Theme Park
Customer Service
Streaming Media Publishing Retail EntertainmentBusiness Services

11. ©2015 Couchbase Inc. 11@arungupta
NoSQL at Gannett: Re-­‐engineering the CMS

12. ©2015 Couchbase Inc. 12@arungupta
Gannett: Challenges of RDBMS
• SQL Server is extremely expensive
• Utilize on-­‐premise pet servers that have difficulty
scaling
• Significant replication latency issue with SQL Server
• Business logic coded into Stored Procedures
• Causes significant delay between publish time and presentation time

13. ©2015 Couchbase Inc. 13@arungupta
Gannett: Transition Goals
• Decrease the latency between publish time and
presentation time
• Remove business logic from data layer
• Allow for growth and scalability in the cloud
• Move away from pet servers
• Lower cost – Couchbase operates at 25% of RBDMS

14. ©2015 Couchbase Inc. 14@arungupta
Gannett: Replatforming with NoSQL
Before After
NoSQL
NoSQL

15. ©2015 Couchbase Inc. 15@arungupta
How Gannett used to retrieve an asset

16. ©2015 Couchbase Inc. 16@arungupta
How Gannett now retrieves an asset

17. ©2015 Couchbase Inc. 17@arungupta
Couchbase and Gannett
https://www.youtube.com/watch?v=mor2p0UqZ14
Couchbase has become an
integral part of GANNETT’s next
generation publishing systems

18. ©2015 Couchbase Inc. 18@arungupta
NoSQL at Marriott: Moving from mainframe to distributed
Leading international hotel
provider with 4,200+ properties
in 79 countries
Replatforming from
mainframe-­‐based DB2/Z to
distributed architecture

19. ©2015 Couchbase Inc. 19@arungupta
Marriott: Why replatform?
• Moving from legacy to distributed
• Skill sets available
• Open source
• Application development cost savings
• Infrastructure cost savings
• Leverage cloud strategy
• Data-­‐driven logic vs embedded rules logic

20. ©2015 Couchbase Inc. 20@arungupta
Marriott: Why Open Source and NoSQL?
• Well suited for cloud deployment on commodity
hardware
• Scalability and High Availability
• Taking advantage of the myriad of Open Standards
vs Proprietary Vendor Solutions
• Native JSON processing
• Couchbase: N1QL, LDAP integration, Filtered XDCR,
Service scaling

21. ©2015 Couchbase Inc. 21@arungupta
Couchbase at Marriott
Marriott Data Center
Compute Cluster Couchbase Cluster
MARSHAMARSHA
JSON DocumentsReservation Data
Internal UsersInternal Users
§ 13 Million Documents in Couchbase
§ 200 Transactions/Second
Initial Deployment
§ 30 Million Documents in Couchbase
§ 4000 Transactions/Second
Future Rollout

22. ©2015 Couchbase Inc. 22@arungupta
NoSQL at CenterEdge Software
Leading provider of facility
management for amusement &
entertainment industries:
Family Entertainment Centers
Waterparks
Trampoline Parks
Amusement Parks
Skating Rinks
Bowling Centers
Zoos & Museums
Replacing RDBMS with NoSQL
for better scalability and
reliability in the cloud

23. ©2015 Couchbase Inc. 23@arungupta
We knew that we needed to re-­‐architect and move to something
that didn’t involve SQL at all. The vertical scaling of SQL is
just very limiting.
We had a bunch of SQL Serversup in the cloud serving up the
web stores. That basically melted on a Black Friday
Why NoSQL at CenterEdge: Avoid “Black Friday meltdown”
http://diginomica.com/2015/10/15/how-­‐centeredge-­‐went-­‐from-­‐black-­‐friday-­‐blues-­‐to-­‐cloud-­‐scale-­‐with-­‐couchbase/
more cost savings will be achieved as SQL database contracts
are phased out

24. ©2015 Couchbase Inc. 24@arungupta
Why NoSQL at CenterEdge: Avoid “Black Friday meltdown”
http://diginomica.com/2015/10/15/how-­‐centeredge-­‐went-­‐from-­‐black-­‐friday-­‐blues-­‐to-­‐cloud-­‐scale-­‐with-­‐couchbase/
• Using Couchbase since 1.8, originally for caching,
now for persistence as well
Couchbase has enabled us to do this far more easily than we
ever could have, compared to trying to deal with large SQL
servers and dividing it up and partitioning data… Unlike SQL
Server, as we grow, we just add nodes. We need another
node, we’d spin one up. Zero down time.

25. ©2015 Couchbase Inc. 25@arungupta
NoSQL lines of influence
(Columns, Consistent)
(Values, Available)
Consistent
Documents
(Values)
Wide Column
Available
(Columns, Available) (Documents, Consistent)

26. ©2015 Couchbase Inc. 26@arungupta
Couchbase’s Open Source heritage
ForestDB
(CouchOne) (Membase)
2011:
CouchOne & Membase merge to
form Couchbase
2014:
Couchbase releases ForestDB storage
engine as Open Source project
2015:
Couchbase releases Couchbase Server 4.0,
leveraging bleve open source project for
search

27. ©2015 Couchbase Inc. 27@arungupta
Couchbase is Open Source -­‐ Apache 2.0 license

28. ©2015 Couchbase Inc. 28@arungupta
Couchbase lines of influence
(Columns, Consistent)
(Values, Available)
(Documents, Consistent)
Consistent
Documents
(Values)
(In-­‐Memory)

29. ©2015 Couchbase Inc. 29@arungupta
Choose how to build your apps, and where to run them
Frameworks
Languages
Platforms
Infrastructure
C / C++
Mobile
Mobile
Couchbase supports a wide range of frameworks, languages, platforms, and infrastructure choices

30. ©2015 Couchbase Inc. 30@arungupta
Couchbase integrates with the Big Data ecosystem
Business Intelligence
Offline Analytics
Storage
Search Streaming Analytics
Messaging

31. ©2015 Couchbase Inc. 31@arungupta
Couchbase can be deployed for multiple purposes
High availability
cache
Key-­‐value
store
Document
database
Embedded
database
(mobile devices)
Sync
management

32. ©2015 Couchbase Inc. 32@arungupta
Key capabilities in Couchbase
Query Index Search Scale Replicate

33. ©2015 Couchbase Inc. 33@arungupta
N1QL (“nickel”) query language = SQL for JSON data
Query Index Search Scale Replicate

34. ©2015 Couchbase Inc. 34@arungupta
Global Secondary Indexing – fast, efficient indexes
Query Index Search Scale Replicate

35. ©2015 Couchbase Inc. 35@arungupta
Geospatial search
Query Index Search Scale Replicate

36. ©2015 Couchbase Inc. 36@arungupta
Multi-­‐Dimensional Scaling: Isolate query, index, read-­‐write
Query Index Search Scale Replicate

37. ©2015 Couchbase Inc. 37@arungupta
Cross data center replication (XDCR) with filtering
Query Index Search Scale Replicate

38. ©2015 Couchbase Inc. 38@arungupta
Summary
§ Why Open Source?
– More choice, More flexibility, Less risk, Lower cost
§ Why NoSQL?
– Flexible data model, Structured & Un-­‐structured data, Scale-­‐out architecture
§ Why Couchbase?
– Performance, Availability, Scalability, Flexibility, Ease of Use

39. ©2015 Couchbase Inc. 39@arungupta
Want to know more?
Download Couchbase: couchbase.com/download
Developer Portal: developer.couchbase.com
Free online training: training.couchbase.com/online

40. ©2015 Couchbase Inc. 40@arungupta
Questions?

41. ©2015 Couchbase Inc. 41@arungupta
Thank You.
@arungupta
arun@couchbase.com