SpringOne Platform 2016 Speakers: Ben Lackey; Partner Architect, Datastax. Cornelia Davis; Sr. Director of Technology, Pivotal. DataStax Enterprise (DSE) is a distributed database built on Apache Cassandra with support for Spark, Solr and graph database. Bringing DSE support to the Pivotal Cloud Foundry application platform allows developers and operators to self-service provision DSE clusters and easily connect them to Spring Boot apps running in and managed by PCF. In this session we’ll start with the use cases for on-demand, dedicated DSE clusters, cover the solution design, and demo the system. The creation of on-demand clusters takes full advantage of BOSH 2.0 and we’ll go just a little bit under the covers to show you how these new BOSH features rock this use case. Finally, we’ll complete the story by looking at the support that Spring has for Cassandra.

1. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Cassandra and DataStax
Enterprise on PCF
Ben Lackey
DataStax
@benofben
Cornelia Davis
Pivotal
@cdavisafc

2. PIVOTAL
Brokered Services
PARTNEREDUSERPROVIDED
…
…
PIVOTAL
BOSH Managed
Services
PARTNER
…
…
Automated,
Polyglot Build/
Package/Deploy
Container
Scheduling
Elastic (Auto)Scale
PCF Elastic Runtime
z
PCF Tools
• Apps Manager UI
(App Admin UI)
• CLI
• REST APIs
• PCF Metrics
Dashboard
Ops Manager UI
(Cloud Admin UI)
Mobile Push
Notifications
Dingo
PostgreSQL
Gemfire
Redis
RabbitMQ
Spring Cloud
Services
Single
Sign On
MySQL
HDB
Greenplum DB
VMware
(vSphere + Photon)
MS SQL Server
…
IBM DB/2
Active MQ
Infrastructure OpenStack
*Integration with various 3rd party visualization and management vendors
Security
(Application & Platform)
Self-Healing &
High Availability
(Application & Platform)
Zero Downtime
Upgrades &
Patches
(Application & Platform)
Integrated Logging/
Metrics*
(Application & Platform)
Dynamic Routing &
Extensible Route
Services
Dev + Ops Role-
Based Self-Service
Access
Amazon
Web Services
Microsoft
Azure
Google
Cloud Platform
Oracle DB
Cluster Orchestration
and Management (BOSH)
Infrastructure Agnostic Software Packaging
Multi-Cloud Orchestration of Infrastructure Provisioning
Distributed Software Configuration and Health/Lifecycle Management
Applications/APIs/Microservices
Compiled, staged, containerized, deployed
and managed by platform
Pre-packaged container
deployed and managed
by platform
Java
|
.NET
|
Ruby
|
Node.js
|
Python
|
PHP
|
Go
Pivotal
Cloud
Foundry

3. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
How do we handle massive
transactional data and never go down?
3© 2016 DataStax, All Rights Reserved.
Schema
Memtables
Compaction
SStables
Commit Log

4. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/© 2016 DataStax, All Rights Reserved.
Cassandra
• Distributed self healing mesh
• No active/passive
• Peer to peer replication
• No single point of failure
• Writes are done to all nodes
simultaneously
• Data is safe from node, rack,
and datacenter failure
• Optimized for high volume,
low latency operations
4

5. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 5
http://12factor.net/

6. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 6
Stateless apps allows the
platform
to do all sorts of things for you
demo
Factor 6 – Processes

7. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 7
Router
Cloud Controller
CELL
CELL
Data
Service
PCF Elastic
Runtime
Data
Service

8. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 8
Router
Cloud Controller
CELL
CELL
PCF Elastic
Runtime

9. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 9
demo

10. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Creating and Binding a DataStax Cassandra Service
10
Router
PCF
Elastic
Runtime
create resourcescreate service (HTTP) create service (HTTP)
bind service (HTTP)bind service (HTTP) obtain connection data
CLI Cloud
Controller
Service
Broker

11. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
On Demand Clusters
11
create service
CLI Service
Broker

12. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
On Demand Clusters
12
create service
CLI Service
Broker
BOSH
Director
create
Manifest

13. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
On Demand Clusters
13
create service
CLI Service
Broker
BOSH
Director
create
bosh deploy
via BOSH Director API
Manifest

14. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
On Demand Clusters
14
create service
CLI Service
Broker
BOSH
Director
create
VM
VM
VM
bosh deploy
via BOSH Director API
Manifest

15. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 15
PCF
Data Center 1
PCF
Data Center 2

16. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 16
PCF
Data Center 1
PCF
Data Center 2
Pipelines Distribute Deployments
Active/Active

17. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 17
PCF
Data Center 1
PCF
Data Center 2
Pipelines Distribute Deployments
“Active/Active”

18. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 18
PCF
Data Center 1
PCF
Data Center 2
Pipelines Distribute Deployments
“Active/Active”

19. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/ 19
PCF
Data Center 1
PCF
Data Center 2
Pipelines Distribute Deployments
Active/Active

20. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Summary
• On-demand single tenant database-as-a-service on PCF
• Supports DataStax Enterprise 5.0 (incl. OpsCentre 6.0)
• Currently under active development
• Early adopter program late Q3/early Q4
Vision:
• DataStax multi-data center support
We want to hear from you:
• Damian O'Connor, daoconnor@pivotal.io (Product Manager for the Cassandra Service on PCF)
• Cornelia Davis, cdavis@pivotal.io (Sr. Director of Technology, Platform)
• Ben Lackey, ben.lackey@datastax.com (Partner Architect)
20

21. Unless otherwise indicated, these slides are © 2013-2016 Pivotal Software, Inc. and licensed under a
Creative Commons Attribution-NonCommercial license: http://creativecommons.org/licenses/by-nc/3.0/
Learn More. Stay Connected.
Cornelia Davis @cdavisafc
Ben Lackey @benofben
@springcentral
spring.io/blog
@pivotal
pivotal.io/blog
@pivotalcf
http://engineering.pivotal.io