Cloud-Native Data Day by Pivotal Orchestrating stateful applications with PKS and Portworx

1. 1© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Stateful Container Orchestration
Any Cloud
Scheduler Aware
DevOps UX

2. Experienced Team with Deep Domain Expertise
©2018 Portworx. Confidential.
2
Murli Thirumale
Co-founder
& CEO
Goutham Rao
Co-founder & CTO
Storage Executive, Dell
Co-founder and CEO, Ocarina
Group VP and GM, Citrix
Co-founder and CEO, Net6;
GM, HP
Steve Ackley
CRO
Michael Ferranti
VP Marketing
Vinod Jayaraman
Co-founder & Chief
Architect
Venkat
Ramakrishnan
VP Engineering
CTO/Executive, Dell
Co-founder and CTO, Ocarina
CTO, Citrix
Co-Founder and
CTO, Net6
Architect, Dell Storage
Chief Architect, Ocarina
Principal Engineer, F5
Eric Han
VP Product
Management
Co-founder, Product Manager,
Kubernetes Container
Engine at Google
Senior Business
Development, Google
Senior Product Manager, Microsoft
VP of Marketing, ClusterHQ
Marketing Head, Rackspace-
Mailgun
Strategy, Wachovia/Wells Fargo
Sr. Director, Western Digital
Sr. Director, AMD/SeaMicro
Sr. Director, Fusion IO
VP Engineering, Active Storage
VP Sales, SAP Big Data Cloud,
VP WW Sales, Altiscale
EVP Field Ops, Packet Design
VP Sales, Monosphere
Vicinity, Satmetrix, Marimba Tivoli-IBM
INVESTORS:
Company Snapshot:
HQ: Los Altos CA
Founded: 2014
70 Employees with global
support and field teams

3. Portworx is the leader across many industries
©2018 Portworx. Confidential. 3
SERVICE PROVIDERS INDUSTRIAL
AUTOMOTIVE HEALTHCARE
FINANCE/CONSULTING RETAIL/MEDIA
GOVERNMENT ML/AI/IOT
China Security
Bureau
Imubit

4. 4© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Portworx runs on all schedulers and clouds
Schedulers
Infrastructure
HA • Replication • Density • Encryption • Snapshot • Cloning • Data Mobility
STORK
Compute & Network
Orchestration
Storage
Orchestration

5. Portworx is part of the CNCF stack
Kubernetes - Cloud Native Scheduling
OCI - Cloud Native Execution Runtime
CSI CNI
Portworx
Other Weave Contiv
Prometheus
Portworx allows you to
move this stack across
various infrastructure
types
......
network compute
storage
(ebs)
AWS
network compute
storage
(MD)
AZURE
network compute
storage
(G-PD)
GOOGLE
network compute
storage
(v-SAN)
BARE METAL
VMWARE
Your Portable Cloud Stack
Runs on any interchangeable infrastructure
Multi Cloud

6. Why Portworx?
Tight Kubernetes Integration and DevOps driven automation
● All operations driven through the scheduler
● Extensive OpenStorage API to use for your “Infrastructure as Code Platform”
Very High Application Density Support
● 1000 Nodes per cluster, 100K virtual volumes per cluster, 1000 volumes per host
● No extra cloud provider cost per virtual volume
● High IOPS and bandwidth evenly distributed even to small volumes
Multi AZ and Multi Cloud Application Level Availability
● Every Portworx volume is available in any Availability Zone
● Global volume namespace - Available even across different Cloud Providers
● Application level RTO on failover is in seconds
Application Aware Volume Provisioning
● Application Aware Group Storage Features (Snaps, Encryption, DR per volume groups)
● Multi Container Volume Provisioning - An application is not just one container
Data Workflow Management
● Blue Green deployment support
● Application level migration between clusters and clouds

7. 7© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Top Use Cases for Stateful Containers + Portworx
Databases
Enable density and HA: run multiple databases (SQL, NoSQL) on any
infrastructure, with containerized volumes that are isolated, backed-up off-site,
and encrypted.
Data
Processing
Process faster: create and access TBs of storage in seconds on any compute
server in the cluster, enabling flexible and faster data processing.
Content
Management
Scale easily: run multiple containers with files shared on a common volume, in
order to scale-out more densely and with less to manage.
DevOps
Toolchain
Integrate workflows: share common libraries as snapshots and backup to off-site
s3, allowing for easier workflow integration and always-on data protection.
Big Data
Share infrastructure: run compute jobs with data converged and stored in
containerized volumes, enabling other workloads on the same infrastructure.

8. Open Source
OpenStorage.org
Scheduler Data Layer: OpenStorage is a massively scalable data layer for
Containers and Schedulers like Kubernetes and Mesosphere:
https://github.com/libopenstorage
LCFS
Data Path: LCFS provides core data path functionality for Docker images.
Check it out on https://github.com/portworx/lcfs
PORX
Bundled Data Services: Try out the Portworx community edition at
https://github.com/portworx/px-dev
Torpedo
A test suite for validating storage solutions for Linux Container Orchestration
tools
CSI
Container Storage Interface. Standard Storage API between all Schedulers
and all Storage Providers
STORK
Cloud Native storage orchestration runtime scheduler plugin to translate a
orchestration decisions into something upon which an external cloud native
storage solution can act. Extends Kubernetes with more stateful awareness
of the underlying storage provider, it's capabilities and state.

9. 9© 2017 PORTWORX | CONFIDENTIAL: DO NOT DISTRIBUTE
Architecture

10. PX runs as OCI Container under systemd
PX
Device Store
Timestamp Log
Write Through cache
I/O Dispatch
I/O
Q
U
E
U
E
R
P
C
C
S
I
G
O
S
S
I
P
Provisioning/Mgmt
Clustering
Background tasks
PXPX
■ Nodes share state information over gossip protocol
■ Use Key-Value Store for configuration data
■ Data Sent over highly optimized RPC
PX
gossip gossip gossip
rpc
Configuration Information
PX OCI Container
rpc rpc

11. PX Control Plane And Data Plane
Device Store
Timestamp Log
Write Through cache
I/O Dispatch
I/O
Q
U
E
U
E
R
P
C
C
S
I
G
O
S
S
I
P
Provisioning/Mgmt
Clustering
Background tasks
SCHEDULER
bind mount:
/var/data/mysql
/dev/px
Create, Mount, Snap, Encrypt, etc..
PX Virtual Block
ext4/xfs
Linux Kernel
Mount
R/W/F/T/D
SSD
HDD
Synchronous
Replication
{
I/O,
usage,
CPU,
Mem
}
Real Time Feed