SlideShare a Scribd company logo
1 of 35
Download to read offline
BUILDING COMPLETE PRIVATE
CLOUDS WITH APACHE
CLOUDSTACK + RIAK CS
John Burwell
(jburwell@basho.com | @john_burwell)

Wednesday, October 23, 13
Who Am I
•

Consulting Engineer @ Basho Technologies

•

Member, Apache CloudStack PMC

•

Ran operations and designed automated provisioning for hybrid
analytic/virtualization clouds

•

Led architectural design and server-side development of a SaaS
physical security platform

Wednesday, October 23, 13
... but I submitted a ticket.

Wednesday, October 23, 13
Shifting Role Of IT

From Cost Center
To Business Opportunity

Wednesday, October 23, 13
Wednesday, October 23, 13
Agility

Exploitation Requires Rapid Execution
Infrastructure management must be delegated

Wednesday, October 23, 13
Agility

Exploitation Requires Rapid Execution
Infrastructure management must be delegated

Infrastructure Must Become Boring

Wednesday, October 23, 13
Composable Infrastructure

•

Resource Pooling

•

Rapid Elasticity

•

Self Service

•

Metering/Charge Back

Wednesday, October 23, 13
Got It ... Why Go Private?

•

Leverage existing infrastructure investment

•

Customization and Control

•

Regulatory/Security Requirements

•

Cost

Wednesday, October 23, 13
Doesn’t vSphere/
XCP/XenServer
already do that?

Wednesday, October 23, 13
Traditional Workload
•
•

Fault tolerant

•

Management

Reliable

Specialized hardware

•

IT managed provisioning

•

Static scale out model

Wednesday, October 23, 13

Network

Hypervisor
Cluster

Hypervisor
Cluster

Shared
 Storage
Traditional Workload
•
•

Fault tolerant

•

Management

Reliable

Specialized hardware

•

IT managed provisioning

•

Static scale out model

Network

Hypervisor
Cluster

Hypervisor
Cluster

Shared
 Storage

Focused on resource consolidation not agility

Wednesday, October 23, 13
Software Is Eating Hardware
•

Moore’s Law has pulled fault tolerance up the stack

•

Commodity Hardware
•
•

•

Reduced cost
Services more workload types

Dynamic resource allocation

Wednesday, October 23, 13
Software Is Eating Hardware
•

Moore’s Law has pulled fault tolerance up the stack

•

Commodity Hardware
•
•

•

Reduced cost
Services more workload types

Dynamic resource allocation

Specialized Hardware Reduces Agility

Wednesday, October 23, 13
Cloud Workload
•

Reliable

•

Fault Tolerant

•

Self-Service provisioning

•

Control Plane - Dynamic
scale out model

Rack

Rack

App

App

Commodity Hardware

•

SDN

Wednesday, October 23, 13

Object
 Storage
Cloud Workload
•

Reliable

•

Fault Tolerant

•

Self-Service provisioning

•

Control Plane - Dynamic
scale out model

Rack

Rack

App

App

Commodity Hardware

•

SDN

Object
 Storage

Resource optimization increases agility

Wednesday, October 23, 13
Reality

Traditional
Workload

Wednesday, October 23, 13

Cloud
Workload
Complete Private Cloud

+

Compute Services

Wednesday, October 23, 13

Object Storage
Services
What Is Apache CloudStack?

§Open source software that deploys
and manages large networks of
virtual machines, as a highly
available, highly scalable
Infrastructure as a Service (IaaS)
cloud computing platform.
§CloudStack is a Top-Level Project at
the Apache Software Foundation.

Wednesday, October 23, 13
What Is Apache CloudStack?

§Open source software that deploys
and manages large networks of
virtual machines, as a highly
available, highly scalable
Infrastructure as a Service (IaaS)
cloud computing platform.
§CloudStack is a Top-Level Project at
the Apache Software Foundation.

Wednesday, October 23, 13
Apache CloudStack Users

Wednesday, October 23, 13
Anatomy Of CloudStack
•

Management Server Farm
•

•

VM

Network
Host

Collection of clusters in the same failure boundary

Primary
Storage

A grouping of hosts and their associated storage

Hosts
•

•

Collection of pods, network offerings and secondary storage

Cluster
•

•

Host

Pod
•

•

VM

Zone
•

•

Management and provisioning tasks

Cluster

Secondary
Storage

Cluster

Servers onto which services will be provisioned

Primary Storage
CloudStack Pod

•
•

VM disk storage

Network
•

CloudStack Pod

Logical network associated with service offerings
Zone

•

Secondary Storage
•

Template, snapshot and ISO storage

Wednesday, October 23, 13
Primary Vs Secondary Storage
•

Random access read/write

•

Write once/read many

•

Changes often

•

Append only

•

Zone Scoped

•

Zone or Region Scoped

•

Focused on throughput

•

Focused on reliability

Wednesday, October 23, 13
Primary Vs Secondary Storage
•

Random access read/write

•

Write once/read many

•

Changes often

•

Append only

•

Zone Scoped

•

Zone or Region Scoped

•

Focused on throughput

•

Focused on reliability

Secondary Storage is the lifeboat.

Wednesday, October 23, 13
What Is Riak CS?
•

Simple, reliable storage of large objects accessed using the S3 or Swift
API

•

Objects are stored in buckets with a unique key

•

Multi-tenant security model with per object ACLs

•

Usage Accounting and Reporting

•

Open Source (Apache2 Licensed)

Wednesday, October 23, 13
What Is Riak CS?
•

Simple, reliable storage of large objects accessed using the S3 or Swift
API

•

Objects are stored in buckets with a unique key

•

Multi-tenant security model with per object ACLs

•

Usage Accounting and Reporting

•

Open Source (Apache2 Licensed)

Your Own Private S3

Wednesday, October 23, 13
Anatomy Of Riak CS
•

S3/Swift API Proxy + Riak key-value store

•

Peer-to-Peer Design: Any node can service any read or accept
any write request

•

Maintains multiple replicas (default 3) spread across multiple
nodes

•

Ops Friendly

Wednesday, October 23, 13
Anatomy Of Riak CS
•

S3/Swift API Proxy + Riak key-value store

•

Peer-to-Peer Design: Any node can service any read or accept
any write request

•

Maintains multiple replicas (default 3) spread across multiple
nodes

•

Ops Friendly

Horizontally scaleable storage on
commodity hardware

Wednesday, October 23, 13
Riak CS Use Cases

•

Secondary Storage for VM snapshot and template data

•

Database Backup Storage

•

Serving Static Content

•

Application Log Storage

Wednesday, October 23, 13
Achieving Commodity Reliability

•

Create a zone per power source/backbone network connection

•

Establish independent primary storage in each zone

•

Utilize intra-datacenter block-level replication between zones

•

Distribute Riak CS nodes evenly across zones

Wednesday, October 23, 13
The Complete Private Cloud
Traditional

More Related Content

What's hot

What's hot (20)

Building a Bigdata Architecture on AWS
Building a Bigdata Architecture on AWSBuilding a Bigdata Architecture on AWS
Building a Bigdata Architecture on AWS
 
Protecting Your Big Data on the Cloud
Protecting Your Big Data on the CloudProtecting Your Big Data on the Cloud
Protecting Your Big Data on the Cloud
 
AWS Data migration services
AWS Data migration servicesAWS Data migration services
AWS Data migration services
 
Integrating Infrastructure as Code into a Continuous Delivery Pipeline | AWS ...
Integrating Infrastructure as Code into a Continuous Delivery Pipeline | AWS ...Integrating Infrastructure as Code into a Continuous Delivery Pipeline | AWS ...
Integrating Infrastructure as Code into a Continuous Delivery Pipeline | AWS ...
 
Leveraging ApsaraDB to Deploy Business Data on the Cloud
Leveraging ApsaraDB to Deploy Business Data on the CloudLeveraging ApsaraDB to Deploy Business Data on the Cloud
Leveraging ApsaraDB to Deploy Business Data on the Cloud
 
Key Design Considerations Private and Hybrid Clouds - RightScale Compute 2013
Key Design Considerations Private and Hybrid Clouds - RightScale Compute 2013Key Design Considerations Private and Hybrid Clouds - RightScale Compute 2013
Key Design Considerations Private and Hybrid Clouds - RightScale Compute 2013
 
IBM Cloud Object Storage
IBM Cloud Object StorageIBM Cloud Object Storage
IBM Cloud Object Storage
 
Riak at Engine Yard Cloud
Riak at Engine Yard CloudRiak at Engine Yard Cloud
Riak at Engine Yard Cloud
 
Building Bulletproof Infrastructure on AWS
Building Bulletproof Infrastructure on AWSBuilding Bulletproof Infrastructure on AWS
Building Bulletproof Infrastructure on AWS
 
Responding to Digital Transformation With RDS Database Technology
Responding to Digital Transformation With RDS Database TechnologyResponding to Digital Transformation With RDS Database Technology
Responding to Digital Transformation With RDS Database Technology
 
How does Riak compare to Cassandra? [Cassandra London User Group July 2011]
How does Riak compare to Cassandra? [Cassandra London User Group July 2011]How does Riak compare to Cassandra? [Cassandra London User Group July 2011]
How does Riak compare to Cassandra? [Cassandra London User Group July 2011]
 
Getting Started with Elasticsearch
Getting Started with ElasticsearchGetting Started with Elasticsearch
Getting Started with Elasticsearch
 
Backup on the cloud Webinar
Backup on the cloud WebinarBackup on the cloud Webinar
Backup on the cloud Webinar
 
Getting Started with EC2, S3 and EMR
Getting Started with EC2, S3 and EMRGetting Started with EC2, S3 and EMR
Getting Started with EC2, S3 and EMR
 
(ENT201) New Generation Hybrid Architectures with Suncorp, NetApp, and AWS | ...
(ENT201) New Generation Hybrid Architectures with Suncorp, NetApp, and AWS | ...(ENT201) New Generation Hybrid Architectures with Suncorp, NetApp, and AWS | ...
(ENT201) New Generation Hybrid Architectures with Suncorp, NetApp, and AWS | ...
 
Beyond Relational
Beyond RelationalBeyond Relational
Beyond Relational
 
Launch and Scale Your E-commerce Website with Magento
Launch and Scale Your E-commerce Website with MagentoLaunch and Scale Your E-commerce Website with Magento
Launch and Scale Your E-commerce Website with Magento
 
AliCloud Object Storage Service (OSS) Core Features
AliCloud Object Storage Service (OSS) Core FeaturesAliCloud Object Storage Service (OSS) Core Features
AliCloud Object Storage Service (OSS) Core Features
 
In Flux Limiting for a multi-tenant logging service
In Flux Limiting for a multi-tenant logging serviceIn Flux Limiting for a multi-tenant logging service
In Flux Limiting for a multi-tenant logging service
 
Zabbix at scale with Elasticsearch
Zabbix at scale with ElasticsearchZabbix at scale with Elasticsearch
Zabbix at scale with Elasticsearch
 

Similar to Building Complete Private Clouds with Apache CloudStack and Riak CS

Apache CloudStack 4.2: A First Look
Apache CloudStack 4.2: A First LookApache CloudStack 4.2: A First Look
Apache CloudStack 4.2: A First Look
Shanker Balan
 
What's New with Big Data Analytics
What's New with Big Data AnalyticsWhat's New with Big Data Analytics
What's New with Big Data Analytics
Amazon Web Services
 

Similar to Building Complete Private Clouds with Apache CloudStack and Riak CS (20)

Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CSBetter, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
Better, Faster, Cheaper Infrastructure: Apache CloudStack and Riak CS
 
Making Cloudy Peanut Butter Cups: Apache CloudStack + Riak CS
Making Cloudy Peanut Butter Cups: Apache CloudStack + Riak CSMaking Cloudy Peanut Butter Cups: Apache CloudStack + Riak CS
Making Cloudy Peanut Butter Cups: Apache CloudStack + Riak CS
 
Database Modernization
Database ModernizationDatabase Modernization
Database Modernization
 
AWS Webcast - Library Systems on the AWS Cloud
AWS Webcast - Library Systems on the AWS CloudAWS Webcast - Library Systems on the AWS Cloud
AWS Webcast - Library Systems on the AWS Cloud
 
CIW Lab with CoheisveFT: Get started in public cloud - Part 2 Hands On
CIW Lab with CoheisveFT: Get started in public cloud - Part 2 Hands OnCIW Lab with CoheisveFT: Get started in public cloud - Part 2 Hands On
CIW Lab with CoheisveFT: Get started in public cloud - Part 2 Hands On
 
Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)Being Well Architected in the Cloud (Updated)
Being Well Architected in the Cloud (Updated)
 
Being Well-Architected in the Cloud
Being Well-Architected in the CloudBeing Well-Architected in the Cloud
Being Well-Architected in the Cloud
 
AWS Architecture Fundamentals - Houston
AWS Architecture Fundamentals - HoustonAWS Architecture Fundamentals - Houston
AWS Architecture Fundamentals - Houston
 
Cloud computing Azure
Cloud computing AzureCloud computing Azure
Cloud computing Azure
 
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
AWS re:Invent 2016: Discovery Channel's Broadcast Workflows and Channel Origi...
 
Azure Fundamentals Part 2
Azure Fundamentals Part 2Azure Fundamentals Part 2
Azure Fundamentals Part 2
 
Intro to CloudStack
Intro to CloudStackIntro to CloudStack
Intro to CloudStack
 
Openstack: starter level
Openstack: starter levelOpenstack: starter level
Openstack: starter level
 
AWS Re Invent 2019 Recap
AWS Re Invent 2019 Recap AWS Re Invent 2019 Recap
AWS Re Invent 2019 Recap
 
Scaling the Platform for Your Startup
Scaling the Platform for Your StartupScaling the Platform for Your Startup
Scaling the Platform for Your Startup
 
Comenzando com la nube hibrida
Comenzando com la nube hibrida Comenzando com la nube hibrida
Comenzando com la nube hibrida
 
AWS Webcast - Website Hosting in the Cloud
AWS Webcast - Website Hosting in the CloudAWS Webcast - Website Hosting in the Cloud
AWS Webcast - Website Hosting in the Cloud
 
Apache CloudStack 4.2: A First Look
Apache CloudStack 4.2: A First LookApache CloudStack 4.2: A First Look
Apache CloudStack 4.2: A First Look
 
Create cloud service on AWS
Create cloud service on AWSCreate cloud service on AWS
Create cloud service on AWS
 
What's New with Big Data Analytics
What's New with Big Data AnalyticsWhat's New with Big Data Analytics
What's New with Big Data Analytics
 

Recently uploaded

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

Building Complete Private Clouds with Apache CloudStack and Riak CS

  • 1. BUILDING COMPLETE PRIVATE CLOUDS WITH APACHE CLOUDSTACK + RIAK CS John Burwell (jburwell@basho.com | @john_burwell) Wednesday, October 23, 13
  • 2. Who Am I • Consulting Engineer @ Basho Technologies • Member, Apache CloudStack PMC • Ran operations and designed automated provisioning for hybrid analytic/virtualization clouds • Led architectural design and server-side development of a SaaS physical security platform Wednesday, October 23, 13
  • 3. ... but I submitted a ticket. Wednesday, October 23, 13
  • 4. Shifting Role Of IT From Cost Center To Business Opportunity Wednesday, October 23, 13
  • 6. Agility Exploitation Requires Rapid Execution Infrastructure management must be delegated Wednesday, October 23, 13
  • 7. Agility Exploitation Requires Rapid Execution Infrastructure management must be delegated Infrastructure Must Become Boring Wednesday, October 23, 13
  • 8. Composable Infrastructure • Resource Pooling • Rapid Elasticity • Self Service • Metering/Charge Back Wednesday, October 23, 13
  • 9. Got It ... Why Go Private? • Leverage existing infrastructure investment • Customization and Control • Regulatory/Security Requirements • Cost Wednesday, October 23, 13
  • 10. Doesn’t vSphere/ XCP/XenServer already do that? Wednesday, October 23, 13
  • 11. Traditional Workload • • Fault tolerant • Management Reliable Specialized hardware • IT managed provisioning • Static scale out model Wednesday, October 23, 13 Network Hypervisor Cluster Hypervisor Cluster Shared
  • 13. Traditional Workload • • Fault tolerant • Management Reliable Specialized hardware • IT managed provisioning • Static scale out model Network Hypervisor Cluster Hypervisor Cluster Shared
  • 14.  Storage Focused on resource consolidation not agility Wednesday, October 23, 13
  • 15. Software Is Eating Hardware • Moore’s Law has pulled fault tolerance up the stack • Commodity Hardware • • • Reduced cost Services more workload types Dynamic resource allocation Wednesday, October 23, 13
  • 16. Software Is Eating Hardware • Moore’s Law has pulled fault tolerance up the stack • Commodity Hardware • • • Reduced cost Services more workload types Dynamic resource allocation Specialized Hardware Reduces Agility Wednesday, October 23, 13
  • 17. Cloud Workload • Reliable • Fault Tolerant • Self-Service provisioning • Control Plane - Dynamic scale out model Rack Rack App App Commodity Hardware • SDN Wednesday, October 23, 13 Object
  • 19. Cloud Workload • Reliable • Fault Tolerant • Self-Service provisioning • Control Plane - Dynamic scale out model Rack Rack App App Commodity Hardware • SDN Object
  • 20.  Storage Resource optimization increases agility Wednesday, October 23, 13
  • 22. Complete Private Cloud + Compute Services Wednesday, October 23, 13 Object Storage Services
  • 23. What Is Apache CloudStack? §Open source software that deploys and manages large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. §CloudStack is a Top-Level Project at the Apache Software Foundation. Wednesday, October 23, 13
  • 24. What Is Apache CloudStack? §Open source software that deploys and manages large networks of virtual machines, as a highly available, highly scalable Infrastructure as a Service (IaaS) cloud computing platform. §CloudStack is a Top-Level Project at the Apache Software Foundation. Wednesday, October 23, 13
  • 26. Anatomy Of CloudStack • Management Server Farm • • VM Network Host Collection of clusters in the same failure boundary Primary Storage A grouping of hosts and their associated storage Hosts • • Collection of pods, network offerings and secondary storage Cluster • • Host Pod • • VM Zone • • Management and provisioning tasks Cluster Secondary Storage Cluster Servers onto which services will be provisioned Primary Storage CloudStack Pod • • VM disk storage Network • CloudStack Pod Logical network associated with service offerings Zone • Secondary Storage • Template, snapshot and ISO storage Wednesday, October 23, 13
  • 27. Primary Vs Secondary Storage • Random access read/write • Write once/read many • Changes often • Append only • Zone Scoped • Zone or Region Scoped • Focused on throughput • Focused on reliability Wednesday, October 23, 13
  • 28. Primary Vs Secondary Storage • Random access read/write • Write once/read many • Changes often • Append only • Zone Scoped • Zone or Region Scoped • Focused on throughput • Focused on reliability Secondary Storage is the lifeboat. Wednesday, October 23, 13
  • 29. What Is Riak CS? • Simple, reliable storage of large objects accessed using the S3 or Swift API • Objects are stored in buckets with a unique key • Multi-tenant security model with per object ACLs • Usage Accounting and Reporting • Open Source (Apache2 Licensed) Wednesday, October 23, 13
  • 30. What Is Riak CS? • Simple, reliable storage of large objects accessed using the S3 or Swift API • Objects are stored in buckets with a unique key • Multi-tenant security model with per object ACLs • Usage Accounting and Reporting • Open Source (Apache2 Licensed) Your Own Private S3 Wednesday, October 23, 13
  • 31. Anatomy Of Riak CS • S3/Swift API Proxy + Riak key-value store • Peer-to-Peer Design: Any node can service any read or accept any write request • Maintains multiple replicas (default 3) spread across multiple nodes • Ops Friendly Wednesday, October 23, 13
  • 32. Anatomy Of Riak CS • S3/Swift API Proxy + Riak key-value store • Peer-to-Peer Design: Any node can service any read or accept any write request • Maintains multiple replicas (default 3) spread across multiple nodes • Ops Friendly Horizontally scaleable storage on commodity hardware Wednesday, October 23, 13
  • 33. Riak CS Use Cases • Secondary Storage for VM snapshot and template data • Database Backup Storage • Serving Static Content • Application Log Storage Wednesday, October 23, 13
  • 34. Achieving Commodity Reliability • Create a zone per power source/backbone network connection • Establish independent primary storage in each zone • Utilize intra-datacenter block-level replication between zones • Distribute Riak CS nodes evenly across zones Wednesday, October 23, 13
  • 35. The Complete Private Cloud Traditional
  • 39.  CS Wednesday, October 23, 13 Rack App Hypervisor Cluster Rack
  • 40. Up And Running With Riak CS • Learn more @ http://basho.com/riak-cloud-storage • Grab it @ http://docs.basho.com/riakcs/latest/riakcsdownloads/ • Follow us @basho • Help from the riak-users@lists.basho.com mailing list or on FreeNode @ #riak • Contribute @ http://github.com/basho/riak_cs Wednesday, October 23, 13
  • 41. Join Our Community • Learn more @ http://cloudstack.apache.org • Grab it @ http://cloudstack.apache.org/downloads.html • Follow us @cloudstack • Help from the cloudstack-users@cloudstack.apache.org mailing list or on Freenode @ #cloudstack • Contribute on the cloudstack-dev@cloudstack.apache.org mailing list or on Freenode @ #cloudstack-dev Wednesday, October 23, 13
  • 43. Thank you! Deck http://slideshare.net/JohnBurwell1 Follow @ john_burwell Email jburwell@basho.com Wednesday, October 23, 13