SlideShare uma empresa Scribd logo
1 de 29
Baixar para ler offline
RED HAT CEPH STORAGE:
PAST, PRESENT AND FUTURE
Neil Levine
June 25, 2016
AGENDA
Red Hat Storage Overview
Past
Retrospective on Inktank acquisition
Red Hat Ceph Storage 1.2
Present
Red Hat Ceph Storage 1.3
RHEL-OSP with 1.3
Future
Red Hat Ceph Storage 2.0
OpenStack and Containers
Open Software-Defined Storage is a fundamental
reimagining of how storage infrastructure works.
It provides substantial economic and operational
advantages, and it has quickly become ideally
suited for a growing number of use cases.
TODAY EMERGING FUTURE
Cloud
Infrastructure
Cloud
Native Apps
Analytics
Hyper-
Convergence
Containers
???
???
OPEN, SOFTWARE-DEFINED STORAGE
A RISING TIDE
“By 2020, between 70-80% of unstructured data will be held on
lower-cost storage managed by SDS environments.”
“By 2019, 70% of existing storage array products
will also be available as software only versions”
“By 2016, server-based storage solutions will lower
storage hardware costs by 50% or more.”
Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry”
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
Innovation Insight: Separating Hype From Hope for Software-Defined Storage
Market size is projected to increase approximately 20%
year-over-year between 2015 and 2019.
201
3
201
4
201
5
201
6
201
7
201
8
201
9
$1,349B
$1,195B
$1,029B
$859B
$706B
$592B
SDS-P MARKET SIZE BY SEGMENT
$457B
Block Storage
File Storage
Object Storage
Hyperconverged
Source: IDC
Software-Defined Storage is leading a shift in the
global storage industry, with far-reaching effects.
THE RED HAT STORAGE PORTFOLIO
Ceph
management
OPENSOURCE
SOFTWARE
Gluster
management
Ceph
data services
Gluster
data services
STANDARD
HARDWARE
Share-nothing, scale-out
architecture provides durability
and adapts to changing demands
Self-managing and self-healing
features reduce operational overhead
Standards-based interfaces
and full APIs ease integration
with applications and systems
Supported by the
experts at Red Hat
● VM Storage with OpenStack Cinder,
Glance & Nova
● Object storage for tenant apps
Built from the ground up as a next-generation
storage system, based on years of research and
suitable for powering infrastructure platforms
TARGET USE CASES
Rich Media and Archival
● S3-compatible object storage
Highly tunable, extensible, and configurable, with
policy-based control and no single point of failure
Offers mature interfaces for block and object
storage for the enterprise
Cloud Infrastructure
Customer Highlight: Cisco
Cisco uses Red Hat Ceph Storage to deliver storage
for next-generation cloud services
RED HAT CEPH STORAGE
Powerful distributed storage for the cloud and beyond
ANALYTICS
Big Data analytics with Hadoop
CLOUD
INFRASTRUCTURE
RICH MEDIA
AND ARCHIVAL
SYNC AND
SHARE
ENTERPRISE
VIRTUALIZATION
Machine data analytics with Splunk
Virtual machine storage with OpenStack
Object storage for tenant applications
Cost-effective storage for rich media streaming
Active archives
File sync and share with ownCloud
Storage for conventional
virtualization with RHEV
FOCUSED SET OF USE CASES
PAST
TIMELINE
Jul14 Mar15 Jun15May14
INKTANK CEPH ENTERPRISE
v1.2
v1.3
Inktank acquisition &
Ceph Firefly released
Ceph Hammer released
RED HAT CEPH STORAGE
MGMT
All required dependencies are now included within a local package
repository, allowing deployment to non-Internet-connected storage nodes.
MGMTCORECORECOREOBJECT
Administrators can now perform basic cluster administration tasks
through Calamari, the Ceph visual interface.
Erasure-coded storage back-ends are now available, providing durability
with lower capacity requirements than traditional, replicated back-ends.
A cache tier pool can now be designated as a writeback or read cache for
an underlying storage pool in order to provide cost-effective performance.
Clients can be configured to read objects from the closest replica,
increasing performance and reducing network strain.
The Ceph Object Gateway now supports and enforces quotas
for users and buckets.
Off-line installer
GUI management
Erasure coding
Cache tiering
RADOS read-
affinity
User and
bucket quotas
These features were introduced in version 1.2 of Red Hat Ceph Storage,
and have been supported by Red Hat since July, 2014.
DETAIL:
RED HAT CEPH STORAGE V1.2
DELIVERING RED HAT CEPH STORAGE
BEFORE DURING AFTER
DELIVERING RED HAT CEPH STORAGE
Bugzilla
Fork
Package
Doc
Test
A GENUINE RED HAT PRODUCT
CEPH SUCCESSES
PRESENT
RED HAT CEPH STORAGE 1.3
GA Today
Based on Ceph Hammer (0.94)
Core Themes
Robustness at Scale
Operational Efficiency
Performance
Red Hat Ceph Storage 1.3 contains improved logic and
algorithms that allow it to do the “right thing” for users with
multi-petabyte clusters where hardware failure is normal:
ROBUSTNESS AT SCALE
Improved self-management for large clusters
● Improved automatic rebalancing logic, which prioritizes
degraded over misplaced objects
● Rebalancing operations can be temporarily disabled so they
don’t impact performance
● Time-scheduled scrubbing, to avoid disruption during peak
times
● Sharding of object buckets to avoid hot-spots
Ceph is a distributed system with lots of moving parts.
Red Hat Ceph Storage 1.3 introduces features to help
manage storage more efficiently.
OPERATIONAL EFFICIENCY
Making administration tasks easier
● Calamari now supports multiple users and clusters
● CRUSH management via Calamari API allows
programmatic adjustment of placement policies
● Lightweight, embedded Civetweb server eases
deployment of the Ceph Object Gateway
● Faster Ceph Block Device operations make resize,
delete, and flatten operations quicker, while export
parallelism makes backups faster
CEPH WITH SANDISK INFINIFLASH
A number of performance tweaks improve the speed of
Red Hat Ceph Storage 1.3 and increase I/O consistency:
PERFORMANCE
Speedier, more efficient distributed storage
● Optimizations for flash storage devices
increases Ceph’s topline speed
● Read ahead caching accelerates virtual
machine booting in OpenStack
● Allocation hinting reduces XFS fragmentation
to avoid performance degradation over time
● Caching hinting preserves the cache’s
advantages and improves performance
PERFORMANCE
SCALE
OTHER FEATURES
S3 Object Expiration
Swift Storage Policies
IPv6 Support
Local/Pyramid Codes
RED HAT CEPH STORAGE 1.3.z
SELinux Support
Satellite Integration
Puppet-based Installer (Tech Preview)
RHEL OPENSTACK PLATFORM
w/CEPH
Feb15 Jul16Jun14
Icehouse
RHEL-OSP5
RHEL-OSP6
RHEL-OSP7
Juno
Kilo
Juno
ICE 1.2
RHCS 1.2.3 & 1.3.0
RHCS 1.3.0
RHEL OPENSTACK PLATFORM
w/CEPH
RHEL-OSP5
RHEL-OSP6
RHEL-OSP7
Integrated SKU | Integrated Installer (Client)
Ephemeral Volumes
Integrated Installer (Client and Server) | Image Conversion
FUTURE
DETAIL:
RED HAT CEPH STORAGE “TUFNELL”
CORECORECORE
More intelligent scrubbing policies and improved peering logic to reduce
impact of common operations on overall cluster performance.
More information about objects will be provided to help administrators
perform repair operations on corrupted data.
New backend for OSDs to provide performance benefits on existing
and modern drives (SSD, K/V).
Performance
Consistency
Guided Repair
New Backing Store
(Tech Preview)
These projects are currently active in the Ceph development community. They may be
available and supported by Red Hat once they reach the necessary level of maturity.
MGMT
A new user interface with improved sorting and visibility of critical data.
MGMT
Introduction of altering features that notify administrations of critical
issues via email or SMS.
New UI
Alerting
BLOCK
Introduction of a highly-available iSCSI interface for the Ceph Block Device,
allowing integration with legacy systems
BLOCKOBJECTOBJECT
Capabilities for managing virtual block devices in multiple regions, maintaining
consistency through automated mirroring of incremental changes
Access to objects stored in the Ceph Object Gateway via standard Network
File System (NFS) endpoints, providing storage for legacy systems and
applications
Support for deployment of the Ceph Object Gateway across multiple sites
in an active/active configuration (in addition to the currently-available
active/passive configuration)
iSCSI
Mirroring
NFS
Active/Active
Multi-Site
These projects are currently active in the Ceph development community. They may be
available and supported by Red Hat once they reach the necessary level of maturity.
DETAIL:
RED HAT CEPH STORAGE “TUFNELL”
RHEL OPENSTACK PLATFORM
w/CEPH
RHEL-OSP 8
Containers
QoS | Live Migration | Disaster Recovery
RBD Driver for Kubernetes | S3 Backend for OpenShift
Red Hat Ceph Storage: Past, Present and Future

Mais conteúdo relacionado

Mais procurados

Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red_Hat_Storage
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
Rodrigo Missiaggia
 

Mais procurados (20)

Red Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph StorageRed Hat Storage Day Boston - OpenStack + Ceph Storage
Red Hat Storage Day Boston - OpenStack + Ceph Storage
 
Red Hat Storage Day New York - Persistent Storage for Containers
Red Hat Storage Day New York - Persistent Storage for ContainersRed Hat Storage Day New York - Persistent Storage for Containers
Red Hat Storage Day New York - Persistent Storage for Containers
 
Red Hat Storage Day Dallas - Gluster Storage in Containerized Application
Red Hat Storage Day Dallas - Gluster Storage in Containerized Application Red Hat Storage Day Dallas - Gluster Storage in Containerized Application
Red Hat Storage Day Dallas - Gluster Storage in Containerized Application
 
Red Hat Storage Day Dallas - Why Software-defined Storage Matters
Red Hat Storage Day Dallas - Why Software-defined Storage MattersRed Hat Storage Day Dallas - Why Software-defined Storage Matters
Red Hat Storage Day Dallas - Why Software-defined Storage Matters
 
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
Red Hat Storage Day Seattle: Stretching A Gluster Cluster for Resilient Messa...
 
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red HatThe Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
The Future of Cloud Software Defined Storage with Ceph: Andrew Hatfield, Red Hat
 
Red Hat Storage Day Boston - Supermicro Super Storage
Red Hat Storage Day Boston - Supermicro Super StorageRed Hat Storage Day Boston - Supermicro Super Storage
Red Hat Storage Day Boston - Supermicro Super Storage
 
Red Hat Storage Day New York - Penguin Computing Spotlight: Delivering Open S...
Red Hat Storage Day New York - Penguin Computing Spotlight: Delivering Open S...Red Hat Storage Day New York - Penguin Computing Spotlight: Delivering Open S...
Red Hat Storage Day New York - Penguin Computing Spotlight: Delivering Open S...
 
Red Hat Storage Day New York - Intel Unlocking Big Data Infrastructure Effici...
Red Hat Storage Day New York - Intel Unlocking Big Data Infrastructure Effici...Red Hat Storage Day New York - Intel Unlocking Big Data Infrastructure Effici...
Red Hat Storage Day New York - Intel Unlocking Big Data Infrastructure Effici...
 
Red Hat Storage Day New York - Red Hat Gluster Storage: Historical Tick Data ...
Red Hat Storage Day New York - Red Hat Gluster Storage: Historical Tick Data ...Red Hat Storage Day New York - Red Hat Gluster Storage: Historical Tick Data ...
Red Hat Storage Day New York - Red Hat Gluster Storage: Historical Tick Data ...
 
Bootcamp 2017 - SQL Server on Linux
Bootcamp 2017 - SQL Server on LinuxBootcamp 2017 - SQL Server on Linux
Bootcamp 2017 - SQL Server on Linux
 
Red Hat Storage Day Atlanta - Why Software Defined Storage Matters
Red Hat Storage Day Atlanta - Why Software Defined Storage MattersRed Hat Storage Day Atlanta - Why Software Defined Storage Matters
Red Hat Storage Day Atlanta - Why Software Defined Storage Matters
 
Red Hat Storage Day Boston - Red Hat Gluster Storage vs. Traditional Storage ...
Red Hat Storage Day Boston - Red Hat Gluster Storage vs. Traditional Storage ...Red Hat Storage Day Boston - Red Hat Gluster Storage vs. Traditional Storage ...
Red Hat Storage Day Boston - Red Hat Gluster Storage vs. Traditional Storage ...
 
Red Hat Storage Day Seattle: Persistent Storage for Containerized Applications
Red Hat Storage Day Seattle: Persistent Storage for Containerized ApplicationsRed Hat Storage Day Seattle: Persistent Storage for Containerized Applications
Red Hat Storage Day Seattle: Persistent Storage for Containerized Applications
 
Scalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the CloudScalable POSIX File Systems in the Cloud
Scalable POSIX File Systems in the Cloud
 
Red Hat Storage for Mere Mortals
Red Hat Storage for Mere MortalsRed Hat Storage for Mere Mortals
Red Hat Storage for Mere Mortals
 
Why Software-Defined Storage Matters
Why Software-Defined Storage MattersWhy Software-Defined Storage Matters
Why Software-Defined Storage Matters
 
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
Red Hat Storage Day Atlanta - Red Hat Gluster Storage vs. Traditional Storage...
 
Red hat ceph storage customer presentation
Red hat ceph storage customer presentationRed hat ceph storage customer presentation
Red hat ceph storage customer presentation
 
IBM Power9 Features and Specifications
IBM Power9 Features and SpecificationsIBM Power9 Features and Specifications
IBM Power9 Features and Specifications
 

Semelhante a Red Hat Ceph Storage: Past, Present and Future

Red hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivoRed hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivo
Nextel S.A.
 
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Miguel Pérez Colino
 

Semelhante a Red Hat Ceph Storage: Past, Present and Future (20)

Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStackPeanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
Peanut Butter and jelly: Mapping the deep Integration between Ceph and OpenStack
 
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise CloudsCEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
CEPH & OPENSTACK - Red Hat's Winning Combination for Enterprise Clouds
 
Red Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) OverviewRed Hat Storage 2014 - Product(s) Overview
Red Hat Storage 2014 - Product(s) Overview
 
New use cases for Ceph, beyond OpenStack, Luis Rico
New use cases for Ceph, beyond OpenStack, Luis RicoNew use cases for Ceph, beyond OpenStack, Luis Rico
New use cases for Ceph, beyond OpenStack, Luis Rico
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Storage Roadmap
Red Hat Storage RoadmapRed Hat Storage Roadmap
Red Hat Storage Roadmap
 
Red Hat Summit 2015: Red Hat Storage Breakfast session
Red Hat Summit 2015: Red Hat Storage Breakfast sessionRed Hat Summit 2015: Red Hat Storage Breakfast session
Red Hat Summit 2015: Red Hat Storage Breakfast session
 
Red hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivoRed hat storage el almacenamiento disruptivo
Red hat storage el almacenamiento disruptivo
 
Introduction to OpenStack (2012)
Introduction to OpenStack (2012)Introduction to OpenStack (2012)
Introduction to OpenStack (2012)
 
Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015Cloud Strategies for a modern hybrid datacenter - Dec 2015
Cloud Strategies for a modern hybrid datacenter - Dec 2015
 
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMFGestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
Gestione gerarchica dei dati con SUSE Enterprise Storage e HPE DMF
 
Ceph as software define storage
Ceph as software define storageCeph as software define storage
Ceph as software define storage
 
Scality - RING Overview
Scality - RING OverviewScality - RING Overview
Scality - RING Overview
 
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and InfrastrctureRevolutionary Storage for Modern Databases, Applications and Infrastrcture
Revolutionary Storage for Modern Databases, Applications and Infrastrcture
 
HPE Solutions for Challenges in AI and Big Data
HPE Solutions for Challenges in AI and Big DataHPE Solutions for Challenges in AI and Big Data
HPE Solutions for Challenges in AI and Big Data
 
Saviak lviv ai-2019-e-mail (1)
Saviak lviv ai-2019-e-mail (1)Saviak lviv ai-2019-e-mail (1)
Saviak lviv ai-2019-e-mail (1)
 
From Rack scale computers to Warehouse scale computers
From Rack scale computers to Warehouse scale computersFrom Rack scale computers to Warehouse scale computers
From Rack scale computers to Warehouse scale computers
 
OpenStack - An Overview
OpenStack - An OverviewOpenStack - An Overview
OpenStack - An Overview
 
Introducing Mache
Introducing MacheIntroducing Mache
Introducing Mache
 
Why Software-Defined Storage Matters
Why Software-Defined Storage MattersWhy Software-Defined Storage Matters
Why Software-Defined Storage Matters
 

Mais de Red_Hat_Storage

Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...
Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...
Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...
Red_Hat_Storage
 
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red_Hat_Storage
 

Mais de Red_Hat_Storage (14)

Red Hat Storage Day Dallas - Storage for OpenShift Containers
Red Hat Storage Day Dallas - Storage for OpenShift Containers Red Hat Storage Day Dallas - Storage for OpenShift Containers
Red Hat Storage Day Dallas - Storage for OpenShift Containers
 
Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...
Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...
Red Hat Storage Day Dallas - Red Hat Ceph Storage Acceleration Utilizing Flas...
 
Red Hat Storage Day Dallas - Defiance of the Appliance
Red Hat Storage Day Dallas - Defiance of the Appliance Red Hat Storage Day Dallas - Defiance of the Appliance
Red Hat Storage Day Dallas - Defiance of the Appliance
 
Red Hat Storage Day Boston - Why Software-defined Storage Matters
Red Hat Storage Day Boston - Why Software-defined Storage MattersRed Hat Storage Day Boston - Why Software-defined Storage Matters
Red Hat Storage Day Boston - Why Software-defined Storage Matters
 
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology Red Hat Ceph Storage Acceleration Utilizing Flash Technology
Red Hat Ceph Storage Acceleration Utilizing Flash Technology
 
Red Hat Storage Day Boston - Persistent Storage for Containers
Red Hat Storage Day Boston - Persistent Storage for Containers Red Hat Storage Day Boston - Persistent Storage for Containers
Red Hat Storage Day Boston - Persistent Storage for Containers
 
Red Hat Storage Day - When the Ceph Hits the Fan
Red Hat Storage Day -  When the Ceph Hits the FanRed Hat Storage Day -  When the Ceph Hits the Fan
Red Hat Storage Day - When the Ceph Hits the Fan
 
Red Hat Storage Day New York - New Reference Architectures
Red Hat Storage Day New York - New Reference ArchitecturesRed Hat Storage Day New York - New Reference Architectures
Red Hat Storage Day New York - New Reference Architectures
 
Red Hat Storage Day New York -Performance Intensive Workloads with Samsung NV...
Red Hat Storage Day New York -Performance Intensive Workloads with Samsung NV...Red Hat Storage Day New York -Performance Intensive Workloads with Samsung NV...
Red Hat Storage Day New York -Performance Intensive Workloads with Samsung NV...
 
Red Hat Storage Day New York - Welcome Remarks
Red Hat Storage Day New York - Welcome Remarks Red Hat Storage Day New York - Welcome Remarks
Red Hat Storage Day New York - Welcome Remarks
 
Red Hat Storage Day New York - What's New in Red Hat Ceph Storage
Red Hat Storage Day New York - What's New in Red Hat Ceph StorageRed Hat Storage Day New York - What's New in Red Hat Ceph Storage
Red Hat Storage Day New York - What's New in Red Hat Ceph Storage
 
Storage: Limitations, Frustrations, and Coping with Future Needs
Storage: Limitations, Frustrations, and Coping with Future NeedsStorage: Limitations, Frustrations, and Coping with Future Needs
Storage: Limitations, Frustrations, and Coping with Future Needs
 
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
Red Hat Storage Day Atlanta - Persistent Storage for Linux Containers
 
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
Red Hat Storage Day Atlanta - Designing Ceph Clusters Using Intel-Based Hardw...
 

Último

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Último (20)

🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 

Red Hat Ceph Storage: Past, Present and Future

  • 1. RED HAT CEPH STORAGE: PAST, PRESENT AND FUTURE Neil Levine June 25, 2016
  • 2. AGENDA Red Hat Storage Overview Past Retrospective on Inktank acquisition Red Hat Ceph Storage 1.2 Present Red Hat Ceph Storage 1.3 RHEL-OSP with 1.3 Future Red Hat Ceph Storage 2.0 OpenStack and Containers
  • 3. Open Software-Defined Storage is a fundamental reimagining of how storage infrastructure works. It provides substantial economic and operational advantages, and it has quickly become ideally suited for a growing number of use cases. TODAY EMERGING FUTURE Cloud Infrastructure Cloud Native Apps Analytics Hyper- Convergence Containers ??? ??? OPEN, SOFTWARE-DEFINED STORAGE
  • 4. A RISING TIDE “By 2020, between 70-80% of unstructured data will be held on lower-cost storage managed by SDS environments.” “By 2019, 70% of existing storage array products will also be available as software only versions” “By 2016, server-based storage solutions will lower storage hardware costs by 50% or more.” Gartner: “IT Leaders Can Benefit From Disruptive Innovation in the Storage Industry” Innovation Insight: Separating Hype From Hope for Software-Defined Storage Innovation Insight: Separating Hype From Hope for Software-Defined Storage Market size is projected to increase approximately 20% year-over-year between 2015 and 2019. 201 3 201 4 201 5 201 6 201 7 201 8 201 9 $1,349B $1,195B $1,029B $859B $706B $592B SDS-P MARKET SIZE BY SEGMENT $457B Block Storage File Storage Object Storage Hyperconverged Source: IDC Software-Defined Storage is leading a shift in the global storage industry, with far-reaching effects.
  • 5. THE RED HAT STORAGE PORTFOLIO Ceph management OPENSOURCE SOFTWARE Gluster management Ceph data services Gluster data services STANDARD HARDWARE Share-nothing, scale-out architecture provides durability and adapts to changing demands Self-managing and self-healing features reduce operational overhead Standards-based interfaces and full APIs ease integration with applications and systems Supported by the experts at Red Hat
  • 6. ● VM Storage with OpenStack Cinder, Glance & Nova ● Object storage for tenant apps Built from the ground up as a next-generation storage system, based on years of research and suitable for powering infrastructure platforms TARGET USE CASES Rich Media and Archival ● S3-compatible object storage Highly tunable, extensible, and configurable, with policy-based control and no single point of failure Offers mature interfaces for block and object storage for the enterprise Cloud Infrastructure Customer Highlight: Cisco Cisco uses Red Hat Ceph Storage to deliver storage for next-generation cloud services RED HAT CEPH STORAGE Powerful distributed storage for the cloud and beyond
  • 7. ANALYTICS Big Data analytics with Hadoop CLOUD INFRASTRUCTURE RICH MEDIA AND ARCHIVAL SYNC AND SHARE ENTERPRISE VIRTUALIZATION Machine data analytics with Splunk Virtual machine storage with OpenStack Object storage for tenant applications Cost-effective storage for rich media streaming Active archives File sync and share with ownCloud Storage for conventional virtualization with RHEV FOCUSED SET OF USE CASES
  • 9. TIMELINE Jul14 Mar15 Jun15May14 INKTANK CEPH ENTERPRISE v1.2 v1.3 Inktank acquisition & Ceph Firefly released Ceph Hammer released RED HAT CEPH STORAGE
  • 10. MGMT All required dependencies are now included within a local package repository, allowing deployment to non-Internet-connected storage nodes. MGMTCORECORECOREOBJECT Administrators can now perform basic cluster administration tasks through Calamari, the Ceph visual interface. Erasure-coded storage back-ends are now available, providing durability with lower capacity requirements than traditional, replicated back-ends. A cache tier pool can now be designated as a writeback or read cache for an underlying storage pool in order to provide cost-effective performance. Clients can be configured to read objects from the closest replica, increasing performance and reducing network strain. The Ceph Object Gateway now supports and enforces quotas for users and buckets. Off-line installer GUI management Erasure coding Cache tiering RADOS read- affinity User and bucket quotas These features were introduced in version 1.2 of Red Hat Ceph Storage, and have been supported by Red Hat since July, 2014. DETAIL: RED HAT CEPH STORAGE V1.2
  • 11. DELIVERING RED HAT CEPH STORAGE BEFORE DURING AFTER
  • 12. DELIVERING RED HAT CEPH STORAGE Bugzilla Fork Package Doc Test
  • 13. A GENUINE RED HAT PRODUCT
  • 16. RED HAT CEPH STORAGE 1.3 GA Today Based on Ceph Hammer (0.94) Core Themes Robustness at Scale Operational Efficiency Performance
  • 17. Red Hat Ceph Storage 1.3 contains improved logic and algorithms that allow it to do the “right thing” for users with multi-petabyte clusters where hardware failure is normal: ROBUSTNESS AT SCALE Improved self-management for large clusters ● Improved automatic rebalancing logic, which prioritizes degraded over misplaced objects ● Rebalancing operations can be temporarily disabled so they don’t impact performance ● Time-scheduled scrubbing, to avoid disruption during peak times ● Sharding of object buckets to avoid hot-spots
  • 18. Ceph is a distributed system with lots of moving parts. Red Hat Ceph Storage 1.3 introduces features to help manage storage more efficiently. OPERATIONAL EFFICIENCY Making administration tasks easier ● Calamari now supports multiple users and clusters ● CRUSH management via Calamari API allows programmatic adjustment of placement policies ● Lightweight, embedded Civetweb server eases deployment of the Ceph Object Gateway ● Faster Ceph Block Device operations make resize, delete, and flatten operations quicker, while export parallelism makes backups faster
  • 19. CEPH WITH SANDISK INFINIFLASH
  • 20. A number of performance tweaks improve the speed of Red Hat Ceph Storage 1.3 and increase I/O consistency: PERFORMANCE Speedier, more efficient distributed storage ● Optimizations for flash storage devices increases Ceph’s topline speed ● Read ahead caching accelerates virtual machine booting in OpenStack ● Allocation hinting reduces XFS fragmentation to avoid performance degradation over time ● Caching hinting preserves the cache’s advantages and improves performance PERFORMANCE SCALE
  • 21. OTHER FEATURES S3 Object Expiration Swift Storage Policies IPv6 Support Local/Pyramid Codes
  • 22. RED HAT CEPH STORAGE 1.3.z SELinux Support Satellite Integration Puppet-based Installer (Tech Preview)
  • 23. RHEL OPENSTACK PLATFORM w/CEPH Feb15 Jul16Jun14 Icehouse RHEL-OSP5 RHEL-OSP6 RHEL-OSP7 Juno Kilo Juno ICE 1.2 RHCS 1.2.3 & 1.3.0 RHCS 1.3.0
  • 24. RHEL OPENSTACK PLATFORM w/CEPH RHEL-OSP5 RHEL-OSP6 RHEL-OSP7 Integrated SKU | Integrated Installer (Client) Ephemeral Volumes Integrated Installer (Client and Server) | Image Conversion
  • 26. DETAIL: RED HAT CEPH STORAGE “TUFNELL” CORECORECORE More intelligent scrubbing policies and improved peering logic to reduce impact of common operations on overall cluster performance. More information about objects will be provided to help administrators perform repair operations on corrupted data. New backend for OSDs to provide performance benefits on existing and modern drives (SSD, K/V). Performance Consistency Guided Repair New Backing Store (Tech Preview) These projects are currently active in the Ceph development community. They may be available and supported by Red Hat once they reach the necessary level of maturity. MGMT A new user interface with improved sorting and visibility of critical data. MGMT Introduction of altering features that notify administrations of critical issues via email or SMS. New UI Alerting
  • 27. BLOCK Introduction of a highly-available iSCSI interface for the Ceph Block Device, allowing integration with legacy systems BLOCKOBJECTOBJECT Capabilities for managing virtual block devices in multiple regions, maintaining consistency through automated mirroring of incremental changes Access to objects stored in the Ceph Object Gateway via standard Network File System (NFS) endpoints, providing storage for legacy systems and applications Support for deployment of the Ceph Object Gateway across multiple sites in an active/active configuration (in addition to the currently-available active/passive configuration) iSCSI Mirroring NFS Active/Active Multi-Site These projects are currently active in the Ceph development community. They may be available and supported by Red Hat once they reach the necessary level of maturity. DETAIL: RED HAT CEPH STORAGE “TUFNELL”
  • 28. RHEL OPENSTACK PLATFORM w/CEPH RHEL-OSP 8 Containers QoS | Live Migration | Disaster Recovery RBD Driver for Kubernetes | S3 Backend for OpenShift