Looking for a high performance, scale-out NAS file system? Or are you a new user of GlusterFS and want to learn more? This webinar includes an introduction and review of the GlusterFS architecture and key features. Learn how GlusterFS is deployed in the datacenter, in the cloud, or between the two. We’ll also cover a brief update on GlusterFS v3.3 which is currently in beta.
On the agenda:
*Brief intro to Gluster’s History
*Gluster Architecture Design Goals
*Key Technical Differentiators
*Gluster Elastic Hashing Algorithm
*Deployment scenarios
*Use Cases
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
Gluster Webinar: Introduction to GlusterFS v3.3
1. Introduction To GlusterFS
Audio is available via VoIP or Landline.
For VoIP
You will be connected to audio using your
computer‟s speakers or headset.
For Landline:
Please select Use Telephone after joining the
Webinar.
US/Canada attendees dial (773) 945-1011
Access Code 584-930-717
2. Today’s Speakers
Heather Wellington Tom Trainer
Marketing Manager Director
Gluster, Inc. Product Marketing
Gluster, Inc.
A Better Way To Do Storage 2
3. History of Gluster
How it all started
– Backgrounds in high performance, clustered computing
– Working at Lawrence Livermore National Labs
• AB Periasamy & Hitesh Chellani design “Thunder”
• One of the worlds fastest super computers
• On Intel commodity hardware
• Solved filesystem scalability and performance limitations
– Large customer in oil & gas persuaded them to focus on storage
– Gluster founded by Hitesh & AB to bring technology to market
Thunder
Result: award winning technology
A Better Way To Do Storage 3
4. What is the Gluster File System?
A scale-out file system for object and network
attached storage (NAS)
GlusterFS provides
– Flexibility to deploy in ANY environment
– High availability
– Unified files and objects
– Scalability to Petabytes & beyond
– Linearly scalable performance
– Superior storage economics
A Better Way To Do Storage 4
5. GlusterFS Architecture Design Goals
Innovation
– Eliminate metadata – improve file access time
– Unify files and objects
Elasticity
– Flexibility adapt to growth/reduction
– Add, delete volumes & users
– Without disruption
Scale linearly
– Multiple dimensions
• Performance
• Capacity
– Aggregated resources
Performance
Eliminate metadata
– Improve file access speed
Simplicity
Capacity
– Ease of management
– No complex Kernel patches
– Run in user space
A Better Way To Do Storage 5
6. Key Differentiators
Filesystem runs in user space
Software only
Open source
Modular, stackable storage OS architecture
Data stored in native formats
No metadata – Elastic hashing
Unified files and objects
Virtual Machine (VM) virtual motion enabler
A Better Way To Do Storage 6
7. Filesystem Runs in User Space
User Space Not tied to kernel
GlusterFS
No reassemblies
Server
(CPU/Mem) Independence
Kernel
1 TB 1 TB
1 TB 1 TB
1 TB 1 TB
1 TB 1 TB
1 TB 1 TB
1 TB 1 TB
1 TB 1 TB
A Better Way To Do Storage 7
8. Software Only
Hardware agnostic
Superior storage economics & flexibility
– Data center / private cloud use commodity hardware
– Public cloud – i.e. AWS, RackSpace, GoGrid – pay for only what you need
No lock-in
– Hardware vendors-at purchase time or in the future
– Public or private cloud
– Performance, capacity, or availability levels
– GlusterFS – not proprietary, files are stored in native formats (i.e. EXT4)
A Better Way To Do Storage 8
9. Open Source
200,000+ downloads
Global Adoption – ~15,000 /month
500+ registered deployments
– 45 countries
2,500+ registered users
– Mailing lists, Forums, etc.
Active community
– Diverse testing environments
– Bugs identification and fixes
– Code contributions
Member of broader ecosystem
– OpenStack, Linux Foundation, Open
Virtualization Alliance
A Better Way To Do Storage 9
10. Elastic Hashing
No metadata server
An algorithmic approach
– Unique hash tag for each file stored
– Tags stored within the file system
– Rapid file read – low latency
Traditional Central Metadata Server
Innovative Elastic Approach
A Better Way To Do Storage Traditional Distributed Metadata Server 10
11. A Standard Gluster NAS Deployment
Clients/Apps Clients/Apps Clients/Apps Standard clients
running standard apps
IP Network Over any standard IP
network
Access application
data, as files & folders,
Gluster Global Namespace (NFS, CIFS, Gluster Native)
in a global namespace,
Application data VMs VMDK VMDK using a variety of
standard protocols
Stored in a
commoditized,
virtual storage pool virtualized, scale-out,
centrally managed pool
DAS, SAN, NAS
A Better Way To Do Storage 11
12. Unifying Public and Private Cloud Storage
Client/Apps Client/Apps Client/Apps
Client/Apps
Client/Apps Client/Apps
Client/Apps Client/Apps
Client/Apps
IP Network
Gluster Global Namespace
Private Cloud Public Cloud
Replication
A Better Way To Do Storage 12
13. Deployment Scenarios
Common Solutions Built on GlusterFS
Media serving (CDN)
Large scale file storage
Unified file and object storage
Tier 2 & 3 archive
File sharing
Multi-tenant file systems
Storage for High Performance
Computing (HPC)
IaaS storage layer
Disaster recovery
Backup & restore
Private cloud
A Better Way To Do Storage 13
14. Introducing GlusterFS 3.3 (BETA) July 20, 2011
GlusterFS 3.3: Next generation file and object
storage
– The first system for data storage that enables you to store and access data as
an object and as a file
– Flexible and powerful, it simplifies access and management of data
– Eases migration of legacy, file-based applications to object storage for use in
the cloud
Public beta availability: July 20, 2011
– Broad community testing and participation
– Selected enterprise customer engagements
A Better Way To Do Storage 14
15. The “Traditional” Unified Approach
Files Objects DB’s
“VNX reminds me of my old VHS, DVD and cable box….
….one thing fails and I’m blown out of the water.” NAS Object Block
Beta Customer , 2011
Carved Up
Proprietary Storage Pool
Bolt-on hardware approach
– Combined hardware raises costs
– Higher TCO Traditional Monolithic Hardware
– Paying for what you many not need Bolt-on Approach
(i.e. EMC VNX)
Increased risk
– Common hardware elements can fail
• Power supplies
• Fans
• Cabling…lots of cabling
A Better Way To Do Storage 15
16. Software Approach to File and Object
High performance storage across heterogeneous server environments
Window Access
– Improves Windows performance
– Uses HTTP, not slower CIFS
– We will still support SAMBA
Object Storage
– API
– Internet Protocol (IP)
– ResTFul
– Get/Put
– Buckets
– Objects seen as files
Standards based
– Amazon S3 ReSTFul interface
compatible
– Access data as objects and a NAS
Network Attached Storage (NAS)
interface to access files (NFS, CIFS, – NFS / CIFS / GlusterFS
GlusterFS) – POSIX compliant
– Access files within objects
A Better Way To Do Storage 16
17. GlusterFS 3.3 Unified File & Object Storage
Widely deployable and extremely flexible
– On-premise, virtualized and in public and private clouds
– Deep unification of file and object data storage
• Not just unified at the management layer
• Not a bolt-together hardware product
– Access data within objects as files
– Compatible with Amazon Web Services
• S3
• Create S3 on EC2 and EBS
– Back up objects from the data center to AWS
– Enable S3 functionality in the data center
– Built to run on commodity hardware
A Better Way To Do Storage 17
18. GlusterFS 3.3 Easing & Accelerating Legacy App Migration
Unified file & object storage accelerates legacy app migration to the cloud
Gluster FS 3.3
Object Storage
Data Center, Virtual
Public, Private Cloud
Object
Info
Enterprise Apps / Enterprise Data Center
Enables cloudification of applications
– Removes remaining storage hurdles related to file only
access
– Allows for gradual app migration to the cloud
– Enables moves to both private and public cloud
infrastructures
A Better Way To Do Storage 18
19. Gluster 3.3 Unified File & Object – Use Cases
S3
Data Center: S3 in house &/ integrate with S3
Data Center IaaS: Deliver S3 to clients
– Take control of cloud services
– Reduce AWS S3 costs
– Deliver S3 like global services in-house
– Legacy application migration
IaaS
– Deliver File and S3 Services
– Unified file and object
• Competitive differentiator
– Drastically reduce storage costs Traditional Data Center
Private Cloud
– Increase offerings, revenues and margins
IaaS
A Better Way To Do Storage 19
20. The Gluster Connector for OpenStack – July 27, 2011
Enables GlusterFS to be the underlying file system
Connects GlusterFS to Xen and KVM hypervisor
– Unified File and Object storage OpenStack with Gluster
– Highly-available, scale-out NAS
– Alternative to SWIFT
Mobile Apps. Web Clients. Enterprise Software Ecosystem
API Layer
OpenStack Prior to Gluster
…
Compute
Unified File &
Object Storage
SWIFT
OpenStack Imaging Services
A Better Way To Do Storage 20
21. The Gluster Connector for OpenStack – July 27, 2011
Connector enables GlusterFS to be chosen as the filesystem
– Provides:
• Unified File and Object storage
• Highly scalable NAS
• High Availability – synchronous and asynchronous replication
• Preferred, scalable alternative to SWIFT
• Virtual motion of virtual machines (a.k.a. vmotion)
VM VM VM VM VM VM VM VM
Hypervisor Hypervisor
GlusterFS GlusterFS
Server Server
(CPU/Mem) (CPU/Mem)
Virtual storage pool
A Better Way To Do Storage 21
22. Pandora Internet Radio
Problem
• Explosive user & title growth
• As many as 12 file formats for each song
• „Hot‟ content and long tail
Solution
• Three data centers, each with a six-node
GlusterFS cluster
• 1.2 PB of audio served • Replication for high availability
per week • 250+ TB total capacity
• 13 million files Benefits
• Over 50 GB/sec peak • Easily scale capacity
traffic • Centralized management; one administrator
to manage day-to-day operations
• No changes to application
• Higher reliability
A Better Way To Do Storage 22
23. Brightcove
Problem
• Cloud-based online video platform
• Explosive customer & title growth
• Massive video in multiple locations
• Costs rising, esp. with HD formats
Solution
• Complete scale-out based on commodity
DAS/JBOD
• Replication for high availability
• Over 1 PB currently in
• 1PB total capacity
Gluster
• Separate 4 PB project Benefits
in the works • Easily scale capacity
• Centralized management; one administrator
to manage day-to-day operations
• Higher reliability
• Path to multi-site
A Better Way To Do Storage 23
24. Cincinnati Bell Technology Solutions
Problem
• Host a dedicated enterprise cloud solution
• Large scale VMware environment
• Need high availability
Solution
• Large scale VM
• Gluster for VM storage, NFS to clients
storage
• SAS drives on back-end
• Low cost service • Replication for high availability
delivery for enterprise
customer Benefits
• Drastic reduction in • Storage provisioning from 6 wks to 15 min.
provisioning time • Vendor agnostic storage
• Low cost of service delivery
• Elastic growth
A Better Way To Do Storage 24
25. Partners Healthcare
Private Cloud: Centralized Storage as a Service
Problem
• Capacity growth from 144TB to 1+PB
• Multiple distributed users/departments
• Multi OS access - Windows, Linux and Unix
Solution
• Over 500 TB • GlusterFS Cluster
• 9 Sun “Thumper” • Solaris/ZFS/x4500 w/ InfiniBand
systems in cluster • Native CIFS/ NFS access
Benefits
• Capacity on demand / pay as you grow
• Centralized management
• Higher reliability
• OPEX decreased by 10X
A Better Way To Do Storage 25
26. 4 Supported Ways to Consume GlusterFS
Virtual Machines
– GlusterFS deployable on the leading virtual machines
Amazon Web Services (AWS)
– GlusterFS deployed within Amazon Machine Image (AMI)
RightScale Cloud Management
– GlusterFS is available within a RightScale ServerTemplate
– Deployable via the RightScale Cloud Management Dashboard
Storage software appliance
– Deployable on bare metal and supports any hardware on the Red Hat Hardware
Compatibility List (HCL) of certified servers and storage
A Better Way To Do Storage 26
28. Summary
GlusterFS – A scale-out file system
– NAS
– Object
Flexibility, scalability, superior economics
OpenStack cloud
– Unified file and object storage
– Virtual machine (VM) virtual motion
Innovative architecture provides a better way to do
storage
A Better Way To Do Storage 28
29. Questions and Answers
Your turn - ask our experts
Try Gluster for free here: http://www.gluster.com/trybuy/
Additional resources here: http://www.gluster.com/products/resources/
Join the community: http://www.gluster.org/
Follow on twitter: @gluster.
Read our blog: http://blog.gluster.com/
Contact us at: info@gluster.com or 1-800-805-5215
A Better Way To Do Storage 29