SlideShare uma empresa Scribd logo
1 de 34
Baixar para ler offline
Cloud storage reloaded:
Some aspects on operating distributed Linux file systems
              like Ceph and GlusterFS

                     Udo Seidel
Agenda
●   Introduction/motivation
●   Distributed storage
●   Ceph and GlusterFS
●   Operational considerations
●   Summary




                    LinuxCon Europe 05-07/11 2012   2
Introduction




LinuxCon Europe 05-07/11 2012   3
Me ;-)
●   Teacher of mathematics & physics
●   PhD in experimental physics
●   Started with Linux in 1996
●   Linux/UNIX trainer
●   Solution engineer in HPC and CAx environment
●   Head of a international team with people in
    Erding, Miami and Sydney @Amadeus


                    LinuxCon Europe 05-07/11 2012   4
Shared File Systems
●   Normal 'business' for Linux
●   Several implementation approaches
    ●   Network based, e.g. NFS, CIFS
    ●   'clustered'
         –   Shared disk, e.g. OCFS2, GFS2
         –   Parallel/distributed, e.g. Ceph, GlusterFS




                            LinuxCon Europe 05-07/11 2012   5
Distributed File Systems
●   'Recent' attention on distributed storage
    ●   Cloud hype
    ●   Big Data
●   Which solution to choose?
    ●   Just storage or file system too?
●   Knock-on effects
    ●   Technical
    ●   Non-technical

                        LinuxCon Europe 05-07/11 2012   6
Operations
●   Important part of the life cycle
●   Geek vs. Enterprise
●   Technical challenges and more




                     LinuxCon Europe 05-07/11 2012   7
Distributed Storage




    LinuxCon Europe 05-07/11 2012   8
History
●   Reviewing storage task responsibilities
    ●   Block allocation
    ●   Space management
●   Extension of SCSI standard
    ●   Object based storage
    ●   Meta-Data handling separated from data
        management



                       LinuxCon Europe 05-07/11 2012   9
Object based storage
●   Storage objects quite general
    ●   Partition, file, ...
    ●   Unique identifier
●   OSD (Object based Storage Device)
    ●   Hardware -> original trigger
    ●   Software -> common implementation
●   Interfaces to existing technology
    ●   Part of the distributed storage solution
    ●   Additional development of existing approaches
                           LinuxCon Europe 05-07/11 2012   10
Distributed storage:
               Paradigm changes
●   Block -> Object
●   Central -> Distributed
    ●   Few -> Many
    ●   Big -> Small




                       LinuxCon Europe 05-07/11 2012   11
Distributed storage – Now what?!?
●   Several implementations
●   Different functions
●   Support models
●   Storage vendors initiatives
●   Relation to Linux distributions




                     LinuxCon Europe 05-07/11 2012   12
Ceph and GlusterFS




    LinuxCon Europe 05-07/11 2012   13
Ceph and GlusterFS
●   Sufficient community presence
●   Picked up by Enterprise Linux vendors
●   Good amount of commonalities but still quite
    different




                   LinuxCon Europe 05-07/11 2012   14
Ceph and GlusterFS – High level
●   Server part
    ●   Block storage -> storage server (OSD)
    ●   (POSIX) file system -> Meta data
    ●   HA -> replication and distribution
●   Client part
    ●   (POSIX) file system
    ●   Storage layer



                        LinuxCon Europe 05-07/11 2012   15
Ceph




LinuxCon Europe 05-07/11 2012   16
GlusterFS




LinuxCon Europe 05-07/11 2012   17
Ceph and GlusterFS – some details
                          CEPH                            GLUSTERFS
  Server implementation   userspace                       userspace
  Client implementation   userspace/FUSE and              userspace/FUSE
                          native kernel
  File system access      CEPH protocol suite             GlusterFS and NFS
                                                          protocol
  Block device access     yes                             RFP ongoing
  QEMU integration        yes                             Under development
  Replication traffic     OSD network                     Client-server network
  Interconnect            IP based                        IP based and/or
                                                          Infiniband
  Encryption              no                              not really
  Back-end file system    XFS ..... BTRFS ... ext4        XFS ........ext4
  Storage object          CRUSH object                    file (except for striping)
  GEO replication         not really                      yes

                          LinuxCon Europe 05-07/11 2012                                18
Ceph and GlusterFS – more details
                         CEPH                            GLUSTERFS
 Online growth/shrink    yes                             yes
 POSIX                   yes                             alike
 Concurrent workload     technically yes                 technically yes
 NAS replacement         technically yes                 technically yes
 SAN replacment          technically yes                 no
 Hadoop integration      yes                             yes
 Openstack integration   yes                             yes
 Community version       yes                             yes
 available
 Production readiness    Block layer                     File system layer
 Service provider        Vendor and other                Vendor and other
 ...                     ...                             ...


                         LinuxCon Europe 05-07/11 2012                       19
Operational considerations




        LinuxCon Europe 05-07/11 2012   20
Status quo “pre distributed storage”
●   Server and Storage
    ●   Clear responsibilities
    ●   Known area: SCSI, NFS, FC
    ●   Strict border lines
        –   Technically
        –   organizationally
●   Storage hardware and topology
    ●   Less focus on local drives
    ●   Dedicated/separated storage network
                           LinuxCon Europe 05-07/11 2012   21
Changes with distributed storage
●   New paradigm
●   Big overlap between server and storage
    ●   Technical implication
    ●   Organizational structure
●   Strong network dependency
    ●   Topology
    ●   physics
●   Support and supported setups

                       LinuxCon Europe 05-07/11 2012   22
Challenge one: server vs. storage
●   Need for
    ●   Server admin with strong storage skills
    ●   Storage admin with strong O/S skills
●   Review of
    ●   Current organizational setup
    ●   Strategy for traditional storage
    ●   Operation procedures
    ●   HA architecture

                        LinuxCon Europe 05-07/11 2012   23
Challenge one: possible answers
●   'DevOps model' for O/S and storage admins
    ●   Best of both worlds
    ●   Better common understanding
    ●   Potential of process simplification
    ●   BUT organizational changes needed!




                        LinuxCon Europe 05-07/11 2012   24
Challenge one: possible answers
●   'Appliance model' for O/S and storage admins
    ●   Less internal changes
    ●   Potential of reusing existing processes
    ●   BUT less control and visibility




                        LinuxCon Europe 05-07/11 2012   25
Challenge two: infrastructure
●   Dedicated vs. Shared
●   Responsibilities
    ●   server vs. storage vs. network
●   Transport medium
●   Local setup
    ●   Spinning disks vs. SSD
    ●   RAID?
    ●   HA configuration of single server

                       LinuxCon Europe 05-07/11 2012   26
Challenge two: possible answers
●   Different flavour of performance vs. cost topic
    ●   Dedicated vs. Shared
    ●   Transport medium
    ●   Spinning disks vs. SSD
    ●   HA on server level




                       LinuxCon Europe 05-07/11 2012   27
Challenge two: possible answers
●   Team up with network organization
●   Single server full blown SPOF on purpose
●   Think big




                   LinuxCon Europe 05-07/11 2012   28
Challenge three: support
●   Service provider
●   Application support




                   LinuxCon Europe 05-07/11 2012   29
Challenge three: possible answers
●   Combine with Linux vendor support
    ●   Single point of contact
    ●   Leverage vendor QA
●   Hide the new technology
    ●   XaaS
    ●   Appliance approach
    ●   File system level
●   Reminder: Think big

                        LinuxCon Europe 05-07/11 2012   30
Summary ... kind of ...




      LinuxCon Europe 05-07/11 2012   31
The message
●   New world with several challenges
    ●   Don't underestimate them
    ●   Don't overestimate them
●   Technical revolution
    ●   requires non-technical changes
    ●   Don't underestimate the potential
●   Think big! ;-)
●   Get started!

                       LinuxCon Europe 05-07/11 2012   32
References
●   http://www.ceph.com
●   http://www.gluster.org
●   “your business/company”




                    LinuxCon Europe 05-07/11 2012   33
Thank you!




LinuxCon Europe 05-07/11 2012   34

Mais conteúdo relacionado

Mais procurados

CephFS update February 2016
CephFS update February 2016CephFS update February 2016
CephFS update February 2016John Spray
 
The State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackThe State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackSage Weil
 
Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...
Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...
Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...Gluster.org
 
Red Hat Gluster Storage : GlusterFS
Red Hat Gluster Storage : GlusterFSRed Hat Gluster Storage : GlusterFS
Red Hat Gluster Storage : GlusterFSbipin kunal
 
BlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephBlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephSage Weil
 
Gluster fs architecture_&_roadmap_atin_punemeetup_2015
Gluster fs architecture_&_roadmap_atin_punemeetup_2015Gluster fs architecture_&_roadmap_atin_punemeetup_2015
Gluster fs architecture_&_roadmap_atin_punemeetup_2015Atin Mukherjee
 
Community Update at OpenStack Summit Boston
Community Update at OpenStack Summit BostonCommunity Update at OpenStack Summit Boston
Community Update at OpenStack Summit BostonSage Weil
 
Introduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackIntroduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackOpenStack_Online
 
SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014Kyle Bader
 
Gluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephantGluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephantGluster.org
 
Ceph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud StorageCeph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud StorageSage Weil
 
20160130 Gluster-roadmap
20160130 Gluster-roadmap20160130 Gluster-roadmap
20160130 Gluster-roadmapGluster.org
 
Red Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS PlansRed Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS PlansRed_Hat_Storage
 
OSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo Seidel
OSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo SeidelOSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo Seidel
OSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo SeidelNETWAYS
 
OpenVZ, Virtuozzo and Docker
OpenVZ, Virtuozzo and DockerOpenVZ, Virtuozzo and Docker
OpenVZ, Virtuozzo and DockerKirill Kolyshkin
 
Software defined storage
Software defined storageSoftware defined storage
Software defined storageGluster.org
 
What's new in Jewel and Beyond
What's new in Jewel and BeyondWhat's new in Jewel and Beyond
What's new in Jewel and BeyondSage Weil
 

Mais procurados (20)

CephFS update February 2016
CephFS update February 2016CephFS update February 2016
CephFS update February 2016
 
Block Storage For VMs With Ceph
Block Storage For VMs With CephBlock Storage For VMs With Ceph
Block Storage For VMs With Ceph
 
The State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStackThe State of Ceph, Manila, and Containers in OpenStack
The State of Ceph, Manila, and Containers in OpenStack
 
Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...
Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...
Introduction to highly_availablenfs_server_on_scale-out_storage_systems_based...
 
Red Hat Gluster Storage : GlusterFS
Red Hat Gluster Storage : GlusterFSRed Hat Gluster Storage : GlusterFS
Red Hat Gluster Storage : GlusterFS
 
BlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for CephBlueStore: a new, faster storage backend for Ceph
BlueStore: a new, faster storage backend for Ceph
 
Gluster fs architecture_&_roadmap_atin_punemeetup_2015
Gluster fs architecture_&_roadmap_atin_punemeetup_2015Gluster fs architecture_&_roadmap_atin_punemeetup_2015
Gluster fs architecture_&_roadmap_atin_punemeetup_2015
 
Community Update at OpenStack Summit Boston
Community Update at OpenStack Summit BostonCommunity Update at OpenStack Summit Boston
Community Update at OpenStack Summit Boston
 
Introduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStackIntroduction into Ceph storage for OpenStack
Introduction into Ceph storage for OpenStack
 
SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014SF Ceph Users Jan. 2014
SF Ceph Users Jan. 2014
 
Gluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephantGluster fs hadoop_fifth-elephant
Gluster fs hadoop_fifth-elephant
 
Foss Gadgematics
Foss GadgematicsFoss Gadgematics
Foss Gadgematics
 
Ceph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud StorageCeph, Now and Later: Our Plan for Open Unified Cloud Storage
Ceph, Now and Later: Our Plan for Open Unified Cloud Storage
 
librados
libradoslibrados
librados
 
20160130 Gluster-roadmap
20160130 Gluster-roadmap20160130 Gluster-roadmap
20160130 Gluster-roadmap
 
Red Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS PlansRed Hat Gluster Storage, Container Storage and CephFS Plans
Red Hat Gluster Storage, Container Storage and CephFS Plans
 
OSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo Seidel
OSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo SeidelOSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo Seidel
OSDC 2013 | Distributed Storage with GlusterFS by Dr. Udo Seidel
 
OpenVZ, Virtuozzo and Docker
OpenVZ, Virtuozzo and DockerOpenVZ, Virtuozzo and Docker
OpenVZ, Virtuozzo and Docker
 
Software defined storage
Software defined storageSoftware defined storage
Software defined storage
 
What's new in Jewel and Beyond
What's new in Jewel and BeyondWhat's new in Jewel and Beyond
What's new in Jewel and Beyond
 

Semelhante a Cephfsglusterfs.talk

London Ceph Day Keynote: Building Tomorrow's Ceph
London Ceph Day Keynote: Building Tomorrow's Ceph London Ceph Day Keynote: Building Tomorrow's Ceph
London Ceph Day Keynote: Building Tomorrow's Ceph Ceph Community
 
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph Ceph Community
 
Ceph Day NYC: Building Tomorrow's Ceph
Ceph Day NYC: Building Tomorrow's CephCeph Day NYC: Building Tomorrow's Ceph
Ceph Day NYC: Building Tomorrow's CephCeph Community
 
Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1sprdd
 
Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1sprdd
 
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo SeidelOSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo SeidelNETWAYS
 
Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Community
 
Ceph Day New York: Ceph: one decade in
Ceph Day New York: Ceph: one decade inCeph Day New York: Ceph: one decade in
Ceph Day New York: Ceph: one decade inCeph Community
 
State of the_gluster_-_lceu
State of the_gluster_-_lceuState of the_gluster_-_lceu
State of the_gluster_-_lceuGluster.org
 
Ceph: A decade in the making and still going strong
Ceph: A decade in the making and still going strongCeph: A decade in the making and still going strong
Ceph: A decade in the making and still going strongPatrick McGarry
 
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...NETWAYS
 
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebula Project
 
pnfs status
pnfs statuspnfs status
pnfs statusbergwolf
 
Gluster intro-tdose
Gluster intro-tdoseGluster intro-tdose
Gluster intro-tdoseGluster.org
 
Gluster intro-tdose
Gluster intro-tdoseGluster intro-tdose
Gluster intro-tdoseGluster.org
 
Ceph Day SF 2015 - Keynote
Ceph Day SF 2015 - Keynote Ceph Day SF 2015 - Keynote
Ceph Day SF 2015 - Keynote Ceph Community
 
2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific DashboardCeph Community
 
Red Hat Storage Server Roadmap & Integration With Open Stack
Red Hat Storage Server Roadmap & Integration With Open StackRed Hat Storage Server Roadmap & Integration With Open Stack
Red Hat Storage Server Roadmap & Integration With Open StackRed_Hat_Storage
 
Keeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containersKeeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containersSage Weil
 
Performance characterization in large distributed file system with gluster fs
Performance characterization in large distributed file system with gluster fsPerformance characterization in large distributed file system with gluster fs
Performance characterization in large distributed file system with gluster fsNeependra Khare
 

Semelhante a Cephfsglusterfs.talk (20)

London Ceph Day Keynote: Building Tomorrow's Ceph
London Ceph Day Keynote: Building Tomorrow's Ceph London Ceph Day Keynote: Building Tomorrow's Ceph
London Ceph Day Keynote: Building Tomorrow's Ceph
 
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
Ceph Day Santa Clara: Keynote: Building Tomorrow's Ceph
 
Ceph Day NYC: Building Tomorrow's Ceph
Ceph Day NYC: Building Tomorrow's CephCeph Day NYC: Building Tomorrow's Ceph
Ceph Day NYC: Building Tomorrow's Ceph
 
Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1
 
Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1Wheeler w 0450_linux_file_systems1
Wheeler w 0450_linux_file_systems1
 
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo SeidelOSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
OSDC 2012 | Extremes Wolken Dateisystem!? by Dr. Udo Seidel
 
Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development Ceph Day London 2014 - The current state of CephFS development
Ceph Day London 2014 - The current state of CephFS development
 
Ceph Day New York: Ceph: one decade in
Ceph Day New York: Ceph: one decade inCeph Day New York: Ceph: one decade in
Ceph Day New York: Ceph: one decade in
 
State of the_gluster_-_lceu
State of the_gluster_-_lceuState of the_gluster_-_lceu
State of the_gluster_-_lceu
 
Ceph: A decade in the making and still going strong
Ceph: A decade in the making and still going strongCeph: A decade in the making and still going strong
Ceph: A decade in the making and still going strong
 
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
OpenNebula Conf 2014 | Using Ceph to provide scalable storage for OpenNebula ...
 
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
OpenNebulaConf 2014 - Using Ceph to provide scalable storage for OpenNebula -...
 
pnfs status
pnfs statuspnfs status
pnfs status
 
Gluster intro-tdose
Gluster intro-tdoseGluster intro-tdose
Gluster intro-tdose
 
Gluster intro-tdose
Gluster intro-tdoseGluster intro-tdose
Gluster intro-tdose
 
Ceph Day SF 2015 - Keynote
Ceph Day SF 2015 - Keynote Ceph Day SF 2015 - Keynote
Ceph Day SF 2015 - Keynote
 
2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard2021.02 new in Ceph Pacific Dashboard
2021.02 new in Ceph Pacific Dashboard
 
Red Hat Storage Server Roadmap & Integration With Open Stack
Red Hat Storage Server Roadmap & Integration With Open StackRed Hat Storage Server Roadmap & Integration With Open Stack
Red Hat Storage Server Roadmap & Integration With Open Stack
 
Keeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containersKeeping OpenStack storage trendy with Ceph and containers
Keeping OpenStack storage trendy with Ceph and containers
 
Performance characterization in large distributed file system with gluster fs
Performance characterization in large distributed file system with gluster fsPerformance characterization in large distributed file system with gluster fs
Performance characterization in large distributed file system with gluster fs
 

Mais de Udo Seidel

ceph openstack dream team
ceph openstack dream teamceph openstack dream team
ceph openstack dream teamUdo Seidel
 
Gluster.community.day.2013
Gluster.community.day.2013Gluster.community.day.2013
Gluster.community.day.2013Udo Seidel
 
Lt2013 uefisb.talk
Lt2013 uefisb.talkLt2013 uefisb.talk
Lt2013 uefisb.talkUdo Seidel
 
Lt2013 glusterfs.talk
Lt2013 glusterfs.talkLt2013 glusterfs.talk
Lt2013 glusterfs.talkUdo Seidel
 
Linuxconeurope2011.ext4btrfs.talk
Linuxconeurope2011.ext4btrfs.talkLinuxconeurope2011.ext4btrfs.talk
Linuxconeurope2011.ext4btrfs.talkUdo Seidel
 
Osdc2011.ext4btrfs.talk
Osdc2011.ext4btrfs.talkOsdc2011.ext4btrfs.talk
Osdc2011.ext4btrfs.talkUdo Seidel
 
Linuxkongress2010.gfs2ocfs2.talk
Linuxkongress2010.gfs2ocfs2.talkLinuxkongress2010.gfs2ocfs2.talk
Linuxkongress2010.gfs2ocfs2.talkUdo Seidel
 

Mais de Udo Seidel (7)

ceph openstack dream team
ceph openstack dream teamceph openstack dream team
ceph openstack dream team
 
Gluster.community.day.2013
Gluster.community.day.2013Gluster.community.day.2013
Gluster.community.day.2013
 
Lt2013 uefisb.talk
Lt2013 uefisb.talkLt2013 uefisb.talk
Lt2013 uefisb.talk
 
Lt2013 glusterfs.talk
Lt2013 glusterfs.talkLt2013 glusterfs.talk
Lt2013 glusterfs.talk
 
Linuxconeurope2011.ext4btrfs.talk
Linuxconeurope2011.ext4btrfs.talkLinuxconeurope2011.ext4btrfs.talk
Linuxconeurope2011.ext4btrfs.talk
 
Osdc2011.ext4btrfs.talk
Osdc2011.ext4btrfs.talkOsdc2011.ext4btrfs.talk
Osdc2011.ext4btrfs.talk
 
Linuxkongress2010.gfs2ocfs2.talk
Linuxkongress2010.gfs2ocfs2.talkLinuxkongress2010.gfs2ocfs2.talk
Linuxkongress2010.gfs2ocfs2.talk
 

Último

PDT 88 - 4 million seed - Seed - Protecto.pdf
PDT 88 - 4 million seed - Seed - Protecto.pdfPDT 88 - 4 million seed - Seed - Protecto.pdf
PDT 88 - 4 million seed - Seed - Protecto.pdfHajeJanKamps
 
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)tazeenaila12
 
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 Building Your Personal Brand on LinkedIn - Expert Planet-  2024 Building Your Personal Brand on LinkedIn - Expert Planet-  2024
Building Your Personal Brand on LinkedIn - Expert Planet- 2024Stephan Koning
 
Anyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agencyAnyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agencyHanna Klim
 
Chapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptx
Chapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptxChapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptx
Chapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptxesiyasmengesha
 
Fabric RFID Wristbands in Ireland for Events and Festivals
Fabric RFID Wristbands in Ireland for Events and FestivalsFabric RFID Wristbands in Ireland for Events and Festivals
Fabric RFID Wristbands in Ireland for Events and FestivalsWristbands Ireland
 
AMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdf
AMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdfAMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdf
AMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdfJohnCarloValencia4
 
Entrepreneurship & organisations: influences and organizations
Entrepreneurship & organisations: influences and organizationsEntrepreneurship & organisations: influences and organizations
Entrepreneurship & organisations: influences and organizationsP&CO
 
IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...
IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...
IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...AustraliaChapterIIBA
 
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...Khaled Al Awadi
 
Lecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb toLecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb toumarfarooquejamali32
 
ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...
ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...
ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...ISONIKELtd
 
Live-Streaming in the Music Industry Webinar
Live-Streaming in the Music Industry WebinarLive-Streaming in the Music Industry Webinar
Live-Streaming in the Music Industry WebinarNathanielSchmuck
 
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003believeminhh
 
7movierulz.uk
7movierulz.uk7movierulz.uk
7movierulz.ukaroemirsr
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHelene Heckrotte
 
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for BusinessQ2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for BusinessAPCO
 
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John MeulemansBCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John MeulemansBBPMedia1
 
Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)Lviv Startup Club
 

Último (20)

PDT 88 - 4 million seed - Seed - Protecto.pdf
PDT 88 - 4 million seed - Seed - Protecto.pdfPDT 88 - 4 million seed - Seed - Protecto.pdf
PDT 88 - 4 million seed - Seed - Protecto.pdf
 
Investment Opportunity for Thailand's Automotive & EV Industries
Investment Opportunity for Thailand's Automotive & EV IndustriesInvestment Opportunity for Thailand's Automotive & EV Industries
Investment Opportunity for Thailand's Automotive & EV Industries
 
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
Harvard Business Review.pptx | Navigating Labor Unrest (March-April 2024)
 
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 Building Your Personal Brand on LinkedIn - Expert Planet-  2024 Building Your Personal Brand on LinkedIn - Expert Planet-  2024
Building Your Personal Brand on LinkedIn - Expert Planet- 2024
 
Anyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agencyAnyhr.io | Presentation HR&Recruiting agency
Anyhr.io | Presentation HR&Recruiting agency
 
Chapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptx
Chapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptxChapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptx
Chapter_Five_The_Rural_Development_Policies_and_Strategy_of_Ethiopia.pptx
 
Fabric RFID Wristbands in Ireland for Events and Festivals
Fabric RFID Wristbands in Ireland for Events and FestivalsFabric RFID Wristbands in Ireland for Events and Festivals
Fabric RFID Wristbands in Ireland for Events and Festivals
 
AMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdf
AMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdfAMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdf
AMAZON SELLER VIRTUAL ASSISTANT PRODUCT RESEARCH .pdf
 
Entrepreneurship & organisations: influences and organizations
Entrepreneurship & organisations: influences and organizationsEntrepreneurship & organisations: influences and organizations
Entrepreneurship & organisations: influences and organizations
 
IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...
IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...
IIBA® Melbourne - Navigating Business Analysis - Excellence for Career Growth...
 
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...NewBase  25 March  2024  Energy News issue - 1710 by Khaled Al Awadi_compress...
NewBase 25 March 2024 Energy News issue - 1710 by Khaled Al Awadi_compress...
 
Lecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb toLecture_6.pptx English speaking easyb to
Lecture_6.pptx English speaking easyb to
 
ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...
ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...
ISONIKE Ltd Accreditation for the Conformity Assessment and Certification of ...
 
Live-Streaming in the Music Industry Webinar
Live-Streaming in the Music Industry WebinarLive-Streaming in the Music Industry Webinar
Live-Streaming in the Music Industry Webinar
 
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
The Vietnam Believer Newsletter_MARCH 25, 2024_EN_Vol. 003
 
7movierulz.uk
7movierulz.uk7movierulz.uk
7movierulz.uk
 
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptxHELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
HELENE HECKROTTE'S PROFESSIONAL PORTFOLIO.pptx
 
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for BusinessQ2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
Q2 2024 APCO Geopolitical Radar - The Global Operating Environment for Business
 
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John MeulemansBCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
BCE24 | Virtual Brand Ambassadors: Making Brands Personal - John Meulemans
 
Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)Michael Vidyakin: Introduction to PMO (UA)
Michael Vidyakin: Introduction to PMO (UA)
 

Cephfsglusterfs.talk

  • 1. Cloud storage reloaded: Some aspects on operating distributed Linux file systems like Ceph and GlusterFS Udo Seidel
  • 2. Agenda ● Introduction/motivation ● Distributed storage ● Ceph and GlusterFS ● Operational considerations ● Summary LinuxCon Europe 05-07/11 2012 2
  • 4. Me ;-) ● Teacher of mathematics & physics ● PhD in experimental physics ● Started with Linux in 1996 ● Linux/UNIX trainer ● Solution engineer in HPC and CAx environment ● Head of a international team with people in Erding, Miami and Sydney @Amadeus LinuxCon Europe 05-07/11 2012 4
  • 5. Shared File Systems ● Normal 'business' for Linux ● Several implementation approaches ● Network based, e.g. NFS, CIFS ● 'clustered' – Shared disk, e.g. OCFS2, GFS2 – Parallel/distributed, e.g. Ceph, GlusterFS LinuxCon Europe 05-07/11 2012 5
  • 6. Distributed File Systems ● 'Recent' attention on distributed storage ● Cloud hype ● Big Data ● Which solution to choose? ● Just storage or file system too? ● Knock-on effects ● Technical ● Non-technical LinuxCon Europe 05-07/11 2012 6
  • 7. Operations ● Important part of the life cycle ● Geek vs. Enterprise ● Technical challenges and more LinuxCon Europe 05-07/11 2012 7
  • 8. Distributed Storage LinuxCon Europe 05-07/11 2012 8
  • 9. History ● Reviewing storage task responsibilities ● Block allocation ● Space management ● Extension of SCSI standard ● Object based storage ● Meta-Data handling separated from data management LinuxCon Europe 05-07/11 2012 9
  • 10. Object based storage ● Storage objects quite general ● Partition, file, ... ● Unique identifier ● OSD (Object based Storage Device) ● Hardware -> original trigger ● Software -> common implementation ● Interfaces to existing technology ● Part of the distributed storage solution ● Additional development of existing approaches LinuxCon Europe 05-07/11 2012 10
  • 11. Distributed storage: Paradigm changes ● Block -> Object ● Central -> Distributed ● Few -> Many ● Big -> Small LinuxCon Europe 05-07/11 2012 11
  • 12. Distributed storage – Now what?!? ● Several implementations ● Different functions ● Support models ● Storage vendors initiatives ● Relation to Linux distributions LinuxCon Europe 05-07/11 2012 12
  • 13. Ceph and GlusterFS LinuxCon Europe 05-07/11 2012 13
  • 14. Ceph and GlusterFS ● Sufficient community presence ● Picked up by Enterprise Linux vendors ● Good amount of commonalities but still quite different LinuxCon Europe 05-07/11 2012 14
  • 15. Ceph and GlusterFS – High level ● Server part ● Block storage -> storage server (OSD) ● (POSIX) file system -> Meta data ● HA -> replication and distribution ● Client part ● (POSIX) file system ● Storage layer LinuxCon Europe 05-07/11 2012 15
  • 18. Ceph and GlusterFS – some details CEPH GLUSTERFS Server implementation userspace userspace Client implementation userspace/FUSE and userspace/FUSE native kernel File system access CEPH protocol suite GlusterFS and NFS protocol Block device access yes RFP ongoing QEMU integration yes Under development Replication traffic OSD network Client-server network Interconnect IP based IP based and/or Infiniband Encryption no not really Back-end file system XFS ..... BTRFS ... ext4 XFS ........ext4 Storage object CRUSH object file (except for striping) GEO replication not really yes LinuxCon Europe 05-07/11 2012 18
  • 19. Ceph and GlusterFS – more details CEPH GLUSTERFS Online growth/shrink yes yes POSIX yes alike Concurrent workload technically yes technically yes NAS replacement technically yes technically yes SAN replacment technically yes no Hadoop integration yes yes Openstack integration yes yes Community version yes yes available Production readiness Block layer File system layer Service provider Vendor and other Vendor and other ... ... ... LinuxCon Europe 05-07/11 2012 19
  • 20. Operational considerations LinuxCon Europe 05-07/11 2012 20
  • 21. Status quo “pre distributed storage” ● Server and Storage ● Clear responsibilities ● Known area: SCSI, NFS, FC ● Strict border lines – Technically – organizationally ● Storage hardware and topology ● Less focus on local drives ● Dedicated/separated storage network LinuxCon Europe 05-07/11 2012 21
  • 22. Changes with distributed storage ● New paradigm ● Big overlap between server and storage ● Technical implication ● Organizational structure ● Strong network dependency ● Topology ● physics ● Support and supported setups LinuxCon Europe 05-07/11 2012 22
  • 23. Challenge one: server vs. storage ● Need for ● Server admin with strong storage skills ● Storage admin with strong O/S skills ● Review of ● Current organizational setup ● Strategy for traditional storage ● Operation procedures ● HA architecture LinuxCon Europe 05-07/11 2012 23
  • 24. Challenge one: possible answers ● 'DevOps model' for O/S and storage admins ● Best of both worlds ● Better common understanding ● Potential of process simplification ● BUT organizational changes needed! LinuxCon Europe 05-07/11 2012 24
  • 25. Challenge one: possible answers ● 'Appliance model' for O/S and storage admins ● Less internal changes ● Potential of reusing existing processes ● BUT less control and visibility LinuxCon Europe 05-07/11 2012 25
  • 26. Challenge two: infrastructure ● Dedicated vs. Shared ● Responsibilities ● server vs. storage vs. network ● Transport medium ● Local setup ● Spinning disks vs. SSD ● RAID? ● HA configuration of single server LinuxCon Europe 05-07/11 2012 26
  • 27. Challenge two: possible answers ● Different flavour of performance vs. cost topic ● Dedicated vs. Shared ● Transport medium ● Spinning disks vs. SSD ● HA on server level LinuxCon Europe 05-07/11 2012 27
  • 28. Challenge two: possible answers ● Team up with network organization ● Single server full blown SPOF on purpose ● Think big LinuxCon Europe 05-07/11 2012 28
  • 29. Challenge three: support ● Service provider ● Application support LinuxCon Europe 05-07/11 2012 29
  • 30. Challenge three: possible answers ● Combine with Linux vendor support ● Single point of contact ● Leverage vendor QA ● Hide the new technology ● XaaS ● Appliance approach ● File system level ● Reminder: Think big LinuxCon Europe 05-07/11 2012 30
  • 31. Summary ... kind of ... LinuxCon Europe 05-07/11 2012 31
  • 32. The message ● New world with several challenges ● Don't underestimate them ● Don't overestimate them ● Technical revolution ● requires non-technical changes ● Don't underestimate the potential ● Think big! ;-) ● Get started! LinuxCon Europe 05-07/11 2012 32
  • 33. References ● http://www.ceph.com ● http://www.gluster.org ● “your business/company” LinuxCon Europe 05-07/11 2012 33
  • 34. Thank you! LinuxCon Europe 05-07/11 2012 34