SlideShare uma empresa Scribd logo
1 de 33
RADOS for Eucalyptus
        <tasada@livedoor.jp>
RADOS for Eucalyptus

• Eucalyptus
    IaaS



•
IaaS

• Infrastructure as a Service
• Web
                                …   Web



•           Amazon Web Services
Amazon EC2
•   Web          Linux Solaris Windows
          VM

•         EC2


    →
                S3

•   VM               S3
Amazon S3
•   Web



•   REST/SOAP API

•
•
                    1020   2010/03
Amazon EBS

•
        EC2
    →



•
Eucalyptus
•                    IaaS

•   Amazon EC2, S3, EBS     API
    →Amazon



•
    •
    •
Eucalyptus
                                Cloud
                               Controller
                                                         Walrus                S3

 Cluster           Storage                   Cluster               Storage
Controller        Controller                Controller            Controller


         Node
                                    EBS              Node
           Node
        Controller                                     Node
                                                    Controller
             Node
         Controller                                      Node
                                                     Controller
          Controller                                  Controller

                         VM
Eucalyptus
•
    •   Walrus(S3       )




    •   SC(EBS      )
Eucalyptus

•

•   Ceph Filesystem

    •
    •                 S3   EBS like
Ceph Filesystem
•

•   POSIX             ”mount   ”

•   Ceph Filesystem

    •
    •
    •
Ceph Filesystem
•
•

•
    •
    •   etc..
RADOS
•
•   Reliable, Autonomic Distributed Object Store


•
      ≠

•
•                                           etc...

•
RADOS
              OSD




                IO




Monitor OSD
                OSD   IO
~100PG/
      OSD

PG




OSD


               ”   ”
CRUSH
•        PG OSD

•
                  HDD
          OSD
    →



•
•   OSD
      up down IP

•
      PG

•             OSD          Monitor



•   Monitor         down
RADOS API
•   RADOS

    •   pool      API
        open_pool(), close_pool(), lookup_pool(), create_pool(),
        delete_pool(), list_pools(), get_pool_stats()
    •                        API
        create(), write(), read(), remove(), trunk(), getxattr(),
        setxattr(), stat(), list_objects_open(),
        list_objects_more(), list_objects_close()
    •                        API            IO API etc...
RADOS API


• radosgw:
    S3

• rbd:
•            S3   EBS
RADOS for Eucalyptus

• Walrus/SC                   RADOS

• Walrus
•             (radosgw, rbd...)
Before
                                Cloud
                                                         Walrus
                               Controller


 Cluster           Storage                   Cluster               Storage
Controller        Controller                Controller            Controller


         Node                                        Node
           Node
        Controller                                     Node
                                                    Controller
             Node
         Controller                                      Node
                                                     Controller
          Controller                                  Controller
After
                                Cloud                    Walrus
                               Controller                 Walrus
                                                           Walrus

 Cluster           Storage                   Cluster           Storage
Controller        Controller                Controller        Controller


         Node                                        Node
           Node
        Controller                                     Node
                                                    Controller
             Node
         Controller                                      Node
                                                     Controller
          Controller                                  Controller




                               RADOS
                               Cluster
RADOS for Walrus
•
    • radosgw Eucalyptus
    • Walrus RADOS
•
• RADOS API     C/C++
  Java                JNI

• File/FileInputStream/FileOutputStream
                                RADOS API
•
        RADOS



•
    •

    •
•
    :,(

•
    RADOS
(MB/s) 90.0



      67.5          40%
              70%
                                LocalFS
      45.0                      RADOS
                          60%   Walrus(LocalFS)
                                Walrus(RADOS)

      22.5



         0
(MB/s) 90.0



      67.5                40%
                    70%
                                        LocalFS
      45.0                              RADOS
                                60%     Walrus(LocalFS)
                                        Walrus(RADOS)

      22.5



         0
              Web               RADOS
60
        Per!OSD Throughput




                             50
                             40
             (MB/sec)




                             30
                             20                              no replication
                                                             2x replication
                             10                              3x replication
                             0
                                  4   16   64          256   1024      4096
                                           Write Size (KB)

 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im
              Ceph
 physical disk. Replication has minimal impact on OSD throughput, although
                                             60MB/s
r of OSDs is fixed, n-way replication reduces total effective throughput by a facto
e replicated data must be written to n OSDs.
60
        Per!OSD Throughput




                             50
                             40
             (MB/sec)




                             30
                             20                              no replication
                                                             2x replication
                             10                              3x replication
                             0
                                  4   16   64          256   1024      4096
                                           Write Size (KB)

 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im
              Ceph
 physical disk. Replication has minimal impact on OSD throughput, although
                                             60MB/s
r of OSDs is fixed, n-way replication reduces total effective throughput by a facto
e replicated data must be written to n OSDs.
• RADOS Walrus
• Ceph Eucalyptus
• rbd Eucalyptus
URL

• Wiki:
   http://r4eucalyptus.wikia.com
• Repository:
  bzr branch lp:~syuu/eucalyptus/rados4eucalyptus-2.0.0

Mais conteúdo relacionado

Destaque

How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
Eucalyptus Systems, Inc.
 
Eucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud ComputingEucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud Computing
elliando dias
 
Open Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -EucalyptusOpen Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -Eucalyptus
Sameer Naik
 
Database.Cache&Buffer&Lock
Database.Cache&Buffer&LockDatabase.Cache&Buffer&Lock
Database.Cache&Buffer&Lock
Lixun Peng
 
Evaluacion Factorial de las Aptitudes
Evaluacion Factorial de las AptitudesEvaluacion Factorial de las Aptitudes
Evaluacion Factorial de las Aptitudes
karkim
 
AP Notes Sept 2 2009
AP Notes Sept 2 2009AP Notes Sept 2 2009
AP Notes Sept 2 2009
msmckennna
 
Orhideje i-misli
Orhideje i-misliOrhideje i-misli
Orhideje i-misli
verka 123
 
Scarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist ChurchScarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist Church
thackley
 

Destaque (20)

Green IT matters at Wipro Ltd
Green IT matters at Wipro LtdGreen IT matters at Wipro Ltd
Green IT matters at Wipro Ltd
 
Building clouds with eucalyptus
Building clouds with eucalyptusBuilding clouds with eucalyptus
Building clouds with eucalyptus
 
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
 
Eucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud ComputingEucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud Computing
 
Eucalyptus - Open Source Infrastructure-as-a-Service
Eucalyptus - Open Source Infrastructure-as-a-ServiceEucalyptus - Open Source Infrastructure-as-a-Service
Eucalyptus - Open Source Infrastructure-as-a-Service
 
CloudStack Architecture
CloudStack ArchitectureCloudStack Architecture
CloudStack Architecture
 
CloudStack vs OpenStack
CloudStack vs OpenStackCloudStack vs OpenStack
CloudStack vs OpenStack
 
CloudStack vs Openstack
CloudStack vs OpenstackCloudStack vs Openstack
CloudStack vs Openstack
 
Open Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -EucalyptusOpen Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -Eucalyptus
 
Lifting Matters Issue 11 Febuary 2010
Lifting Matters Issue 11 Febuary 2010Lifting Matters Issue 11 Febuary 2010
Lifting Matters Issue 11 Febuary 2010
 
Database.Cache&Buffer&Lock
Database.Cache&Buffer&LockDatabase.Cache&Buffer&Lock
Database.Cache&Buffer&Lock
 
Community, Coaching, Curation: New L&D roles
Community, Coaching, Curation: New L&D rolesCommunity, Coaching, Curation: New L&D roles
Community, Coaching, Curation: New L&D roles
 
八白散
八白散八白散
八白散
 
Psvkbsrk.kursus
Psvkbsrk.kursusPsvkbsrk.kursus
Psvkbsrk.kursus
 
Evaluacion Factorial de las Aptitudes
Evaluacion Factorial de las AptitudesEvaluacion Factorial de las Aptitudes
Evaluacion Factorial de las Aptitudes
 
AP Notes Sept 2 2009
AP Notes Sept 2 2009AP Notes Sept 2 2009
AP Notes Sept 2 2009
 
Orhideje i-misli
Orhideje i-misliOrhideje i-misli
Orhideje i-misli
 
Scarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist ChurchScarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist Church
 
Winter driving october 2013
Winter driving october 2013Winter driving october 2013
Winter driving october 2013
 
Cartoon Planet
Cartoon PlanetCartoon Planet
Cartoon Planet
 

Semelhante a RADOS for Eucalyptus

Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1
Ram Chinta
 
Supercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO AmsterdamSupercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO Amsterdam
Acunu
 
AWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best PracticesAWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best Practices
Amazon Web Services
 
Open Cloud Interop Public
Open Cloud Interop PublicOpen Cloud Interop Public
Open Cloud Interop Public
rvanhoe
 
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve MillidgeJUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
C2B2 Consulting
 
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
Vitor Tomaz
 
Windows Azure platform overview
Windows Azure platform overviewWindows Azure platform overview
Windows Azure platform overview
Frédéric Harper
 
Varnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright CrazyVarnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright Crazy
Mike Willbanks
 
Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.
Mike Willbanks
 

Semelhante a RADOS for Eucalyptus (20)

Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1
 
Cybera - Clouds & other computational frameworks for science
Cybera - Clouds & other computational frameworks for scienceCybera - Clouds & other computational frameworks for science
Cybera - Clouds & other computational frameworks for science
 
JUDCon 2010 Boston : CoolingTower and CirrAS
JUDCon 2010 Boston : CoolingTower and CirrASJUDCon 2010 Boston : CoolingTower and CirrAS
JUDCon 2010 Boston : CoolingTower and CirrAS
 
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
 
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
 
Infrastruttura Scalabile Per Applicazioni Aziendali Sun Microsystems - Virt...
Infrastruttura Scalabile Per Applicazioni Aziendali   Sun Microsystems - Virt...Infrastruttura Scalabile Per Applicazioni Aziendali   Sun Microsystems - Virt...
Infrastruttura Scalabile Per Applicazioni Aziendali Sun Microsystems - Virt...
 
Supercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO AmsterdamSupercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO Amsterdam
 
Arquitectura dos Serviços da plataforma Windows Azure
Arquitectura dos Serviços da plataforma Windows AzureArquitectura dos Serviços da plataforma Windows Azure
Arquitectura dos Serviços da plataforma Windows Azure
 
OpenStack Report
OpenStack ReportOpenStack Report
OpenStack Report
 
Sysops cu Chef
Sysops cu ChefSysops cu Chef
Sysops cu Chef
 
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
 
Cloud Foundry Bootcamp
Cloud Foundry BootcampCloud Foundry Bootcamp
Cloud Foundry Bootcamp
 
AWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best PracticesAWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best Practices
 
Open Cloud Interop Public
Open Cloud Interop PublicOpen Cloud Interop Public
Open Cloud Interop Public
 
Ga cloud scaling 3 30-2012
Ga cloud scaling 3 30-2012Ga cloud scaling 3 30-2012
Ga cloud scaling 3 30-2012
 
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve MillidgeJUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
 
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
 
Windows Azure platform overview
Windows Azure platform overviewWindows Azure platform overview
Windows Azure platform overview
 
Varnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright CrazyVarnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright Crazy
 
Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.
 

Mais de Takuya ASADA

Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」
Takuya ASADA
 
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワークSeastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Takuya ASADA
 
僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない
Takuya ASADA
 
Interrupt Affinityについて
Interrupt AffinityについてInterrupt Affinityについて
Interrupt Affinityについて
Takuya ASADA
 
OSvパンフレット
OSvパンフレットOSvパンフレット
OSvパンフレット
Takuya ASADA
 
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
Takuya ASADA
 
「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2
Takuya ASADA
 
「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1
Takuya ASADA
 

Mais de Takuya ASADA (20)

Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」
 
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワークSeastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
 
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
 
ヤマノススメ〜秋山郷 de ハッカソン〜
ヤマノススメ〜秋山郷 de ハッカソン〜ヤマノススメ〜秋山郷 de ハッカソン〜
ヤマノススメ〜秋山郷 de ハッカソン〜
 
UEFI時代のブートローダ
UEFI時代のブートローダUEFI時代のブートローダ
UEFI時代のブートローダ
 
OSvのご紹介 in 
Java 8 HotSpot meeting
OSvのご紹介 in 
Java 8 HotSpot meetingOSvのご紹介 in 
Java 8 HotSpot meeting
OSvのご紹介 in 
Java 8 HotSpot meeting
 
OSvパンフレット v3
OSvパンフレット v3OSvパンフレット v3
OSvパンフレット v3
 
OSvのご紹介 in OSC2014 Tokyo/Fall
OSvのご紹介 in OSC2014 Tokyo/FallOSvのご紹介 in OSC2014 Tokyo/Fall
OSvのご紹介 in OSC2014 Tokyo/Fall
 
OSv噺
OSv噺OSv噺
OSv噺
 
OSvの概要と実装
OSvの概要と実装OSvの概要と実装
OSvの概要と実装
 
Linux network stack
Linux network stackLinux network stack
Linux network stack
 
Ethernetの受信処理
Ethernetの受信処理Ethernetの受信処理
Ethernetの受信処理
 
Presentation on your terminal
Presentation on your terminalPresentation on your terminal
Presentation on your terminal
 
僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない
 
Interrupt Affinityについて
Interrupt AffinityについてInterrupt Affinityについて
Interrupt Affinityについて
 
OSvパンフレット
OSvパンフレットOSvパンフレット
OSvパンフレット
 
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
 
「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2
 
「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1
 
10GbE時代のネットワークI/O高速化
10GbE時代のネットワークI/O高速化10GbE時代のネットワークI/O高速化
10GbE時代のネットワークI/O高速化
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 

RADOS for Eucalyptus

  • 1. RADOS for Eucalyptus <tasada@livedoor.jp>
  • 2. RADOS for Eucalyptus • Eucalyptus IaaS •
  • 3. IaaS • Infrastructure as a Service • Web … Web • Amazon Web Services
  • 4. Amazon EC2 • Web Linux Solaris Windows VM • EC2 → S3 • VM S3
  • 5. Amazon S3 • Web • REST/SOAP API • • 1020 2010/03
  • 6. Amazon EBS • EC2 → •
  • 7. Eucalyptus • IaaS • Amazon EC2, S3, EBS API →Amazon • • •
  • 8. Eucalyptus Cloud Controller Walrus S3 Cluster Storage Cluster Storage Controller Controller Controller Controller Node EBS Node Node Controller Node Controller Node Controller Node Controller Controller Controller VM
  • 9. Eucalyptus • • Walrus(S3 ) • SC(EBS )
  • 10. Eucalyptus • • Ceph Filesystem • • S3 EBS like
  • 11. Ceph Filesystem • • POSIX ”mount ” • Ceph Filesystem • • •
  • 13. • • • • • etc..
  • 14. RADOS • • Reliable, Autonomic Distributed Object Store • ≠ • • etc... •
  • 15. RADOS OSD IO Monitor OSD OSD IO
  • 16. ~100PG/ OSD PG OSD ” ”
  • 17. CRUSH • PG OSD • HDD OSD → •
  • 18. OSD up down IP • PG • OSD Monitor • Monitor down
  • 19. RADOS API • RADOS • pool API open_pool(), close_pool(), lookup_pool(), create_pool(), delete_pool(), list_pools(), get_pool_stats() • API create(), write(), read(), remove(), trunk(), getxattr(), setxattr(), stat(), list_objects_open(), list_objects_more(), list_objects_close() • API IO API etc...
  • 20. RADOS API • radosgw: S3 • rbd: • S3 EBS
  • 21. RADOS for Eucalyptus • Walrus/SC RADOS • Walrus • (radosgw, rbd...)
  • 22. Before Cloud Walrus Controller Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller
  • 23. After Cloud Walrus Controller Walrus Walrus Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller RADOS Cluster
  • 24. RADOS for Walrus • • radosgw Eucalyptus • Walrus RADOS •
  • 25. • RADOS API C/C++ Java JNI • File/FileInputStream/FileOutputStream RADOS API
  • 26. RADOS • • •
  • 27. :,( • RADOS
  • 28. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0
  • 29. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0 Web RADOS
  • 30. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
  • 31. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
  • 32. • RADOS Walrus • Ceph Eucalyptus • rbd Eucalyptus
  • 33. URL • Wiki: http://r4eucalyptus.wikia.com • Repository: bzr branch lp:~syuu/eucalyptus/rados4eucalyptus-2.0.0

Notas do Editor