SlideShare uma empresa Scribd logo
1 de 33
RADOS for Eucalyptus
        <tasada@livedoor.jp>
RADOS for Eucalyptus

• Eucalyptus
    IaaS



•
IaaS

• Infrastructure as a Service
• Web
                                …   Web



•           Amazon Web Services
Amazon EC2
•   Web          Linux Solaris Windows
          VM

•         EC2


    →
                S3

•   VM               S3
Amazon S3
•   Web



•   REST/SOAP API

•
•
                    1020   2010/03
Amazon EBS

•
        EC2
    →



•
Eucalyptus
•                    IaaS

•   Amazon EC2, S3, EBS     API
    →Amazon



•
    •
    •
Eucalyptus
                                Cloud
                               Controller
                                                         Walrus                S3

 Cluster           Storage                   Cluster               Storage
Controller        Controller                Controller            Controller


         Node
                                    EBS              Node
           Node
        Controller                                     Node
                                                    Controller
             Node
         Controller                                      Node
                                                     Controller
          Controller                                  Controller

                         VM
Eucalyptus
•
    •   Walrus(S3       )




    •   SC(EBS      )
Eucalyptus

•

•   Ceph Filesystem

    •
    •                 S3   EBS like
Ceph Filesystem
•

•   POSIX             ”mount   ”

•   Ceph Filesystem

    •
    •
    •
Ceph Filesystem
•
•

•
    •
    •   etc..
RADOS
•
•   Reliable, Autonomic Distributed Object Store


•
      ≠

•
•                                           etc...

•
RADOS
              OSD




                IO




Monitor OSD
                OSD   IO
~100PG/
      OSD

PG




OSD


               ”   ”
CRUSH
•        PG OSD

•
                  HDD
          OSD
    →



•
•   OSD
      up down IP

•
      PG

•             OSD          Monitor



•   Monitor         down
RADOS API
•   RADOS

    •   pool      API
        open_pool(), close_pool(), lookup_pool(), create_pool(),
        delete_pool(), list_pools(), get_pool_stats()
    •                        API
        create(), write(), read(), remove(), trunk(), getxattr(),
        setxattr(), stat(), list_objects_open(),
        list_objects_more(), list_objects_close()
    •                        API            IO API etc...
RADOS API


• radosgw:
    S3

• rbd:
•            S3   EBS
RADOS for Eucalyptus

• Walrus/SC                   RADOS

• Walrus
•             (radosgw, rbd...)
Before
                                Cloud
                                                         Walrus
                               Controller


 Cluster           Storage                   Cluster               Storage
Controller        Controller                Controller            Controller


         Node                                        Node
           Node
        Controller                                     Node
                                                    Controller
             Node
         Controller                                      Node
                                                     Controller
          Controller                                  Controller
After
                                Cloud                    Walrus
                               Controller                 Walrus
                                                           Walrus

 Cluster           Storage                   Cluster           Storage
Controller        Controller                Controller        Controller


         Node                                        Node
           Node
        Controller                                     Node
                                                    Controller
             Node
         Controller                                      Node
                                                     Controller
          Controller                                  Controller




                               RADOS
                               Cluster
RADOS for Walrus
•
    • radosgw Eucalyptus
    • Walrus RADOS
•
• RADOS API     C/C++
  Java                JNI

• File/FileInputStream/FileOutputStream
                                RADOS API
•
        RADOS



•
    •

    •
•
    :,(

•
    RADOS
(MB/s) 90.0



      67.5          40%
              70%
                                LocalFS
      45.0                      RADOS
                          60%   Walrus(LocalFS)
                                Walrus(RADOS)

      22.5



         0
(MB/s) 90.0



      67.5                40%
                    70%
                                        LocalFS
      45.0                              RADOS
                                60%     Walrus(LocalFS)
                                        Walrus(RADOS)

      22.5



         0
              Web               RADOS
60
        Per!OSD Throughput




                             50
                             40
             (MB/sec)




                             30
                             20                              no replication
                                                             2x replication
                             10                              3x replication
                             0
                                  4   16   64          256   1024      4096
                                           Write Size (KB)

 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im
              Ceph
 physical disk. Replication has minimal impact on OSD throughput, although
                                             60MB/s
r of OSDs is fixed, n-way replication reduces total effective throughput by a facto
e replicated data must be written to n OSDs.
60
        Per!OSD Throughput




                             50
                             40
             (MB/sec)




                             30
                             20                              no replication
                                                             2x replication
                             10                              3x replication
                             0
                                  4   16   64          256   1024      4096
                                           Write Size (KB)

 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im
              Ceph
 physical disk. Replication has minimal impact on OSD throughput, although
                                             60MB/s
r of OSDs is fixed, n-way replication reduces total effective throughput by a facto
e replicated data must be written to n OSDs.
• RADOS Walrus
• Ceph Eucalyptus
• rbd Eucalyptus
URL

• Wiki:
   http://r4eucalyptus.wikia.com
• Repository:
  bzr branch lp:~syuu/eucalyptus/rados4eucalyptus-2.0.0

Mais conteúdo relacionado

Destaque

How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...Eucalyptus Systems, Inc.
 
Eucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud ComputingEucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud Computingelliando dias
 
Eucalyptus - Open Source Infrastructure-as-a-Service
Eucalyptus - Open Source Infrastructure-as-a-ServiceEucalyptus - Open Source Infrastructure-as-a-Service
Eucalyptus - Open Source Infrastructure-as-a-Servicebuildacloud
 
CloudStack vs OpenStack
CloudStack vs OpenStackCloudStack vs OpenStack
CloudStack vs OpenStackVictor Zhang
 
Open Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -EucalyptusOpen Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -EucalyptusSameer Naik
 
Lifting Matters Issue 11 Febuary 2010
Lifting Matters Issue 11 Febuary 2010Lifting Matters Issue 11 Febuary 2010
Lifting Matters Issue 11 Febuary 2010Alan Bassett
 
Database.Cache&Buffer&Lock
Database.Cache&Buffer&LockDatabase.Cache&Buffer&Lock
Database.Cache&Buffer&LockLixun Peng
 
Community, Coaching, Curation: New L&D roles
Community, Coaching, Curation: New L&D rolesCommunity, Coaching, Curation: New L&D roles
Community, Coaching, Curation: New L&D rolesBrightwave Group
 
Evaluacion Factorial de las Aptitudes
Evaluacion Factorial de las AptitudesEvaluacion Factorial de las Aptitudes
Evaluacion Factorial de las Aptitudeskarkim
 
AP Notes Sept 2 2009
AP Notes Sept 2 2009AP Notes Sept 2 2009
AP Notes Sept 2 2009msmckennna
 
Orhideje i-misli
Orhideje i-misliOrhideje i-misli
Orhideje i-misliverka 123
 
Scarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist ChurchScarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist Churchthackley
 
Winter driving october 2013
Winter driving october 2013Winter driving october 2013
Winter driving october 2013Alan Bassett
 

Destaque (20)

Green IT matters at Wipro Ltd
Green IT matters at Wipro LtdGreen IT matters at Wipro Ltd
Green IT matters at Wipro Ltd
 
Building clouds with eucalyptus
Building clouds with eucalyptusBuilding clouds with eucalyptus
Building clouds with eucalyptus
 
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
How to Transform Enterprise Applications to On-premise Clouds with Wipro and ...
 
Eucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud ComputingEucalyptus - An Open-source Infrastructure for Cloud Computing
Eucalyptus - An Open-source Infrastructure for Cloud Computing
 
Eucalyptus - Open Source Infrastructure-as-a-Service
Eucalyptus - Open Source Infrastructure-as-a-ServiceEucalyptus - Open Source Infrastructure-as-a-Service
Eucalyptus - Open Source Infrastructure-as-a-Service
 
CloudStack Architecture
CloudStack ArchitectureCloudStack Architecture
CloudStack Architecture
 
CloudStack vs OpenStack
CloudStack vs OpenStackCloudStack vs OpenStack
CloudStack vs OpenStack
 
CloudStack vs Openstack
CloudStack vs OpenstackCloudStack vs Openstack
CloudStack vs Openstack
 
Open Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -EucalyptusOpen Source Cloud Computing -Eucalyptus
Open Source Cloud Computing -Eucalyptus
 
Lifting Matters Issue 11 Febuary 2010
Lifting Matters Issue 11 Febuary 2010Lifting Matters Issue 11 Febuary 2010
Lifting Matters Issue 11 Febuary 2010
 
Database.Cache&Buffer&Lock
Database.Cache&Buffer&LockDatabase.Cache&Buffer&Lock
Database.Cache&Buffer&Lock
 
Community, Coaching, Curation: New L&D roles
Community, Coaching, Curation: New L&D rolesCommunity, Coaching, Curation: New L&D roles
Community, Coaching, Curation: New L&D roles
 
八白散
八白散八白散
八白散
 
Psvkbsrk.kursus
Psvkbsrk.kursusPsvkbsrk.kursus
Psvkbsrk.kursus
 
Evaluacion Factorial de las Aptitudes
Evaluacion Factorial de las AptitudesEvaluacion Factorial de las Aptitudes
Evaluacion Factorial de las Aptitudes
 
AP Notes Sept 2 2009
AP Notes Sept 2 2009AP Notes Sept 2 2009
AP Notes Sept 2 2009
 
Orhideje i-misli
Orhideje i-misliOrhideje i-misli
Orhideje i-misli
 
Scarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist ChurchScarecrow Festival at Thackley Methodist Church
Scarecrow Festival at Thackley Methodist Church
 
Winter driving october 2013
Winter driving october 2013Winter driving october 2013
Winter driving october 2013
 
Cartoon Planet
Cartoon PlanetCartoon Planet
Cartoon Planet
 

Semelhante a RADOS for Eucalyptus

Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram Chinta
 
Cybera - Clouds & other computational frameworks for science
Cybera - Clouds & other computational frameworks for scienceCybera - Clouds & other computational frameworks for science
Cybera - Clouds & other computational frameworks for scienceCybera Inc.
 
JUDCon 2010 Boston : CoolingTower and CirrAS
JUDCon 2010 Boston : CoolingTower and CirrASJUDCon 2010 Boston : CoolingTower and CirrAS
JUDCon 2010 Boston : CoolingTower and CirrASmarekgoldmann
 
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developerVitor Tomaz
 
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...rhatr
 
Infrastruttura Scalabile Per Applicazioni Aziendali Sun Microsystems - Virt...
Infrastruttura Scalabile Per Applicazioni Aziendali   Sun Microsystems - Virt...Infrastruttura Scalabile Per Applicazioni Aziendali   Sun Microsystems - Virt...
Infrastruttura Scalabile Per Applicazioni Aziendali Sun Microsystems - Virt...Walter Moriconi
 
Supercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO AmsterdamSupercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO AmsterdamAcunu
 
Arquitectura dos Serviços da plataforma Windows Azure
Arquitectura dos Serviços da plataforma Windows AzureArquitectura dos Serviços da plataforma Windows Azure
Arquitectura dos Serviços da plataforma Windows AzureComunidade NetPonto
 
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
[NetPonto] Arquitectura dos Serviços da plataforma Windows AzureVitor Tomaz
 
Cloud Foundry Bootcamp
Cloud Foundry BootcampCloud Foundry Bootcamp
Cloud Foundry BootcampAndy Piper
 
AWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best PracticesAWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best PracticesAmazon Web Services
 
Open Cloud Interop Public
Open Cloud Interop PublicOpen Cloud Interop Public
Open Cloud Interop Publicrvanhoe
 
Ga cloud scaling 3 30-2012
Ga cloud scaling 3 30-2012Ga cloud scaling 3 30-2012
Ga cloud scaling 3 30-2012Andy Parsons
 
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve MillidgeJUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve MillidgeC2B2 Consulting
 
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure PlatformVitor Tomaz
 
Windows Azure platform overview
Windows Azure platform overviewWindows Azure platform overview
Windows Azure platform overviewFrédéric Harper
 
Varnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright CrazyVarnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright CrazyMike Willbanks
 
Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.Mike Willbanks
 

Semelhante a RADOS for Eucalyptus (20)

Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1
 
Cybera - Clouds & other computational frameworks for science
Cybera - Clouds & other computational frameworks for scienceCybera - Clouds & other computational frameworks for science
Cybera - Clouds & other computational frameworks for science
 
JUDCon 2010 Boston : CoolingTower and CirrAS
JUDCon 2010 Boston : CoolingTower and CirrASJUDCon 2010 Boston : CoolingTower and CirrAS
JUDCon 2010 Boston : CoolingTower and CirrAS
 
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
[AzurePT] Desenvolvimento para o Windows Azure: Diferença para o developer
 
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
You Call that Micro, Mr. Docker? How OSv and Unikernels Help Micro-services S...
 
Infrastruttura Scalabile Per Applicazioni Aziendali Sun Microsystems - Virt...
Infrastruttura Scalabile Per Applicazioni Aziendali   Sun Microsystems - Virt...Infrastruttura Scalabile Per Applicazioni Aziendali   Sun Microsystems - Virt...
Infrastruttura Scalabile Per Applicazioni Aziendali Sun Microsystems - Virt...
 
Supercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO AmsterdamSupercharging Cassandra - GOTO Amsterdam
Supercharging Cassandra - GOTO Amsterdam
 
Arquitectura dos Serviços da plataforma Windows Azure
Arquitectura dos Serviços da plataforma Windows AzureArquitectura dos Serviços da plataforma Windows Azure
Arquitectura dos Serviços da plataforma Windows Azure
 
OpenStack Report
OpenStack ReportOpenStack Report
OpenStack Report
 
Sysops cu Chef
Sysops cu ChefSysops cu Chef
Sysops cu Chef
 
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
[NetPonto] Arquitectura dos Serviços da plataforma Windows Azure
 
Cloud Foundry Bootcamp
Cloud Foundry BootcampCloud Foundry Bootcamp
Cloud Foundry Bootcamp
 
AWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best PracticesAWS Summit 2011: Application Security Best Practices
AWS Summit 2011: Application Security Best Practices
 
Open Cloud Interop Public
Open Cloud Interop PublicOpen Cloud Interop Public
Open Cloud Interop Public
 
Ga cloud scaling 3 30-2012
Ga cloud scaling 3 30-2012Ga cloud scaling 3 30-2012
Ga cloud scaling 3 30-2012
 
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve MillidgeJUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
JUDCon London 2011 - Elastic SOA on the Cloud, Steve Millidge
 
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
[.Net Juniors Academy] Introdução ao Cloud Computing e Windows Azure Platform
 
Windows Azure platform overview
Windows Azure platform overviewWindows Azure platform overview
Windows Azure platform overview
 
Varnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright CrazyVarnish, The Good, The Awesome, and the Downright Crazy
Varnish, The Good, The Awesome, and the Downright Crazy
 
Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.Varnish, The Good, The Awesome, and the Downright Crazy.
Varnish, The Good, The Awesome, and the Downright Crazy.
 

Mais de Takuya ASADA

Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」Takuya ASADA
 
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワークSeastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワークTakuya ASADA
 
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」Takuya ASADA
 
ヤマノススメ〜秋山郷 de ハッカソン〜
ヤマノススメ〜秋山郷 de ハッカソン〜ヤマノススメ〜秋山郷 de ハッカソン〜
ヤマノススメ〜秋山郷 de ハッカソン〜Takuya ASADA
 
UEFI時代のブートローダ
UEFI時代のブートローダUEFI時代のブートローダ
UEFI時代のブートローダTakuya ASADA
 
OSvのご紹介 in 
Java 8 HotSpot meeting
OSvのご紹介 in 
Java 8 HotSpot meetingOSvのご紹介 in 
Java 8 HotSpot meeting
OSvのご紹介 in 
Java 8 HotSpot meetingTakuya ASADA
 
OSvパンフレット v3
OSvパンフレット v3OSvパンフレット v3
OSvパンフレット v3Takuya ASADA
 
OSvのご紹介 in OSC2014 Tokyo/Fall
OSvのご紹介 in OSC2014 Tokyo/FallOSvのご紹介 in OSC2014 Tokyo/Fall
OSvのご紹介 in OSC2014 Tokyo/FallTakuya ASADA
 
OSvの概要と実装
OSvの概要と実装OSvの概要と実装
OSvの概要と実装Takuya ASADA
 
Linux network stack
Linux network stackLinux network stack
Linux network stackTakuya ASADA
 
Ethernetの受信処理
Ethernetの受信処理Ethernetの受信処理
Ethernetの受信処理Takuya ASADA
 
Presentation on your terminal
Presentation on your terminalPresentation on your terminal
Presentation on your terminalTakuya ASADA
 
僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがないTakuya ASADA
 
Interrupt Affinityについて
Interrupt AffinityについてInterrupt Affinityについて
Interrupt AffinityについてTakuya ASADA
 
OSvパンフレット
OSvパンフレットOSvパンフレット
OSvパンフレットTakuya ASADA
 
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜Takuya ASADA
 
「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2Takuya ASADA
 
「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1Takuya ASADA
 
10GbE時代のネットワークI/O高速化
10GbE時代のネットワークI/O高速化10GbE時代のネットワークI/O高速化
10GbE時代のネットワークI/O高速化Takuya ASADA
 

Mais de Takuya ASADA (20)

Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」Seastar in 歌舞伎座.tech#8「C++初心者会」
Seastar in 歌舞伎座.tech#8「C++初心者会」
 
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワークSeastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
Seastar:高スループットなサーバアプリケーションの為の新しいフレームワーク
 
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
高スループットなサーバアプリケーションの為の新しいフレームワーク
「Seastar」
 
ヤマノススメ〜秋山郷 de ハッカソン〜
ヤマノススメ〜秋山郷 de ハッカソン〜ヤマノススメ〜秋山郷 de ハッカソン〜
ヤマノススメ〜秋山郷 de ハッカソン〜
 
UEFI時代のブートローダ
UEFI時代のブートローダUEFI時代のブートローダ
UEFI時代のブートローダ
 
OSvのご紹介 in 
Java 8 HotSpot meeting
OSvのご紹介 in 
Java 8 HotSpot meetingOSvのご紹介 in 
Java 8 HotSpot meeting
OSvのご紹介 in 
Java 8 HotSpot meeting
 
OSvパンフレット v3
OSvパンフレット v3OSvパンフレット v3
OSvパンフレット v3
 
OSvのご紹介 in OSC2014 Tokyo/Fall
OSvのご紹介 in OSC2014 Tokyo/FallOSvのご紹介 in OSC2014 Tokyo/Fall
OSvのご紹介 in OSC2014 Tokyo/Fall
 
OSv噺
OSv噺OSv噺
OSv噺
 
OSvの概要と実装
OSvの概要と実装OSvの概要と実装
OSvの概要と実装
 
Linux network stack
Linux network stackLinux network stack
Linux network stack
 
Ethernetの受信処理
Ethernetの受信処理Ethernetの受信処理
Ethernetの受信処理
 
Presentation on your terminal
Presentation on your terminalPresentation on your terminal
Presentation on your terminal
 
僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない僕のIntel nucが起動しないわけがない
僕のIntel nucが起動しないわけがない
 
Interrupt Affinityについて
Interrupt AffinityについてInterrupt Affinityについて
Interrupt Affinityについて
 
OSvパンフレット
OSvパンフレットOSvパンフレット
OSvパンフレット
 
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
BHyVeでOSvを起動したい
〜BIOSがなくてもこの先生きのこるには〜
 
「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2「ハイパーバイザの作り方」読書会#2
「ハイパーバイザの作り方」読書会#2
 
「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1「ハイパーバイザの作り方」読書会#1
「ハイパーバイザの作り方」読書会#1
 
10GbE時代のネットワークI/O高速化
10GbE時代のネットワークI/O高速化10GbE時代のネットワークI/O高速化
10GbE時代のネットワークI/O高速化
 

Último

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Orbitshub
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfOverkill Security
 

Último (20)

Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 

RADOS for Eucalyptus

  • 1. RADOS for Eucalyptus <tasada@livedoor.jp>
  • 2. RADOS for Eucalyptus • Eucalyptus IaaS •
  • 3. IaaS • Infrastructure as a Service • Web … Web • Amazon Web Services
  • 4. Amazon EC2 • Web Linux Solaris Windows VM • EC2 → S3 • VM S3
  • 5. Amazon S3 • Web • REST/SOAP API • • 1020 2010/03
  • 6. Amazon EBS • EC2 → •
  • 7. Eucalyptus • IaaS • Amazon EC2, S3, EBS API →Amazon • • •
  • 8. Eucalyptus Cloud Controller Walrus S3 Cluster Storage Cluster Storage Controller Controller Controller Controller Node EBS Node Node Controller Node Controller Node Controller Node Controller Controller Controller VM
  • 9. Eucalyptus • • Walrus(S3 ) • SC(EBS )
  • 10. Eucalyptus • • Ceph Filesystem • • S3 EBS like
  • 11. Ceph Filesystem • • POSIX ”mount ” • Ceph Filesystem • • •
  • 13. • • • • • etc..
  • 14. RADOS • • Reliable, Autonomic Distributed Object Store • ≠ • • etc... •
  • 15. RADOS OSD IO Monitor OSD OSD IO
  • 16. ~100PG/ OSD PG OSD ” ”
  • 17. CRUSH • PG OSD • HDD OSD → •
  • 18. OSD up down IP • PG • OSD Monitor • Monitor down
  • 19. RADOS API • RADOS • pool API open_pool(), close_pool(), lookup_pool(), create_pool(), delete_pool(), list_pools(), get_pool_stats() • API create(), write(), read(), remove(), trunk(), getxattr(), setxattr(), stat(), list_objects_open(), list_objects_more(), list_objects_close() • API IO API etc...
  • 20. RADOS API • radosgw: S3 • rbd: • S3 EBS
  • 21. RADOS for Eucalyptus • Walrus/SC RADOS • Walrus • (radosgw, rbd...)
  • 22. Before Cloud Walrus Controller Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller
  • 23. After Cloud Walrus Controller Walrus Walrus Cluster Storage Cluster Storage Controller Controller Controller Controller Node Node Node Controller Node Controller Node Controller Node Controller Controller Controller RADOS Cluster
  • 24. RADOS for Walrus • • radosgw Eucalyptus • Walrus RADOS •
  • 25. • RADOS API C/C++ Java JNI • File/FileInputStream/FileOutputStream RADOS API
  • 26. RADOS • • •
  • 27. :,( • RADOS
  • 28. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0
  • 29. (MB/s) 90.0 67.5 40% 70% LocalFS 45.0 RADOS 60% Walrus(LocalFS) Walrus(RADOS) 22.5 0 Web RADOS
  • 30. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
  • 31. 60 Per!OSD Throughput 50 40 (MB/sec) 30 20 no replication 2x replication 10 3x replication 0 4 16 64 256 1024 4096 Write Size (KB) 6.7: Per-OSD write performance. The horizontal line indicates the upper limit im Ceph physical disk. Replication has minimal impact on OSD throughput, although 60MB/s r of OSDs is fixed, n-way replication reduces total effective throughput by a facto e replicated data must be written to n OSDs.
  • 32. • RADOS Walrus • Ceph Eucalyptus • rbd Eucalyptus
  • 33. URL • Wiki: http://r4eucalyptus.wikia.com • Repository: bzr branch lp:~syuu/eucalyptus/rados4eucalyptus-2.0.0

Notas do Editor