SlideShare uma empresa Scribd logo
1 de 28
Baixar para ler offline
OpenIO Summit ‘17
ARM, Object Storage and More
OpenIO Summit’17
Topics
1
2
3
Genesis
Hardware review
Deployment frameworks and APIs
4 Demo
OpenIO Summit’17
Very lite software stack
• Written in C
• 1 core
• 2GB ram
Grid of nodes with 

no consistent hashtable
Easy to scale

Never rebalance
Conscience technology

Real time load balancing for
optimal data placement
Very few communication
between nodes

When a node is working
others are free
We think different
OpenIO SDS technology
OpenIO Summit ‘17
Hardware limitation
• 1 node ~1PB
• Scalability at the enclosure level
Lets find a hardware that fits

OpenIO SDS flexibility
OpenIO Summit ‘17
Why ARM is great?
• Cheap
• Low power consumption
• Low heat
• Enough resources
One board per disk
OpenIO Summit ‘17
One board per disk benefits
• Failure domain
• Scaling at the disk level
• Cost effective
We need a flexible method

to provide and install the 

servers…


Here comes OVH’s IAAS API
OpenIO Summit’17
• Large range of OS (~130)
• Automatic build factory
• Large scale infrastructure to deploy OS
• ~ 500 builds or rebuilds per day
• User defined
Installation Backend - key facts
OpenIO Summit’17
How it works
OpenIO SDS deployment on OVH’s ARM nodes
Install

process
OVH Rest API
OpenIO SDS cluster
HW
OS
HW
OS
HW
OS
Deploy OpenIO SDS
Build
Aggregate
OpenIO Summit’17
HDAAS - Architecture
• 1 switch module
• 24 hard drive modules
Hardware
OpenIO Summit’17
HDAAS - Module
• Dual core 

Cortex A9 ARMv7 CPU
• Up to 1 GHz per core
• 2 GB DDR3
• 2 x GbE ports SGMII / RGMII
Hardware
OpenIO Summit’17
HDAAS - Module - NIC Speed
• Up to 2.5 Gb/s
• Misleading info from ethtool
Hardware
OpenIO Summit’17
HDAAS - Module - NIC Speed
• Iperf
Hardware
OpenIO Summit’17
OVH API - Install main steps
• Boots on rescue (live system)
• Build partitioning layout and mount it
• Copy image and layout
• Make it bootable
• Reboot on system
• Customize system
Deployment framework and API
OpenIO Summit’17
OVH API - Tools
• Rescue = live, adapted for ARMv7
• Base images
• Scripts to drive tftp config
Deployment framework and API
OpenIO Summit’17
OVH API - Tools
• First images: cross compiling from an x86 build machine



• Problems on more advanced packages
• Advanced images directly built on final target using deboostrap
Build rescue and images
OpenIO Summit’17
OVH API - Tools
• From network (using uboot > pxe > syslinux)











• Main drawback: users are not independent on us regarding the kernel upgrades
Boot on local drive v1
OpenIO Summit’17
OVH API - Tools
• Entirely from local disk
• uBoot still boots on network first (so as to keep rescue available)
• syslinux chains back on local disk 



• With U-boot-tools: we persist a localcmd in uboot firmware direcly from rescue



• Limitations: uboots only knows how to boot from ext* filesystems
Boot on local drive v2
OpenIO Summit’17
Using the API for our use case
OpenIO Summit’17
1. Create a template
OpenIO Summit’17
2. Add a scheme partition
OpenIO Summit’17
3. List of schemes available for a template
OpenIO Summit’17
4. Add a partition in a partitioning scheme
OpenIO Summit’17
4. Add a partition in a partitioning scheme
OpenIO Summit’17
5. List of partitions defined
OpenIO Summit’17
6. Customized template
OpenIO Summit’17
7. Launch install
OpenIO Summit’17
8. Monitoring a bunch of installs I
OpenIO Summit’17
What can you expect from Grid for Apps in the near future?
Questions?
OpenIO

Mais conteúdo relacionado

Mais procurados

BlaBlaCar and infrastructure automation
BlaBlaCar and infrastructure automationBlaBlaCar and infrastructure automation
BlaBlaCar and infrastructure automation
sinfomicien
 
XenTT: Deterministic Systems Analysis in Xen
XenTT: Deterministic Systems Analysis in XenXenTT: Deterministic Systems Analysis in Xen
XenTT: Deterministic Systems Analysis in Xen
The Linux Foundation
 
Kernel Recipes 2017 - What's inside the input stack? - Benjamain Tissoires
Kernel Recipes 2017 - What's inside the input stack? - Benjamain TissoiresKernel Recipes 2017 - What's inside the input stack? - Benjamain Tissoires
Kernel Recipes 2017 - What's inside the input stack? - Benjamain Tissoires
Anne Nicolas
 

Mais procurados (20)

OSv: probably the best OS for cloud workloads you've never hear of
OSv: probably the best OS for cloud workloads you've never hear ofOSv: probably the best OS for cloud workloads you've never hear of
OSv: probably the best OS for cloud workloads you've never hear of
 
XPDDS17: Xen-lite for ARM: Adapting Xen for a Samsung Exynos MicroServer with...
XPDDS17: Xen-lite for ARM: Adapting Xen for a Samsung Exynos MicroServer with...XPDDS17: Xen-lite for ARM: Adapting Xen for a Samsung Exynos MicroServer with...
XPDDS17: Xen-lite for ARM: Adapting Xen for a Samsung Exynos MicroServer with...
 
BlaBlaCar and infrastructure automation
BlaBlaCar and infrastructure automationBlaBlaCar and infrastructure automation
BlaBlaCar and infrastructure automation
 
Embedded Linux
Embedded LinuxEmbedded Linux
Embedded Linux
 
Building a Container Platform with docker swarm
Building a Container Platform with docker swarmBuilding a Container Platform with docker swarm
Building a Container Platform with docker swarm
 
Linux kernel booting
Linux kernel bootingLinux kernel booting
Linux kernel booting
 
XenTT: Deterministic Systems Analysis in Xen
XenTT: Deterministic Systems Analysis in XenXenTT: Deterministic Systems Analysis in Xen
XenTT: Deterministic Systems Analysis in Xen
 
Coal 9 pipelining in Assembly Programming
Coal 9 pipelining in Assembly ProgrammingCoal 9 pipelining in Assembly Programming
Coal 9 pipelining in Assembly Programming
 
BlaBlaCar Elastic Search Feedback
BlaBlaCar Elastic Search FeedbackBlaBlaCar Elastic Search Feedback
BlaBlaCar Elastic Search Feedback
 
Linux kernel development
Linux kernel developmentLinux kernel development
Linux kernel development
 
PX4 Seminar 01
PX4 Seminar 01PX4 Seminar 01
PX4 Seminar 01
 
RISC-V on Edge: Porting EVE and Alpine Linux to RISC-V
RISC-V on Edge: Porting EVE and Alpine Linux to RISC-VRISC-V on Edge: Porting EVE and Alpine Linux to RISC-V
RISC-V on Edge: Porting EVE and Alpine Linux to RISC-V
 
Kernel Recipes 2017 - What's inside the input stack? - Benjamain Tissoires
Kernel Recipes 2017 - What's inside the input stack? - Benjamain TissoiresKernel Recipes 2017 - What's inside the input stack? - Benjamain Tissoires
Kernel Recipes 2017 - What's inside the input stack? - Benjamain Tissoires
 
PX4 Seminar 02
PX4 Seminar 02PX4 Seminar 02
PX4 Seminar 02
 
Python on FreeBSD
Python on FreeBSDPython on FreeBSD
Python on FreeBSD
 
Kernel Recipes 2017 - HDMI CEC: Status Report - Hans Verkuil
Kernel Recipes 2017 - HDMI CEC: Status Report - Hans VerkuilKernel Recipes 2017 - HDMI CEC: Status Report - Hans Verkuil
Kernel Recipes 2017 - HDMI CEC: Status Report - Hans Verkuil
 
Embedded Systems: Lecture 8: The Raspberry Pi as a Linux Box
Embedded Systems: Lecture 8: The Raspberry Pi as a Linux BoxEmbedded Systems: Lecture 8: The Raspberry Pi as a Linux Box
Embedded Systems: Lecture 8: The Raspberry Pi as a Linux Box
 
ルータHackで楽しもう! (シプキャン2014 東京大会)
ルータHackで楽しもう! (シプキャン2014 東京大会)ルータHackで楽しもう! (シプキャン2014 東京大会)
ルータHackで楽しもう! (シプキャン2014 東京大会)
 
Kernel Recipes 2017 - The Serial Device Bus - Johan Hovold
Kernel Recipes 2017 - The Serial Device Bus - Johan HovoldKernel Recipes 2017 - The Serial Device Bus - Johan Hovold
Kernel Recipes 2017 - The Serial Device Bus - Johan Hovold
 
CoreOS Overview
CoreOS OverviewCoreOS Overview
CoreOS Overview
 

Semelhante a OpenIO Summit'17 - ARM, Object Storage and more

Add sale davinci
Add sale davinciAdd sale davinci
Add sale davinci
Akash Sahoo
 
"Building Complete Embedded Vision Systems on Linux—From Camera to Display," ...
"Building Complete Embedded Vision Systems on Linux—From Camera to Display," ..."Building Complete Embedded Vision Systems on Linux—From Camera to Display," ...
"Building Complete Embedded Vision Systems on Linux—From Camera to Display," ...
Edge AI and Vision Alliance
 
ch4-Software is Everywhere
ch4-Software is Everywherech4-Software is Everywhere
ch4-Software is Everywhere
ssuser06ea42
 

Semelhante a OpenIO Summit'17 - ARM, Object Storage and more (20)

Opening last bits of the infrastructure
Opening last bits of the infrastructureOpening last bits of the infrastructure
Opening last bits of the infrastructure
 
Ironic 140622212631-phpapp02
Ironic 140622212631-phpapp02Ironic 140622212631-phpapp02
Ironic 140622212631-phpapp02
 
Ironic 140622212631-phpapp02
Ironic 140622212631-phpapp02Ironic 140622212631-phpapp02
Ironic 140622212631-phpapp02
 
Hands on OpenCL
Hands on OpenCLHands on OpenCL
Hands on OpenCL
 
Building Embedded Linux Full Tutorial for ARM
Building Embedded Linux Full Tutorial for ARMBuilding Embedded Linux Full Tutorial for ARM
Building Embedded Linux Full Tutorial for ARM
 
Exploring the ABC's of Raspberry Pi with Python
Exploring the ABC's of Raspberry Pi with PythonExploring the ABC's of Raspberry Pi with Python
Exploring the ABC's of Raspberry Pi with Python
 
Lec 10-linux-review
Lec 10-linux-reviewLec 10-linux-review
Lec 10-linux-review
 
XPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM Systems
XPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM SystemsXPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM Systems
XPDDS18: CPUFreq in Xen on ARM - Oleksandr Tyshchenko, EPAM Systems
 
Current and Future of Non-Volatile Memory on Linux
Current and Future of Non-Volatile Memory on LinuxCurrent and Future of Non-Volatile Memory on Linux
Current and Future of Non-Volatile Memory on Linux
 
Up and running with Raspberry Pi
Up and running with Raspberry PiUp and running with Raspberry Pi
Up and running with Raspberry Pi
 
Add sale davinci
Add sale davinciAdd sale davinci
Add sale davinci
 
Linux on RISC-V with Open Source Hardware (Open Source Summit Japan 2020)
Linux on RISC-V with Open Source Hardware (Open Source Summit Japan 2020)Linux on RISC-V with Open Source Hardware (Open Source Summit Japan 2020)
Linux on RISC-V with Open Source Hardware (Open Source Summit Japan 2020)
 
"Building Complete Embedded Vision Systems on Linux—From Camera to Display," ...
"Building Complete Embedded Vision Systems on Linux—From Camera to Display," ..."Building Complete Embedded Vision Systems on Linux—From Camera to Display," ...
"Building Complete Embedded Vision Systems on Linux—From Camera to Display," ...
 
ch4-Software is Everywhere
ch4-Software is Everywherech4-Software is Everywhere
ch4-Software is Everywhere
 
Os lectures
Os lecturesOs lectures
Os lectures
 
OpenShift 4 installation
OpenShift 4 installationOpenShift 4 installation
OpenShift 4 installation
 
NXP IMX6 Processor - Embedded Linux
NXP IMX6 Processor - Embedded LinuxNXP IMX6 Processor - Embedded Linux
NXP IMX6 Processor - Embedded Linux
 
Stateless Hypervisors at Scale
Stateless Hypervisors at ScaleStateless Hypervisors at Scale
Stateless Hypervisors at Scale
 
Open Audit
Open AuditOpen Audit
Open Audit
 
Chapter 1 - Introduction to Operating System.pptx
Chapter 1 - Introduction to Operating System.pptxChapter 1 - Introduction to Operating System.pptx
Chapter 1 - Introduction to Operating System.pptx
 

Mais de OpenIO Object Storage

Mais de OpenIO Object Storage (13)

Nano-node: Intelligent Hard Drives in Large Storage Infrastructures
Nano-node: Intelligent Hard Drives in Large Storage InfrastructuresNano-node: Intelligent Hard Drives in Large Storage Infrastructures
Nano-node: Intelligent Hard Drives in Large Storage Infrastructures
 
IoT e l'integrazione cloud edge
IoT e l'integrazione cloud edgeIoT e l'integrazione cloud edge
IoT e l'integrazione cloud edge
 
OpenIO Summit'17: Much Done, More Yet to Come
OpenIO Summit'17: Much Done, More Yet to ComeOpenIO Summit'17: Much Done, More Yet to Come
OpenIO Summit'17: Much Done, More Yet to Come
 
OpenIO Summit'17 - Partner Session 2CRSI
OpenIO Summit'17 - Partner Session 2CRSIOpenIO Summit'17 - Partner Session 2CRSI
OpenIO Summit'17 - Partner Session 2CRSI
 
OpenIO Summt'17 - A Scalable and Collaborative Email Solution from BlueMind a...
OpenIO Summt'17 - A Scalable and Collaborative Email Solution from BlueMind a...OpenIO Summt'17 - A Scalable and Collaborative Email Solution from BlueMind a...
OpenIO Summt'17 - A Scalable and Collaborative Email Solution from BlueMind a...
 
OpenIO Summit'17 - OpenIO Demonstrates the Flexibility of its Object Storage ...
OpenIO Summit'17 - OpenIO Demonstrates the Flexibility of its Object Storage ...OpenIO Summit'17 - OpenIO Demonstrates the Flexibility of its Object Storage ...
OpenIO Summit'17 - OpenIO Demonstrates the Flexibility of its Object Storage ...
 
OpenIO Summit'17 - Grid for Apps
OpenIO Summit'17 - Grid for AppsOpenIO Summit'17 - Grid for Apps
OpenIO Summit'17 - Grid for Apps
 
OpenIO Summit'17 - Building GDPR compliant solutions with OpenIO and SME File...
OpenIO Summit'17 - Building GDPR compliant solutions with OpenIO and SME File...OpenIO Summit'17 - Building GDPR compliant solutions with OpenIO and SME File...
OpenIO Summit'17 - Building GDPR compliant solutions with OpenIO and SME File...
 
OpenIO ServerLess Storage
OpenIO ServerLess StorageOpenIO ServerLess Storage
OpenIO ServerLess Storage
 
OpenIO A3techlive in London - March 2016
OpenIO A3techlive in London - March 2016OpenIO A3techlive in London - March 2016
OpenIO A3techlive in London - March 2016
 
IT Press Tour #19 Slides OpenIO June 2016
IT Press Tour #19 Slides OpenIO June 2016IT Press Tour #19 Slides OpenIO June 2016
IT Press Tour #19 Slides OpenIO June 2016
 
IT Press Tour #17 - OpenIO & Technology
IT Press Tour #17 - OpenIO & TechnologyIT Press Tour #17 - OpenIO & Technology
IT Press Tour #17 - OpenIO & Technology
 
Oscon 2015 - OpenIO: Enabling the petabyte-sized mailboxes
Oscon 2015 - OpenIO: Enabling the petabyte-sized mailboxesOscon 2015 - OpenIO: Enabling the petabyte-sized mailboxes
Oscon 2015 - OpenIO: Enabling the petabyte-sized mailboxes
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Victor Rentea
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
Navigating the Deluge_ Dubai Floods and the Resilience of Dubai International...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..Understanding the FAA Part 107 License ..
Understanding the FAA Part 107 License ..
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
AI+A11Y 11MAY2024 HYDERBAD GAAD 2024 - HelloA11Y (11 May 2024)
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

OpenIO Summit'17 - ARM, Object Storage and more