OpenNebulaConf2018 - Our Journey to OpenNebula - Germán Gutierrez - Booking.com

•

1 gostou•205 visualizações

OpenNebula Project

The use-case story of Booking.com and what it took to get 1700 users up and running with OpenNebula.

Software

Our journey to OpenNebula.
Germán Gutiérrez
Team Carmen

Germán Gutiérrez
Linux Systems @Booking.com
15+ years of experience in high scale deployments, DevOps, Linux/Unix Administration, DNS,
Web servers, MySQL, OpenLDAP, Shell/perl/python scripts & more
At Booking.com leading implementation & scaling of OpenNebula systems application in
development environment, impacting 1700+ tech and product users

Team Carmen:
● Nate Nuss - Team Leader
● Maria Scerbikova - Product Owner
● Giordano Fechio - System Administrator
● Lily Chen - Developer
● Omar Othman - Developer

Special thanks to:
● Mariano Guezuraga - Senior System Administrator

What’s this talk is about.
What’s this talk is not about.

Our size:
● Over 1000 hosts
● Over 13k VMs running
● Over 2000 Users
● And counting...

In short.
2016 MAY Joined the company and a team of 2.
2016 OCT Hackathon with OpenNebula.
2017 The year of OpenNebula: test, partial migration, team growth.
2018 The final move and current state.

Our use case.
● Development environment
● Many templates/roles
● User oriented
● Template/role ownership
● Our team provides the infrastructure

How it was.
● In house solution (perl, python, bash)
● Master & hosts
● Host with local storage
● VMs in the same network (bridged)
● The SoT (puppet class, DNS, IP assignment) was
an internal app for physical servers
● The scheduler was a cronjob

How it is.
● Network: OVS + VLANs
● Storage:
○ NFS/NetApp
○ Image / Template
● Tooling: cli in python
● We are the SoT:
○ Web Service in python
○ IP assignment by ONe
○ Updates DNS via hook

What didn’t work as expected.
● Networking:
○ One big Network to rule them all
○ Incident
○ Lesson learned, future.

What didn’t work as expected.
● SoT - Source of truth:
○ ONe API is slow*, then it needs cache!
■ Tuning oned helped
■ What can possibly go wrong with cache?
○ Lesson learned
■ FQDN as ID is a bad idea, bad design.

What didn’t work as expected.
● Tooling, python with python-oca
○ Supports ONe up to 4.10
○ Python-oca last commit 2017
○ Cumbersome to maintain
○ Lesson learned

What didn’t work as expected.
● Storage Shared/NetApp
○ Huge impact.
○ We had one Volume
○ We feared space issues
○ We had high CPU usage due to I/O
○ First actions: “easy” because of our use case.
○ “Solving” the issue.
○ Lesson learned.

Where are we?.
● Still caching, enter “bone” as a web service.
● As a team we are the MITM:
○ Working on a self service page for troubleshooting.
○ The same for role/template owners.
○ We need to split the bone and the selfservice code
● The NFS issue is “gone” (expensive)
● WIP: Rewriting the CLI in ruby: brone.

Where are we?. (cont.)
● We still don’t know how to deal with retries.
● Networking: Raised an issue to let us go for a SDN, so
the network drivers are pluggable as other parts of the
system.
● We have wasted resources: the user won’t destroy the
VM after usage.

Mais conteúdo relacionado

Mais procurados

Voyage en terre du multi-cloud

Frederic Leger

NTS: What We Do With OpenNebula - and Why We Do It

OpenNebula Project

OpenNebula Conf 2014 | Deploying OpenNebula in a Snap using Configuration Man...

NETWAYS

OpenNebula is a great cloud orchestration and management tool, characterised by its flexibility, durability and focused feature matrix. A feature matrix that is driven largely by real world problem scenarios and real world feedback : something that has been the focus of CentOS project as well. From large scale deployment automation to patch management and state control, the CentOS Project aims to solve real world problems faced by the people who run infrastructure : The Sysadmins administrators and operations teams. During this talk, I will share why OpenNebula and CentOS Linux are a perfect match and go into some user stories that demonstrate this relationships success in real world scenarios.

CentOS and OpenNebula, a Perfect Match

NETWAYS

Get introduced to the new ASP.NET 5. This stack stack that will change the way you build modern web apps! The next generation ASP.NET gives us a much needed modern framework for web and cloud. It is built from the ground up to provide an optimized development framework for apps that are either deployed to the cloud or run on-premises. A significant redesign, full open source and available on GitHub, ASP.NET 5 uses cloud-optimized version, that is enhanced for server scenarios like low-memory and high-throughput. Get to know the all new powerful ASP.NET 5 through our webinar. We would encourage you to go through the live Demo. Write back to us at jghosh@suyati.com for any queries. Suyati Technologies Pvt Ltd. 2nd Floor, B-Wing, Thapasya building, Infopark, Kakkanad Kochi 682030, Kakkanad, Kerala 682030

Get acquainted with the new ASP.Net 5

Suyati Technologies

Deploying CloudStack and Ceph with flexible VXLAN and BGP networking

ShapeBlue

Adventures in Research

NETWAYS

NSX with OpenNebula - upcoming 5.10

OpenNebula Project

We’re moving into a world of open cloud — where each organization can find the right cloud for its unique needs. A single cloud management platform can not be all things to all people, there will be a cloud space with several offerings focused on different environments and/or industries. The OpenNebula commitment to the open cloud flows directly out of its mission — to become the simplest cloud enabling platform — and its purpose — to bring simplicity to the private and hybrid enterprise cloud. OpenNebula exists to help companies build simple, cost-effective, reliable, open enterprise clouds on existing IT infrastructure. The OpenNebula Conference will be a great opportunity to remind our vision, vision and commitment, to look back at how the project has grown in the last 8 years, and to give a peek at what to expect from the project in the near future.

OpenNebulaConf2017US: Welcome and project update by Ignacio M. Llorente and R...

OpenNebula Project

Computer networks are undergoing a phenomenal growth, driven by the rapidly increasing number of nodes constituting the networks. At the same time, the number of security threats on Internet and intranet networks is constantly increasing, and the testing and experimentation of cyber defense solutions require the availability of separate, test environments that best reflect the complexity of a real system. Such environments support the deployment and monitoring of complex mission-driven network scenarios, and cyber security training activities, thus enabling enterprises to study cyber defense strategies and allowing security researchers to evaluate their algorithms at scale. The main objective is delivering to researchers and practitioners an overview of the technological means and the practical steps to setup a private cloud platform based on OpenNebula for the creation and management of virtual environments that support cyber-security activities of training and testing, as well as an overview of its possible applications in the cyber security domain. In particular: 1. We describe our infrastructure based on OpenNebula 2. We overview our application, sitting on top of OpenNebula, as well as the technological tools involved in the management of its lifecycle (e.g., Ansible) . 3. We show how the platform can support various examples of security research activities  [References] Building an emulation environment for cyber security analyses of complex networked systems, Tanasache, Florin Dragos and Sorella, Mara and Bonomi, Silvia and Rapone, Raniero and Meacci, Davide, ICDCN '19, ACM, 2019

OpenNebulaConf2019 - Building Virtual Environments for Security Analyses of C...

OpenNebula Project

FreeIPA is an integrated Identity and Authentication solution for Linux and Unix environments. It provides a centralized authentication and authorization information and it also stores user data information such as user names, groups, hosts and many different objects to manage the security aspects of a network of computers. FreeIPA uses different technologies, but the core of the authentication system is based on MIT Kerberos technology. Thanks to this technology the authentication works on the basis of tickets to allow users or nodes communicating over a non-secure network to prove their identity to get access to different services. In this talk we will show how it is possible to integrate Sunstone authentication with the FreeIPA SSO thanks to the new Sunstone remote authentication plugin provided by OpenNebula. We will describe how to setup Sunstone in an easy way to include Kerberos authentication using Apache and Phusion Passenger module. This configuration approach also changes the security mechanism used by libvirt to establish the connection between hypervisors. We will explain how it is possible, using the host keytabs generated by FreeIPA, to improve the security between the hypervisors when we have to migrate virtual machines in an insecure network.

OpenNebulaConf 2016 - Sunstone integration with FreeIPA using Single Sign by ...

OpenNebula Project

VTastic: Akamai Innovations for Distributed System Testing - Jack Wadden, Akamai Akamai Technologies’ CDN platform is a complex, highly-integrated distributed system consisting of over 200,000 servers in over 120 countries.. Processing over 3 Trillion web requests per day, the Akamai platform regularly serves over 30Tbps of traffic to end users around the world. Setup and maintenance of Akamai integration test environments involves a significant investment of hardware, time and subject matter expertise. As a result, these environments are a scarce resource. Using Opennebula, Akamai has developed a system for saving and cloning multi-node integration test environments on-demand. The system is succeeding and has the potential to revolutionize Akamai’s approach to software development and testing. After exploring Akamai’s platform architecture and testing challenges, we will describe the key innovations that enabled the Vtastic solution, challenges we faced in implementing a reliable system, and future capabilities the system can offer.

OpenNebulaConf 2016 - VTastic: Akamai Innovations for Distributed System Test...

OpenNebula Project

See how Inoreader migrated from Bare-metal servers to OpenNebula + StorPool. Inoreader has reached a tipping point where it was no longer sustainable to add hardware servers to store the billions of articles that hundreds of thousands of users read every day across the globe. With OpenNebula and StorPool we can now utilize those servers far more efficiently and no longer worry about performance and downtime.

OpenNebulaConf2018 - How Inoreader Migrated from Bare-Metal Containers to Ope...

OpenNebula Project

Coding for the cloud - development of modern web applications

Wekoslav Stefanovski

The Université Catholique de Louvain has been using OpenNebula in IT academic environment for several years. We were so satisfied that when we decided to implement VDI we looked for a connection broker compatible with this cloud orchestrator. Thanks to OpenNebula + UDS Enterprise VDI joint solution, we will soon be able to give our 37,000 students access to virtual classrooms as if they were in the standard computer classrooms, so that they could access the same software from anywhere, anytime and using any device. The first tests with the solution have been very successful and we are now looking at expanding it to the whole university. In this session we will detail how the VDI infrastructure was built, the different components used and their role in the platform and how the IT staff deploys and manages the virtual desktops. We'll also explain how in the near future we will extend the use of OpenNebula to remote applications.

OpenNebulaConf2018 - UCLouvain Case Study: VDI for 37,000 students with OpenN...

OpenNebula Project

You've successfully learned all the ins and outs of Javascript, and can code up a website's front-end in minutes. Great. But, you always had to rely on some pesky back-end developers, with their weird way of speaking, using their weird server languages... Well, not any more - With meteor.js, you can create, build and deploy a completely complete website using only Javascript - and all from your favorite editor. Come and see the magic!

Through Meteor to the stars - Developing full-stack SPA's with meteor.js

Wekoslav Stefanovski

Business Apps with the Universal Windows Platform

Christian Nagel

It wasn’t more then 4 months between the first getting in touch with Opennebula and our productive Opennebula cluster beeing fired up. It was a quick decision that turned our to be the absolute right one. Since a little more than a year we are on our evolving way with Opennebula. So what have we been looking for and why did we end up with Opennebula? How does our setup look like in the moment and what are our future plans with Opennebula? Learnings from a year with Opennebula.

OpenNebula Conf 2014 | OpenNebula as alternative to commercial virtualization...

NETWAYS

Detailed Introduction To Docker

nklmish

OpenNebula - Status and Roadmap

OpenNebula Project

Mais procurados (20)