OpenStack Data Processing ("Sahara") project update - December 2014

•

1 gostou•850 visualizações

Sergey Lukjanov

Software

Sergey Lukjanov
PTL
OpenStack Sahara
Data Processing Update

To provide a scalable data processing stack
and associated management interfaces Sahara
● provisions & operates data proc. clusters
● schedules & operates data proc. jobs /
workloads

Elastic Data Processing (EDP) is Sahara’s take
on data processing workflow management.

Juno release overview
● 540+ code commits from 50 people
● 32 blueprints implemented
● ~5000 code reviews
● ~168 bugs fixed
details: https://launchpad.net/sahara/juno

Sahara UI completely merged into Horizon

Vanilla Apache Hadoop 2.4.1 support
Cloudera Distribution of Apache Hadoop 5.X
support
Apache Spark 0.9.1 and 1.0.0 support

Kilo plans
● New versions for CDH, HDP, etc.
● Dashboard UX improvements
● Better Heat integration
● Ironic support

OpenStack Data Processing ("Sahara") project update - December 2014

Mais conteúdo relacionado

Mais procurados

The state of the art for OpenStack Data Processing (Hadoop on OpenStack) - At...spinningmatt

Lessons Learned from Building an Enterprise Big Data Platform from the Ground...DataWorks Summit

State of Spark in the cloud (Spark Summit EU 2017)Nicolas Poggi

Savanna: Hadoop on OpenStackMirantis

Hadoop and OpenStackDataWorks Summit

20150425 experimenting with openstack sahara on dockerWei Ting Chen

OpenStack Trove Day (19 Aug 2014, Cambridge MA) - Saharaspinningmatt

Tachyon and Apache Sparkrhatr

Performance Troubleshooting Using Apache Spark MetricsDatabricks

Using Apache Spark in the Cloud—A Devops Perspective with Telmo OliveiraSpark Summit

Apache Kylin: Speed Up Cubing with Apache Spark with Luke Han and Shaofeng ShiDatabricks

Apache Spark on K8S Best Practice and Performance in the CloudDatabricks

Scale-Out Using Spark in Serverless Herd Mode!Databricks

IEEE International Conference on Data Engineering 2015Yousun Jeong

20150314 sahara intro and the future plan for open stack meetupWei Ting Chen

Apache Spark OverviewairisData

Storage Engine Considerations for Your Apache Spark Applications with Mladen ...Spark Summit

Improved Applications with IPv6: an overviewCisco DevNet

Hello OpenStack, Meet HadoopDataWorks Summit

Building a Business Logic Translation Engine with Spark Streaming for Communi...Spark Summit

Mais procurados (20)

The state of the art for OpenStack Data Processing (Hadoop on OpenStack) - At...

Lessons Learned from Building an Enterprise Big Data Platform from the Ground...

State of Spark in the cloud (Spark Summit EU 2017)

Savanna: Hadoop on OpenStack

Hadoop and OpenStack

20150425 experimenting with openstack sahara on docker

OpenStack Trove Day (19 Aug 2014, Cambridge MA) - Sahara

Tachyon and Apache Spark

Performance Troubleshooting Using Apache Spark Metrics

Using Apache Spark in the Cloud—A Devops Perspective with Telmo Oliveira

Apache Kylin: Speed Up Cubing with Apache Spark with Luke Han and Shaofeng Shi

Apache Spark on K8S Best Practice and Performance in the Cloud

Scale-Out Using Spark in Serverless Herd Mode!

IEEE International Conference on Data Engineering 2015

20150314 sahara intro and the future plan for open stack meetup

Apache Spark Overview

Storage Engine Considerations for Your Apache Spark Applications with Mladen ...

Improved Applications with IPv6: an overview

Hello OpenStack, Meet Hadoop

Building a Business Logic Translation Engine with Spark Streaming for Communi...

Destaque

Benchmarking sahara based big data as a service solutionsZhidong Yu

Sahara presentation latest - Codemotion Rome 2015Codemotion

20151027 sahara + manila finalWei Ting Chen

از نماینده ایران در WSIS Prizes 2016 حمایت کنید ... متشکریم ...Leila Esmaeili

20150704 benchmark and user experience in sahara weitingWei Ting Chen

Sahara Updates - Kilo EditionOpenStack Foundation

آشنایی با جرم‌یابی قانونی رایانه‌ایRamin Najjarbashi

Cloud Security and Risk ManagementMorteza Javan

The Evolution of OpenStack – From Infancy to EnterpriseRackspace

Big Data on OpenStackNati Shalom

Destaque (10)

Benchmarking sahara based big data as a service solutions

Sahara presentation latest - Codemotion Rome 2015

20151027 sahara + manila final

از نماینده ایران در WSIS Prizes 2016 حمایت کنید ... متشکریم ...

20150704 benchmark and user experience in sahara weiting

Sahara Updates - Kilo Edition

آشنایی با جرم‌یابی قانونی رایانه‌ای

Cloud Security and Risk Management

The Evolution of OpenStack – From Infancy to Enterprise

Big Data on OpenStack

Semelhante a OpenStack Data Processing ("Sahara") project update - December 2014

Sahara Updates - Liberty EditionOpenStack Foundation

Hortonworks tech workshop in-memory processing with sparkHortonworks

Creating the Internet of Your ThingsDataWorks Summit/Hadoop Summit

Bigdataappliance datasheet-1883358Ory Chhean

[Hadoop Meetup] Apache Hadoop 3 community update - Rohith SharmaNewton Alex

Big Data Customer Education Webcast: The Latest Advancements in Syncsort DMX ...Precisely

Apache Ambari BOF - OpenStack - Hadoop Summit 2013Hortonworks

Spark and Object Stores —What You Need to Know: Spark Summit East talk by Ste...Spark Summit

Hadoop Now, Next and BeyondDataWorks Summit

Hadoop Summit Dublin 2016: Hadoop Platform at Yahoo - A Year in Review Sumeet Singh

Hadoop Platform at YahooDataWorks Summit/Hadoop Summit

Empower Data-Driven Organizations with HPE and HadoopDataWorks Summit/Hadoop Summit

Apache Spark and Object StoresSteve Loughran

Introduction to the Hadoop EcoSystemShivaji Dutta

Big data architecture on cloud computing infrastructuredatastack

Modernize Your Existing EDW with IBM Big SQL & Hortonworks Data PlatformHortonworks

Cloudera + MicrosoftでHadoopするのがイイらしい。 #CWT2016Cloudera Japan

Build Your Own PaaS, Just like Red Hat's OpenShift from LinuxCon 2013 New Orl...OpenShift Origin

HPC DAY 2017 | FlyElephant Solutions for Data Science and HPCHPC DAY

Azure Big data Michel HUBERT

Semelhante a OpenStack Data Processing ("Sahara") project update - December 2014 (20)

Sahara Updates - Liberty Edition

Hortonworks tech workshop in-memory processing with spark

Creating the Internet of Your Things

Bigdataappliance datasheet-1883358

[Hadoop Meetup] Apache Hadoop 3 community update - Rohith Sharma

Big Data Customer Education Webcast: The Latest Advancements in Syncsort DMX ...

Apache Ambari BOF - OpenStack - Hadoop Summit 2013

Spark and Object Stores —What You Need to Know: Spark Summit East talk by Ste...

Hadoop Now, Next and Beyond

Hadoop Summit Dublin 2016: Hadoop Platform at Yahoo - A Year in Review

Hadoop Platform at Yahoo

Empower Data-Driven Organizations with HPE and Hadoop

Apache Spark and Object Stores

Introduction to the Hadoop EcoSystem

Big data architecture on cloud computing infrastructure

Modernize Your Existing EDW with IBM Big SQL & Hortonworks Data Platform

Cloudera + MicrosoftでHadoopするのがイイらしい。 #CWT2016

Build Your Own PaaS, Just like Red Hat's OpenShift from LinuxCon 2013 New Orl...

HPC DAY 2017 | FlyElephant Solutions for Data Science and HPC

Azure Big data

Mais de Sergey Lukjanov

[Mirantis Day 2015] Проект Sahara - BigData на OpenStackSergey Lukjanov

Courses: concurrency #2Sergey Lukjanov

Twitter StormSergey Lukjanov

Java Agents and Instrumentation techtalkSergey Lukjanov

Java Bytecode techtalkSergey Lukjanov

Kotlin techtalkSergey Lukjanov

Mais de Sergey Lukjanov (6)

[Mirantis Day 2015] Проект Sahara - BigData на OpenStack

Courses: concurrency #2

Twitter Storm

Java Agents and Instrumentation techtalk

Java Bytecode techtalk

Kotlin techtalk

Último

Odoo 14 - eLearning Module In Odoo 14 Enterprisepreethippts

Intelligent Home Wi-Fi Solutions | ThinkPalmSujith Sukumaran

React Server Component in Next.js by Hanief UtamaHanief Utama

Recruitment Management Software Benefits (Infographic)Hr365.us smith

Hot Sexy call girls in Patel Nagar🔝 9953056974 🔝 escort Service9953056974 Low Rate Call Girls In Saket, Delhi NCR

英国UN学位证,北安普顿大学毕业证书1:1制作qr0udbr0

Innovate and Collaborate- Harnessing the Power of Open Source Software.pdfYashikaSharma391629

Unveiling Design Patterns: A Visual Guide with UML DiagramsAhmed Mohamed

Post Quantum Cryptography – The Impact on Identityteam-WIBU

Taming Distributed Systems: Key Insights from Wix's Large-Scale Experience - ...Natan Silnitsky

Simplifying Microservices & Apps - The art of effortless development - Meetup...Rob Geurden

Open Source Summit NA 2024: Open Source Cloud Costs - OpenCost's Impact on En...Matt Ray

Xen Safety Embedded OSS Summit April 2024 v4.pdfStefano Stabellini

Machine Learning Software Engineering Patterns and Their EngineeringHironori Washizaki

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...confluent

MYjobs Presentation Django-based projectAnoyGreter

SensoDat: Simulation-based Sensor Dataset of Self-driving CarsChristian Birchler

Folding Cheat Sheet #4 - fourth in a seriesPhilip Schwarz

A healthy diet for your Java application Devoxx France.pdfMarharyta Nedzelska

SpotFlow: Tracking Method Calls and States at Runtimeandrehoraa