Deploy Spark ML and Tensorflow AI Models from Notebooks to Microservices - Nov 16 2016 - Madrid

•

6 likes•1,610 views

In this completely 100% Open Source demo-based talk, Chris Fregly from PipelineIO will be addressing an area of machine learning and artificial intelligence that is often overlooked: the real-time, end-user-facing "serving” layer in a hybrid-cloud and on-premise deployment environment using Jupyter, NetflixOSS, Docker, and Kubernetes. Serving models to end-users in real-time in a highly-scalable, fault-tolerant manner requires not only an understanding of machine learning fundamentals, but also an understanding of distributed systems and scalable microservices. Chris will combine his work experience from both Databricks and Netflix to present a 100% open source, real-world, hybrid-cloud, on-premise, and NetflixOSS-based production-ready environment to serve your notebook-based Spark ML and TensorFlow AI models with highly-scalable and highly-available robustness. Speaker Bio Chris Fregly is a Research Scientist at PipelineIO - a Streaming Analytics and Machine Learning Startup in San Francisco. Chris is an Apache Spark Contributor, Netflix Open Source Committer, Founder of the Global Advanced Spark and TensorFlow Meetup, and Author of the upcoming book, Advanced Spark, and Creator of the upcoming O'Reilly video series, Scaling TensorFlow Distributed in Production. Previously, Chris was an engineer at Databricks and Netflix - as well as a Founding Member of the IBM Spark Technology Center in San Francisco.

Software

INNOVATION TECHNOLOGY
MEETUP @ BEEVA
Deploy Spark andTensorflow Models:
From Notebook Dev to Microservice Prod
Madrid - November 16, 2016
ThankYou, BEEVA!
http://pipeline.io http://beeva.com

WHO AM I?
Chris Fregly
--------
Research Scientist @ PipelineIO
(Formerly Netflix and Databricks)
--------
http://pipeline.io

FUN WORKSHOP ON SATURDAY!
(HERE IN MADRID)
http://pipeline.io#upcoming-workshops

SOURCE CODE AND DOCKER IMAGES
• Github Repo: 900 Stars, 300 Forks
• DockerHub Repo: 6,200 Pulls

WHAT IS PIPELINE.IO?
ExtendingYour ML Pipelines into Production
100% Open Source!
http://pipeline.io

BRAINSTORMING AND VALIDATING
• Major Gaming Company
• Large Ride Sharing Service
• Popular Q & A Site
• Online Clothing Retailer
• DominantVideo Streaming

PIPELINE.IO FOCUS
• Model Deploying andTesting
• Model Scaling and Serving
• Online ModelTraining
• Dynamic Model Optimizing

MODEL DEPLOYING AND TESTING
Continuously Test
and Deploy Models
in Production!

ONLINE MODEL TRAINING
• Continuous, Incremental, and Partial Training
• Kafka + Spark Streaming + Spark ML
• Real-time, Dynamic Recommendations

DYNAMIC MODEL OPTIMIZING
Generate Optimized
Code from Spark ML!

PIPELINE.IO PLAN FOR 2017
• Performance
• Code Generation: CPU and GPU
• Continued Global Expansion

MORE WORKSHOPS IN 2017
http://pipeline.io#upcoming-workshops

WE’RE HIRING!!
• Kafka, Spark ML, and TensorFlow Contributors
• Systems Engineers
• GPU/CUDA Engineers
• C++, Java, Scala, Python
WE ONLY HIRE
NICE PEOPLE!!

DEMO!
Circuit Breakers and Request Batching

DEMO!
Deploy Spark ML DecisionTree to Production
Deploy to Cloud
or On-Premise!

DEMO!
Dynamic Code Generation of DecisionTree

THANK YOU!!
http://pipeline.io http://beeva.com

What's hot

At the end of 2017, our team started to work on a completely new mobile SDK. We started from scratch and we wanted to fix issues that we witnessed during our work on the existing SDK. And CI was one of the major topics. This talk is about our approach to building new CI from scratch. What we tried, what didn't work, what types of issues we faced. Keywords for this talk: Jenkins, AWS, Serverless, Docker, Mac mini, git, repo, Gerrit, Java, Go

Building CI from scratch

Artem Nikitin

Kubernetes on AWS at Europe's Leading Online Fashion Platform

Henning Jacobs

This was a talk presented at AnDevCon in Washington DC, July 2017. For products that are delivered on the Web, iOS and Android, there have been myriad approaches to reducing development time and the duplication of work. Sharing code between major platforms has, in some ways, felt like the search for the holy grail - hope remains, but as of today, has yet to be found. As long as there have been multiple platforms, there has been a desire to write once, deploy everywhere. In this class, we will look at accelerating cross-platform development by harnessing serverless microservices. At Hootsuite, our serverless experiment uses AWS Lambda functions. This class will cover the motivations of using AWS Lambda compared with other mobile cross-platform solutions. We will also examine the benefits and drawbacks of this approach to cross-platform development. Lastly, you will learn how Hootsuite worked to automate the deployment and versioning of its AWS Lambda function, including its integration it into our existing continuous integration pipeline. We also share the lessons learned after having an AWS Lambda deployment on iOS and Android running for many months as well as the experimentation with Amazon API Gateway to create an endpoint which invokes the Lambda function, enabling the function to be used by our web-based products as well.

Put iOS and Android on the same Wavelength with Serverless Microservices

Neil Power

OpenFaaS 2019 Project Update

Alex Ellis

Facilitez votre transition DevOps grâce à l'automatisation de votre infras...

VMware Tanzu

Modern software development is increasingly taking a “microservice” approach that has resulted in an explosion of complexity at the network level. We have more applications running distributed across different datacenters. Distributed tracing, events, and metrics are essential for observing and understanding modern microservice architectures. This talk is a deep dive on how to monitor your distributed system. You will get tools, methodologies, and experiences that will help you to realize what your applications expose and how to get value out from all these information. Gianluca Arbezzano, SRE at InfluxData will share how to monitor a distributed system, how to switch from a more traditional monitoring approach to observability. Stay focused on the server’s role and not on the hostname because it’s not really important anymore, our servers or containers are fast moving part and it’s easy to detach it from the right in case of trouble than call the server by name as a cute puppet. How to design a SLO for your core services and now to iterate on them. Instrument your services with tracing using tools like Zipkin or Jaeger to measure latency between in your network.

OSDC 2018 - Distributed monitoring

Gianluca Arbezzano

Alfresco Process Services (APS) and the Internet of Things

Nathan McMinn

Introducing GitLab (June 2018)

Noa Harel

Continuous Integration & Development with Gitlab

Ayush Sharma

What's New in GitLab and Software Development Trends

Noa Harel

Nulab's DevOps tool stack based on AWS

Takashi Someda

2014-05-gluecon-amplifying-docker

Alex Heneveld

Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka and Cassandra ---------------------------------- Presentation: @TIAD Paris -- http://tiad.io/ ---------------------------------- Source code: https://github.com/rogaha/data-processing-pipeline ---------------------------------- Resources: https://www.docker.com/products/docker / https://www.docker.com/technologies/overview

Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka ...

Roberto Hashioka

GitOps meets Serverless

Alex Ellis

有 Firebase 就不用找後端工程師了 (誤)

WANGCHOU LU

Swedish SharePoint UserGroup Göteborg Oct 5 2016 SharePoint Framework

David Opdendries

From AWS/STUPS to Kubernetes on AWS @Zalando - Berlin Kubernetes Meetup

Henning Jacobs

Slides of a session that I have given/will give at various developer conferences in H1 2018. Niklas Heidloff http://twitter.com/nheidloff http://heidloff.net Summary Article http://heidloff.net/article/when-to-use-serverless-kubernetes OpenWhisk https://openwhisk.apache.org https://github.com/ibm-functions/composer https://github.com/nheidloff/openwhisk-debug-nodejs Kubernetes https://kubernetes.io https://istio.io IBM Cloud http://ibm.biz/nheidloff Abstract There is a lot of debate whether to use Serverless or Kubernetes to build cloud-native apps. Both have their advantages and unique capabilities which developers should take into consideration when planning new projects. We will throw some light on the topics ease of use, maturity, types of scenarios, developer productivity and debugging, supported languages, DevOps and monitoring, performance, community and pricing. Cloud-native architectures shift the complexity from within an application to orchestrations of Microservices. Both Kubernetes and Serverless have their strengths which we will discuss. Besides the core development topics, developers should also understand operational aspects how complicated it is to maintain your own systems versus using managed platforms.

When to use Serverless? When to use Kubernetes?

Niklas Heidloff

E2E Data Pipeline - Apache Spark/Airflow/Livy

Rikin Tanna

React, GraphQL и Relay - вполне себе нормальный компонентный подход (nodkz)

Pavel Chertorogov

What's hot (20)

Building CI from scratch

Kubernetes on AWS at Europe's Leading Online Fashion Platform

Put iOS and Android on the same Wavelength with Serverless Microservices

OpenFaaS 2019 Project Update

Facilitez votre transition DevOps grâce à l'automatisation de votre infras...

OSDC 2018 - Distributed monitoring

Alfresco Process Services (APS) and the Internet of Things

Introducing GitLab (June 2018)

Continuous Integration & Development with Gitlab

What's New in GitLab and Software Development Trends

Nulab's DevOps tool stack based on AWS

2014-05-gluecon-amplifying-docker

Real-Time Data Processing Pipeline & Visualization with Docker, Spark, Kafka ...

GitOps meets Serverless

有 Firebase 就不用找後端工程師了 (誤)

Swedish SharePoint UserGroup Göteborg Oct 5 2016 SharePoint Framework

From AWS/STUPS to Kubernetes on AWS @Zalando - Berlin Kubernetes Meetup

When to use Serverless? When to use Kubernetes?

E2E Data Pipeline - Apache Spark/Airflow/Livy

React, GraphQL и Relay - вполне себе нормальный компонентный подход (nodkz)

Viewers also liked

Using the latest advancements from TensorFlow including the Accelerated Linear Algebra (XLA) Framework, JIT/AOT Compiler, and Graph Transform Tool, I’ll demonstrate how to optimize, profile, and deploy TensorFlow Models in GPU-based production environment. This talk is contains many Spark ML and TensorFlow AI demos using PipelineIO's 100% Open Source Community Edition. All code and Docker images are available to reproduce on your own CPU or GPU-based cluster. Chris Fregly is Founder and Research Engineer at PipelineIO, a Streaming Machine Learning and Artificial Intelligence Startup based in San Francisco. He is also an Apache Spark Contributor, a Netflix Open Source Committer, founder of the Global Advanced Spark and TensorFlow Meetup, author of the O’Reilly Training and Video Series titled, "High Performance TensorFlow in Production." Previously, Chris was a Distributed Systems Engineer at Netflix, a Data Solutions Engineer at Databricks, and a Founding Member and Principal Engineer at the IBM Spark Technology Center in San Francisco. https://www.meetup.com/TensorFlow-Chicago/events/240267321/ https://www.meetup.com/Advanced-Spark-and-TensorFlow-Meetup/events/240587698/ http://pipeline.io https://github.com/fluxcapacitor/pipeline

High Performance Distributed TensorFlow with GPUs - TensorFlow Chicago Meetup...

Deploy Spark ML and Tensorflow AI Models from Notebooks to Microservices - Nov 16 2016 - Madrid

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Deploy Spark ML and Tensorflow AI Models from Notebooks to Microservices - Nov 16 2016 - Madrid

Similar to Deploy Spark ML and Tensorflow AI Models from Notebooks to Microservices - Nov 16 2016 - Madrid (20)

More from Chris Fregly

More from Chris Fregly (20)

Recently uploaded

Recently uploaded (20)

Deploy Spark ML and Tensorflow AI Models from Notebooks to Microservices - Nov 16 2016 - Madrid