2016 Tableau in the Cloud - A Netflix Original (AWS Re:invent)

•Download as PPTX, PDF•

6 likes•1,395 views

Building a data platform doesn’t have to be like entering a portal to Stranger Things. Join us in one hour for Tableau in the Cloud: A Netflix Original where Albert Wong, Netflix’s analytics expert, will show you how to simplify your data stack to deliver self-service analytics at scale. Albert will discuss the details of connecting to big data, finding datasets, and discovering critical insights from visualizations. He will also share how Netflix is developing and growing their analytics ecosystem with Tableau, and how they prioritize sustaining their data culture of freedom and responsibility.

Data & Analytics

Tableau in the Cloud:
A Netflix Original
Albert Wong - Enterprise Reporting Platform

● Carnegie Mellon Alum
● 2005 - Introduced to BI
● 2011 - Started Netflix
My Background

Metrics
93 million members
125 hours/day
190 countries

@netflixdata
Data Platform
Data Engineering Data Science
Hadoop, Hive, Pig
Spark
Presto
Teradata
Amazon Redshift
Druid
MicroStrategy
Tableau
D3
R
Jupyter
Zeppelin
S3
Python
Portal
Data Pipelines
Visualizations
Metrics
A/B Testing
Algorithms Research
Machine Learning

Netflix Culture
● Freedom and responsibility
● Loosely coupled, highly aligned
● Context over control
Google Search: Netflix Culture Deck

Data Platform
events data
operations data
data processors
fast storage data viz
data
exploration
data services
kragle
metacat
portal
Amazon S3
Amazon Redshift

Specialized Data Storage
Amazon Redshift

Data Platform Tech Summary
●Culture
●Cloud
●Scalability
●Developmen
t

A Closer Look
● User Account Management
● Emails
● Navigation
● Big Data
● Governance

redirect
identify
signup flow
authenticate
add
no account error
redirect
Account Management

Connecting to BIG Data
Amazon Redshift
Tableau data
extract
Netflix + Tableau API

Governance
Tableau data
extract
Netflix + Tableau API
Netflix SQL Repository
ETL
Users

@albertcwong
@netflixdata
jobs.netflix.com
Resources

What's hot

Getting It Right Exactly Once: Principles for Streaming Architectures

SingleStore

Insnap, a hyper-personalized ML-based platform acquired by The Honest Company, has been used to build a real-time data platform based on Apache Spark, Cassandra and Redshift. Users’ behavioral and transactional data have been used to build data models and ML models, and to drive use cases for marketing, growth, finance and operations. Learn how Honest Company has used Spark as a workhorse for 1) collecting, ETL and storing data from various sources including mysql, mongo, jde, Google analytics, Facebook, Localytics and REST API; 2) building data models and aggregating and generating reports of revenue, order fulfillment tracking, data pipeline monitoring and subscriptions; 3) Using ML to build model for user acquisitions, LTV and recommendations use cases. Spark replaced the monolithic codebase with flexible, scalable and robust pipelines. Databricks helped The Honest Company to focus on data instead of maintaining infrastructure. While Honest users got delightful recommendations to improve experience, data users at Honest understood users much better in terms of segmenting with behavioral information and advanced ML models, leading to increased revenue and retention.

Leveraging Spark to Democratize Data for Omni-Commerce with Shafaq Abdullah

Databricks

In-Memory Computing Webcast. Market Predictions 2017

SingleStore

Life occurs in real-time, and not surprisingly, more solutions are being built using streaming technologies. Event-based architectures are becoming the norm, and customers are expecting immediate access to their data. This new world offers many exciting opportunities, but also some new challenges. What do you do when your streaming data is not complete? What if it relies on another data source? Does the dependent data exist yet, and does it come from a 3rd party? How do we merge a complete picture of data when data is sourcing from multiple places at the same time? A new norm in the world of distributed services. Join us as we dive deep into the technical details around these scenarios and more. Expect to learn about stream-stream joins, enriching stream data using local or remote data, and ways to anticipate and correct errors within the stream. Leave with a better understanding of managing data dependencies within a Spark Structured Streaming application.

Life is but a Stream

Databricks

Real-Time, Geospatial, Maps by Neil Dahlke

SingleStore

Cloud Connect 2012, Big Data @ Netflix

Jerome Boulon

Vulnerabilities such as Spectre and Meltdown continue to plague many production servers, based on Intel CPUs. Our solution involves software-based monitoring of hardware counters and sending that data to Apache Spark clusters for threat detection. We leverage Spark's support for support vector machine (SVM) inference. Our machine learning models are trained off-line by a data scientist within a Jupyter notebook environment. As new models are validated, they can be easily deployed to the Spark cluster from the notebook. We have standardized model export and import using the ONNX machine learning open file format. In our presentation, we will demo the full pipeline, from model training to deployment. We will discuss the various challenges when deploying ML-based cyber-threat detection at scale using Apache Spark. For example, we found that gaps in detection can occur when Spark models are updated. We will describe a novel data ingestion architecture, based on Apache Kafka, that we developed to deal with this issue.

Scaling ML-Based Threat Detection For Production Cyber Attacks

Databricks

PixieDust is a new open source library that helps data scientists and developers working in Jupyter Notebooks and Apache Spark be more efficient. PixieDust speeds up data manipulation and display with features like: auto-visualization of Spark DataFrames, real-time Spark job progress monitoring, automated local install of Python and Scala kernels running with Spark, and much more. Come along and learn how you can use this tool in your own projects to visualize and explore data effortlessly with no coding. Oh, and if you prefer working with a Scala Notebook, this session is also for you, as PixieDust can also run on a Scala Kernel. Imagine being able to visualize your favorite Python chart engines from a Scala Notebook! We’ll finish the session with a demo combining Twitter, Watson Tone Analyzer, Spark Streaming, and some fun real-time visualizations–all running within a Notebook.

Taking Jupyter Notebooks and Apache Spark to the Next Level PixieDust with Da...

Databricks

Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can Speed up the World" Bio: Ronan Corkery is a kdb+ engineer who has been working with Kx and First Derivatives for the past 4 years. Currently based in Total Gas and Power he spent his first 2 year working with Morgan Stanley. Abstract: Ronan's presentation will focus on the vertical industries the formally only finance based technologies Kx offers has been moving into. He will present proven solutions as well as introducing the overall architecture that Kx uses as well as laying out potential opportunities to work with Kx.

Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...

Maya Lumbroso

Building Real-Time Data Pipelines with Kafka, Spark, and MemSQL

SingleStore

In the on-demand economy real-time analytics is both a necessity and a competitive advantage. The next evolution in the on-demand economy is in predictive analytics fueled by live streams of data—in effect knowing what customers want before they do. This session will feature technical examples of real-time pipelines, machine learning, and custom dashboards as well as off-the-shelf dashboards with Tableau.

CTO View: Driving the On-Demand Economy with Predictive Analytics

SingleStore

Netflix is a famously data-driven company. Data is used to make informed decisions on everything from content acquisition to content delivery, and everything in-between. As with any data-driven company, it’s critical that data used by the business is accurate. Or, at worst, that the business has visibility into potential quality issues as soon as they arise. But even in the most mature data warehouses, data quality can be hard. How can we ensure high quality in a cloud-based, internet-scale, modern big data warehouse employing a variety of data engineering technologies? In this talk, Michelle Ufford will share how the Data Engineering & Analytics team at Netflix is doing exactly that. We’ll kick things off with a quick overview of Netflix’s analytics environment, then dig into the architecture of our current data quality solution. We’ll cover what worked, what didn’t work so well, and what we're working on next. We’ll conclude with some tips & lessons learned for ensuring high quality on big data. This talk was presented at DataWorks/Hadoop Summit 2017 on June 13, 2017.

Scaling Data Quality @ Netflix

Michelle Ufford

HP ships millions of PCs, Printers, and other devices every year to customers in all market segments. More customers are seeking services provided with our products enabling new opportunities for HP to create services from the data we can collect from our devices. Every device we ship is an IoT endpoint with powerful CPU to capture rich data. Insights from this data are used internally to improve our products and focus on customer needs. In this presentation, John will focus on HP’s journey to enabling Big Data analytics from within a large enterprise environment. He will review the challenges and how HP decided on AWS, Apache Spark and Databricks as the foundation for their entry into Big Data Analytics. John will also review how HP uses Spark to build analytic services from the data they generate from their devices.

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Spark Summit

How did Devon move from a traditional reporting and data warehouse approach to a modern data lake? What did it take to go from a slow and brittle technical landscape to an a flexible, scalable, and agile platform? In the past, Devon addressed data solutions in dozens of ways depending on the user and the requirements. Through a visionary program, driven by Databricks, Devon has begun a transformation of how it consumes data and enables engineers, analysts, and IT developers to deliver data driven solutions along all levels of the data analytics spectrum. We will share the vision, technical architecture, influential decisions, and lessons learned from our journey. Join us to hear the unique Databricks success story at Devon.

Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...

Databricks

Organizations with on-premises Hadoop infrastructure are bogged down by system complexity, unscalable infrastructure, and the increasing burden on DevOps to manage legacy architectures. Costs and resource utilization continue to go up while innovation has flatlined. In this session, you will learn why, now more than ever, enterprises are looking for cloud alternatives to Hadoop and are migrating off of the architecture in large numbers. You will also learn how elastic compute models’ benefits help one customer scale their analytics and AI workloads and best practices from their experience on a successful migration of their data and workloads to the cloud.

Modernizing to a Cloud Data Architecture

Databricks

Netflix will spend roughly 19B+ on content in 2021 over 100 countries to entertain over 200M subscribers. With this scale of investment in internationalized productions, it is essential to intelligently invest and track the movement of cash, in near-real-time, from pre-production to launch. This involves complex near real time financial calculations, data movement, consistent data views of transactional data of the present and the cash predictions of the future. It needs exactly once processing semantics and idempotency while guaranteeing a low latency serving layer. We leverage kafka to build a scalable and fault tolerance event-based processing engine to provide the right SLA guarantees. We also embrace event-driven data materialization to provide low latency lookups at scale. The aim of this talk is to provide an insight into how we built such a scalable system while embracing a full blown Kappa architecture, with Kafka at the heart of it all.

Money Heist - A Stream Processing Original! | Meha Pandey and Shengze Yu, Net...

HostedbyConfluent

As big data technology matures, you’d think there would be more talent available to hire. Although the number of people interested and engaged in the big data world has dramatically increased, job demand is far ahead. Companies like Google or Facebook have access to the best talent — thousands of engineers with PhDs from the best schools, which is why they are able to innovate. How can a company close the skills gap while innovating and creating product advantage? This talk highlights how the right technology can allow you to compete without having an army of PhDs at your disposal. At iPass, we’ve created an environment where our engineers can be empowered to create value without getting bogged down by big data and Ops challenges. As a result, we have been able to more easily recruit internal engineers to our big data team, leveraging their current expertise, while bringing them up to speed on big data projects much faster. Join this talk to learn how you can do the same for your organization.

How Apache Spark Changed the Way We Hire People with Tomasz Magdanski

Databricks

Around the world, businesses are turning to AI to transform the way they operate and serve their customers. But before they can implement these technologies, companies must address the roadblock of moving from batch analytics to making real-time decisions by rapidly accessing and analyzing the relevant information amidst a sea of data. Yaron will explain how to make Spark handle multivariate real-time, historical and event data simultaneously to provide immediate and intelligent responses. He will present several time sensitive use-cases including fraud detection, prevention of outages and customer recommendations to demonstrate how to perform predictive analytics and real-time actions with Spark. Speaker: Yaron Ekshtein

Real-Time Analytics and Actions Across Large Data Sets with Apache Spark

Databricks

No sql and sql - open analytics summit

Open Analytics

Zillow's favorite big data & machine learning tools

njstevens

What's hot (20)

Getting It Right Exactly Once: Principles for Streaming Architectures

Leveraging Spark to Democratize Data for Omni-Commerce with Shafaq Abdullah

In-Memory Computing Webcast. Market Predictions 2017

Life is but a Stream

Real-Time, Geospatial, Maps by Neil Dahlke

Cloud Connect 2012, Big Data @ Netflix

Scaling ML-Based Threat Detection For Production Cyber Attacks

Taking Jupyter Notebooks and Apache Spark to the Next Level PixieDust with Da...

Ronan Corkery, kdb+ developer at Kx Systems: “Kdb+: How Wall Street Tech can ...

Building Real-Time Data Pipelines with Kafka, Spark, and MemSQL

CTO View: Driving the On-Demand Economy with Predictive Analytics

Scaling Data Quality @ Netflix

Unlocking Value in Device Data Using Spark: Spark Summit East talk by John La...

Transforming Devon’s Data Pipeline with an Open Source Data Hub—Built on Data...

Modernizing to a Cloud Data Architecture

Money Heist - A Stream Processing Original! | Meha Pandey and Shengze Yu, Net...

How Apache Spark Changed the Way We Hire People with Tomasz Magdanski

Real-Time Analytics and Actions Across Large Data Sets with Apache Spark

No sql and sql - open analytics summit

Zillow's favorite big data & machine learning tools

Viewers also liked

Netflix - Enabling a Culture of Analytics

Blake Irvine

Cloud Native: A dose of reality

Donnie Berkholz

SV Forum Platform Architecture SIG - Netflix Open Source Platform

Adrian Cockcroft

MessageBus vs MessageBus

Nguyen Trung Kien

Reactive applications are becoming a de-facto industry standard and, if employed correctly, toolkits like Lightbend Reactive Platform make the implementation easier than ever. But the design of these systems might be challenging as it requires particular mindset shift to tackle problems we might not be used to. In this talk, we’re going to discuss the most common things I’ve seen in the field that prevented applications to work as expected. I’d like to talk about typical pitfalls that might cause troubles, about trade-offs that might not be fully understood or important choices that might be overlooked including persistent actors pitfalls, tackling of network partitions, proper implementations of graceful shutdown or distributed transactions, trade-offs of micro-services or actors and more. This talk should be interesting for anyone who is thinking about, implementing, or have already deployed a reactive application. My goal is to provide is to provide a comprehensive explanation of common problems to be sure they won’t be repeated by fellow developers. The talk is a little bit more focused on Lightbend platform but the understanding of the concepts we are going to talk about should be beneficial for everyone interested in this field.

Top Mistakes When Writing Reactive Applications - Scala by the Bay 2016

Petr Zapletal

Today Netflix is worth $37B and growing. But when the company was started back in 1997, founder Reed Hastings knew he wanted to create a company culture that brought in (and rewarded) the best people for doing great work. To understand the inner workings of the Netflix culture, we have to look beyond the headlines, the share price and the hype and understand what makes the culture tick - without the day-to-day involvement of the founder. Today we'll look at the 10 most critical take aways from everything that's ever been written about the Netflix company culture. If you want happier, more fulfilled employees then pay close attention.

Inside Netflix: The Company Culture That Created a $37B Business

PeopleSpark

SpringOne Platform 2016 Speaker: Casey West; Principal Technologist, Pivotal The value of embracing microservices, containers, and continuous delivery is powerful only when brought together in logical, scalable, and portable ways. When used incorrectly it’s increasingly easy to make things much worse for you and your team, and do it at scale. For example, while microservices can be used to effectively isolate functionality, increase the speed of delivery, and help scale your team it can also be a way to inefficiently duplicate functionality and create single points of failure. I’ll share anti-patterns and corresponding best practices based on my experience building application infrastructure and platforms, as well as the applications which are deployed to them.

The Five Stages of Cloud Native

VMware Tanzu

The Cloud Native Stack

QAware GmbH

Presented by Andrew White and Jesse Kriss at ShmooCon 2017. User Focused Security is an approach we are using to address employee information security at Netflix. If we provide employees with the right information and low-friction tools, we believe they can get their devices into a more secure state without heavy-handed policy enforcement. Letting people retain control over their devices means that they can maintain flexibility and productivity and address security recommendations as appropriate to their levels of access. This approach will only be successful, though, if we can provide clear and specific action, and make it easy to do the right thing. Stethoscope is a web-based tool that gives Netflix employees a view into the security state of their devices, with specific recommendations regarding disk encryption, firewalls, and other device settings. The website, in conjunction with email alerts, gives Netflix employees a straightforward way to see what actions they should take to remain safe. Andrew White and Jesse Kriss are both members of the Information Security team at Netflix, where they work on designing and building software tools that help people make good decisions around corporate security. Andrew holds a PhD in Computer Science from the University of North Carolina at Chapel Hill and a B.S. in Computer Science and B.A. in Mathematics from the University of Richmond. Jesse (@jkriss) holds a Master’s in Human-Computer Interaction from Carnegie Mellon University and B.A. in Music from Carleton College. Prior to Netflix, he worked at NASA/JPL, Obama 2012, Figure 53, and IBM Research.

User Focused Security at Netflix: Stethoscope

Jesse Kriss

In this talk, Kenny Bastani will introduce you to Spring Cloud, a set of tools for building cloud-native JVM applications. We will take a look at some of the common patterns for microservice architectures and how to use Cloud Foundry to deploy multiple microservices to the cloud. We will also dive into a microservices example project of a cloud-native application built using Spring Boot and Spring Cloud. Using this example project, I'll show you how to use Cloud Foundry to spin up a microservice cluster. We will then explore what a cloud-native application looks like when using self-describing REST APIs that link multiple microservices together.

Cloud Native Java Microservices

Kenny Bastani

Lagom is a new framework for Java designed with microservices in mind. It aims to simplify the process of building microservice-based systems that communicate asynchronously, self-heal, scale elastically and remain responsive under load and under failure. Many of the challenges of microservices are caused by the fact we use tools designed without them in mind. So, how can a framework made to build systems composed of microservices from the start offer us a better solution? Because Lagom is a tool that is highly opinionated and explicitly designed to make development and production with microservices easy, it brings back all the fun and productivity into programming while still enabling you to build a reactive, distributed, highly scalable and rock solid application. By the end of this presentation, you'll have experienced first hand how creating systems of microservices on the JVM using Lagom is dead-simple, intuitive, frictionless and a lot of fun! And we’ll ask whether reactive microservices are potentially so much better than, for example, Java EE? DevoxxUK https://cfp.devoxx.co.uk/2016/talk/UZA-8885/Taking_the_friction_out_of_microservice_frameworks_with_Lagom

Taking the friction out of microservice frameworks with Lagom

Markus Eisele

DevNexus 2017 Microservices-based architectures are en-vogue. The last couple of years we have learned how the thought-leaders implement them, and every other week we have heard about how containers and Platform-as-a-Service offerings make them ultimately happen. The problem is that the developers are almost forgotten and left alone with provisioning and continuous delivery systems, containers and resource schedulers, and frameworks and patterns to help slice existing monoliths. How can we get back in control and efficiently develop them without having to provision complete production-like environments locally, by hand? All the new buzzwords, frameworks, and hyped tools have made us forget ourselves—Java developers–and what it means to be productive and have fun building systems. The problem that we set out to solve is: how can we run real-world Microservices-based systems on our local development machines, managing provisioning, and orchestration of potentially hundreds of services directly from a single command line tool, without sacrificing productivity enablers like hot code reloading and instant turnaround time? During this talk, you’ll experience first-hand how much fun it can be to develop large-scale Microservices-based systems. You will learn a lot about what it takes to fail fast and recover and truly understand the power of a fully integrated Microservices development environment.

Stay productive while slicing up the monolith

Markus Eisele

The ability to deliver software is no longer a differentiator. In fact, it is a basic requirement for survival. Companies that embrace cloud native patterns of software delivery will survive; companies that don’t - will not. In this webinar, we will: - Look at the common patterns that distinguish cloud native companies and the architectures that they employ. - Discover that an opinionated platform, one that stretches from the infrastructure all the way to the application framework, rather than ad-hoc automation, is an essential component to an enterprise's cloud native journey. - Show that the combination of Pivotal Cloud Foundry and Spring is the complete cloud native platform. Speaker: Faiz Parkar DIRECTOR OF PRODUCT MARKETING As Director of Product Marketing for Pivotal in the Europe, Middle East and Africa region, Faiz Parkar loves working at the intersection of cloud native platforms, big data/analytics and agile application development to help organisations deliver compelling data-driven software experiences for their customers. With more than 25 years experience in the IT industry, Faiz has helped organisations large and small to take advantage of technology transitions from proprietary systems to client/server, from physical infrastructure to virtual, and from virtual infrastructure to cloud. His mission now is to help organisations accelerate their digital transformation journey and reinvent themselves as the digital leaders of the future.

The Cloud Native Journey

VMware Tanzu

Netflix is the world's leading internet television network. In this presentation, I talk about the aspects of Netflix culture that have contributed to its success. The freedom and responsibility culture, with highly aligned, loosely coupled teams of amazing, enthusiastic, helpful, high performance people with excellent judgement has helped build Netflix to adapt and change quickly, and iterate to make the best service possible. By eliminating rules and processes, and ensuring that employees have the contexts of the business in all aspects, Netflix has enabled employees to use their judgement to get things done rather than relying on control or process. This has resulted in Netflix becoming a leader in not only internet streaming, but also cloud computing, media, and culture. Because of the Netflix culture, we have been able to attract and retain great employees. I give a few examples from my team, Edge Engineering of how the culture enables us to build the high scale, resilient and dynamic services that are the front door to the Netflix streaming application, and how the freedom we have has enabled us to open source core technologies that are needed for large scale, service-oriented architectures in a cloud environment. This slideshow also gives a high level overview of how the streaming service works, and how Netflix's Open Connect Appliance can help ISPs.

Netflix’s Success through Technology and Culture - Andicom 2014

Mikey Cohen - Hiring Amazing Engineers

Modernizing Applications with Microservices

Markus Eisele

Global Netflix Platform

Adrian Cockcroft

The state of sbt 0.13, sbt server, and sbt 1.0 (ScalaMatsuri ver)

Eugene Yokota

Viewers also liked (17)

Netflix - Enabling a Culture of Analytics

Cloud Native: A dose of reality

SV Forum Platform Architecture SIG - Netflix Open Source Platform

MessageBus vs MessageBus

Top Mistakes When Writing Reactive Applications - Scala by the Bay 2016

Inside Netflix: The Company Culture That Created a $37B Business

The Five Stages of Cloud Native

The Cloud Native Stack

User Focused Security at Netflix: Stethoscope

Cloud Native Java Microservices

Taking the friction out of microservice frameworks with Lagom

Stay productive while slicing up the monolith

The Cloud Native Journey

Netflix’s Success through Technology and Culture - Andicom 2014

Modernizing Applications with Microservices

Global Netflix Platform

The state of sbt 0.13, sbt server, and sbt 1.0 (ScalaMatsuri ver)

Similar to 2016 Tableau in the Cloud - A Netflix Original (AWS Re:invent)

4th Industrial Revolution

Rolando Rangel

Thousands of services work in concert to deliver millions of hours of video streams to Netflix customers every day. These applications vary in size, function, and technology, but they all make use of the Netflix network to communicate. Understanding the interactions between these services is a daunting challenge both because of the sheer volume of traffic and the dynamic nature of deployments. In this session, we first discuss why Netflix chose Kinesis Streams to address these challenges at scale. We then dive deep into how Netflix uses Kinesis Streams to enrich network traffic logs and identify usage patterns in real time. Lastly, we cover how Netflix uses this system to build comprehensive dependency maps, increase network efficiency, and improve failure resiliency. From this session, you'll learn how to build a real-time application monitoring system using network traffic logs and get real-time, actionable insights.

How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...

Amazon Web Services

Knowledge Graph for Machine Learning and Data Science

Cambridge Semantics

Data Platform Architecture Principles and Evaluation Criteria

ScyllaDB

Data Platform on GCP

Patrick Alexander

AWS vs Azure vs Google (GCP) - Slides

TobyWilman

Architecting an Open Source AI Platform 2018 edition

David Talby

Delivering business insights and automation utilizing aws data services

Bhuvaneshwaran R

Integrating Web and Business Data

Safe Software

Gimel and PayPal Notebooks @ TDWI Leadership Summit Orlando

Romit Mehta

Today, data lakes are widely used and have become extremely affordable as data volumes have grown. However, they are only meant for storage and by themselves provide no direct value. With up to 80% of data stored in the data lake today, how do you unlock the value of the data lake? The value lies in the compute engine that runs on top of a data lake. Join us for this webinar where Ahana co-founder and Chief Product Officer Dipti Borkar will discuss how to unlock the value of your data lake with the emerging Open Data Lake analytics architecture. Dipti will cover: -Open Data Lake analytics - what it is and what use cases it supports -Why companies are moving to an open data lake analytics approach -Why the open source data lake query engine Presto is critical to this approach

Unlocking the Value of Your Data Lake

DATAVERSITY

Netflix Big Data Paris 2017

Jason Flittner

Data analytics at a petabyte scale final

Ori Reshef

Integrating Web and Business Data

Sterling Geo

Data Lake allows an organisation to store all of their data, structured and unstructured, in one, centralised repository. Since data can be stored as-is, there is no need to convert it to a predefined schema and you no longer need to know what questions you want to ask of your data beforehand. In this session we will explore the architecture of a Data Lake on AWS and cover topics such as storage, processing and security.

Building your Datalake on AWS

Amazon Web Services

Data Con LA 2020 Description Apache Druid is a cloud-native open-source database that enables developers to build highly-scalable, low-latency, real-time interactive dashboards and apps to explore huge quantities of data. This column-oriented database provides the microsecond query response times required for ad-hoc queries and programmatic analytics. Druid natively streams data from Apache Kafka (and more) and batch loads just about anything. At ingestion, Druid partitions data based on time so time-based queries run significantly faster than traditional databases, plus Druid offers SQL compatibility. Druid is used in production by AirBnB, Nielsen, Netflix and more for real-time and historical data analytics. This talk provides an introduction to Apache Druid including: Druid's core architecture and its advantages, Working with streaming and batch data in Druid, Querying data and building apps on Druid and Real-world examples of Apache Druid in action Speaker Matt Sarrel, Imply Data, Developer Evangelist

Apache Druid 101

Data Con LA

A primer on building real time data-driven products

Lars Albertsson

Marketing Data Engineering Team @ Netflix

Nihit Kaul (He/Him)

Intro Presentation at AWS AWSome Day Glasgow September 2015

Ian Massingham

Distributed Data Quality - Technical Solutions for Organizational Scaling

Justin Cunningham

Similar to 2016 Tableau in the Cloud - A Netflix Original (AWS Re:invent) (20)

4th Industrial Revolution

How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...

Knowledge Graph for Machine Learning and Data Science

Data Platform Architecture Principles and Evaluation Criteria

Data Platform on GCP

AWS vs Azure vs Google (GCP) - Slides

Architecting an Open Source AI Platform 2018 edition

Delivering business insights and automation utilizing aws data services

Integrating Web and Business Data

Gimel and PayPal Notebooks @ TDWI Leadership Summit Orlando

Unlocking the Value of Your Data Lake

Netflix Big Data Paris 2017

Data analytics at a petabyte scale final

Integrating Web and Business Data

Building your Datalake on AWS

Apache Druid 101

A primer on building real time data-driven products

Marketing Data Engineering Team @ Netflix

Intro Presentation at AWS AWSome Day Glasgow September 2015

Distributed Data Quality - Technical Solutions for Organizational Scaling

Recently uploaded

Ashok Vihar Call Girls in Delhi (–9953330565) Escort Service In Delhi NCR PROVIDE 100% REAL GIRLS ALL ARE GIRLS LOOKING MODELS AND RAM MODELS ALL GIRLS” INDIAN , RUSSIAN ,KASMARI ,PUNJABI HOT GIRLS AND MATURED HOUSE WIFE BOOKING ONLY DECENT GUYS AND GENTLEMAN NO FAKE PERSON FREE HOME SERVICE IN CALL FULL AC ROOM SERVICE IN SOUTH DELHI Ultimate Destination for finding a High Profile Independent Escorts in Delhi.Gurgaon.Noida..!.Like You Feel 100% Real Girl Friend Experience. We are High Class Delhi Escort Agency offering quality services with discretion. We only offer services to gentlemen people. We have lots of girls working with us like students, Russian, models, house wife, and much More We Provide Short Time and Full Night Service Call ☎☎+91–9953330565 ❤꧂ • In Call and Out Call Service in Delhi NCR • 3* 5* 7* Hotels Service in Delhi NCR • 24 Hours Available in Delhi NCR • Indian, Russian, Punjabi, Kashmiri Escorts • Real Models, College Girls, House Wife, Also Available • Short Time and Full Time Service Available • Hygienic Full AC Neat and Clean Rooms Avail. In Hotel 24 hours • Daily New Escorts Staff Available • Minimum to Maximum Range Available. Location;- Delhi, Gurgaon, NCR, Noida, and All Over in Delhi Hotel and Home Services HOTEL SERVICE AVAILABLE :-REDDISSON BLU,ITC WELCOM DWARKA,HOTEL-JW MERRIOTT,HOLIDAY INN MAHIPALPUR AIROCTY,CROWNE PLAZA OKHALA,EROSH NEHRU PLACE,SURYAA KALKAJI,CROWEN PLAZA ROHINI,SHERATON PAHARGANJ,THE AMBIENC,VIVANTA,SURAJKUND,ASHOKA CONTINENTAL , LEELA CHANKYAPURI,_ALL 3* 5* 7* STARTS HOTEL SERVICE BOOKING CALL Call WHATSAPP Call ☎+91–9953330565❤꧂ NIGHT SHORT TIME BOTH ARE AVAILABLE

Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service

9953056974 Low Rate Call Girls In Saket, Delhi NCR

ALSO dropshipping via API with DroFx.pptx

olyaivanovalion

Anomaly detection and data imputation within time series

Paris Women in Machine Learning and Data Science

Carero dropshipping via API with DroFx.pptx

olyaivanovalion

BabyOno dropshipping via API with DroFx.pptx

olyaivanovalion

Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand Booking Contact Details :- WhatsApp Chat :- +91-7737669865 Call Girls In Model Towh +91-7737669865 !! Best Woman Seeking Man Call Girls Service, Escorts Service in Home Hotel in NCR 24 Hours Available Service Call Girls, Contact Us +91-7737669865 (Any Time. Any Where) Call Girls in , Noida, Gurgaon, Ghaziabad,Sexy Indian Female Escorts Service NCRWelcome To Escorts Service – An All Over New Very Sexy Hot Call Girls Agency Service Escorts In South NCR’s No. 1 High Profile Independent Female Escorts Service. We Provide Good Quality Educated Profile At #K09 Very Regnebal Price 100% Safe And Original.We Are Provide Escorts Service All OYO Hotels ,3*,4*,5* Star Hotel And Home Flat, Apartment. Guest-House. Services In -Call And Out – Call Both Are Services Available. 24Hrs. Any Time Any Where. In All Over Noida Gurgaon Ghaziabad Faridabad.More Information And Contact Profile Real Pic Visit Our Website City Wise Escorts Service Agency.Good Looking Cheap And Best Models Girls U Can Get Best Click On Link……Night Call Girls Now In Hotel Le Meridien Gurgaon Near Female Escort One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7737669865 We are available 24*7 all days of the year. Call us — 7737669865 Thank you for Visiting.

Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand

amitlee9823

Week-01-2.ppt BBB human Computer interaction

fulawalesam

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service

Delhi Call girls

Ravak dropshipping via API with DroFx.pptx

olyaivanovalion

Halmar dropshipping via API with DroFx

olyaivanovalion

Midocean dropshipping via API with DroFx

olyaivanovalion

Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore Escorts Service Booking Contact Details :- WhatsApp Chat :- +91-7737669865 4-May-2024(SMW) Call Girls In Model Towh +91-7737669865 !! Best Woman Seeking Man Call Girls Service, Escorts Service in Home Hotel in NCR 24 Hours Available Service Call Girls, Contact Us +91-7737669865 (Any Time. Any Where) Call Girls in , Noida, Gurgaon, Ghaziabad,Sexy Indian Female Escorts Service NCRWelcome To Escorts Service – An All Over New Very Sexy Hot Call Girls Agency Service Escorts In South NCR’s No. 1 High Profile Independent Female Escorts Service. We Provide Good Quality Educated Profile At Very Regnebal Price 100% Safe And Original.We Are Provide Escorts Service All OYO Hotels ,3*,4*,5* Star Hotel And Home Flat, Apartment. Guest-House. Services In -Call And Out – Call Both Are Services Available. 24Hrs. Any Time Any Where. In All Over Noida Gurgaon Ghaziabad Faridabad.More Information And Contact Profile Real Pic Visit Our Website City Wise Escorts Service Agency.Good Looking Cheap And Best Models Girls U Can Get Best Click On Link……Night Call Girls Now In Hotel Le Meridien Gurgaon Near Female Escort One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7737669865 We are available 24*7 all days of the year. Call us — 7737669865 Thank you for Visiting.

Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...

amitlee9823

Mature dropshipping via API with DroFx.pptx

olyaivanovalion

Discover Why Less is More in B2B Research

michael115558

April 2024 - Crypto Market Report's Analysis

manisha194592

Gen AI on Enterprise Cloud Apache NiFi Milvus Apache Kafka Apache Flink Cloudera Machine Learning Cloudera DataFlow https://medium.com/@tspann/building-a-milvus-connector-for-nifi-34372cb3c7fa https://www.meetup.com/futureofdata-princeton/events/300737266/ https://lu.ma/q7pcfyjn?source=post_page-----34372cb3c7fa--------------------------------&tk=TTyakY If you're interested in working with Generative AI on the cloud, this virtual workshop is for you. Tim Spann from Cloudera and Yujian Tang from Zilliz will cover how you can implement your own GenAI workflows on the cloud at enterprise scale. 9:00 - 9:05: Intro 9:05 - 9:15: What is Milvus 9:15 - 9:25: Cloudera Development Platform 9:25 - 10:00: Demo Location https://www.youtube.com/watch?v=IfWIzKsoHnA https://github.com/tspannhw/SpeakerProfile https://www.linkedin.com/in/yujiantang/

Generative AI on Enterprise Cloud with NiFi and Milvus

Timothy Spann

Digital advertising, or paid media, encompasses the strategic deployment of online advertisements to reach target audiences efficiently and effectively. This includes any digital platform that supports advertising to deliver unique messages for any objective. Understanding the mechanics of digital advertising platforms, along with insights into audience behaviors and preferences, allows marketers to optimize their ad spend and achieve significant engagement and conversion rates. This lecture is for Advanced Digital & Social Media Strategy (MGMTX 466.05) at UCLA Extension.

Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...

Valters Lauzums

VidaXL dropshipping via API with DroFx.pptx

olyaivanovalion

(NEHA) Call Girls Katra Call Now: 8617697112 Katra Escorts Booking Contact Details WhatsApp Chat: +91-8617697112 Katra Escort Service includes providing maximum physical satisfaction to their clients as well as engaging conversation that keeps your time enjoyable and entertaining. Plus, they look fabulously elegant, making an impression. Independent Escorts Katra understands the value of confidentiality and discretion; they will go the extra mile to meet your needs. Simply contact them via text messaging or through their online profiles; they'd be more than delighted to accommodate any request or arrange a romantic date or fun-filled night together. We provide:

(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7

Call Girls in Nagpur High Profile Call Girls

Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore Escorts Service Booking Contact Details :- WhatsApp Chat :- +91-7737669865 2-May-2024(SMW) Call Girls In Model Towh Bangalore +91-7737669865 !! Best Woman Seeking Man Call Girls Service, Escorts Service in Home Hotel in Bangalore NCR 24 Hours Available Service Call Girls, Contact Us +91-7737669865 (Any Time. Any Where) Call Girls in Bangalore, Noida, Gurgaon, Ghaziabad,Sexy Indian Female Escorts Service Bangalore NCRWelcome To Bangalore Escorts Service – An All Over New Bangalore Very Sexy Hot Call Girls Agency Service Escorts In South BangaloreNCRBangalore’s No. 1 High Profile Independent Female Escorts Service. We Provide Good Quality Educated Profile At Very Regnebal Price 100% Safe And Original.We Are Provide Escorts Service All OYO Hotels ,3*,4*,5* Star Hotel And Home Flat, Apartment. Guest-House. Services In -Call And Out – Call Both Are Services Available. 24Hrs. Any Time Any Where. In All Over Bangalore Noida Gurgaon Ghaziabad Faridabad.More Information And Contact Profile Real Pic Visit Our Website City Wise Escorts Service Agency.Good Looking Cheap And Best Models Girls U Can Get Best Click On Link……Night Call Girls Now In Hotel Le Meridien Gurgaon Near Female Escort One Shot — 5000/in call (time 1 hour), 6000/out call Two shot with one girl — 8000/in call (time 2 hour), 10000/out call Body to body massage with sex- 8000/in call (time 1 hour) Full night Service for one person– 12000/in call, 13000/out call (shot limit 3-4 shots) Full night Service for more than 1 person — please contact Us —7737669865 We are available 24*7 all days of the year. Call us — 7737669865 Thank you for Visiting.

Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...

amitlee9823

Recently uploaded (20)

Call Girls In Shalimar Bagh ( Delhi) 9953330565 Escorts Service

ALSO dropshipping via API with DroFx.pptx

Anomaly detection and data imputation within time series

Carero dropshipping via API with DroFx.pptx

BabyOno dropshipping via API with DroFx.pptx

Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand

Week-01-2.ppt BBB human Computer interaction

BDSM⚡Call Girls in Mandawali Delhi >༒8448380779 Escort Service

Ravak dropshipping via API with DroFx.pptx

Halmar dropshipping via API with DroFx

Midocean dropshipping via API with DroFx

Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...

Mature dropshipping via API with DroFx.pptx

Discover Why Less is More in B2B Research

April 2024 - Crypto Market Report's Analysis

Generative AI on Enterprise Cloud with NiFi and Milvus

Digital Advertising Lecture for Advanced Digital & Social Media Strategy at U...

VidaXL dropshipping via API with DroFx.pptx

(NEHA) Call Girls Katra Call Now 8617697112 Katra Escorts 24x7

Junnasandra Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore...

2016 Tableau in the Cloud - A Netflix Original (AWS Re:invent)

1. Tableau in the Cloud: A Netflix Original Albert Wong - Enterprise Reporting Platform

2. ● Carnegie Mellon Alum ● 2005 - Introduced to BI ● 2011 - Started Netflix My Background

3. Metrics 93 million members 125 hours/day 190 countries

4. @netflixdata Data Platform Data Engineering Data Science Hadoop, Hive, Pig Spark Presto Teradata Amazon Redshift Druid MicroStrategy Tableau D3 R Jupyter Zeppelin S3 Python Portal Data Pipelines Visualizations Metrics A/B Testing Algorithms Research Machine Learning

5. Netflix Culture ● Freedom and responsibility ● Loosely coupled, highly aligned ● Context over control Google Search: Netflix Culture Deck

7. Data Platform events data operations data data processors fast storage data viz data exploration data services kragle metacat portal Amazon S3 Amazon Redshift

8. Single Data Warehouse Amazon S3

9. Accessing Data Warehouse

10. Specialized Data Storage Amazon Redshift

11. Visualizing Data

12. Connecting to Data Amazon Redshift

13. Data Platform Tech Summary ●Culture ●Cloud ●Scalability ●Developmen t

14. A Closer Look ● User Account Management ● Emails ● Navigation ● Big Data ● Governance

15. Distinguishing Desktop and Server

16. Account Management

17. + REST API Account Management

18. redirect identify signup flow authenticate add no account error redirect Account Management

19. Emailing