Design for X: Exploring Product Design with Apache Spark and GraphLab

•

1 gostou•295 visualizações

Ideas for designing data science products for: bots, knowledge gaps, IOT + fairness. Combining elements from Apache Spark and Turi's GraphLab products.

Software

DESIGN FOR X
exploring data science product design with apache spark + graphlab {create}
@amcasari @Concur
data science summit 2016, san francisco
nasa

data science via random walks
senior product mgr +
data scientist
@ Concur Labs
control systems
engineering +
robotics + legos
officer in USN
operations research
analyst
wandering dirtbag +
conservation volunteer
EE +
applied math
+ complex systems
underwater robotics
engineer
technology
consultant
SAHM

INSANELY QUICK INTRO TO +
➤ Concur Accelerator Team
➤ Concur Labs
➤ Incubator (still brewing)
850K
Users log into Concur
300K
Expense reports
processed
120K
Trips booked
170M
Trips & expense
reports warehoused
Typical Day at Concur
How do we encourage a culture of innovation
while delivering quality service to our existing
33,000 business clients and 40M users?

DESIGN SPRINTS FOR DATA SCIENCEY PROTOTYPES
courtesy google ventures {we iterated…because data}

INSANELY QUICK INTRO TO
➤ “fast and general engine for large-scale data processing”
➤ advanced cyclic data ﬂow and in-memory computing > runs
10x-100x faster than Hadoop MR
➤ interactive shells in several languages (incl. SQL)
➤ performant + scalable
courtesy databricks

ALMOST AS INSANELY QUICK INTRO TO +
➤ graphlab create is based on a python data science library
developed + (some) os’d by turi
➤ SFrame <<>> Spark DataFrame | SparkRDD
➤ (yes it works with Open Source SFrame and GLC)
courtesy turi

WHAT PROBLEM DO WE WANT TO DATA SCIENCE?
Knowledge
Gaps
IOT
Networks
Bots
Fairness
+

➤ “We could {build this} {answer this better} if….”
➤ Reciprocal Data Applications
DESIGN FOR KNOWLEDGE GAPS
rda rdarda
choose
your data
storage
choose
your data
storage
choose
your data
storage
the app you
really
want to make

➤ “Can we trust our sensors?”
➤ “Has our network been hacked?”
DESIGN FOR IOT NETWORKS
device
device
device
alerts,
notifications,
monitoring
dashboards
data
services
Anomaly Detection Toolkit
TimeSeries <<>> SFrame

➤ “How do we create a conversational interface?”
….nothing new, just the burning question since Turing, 1950
DESIGN FOR BOTS
what NOT to do….
non-creepy
unisex
animal mascot
conversational
ui
choose
or
create
your
framework
choose your data storage
Advanced Deep Learning
Text Analysis Toolkit
Graph Analytics Toolkit

➤ know your biases + limitations
➤ in your data, their data, all the data
➤ in your feature selection
➤ in your algorithm
…..because ethics (these ALL bias your results + communications)
DESIGN FOR FAIRNESS
learn more at data & society’s case studies
+ +
open source. reproducible. transparent.

{THANKS MUCH}
➤ Concur is hiring!
➤ SAP + SAP Ariba are
hiring!
concurlabs.com
github.com/
concurlabs
➤ example notebooks will
be posted on our
github in the future
@amcasari

Mais conteúdo relacionado

Mais procurados

The Business Economics and Opportunity of Open Source Data Science

Revolution Analytics

Insnap, a hyper-personalized ML-based platform acquired by The Honest Company, has been used to build a real-time data platform based on Apache Spark, Cassandra and Redshift. Users’ behavioral and transactional data have been used to build data models and ML models, and to drive use cases for marketing, growth, finance and operations. Learn how Honest Company has used Spark as a workhorse for 1) collecting, ETL and storing data from various sources including mysql, mongo, jde, Google analytics, Facebook, Localytics and REST API; 2) building data models and aggregating and generating reports of revenue, order fulfillment tracking, data pipeline monitoring and subscriptions; 3) Using ML to build model for user acquisitions, LTV and recommendations use cases. Spark replaced the monolithic codebase with flexible, scalable and robust pipelines. Databricks helped The Honest Company to focus on data instead of maintaining infrastructure. While Honest users got delightful recommendations to improve experience, data users at Honest understood users much better in terms of segmenting with behavioral information and advanced ML models, leading to increased revenue and retention.

Leveraging Spark to Democratize Data for Omni-Commerce with Shafaq Abdullah

Databricks

PixieDust is a new open source library that helps data scientists and developers working in Jupyter Notebooks and Apache Spark be more efficient. PixieDust speeds up data manipulation and display with features like: auto-visualization of Spark DataFrames, real-time Spark job progress monitoring, automated local install of Python and Scala kernels running with Spark, and much more. Come along and learn how you can use this tool in your own projects to visualize and explore data effortlessly with no coding. Oh, and if you prefer working with a Scala Notebook, this session is also for you, as PixieDust can also run on a Scala Kernel. Imagine being able to visualize your favorite Python chart engines from a Scala Notebook! We’ll finish the session with a demo combining Twitter, Watson Tone Analyzer, Spark Streaming, and some fun real-time visualizations–all running within a Notebook.

Taking Jupyter Notebooks and Apache Spark to the Next Level PixieDust with Da...

Databricks

Big data-science-oanyc

Open Analytics

Spark has established itself as the most popular platform for advanced scale-out analytical applications. It is deeply integrated with the Hadoop ecosystem, offers a set of powerful libraries and supports both Python and R. Because of these reasons Data Scientists have started to adopt Spark to train and deploy their models. When Spark 1.4 was released back in 2015, it included the new SparkR library: this API gave R users the exciting new option to run R code on Spark. And while the initial promise to provide a full R environment in Spark has been kept, it takes a deeper understanding of SparkR’s inner workings to make optimal use of its capabilities. This talk will give a comprehensive update on where we stand with Data Science applications in R based on the latest Spark releases. We will share insights from both a Startup solution and a Fortune 100 company where SparkR does Machine Learning in the Cloud on a scale that would have not been feasible previously: it’s parallel execution model runs in minutes and hours whereas conventional sequential approaches would take days and months. Suggested Topics: • An update on the SparkR architecture in the latest Spark release: using R with SparkSQL, MLlib and Spark’s Structured Streaming • How to handle practical challenges, e.g. running R on the cluster without a local installation, storing non-tabular results, such as Data Science models or plots, mixing Scala and R. • Scaling Big Compute Applications with SparkR: Parallelizing SparkR applications with User-Defined Functions (UDFs) and elastic scaling of resources in the Cloud • An Outlook on Machine Learning with SparkR and its ecosystem, frameworks and tools. • Plus: “Do I need to learn Python?”

An Update on Scaling Data Science Applications with SparkR in 2018 with Heiko...

Databricks

Slides from the Big Data Gurus meetup at Samsung R&D, August 14, 2013 This presentation covers the high level architecture of the Netflix Data Platform with a deep dive into the architecture, implementation, use cases, and future of Lipstick (https://github.com/Netflix/Lipstick) - our open source tool for graphically analyzing and monitoring the execution of Apache Pig scripts. Netflix uses Apache Pig to express many complex data manipulation and analytics workflows. While Pig provides a great level of abstraction between MapReduce and data flow logic, once scripts reach a sufficient level of complexity, it becomes very difficult to understand how data is being transformed and manipulated across MapReduce jobs. To address this problem, we created (and open sourced) a tool named Lipstick that visualizes and monitors the progress and performance of Pig scripts.

Putting Lipstick on Apache Pig at Netflix

Jeff Magnusson

Are we reaching a Data Science Singularity? How Cognitive Computing is emergi...

Big Data Spain

Analyzing Data With Python

Sarah Guido

Slides from Michelle Ufford's Data Warehousing talk at Hadoop Summit 2015. How can we take advantage of the veritable treasure trove of data stored in Hadoop to augment our traditional data warehouses? In this session, Michelle will share her experience with migrating GoDaddy’s data warehouse to Hadoop. She’ll explore how GoDaddy has adapted traditional data warehousing methodologies to work with Hadoop and will share example ETL patterns used by her team. Topics will also include how the integration of structured and unstructured data has exposed new insights, the resulting business impact, and tips for making your own Hadoop migration project more successful. Recording available here: https://www.youtube.com/watch?v=0AxoB-wJcZc

Data Warehousing Patterns for Hadoop

Michelle Ufford

JanusGraph: Looking Backward and Reaching Forward - by Jason Plurad (@pluradj): The JanusGraph project started at the Linux Foundation earlier this year, but it is not the new kid on the block. We'll start with a look at the origins and evolution of this open source graph database through the lens of a few IBM graph use cases. We'll discuss the new features in latest release of JanusGraph, and then take a look at future directions to explore together with the open community.

Janus graph lookingbackwardreachingforward

Demai Ni

Magellen: Geospatial Analytics on Spark by Ram Sriharsha

Spark Summit

Building Better Analytics Workflows (Strata-Hadoop World 2013)

Wes McKinney

Given at Data Day Seattle 2015. Bitly generates over 9 billion clicks on shortened links a month, as well as over 100 million unique link shortens. Analyzing data of this scale is not without its challenges. At Bitly, we have started adopting Apache Spark as a way to process our data. In this talk, I’ll elaborate on how I use Spark as part of my data science workflow. I’ll cover how Spark fits into our existing architecture, the kind of problems I’m solving with Spark, and the benefits and challenges of using Spark for large-scale data science.

Data Science at Scale: Using Apache Spark for Data Science at Bitly

Sarah Guido

Zalandos AI-driven products and distributed landscape of analytical data marts cannot wait for long-running, hard-to-recover, monolithic batch jobs taking all night to calculate already outdated data. Modern data integration pipelines need to deliver fast and easy to consume data sets in high quality. Based on Spark Streaming and Delta, the central data warehousing team was able to deliver widely-used master data as S3 or Kafka streams and snapshots at the same time. The talk will cover challenges in our fashion data platform and a detailed architectural deep dive about separation of integration from enrichment, providing streams as well as snapshots and feeding the data to distributed data marts. Finally, lessons learned and best practices about Delta’s MERGE command, Scala API vs Spark SQL and schema evolution give more insights and guidance for similar use cases.

Data Warehousing with Spark Streaming at Zalando

Databricks

WeCloudData Toronto Open311 Workshop - Matthew Reyes

WeCloudData

Making it easy to work with data

Charles Smith

OSCON 2015

Charles Smith

An excursion into Graph Analytics with Apache Spark GraphX

Krishna Sankar

Microsoft R Server for Data Sciencea

Data Science Thailand

Managed Cluster Services

Adam Doyle

Mais procurados (20)

The Business Economics and Opportunity of Open Source Data Science

Leveraging Spark to Democratize Data for Omni-Commerce with Shafaq Abdullah

Taking Jupyter Notebooks and Apache Spark to the Next Level PixieDust with Da...

Big data-science-oanyc

An Update on Scaling Data Science Applications with SparkR in 2018 with Heiko...

Putting Lipstick on Apache Pig at Netflix

Are we reaching a Data Science Singularity? How Cognitive Computing is emergi...

Analyzing Data With Python

Data Warehousing Patterns for Hadoop

Janus graph lookingbackwardreachingforward

Magellen: Geospatial Analytics on Spark by Ram Sriharsha

Building Better Analytics Workflows (Strata-Hadoop World 2013)

Data Science at Scale: Using Apache Spark for Data Science at Bitly

Data Warehousing with Spark Streaming at Zalando

WeCloudData Toronto Open311 Workshop - Matthew Reyes

Making it easy to work with data

OSCON 2015

An excursion into Graph Analytics with Apache Spark GraphX

Microsoft R Server for Data Sciencea

Managed Cluster Services

Destaque

Diapositivas casa de la calidad

Ethetson Pineda

Design for 'X' and be prepared for anything

Team Consulting Ltd

Qfd - Despliegue de la función de Calidad

Kelly Cuervo

Determinación de características qfd

Sagui Lab

Module 4: Design For X

Naseel Ibnu Azeez

Concurrent engineering is a contemporary approach to DFSS. DFX techniques are part of detail design and are ideal approaches to improve life-cycle cost, quality, increased design flexibility, and increased efficiency and productivity using the concurrent design concepts (Maskell 1991). Benefits are usually pinned as competitiveness measures, improved decision-making, and enhanced operational efficiency. The letter “X” in DFX is made up of two parts: life-cycle processes x and performance measure

Design for x : Design for Manufacturing,Design for Assembly

Naseel Ibnu Azeez

Metodologia Casa de la Calidad QFD

J Carlos Ordoñez

Material Selection and Design Standards

Naseel Ibnu Azeez

Destaque (8)

Diapositivas casa de la calidad

Design for 'X' and be prepared for anything

Qfd - Despliegue de la función de Calidad

Determinación de características qfd

Module 4: Design For X

Design for x : Design for Manufacturing,Design for Assembly

Metodologia Casa de la Calidad QFD

Material Selection and Design Standards

Semelhante a Design for X: Exploring Product Design with Apache Spark and GraphLab

Monitoring Big Data Systems Done "The Simple Way" - Codemotion Berlin 2017

Demi Ben-Ari

Monitoring Big Data Systems Done "The Simple Way" - Codemotion Milan 2017 - D...

Demi Ben-Ari

Once you start working with Big Data systems, you discover a whole bunch of problems you won’t find in monolithic systems. Monitoring all of the components becomes a big data problem itself. In the talk we’ll mention all of the aspects that you should take in consideration when monitoring a distributed system using tools like: Web Services,Spark,Cassandra,MongoDB,AWS. Not only the tools, what should you monitor about the actual data that flows in the system? We’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy.

Demi Ben-Ari - Monitoring Big Data Systems Done "The Simple Way" - Codemotion...

Codemotion

Once you start working with distributed Big Data systems, you start discovering a whole bunch of problems you won’t find in monolithic systems. All of a sudden to monitor all of the components becomes a big data problem itself. In the talk we’ll mention all of the aspects that you should take in consideration when monitoring a distributed system once you’re using tools like: Web Services, Apache Spark, Cassandra, MongoDB, Amazon Web Services. Not only the tools, what should you monitor about the actual data that flows in the system? And we’ll cover the simplest solution with your day to day open source tools, the surprising thing, that it comes not from an Ops Guy. Demi Ben-Ari is a Co-Founder and CTO @ Panorays. Demi has over 9 years of experience in building various systems both from the field of near real time applications and Big Data distributed systems. Describing himself as a software development groupie, Interested in tackling cutting edge technologies. Demi is also a co-founder of the “Big Things” Big Data community: http://somebigthings.com/big-things-intro/

Monitoring Big Data Systems - "The Simple Way"

Demi Ben-Ari

Data infrastructure architecture for medium size organization: tips for colle...

DataWorks Summit/Hadoop Summit

Building search and discovery services for Schibsted (LSRS '17)

Sandra Garcia

Scaling up with Cisco Big Data: Data + Science = Data Science

eRic Choo

As we all can appreciate, “teaching” a vehicle to drive under the full range of conditions it will encounter (i.e. road conditions, weather conditions, behavior of other vehicles) is a daunting proposition. If merely the thought of this makes you nervous, you’re not alone – according to the American Automobile Association (AAA), 75 percent of consumers are not yet ready to embrace self-driving cars. However, that is the very challenge facing automakers – teaching vehicles to unfailingly assess and respond to any combination of operational conditions “on-the-fly” through discrete rules (algorithms) governing a vehicle’s behavior. Join Hortonworks and NorCom at the upcoming webinar as we discuss: •Evolution of the autonomous driving •Traditional data management approaches and main challenges associated with them •How NorCom and Hortonworks can address those challenges and accelerate the pace of autonomous development

Your Self-Driving Car - How Did it Get So Smart?

Hortonworks

"Data mesh is a relatively recent architectural innovation, espoused as one of the best ways to fix analytic data. We renegotiate aged social conventions by focusing on treating data as a product, with a clearly defined data product owner, akin to that of any other product. In addition, we focus on building out a self-service platform with integrated governance, letting consumers safely access and use the data they need to solve their business problems. Data mesh is prescribed as a solution for _analytical data_, so that conventionally analytical results (think weekly sales or monthly revenue reports) can be more accurately and predictably computed. But what about non-analytical business operations? Would they not also benefit from data products backed by self-service capabilities and dedicated owners? If you've ever provided a customer with an analytical report that differed from their operational conclusions, then this talk is for you. Adam discusses the resounding successes he has seen from applying data mesh _off-label_ to both analytical and operational domains. The key? Event streams. Well-defined, incrementally updating data products that can power both real-time and batch-based applications, providing a single source of data for a wide variety of application and analytical use cases. Adam digs into the common areas of success seen across numerous clients and customers and provides you with a set of practical guidelines for implementing your own minimally viable data mesh. Finally, Adam covers the main social and technical hurdles that you'll encounter as you implement your own data mesh. Learn about important data use cases, data domain modeling techniques, self-service platforms, and building an iteratively successful data mesh."

Off-Label Data Mesh: A Prescription for Healthier Data

HostedbyConfluent

In this talk I will introduce you to a Docker container that provides you an easy way to do distributed graph processing using Apache Spark GraphX and a Neo4j graph database. You'll learn how to analyze big data graphs that are exported from Neo4j and consequently updated from the results of a Spark GraphX analysis. The types of analysis I will be talking about are PageRank, connected components, triangle counting, and community detection. Database technologies have evolved to be able to store big data, but are largely inflexible. For complex graph data models stored in a relational database there may be tedious transformations and shuffling around of data to perform large scale analysis. Fast and scalable analysis of big data has become a critical competitive advantage for companies. There are open source tools like Apache Hadoop and Apache Spark that are providing opportunities for companies to solve these big data problems in a scalable way. Platforms like these have become the foundation of the big data analysis movement. Speakers

Big Graph Analytics on Neo4j with Apache Spark

Kenny Bastani

The Future of Data Science

DataWorks Summit

Over 90% of today’s data has been generated in the last two years, and growth rates continue to climb. In this session, we’ll step through challenges and best practices with data capturing, how to derive meaningful insights to help predict the future, and common pitfalls in data analysis. Come discover how integrated solutions involving Amazon S3, AWS Glue, Amazon Redshift, Amazon Athena, Amazon EMR, Amazon Kinesis, and Amazon Machine Learning/Deep Learning result in effective data systems for data scientists and business users, alike.

Initiate Edinburgh 2019 - Big Data Meets AI

Amazon Web Services

by Dan Romuald Mbanga, Business Development Manager, AWS Deep learning continues to push the state of the art in domains such as computer vision, natural language understanding and recommendation engines. One of the key reasons for this progress is the availability of highly flexible and developer friendly deep learning frameworks. In this workshop, we will provide an overview of deep learning focusing on getting started with the TensorFlow and Keras frameworks on AWS. Level 100

Introduction to Deep Learning

Amazon Web Services

The hidden engineering behind machine learning products at Helixa

Alluxio, Inc.

Nous assisterons probablement à une rupture générationnelle entre les apps avec de l'intelligence artificielle et celles sans. Ces dernières, comme les applications en mode caractères à l'arrivée des interfaces graphiques, auront du mal à perdurer. Azure met à dispositions 3 approches pour ajouter de l'IA dans une app, avec un niveau de difficulté graduel, de l'outil ne nécessitant aucune compétence particulière à celui dédié aux Data Scientistes.

Tour de France Azure PaaS 6/7 Ajouter de l'intelligence

Alex Danvy

Delivered to SQL Saturday BI Edition -- Atlanta, GA Microsoft provides several technologies in and around Azure which can be used for casual to serious data science. This presentation provides an overview of the major Microsoft options for both on-premise and cloud-based data science (and hybrid). These technologies have been used by the presenter in various companies and industries, both as a Microsoft consultant and previously independent consultant. As well, the speaker provides insights into data science careers, information which helps imply where the business will likely be for consultants and partners.

Microsoft Technologies for Data Science 201612

Mark Tabladillo

Big Data made easy in the era of the Cloud - Demi Ben-Ari

Demi Ben-Ari

Social media are computer-mediated tools that allow people to create, share or exchange information, ideas, and pictures/videos in virtual communities and networks. To sum up Social Media is everything for your customers and Your company need to listen them to understand, make a custom offer or improve loyalty etc. Azure Stream Analytics and HDInsight platforms can solve this problem for you. We'll focus on how to get Twitter data using Stream Analytics and how to make data enrichment and storing using HDInsight and What is the problem about sentiment analytics using Azure Machine Learning.

Social media analytics using Azure Technologies

Koray Kocabas

Intervention de Florian Douetteau, CEO, Dataiku au Forum du GFII 2014. Atelier : "De la Business Intelligence aux analyses prédictives grâce aux Big Data", le 08/12/14. Abstract : Le prédictif est la nouvelle frontière de la « data intelligence ». Les premiers développements industriels voient le jour, illustrant concrètement l'apport de ces approches pour administrer plus efficacement des systèmes complexes (ville intelligente, transports, énergie, maintenance, etc.), pour outiller la prise de décision dans la gestion du risque (naturel, industriel, client, économique, financier, etc.) ou pour affiner la personnalisation des offres et la recommandation dans le marketing et la publicité. Quelles que soient les applications, il ne s'agitpas de prévoir l'avenir mais de réduire l'incertitude en modélisant des probabilités et des scénarios d'évolution. Les technologies sont entrées dans une phase opérationnelle. Les avancées du Big Data dans la modélisation, le machine learning, ou l'algorithmique sémantique apportent désormais la puissance calculatoire qui faisait auparavant défaut pour fouiller les vastes ensembles de données non-structurées disponibles sur le web, les média sociaux et l'internet des objets. Au-delà des défis en termes de R&D, l'enjeu aujourd'hui est de simplifier l'accès aux approches prédictives pour en démocratiser les usages dans les différents métiers. Des solutions innovantes sont développées pour faciliter la conception de modèles et simplifier le développement d'applications "Web Services" ou "BI Mobile" pour mieux toucher les décideurs. Les modes de distribution en cloud permettent de mutualiser les ressources. Des modèles économiques innovants sont également expérimentés par les fournisseurs de solutions pour réduire les coûts d'accès aux technologies et essaimer dans les entreprises. Le Forum du GFII consacrera un atelier sur ce thème. Des fournisseurs de solutions interviendront pour présenter des cas d'usages en Business Intelligence, en maintenance prédictive et dans la gestion du risque naturel. Source : http://forum.gfii.fr/forum/de-la-business-intelligence-au-predictif-grace-aux-big-data

Machine Learning on dirty data - Dataiku - Forum du GFII 2014

Le_GFII

Many data pipelines share common characteristics and are often built in similar but bespoke ways, even within a single organisation. In this talk, we will outline the key considerations which need to be applied when building data pipelines, such as performance, idempotency, reproducibility, and tackling the small file problem. We’ll work towards describing a common Data Engineering toolkit which separates these concerns from business logic code, allowing non-Data-Engineers (e.g. Business Analysts and Data Scientists) to define data pipelines without worrying about the nitty-gritty production considerations. We’ll then introduce an implementation of such a toolkit in the form of Waimak, our open-source library for Apache Spark (https://github.com/CoxAutomotiveDataSolutions/waimak), which has massively shortened our route from prototype to production. Finally, we’ll define new approaches and best practices about what we believe is the most overlooked aspect of Data Engineering: deploying data pipelines.

Best Practices for Building and Deploying Data Pipelines in Apache Spark

Databricks

Semelhante a Design for X: Exploring Product Design with Apache Spark and GraphLab (20)

Monitoring Big Data Systems Done "The Simple Way" - Codemotion Berlin 2017

Monitoring Big Data Systems Done "The Simple Way" - Codemotion Milan 2017 - D...

Demi Ben-Ari - Monitoring Big Data Systems Done "The Simple Way" - Codemotion...

Monitoring Big Data Systems - "The Simple Way"

Data infrastructure architecture for medium size organization: tips for colle...

Building search and discovery services for Schibsted (LSRS '17)

Scaling up with Cisco Big Data: Data + Science = Data Science

Your Self-Driving Car - How Did it Get So Smart?

Off-Label Data Mesh: A Prescription for Healthier Data

Big Graph Analytics on Neo4j with Apache Spark

The Future of Data Science

Initiate Edinburgh 2019 - Big Data Meets AI

Introduction to Deep Learning

The hidden engineering behind machine learning products at Helixa

Tour de France Azure PaaS 6/7 Ajouter de l'intelligence

Microsoft Technologies for Data Science 201612

Big Data made easy in the era of the Cloud - Demi Ben-Ari

Social media analytics using Azure Technologies

Machine Learning on dirty data - Dataiku - Forum du GFII 2014

Best Practices for Building and Deploying Data Pipelines in Apache Spark

Mais de Amanda Casari

Data-driven companies making intelligent products must design for security and privacy to be competitive globally. The EU General Data Protection Regulation (GDPR), implemented May 2018, is the benchmark that global data privacy will be measured against. This presentation outlines the basic tenets of personal data and details the high-level changes that GDPR-compliant businesses face. It translates the current and near-future impact to teams designing products driven by machine learning and artificial intelligence and shares use cases of how SAP Concur is designing to meet this challenge while still delivering services to its end users that are driven by advanced algorithms. Presented at The AI Conference, San Francisco, September 2018

When Privacy Scales - Intelligent Product Design under GDPR

Amanda Casari

Scaling Data Science Products, Not Data Science Teams

Amanda Casari

Spark Hearts GraphLab Create

Amanda Casari

Apache Spark for Everyone - Women Who Code Workshop

Amanda Casari

20160512 apache-spark-for-everyone

Amanda Casari

Machine learning fits mathematical models to date to derive insights or make predictions. Engineering the features that sit between data and models is a crucial step in the machine learning pipeline, because the right features can ease the difficulty of modeling and enable results of higher quality. In this talk, we will dive deeper into the mechanisms behind popular feature engineering techniques and walk through use of where these techniques are most useful. You will be able to better identify which methods to use based on your data and the problem you are working to solve.

Feature Engineering for Machine Learning at QConSP

Amanda Casari

When describing a product as "data-driven" or "fueled by machine learning," it can be difficult to parse a common, fundamental definition of what makes an application "intelligent." In this talk, we will cover how you can peel back the buzzwords from the space of data science, machine learning, and artificial intelligence. You will be able to: - Start sketching your own frameworks for understanding and evaluating these products - Better understand how things can go wrong - Know what questions to ask product vendors, and have a better understanding of their answers - Learn more about data science as a process, as people organizations, as a product and as a service

Understanding Products Driven by Machine Learning and AI: A Data Scientist's ...

Amanda Casari

PyLadies Seattle - Lessons in Interactive Visualizations

Amanda Casari

Mais de Amanda Casari (8)

When Privacy Scales - Intelligent Product Design under GDPR

Scaling Data Science Products, Not Data Science Teams

Spark Hearts GraphLab Create

Apache Spark for Everyone - Women Who Code Workshop

20160512 apache-spark-for-everyone

Feature Engineering for Machine Learning at QConSP

Understanding Products Driven by Machine Learning and AI: A Data Scientist's ...

PyLadies Seattle - Lessons in Interactive Visualizations

Último

Model Call Girl Services in Delhi reach out to us at 🔝 9953056974 🔝✔️✔️ Our agency presents a selection of young, charming call girls available for bookings at Oyo Hotels. Experience high-class escort services at pocket-friendly rates, with our female escorts exuding both beauty and a delightful personality, ready to meet your desires. Whether it's Housewives, College girls, Russian girls, Muslim girls, or any other preference, we offer a diverse range of options to cater to your tastes. We provide both in-call and out-call services for your convenience. Our in-call location in Delhi ensures cleanliness, hygiene, and 100% safety, while our out-call services offer doorstep delivery for added ease. We value your time and money, hence we kindly request pic collectors, time-passers, and bargain hunters to refrain from contacting us. Our services feature various packages at competitive rates: One shot: ₹2000/in-call, ₹5000/out-call Two shots with one girl: ₹3500/in-call, ₹6000/out-call Body to body massage with sex: ₹3000/in-call Full night for one person: ₹7000/in-call, ₹10000/out-call Full night for more than 1 person: Contact us at 🔝 9953056974 🔝. for details Operating 24/7, we serve various locations in Delhi, including Green Park, Lajpat Nagar, Saket, and Hauz Khas near metro stations. For premium call girl services in Delhi 🔝 9953056974 🔝. Thank you for considering us!

CHEAP Call Girls in Pushp Vihar (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE

9953056974 Low Rate Call Girls In Saket, Delhi NCR

Conference: Engage2024 in Antwerp Type: Workshop Speakers: Florian Vogler, Henning Kunz, Christoph Adler Title: Navigating the Future with The Hitchhiker's Guide to Notes and Domino 14 Abstract: Embark on an exhilarating journey with industry trailblazers Florian Vogler, Henning Kunz, and Christoph Adler in this not-to-be-missed workshop at the forefront of the tech universe. Get ready for a thrilling kick-off as we navigate the current state of the HCL universe, setting the stage for an exploration of the groundbreaking Notes and Domino 14. Discover the latest enhancements and revolutionary features that will redefine your experience. In this interactive session, unlock a treasure trove of tips and tricks to elevate your utilization of version 14, both with and without the game-changing panagenda MarvelClient. Brace yourself for also diving into Nomad, Nomad Web, and VoltMX, expanding your horizons in the expansive HCL landscape. Be a part of this exclusive opportunity to stay ahead in the ever-evolving world of HCL technologies. Your journey to mastering Notes and Domino 14 begins here. And remember, in the spirit of intergalactic exploration, don't forget to bring your towel!

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

panagenda

InShot proinshot.com stands tall among its peers as the ultimate video editing app, offering simplicity, versatility, and power in one package. With its intuitive interface and comprehensive feature set, InShot caters to both beginners and seasoned editors alike. Whether you're creating content for social media, YouTube, or personal projects, InShot empowers you to unleash your creativity and transform your videos into captivating masterpieces. Join the millions of users who trust InShot https://www.proinshot.com/ for all their video editing needs and discover the difference for yourself!

Exploring the Best Video Editing App.pdf

proinshot.com

8257 interfacing 2 in microprocessor for btech students

HimanshiGarg82

The title is not connected to what is inside

shinachiaurasa2

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal

%+27788225528 love spells in Boston Psychic Readings, Attraction spells,Bring...

masabamasaba

+971565801893 Mtp-Kit (500MG) Prices » Dubai [(+971565801893**)] Abortion Pills For Sale In Dubai, UAE, Mifepristone and Misoprostol Tablets Available In Dubai, UAE CONTACT DR.Leen Whatsapp +971565801893 We Have Abortion Pills / Cytotec Tablets /Mifegest Kit Available in Dubai, Sharjah, Abudhabi, Ajman, Alain, Fujairah, Ras Al Khaimah, Umm Al Quwain, UAE, Buy cytotec in Dubai +971565801893''''Abortion Pills near me DUBAI | ABU DHABI|UAE. Price of Misoprostol, Cytotec” +971565801893' Dr.DEEM ''BUY ABORTION PILLS MIFEGEST KIT, MISOPROTONE, CYTOTEC PILLS IN DUBAI, ABU DHABI,UAE'' Contact me now via What's App…… abortion Pills Cytotec also available Oman Qatar Doha Saudi Arabia Bahrain Above all, Cytotec Abortion Pills are Available In Dubai / UAE, you will be very happy to do abortion in Dubai we are providing cytotec 200mg abortion pill in Dubai, UAE. Medication abortion offers an alternative to Surgical Abortion for women in the early weeks of pregnancy. We only offer abortion pills from 1 week-6 Months. We then advise you to use surgery if its beyond 6 months. Our Abu Dhabi, Ajman, Al Ain, Dubai, Fujairah, Ras Al Khaimah (RAK), Sharjah, Umm Al Quwain (UAQ) United Arab Emirates Abortion Clinic provides the safest and most advanced techniques for providing non-surgical, medical and surgical abortion methods for early through late second trimester, including the Abortion By Pill Procedure (RU 486, Mifeprex, Mifepristone, early options French Abortion Pill), Tamoxifen, Methotrexate and Cytotec (Misoprostol). The Abu Dhabi, United Arab Emirates Abortion Clinic performs Same Day Abortion Procedure using medications that are taken on the first day of the office visit and will cause the abortion to occur generally within 4 to 6 hours (as early as 30 minutes) for patients who are 3 to 12 weeks pregnant. When Mifepristone and Misoprostol are used, 50% of patients complete in 4 to 6 hours; 75% to 80% in 12 hours; and 90% in 24 hours. We use a regimen that allows for completion without the need for surgery 99% of the time. All advanced second trimester and late term pregnancies at our Tampa clinic (17 to 24 weeks or greater) can be completed within 24 hours or less 99% of the time without the need surgery. The procedure is completed with minimal to no complications. Our Women's Health Center located in Abu Dhabi, United Arab Emirates, uses the latest medications for medical abortions (RU-486, Mifeprex, Mifegyne, Mifepristone, early options French abortion pill), Methotrexate and Cytotec (Misoprostol). The safety standards of our Abu Dhabi, United Arab Emirates Abortion Doctors remain unparalleled. They consistently maintain the lowest complication rates throughout the nation. Our Physicians and staff are always available to answer questions and care for women in one of the most difficult times in their lives. The decision to have an abortion at the Abortion Clinic in Abu Dhabi, United Arab Emirates.+971565801893

+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...

Health

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

Foundation models are machine learning models which are easily capable of performing variable tasks on large and huge datasets. FMs have managed to get a lot of attention due to this feature of handling large datasets. It can do text generation, video editing to protein folding and robotics. In case we believe that FMs can help the hospitals and patients in any way, we need to perform some important evaluations, tests to test these assumptions. In this review, we take a walk through Fms and their evaluation regimes assumed clinical value. To clarify on this topic, we reviewed no less than 80 clinical FMs built from the EMR data. We added all the models trained on structured and unstructured data. We are referring to this combination of structured and unstructured EMR data or clinical data.

Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...

harshavardhanraghave

Generic or specific? Making sensible software design decisions

Bert Jan Schrijver

%in Durban+277-882-255-28 abortion pills for sale in Durban

masabamasaba

In today's dynamic e-commerce landscape, the payment gateway emerges as a linchpin, ensuring smooth and secure transactions between buyers and sellers. In this discourse, we delve into the meticulous process of devising test cases tailored for scrutinizing payment gateways. Crafting precise test cases for payment gateways is a quintessential responsibility for testers operating within the service industry. This article meticulously explores pivotal scenarios integral to how to test payment gateways, coupled with essential guidelines for drafting effective test cases.

Payment Gateway Testing Simplified_ A Step-by-Step Guide for Beginners.pdf

kalichargn70th171

(Vivek)Call Us, 8448380779,Call girls in Delhi NCr – We Offer best in class call girls. escort Service At Affordable Price At low Rate with Space Night 8000 We Are One Of The Oldest Escort and Call girls Agencies in Delhi. You Will Find That Our Female Escorts Are Full Of Fun, Sexy And They Would Love Enjoy Your Company. We Have A Fantastic Selection Of Escort Ladies Available For In-Calls As Well As Out-Calls. Our Escorts Are Not Only Beautiful But All Have Great Personalities Making Them The Perfect Companion For Any Occasion. In-Call:- You Can Come At Our Place in Delhi Our place Which Is Very Clean Hygienic 100% safe Accommodation. Out-Call:- You have To Come Pick The Girl From My Place We Are Also Provide Door Step Services (Delhi Ncr, Noida, Gurgaon, Faridabad, Ghaziabad Note:- Pic Collectors Time Passers Bargainers Stay Away As We Respect The Value For Your Money Time And Expect The Same From You Hygienic:- Full Ac room And Clean Rooms Available In Hotel 24 * 7 Hourly In Delhi NCR More Details, With WhatsApp Number, +91-8448380779

call girls in Vaishali (Ghaziabad) 🔝 >༒8448380779 🔝 genuine Escort Service 🔝✔️✔️

Delhi Call girls

%in kempton park+277-882-255-28 abortion pills for sale in kempton park

masabamasaba

At the recent Microsoft Ignite 2023 conference, Microsoft unveiled a groundbreaking strategy that will redefine enterprise work management. The plan involves integrating Microsoft’s key planning tools, Microsoft To Do, Microsoft Planner, and Microsoft Project for the web into a unified experience called “Microsoft Planner.” What does this new strategy from Microsoft mean for current users? Join us and learn how best to take advantage of this announcement while gaining a clear path on how to elevate the current state of Microsoft Planner from a basic task manager to a comprehensive tool for Enterprise Work Management using OnePlan. Learn how OnePlan’s integration with Microsoft Planner allows for strategic alignment with business goals through advanced features like strategic planning, portfolio management, resource management, financial management, and more!

Introducing Microsoft’s new Enterprise Work Management (EWM) Solution

OnePlan Solutions

introduction-to-automotive Andoid os-csimmonds-ndctechtown-2021.pdf

VishalKumarJha10

Test automation is a cornerstone of software development and quality assurance in today's rapidly evolving digital landscape. Its significance cannot be overstated. Businesses can enhance efficiency, productivity, and accelerate software delivery to market through automation, streamlining testing processes effectively. This comprehensive guide addresses the best practices for test automation in 2024. It offers a detailed checklist to empower you to optimize your automation efforts and maintain a competitive edge.

The Ultimate Test Automation Guide_ Best Practices and Tips.pdf

kalichargn70th171

Looking for an efficient way to manage your finances? Look no further than our money management app. With easy-to-use features, you can track your expenses, create budgets, and monitor your savings goals all in one place. Our app provides real-time updates on your spending habits and helps you make smarter financial decisions. Take control of your finances today with our user-friendly money management app.

Right Money Management App For Your Financial Goals

Jhone kinadey

%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...

masabamasaba

In the past six months, the AI landscape has undergone a massive transformation, ushering in a new era of productivity with the latest in Large Language Models (LLMs) and AI technology. This deep dive unlocks how to: Create CustomGPT Models: No coding needed to tailor AI for your unique projects. Integrate your own data, including PDFs and Excel sheets, making information handling a breeze. Plus, discover how to call your own actions/integrations for even more personalized utility. Navigate Advanced Prompting: Overcome AI's memory limits and utilize Retrieval-Augmented Generation for accessing your personalized data, streamlining how you interact with AI. Stay Ahead with AI Trends: Peek into the evolving world of LLMs, featuring newcomers like Google Gemini, Anthropic Claude, Open Sora, and Twitter Grok, and understand what their advancements mean for your productivity. Witness Real-Life Transformations: Through examples and prompt demonstrations, see firsthand how these AI strategies revolutionize routine tasks, from data analysis to content creation. Learn to leverage image output and input for advanced practical use cases, adding a new dimension to your productivity toolkit. No previous coding or AI experience is needed for this talk. Stay ahead in the fast-evolving world of work. Embrace the AI revolution and transform your workflow with advanced LLM techniques. Join us to ensure you're not left behind in the productivity race.

AI Mastery 201: Elevating Your Workflow with Advanced LLM Techniques

VictorSzoltysek

Design for X: Exploring Product Design with Apache Spark and GraphLab

1. DESIGN FOR X exploring data science product design with apache spark + graphlab {create} @amcasari @Concur data science summit 2016, san francisco nasa

2. data science via random walks senior product mgr + data scientist @ Concur Labs control systems engineering + robotics + legos officer in USN operations research analyst wandering dirtbag + conservation volunteer EE + applied math + complex systems underwater robotics engineer technology consultant SAHM

3. INSANELY QUICK INTRO TO + ➤ Concur Accelerator Team ➤ Concur Labs ➤ Incubator (still brewing) 850K Users log into Concur 300K Expense reports processed 120K Trips booked 170M Trips & expense reports warehoused Typical Day at Concur How do we encourage a culture of innovation while delivering quality service to our existing 33,000 business clients and 40M users?

4. DESIGN SPRINTS FOR DATA SCIENCEY PROTOTYPES courtesy google ventures {we iterated…because data}

5. INSANELY QUICK INTRO TO ➤ “fast and general engine for large-scale data processing” ➤ advanced cyclic data ﬂow and in-memory computing > runs 10x-100x faster than Hadoop MR ➤ interactive shells in several languages (incl. SQL) ➤ performant + scalable courtesy databricks

6. ALMOST AS INSANELY QUICK INTRO TO + ➤ graphlab create is based on a python data science library developed + (some) os’d by turi ➤ SFrame <<>> Spark DataFrame | SparkRDD ➤ (yes it works with Open Source SFrame and GLC) courtesy turi

7. WHAT PROBLEM DO WE WANT TO DATA SCIENCE? Knowledge Gaps IOT Networks Bots Fairness +

8. ➤ “We could {build this} {answer this better} if….” ➤ Reciprocal Data Applications DESIGN FOR KNOWLEDGE GAPS rda rdarda choose your data storage choose your data storage choose your data storage the app you really want to make

9. ➤ “Can we trust our sensors?” ➤ “Has our network been hacked?” DESIGN FOR IOT NETWORKS device device device alerts, notifications, monitoring dashboards data services Anomaly Detection Toolkit TimeSeries <<>> SFrame

10. ➤ “How do we create a conversational interface?” ….nothing new, just the burning question since Turing, 1950 DESIGN FOR BOTS what NOT to do…. non-creepy unisex animal mascot conversational ui choose or create your framework choose your data storage Advanced Deep Learning Text Analysis Toolkit Graph Analytics Toolkit

11. ➤ know your biases + limitations ➤ in your data, their data, all the data ➤ in your feature selection ➤ in your algorithm …..because ethics (these ALL bias your results + communications) DESIGN FOR FAIRNESS learn more at data & society’s case studies + + open source. reproducible. transparent.

12. {THANKS MUCH} ➤ Concur is hiring! ➤ SAP + SAP Ariba are hiring! concurlabs.com github.com/ concurlabs ➤ example notebooks will be posted on our github in the future @amcasari

Design for X: Exploring Product Design with Apache Spark and GraphLab

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (8)

Semelhante a Design for X: Exploring Product Design with Apache Spark and GraphLab

Semelhante a Design for X: Exploring Product Design with Apache Spark and GraphLab (20)

Mais de Amanda Casari

Mais de Amanda Casari (8)

Último

Último (20)

Design for X: Exploring Product Design with Apache Spark and GraphLab