Kodu Game Lab e Project Spark

•Transferir como PPTX, PDF•

0 gostou•338 visualizações

Kodu e Project Spark são ferramentas de programação que podem ser usadas no processo pedagógico para ensinar conceitos de programação de forma divertida e criativa. Essas ferramentas permitem que estudantes criem jogos e mundos virtuais sem precisar saber linguagens de programação tradicionais.

Tecnologia

Fabricio Catae
@fcatae
Evangelista Técnico
Microsoft
A importância da programação
no processo pedagógico
Kodu e Project Spark

Recomendados

TDC2018SP | Trilha .Net - Obtendo metricas com TDD utilizando build automatiz...

tdc-globalcode

TDC2018SP | Trilha .Net - Real Time apps com Azure SignalR Service

tdc-globalcode

ApresentaçãO Final

HotSpy2009

GDG Aracaju: Introdução

Erick Mendonça

Road to hooks - Engenharia e Produto evoluindo juntos

Pedro Neto

Gestão de fábrica de software com desenvolvimento multi plataformasJosé Freire Neto

Apache Spark Use case for Education Industry

Vinayak Agrawal

Cancer Outlier Profile Analysis using Apache Spark

Mahmoud Parsian

How Totango uses Apache Spark

Oren Raboy

Getting Apache Spark Customers to Production

Cloudera, Inc.

Succinct Spark: Fast Interactive Queries on Compressed RDDs by Rachit Agarwal

Spark Summit

Fighting Fraud with Apache Spark

Miklos Christine

Record linkage, a real use case with spark ml - Paris Spark meetup Dec 2015

Modern Data Stack France

Record Linkage, un cas d’utilisation en Spark ML par Alexis Seigneurin Le Record Linkage est le process qui consiste à trouver, dans un data set, les enregistrements qui représentent la même entité. Cette opération est particulièrement compliquée quand, comme nous, vous travaillez avec des données anonymisées. C’est là que le Machine Learning vient en renfort ! Nous avons implémenté un algorithme de Record Linkage en Spark SQL (DataFrames) et Spark ML plutôt que d’utiliser des règles statiques. Nous verrons le process de Feature Engineering, pourquoi nous avons dû étendre Spark DataFrames pour préserver des méta-données au travers du pipeline de traitement, et comment nous avons utilisé le Machine Learning pour réconcilier les enregistrements. Nous verrons enfin comment nous avons industrialisé cette application. Alexis Seigneurin : Développeur depuis 15 ans, j'attache beaucoup d'importance aux problématiques de traitement, d'analyse et de stockage de la donnée.Chez Ippon, j'interviens principalement sur des missions de conseil et d'architecture autour de technologies big data. Par ailleurs, j'anime la formation Spark chez Ippon.

Not Your Father's Database: How to Use Apache Spark Properly in Your Big Data...

Databricks

This session will cover a series of problems that are adequately solved with Apache Spark, as well as those that are require additional technologies to implement correctly. Here’s an example outline of some of the topics that will be covered in the talk: Problems that are perfectly solved with Apache Spark: 1) Analyzing a large set of data files. 2) Doing ETL of a large amount of data. 3) Applying Machine Learning & Data Science to a large dataset. 4) Connecting BI/Visualization tools to Apache Spark to analyze large datasets internally. By Vida Ha at Spark Summit East 2016.

Building a Turbo-fast Data Warehousing Platform with Databricks

Databricks

Traditionally, data warehouse platforms have been perceived as cost prohibitive, challenging to maintain and complex to scale. The combination of Apache Spark and Spark SQL – running on AWS – provides a fast, simple, and scalable way to build a new generation of data warehouses that revolutionizes how data scientists and engineers analyze their data sets. In this webinar you will learn how Databricks - a fully managed Spark platform hosted on AWS - integrates with variety of different AWS services, Amazon S3, Kinesis, and VPC. We’ll also show you how to build your own data warehousing platform in very short amount of time and how to integrate it with other tools such as Spark’s machine learning library and Spark streaming for real-time processing of your data.

Lambda Architectures in Practice

C4Media

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1FQYcP0. Gian Merlino presents the advantages, challenges, and best practices to deploying and maintaining lambda architectures in the real world, using the infrastructure at Metamarkets as a case study. Filmed at qconsf.com. Gian Merlino is a senior software engineer at Metamarkets, responsible for the infrastructure behind its data ingestion pipelines and is a committer on the Druid project.

Building a Graph of all US Businesses Using Spark Technologies by Alexis Roos

Spark Summit

Implementing Near-Realtime Datacenter Health Analytics using Model-driven Ver...

Spark Summit

Mastering Your Customer Data on Apache Spark by Elliott Cordo

Spark Summit

Real-Time Log Analysis with Apache Mesos, Kafka and Cassandra

Joe Stein

Slides for our solution we developed for using Mesos, Docker, Kafka, Spark, Cassandra and Solr (DataStax Enterprise Edition) all developed in Go for doing realtime log analysis at scale. Many organizations either need or want log analysis in real time where you can see within a second what is happening within your entire infrastructure. Today, with the hardware available and software systems we have in place, you can develop, build and use as a service these solutions.

Real Time BOM Explosions with Apache Solr and Spark

QAware GmbH

Apache Big Data Conference 2016, Vancouver BC: Talk by Andreas Zitzelsberger (@andreasz82, Principal Software Architect at QAware) Abstract: Bills of materials (BOMs) are at the heart of every manufacturing process. Especially large BOMs can be found in the automotive industry, where a complex and highly variable product meets high production volumes. Drawing from the experiences made in an ongoing real world project for a major car manufacturer, Andreas provides an in-depth view how Apache Solr and Apache Spark were used to power an innovative architecture that provides lightning-fast BOM explosions, demand forecasts and scenario-based planning on 20 billion records per scenario.

Spark Summit Keynote by Seshu Adunuthula

Spark Summit

Pulsar: Real-time Analytics at Scale with Kafka, Kylin and Druid

Tony Ng

Voxxed Days Thesaloniki 2016 - Streaming Engines for Big Data

Voxxed Days Thessaloniki

Building a Just in Time Data Warehouse by Dan Morris and Jason Pohl

Spark Summit

Spark-Streaming-as-a-Service with Kafka and YARN: Spark Summit East talk by J...

Spark Summit

Since April 2016, Spark-as-a-service has been available to researchers in Sweden from the Swedish ICT SICS Data Center at www.hops.site. Researchers work in an entirely UI-driven environment on a platform built with only open-source software. Spark applications can be either deployed as jobs (batch or streaming) or written and run directly from Apache Zeppelin. Spark applications are run within a project on a YARN cluster with the novel property that Spark applications are metered and charged to projects. Projects are also securely isolated from each other and include support for project-specific Kafka topics. That is, Kafka topics are protected from access by users that are not members of the project. In this talk we will discuss the challenges in building multi-tenant Spark streaming applications on YARN that are metered and easy-to-debug. We show how we use the ELK stack (Elasticsearch, Logstash, and Kibana) for logging and debugging running Spark streaming applications, how we use Graphana and Graphite for monitoring Spark streaming applications, and how users can debug and optimize terminated Spark Streaming jobs using Dr Elephant. We will also discuss the experiences of our users (over 120 users as of Sept 2016): how they manage their Kafka topics and quotas, patterns for how users share topics between projects, and our novel solutions for helping researchers debug and optimize Spark applications. To conclude, we will also give an overview on our course ID2223 on Large Scale Learning and Deep Learning, in which 60 students designed and ran SparkML applications on the platform.

Apache Spark Model Deployment

Databricks

Tech-Talk at Bay Area Spark Meetup Apache Spark(tm) has rapidly become a key tool for data scientists to explore, understand and transform massive datasets and to build and train advanced machine learning models. The question then becomes, how do I deploy these model to a production environment. How do I embed what I have learned into customer facing data applications. Like all things in engineering, it depends. In this meetup, we will discuss best practices from Databricks on how our customers productionize machine learning models and do a deep dive with actual customer case studies and live demos of a few example architectures and code in Python and Scala. We will also briefly touch on what is coming in Apache Spark 2.X with model serialization and scoring options.

2016 Spark Summit East Keynote: Matei Zaharia

Databricks

Mule Meetup Cache Redis

Kodu Game Lab e Project Spark

Recomendados

Recomendados

Mais conteúdo relacionado

Destaque

Destaque (20)

Mais de Fabrício Catae

Mais de Fabrício Catae (20)

Último

Último (7)

Kodu Game Lab e Project Spark

Notas do Editor