O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

Open Source Lisbon - Francisco Teixeira Presentation

49 visualizações

Publicada em

"In data we trust, a smarter future to build Azure Databricks" - Francisco Teixeira

Publicada em: Tecnologia
  • Seja o primeiro a comentar

  • Seja a primeira pessoa a gostar disto

Open Source Lisbon - Francisco Teixeira Presentation

  1. 1. Shape the future with the power of data and Azure Databricks
  2. 2. WATER LEVEL FULL pH NEUTRAL 14 0 SMART COLLAR Retuned home at 5:07pm 3 NEW MESSAGES Re: Medical Education 26° INDOOR TEMPERATURE FAVORITE STATION Jazz Classics MORNING COFFEE Normally wakes up at 7:00am PURCHASED ON AMAZON Reminder: Shall I reorder more detergent? THE DIGITALERAIS HERE What does this mean to you?
  3. 3. Artificial Intelligenc e 3D Printers 1% of 2007 Cost Smartphones 2% of 2007 Cost Sensors .3% of 2007 Cost Solar .5% of 1984 Cost DNA Sequencing .01% of 2007 Cost Industrial Robots 3% of 2007 Cost Mixed Reality 1% of 2007 cost Drones 1% of 2007 cost Cloud Transformative Technologies Democratized
  4. 4. Digital companies - faster and disrupt furtherVALUATION $25b $50b $75b $100b $150b $200b $250b Y E A R S IN B U SI N E S S $984b$508b $862b $385b 50 75 100 175 25 200 150 125
  5. 5. Streami ng Recommendati ons Analyti cs $5b movie studio Mail DVD Delivery What did Netflix do right? Cross-device Intelligent cloud Data Analytics Agile Cross-device Multi-sense AI Intelligent cloud Agile Cross- device Multi-sense Data AgileAnalytics Agile Intelligent cloud AI Data A I Intelligent cloud Agile Data Agile Multi- senseAnalytics Cross-device 2004 2006 2008 2010 2012 2014 2016 #NETFLIX #5billionMovieStudio 2002 v v
  6. 6. Azure Databricks Powered by Apache Spark
  7. 7. S P A R K : A B R I E F H I S T O R Y
  8. 8. • Open-source data processing engine built around speed, ease of use, and sophisticated analytics • In memory engine that is up to 100 times faster than Hadoop • Largestopen-source data projectwith 1000+ contributors • Highly extensible with support for Scala, Java and Python alongside Spark SQL, GraphX, Streaming and Machine Learning Library (Mllib) Why Spark?
  9. 9. What is Azure Databricks? A fast, easy and collaborative Apache® Spark™ based analytics platform optimized for Azure Best of Databricks Best of Microsoft Designed in collaboration with the founders of Apache Spark One-click set up; streamlined workflows Interactive workspace that enables collaboration between data scientists, data engineers, and business analysts. Native integration with Azure services (Power BI, SQL DW, Cosmos DB, Blob Storage) Enterprise-grade Azure security (Active Directory integration, compliance, enterprise-grade SLAs)
  10. 10. Optimized Databricks Runtime Engine DATABRICKS I/ O SERVERLESS Collaborative Workspace Cloud storage Data warehouses Hadoop storage IoT / streaming data Rest APIs Machine learning models BI tools Data exports Data warehouses Azure Databricks Enhance Productivity Deploy Production Jobs &Workflows APACHE SPARK MULTI-STAGE PIPELINES DATA ENGINEER JOB SCHEDULER NOTIFICATION & LOGS DATA SCIENTIST BUSINESS ANALYST Build on secure &trusted cloud Scale without limits Azure Databricks
  11. 11. Use Cases
  12. 12. Modern Big Data Warehouse Business / customapps (Structured) Logs, files and media (unstructured) Azure storage Polybase Azure SQL Data Warehouse Data factory Data factory Azure Databricks (Spark) Analytical dashboards Model &ServePrep &TrainStoreIngest Intelligence
  13. 13. Advanced Analytics on Big Data Web &mobile appsAzure Databricks (SparkMllib, SparkR, SparklyR) Azure Cosmos DB Business / customapps (Structured) Logs, files and media (unstructured) Azure storage Polybase Azure SQL Data Warehouse Data factory Data factory Analytical dashboards Model &ServePrep &TrainStoreIngest Intelligence
  14. 14. Real-time analytics on Big Data Unstructured data Azure storage Polybase Azure SQL Data Warehouse Azure HDInsight (Kafka) Azure Databricks (Spark) Analytical dashboards Model &ServePrep &TrainStoreIngest Intelligence
  15. 15. Demo
  16. 16. Engage Microsoft experts for a workshop to help identify high impact scenarios Already using Azure? try Azure Databricks now or create a free Azure account to start using Azure Databricks  Learn more about Azure Databricks www.azure.com/databricks How to get started
  17. 17. Thank you! Francisco Teixeira @fratei aka.ms/francisco.teixeira