Additional information on #datatuesday: http://data-tuesday.com/ Additional information on Hadoop on Azure: http://www.hadooponazure.com, http://aka.ms/benjguinhadoop

1. Data Tuesday – 10 janvier 2012
Pierre Lagarde (DPE) – pierlag@microsoft.com
Benjamin Guinebertière (DPE) – www.benjguin.com

2. Microsoft Distribution of Hadoop [MDH]
• Code name : Isotope
• Leveraging the Hadoop data-driven
community
– OnPremise – Cloud
– Windows Server integration [AD – Secure HDFS]
– Connection with SQL Server / Excel
– Developer Framework [JavaScript, .NET, F#, …]
– Hadoop as a Service through Azure [eMDH]

3. Structural Overview
ISOTOPE
[Azure and Enterprise]
Java - JavaScript Streaming OM HiveQL PigLatin .NET/C#/F# (T)SQL
NOSQL OCEAN OF DATA ETL
[unstructured, semi-structured, structured]
HDFS
A SEAMLESS OCEAN OF INFORMATION PROCESSING AND ANALYTICS
EIS / ERP RDBMS File System OData [RSS] Azure Storage

4. Création d’un cluster à la demande

5. Map/Reduce - Java

6. Map/Reduce – C#

7. Map/Reduce - JavaScript

8. Démo - JavaScript
distcp HDFS
Sort/filter
JavaScript M/R
from("books")
Azure Storage .mapReduce("file.js", "word, count:long")
.orderBy("count DESC")
.take(10)
.to("top10")
HDFS File
Graph.bar(data)
Excel ODBC Reporting
Hive Connector SQLServer

11. • from("books")
.mapReduce("bin/WordCountLong.js", "word, count:long")
.orderBy("count DESC")
.take(10)
.to("demo-top10")

13. • #get top10