SlideShare uma empresa Scribd logo

Elastic Map Reduce 101

•
•
K
Kush Ohri

Intro to Elastic Map Reduce - or Hadoop on Amazon Cloud

1 de 12
Baixar para ler offline
Intro to Using Hadoop on Amazon Cloud Ajay Ohri
Elastic Map Reduce (EMR)
 
 Sample App- Big Data Web Analytics
  Specify Location

 Specifying Instances
Logging
Next  Running R on Hadoop on Amazon EMR (for ordinary people!)  Wishlist- Easier Tutorials on Running optimized Parallel Processing on Big Data Jobs using Amazon EMR and R – http://jeffreybreen.wordpress.com/2012/03/10/big-data-step-by-step-slides/  Also see -segue package tutorial  http://jeffreybreen.wordpress.com/2011/01/10/segue-r-to-amazon-elastic-mapreduce-hadoop/

Recomendados

Breakfast in the Clouds
Breakfast in the CloudsBreakfast in the Clouds
Breakfast in the CloudsYahoo Developer Network
 
IoT & Deep Learning on AWS
IoT & Deep Learning on AWSIoT & Deep Learning on AWS
IoT & Deep Learning on AWSJulien SIMON
 
Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...
Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...
Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...Julien SIMON
 
Using EC2
Using EC2Using EC2
Using EC2Symposia Media
 
Google Web App
Google Web AppGoogle Web App
Google Web Appgooglewebappa2z
 
Build, Train and Deploy ML Models using Amazon SageMaker
Build, Train and Deploy ML Models using Amazon SageMakerBuild, Train and Deploy ML Models using Amazon SageMaker
Build, Train and Deploy ML Models using Amazon SageMakerHagay Lupesko
 
Green Your Apps (at Over The Air 2011)
Green Your Apps (at Over The Air 2011)Green Your Apps (at Over The Air 2011)
Green Your Apps (at Over The Air 2011)AMEE
 
New AI/ML services at AWS re:Invent 2017
New AI/ML services at AWS re:Invent 2017New AI/ML services at AWS re:Invent 2017
New AI/ML services at AWS re:Invent 2017Julien SIMON
 

Recomendados

Breakfast in the Clouds
Breakfast in the CloudsBreakfast in the Clouds
Breakfast in the CloudsYahoo Developer Network
 
IoT & Deep Learning on AWS
IoT & Deep Learning on AWSIoT & Deep Learning on AWS
IoT & Deep Learning on AWSJulien SIMON
 
Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...
Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...
Machine Learning: From Notebook to Production with Amazon Sagemaker (January ...Julien SIMON
 
Using EC2
Using EC2Using EC2
Using EC2Symposia Media
 
Google Web App
Google Web AppGoogle Web App
Google Web Appgooglewebappa2z
 
Build, Train and Deploy ML Models using Amazon SageMaker
Build, Train and Deploy ML Models using Amazon SageMakerBuild, Train and Deploy ML Models using Amazon SageMaker
Build, Train and Deploy ML Models using Amazon SageMakerHagay Lupesko
 
Green Your Apps (at Over The Air 2011)
Green Your Apps (at Over The Air 2011)Green Your Apps (at Over The Air 2011)
Green Your Apps (at Over The Air 2011)AMEE
 
New AI/ML services at AWS re:Invent 2017
New AI/ML services at AWS re:Invent 2017New AI/ML services at AWS re:Invent 2017
New AI/ML services at AWS re:Invent 2017Julien SIMON
 
Dba Tools for Azure
Dba Tools for AzureDba Tools for Azure
Dba Tools for AzureRadu Vunvulea
 
Building machine learning inference pipelines at scale (March 2019)
Building machine learning inference pipelines at scale (March 2019)Building machine learning inference pipelines at scale (March 2019)
Building machine learning inference pipelines at scale (March 2019)Julien SIMON
 
The Esri / Google Treaty: How to Power Your New Mapping Options
The Esri / Google Treaty: How to Power Your New Mapping OptionsThe Esri / Google Treaty: How to Power Your New Mapping Options
The Esri / Google Treaty: How to Power Your New Mapping OptionsSafe Software
 
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdfKate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdfAmazon Web Services
 
Deep Learning with Apache MXNet with Python
Deep Learning with Apache MXNet with Python Deep Learning with Apache MXNet with Python
Deep Learning with Apache MXNet with Python Amazon Web Services
 
How to decrease the environmental impact of your app
How to decrease the environmental impact of your appHow to decrease the environmental impact of your app
How to decrease the environmental impact of your appCarsonified Team
 
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot InstancesAWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot InstancesAmazon Web Services
 
AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)
AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)
AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)Carlos Cortez Senior Cloud Architect
 
AWS Perú Meetup - Arquitecting for HA by Raul Hugo
AWS Perú Meetup - Arquitecting for HA by Raul HugoAWS Perú Meetup - Arquitecting for HA by Raul Hugo
AWS Perú Meetup - Arquitecting for HA by Raul HugoCarlos Cortez Senior Cloud Architect
 
Optimize your machine learning workloads on AWS (March 2019)
Optimize your machine learning workloads on AWS (March 2019)Optimize your machine learning workloads on AWS (March 2019)
Optimize your machine learning workloads on AWS (March 2019)Julien SIMON
 
AWS Spot infographic
AWS Spot infographicAWS Spot infographic
AWS Spot infographicCMPUTE
 
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)Julien SIMON
 
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)Julien SIMON
 
Use Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition SystemUse Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition SystemAmazon Web Services
 
AWS Summit Singapore 2019 | Build a Unified Cloud
AWS Summit Singapore 2019 | Build a Unified CloudAWS Summit Singapore 2019 | Build a Unified Cloud
AWS Summit Singapore 2019 | Build a Unified CloudAWS Summits
 
RightScale Minneapolis Lightning Talk
RightScale Minneapolis Lightning TalkRightScale Minneapolis Lightning Talk
RightScale Minneapolis Lightning TalkIntel Corporation
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computingaseemsidhu
 

Mais conteúdo relacionado

Mais procurados

Building machine learning inference pipelines at scale (March 2019)
Building machine learning inference pipelines at scale (March 2019)Building machine learning inference pipelines at scale (March 2019)
Building machine learning inference pipelines at scale (March 2019)Julien SIMON
 
The Esri / Google Treaty: How to Power Your New Mapping Options
The Esri / Google Treaty: How to Power Your New Mapping OptionsThe Esri / Google Treaty: How to Power Your New Mapping Options
The Esri / Google Treaty: How to Power Your New Mapping OptionsSafe Software
 
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdfKate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdfAmazon Web Services
 
Deep Learning with Apache MXNet with Python
Deep Learning with Apache MXNet with Python Deep Learning with Apache MXNet with Python
Deep Learning with Apache MXNet with Python Amazon Web Services
 
How to decrease the environmental impact of your app
How to decrease the environmental impact of your appHow to decrease the environmental impact of your app
How to decrease the environmental impact of your appCarsonified Team
 
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot InstancesAWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot InstancesAmazon Web Services
 
Optimize your machine learning workloads on AWS (March 2019)
Optimize your machine learning workloads on AWS (March 2019)Optimize your machine learning workloads on AWS (March 2019)
Optimize your machine learning workloads on AWS (March 2019)Julien SIMON
 
AWS Spot infographic
AWS Spot infographicAWS Spot infographic
AWS Spot infographicCMPUTE
 
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)Julien SIMON
 
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)Julien SIMON
 
Use Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition SystemUse Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition SystemAmazon Web Services
 
AWS Summit Singapore 2019 | Build a Unified Cloud
AWS Summit Singapore 2019 | Build a Unified CloudAWS Summit Singapore 2019 | Build a Unified Cloud
AWS Summit Singapore 2019 | Build a Unified CloudAWS Summits
 
RightScale Minneapolis Lightning Talk
RightScale Minneapolis Lightning TalkRightScale Minneapolis Lightning Talk
RightScale Minneapolis Lightning TalkIntel Corporation
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computingaseemsidhu
 

Mais procurados (17)

Dba Tools for Azure
Dba Tools for AzureDba Tools for Azure
Dba Tools for Azure
 
Building machine learning inference pipelines at scale (March 2019)
Building machine learning inference pipelines at scale (March 2019)Building machine learning inference pipelines at scale (March 2019)
Building machine learning inference pipelines at scale (March 2019)
 
The Esri / Google Treaty: How to Power Your New Mapping Options
The Esri / Google Treaty: How to Power Your New Mapping OptionsThe Esri / Google Treaty: How to Power Your New Mapping Options
The Esri / Google Treaty: How to Power Your New Mapping Options
 
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdfKate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
Kate Werling - Build text analytics solutions with AWS ML Services (300) _BP.pdf
 
Deep Learning with Apache MXNet with Python
Deep Learning with Apache MXNet with Python Deep Learning with Apache MXNet with Python
Deep Learning with Apache MXNet with Python
 
How to decrease the environmental impact of your app
How to decrease the environmental impact of your appHow to decrease the environmental impact of your app
How to decrease the environmental impact of your app
 
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot InstancesAWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
AWS Compute Evolved Week: Cost Optimize EC2 with Amazon EC2 Spot Instances
 
AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)
AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)
AWS Peru Meetup - recap reinvent 2016 (by Carlos Cortez)
 
AWS Perú Meetup - Arquitecting for HA by Raul Hugo
AWS Perú Meetup - Arquitecting for HA by Raul HugoAWS Perú Meetup - Arquitecting for HA by Raul Hugo
AWS Perú Meetup - Arquitecting for HA by Raul Hugo
 
Optimize your machine learning workloads on AWS (March 2019)
Optimize your machine learning workloads on AWS (March 2019)Optimize your machine learning workloads on AWS (March 2019)
Optimize your machine learning workloads on AWS (March 2019)
 
AWS Spot infographic
AWS Spot infographicAWS Spot infographic
AWS Spot infographic
 
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
Build, train and deploy Machine Learning models on Amazon SageMaker (May 2019)
 
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
Deep Learning with TensorFlow and Apache MXNet on Amazon SageMaker (March 2019)
 
Use Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition SystemUse Amazon Rekognition to Build a Facial Recognition System
Use Amazon Rekognition to Build a Facial Recognition System
 
AWS Summit Singapore 2019 | Build a Unified Cloud
AWS Summit Singapore 2019 | Build a Unified CloudAWS Summit Singapore 2019 | Build a Unified Cloud
AWS Summit Singapore 2019 | Build a Unified Cloud
 
RightScale Minneapolis Lightning Talk
RightScale Minneapolis Lightning TalkRightScale Minneapolis Lightning Talk
RightScale Minneapolis Lightning Talk
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 

Elastic Map Reduce 101

  • 1. Intro to Using Hadoop on Amazon Cloud Ajay Ohri
  • 4. Sample App- Big Data Web Analytics
  • 5.   Specify Location
  • 6.
  • 7. Specifying Instances
  • 9.
  • 10.
  • 11.
  • 12. Next  Running R on Hadoop on Amazon EMR (for ordinary people!)  Wishlist- Easier Tutorials on Running optimized Parallel Processing on Big Data Jobs using Amazon EMR and R – http://jeffreybreen.wordpress.com/2012/03/10/big-data-step-by-step-slides/  Also see -segue package tutorial  http://jeffreybreen.wordpress.com/2011/01/10/segue-r-to-amazon-elastic-mapreduce-hadoop/