SlideShare uma empresa Scribd logo
1 de 10
Servers are like Bulldozers
2 ways to use R on a Virtual Machine (VM)
Clark Fitzgerald
Analyst - Cisco Business Intelligence
Rent the Bulldozer!
Economics
• Cool new server: Couple thousand dollars
• Electricity in Bay Area: $0.22 per kWh
• 800 Watts => $0.18 per hour for electricity
• Amazon 2 XL standard instance:
– 30 GB memory
– 8 Cores
– $0.18 per hour for spot instance
Case 1: Teaching
• Good for beginners
• 10 students at a time
• VM with 2 cores, 4 GB memory
Case 1: Teaching
Case 2: Automation
• Run a program on a regular basis
• Used AWS micro instance for free
• Example: Build a time series of exchange rate data
data <- readHTMLTable("http://www.x-rates.com/table/?from=USD&amount=1")
…
write.table(row, "/home/shared/barug_oct13/hourly_rate.csv",
append = TRUE, quote = FALSE, sep = ", ",
row.names = FALSE, col.names = FALSE)
Linux shell ~$crontab -e
0 * * * * sudo R CMD Batch /home/shared/barug_oct13/get_conv_rate.R
Case 2: Automation
Details:
• Case 3- High performance computing
• Amazon Web Services Elastic Compute (AWS EC2)
• Get started with Louis Aslett’s site
• Can scale up arbitrarily large
Questions?
Links:
• Everything can be found on my blog:
– http://datalearner.wordpress.com/
• http://www.louisaslett.com/RStudio_AMI/
• Electricity:
http://www.bls.gov/ro9/cpisanf_energy.pdf
• Amazon Pricing:
http://aws.amazon.com/ec2/instance-types/
• http://aws.amazon.com/ec2/pricing/#spot

Mais conteúdo relacionado

Mais procurados

21. cubic realcomplexrootscastouchpad
21. cubic realcomplexrootscastouchpad21. cubic realcomplexrootscastouchpad
21. cubic realcomplexrootscastouchpad
Media4math
 
Qtp change excel cell c olor
Qtp change excel cell c olorQtp change excel cell c olor
Qtp change excel cell c olor
Ramu Palanki
 

Mais procurados (19)

21. cubic realcomplexrootscastouchpad
21. cubic realcomplexrootscastouchpad21. cubic realcomplexrootscastouchpad
21. cubic realcomplexrootscastouchpad
 
Using Spark over Cassandra
Using Spark over CassandraUsing Spark over Cassandra
Using Spark over Cassandra
 
WebRender (MadRust)
WebRender (MadRust)WebRender (MadRust)
WebRender (MadRust)
 
Toy Model Overview
Toy Model OverviewToy Model Overview
Toy Model Overview
 
Declarative Infrastructure Tools
Declarative Infrastructure Tools Declarative Infrastructure Tools
Declarative Infrastructure Tools
 
S2
S2S2
S2
 
Cassandra at talkbits
Cassandra at talkbitsCassandra at talkbits
Cassandra at talkbits
 
Handle TBs with $1500 per month
Handle TBs with $1500 per monthHandle TBs with $1500 per month
Handle TBs with $1500 per month
 
"Metrics: Where and How", Vsevolod Polyakov
"Metrics: Where and How", Vsevolod Polyakov"Metrics: Where and How", Vsevolod Polyakov
"Metrics: Where and How", Vsevolod Polyakov
 
Everything You Wanted to Know About Overflow, Expiration and Eviction
Everything You Wanted to Know About Overflow, Expiration and EvictionEverything You Wanted to Know About Overflow, Expiration and Eviction
Everything You Wanted to Know About Overflow, Expiration and Eviction
 
Functions with heap and stack
Functions with heap and stackFunctions with heap and stack
Functions with heap and stack
 
Presto Bangalore Meetup1 Presto Raptor@ola
Presto Bangalore Meetup1 Presto Raptor@olaPresto Bangalore Meetup1 Presto Raptor@ola
Presto Bangalore Meetup1 Presto Raptor@ola
 
AWS user group September 2017 - Rob Ribeiro "Seeking Solutions for Debugging ...
AWS user group September 2017 - Rob Ribeiro "Seeking Solutions for Debugging ...AWS user group September 2017 - Rob Ribeiro "Seeking Solutions for Debugging ...
AWS user group September 2017 - Rob Ribeiro "Seeking Solutions for Debugging ...
 
Introduction to Bizur
Introduction to BizurIntroduction to Bizur
Introduction to Bizur
 
C* Summit 2013: Time-Series Metrics with Cassandra by Mike Heffner
C* Summit 2013: Time-Series Metrics with Cassandra by Mike HeffnerC* Summit 2013: Time-Series Metrics with Cassandra by Mike Heffner
C* Summit 2013: Time-Series Metrics with Cassandra by Mike Heffner
 
Resource management in the cloud
Resource management in the cloudResource management in the cloud
Resource management in the cloud
 
Remora the another asdf.
Remora the another asdf.Remora the another asdf.
Remora the another asdf.
 
BigData Middleware Landscape Infographic
BigData Middleware Landscape InfographicBigData Middleware Landscape Infographic
BigData Middleware Landscape Infographic
 
Qtp change excel cell c olor
Qtp change excel cell c olorQtp change excel cell c olor
Qtp change excel cell c olor
 

Semelhante a October 2013 BARUG Lightning Talk

Semelhante a October 2013 BARUG Lightning Talk (20)

Deep Dive on Delivering Amazon EC2 Instance Performance
Deep Dive on Delivering Amazon EC2 Instance PerformanceDeep Dive on Delivering Amazon EC2 Instance Performance
Deep Dive on Delivering Amazon EC2 Instance Performance
 
Aws meetup (sep 2015) exprimir cada centavo
Aws meetup (sep 2015)   exprimir cada centavoAws meetup (sep 2015)   exprimir cada centavo
Aws meetup (sep 2015) exprimir cada centavo
 
Future of computing is boring (and that is exciting!)
Future of computing is boring (and that is exciting!) Future of computing is boring (and that is exciting!)
Future of computing is boring (and that is exciting!)
 
AWS - an introduction to bursting (GP2 - T2)
AWS - an introduction to bursting (GP2 - T2)AWS - an introduction to bursting (GP2 - T2)
AWS - an introduction to bursting (GP2 - T2)
 
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
 
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
 
Tweaking performance on high-load projects
Tweaking performance on high-load projectsTweaking performance on high-load projects
Tweaking performance on high-load projects
 
Finding New Sub-Atomic Particles on the AWS Cloud (BDT402) | AWS re:Invent 2013
Finding New Sub-Atomic Particles on the AWS Cloud (BDT402) | AWS re:Invent 2013Finding New Sub-Atomic Particles on the AWS Cloud (BDT402) | AWS re:Invent 2013
Finding New Sub-Atomic Particles on the AWS Cloud (BDT402) | AWS re:Invent 2013
 
Kubernetes: Reducing Infrastructure Cost & Complexity
Kubernetes: Reducing Infrastructure Cost & ComplexityKubernetes: Reducing Infrastructure Cost & Complexity
Kubernetes: Reducing Infrastructure Cost & Complexity
 
AWS Lambdas are cool - Cheminfo Stories Day 1
AWS Lambdas are cool - Cheminfo Stories Day 1AWS Lambdas are cool - Cheminfo Stories Day 1
AWS Lambdas are cool - Cheminfo Stories Day 1
 
Optimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot InstancesOptimize Content Processing in the Cloud with GPU and Spot Instances
Optimize Content Processing in the Cloud with GPU and Spot Instances
 
EXPERTALKS: Nov 2012 - Web Application Clustering
EXPERTALKS: Nov 2012 - Web Application ClusteringEXPERTALKS: Nov 2012 - Web Application Clustering
EXPERTALKS: Nov 2012 - Web Application Clustering
 
PostgreSQL on AWS: Tips & Tricks (and horror stories)
PostgreSQL on AWS: Tips & Tricks (and horror stories)PostgreSQL on AWS: Tips & Tricks (and horror stories)
PostgreSQL on AWS: Tips & Tricks (and horror stories)
 
Deep Dive on Delivering Amazon EC2 Instance Performance
Deep Dive on Delivering Amazon EC2 Instance PerformanceDeep Dive on Delivering Amazon EC2 Instance Performance
Deep Dive on Delivering Amazon EC2 Instance Performance
 
Devopsconf2015 sebamontini-151117150231-lva1-app6891
Devopsconf2015 sebamontini-151117150231-lva1-app6891Devopsconf2015 sebamontini-151117150231-lva1-app6891
Devopsconf2015 sebamontini-151117150231-lva1-app6891
 
Devopsconf 2015 sebamontini
Devopsconf 2015 sebamontiniDevopsconf 2015 sebamontini
Devopsconf 2015 sebamontini
 
Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...
Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...
Flink Forward Berlin 2017: Robert Metzger - Keep it going - How to reliably a...
 
cloud conference 2013 - Infrastructure as a Service in Amazon Web Services
cloud conference 2013 - Infrastructure as a Service in Amazon Web Servicescloud conference 2013 - Infrastructure as a Service in Amazon Web Services
cloud conference 2013 - Infrastructure as a Service in Amazon Web Services
 
Aws
AwsAws
Aws
 
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
SRV402 Deep Dive on Amazon EC2 Instances, Featuring Performance Optimization ...
 

Último

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 

October 2013 BARUG Lightning Talk

  • 1. Servers are like Bulldozers 2 ways to use R on a Virtual Machine (VM) Clark Fitzgerald Analyst - Cisco Business Intelligence
  • 3. Economics • Cool new server: Couple thousand dollars • Electricity in Bay Area: $0.22 per kWh • 800 Watts => $0.18 per hour for electricity • Amazon 2 XL standard instance: – 30 GB memory – 8 Cores – $0.18 per hour for spot instance
  • 4. Case 1: Teaching • Good for beginners • 10 students at a time • VM with 2 cores, 4 GB memory
  • 6. Case 2: Automation • Run a program on a regular basis • Used AWS micro instance for free • Example: Build a time series of exchange rate data data <- readHTMLTable("http://www.x-rates.com/table/?from=USD&amount=1") … write.table(row, "/home/shared/barug_oct13/hourly_rate.csv", append = TRUE, quote = FALSE, sep = ", ", row.names = FALSE, col.names = FALSE) Linux shell ~$crontab -e 0 * * * * sudo R CMD Batch /home/shared/barug_oct13/get_conv_rate.R
  • 8. Details: • Case 3- High performance computing • Amazon Web Services Elastic Compute (AWS EC2) • Get started with Louis Aslett’s site • Can scale up arbitrarily large
  • 10. Links: • Everything can be found on my blog: – http://datalearner.wordpress.com/ • http://www.louisaslett.com/RStudio_AMI/ • Electricity: http://www.bls.gov/ro9/cpisanf_energy.pdf • Amazon Pricing: http://aws.amazon.com/ec2/instance-types/ • http://aws.amazon.com/ec2/pricing/#spot

Notas do Editor

  1. Grateful to be hereFamily does constructionWant to be statistician- graduated from Berkeley last year, took GRE’s this morningR is like a home tractorR on a server is like a bulldozer- powerful capabilitiesWhy buy a bulldozer?
  2. You can have complete control over your VMPay only while you use it
  3. Server: http://www.amazon.com/Lenovo-ThinkServer-2594A9U-E5-2620-Processors/dp/B00BGFMFGU/ref=sr_1_3?s=pc&amp;ie=UTF8&amp;qid=1380547414&amp;sr=1-3Electricity: http://www.bls.gov/ro9/cpisanf_energy.pdfAmazon Pricing: http://aws.amazon.com/ec2/instance-types/http://aws.amazon.com/ec2/pricing/#spot
  4. Students can access Rstudio from web browserNo need to install- makes it less intimidating, lowers the barCreate Linux users with standard names
  5. Push the same script out to each user’s file directorySet permissions so they can read the script but not save changesShould be using this along with a presentation tool- projector or Webex
  6. require(ggplot2)require(grid)hourly &lt;- read.csv(&quot;/home/shared/barug_oct13/hourly_rate.csv&quot;,col.names = c(&quot;time&quot;, &quot;rate&quot;),colClasses = c(&quot;POSIXct&quot;, &quot;numeric&quot;))conv.rate &lt;- ggplot(hourly, aes(time, rate)) + geom_point(size = 5, color = &quot;blue&quot;) +ggtitle(&quot;Value of Korean Won per US Dollar&quot;) + theme_gray(30) + theme(axis.title.x = element_blank(), axis.title.y = element_blank()) + theme(plot.margin = unit(c(3, 2, 1, 1), &quot;cm&quot;)) + theme(plot.title = element_text(vjust= 5))ggsave(conv.rate, file = &quot;conv_rate.jpg&quot;, width = 10, height = 6.5)