Yahoo! Scalable Storage and Delivery Services

•

10 gostaram•2,058 visualizações

From Chuck Neerdaels' presentation "Yahoo! Scalable Storage and Delivery Services" at the 2009 Cloud Computing Expo in Santa Clara, CA, USA. Here's the talk description on the Expo's site: http://cloudcomputingexpo.com/event/session/541

Tecnologia

Chuck Neerdaels VP of Storage and Edge Services Y! Scalable Storage and Delivery Service

Cloud Storage & Edge Services Overview ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

CS&E cont. ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Typical Use Cases User Data and Preferences Image/Video Storage & Delivery RSS Feeds Caching, Load Balancing

Want a real demo? Sports.yahoo.com Travel.yahoo.com Finance.yahoo.com Mail.yahoo.com News.yahoo.com *.yahoo.com

Infrastructure and Platform Service Reality ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

But what if they didn’t… ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],Yahoo! sites would become stale, boring, slow, non-profitable, or non-existent

What Makes an On-line Cloud Service at Y!… Global

Internal Expectations ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Common Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object]

MObStor: Blowing Through the Cloudiness Global Servers Caching Protocol Termination Authentication Content Routing Local Servers Auto Expiration De-duplication Object Placement Re-replication

MObStor: Trying to Increase 9’s DNS GSLB Hardware VIP Scalable Session Manager Internal DNS with Load Feedback Hardware VIP Local Replication Global Replication Separate Metadata Replication

Sherpa/PNUTs DNS GSLB Hardware VIP Scalable Router & Session Manager Consistency vs. Availability Knobs Local Replication Global Replication Ordered Messaging

Physics and Economics for a Global Cloud…

What’s your target SLA? 0 Distance between producer/consumer *Illustrative, and not intended to portray reality Latency Speed of light + network degradation

What’s your budget? Latency Replication Costs *Illustrative, and not intended to portray reality $$$ $

Lessons Learned ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Why would any of you care about a Y! proprietary cloud?

Committed to Open Source ,[object Object],[object Object],[object Object],[object Object]

[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Questions? Y! Scalable Storage and Delivery Service

Mais conteúdo relacionado

Semelhante a Yahoo! Scalable Storage and Delivery Services

Compare Clustering Methods for MS SQL ServerAlexDepo

CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...Adrian Cockcroft

Lightning talksSkills Matter

Sampling from the Cloud SmorgasbordJim O'Neil

Concurrency presents Modern DatacenterJake Borzym

Designing for the Cloud Tutorial - QCon SF 2009Stuart Charlton

Cloud Spotting 2017: An overview of cloud computingPatrice Kerremans

Data Center 3.0 Star TrekBill Petro

Solving enterprise challenges through scale out storage & big compute finalAvere Systems

Introduction to Azure DocumentDBDenny Lee

Tuenti teams - Php ConferenceGuille -bisho-

Farms, Fabrics and CloudsSteve Loughran

Handling Data in Mega Scale SystemsDirecti Group

How to Think Multi-CloudRightScale

Introduction to Cloud computingMathews Job

BigData & CDN - OOP2011 (Pavlo Baron)Pavlo Baron

Concurrency presents Modern DatacenterConcurrency, Inc.

Tuenti Tech Teams. Frontend, Backend, Systems and more, working togetherTuenti

TenT-Day01.pptxJohanMyburgh15

TenT-Day01.pptxJohan Myburgh

Semelhante a Yahoo! Scalable Storage and Delivery Services (20)

Compare Clustering Methods for MS SQL Server

CMG2013 Workshop: Netflix Cloud Native, Capacity, Performance and Cost Optimi...

Lightning talks

Sampling from the Cloud Smorgasbord

Concurrency presents Modern Datacenter

Designing for the Cloud Tutorial - QCon SF 2009

Cloud Spotting 2017: An overview of cloud computing

Data Center 3.0 Star Trek

Solving enterprise challenges through scale out storage & big compute final

Introduction to Azure DocumentDB

Tuenti teams - Php Conference

Farms, Fabrics and Clouds

Handling Data in Mega Scale Systems

How to Think Multi-Cloud

Introduction to Cloud computing

BigData & CDN - OOP2011 (Pavlo Baron)

Concurrency presents Modern Datacenter

Tuenti Tech Teams. Frontend, Backend, Systems and more, working together

TenT-Day01.pptx

Mais de Yahoo Developer Network

Developing Mobile Apps for Performance - Swapnil Patel, Verizon MediaYahoo Developer Network

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...Yahoo Developer Network

Athenz & SPIFFE, Tatsuya Yano, Yahoo JapanYahoo Developer Network

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...Yahoo Developer Network

CICD at Oath using ScrewdriverYahoo Developer Network

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, OathYahoo Developer Network

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenuYahoo Developer Network

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, AmpoolYahoo Developer Network

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...Yahoo Developer Network

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...Yahoo Developer Network

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, OathYahoo Developer Network

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...Yahoo Developer Network

Moving the Oath Grid to Docker, Eric Badger, OathYahoo Developer Network

Architecting Petabyte Scale AI ApplicationsYahoo Developer Network

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...Yahoo Developer Network

Jun 2017 HUG: YARN Scheduling – A Step BeyondYahoo Developer Network

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies Yahoo Developer Network

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...Yahoo Developer Network

February 2017 HUG: Exactly-once end-to-end processing with Apache ApexYahoo Developer Network

February 2017 HUG: Data Sketches: A required toolkit for Big Data AnalyticsYahoo Developer Network

Mais de Yahoo Developer Network (20)

Developing Mobile Apps for Performance - Swapnil Patel, Verizon Media

Athenz - The Open-Source Solution to Provide Access Control in Dynamic Infras...

Athenz & SPIFFE, Tatsuya Yano, Yahoo Japan

Athenz with Istio - Single Access Control Model in Cloud Infrastructures, Tat...

CICD at Oath using Screwdriver

Big Data Serving with Vespa - Jon Bratseth, Distinguished Architect, Oath

How @TwitterHadoop Chose Google Cloud, Joep Rottinghuis, Lohit VijayaRenu

The Future of Hadoop in an AI World, Milind Bhandarkar, CEO, Ampool

Apache YARN Federation and Tez at Microsoft, Anupam Upadhyay, Adrian Nicoara,...

Containerized Services on Apache Hadoop YARN: Past, Present, and Future, Shan...

HDFS Scalability and Security, Daryn Sharp, Senior Engineer, Oath

Hadoop {Submarine} Project: Running deep learning workloads on YARN, Wangda T...

Moving the Oath Grid to Docker, Eric Badger, Oath

Architecting Petabyte Scale AI Applications

Introduction to Vespa – The Open Source Big Data Serving Engine, Jon Bratseth...

Jun 2017 HUG: YARN Scheduling – A Step Beyond

Jun 2017 HUG: Large-Scale Machine Learning: Use Cases and Technologies

February 2017 HUG: Slow, Stuck, or Runaway Apps? Learn How to Quickly Fix Pro...

February 2017 HUG: Exactly-once end-to-end processing with Apache Apex

February 2017 HUG: Data Sketches: A required toolkit for Big Data Analytics

Último

Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software

SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j

Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst

Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies

08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls

How to Remove Document Management Hurdles with X-Docs?XfilesPro

Salesforce Community Group Quito, Salesforce 101Paola De la Torre

IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge

WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j

Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106

Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

How to convert PDF to text with Nanonetsnaman860154

Pigging Solutions in Pet Food ManufacturingPigging Solutions

GenCyber Cyber Security Day PresentationMichael W. Hawkins

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski

Install Stable Diffusion in windows machinePadma Pradeep

Yahoo! Scalable Storage and Delivery Services

1. Chuck Neerdaels VP of Storage and Edge Services Y! Scalable Storage and Delivery Service

4. Typical Use Cases User Data and Preferences Image/Video Storage & Delivery RSS Feeds Caching, Load Balancing

5. A Quick Demo…

7. more cute puppy photos

9. Want a real demo? Sports.yahoo.com Travel.yahoo.com Finance.yahoo.com Mail.yahoo.com News.yahoo.com *.yahoo.com

10.

11.

12. What Makes an On-line Cloud Service at Y!… Global

13.

14.

15. A Little More Detail: MObStor & Sherpa

16. MObStor: Blowing Through the Cloudiness Global Servers Caching Protocol Termination Authentication Content Routing Local Servers Auto Expiration De-duplication Object Placement Re-replication

17. MObStor: Trying to Increase 9’s DNS GSLB Hardware VIP Scalable Session Manager Internal DNS with Load Feedback Hardware VIP Local Replication Global Replication Separate Metadata Replication

18. Sherpa/PNUTs

19. Sherpa/PNUTs DNS GSLB Hardware VIP Scalable Router & Session Manager Consistency vs. Availability Knobs Local Replication Global Replication Ordered Messaging

20. Physics and Economics for a Global Cloud…

21. What’s your target SLA? 0 Distance between producer/consumer *Illustrative, and not intended to portray reality Latency Speed of light + network degradation

22. What’s your budget? Latency Replication Costs *Illustrative, and not intended to portray reality $$$ $

23.

24. Why would any of you care about a Y! proprietary cloud?

25.

26.

27. Questions? Y! Scalable Storage and Delivery Service

Notas do Editor

Online

Yahoo! Scalable Storage and Delivery Services

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a Yahoo! Scalable Storage and Delivery Services

Semelhante a Yahoo! Scalable Storage and Delivery Services (20)

Mais de Yahoo Developer Network

Mais de Yahoo Developer Network (20)

Último

Último (20)

Yahoo! Scalable Storage and Delivery Services

Notas do Editor