Case Study of Sound Cloud Architecture

•Transferir como PPTX, PDF•

1 gostou•872 visualizações

Chinh Ngo Nguyen

Case Study of SoundCloud's Archiecture

Tecnologia

SoundCloud’s Architecture
Ngo Nguyen Chinh
Ha Noi 2016

Web Server
• The early days of SoundCloud, using Apache to serve the image/style/behavior
resources
• Then, replaced Apache with Nginx and reduced a web tier’s conguration
complexity

Load distribution
• HAProxy was added into SoundCloud infrastructure, and it entered as Queuing
Load Balancer
• Apply queue theory to solve “head of the line blocking”

Going Asynchronous
• Coordinating these subsystems, SoundCloud need some middleware that would
reliably queue, acknowledge and re-delivery job tickes on failure
• Using AMQP, implemeted by RabbitMQ

Caching
• Using Memcached to alleviate IO contention in the database like most
applications
• Add Varnish to handle backend partially rendered template caching and mostly
read-only APU responses

Dashboard
• Chose Cassandra as the storage system for the Dashboard index

Search
• Using Elastic Search for managing index storage

References
https://developers.soundcloud.com/blog/evolution-of-soundclouds-architecture

Mais conteúdo relacionado

Mais procurados

Kubernetes talk at DDDSydney 2017Hesham Amin

StreamSQL Feature Store (Apache Pulsar Summit)Simba Khadder

The Need for Speed - EpiCenter 2010Phil Pursglove

Openstack heat & How Autoscaling worksCoreStack

Apache Con 2021 Structured Data StreamingShivji Kumar Jha

Architecture of Falcon, a new chat messaging backend system build on ScalaTanUkkii

Velocity - Edge UGPhil Pursglove

Datacenter Computing and Resource Management Using Apache MesosSigmoid

Heat monasca auto scaleKanagaraj M

Training And Serving ML Model Using Kubeflow by Jayesh SharmaCodeOps Technologies LLP

The Need For Speed - NxtGen CambridgePhil Pursglove

AnchalResumeAnchal Sharma

(ATS6-PLAT06) Maximizing AEP PerformanceBIOVIA

The Need For Speed - NEBytesPhil Pursglove

Spark Hsinchu meetupYung-An He

Apache kafkaRamakrishna kapa

SpringPeople Introduction to MongoDB AdministrationSpringPeople

Infrastructure Automation on AWS using a Real-World Customer ExampleAPI Talent

SAP on Azure Web Dispatcher High AvailabilityGary Jackson MBCS

Mais procurados (19)

Kubernetes talk at DDDSydney 2017

StreamSQL Feature Store (Apache Pulsar Summit)

The Need for Speed - EpiCenter 2010

Openstack heat & How Autoscaling works

Apache Con 2021 Structured Data Streaming

Architecture of Falcon, a new chat messaging backend system build on Scala

Velocity - Edge UG

Datacenter Computing and Resource Management Using Apache Mesos

Heat monasca auto scale

Training And Serving ML Model Using Kubeflow by Jayesh Sharma

The Need For Speed - NxtGen Cambridge

AnchalResume

(ATS6-PLAT06) Maximizing AEP Performance

The Need For Speed - NEBytes

Spark Hsinchu meetup

Apache kafka

SpringPeople Introduction to MongoDB Administration

Infrastructure Automation on AWS using a Real-World Customer Example

SAP on Azure Web Dispatcher High Availability

Destaque

Patterns of enterprise application architectureChinh Ngo Nguyen

Software architectureVolodymyr Yelchev

Frank Gehry: Study & ResearchNicholas Socrates

Frank o gehryShivani Choudhary

Business Model - AirbnbThiago Paiva

REST & RESTful Web ServicesHalil Burak Cetinkaya

The Evolution of Airbnb's FrontendSpike Brehm

Destaque (7)

Patterns of enterprise application architecture

Software architecture

Frank Gehry: Study & Research

Frank o gehry

Business Model - Airbnb

REST & RESTful Web Services

The Evolution of Airbnb's Frontend

Semelhante a Case Study of Sound Cloud Architecture

webserversEwere Diagboya

Stacktician - CloudStack Collab Conference 2014amoghvk

Maximilian Michels - Flink and BeamFlink Forward

EventHub for kafka ecosystems kafka meetupNitin Kumar

Migrating to awsIT Expert Club

Spark Resource ManagerShad Amez

Play Architecture, Implementation, Shiny Objects, and a ProposalMike Slinn

Prashant Vichare ResumePrashant Vichare

Eclipse Enterprise Content Repository (ECR)Florent Guillaume

Roshan Bhattarai: Scaling WordPress for high traffic siteswpnepal

Scaling wordpress for high trafficRoshan Bhattarai

Using the SDACK Architecture to Build a Big Data ProductEvans Ye

Meetup #3: Migrate a fast scale system to AWSAWS Vietnam Community

Caching strategies with luceeGert Franz

Operating OpenStack - Case Study in the Rackspace CloudRainya Mosher

Lopez deploying openstacktrunk_20130416OpenStack Foundation

Machine Learning Trends of 2018 combined with the Apache Kafka EcosystemKai Wähner

Leveraging OpenStack to Run Mesos/Marathon at Charter CommunicationsTesora

AWS re:Invent 2016: Accenture Cloud Platform Serverless Journey (ARC202)Amazon Web Services

Wikipedia Cloud Search WebinarSearch Technologies

Semelhante a Case Study of Sound Cloud Architecture (20)

webservers

Stacktician - CloudStack Collab Conference 2014

Maximilian Michels - Flink and Beam

EventHub for kafka ecosystems kafka meetup

Migrating to aws

Spark Resource Manager

Play Architecture, Implementation, Shiny Objects, and a Proposal

Prashant Vichare Resume

Eclipse Enterprise Content Repository (ECR)

Roshan Bhattarai: Scaling WordPress for high traffic sites

Scaling wordpress for high traffic

Using the SDACK Architecture to Build a Big Data Product

Meetup #3: Migrate a fast scale system to AWS

Caching strategies with lucee

Operating OpenStack - Case Study in the Rackspace Cloud

Lopez deploying openstacktrunk_20130416

Machine Learning Trends of 2018 combined with the Apache Kafka Ecosystem

Leveraging OpenStack to Run Mesos/Marathon at Charter Communications

AWS re:Invent 2016: Accenture Cloud Platform Serverless Journey (ARC202)

Wikipedia Cloud Search Webinar

Último

Understanding the Laravel MVC ArchitecturePixlogix Infotech

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

Pigging Solutions in Pet Food ManufacturingPigging Solutions

Salesforce Community Group Quito, Salesforce 101Paola De la Torre

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

A Domino Admins Adventures (Engage 2024)Gabriella Davis

[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745

Benefits Of Flutter Compared To Other FrameworksSoftradix Technologies

My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar

Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst

How to convert PDF to text with Nanonetsnaman860154

Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies

SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j

Key Features Of Token Development (1).pptxLBM Solutions

Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software

Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

Pigging Solutions Piggable Sweeping ElbowsPigging Solutions

Case Study of Sound Cloud Architecture

1. SoundCloud’s Architecture Ngo Nguyen Chinh Ha Noi 2016

2. Overview

3. Web Server • The early days of SoundCloud, using Apache to serve the image/style/behavior resources • Then, replaced Apache with Nginx and reduced a web tier’s conguration complexity

4. Load distribution • HAProxy was added into SoundCloud infrastructure, and it entered as Queuing Load Balancer • Apply queue theory to solve “head of the line blocking”

5. Going Asynchronous • Coordinating these subsystems, SoundCloud need some middleware that would reliably queue, acknowledge and re-delivery job tickes on failure • Using AMQP, implemeted by RabbitMQ

6. Caching • Using Memcached to alleviate IO contention in the database like most applications • Add Varnish to handle backend partially rendered template caching and mostly read-only APU responses

7. Dashboard • Chose Cassandra as the storage system for the Dashboard index

8. Search • Using Elastic Search for managing index storage

9. Notifications and Stats •

10. References https://developers.soundcloud.com/blog/evolution-of-soundclouds-architecture

11. Thanks!

Case Study of Sound Cloud Architecture

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (19)

Destaque

Destaque (7)

Semelhante a Case Study of Sound Cloud Architecture

Semelhante a Case Study of Sound Cloud Architecture (20)

Último

Último (20)

Case Study of Sound Cloud Architecture

Notas do Editor