Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power by Windows Azure.

1. Ionut Antiu www.get-jukebox.com @johnnyantiu

2. Style Jukebox is a High Fidelity cloud-music streaming service that helps you keep all your music – be it bought, self-produced, or imported from CDs or other media, always backed up and synced across all your devices.

3. FREE PREMIUM Start with 250 songs free (~1.5 GB) Earn up to 3,000 songs for free (18 GB) Add storage for 25,000 songs (~120GB – 1 TB) Hi-Fi Sound Quality MP3, AAC, WMA, OGG +Lossless (FLAC, M4A- ALAC) Free, with NO ADS $24.99 / year or $2.99 / month 30 MB limit / song 1GB limit / song

4. TRACTION 120,000+ registered users 50,000+ MAU Peak of 12,000 users DAU 4,5+ million songs stored in the Cloud 50,000 – 100,000 songs listened daily

5. Web Player Windows Player iPhone Android Windows Phone

6. Technology Windows App C#, WPF iPhone App Objective-C Windows Phone App C#, Silverlight Android App Java Cloud Meta Service API Fast, Sync, Gets 8-core just fine with auto scale Azure, C#, REST Interface, JSON Block Service API Upload, Download, Transcoding, etc. 4-core standby with auto scale Azure, C#, REST, JSON, Streaming Memcache 1 GB Redis Azure, C# Database SQL Azure Premium Windows Azure Storage 30 TB REST Import API 800k songs imported Memcache Worker >= 2 instances Import Worker >= 2 instances Traffic manager Load Balancer | CDN Web Player AngularJS File operations Ex. Index >= 4 instances

7. SCALE?! Because it doesn’t just work!

8. Growing pains

9. Scale Up Scale Out Database, API, Content bandwidth, Website

10. Scale Up One operation that cannot be divided requires more compute power (Audio/Video encoding, Your own DB, etc.) Basic A1 1 Core AMD CPU 1,75 GB RAM EUR 41/month* G5, 32 cores Intel Xeon 448 GB RAM 6 TB EUR 4865/month*

11. Scale Out Used for API, Website, etc. Ex: Each machine can have a limited number of connected users Basic A1 1 Core AMD CPU 1,75 GB RAM EUR 41/month* 4x Basic A1 1 Core AMD CPU 1,75 GB RAM EUR 41/month*

12. Load Balancer Integrated in the Azure Cloud Services Makes sure all instances have the same load Auto-Scale creates new instances or removes automatically

13. Technology Windows App C#, WPF iPhone App Objective-C Windows Phone App C#, Silverlight Android App Java Cloud Meta Service API Fast, Sync, Gets 8-core just fine with auto scale Azure, C#, REST Interface, JSON Block Service API Upload, Download, Transcoding, etc. 4-core standby with auto scale Azure, C#, REST, JSON, Streaming Memcache 1 GB Redis Azure, C# Database SQL Azure Premium Windows Azure Storage 30 TB REST Import API (Dropbox, OneDrive, Google Drive) 800k songs imported Memcache Worker >= 2 instances Import Worker >= 2 instances Traffic manager Load Balancer | CDN Web Player AngularJS File operations Ex. Index >= 4 instances

16. How to test?

20. Test 1 1,000 concurrent users 1 core machine

24. Test 2 1,000 concurrent users 4 core machine $ 0,4 more per hour

27. Autoscale applies to Cloud Services and Websites 1 core machine can handle 200 connections simultaneous 4 core machine can handle 1,000 connections simultaneous

28. Load balanced. > Traffic manager

29. Traffic Manager stylejukebox.trafficmanager.net 4 VM machines in West Europe 4 VM machines in West US Closest location to the user Load balancing Fail-over Works for Websites, Cloud Services

31. Azure Datacenters

33. Storage 20 Gbps in 30 Gbps out Locally, Geo redundant Optional SSD -> Scale with CDN

34. Azure Datacenters

35. Azure CDN Multiplies content in the region Ex: Storage account from Amsterdam are multiplied in CDNs from Amsterdam, London, Frankfurt, Milan, Paris You have to manage which content is multiplied where. Cost: EUR 0,06 / GB out CDN compared to EUR 0,015 / GB just stored

36. SQL Azure vs Microsoft SQL Server

37. Scale SQL Database

38. SQL Azure Performance

39. SQL Azure Performance

40. Scale Up I don’t recommend this  as a scale strategy Basic 5 DTU 30 concurrent request Good predictability EUR 4 / month Premium P3 1,000 DTU SSD, Faster CPU Max 500 GB size EUR 2,800 / month

41. Scale Out I RECOMMEND this as a scale strategy (Should not be the only one) The right DB for you P2, 200 DPU EUR 700 / month RAM in the Cloud Pre-compiled answers Store JSON, Bytes, etc. From 250 MB to 53 GB per Cache We use 1 GB – EUR 80 / month

42. The Memcache Worker predicts and prepares the results Memcache Hit Ratio 86-91% Reduced time of response with 80% to an average of 250ms

43. Monitoring

44. NewRelic

48. Always prepare for things to go wrong Ex: Routers on the Internet

50. Ionut Antiu www.get-jukebox.com @johnnyantiu

Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power by Windows Azure.

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power by Windows Azure.

Semelhante a Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power by Windows Azure. (20)

Último

Último (20)

Scaling our app to 100k users. Use case: Style Jukebox Cloud Player - Power by Windows Azure.