O slideshow foi denunciado.
Utilizamos seu perfil e dados de atividades no LinkedIn para personalizar e exibir anúncios mais relevantes. Altere suas preferências de anúncios quando desejar.

NDBench: Benchmarking Microservices at Scale

152 visualizações

Publicada em

Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2n1fqWa.

Vinay Chella and Ioannis Papapanagiotou designed a benchmarking system for Netflix's Cloud platform that can mimic the performance of production use cases. They showcase how the deployment, management, and monitoring of multiple instances can be done from a single entry-point (UI). They also show how they integrated a benchmarking tool into their release lifecycle. Filmed at qconsf.com.

Vinay Chella is a Cloud Data Architect at Netflix and Apache Cassandra MVP. Ioannis Papapanagiotou is a senior software engineer at Netflix’s Cloud Database Engineering team.

Publicada em: Tecnologia
  • Seja o primeiro a comentar

  • Seja a primeira pessoa a gostar disto

NDBench: Benchmarking Microservices at Scale

  1. 1. InfoQ.com: News & Community Site • Over 1,000,000 software developers, architects and CTOs read the site world- wide every month • 250,000 senior developers subscribe to our weekly newsletter • Published in 4 languages (English, Chinese, Japanese and Brazilian Portuguese) • Post content from our QCon conferences • 2 dedicated podcast channels: The InfoQ Podcast, with a focus on Architecture and The Engineering Culture Podcast, with a focus on building • 96 deep dives on innovative topics packed as downloadable emags and minibooks • Over 40 new content items per week Watch the video with slide synchronization on InfoQ.com! https://www.infoq.com/presentations/ ndbench-neflix-cloud-performance
  2. 2. Purpose of QCon - to empower software development by facilitating the spread of knowledge and innovation Strategy - practitioner-driven conference designed for YOU: influencers of change and innovation in your teams - speakers and topics driving the evolution and innovation - connecting and catalyzing the influencers and innovators Highlights - attended by more than 12,000 delegates since 2007 - held in 9 cities worldwide Presented at QCon San Francisco www.qconsf.com
  3. 3. Netflix Data Benchmark (NDBench)
  4. 4. Circa end of 2015 AD
  5. 5. Netflix Data Benchmark (NDBench)
  6. 6. Vinay Chella Ioannis Papapanagiotou Architects Cloud Database Engineering @ Netflix
  7. 7. Databases and Caches
  8. 8. ● Tens of petabytes of data ● Trillions of ops / day ● Tens of Millions of replications / sec ● Tens of Thousands of servers ● Hundreds of microservice clients Netflix Data Scale
  9. 9. Agenda ● ● ● ● ●
  10. 10. Our Needs ● Single benchmark framework for all data stores/services ● Dynamic configuration while the test is running. ● Test a platform along with production microservices ● Integrate with other platform cloud services ● Pluggable patterns and loads ● Auto tunable framework ● Run infinite horizon tests
  11. 11. What is NDBench?
  12. 12. ● ● ● ● NDBench allows
  13. 13. NDBench Features
  14. 14. Side-by-Side comparison
  15. 15. Varying Data Models
  16. 16. Different instance types
  17. 17. Heterogeneous service comparison
  18. 18. Workload Patterns and Loads
  19. 19. Different Client APIs
  20. 20. Cloud Ecosystem integration Cloud Discovery Properties Metrics
  21. 21. Agenda ● ● ● ● ●
  22. 22. Architecture ● Plugin: Adding Client drivers ● Core: Workload generator ● Web: UI and the servlets
  23. 23. What is Pluggable? • •
  24. 24. Load Patterns • ○ • ○
  25. 25. Configuring a cluster
  26. 26. Continuous Delivery Integration
  27. 27. NDBench exemplar uses
  28. 28. C*
  29. 29. C* 7 to 8 (reads)
  30. 30. i2 vs i3 instance type
  31. 31. SSD Tuning
  32. 32. CMS vs G1GC for Cassandra
  33. 33. AMI Certification Process
  34. 34. Throughput Scalability
  35. 35. Latency
  36. 36. • Benchmarking Tool • Integration Tests • Deployment Validation NDBench @ Netflix as ...
  37. 37. Auto-tuning ● Find the appropriate capacity that the cluster can sustain ○ RPS/WPS ○ Number of documents indexed/sec ● After X% of SLA violations, NDBench stops stepping up the load ○ Exponential backoff
  38. 38. Github: https://github.com/netflix/ndbench Talk to us: https://gitter.im/Netflix/ndbench
  39. 39. Take away
  40. 40. Q & A Vinay Chella - @vinaykchella Ioannis Papapanagiotou - @ipapapa
  41. 41. Architecture ● Core: Workload generator ● API: Adding plugins ● Web: UI and the servlets
  42. 42. Watch the video with slide synchronization on InfoQ.com! https://www.infoq.com/presentations/ ndbench-neflix-cloud-performance

×