Mais conteúdo relacionado

Similar a Technology stack of social networks [MTS](20)


Technology stack of social networks [MTS]

  1. social networks The technology stack of Philipp Weber HDE MTS 2015.01.23
  2. Table of Contents ● Overview ● Included networks ● The stacks ● Comments / Takeaway
  3. *Some of the displayed numbers and technologies reach back to the year of 2011. **Rights to the registered Names / Logos / Trademarks featured are property of and belong to their respective owners. Disclaimer
  4. Facebook - 1.35 billion monthly active users Tumblr - 420 million users Twitter - 284 million monthly active users LinkedIn - 300 million users Google+ - 300 million monthly active users Included Networks
  5. Frontend Backend The stack Databases Cache (Hosting) Meta Templating / Javascript Intermediate- Layer Programming Languages Server specifics Offline processing
  6. The stack - Facebook ● 864 million daily active users ● 700 million mobile daily active users
  7. Facebook Haystack (Object-store) Memcached Facebook markup Language PhpCassandra Hadoop + Hive BigPipe → pagelets Thrift Java Varnish HTTP-accel. HipHopVM - Php-compiler Frontend Backend Meta
  8. The stack - Tumblr ● Microblog / social networking website ● ~40k requests per second ● 15 billion page views per month ● belongs to Yahoo
  9. The stack - Tumblr HBase Redis (Hosting) Gearman and Kestrel PHP HA-Proxy Scala Ruby MySQL Apache Kafka Finagle Frontend Backend Meta
  10. The stack - Twitter ● 80% of Twitter active users are on mobile ● Average of ~5750 Tweets/s ● Record 143.199 Tweets/s
  11. Twitter Flock Memcached (Hosting) Bootstrap JVM Finagle Java Netty JavaScriptRedis Hadoop+ Scalding Scala Frontend Backend Meta User-Store
  12. The stack - LinkedIn ● Leader in Professional networking ● Opened their Network data to busines-research in 2008
  13. The stack - LinkedIn Oracle Voldemort Node.js Java GRails = Java-Rails Hadoop Espresso Scala JRuby JavaScript MySQLJQuery Backbone.js Frontend Backend Meta
  14. The stack - Google+ ● Build on Circle API ● Usually use special Google technology and libraries ● Close interaction with android planned
  15. The stack - Google+ BigTable Closure Java Custom JVM GoogleFile System Closure C++ PythonJQuery Frontend Backend Meta
  16. Takeaway So what can we learn from these examples?
  17. Takeaways #1 Embrace Open Source Open Source systems benefit from university research and a big community. Facebook and Twitter release or found many of their software in OpenSource projects.
  18. Takeaways #2 Scalability: Prepare for scalability starting at the foundation. Monolithic systems make rapid growth impossible or error-proned.
  19. Takeaways #3 Discover new solutions: writes a very in-depth technology-blog with interviews from tech- giants and their experiences. Definitely worth a read.
  20. Thank you for your Attention
  21. Sources Facebook Twitter Tumblr LinkedIn Google+