Mais conteúdo relacionado Semelhante a PLNOG 13: James Kretchmar: How Akamai scales to serve the largest events on the Internet (20) PLNOG 13: James Kretchmar: How Akamai scales to serve the largest events on the Internet2. ©2014 AKAMAI | FASTER FORWARDTM
Sochi Olympic Games 2014
Akamai Helps NBC Olympics Reach Record Digital Audience
10.8 Million Total Hours of Online Video Delivered
3. ©2014 AKAMAI | FASTER FORWARDTM
2014 Winter Olympics Overview
Customers
• NBC, TV2 Norway, France Televisions, …
• 25 customers total
Coverage
• 24/7 over 17 days
• Live streamed all 98 events
• Global audience
Media Technologies
• Delivery in all major streaming formats
• SecureHD for stream protection
• Media Analytics for QoS monitoring and post-event analysis
5. ©2014 AKAMAI | FASTER FORWARDTM
Peak Sochi Events
http://www.multichannel.com/distribution/us
-canada-men%E2%80%99s-hockey-semifinal-
sets-streaming-record-nbc-sports-digital/
148448
6. ©2014 AKAMAI | FASTER FORWARDTM
2014 FIFA World Cup
Akamai delivered the World Cup globally
to 80+ countries
for 50+ rights holders
7. ©2014 AKAMAI | FASTER FORWARDTM
FIFA World Cup Overview
Event
• 1 Month, 32 Teams, 64 Matches, 12 Cities
Customers
• 55 Customers (25 in EMEA)
Streaming technologies:
• HLS, HDS, Smooth
• Both with and without stream security (SecureHD)
Akamai Traffic
• 6.99 Tb/s event peak = ~11,200 full DVDs per minute
• 5.3 million unique online viewers for Belgium/USA in the USA ALONE
• 47.8 average online minutes viewed for Germany vs Portugal on
WatchESPN
8. ©2014 AKAMAI | FASTER FORWARDTM
World Cup Traffic Peaks
Dramatic, Rapid Demand Spikes!
Global Demand with Regional Concentrations
http://www.akamai.com/html/ms/akamai-delivers-online-streaming-performance.
html
Wednesday,
June 25, 2014
9. ©2014 AKAMAI | FASTER FORWARDTM
Peak Perspective
7
6
5
4
3
2
1
0
Terabits per second
2010
2012
2014
10. ©2014 AKAMAI | FASTER FORWARDTM
World Cup
South
Africa
Summer
2010
Summer
Olympics
London
Summer
2012
Winter
Olympics
Sochi
Winter
2014
World Cup
Brazil
Summer
2014
1
1.8
3.1
8.4
Relative Event Size
11. ©2014 AKAMAI | FASTER FORWARDTM
The Akamai Platform
• 149,000 servers
• Located in 92 countries around the world
• Delivers over 2 trillion Internet interactions daily
• Delivers approximately 30% of all Web traffic
12. ©2014 AKAMAI | FASTER FORWARDTM
Akamai Customers
Customers on the Akamai platform include:
• All 20 top global eCommerce sites
• 96 of the top 100 online U.S. retailers (Source: Internet Retailer Magazine)
• The top 30 media & entertainment companies
• 7 of the top 10 banks (Source: The Banker)
• 9 of the top 10 largest newspapers
• 9 out of 10 top social media sites
• All of the top anti-virus companies
• One out of every three Global 500® companies (List compiled by Fortune Magazine)
15. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Centralized Deployment
Total
Traffic
10000
1000
100
10
1
Origin
Traffic
10000
1000
100
10
1
Ave Distance:HIGH
16. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Moderately Distributed Deployment
Total
Traffic
10000
1000
100
10
1
Origin
Traffic
10000
1000
100
10
1
Ave Distance:MEDIUM
17. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Highly Distributed Deployment
Total
Traffic
10000
1000
100
10
1
Origin
Traffic
10000
1000
100
10
1
Ave Distance:LOW
18. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Ave Distance vs. Deployments
Centralized
Somewhat
Distributed
Highly
Distribtued
0 200 400 600 800 1000 1200 1400 1600 1800 2000
Number of Deployments
Ave Distance
19. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Constrained peering points
12,000 networks
connected by
peering points
23. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Highly Distributed Deployment
Total
Traffic
10000
1000
100
10
1
Origin
Traffic
10000
1000
100
10
1
Ave Distance:LOW
24. ©2014 AKAMAI | FASTER FORWARDTM
Managing Load
Challenges:
• Want to send users to the “best” or “closest” server
• Need to fully utilize servers, else have to over-capacitate
• Need to predict and prevent overload
Typical CDN solution is IP Anycast
25. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
IP Anycast
10.12.4.80
10.12.4.80
10.12.4.80
10.12.4.80
10.12.4.80
10.12.4.80
10.12.4.80
10.12.4.80
26. ©2014 AKAMAI | FASTER FORWARDTM
Mechanics of fine-grained load balancing
Problems with IP Anycast:
• Doesn’t find best performance
• Doesn’t account for congestion
• Very coarse
• Won’t work for highly distributed
• Little control
Need a system with fine-grained control
• Send these users to these specific machines
27. CNAME to a special hostname that can return dynamic answers
©2014 AKAMAI | FASTER FORWARDTM
DNS based load-balancing
www.example.com CNAME www.example.com.edgesuite.net
www.example.com.edgesuite.net CNAME a1782.g.akamai.net
a1782.g.akamai.net A 10.7.20.66
A 10.7.20.70
static
dynamic
Now we can choose exactly which servers for which end-users
28. ©2014 AKAMAI | FASTER FORWARDTM
Fine-grained load-balancing
Being able to choose specific servers means:
• Possible to drive close to 100% utilization
• No excess capacity necessary
• Can deal with huge traffic spikes
• Best end user performance
• Can find and route around problems
29. ©2014 AKAMAI | FASTER FORWARDTM
Intelligent Algorithms
Full control is good, but only if you know what to do with it …
• Understand the structure of the Internet
• Measure performance between servers and end users in real time
• Assign to the best performing server
• But with fairness if the best would be overloaded
Load vs. Demand
• When a request comes in we don’t know how “heavy” it will be
• Or on what resource
• Must adaptively measure, adjust and predict with a load feedback controller
32. ©2014 AKAMAI | FASTER FORWARDTM
Reliability = Scalability
The cost of redundancy
• Anything that can break needs a backup
• Requires some extra resources in the system
• If small failures cause large failures, less capacity is available
• For effective use of large capacity, must minimize impact of small failures
• Like RAID for disks
Akamai reliability
• Reliability built in layer upon layer
• Each deployment acts like one big cache, but take a closer look …
33. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Highly Distributed Deployment
Total
Traffic
10000
1000
100
10
1
Origin
Traffic
10000
1000
100
10
1
Ave Distance:LOW
34. ©2014 AKAMAI | FASTER FORWARDTM
Akamai reliability
Within a deployment of servers:
• Disk space effectively shared
• Customers are striped across servers
• Dynamically use more servers if customer load is high
• If a server fails:
•Reassign in a minimally impacting way (consistent hashing)
•DNS reflects the new assignments
• A “buddy” machine grabs the IP
Deployment
• Acts like one big cache
• Multiple machines can fail with no bad effect
36. 4K-UHD
HEVC/H.265
16,000-30,000
Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Quality Requires Bits
COMPRESSED BIT RATE
(Kbps)
50,00
0
40,00
0
30,00
0
20,00
0
10,00
0
0
8K-UHD
XEVC+?
50,000+
Kbps
Future
HD-1080p
AVC/H.264
7,500 Kbps
2011
HD-720p
AVC/H.264
3,500 Kbps
Kbps
2007 2013
VGA/SDTV
MPEG2-4
1,800 Kbps
2004
QVGA
MPEG1
550 Kbps
2001
37. Delivery Innovation: Akamai Media Client Technology
©2014 AKAMAI | FASTER FORWARDTM
A toolkit for the next-generation network
Akamai Media Client
Core Services
API
Cache
Hybrid
HTTP/UDP
(HHU)
Acceleration
Multicast
Delivery
Peer Assisted
Delivery
Intelligent Pre-
Positioning
38. ©2014 AKAMAI | FASTER FORWARDTM
Media Client Technology
Patent Pending
Specification and reference implementation SDK
Connected Device Stack
Application Framework
Services / Libraries
OS
App
Media Client SDK
Media Client SDK
App layer integration
Service layer
integration
Standard HTTP
App
Can be implemented at the
App Layer or the Service Layer
39. Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Akamai’s Media Client Technology Initiative
Hybrid HTTP/UDP
Residentia
l Gateway
HTTP/UDP
Unicast Acceleration
HTTP/UDP Unicast Acceleration
✔Ready to
Play Later
40. Akamai’s Media Client Technology Initiative
Multicast
100,000 Viewers
One 2 Mbps stream per viewer = 200Gbps
©2014 AKAMAI | FASTER FORWARDTM
Akamai Network
ISP Network
HTTP
Origin
Akamai Edge Server Non-Multicast Router
41. ©2014 AKAMAI | FASTER FORWARDTM
Akamai’s Media Client Technology Initiative
Multicast
Akamai Network
ISP Network
HTTP
Multicast
AMT
Origin
Akamai Edge Server Multicast Router AMT Router/Relay
42. Akamai’s Media Client Technology Initiative
Intelligent Prepositioning
Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Residentia
l Gateway
HTTP/UDP Unicast Acceleration
Multicast
Intelligent Prepositioning
Intelligent
Prepositioning
✔Ready to
Content demand is Play Later
predicted,
And content is delivered in
anticipation.
43. Akamai’s Media Client Technology Initiative
Peer Assisted Delivery
Avoid data theft and downtime by extending the
security perimeter outside the data-center and
protect from increasing frequency, scale and
sophistication of web attacks.
©2014 AKAMAI | FASTER FORWARDTM
Residentia
l Gateway
HTTP/UDP Unicast Acceleration
Multicast
Intelligent Prepositioning
Peer-Assisted
Delivery
Peer Assist
Network intelligence can
exclude peering traffic from
data caps and billed usage.
Notas do Editor Has delivered billions of songs for top online music stores