Riot Games initially struggled to deliver their League of Legends website and services from their on-premise datacenter due to issues with scalability, security, and agility. They migrated their workloads to AWS to address these issues. In AWS, they adopted a microservices architecture using containers and automation to improve deployment speed and scalability. However, the rapid growth also created organizational challenges that required adapting practices around VPC design, deployments, and team collaboration. Over time they continued refining their approach to meet goals around security, quality and agility.

2. How Were:Inventedour AWS ModelJonathan McCaffrey : Software Architect Marty Chong : Sr. Network Engineer
GAM 304

3. MARTY CHONG
SR. NETWORK ENGINEER
IAAS TEAM
MARTY.CHONG@
RIOTGAMES.COM
JMCCAFFREY@
RIOTGAMES.COM
JONATHAN McCAFFREY
SOFTWARE ARCHITECT
MEET YOUR PRESENTERS

4. WHO IS RIOT?

6. RIOT GAMES
Developer & publisher of League of Legends
Hosts some of the largest eSportsevents

7. What is League of Legends?
2009
LAUNCH
TEAM
ORIENTED
100+
CHAMPS
MODERN
FANTASY

8. GAMEPLAY SCREESHOT #2

10. Where in the World is.....

11. League of Legends World Championship 2014

12. LEAGUE OF LEGENDS STATS7.5MILLION
PEAK CONCURRENT
PLAYERS
STATS RELEASED JANUARY 201467MILLION
MONTHLY ACTIVE
PLAYERS
MORE THAN27MILLION
DAILY ACTIVE
PLAYERS
MORE THAN
MORE THAN

13. ADAPT
CONCLUSIONOURSTORY
MOVE
STARTINTRODUCTION

14. What is LeagueOfLegends.com?

20. League of Legends is a Global Product

23. Goals for the site technology

24. SECURITY

25. SECURITY
QUALITY

26. AGILITY
SECURITY
QUALITY

27. Lets look at how we applied these initially…

28. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
MOVESTARTIN THE DATACENTERSTRUGGLE TO DELIVER

29. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

30. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

31. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

32. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

33. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
MOVESTARTIN THE DATACENTERSTRUGGLE TO DELIVER
MONOLITHIC APP
PHYSICAL SERVERS
NETWORK SECURITY
REVISIT GOALS

34. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
MOVESTARTIN THE DATACENTERSTRUGGLE TO DELIVER
MONOLITHIC APP
PHYSICAL SERVERS
NETWORK SECURITY
REVISIT GOALS

35. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

36. CMS
Frontpage
News
Media Gallery
Comments
Account Management
Refer-a-friend

37. CMS
Frontpage
News
Media Gallery
Comments
Account Management
Refer-a-friend

38. CMS
Frontpage
News
Media Gallery
Comments
Account Management
Refer-a-friend

39. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
MOVESTARTIN THE DATACENTERSTRUGGLE TO DELIVER
MONOLITHIC APP
PHYSICAL SERVERS
NETWORK SECURITY
REVISIT GOALS

40. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

41. ?

42. ?
IN THE CMS
Bolt-On New Apps

43. ?
NEW APP

44. ?
IN THE CMS

45. ?
IN THE CMS
NEW APP

46. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
MOVESTARTIN THE DATACENTERSTRUGGLE TO DELIVER
MONOLITHIC APP
PHYSICAL SERVERS
NETWORK SECURITY
REVISIT GOALS

47. GAME SERVICES
ROUTER
DDoSMITIGATION
FIREWALL
LOAD BALANCEREDGENA CMSNA FORUMS
MySQL
SERVER
FRONTEND SERVER
MySQL
SERVER
FRONTEND SERVER

48. DDoSMitigation

49. DDoSMitigation
Firewall

50. DDoSMitigation
Firewall
Strict Monitoring

51. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
MOVESTARTIN THE DATACENTERSTRUGGLE TO DELIVER
MONOLITHIC APP
PHYSICAL SERVERS
NETWORK SECURITY
REVISIT GOALS

52. SECURITY
QUALITY
AGILITYREVISITGOALS
Data Center had a lot of security features
No CDN

53. SECURITY
QUALITY
AGILITYREVISITGOALS
Separate stacks for CMS and Forums
CMS did a lot of things
Adding a new stack was very hard

54. SECURITY
QUALITY
AGILITYREVISITGOALS
Static physical server topology

55. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
STARTMOVETO AWSSTRUGGLE TO SCALE

56. LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
RDS
FRONTEND SERVER
RDS
FRONTENDSERVER
VPCCONNECTIONS
ELB
ELB
CDN
ELB
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

57. ELB
ELB
LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
RDS
FRONTEND SERVER
RDS
FRONTEND SERVER
VPCCONNECTIONS
CDN
ELB
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

58. ELB
ELB
LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
CDN
RDS
FRONTEND SERVER
VPCCONNECTIONS
ELB
RDS
FRONTEND SERVER
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

59. LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
CDN
RDS
FRONTEND SERVER
VPCCONNECTIONS
ELB
RDS
FRONTEND SERVER
ELB
ELB
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

60. LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
RDS
FRONTEND SERVER
VPCCONNECTIONS
CDN
ELB
RDS
FRONTEND SERVER
ELB
ELB
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

61. LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
RDS
FRONTEND SERVER
RDS
FRONTEND SERVER
VPCCONNECTIONS
DEV TEAMS
ELB
ELB
CDN
ELB
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

62. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
STARTMOVETO AWSSTRUGGLE TO SCALE
STARTING WITH VPC
MICRO-SERVICES
AUTOMATION
REVISIT GOALS

63. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
STARTMOVETO AWSSTRUGGLE TO SCALE
STARTING WITH VPC
MICRO-SERVICES
AUTOMATION
REVISIT GOALS

64. LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
CDN
RDS
FRONTEND SERVER
VPCCONNECTIONS
ELB
ELB
ELB
RDS
FRONTEND SERVER
COMMUNITY CMS
TOURNAMENT CMS
PLAYERS

65. VPC
VPC
VPC

66. VPC
VPC
VPC
1
# of VPNs

67. VPC
VPC
VPC
2
# of VPNs

68. VPC
VPC
VPC
10
# of VPNs

69. VPC
VPC
VPC
20
# of VPNs

70. VPC
VPC
VPC
40
# of VPNs

71. !!
# of VPNs
VPC
VPC
VPC

72. !!
# of VPNs
VPC
VPC
VPC

73. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
STARTMOVETO AWSSTRUGGLE TO SCALE
STARTING WITH VPC
MICRO-SERVICES
AUTOMATION
REVISIT GOALS

76. LoLGAME SERVICE
LoLGAME SERVICE
RIOT DC 1
LoLGAME SERVICE
RDS
FRONTEND SERVER
VPCCONNECTIONS
CDN
ELB
RDS
FRONTEND SERVER
ELB
ELB
COMMUNITY CMS
TOURNAMENT CMS

77. COMMENTS SERVICE (JAVA)

78. NEWS ARTICLE PAGE
COMMENTS UI (JAVASCRIPT)
COMMENTS SERVICE (JAVA)

80. NEWS ARTICLE PAGE
COMMENTS UI (JAVASCRIPT)
COMMENTS SERVICE (JAVA)
CMS (PHP)

81. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
STARTMOVETO AWSSTRUGGLE TO SCALE
STARTING WITH VPC
MICRO-SERVICES
AUTOMATION
REVISIT GOALS

82. EC2

83. EC2
INSTANCE

84. EC2
INSTANCE
CHEF

85. EC2
INSTANCE
CHEF

86. No AMIs

87. No AMIs
Fragile

88. No AMIs
Fragile
Complex

89. INTRODUCTION
ADAPT
CONCLUSIONOURSTORY
STARTMOVETO AWSSTRUGGLE TO SCALE
STARTING WITH VPC
MICRO-SERVICES
AUTOMATION
REVISIT GOALS

90. SECURITY
QUALITY
AGILITYREVISITGOALS
Implemented VPCs with VPNs
Struggled to scale them

91. SECURITY
QUALITY
AGILITYREVISITGOALS
Take advantage of our CDN
Separate services
We still had a lot of stuff in the CMS

92. SECURITY
QUALITY
AGILITYREVISITGOALS
Automated deploys
Automation was fragile

93. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH

94. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH
SCALING VPC
AWS WORKING GROUP
GOLDEN IMAGE DEPLOYS
STATIC SITE HOSTING
REVIST GOALS

95. WITH ALL GROWTH COMES

96. What brought us agility also brought us the Wild West of Cloud Computing

97. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH
SCALING VPC
AWS WORKING GROUP
GOLDEN IMAGE DEPLOYS
STATIC SITE HOSTING
REVIST GOALS

98. PAIN POINTS
INFRASTRUCTURE
PAIN
ORGINIZATIONAL
PAIN

99. PAIN POINTS
INFRASTRUCTURE
PAIN

100. VPC REGION 1
VPC REGION 2AWS

101. VPC REGION 1
VPC REGION 2AWS
RIOT DC 1
RIOT DC 2
RIOT DC 3

102. VPC REGION 1
VPC REGION 2AWSCDN
RIOT DC 1
RIOT DC 2
RIOT DC 3

103. !!
# of VPNs
VPC
VPC
VPC

104. VPCCONSOLIDATE

105. VPC REGION 1
VPC REGION 2EXTEND
VPN
VPNMULTI-POINT VPN
AMI
AMI

106. VPC REGION 1
VPC REGION 2MULTI-POINT VPNDIRECT CONNECT
AWS DIRECT
CONNECT

108. SHARED MODEL
VPC
PUBLIC
SHARED TOOLS
APPLICATIONS

109. MANY TEAMS –ONE VPC
VPC
PUBLIC
SHARED TOOLS
TEAM 1
TEAM 2
TEAM 3

110. VPC PER TEAM
VPC WEB
VPC BIG DATA
VPC IT
PUBLIC
SHARED TOOLS
APP 1
APP 2
APP 3
PUBLIC
SHARED TOOLS
APP 1
APP 2
APP 3
PUBLIC
SHARED TOOLS
APP 1
APP 2
APP 3

111. COMMODITY-BASED VPC
VPC1
VPC2
VPCAS NEEDED
PUBLIC
SHARED TOOLS
APP 1
APP 2
APP 3
PUBLIC
SHARED TOOLS
APP 1
APP 2
APP 3
PUBLIC
SHARED TOOLS
APP 1
APP 2
APP 3

112. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH
SCALING VPC
AWS WORKING GROUP
GOLDEN IMAGE DEPLOYS
STATIC SITE HOSTING
REVIST GOALS

113. PAIN POINTS
ORGINIZATIONAL
PAIN

117. OK!

118. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH
SCALING VPC
AWS WORKING GROUP
GOLDEN IMAGE DEPLOYS
STATIC SITE HOSTING
REVIST GOALS

119. GIT

120. JENKINS
GIT

121. JENKINS
PACKER
GIT

122. JENKINS
EC2
PACKER
GIT
UPLOAD
RUN
SNAPSHOT

123. JENKINS
EC2
PACKER
GIT
UPLOAD
RUN
SNAPSHOT

124. JENKINS
EC2
PACKER
GIT
UPLOAD
RUN
SNAPSHOT

125. JENKINS
EC2
PACKER
GIT
AMI v1.0

126. JENKINS
EC2
PACKER
GIT
AMI v1.0
AMI v1.1

127. JENKINS
EC2
PACKER
GIT
AMI v1.0
AMI v1.1
AMI v1.2

128. ELBV1 ASG
EC2
EC2

129. ELBV1 ASG
EC2
EC2V2 ASG
EC2
EC2

130. ELBV1 ASG
EC2
EC2V2 ASG
EC2
EC2

131. ELBV2 ASG
EC2
EC2

132. ELBV1 ASG
EC2
EC2V2 ASG
EC2
EC2

133. ELBV1 ASG
EC2
EC2

134. ELBV2 ASG
EC2
EC2

135. ELBV1 ASG
EC2
EC2V2 ASG
EC2
EC2

136. ELBV1 ASG
EC2
EC2

138. PACKMULE!

139. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH
SCALING VPC
AWS WORKING GROUP
GOLDEN IMAGE DEPLOYS
STATIC SITE HOSTING
REVIST GOALS

140. Markdown File

141. Markdown File
GitRepo
Jenkins
Spark

142. HTML Static Site
JS
JS
JS
CSS
CSS
Markdown
Markdown
JSON
Spark

143. STAGE BUCKETAMAZON S3

144. STAGE BUCKET
PROD BUCKETAMAZON S3CDN

145. But its not perfect…

146. INTRODUCTION
CONCLUSIONOURSTORY
MOVE
STARTADAPTTO CHANGESTACKLE GROWTH
SCALING VPC
AWS WORKING GROUP
GOLDEN IMAGE DEPLOYS
STATIC SITE HOSTING
REVIST GOALS

147. SECURITY
QUALITY
AGILITYREVISITGOALS
CDN for everything
Continuing our VPC design

148. SECURITY
QUALITY
AGILITYREVISITGOALS
Static sites
Full-page caching
Auto-scaling
Balance the AWS regions we are in

149. SECURITY
QUALITY
AGILITYREVISITGOALS
Fully automated deploys
Small easy to deploy services
Need to improve local and devworkflows

150. INTRODUCTION
ADAPTOURSTORY
MOVE
STARTCONCLUSION

151. COMMUNICATE WITHIN YOUR ORGANIZATION

152. DOCUMENT
<CODE>

153. STAY TIGHT WITH YOUR AMAZON ACCOUNT TEAM

154. LEARN FROM OUR MISTAKESLEARN FROM OTHERS

155. PLEASE COME AND VISIT OUR BOOTH IN THE EXPO HALL!
THANKS!

156. QUESTIONS?!
MARTY CHONG
SR. NETWORK ENGINEER
IAAS TEAM
MARTY.CHONG@
RIOTGAMES.COM
JMCCAFFREY@
RIOTGAMES.COM
JONATHAN McCAFFREY
SOFTWARE ARCHITECT

157. Please give us your feedback on this session.
Complete session evaluations and earn re:Invent swag.
http://bit.ly/awsevals