Scaling Jenkins
Udaypal Aarkoti
Director, Solution Architecture
©2014 CloudBees, Inc. All Rights Reserved 1

>83%
think
Jenkins
is
mission
cri2cal
Source:
2012
Jenkins
Survey
©2014 CloudBees, Inc. All Rights Reserved 2

©2014 CloudBees, Inc. All Rights Reserved 3
Meet Jenkins
>
67%
Have
>5
projects
>
91%
Have
>2
projects
Source:
2012
Jenkins
Survey

©2014 CloudBees, Inc. All Rights Reserved 4

What does scaling Jenkins involve?
• # of Slaves
• # of Jobs
• # of Builds
• # of Concurrent HTTP requests
• Single master vs Multiple masters
©2014 CloudBees, Inc. All Rights Reserved 5

Managing Jenkins at scale
• Managing multiple Masters
• Security
• Plugins
• Resource Utilization
• Availability
• Organizing Jobs
• Onboarding new teams / projects
©2014 CloudBees, Inc. All Rights Reserved 6

Scaling Jenkins Reference Architecture
Jenkins
Master
1
Jenkins
Master-1 Master-1
Master-1
Shared
©2014 CloudBees, Inc. All Rights Reserved 7
Jenkins
Operations
Center
HA Proxy
Dev Update
Center
QA Update
Center
Jenkins
Operations
Center
Shared
Build noSdheasred
Build noSdheasred
Build noSdheasred
Build nodes
LDAP
Role Based
Access Control
*
*
*
Jenkins
Opera,ons
center
HA Proxy
Jenkins
Master-1
Backup
Shared
Build nodes
Build nodes
HA Proxy
Jenkins
Master-N
Jenkins
Master-N
Backup
Jenkins
Master
N
HA Proxy
Jenkins
Master-N
Jenkins
Master-N
Backup
Jenkins
Test
Environment
Test Update
Center
SSO

©2014 CloudBees, Inc. All Rights Reserved 8
Questions?
Thank
You!