By Kohsuke Kawaguchi and Harpreet Singh, CloudBees, Inc. Continuous delivery (CD) is a competitive differentiator and development and operations teams are under pressure to deliver software faster. The DevOps world is going through a storm of changes - Docker being the key one. This session by Kohsuke and Harpreet will introduce a set of plugins that address various aspects of CD with Docker.

1. Continuous Delivery @cloud-scale
Harpreet Singh/@singh_harpreet
Kohsuke Kawaguchi/@kohsukekawa

2. #jenkinsconf
Agenda
• Continuous Delivery
• Docker
• CD with Jenkins and Docker
• CloudBees Jenkins Platform
• “Tiger” - Jenkins-as-a-Service

3. #jenkinsconf
The speakers today
3
CTO, Programmer Extraordinaire
Favorite Weapon of Choice: IDE
Slide-boy for Marketing
Actual weapon: Power point

4. #jenkinsconf
The speakers today
4
VP, Product Management
Favorite Weapon: Jedi Mind-tricks
Hustler for sales
Actual Weapon: Clasping hand technique

5. #jenkinsconf
About CloudBees
Who are we? The enterprise Jenkins company and the Continuous
Delivery leader enabling IT organizations to respond
rapidly to the needs of the business.
Our business
value
We improve business agility and Business-IT
alignment by delivering better software faster.
Our Platform CloudBees Jenkins Platform provides a range of
continuous delivery solutions powered by Jenkins
that meets the unique needs of enterprises on-
premise or in the cloud.

6. #jenkinsconf
CloudBees Jenkins Platform
Jenkins at Enterprise Scale for CI and CD
Support
Professional
Services
Training
Security
Advisories
NewslettersSupport & Services

7. #jenkinsconf
CloudBees Jenkins Platform Customers
Financial
Services
Technology Retail Consumer
Embedded
Systems

8. #jenkinsconf
Continuous Delivery
Software is indeed eating the world

9. #jenkinsconf
Delivering Software Faster
DEV PROD

10. #jenkinsconf
Reducing friction…
Dev Ops

11. #jenkinsconf
Automation is the key to… love?
Continuous Delivery

12. #jenkinsconf
Software is indeed eating the world
12

13. #jenkinsconf
Jenkins & Workflow
The bazaar where automation happens

14. #jenkinsconf
CD starts from CI
Developer
Source
Code
Control
System
Compile
/BuildCode
Scan TestsCode
Commit
Results
Report
BuildCommit Test
Continuous Delivery
ProdDev

15. #jenkinsconf
…and extends to Deployment
Developer
Source
Code
Control
System
Compile
/BuildCode
Scan TestsCode
Commit
Results
Report
BuildCommit Test Stage Deploy
Deploy
Prod
Deploy
Stage
Complex Delivery Pipelines
Delivery of App and Config
Continuous Delivery
ProdDev

16. #jenkinsconf
Key Workflow Features
• Entire flow is one concise Groovy script using Workflow DSL
– For loops, try-finally, fork-join …
• Can restart Jenkins while flow is running
• Allocate slave nodes and workspaces
– As many as you want, when you want
• Stages throttle concurrency of builds
• Human input/approval integrated into flow
• Standard project concepts: SCM, artifacts, plugins
17

17. #jenkinsconf
Docker
The new currency that is exchanged in the
bazaar
18

18. #jenkinsconf
Docker: Quick Introduction
Container
Application
Container
Application
Container
Application
Machine

19. #jenkinsconf
Jenkins and Docker
Building Modern CD Pipelines

20. #jenkinsconf
Footer
Use Cases
• Building End-to-End CD
Pipelines
• Isolation of teams
21

21. #jenkinsconf
Footer
Docker Demo
22
base
image
app
image
app
src
base
src

22. #jenkinsconf
Demo
23

23. #jenkinsconf
Footer
End to End Continuous Delivery
Source
Code
(git, etc.)
Certified
Docker
Images
(Ubuntu, etc.)
+
Company
“Gold”
Docker Img
(~per app)
TESTING
STAGING
PRODUCTION
1. Docker
Hub
Notifications
3. Docker Traceability
2. Docker Workflow DSL
New Image

24. #jenkinsconf
Footer
Standardized Build Environments
Jenkins Slave
Shared OSCB Jenkins Operations Center
Master A Master B Master C
Docker
Executor
Docker
Executor
Docker
Executor
Docker
Executor

25. #jenkinsconf
Footer
Customized Build Environments
Jenkins Slave
Shared OS
Executor
Executor
Executor
Executor
DockerFile
dockerfile

26. #jenkinsconf
Footer
Leading the Charge on CD Support for Containers
Containers & Jenkins
• OSS Docker plugins June 18
• OSS Kubernetes plugins
Workflow Support
• DSL for Docker and Kubernetes
• Improve pipeline visualization
across organization
Others
• Ops dashboard
27

27. #jenkinsconf
CloudBees Jenkins Platform

28. #jenkinsconf
High Availability for Mission Critical Jenkins
Servers
Developers
Source
Code
Control
System
Code Check-Ins
Results
Reports
Jenkins Master Server
Cluster with Failover

29. #jenkinsconf
Security with Roles-based Access Control
Jenkins Operations Center
SSO
Roles, Groups and
Permissions

30. #jenkinsconf
Managing Jenkins with
CloudBees Jenkins Operations Center
CB Jenkins Operations
Center
Single Pane of Glass
for All Jenkins Servers

31. #jenkinsconf
Monitoring, Visualization and Analytics
Jenkins Workflow Stage View –
Visibility into Pipeline status
Jenkins Analytics – Cross-Team Build
Analytics
… among many other features, tailored for
enterprise organizations using Jenkins @ scale

32. #jenkinsconf
New features
• Promotions of jobs
across masters
• Cross master job
triggers within a
Jenkins cluster
33

33. #jenkinsconf
Solution Packs
TEAM EDITION ENTERPRISE EDITION
Team Edition Features
Ent. Edition Features
Jenkins Core
CloudBees Jenkins Platform for
CloudBees Jenkins Platform
CloudBees Jenkins Enterprise++
CloudBees Jenkins Operations Center++
Team Edition Features
Jenkins Core
CloudBees Jenkins Platform for
CloudBees Jenkins Enterprise
CloudBees Jenkins Operations Center

34. #jenkinsconf
CloudBees Jenkins Platform Team Edition
35
Developer
Productivity
Improved developer feedback loop and eliminate downtime with Validated Merge
and GitHub PR
Team
Management
Organize teams with folders
Recoverability from failures using backup
Security Roles-based access control
Isolate team-sensitive slaves
Analytics Build and performance dashboards
Continuous
Delivery
Build complex delivery pipelines with Workflow
CD with
Containers
Build delivery pipelines with Workflow and Docker
Docker Builds Standardized and Customized Build Environments
Support Module Faster diagnosis for production issues

35. #jenkinsconf
CloudBees Jenkins Platform Enterprise Edition
36
Build & Master
Resilience
Automatic failovers to recover from master failures
Builds that survive master and slave failovers
Optimized
Utilization
Faster builds across geographically distributed slaves with fast archiver
Improved master performance under heavy load with NIO SSH slaves
Enterprise
Management
Ops on cluster of masters; Isolation of teams with custom update centers
Reusable templates
Enterprise
Analytics
Insights in to plugin usage
Enterprise CD Pipeline performance and developer insights
Recover from failures from check pointed locations
VMWare
vSphere builds
vSphere build slaves
Enterprise
Security
Secure inter-master artifact exchange with Secure Copy

36. #jenkinsconf
CloudBees Jenkins Platforms Partners
38

37. #jenkinsconf
Tiger
Jenkins-as-a-Service
https://www.flickr.com/photos/mape_s/

38. #jenkinsconf
Adoption of Jenkins at high-end
• Big companies are adopting Jenkins at scale
– 1000s of developers & applications
– Role separation: admins & users
– Balance b/w central control vs autonomy
– Need to reduce admin overhead
40

39. #jenkinsconf
Jenkins as a Service
• Interest in operating “Jenkins as a Service”
– Self-service provisioning for developers
– Tailored out-of-box experience
– Centralized management
41

40. #jenkinsconf
And we have the technology
• DEV@Cloud
– 1000s of masters on EC2
– Elastic masters & build slaves
– Modified out-of-box experience
• We’ve been working on delivering this
experience to people on-prem
42

41. #jenkinsconf
43 https://www.flickr.com/photos/76877186@N06/8258715760 by Ali Arsh

42. #jenkinsconf
CD@cloud-scale DEV@cloud
• Package software, not a service
• Turn-key setup
• Multi-tenanted slaves
• Multi-tenanted master
• Builds on top of CloudBees Jenkins Platform
– Analytics, Cluster Operations, …
• Available on AWS and OpenStack initially

43. #jenkinsconf
From IT’s point of view
46
Big Honking Box Big Honking Box Big Honking Box
Big Honking Box Big Honking Box Big Honking Box
Big Honking Box Big Honking Box Big Honking Box
HTTPreverseproxy
Storage

44. #jenkinsconf
Tiger Overview
47
Big Honking Box Big Honking Box
...
http://*.ci.example.c
om/
CJOC
bravo
alpha
web tier
storage
charlie

45. #jenkinsconf
Containerized location-transparent build slaves
48
Big Honking Box Big Honking Box
...
alpha
Build in
container
Build in
container
Build in
container

46. #jenkinsconf
Containerized location-transparent masters
49
Big Honking Box Big Honking Box
...
http://*.ci.example.c
om/
CJOC
bravo
alpha
web tier
storage
charlie
delta

47. #jenkinsconf
Containerized location-transparent masters
50
Big Honking Box Big Honking Box
...
http://*.ci.example.c
om/
CJOC bravo
alpha
storage
charlie
delta
web tier

48. #jenkinsconf
Demo
51

49. #jenkinsconf
Beta Signups at the booth

50. #jenkinsconf
Hiring
• Senior Product Manager
• Technology Evangelist
• Many more…

51. #jenkinsconf
Summary
• Building Modern CD Pipelines with Jenkins, Jenkins
Workflow and Docker
• Bringing in CD to Teams and Enterprise-scale with
CloudBees Jenkins Platform
• Operating Jenkins at cloud-scale with Tiger
54

52. #jenkinsconf
Backup
55

53. #jenkinsconf
Use Case: End to End Continuous Delivery
Source
Code
(git, etc.)
Certified
Docker
Images
(Ubuntu, etc.)
+
Triggers:
• New application code (i.e. feature, bug, etc.)
• Updated certified stack (security fix in Linux, etc.)
… will lead to a new gold image being built and
available for…
… TESTING
… STAGING
… PRODUCTION
All taking place in a standardized/similar environment

54. #jenkinsconf
Use Case: End to End Continuous Delivery
Source
Code
(git, etc.)
Certified
Docker
Images
(Ubuntu, etc.)
+
Company
“Gold”
Docker Img
(~per app)
TESTING
STAGING
PRODUCTION