Large-scale, Enterprise-wide Agile Delivery Transformation
Continuous Delivery at Cisco IT
Pete Rim
prim@cisco.com

Agenda
Continuous Delivery Transformation
Focus of Continuous Delivery at Cisco
Our approach and implementation
What results did we see
We need help in these areas
‘Stickies’ for a successful CD transformation

Continuous Delivery Transformation
Accelerating the speed of business with Fast IT
Improve
Software Quality
Optimize
Cost-of-Delivery
 Testing Automation
 Embed SMEs
 Fail Fast / Recover
 Dedicated Teams
 Adaptive Infrastructure
 Self-Service Tools
 Small & Mighty Teams
 Active Stakeholders
 Iterative Approach
Culture Mindset PerceptionChange the of IT
Accelerate
Time-to-Capability

 Small & Mighty
Teams
 Automation Tools
 Embedded SMEs
 Automation Tools
 Centralized Test
Data Management
 Automation Tools
 Centralized
Release
Management
 Active Stakeholders
 Fast Results
 Operational Priority
 High Availability
Changing the Way We Work: Continuous Delivery
Mindset
Automated Testing
Built by Developers
Embedded QC
Adapt & Scale
Policy Enforced
Workload Mobility
Deploy & Release
Control Gates
Regulatory
Compliance
Develop and Build
Continuous
Integration
 Innovation Circles
 Architectural
Framework
 Active Stakeholders
Plan
Iterative Planning

Continuous Delivery Core Team
• Business Value Case
• Communication
• Change Management
• Program Governance
• Metrics
PMO
Process
Tools
Adoption
Sustainability
• Operations
• Automation
• Evolution Plan
• Org Change
• End State Model
• Tool Chain
• Automation
• Optimization
• Release Environment
• Technical Support
Program
Director
Chief
Architect
• End to End Process
• Biz Engagement
• Best Practices
• Training
• Release Strategy
• Adoption Plan
• Client Engagement
• Best Practices
• Checkpoints
• Certification
CD Core Team

Adoption/Subscriber “Waves”
(80+ Services & 600+ Applications grouped into 3 waves)
Pioneer
Business Critical
All Others
- Willing partner
- Get a “win”
- Create your ambassador network
- Prove it’s scalable
- Take a risk
- Show business value
- Finish the job
- Everyone gets to go
- Make it “concrete”
Wave 1
Wave 2
Wave 3

E2E Tools Landscape
ERPNon-ERP
Portfolio & Business Outcome
AppDB
A tool developed Internally in Cisco IT
for Oracle Code Deployment

Conceptual: Release & Environment Model
Dev
Stage
Prod
QA
QA
Medium Frequency Lane
Large Scope
Every Six Months
High Frequency Lane
Medium Scope: Every Month
Small Scope: Every Week/Day
Emergency Lane
Bug Fixes & Patches
On Demand
3 Lanes together provide unlimited go live opportunities
1
2
3
DevIntDev
DevIntDev
All lanes merge in Stage
before deployment to Prod

How did we measure?
TC / # Enhancements or # Stories Delivered
# of Enhancements or # Stories Delivered
Incidents & Downtime
How fast?
At what price?
With what quality?
Business Value Got measurable value?
Process & Platform Adoption How transformational?
Speed
Cost
Quality
Adoption
Biz Value

Continuous Delivery Scorecard

Methodology adoption (Waterfall vs Agile)
62%
55% 56%
49%
38%
27%
38%
45% 44%
50%
63%
73%
0%
10%
20%
30%
40%
50%
60%
70%
80%
FY14-Q4 FY15-Q1 FY15-Q2 FY15-Q3 FY15-Q4 FY16-Q1
Waterfall Agile

Plan
6.00%
Develop &
Build
11.25%
Regression
Test
7.50%
Progression
Test
4.75%
Deploy
2.50%
Total
Savings
32.00%
Application Delivery Productivity Savings Opportunity

We need help in these areas
 ERP/Oracle Environment refresh in 2 days (we have reduced it from 10 days to 6 days)
 Coexistence of multiple active versions of code (FE/BE) in the same environment
Team 1 for Release A
Team 2 for Release B (overlaps with Rel A)
Copy/Clone

‘Stickies’ for a successful Continuous Delivery Transformation
Tools
Tools for ERP and non-ERP
Integrated CD Tool set
Connected Collab tools
Training
Scrum Master Training
Product Owner Training
SAFe Training
Applied Agile Training
Hands-on Workshops
Process
End to End Process
Best Practices (CoE)
Release Process
Business Engagement
Requirement Process
Dev Processes
Test Process
Deployment Process
Production Support Process
Env Support Process
Compliance Process
Test
Test Automation
Risk Based Testing
Test Data Management
Performance Test
Platform
Virtualization
Expedited full-stack provisioning
Elastic infrastructure
Faster Env refreshes
Simplified Infra Engagement
Compliance
Security
SOX
ISO
Support
P1 support for Platform & Tool
Click-to-chat
Self-service Portal
Client Experience
Generic
Transactional vs Content Based
X-functional vs standalone
MVP vs WBS/Components
Distributed vs Collocated
Definition & Measure of Speed
Deployment Frequency
Agile Team Workspaces
Vendor Readiness & SOWs
Release
Go Live windows
Simplified Process
Release Types
Release & Env Model
Freeze process
Early engagement
E2E Automation
Development
PLC (Agile/Hybrid)
Estimation
Code Merge
Embedded QA
Built-in Compliance
Program
PMO
Process
Tools
Adoption
Metrics
Ambassadors

Increased # of Agile Project Releases
Total Releases: Waterfall vs Agile Trending: Waterfall vs Agile Projects
65 70 64
86
52
38
36 32
52
72
106
142
0
20
40
60
80
100
120
140
160
180
200
Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16
Agile
Waterfall
101 102
116
158 158
180
CD as a Program
CD as a
Service CD as a Program
CD as a
Service
64%
64%
56%
41% 41%
36%
36%
36%
44%
59% 59%
64%
0%
10%
20%
30%
40%
50%
60%
70%
Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16
% Waterfall
% Agile

“CD Speed to Production” - Improvements
65
70
64
86
52
3848 46
50
34 34
35
0
10
20
30
40
50
60
70
80
90
100
Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16
Waterfall: Mean Time to Release
Total Projects
Average Days
36
32
52
72
106
142
49
40 38
32 28
32
0
20
40
60
80
100
120
140
160
Q1FY15 Q2FY15 Q3FY15 Q4FY15 Q1FY16 Q2FY16
CD Speed to Production
Total Projects
Average Days
CD as a Program
CD as a
Service
CD as a Program
CD as a
Service