Lessons learned and best practice for beginning a DevOps transformation.

1. 1© Copyright 2015 EMC Corporation. All rights reserved.
EMC DevOps Transformation
Best Practices and Lessons from the field

2. 2© Copyright 2015 EMC Corporation. All rights reserved.
Success is a companies ability to see the
window of opportunity and capitalize on it.
https://www.ted.com/talks/bill_gross_the_single_biggest_reason_why_startups_succeed?language=en

3. 3© Copyright 2015 EMC Corporation. All rights reserved.
Traditional Enterprise IT
COMPLEX MANUAL CONTROLLED

4. 4© Copyright 2015 EMC Corporation. All rights reserved.
Industry Analysts and Reports
TRADITIONAL MODELS TRANSFORMED IT
http://www.appex.fr/fr/mediasanalystes.html?file=files/appex/media_analystes/telechargements/CIO%20Magazine%20AppDev%20Survey%2010-4-2012%20SUMMARY.pdf
http://puppetlabs.com/2014-devops-report
http://stateofagile.versionone.com/
http://velocityconf.com/velocity2014/public/schedule/detail/35184
of IT Executives admit delivering
project on-time and on-budget is
challenging
Say this challenge has remained
the same or gotten worse
over time
~90%
~75%
30x
More frequent code
deployments
Higher rate of success
deploying change
Faster Mean Time To
Recovery (MTTR)
>80%
Report improvements in
productivity, quality, visibility,
alignment, and responsiveness
60x
168x

5. 5© Copyright 2015 EMC Corporation. All rights reserved.

6. 6© Copyright 2015 EMC Corporation. All rights reserved.
What are We Seeing in
the Marketplace?
So…

7. 7EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY
• Agility & Speed
– Faster time-to-market capability
– Shorter feedback loops with
customers
– Ability to experiment or pivot
– Ability to introduce new
technologies
• Simplify & Stabilize
– Improve standardization and
configuration management
– Extend Policy-based administration
– Reduce portfolio complexity
– Control sprawl and shadow IT
– Reduce risk associated with
deployments and upgrades
Common Challenges
• Cost
– Reduce OPEX support cost associated with legacy portfolio
– Improve efficiency and effectiveness of existing team and systems
FASTER BETTER CHEAPER

8. 8EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY
DEVELOPMENT
QUALITY
ASSURANCE (UAT)
STAGING PRODUCTIONManual Manual Manual
DEVELOPMENT
QUALITY
ASSURANCE (UAT)
STAGING PRODUCTIONAUTO AUTO
Manual
AUTO
Build Automation
Version Control
Code Analysis
Automated Unit Testing
Developer Image Automation
Agile Development Practices
Agile Teaming Model
SOA/MicroService Architecture
Agile Testing Methods
Branching Practices
Application Frameworks
Dev/Test Workstation Automation
Automated Functional Testing
Automated Regression Testing
Infrastructure Automation
Configuration Automation
Automated Deployment
Workflow/Pipeline Management
Automated Application Bootstrapping
Release Management/Change Control Optimized for Daily PRODUCTION Release
Automated Penetration Testing
Automated Security/Compliance Checks
Dashboard/Reporting/Audit
Test Workstation Automation
Automated Performance Testing
Automated Load Testing
Collaboration Systems/Tooling
Modernize Enterprise Architecture Model
or
Automated Deploy
Hybrid Cloud Dev/Test Burst
Policy-driven Design w/Financials
Service Portal
Data Services
Monitoring
Logging Services
DR & Rollback
Resiliency Testing
Feature Toggling
Cloud Bursting (all)
RM/CC for Auto
PROD Deploy
Agile Portfolio
Operating Model
ALM Factory
DevOpsisa
PervasiveTransformation

9. 9© Copyright 2015 EMC Corporation. All rights reserved.
Start small and scale with confidence
Incremental Methodology
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APPAPP
APP
APP
APP
APP APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
APP
Single Application
(Project Team)
Dependent Applications
(Program Teams)
10-100s Applications
(Line-of-Business Portfolio)
100-1000s Applications
(Enterprise)
PHASE1
PHASE2PHASE4
PHASE3
GOAL
GOAL
GOAL
GOAL
Goal
+ +
+ +

10. 10EMC CONFIDENTIAL—INTERNAL USE ONLYEMC CONFIDENTIAL—INTERNAL USE ONLY
Best Practices from the Field

11. 11© Copyright 2015 EMC Corporation. All rights reserved.
Top 5 Must Haves for DevOps
1. Common vision and unified approach
2. Success criteria and measures
3. Collaborative, cross functional teams
4. Automated delivery pipelines
5. TRUST

12. 12© Copyright 2015 EMC Corporation. All rights reserved.
the “WHAT” – defines outcomes; sets
enterprises standards to maintain quality
and provide a consistent work environment
across the enterprise
Employ a Top Down & Bottoms Up Change Model
Vision & Approach
CHANGE ADOPTION
LEADERSHIP TEAM
DELIVERY TEAM
the “HOW” – determines the best
approach for achieving the standards
defined at the enterprise level

13. 13© Copyright 2015 EMC Corporation. All rights reserved.
• Reduce cycle time by 300%
• Reduce recovery/rollback time to less than 4hrs
• Improve process efficiency by 10%
• Reduce break/fix workload from 50% to 30%
• Solution is extensible and parameterized
Success Criteria & Measures
Define the Outcomes of Transformation

14. 14© Copyright 2015 EMC Corporation. All rights reserved.
Challenges
• Pain points around delivery and quality of software produced
• Agile development with waterfall testing & release with no clear process defined
to coordinate agile and waterfall teams
• Lean SDLC initiative across the enterprise to save costs, improve architecture,
speed-up time to market, better quality software in shorter release cycles
Strategy engagement on enabling a scalable Agile Factory solution across one of the largest
banks in the world
GLOBAL BANK
Solution
• The ability to deliver a discrete set of deliverables from two or more tightly
integrated teams all the way to PROD on-demand
• Strategy on how Continuous Delivery (CD) elegantly solves most of the
historical challenges preventing the bank from achieving agility at scale
• Enablement of automation throughout the tool chain & SDLC
Results
• Model to execute the multi-year transformational roadmap for the bank for an
omni-channel consumer experience while keeping “as a service” in mind so the
model can be leveraged for the entire wholesale bank
• Actionable roadmap on how CD would radically reduces the time and cost of
building valuable software
•

15. 15© Copyright 2015 EMC Corporation. All rights reserved.
Introduce Matrix Organization
Cross-Functional, Collaborative Teaming
GROUPING DYNAMIC TEAMING MODEL
GOAL
Operational Silos
Centralized Management
Cross-functional Team
Self-managed; Product Aligned

16. 16© Copyright 2015 EMC Corporation. All rights reserved.
Release Candidate Pipelines
Delivery Pipelines
VERSION
CONTROL
COMMIT
CREATE
CHANGE
• New software
• Enhancements/fixes
• Upgrades
• Patches
• Configurations
TEST UAT STAGE
PROD
Development & Build Process
1.1
1.2
1.3
1.4
1.5
1.2
Automated Tool Chain

17. 17© Copyright 2015 EMC Corporation. All rights reserved.
Integrated & Automated Tool Chain
Version
Control
Assemble
Dependencies
Unit Test BuildCompile BuildAnalyze Code
IaaS
Provisioning
Configuration
Automation
Middleware &
Runtime
Deployment
Portal
Command Line
Code Commit
Manifest/
Profile Creation
Analyze Code Unit Test Code
Workflow/
Deployment
Engine
Service
Catalogue
Environment
Profiles/
Controller
(CMDB) Application
Deployment &
Configuration
Application
Bootstraping
CONTINUOUS BUILD/INTEGRATION
PLATFORM AUTOMATION SCRIPTING
Application
Environment-
as-a-Service
TEST AUTOMATION SUITE
System Test
Compliance Test
UI Test
Perform. Test
Penetration Test
Integration Test
Smoke Test
Functional Test
Regression Test
Dashboard/
Management
Monitoring,
Logging, &
Management

18. 18© Copyright 2015 EMC Corporation. All rights reserved.
App/Dev Accelerator Proof of Concept (POC)
Large Insurance Provider
• Challenge
– Virtualized environments contained waste and were generally
overprovisioned and under utilized
– Creating new virtual environments for development and integration
testing took too much time
• Solution
– Implemented service catalog in vCAC, orchestration with App
Director, infrastructure automation and configuration with
Puppet
– Environment monitoring with vCOPS, configuration drift
monitoring with Puppet
• Results
– Defined self service catalog, automated infrastructure provisioning
& configuration, deployed apps, provided monitoring for
configuration drift and utilization
– Provided configuration drift and environment utilization monitoringCreated self service
workflow that allows
user to select, provision
and deploy applications
to a cluster in ~20
minutes

19. 19© Copyright 2015 EMC Corporation. All rights reserved.
Challenges
• 37+ week lead time to change patient facing software along with suffering quality
• Legacy systems and software supporting business critical applications
• Heavy compliance restrictions
• Business & Technical Units performing in silos
• Environmental starvation for large development teams
Onboarding DevOps and building a Continuous Delivery (CD) ecosystem for the largest HMO
in the United States
Large Nonprofit HMO
Solution
• Design & deploy a Continuous Delivery Ecosystem leveraging hybrid cloud
technology integrated with a DevOps tool chain
• Executive coaching, DevOps workshops, and talent seeding to help change the
overall company culture
• Modernize two application services to demonstrate CD as well as replatform from
end of life systems, spearheading a larger replatform effort
Results
• Expanded architecture design of current cloud to accommodate CD & Compliance
requirements, enabling an organizational technical standard for DevOps
• Demonstrated the automated builds of two services through CD, allowing sponsors to
showcase speed and agility
• Relieved environmental starvation issues
• Brought two integrated product development team from apprentice to practitioner level
• Proved CD can accelerate replatform & migration efforts

20. 20© Copyright 2015 EMC Corporation. All rights reserved.
• Solution globally; implement
locally
• Elicit input from SMEs and
Stakeholders
• Be transparent
• Allow time to build trust
TRUST
ADOPTION over COMPLETION

21. 21© Copyright 2015 EMC Corporation. All rights reserved.
So how can
the EMC
Federation
help?

22. 22© Copyright 2015 EMC Corporation. All rights reserved.
Service Models
Strategic and planning services that design and define a roadmap and phase 1 (MVP)
devops/continuous delivery plan tailored to an enterprise’s unique maturity and readiness.
Joint partnership to
implement continuous
delivery tool chains and
seed a devops cultures
within an enterprise
Federation-led project to
implement prescribed
continuous delivery tool
chains that compliment and
influence devops initiatives
within an enterprise
Federation-managed hybrid
cloud infrastructure with
devops lab services based
on prescribe tooling to
support development, test,
and production workloads
* Need to validate that we can deliver these services
ADVISOR
NAVIGATOR DRIVER MANAGED*

23. 23© Copyright 2015 EMC Corporation. All rights reserved.
Full Spectrum Portfolio Support
Bare Metal Virtualized
Containers &
Services
Enterprise Application Portfolio
DEVOPS ENABLED
CONTINUOUS DELIVERY
TOOL CHAIN
• API Driven Architecture
• Multi-Modal Capability
• Software Defined
• Policy Driven
RESILIENCY AGILITY SPEED

24. 24© Copyright 2015 EMC Corporation. All rights reserved.
RE-ENGINEER
The Federation Approach
CROSS
FUNCTIONAL
DEVOPS TEAM
OPTIMIZED
PROCESSES
CONTINUOUS DELIVERY
TOOL CHAINS
INDUSTRY LEADING TOOOLS
OPEN PARTNER COMMUNITY
APPLICATION DELIVERY
PIPELINE (SDLC)

25. 25© Copyright 2015 EMC Corporation. All rights reserved.
Why the Federation for DevOps?
Single source for DevOps best-of-breed solutions
• Puppet Labs
• Chef
• Microsoft
• CloudBees
Focus on People & Process; Not just technology
Strategic Partnerships w/Leading Vendors
• Business alignment
• Organizational structure
• Application lifecycle policies and procedures
• Development languages (Java, .Net, Ruby, etc.)
• Virtualization platforms (vSphere, HyperV, OpenStack)
• DevOps tools (Puppet, Chef, TFS, etc.)
Evolutionary approach to the cloud
Agnostic approach
• DevOps enabled Cloud Migrations
• Maximize value of brownfield applications
• Empower greenfield application development
Enterprise Experience
& Storage Automation
Cloud & Infrastructure
Automation
Enterprise Security
& Compliance
PaaS
Solutions

26. Enabling IT@Velocity
Thank You.
Email: bart.driscoll@emc.com Twitter:@bartdriscoll Blog:Infocus.emc.com
Bart Driscoll