Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/QuayqI.
Robert Benefield offers a pragmatic overview for discovering operational indicators that provide valuable insight in running and improving online services. Filmed at qconlondon.com.
Robert Benefield has over 20 years of executive leadership experience building and leading world-class global lean and high performance engineering and technical operations organizations in demanding high uptime environments spanning industries such as investment banking, defence, telco, and Internet service industries.
Ensuring Technical Readiness For Copilot in Microsoft 365
Instrumenting Your Business For Success with DevOps
1.
2. InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month
Watch the video with slide
synchronization on InfoQ.com!
http://www.infoq.com/presentations
/business-success-devops
http://www.infoq.com/presentati
ons/nasa-big-data
http://www.infoq.com/presentati
ons/nasa-big-data
3. Presented at QCon London
www.qconlondon.com
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
4. Instrumenting Your Business For Success
With DevOps
Robert Benefield
Evolve Beyond, Ltd
rbenefield@evolvebeyond.com
5. CTO, Evolve Beyond @leandevops
Over 20 years of experience in Development, Operations and
Executive levels from start-ups to large multinationals
About Me
Software, Military, Government, Banking, Utilities, Telecom,
Internet, Energy, Healthcare, Embedded Systems
I like solving difficult problems
Evolve Beyond, Ltd 2014
11. Availability
Mean Time Between Failure (MTBF)
Mean Time To Recover (MTTR)
Health
Typical DevOps Measures
Health
Warnings/Failures/Restarts
Throughput
Capacity (CPU, Memory, I/O, etc)
Deploy speed & frequency
Team Velocity
Evolve Beyond, Ltd 2014
0
10
20
30
40
50
60
70
Day
1Day
2Day
3Day
4Day
5Day
6Day
7Day
8Day
9Day
10Day
11
Ideal
Actual
14. The Service is the Product!
Available
– Does it work when I need it?
Usable
Customer’s View
Usable
– Does it do what I need it to do?
– Is it easy to use and performant?
Provide Value
– Is it value for money?
– Is it better than I could do myself?
Secure
– Is my data safe?
Evolve Beyond, Ltd 2014
15. Perceived Business View
“Agile just means we deliver faster, right?”
“Cloud/SaaS is just a distribution channel”“Cloud/SaaS is just a distribution channel”
“DevOps is Cloud + Automation to go even
faster!”
Evolve Beyond, Ltd 2014
16. Business Metrics Focus
Increase revenue & market share
Reduce costs & delivery friction
Protect – manage risk to revenue & marketProtect – manage risk to revenue & market
Which all boils down to:
Understanding the Customer & Market
Understanding resident capabilities & risks
Evolve Beyond, Ltd 2014
17. Availability
Mean Time Between Failure (MTBF)
Mean Time To Recover (MTTR)
Health
Typical DevOps Measures
Health
Warnings/Failures/Restarts
Throughput
Capacity (CPU, Memory, I/O, etc)
Deploy speed & frequency
Team Velocity
Evolve Beyond, Ltd 2014
0
10
20
30
40
50
60
70
Day
1Day
2Day
3Day
4Day
5Day
6Day
7Day
8Day
9Day
10Day
11
Ideal
Actual
19. What causes friction?
What are our risks?
What are our capabilities?
Building Situational Awareness
What are our capabilities?
Do we really understand our customers?
Remember: We run the service!
How are decisions made?
Evolve Beyond, Ltd 2014
20. How quickly can we deliver?
How quickly can we scale?
Friction
How quickly can we respond?
How quickly can we resolve?
How often is there rework?
Evolve Beyond, Ltd 2014
23. Tracking & Trending the “Why & When”
Event Friction
Deploy Rework
Master Database
frontend web
Search
network
server
0
20
40
60
80
100
120
140
Effort due to change rework
Evolve Beyond, Ltd 2014
server
user
build engine
partner
0
24. Where is the technical debt?
Where are the “known unknowns”?
Where are the SPoFs?
Risks
Where are the SPoFs?
Where are the dependencies?
Evolve Beyond, Ltd 2014
28. What are they?
Are they being used?
Capabilities
Are they being used?
Are they constrained?
Evolve Beyond, Ltd 2014
29. Who they are
What they use (when/how/why)
Understanding the Customer
What is important to them
How do we know how well are we doing?
Evolve Beyond, Ltd 2014
0
500
1000
1500
2000
2500
3000
3500
Login
Checkout
Search
BuildReport
User…
ImportData
Download
AddCart
Fax
HelpPages