Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/2EGPRkI. Rafael Schloming talks about how the real goal of microservices is to break up a monolithic development workflow. He shows how to build software enabling to move fast and make things. Filmed at qconsf.com. Rafael Schloming is Co-founder and Chief Architect of Datawire. He is a globally recognized expert on messaging and distributed systems and a spec author of the AMQP specification. Previously, Rafael was a principal software engineer at Red Hat.

1. Microservices:
Service Oriented Development
Rafael Schloming

2. InfoQ.com: News & Community Site
• Over 1,000,000 software developers, architects and CTOs read the site world-
wide every month
• 250,000 senior developers subscribe to our weekly newsletter
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• 2 dedicated podcast channels: The InfoQ Podcast, with a focus on
Architecture and The Engineering Culture Podcast, with a focus on building
• 96 deep dives on innovative topics packed as downloadable emags and
minibooks
• Over 40 new content items per week
Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
service-oriented-development

3. Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide
Presented at QCon San Francisco
www.qconsf.com

4. datawire.io
How do I break up my monolith?
How do I architect my app with microservices?
What infrastructure do I need in place before I
can benefit from microservices?
2

5. datawire.io
● Building a cloud application using
microservices in 2013
● Distributed systems engineers
● Multiple services
● Prototyping was really fast
● … then we launched and things
slowed down…
3
Microservices at Datawire ...

6. datawire.io
Debugging Velocity (or lack thereof)
4

7. datawire.io
Tooling
Architecture
Process!!!
5

8. datawire.io
Debugging our Pipeline
6

9. datawire.io
Velocity comes from Process, not
Architecture
7

10. datawire.io
Service Oriented Architecture
Service Oriented Development
8

11. datawire.io 9
Stability/Maturity
Velocity
Prototype Production Mission critical

12. datawire.io 10
Stability/Maturity
Velocity
Prototype Production Mission critical

13. datawire.io
A single process is inefficient
(Forces a single Stability vs Velocity Tradeoff)
11

14. datawire.io 12
Define
Code
Test
Release
Prod

15. datawire.io 13
Define
Code
Test
Release
Prod
Centralized process
● Specialized teams
● Fixed policies (e.g.,
release criteria)

16. datawire.io
A single process doesn’t scale
14

17. datawire.io
How do I break up my monolith?
How do I break up my process?
15

18. datawire.io 16
Microservices lets you run multiple processes!

19. datawire.io
Microservices is a distributed
development architecture
workflow.
17

20. datawire.io 18
Stability/Maturity
Velocity
Prototype Production Mission critical
● How do I get to Continuous Deployment incrementally?
● How do I limit the scope of PCI (audit process)?
● How do I ship feature X as fast as possible?

21. datawire.io
Microservices is ...
● Multiple workflows
○ Including your existing workflow!
○ Workflows designed for different
stability/velocity tradeoffs
● Simultaneous workflows
19

22. datawire.io
Doing things this way shifts how people operate!
● Requires both organizational and technical changes
20

23. datawire.io
Organizational Implementation
21

24. datawire.io
You gotta give in order to get
22
Education
● Everyone exposed to full dev cycle
Communication
● Nobody speaks the same language
Delegation
● Small teams own big important parts

25. datawire.io
But you get a lot
23
Education
● Specialists become generalists -> Better holistic systems
● Learning, personal growth -> Job satisfaction
Communication
● Conflict -> Collaboration
Delegation
● Massive organizational scale

26. datawire.io
Create self-sufficient, autonomous
software teams.
24

27. datawire.io
Why self-sufficiency and autonomy?
● Self-sufficient
○ Team does not need to rely on other teams to achieve its goals
● Autonomy
○ Team is able to independently make (process) decisions on how to achieve its goals
25

28. datawire.io
Eliminate centralized specialist functions
26
Centralized architecture
Centralized infrastructure / ops*
(You might need a platform team)

29. datawire.io
Think Spinoff
27

30. datawire.io 28
Monolith

31. datawire.io 29
Monolith
Microservice
Team

32. datawire.io
Technical Implementation
30

33. datawire.io
The Workflows
31
Prototype
Production Users
& Growth
Mission CriticalStage
Goals
Fast Feedback
from both
Tools & Users
Add Features
&
Don’t Disrupt
Users
Stability

34. datawire.io
One Platform, Parallel Workflows, Seamless Transitions
32
Stage 1: Rapid
development,
early users
Stage 2: Users
Stage 3: Internal
users, coupling
Stage
Goals Doesn’t crash...
Minimal
disruption to
users...
No cascade
failures...
Stage 1: Rapid
development,
early users
Stage 2: Users
Stage 3: Internal
users, coupling
Stage 1: Rapid
development,
early users
Stage 2: Users
Stage 3: Internal
users, couplingPrototype
Production Users
& Growth
Mission Critical
Doesn’t crash...
Minimal
disruption to
users...
No cascade
failures...Doesn’t crash...
Minimal
disruption to
users...
No cascade
failures...
Fast Feedback
from both
Tools & Users
Add Features
&
Don’t Disrupt
Users
Stability

35. datawire.io
Kubernetes / Docker / Envoy give you the infra you need
33

36. datawire.io
How do I actually use these technologies to
build my workflows?
34

37. datawire.io 35
Stage 1: Prototyping
Org Problem:
You need buy-in for prototyping in
production
Goal:
Fast Feedback from both Tools and
Users
Tech Problem:
You can’t run microservices locally

38. datawire.io 36
Strategy:
Self Service Provisioning
&
Development Containers

39. datawire.io
Make this fast and easy!
● Too much friction leads to accidental coupling
Provide fast self-service provisioning
37

40. datawire.io
Problem: Coding on remote infra is slow...
VM based pipeline:
● Deploy time: maybe 45 minutes?
Docker based pipeline:
● Deploy time: maybe a few minutes?
Hacking react on my laptop with live reload:
● Maybe 1-2 seconds?
Hacking flask on my laptop with live reload:
● Instantaneous
38

41. datawire.io
How can we do better?
39

42. datawire.io
Develop inside a container
Helps with onboarding and jumping between services:
● Single source of truth for build & dependencies
● Consistent and portable dev environment
You can make a faster feedback loop:
1. Sync local files -> remote build
2. Sync local files -> local build; snapshot image; deploy in seconds
3. Sync local files -> local build; proxy into remote cluster
Shameless self promotion:
● See https://forge.sh for (2) and https://telepresence.io for (3)
40

43. datawire.io
Fast Deploy == Resilience
41

44. datawire.io 42
Stage 2: Production Users & Growth
Org Problems:
Recognize the Tradeoff
&
How to measure user impact
Goal:
Add Features
&
Don’t Disrupt Users
Tech Problem:
Software Bugs

45. datawire.io 43
Strategy:
Genetic Diversity
(Multiversion Deployment)

46. datawire.io
Multiple versions for software redundancy
44
End user
Primary version
Canary version
Dev version

47. datawire.io 45
Stage 3: Mission Critical
Org Problem:
Avoid regressing
Goal:
Stability
Tech Problem:
L7 Observability

48. datawire.io 46
Strategy:
Service Level Objectives
&
L7 Observability

49. datawire.io
Cascade Failures
47
A B C D EX

50. datawire.io
Summary
1. Start with: “How do I break up my monolithic process?”
2. Spinoff self sufficient & autonomous teams
3. Build awesome tooling for Service Oriented Development
48

51. datawire.io
Thank you!
● rhs@datawire.io
● If you want to learn more about these ideas, check out our hands-on tutorial here:
○ https://datawire.io/faster
● If you’re interested in any of our open source tools, check them out:
○ https://forge.sh for deployment
○ https://www.telepresence.io for real-time live coding
○ https://www.getambassador.io self-service API Gateway built on Envoy
49

52. END

53. Watch the video with slide
synchronization on InfoQ.com!
https://www.infoq.com/presentations/
service-oriented-development