Just what is a "service mesh", and if I get one will it make everything OK? Communication is the backbone of distributed applications. Imagine you could control that backbone independently of all the components, so your application code just makes simple calls to other services, and your communication backbone does all the complex non-functional work. Load balancing, traffic management, fault tolerance, end-to-end monitoring, dynamic routing and secure communication could all be applied and controlled centrally. That's a service mesh. In this session I'll cover the major features of a service mesh using Istio - which is the most popular technology in this space. I'll show you what you can do with a service mesh, how it simplifies application design and also where it adds complexity. My examples will range from new microservices designs to legacy monoliths, and you'll see what a service mesh can bring to different types of application.

1. Just what is a Service Mesh?
And if I get one, will it make everything OK?
@EltonStoneman | elton@docker.com | #BuildStuffLT

2. • Understanding the service mesh
• Using Istio with Kubernetes
• Evaluating service meshery

3. WHAT IS A SERVICE MESH?
It's the communication
between software components,
made into its own thing

4. web
api
database
• Address
• Timeout
• Retry
• Encryption
• Address
• Timeout
• Retry
• Encryption

5. microservices-demo

6. web
api
database
service-mesh
• Address
• Timeout
• Retry
• Encryption

7. web
api
database
service-mesh

8. SERVICE MESH FEATURES
• Traffic management
• Discovery, load-balancing, failure handling
• Security
• Encryption, authentication, authorization
• Observability
• Visualization, tracing, monitoring, logging

9. INTRODUCING ISTIO
• Open source, platform-agnostic*
• 0.1 in 2017, 1.0 in 2018
• Other service meshes around
• Consul, Linkerd, Maesh, SMI

10. * https://istio.io/docs/concepts/what-is-istio/

11. * https://istio.io/docs/concepts/what-is-istio/

12. * https://istio.io/docs/concepts/what-is-istio/

13. * https://istio.io/docs/concepts/what-is-istio/

14. YOUR SERVICE MESH IS NOT FREE
• Istio: ~2M LOC
• Envoy: ~250K
• Kubernetes: ~3.1M
• Docker: ~950K

15. YOUR SERVICE MESH IS NOT FREE
Here at Shopify, we’re working
on deploying Istio as our service
mesh. We’re doing quite well,
but are hitting a wall: Cost.
https://is.gd/ZqwILb

16. istio/istio

17. istio/istio

18. istio/istio

19. USING ISTIO
• Deploying on Kubernetes
• Automatic service registration
• Running apps with Istio

20. > demo 1

22. productpage
reviews
Service
Pod
Container

23. productpage
reviews
Virtual Service
Destination
Subset
Service
Pod
Container

24. productpage
reviews
Virtual Service
Service
Pod
Container
Destination
Subset
- route:
- destination:
host: reviews
subset: v2
weight: 50

25. TRAFFIC MANAGEMENT
• Runtime management
• Healthchecks, load-balancing, retries
• Quality control
• Personalized routing, fault injection
• Deployment
• A/B testing, canaries, staged rollouts

26. > demo 2

28. productpage
reviews
Mutual TLS
Secure naming
Identity/Authn/Authz
Certificate mgmt
Issue/Store/Rotate

29. > demo 3

31. productpage
reviews
Visualization
Distributed Tracing
Monitoring
Logging

32. > demo 4

34. SERVICE MESH ALTERNATIVES
• Traffic management
• DNS, feature toggles, libraries
• Security
• Platform, OSS integration
• Observability
• Prometheus, Grafana, Jaeger…

35. DO I NEED A SERVICE MESH?
• Service sprawl
• Release bottlenecks
• Snowflake implementations
• Cloud-native app pilot

36. THINK ABOUT THE COST
• Lock-in: tech & architecture
• Learning curve
• Environment drift
• Anti-DevOps – more SRE

38. NEXT STEPS
• Today’s demos | is.gd/q23hrk
• Docker and Kubernetes for .NET Devs | dak4.net
• Learn Docker in a Month of Lunches | is.gd/xZ8HiC
• Manning 40% discount | ctwbuild19

39. THANK YOU :)
@EltonStoneman | elton@docker.com | #BuildStuffLT