Everyone talks about microservices and everyone wants to build microservices. But this architecture brings a lot of complexity. Service Mesh will help you to deal with this complexity and let you focus on your application. And Istio is a production-ready Service Mesh implementation. Join the talk to see how to resolve the common challenges of microservice architecture in practice.

1. Microservices
the phantom menace
istio service mesh
the new hope

2. About me
Sergii Bishyr
Software engineer / TL
Program committee
@BishyrS
seriybg@gmail.com
2

3. Agenda
• What is Service Mesh and why do we need it
• What is Istio and how to use it
• Demo
• Summary
3

4. Why Microservices?
• It’s a trend
• Make changes less expensive
• Faster time to production
• Use right tool for the right task
• etc.
4

5. Why Microservices?
• It’s a tend
• Make change less expensive
• Use right tool for the right task
• Scalability
• etc.
5
Complexity it
introduces!

6. Microservices
6

7. Microservices
7

8. Client Library
8
Service
Discovery
Circuit
breaker
Tracing,
Metrics
etc.

9. Client Library
9

10. Polyglot architectures
10

11. Client Library
11

12. Sidecar Pattern
12

13. Sidecar Pattern
13

14. Sidecar Pattern
14

15. Service Mesh
15
Control Plane

16. Service Mesh
16
Control Plane
Configs

17. Service Mesh
17
Control Plane
Configs

18. ThoughtWorks Technology Radar
thoughtworks.com/radar/techniques/service-mesh 18

19. Meet Istio
istio.io
19

20. Istio Control Plane
Pilot Mixer Citadel
Configs Telemetry,
Policy checks
TLS certs
20

21. Istio Proxy
21

22. Istio
22
Control Plane
Configs

23. ThoughtWorks Technology Radar
thoughtworks.com/radar/platforms/istio 23

24. Service to Service communication
24

25. Service to Service communication
25

26. Service to Service communication
26

27. Service to Service communication
27

28. Service to Service communication
28

29. Service to Service communication
29

30. Service Discovery
30

31. Service Discovery
31
Service
Registry

32. Service Discovery
32
Service
Registry

33. Service Discovery
33
Service
Registry

34. Service Discovery
34
Service
Registry

35. Service Discovery
35
Service
Registry

36. Service Discovery
36
Service
Registry

37. Service Discovery
37
Service
Registry

38. Service Discovery
38
Service
Registry

39. Service Discovery
39
Service
Registry

40. Service Discovery
40
Service
Registry

41. Service Discovery
41
Service
Registry

42. Service Discovery
42
Service
Registry

43. Fault Handling
43

44. Fault Handling
44

45. Fault Handling
45
Service A Service B

46. Fault Handling
46
Service A Service B

47. Fault Handling
Timeout
47
Service A Service B

48. Fault Handling
Timeout
Retry
48
Service A Service B

49. Istio Resiliency
49
Service A Service B
Timeout: 1m, Retries: 5

50. Istio Resiliency
50
Service A Service B
Timeout: 1m, Retries: 5
Timeout: 15s, Retries: 3

51. Fault Handling
51
Service A Service B

52. Fault Handling
52
Service A Service B

53. Istio Circuit Breaker
53
Service A Service B
max connections
max pending requests
max requests
consecutive errors

54. Testing
54

55. Testing
55

56. Testing
56

57. Testing
57

58. Testing
58

59. Istio Fault injection
59

60. Release testing
60
Service A Service B v1

61. Release testing
61
Service A
Service B v1
Service B v2

62. Blue-Green Deployment
62
Service A
Service B v1
Service B v2
GREEN
BLUE

63. Blue-Green Deployment
63
TESTS
Service A
Service B v1
Service B v2
GREEN
BLUE

64. Blue-Green Deployment
64
Service A
Service B v1
Service B v2
GREEN
BLUE

65. Istio Traffic mirroring
65
Service A
Service B v1
Service B v2
GREEN
BLUE

66. Istio Traffic mirroring
66
Service A
Service B v1
Service B v2
GREEN
BLUE

67. Canary Deployment
67
Service A
Service B v1
Service B v2

68. Canary Deployment
68
Service A
Service B v1
Service B v2

69. Canary Deployment
69
Service A
Service B v1
Service B v2

70. Istio Advanced routing
70
Service A
Service B v1
Service B v2

71. Istio Advanced routing
71
Service A
Service B v1
Service B v2

72. Security
72

73. Encryption
73
HTTPS

74. Encryption
74
HTTPS

75. Encryption
75
HTTPS
Certificate
Authority

76. Encryption
76
HTTPS
Certificate
Authority

77. Encryption
77
HTTPS
Certificate
Authority

78. Istio Mutual TLS
78
Istio Citadel
HTTPS

79. Istio Mutual TLS
79
Istio Citadel
HTTPS

80. Istio Mutual TLS
80
Istio Citadel
HTTPS

81. Istio Mutual TLS
81
Istio Citadel
HTTPS

82. Troubleshooting
82

83. Troubleshooting
83

84. Troubleshooting
84

85. Troubleshooting
85

86. Troubleshooting
86
?
?
?
?
? ? ?
???

87. Istio Telemetry
Service Service Service
Istio Mixer
Tracing
Metrics
Logging
etc.
87

88. Distributed Tracing, Log Aggregation,
Monitoring
88

89. Istio Key Concepts
89
The Cluster
SERVICE
SERVICE
SERVICEVIRTUAL
SERVICE
DESTINATION
RULE
GATEWAY SERVICE
ENTRY
POLICIES

90. Not so long time ago, in a company
far far away…
(DEMO TIME)
github.com/SeriyBg/starwars-istio 90

91. 91github.com/SeriyBg/starwars-istio
voxxedminsk.istiodemo.xyz

92. 92
Summary
● Focus on business logic
● Freedom to choose any technology stack
● Observability out of the box
● Solve most of the microservices problems
(but not all of them)
Choose wisely.
You are responsible for your application!

93. Resources
• Official Istio site
istio.io
• “Istio in Action” by Christian Posta
manning.com/books/istio-in-action
• Christian Posta’s blog
blog.christianposta.com/tags/#istio
• Red Hat Developers blog
developers.redhat.com/topics/service-mesh
93

94. Thank You!
@BishyrS
seriybg@gmail.com
Any questions do you have?
94