You’ve spent considerable time picking your orchestrator, choosing the right cloud provider and configuring all the intricate details of your new Docker environment, but what about monitoring? In this talk we will cover the tools available on the market: upsides, downsides and upcoming changes. We’ll open the floor to questions, comments and feedback for each tool, so you have a complete view on the monitoring landscape.

1. Monitoring your shiny new Docker
environment
1

2. 2
BUY COSCALE

3. Quick question
● Docker in production?
● Orchestrator?
● Monitoring?
3

4. Source: “Hope vs. reality, Containers in 2016”, Global perception study by CloudFoundry, June 2016

5. Framework
5

6. The environment
Kubernetes
● 3 master nodes
○ Manages nodes, services, containers
● 3 infrastructure nodes
○ Manages inbound traffic
● 5 compute nodes
○ Runs application containers
● (Bastion management node)
● (Hardware load balancer)
6
Docker
● Kubernetes internal services
± 5 containers per node
± 1 container per application container
○ DNS
○ Proxy
○ Managers
● Your application
± 30 containers per node
○ Microservices
○ Databases
○ Caching
○ Queuing
○ ...

7. 7

8. 8
Why?

9. 9

10. The environment
Kubernetes / Openshift / Docker EE
● 3 master nodes
○ Manages nodes, services, containers
● 3 infrastructure nodes
○ Manages inbound traffic
● 5 compute nodes
○ Runs application containers
● (Bastion management node)
● (Hardware load balancer)
10
Docker
● Kubernetes internal services
± 5 containers per node
± 1 container per application container
○ DNS
○ Proxy
○ Managers
● Your application
± 30 containers per node
○ Microservices
○ Databases
○ Caching
○ Queuing
○ ...

11. 11

12. 12

13. 13

14. 14

15. 15

16. How is it different?
16

17. Docker
Container != VM, but not far from
● Disk
● CPU
● Memory
● Application
17
In CoScale:
- 67 OS
- 35 Docker (/ container)

18. 18

19. 19
Orchestration
● Automagical management of
resources
● Self-healing
● Easily scalable

20. 20

21. Node B Node CNode A
Dynamic behavior
21
Services

22. ± 350
containers
22

23. Metrics
35 Docker metrics + 10 Orchestration metrics / Container
x 350
=
15750 metrics
23

24. The what?
24

25. 25
(Virtualized) OS System / Infrastructure monitoring
Container resource monitoring
Container
Application
component
Container
Application
component
Container
Application
component
CPU, Memory, Storage, Network, ...
Orchestration monitoring
Services, volumes, replication controllers, ...
CPU, memory, storage, network, ...
In-container / Application monitoring
Web service, database, caching, ...
Orchestrator

26. The how?
26

27. Endpoints (pull)
27

28. Injection (push)
28
Container
Plugin
Container
Container
Container
CoScale agent

29. 29
Dimensions
29
Old
● Metric Network - server1
● Metric Network - server2
….
● Metric Network - container x
x 350
New
Metric Network
Dimension
Server
Dimension
Interface

30. Tracing (pull)
30

31. The who?
31

32. Prometheus
32

33. Dynatrace
33

34. Sysdig
34

35. CoScale
35
APP
APP
APP
APP
APP
API
APP
APP
RUM
Postgresql
Metadata
Cassandra
Metric data
Elasticsearch
Event data
HaProxy
Loadbalancer
HTTPS handling
Analysis workers
Alerting workers
Data workers
RUM
Boomerang.js
Agent
Log & api
parsing

36. Questions?
36

37. The future
37

38. Thanks for your time
38
● samuel.vandamme@coscale.com
● @kidk (twitter)
● https://www.coscale.com