For a lot of companies it is a challenge to automate their development pipeline. We would like to talk about one possible solution based on gitlab and terraform. The infrastructure and development process is created around git repositories. With Terraform it is possible to code also parts of the infrastructure. So each change in the application and also in the infrastrucure can be tracked within git repositorities. This is a great effort also for the CI process. So it is possible to automate the whole testing and integration processes very easy.

1. GitOps with GitLab
a title in flux

2. INTRO - Gerhard
Likes Dislikes
Perfect cabled rack >70% load on UPS
Cables with different colors Faulty OSD’s in a ceph cluster
Dark fibre ADSL

3. INTRO - Jason
Likes Dislikes
>90% cache hit ratio Working in an office
eBPF tracing systemd
Metrics Alerts after 2am
vim emacs

4. What are we talking about
● What do we have?
● What do we want?
● Getting started
○ Phases 1..N
● Screenshots

5. What are we talking about
● What do we have?
● What do we want?
● Getting started
○ Phases 1..N
● Screenshots Demo

6. What do we have?

7. What do we have?
● 30+ Microservices

8. What do we have?
● 30+ Microservices
● 6+ languages

9. What do we have?
● 30+ Microservices
● 6+ languages
● A few different dbs

10. What do we have?
● 30+ Microservices
● 6+ languages
● A few different dbs
● Containers… lots of containers

11. What do we have?
● 30+ Microservices
● 6+ languages
● A few different dbs
● Containers… lots of containers
CHAOS Lots of ENTROPY

12. What do we have?
● 30+ Microservices
● 6+ languages
● A few different dbs
● Containers… lots of containers
CHAOS Lots of ENTROPY

13. What do we want?

14. What do we want?
● Self service

15. What do we want?
● Self service
● Single source of truth

16. What do we want?
● Self service
● Single source of truth
● Language agnostic

17. What do we want?
● Self service
● Single source of truth
● Language agnostic
Problem Challenge

18. What do we want?
● Self service
● Single source of truth
● Language agnostic
Problem Challenge

19. Getting started

20. Getting started
FNDP

21. Getting started
FNDP
aka Fancy New
Deployment Pipeline

22. Phase 1
Infrastructure as Code

23. Phase 1
Infrastructure as Code == Terraform

24. Phase 1
Infrastructure as Code == Terraform

25. Phase 1
Infrastructure as Code == Terraform
● Infrastructure/Configuration drift

26. Phase 1
Infrastructure as Code == Terraform
● Infrastructure/Configuration drift
● Meatbag CI

27. Phase 1
Infrastructure as Code == Terraform
● Infrastructure/Configuration drift
● Meatbag CI
● Coordination is hard

28. Phase 2
Infrastructure as Code + GitLab CI

29. Phase 2
Infrastructure as Code + GitLab CI
● What about applications?

30. Phase 3
Applications with Deployment code in a GitLab
CI pipeline based on bash scripts

31. Phase 3
Applications with Deployment code in a GitLab
CI pipeline based on bash scripts
● Fragile (aka the ice castle)

32. Phase N (as in… for Now)
GitOps (with GitLab CI scaffolding)

33. Phase N (as in… for Now)
GitOps (with GitLab CI scaffolding)
● Flux (GitOps Kubernetes operator)

34. GitOps

35. GitOps
● Declarative approach

36. GitOps
● Declarative approach
● CICD Based

37. GitOps
● Declarative approach
● CICD Based
● Heavily Opinionated

38. GitOps - demo
● Git repo of kubernetes setup (IaC)
○ Terraform Code
○ CI managed
○ GKE based

39. GitOps - demo
● Git repo of kubernetes setup
○ Terraform Code
○ CI managed
○ GKE based
● Raspberrypi cluster

40. GitOps - demo
● Git repo of kubernetes setup
○ Terraform Code
○ CI managed
○ GKE based
● Raspberrypi cluster

41. GitOps - demo
● MiniKube

42. GitOps - demo
● MiniKube
● GitLab VM
○ Infrastructure repository

43. GitOps - demo
● MiniKube
● GitLab VM
○ Infrastructure repository
● Flux on MiniKube
○ Flux watches: Infrastructure repo

44. Its demo time

45. Some notes
● Work in progress

46. Some notes
● Work in progress
● Unifying pipelines

47. Some notes
● Work in progress
● Unifying pipelines
● Evaluate other tools

48. Some notes
● Work in progress
● Unifying pipelines
● Evaluate other tools
● Did i mention it’s a work in progress?

49. Questions?