Kubernetes User Group: 維運 Kubernetes 的兩三事

•

7 gostaram•1,441 visualizações

Container Orchestration 之爭已經落幕，Kubernetes 成為主流，AWS, Azure 跟 GCP 都已提出相對應的解決方案，但該選擇廠商所提供的服務或是自己架設呢？如何把 Stateless 甚至是 Stateful 應用服務運行於其上呢？部署應用程式到 Kubernetes 之中該如何做比較好？本分享談及多次在公司導入及維運 Kubernetes 的相關經驗，讓有興趣或是剛使用的人可以減少摸索的時間

Software

Something About . . .
Operation/Maintenance
Kubernetes

Select Where Your Kubernetes is!
7
Public Cloud
No
Yes
Completed
Network Infra.
General Usage
Yes
Yes
No
Shutdown
Suddenly
No Yes
No

When Should I Self-Hosted Kubernetes
◂
◂
◂
8

High Availability: Kubernetes Itself
10
- Key/Value Storage - apiserver
- scheduler
- controller-manager
- kubelet
- kube-proxy
- container runtime- HA: 1, 3, 5 …
- Clustering Guide
- General HA Mode

High Availability: Application in K8S
◂
11
~$ kubectl get deployment
NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE
Nginx 3 3 3 3 18s

Scalability: Horizontal Pod Autoscaler
14
Ref

Scalability: Vertical Pods Autoscaler
15
Ref

Manage Production Service
19
Stateless Stateful
Setup
Scale Out/Up
Backup
Upgrade
Operation

What is Kubernetes Operator?
22
An Operator is a Domain Specific Controller

Operation of Stateless Service
23
kubectl
ReplicaSet
app=web, env=prod
Pod
app=web
env=prod
scale up
desired=3 count=1
kubectl
ReplicaSet
app=web, env=prod
Pod
app=web
env=prod
desired=3 count=3

Operation of Stateful Service
(Operator)
24
backup
kubectl
etcd Operator
app=3.0.13
size=3
Pod
app=web
env=prod
backup-tool
interval=300s

Log Collect
Centralised V.S. Decentralised
◂
◂
◂
29

System/Application
Metric Collect . . .
30

Common Resource View of K8S Application
36
Deployment YAML
ConfigMap YAML Secret YAML/VaultDocker Image Tag
Service YAML

Good Old Days V.S. Kubernetes
40
GNU/Linux
ELF Binaries Config in /etc
apt, yum, etc
Chef, Puppet, Ansible
Kubernetes
Images K8S Object
Helm
Operator Framework

CI/CD Total Solution For K8S
◂
◂
◂
◂
◂
41

Official TroubleShooting Guide
◂
◂
◂
◂
44

Just My Two Cents: Pod
◂ Pending
◂ Terminating
◂ CrashLoopBackOff
45

Just My Two Cents: Service
◂ Endpoint is Empty
◂
◂
◂
46

Just My Two Cents: Node Register
◂
◂
◂
◂
47

1.
Your Best
Friend: kubectl
Good Craftsmanship Depends
on Use of The Right Tools

When You Manage N Clusters N
Namespaces
◂
◂
◂
◂
◂
49

There Are Several Helper Tool For You
◂
◂
◂
◂
50
Ref

1.
Kubernetes
Trends
Where Kubernetes is Going?

Mais conteúdo relacionado

Mais procurados

AWS re:Invent re:Cap 2019: My ElasticSearch Journey on AWSsmalltown

Containers and CloudStackShapeBlue

AWS Lambda and serverless Java | DevNation LiveRed Hat Developers

整合Cloud Foundry 和 Kubernetes 技術打造企業級雲應用平台解決方案inwin stack

Wido den hollander cloud stack and cephShapeBlue

實際架構實踐演化與解決方案Camel Camel

Stratoscale Latest and GreatestZach Lanksbury

OpenStack Watcheropenstackindia

Developing the Stratoscale System at Scale - Muli Ben-Yehuda, Stratoscale - D...DevOpsDays Tel Aviv

Deploying openstack using ansibleopenstackindia

XCP-ng - past, present and futureShapeBlue

K8S in prodMageshwaran Rajendran

Demistifying open stack storageopenstackindia

Web後端技術的演變inwin stack

Intro to creating kubernetes operators Juraj Hantak

OpenStack on Kubernetes (BOS Summit / May 2017 update)rhirschfeld

Kafka on Kubernetes: Keeping It Simple (Nikki Thean, Etsy) Kafka Summit SF 2019confluent

Boyan Krosnov - Building a software-defined cloud - our experienceShapeBlue

John Spray - Ceph in KubernetesShapeBlue

DevEx | there’s no place like k3sHaggai Philip Zagury

Mais procurados (20)

AWS re:Invent re:Cap 2019: My ElasticSearch Journey on AWS

Containers and CloudStack

AWS Lambda and serverless Java | DevNation Live

整合Cloud Foundry 和 Kubernetes 技術打造企業級雲應用平台解決方案

Wido den hollander cloud stack and ceph

實際架構實踐演化與解決方案

Stratoscale Latest and Greatest

OpenStack Watcher

Developing the Stratoscale System at Scale - Muli Ben-Yehuda, Stratoscale - D...

Deploying openstack using ansible

XCP-ng - past, present and future

K8S in prod

Demistifying open stack storage

Web後端技術的演變

Intro to creating kubernetes operators

OpenStack on Kubernetes (BOS Summit / May 2017 update)

Kafka on Kubernetes: Keeping It Simple (Nikki Thean, Etsy) Kafka Summit SF 2019

Boyan Krosnov - Building a software-defined cloud - our experience

John Spray - Ceph in Kubernetes

DevEx | there’s no place like k3s

Semelhante a Kubernetes User Group: 維運 Kubernetes 的兩三事

Database as a Service (DBaaS) on KubernetesObjectRocket

CKA(Kubernetes 자격증) 잘 준비하는 법_InfraEngineer

Dive into DevOps | March, Traefik as kubernetes ingress controller, Ihor BorodinProvectus

PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...Equnix Business Solutions

Kubernetes extensibility: crd & operators Giacomo Tirabassi

Kubernetes extensibility: CRDs & OperatorsSIGHUP

Production Grade Kubernetes ApplicationsNarayanan Krishnamurthy

Kubernetes InternalsShimi Bandiel

Muli Ben-Yehuda, Stratoscale - The Road to a Hyper-Converged OpenStack, OpenS...Cloud Native Day Tel Aviv

Running Kubernetes in KubernetesQAware GmbH

JDO 2019: What you should be aware of before setting up kubernetes on premise...PROIDEA

KubernetesAnastasios Gogos

01 - VMUGIT - Lecce 2018 - Fabio Rapposelli, VMwareVMUG IT

Cluster management with KubernetesSatnam Singh

GDG Cloud Southlake 29 Jimmy Mesta OWASP Top 10 for KubernetesJames Anderson

Create a Varnish cluster in Kubernetes for Drupal caching - DrupalCon North A...Ovadiah Myrgorod

Cloud-Native Operations with Kubernetes and CI/CDVMware Tanzu

Kubernetes SecurityKarthik Gaekwad

Lc3 beijing-june262018-sahdev zala-guangyaSahdev Zala

Production Ready Kafka on Kubernetes (Devandra Tagare, Lyft) Kafka Summit SF ...confluent

Semelhante a Kubernetes User Group: 維運 Kubernetes 的兩三事 (20)

Database as a Service (DBaaS) on Kubernetes

CKA(Kubernetes 자격증) 잘 준비하는 법_

Dive into DevOps | March, Traefik as kubernetes ingress controller, Ihor Borodin

PGConf.ASIA 2019 Bali - Building PostgreSQL as a Service with Kubernetes - Ta...

Kubernetes extensibility: crd & operators

Kubernetes extensibility: CRDs & Operators

Production Grade Kubernetes Applications

Kubernetes Internals

Muli Ben-Yehuda, Stratoscale - The Road to a Hyper-Converged OpenStack, OpenS...

Running Kubernetes in Kubernetes

JDO 2019: What you should be aware of before setting up kubernetes on premise...

Kubernetes

01 - VMUGIT - Lecce 2018 - Fabio Rapposelli, VMware

Cluster management with Kubernetes

GDG Cloud Southlake 29 Jimmy Mesta OWASP Top 10 for Kubernetes

Create a Varnish cluster in Kubernetes for Drupal caching - DrupalCon North A...

Cloud-Native Operations with Kubernetes and CI/CD

Kubernetes Security

Lc3 beijing-june262018-sahdev zala-guangya

Production Ready Kafka on Kubernetes (Devandra Tagare, Lyft) Kafka Summit SF ...

Mais de smalltown

Kubernetes Summit 2023: Head First Kubernetes smalltown

SRE Conference 2022 - How to Build a Healthy On-Call Culturesmalltown

DevOpsDays Taipei 2021 - How FinTech Embrace Change Managementsmalltown

Cloud Native User Group: Shift-Left Testing IaC With PaCsmalltown

Kubernetes Summit 2019 - Harden Your Kubernetes Clustersmalltown

HashiCorp Vault Workshop：幫 Credentials 找個窩smalltown

TW SEAT - DevOps: Security 干我何事？smalltown

DevOpsDays - DevOps: Security 干我何事？smalltown

Docker Summit 2016 - Kubernetes: Sweets and Bitterssmalltown

DevOpsDays Taipei 2017 - Terraform: Everything Is Codesmalltown

COSCUP 2017 - infrastructure As Code smalltown

AWS Connect 2017 - Container (feat. AWS)smalltown

DevOps Summit 2016 - The immutable Journeysmalltown

DevOps 2015 - Dancing with Chefsmalltown

Mais de smalltown (14)

Kubernetes Summit 2023: Head First Kubernetes

SRE Conference 2022 - How to Build a Healthy On-Call Culture

DevOpsDays Taipei 2021 - How FinTech Embrace Change Management

Cloud Native User Group: Shift-Left Testing IaC With PaC

Kubernetes Summit 2019 - Harden Your Kubernetes Cluster

HashiCorp Vault Workshop：幫 Credentials 找個窩

TW SEAT - DevOps: Security 干我何事？

DevOpsDays - DevOps: Security 干我何事？

Docker Summit 2016 - Kubernetes: Sweets and Bitters

DevOpsDays Taipei 2017 - Terraform: Everything Is Code

COSCUP 2017 - infrastructure As Code

AWS Connect 2017 - Container (feat. AWS)

DevOps Summit 2016 - The immutable Journey

DevOps 2015 - Dancing with Chef

Último

What is Binary Language? Computer Number SystemsJheuzeDellosa

Alluxio Monthly Webinar | Cloud-Native Model Training on Distributed DataAlluxio, Inc.

BATTLEFIELD ORM: TIPS, TACTICS AND STRATEGIES FOR CONQUERING YOUR DATABASEOrtus Solutions, Corp

TECUNIQUE: Success Stories: IT Service providermohitmore19

EY_Graph Database Powered SustainabilityNeo4j

Project Based Learning (A.I).pptx detail explanationkaushalgiri8080

Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsAlberto González Trastoy

DNT_Corporate presentation know about usDynamic Netsoft

Cloud Management Software Platforms: OpenStackVICTOR MAESTRE RAMIREZ

Steps To Getting Up And Running Quickly With MyTimeClock Employee Scheduling ...MyIntelliSource, Inc.

Reassessing the Bedrock of Clinical Function Models: An Examination of Large ...harshavardhanraghave

Unit 1.1 Excite Part 1, class 9, cbse...aditisharan08

Hand gesture recognition PROJECT PPT.pptxbodapatigopi8531

A Secure and Reliable Document Management System is Essential.docxComplianceQuest1

Building Real-Time Data Pipelines: Stream & Batch Processing workshop SlideChristina Lin

Russian Call Girls in Karol Bagh Aasnvi ➡️ 8264348440 💋📞 Independent Escort S...soniya singh

Adobe Marketo Engage Deep Dives: Using Webhooks to Transfer DataBradBedford3

Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...MyIntelliSource, Inc.

Introduction to Decentralized Applications (dApps)Intelisync

Short Story: Unveiling the Reasoning Abilities of Large Language Models by Ke...kellynguyen01

Kubernetes User Group: 維運 Kubernetes 的兩三事

1. Something About . . . Operation/Maintenance Kubernetes

2. Hello! I am Tom Tsai aka smalltown 2

3. “ 3 http://bit.ly/taipei-hug

4. “ Kubernetes Production 4

5. Outline ◂ ◂ ◂ ◂ ◂ ◂ ◂ ◂ 5

6. 1. Where is Your Kubernetes?

7. Select Where Your Kubernetes is! 7 Public Cloud No Yes Completed Network Infra. General Usage Yes Yes No Shutdown Suddenly No Yes No

8. When Should I Self-Hosted Kubernetes ◂ ◂ ◂ 8

9. 1. High Availability/Scalability

10. High Availability: Kubernetes Itself 10 - Key/Value Storage - apiserver - scheduler - controller-manager - kubelet - kube-proxy - container runtime- HA: 1, 3, 5 … - Clustering Guide - General HA Mode

11. High Availability: Application in K8S ◂ 11 ~$ kubectl get deployment NAME DESIRED CURRENT UP-TO-DATE AVAILABLE AGE Nginx 3 3 3 3 18s

12. Before Talk About Scalability . . . 12

13. K8S Resource Request & Limit 13 Ref

14. Scalability: Horizontal Pod Autoscaler 14 Ref

15. Scalability: Vertical Pods Autoscaler 15 Ref

16. Scalability: Cluster Autoscaler 16 Ref

17. 1. Manage Stateful Service

18. Stateful Service ◂ ◂ ◂ ◂ ◂ ◂ 18

19. Manage Production Service 19 Stateless Stateful Setup Scale Out/Up Backup Upgrade Operation

20. CoreOS Brings K8S Operator . . . 20

21. What is Kubernetes Operator? ◂ ◂ ◂ 21

22. What is Kubernetes Operator? 22 An Operator is a Domain Specific Controller

23. Operation of Stateless Service 23 kubectl ReplicaSet app=web, env=prod Pod app=web env=prod scale up desired=3 count=1 kubectl ReplicaSet app=web, env=prod Pod app=web env=prod desired=3 count=3

24. Operation of Stateful Service (Operator) 24 backup kubectl etcd Operator app=3.0.13 size=3 Pod app=web env=prod backup-tool interval=300s

25. Exist Operators ◂ ◂ 25

26. 1. Log/Monitoring

27. Log Management . . . 27

28. Log Management: Yes, ELKF ◂ ◂ ◂ 28

29. Log Collect Centralised V.S. Decentralised ◂ ◂ ◂ 29

30. System/Application Metric Collect . . . 30

31. Metrics: Yes, Prometheus ◂ 31

32. Get Alert When Service . . . 32

33. Monitoring: Internal ◂ ◂ 33 Ref

34. Monitor: External ◂ ◂ ◂ ◂ 34

35. 1. Continuous Delivery

36. Common Resource View of K8S Application 36 Deployment YAML ConfigMap YAML Secret YAML/VaultDocker Image Tag Service YAML

37. Deploy With kubectl 37 Ref

38. The Key Man: Helm ◂ ◂ ◂ 38

39. Deploy With Helm 39 Ref

40. Good Old Days V.S. Kubernetes 40 GNU/Linux ELF Binaries Config in /etc apt, yum, etc Chef, Puppet, Ansible Kubernetes Images K8S Object Helm Operator Framework

41. CI/CD Total Solution For K8S ◂ ◂ ◂ ◂ ◂ 41

42. GitOps Patterns 42 Ref

43. 1. TroubleShooting Guide

44. Official TroubleShooting Guide ◂ ◂ ◂ ◂ 44

45. Just My Two Cents: Pod ◂ Pending ◂ Terminating ◂ CrashLoopBackOff 45

46. Just My Two Cents: Service ◂ Endpoint is Empty ◂ ◂ ◂ 46

47. Just My Two Cents: Node Register ◂ ◂ ◂ ◂ 47

48. 1. Your Best Friend: kubectl Good Craftsmanship Depends on Use of The Right Tools

49. When You Manage N Clusters N Namespaces ◂ ◂ ◂ ◂ ◂ 49

50. There Are Several Helper Tool For You ◂ ◂ ◂ ◂ 50 Ref

51. 1. Kubernetes Trends Where Kubernetes is Going?

52. Kubernetes Move So Fast... ◂ ◂ ◂ ◂ 52