Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)

Kubernetes One-Click Deployment:
Hands-on Workshop
@joerg_schad @dcos

Jörg Schad
Technical Community
Lead / Developer
● Core Mesos
developer at
Mesosphere
● Passions are deep
learning, distributed
data systems, and
data analytics

Chris Gaun
PMM at Mesosphere /
CNCF Ambasador
● Previous to that
Gartner analyst
covering public IaaS
● @gaunetes

First, Some Questions (Show of
Hands)
• Are you a developer?
• Are you in operations?
• Are you using K8s (in production)?
• Are you using DC/OS (in production)?

© 2018 Mesosphere, Inc. All Rights Reserved.
Hardware
Operating System
Application
7
COMPUTERS

noun | ˈmīkrō/ /ˈsərvəs/ :
an approach to application development in which a
large application is built as a suite of modular services.
Each module supports a specific business goal and
uses a simple, well-defined interface to communicate
with other modules.*
Microservices are designed to be flexible, resilient,
efficient, robust, and individually scalable.
*From whatis.com
OVERVIEW

Operating
System
Operating
System
Operating
System
ServiceApp ServiceServiceAppApp
9
MICROSERVICES
- Polyglot
- Single
Responsibility
- Smaller Teams
- Utilization
- Machine
types/groups
- Dependency hell
Machine
Infrastructure
Machine Machine
ServiceService ServiceServiceServiceService

ServiceApp ServiceServiceAppApp
OS
10
CONTAINERS
- Rapid deployment
- Dependency
vendoring
- Container image
repositories
- Spreadsheet
scheduling
OS OS
Machine
Infrastructure
Machine Machine
Container Runtime Container Runtime Container Runtime
ServiceService ServiceServiceServiceService

CONTAINER
SCHEDULING
RESOURCE
MANAGEMENT
SERVICE
MANAGEMENT
- Load Balancing
- Readiness Checking
CONTAINER ORCHESTRATION

CONTAINER
SCHEDULING
- Placement
- Replication/Scaling
- Resurrection
- Rescheduling
- Rolling Deployment
- Upgrades
- Downgrades
- Collocation
RESOURCE
MANAGEMENT
- Memory
- CPU
- GPU
- Volumes
- Ports
- IPs
- Images/Artifacts
SERVICE
MANAGEMENT
- Labels
- Groups/Namespaces
- Dependencies
- Load Balancing
- Readiness Checking
CONTAINER ORCHESTRATION

Orchestration
13
Machine Infrastructure
Web Apps & Services
Scheduling
Resource Management
Container Runtime
Machine & OS
Service Management
CONTAINER
ORCHESTRATION
Machine & OS Machine & OS
Container Runtime Container Runtime

The premier platform to run data-driven,
containerized applications on any infrastructure
North American
Banks
Worldwide Telco
Companies
Highest-Valued
Startups
Automotive
Technology Efforts
Represents organizations using Mesosphere technologies
5 of Top
10
30% of 7 of Top
12
5 of Top
10
6
Leading

Volume
Data
Loader
Front
End
Pods

Volume
Data
Loader
Front
End
Pods
Set of Related Containers
Tightly Coupled
Ephemeral/Stateless
Share Namespace
Share Network
Unit of Management

Pods
Set of Related Containers
Tightly Coupled
Ephemeral/Stateless
Share Namespace
Share Network
Unit of Management
Pod

Pod Networking
D
B
C
A
Routable
(layer 3)
No NAT
(internode)10.0.0.1 10.0.0.2
10.0.0.3 10.0.0.4

Labels
D
B
C
A
app = portal
tier = frontend
version = v1
app = portal
tier = backend
version = v1
app = portal
tier = frontend
version = v2
app = portal
tier = backend
version = v2

Label Selectors
D
B
C
A
app = portal
tier = frontend
version = v1
app = portal
tier = backend
version = v1
app = portal
tier = frontend
version = v2
app = portal
tier = backend
version = v2
app = portal
SELECTOR

Label Selectors
D
B
C
A
app = portal
tier = frontend
version = v1
app = portal
tier = backend
version = v1
app = portal
tier = frontend
version = v2
app = portal
tier = backend
version = v2
app = portal
version = v1
SELECTOR

Controllers
Desired State
Current State
UPDATEANALYZE

Replica Set (Controller)
NODE 1
A
NODE 2
A
NODE 3
A
NODE 4
A
Replicas = 4
DESIRED
Replicas = 4
CURRENT

NODE 1
A
NODE 2
A
NODE 3
A
NODE 4
A
Replicas = 4
DESIRED
Replicas = 3
CURRENT

NODE 1
A
NODE 2
A
NODE 3
A
NODE 4
A
Replicas = 4
DESIRED
Replicas = 4
CURRENT
A

(µ)Services
Service A
Stable Cluster-wide IP
Cluster-wide DNS name
Layer 3 Load Balancer
Updates continuously
app = portal
tier = frontend
version = v1
SELECTOR
A A A

(µ)Services
Service A
New Pod added
automatically based
on its label selector
app = portal
tier = frontend
version = v1
SELECTOR
A A A A

Kubernetes concepts
30
kind: Deployment
kind: ReplicaSet
kind: Pod
scales
N instances
of Pod
Set of
Containers
Upgrades
Deployees

Configuration File
31
apiVersion: apps/v1beta2
kind: Deployment
metadata:
name: nginx-deployment
spec:
replicas: 3
selector:
matchLabels:
app: nginx
template:
metadata:
labels:
app: nginx
spec:
containers:
- name: nginx
image: nginx:1.7.9
ports:
- containerPort: 80

Configuration File
32
apiVersion: apps/v1beta2
kind: Deployment
metadata:
name: nginx-deployment
spec:
replicas: 3
selector:
matchLabels:
app: nginx
template:
metadata:
labels:
app: nginx
spec:
containers:
- name: nginx
image: nginx:1.7.9
ports:
- containerPort: 80
ReplicaSet
Pod

Service Spec and Labels
kind: Service
apiVersion: v1
metadata:
name: my-service
spec:
selector:
app: MyApp
ports:
- protocol: TCP
port: 80
targetPort: 9376
Label

ETCD 01
MASTER 01
etcd
LoadBalancer
WORKER 01
API Server
Scheduler
Controller
Manager
Kubectl
Kubelet Kube Proxy
Container Engine (Docker,
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
API Server
Scheduler
Controller
Manager
Kubectl
Kubelet Kube Proxy
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
• Etcd is a distributed, consistent
key-value store
• Uses the RAFT consensus
algorithm for leader election
• Supports revisions and event
streams
• Primary store for all K8s API
objects (single source of truth)
• The only storage backend
currently supported by
Kubernetes
etcd

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
Scheduler
Controller
Manager
Kubectl
Kubelet Kube Proxy
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
etcd
API Server
• Entry point to the system
• CRUD server for all the API
objects in Kubernetes
• Processes REST requests and
updates the objects in etcd
• Performs authentication /
authorization
MORE: https://goo.gl/KL8WfQ

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
Scheduler
Kubectl
Kubelet Kube Proxy
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
etcd
API Server
• Daemon process that
implements the control loops
built into Kubernetes
• E.g. … see NEXT slide
MORE: https://goo.gl/NJyRP3
Controller
Manager

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
Scheduler
Kubectl
Kubelet Kube Proxy
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
etcd
API Server
Types of Controllers in Kubernetes:
● ReplicaSet - desired state of pods
● ReplicationController - deprecated
● Deployments - updates
● StatefulSets - data services
● DaemonSet
● GarbageCollection - kills orphans
● Jobs
● CronJobs
Controller
Manager

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
Kubectl
Kubelet Kube Proxy
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
etcd
API Server
Controller
Manager
• Answers: Where should this pod
run?
• Based on policy, available
resources, affinity, labels, Qos
requirements, etc.
• Binds unscheduled pods to
nodes
EXPERT MODE:
● Node Affinity/Anti-Affinity
● Taints and Tolerations
● Pod Affinity/Anti-Affinity
https://goo.gl/nvLDE9Scheduler

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
Kubectl
Kube Proxy
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
etcd
API Server
Controller
Manager
Scheduler
• Agent that runs on each node
• Recieves a set of PodSpecs and
insures all pods are running and
healthy
• Interacts with container runtime
(Docker, CRI-O)
• Performs some node-level health
checks
MORE: https://goo.gl/FEKN43
Kubelet

ETCD 01
MASTER 01
LoadBalancer
WORKER 01
Kubectl
CRI-O)
Pod Pod Pod
HTTPS
HTTPS
HTTPS
HTTPS
etcd
API Server
Controller
Manager
Scheduler
Kubelet
• Network proxy and load balancer
for Services
• Used to be a user-space proxy
• Currently uses iptables
MORE: https://goo.gl/ph4sAs
Kube Proxy

Challenges

- RBAC + IAM
- Network segmentation
- OSS framework/ container control
- Multiple isolated clusters
- Vanilla / standard / OSS Kubernetes
- Identical setup / components / no snowflakes
- Multi/hybrid cloud
- Multi data center
- Easy updating / versioning
- Scaling
- Integrations - ELB, networking, Storage, Monitoring
- Easy installation
Security
Interoperability
Easy
Management
Delivering Kubernetes Challenges
Where they run Kubernetes
Multiple management hurdles
42%
On
Prem
57%
DIY
AWS
~40%
40+%
Require more security for wider
deployment
CNCF poll

Kubernetes
Container Runtime
Machine & OS Machine & OS Machine & OS
Container Runtime Container RuntimeContainer Runtime
Container Runtime
Orchestration
Scheduling
Resource Management
Service Management
Web Apps & Services
OrchestrationScheduling
Resource Management
Service Management
Web Apps & Services

KUBERNETES ARCHITECTURE
50
ETCD 01
MASTER 01
etcd
LoadBalancer
WORKER 01
API Server
Scheduler
Controller
Manager
Kubectl
Kubelet Kube Proxy
CRI-O)
Pod Pod Pod
HTTP
S
HTTP
S
HTTP
S
HTTP
S

Kubernetes HA
Container Runtime
Container Runtime
Web Apps & Services
etcd etcdetcd
api-ser
ver
api-ser
ver
api-ser
ver
Kube-
proxy
Kube-
proxy
scheduler
Kube-
proxy
scheduler
schedulercontrollercontroller
controller
kubelet kubelet kubelet
...

Kubernetes HA
Container Runtime
Container Runtime
Web Apps & Services
etcd etcdetcd
api-ser
ver
api-ser
ver
api-ser
ver
Kube-
proxy
Kube-
proxy
scheduler
Kube-
proxy
scheduler
controller
...

Datacenter

Datacenter
Typical Datacenter
siloed, over-provisioned servers,
low utilization
Kubernetes
Jenkins
Kafka
Spark
Kuk

Datacenter
Typical Datacenter
low utilization
Mesos/ DC/OS
automated schedulers, workload multiplexing onto the
same machines
Tensorflow
Jenkins
Kafka
Spark
Tensorflow

PHYSICAL INFRASTRUCTURE
MICROSERVICES, CONTAINERS, & DEV TOOLS
VIRTUAL MACHINES PUBLIC CLOUDS
DATA SERVICES, MACHINE LEARNING, & AI
Security &
Compliance
Application-Aware
Automation
Multitenancy
Hybrid Cloud
Management
100+
MORE
DatacenterEdge
Datacenter and Cloud as a Single Computing Resource
Powered by Apache Mesos
20+
MORE
Unified hybrid cloud operations
Securely manage cloud, datacenter, and edge
infrastructures from a single control plane
4
Mesosphere DC/OS
Intelligent resource pooling
Optimize workload density for highest utilization with
resource guarantees
3
Broad workload coverage
Run today & tomorrow’s applications including traditional
J2EE, containers, analytics & ML
1
Application-aware automation
Automate workload-specific operating procedures to
“as-a-Service” anything from Kubernetes to data services
2

Deploy
Scale
Configure
Recover
3 AM
...
Typical Datacenter
low utilization
Kubernetes
Jenkins
Kafka
Spark
Cassandra

DC1
DC2
DC3
Deploy
Scale
Configure
Recover
3 AM
...

Two-level Scheduling
1. Agents advertise resources to Master
2. Master offers resources to Framework
3. Framework rejects / uses resources
4. Agent reports task status to Master
60
MESOS ARCHITECTURE
Mesos
Master
Mesos
Master
Mesos
Master
Mesos AgentMesos Agent Service
Cassandra
Executor
Cassandra
Task
Kubernetes
Scheduler
Spark
Executor
Spark
Task
Mesos AgentMesos Agent Service
Docker
Executor
Docker
Task
K8s Executor
Kubelet
Task
Marathon
Scheduler
Kafka
Scheduler

DC/OS and Kubernetes
Container Runtime
Container Runtime
Orchestration
Scheduling
Resource Management
Service Management
Web Apps & Services
Mesosphere DC/OS
OrchestrationScheduling
Resource Management
Service Management
Web Apps & Services

DC/OS and Kubernetes
Orchestration
Web Apps & Services
Scheduling
Resource Management
Container Runtime
Machine & OS
Service Management
Container Runtime
Orchestration
Scheduling
Resource Management
Service Management
Web Apps & Services
Mesosphere DC/OS
Big Data
Services
● Spark
● Flink
● Kafka
● ….

Mesos and Kubernetes
Container Runtime
Container Runtime
DC/OS / Apache Mesos
Web Apps & Services
etcd etcdetcd
api-ser
ver
api-ser
ver
api-ser
ver
Kube-
proxy
Kube-
proxy
scheduler
Kube-
proxy
scheduler
controller
...

Mesos and Kubernetes
Container Runtime
Container Runtime
Mesosphere Apache Mesos
Web Apps & Services
etcd etcdetcd
api-ser
ver
api-ser
ver
api-ser
ver
Kube-
proxy
Kube-
proxy
scheduler
Kube-
proxy
scheduler
controller
...

Reality
Container Runtime
Container Runtime
Orchestration
Scheduling
Resource Management
Service Management
Web Apps & Services
DC/OS/Apache
Mesos

Lab 0
Access DC/OS

USER: bootstrapuser
Password: deleteme

Lab 1
DC/OS and CLI

INSTALLING THE CLI

Self-Signed Certifications for Demo Cluster

First non Kubernetes, non docker container

DC/OS
Kubernetes
Integration

Kubernetes with DC/OS 1.11 Features
Simple HA
Cluster
Provisioning
Robust API
Server Auth
Non-disruptive
Upgrades
Automated
self-healing
Scalable
Kubernetes
Transport Layer
Security
Cloud Native
Services

Why Kubernetes on DC/OS: Automation
Management
Ability to easily create & scale pure play Kubernetes, data services,
and OSS components anywhere
Lifecycle
Ability to install/upgrade/patch every component of the
solution stack (data, K8s, CI/CDs and ML)
as-a-Service
Ability for each LOB to choose components and
manage resources and lifecycle according to its will
Security 30% Fortune 50 | CNI | TLS | Authentication

Simple HA Cluster
Provisioning
Kubernetes with DC/OS 1.11 Features
Robust API
Server Auth
Non-disruptive
Upgrades
Automated
self-healing
Scalable
Kubernetes
Transport Layer
Security
Cloud Native
Services

Dead Simple Secure & HA Provisioning
1. Prerequisites
2. Installing the Client Tools
3. Provisioning Compute Resources
4. Provisioning the CA and Generating TLS Certificates
5. Generating Kubernetes Configuration Files for Authentication
6. Generating the Data Encryption Config and Key
7. Bootstrapping the etcd Cluster… 3x for HA
10. Bootstrapping the Kubernetes Control Plane… 3x for HA
13. Bootstrapping the Kubernetes Worker Nodes
14. Configuring kubectl for Remote Access
15. Provisioning Pod Network Routes
16. Deploying the DNS Cluster Add-on… Deploying other Add-ons
20. Smoke Test
21. Cleaning Up
We turn this (21 steps)*….
$ dcos package install
kubernetes
Into this….
* Kubernetes the Hard Way by Kelsey Hightower

What’s Kubernetes Done Right?
● Automated - Kubernetes operations should be automated
● Evergreen - You want to always run the latest version of Kubernetes
● Included - Kubernetes is a commoditized standard that is included in a solution
● Open source - Market standard is pure OSS Kubernetes
● Unified - Kubernetes is not an island, you’ll have other workloads

Enhanced Data Security (EE)
● Secure Authentication, Authorization and
In-Transit Data Encryption
● Enable Authentication of Users, Apps
(Client-Server) & Inter-Service
Communication (Server to Server)
● One-Click Configuration of Transport
Security (TLS)
● Significantly Reduce Operational Overhead Non-locked down DIY Kubernetes
clusters target of hidden malware

Enabling Developer Agility:
Kubernetes is one part of a holistic CI/CD pipeline
Source Code
Control
Build and Test Release
Deploy, Monitor
and Log
Automatically trigger CI/CD
pipeline based on code
check-in.
Start automated build and test,
including functional, security
and performance tests.
Update artifact repository with
latest successful code artifacts
and pull newest images
Deploy applications to container
orchestration and watch with
monitoring and logging
CONTINUOUS INTEGRATION (CI) CONTINUOUS DEPLOYMENT (CD)
Marathon

● CNI - Container Networking Interface
● Kube-DNS - Kubernetes DNS server
● Kube-proxy - East-west loadbalancer
● Ingress - North-South loadbalancer
Networking in Kubernetes

Networking in Kubernetes on DC/OS

Lab 2
Install DC/OS Kubernetes

Lab 2a
Configure Kubectl

1. Install Kubectl
a. https://kubernetes.io/docs/tasks/tools/install-kubectl/
2. Install cli (only if you installed from UI)
a. dcos package install kubernetes --cli
3. Configure Kubectl
a. dcos kubernetes kubeconfig
b. Kubectl config view
Setting up Kubectl

● Klick on icon next to proxy
Dashboard

kubectl run hello-world
--replicas=5 --labels="run=load-balancer-example"
--image=gcr.io/google-samples/node-hello:1.0
--port=8080
Run Hello World

Lab 4
Failures

Zero Touch Self-Healing
Robust API
Server Auth
Non-disruptive
Upgrades
Scalable
Kubernetes
Transport Layer
Security
Cloud Native
Services
Simple HA
Cluster
Provisioning
Automated
self-healing

ServerServer Server
Application Aware Scheduling
Automated Self Healing
Server Server Server Server Server
Server Server Server
KubernetesZero
Touch
20+
MORE
Cloud Native
Services

Kill kubelet process
● dcos task exec -it kube-node-0-kubelet bash
● ps aux | grep "./kubelet "
root 62 2.3 0.6 741984 100580 ? Sl 15:16 3:25
./kubelet --address=10.0.4.5
--hostname-override=kube-node-1-kubelet.kubernetes.mesos
● kill -9 62

Watch the kubelet being restarted

Watch it being restarted

Lab 7
Configuration Change

One-Click Scalability and Upgrades
Robust API
Server Auth
Transport Layer
Security
Cloud Native
Services
Simple HA
Cluster
Provisioning
Automated
self-healing
Scalable
Kubernetes
Non-disruptive
Upgrades

Change Number of Nodes
dcos kubernetes update --options=k8s-package-options.json

Observe Change in K8s UI

Lab 8
Update

Update to next K8s Version
`dcos package install kubernetes --cli
--package-version=1.0.2-1.9.6`
And
`dcos kubernetes update --package-version=1.0.2-1.9.6`

Lab 9
SMACK Stack/ Apache Flink

SMACK Stack
Generator Display
1. Financial data created
by generator
2. Written to
Kafka topics
3. Kafka Topics
consumed by Spark or
Flink
4. Results written back into Kafka
stream (another topic)
7. Results displayed

SMACK Stack
Generator Display
1. Financial data created
by generator
2. Written to
Kafka topics
4. Results written back into Kafka
stream (another topic)
5. Results displayed
3. Kafka Topics
consumed and analyzed
by Flink
Kubernetes Cluster
(running on top of DC/OS)

Install Apache Flink & Kafka

Deploy Flink Job
https://s3-eu-west-1.amazonaws.com/downloads.mesosphere.com/flink/flink-job-1.0.jar

Deploy Microservices
https://s3-eu-west-1.amazonaws.com/downloads.mesosphere.com/flink/flink-job-1.0.jar

Deploy Microservices
# Deploy Display
$ kubectl apply -f
https://raw.githubusercontent.com/dcos-labs/dcos-kubernetes-
workshop/master/flinkDemo/flink-demo-actor.yaml
# Deploy Generator
$ kubectl apply -f
https://raw.githubusercontent.com/dcos-labs/dcos-kubernetes-
workshop/master/flinkDemo/flink-demo-generator.yaml
$ kubectl get pods
$ kubectl logs flink-demo-actor-655890656-8d1ls

Lab 10
Kill Cluster

Kill Cluster
dcos package uninstall --app-id=kubernetes kubernetes

11
Sign Up For Slack
1. Slack URL: https://chat.dcos.io/
2. Join #kubernetes channel
3. OSS support / feedback

THANK YOU!
ANY
QUESTIONS?
@dcos
users@dcos.io
/groups/8295652
/dcos
/dcos/examples
/dcos/demos
chat.dcos.io
https://github.com/mesosphere/dcos-kubernetes-quickstart
https://mesosphere.com/blog/another-kubernetes-service/

CONFIDENTIAL
Make it insanely easy
to build and scale
world-changing technology

Step 1
ssh in to your bootstrap node with the centos/FindBlissInIgnorance credentials
Step 2
cd into the ~/tools/dcos-ansible directory:
$ cd ~/tools/dcos-ansible
Enter IP addresses
Warning
Make sure you use your respective 10.0.0.X IPs in the hosts file a
Step 3
Execute the following command to start the installation of DC/OS 1.11:
$ ansible-playbook -i hosts --private-key student_* --extra-vars "dcos_version=dcos-1.11" main.yaml
It will take several minutes to run through the deployment. We will verify the installation was successful in Lab 1: Upgrading DC/OS shortly.

Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)

Semelhante a Kubernetes One-Click Deployment: Hands-on Workshop (Mainz) (20)

Mais de QAware GmbH

Mais de QAware GmbH (20)

Último

Último (20)

Kubernetes One-Click Deployment: Hands-on Workshop (Mainz)