1.
Azure Community Conference 2021
India’s largest Azure Conference
#AzConfDev

2.
#AzConfDev
Title Sponsor Gold Sponsor
Community Partner

3.
#AzConfDev
Our Partners

4.
#AzConfDev
Communities

5.
#AzConfDev
Improve
Monitoring and Observability
for
Kubernetes
with
OSS tools

6.
#AzConfDev
Nilesh Gule
Microsoft Azure MVP

7.
#AzConfDev
Pre-requisites
Self contained application with all its dependencies
Docker
❖ Orchestrates containers
❖ Self healing
❖ Service discovery
❖ Scaling
Kubernetes
❖ Scalable apps in dynamic environments (public /
private / hybrid clouds)
❖ Exemplified by Containers, service meshes,
microservices, immutable infrastructure &
declarative APIs
❖ Loosely coupled systems, resilient, observable &
manageable
❖ Robust automation
Cloud Native Applications

8.
#AzConfDev

9.
#AzConfDev
CNCF cloud trail
https://github.com/cncf/trailmap

10.
#AzConfDev
Centralized
Logging

11.
#AzConfDev
❑ Application specific
❖ Long term log retention for compliance reasons
❖ Workloads scheduled on different nodes during
application restarts / updates
❖ Autoscaling workloads
❑ Kubernetes upgrades
❖ Auto healing can reschedule workloads
❖ Underlying nodes added / deleted during cluster
scaling
❖ Underlying nodes replaced during cluster
upgrades
Container based workloads
Why centralized logging
❖ Not much control over underlying infra
❖ Relies on cloud prover specific logging and monitoring
solution
PaaS / Serverless services

12.
#AzConfDev
Tech Talks EFK integration
Log collector Log storage Log search, visualise,
dashboards
rabbitmq-producer-service rabbitmq-consumer-deployment

13.
#AzConfDev
Demo 1 – Log Aggregation with EFK

14.
#AzConfDev
Monitoring and
Alerting

15.
#AzConfDev
• Application specific
• Monitor resource usage
• Monitor scaling needs
• Monitor anomalies / outliers
• Kubernetes platform level
• Monitor cluster resources (CPU / RAM)
• API health
• Autoscaling
Container based workloads
Why Monitoring & Alerting
• Monitor resource usage
• Scaling
• Bottlenecks
PaaS / Serverless services

16.
#AzConfDev
Prometheus Architecture

17.
#AzConfDev
Demo 2 – Metrics using Prometheus &
Grafana

18.
#AzConfDev
Spring Boot Conference App integration
https://github.com/NileshGule/spring-boot-conference-app/tree/mssql-server
conference-demo-service-monitor
conference-demo-service

19.
#AzConfDev
Exception
Handling

20.
#AzConfDev
Sentry Architecture
https://develop.sentry.dev/architecture/

21.
#AzConfDev
Spring Boot Sentry integration
conference-demo-service
Managed Kubernetes cluster

22.
#AzConfDev
Demo 3 – Exception aggregation using
Sentry

23.
#AzConfDev
http://20.197.112.18:8080/api/v1/crash/boom

24.
#AzConfDev
End to End Observability

25.
#AzConfDev
Summary
Modern day cloud native applications need new ways to address observability &
monitoring
Log Aggregation
✓ EFK stack helps in centralized logging
✓ Kibana is used to visualize logs and build dashboards
Monitoring & Alerting
✓ Prometheus provides easy to use metrics for platforms, applications
✓ Grafana provides visualization capabilities to build intuitive dashboards
Exception Aggregation
✓ Sentry provides Exception Aggregation capabilities
✓ Excellent telemetry data captured by Sentry to help diagnose problems

26.
#AzConfDev
References
Log Aggregation
❖ Elastic stack
❖ Kibana
❖ Fluentd
Monitoring & Alerting
❖ Prometheus
❖ Grafana
❖ Kube Prometheus stack
❖ Houssem Dellai – Prometheus & Grafana
for monitoring Kubernetes
Sentry
❖ Sentry docs

27.
#AzConfDev
Source Code & slide deck
Tech Talks
https://github.com/NileshGule/pd-tech-fest-2019
Conference app
https://github.com/NileshGule/spring-boot-conference-app/tree/mssql-server
https://speakerdeck.com/nileshgule/
https://www.slideshare.net/nileshgule/

28.
Nilesh Gule
ARCHITECT | MICROSOFT MVP
“Code with Passion and
Strive for Excellence”
nileshgule
@nileshgule Nilesh Gule
NileshGule
www.handsonarchitect.com
https://bit.ly/youtube-nileshgule

29.
#AzConfDev
Q & A

30.
#AzConfDev
Feedback

31.
#AzConfDev
THANK YOU!