The document discusses various cloud native resiliency patterns for building resilient applications from the ground up. It describes resilience as the ability of a system to return to its normal behavior after experiencing a fault or unexpected event. The document then provides an overview of several resiliency patterns including load balancing, circuit breaking, retries, deadlines, load shedding, service discovery, locality load balancing, failover, rate limiting, concurrency control, autoscaling, and interplay between load shedding and autoscaling. Code examples and additional resources are provided.

1. #jconfdev
Cloud Native resiliency patterns
from the ground up
Ana-Maria Mihalceanu
@ammbra1508

2. Hello! I am Ana
Java Champion, Certified Architect
Developer Advocate @ RedHat
“Control” enthusiast
@ammbra1508

3. #jconfdev
How do you feel when an application
is too busy/not available?
@ammbra1508

4. #jconfdev
How do you feel when YOUR application
is too busy/not available?
@ammbra1508

5. #jconfdev What is resilience?
@ammbra1508
Normal Behaviour
Faulty Behaviour
Unexpected event occurs
Unexpected
condition occurs
Degraded Mode
Behaviour
Feedback control mitigates
malfunction
Recovery control restores expected behaviour
Detection control recognizes malfunction

6. #jconfdev What is resilience?
@ammbra1508
Normal Behaviour
Faulty Behaviour
Unexpected event occurs
Unexpected
condition occurs
Degraded Mode
Behaviour
Feedback control mitigates
malfunction
Recovery control restores expected behaviour
Detection control recognizes malfunction

7. #jconfdev Where to start?
@ammbra1508
Source: https://martinfowler.com/bliki/CircuitBreaker.html

8. #jconfdev Resilience is in details
@ammbra1508

9. #jconfdev
Using Proxies for
Infrastructure Resilience
@ammbra1508

10. #jconfdev Available Patterns
@ammbra1508
Load Balancing Circuit breaking,
retries and deadlines
Load Shedding
Service
discovery

11. #jconfdev Locality load balancing and Failover
@ammbra1508

12. #jconfdev Locality load balancing and Failover
@ammbra1508

13. #jconfdev Circuit breaker with Istio
@ammbra1508

14. #jconfdev Failover with Skupper
@ammbra1508

15. #jconfdev
” Load shedding drops some proportion of
load by dropping traffic as the server
approaches overload conditions.”
@ammbra1508
source: Site Reliability Engineering book

16. #jconfdev Rate limiting with TokenBucket
@ammbra1508

17. #jconfdev Rate limiting with TokenBucket
@ammbra1508

18. #jconfdev Rate limiting with TokenBucket
@ammbra1508

19. #jconfdev Rate limiting with TokenBucket
@ammbra1508

20. #jconfdev
Concurrency Control based on
request priority
@ammbra1508

21. #jconfdev
Concurrency Control based on
request priority
@ammbra1508

22. #jconfdev Tailor Autoscaling
@ammbra1508

23. #jconfdev Interplay autoscaling with load shedding
@ammbra1508
Autoscaling condition
Workload increases
Load shedding reduces
resource stress
Increased
traffic
continues
Load shedding
stops
Yes
No
Trigger
autoscaling

24. #jconfdev
@ammbra1508
Code made available at
https://github.com/ammbra/resilience

25. #jconfdev Extra Resources
@ammbra1508

26. @ammbra1508
dn.dev/istio-istiobook dn.dev/k8spatterns1 Download