Hopelessness and Confidence in Distributed Systems Design

•

3 gostaram•1,862 visualizações

The slides from my Strangeloop 2015 keynote Video is available here: https://www.youtube.com/watch?v=TlU1opuCXB0&feature=youtu.be&a

Tecnologia

Hopelessness and Confidence in
Distributed Systems Design
Camille Fournier, Senior Thinker and
Raconteur
@skamille

The easiest
way to scale!
Hassle-free
scaling!
Easiest.
Database.
Ever.
Sync state in a cinch at a
distributed system scale.
Real-time
data
Real-time
Analytics
Real-time
Decisions

Distributed Systems: Ugly, Hard,
and Here to Stay

A brief interlude: The goals of
Distributed Systems

"DSM
FIGURE"
by
Mehrnazzhian
-‐
Own
work.
Licensed
under
CC
BY-‐SA
4.0
via
Commons

GLOBAL SERVICE DISCOVERY USING
ZOOKEEPER

Naïve approach: Central Coordinator!
•  Should all data be in one system? That would be
easy!
•  But then…
DISTANCE PERFOMANCE/

•  Speed of light
•  Limitations of bandwidth and latency
DISTANCE PERFOMANCE/

Fallacies of Distributed Computing
Deutsch et al, Sun Microsystems
1.  The network is reliable.
2. Latency is zero.
3. Bandwidth is infinite.
4.  The network is secure.
5.  Topology doesn't change.
6.  There is one administrator.
7.  Transport cost is zero.
8. The network is homogeneous.

BEST PRACTICE: Remember that
clients are part of your system

Scaling (systems and humans)
and failure tolerance (??)
/

COMMON
UNDERSTANDING
THE PERFECT
TOOL FOR THE
JOB
/
@coda

BEST PRACTICE: Data Design (again!)
•  Silence comes via good design!
•  You can always design poorly and have to
overcommunicate/coordinate

COMBAT HOPE AND FEAR BY
UNDERSTANDING TRADE/OFFS

Thank you!
Special Thanks:
@randommood
@SeanTAllen
@chrisk5000
@HenryR
@aphyr
@caitie
@pbailis (aka
Littlefinger)
@giltene
@MikeM6174
@tsantero
?s: @skamille

Mais conteúdo relacionado

Semelhante a Hopelessness and Confidence in Distributed Systems Design

The Reactive Principles: Design Principles For Cloud Native ApplicationsJonas Bonér

Big Data Berlin – Automating Decisions is the Next Frontier for Big DataLars Trieloff

The Reactive Principles: Eight Tenets For Building Cloud Native ApplicationsLightbend

TAMING THE INFRASTRUCTURE GONE WILDColloquium

TAMING THE INFRASTRUCTURE GONE WILDIsaac Christoffersen

Chaos engineering Alberto Acerbis

Successfully Migrate Cisco Call Manager 4x To 7x With a Proven Frameworkglamba

Bloom plseminar-sp15Joe Hellerstein

The case for chaos testingPeter Lamar

Build agile and elastic data pipelineDeba Chatterjee

Big Data and Machine Learning on AWSCloudHesive

1.) extreme networks (top 10 reasons)Jeff Green

Introduction to Distributed Computing & Distributed DatabasesShankar Iyer

Resilience and Compliance at Speed and ScaleJason Chan

The Great Disconnect of Data Protection: Perception, Reality and Best Practicesiland Cloud

Talk at the Boston Cloud Foundry Meetup June 2015Chip Childers

Fault-tolerance on the Cheap: Making Systems That (Probably) Won't Fall Over Brian Troutwine

Webinar: Is Convergence right for you? – 4 questions to askStorage Switzerland

Inerview Quesion on Data Mining and Machine LearningYash Diwakar

#ATAGTR2021 Presentation : "Chaos engineering: Break it to make it" by Anupa...Agile Testing Alliance

Semelhante a Hopelessness and Confidence in Distributed Systems Design (20)

The Reactive Principles: Design Principles For Cloud Native Applications

Big Data Berlin – Automating Decisions is the Next Frontier for Big Data

The Reactive Principles: Eight Tenets For Building Cloud Native Applications

TAMING THE INFRASTRUCTURE GONE WILD

Chaos engineering

Successfully Migrate Cisco Call Manager 4x To 7x With a Proven Framework

Bloom plseminar-sp15

The case for chaos testing

Build agile and elastic data pipeline

Big Data and Machine Learning on AWS

1.) extreme networks (top 10 reasons)

Introduction to Distributed Computing & Distributed Databases

Resilience and Compliance at Speed and Scale

The Great Disconnect of Data Protection: Perception, Reality and Best Practices

Talk at the Boston Cloud Foundry Meetup June 2015

Fault-tolerance on the Cheap: Making Systems That (Probably) Won't Fall Over

Webinar: Is Convergence right for you? – 4 questions to ask

Inerview Quesion on Data Mining and Machine Learning

#ATAGTR2021 Presentation : "Chaos engineering: Break it to make it" by Anupa...

Último

[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745

Presentation on how to chat with PDF using ChatGPT code interpreternaman860154

Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700

Understanding the Laravel MVC ArchitecturePixlogix Infotech

WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

A Domino Admins Adventures (Engage 2024)Gabriella Davis

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada

🐬 The future of MySQL is Postgres 🐘RTylerCroy

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh

Slack Application Development 101 Slidespraypatel2

Scaling API-first – The story of a global engineering organizationRadu Cotescu

Boost PC performance: How more available memory can improve productivityPrincipled Technologies

Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited

SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren

Hopelessness and Confidence in Distributed Systems Design

1. Hopelessness and Confidence in Distributed Systems Design Camille Fournier, Senior Thinker and Raconteur @skamille

2. The easiest way to scale! Hassle-free scaling! Easiest. Database. Ever. Sync state in a cinch at a distributed system scale. Real-time data Real-time Analytics Real-time Decisions

3. @aphyr

4. Distributed Systems: Ugly, Hard, and Here to Stay

7. TRADE/OFF

8. TRADE/OFF

9. Embrace Hopelessness Gain Confidence

10.

11. A brief interlude: The goals of Distributed Systems

12. SCALE

13. FAILURE TOLERANCE

14.

15. A DISTRIBUTED CACHE FOR RISK ANALYSIS

16.

17.

18. Scaling /

19. "DSM FIGURE" by Mehrnazzhian -‐ Own work. Licensed under CC BY-‐SA 4.0 via Commons

20. Azul

21.

22. SYNCHRONIZATION PERFORMANCE/

23. REWRITING MODIFICATION/

24. BEST practice: TESTING

25. GLOBAL SERVICE DISCOVERY USING ZOOKEEPER

26. GLOBAL service discovery system

27. Failure Tolerance Scaling /

28. Naïve approach: Central Coordinator! •  Should all data be in one system? That would be easy! •  But then… DISTANCE PERFOMANCE/

29. •  Speed of light •  Limitations of bandwidth and latency DISTANCE PERFOMANCE/

30. Fallacies of Distributed Computing Deutsch et al, Sun Microsystems 1.  The network is reliable. 2. Latency is zero. 3. Bandwidth is infinite. 4.  The network is secure. 5.  Topology doesn't change. 6.  There is one administrator. 7.  Transport cost is zero. 8. The network is homogeneous.

31. Wide Area Networks Add Complexity

32. FEATURES CONTROL/

33. BEST PRACTICE: Remember that clients are part of your system

34. A second brief interlude…

35.

36. MICROSERVICES AT RENT THE RUNWAY

37. Evolution off of a monolith

38. Scaling (systems and humans) and failure tolerance (??) /

39. COMMON UNDERSTANDING THE PERFECT TOOL FOR THE JOB / @coda

40. RATE OF CHANGE THOROUGHNESS/

41. @adrianco

42. BEST PRACTICE: DATA DESIGN (AGAIN!)