SlideShare uma empresa Scribd logo
1 de 77
Baixar para ler offline
Software Defined
Infrastructure
Mark Burgess
Professor, PhD, BSc
Trends and solutions for networks in an NFV/SDN era
• O - Operation,
• M - Maintenance,
• P - Provisioning
• PhD theoretical physics
• Professor of Network and System Administration
• EMANICS network of excellence
• CFEngine founder, computer immunology, promise theory
• Industry advisor, researcher, working with SDN leaders
• Web: http://markburgess.org
About me …
Some conclusions
• Multi-tenant — self-service systems, built on fabrics
• Fixed and stable infrastructure fabrics
(net+compute+storage)
• Dynamic, virtualized names and services on top
• Get rid of middle-boxes (load-balancers, firewalls)
There are no simple answers:
Technology is easy, people are difficult!
Table of contents
I. The business challenge
II. The cultural challenge
III.The technical challenge
IV. Infrastructure fabrics
I. The business challenge
An on-going business transformation
( )
Hypothesis driven deployment in a world of smart infrastructure
Paris
Paris
“Continuous improvement of software
as a stream of releases, always ready for
use…”
Continuous delivery is ...
Irregular and high risk
Regular and low risk
What story are you trying to tell?
II. The cultural challenge:
getting unstuck
Infrastructure
culture
Addressability
Latency
Connectedness
Garbage collection
Normalization
Engineering focus
Town
planning
Business focus
CAD
CAM
Stylesheets for infrastructure
“Functional” systems have two aspects
Semantics ( )
and
Dynamics ( )
DevOps
Semantics ( ) and Dynamics ( ) 

Desired-state and actual behaviour

Dev + Ops 

What you intend + What actually happens
Convergence
Infrastructure
(ops)
Intent/function
(dev)
Configuration drift
Prep/runtime
“Consensus”
Unintended change
Emergent side effects
Semantics ( )
Continuity
Availability
(ops)
History
(dev)
Geography (space)
Latency (time)
Usability (consistent)
Compatibility
Persistence of worlds
Dynamics ( )
• Convergence ( )
• to a desired end-state / promised outcome
• Divergence (branching decisions) ( )
• intentionally and unintentionally diverging
Competing forces
Controlled and uncontrolled
• Diverging chain reactions ( )
• (branching, many-worlds)
• Convergence to a target ( )
• (possibly parallel sinks)
Deployment or change management?
Divergent ( )
“Continuous delivery requires continuous automation
... not power-assisted intervention”
Intervention vs automation
Technology should be simplicity
Significant innovation doesn’t happen until humans change
their habits, or get out of the way …
Human Identity inertia ( )
III. The technical challenges
Technical challenges
1.Scale
2.Complexity
3.Knowledge
Atoms ( )
local information,
autonomous
Autonomy ( )
freedom to act without
dependency
Promises converge ( )
Modelling intent (semantics)
Thinking in promises versus impositions
Impose:
unpredictable
Promise:
predictable policy
Many parts with
STRONG COUPLING
increases complexity!
Coupling - ecosystem
Don´t confuse tidiness with resilience
Don´t confuse untidiness with disorder
Organization is optimization with constraints
Autonomous agents that keep promises
1. Scaling
Vertical
Horizontal
Simple
Complex
2. Complexity
Weak coupling, and clear relationships
Encapsulation
Tunnels
VxLAN
GRE
EVPN
Centralized
(Vertical)
Humanized
Points of service
Identities
Home
Local
Intentional
Decentralized
(Horizontal)
Dehumanized
Logistics
Replicas
Storage
Non-local
Emergent
Central BRAIN …
(vertical scaling, strong coupling)
Decentralized Society ….
(horizontal scaling, weak coupling)
3. Knowledge
Parallel
Serial
The story …
SSH
cron jobs
containers
hands-on
3. Knowledge
Sem
antics (
)
Dynam
ics(
)
IV. Infrastructure fabrics
Network designed for low density end-points
• New reality:
• High density datacenter (North-South, East-West)
• Internet of Things
• Push networking (UDP)
• TCP brings more security
• Built on top of Ethernet (bus arch)
Scaling network communication
• Read/retrieve/service portal (promises)
• Client-server, anycast
• Publish-subscribe (streaming)
• Caching/CDN: fixed addresses not that important
• Signalling (impositions)
• Scales vertically (brute force)
• Fixed addressing important
Summary: From impositions to promise thinking
1. Every processing entity in an infrastructure MUST be individually
addressable (SCALE)
2. Remove middle-boxes (COMPLEXITY)
3. Instead of uninvited impositions, get clients to establish a bond
with a service point (KNOWLEDGE)
Sharing resources
How does workload affect the
needs for resource sharing?
Where to put workloads and data to
best tell the business story?
The failures of vertical network scaling
•Address scaling -> NAT
•NAT -> private addressing
•private addressing -> L2 /LAN thinking
•L2 focus -> tunnels to extend LANs
•tunnels -> dynamic address rewriting
•dynamic addresses -> collapse under complexity
SDN is fixated on LAN
• IPv4 a flawed model of LAN/WAN
• WAN/(LAN x 2) + ARP
• Routing AND L2 tunnels
• IPV6
• Peer discovery
• L3 Index service
•Hint (CDN)
Bad semantics ( )
L3 subnets confused with host groups
Scalabilty
Summarization
Why LAN doesn’t scale, and why tunnels don’t help
Bad dynamics ( )
Abusing L2 tunnelling
Can’t extend a
broadcast group
indefinitely
Tunnels don’t really
simplify navigation,
just make it someone
else’s problem
Tunnels: VxLAN, EVPN (MPLS/BGP)
High density workloads
Middle-boxes, “network functionality”
Load balancers —> Firewall
Designed for a sparse hierarchical network
• Designed for North-South traffic model
• Pile weight into single point of failure
• Break end-to-end principle
• Addresses don’t match geography
Load balancing by cooperation
Imposition —> Promises
Firewall by cooperation
Imposition —> Promises
Microservices
Autonomous tenants .. many
autonomous agents rather than
a top down control
Strong vertical integration for
human ownership
Weak horizontal integration for
scale
We have to separate
end-point names/addresses
from transport mechanisms
Namespaces ( )
Technology should be simplicity
Tenant networks
Clos non-blocking fabrics (I)
Pattern based provisioning (e.g. CFEngine)
bundle agent clos
{
vars:
# Generate the interface lists used on the routers
"spine" slist => expandrange("swp[1-5]", "1"); # point to 5 leafsw
"leaves" slist => expandrange("swp[1-2]", "1"); # point to 2 spinesw
interfaces:
spine::
"$(spine)"
link_services => ibgp_reflector("server");
ToR::
"$(leaves)"
link_services => ibgp_reflector("client");
}
Complexity (strong coupling) means cost
Clos non-blocking fabrics (II)
Cable-Free Clos non-blocking fabrics (III) ?
Weak coupling
Addresses that reflect location
3d printed datacenter
Balance exploration against simple targeted outcomes
Automate documentation of intent: policy converges ( )
Watch out for the human storyline ( )
Delegate for tidiness with weak coupling ( )
The future
Join the discussion …

Mais conteúdo relacionado

Semelhante a Software Defined Infrastructure

Semelhante a Software Defined Infrastructure (20)

Network Management and Flow Analysis in Today’s Dense IT Environments
Network Management and Flow Analysis in Today’s Dense IT EnvironmentsNetwork Management and Flow Analysis in Today’s Dense IT Environments
Network Management and Flow Analysis in Today’s Dense IT Environments
 
Introduction
IntroductionIntroduction
Introduction
 
SDN Abstractions
SDN AbstractionsSDN Abstractions
SDN Abstractions
 
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
 
Research portfolio
Research portfolio Research portfolio
Research portfolio
 
Surviving microservices
Surviving microservicesSurviving microservices
Surviving microservices
 
Serena DevOps Drive-in webcast with Mark Burgess, October 31
Serena DevOps Drive-in webcast with Mark Burgess, October 31Serena DevOps Drive-in webcast with Mark Burgess, October 31
Serena DevOps Drive-in webcast with Mark Burgess, October 31
 
Novi sad ai event 1-2018
Novi sad ai event 1-2018Novi sad ai event 1-2018
Novi sad ai event 1-2018
 
Melbourne Microservices Meetup: Agenda for a new Architecture
Melbourne Microservices Meetup: Agenda for a new ArchitectureMelbourne Microservices Meetup: Agenda for a new Architecture
Melbourne Microservices Meetup: Agenda for a new Architecture
 
node.js and Containers: Dispatches from the Frontier
node.js and Containers: Dispatches from the Frontiernode.js and Containers: Dispatches from the Frontier
node.js and Containers: Dispatches from the Frontier
 
Some Musings on OpenFlow and SDN for Enterprise Networks
Some Musings on OpenFlow and SDN for Enterprise NetworksSome Musings on OpenFlow and SDN for Enterprise Networks
Some Musings on OpenFlow and SDN for Enterprise Networks
 
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
A Cloud-Based Bayesian Smart Agent Architecture for Internet-of-Things Applic...
 
Intro RINA
Intro RINAIntro RINA
Intro RINA
 
Claremont Report on Database Research: Research Directions (Anastasia Ailamaki)
Claremont Report on Database Research: Research Directions (Anastasia Ailamaki)Claremont Report on Database Research: Research Directions (Anastasia Ailamaki)
Claremont Report on Database Research: Research Directions (Anastasia Ailamaki)
 
Distributed Systems @ Code Europe
Distributed Systems @ Code EuropeDistributed Systems @ Code Europe
Distributed Systems @ Code Europe
 
Fault tolerance in Information Centric Networks
Fault tolerance in Information Centric NetworksFault tolerance in Information Centric Networks
Fault tolerance in Information Centric Networks
 
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
Scalability and Resilience of Multi-Tenant Distributed Clouds in the Big Serv...
 
Microservices Gone Wrong!
Microservices Gone Wrong!Microservices Gone Wrong!
Microservices Gone Wrong!
 
IETF 112: Internet centrality and its impact on routing
IETF 112: Internet centrality and its impact on routingIETF 112: Internet centrality and its impact on routing
IETF 112: Internet centrality and its impact on routing
 
slides15-1.pdf
slides15-1.pdfslides15-1.pdf
slides15-1.pdf
 

Mais de Mark Burgess (7)

Config management camp 18
Config management camp 18Config management camp 18
Config management camp 18
 
Fault, Errors, and Promise Theory
Fault, Errors, and Promise TheoryFault, Errors, and Promise Theory
Fault, Errors, and Promise Theory
 
Collapse of Complex IT Infrastructure
Collapse of Complex IT InfrastructureCollapse of Complex IT Infrastructure
Collapse of Complex IT Infrastructure
 
Uncertain infrastructure
Uncertain infrastructureUncertain infrastructure
Uncertain infrastructure
 
Future of configuration
Future of configurationFuture of configuration
Future of configuration
 
Brains Societies, and Semantic Spaces
Brains Societies, and Semantic SpacesBrains Societies, and Semantic Spaces
Brains Societies, and Semantic Spaces
 
September16
September16September16
September16
 

Último

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Último (20)

FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
WSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering DevelopersWSO2's API Vision: Unifying Control, Empowering Developers
WSO2's API Vision: Unifying Control, Empowering Developers
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​Elevate Developer Efficiency & build GenAI Application with Amazon Q​
Elevate Developer Efficiency & build GenAI Application with Amazon Q​
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 

Software Defined Infrastructure