AWS DynamoDB Streams - A quick introduction

As serverless architectures become more popular, AWS customers need a framework of patterns to help them deploy their workloads without managing servers or operating systems. This session introduces and describes four re-usable serverless patterns for web apps, stream processing, batch processing, and automation. For each, we provide a TCO analysis and comparison with its server-based counterpart. We also discuss the considerations and nuances associated with each pattern and have customers share similar experiences. The target audience is architects, system operators, and anyone looking for a better understanding of how serverless architectures can help them save money and improve their agility.

A brief introduction to the recently announced AWS DynamoDB streams

Software

AWS DynamoDB Streams
A quick introduction
Chris Richardson
Author of POJOs in Action
Founder of the original CloudFoundry.com
@crichardson
@crichardson
chris@chrisrichardson.net
http://plainoldobjects.com
http://microservices.io

@crichardson
What is a DynamoDB
Stream?
An ordered sequence of changes to items in a DynamoDB table:
Puts, updates, and deletes performed in last 24 hours
Sharded for scalability
Kinda like: message queue or Kafka topic
Similar to Kinesis streams
Subscribe to a stream to track the changes made to a table
Real time analytics
Cross region replication
Maintain materialized view tables
...

Creating a table with a stream
KEYS,
OLD_IMAGE
and/or
NEW_IMAGE
@crichardson

Getting the shards in a stream
@crichardson

https://github.com/awslabs/amazon-kinesis-client
@crichardson
Kinesis adapter
http://dynamodb-preview.s3-website-us-west-2.amazonaws.com/docs/streams-dg/Streams.KCLAdapter.html
Scalable,
fault tolerant
programming
model for stream
processing

@crichardson
Lambda integration
http://dynamodb-preview.s3-website-us-west-2.amazonaws.com/docs/streams-dg/Streams.Lambda.Walkthrough.Basic.html#Streams.Lambda.Walkthrough.Basic.Step3

@crichardson
@crichardson chris@chrisrichardson.net
http://plainoldobjects.com http://microservices.io

What's hot

Serverless computing

Dmitriy Ivanov

AWS re:Invent 2016: Serverless Architectural Patterns and Best Practices (ARC...

Intro to AWS Lambda

KSQL is an easy-to-use and easy-to-understand streaming SQL engine for Apache Kafka built on top of Kafka Streams. The ability to write streaming applications using only SQL makes Apache Kafka available to a whole range of new developers and potential use cases, either as a stand-alone solution, or as a single component to a broader Kafka Streams implementation. Inspired by a customer project now in production, experience the lifecycle of a streaming application developed using KSQL and Kafka Streams. With Apache Gradle as our build framework, we’ll explore the open-source Gradle plugin we built during this project to improve developer efficiency and automate the deployment of KSQL pipelines, user-defined functions, and Kafka Streams microservices. We’ll demonstrate the deployment process live, and discuss design decisions around incorporating SQL-based processes into an overall streaming application. Key Takeaways 1. KSQL is a natural choice for expressing data-driven applications, but it may not naturally fit into established DevOps processes and automations. 2. We built an open-source Gradle plugin to handle all aspects of deploying a Kafka-based streaming application: KSQL pipelines, KSQL user-defined functions, and Kafka Streams microservices. 3. KSQL pipelines can be deployed using either a server start script, or the KSQL REST API, and our Gradle plugin fully supports both options.

Serverless Framework Intro

Nikolaus Graf

Choose Right Stream Storage: Amazon Kinesis Data Streams vs MSK

Sungmin Kim

Real Time Dashboard - Architecture

Nowa Labs Pte Ltd

Use Apache Gradle to Build and Automate KSQL and Kafka Streams (Stewart Bryso...

confluent

Serverless by Example: Building a Real-Time Chat System

Tinder’s Quickfire Pipeline powers all things data at Tinder. It was originally built using AWS Kinesis Firehoses and has since been extended to use both Kafka and other event buses. It is the core of Tinder’s data infrastructure. This rich data flow of both client and backend data has been extended to service a variety of needs at Tinder, including Experimentation, ML, CRM, and Observability, allowing backend developers easier access to shared client side data. We perform this using many systems, including Kafka, Spark, Flink, Kubernetes, and Prometheus. Many of Tinder’s systems were natively designed in an RPC first architecture. Things we’ll discuss decoupling your system at scale via event-driven architectures include: – Powering ML, backend, observability, and analytical applications at scale, including an end to end walk through of our processes that allow non-programmers to write and deploy event-driven data flows. – Show end to end the usage of dynamic event processing that creates other stream processes, via a dynamic control plane topology pattern and broadcasted state pattern – How to manage the unavailability of cached data that would normally come from repeated API calls for data that’s being backfilled into Kafka, all online! (and why this is not necessarily a “good” idea) – Integrating common OSS frameworks and libraries like Kafka Streams, Flink, Spark and friends to encourage the best design patterns for developers coming from traditional service oriented architectures, including pitfalls and lessons learned along the way. – Why and how to avoid overloading microservices with excessive RPC calls from event-driven streaming systems – Best practices in common data flow patterns, such as shared state via RocksDB + Kafka Streams as well as the complementary tools in the Apache Ecosystem. – The simplicity and power of streaming SQL with microservices

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

confluent

Originally, Hadoop was used as a batch analytics tool; however, this is rapidly changing, as applications move towards real-time processing and streaming. Amazon Elastic MapReduce has made running Hadoop in the cloud easier and more accessible than ever. Each day, tens of thousands of Hadoop clusters are run on the Amazon Elastic MapReduce infrastructure by users of every size — from university students to Fortune 50 companies. We recently launched Amazon Kinesis – a managed service for real-time processing of high volume, streaming data. Amazon Kinesis enables a new class of big data applications which can continuously analyze data at any volume and throughput, in real-time. Adi will discuss each service, dive into how customers are adopting the services for different use cases, and share emerging best practices. Learn how you can architect Amazon Kinesis and Amazon Elastic MapReduce together to create a highly scalable real-time analytics solution which can ingest and process terabytes of data per hour from hundreds of thousands of different concurrent sources. Forever change how you process web site click-streams, marketing and financial transactions, social media feeds, logs and metering data, and location-tracking events.

Real-time Streaming and Querying with Amazon Kinesis and Amazon Elastic MapRe...

Re-imagining your legacy monolithic applications as microservices is a great opportunity to challenge design decisions such as choice of language, synchronicity, access patterns and coupling and promotes isolated deployments, modularity and separation of concerns, while providing per-end point analytics for free. See how Amazon API Gateway and Amazon Web Services Lambda, together with microframeworks like Chalice make "Peeling the Onion" and redefining legacy applications in terms of microservices manageable. Speaker: Craig Dickson, Solutions Architect, Amazon Web Services

Peeling the Onion - Monoliths to Serverless Microservices on Amazon Web Services

Introduction to Serverless

Presentation from the developer track at I Love APIs London 2016 featuring Matt McClean, Amazon Web Services. Developers have been jumping on the microservices bandwagon because of the obvious benefits of faster release cycles and innovation. However, microservices' downside is the increased server costs, operational costs, and performance costs. To reduce this complexity, Amazon Web Services created AWS Lambda - a compute platform that lets you build microservices with no provisioning and servers. Matt McClean, Solution Architect from AWS, presents how to use AWS Lambda to build your microservices. He covers various architectural patterns and anti-patterns for using AWS Lambda.

Serverless computing with AWS Lambda

Apigee | Google Cloud

AWS Lambda is a new compute service that runs your code in response to events and automatically manages compute resources for you. In this session, you learn what you need to get started quickly, including a review of key features, a live demonstration, guidelines on how to use AWS Lambda with Amazon S3 event notifications and Amazon DynamoDB streams, and tips on getting the most out of Lambda functions.

AWS Lambda: Event-Driven Code in the Cloud

You can now develop your AWS Lambda functions in C# using the .NET Core 1.0 runtime. The easiest way to get started is with the AWS Toolkit for Visual Studio, which includes project templates for individual C# Lambda functions, full C# serverless applications, and also tools to publish both projects types to AWS. To manually create a C# Lambda function, you simply specify the Lambda runtime parameter as “netcore1.0” and upload the ZIP of all NuGet dependencies as well as your own published DLL assemblies through the AWS CLI or AWS Lambda console. Alternatively, you can use AWS CloudFormation through the AWS Serverless Application Specification for deploying your C# Lambda function.

AWS Lambda in C#

Nested Beanstalk Deployment - Brett Sutter, Minneapolis

AWS Chicago

Serverless presentation

jasonsich

Getting Started with Docker on AWS

Serverless architectures allow you to build and run applications and services without having to manage infrastructure. With serverless architectures, your application still runs on servers, but all the server management is done by AWS. In this session, you will learn how to build applications and services using a serverless architecture. We will discuss how you can use AWS Lambda to run code for any type of application or backend service; Amazon DynamoDB to store application data with high scalability and redundancy; and Amazon API Gateway to create and manage secure API endpoints. We will run through a demo setting up a web application using this architecture, and we will discuss best practices and patterns used by our customers to run serverless applications.

Serverless Architecture

Michał Kurzeja

Getting Started with Serverless Architectures

DynamoDB Streams is a feature of DynamoDB that allows you to access a stream of all changes made to your DynamoDB tables in the last rolling 24 hours. You can use AWS Lambda to process event data generated from a DynamoDB Stream. In this webinar, we will cover key Amazon DynamoDB Streams and AWS Lambda features, walk through sample use cases for real-time data processing, and discuss best practices on using the services together. We'll then demonstrate setting up Amazon DynamoDB Streams and an associated Lambda function to capture and perform custom computations on database table updates, all without setting up any infrastructure Learning Objectives: · Understand key Amazon DynamoDB Streams and AWS Lambda features · Learn how to set up a real-time data modification framework using Amazon DynamoDB Streams AWS Lambda · Learn sample use cases, best practices and tips on using AWS Lambda with Amazon DynamoDB Streams

What's hot (20)

Serverless computing

AWS re:Invent 2016: Serverless Architectural Patterns and Best Practices (ARC...

Intro to AWS Lambda

Serverless Framework Intro

Choose Right Stream Storage: Amazon Kinesis Data Streams vs MSK

Real Time Dashboard - Architecture

Use Apache Gradle to Build and Automate KSQL and Kafka Streams (Stewart Bryso...

Serverless by Example: Building a Real-Time Chat System

Event Driven Architecture with a RESTful Microservices Architecture (Kyle Ben...

Real-time Streaming and Querying with Amazon Kinesis and Amazon Elastic MapRe...

Peeling the Onion - Monoliths to Serverless Microservices on Amazon Web Services

Introduction to Serverless

Serverless computing with AWS Lambda

AWS Lambda: Event-Driven Code in the Cloud

AWS Lambda in C#

Nested Beanstalk Deployment - Brett Sutter, Minneapolis

Serverless presentation

Getting Started with Docker on AWS

Serverless Architecture

Getting Started with Serverless Architectures

Viewers also liked

Real-time Data Processing with Amazon DynamoDB Streams and AWS Lambda

Kinesis to Kafka Bridge is a Samza job that replicates AWS Kinesis to a configurable set of Kafka topics and vice versa. It enables integration between AWS and the rest of LinkedIn. It supports replicating streams in any LinkedIn fabric, any AWS account, and any AWS region. DynamoDB Stream to Kafka Bridge is built on top of Kinesis to Kafka Bridge. It enables data replication from AWS DynamoDB to LinkedIn. In this presentation we will talk about how we designed the system and how we use it in LinkedIn.

Bridging the Gap: Connecting AWS and Kafka

Pengfei (Jason) Li

EC2 Avanzado

Dynamo Streams provides a stream of all the updates done to your DynamoDB table. It is a simple but extremely powerful primitive which will enable developers to easily build solutions like cross-region replication, and to host additional materialized views, for instance an ElasticSearch index, on top of DynamoDB tables. In this session we will dive deep into details of Dynamo Streams, and how customers can leverage Dynamo Streams to build custom solutions and to extend the functionality of DynamoDB. We will give a demo of an example application built on top of Dynamo Streams to demonstrate the power and simplicity of Dynamo Streams.

(SDD424) Simplifying Scalable Distributed Applications Using DynamoDB Streams...

Amazon Simple Queue Service (SQS) and Amazon DynamoDB build together a really fast, reliable and scalable layer to receive and process high volumes of messages based on its distributed and high available architecture. We propose a full system that would handle any volume of data or level of throughput, without losing messages or requiring other services to be always available. Also, it enables applications to process messages asynchronously and includes more compute resources based on the number of messages enqueued. The whole architecture helps applications reach predefined SLAs as we can add more workers to improve the whole performance. In addition, it decreases the total costs because we use new workers briefly and only when they are required.

Massive Message Processing with Amazon SQS and Amazon DynamoDB (ARC301) | AWS...

Developing applications with a microservice architecture (SVforum, microservi...

Amazon Kinesis Firehose was launched in the end of 2015 and provides easy way for customers to ingest streaming data to Amazon Redshift, Amazon Elasticsearch and Amazon S3. In 2016, we introduced new features that helps customers to implement in-line processing within Kinesis firehose using AWS Lambda. Amazon Kinesis Firehose makes it easy to load real-time, streaming data into AWS without having to build custom stream processing applications. This session is designed for developers, data engineers and analysts who are looking to load, analyze and get powerful insights from real0time streaming data using existing analytics tools. We will explore key features and walk through how to use Kinesis Firehose to ingest streaming data into Amazon Kinesis Analytics, Amazon S3, Amazon Redshift and Amazon Elasticsearch service.

Viewers also liked (6)

Real-time Data Processing with Amazon DynamoDB Streams and AWS Lambda

Bridging the Gap: Connecting AWS and Kafka

EC2 Avanzado

(SDD424) Simplifying Scalable Distributed Applications Using DynamoDB Streams...

Massive Message Processing with Amazon SQS and Amazon DynamoDB (ARC301) | AWS...

Developing applications with a microservice architecture (SVforum, microservi...

Similar to AWS DynamoDB Streams - A quick introduction

AWS Startup Day Bangalore: Being Well-Architected in the Cloud

Adrian Hornsby

Amazon Kinesis Firehose - Pop-up Loft TLV 2017

Learn how Digital Advertising customers are leveraging the integration between Amazon DynamoDB and Amazon Redshift to manage their high scale data, from creation to analysis. In this session, we will describe the three essential ingredients of efficient data flow in the cloud, and introduce a reference architecture that enables customers to meet the demands for low latency and high volume encountered in the Digital Advertising industry. Using existing SQL-based tools and business intelligence systems, you will learn how to gain deeper insight from your data at lower cost. The design principles presented here will be useful to every environment where managing data at scale is a challenge.

AWS Webinar - Dynamo DB + Redshift 13_09_19

In today's world, consumer habits change fast and marketing decisions need to be made within -seconds, not days. Delivering engaging marketing experiences requires real-time, high performing architectures that provide marketers the ability to measure and improve the performance of their campaigns and tie them more closely to corporate goals. The AWS Cloud enables you to deliver marketing content and campaigns with the levels of availability, performance, and personalization that your customers expect while lowering your costs. Please join us for this webinar, where AWS will showcase the benefits and business case for running digital marketing solutions on the AWS Cloud. We will also highlight several customer success stories and how to engage with AWS or an AWS partner on next steps.

AWS Webcast - Power your Digital Marketing Strategy with Amazon Web Services

AWS has a large and growing portfolio of big data management and analytics services, designed to integrate into solution architectures to meet the needs of your business. In this session, we look at analytics through the eyes of a business intelligence analyst, a data scientist, and an application developer, to explore how to quickly leverage Amazon Redshift, Amazon QuickSight, RStudio, and Amazon Machine Learning to create powerful, yet straightforward, business solutions.

Ambry : Linkedin's Scalable Geo-Distributed Object Store

Sivabalan Narayanan

Easy Analytics with AWS - AWS Summit Bahrain 2017

What's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit

Learn how to architect fully available and scalable Microsoft solutions and environments in AWS. Find out how Microsoft solutions can leverage various AWS services to achieve more resiliency, replace unnecessary complexity, simplify architecture, provide scalability, and introduce DevOps concepts, such as compliance, governance, automation, and repeatability. Also, plan authentication and authorization, and explore various hybrid scenarios with other cloud environment and on-premise solutions/infrastructure. Learn about common architecture patterns for network design, Active Directory, and business productivity solutions like Dynamics AX, CRM, and SharePoint, also common scenarios for custom .NET, .NET Core with SQL deployments and migrations.

WIN204-Simplifying Microsoft Architectures with AWS Services

Learn from the Amazon Cloud Drive team how Amazon Cloud Drive services are built on top of AWS core services using Amazon S3, Amazon DynamoDB, Amazon EC2, Amazon SQS, Amazon Kinesis, and Amazon CloudSearch. This session will cover design and implementation aspects of large-scale data uploads, metadata storage and query, and consistent and fault-tolerant services on top of the AWS stack. The session will provide guidance and best practices about how and when to leverage and integrate AWS infrastructure and managed services for scalable solutions. This session will also cover how Cloud Drive services teams innovated to attain high throughputs.

(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...

As serverless architectures become more popular, customers need a framework of patterns to help them to identify how to leverage AWS to deploy their workloads without managing servers or operating systems. In this session, we describe reusable serverless patterns while considering costs. For each pattern, we provide operational, security, and reliability best practices and discuss potential challenges. We also demonstrate the implementation of some of the patterns in a reference solution. This session can help you recognize services and applications for serverless architectures in your own organization and understand areas of potential savings and increased agility and reliability.

re:Invent ARC307 - Serverless architectural patterns and best practices.pdf

Heitor Lessa

Learning Objectives: - Use cases and best practices for serverless big data applications - Leverage AWS technologies such as AWS Lambda and Amazon Kinesis - Learn to perform ETL, event processing, ad-hoc analysis, real-time processing, and MapReduce with serverless Building data processing applications is challenging and time-consuming, and often requires specialized expertise to deploy and operate. With serverless computing, you can perform real-time stream processing of multiple data types without needing to spin up servers or install software, allowing you to deploy big data applications quickly and more easily. Come learn how you can use AWS Lambda with Amazon Kinesis to analyze streaming data in real-time and then store the results in a managed NoSQL database such as Amazon DynamoDB. You’ll learn tips and tricks for doing in-line processing, data manipulation, and even distributed MapReduce on large data sets.

Building Big Data Applications with Serverless Architectures - June 2017 AWS...

AWS provides a broad platform of managed services to help you build, secure, and seamlessly scale end-to-end Big Data applications quickly and with ease. Want to get ramped up on how to use Amazon's big data web services? Learn when to use which service? Want to write your first big data application on AWS? Join us in this session as we discuss reference architecture, design patterns, and best practices for pulling together various AWS services to meet your big data challenges.

Building a Data Processing Pipeline on AWS - AWS Summit SG 2017

Serverless Realtime Backup

With the breadth of AWS services available that are relevant to digital media, organizations can readily build out complete content/asset management (DAM/MAM/CMS) solutions in the cloud. This session provides a detailed walkthrough for implementing a scalable, rich-media asset management platform capable of supporting a variety of industry use cases. The session includes code-level walkthrough, AWS architecture strategies, and integration best practices for content storage, metadata processing, discovery, and overall library management functionality—with particular focus on the use of Amazon S3, Amazon Elastic Transcoder, Amazon DynamoDB and Amazon CloudSearch. Customer case study will highlight successful usage of Amazon CloudSearch by PBS to enable rich discovery of programming content across the breadth of their network catalog.

Building a Scalable Digital Asset Management Platform in the Cloud (MED402) |...

Building a Data Processing Pipeline on AWS

Building a Real Time Dashboard with Amazon Kinesis, Amazon Lambda and Amazon ...

More customers are moving their Microsoft applications to AWS to become more agile, improve their security posture, and dramatically lower costs. Attend this session to learn how to architect fully available and scalable Microsoft environments on AWS. Find out how Microsoft solutions can leverage various AWS services to achieve more resiliency, reduce complexity, improve security, and increase scalability. We discuss how you can leverage AWS services to meet compliance and governance requirements for your Microsoft applications. We introduce DevOps concepts that you can deploy to help implement automation and repeatability. Learn how to plan authentication and authorization for hybrid cloud scenarios between your AWS and on-premises environments. Learn about common architecture patterns for network design, Active Directory, and business productivity solutions such as Dynamics AX, CRM, and SharePoint, and common scenarios for custom .NET and .NET Core with SQL deployments.

Simplifying Microsoft Architectures with AWS - CMP214 - re:Invent 2017

What's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit

Improving Infrastructure Governance on AWS

How to build Business Intelligence System from scratch on AWS (Day1, Day2) ------------------------------------------------------------------------------------------ 2020-03-18(수)~19(목) 2일 동안 온라인으로 진행한 Online AWS Analytics Immersion Day 전체 발표 자료 입니다. BI(Business Intelligence) 시스템을 설계하는 과정에서 AWS Analytics 서비스들을 어떻게 활용할 수 있는지 설명 드리고자 만든 자료 입니다. Target Audience ------------------- Online Analytics Immersion Day는 다음과 같은 고객을 대상으로 진행됩니다. - AWS Analytics Services (ex. Kinesis, Athena, Redshift, EMR, etc)의 기본 개념을 알고 있지만, 이러한 서비스 활용 방법 및 데이터 분석 시스템 구축 과정이 궁금하신 분 - 데이터 분석 시스템을 구축한 경험은 있지만, 자신이 만든 시스템을 아키텍처 관점에서 어떻게 평가하고 확인할 수 있는지 궁금하신 분

AWS Analytics Immersion Day - Build BI System from Scratch (Day1, Day2 Full V...

Sungmin Kim

Similar to AWS DynamoDB Streams - A quick introduction (20)

AWS Startup Day Bangalore: Being Well-Architected in the Cloud

Amazon Kinesis Firehose - Pop-up Loft TLV 2017

AWS Webinar - Dynamo DB + Redshift 13_09_19

AWS Webcast - Power your Digital Marketing Strategy with Amazon Web Services

Ambry : Linkedin's Scalable Geo-Distributed Object Store

Easy Analytics with AWS - AWS Summit Bahrain 2017

What's New with Amazon DynamoDB - SRV311 - Chicago AWS Summit

WIN204-Simplifying Microsoft Architectures with AWS Services

(ARC309) Building and Scaling Amazon Cloud Drive to Millions of Users | AWS r...

re:Invent ARC307 - Serverless architectural patterns and best practices.pdf

Building Big Data Applications with Serverless Architectures - June 2017 AWS...

Building a Data Processing Pipeline on AWS - AWS Summit SG 2017

Serverless Realtime Backup

Building a Scalable Digital Asset Management Platform in the Cloud (MED402) |...

Building a Data Processing Pipeline on AWS

Building a Real Time Dashboard with Amazon Kinesis, Amazon Lambda and Amazon ...

Simplifying Microsoft Architectures with AWS - CMP214 - re:Invent 2017

What's New with Amazon DynamoDB - SRV311 - Atlanta AWS Summit

Improving Infrastructure Governance on AWS

AWS Analytics Immersion Day - Build BI System from Scratch (Day1, Day2 Full V...

More from Chris Richardson

The microservice architecture: what, why, when and how?

A common microservice architecture anti-pattern is more the merrier. It occurs when an organization team builds an excessively fine-grained architecture, e.g. one service-per-developer. In this talk, you will learn about the criteria that you should consider when deciding service granularity. I'll discuss the downsides of a fine-grained microservice architecture. You will learn how sometimes the solution to a design problem is simply a JAR file.

More the merrier: a microservices anti-pattern

This is a talk I gave at YOW! London 2022. Let's imagine that you are responsible for an aging monolithic application that's critical to your business. Sadly, getting changes into production is a painful ordeal that regularly causes outages. And to make matters worse, the application's technology stack is growing increasingly obsolete. Neither the business nor the developers are happy. You need to modernize your application and have read about the benefits of microservices. But is the microservice architecture a good choice for your application? In this presentation, I describe the dark energy and dark matter forces (a.k.a. concerns) that you must consider when deciding between the monolithic and microservice architectural styles. You will learn about how well each architectural style resolves each of these forces. I describe how to evaluate the relative importance of each of these forces to your application. You will learn how to use the results of this evaluation to decide whether to migrate to the microservice architecture.

YOW London - Considering Migrating a Monolith to Microservices? A Dark Energy...

Dark matter and dark energy are mysterious concepts from astrophysics that are used to explain observations of distant stars and galaxies. The Microservices pattern language - a collection of patterns that solve architecture, design, development, and operational problems — enables software developers to use the microservice architecture effectively. But how could there possibly be a connection between microservices and these esoteric concepts from astrophysics? In this presentation, I describe how dark energy and dark matter are excellent metaphors for the competing forces (a.k.a. concerns) that must be resolved by the microservices pattern language. You will learn that dark energy, which is an anti-gravity, is a metaphor for the repulsive forces that encourage decomposition into services. I describe how dark matter, which is an invisible matter that has a gravitational effect, is a metaphor for the attractive forces that resist decomposition and encourage the use of a monolithic architecture. You will learn how to use the dark energy and dark matter forces as guide when designing services and operations.

Dark Energy, Dark Matter and the Microservices Patterns?!

Dark energy and dark matter are useful metaphors for the repulsive forces, which encourage decomposition into services, and the attractive forces, which resist decomposition. You must balance these conflicting forces when defining a microservice architecture including when designing system operations (a.k.a. requests) that span services. In this talk, I describe the dark energy and dark matter forces. You will learn how to design system operations that span services using microservice architecture collaboration patterns: Saga, Command-side replica, API composition, and CQRS patterns. I describe how each of these patterns resolve the dark energy and dark matter forces differently.

Dark energy, dark matter and microservice architecture collaboration patterns

It sounds dull but good architecture documentation is essential. Especially when you are actively trying to improve your architecture. For example, I spend a lot time helping clients modernize their software architecture. More often than I like, I’m presented with a vague and lifeless collection of boxes and lines. As a result, it’s sometimes difficult to discuss the architecture in a meaningful and productive way. In this presentation, I’ll describe techniques for creating minimal yet effective documentation for your application’s microservice architecture. In particular, you will learn how documenting scenarios can bring your architecture to life.

Scenarios_and_Architecture_SkillsMatter_April_2022.pdf

This is a presentation that gave at the O'Reilly Software Architecture Superstream: Software Architecture Patterns. The talk's focus is the microservices pattern language. However, it also shows how thinking with the pattern mindset - context/problem/forces/solution/consequences - leads to better technically decisions. The microservices architecture offers tremendous benefits, but it’s not a silver bullet. It also has some significant drawbacks. The microservices pattern language—a collection of patterns that solve architecture, design, development, and operational problems—enables software developers to apply the microservices architecture effectively. I provide an overview of the microservices architecture and examines the motivations for the pattern language, then takes you through the key patterns in the pattern language.

Using patterns and pattern languages to make better architectural decisions

Rapid, reliable, frequent and sustainable software development requires an architecture that is loosely coupled and modular. Teams need to be able complete their work with minimal coordination and communication with other teams. They also need to be able keep the software’s technology stack up to date. However, the microservice architecture isn’t always the only way to satisfy these requirements. Yet, neither is the monolithic architecture. In this talk, I describe loose coupling and modularity and why they are is essential. You will learn about three architectural patterns: traditional monolith, modular monolith and microservices. I describe the benefits, drawbacks and issues of each pattern and how well it supports rapid, reliable, frequent and sustainable development. You will learn some heuristics for selecting the appropriate pattern for your application.

iSAQB gathering 2021 keynote - Architectural patterns for rapid, reliable, fr...

To deliver a large complex application rapidly, frequently and reliably, you often must use the microservice architecture. The microservice architecture is an architectural style that structures the application as a collection of loosely coupled services. One challenge with using microservices is that in order to be loosely coupled each service has its own private database. As a result, implementing transactions and queries that span services is no longer straightforward. In this presentation, you will learn how event-driven microservices address this challenge. I describe how to use sagas, which is an asynchronous messaging-based pattern, to implement transactions that span services. You will learn how to implement queries that span services using the CQRS pattern, which maintain easily queryable replicas using events.

Events to the rescue: solving distributed data problems in a microservice arc...

The microservice architecture is growing in popularity. It is an architectural style that structures an application as a set of loosely coupled services that are organized around business capabilities. Its goal is to enable the continuous delivery of large, complex applications. However, the microservice architecture is not a silver bullet and it has some significant drawbacks. The goal of the microservices pattern language is to enable software developers to apply the microservice architecture effectively. It is a collection of patterns that solve architecture, design, development and operational problems. In this talk, I’ll provide an overview of the microservice architecture and describe the motivations for the pattern language. You will learn about the key patterns in the pattern language.

A pattern language for microservices - June 2021

Delivering large, complex software rapidly, frequently and reliably requires a loosely coupled organization. DevOps teams should rarely need to communicate and coordinate in order to get work done. Conway's law states that an organization and the architecture that it develops mirror one another. Hence, a loosely coupled organization requires a loosely coupled architecture. In this presentation, you will learn about design-time coupling in a microservice architecture and why it's essential to minimize it. I describe how to design service APIs to reduce coupling. You will learn how to minimize design-time coupling by applying a version of the DRY principle. I describe how key microservices patterns potentially result in tight design time coupling and how to avoid it.

QConPlus 2021: Minimizing Design Time Coupling in a Microservice Architecture

In order to explain certain astronomical observations, physicists created the mysterious concepts of dark energy and dark matter. Dark energy is a repulsive force. It’s an anti-gravity that is forcing matter apart and accelerating the expansion of the universe. Dark matter has the opposite attraction effect. Although it’s invisible, dark matter has a gravitational effect on stars and galaxies. In this presentation, you will learn how these metaphors apply to the microservice architecture. I describe how there are multiple repulsive forces that drive the decomposition of your application into services. You will learn, however, that there are also multiple attractive forces that resist decomposition and bind software elements together. I describe how as an architect you must find a way to balance these opposing forces.

Mucon 2021 - Dark energy, dark matter: imperfect metaphors for designing micr...

Skillsmatter CloudNative eXchange 2020 The microservice architecture is a key part of cloud native. An essential principle of the microservice architecture is loose coupling. If you ignore this principle and develop tightly coupled services the result will mostly likely be yet another "microservices failure story”. Your application will be brittle and have all of disadvantages of both the monolithic and microservice architectures. In this talk you will learn about the different kinds of coupling and how to design loosely coupled microservices. I describe how to minimize design time and increase the productivity of your DevOps teams. You will learn how how to reduce runtime coupling and improve availability. I describe how to improve availability by minimizing the coupling caused by your infrastructure.

Designing loosely coupled services

Microservices - an architecture that enables DevOps (T Systems DevOps day)

DDD SoCal: Decompose your monolith: Ten principles for refactoring a monolith...

Decompose your monolith: Six principles for refactoring a monolith to microse...

The microservice architecture is becoming increasingly important. But what is it exactly? Why should you care about microservices? And, what do you need to do to ensure that your organization uses the microservice architecture successfully? In this talk, I’ll answer these and other questions. You will learn about the motivations for the microservice architecture and why simply adopting microservices is insufficient. I describe essential characteristics of microservices, You will learn how a successful microservice architecture consists of loosely coupled services with stable APIs that communicate asynchronously.

TDC2020 - The microservice architecture: enabling rapid, reliable, frequent a...

Overview of the Eventuate Tram Customers and Orders application

An overview of the Eventuate Platform

#DevNexus202 Decompose your monolith

Conference: Engage2024 in Antwerp Type: Workshop Speakers: Florian Vogler, Henning Kunz, Christoph Adler Title: Navigating the Future with The Hitchhiker's Guide to Notes and Domino 14 Abstract: Embark on an exhilarating journey with industry trailblazers Florian Vogler, Henning Kunz, and Christoph Adler in this not-to-be-missed workshop at the forefront of the tech universe. Get ready for a thrilling kick-off as we navigate the current state of the HCL universe, setting the stage for an exploration of the groundbreaking Notes and Domino 14. Discover the latest enhancements and revolutionary features that will redefine your experience. In this interactive session, unlock a treasure trove of tips and tricks to elevate your utilization of version 14, both with and without the game-changing panagenda MarvelClient. Brace yourself for also diving into Nomad, Nomad Web, and VoltMX, expanding your horizons in the expansive HCL landscape. Be a part of this exclusive opportunity to stay ahead in the ever-evolving world of HCL technologies. Your journey to mastering Notes and Domino 14 begins here. And remember, in the spirit of intergalactic exploration, don't forget to bring your towel!

More from Chris Richardson (20)

The microservice architecture: what, why, when and how?

More the merrier: a microservices anti-pattern

YOW London - Considering Migrating a Monolith to Microservices? A Dark Energy...

Dark Energy, Dark Matter and the Microservices Patterns?!

Dark energy, dark matter and microservice architecture collaboration patterns

Scenarios_and_Architecture_SkillsMatter_April_2022.pdf

Using patterns and pattern languages to make better architectural decisions

iSAQB gathering 2021 keynote - Architectural patterns for rapid, reliable, fr...

Events to the rescue: solving distributed data problems in a microservice arc...

A pattern language for microservices - June 2021

QConPlus 2021: Minimizing Design Time Coupling in a Microservice Architecture

Mucon 2021 - Dark energy, dark matter: imperfect metaphors for designing micr...

Designing loosely coupled services

Microservices - an architecture that enables DevOps (T Systems DevOps day)

DDD SoCal: Decompose your monolith: Ten principles for refactoring a monolith...

Decompose your monolith: Six principles for refactoring a monolith to microse...

TDC2020 - The microservice architecture: enabling rapid, reliable, frequent a...

Overview of the Eventuate Tram Customers and Orders application

An overview of the Eventuate Platform

#DevNexus202 Decompose your monolith

Recently uploaded

W01_panagenda_Navigating-the-Future-with-The-Hitchhikers-Guide-to-Notes-and-D...

panagenda

%in Benoni+277-882-255-28 abortion pills for sale in Benoni

%in Soweto+277-882-255-28 abortion pills for sale in soweto

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal.

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...

%in ivory park+277-882-255-28 abortion pills for sale in ivory park

Investing in AI transformation today The modern business advantage: Uncovering deep insights with AI Organizations around the world have come to recognize AI as the transformative technology that enables them to gain real business advantage. AI’s ability to organize vast quantities of data allows those who implement it to uncover deep business insights, augment human expertise, drive operational efficiency, transform their products, and better serve their customers

WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...

WSO2

Microsoft AI Transformation Partner Playbook.pdf

Willy Marroquin (WillyDevNET)

VTU technical seminar 8Th Sem on Scikit-learn

AmarnathKambale

Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic near me by a powerful astrologer and spell caster in Atlanta. Bring back your lover with Asaf's voodoo-love witchcraft. Psychic Reading | Astrologer | Spell Caster | Obsession Spells | Black Magic | Witchcraft | Protection spell | wiccan spells. Black magic expert and voodoo love spells that work overnight to retrieve that love | lost love spell caster with powerful love psychic reading. Best astrologer & psychic in Sandy Springs, GA to renew your relationship & make your relationship stronger. love spells to bring back the feelings of love for ex-lovers. Increase the intimacy, affection & love between you and your lover using voodoo relationship obsession spells in USA. Money spells, easy love spells with just words, think of me spell, powerful love spell, spells of love, spells that work, love potion to attract a man, easy love spells with just words, pink candle prayer, white magic spells, call me spell, manifestation spell, gay love spells, Commitment spells, business spells and, how to bring back lost love in a relationship, Witchcraft love spells that work immediately to increase love & intimacy in your relationship. Attraction love spells to attract someone, stop a divorce, prevent a breakup & get your ex back. When using love binding spells, there are several things you should know, particularly how to protect yourself from negative energies and how to use the powers of incantations for the good of all people involved. When the focus is love, the results are truly magical. It’s important to remember love is not manipulative, it is not forceful, and it does not bend another to its will. Love is free-flowing, accepting, kind, and generous. For your love spell to work as intended, you must have good intentions in your heart. Below, we share the top five love spells you can use today to shift the energies in your life and create a future filled with love and fulfilment. Obsession spells to Get Your Ex-Lover Back. All women want one thing the most in life to be love and love in return – not much to ask. A lady wants a good man who loves you unconditionally and loyally. You want a man who is honest, hardworking, and loyal – not a complainer or a weakling or a self-centred man. You are a strong, independent, sensual, caring, loving woman. And you don’t think it’s asking too much to want to be with a loving, intelligent man with a good sense of humour and daring, an upright and confident man – who knows who he is. No one wants a chauvinistic and macho man, but you do want someone who will be willing to protect and care for you. Who loves you for you and not some kind of imaginary. You have no doubt that when the right guy appears on your doorstep, you’ll never let him go. But sometimes a man doesn’t realize he has that good woman.

Love witchcraft +27768521739 Binding love spell in Sandy Springs, GA |psychic...

chiefasafspells

Craft an AI & Machine Learning Pitch with our Editable Professional PowerPoint Template. Ignite your AI & Machine Learning pitch with our cutting-edge PowerPoint template tailored for the industry. Perfect for AI conferences, investor presentations, sales pitches to tech-focused companies, training sessions, and educational programs. - 20+ editable slides: Get a variety of options to choose from for your presentation. - Time-saving solution: Download, replace text/images with a few clicks. - User-friendly customization: Easy to use and personalize. - Modern and attractive design: Captivating visuals, sleek layout. - Tailored to your requirements: Fully alterable for customization. - Well-organized slides: Complete control over content. - Thematic specificity: Reflects healthcare industry with relevant graphics. - Showcase your business idea: Communicate value proposition effectively.

AI & Machine Learning Presentation Template

Presentation.STUDIO

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in Tembisa ● Abortion Pills For Sale in Tembisa ● Tembisa 🏥🚑!! Abortion Clinic Near Me Cost, Price, Women's Clinic Near Me, Abortion Clinic Near, Abortion Doctors Near me, Abortion Services Near Me, Abortion Pills Over The Counter, Abortion Pill Doctors' Offices, Abortion Clinics, Abortion Places Near Me, Cheap Abortion Places Near Me, Medical Abortion & Surgical Abortion, approved cyctotec pills and womb cleaning pills too plus all the instructions needed This Discrete women’s Termination Clinic offers same day services that are safe and pain free, we use approved pills and we clean the womb so that no side effects are present. Our main goal is that of preventing unintended pregnancies and unwanted births every day to enable more women to have children by choice, not chance. We offer Terminations by Pill and The Morning After Pill.” Our Private VIP Abortion Service offers the ultimate in privacy, efficiency and discretion. we do safe and same day termination and we do also womb cleaning as well its done from 1 week up to 28 weeks. We do delivery of our services world wide SAFE ABORTION CLINICS/PILLS ON SALE WE DO DELIVERY OF PILLS ALSO Abortion clinic at very low costs, 100% Guaranteed and it’s safe, pain free and a same day service. It Is A 45 Minutes Procedure, we use tested abortion pills and we do womb cleaning as well. Alternatively the medical abortion pill and womb cleansing !!!

Abortion Pill Prices Tembisa [(+27832195400*)] 🏥 Women's Abortion Clinic in T...

Medical / Health Care (+971588192166) Mifepristone and Misoprostol tablets 200mg

ADR, or Architecture Decision Record, is a valuable tool in software development for several reasons. It provides a centralized location for documenting and tracking architectural decisions, aiding both current and future team members. ADRs enhance communication among team members by documenting the rationale behind architectural decisions, especially beneficial during onboarding of new team members or when revisiting decisions. They serve as a knowledge base, enabling teams to learn from past decisions and refine their decision-making process. Additionally, ADRs contribute to transparency by helping stakeholders understand the reasons behind specific architectural choices. As with any other tool or process, introducing them into an organization can face several obstacles, and overcoming these challenges is crucial for successful implementation. In this talk I go through some common problems and our way of solving them.

Architecture decision records - How not to get lost in the past

Papp Krisztián

WSO2CON 2024 - Building the API First Enterprise – Running an API Program, fr...

WSO2

Data spaces in distributed environments should be allowed to evolve in agile ways providing data space owners with large flexibility about which data they store. Agility and heterogeneity, however, jeopardize data exchanges because representations may build on varying ontologies and data consumers may not rely on the semantic correctness of their queries in the context of semantically heterogeneous, evolving data spaces. Graph data spaces are one example of a powerful model for representing and querying data whose semantics may change over time. To assert and enforce conditions on individual graph data spaces, shape languages (e.g SHACL) have been developed. We investigate the question of how querying and programming can be guarded by reasoning over SHACL constraints in a distributed setting and we sketch a picture of how a future landscape based on semantically heterogeneous data spaces might look like.

Shapes for Sharing between Graph Data Spaces - and Epistemic Querying of RDF-...

Steffen Staab

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

%+27788225528 love spells in Atlanta Psychic Readings, Attraction spells,Brin...

Announcing Codolex 2.0 from GDK Software

Jim McKeeth

%in kempton park+277-882-255-28 abortion pills for sale in kempton park

%in Harare+277-882-255-28 abortion pills for sale in Harare