apidays LIVE JAKARTA - Event Driven APIs by Phil Scanlon

Event Driven APIs
Phil Scanlon
VP Field Technology, APAC & ME
Solace

Talking Points
APIs, Events, Event Driven APIs
Duality
The real time enterprise and its
digital patterns
Service Mesh and Event Mesh
Competing, Complementing,
Duality again?
Looking for Schrodinger’s Cat –
Event Portal
Visualizing Event Streams
Why Care?
Responsive, real time, distributed apps
Agility and CX

Digital Transformation
Events for Real time, responsive
apps

The Real Time Business Transformation

Real Time Digital Transformation
To unlock
the value of data,
you need to set it in
motion
as Event Streams
5
© Solace
Proprietary & Confidential

The Evolution of Integration – Event Driven
Banking
Producer
A
Consume
r
A
MQ
Producer
B
MQ
Producer
C
MQ
Producer
A
Consume
r
C
Producer
B
Producer
C
IBM MQ Point to Point
• Technical Interfaces – Producer needs
to know the exact end point of the
Consumer
• No grain for functional capability
• Point-to-point model
Enterprise Service Bus
• Functional capability – Producer needs to
know the exact end point for a feature
and not Consumer
• Coarse grain functional capability
• Pub-Sub Model
Event Driven Architecture
• Dynamic Routing on Taxonomy
• Producer need not know end point of system
or feature, just connects to the Event Mesh
(fabric that connects all end points)
• Fine grain functional capability via Event
Model (pub-sub+)
Producer
A
Consume
r
B
MQ
Producer
B
MQ
Producer
C
MQ
Producer
A
Consume
r
C
MQ
Producer
B
MQ
Producer
C
MQ
Producer
A Consume
r
A
Producer
B
Producer
C
Consume
r
B
Producer
A
Producer
B
Producer
C
Consume
r
A
Consume
r
B
Consume
r
C

Batch Polling Event
Streaming
Long Time Real
Time
Event Driven &
APIs
ETL  SOA &
APIs
Event-Driven is the new imperative…
Liberate Data at Rest - Identify Real Time Candidates
Ask the question – why not real time? Business, or IT
problem?
Select high visibility, quick win candidates to start the
event driven journey

API, Events, Event Driven APIs

Order Management Event Flow
© Solace
Proprietary &
Confidential
ORDER
VALIDATOR
MICROSERVICE
CREDIT CHECK
MICROSERVICE
INVENTORY
CHECK
MICROSERVICE
PAYMENT
PROCESSOR
MICROSERVICE
ORDER
PROCESSOR
MICROSERVICE

Order Management Event Flow – Insights
Consumers
© Solace
Proprietary &
Confidential
ORDER
VALIDATOR
MICROSERVICE
CREDIT CHECK
MICROSERVICE
INVENTORY
CHECK
MICROSERVICE
PAYMENT
PROCESSOR
MICROSERVICE
ORDER
PROCESSOR
MICROSERVICE
CROSS SELL
UPSELL
MICROSERVICE
DATA LAKE
INGESTOR
MICROSERVICE
INSIGHTS
AI ML
MICROSERVICE

Responsive Applications Give Better CX
Sync and Async Paths – APIs and Events
© Solace
Proprietary &
Confidential
ORDER
VALIDATOR
MICROSERVICE
CREDIT CHECK
MICROSERVICE
INVENTORY
CHECK
MICROSERVICE
PAYMENT
PROCESSOR
MICROSERVICE
ORDER
PROCESSOR
MICROSERVICE
CROSS SELL
UPSELL
MICROSERVICE
DATA LAKE
INGESTOR
MICROSERVICE
INSIGHTS
AI ML
MICROSERVICE
Synchronous, Fast
path
Asynchronous,
Parallel Path
Eventually Consistency
Deferred Execution
API
North South
Traffic
Event
s
East West

APIs and Events Evolution
Separation of API From Service Implementation
1
2© Solace Proprietary
& Confidential
Subscribe
Subscribe
Subscribe
Publish
Publish
Subscribe
API
Sources from : Gartner Application Architecture, Development & Integration Summit 2018

• Cloud-native API
(Spring, REST and WebSocket)
• IoT ready
(MQTT)
• Enterprise ready
(JMS, JCA, REST, AMQP)
• Any-to-any
interoperability
• Open APIs and
Protocols
• Eliminate platform and
protocol lock-in
Streaming APIs and Integration
1
3
© Solace
Proprietary &
Confidential
Objective C
iOS
JavaScript
HTML5
.NET
Core 2.0
HTTP API
RESTC, C++, Java,
JavaScript,
Python, Go, .NET
C, C#/.NET, JMS/JCA,
Java
Boot, cloud connector,
cloud stream,
cloud data flow
JMS (1.1, 2.0), Python, Ruby,
C++, .NET, Perl,
Node.js, .NET,
Java, .NET(NNMS)
Source and Sink
seamless Kafka
connectors
Cloud Native Services
Ex: (SQS,SNS, Beam,
Kinesis…)
Edge Streaming Family

Evolving SOA to Event Driven Architecture
• Event Aware Messaging moves to the core for routing
• Topic namespace is designed
• Topic namespace used for Runtime Governance
• Runtime Governance via Topic Hierarchies and ACLs
• Each event had a topic
• Event Cataloguing (REST or messaging)
• Versioning, AB testing via Topics
• Microservices consume and produce events
• Works hand in hand with event cataloguing
and governance via ACLs
• Self Orchestration Chhoreography - Microservices
“subscribe” to events, rather than being “called”
• When needed, ESB used as an exception for non
standard transformation and orchestration only
• When needed, API platforms can front APIs
Evolution Steps:

• Event driven APIs are described by “Topics”
– Topic routing has been around for 20 years and scales
better than SOA
• TIBCO RV
• Capital markets to IoT runs on this
– Topic routing is standardized
– Topics are routable by Solace as an Event Driven Data
River…
Tag Events with Routable Topics/URL
Message
Payload
Binary or json or xml, or anything!
REST URL : http://host:port/
pay/init/sg/v1/qr/dbs/casa/taxi/comfort
Event over REST
Message
Payload
Binary or json or xml, or anything!
Topic: pay/init/sg/v1/qr/dbs/casa/taxi/comfort
Event over MQTT/JMS
Event Routing Enabled
Taxonomy
REST JMS
Publish:
Subscribe – filtered matching:
pay/init/sg/v1/>
or
pay/init/*/v1/qr/>

Event Driven Microservices
B2B
EventDriven
Microservices
Payment Gateway Init
JMS Topic:
pay/init/*/v1/>
AMQP Topic :
Event
Producers
Messaging–
Eventing
Backbone
REST URL: http://host:port/
• Events are published to context based,
“/” separated URLs
• “/” tokenized string is used for event
routing
• ACLs apply
• Microservices subscribe to events of
interest using topic subscriptions
• Persistent, Request Reply are also
supported.
• Wildcard subscriptions supported
New channels added
easily, just publish on
the same event
taxonomy
Event Mesh
Micro
Service

Agility with Event Routing - Pub Sub
Choreography
B2B
EventDriven
Microservices
Payment Gateway Init
JMS Topic:
pay/init/*/v1/>
AMQP Topic :
Event
Producers
Messaging–
Eventing
Backbone
MQTT Topic:
pay/*/sg/*/qr/>
QR Campaign Analytics
• Microservices subscribe to events of
interest using topic subscriptions
• Persistent, Request Reply are also
supported.
• Wildcard subscriptions supported
Event Mesh
Micro
Service
Micro
Service

Event Mesh
ESB/Adapters
Event Driven Microservices – ESB at the
Edge
ESB/Adapters
B2B
Lightweight ESB at the edge (only if
needed) - Orchestration |
Transformation | Adaptation
EventDriven
Microservices
JMS Topic:
pay/*/sg/*/qr/>
QR Campaign AnalyticsPayment Gateway
Init
Legacy
Proprietary
StandardsJMS Topic:
pay/init/*/v1/>
AMQP Topic :
Event
Producers
Messaging–
Eventing
Backbone
Micro
Service
Micro
Service
API Platform

Event Mesh
Event Driven Microservices
API Platform
B2B
Lightweight Microservices at the edge -
Choreography | Transformation |
Adaptation
EventDriven
Microservices
JMS Topic:
pay/*/sg/*/qr/>
QR Campaign AnalyticsPayment Gateway Init
Legacy
Proprietary
StandardsJMS Topic:
pay/init/*/v1/>
AMQP Topic :
Event
Producers
Messaging–
Eventing
Backbone
Micro
Service
Micro
Service
Micro
Service
Micro
Service
Micro
Service
Micro
Service
API Platform

Distributed Integration

The East West Traffic Debate – Service Mesh?
Event Mesh?
21
© Solace
Proprietary & Confidential
Microservices were happily
coupled
But management had a problem
Decouple with Sidecars and Service Mesh
But not all Microservices want to be serially
coupled
Some like parallel lives!
Service Mesh Loves Event Mesh!

• Solace Event
Streaming
Platform is an end
to end
foundational
architectural layer
for SAP
Modernization,
IOT, Event Driven
APIs and Event
Driven iPaaS
SAP Ecosystem Example - Hybrid Multi Cloud Event Mesh
Data Lake,
AI, ML
Retail
Factorie
s
Trackin
g
IOT API GW
iPaaS
EAI/ES
B
SAP PI/PO
Streaming

Event Portal
Meanwhile, Inside the Box,
Schrodinger’s Cat Plans Its
Revenge…
Source: Open Culture
http://www.openculture.com/2019/05/meanwhile-inside-the-box-
schrodingers-cat-plans-its-revenge.html

Event Portal - Event Choreography And
Cataloging

Event Portal – Catalog, Discover, Design Event
Streaming
Event Discovery Event Catalog Event Designer
Solace Event
Streaming Platform
Runtime, Catalogue,
Metrics and

2
6
© Solace
Proprietary &
Confidential
Single place to design, create, catalog, visualize,
discover, share, secure and manage all events within
your ecosystem
PubSub+ Event Portal
PubSub+ Event Portal
Mainframe/
SAP
Distributed
Apps IoTMicro
services
Server
Less
Event Brokers
Solace Kafka Others

The Foundational Elements of Event Portal
2
7
© Solace
Proprietary &
Confidential
Application
A Publisher
and/or Subscriber
Event
Topic address + metadata that
references a payload schema
Schema
Payload object definition
JSON, Text, Binary, XML, Avro
Application Domain
Team, LOB, process
(i.e. HR, Inventory, Billing

Event Streaming Platform
Event Mesh is the Nervous System
30
iPaaS
Low Code
Micro
Services
Analytics and
Stream
Processing
IOT Platform
API
Management
Event
Onramp/Offramp
CDC, Legacy Connectors, Xform
API&Event
ProcessingEventStreamingPlatform
Hybrid Multi Cloud Event Mesh Solace Event Portal
SAP EM is Solace

Who are Solace?
The “Event Driven” Guys and Gals
Docker VM
K8S Flavors
Cloud SaaS
Hardware Appliances
3
1
Award-
winning
business
Solace is free
10,000 msg/sec
solace.dev

Take Aways
APIs, Events, Event Driven APIs
Duality
The real time enterprise and its digital
patterns need both APIs and Events – APIs
for North South, Events for East West Traffic
Service Mesh for APIs, Event
Mesh for Events
Looking for Schrodinger’s Cat –
Event Portal
Architect, Design, and Visualize Event Streams
Codegen and Metrics
Design Time and runtime governance
Why Care?
Responsive, real time, distributed apps
Agility and CX

Be Event Driven
Thank You
Phil Scanlon. Solace

apidays LIVE JAKARTA - Event Driven APIs by Phil Scanlon

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a apidays LIVE JAKARTA - Event Driven APIs by Phil Scanlon

Semelhante a apidays LIVE JAKARTA - Event Driven APIs by Phil Scanlon (20)

Mais de apidays

Mais de apidays (20)

Último

Último (20)

apidays LIVE JAKARTA - Event Driven APIs by Phil Scanlon