More Related Content Similar to Architecting a modern Big Data Enterprise API Ecosystem (20) Architecting a modern Big Data Enterprise API Ecosystem1. ARCHITECTING
A MODERN BIG DATA ENTERPRISE
API ECOSYSTEM
+OLEG DULIN
CHIEF ARCHITECT, ADP INNOVATION LAB
Copyright © 2017 ADP, LLC. 1
2. Copyright © 2017 ADP, LLC.
APPLICATION SERVER
PLATFORMS
DISTRIBUTED
SYSTEMS
WALL STREET
WHOLESALE AND
DISTRIBUTION
HUMAN CAPITAL
MANAGEMENT
& PAYROLL
BLOGGING
CLOUD
COMPUTING
LINUX AND OPEN-
SOURCE ADVOCACY
A B O U T M E
2
3. OVER 630,000
CLIENTS
MORE THAN
35 MILLION USERS
5 MILLION
LOGINS A DAY
2015 RANK: #13
2016 RANK IN
FINANCIAL
SERVICES DATA: #1
2016 RANK: #43
2016 SCORE: 100%
2014 RANK: #20
2014 RANK: #19
100+
COUNTRIES
WIDE BREADTH
OF HCM SOLUTIONS
BEST HCM SERVICE
AND BPO OFFERINGS
T H E L A R G E S T G L O B A L
P R O V I D E R O F C L O U D - B A S E D
H C M S O L U T I O N S
A B O U T A D P
3Copyright © 2017 ADP, LLC.
4. Copyright © 2017 ADP, LLC. Proprietary and Confidential. 4
I N N O V A T I O N L A B
A D P
DESIGN-DRIVEN CULTURE
LEAN UX AND USER-CENTRIC
METHODOLOGY
IN-HOUSE RESEARCH CENTER
OPEN INNOVATION AND
COLLABORATION
5. Copyright © 2017 ADP, LLC.
H C M I N D U S T R Y T R E N D S
5
GIG
ECONOMY
CONSUMERIZATIONGOING
GLOBAL
BIG
DATA
OPEN
ECOSYSTEM
6. Taking your API
ecosystem to the
next level
OPEN-SOURCE
The benefit to the
modern enterprise
API ECOSYSTEM
S
Harnessing the
collected data
BIG DATA
A G E N D A
6Copyright © 2017 ADP, LLC.
7. …I SUGGEST THAT A
COMPANY BE VIEWED NOT AS
A MEMBER OF A SINGLE
INDUSTRY
BUT AS PART OF A BUSINESS
ECOSYSTEM THAT CROSSES
A VARIETY OF INDUSTRIES.
J A M E S M O O R E , “ P R E D A T O R S A N D P R E Y ” ,
H A R V A R D B U S I N E S S R E V I E W 1 9 9 3
7Copyright © 2017 ADP, LLC.
“
9. STARTUPS ARE BORN ONLINE
TAKE A FRESH LOOK AT AN EXISTING
COMMODITY OR SERVICE ECOSYSTEM
DELIVER IT IN NEW WAYS VIA NEW
CHANNELS
SMART ECOSYSTEM LEADERS BENEFIT
IN NEW AND MORE PROFITABLE WAYS
INCUMBENTS WITH NO ECOSYSTEM
LEADERSHIP WILL FEEL IT
“VERTICAL COMMERCE AND HOW THE NEXT GENERATION OF
RETAIL WILL BE BUILT”S T E P H A N A N G O , 8 / 2 1 / 1 6
B E G E T V E R T I C A L C O M M E R C E
E C O S Y S T E M S
9Copyright © 2017 ADP, LLC.
10. T O E C O S Y S T E M B U I L D I N G
P U B L I C A P I S A R E C R U C I A L
PUBLIC
APIS
APPS ARE SHORT-LIVED
ENTERPRISE SYSTEMS ARE
COMPLEX AND COSTLY
ONCE A SUPPLIER OR PARTNER PLUGS
INTO AN ECOSYSTEM, THEY STAY
THERE
ECOSYSTEMS ARE LONG-LIVED
Copyright © 2017 ADP, LLC.
CONSUMER APPS
INTERNAL ENTERPRIS
E APPS
SUPPLIERS
PARTNERS
10
11. APPLE
App Store, iOS, MacOS,
iTunes, Xcode toolchain,
Apple Pay
AMAZON Retail API, AWS, Prime
MICROSOFT
Office 365, Windows,
Azure, Active Directory,
Visual Studio
WALMART
Open API, retail API,
product catalog
IFTTT
Sprawling partner
ecosystem
ADP
API, Marketplace,
developer outreach,
partner program
SALESFORCE
Force.com,
database.com, sales cloud,
marketing cloud, etc.
PAYPAL
Online shopping,
payments
A P I E C O - S Y S T E M E X A M P L E S
W E L L K N O W N
11Copyright © 2017 ADP, LLC.
13. EXISTING SERVICE OR PRODUCT
DELIVERED IN INNOVATIVE NEW WAYS
MILLENNIAL FRIENDLY BANKING
IFTTT IS AN ECOSYSTEM LEADER
QAPITAL PARTICIPATES IN THE
IFTTT ECO-SYSTEM
“WHAT IS IFTTT? QAPITAL LETS YOU SAVE WITH YOUR
FAVORITE APPS” Q A P I T A L B L O G , 9 / 1 1 / 2 0 1 5
I F T T T A N D Q A P I T A L
13Copyright © 2017 ADP, LLC.
14. CENTER OF THE ADP ECOSYSTEM
LEADERSHIP
API ACCESS TO ALL ASPECTS OF
HCM AND PAYROLL
APP STORE
INTEGRATED WITH ADP DATA CLOUD
PARTNER PROGRAM
DEVELOPER OUTREACH PROGRAM
A D P M A R K E T P L A C E
L I N K : ADP MARKETPLACE
14Copyright © 2017 ADP, LLC.
15. GROUND WORK
Tenancy
Redundancy and replication
Software lifecycle
SECURITY
Authentication and microservice security
User profiles and account management
Authorization and access control
API ARCHITECTURE
Business events
Queries
Integration
ANALYTICS
Machine learning
Predictive notifications
Chat bots
P L A N N I N G C H E C K L I S T
A P I E C O S Y S T E M S
15Copyright © 2017 ADP, LLC.
16. MULTI-TENANT
Shared logical instance
Managed data security
API and data limits
Examples: ADP, Google Maps
VIRTUALIZED
Each customer gets their own virtual instance
Data is segregated
Network and computing infrastructure limits
Examples: AWS, SAP
O N T E N A N C Y V S . V I R T U A L I Z A T I O N
D E C I D E
16Copyright © 2017 ADP, LLC.
17. DURABILITY Ensure data and transactions are not lost
AVAILABILITY Provide non-stop API access
REDUNDANCY Keep all of your data centers always “hot”
REPLICATION Keep or replicate data where it makes sense
17Copyright © 2017 ADP, LLC.
R E D U N D A N C Y A N D R E P L I C A T I O N
P L A N
18. SUPPORT SDLC API
CONSUMERS EXPECT
DON’T REINVENT THE WHEEL
OR OVER-ENGINEER
STAY CONSISTENT WITH
INDUSTRY BEST PRACTICES
D E V E L O P M E N T L I F E C Y C L E
A C C O M O D A T E
18Copyright © 2017 ADP, LLC.
DEVELOPMENT
PRODUCTION
SCALABILITY
TESTING
QUALITY
ASSURANCE
19. LOST PASSWORDS ARE THE MOST
COMMON TECH SUPPORT COMPLAINT
LET USERS USE THEIR SOCIAL
NETWORK CREDENTIALS
TAKE CARE TO ENSURE THAT SOCIAL
NETWORKS OUTLAST YOUR OWN
PLATFORM
CONSIDER OFFERING
PASSWORD MANAGEMENT
A N D A C C O U N T M A N A G E M E N T
U S E R P R O F I L E S
19Copyright © 2017 ADP, LLC.
20. OAUTH 2.0 IS AN INDUSTRY
STANDARD
JWT TOKENS FOR
MICRO-SERVICE SECURITY
L I N K : “OAUTH 2.0: THE PROTOCOL
AT THE CENTER OF THE UNIVERSE”
20Copyright © 2017 ADP, LLC.
A N D M I C R O - S E R V I C E S E C U R I T Y
A U T H E N T I C A T I O N
RESOURCE OWNE
R
(YOU)
CLIENT
(THIRD-PARTY APP
)
AUTHORIZATION
SERVER
RESOURCE
SERVER
CONNECT
TO SERVICE REQUEST AUTHORIZATION
CODE
REQUEST CREDENTIALS
AND CONSENT
ENTER CREDENTIALS AND GRANT CONSEN
T
AUTHORIZATION CODE
RESPONSE
OBTAIN ACCESS TOKEN
ACCESS THE RESOURC
E
REFRESH EXPIRED
ACCESS TOKEN
USE THE APP
21. 21Copyright © 2017 ADP, LLC.
A N D A C C E S S C O N T R O L
A U T H O R I Z A T I O N
TAKE ADVANTAGE
OF OAUTH SCOPES
THINK THROUGH
DATA SECURITY
22. GENERIC DATA STORES
PERFORM CRUD
Tables get updated
Documents get uploaded
No semantic meaning
Can’t learn
UPDATE Inventory SET count=coun
WHERE productId=422;
BUSINESS PLATFORMS
OPERATE ON EVENTS
Products get ordered
Employees get hired
Semantically meaningful
Can learn and predict
POST /Order
{
“customerId”:4,
”productId”: 422,
“quantity”: 1
}
22Copyright © 2017 ADP, LLC.
B U S I N E S S E V E N T S A P I
D E S I G N
23. MEANINGFUL QUERIES GET /payroll/v2/workers/abc123ef/pay-distributions
OVER-GENERALIZED
POST /v2/Query
{
“type”: “PayDistributions”,
”filter”: {
“associateId”:”abc123ef”
}
}
23Copyright © 2017 ADP, LLC.
F O R Q U E R I E S
A D D S U P P O R T
24. ODATA
Strongly typed with EDM metadata
Supports basic CRUD and
integration endpoints
Supports business events (actions)
Best in Microsoft environments
GRAPHQL
Strongly typed
Query language for APIs
Less chatty than OData and REST
Get all required data in one call
Perfect for mobile and single page apps
F O R Q U E R I E S
O D A T A V S G R A P H Q L
24Copyright © 2017 ADP, LLC.
25. API FRIENDLY TO
ESB TOOLS
Mule ESB
BizTalk
OData
BULK DATA LOADS
OData batch
Streaming
INITIAL INTEGRATION
AND MAINTENANCE
Ability to suspend event analytics during maintenance
I N T E G R A T I O N
25Copyright © 2017 ADP, LLC.
26. WHEN BUSINESS EVENTS HAPPEN,
PARTNERS WANT TO KNOW
“UPDATES” API
OUTBOUND WEBHOOK
NOTIFICATIONS
26Copyright © 2017 ADP, LLC.
AND OUTBOUND NOTIFICATIONS
W E B H O O K S
27. # A D P i n n o v a t i o n | # h e l l o w o r k
OPEN-SOURCETaking your API Ecosystem to the Next Level
28. OFFER DEVELOPERS OPEN-SOURCE
LIBRARIES FOR YOUR APIS
CONTRIBUTE CODE THAT IS NOT
CRITICAL TO YOUR CORE BUSINESS
BUILD DEVELOPER
COMMUNITY
L I N K : ADP LABS GITHUB
28Copyright © 2017 ADP, LLC.
O P E N - S O U R C E
H A R N E S S I N G
29. 29Copyright © 2017 ADP, LLC.
“ C I T I Z E N D E V E L O P E R S ”
N U R T U R E
CREATE NEW BUSINESS APPS
WITHIN THE ECOSYSTEM
ORGANIZE
HACKATHONS
TRAINING AND
EDUCATION
30. BIG DATA
# A D P i n n o v a t i o n | # h e l l o w o r k
Harnessing the Collected Data
31. 31Copyright © 2017 ADP, LLC.
A P I U S A G E
A N A L Y Z E
API CALLS CAN BE ANALYZED
TRACK AND ENFORCE RESOURCE
UTILIZATION BY API CONSUMERS
PREVENT DOS
PRIORITIZE DEVELOPMENT
AUTO-SCALE
32. BUSINESS EVENTS
CAN BE ANALYZED
Orders get placed
People get paid
Vacations get booked
BUSINESS EVENTS
CAN BE PREDICTED
Past history can offer insights
Anticipate sales
Proactive notifications
32Copyright © 2017 ADP, LLC.
I N T E L L I G E N C E
A P P L Y
33. LEARN FROM BUSINESS EVENTS
WITHIN THE ECOSYSTEM
TRY TO PREDICT EVENTS
PROACTIVELY NOTIFY USERS
VIA CHANNELS THEY USE
33Copyright © 2017 ADP, LLC.
P R E D I C T I V E A N A L Y T I C S
H A R N E S S
34. ENCOURAGE
INNOVATION
NEW WAYS TO SECURE SYSTEMS
WITHOUT GETTING IN THE WAY
ENCOURAGE “CITIZEN DEVELOPERS”
34Copyright © 2017 ADP, LLC.
I T D E P A R T M E N T S R E L E V A N T
K E E P
35. 35Copyright © 2017 ADP, LLC.
A D P M A R K E T P L A C E
R E S U L T S
200+ APPS AVAILABLE
1250+ PARTNERS IN PIPELINE
500% GROWTH IN SITE VISITS
2851 CLIENT SUBSCRIPTIONS
Insights VIA ADP DATA CLOUD
36. DON’T MISS AN OPPORTUNITY
TO BECOME AN ECOSYSTEM LEADER
LEVERAGE EXISTING
ECOSYSTEMS
THINK ABOUT CREATIVE NEW WAYS TO
DELIVER EXISTING PRODUCTS AND
SERVICES
36Copyright © 2017 ADP, LLC.
C O N C L U S I O N S
37. THANK YOU
# A D P i n n o v a t i o n | # h e l l o w o r k
WEB: ADP.com
ADP Innovation Lab: https://www.adp.com/why-adp/innovation.aspx
Oleg Dulin on Twitter: @olegdulin
The information provided in this document is for informational purposes only and not for the purpose of providing legal, accounting, or tax advice. The information and services
ADP provides should not be deemed a substitute for the advice of any such professional. Such information is by nature subject to revision and may not be the most current
information available. ADP and the ADP logo are registered trademarks of ADP, LLC. ADP A more human resource. is a service mark of ADP, LLC. All other marks are the
property of their respective owners. Copyright (c) 2017 ADP, LLC.
Editor's Notes “Successful businesses are those that evolve rapidly and effectively. Yet innovative businesses can’t evolve in a vacuum. They must attract resources of all sorts, drawing in capital, partners, suppliers, and customers to create cooperative networks. “
Let’s dive in Let’s dive in Let’s dive in http://www.computerworld.com/article/3007415/cloud-security/oauth-20-the-protocol-at-the-center-of-the-universe.html https://github.com/adplabs Consider if an app is needed at all