1.
D A V I D E S P O S I T O
P L A T F O R M A R C H I T E C T
Migrating Automation Tests to Postman
Monitors and ROI

2.
Who am I?
espo@bettercloud.com

3.
SaaS Provider
e.g. Slack, Google, Okta, Zendesk
API
Advanced Search
Automation
Bulk Actions
Auditing
Fine Grained Access Controls
Derived Event Feeds
Real Time Security Monitoring
DLP
SaaS Admin Decorator Pattern

4.
~700
Internal API’s
BetterCloud in 2019
100
Engineers
12Integrations
320
Services
1-5 billion
REST calls made
per day

5.
APIs at BetterCloud
● 3rd Party
● API Provider
● Internal APIs
● API Ops
SaaS Provider
E.g. Google
Internal Services
Micro1 Micro2
Micro3
PlatformAPI
Customers
& Partners
API Ops

6.
How to measure API’s
Performance Correctness

7.
How to measure API’s
Performance
Resilience
How does the system perform
under load?
Sampling
How does the system perform in
average or ideal conditions?
Correctness

8.
How to measure API’s
Performance
Resilience
How does the system perform
under load?
Sampling
How does the system perform in
average or ideal conditions?
Correctness
Smoke Testing
Does anything explode?
Feature Testing
Does the system adhere to the
contract?

9.
How to measure API’s
Performance
Resilience
How does the system perform
under load?
Sampling
How does the system perform in
average or ideal conditions?
Correctness
Smoke Testing
Does anything explode?
Feature Testing
Does the system adhere to the
contract?

10.
APIs at BetterCloud
● 3rd Party
● API Provider
● Internal APIs
● API Ops
SaaS Provider
E.g. Google
Internal Services
Micro1 Micro2
Micro3
PlatformAPI
Customers
& Partners
API Ops

11.
BetterCloud as an API
Provider
● Tenant specific credentials
● Sampling
○ latency < 500 ms
● Smoke
○ check headers
● Feature
○ GraphQL queries
Internal Services
Micro1
PlatformAPI
Customers
& Partners

12.
Internal APIs at
BetterCloud
Internal Services
Micro1 Micro2
Micro3
PlatformAPI
● HMAC Authentication
● Sampling
○ latency < 500ms
● Smoke
○ check headers
● Feature

13.
#1 Productivity
#2 Historical Trends
#3 Out of the Box Integrations

14.
Psst… Don’t tell...
Scheduled Webhooks as a Service
● Automated Testing (as Designed)
○ Track trends
● Automated Operations
○ Non-critical metrics and alerts, e.g. Kafka
partition skew
● Business Insights
○ Data aggregations
○ Abusive customer alerts

15.
What’s Next?
Monitor vs. Newman

16.
espo@bettercloud.com