What's New in Serverless - SRV305 - re:Invent 2017

AWS re:INVENT
What’s New in AWS Serverless
Dr. T im W a g n e r, G e n e r a l M a n a g e r A m a z o n API G a t e w a y and A WS L a m b d a
N o v e m b e r 3 0 , 2 0 1 7

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A typical day for a developer…
Manager “We need an app to let our customers update preference
settings – our competitors just launched the same thing, so I need it
fast. I don’t want to pay a lot for it, especially when no one is using it.
But remember that we’re growing, so make sure it scales great and is
easy to manage and operate. And you’re on your own – sorry!”
Developer “Not a problem. I’ll make it serverless…”

Serverless means…
No Server Management Flexible Scaling
No Idle Capacity
$
High Availability

Joe promised his boss an app.
Now what?
Step 1: Find a working example!
Serverless web app with
…an API hosted on Amazon API Gateway
…access to existing data stored in Amazon DynamoDB
…static content served by Amazon S3 and Amazon CloudFront
…dynamic content/business logic encoded as Lambda functions
What we need

• Search and browse ready-made apps
and samples
• Customize open source apps to get
started quickly
• Share apps privately or publically
•Monetize APIs using theAWS
Marketplace
• Powered by AWS Serverless
Application Model (AWS SAM)!
AWS Serverless Application Repository
(preview)

Lambda Function Editor
• Edit multiple files at once!
• Create new files for existing
packages
• Run tests and view results
and logs without leaving the
editor
• Save test inputs and reuse
them later
• WYSIWYG designer

Serverless app benefits
Go from concept to working code in under 5 minutes. And
your app isn’t just a prototype…
• 1,000 concurrent executions (10K TPS) by default.
• Every account in good standing is automatically
approved to 3X the default!

• 1,000 concurrent executions, pre-
approved to triple Faster perf with
cold-start
optimization!
Up to 80% reduction in start
times for larger functions

• 1,000 concurrent executions (10K
TPS) by default. Auto-approvals for
everyone to triple.
• Up to 80% faster cold start times
Built-in logging and
monitoring, now with:
“grab-n-go” logs in the
Lambda console

everyone to triple.
• Find Lambda logs instantly 1.5GB
3GB
Top memory size
of…

everyone to triple.
• Find Lambda logs instantly
• Top memory size of 3GB
Go
Serverless!

Next, Joe needs to make some changes.
Step 2: Customize and share
Need an IDE for local dev/test/debug
Customize the app we deployed in step 1
Set up a CI/CD pipeline for the team
Deploy (safely!)
What we need
to do

Easy-to-use IDE in the cloud
Builtin GitHub support
Builtin Lambda blueprint support
Builtin SAM Local:
Local testing!
IDE debugging!
Deploy directly to Lambda and/or
push updates to GitHub
New
LaunchAWS Cloud9

Automated CI/CD process
Git push your changes from Cloud9
when ready to share…
Set up an AWS CodePipeline to
build automatically on updates
Local Testing

I need to deploy Lambda functions
safely and incrementally.
Customer feedback
How can I deploy multiple
functions and APIs in a
coordinated way?
How do I roll back
automatically?
How can I shape traffic
between two versions of
an API?

Safe, incremental serverless deployment
Lambda: Weighted aliases
• Set percentage of traffic between two versions of the same
function
API Gateway: Sub-stages for incremental deployments
• Share traffic between two stages
AWS CodeDeploy: Automated support for safe serverless
deployments
• Amazon CloudWatch metrics-driven rollout/rollback

Another typical day…
Manager: “That app you built is working great, but now we need to
include data from a relational DB and one of our legacy services in our
VPC. Is your serverless architecture going to handle that?”
Developer “Not a problem.”

Next up: Deal with legacy stuff.
Step 3: Connect to enterprise systems
Monitor concurrency
Limit concurrency for legacy connectivity
Hook up APIs to VPC-based services
Audit and log all invocations
What we need
to do

I need a way to protect the capacity of a
Lambda function from others running in
the same account.
Customer feedback
I want to temporarily disable
a function.
Can you create a “dev mode”
for functions?
Lambda can overwhelm
my legacy systems with
too many calls

I need a way to protect the capacity of a
Lambda function from others running in
the same account.
Customer Feedback
I want to temporarily disable
a function.
Can you create a “dev mode”
for functions?
Lambda can overwhelm
my legacy systems with
too many calls
Insight: Concurrency control is a key
element of managing functions in a
serverless app.

Lambda: Concurrency metric
Lambda: Per-function concurrency throttles
Enterprise connectivity
What you can do with it
1. Limit concurrency to legacy systems
2. Protect serverless production services from
other functions in the same account
3. Temporarily disable a function
4. Develop functions with limited billing and
“runaway” protection

VPC (PrivateLink) integrations
Access services and data in
your VPC from an API
Regional endpoints
Fast, region-specific API
endpoints
Enterprise connectivity: API Gateway

API Gateway connectivity solutions
To
From
Internet
Regional
AWS Service
Customer VPC
Internet
Regional
AWS Service
Existing Service
(Edge-optimized, public integrations)
Private VPC
Region-optimized Endpoints
Region Endpoints
+Private VPC
Recent
New

Log and audit
Structured logging for APIs
AWS CloudTrail support for
Lambda functions

Serverless for the enterprise: checklist
Uptime
Scale
Performance
Management
Safe deploys
Concurrency controls

AWS re:INVENT
FICO DMS Presentation
J E E T K A U L
F I C O

You may be familiar with us…

FICO Delivers Advanced Analytics
BANKING More than half of the top 100 banks
INSURANCE Two-thirds of top US P&C Insurers
RETAIL/CONSUMER GOODS One-third of top US Retailers
HEALTHCARE/PHARMA Two-thirds of top US P&C Insurers
GOVERNMENT Over 100 Government Agencies

A Journey from COBOL to the Cloud
Traditional
Software
Development

Cloud Deployment Requirements
• Diverse Customer Demand
• From 50 to >300M transactions per day
• Real-time and Batch processing
• Support customers with multiple LCM environments
• Customer options for multiple software updates daily
• Secure by default
• Customer Availability and Performance SLAs

FICO Decision Management Suite
streaming
Decision development
Decision execution
Decision capture
Analytic DatamartLCMDesignCatalog containers
Apache
Spark

FICO DMS lessons learned
streaming
Decision development
Decision execution
Decision capture
Analytic DatamartLCMDesignCatalog
• Clusters sized for peak
• Infrastructure management
• Pace of development and deployment
(agility)
containers
Apache
Spark

FICO DMS lessons learned
Decision execution
Analytic DatamartLCMDesignCatalog
• Clusters sized for peak
• Infrastructure management
• Pace of development and deployment
(agility)
Decision development Decision capture

AWS Lambda at the heart of our strategy

FICO DMS – A Lambda centered approach
• Decision assets saved in Amazon S3
• DMS deployer creates Lambda functions
from decision assets
• All execution via AWS Lambda
Decision development Decision execution Decision capture
Analytic DatamartDMS
deployerDesignCatalog

Don’t wait. Start with Serverless now!
• >95% decrease in overall deployment
and operational costs
• Decrease in development time & cost
• Change took few weeks
• Significant decrease in operations
overhead
$

THANK YOU!
J E E T K A U L
F I C O

Serverless for Everyone

CUSTOMERS LOVE LAMBDA

Customer benefits: Agility, scale, cost savings
iRobot does >1,000 Lambda deploys per day
for its serverless IoT backend that runs internet
connected-vacuums, with 2M connected robots
by 2018 (FY17 projected)
Fannie Mae is replacing on-prem data
centers with a Lambda-based solution that can
run a Monte Carlo simulation on 20M mortgage
calculations in 1.5 hours
Nextdoor replaced its Apache Flume
platform with a serverless data ingestion
pipeline that handles 3B events daily
HomeAway uses Lambda to process and prepare 6M
user-uploaded photos a month for its vacation rental
marketplace
Agero’s accident detection and driver behavior analysis
platform handles over 1B Lambda requests each month
and scales to handle 20x at peak load
Revvel reduced video transcoding time by >95% at a
fraction of the cost of transcoding videos on server-based
solutions

Serverless for everything
Lambda and API Gateway in every commercial AWS Region +
AWS GovCloud
• …including Beijing!
Lambda@Edge new features:
• Content-based Dynamic Origin Selection
• Network Calls from Viewer Events
• Advanced Response Generation

Serverless for everything
• Faster cold start performance
• Assurance programs: ISO, PCI, HIPAA
• …and now SOC 1, SOC 2, and SOC 3
• Lambda for devices (AWS Greengrass, AWS Snowball Edge)
• Lambda for Windows – CoreCLR 2.0

An expanding Serverless ecosystem
Build and CI/CD
Logging and MonitoringApplications and Deployment
Chalice Framework Serverless Java Container

It’s been a busy year…
…did I forget anything?

• Turn any Go program into a
Lambda function by adding 2
lines
• Open source connector
• Launching early 2018!
Golang in Lambda

Some things to do today:
1. Check out the new Lambda editor
2. Take Cloud9 for a spin
3. Try grab-N-go logs in Lambda and structured API logging
4. Sign up for the Serverless Application Repository preview
5. Follow @timallenwagner for ongoing Serverless news!

AWS re:INVENT
What’s New in AWS Serverless
Dr. T im W a g n e r, G e n e r a l M a n a g e r A m a z o n API G a t e w a y and A WS L a m b d a
@ t i m a l l e n w a g n e r

What's New in Serverless - SRV305 - re:Invent 2017

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a What's New in Serverless - SRV305 - re:Invent 2017

Semelhante a What's New in Serverless - SRV305 - re:Invent 2017 (20)

Mais de Amazon Web Services

Mais de Amazon Web Services (20)

What's New in Serverless - SRV305 - re:Invent 2017