AWS Serverless Application Development Deep Dive

© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved
Pop-up Loft
Deep Dive on Serverless Application Development
Adam Westrich,
Solutions Architect

Agenda
• What do we need to think about when building a serverless architecture?
• Bundling and Deploying
• Continuous Integration & Continuous Delivery
• Versioning, Stages, Variables
• Metrics, Monitoring, Logs, and Profiling

Serverless application
EVENT SOURCE SERVICES (ANYTHING)
Changes in
data state
Requests to
endpoints
Changes in
resource state
FUNCTION
Node.js
Python
Java
C#

Amazon S3 Amazon
DynamoDB
Amazon
Kinesis
AWS
CloudFormation
AWS CloudTrail Amazon
CloudWatch
Amazon
Cognito
Amazon SNSAmazon
SES
Cron events
DATA STORES ENDPOINTS
CONFIGURATION REPOSITORIES EVENT/MESSAGE SERVICES
Event sources that trigger AWS Lambda
… and a few more with more on the way!
AWS
CodeCommit
Amazon
API Gateway
Amazon
Alexa
AWS IoT AWS Step
Functions

Bundling and Deploying
Serverless Applications

Building a deployment package
Node.js & Python
• .zip file consisting of
your code and any
dependencies
• Use npm/pip to
install libraries
• All dependencies
must be at root level
Java
• Either .zip file with all
code/dependencies,
or standalone .jar
• Use Maven / Eclipse
IDE plugins
• Compiled class &
resource files at root
level, required jars in
/lib directory
C# (.NET Core)
• Either .zip file with all
code/dependencies,
or a standalone .dll
• Use NuGet /
VisualStudio plugins
• All assemblies (.dll)
at root level

Create templates of your infrastructure
CloudFormation provisions AWS resources based
on dependency needs
Version control/replicate/update templates like
code
Integrates with development, CI/CD, management
tools
JSON and YAML supported
AWS CloudFormation

CloudFormation template
AWSTemplateFormatVersion: '2010-09-09'
Resources:
GetHtmlFunctionGetHtmlPermissionProd:
Type: AWS::Lambda::Permission
Properties:
Action: lambda:invokeFunction
Principal: apigateway.amazonaws.com
FunctionName:
Ref: GetHtmlFunction
SourceArn:
Fn::Sub: arn:aws:execute-api:${AWS::Region}:${AWS::AccountId}:${ServerlessRestApi}/Prod/ANY/*
ServerlessRestApiProdStage:
Type: AWS::ApiGateway::Stage
Properties:
DeploymentId:
Ref: ServerlessRestApiDeployment
RestApiId:
Ref: ServerlessRestApi
StageName: Prod
ListTable:
Type: AWS::DynamoDB::Table
Properties:
ProvisionedThroughput:
WriteCapacityUnits: 5
ReadCapacityUnits: 5
AttributeDefinitions:
- AttributeName: id
AttributeType: S
KeySchema:
- KeyType: HASH
AttributeName: id
GetHtmlFunction
Type: AWS::Lambda::Function
Properties:
Handler: index.gethtml
Code:
S3Bucket: flourish-demo-bucket
S3Key: todo_list.zip
Role:
Fn::GetAtt:
- GetHtmlFunctionRole
- Arn
Runtime: nodejs4.3
GetHtmlFunctionRole:
Type: AWS::IAM::Role
Properties:
ManagedPolicyArns:
- arn:aws:iam::aws:policy/AmazonDynamoDBReadOnlyAccess
- arn:aws:iam::aws:policy/service-role/AWSLambdaBasicExecutionRole
AssumeRolePolicyDocument:
Version: '2012-10-17'
Statement:
- Action:
- sts:AssumeRole
Effect: Allow
Principal:
Service:
- lambda.amazonaws.com
ServerlessRestApiDeployment:
Type: AWS::ApiGateway::Deployment
Properties:
RestApiId:
Description: 'RestApi deployment id: 127e3fb91142ab1ddc5f5446adb094442581a90d'
StageName: Stage
GetHtmlFunctionGetHtmlPermissionTest:
Properties:
FunctionName:
SourceArn:
Fn::Sub: arn:aws:execute-api:${AWS::Region}:${AWS::AccountId}:${ServerlessRestApi}/*/ANY/*
ServerlessRestApi:
Type: AWS::ApiGateway::RestApi
Properties:
Body:
info:
version: '1.0'
title:
Ref: AWS::StackName
paths:
"/{proxy+}":
x-amazon-apigateway-any-method:
x-amazon-apigateway-integration:
httpMethod: ANY
type: aws_proxy
uri:
Fn::Sub: arn:aws:apigateway:${AWS::Region}:lambda:path/2015-03-
31/functions/${GetHtmlFunction.Arn}/invocations
responses: {}
swagger: '2.0'

AWS Serverless Application Model (SAM)
CloudFormation extension optimized for serverless
New serverless resource types: functions, APIs, and
tables
Supports anything CloudFormation supports
Open specification (Apache 2.0)

CloudFormation template
AWSTemplateFormatVersion: '2010-09-09'
Resources:
GetHtmlFunctionGetHtmlPermissionProd:
Properties:
FunctionName:
SourceArn:
Fn::Sub: arn:aws:execute-api:${AWS::Region}:${AWS::AccountId}:${ServerlessRestApi}/Prod/ANY/*
ServerlessRestApiProdStage:
Type: AWS::ApiGateway::Stage
Properties:
DeploymentId:
Ref: ServerlessRestApiDeployment
RestApiId:
StageName: Prod
ListTable:
Type: AWS::DynamoDB::Table
Properties:
ProvisionedThroughput:
WriteCapacityUnits: 5
ReadCapacityUnits: 5
AttributeDefinitions:
- AttributeName: id
AttributeType: S
KeySchema:
- KeyType: HASH
AttributeName: id
GetHtmlFunction:
Type: AWS::Lambda::Function
Properties:
Code:
S3Bucket: flourish-demo-bucket
S3Key: todo_list.zip
Role:
Fn::GetAtt:
- GetHtmlFunctionRole
- Arn
Runtime: nodejs4.3
GetHtmlFunctionRole:
Type: AWS::IAM::Role
Properties:
ManagedPolicyArns:
- arn:aws:iam::aws:policy/AmazonDynamoDBReadOnlyAccess
- arn:aws:iam::aws:policy/service-role/AWSLambdaBasicExecutionRole
AssumeRolePolicyDocument:
Version: '2012-10-17'
Statement:
- Action:
- sts:AssumeRole
Effect: Allow
Principal:
Service:
- lambda.amazonaws.com
ServerlessRestApiDeployment:
Type: AWS::ApiGateway::Deployment
Properties:
RestApiId:
Description: 'RestApi deployment id: 127e3fb91142ab1ddc5f5446adb094442581a90d'
StageName: Stage
GetHtmlFunctionGetHtmlPermissionTest:
Properties:
FunctionName:
SourceArn:
Fn::Sub: arn:aws:execute-api:${AWS::Region}:${AWS::AccountId}:${ServerlessRestApi}/*/ANY/*
ServerlessRestApi:
Type: AWS::ApiGateway::RestApi
Properties:
Body:
info:
version: '1.0'
title:
Ref: AWS::StackName
paths:
"/{proxy+}":
x-amazon-apigateway-any-method:
x-amazon-apigateway-integration:
httpMethod: ANY
type: aws_proxy
uri:
Fn::Sub: arn:aws:apigateway:${AWS::Region}:lambda:path/2015-03-
31/functions/${GetHtmlFunction.Arn}/invocations
responses: {}
swagger: '2.0'

SAM template
AWSTemplateFormatVersion: '2010-09-09’
Transform: AWS::Serverless-2016-10-31
Resources:
GetHtmlFunction:
Type: AWS::Serverless::Function
Properties:
CodeUri: s3://flourish-demo-bucket/todo_list.zip
Runtime: nodejs4.3
Policies: AmazonDynamoDBReadOnlyAccess
Events:
GetHtml:
Type: Api
Properties:
Path: /{proxy+}
Method: ANY
ListTable:
Type: AWS::Serverless::SimpleTable

AWS commands – Package & Deploy
Package
• Creates a deployment package (.zip file)
• Uploads deployment package to an Amazon S3 bucket
• Adds a CodeUri property with S3 URI
Deploy
• Calls CloudFormation ‘CreateChangeSet’ API
• Calls CloudFormation ‘ExecuteChangeSet’ API

Versioning, Stages, Variables

Function versioning and aliases
• Versions = immutable copies of
code + configuration
• Aliases = mutable pointers to
versions
• Development against $LATEST
version
• Each version/alias gets its own
ARN
• Enables rollbacks, staged
promotions, “locked” behavior for
client
Lambda Function
Version $LATEST
Lambda Function
Version 123
Lambda Function
DEV Alias
Lambda Function
BETA Alias
Lambda Function
PROD Alias

Lambda Environment Variables
• Key-value pairs that you can dynamically pass to your function
• Available via standard environment variable APIs such as process.env for
Node.js or os.environ for Python
• Can optionally be encrypted via KMS
– Allows you to specify in IAM what roles have access to the keys to decrypt the
information
• Useful for creating environments per stage (i.e. dev, testing, production)

API Gateway Stages
• Stages are named links to a deployed version of your
API
• Recommended for managing API lifecycle
– dev/test/prod
– alpha/beta/gamma
• Support for parameterized values via stage variables

API Gateway Stage Variables
• Stage variables act like environment variables
• Use stage variables to store configuration values
• Stage variables are available in the $context object
• Values are accessible from most fields in API Gateway
• Lambda function ARN
• HTTP endpoint
• Custom authorizer function name
• Parameter mappings

Stage variables and Lambda alias for stages
Using Stage Variables in API Gateway together with Lambda function Aliases
helps you manage a single API configuration and Lambda function for multiple
stages
myLambdaFunction
1
2
3 = prod
4
5
6 = beta
7
8 = dev
My First API
Stage variable = lambdaAlias
Prod
lambdaAlias = prod
Beta
lambdaAlias = beta
Dev
lambdaAlias = dev

Continuous Integration &
Continuous Delivery for

Continuous Integration
Continuous Delivery
Continuous Deployment
Source Build Test Production
Feedback

Source Build Test Production
• Version
Control
• Branching
• Code Review
• Compilation
• Unit Tests
• Static Analysis
• Packaging
• Integration Tests
• Load Tests
• Security Tests
• Acceptance Tests
• Deployment
• Monitoring
• Measuring
• Validation

Where to Focus Your Tests:
UI
Service
Unit 70%
20%
10%

Fully managed build service that compiles source code, runs
tests, and produces software packages
Scales continuously and processes multiple builds
concurrently
You can provide custom build environments suited to your
needs via Docker images
Only pay by the minute for the compute resources you use
Launched with CodePipeline and Jenkins integration
AWS CodeBuild

What service and release step corresponds with which tests?
UI
Service
Unit
Third Party
Tooling
AWS CodeBuild
BuildTest

version: 0.1
environment_variables:
plaintext:
"INPUT_FILE": "saml.yaml”
"S3_BUCKET": "”
phases:
install:
commands:
- npm install
pre_build:
commands:
- eslint *.js
build:
commands:
- npm test
post_build:
commands:
- aws cloudformation package --template $INPUT_FILE --s3-
bucket $S3_BUCKET --output-template post-saml.yaml
artifacts:
type: zip
files:
- post-saml.yaml
- beta.json
buildspec.yml Example

version: 0.1
environment_variables:
plaintext:
"INPUT_FILE": "saml.yaml”
"S3_BUCKET": "”
phases:
install:
commands:
- npm install
pre_build:
commands:
- eslint *.js
build:
commands:
- npm test
post_build:
commands:
- aws cloudformation package --template $INPUT_FILE --s3-
bucket $S3_BUCKET --output-template post-saml.yaml
artifacts:
type: zip
files:
- post-saml.yaml
- beta.json
• Variables to be used by phases of
build
• Examples for what you can do in the
phases of a build:
• You can install packages or run
commands to prepare your
environment in ”install”.
• Run syntax checking, commands in
“pre_build”.
• Execute your build tool/command
in “build”
• Test your app further or ship a
container image to a repository in
post_build
• Create and store an artifact in S3
buildspec.yml Example

Continuous delivery service for fast and reliable
application updates
Model and visualize your software release process
Builds, tests, and deploys your code every time
there is a code change
Integrates with third-party tools and AWS
AWS CodePipeline

Source
Source
GitHub
Build
CodeBuild
AWS CodeBuild
Deploy
JavaApp
Elastic Beanstalk
Pipeline
Stage
Action
Transition
AWS CodePipeline
MyApplication

Build
CodeBuild
AWS CodeBuild
NotifyDevelopers
Lambda
Parallel actions
Source
Source
GitHub
Deploy
JavaApp
Elastic Beanstalk
AWS CodePipeline
MyApplication

Build
CodeBuild
AWS CodeBuild
NotifyDevelopers
Lambda
TestAPI
Runscope
Sequential actions
Deploy
JavaApp
Elastic Beanstalk
Source
Source
GitHub
AWS CodePipeline
MyApplication

Build
CodeBuild
AWS CodeBuild
Staging-Deploy
JavaApp
Elastic Beanstalk
Prod-Deploy
JavaApp
Elastic Beanstalk
QATeamReview
Manual Approval
Manual Approvals
Review
AWS CodePipeline
MyApplication

Deploy via CodePipeline
Pipeline flow:
1. Commit your code to a source code repository
2. Package in CodeBuild
3. Use CloudFormation actions in CodePipeline to
create or update stacks via SAM templates
Optional: Make use of ChangeSets
4. Make use of specific stage/environment
parameter files to pass in Lambda variables
5. Test our application between stages/environments
Optional: Make use of Manual Approvals

AWS CodeStar
Quickly develop, build, and deploy applications on AWS
Start developing on AWS in minutes
Work across your team, securely
Manage software delivery easily
Choose from a variety of project templates

Pipeline
Commit History
Issue Tracking
AWS CodeStar

AWS CodeStar
Adding Team Members

Metrics, Monitoring,
Logs, and Profiling

• Gain system-wide visibility into resource utilization,
application performance, and operational health
• Collect and track metrics with CloudWatch Metrics
• Collect and monitor log files with CloudWatch Logs
• Set alarms and send messages to SNS
• Automatically react changes via CloudWatch Events
Amazon CloudWatch

Lambda
• Default (free) metrics:
• Invocations
• Duration
• Throttles
• Errors
• Iterator Age
• Create custom metrics from inside
your application using “put-metric”
API call.
CloudWatch Metrics
API Gateway
• Default (free) metrics at Stage
level:
• Count
• 4XXError
• 5XXError
• Latency
• IntegrationLatency
• CacheHitcount
• CacheMissCount
• Detailed metrics
• Same set of metrics at method
level
• Can be enabled globally or only for
specific methods

CloudWatch Logs
• Lambda Logging
– Logging directly from your code
– Basic request information included
• API Gateway Logging
– 2 Levels of logging, ERROR and INFO
– Optionally log method request/body content
– Set globally in stage, or override per method
• Log Pivots
– Build metrics based on log filters
– Jump to logs that generated metrics

Custom
CloudWatch
Dashboards

• Identify performance bottlenecks and errors
• Pinpoint issues to specific service(s) in your
application
• Identify impact of issues on users of the
application
• Visualize the service call graph of your application
AWS X-Ray

Service map

Trace view

DEMO!

Putting it all together!
• Bundling and Deploying
• Continuous Integration & Continuous Delivery
• Versioning, Stages, Variables
• Metrics, Logs, Monitoring, and Performance Troubleshooting

Next steps
• See https://aws.amazon.com/serverless for reference architectures, samples,
and links to more content!
• Explore the AWS SAM specification on GitHub
• Visit the Lambda console, download a blueprint, and get started building your
own Serverless Applications
• Send us your questions, comments, and feedback on the AWS Lambda
Forums.

Workshop Overview

Scenario: Wild Rydes (www.wildrydes.com)

Help Wild Rydes Disrupt Transportation!
So how does this magic work?

Wild Rydes is Backed by Leading Investors
THE BARN
ACCELERATOR
TENDERLOIN
CAPITAL
PENGLAI COMMUNICATIONS
AND POST NEW CENTURY
TECHNOLOGY CORP LIMITED

Your Task: Build the Wild Rydes Backend APIs
Welcome to Wild Rydes
Inc., Employee #3!

Scenario: Wild Rydes
The Wild Rydes Serverless DevOps Workshop introduces the basics of building
backend APIs using serverless infrastructure.
All CRUD Operations as API Calls

DevOps

Introducing SAM
New resource types AWS::Serverless::*
Automate Deployment with Cloudformation
Portable to any CI/ CD Environment

Flow
AWS
CodePipeline
AWS
CodeBuild
Amazon API
Gateway
AWS
Lambda
Amazon
DynamoDB
S3 Bucket
with codeCode
Build and Deploy Processes
Deployment and Provisioning
- API Methods and Resources
- Lambda Functions
- DynamoDB Tables
AWS X-Ray
Tracing and Debugging

Module 1: Serverless Application Model
OBJECTIVE: In this module you'll use the Serverless Application Model (SAM) to define
a serverless RESTful API that has functionality to list, create, view, update, and delete
the unicorns in the Wild Rydes stable.

Module 2: Continuous Delivery Pipeline
OBJECTIVE: In this module, you'll use AWS CodePipeline, AWS CodeBuild, and Amazon S3
to build a Continuous Delivery pipeline to automate a code deployment workflow for the
Unicorn API.

Module 3: AWS X-Ray Integration
OBJECTIVE: In this module, you'll use AWS X-Ray to analyze and debug the Unicorn API
after a code change is deployed through the AWS CodePipeline that you built in Module 2:
Continuous Delivery Pipeline.
• Lambda service (AWS::Lambda)
• Lambda function (AWS::Lambda::Function)
• Downstream service calls

Module 4: Multiple Environment CI/CD Pipeline
OBJECTIVE: In this module, you'll enhance the AWS CodePipeline that you built in
Module 2 to add integration tests, and a Beta environment in which to test them.

Lab Documentation here -
• https://github.com/awslabs/aws-serverless-workshops

Clean up

Activity 6: Clean up
1. Make sure you delete the
1. S3 bucket
2. IAM Roles
3. Code Pipeline and Code Build
4. Lambda Functions
5. API Gateway

Thank
you!

AWS Serverless Application Development Deep Dive

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Semelhante a AWS Serverless Application Development Deep Dive

Semelhante a AWS Serverless Application Development Deep Dive (20)

Mais de Amazon Web Services

Mais de Amazon Web Services (20)

AWS Serverless Application Development Deep Dive