Amazon announced several new services and updates at re:Invent 2013 including Kinesis for real-time streaming data processing at massive scale, RDS for PostgreSQL, high-performance C3 EC2 instances, WorkSpaces for desktop computing in the cloud, AppStream for streaming applications, CloudTrail for AWS API logs, IAM updates with SAML 2.0 support, new features for Redshift data warehousing, a new EMR console, and more checks for Trusted Advisor.
2. Agenda
•
•
•
•
•
•
•
•
•
•
Kinesis – Collect, Process and Integrate
RDS PostrgreSQL
C3 EC2 Instance Family
WorkSpaces – Desktop Computing in the Cloud
AppStream – Stream Your Apps
CloudTrail – AWS API Log Services
IAM – STS Federation support for SAML2.0
Redshift – New Features
EMR – New App Console
Amazon Trusted Advisor – New Features
3. Amazon Kinesis – Collect, Process & Integrate
Amazon Kinesis (http://aws.amazon.com/kinesis/) is a fully managed service for
real-time processing of streaming data at massive scale.
– Collect and process hundreds of terabytes of data per hour from hundreds
of thousands of sources
– Easily write applications that process information in real-time
•
•
•
•
•
•
web site click-streams
marketing and financial information
manufacturing instrumentation and social media
operational logs, metering data and real-time operational decisions
Real-time dashboards and make business decisions
Capture exceptions and generate alerts
– Integrates with variety of other services such as Amazon Simple Storage
Service (Amazon S3), Amazon DynamoDB, or Amazon Redshift.
4. Amazon Kinesis – Collect, Process & Integrate
Amazon Kinesis (http://aws.amazon.com/kinesis/) is a fully managed service for
real-time processing of streaming data at massive scale.
http://www.youtube.com/watch?v=MbEfiX4sMXc
Limited preview in the US-EAST region
5. Amazon RDS for PostgreSQL
Amazon RDS PostgreSQL (http://aws.amazon.com/rds/postgresql/) makes it easy to set
up, operate, and scalable deployments in the cloud.
– Scalable PostgreSQL deployments in minutes with cost-efficient and
resizable hardware capacity.
– In the AWS Management Console, you can deploy a PostgreSQL database
with automatically configured database parameters for optimal
performance.
– RDS for PostgreSQL database instances can be provisioned with either
standard storage or Provisioned IOPS storage. Once provisioned, you can
scale from 10GB to 3TB of storage and from 1,000 IOPS to 30,000 IOPS.
– Support Multi-AZ and Reserved Instances
– Pricing - http://aws.amazon.com/rds/postgresql/#pricing
Beta but GA in all regions
6. Amazon EC2 C3 instance family
EC2 C3 instances are designed to deliver high performance at an
economical price.
– Comparing to C1 instances :: compute-intensive workloads
•
•
•
•
faster processors (2.8GHz Intel Xeon E5-2680v2 Ivy Bridge)
approximately double the memory per vCPU
SSD based instance storage
Pricing - http://aws.amazon.com/ec2/pricing/
Instance
Name
vCPU
ECU
RAM (GiB)
Local Storage
Price (Tokyo / Linux)
c3.large
2
7
3.75
2x16GB SSD
$0.192 per hour
c3.xlarge
4
14
7
2x40GB SSD
$0.383 per hour
c3.2xlarge
8
28
15
2x80GB SSD
$0.766 per hour
c3.4xlarge
16
55
30
2x160GB SSD
$1.532 per hour
c3.8xlarge
32
108
60
2x320GB SSD
$3.064 per hour
C3 instances are initially available in in the US East (N. Virginia), US West (Oregon), EU (Ireland), Asia Pacific (Singapore), Asia Pacific (Tokyo), and Asia Pacific (Sydney) regions.
Prices are as of November 25 ‘ 2013
7. Amazon WorkSpaces – Desktop Computing in the Cloud
Amazon WorkSpaces (http://aws.amazon.com/workspaces/) is a fully managed
desktop computing service in the cloud competitive with traditional
desktops.
– Easy to provision & No up-front fee investment
– WorkSpaces can be accessed via laptops, iPad, Kindle Fire, or Android
tablets.
– Low cost. Highly competitive with traditional desktops and half the cost of
most virtual desktop infrastructure (VDI) solutions.
– Integrates with customers’ corporate Active Domain domains
http://www.youtube.com/watch?v=jsqI7KU3S8I
8. Amazon WorkSpaces – Desktop Computing in the Cloud
Amazon WorkSpaces is a fully managed desktop computing service in
the cloud competitive with traditional desktops.
Limited preview
9. Amazon AppStream
Amazon AppStream (http://aws.amazon.com/appstream/) is a flexible, low-latency
service that lets you stream resource intensive applications and games
from the cloud.
– Deploys and renders your application on AWS infrastructure and streams
the output (instant-on without downloading or installing files) to massmarket devices, such as personal computers, tablets, and mobile phones
– Highly scalable for both computational and storage needs
– No device constraints and support multi-platform with enhanced security
– Use cases: Sports, picture in picture, games, demo/trial applications, CAD
and 3D software, movie production, and more
– No up-front cost and pay for what you use
• During the limited preview, AppStream is free (for up to 10 concurrent streams).
After the preview, first 20 hours is free but $0.83 /hr for 20 hours or more.
10. Amazon AppStream – Stream Your Apps
Amazon AppStream (http://aws.amazon.com/appstream/) is a flexible, low-latency
service that lets you stream resource intensive applications and games
from the cloud.
http://www.youtube.com/watch?v=Dx1d_9E2Zck
Limited preview. US-E(N.Virginia) only for now.
11. Amazon CloudTrail – AWS API Logs Services
AWS CloudTrail (http://aws.amazon.com/cloudtrail/) is a web service that records AWS
API calls for your account and delivers log files to you.
– Log files include the identity of the API caller, time, source IP address, the
request parameters, and the response elements returned by the AWS service.
– Provides a history of AWS API activity across your account, including API
calls made via the AWS Management Console, SDKs, CLI, and higher-level
AWS services (such as AWS CloudFormation).
– CloudTrail uses S3 to store logs and SNS (Simple Notification Services) for
notifications
– Use cases: security analysis, resource change tracking, and compliance
auditing.
– Provided at no extra cost. Users are only charged for the S3 bucket storage
usage for log files.
Beta and available in US-E & US-W
12. AWS IAM Updates - STS Federation support for SAML 2.0
Identify federation now supports SAML 2.0, an open industry standard,
to enable federated SSO, empowering users to sign into AWS
management console or make programmatic calls to AWS APIs, by
using assertions from a SAML-compliant identity provider (IdP).
- New IAM features
•
•
•
•
Web Identity federation (Facebook, Google, Amazon)
SAML (Security Assertion Markup Language) 2.0 Support
Single sign on to the AWS management console
Identity federation
13. Amazon Redshift – Petabyte-scale Data warehouse service
Amazon Redshift (http://aws.amazon.com/redshift/) is a fully managed, fast,
petabyte-scale data warehouse service to analyze all your data using
existing business intelligence tools.
– New features (Nov. 2013)
•
•
•
•
•
•
•
•
Distributed Tables – More controls over distribution of a table’s row.
Remote Loading – Load data into Redshift from remote hosts across an SSH.
Approximate Count Distinct – Variant of the COUNT function
Workload Queue Memory Management
Key Rotation
HSM Support
Database Auditing and Logging – Stores to S3
SNS Notification