This session covers the features and enhancements in our Redis-compatible service, Amazon ElastiCache for Redis. We cover key features, such as Redis 5, scalability and performance improvements, security and compliance, and much more. We also discuss upcoming features and customer case studies.

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Reliable & Scalable Redis in the
Cloud with Amazon ElastiCache
Andi Gutmans
GM, Amazon ElastiCache, Amazon Elasticsearch Service, Amazon Neptune
AWS
D A T 2 0 2

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Modern apps create new requirements
Users: 1 million+
Data volume: TB–PB–EB
Locality: Global
Performance: Milliseconds–microseconds
Request rate: Millions
Access: Mobile, IoT, devices
Scale: Up-out-in
Economics: Pay as you go
Developer access: Instant API access

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Data categories and common use cases
Relational
Referential
integrity, ACID
transactions,
schema-
on-write
Lift and shift,
CRM, finance
Key-value
Low-latency,
key lookups
with high
throughput and
fast ingestion
of data
Real-time bidding,
shopping cart,
social, product
catalog, customer
preferences
Document
Indexing and
storing
documents
with support
for query on
any attribute
Content
management,
personalization,
mobile
In-memory
Microseconds
latency, key-
based queries,
and data
structures
Leaderboards,
real-time analytics,
caching
Graph
Creating and
navigating
relationships
between data
easily and
quickly
Fraud detection,
social networking,
recommendation
engine

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Real-time apps need low latency and high concurrency
Users: 1 million+
Data volume: TB
Locality: Global
Performance: Microseconds
Request rate: Millions
Access: Mobile, IoT, devices
Scale: Up-out-in
Economics: Pay as you go
Developer access: Open Redis APISocial mediaRide hailing Media streaming Social mediaRide hailing Media streaming Gaming

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Redis—#1 in-memory data store*
* https://db-engines.com/en/ranking

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
About Redis
Fast
<1ms latency for
most commands
Open source
Simple
Highly available
Replication
Atomic operations
Supports transactions
In-memory
key-value store
Powerful
~200 commands, Lua scripting,
Geospatial, Pub/Sub
Various data structures
Strings, lists, hashes, sets, sorted sets,
streams, bitmaps, streams
and HyperLogLogs
Backup/Restore
Enables snapshotting

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use cases
Gaming
leaderboards
Chat apps
Caching
Session
store
Machine
learning
Real-time
analytics
Media
streaming
Message
queues
Geospatial

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Redis 5—released October 17
REDIS STREAMS!
Log data structure for streaming use-cases
OTHER ENHANCEMENTS
Optimized HyperLogLog algorithm
Memory management improvements
Sorted sets now support linked list-like pop and block operations
Many bug fixes, performance improvements and enhancements
More at https://aws.amazon.com/redis/Whats_New_Redis5/

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Redis Streams
Timestamp
oriented append-
only log
Collect volumes of
data arriving
at high velocity
Message queues,
website activity
tracking,
event streams

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Redis Streams
NEW DATA TYPE
Indexed by timestamp, multiple fields
per entry
IMPLEMENTED WITH RAX
A Radix library tree optimized for fast
lookups and range queries
CONSUMER GROUPS
Consumer groups allow multiple
consumers to participate in processing
messages by each consuming a unique
subset of the data
START
END
CONSUMER 1
CONSUMER 2
CONSUMER A
CONSUMER B

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
1) 1) "1542737709872-0"
2) 1) "msg"
2) ”Hello!"
Hello!
"154273770872-0"
Redis Streams
Producer
XADD mystream * msg
Stream
XRANGE mystream - +
Consumer
Generate a unique ID =
“time–sequence #”
Append only data structure with
ability to fan out
Add messages to a
stream
Single Consumer
Listen to items : XREAD
Query by range: XRANGE, XREVRANGE
Items in the stream: XLEN
at least once messaging
Redis generated
unique ID
Consumer Groups (XG R O U P , X R E A D G R O U P )
Allow multiple consumers to participate in processing
messages by each consuming a unique subset of the data

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ENDSTART
CONSUMER 92389CONSUMER 203242CONSUMER 37463
Example: Simple Chat Application

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ENDSTART
CONSUMER 92389
CONSUMER 203242
CONSUMER 37463
Example: Simple Chat Application

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
More on Redis Streams—
https://aws.amazon.com/redis/

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Difficult
to scale
Difficult
to manage
Hard to make
highly available
Self-managing Redis is challenging
Expensive
Online scaling can be
error prone, replication
performance needs to
be monitored
Manage hardware provisioning,
software patching, setup,
configuration, and backups
Invest in people,
processes, hardware,
and software
Need to implement fast
error detection and
remediation

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Introducing Amazon ElastiCache for Redis
Fully-managed, Redis compatible, in-memory data store in the cloud
Extreme performance
In-memory data store and cache for
sub-millisecond response times
Fully managed
AWS manages all hardware and software
setup, configuration, monitoring
Easily scalable
Read scaling with replicas
Write and memory scaling with sharding
Non-disruptive scaling
Redis compatible
Redis 5 Support
Redis clients compatible
Reliable
Multi-AZ
Deep monitoring
Automatic failover
Secure and compliant
Amazon VPC
HIPAA, PCI, FedRAMP
Encryption at-rest and in-transit
Authentication

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
ElastiCache for Redis customers
GE’s Predix Platform uses
ElastiCache for Redis to
help developers build
container-based stateless
applications on AWS.
ElastiCache is used to
manage session state for
these applications.
Grab, the leading ride
hailing service in Southeast
Asia, uses ElastiCache for
Redis as a caching layer
for real-time data
computation for 4 million
daily bookings. Grab
estimates savings of 30-
40% on manpower
with AWS.
Expedia’s real-time
analytics application uses
ElastiCache for Redis as a
caching layer to increase
throughput, reduce
latency, and reduce cost.
ElastiCache powers A/B
testing on Expedia website
with ~200M messages
daily.
Peloton’s leaderboard requires
elasticity, low latency, and
real-time processing to deliver
customizable rider data for the
community of users riding
together virtually from the
comfort of their homes.
Peloton relies on Amazon
ElastiCache for Redis to power
its on-demand, live
leaderboard.

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
SOFTWARE & INTERNET FINANCIAL SERVICESRIDE -HAILING GAMING
MEDIA AND ENTERTAINMENT SOCIAL MEDIA TELECOMMUNICATIONS TRAVEL
INDUSTRIALS & SERVICES LOGISTICS & OPERATIONS PUBLISHING OTHER
Amazon ElastiCache customers

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Online Redis cluster
resharding
Encryption at rest
Encryption in-transit
R4
instances
Redis 3.2.6
Redis 3.2.10
HIPAA
eligible
What’s new—re:Invent 2017

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
What’s new—2018
CPU utilization metric, T2
snapshot and auto-failover
Open-sourced encryption
in-transit
PCI and FedRAMP compliance
In-place Redis cluster
version upgrades
Optimized M5 and R5
instances
Redis 5 Redis cluster scalability—
250 nodes, 250 shards,
read replica scaling

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Optimized M5 and R5 instances
Scale up to 170 TB of
in-memory capacity
AWS Nitro System,
dedicated hardware and
lightweight hypervisor,
delivers performance
indistinguishable from
bare-metal
Custom Intel Xeon
Scalable processors up
to 3.1 GHz and AVX-5120
50000
100000
150000
200000
250000
300000
Large X Large 2X Large 4X Large 8X Large/12X
Large
16X Large/24X
Large
R4 vs. Vanilla R5 vs. ElastiCache R5 Instances
(requests/second)
Vanilla R4 Vanilla R5 Tuned R5

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Challenge: Large surge event for a
new feature launch on Fornite
required scaling Redis clusters
Solution: ElastiCache for Redis with
online cluster resizing to dynamically
scale out and scale in. Migrated to
optimized R5 instances for higher
throughput, superior performance,
and managing traffic spikes
Epic Games: ElastiCache to manage surge events

28. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Coming soon….
PERFORMANCE BOOST FOR MULTI-CORE NODES
Further optimizations providing significant throughput boost
RENAME COMMAND SUPPORT
Ability to rename a command
SELF-SERVICE PATCHING
Provides increased flexibility to control when updates occur

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Related sessions
Tuesday, Nov 27
DAT302—ElastiCache Deep Dive: Design Patterns for In-Memory Data Stores
3:15 PM – 4:15 PM | Mirage, Mirage Event Center B
Friday, Nov 30
DAT309—Hands-On with Amazon ElastiCache for Redis—Workshop
8:30 AM – 10:45 AM | Mirage, Mirage Event Center C3
Wednesday, Nov 28
DAT353—Building a Messaging Application with Redis Streams
1:00 PM – 2:00 PM | MGM, Level 3, South Concourse 302

30. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Andi Gutmans
gutmans@amazon.com

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.