HK-AWS-Quick-Start-Workshop

6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. • key-value access • complex queries • transactions • analytics Traditional Database Architecture App/Web Tier Client Tier RDBMS

7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Data categories and common use cases Relational Key-value Document In-memory Graph Referential integrity, ACID transactions, schema- on-write Low-latency, key lookups with high throughput and fast ingestion of data Indexing and storing documents with support for query on any attribute Microseconds latency, key-based queries, and specialized data structures Creating and navigating data relations easily and quickly Lift and shift, EMR, CRM, finance Real-time bidding, shopping cart, social Content management, personalization, mobile Leaderboards, real-time analytics, caching Fraud detection, social networking, recommendation engine Search Indexing and searching semi- structured logs and data Product catalog, help and FAQs, full text Time-series Ledger Collect, store, and process data sequenced by time IoT applications, event tracking Complete, immutable, and verifiable history of all changes to application data Systems of record, supply chain, health care, registrations, financial

9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Microservices at Amazon Service-Oriented Architecture (SOA) Single-purpose Connect only through APIs Connect over HTTPS “Microservices”

11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Microservices… Eliminates any long-term commitment to a technology stack Polyglot ecosystem Polyglot persistence • Decompose Databases • Database per microservice pattern Allows easy use of Canary and Blue-Green deployments

13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Redshift Data warehousing EMR Hadoop + Spark Athena Interactive analytics Kinesis Data Analytics Real time Elasticsearch Service Operational Analytics RDS MySQL, PostgreSQL, MariaDB, Oracle, SQL Server Aurora MySQL, PostgreSQL QuickSight SageMaker DynamoDB Key value, Document ElastiCache Redis, Memcached Neptune Graph Timestream Time Series QLDB Ledger Database S3/Glacier Glue ETL & Data Catalog Lake Formation Data Lakes Database Migration Service | Snowball | Snowmobile | Kinesis Data Firehose | Kinesis Data Streams Data Movement Analytics Databases Business Intelligence & Machine Learning Data Lake Managed Blockchain Blockchain Templates Blockchain RDS on VMware DocumentDB Document Our portfolio Broad and deep portfolio, purpose-built for builders

14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS: Purpose-built databases Relational Key-value Document In-memory Graph Search Amazon DynamoDB Amazon Neptune Amazon RDS Aurora CommercialCommunity Amazon ElastiCache Amazon Elasticsearch Service Amazon DocumentDB Time-series Ledger Amazon Timestream Amazon Quantum Ledger Database

16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon RDS Managed relational database service with a choice of popular database engines Easy to administer No need to provision infrastructure, install, and maintain DB software Highly scalable Scale DB compute and storage with a few clicks; minimal downtime for your application Available & durable Automatic Multi-AZ data replication; automated backup, snapshots, and failover Fast & secure SSD storage and guaranteed provisioned I/O; data encryption at rest and in transit

17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Aurora MySQL and PostgreSQL compatible relational database built for the cloud Performance and availability of commercial-grade databases at 1/10th the cost Performance & scalability 5x throughput of standard MySQL and 3x of standard PostgreSQL; scale-out up to 15 read replicas Availability & durability Fault-tolerant, self-healing storage; six copies of data across three AZs; continuous backup to S3 Highly secure Network isolation, encryption at rest/transit Fully managed Managed by RDS: no hardware provisioning, software patching, setup, configuration, or backups

19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Aurora Serverless On-demand, auto-scaling database for applications with variable workloads Warm Capacity Pool Application Database Endpoint Scalable Database Capacity (Compute + Memory) Shared Distributed Storage Starts up on demand, shuts down when not in use Automatically scales with no instances to manage Pay per second for the database capacity you use

21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB We needed to adapt to power Amazon.com Needed to power Amazon.com Required massive scalability and reliability DynamoDB designed to meet this need

22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Many Applications Require Millisecond Latency at Any Scale Example: Amazon Prime Day 2017 Biggest shopping event in Amazon history Peaked at 12.9 million requests per second Thousands of Amazon teams using DynamoDB 3.34 trillion requests

23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DynamoDB Fully-managed nonrelational database for any scale High performance Fast, consistent performance Virtually unlimited throughput Virtually unlimited storage Secure Encryption at rest and transit Fine-grained access control PCI, HIPAA, FIPS140-2 eligible Fully managed Maintenance-free Serverless Auto scaling Backup and restore Global tables

24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. DynamoDB Global Tables Build high-performance, globally distributed applications Low latency reads and writes to locally available tables Multi-region redundancy and resiliency Easy to set up and no application rewrites required

25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon ElastiCache Fully-managed, Redis or Memcached compatible, low-latency, in-memory data store Fully managed AWS manages all hardware and software setup, configuration, monitoring Extreme performance In-memory data store and cache for sub-millisecond response times Easily scalable Read scaling with replicas Write and memory scaling with sharding Non-disruptive scaling

26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Graph Use Cases Social news feed Recommendations Retail fraud detection Friends Use Play Like Check in Like Connect Read Credit card Product Email address Credit card Known fraud Uses Paid with Uses Paid with Paid with Purchased Approve purchase? Sport Product Purchased Purchased People who also follow sports purchased… Purchased Knows Knows Do you know… Follows Follows Follows

27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Challenges Building Apps with Highly-Connected Data Existing graph databasesRelational databases Too expensiveDifficult to maintain high availability Difficult to scale Limited support for open standards Inefficient graph processing Unnatural for querying graph Rigid schema inflexible for changing graphs

28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Neptune Fully managed graph database Fast & scalable Store billions of relationships; query with millisecond latency Reliable Six replicas of your data across three AZs with full backup and restore Easy Build powerful queries easily with Gremlin and SPARQL Open Supports Apache TinkerPop and W3C RDF graph models Gremlin SPARQL

29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon DocumentDB Fast, scalable, and fully managed MongoDB-compatible database service Fast Scalable Fully managed MongoDB compatible Millions of requests per second with millisecond latency; twice the throughput of MongoDB Separation of compute and storage enables both layers to scale independently; scale out to 15 read replicas in minutes Managed by AWS: no hardware provisioning; auto patching, quick setup, secure, and automatic backups Compatible with MongoDB 3.6; use the same SDKs, tools, and applications with Amazon DocumentDB

31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS Database Migration Service Migrating Databases to AWS 100,000+ Databases migrated Migrate between on-premises and AWS Migrate between databases Data replication for zero-downtime migration Automated schema conversion

34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Considerations when moving file data 1. Why are you moving data storage to AWS? 2. What is the data you’re moving? 3. Where is the data going – to which service/for what application & use case? 4. When do you need the data off your array/out of the DC/in AWS? 5. How much data? How much usable network capacity?

37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Cost – hidden expenses • Capex – high up-front capital investment • Guesswork on how much storage you will need • Guesswork on types of drives, mix of SSD/HDD • Expensive add-on software for tiering, snapshotting, HA, DR • Warranty renewals, EOL, migrations Why move? The pain of managing on-premises storage

38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Complexity • Specialized expertise • Availability – need a second array and datacenter for HA • Backup – dedicated backup arrays plus offsite copy • Scalability – difficult to scale: time/cost to order more drives, upgrade controllers, EOL of array – all additional hidden costs Why move? The pain of managing on-premises storage

40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. What? File data Also referred to as unstructured data Productivity Apps Development Data Media Files Digital Security Sensor Data Oceanographic Weather Traffic Machine Generated Satellite images Weather data Seismic imagery Atmospheric data

42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where? Storage portfolio breadth and depth Amazon FSx for Windows Amazon FSx for Lustre Amazon EFS Amazon EBS AWS DataSync AWS Transfer for SFTP AWS Snow* Family Amazon Glacier Amazon S3 AWS Backup AWS Storage Gateway Family

43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where? Amazon Elastic File System (EFS) Storage for Linux-based applications Key Workloads: Enterprise applications, web serving, content management, in-cloud database backups, container storage, test and development, media workflows Linux NFSv4.x Local file system File server NAS filer Clustered or Scale-out file system Direct Connect VPN Multi-VPC Multi-account What OS and Protocol is being used? Where is the data coming from? How can the migrated data be accessed?

44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where? Amazon FSx for Windows File Server Storage for Windows-based business applications Key Workloads: Home directories, .NET applications, content management, software development environments, media workflows Windows Server 2008, 2012, 2016 Windows 7, 8, 10 SMB 2.0 SMB 3.x Local Windows file system Windows file server NAS filer Direct Connect VPN Single-AZ Multi-AZ via DFS-R What OS and Protocol is being used? Where is the data coming from? How will the migrated data be accessed?

45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where? AWS Storage Gateway Hybrid cloud service enabling on-premises apps to seamlessly use AWS storage Standard storage protocols Fully managed cache Optimized data transfer AWS integrated

46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where? Hybrid file storage: File Gateway and Volume Gateway File Gateway Volume Gateway + File Server Store and access objects in Amazon S3 Block storage and file systems on-premises

47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Where? Hybrid storage w/ Amazon S3 & File Gateway Store files as objects in S3 and access via standard file protocols Key Workloads: File backup, hybrid workflows, active archive, content distribution Windows Linux NFSv3, NFSv4.1 SMB2, SMB3 Local file system File server NAS filer On-premises Remote location or branch office In AWS What OS and Protocol is being used? Where is the data coming from? How will the migrated data be accessed?

48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How? Options for Data Transfer AWS Direct Connect Amazon Kinesis Firehose AWS Snowball AWS Snowmobile AWS Storage Gateway Amazon S3 Transfer Acceleration AWS DataSync AWS Transfer for SFTP AWS Snowball Edge Storage Optimized Amazon Kinesis Data Streams Amazon Kinesis Video Streams NEW! AWS Snowball Edge Compute Optimized NEW! NEW!

49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How? Options for File Data Transfer AWS Storage Gateway AWS DataSync AWS Transfer for SFTP NEW!NEW! AWS Direct Connect AWS Snowball AWS Snowball Edge Storage Optimized AWS Snowball Edge Compute Optimized NEW!

50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How? AWS DataSync AWS Online transfer service that simplifies, automates, and accelerates moving data between on-premises storage and AWS Combines the speed and reliability of network acceleration software with the cost-effectiveness of open source tools Fast data transfer Easy to use Secure and reliable Cloud integrated Cost-effective

51. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How? AWS Transfer for SFTP Fully-managed service enabling transfer of data over SFTP, and stored in Amazon S3 Fully managed in AWS Native integration with AWS services Cost-effective Seamless migration of existing workflows Simple to use Enterprise ready

52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Summary • On-premises storage continues to grow • AWS storage portfolio is growing • The customer may think of storage as • DAS, NAS, SAN • Backup/DR, Home directories, Enterprise Apps • Application-specific data • There are many enterprise file-based workloads that can be migrated today • For Linux-based applications, use EFS • For Windows-based business applications, use FSx for Windows File Server • To store data in S3 and access via standard file protocols, use File Gateway

HK-AWS-Quick-Start-Workshop

Esté a ler uma amostra.

Confira estes a seguir

HK-AWS-Quick-Start-Workshop

Mais Conteúdo rRelacionado

Diapositivos para si (20)

Semelhante a HK-AWS-Quick-Start-Workshop (20)

Mais de Amazon Web Services (20)