SlideShare uma empresa Scribd logo
1 de 42
NETFLIX MOVING TO
 AMAZON CLOUD




Hien Luu
Agenda

    Why Amazon Cloud?

    Tour of AWS

    How Netflix leverages AWS?

    Best Practices
Why Amazon Cloud?




       Focus On Core Competence
Why Amazon Cloud?

         High Growth

       High Scalability

       High Availability

           Elasticity
Why Amazon Cloud?


               AWS

    EC2, SDB, SQS, S3, EBS, EMR,
        ELB, ASG, RDB, (IAM)
Tour of AWS

Service       Service Name
Compute       Elastic Compute Cloud (EC2)
              Elastic Map/Reduce (EMR)
              Auto Scaling (ASG)
Database      Relation Database Services (RDS)

Messaging     Simple Queue Service (SQS)
              Simple Notification Service (SNS)
Monitoring    CloudWatch
Networking    Elastic Load Balancing (ELB)
Storage       SimpleDB (SDB)
              Simple Storage Service (S3)
              Elastic Block Storage (EBS)
Tour of AWS (EC2)
EC2 = Elastic Compute Cloud

       Computer
                                   EC2 Instance

   EC2 Instance                        AMI

                                   Application

   EC2 Instance                        OS


                              Memory           Storage
                                               (non-persistent)
• Elastic
• Management control
• Flexible (OS, etc..)          Multi-tenant
• Secure
Tour of AWS (EC2)

        EC2 Instance
                                      Elastic IP Address
          AMI                         • Static IP
       Application                    • Map to EC2 instance
                                      • Hourly charge (when not mapped)
              OS                      • Limited # of IP addresses per account



Instance id            i-79f90613
Private DNS/IP         ip-10-202-26-32.ec2.internal/
(transient)            10.202.26.32
Public DNS/IP          ec2-184-73-69-47.compute-1.amazonaws.com/
(transient)            184.73.69.47
Tour of AWS (EC2)
                       Computing   Memory   Storage
          Type                                         Platform     I/O         Name
                         Unit        (GB)     (GB)

Small                      1         1.7      160        32       Moderate     m1.small

Large                      4         7.5      850        64         High       m1.large

X-Large                    8         15      1690        64         High      m1.xlarge

High-CPU Medium            5         1.7      350        32       Moderate    c1.medium

High-CPU X-Large          20          7      1690        64         High       c1.xlarge

High-Memory X-Large       6.5        17.1     420        64       Moderate    m2.xlarge

High-Memory 2X-Large      13         34.2     850        64         High      m2.2xlarge

High-Memory 4X-Large      26         68.4    1690        64         High      m2.4xlarge

Cluster Compute                                                   Very High
                         33.5        23      1690        64                   cc1.4xlarge
                                                                  (10 Gbps)

                                $0.085/hr - $2.40/hr
Tour of AWS (EC2)
    How to launch an EC2 instance?
       Amazon  provides scripts or AWS console
       RightScale

    AMIs are stored in S3 or EBS
       Use   an existing AMI from AMZ
Tour of AWS (EC2)
                               High Availability




                                                                  Region
                                                   US-East (Northern Virginia)
                                                   US-West (Northern California)
                                                   EU (Ireland)
Netflix: us-east-1c & us-east-1d                   Asia Pacific (Singapore)
Tour of AWS – Security Group


          app1                                    app3

       EC2 Instance                            EC2 Instance
         EC2 Instance                           EC2 Instance




                           app2

                        EC2 Instance
                          EC2 Instance




        Access rule: protocol | from port | to port
Tour of AWS - ELB

              Client1                     Client2                   Client3




                                    ELB (DNS name, port)                         Health check
HTTP/HTTPS                                                                       URL, interval




    EC2 Instance     EC2 Instance                          EC2 Instance       EC2 Instance


        Availability Zone                                      Availability Zone
                                          us-east
Tour of AWS – Auto Scaling


                                                      EC2 Instance
  Application demand




                                              EC2 Instance     EC2 Instance

                                              EC2 Instance     EC2 Instance


                                     EC2 Instance     EC2 Instance     EC2 Instance

                                      EC2 Instance    EC2 Instance     EC2 Instance

                              EC2 Instance     EC2 Instance     EC2 Instance    EC2 Instance

                               EC2 Instance    EC2 Instance     EC2 Instance    EC2 Instance



                                                              Time


                       Launch or terminate EC2 instances based on user-defined triggers
Tour of AWS – Auto Scaling

    Auto Scaling
    Configuration                         Launch Configuration

                                                                   AMI
 LaunchConfigName                                                Application
                                          AMI id
 Min                                      Security group
 Max                                                                OS
                                          Instance type
 Load balancer                            User data
 Availability zone
 Triggers




                     •  Health
                     •  CPU Utilization
                     •  Latency
                     •  I/O activity
Tour of AWS – Cloud Watch

               Visibility into resource utilization, operational performance


                                                                          CPU

                                                                        Network

 EC2 Instance       EC2 Instance
                                                                        Disk I/O
EC2 Instance      EC2 Instance
                                                                          EBS

                                                                     Load Balancer


                    AWS Management Console                                RDS
Tour of AWS - EBS
    Persistent storage for EC2 instances
       100   volumes or 20 TB – Max 1TB per volume
  Off-instance persistent storage
  Attach and detach to/from

       EC2   instance
    Why do we need this?
       Persistent   file systems
    Take backups and store in S3

      Public data sets: Human Genone, US Census Data
Tour of AWS – S3
     Data storage infrastructure – for the Internet
     Write, read, delete objects up to 5 GB

     Scalable, reliable, unlimited storage

     Objects can be made publicly accessible

                                                   Per Account


                                                                           ..100




99.999999999% durability and 99.99% availability   $0.055/GB -> $0.15/GB
Tour of AWS – S3
    Interesting APIs
       Can I search objects in a bucket? NO
       Can I get a list of objects in a bucket? NO

       Can I remove a bucket?
         Remove    all objects first
       Can   I get list of keys? YES
         Also   by prefix
Tour of AWS - SimpleDB
    For structured, non-relational text data
    Highly available
    Zero administrative overhead
    Auto indexing
         Domain


              itemId          Email                    Pets

primary key                                                             Item
              jdoe            jdoe@yahoo.com            dog

              mjane           mjane@gmail.com          cat, bird


               Domains are collections of items that are described by
                               attribute-value pairs
Tour of AWS - SimpleDB
                                  No Schema

itemId          Email                Pet

jdoe            jdoe@yahoo.com        dog

mjane           mjane@gmail.com      cat, bird




         itemId          Email                   Pet         Phone

         jdoe            jdoe@yahoo.com          dog

         mjane           mjane@gmail.com         cat, bird   333-444-5555
Tour of AWS - SimpleDB
                               256 Attributes                   1024 Bytes
10 GB



              itemId        Email               Pet

              jdoe          jdoe@yahoo.com      dog

              mjane         mjane@gmail.com     cat, bird


                                                                1024 Bytes


   select <attributes> from <domain> where <query expression>

        Default to 100 items per select, maximum up to 2500 items
Tour of AWS - SimpleDB
                                                   SimpleDB
 Read Consistency
                                                    Node 1
                                         itemId     Email              Pet

                                         jdoe       jdoe@yahoo.com     dog     cat
                                         mjane      mjane@gmail.com    cat, bird




                                                    Node 2
                                         itemId     Email              Pet

                                         jdoe       jdoe@yahoo.com     dog     cat
                                         mjane      mjane@gmail.com    cat, bird




               Select, G
                        etAttribu
                                    te                Node 3
                                          itemId     Email               Pet

                                          jdoe       jdoe@yahoo.com      dog    cat
                                          mjane      mjane@gmail.com     cat, bird
Tour of AWS - SimpleDB

                                    CAP THEOREM

                                                                  Tolerant of node
                                                                       failures
                                             A
                                          Availability


                                     CA              AP
All nodes see the
                                                                              Tolerant of
    same data                     BigTable         SimpleDB
                                                                             message loss


                       C
                                              CP
                                          Hbase
                                                                 P
                                                               Partition
                    Consistency           Membase             Tolerance


                           Shared-data Distributed System
Tour of AWS - SimpleDB

    Eventual Consistent Read                     Consistent Read
Stale reads possible                   No stale reads
Lowest latency                         Higher latency (500 to 1000ms)
Highest throughput                     Lower throughput (1/3)




Conditional Put & Delete
Optimistic concurrency control
Eliminate lost updates due to concurrent writing to same item
Comparing an attribute with specified expected value
Transactional semantics
Tour of AWS - SQS
      Web-scale Message Infrastructure

           • Up to 64KB size
           • Retain up to 14 days
           • Message visibility -12 hours
     m6
                                            m1


                  m2       m5      m4



           • Concurrent writers & readers   m3
           • No FIFO
           • Delivery “at least once”
     m7
Tour of AWS - SNS
          Notification Infrastructure

                                                      m1
                                 HTTP/HTTPS
     m5


                       Topic                          m1




                                                           SQS
                 m4      m3     m2

                                                      m1
            • 100 topics per account
            • Message max size 8K text
            data
     m6                                       Email
Tour of AWS - Security
                                           AWS
Account: Access key & Secret key
                                            EC2


                             HTTP/HTTPS   SimpleDB

                                            S3


                                            SQS

                                            SNS

                     Authentication via
                     HMAC signature          ..
Netflix In AWS Cloud


                Encoding




  Use ~4K EC2   Petabytes on
    Instances        S3        CDN
Netflix In AWS Cloud

                                                                Netflix Data Center



Discovery                                 API ELB
 Discovery
 Service
   Service
                                                                      Oracle
                  Internal
                    Internal               API
                  Service                    API
                    Service


memcached                                           memcached          SQS
                                                                     Consumer



             S3                                     SQS
                               SimpleDB
Netflix In AWS Cloud


                   Security Group


  Auto Scaling
                       Internal
     Group               Internal
                       Services
                           Internal
                         Services
                             Internal
                           Services
                             Service
Netflix In AWS Cloud
    SimpleDB
       Rental
             history: ~800M items
       Queue: ~1B items

    S3
       Compressed  rental history: ~17M objects
       Streaming activity logs




          Access through customer id or movie id or both
Netflix In AWS Cloud
    Missing infrastructure services
       Discovery service
       Middle tier load balancer

       Encryption service
         Key   management
       Caching
         Wrap   memcached server
             Discoverable
             Instrumented
Netflix In AWS Cloud

                           Discovery
                            Discovery
                            Service
                              Service
                Middle
   Web           Tier
                Load
 Application
               Balancer
                                        Heart beat


                          Internal
                            Internal
                          Services
                              Internal
                            Services
                                Internal
                              Services
                                Service
Netflix In AWS Cloud

              Big Bang Transition

  iPhone   Launch
   Totallyrun in cloud and no fallback option
   No control once App Store gate is opened
   Have to scale on day one
  EC2   elasticity
Netflix In AWS Cloud
     Datacenter   vs   Cloud




                        Copy from Adrian’s slide
Best Practices
  Automate deployment process
  Dealing with failure

       Network latency
       503s, 408s, exponential backoff

       Read/connect timeout

    Persistence strategy
       Rethink   storage
         SimpleDB, S3, RDS
         Sharding
         Eventual consistency
Best Practices




                 Copy from Adrian’s slide
Best Practices
    SimpleDB
       Sorting    is lexicographical
          Pad numeric attributes
          Use consistent date format (Joda time)
       Explicit
               selecting limit
       Use batch put and batch delete
       Dealing with null
       Dealing with eventual consistency
          Consistentget
          Conditional put
       Item   name
          Combining    columns
          UUID
Best Practices
    SimpleDB
       Index      selectivity and performance
         #   of distinct attribute values in all the items in domain
       Sharding
         Get around the limits
         Scale the write throughput
                  BatchPutAttribute or BatchDeleteAttribute
Best Practices
    S3
       Achieving   high write throughput
         Pre-sortedthe keys before upload
         Preprend object key with increasing 4 to 6 digits

    SQS
       Decouple    system
       Asynchronous processing

       Buffering

       Visibility window > processing time
Q&A

Mais conteúdo relacionado

Mais procurados

Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram Chinta
 
Netflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsNetflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsAdrian Cockcroft
 
The art of infrastructure elasticity
The art of infrastructure elasticityThe art of infrastructure elasticity
The art of infrastructure elasticityHarish Ganesan
 
AWS Update | London - Overview of New Releases
AWS Update | London - Overview of New ReleasesAWS Update | London - Overview of New Releases
AWS Update | London - Overview of New ReleasesAmazon Web Services
 
Introduction to Container Management on AWS
Introduction to Container Management  on AWSIntroduction to Container Management  on AWS
Introduction to Container Management on AWSAmazon Web Services
 
AWS Webcast - Design for Availability
AWS Webcast - Design for AvailabilityAWS Webcast - Design for Availability
AWS Webcast - Design for AvailabilityAmazon Web Services
 
Building a CICD Pipeline for Containers - DevDay Austin 2017
Building a CICD Pipeline for Containers - DevDay Austin 2017Building a CICD Pipeline for Containers - DevDay Austin 2017
Building a CICD Pipeline for Containers - DevDay Austin 2017Amazon Web Services
 
Getting Started with Docker on AWS - DevDay Los Angeles 2017
Getting Started with Docker on AWS - DevDay Los Angeles 2017Getting Started with Docker on AWS - DevDay Los Angeles 2017
Getting Started with Docker on AWS - DevDay Los Angeles 2017Amazon Web Services
 
RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...
RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...
RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...Amazon Web Services
 
Prepare your IT Infrastructure for Thanksgiving
Prepare your IT Infrastructure for ThanksgivingPrepare your IT Infrastructure for Thanksgiving
Prepare your IT Infrastructure for ThanksgivingHarish Ganesan
 
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...Amazon Web Services
 
Intro to Batch Processing on AWS - DevDay Los Angeles 2017
Intro to Batch Processing on AWS - DevDay Los Angeles 2017Intro to Batch Processing on AWS - DevDay Los Angeles 2017
Intro to Batch Processing on AWS - DevDay Los Angeles 2017Amazon Web Services
 
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Adrian Cockcroft
 
(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline
(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline
(CMP405) Containerizing Video: The Next Gen Video Transcoding PipelineAmazon Web Services
 
CloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsCloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsDavid Pallmann
 
Intro to Batch Processing on AWS - DevDay Austin 2017
Intro to Batch Processing on AWS - DevDay Austin 2017Intro to Batch Processing on AWS - DevDay Austin 2017
Intro to Batch Processing on AWS - DevDay Austin 2017Amazon Web Services
 
Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...
Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...
Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...Amazon Web Services
 
Netflix keynote-adrian-qcon
Netflix keynote-adrian-qconNetflix keynote-adrian-qcon
Netflix keynote-adrian-qconYiwei Ma
 
AWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPSAWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPSAmazon Web Services
 

Mais procurados (20)

Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1Ram chinta hug-20120922-v1
Ram chinta hug-20120922-v1
 
Netflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsNetflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and Ops
 
The art of infrastructure elasticity
The art of infrastructure elasticityThe art of infrastructure elasticity
The art of infrastructure elasticity
 
AWS Update | London - Overview of New Releases
AWS Update | London - Overview of New ReleasesAWS Update | London - Overview of New Releases
AWS Update | London - Overview of New Releases
 
Introduction to Container Management on AWS
Introduction to Container Management  on AWSIntroduction to Container Management  on AWS
Introduction to Container Management on AWS
 
AWS Webcast - Design for Availability
AWS Webcast - Design for AvailabilityAWS Webcast - Design for Availability
AWS Webcast - Design for Availability
 
Building a CICD Pipeline for Containers - DevDay Austin 2017
Building a CICD Pipeline for Containers - DevDay Austin 2017Building a CICD Pipeline for Containers - DevDay Austin 2017
Building a CICD Pipeline for Containers - DevDay Austin 2017
 
Getting Started with Docker on AWS - DevDay Los Angeles 2017
Getting Started with Docker on AWS - DevDay Los Angeles 2017Getting Started with Docker on AWS - DevDay Los Angeles 2017
Getting Started with Docker on AWS - DevDay Los Angeles 2017
 
Netflix in the cloud 2011
Netflix in the cloud 2011Netflix in the cloud 2011
Netflix in the cloud 2011
 
RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...
RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...
RMG202 Rainmakers: How Netflix Operates Clouds for Maximum Freedom and Agilit...
 
Prepare your IT Infrastructure for Thanksgiving
Prepare your IT Infrastructure for ThanksgivingPrepare your IT Infrastructure for Thanksgiving
Prepare your IT Infrastructure for Thanksgiving
 
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...
(ENT209) Netflix Cloud Migration, DevOps and Distributed Systems | AWS re:Inv...
 
Intro to Batch Processing on AWS - DevDay Los Angeles 2017
Intro to Batch Processing on AWS - DevDay Los Angeles 2017Intro to Batch Processing on AWS - DevDay Los Angeles 2017
Intro to Batch Processing on AWS - DevDay Los Angeles 2017
 
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
Global Netflix - HPTS Workshop - Scaling Cassandra benchmark to over 1M write...
 
(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline
(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline
(CMP405) Containerizing Video: The Next Gen Video Transcoding Pipeline
 
CloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsCloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design Patterns
 
Intro to Batch Processing on AWS - DevDay Austin 2017
Intro to Batch Processing on AWS - DevDay Austin 2017Intro to Batch Processing on AWS - DevDay Austin 2017
Intro to Batch Processing on AWS - DevDay Austin 2017
 
Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...
Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...
Disaster Recovery Site on AWS - Minimal Cost Maximum Efficiency (STG305) | AW...
 
Netflix keynote-adrian-qcon
Netflix keynote-adrian-qconNetflix keynote-adrian-qcon
Netflix keynote-adrian-qcon
 
AWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPSAWS Update | London - Performance Update and Provisioned IOPS
AWS Update | London - Performance Update and Provisioned IOPS
 

Destaque

Big Data Story - From An Engineer's Perspective
Big Data Story - From An Engineer's PerspectiveBig Data Story - From An Engineer's Perspective
Big Data Story - From An Engineer's PerspectiveHien Luu
 
Architecting applications in the AWS cloud
Architecting applications in the AWS cloudArchitecting applications in the AWS cloud
Architecting applications in the AWS cloudCloud Genius
 
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAXThe Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAXAmazon Web Services
 
Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)
Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)
Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)Joe Sondow
 
So You Want to Be an AWS Partner?
So You Want to Be an AWS Partner? So You Want to Be an AWS Partner?
So You Want to Be an AWS Partner? Amazon Web Services
 
Netflix cloud architecture...continued
Netflix cloud architecture...continuedNetflix cloud architecture...continued
Netflix cloud architecture...continuedCloud Genius
 
AWS Webcast - What's New with Amazon Elastic Transcoder
AWS Webcast - What's New with Amazon Elastic TranscoderAWS Webcast - What's New with Amazon Elastic Transcoder
AWS Webcast - What's New with Amazon Elastic TranscoderAmazon Web Services
 
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...Amazon Web Services
 
Partnering with AWS: How to Build Your Business with AWS
Partnering with AWS: How to Build Your Business with AWSPartnering with AWS: How to Build Your Business with AWS
Partnering with AWS: How to Build Your Business with AWSAmazon Web Services
 
AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...
AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...
AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...Amazon Web Services
 
What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...
What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...
What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...Amazon Web Services
 
AWS Webcast - AWS Webinar Series for Education #1 - What is Cloud Computing
AWS Webcast - AWS Webinar Series for Education #1 - What is Cloud ComputingAWS Webcast - AWS Webinar Series for Education #1 - What is Cloud Computing
AWS Webcast - AWS Webinar Series for Education #1 - What is Cloud ComputingAmazon Web Services
 
Intro to AWS: Amazon EC2 and Compute Services
Intro to AWS: Amazon EC2 and Compute ServicesIntro to AWS: Amazon EC2 and Compute Services
Intro to AWS: Amazon EC2 and Compute ServicesAmazon Web Services
 
Scalable Media Workflows in the Cloud
Scalable Media Workflows in the CloudScalable Media Workflows in the Cloud
Scalable Media Workflows in the CloudAmazon Web Services
 
Aspera on demand for AWS (S3 inc) overview
Aspera on demand for AWS (S3 inc) overviewAspera on demand for AWS (S3 inc) overview
Aspera on demand for AWS (S3 inc) overviewBhavik Vyas
 
Netflix competitive landscape
Netflix competitive landscapeNetflix competitive landscape
Netflix competitive landscapedribayles
 
Aws for Start-ups - Introduction & AWS Overview
Aws for Start-ups  - Introduction & AWS OverviewAws for Start-ups  - Introduction & AWS Overview
Aws for Start-ups - Introduction & AWS OverviewAmazon Web Services
 
Getting Started with Amazon EC2 and AWS Compute Services
Getting Started with Amazon EC2 and AWS Compute ServicesGetting Started with Amazon EC2 and AWS Compute Services
Getting Started with Amazon EC2 and AWS Compute ServicesAmazon Web Services
 

Destaque (20)

Big Data Story - From An Engineer's Perspective
Big Data Story - From An Engineer's PerspectiveBig Data Story - From An Engineer's Perspective
Big Data Story - From An Engineer's Perspective
 
Architecting applications in the AWS cloud
Architecting applications in the AWS cloudArchitecting applications in the AWS cloud
Architecting applications in the AWS cloud
 
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAXThe Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
The Lean Cloud for Startups with AWS - Customer Success Story - wireWAX
 
Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)
Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)
Asgard: Using Grails to Deploy Netflix to AWS (Extended Slides)
 
So You Want to Be an AWS Partner?
So You Want to Be an AWS Partner? So You Want to Be an AWS Partner?
So You Want to Be an AWS Partner?
 
Netflix cloud architecture...continued
Netflix cloud architecture...continuedNetflix cloud architecture...continued
Netflix cloud architecture...continued
 
Running a Lean Startup with AWS
Running a Lean Startup with AWSRunning a Lean Startup with AWS
Running a Lean Startup with AWS
 
AWS Webcast - What's New with Amazon Elastic Transcoder
AWS Webcast - What's New with Amazon Elastic TranscoderAWS Webcast - What's New with Amazon Elastic Transcoder
AWS Webcast - What's New with Amazon Elastic Transcoder
 
Achieving Profitability on AWS
Achieving Profitability on AWSAchieving Profitability on AWS
Achieving Profitability on AWS
 
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
(MED305) Achieving Consistently High Throughput for Very Large Data Transfers...
 
Partnering with AWS: How to Build Your Business with AWS
Partnering with AWS: How to Build Your Business with AWSPartnering with AWS: How to Build Your Business with AWS
Partnering with AWS: How to Build Your Business with AWS
 
AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...
AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...
AWS re:Invent 2016: How Netflix Achieves Email Delivery at Global Scale with ...
 
What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...
What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...
What an Enterprise Can Learn from Netflix, a Cloud-native Company (ENT203) | ...
 
AWS Webcast - AWS Webinar Series for Education #1 - What is Cloud Computing
AWS Webcast - AWS Webinar Series for Education #1 - What is Cloud ComputingAWS Webcast - AWS Webinar Series for Education #1 - What is Cloud Computing
AWS Webcast - AWS Webinar Series for Education #1 - What is Cloud Computing
 
Intro to AWS: Amazon EC2 and Compute Services
Intro to AWS: Amazon EC2 and Compute ServicesIntro to AWS: Amazon EC2 and Compute Services
Intro to AWS: Amazon EC2 and Compute Services
 
Scalable Media Workflows in the Cloud
Scalable Media Workflows in the CloudScalable Media Workflows in the Cloud
Scalable Media Workflows in the Cloud
 
Aspera on demand for AWS (S3 inc) overview
Aspera on demand for AWS (S3 inc) overviewAspera on demand for AWS (S3 inc) overview
Aspera on demand for AWS (S3 inc) overview
 
Netflix competitive landscape
Netflix competitive landscapeNetflix competitive landscape
Netflix competitive landscape
 
Aws for Start-ups - Introduction & AWS Overview
Aws for Start-ups  - Introduction & AWS OverviewAws for Start-ups  - Introduction & AWS Overview
Aws for Start-ups - Introduction & AWS Overview
 
Getting Started with Amazon EC2 and AWS Compute Services
Getting Started with Amazon EC2 and AWS Compute ServicesGetting Started with Amazon EC2 and AWS Compute Services
Getting Started with Amazon EC2 and AWS Compute Services
 

Semelhante a Netflix Moving To Cloud

Amazon Ec2 Application Design
Amazon Ec2 Application DesignAmazon Ec2 Application Design
Amazon Ec2 Application Designguestd0b61e
 
An intro to Amazon Web Services (AWS)
An intro to Amazon Web Services (AWS)An intro to Amazon Web Services (AWS)
An intro to Amazon Web Services (AWS)Andreas Chatzakis
 
Amazon EC2 - Masterclass - Pop-up Loft Tel Aviv
Amazon EC2 - Masterclass - Pop-up Loft Tel AvivAmazon EC2 - Masterclass - Pop-up Loft Tel Aviv
Amazon EC2 - Masterclass - Pop-up Loft Tel AvivAmazon Web Services
 
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Amazon Web Services
 
Best Practices running SQL Server on AWS
Best Practices running SQL Server on AWSBest Practices running SQL Server on AWS
Best Practices running SQL Server on AWSAmazon Web Services
 
Amazon Web Services - Elastic Beanstalk
Amazon Web Services - Elastic BeanstalkAmazon Web Services - Elastic Beanstalk
Amazon Web Services - Elastic BeanstalkAmazon Web Services
 
Getting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWSGetting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWSAmazon Web Services
 
Getting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWSGetting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWSAmazon Web Services
 
Amazon Web Services EC2 Basics
Amazon Web Services EC2 BasicsAmazon Web Services EC2 Basics
Amazon Web Services EC2 BasicsOnur ŞALK
 
AWS Compute Services
AWS Compute ServicesAWS Compute Services
AWS Compute ServicesSabir Mustafa
 
AWS March 2016 Webinar Series - Amazon EC2 Masterclass
AWS March 2016 Webinar Series - Amazon EC2 MasterclassAWS March 2016 Webinar Series - Amazon EC2 Masterclass
AWS March 2016 Webinar Series - Amazon EC2 MasterclassAmazon Web Services
 
AWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for GovernmentAWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for GovernmentAmazon Web Services
 
Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC
Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC
Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC Amazon Web Services
 
NHGRI Cloud Computing talk
NHGRI Cloud Computing talkNHGRI Cloud Computing talk
NHGRI Cloud Computing talkDeepak Singh
 

Semelhante a Netflix Moving To Cloud (20)

Amazon Ec2 Application Design
Amazon Ec2 Application DesignAmazon Ec2 Application Design
Amazon Ec2 Application Design
 
Amazon EC2: What is this and what can I do with it?
Amazon EC2: What is this and what can I do with it?Amazon EC2: What is this and what can I do with it?
Amazon EC2: What is this and what can I do with it?
 
AWS Quick Intro
AWS Quick IntroAWS Quick Intro
AWS Quick Intro
 
An intro to Amazon Web Services (AWS)
An intro to Amazon Web Services (AWS)An intro to Amazon Web Services (AWS)
An intro to Amazon Web Services (AWS)
 
Amazon EC2 - Masterclass - Pop-up Loft Tel Aviv
Amazon EC2 - Masterclass - Pop-up Loft Tel AvivAmazon EC2 - Masterclass - Pop-up Loft Tel Aviv
Amazon EC2 - Masterclass - Pop-up Loft Tel Aviv
 
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
 
Best Practices running SQL Server on AWS
Best Practices running SQL Server on AWSBest Practices running SQL Server on AWS
Best Practices running SQL Server on AWS
 
Jeff barr Seattle_interactive_2011_q4
Jeff barr Seattle_interactive_2011_q4Jeff barr Seattle_interactive_2011_q4
Jeff barr Seattle_interactive_2011_q4
 
Amazon Web Services - Elastic Beanstalk
Amazon Web Services - Elastic BeanstalkAmazon Web Services - Elastic Beanstalk
Amazon Web Services - Elastic Beanstalk
 
Getting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWSGetting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
 
Getting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWSGetting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
Getting Started in the AWS Cloud, Glen Robinson, Solutions Architect, AWS
 
Amazon Web Services EC2 Basics
Amazon Web Services EC2 BasicsAmazon Web Services EC2 Basics
Amazon Web Services EC2 Basics
 
AWS Compute Services
AWS Compute ServicesAWS Compute Services
AWS Compute Services
 
AWS March 2016 Webinar Series - Amazon EC2 Masterclass
AWS March 2016 Webinar Series - Amazon EC2 MasterclassAWS March 2016 Webinar Series - Amazon EC2 Masterclass
AWS March 2016 Webinar Series - Amazon EC2 Masterclass
 
Amazon web services
Amazon web servicesAmazon web services
Amazon web services
 
AWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for GovernmentAWS Webcast - Explore the AWS Cloud for Government
AWS Webcast - Explore the AWS Cloud for Government
 
Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC
Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC
Building Fault Tolerant Applications in the cloud - AWS Summit 2012 - NYC
 
NHGRI Cloud Computing talk
NHGRI Cloud Computing talkNHGRI Cloud Computing talk
NHGRI Cloud Computing talk
 
EC2.pdf
EC2.pdfEC2.pdf
EC2.pdf
 
Amazon EC2:Masterclass
Amazon EC2:MasterclassAmazon EC2:Masterclass
Amazon EC2:Masterclass
 

Último

Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...DianaGray10
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintMahmoud Rabie
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAshyamraj55
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024SkyPlanner
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopBachir Benyammi
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfAijun Zhang
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IES VE
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Will Schroeder
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxMatsuo Lab
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesMd Hossain Ali
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Brian Pichman
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxGDSC PJATK
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioChristian Posta
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPathCommunity
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...Aggregage
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsSafe Software
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdfPedro Manuel
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.YounusS2
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureEric D. Schabell
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfJamie (Taka) Wang
 

Último (20)

Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
Connector Corner: Extending LLM automation use cases with UiPath GenAI connec...
 
Empowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership BlueprintEmpowering Africa's Next Generation: The AI Leadership Blueprint
Empowering Africa's Next Generation: The AI Leadership Blueprint
 
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPAAnypoint Code Builder , Google Pub sub connector and MuleSoft RPA
Anypoint Code Builder , Google Pub sub connector and MuleSoft RPA
 
Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024Salesforce Miami User Group Event - 1st Quarter 2024
Salesforce Miami User Group Event - 1st Quarter 2024
 
NIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 WorkshopNIST Cybersecurity Framework (CSF) 2.0 Workshop
NIST Cybersecurity Framework (CSF) 2.0 Workshop
 
Machine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdfMachine Learning Model Validation (Aijun Zhang 2024).pdf
Machine Learning Model Validation (Aijun Zhang 2024).pdf
 
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
IESVE Software for Florida Code Compliance Using ASHRAE 90.1-2019
 
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
Apres-Cyber - The Data Dilemma: Bridging Offensive Operations and Machine Lea...
 
Introduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptxIntroduction to Matsuo Laboratory (ENG).pptx
Introduction to Matsuo Laboratory (ENG).pptx
 
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just MinutesAI Fame Rush Review – Virtual Influencer Creation In Just Minutes
AI Fame Rush Review – Virtual Influencer Creation In Just Minutes
 
Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )Building Your Own AI Instance (TBLC AI )
Building Your Own AI Instance (TBLC AI )
 
Cybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptxCybersecurity Workshop #1.pptx
Cybersecurity Workshop #1.pptx
 
Comparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and IstioComparing Sidecar-less Service Mesh from Cilium and Istio
Comparing Sidecar-less Service Mesh from Cilium and Istio
 
UiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation DevelopersUiPath Community: AI for UiPath Automation Developers
UiPath Community: AI for UiPath Automation Developers
 
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
The Data Metaverse: Unpacking the Roles, Use Cases, and Tech Trends in Data a...
 
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration WorkflowsIgniting Next Level Productivity with AI-Infused Data Integration Workflows
Igniting Next Level Productivity with AI-Infused Data Integration Workflows
 
Nanopower In Semiconductor Industry.pdf
Nanopower  In Semiconductor Industry.pdfNanopower  In Semiconductor Industry.pdf
Nanopower In Semiconductor Industry.pdf
 
Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.Basic Building Blocks of Internet of Things.
Basic Building Blocks of Internet of Things.
 
OpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability AdventureOpenShift Commons Paris - Choose Your Own Observability Adventure
OpenShift Commons Paris - Choose Your Own Observability Adventure
 
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
activity_diagram_combine_v4_20190827.pdfactivity_diagram_combine_v4_20190827.pdf
 

Netflix Moving To Cloud

  • 1. NETFLIX MOVING TO AMAZON CLOUD Hien Luu
  • 2. Agenda   Why Amazon Cloud?   Tour of AWS   How Netflix leverages AWS?   Best Practices
  • 3. Why Amazon Cloud? Focus On Core Competence
  • 4. Why Amazon Cloud? High Growth High Scalability High Availability Elasticity
  • 5. Why Amazon Cloud? AWS EC2, SDB, SQS, S3, EBS, EMR, ELB, ASG, RDB, (IAM)
  • 6. Tour of AWS Service Service Name Compute Elastic Compute Cloud (EC2) Elastic Map/Reduce (EMR) Auto Scaling (ASG) Database Relation Database Services (RDS) Messaging Simple Queue Service (SQS) Simple Notification Service (SNS) Monitoring CloudWatch Networking Elastic Load Balancing (ELB) Storage SimpleDB (SDB) Simple Storage Service (S3) Elastic Block Storage (EBS)
  • 7. Tour of AWS (EC2) EC2 = Elastic Compute Cloud Computer EC2 Instance EC2 Instance AMI Application EC2 Instance OS Memory Storage (non-persistent) • Elastic • Management control • Flexible (OS, etc..) Multi-tenant • Secure
  • 8. Tour of AWS (EC2) EC2 Instance Elastic IP Address AMI • Static IP Application • Map to EC2 instance • Hourly charge (when not mapped) OS • Limited # of IP addresses per account Instance id i-79f90613 Private DNS/IP ip-10-202-26-32.ec2.internal/ (transient) 10.202.26.32 Public DNS/IP ec2-184-73-69-47.compute-1.amazonaws.com/ (transient) 184.73.69.47
  • 9. Tour of AWS (EC2) Computing Memory Storage Type Platform I/O Name Unit (GB) (GB) Small 1 1.7 160 32 Moderate m1.small Large 4 7.5 850 64 High m1.large X-Large 8 15 1690 64 High m1.xlarge High-CPU Medium 5 1.7 350 32 Moderate c1.medium High-CPU X-Large 20 7 1690 64 High c1.xlarge High-Memory X-Large 6.5 17.1 420 64 Moderate m2.xlarge High-Memory 2X-Large 13 34.2 850 64 High m2.2xlarge High-Memory 4X-Large 26 68.4 1690 64 High m2.4xlarge Cluster Compute Very High 33.5 23 1690 64 cc1.4xlarge (10 Gbps) $0.085/hr - $2.40/hr
  • 10. Tour of AWS (EC2)   How to launch an EC2 instance?   Amazon provides scripts or AWS console   RightScale   AMIs are stored in S3 or EBS   Use an existing AMI from AMZ
  • 11. Tour of AWS (EC2) High Availability Region US-East (Northern Virginia) US-West (Northern California) EU (Ireland) Netflix: us-east-1c & us-east-1d Asia Pacific (Singapore)
  • 12. Tour of AWS – Security Group app1 app3 EC2 Instance EC2 Instance EC2 Instance EC2 Instance app2 EC2 Instance EC2 Instance Access rule: protocol | from port | to port
  • 13. Tour of AWS - ELB Client1 Client2 Client3 ELB (DNS name, port) Health check HTTP/HTTPS URL, interval EC2 Instance EC2 Instance EC2 Instance EC2 Instance Availability Zone Availability Zone us-east
  • 14. Tour of AWS – Auto Scaling EC2 Instance Application demand EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance EC2 Instance Time Launch or terminate EC2 instances based on user-defined triggers
  • 15. Tour of AWS – Auto Scaling Auto Scaling Configuration Launch Configuration AMI LaunchConfigName Application AMI id Min Security group Max OS Instance type Load balancer User data Availability zone Triggers •  Health •  CPU Utilization •  Latency •  I/O activity
  • 16. Tour of AWS – Cloud Watch Visibility into resource utilization, operational performance CPU Network EC2 Instance EC2 Instance Disk I/O EC2 Instance EC2 Instance EBS Load Balancer AWS Management Console RDS
  • 17. Tour of AWS - EBS   Persistent storage for EC2 instances   100 volumes or 20 TB – Max 1TB per volume   Off-instance persistent storage   Attach and detach to/from   EC2 instance   Why do we need this?   Persistent file systems   Take backups and store in S3 Public data sets: Human Genone, US Census Data
  • 18. Tour of AWS – S3   Data storage infrastructure – for the Internet   Write, read, delete objects up to 5 GB   Scalable, reliable, unlimited storage   Objects can be made publicly accessible Per Account ..100 99.999999999% durability and 99.99% availability $0.055/GB -> $0.15/GB
  • 19. Tour of AWS – S3   Interesting APIs   Can I search objects in a bucket? NO   Can I get a list of objects in a bucket? NO   Can I remove a bucket?   Remove all objects first   Can I get list of keys? YES   Also by prefix
  • 20. Tour of AWS - SimpleDB   For structured, non-relational text data   Highly available   Zero administrative overhead   Auto indexing Domain itemId Email Pets primary key Item jdoe jdoe@yahoo.com dog mjane mjane@gmail.com cat, bird Domains are collections of items that are described by attribute-value pairs
  • 21. Tour of AWS - SimpleDB No Schema itemId Email Pet jdoe jdoe@yahoo.com dog mjane mjane@gmail.com cat, bird itemId Email Pet Phone jdoe jdoe@yahoo.com dog mjane mjane@gmail.com cat, bird 333-444-5555
  • 22. Tour of AWS - SimpleDB 256 Attributes 1024 Bytes 10 GB itemId Email Pet jdoe jdoe@yahoo.com dog mjane mjane@gmail.com cat, bird 1024 Bytes select <attributes> from <domain> where <query expression> Default to 100 items per select, maximum up to 2500 items
  • 23. Tour of AWS - SimpleDB SimpleDB Read Consistency Node 1 itemId Email Pet jdoe jdoe@yahoo.com dog cat mjane mjane@gmail.com cat, bird Node 2 itemId Email Pet jdoe jdoe@yahoo.com dog cat mjane mjane@gmail.com cat, bird Select, G etAttribu te Node 3 itemId Email Pet jdoe jdoe@yahoo.com dog cat mjane mjane@gmail.com cat, bird
  • 24. Tour of AWS - SimpleDB CAP THEOREM Tolerant of node failures A Availability CA AP All nodes see the Tolerant of same data BigTable SimpleDB message loss C CP Hbase P Partition Consistency Membase Tolerance Shared-data Distributed System
  • 25. Tour of AWS - SimpleDB Eventual Consistent Read Consistent Read Stale reads possible No stale reads Lowest latency Higher latency (500 to 1000ms) Highest throughput Lower throughput (1/3) Conditional Put & Delete Optimistic concurrency control Eliminate lost updates due to concurrent writing to same item Comparing an attribute with specified expected value Transactional semantics
  • 26. Tour of AWS - SQS Web-scale Message Infrastructure • Up to 64KB size • Retain up to 14 days • Message visibility -12 hours m6 m1 m2 m5 m4 • Concurrent writers & readers m3 • No FIFO • Delivery “at least once” m7
  • 27. Tour of AWS - SNS Notification Infrastructure m1 HTTP/HTTPS m5 Topic m1 SQS m4 m3 m2 m1 • 100 topics per account • Message max size 8K text data m6 Email
  • 28. Tour of AWS - Security AWS Account: Access key & Secret key EC2 HTTP/HTTPS SimpleDB S3 SQS SNS Authentication via HMAC signature ..
  • 29. Netflix In AWS Cloud Encoding Use ~4K EC2 Petabytes on Instances S3 CDN
  • 30. Netflix In AWS Cloud Netflix Data Center Discovery API ELB Discovery Service Service Oracle Internal Internal API Service API Service memcached memcached SQS Consumer S3 SQS SimpleDB
  • 31. Netflix In AWS Cloud Security Group Auto Scaling Internal Group Internal Services Internal Services Internal Services Service
  • 32. Netflix In AWS Cloud   SimpleDB   Rental history: ~800M items   Queue: ~1B items   S3   Compressed rental history: ~17M objects   Streaming activity logs Access through customer id or movie id or both
  • 33. Netflix In AWS Cloud   Missing infrastructure services   Discovery service   Middle tier load balancer   Encryption service   Key management   Caching   Wrap memcached server   Discoverable   Instrumented
  • 34. Netflix In AWS Cloud Discovery Discovery Service Service Middle Web Tier Load Application Balancer Heart beat Internal Internal Services Internal Services Internal Services Service
  • 35. Netflix In AWS Cloud Big Bang Transition  iPhone Launch  Totallyrun in cloud and no fallback option  No control once App Store gate is opened  Have to scale on day one  EC2 elasticity
  • 36. Netflix In AWS Cloud Datacenter vs Cloud Copy from Adrian’s slide
  • 37. Best Practices   Automate deployment process   Dealing with failure   Network latency   503s, 408s, exponential backoff   Read/connect timeout   Persistence strategy   Rethink storage   SimpleDB, S3, RDS   Sharding   Eventual consistency
  • 38. Best Practices Copy from Adrian’s slide
  • 39. Best Practices   SimpleDB   Sorting is lexicographical   Pad numeric attributes   Use consistent date format (Joda time)   Explicit selecting limit   Use batch put and batch delete   Dealing with null   Dealing with eventual consistency   Consistentget   Conditional put   Item name   Combining columns   UUID
  • 40. Best Practices   SimpleDB   Index selectivity and performance   # of distinct attribute values in all the items in domain   Sharding   Get around the limits   Scale the write throughput   BatchPutAttribute or BatchDeleteAttribute
  • 41. Best Practices   S3   Achieving high write throughput   Pre-sortedthe keys before upload   Preprend object key with increasing 4 to 6 digits   SQS   Decouple system   Asynchronous processing   Buffering   Visibility window > processing time
  • 42. Q&A