SlideShare uma empresa Scribd logo
1 de 17
Baixar para ler offline
AdaptiveBlue @
   AWS NYC Meetup
           June 4, 2009



Mark Tabry, Software Engineer
    http://getglue.com
Agenda


   About AdaptiveBlue
   Glue: The Network of People and Things
   Glue: Building on Amazon Web Services
   Glue: Semantic Technology Stack
About AdaptiveBlue

 Founded in 2006, based in New York

 Focuses on enhancing browsing experience

 Launched BlueOrganizer and Glue add-ons for
  Firefox and SmartLinks Widgets for blogs
Get Glue. The Network That
      Sticks With You.
    http://getglue.com
What is Glue?

Glue is a contextual network that uses
semantic technology to automatically
connect people around everyday things -
books, music, movies, stars, artists,
stocks, wine, restaurants and more.
1. Contextual: Glue is distributed and appears
  when it makes sense on popular sites.

2. Automatic: Users participate in Glue just by
  browsing their favorite sites.

3. Simple: Glue removes the friction involved
  in networking - the network comes to you.
Glue Demo
Glue:
Building on Amazon
    Web Services
AWS-based Architecture
                                                                                    Client Layer

Browser Add-Ons         Widgets         iPhones          Facebook Apps             API Clients

                                                                                   Load Balancer Layer
                                    Round Robin DNS


            Load Balancer 1                                    Load Balancer 2

                                                                                    Web Service Layer


             Host 1 (EC2)                                                Host N (EC2)


           Glue Web Service                                            Glue Web Service

                                                  ...
             Batch Services                                              Batch Services



                                                                                     Database Layer


             Amazon S3                                     Rackspace MySQL
                                  Amazon SimpleDB
           Object Database/                                  User accounts
                                  Interactions between
            People Profiles                                    Analytics
                                   People and Things
AdaptiveBlue AWS Stack


    Relating People and Things ( SimpleDB )

Records of people’s interactions around things are stored
 in SimpleDB Domains using duplication for fast access.


          Storing Object Meta Data ( S3 )

    XML representation of millions of books, music,
       movies, etc. is stored using Amazon S3


    Transactional and Batch Support ( EC2 )

        Web Service Requests and batches are
          distributed through EC2 instances.
Amazon SimpleDB in a Nutshell

        Simple DB Domain
                                      Idea:
             Record 1
   Key1      Attributes: A1,A2…       Create flat database with
                                      auto-indexed tables.
               …
             Record N                 Main Features:
   Key2      Attributes: A1,A2…
                                         Each attribute is indexed.
                                         Record structure is flexible.
                      Get record         Basic operators in queries
Put record            Query records      Supports sorting.


             Client
How Glue uses SimpleDB

                           Interaction Record
                     Key1        Attributes: A1,A2…




          Object Domains                          People Domains

    OD1    OD2   …         ODN              PD1    PD2   …         PDN




    Each record is duplicated into Object and Person Domain
    The Key is a combination of USER_ID and OBJECT_KEY
    Djb2hash is used to calculate the domain for each record

Records for each USER and each OBJECT inside the same domain.
Amazon S3 in a Nutshell


             Amazon S3                  Idea:

  Bucket 1               Bucket N       Put/Get objects into buckets
                …                       based on unique keys.




Put object             Get object   Main Features:

                                         Public/Private access.
                                         Support for large objects.
              Client
How Glue Uses S3


            Object Bucket                       People Bucket




    XML-files with object information   XML-files with user and friends info




     XML is serialized as string and written to S3
     Each file has a unique key: OBJECT_ID or USER_ID/profile, etc.
Amazon EC2 in the Nutshell


                Usage:

                    Create Machine Image
                    Deploy the image to S3
                    Start 1 or more instances
                    Use it as regular machine(s)



                 Main Options:
  Machine           Dynamic/Static IPS
   Image            Choose cores
(OS + Apps)         Choose locations
                    Persistence via EBS
How Glue uses EC2
                                Round Robin DNS


           Load Balancer 1                        Load Balancer 2




       Host 1 (EC2/Rackspace)                       Host N (EC2/Rackspace)


          Glue Web Service                             Glue Web Service

                                         ...
           Batch Services                                Batch Services




   Web Service processes transactional requests
   Batch Services are time-based & run on sets of USERS and OBJECTS

The system scales by equally partitioning Data and Requests
http://getglue.com
http://twitter/marktabry
Mark.Tabry@gmail.com

Mais conteúdo relacionado

Mais procurados

SWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew ChengSWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew Cheng
Dennis Chung
 
Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010
Agora Group
 
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
Amazon Web Services Korea
 

Mais procurados (17)

Angular JS and Magento
Angular JS and MagentoAngular JS and Magento
Angular JS and Magento
 
Windows Azure: Lessons From the Field
Windows Azure: Lessons From the FieldWindows Azure: Lessons From the Field
Windows Azure: Lessons From the Field
 
Building Silverlight Applications Using .NET (Part 2 of 2)
Building Silverlight Applications Using .NET (Part 2 of 2)Building Silverlight Applications Using .NET (Part 2 of 2)
Building Silverlight Applications Using .NET (Part 2 of 2)
 
Move to azure
Move to azureMove to azure
Move to azure
 
SWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew ChengSWUG - June 2010 - AD LDS by Andrew Cheng
SWUG - June 2010 - AD LDS by Andrew Cheng
 
Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011Games + Amazon = Love - Presentation quo vadis 2011
Games + Amazon = Love - Presentation quo vadis 2011
 
Windows Azure for Developers - Building Block Services
Windows Azure for Developers - Building Block ServicesWindows Azure for Developers - Building Block Services
Windows Azure for Developers - Building Block Services
 
Offline Html5 3days
Offline Html5 3daysOffline Html5 3days
Offline Html5 3days
 
Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010Arnia-Cubrid - Programatica2010
Arnia-Cubrid - Programatica2010
 
Node.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQ
Node.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQNode.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQ
Node.CQ - Creating Real-time Data Mashups with Node.JS and Adobe CQ
 
C fowler intro-azure
C fowler intro-azureC fowler intro-azure
C fowler intro-azure
 
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
AWS에서 자바스크립트 활용 - 서비스와 개발 도구 - AWS Summit Seoul 2017
 
What's New for the Windows Azure Developer? Lots!!
What's New for the Windows Azure Developer?  Lots!!What's New for the Windows Azure Developer?  Lots!!
What's New for the Windows Azure Developer? Lots!!
 
Day Of Cloud - Windows Azure Platform
Day Of Cloud - Windows Azure PlatformDay Of Cloud - Windows Azure Platform
Day Of Cloud - Windows Azure Platform
 
Getting Started with Docker on AWS
Getting Started with Docker on AWSGetting Started with Docker on AWS
Getting Started with Docker on AWS
 
[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox
[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox
[React Native] Lecture 4: Basic Elements and UI Layout by using FlexBox
 
Amazon Lumberyard: end-to-end solutions for game developers
Amazon Lumberyard: end-to-end solutions for game developersAmazon Lumberyard: end-to-end solutions for game developers
Amazon Lumberyard: end-to-end solutions for game developers
 

Semelhante a NYC Amazon Web Services Meetup: How Glue uses AWS

Jeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud ComputingJeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud Computing
deimos
 
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
IndicThreads
 

Semelhante a NYC Amazon Web Services Meetup: How Glue uses AWS (20)

AWS Customer Presentation - AdaptiveBlue
AWS Customer Presentation - AdaptiveBlueAWS Customer Presentation - AdaptiveBlue
AWS Customer Presentation - AdaptiveBlue
 
Taking Web Application Deployment from Infancy to Maturity in AWS
Taking Web Application Deployment from Infancy to Maturity in AWSTaking Web Application Deployment from Infancy to Maturity in AWS
Taking Web Application Deployment from Infancy to Maturity in AWS
 
Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013
Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013
Building Scalable Windows and .NET Apps on AWS (TLS302) | AWS re:Invent 2013
 
Log Analysis At Scale
Log Analysis At ScaleLog Analysis At Scale
Log Analysis At Scale
 
Architecting Cloud Apps
Architecting Cloud AppsArchitecting Cloud Apps
Architecting Cloud Apps
 
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
202201 AWS Black Belt Online Seminar Apache Spark Performnace Tuning for AWS ...
 
AWS Innovate: Build a Data Lake on AWS- Johnathon Meichtry
AWS Innovate: Build a Data Lake on AWS- Johnathon MeichtryAWS Innovate: Build a Data Lake on AWS- Johnathon Meichtry
AWS Innovate: Build a Data Lake on AWS- Johnathon Meichtry
 
Cloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWebCloud Architectures - Jinesh Varia - GrepTheWeb
Cloud Architectures - Jinesh Varia - GrepTheWeb
 
Infopark AG - AWS Customer Presentation
Infopark AG - AWS Customer PresentationInfopark AG - AWS Customer Presentation
Infopark AG - AWS Customer Presentation
 
Scaling Up to Your First 10 Million Users
Scaling Up to Your First 10 Million UsersScaling Up to Your First 10 Million Users
Scaling Up to Your First 10 Million Users
 
Jeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud ComputingJeff Barr Amazon Services Cloud Computing
Jeff Barr Amazon Services Cloud Computing
 
AWS User Group December 2016
AWS User Group December 2016AWS User Group December 2016
AWS User Group December 2016
 
Data In Cloud
Data In CloudData In Cloud
Data In Cloud
 
Introducing SQL Server Data Services
Introducing SQL Server Data ServicesIntroducing SQL Server Data Services
Introducing SQL Server Data Services
 
Introducing SQL Server Data Services
Introducing SQL Server Data ServicesIntroducing SQL Server Data Services
Introducing SQL Server Data Services
 
Big data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The NetherlandsBig data and serverless - AWS UG The Netherlands
Big data and serverless - AWS UG The Netherlands
 
Born in the Cloud; Build it Like a Startup
Born in the Cloud; Build it Like a StartupBorn in the Cloud; Build it Like a Startup
Born in the Cloud; Build it Like a Startup
 
CloudFork
CloudForkCloudFork
CloudFork
 
NHGRI Cloud Computing talk
NHGRI Cloud Computing talkNHGRI Cloud Computing talk
NHGRI Cloud Computing talk
 
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
Scalable Architecture on Amazon AWS Cloud - Indicthreads cloud computing conf...
 

Mais de Alex Iskold (9)

Skopenow
Skopenow Skopenow
Skopenow
 
Leblum
LeblumLeblum
Leblum
 
Techstars NYC Fall 2015 Program Overview
Techstars NYC Fall 2015 Program OverviewTechstars NYC Fall 2015 Program Overview
Techstars NYC Fall 2015 Program Overview
 
Seed funding gotchas
Seed funding gotchasSeed funding gotchas
Seed funding gotchas
 
GetGlue Pepsi/X Factor Campaign
GetGlue Pepsi/X Factor CampaignGetGlue Pepsi/X Factor Campaign
GetGlue Pepsi/X Factor Campaign
 
GetGlue QR Codes Announcement at Ad:Tech
GetGlue QR Codes Announcement at Ad:TechGetGlue QR Codes Announcement at Ad:Tech
GetGlue QR Codes Announcement at Ad:Tech
 
Danger Of Free
Danger Of FreeDanger Of Free
Danger Of Free
 
Adaptive Blue Sem Tech Meetup Nyc
Adaptive Blue Sem Tech Meetup NycAdaptive Blue Sem Tech Meetup Nyc
Adaptive Blue Sem Tech Meetup Nyc
 
How to run your startup on Amazon Web Services, by Alex Iskold
How to run your startup on Amazon Web Services, by Alex IskoldHow to run your startup on Amazon Web Services, by Alex Iskold
How to run your startup on Amazon Web Services, by Alex Iskold
 

Último

IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Último (20)

Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 

NYC Amazon Web Services Meetup: How Glue uses AWS

  • 1. AdaptiveBlue @ AWS NYC Meetup June 4, 2009 Mark Tabry, Software Engineer http://getglue.com
  • 2. Agenda  About AdaptiveBlue  Glue: The Network of People and Things  Glue: Building on Amazon Web Services  Glue: Semantic Technology Stack
  • 3. About AdaptiveBlue  Founded in 2006, based in New York  Focuses on enhancing browsing experience  Launched BlueOrganizer and Glue add-ons for Firefox and SmartLinks Widgets for blogs
  • 4. Get Glue. The Network That Sticks With You. http://getglue.com
  • 5. What is Glue? Glue is a contextual network that uses semantic technology to automatically connect people around everyday things - books, music, movies, stars, artists, stocks, wine, restaurants and more.
  • 6. 1. Contextual: Glue is distributed and appears when it makes sense on popular sites. 2. Automatic: Users participate in Glue just by browsing their favorite sites. 3. Simple: Glue removes the friction involved in networking - the network comes to you.
  • 9. AWS-based Architecture Client Layer Browser Add-Ons Widgets iPhones Facebook Apps API Clients Load Balancer Layer Round Robin DNS Load Balancer 1 Load Balancer 2 Web Service Layer Host 1 (EC2) Host N (EC2) Glue Web Service Glue Web Service ... Batch Services Batch Services Database Layer Amazon S3 Rackspace MySQL Amazon SimpleDB Object Database/ User accounts Interactions between People Profiles Analytics People and Things
  • 10. AdaptiveBlue AWS Stack Relating People and Things ( SimpleDB ) Records of people’s interactions around things are stored in SimpleDB Domains using duplication for fast access. Storing Object Meta Data ( S3 ) XML representation of millions of books, music, movies, etc. is stored using Amazon S3 Transactional and Batch Support ( EC2 ) Web Service Requests and batches are distributed through EC2 instances.
  • 11. Amazon SimpleDB in a Nutshell Simple DB Domain Idea: Record 1 Key1 Attributes: A1,A2… Create flat database with auto-indexed tables. … Record N Main Features: Key2 Attributes: A1,A2…  Each attribute is indexed.  Record structure is flexible. Get record  Basic operators in queries Put record Query records  Supports sorting. Client
  • 12. How Glue uses SimpleDB Interaction Record Key1 Attributes: A1,A2… Object Domains People Domains OD1 OD2 … ODN PD1 PD2 … PDN  Each record is duplicated into Object and Person Domain  The Key is a combination of USER_ID and OBJECT_KEY  Djb2hash is used to calculate the domain for each record Records for each USER and each OBJECT inside the same domain.
  • 13. Amazon S3 in a Nutshell Amazon S3 Idea: Bucket 1 Bucket N Put/Get objects into buckets … based on unique keys. Put object Get object Main Features:  Public/Private access.  Support for large objects. Client
  • 14. How Glue Uses S3 Object Bucket People Bucket XML-files with object information XML-files with user and friends info  XML is serialized as string and written to S3  Each file has a unique key: OBJECT_ID or USER_ID/profile, etc.
  • 15. Amazon EC2 in the Nutshell Usage:  Create Machine Image  Deploy the image to S3  Start 1 or more instances  Use it as regular machine(s) Main Options: Machine  Dynamic/Static IPS Image  Choose cores (OS + Apps)  Choose locations  Persistence via EBS
  • 16. How Glue uses EC2 Round Robin DNS Load Balancer 1 Load Balancer 2 Host 1 (EC2/Rackspace) Host N (EC2/Rackspace) Glue Web Service Glue Web Service ... Batch Services Batch Services  Web Service processes transactional requests  Batch Services are time-based & run on sets of USERS and OBJECTS The system scales by equally partitioning Data and Requests