MySQL And Search At Craigslist

•Transferir como ODP, PDF•

28 gostaram•14,763 visualizações

Jeremy Zawodny

My talk as given at the 2009 MySQL Conference and Expo in Santa Clara, CA

Tecnologia

MySQL and Search at Craigslist ,[object Object],[object Object],[object Object],[object Object],[object Object]

Who Am I? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Craigslist? ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

What is Craigslist? ,[object Object],[object Object],[object Object]

Technical and other Challenges ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Goals ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Craigslist Internals Overview Perl + memcached Apache 1.3 + mod_perl Perl + memcached MySQL 5.0.xx Sphinx ... Load Balancer Read Proxy Array Write Proxy Array Web Read Array Object Cache Read DB Cluster Not Included : - user db, image db - async tasks, email - accounting, internal tools - and more! Search Cluster

Vertical Partitioning: Roles Users Classifieds Users Classifieds Forums Stats Archive Write Read Long Trash

Vertical Partitioning ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Horizontal Partitioning: Hydra cluster_01 cluster_02 cluster_03 cluster_N ... client

Horizontal Partitioning: Hydra ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Evolution ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

MySQL Full-Text Problems ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx: My First CL Project ,[object Object],[object Object],[object Object],[object Object],[object Object]

Search Implementation Details ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Incremental Indexing ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Issues ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Search Project Results ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Sphinx Wishlist ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Data Archiving, Replication, Indexes ,[object Object],[object Object],[object Object],[object Object]

Data Archiving: OOB Replication ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Long Term Data Archiving ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Drizzle, XtraDB, Future Stuff ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

We're Hiring! ,[object Object],[object Object],[object Object],[object Object],[object Object],[object Object]

Mais conteúdo relacionado

Mais procurados

Webinar | Introduction to Amazon DynamoDBAmazon Web Services

Best Practices for Data Warehousing with Amazon Redshift | AWS Public Sector ...Amazon Web Services

1.4 data warehouseKrish_ver2

Cs583 info-retrievalBorseshweta

Data Mining: an IntroductionAli Abbasi

Association Rule Learning Part 1: Frequent Itemset GenerationKnoldus Inc.

IRJET - Customer Churn Analysis in Telecom IndustryIRJET Journal

Cassandra ppt 1Skillwise Group

Build a Real-time Streaming Data Visualization System with Amazon Kinesis Ana...Amazon Web Services

3 V's of Big Datasunil173422

Cassandra nice use cases and worst anti patternsDuyhai Doan

Introducing DynamoDBAmazon Web Services

Amazon Redshift Tutorial | AWS Tutorial for Beginners | AWS Certification Tra...Edureka!

Boston crime rate tableau projectsharda university

Data Warehousing with Amazon RedshiftAmazon Web Services

대용량 분산 아키텍쳐 설계 #5. restTerry Cho

Chapter 6. Mining Frequent Patterns, Associations and Correlations Basic Conc...Subrata Kumer Paul

Introduction to Amazon RedshiftAmazon Web Services

Amazon Machine Learning Case Study: Predicting Customer ChurnAmazon Web Services

Optimizing Apache Spark SQL JoinsDatabricks

Mais procurados (20)

Webinar | Introduction to Amazon DynamoDB

Best Practices for Data Warehousing with Amazon Redshift | AWS Public Sector ...

1.4 data warehouse

Cs583 info-retrieval

Data Mining: an Introduction

Association Rule Learning Part 1: Frequent Itemset Generation

IRJET - Customer Churn Analysis in Telecom Industry

Cassandra ppt 1

Build a Real-time Streaming Data Visualization System with Amazon Kinesis Ana...

3 V's of Big Data

Cassandra nice use cases and worst anti patterns

Introducing DynamoDB

Amazon Redshift Tutorial | AWS Tutorial for Beginners | AWS Certification Tra...

Boston crime rate tableau project

Data Warehousing with Amazon Redshift

대용량 분산 아키텍쳐 설계 #5. rest

Chapter 6. Mining Frequent Patterns, Associations and Correlations Basic Conc...

Introduction to Amazon Redshift

Amazon Machine Learning Case Study: Predicting Customer Churn

Optimizing Apache Spark SQL Joins

Destaque

Lessons Learned Migrating 2+ Billion Documents at CraigslistJeremy Zawodny

Realtime Search Infrastructure at Craigslist (OpenWest 2014)Jeremy Zawodny

Fusion-io and MySQL at CraigslistJeremy Zawodny

Social Media Trends - Content CurationChris Mikulin

SphinxSearchPrzemyslaw Wroblewski

Managing Big Data with MySQLmwasaha mwagambo

Sphinx at Craigslist in 2012Jeremy Zawodny

Chipotle Buyer PersonaCrismerly Santibañez

Chipotle Buyer Persona Esther Khoudari

Ahlstrom Financial Statements 2016 & Interim Report Q4/2016Ahlstrom-Munksjö

Top 5 Trends in Local Advertising David Shaner

Sphinx - High performance full-text search for MySQLNguyen Van Vuong

Chipolte buyer personaCaroline Redmond

Craigee Pitch Presentationcraigee

Four Tech Trends for 2017Peter Pajor

Localyser - An Introductionsps:affinity

Nancy Kruse - Spotting Millennial Food TrendsJohn Blue

Why Your MongoDB Needs RedisItamar Haber

Mobile UX-COESatyajit Roy

Youth Trends & InsightsJason Newport

Destaque (20)

Lessons Learned Migrating 2+ Billion Documents at Craigslist

Realtime Search Infrastructure at Craigslist (OpenWest 2014)

Fusion-io and MySQL at Craigslist

Social Media Trends - Content Curation

SphinxSearch

Managing Big Data with MySQL

Sphinx at Craigslist in 2012

Chipotle Buyer Persona

Ahlstrom Financial Statements 2016 & Interim Report Q4/2016

Top 5 Trends in Local Advertising

Sphinx - High performance full-text search for MySQL

Chipolte buyer persona

Craigee Pitch Presentation

Four Tech Trends for 2017

Localyser - An Introduction

Nancy Kruse - Spotting Millennial Food Trends

Why Your MongoDB Needs Redis

Mobile UX-COE

Youth Trends & Insights

Semelhante a MySQL And Search At Craigslist

My Sql And Search At CraigslistMySQLConference

UnConference for Georgia Southern Computer Science March 31, 2015Christopher Curtin

Open source TechnologyAmardeep Vishwakarma

Object- Relational Persistence in SmalltalkESUG

Introduction to MongoDBJustin Smestad

Scaling your websiteAlejandro Marcu

Getting Started with Amazon RedshiftAmazon Web Services

Spark Summit EU talk by Shay Nativ and Dvir VolkSpark Summit

AWS Webcast - Build high-scale applications with Amazon DynamoDBAmazon Web Services

MinneBar 2013 - Scaling with CassandraJeff Smoley

Why databases cry at nightMichael Yarichuk

Deep Dive in Big DataAmazon Web Services

Agility and Scalability with MongoDBMongoDB

From a student to an apache committer practice of apache io tdbjixuan1989

Case Study: Elasticsearch Ingest Using StreamSets at Cisco IntercloudRick Bilodeau

Case Study: Elasticsearch Ingest Using StreamSets @ Cisco IntercloudStreamsets Inc.

Introduction to Azure DocumentDBDenny Lee

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...Hirofumi Iwasaki

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010Bhupesh Bansal

Hadoop and Voldemort @ LinkedInHadoop User Group

Semelhante a MySQL And Search At Craigslist (20)

My Sql And Search At Craigslist

UnConference for Georgia Southern Computer Science March 31, 2015

Open source Technology

Object- Relational Persistence in Smalltalk

Introduction to MongoDB

Scaling your website

Getting Started with Amazon Redshift

Spark Summit EU talk by Shay Nativ and Dvir Volk

AWS Webcast - Build high-scale applications with Amazon DynamoDB

MinneBar 2013 - Scaling with Cassandra

Why databases cry at night

Deep Dive in Big Data

Agility and Scalability with MongoDB

From a student to an apache committer practice of apache io tdb

Case Study: Elasticsearch Ingest Using StreamSets at Cisco Intercloud

Case Study: Elasticsearch Ingest Using StreamSets @ Cisco Intercloud

Introduction to Azure DocumentDB

Java EE 7 with Apache Spark for the World’s Largest Credit Card Core Systems ...

Voldemort & Hadoop @ Linkedin, Hadoop User Group Jan 2010

Hadoop and Voldemort @ LinkedIn

Último

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra

Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Principled Technologies

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services

How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes

Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays

Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez

Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j

TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc

Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer

AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer

Real Time Object Detection Using Open CVKhem

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

Manulife - Insurer Innovation Award 2024The Digital Insurer

GenAI Risks & Security Meetup 01052024.pdflior mazor

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun

Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya