Xebia Knowledge Exchange (may 2010) - NoSQL : Using the right tool for the right job

•Transferir como PPTX, PDF•

3 gostaram•1,079 visualizações

Michaël Figuière

Tecnologia Notícias e política

NoSQLUsing the right tool for the right job

www.xebia.fr / blog.xebia.fr 3 Not Only I / I / No SQL

www.xebia.fr / blog.xebia.fr 4 Not Only I / I / / / No SQL

www.xebia.fr / blog.xebia.fr 5 Not Only I / I / / / No SQL Relational

www.xebia.fr / blog.xebia.fr 6 Need to store some data ? Oracle SQL Server Sybase DB2 MySQL PostgreSQL

www.xebia.fr / blog.xebia.fr 7 RDBMS are great for relationalstorage !

www.xebia.fr / blog.xebia.fr 8 RDBMS may not befully trivial… …what a pity if youjustwanted a put / get store

www.xebia.fr / blog.xebia.fr 9 How to achieve scalability and highavailability with a RDMS ?

www.xebia.fr / blog.xebia.fr 10 Memcachedcan help to reduce the pressure on RDBMS

www.xebia.fr / blog.xebia.fr 11 But thiswasn’tenough for some people…

www.xebia.fr / blog.xebia.fr 12 The birth of Dynamo at Amazon.com… Temporal unavailability is acceptable Rich storage is preferred for reporting Write must ALWAYS be available Only key-value is required

www.xebia.fr / blog.xebia.fr 13 So theystarted to createtheirowndatabasethatwould match theirneeds…

www.xebia.fr / blog.xebia.fr 14 So theystarted to createtheirowndatabasethatwould match theirneeds…

www.xebia.fr / blog.xebia.fr 15 Consistent hashingspreadskeysuniformallyacross the partitions

www.xebia.fr / blog.xebia.fr 16 Shardingbringsscalability, replicationbringshighavailability

www.xebia.fr / blog.xebia.fr 17 But failuresstill have to behandledefficiently…

www.xebia.fr / blog.xebia.fr 18 In case of failure of a node, the 2 othernodes serve itsload

www.xebia.fr / blog.xebia.fr 19 In this configuration, clients know only few nodeswhichact as proxy to othernodes…

www.xebia.fr / blog.xebia.fr 20 Gossipprotocol to let everybody know node B has failed…

www.xebia.fr / blog.xebia.fr 21 Eventualconsistency… N = Number of replicas R = Number of readresponses to wait for W = Number of writeaknowledges to wait for

www.xebia.fr / blog.xebia.fr 22 The ratio between N, R and W makeseverything…

www.xebia.fr / blog.xebia.fr 23 The ratio between N, R and W makeseverything…

www.xebia.fr / blog.xebia.fr 24 The ratio between N, R and W makeseverything…

www.xebia.fr / blog.xebia.fr 26 Key-value stores are simple…

www.xebia.fr / blog.xebia.fr 27 Several competitors…

www.xebia.fr / blog.xebia.fr 30 Document orienteddatabases are an evolution of key-value stores

www.xebia.fr / blog.xebia.fr 31 MongoDBis the leader so far… … 10gen saidthey are the « MySQL of NoSQL »

www.xebia.fr / blog.xebia.fr 32 MongoDBis the leader so far…

www.xebia.fr / blog.xebia.fr 33 MongoDBis the leader so far…

www.xebia.fr / blog.xebia.fr 34 Graph databases are great to store… graphs !

www.xebia.fr / blog.xebia.fr 35 NeoTechnologyis the leader so far with Neo4j…

www.xebia.fr / blog.xebia.fr 37 Column-orienteddatabases have a veryparticular data model…

www.xebia.fr / blog.xebia.fr 38 Cassandra Vs HBase !

www.xebia.fr / blog.xebia.fr 39 Cassandra addsSuperColumns to this model…

www.xebia.fr / blog.xebia.fr 40 Cassandra wasdeveloppedatFacebook, to store the user messages

www.xebia.fr / blog.xebia.fr 41 Nowalsoused by Digg, Twitter, Rackspace,…

What a model… www.xebia.fr / blog.xebia.fr 42

www.xebia.fr / blog.xebia.fr 43 An example…

www.xebia.fr / blog.xebia.fr 44 Cassandra Demo

Mais conteúdo relacionado

Semelhante a Xebia Knowledge Exchange (may 2010) - NoSQL : Using the right tool for the right job

Learn how to extend your existing MySQL based website to leverage the power of MySQL variants, AWS cloud based MySQL deployments and RDBMS alternatives. Evaluate how to integrate and use these different various technologies such as MySQL based variations KickFire, a column based optimization and InfoBright, a data warehousing solution. Understand the means of approach towards data synchronization between various database solutions in your business.

Extending The My Sql Data Landscape

Ronald Bradford

In this tutorial we will take Mediawiki, one of the most popular open-source wiki applications, and we will use it to discuss schema and scalability design problems we suffered on Wikipedia. We will discuss how they were solved (or how we plan to solve them). Forget about basic normalization theory or performance promises made by vendors in an ideal world. All topics discussed will be based on *actual problems* found when trying to handle the infrastructure of one of the top 10 most popular websites. * Target audience: Developers using MySQL from any programming language; or system administrators, devops and architects in charge of the data model of its application * Requirements: Basic SQL. Ability to read PHP. Basic familiarity with how wikis/Wikipedia works. * Session dynamic: You are expected to contribute actively- it will not be a lecture format * Topics (practical cases): - Case #0: Pages and revisions - Case #2: Supporting 290 languages - Case #3: An abnormal denormalization - Case #4: Key-value system - Case #5: Revisions and deletions - Case #6: What's links here - Case #7: A large table - Case #8: Anecdotes: The ghost tables and Timestamps - Case #9: Slots https://www.percona.com/live/plam16/sessions/mysql-schema-design-practice

MySQL Schema Design in Practice

Jaime Crespo

Now that teams are increasingly being pressed to cut costs, the database can be a low-hanging fruit for sizable cost reduction – especially if you’re managing terabytes to petabytes of data with millions of read/write operations per second. Join Tzach Livyatan, VP of Product at ScyllaDB, as he shares four ways that teams commonly cut database costs by rethinking their database strategy. We’ll cover topics including: - Cutting admin costs by reducing node sprawl and reducing the need for tuning - ScyllaDB as a better, compatible Amazon DynamoDB - Options to increase price performance through new cloud instances - Ways to safely add more workloads to your cluster without compromising the performance of your latency-sensitive workloads

How Development Teams Cut Costs with ScyllaDB.pdf

ScyllaDB

Java/Scala Lab: Роман Никитченко - Big Data - Big Pitfalls.

GeeksLab Odessa

Big Data - Big Pitfalls.

Roman Nikitchenko

Let's talk real-world private cloud implementation!

Boris Hristov

DDD on example of Symfony (SfCampUA14)

Oleg Zinchenko

Approaching unknown unknowns: CMF for the masses

Alessandro Nadalin

FalkorDB - Fastest way to your Knowledge

Guy Korland

Why Architecture in Web Development matters

Lars Jankowfsky

R Markdown Tutorial For Beginners

Rsquared Academy

CMF: a pain in the F @ PHPDay 05-14-2011

Alessandro Nadalin

Watch this webinar replay as we walk you through all you need to know to plan and execute a successful migration from Oracle database to MariaDB. Over the years MariaDB has gained Enterprise support and maturity to run critical and complex data transaction systems. With the recent version, MariaDB has added some great new features such as SQL_Mode=Oracle compatibility, making the transition process easier than ever before. Whether you’re planning to migrate from Oracle database to MariaDB manually or with the help of a commercial tool to automate the entire migration process, you need to know all the possible bottlenecks and methods involved in the process and the results validation. Migrating from Oracle database to MariaDB can come with a number of benefits: lower cost of ownership, access to and use of an open source database engine, tight integration with the web, wide circle of MariaDB database professionals and more. Find out how it could benefit your organisation! AGENDA - A brief introduction to the platform - Oracle vs MariaDB - Platform support - Installation process - Database access - Backup process - Controlling query execution - Security - Replication options - Migration - Planning and development strategy - Assessment or preliminary check - Data type mapping - Migration tools - Migration process - Testing - Post-migration - Monitoring and Alerting - Performance Management - Backup Management - High availability - Upgrades - Scaling - Staff training SPEAKER Bartlomiej Oles, Senior Support Engineer at Severalnines, is a MySQL and Oracle DBA, with over 15 years experience in managing highly available production systems at IBM, Nordea Bank, Acxiom, Lufthansa, and other Fortune 500 companies. In the past five years, his focus has been on building and applying automation tools to manage multi-datacenter database environments.

Webinar slides: How to Migrate from Oracle DB to MariaDB

Severalnines

Reporting Large Environment Zabbix Database

Alain Ganuchaud

Database Reporting may help in many areas. - Managing Zabbix Large Environment with 14 000 hosts, 10 000 items and 10 000 triggers for over 7 000 NVS is not so easy and Zabbix Administrators need some High Level Dashboards to sanitize and standardize configurations. - Some events (as for example the loss of a part of a Datacenter) need Summary Report because, on such Large Environment, Zabbix will fire too many informations. - Designing High level dashboards for key actors as Managers, forecasters, ... We will see how we can organize Zabbix Database Reporting for such Large Environment with OpenBI tools. Zabbix Conference 2015

Alain Ganuchaud - Reporting Large Environment Zabbix Database

Zabbix

001 hbase introduction

Scott Miao

Vote NO for MySQL - Election 2012: NoSQL. Researchers predict a dark future for MySQL. Significant market loss to come. Are things that bad, is MySQL falling behind? A look at NoSQL, an attempt to identify different kinds of NoSQL stores, their goals and how they compare to MySQL 5.6. Focus: Key Value Stores and Document Stores. MySQL versus NoSQL means looking behind the scenes, taking a step back and looking at the building blocks.

Vote NO for MySQL

Ulf Wendel

Scaling Rails with memcached

elliando dias

If NoSQL is your answer, you are probably asking the wrong question.

Lukas Smith

noSql + rest: Arquitetura Contemporanea

Guilherme Silveira

Semelhante a Xebia Knowledge Exchange (may 2010) - NoSQL : Using the right tool for the right job (20)

Extending The My Sql Data Landscape

MySQL Schema Design in Practice

How Development Teams Cut Costs with ScyllaDB.pdf

Java/Scala Lab: Роман Никитченко - Big Data - Big Pitfalls.

Big Data - Big Pitfalls.

Let's talk real-world private cloud implementation!

DDD on example of Symfony (SfCampUA14)

Approaching unknown unknowns: CMF for the masses

FalkorDB - Fastest way to your Knowledge

Why Architecture in Web Development matters

R Markdown Tutorial For Beginners

CMF: a pain in the F @ PHPDay 05-14-2011

Webinar slides: How to Migrate from Oracle DB to MariaDB

Reporting Large Environment Zabbix Database

Alain Ganuchaud - Reporting Large Environment Zabbix Database

001 hbase introduction

Vote NO for MySQL

Scaling Rails with memcached

If NoSQL is your answer, you are probably asking the wrong question.

noSql + rest: Arquitetura Contemporanea

Mais de Michaël Figuière

Apache Cassandra is a distributed, scalable and highly available database used in many large scale infrastructures in companies such as Netflix, eBay, Instagram or Spotify. It comes with a SQL-like query language that reduces its learning curve, but in order to allow developers to have a similar productivity as with traditional RDBMS, several tools are required. DataStax DevCenter is a standalone IDE built on top of the Eclipse RCP Platform, that makes it easier to create data models and scripts for Cassandra. It relies on Xtext to bring a modern editor with content assist, syntax highlighting, cross references, instant validation and quick fixes. Besides that, in order to build a sophisticated UI while keeping the codebase simple, e4 has been leveraged for dependency injection and event dispatching. This presentation will provide an overview of the design challenges that we've faced and our experience putting together all these technologies.

EclipseCon - Building an IDE for Apache Cassandra

Michaël Figuière

Paris Cassandra Meetup - Cassandra for Developers

Michaël Figuière

YaJug - Cassandra for Java Developers

Michaël Figuière

Geneva JUG - Cassandra for Java Developers

Michaël Figuière

ChtiJUG - Cassandra 2.0

Michaël Figuière

Cassandra summit 2013 - DataStax Java Driver Unleashed!

Michaël Figuière

NYC* Tech Day - New Cassandra Drivers in Depth

Michaël Figuière

Paris Cassandra Meetup - Overview of New Cassandra Drivers

Michaël Figuière

ApacheCon Europe 2012 - Real Time Big Data in practice with Cassandra

Michaël Figuière

NoSQL Matters 2012 - Real Time Big Data in practice with Cassandra

Michaël Figuière

GTUG Nantes (Dec 2011) - BigTable et NoSQL

Michaël Figuière

Duchess France (Nov 2011) - Atelier Apache Mahout

Michaël Figuière

JUG Summer Camp (Sep 2011) - Les applications et architectures d’entreprise d...

Michaël Figuière

BreizhCamp (Jun 2011) - Haute disponibilité et élasticité avec Cassandra

Michaël Figuière

Mix-IT (Apr 2011) - Intelligence Collective avec Apache Mahout

Michaël Figuière

Xebia Knowledge Exchange (mars 2011) - Machine Learning with Apache Mahout

Michaël Figuière

FOSDEM (feb 2011) - A real-time search engine with Lucene and S4

Michaël Figuière

Xebia Knowledge Exchange (feb 2011) - Large Scale Web Development

Michaël Figuière

Lorraine JUG (dec 2010) - NoSQL, des grands du Web aux entreprises

Michaël Figuière

Tours JUG (oct 2010) - NoSQL, des grands du Web aux entreprises

Michaël Figuière

Mais de Michaël Figuière (20)