MySQL Cluster NoSQL Memcached API

MySQL Cluster: NoSQL Memcached API

•  Meet New Requirements: Add persistence, sharding, fault tolerance
•  Ease-of-Use: Standard Memcached libraries
•  Simplification: Eliminate cache-coherency & consolidate data tiers
•  Flexible Data Model: Schema / Schema-less storage
•  Flexible Access Patterns: SQL and NoSQL
•  Flexible Deployments: values stored in Cluster, Memcached or both
•  Key / Value Performance: Native access to MySQL Cluster

Copyright © 2012 Oracle Corp.

Program Agenda

•  Overview, MySQL Cluster <Insert Picture Here>

•  Memcached API
•  Memcache Overview
•  MySQL Cluster (NDB) & Memcache setup
•  Sample Application
•  Resources to Get Started


MySQL Cluster

HIGH SCALE, •  Auto-Sharding, Multi-Master
READS + WRITES •  ACID Compliant, OLTP + Real-Time Analytics

99.999% •  Shared nothing, no Single Point of Failure
AVAILABILITY •  Self Healing + On-Line Operations

•  High Load, Real Time Performance
REAL-TIME
•  Predictable Low-Latency, Bounded Access Time

•  Key/Value + Complex, Relational Queries
SQL + NoSQL
•  SQL + Memcached + Java + JPA + HTTP/REST + C++

•  Open Source + Commercial Editions
LOW TCO
•  Commodity hardware + Management, Monitoring Toos


MySQL Cluster 7.2
70x Faster JOINs

8x Higher Per Node
Performance
Fastest Ramp…Ever

NoSQL Memcached API

Geo-Distributed
Clusters
writes

Memcached API


Memcached Overview

memcached
Application
hash key
erver memcached
to pick s to find data
Memcache
hash key
Client

friends:12389! memcached
memcache key


Memcache Protocol Elements

•  Key Up to 250 characters
•  Expire Time A number in seconds, up to 30 days
•  Flags 32-bit number for application use
•  CAS ID 64-bit incrementing version number on value
•  Value Value stored for key; traditionally up to 1 MB.


Memcache Protocol Commands (1)

•  get key Fetch value for this key
•  set key value Store this data
•  add key value Store this data (strict insert)
•  replace key value Store this data (strict update)
•  cas key value cas-id Update with version number check


Memcache Protocol Commands (2)

•  append key value Append text to current value
•  prepend key value Insert text before current value
•  incr key amount Add to current stored integer value
•  decr key amount Subtract from current stored value
•  delete key Delete a key and value
•  flush_all Delete all stored values on the server
•  stats stat-name Fetch server statistics


Traditional architecture:
Memcached & MySQL

Application t!
ro ughpu
hi gher th tency!
a
lower l memcached
Memcache
Client

mysql client

more sto
more po rage (on MySQL
werful p disk)!
rotocol ( Slave
SQL)!


NDB & Memcache Architecture:
Memcache protocol + NDB storage

MySQL
Application Cluster
memcached Data Node

Memcache
Client NDB Engine MySQL
Cluster
Data Node


Goals
•  Access stored data directly from memcache client
•  Memcached perspective:
•  MySQL Cluster is a write-scalable, replicated data store
•  with reliable in-memory storage,
•  plus on-disk storage when data is too big for memory.

•  MySQL Cluster perspective:
•  memcache is a high performance API
•  providing easy access to in-memory data,
•  plus an extra layer of caching when data is on disk.


Measured Latency memcachetest -t 2 -M 7000 -c 25000 !


Configuration Overview
NDB Memcache


Anatomy of a Memcache key

user:1248

the prefix the database key


A key-prefix mapping

Memcache
Cache
key Cluster Container
Policy
prefix


A memcache server role

key Con- Cache
Cluster
prefix tainer Policy

key Con- Cache
Cluster
Server
Role
ID
key Con- Cache
Cluster

key Con- Cache
Cluster


Getting Started
MySQL Cluster and Memcached


Cluster on a laptop

•  Configuration file cluster.ini
•  Management server ndb_mgmd
•  Data node ndbd
•  MySQL server mysqld
•  Memcached server memcached

(All of these are present in MySQL Cluster 7.2 distribution)


Cluster Configuration File

A single central file for the whole cluster
Loaded by the management server on --initial
And then stored in cache for future restarts
Sections:
[MGM]
[DB DEFAULT]
[NDBD]
[API]


[MGM] section: Management Server

[MGM]
NodeId=1
datadir=/Users/jdd/sandbox/ndb
hostname=localhost


[DB DEFAULT] Section: data node
parameters

[DB DEFAULT]
NoOfReplicas=1
TimeBetweenGlobalCheckpoints=12000
HeartbeatIntervalDbApi=15000
DataMemory=180M
IndexMemory=60M


[NDBD] Sections: individual data node

[NDBD]
NodeId=2


[API] Sections for MySQL &
Memcached servers

[API]
[API]
[API]
[API]
[API]
[API]
[API]


Complete cluster.ini file
[MGM]
NodeId=1
datadir=/Users/jdd/sandbox/ndb
hostname=localhost

[DB DEFAULT]
NoOfReplicas=1
TimeBetweenGlobalCheckpoints=12000
HeartbeatIntervalDbApi=15000
DataMemory=180M
IndexMemory=60M

[NDBD]
NodeId=2

[API]
[API]
...


Start the Management Server

% ndb_mgmd -f config-file-path


Start the Data Node

% ndbd


Configure & start mysqld (my.cnf file)

[mysqld]
ndbcluster


Load NDB Memcache configuration
tables

% cd /usr/local/mysql/share/memcache-api

% mysql -u root < ndb_memcache_metadata.sql


Sample Application


"Twitter-like" Application

•  Two Tables
•  authors
•  tweets
•  Three Perl Functions
•  Create a new author record
•  Insert a new tweet
•  Increment an author's tweet count


Required Perl Modules

% cpan install Cache::Memcached

% cpan install UUID::Tiny


Sample Application

% mysql -u root

mysql> CREATE DATABASE demo;
use demo;


Data Definition: Authors

CREATE TABLE authors (
author varchar(15) not null,
date_created timestamp,
tweets bigint unsigned not null default 0,
followers bigint unsigned not null default 0,
following bigint unsigned not null default 0,
PRIMARY KEY (author)
) ENGINE=ndb;


Data Definition: Tweets

CREATE TABLE tweets (
id varchar(36) primary key,
author varchar(15),
time_stamp timestamp,
tweet varchar(140),
index(time_stamp),
index(author))ENGINE=ndb;


Configuration: Use the ndbmemcache
config schema
mysql> use ndbmemcache;
show tables;


Configuration: Create container &
key_prefixes
INSERT into containers
SET
name = 'tweets_table' ,
db_schema = 'demo' , db_table = 'tweets',
key_columns = 'id' ,
value_columns = 'time_stamp,author,tweet';

INSERT into key_prefixes
SET
key_prefix = 'tweet:',
policy = 'ndb-only',
container = 'tweets_table';


Two key_prefixes for authors table

•  newauthor:
•  ADD an author record and set date_created
•  tweetcount:
•  INCR tweet count for author


Configuration: New Author

SET
name = 'author_new' ,
db_schema = 'demo' , db_table = 'authors',
key_columns = 'author' ,
value_columns = 'date_created';

SET
key_prefix = 'newauthor:',
container = 'author_new';


Configuration: Tweet Count

SET
name = 'author_count',
db_schema = 'demo', db_table = 'authors',
key_columns = 'author',
increment_column = 'tweets';

SET
key_prefix = 'tweetcount:',
container = 'author_count';


Memcached: Start the server

% cd /usr/local/mysql
% bin/memcached -E lib/ndb_engine.so

17-Aug-2012 13:53:32 PDT NDB Memcache 5.5.25-ndb-7.2.7 ...
Contacting primary management server (localhost:1186) ...
Connected to "localhost:1186" as node id 4.Retrieved 6 key
prefixes for server role "default_role".
Server started with 4 threads.
Priming the pump ... done [0.661 sec].


Perl: Startup Code

use Cache::Memcached;
use UUID::Tiny;

our $mc = new Cache::Memcached( {
'servers' => [ "localhost:11211" ]
});


Perl: Add a new author

## Takes one parameter: author
sub new_author {
my $author = shift;
my $time = time();

my $key = "newauthor:$author";

$mc->add($key, $time);
}


Perl: Insert a Tweet

## Take two parameters: author and tweet
sub insert_tweet {
my $author = shift;
my $tweet = shift;
my $id = create_UUID_as_string(UUID_V4);
my $time = time();

# Insert the tweet
my $key = "tweet:$id";
my $value = "$time" ."t". $author ."t". $tweet;
$mc->add($key, $value);
}


Perl: Increment Tweet Count

## Increment the author's tweet count.
## Take one parameter: author
sub increment_tweetcount {
my $author = shift;

my $key = "tweetcount:$author";
$mc->incr($key, 1);
}


Download MySQL Cluster + Memcached API

http://www.mysql.com/downloads/cluster/#downloads

MySQL Cluster CGE
Most secure, scalable MySQL Database, Development /
Management / Monitoring Tools, backed by Oracle Premier
Lifetime Support

Oracle Product Oracle Premier
Certifications/Integrations Support

MySQL Enterprise MySQL Enterprise
Backup Monitor/Query Analyzer

MySQL Enterprise MySQL Enterprise
Security Scalability

MySQL Cluster
MySQL Workbench
Manager

Oracle Premier Support for MySQL
Rely on The Experts - Get Unique Benefits
•  Straight from the Source
•  Largest Team of MySQL Experts
•  Direct Access to MySQL Support Engineers
•  Backed by MySQL Developers Only From
•  Global 24/7/365, 29 languages
•  Forward Compatible Hot Fixes
Oracle
•  MySQL Maintenance Releases
•  Unlimited Incidents
•  Knowledge Base
"The MySQL support service has been
•  MySQL Consultative Support essential in helping us with troubleshooting
and providing recommendations for the
production cluster, Thanks."

-- Carlos Morales – Playfulplay.com

Getting Started
Learn More
Scaling Web
Databases Guide

www.mysql.com/cluster/

Get MySQL Cluster 7.2 Review Documentation
https://dev.mysql.com/doc/refman/5.5/en/
Download Today mysql-cluster-ndbmemcache.html
http://www.mysql.com/
downloads/cluster/

Copyright 2011 Oracle Corporation 50

Summary

Scale Web Services with
99.999% Availability

Native Memcached NoSQL Access

Try it out Today!

Copyright 2011 Oracle Corporation 51

MySQL Cluster Architecture

JPA REST
Application Nodes

Node Group 1 Node Group 2

F1 F2
Node 1

Node 3
Cluster Cluster
Mgmt F3 F4 Mgmt

F3 F4

Node 4
Node 2

F1 F2
Data Nodes

MySQL Cluster - Extreme Resilience

JPA REST
Application Nodes

Node Group 1 Node Group 2

F1 F2
Node 1

Node 3
Cluster Cluster
Mgmt F3 F4 Mgmt

F3 F4

Node 4
Node 2

F1 F2
Data Nodes

MySQL Cluster NoSQL Memcached API

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to MySQL Cluster NoSQL Memcached API

Similar to MySQL Cluster NoSQL Memcached API (20)

More from Mat Keep

More from Mat Keep (9)

Recently uploaded

Recently uploaded (20)

MySQL Cluster NoSQL Memcached API