Here's an example of how to code with Riak using cURL and ruby to do a basic PUT, GET and more. We then index the data using Apache Solr integration. No matter what platform we’re discussing, we’re beyond the view of rows and columns. Data is more diverse than ever. More difficult to parse. Here is some of that story.

1. Coding with Riak
by Matt Brender

2. 2
{ "text": ”Hello #VelocityConf!",
"entities": {
"hashtags": [“#VelocityConf”],
"symbols": [],
"urls": [],
"user_mentions": [{
"screen_name": ”mjbrender",
"name": ”Matt Brender",
"id": 4948123,
"id_str": ”42424242",
"indices": [81, 92]
}, {
"screen_name": ”mjbrender",
"name": ”Matt Brender",
"id": 376825877,
"id_str": "376825877",
"indices": [121, 132]
}]
}}

3. 3

4. git clone
https://github.com/basho-labs
riak-dev
cluster
4

5. ➜ (riak-dev-cluster) rake bootstrap
➜ (riak-dev-cluster) rake member_status
---- Cluster Status ----
Ring ready: true
5
Starting the riak-dev-cluster
for a local dev environment

6. 6
Starting the Riak.app
for a local dev environment

7. 7
Starting the Riak.app
getting search going right away
https://github.com/mjbrender/riak-
app-enable-search

8. It’s not about NoSQL
8

9. What we really need..
9

10. is a database that allows
my app to scale
10

11. Enter Riak
11

12. Using Riak
the art of
key/value
12

13. • Keys – simply binary values
used to identify Objects.*
• Values – can be numbers,
strings, objects, binaries, etc.
• Buckets – used to define a
virtual namespace for storing
Riak objects.
Data Model
Riak stores data as a combination of keys and values in buckets
13

14. curl http://127.0.0.1:8098/types/places/buckets/country/keys/US
{
"Alpha2_s": "US”,
"Alpha3_s": "USA”,
"EnglishName_s": "United States”,
"NumericCode_i": 840
}
Riak offers both HTTP and Protocol Buffers APIs. The following HTTP
API example uses curl to retrieve a value by key:
Note: Protocol buffers are Google's language-neutral, platform-neutral,
extensible mechanism for serializing structured data – think XML, but
smaller, faster, and simpler.
Data Model
14

15. There are a diverse group of client libraries for Riak that support both the
HTTP and Protocol Buffer APIs:
Basho Supported Libraries:
• Java
• Ruby
• Python
• PHP
• Erlang
• .NET
• Node.js
Community Libraries:
• C
• Clojure
• Go
• Perl
• Scala
• R
Polylingual

16. ➜ export RIAK_HOST=http://localhost:8098
➜ curl -v $RIAK_HOST/buckets/capitals/keys/usa
-X PUT
-H "content-type: text/plain”
-d "Washington D.C.”
* Trying 127.0.0.1... connected
> PUT /buckets/capitals/keys/usa HTTP/1.1
> Content-Type: text/plain
>
< HTTP/1.1 204 No Content
16
Storing data
Through HTTP

17. ➜ curl $RIAK_HOST/buckets/capitals/keys/usa
Washington D.C.
17
Retrieving data
Through HTTP

18. ➜ curl -v $RIAK_HOST/buckets/capitals/keys/usa
Trying 127.0.0.1... Connected
> GET /buckets/capitals/keys/usa HTTP/1.1
< HTTP/1.1 200 OK
< X-Riak-Vclock:
a85hYGBgzGDKBVIcR4M2cvvL1tzJYEpkzGNluGw/+QRfFgA=
< Vary: Accept-Encoding
< Server: MochiWeb/1.1 WebMachine/1.9.0 (someone had painted it blue)
< Link: </buckets/capitals>; rel="up"
< Last-Modified: Tue, 26 May 2015 14:44:35 GMT
< ETag: "1yAFlUinalK2zNd7LpkOgU”
Washington D.C.
18
Retrieving data
Through HTTP (extended)

19. ➜ gem install riak-client
Successfully installed riak-client-2.1.0
1 gem installed
19
https://github.com/basho/riak-ruby-client
A Simple Ruby App
Starting with the client

20. >> require 'riak'
=> true
>> client = Riak::Client.new(:pb_port => 8087)
=> #<Riak::Client [#<Node 127.0.0.1:8087>]>
>> client.ping
=> true
20
A Simple Ruby App
That stores and retrieves data

21. >> default_bucket = client.bucket("default")
=> #<Riak::Bucket {default}>
>> value = default_bucket.new("Monty Python")
=> #<Riak::RObject {default,Monty Python} [#<Riak::RContent
[application/json]:nil>]>
>> value.data = ["Graham Chapman", "Eric Idle", "Terry
Gilliam", "Terry Jones", "John Cleese", "Michael Palin”]
>> value.store()
=> #<Riak::RObject {default,Monty Python} [#<Riak::RContent
[application/json]:["Graham Chapman", "Eric Idle", "Terry Gilliam", "Terry
Jones", "John Cleese", "Michael Palin"]>]>
21
A Simple Ruby App
That stores and retrieves data

22. >> fetched = default_bucket.get("Monty Python")
=> #<Riak::RObject {default,Monty Python}
[#<Riak::RContent [application/json]:["Graham Chapman",
"Eric Idle", "Terry Gilliam", "Terry Jones", "John Cleese",
"Michael Palin"]>]>
>> fetched.data.to_json
=> "["Graham Chapman","Eric Idle","Terry
Gilliam","Terry Jones","John Cleese","Michael Palin"]"
22
A Simple Ruby App
That stores and retrieves data

23. Searching
in Riak

24. ➜ riak-2.1.0 cat etc/riak.conf | grep -i search
## this to be set to 'active', including search.
## To enable Search set this 'on'.
search = on
24
Solr will index any field that it recognizes, based
on the index's schema. The default schema
(_yz_default) uses the suffix to decide the field
type (_s represents a string, _i is an integer, _b is
binary and so on).
A Simple Search
Enabling search in Riak

25. >> client.create_search_index(‘libraries’, ‘_yz_default’)
=> true
>> bucket = client.bucket(‘coding-with-riak’)
=> #<Riak::Bucket {coding-with-riak}>
>> bucket.properties = {‘search_index’ => ‘libraries’}
25
A Simple Search
Enabling search in Riak

26. Riak stores data as a combination of keys and values in buckets
A SIMPLE SEARCH
Key Value Bucket
ruby {
"name_s" : "Ruby Client",
"maintainer_s" : “Basho",
"popular_b" : true
}
coding-with-riak
go {
"name_s" : "Go Client",
"popular_b" : true,
"maintainer_s" : “Community"
}
coding-with-riak
26
A Simple Search
Using Apache Solr

27. >> results = client.search("libraries", "maintainer_s:Basho")
=> {"max_score"=>1.8109302520751953, "num_found"=>1,
"docs"=>[{"score"=>"1.81093030000000010382e+00",
"_yz_rb"=>"coding-with-riak", "_yz_rt"=>"default",
"_yz_rk"=>"ruby", "_yz_id"=>"1*default*coding-with-
riak*ruby*57", "name_s"=>"Ruby Client",
"maintainer_s"=>”Basho", "popular_b"=>"true"}]}
27
A Simple Search
Using Apache Solr

28. >> py = bucket.new("python")
=> #<Riak::RObject {coding-with-riak,python}
[#<Riak::RContent [application/json]:nil>]>
>> py.data = {"name_s"=>"Python Client",
"maintainer_s"=>”Basho", "popular_b"=>true}
=> {"name_s"=>"Python Client",
"maintainer_s"=>”Basho", "popular_b"=>true}
>> py.store
28
A Simple Search
Using Apache Solr

29. >> results = client.search("libraries", "maintainer_s:Basho")
=> {"max_score"=>1.0, "num_found"=>2,
"docs"=>[{"score"=>"1.00000000000000000000e+00", "_yz_rb"=>"coding-
with-riak", "_yz_rt"=>"default", "_yz_rk"=>"ruby",
"_yz_id"=>"1*default*coding-with-riak*ruby*57", "name_s"=>"Ruby
Client", "maintainer_s"=>"basho", "popular_b"=>"true"},
{"score"=>"1.00000000000000000000e+00", "_yz_rb"=>"coding-with-riak",
"_yz_rt"=>"default", "_yz_rk"=>"python", "_yz_id"=>"1*default*coding-
with-riak*python*48", "name_s"=>"Python Client",
"maintainer_s"=>"basho", "popular_b"=>"true"}]}
29
A Simple Search
Using Apache Solr

30. >> results["docs"].each {|x| puts x["name_s"]}
Ruby Client
Python Client
>> results["docs"].each {|x| puts x["name_s"] + "," +
x["maintainer_s"]}
Ruby Client,Basho
Python Client,Basho
Basho Confidential 30
A Simple Search
Using Apache Solr

31. 31
• Apache Solr full-
text search
• Support for Solr’s
client query APIs
• Tag objects with
one or more query
values
• Index integers or
strings
• Exact matches or
ranges of values
• Filter documents
by tag
• Count words in
documents
• Extract links to
related data
Riak Search
Secondary
Indexes
MapReduce
Search in Riak

32. choose your own language
Developing for Riak
32

33. Coding
Considerations
33

34. 34
Client
DBRiak

35. 35
Client
DBRiak
http://www.slideshare.net/dkrotkine/slides-wide

36. Fear the
multi-write
36

37. 37

38. IMAGE FROM IPAD
Write availability
38

39. IMAGE FROM IPAD
Messaging Queue
(highlight Dynamiq/RabbitMQ)
39

40. 40

41. MONITORING
The choice is
yours
41

42. A multitude of stats is available through riak-admin or HTTP
Calculations
Basic Stats:
• CPU (user/system/wait/idle)
• Processor Load
• Available Memory
• Available disk space
• Used file descriptors
• Swap Usage
• IOWait
• Read operations
• Write operations
• Network throughput
• Network errors
Exploring Latency:
• FSM Time Stats represent
the amount of time in
microseconds required to
traverse the GET or PUT
Finite State Machine code,
offering a picture of general
node health.

43. The most common way to analyze Riak is through your favorite interface
Tools
Basho Tested:
• Zabbix
• Nagios
• New Relic
Community Libraries:
• OpenTSDB
• Ganglia
• collectd

44. IN REVIEW

45. from one to many
Scaling Up
From laptop to cluster
without changing settings
45

46. from one to many
Scaling Up
From laptop to cluster
without changing settings
46
^ code

47. here’s where it gets.. easy?
Scaling Up
$ dev2/bin/riak-admin cluster join dev1@127.0.0.1
$ dev3/bin/riak-admin cluster join dev1@127.0.0.1
$ dev4/bin/riak-admin cluster join dev1@127.0.0.1
$ dev5/bin/riak-admin cluster join dev1@127.0.0.1
Just add a machine

48. Biggest change for dev:
reads
48

49. 49
Biggest change for ops:
administration

50. 50
Cost of Downtime

51. What you will gain
51
More flexible, fluid designs
More natural data representations
Scaling without pain
Reduced operational complexity

52. Application Type Key Value
Session User/Session ID Session Data
Advertising Campaign ID Ad Content
Logs Date Log File
Sensor Date, Date/Time Sensor Updates
User Data Login, email, UUID User Attributes
Content Title, Integer Text,
JSON/XML/HTTP
document, images,
Riak Use Cases

53. RIAK DEPLOYED
WORLDWIDE

54. getting to know us
Spend Time
github.com/basho-labs
&
docs.basho.com
@mjbrender