http://blog.lucascaton.com.br/?p=1373

1. Getting search working should not be hard.
Lucas Catón

2. ElasticSearch?
Full-text search engine and database.

3. It’s based on Lucene...
Written in Java (fast!)
painless setup
open-source

4. Real-time search
Full-text search engine and database
Communicating
JSON over RESTful HTTP
Free search schema
Document oriented

5. Cloud-ready & distributed
Built for the cloud
Highly-available
Always available
Scalable
Scale to hundreds

7. Benchmarks by Socialcast Engineering
http://engineering.socialcast.com/2011/05/realtime-search-solr-vs-elasticsearch/

8. Benchmarks by Socialcast Engineering
http://engineering.socialcast.com/2011/05/realtime-search-solr-vs-elasticsearch/

9. Benchmarks by Socialcast Engineering
http://engineering.socialcast.com/2011/05/realtime-search-solr-vs-elasticsearch/

10. Benchmarks by Socialcast Engineering
http://engineering.socialcast.com/2011/05/realtime-search-solr-vs-elasticsearch/

11. Query DSL

12. Normalise values and search terms
"deleteByQuery" "DELETE QUERY"
'delete'
'by'
'query'
'deletebyquery'

13. Analyse
Normalise values and search terms
"deleteByQuery" "DELETE QUERY"
'delete'
'by'
'query'
'deletebyquery'

14. What is stored in ElasticSearch?

15. Document:
{
tweet => "Perl is GREAT!",
posted => "2011-08-15",
user => {
name => "Clinton Gormley",
email => "drtech@cpan.org"
},
tags => ["perl","opinion"],
posts => 2
}

16. Document:
{
tweet => "Perl is GREAT!",
posted => "2011-08-15",
user => {
name => "Clinton Gormley",
Fields email => "drtech@cpan.org"
},
tags => ["perl","opinion"],
posts => 2
}

17. Document:
Values
{
tweet => "Perl is GREAT!",
posted => "2011-08-15",
user => {
name => "Clinton Gormley",
email => "drtech@cpan.org"
},
tags => ["perl","opinion"],
posts => 2
}

18. Built in analyzers:
Pattern, Language, Snowball, Custom, Standard
Simple, Whitespace, Stop, Keyword

19. The Brown-Cow's Part_No. #A.BC123-456 joe@bloggs.com
keyword:
The Brown-Cow's Part_No. #A.BC123-456 joe@bloggs.com
whitespace:
The, Brown-Cow's, Part_No., #A.BC123-456, joe@bloggs.com
simple:
the, brown, cow, s, part, no, a, bc, joe, bloggs, com
standard:
brown, cow's, part_no, a.bc123, 456, joe, bloggs.com
snowball (English):
brown, cow, part_no, a.bc123, 456, joe, bloggs.com

20. RTFM!

21. Language Analyzers
A set of analyzers aimed at analyzing specific language text. The following types
are supported: arabic, armenian, basque, brazilian, bulgarian, catalan, chinese,
cjk, czech, danish, dutch, english, finnish, french, galician, german, greek, hindi,
hungarian, indonesian, italian, norwegian, persian, portuguese, romanian,
russian, spanish, swedish, turkish, thai.

22. Clients
Java, Ruby, PHP, Groovy, Python,
Perl, Erlang, .NET, Clojure, Scala...

23. Ruby clients
https://github.com/karmi/tire
Great documentation, easy installation, flexible.
↪ 43,605 total downloads (rubygems.org)
https://github.com/grantr/rubberband
Poor documentation.
↪ 9,570 total downloads (rubygems.org)
https://github.com/wireframe/elastic_searchable/
Not very flexible.
↪ 16,820 total downloads (rubygems.org)
https://github.com/angelf/escargot
Not ready yet (WIP).
↪ 998 total downloads (rubygems.org)

24. Ruby clients
https://github.com/karmi/tire
Great documentation, easy installation, flexible.
↪ 43,605 total downloads (rubygems.org)
https://github.com/grantr/rubberband
Poor documentation.
↪ 9,570 total downloads (rubygems.org)
https://github.com/wireframe/elastic_searchable/
Not very flexible.
↪ 16,820 total downloads (rubygems.org)
https://github.com/angelf/escargot
Not ready yet (WIP).
↪ 998 total downloads (rubygems.org)

27. evenshtein algorithm
L ce) an
(similarity based on dist

28. Rails

32. Highlight
> highlight :tags, :title, :options => { :tag => '<strong>' }
=> "Foo <strong>matched word</strong> Bar"
https://github.com/karmi/tire/blob/master/test/integration/highlight_test.rb

33. Powerfull aggregation feature (Facets)

34. Powerfull aggregation feature (Facets)

35. Plugins
How to install:
/path/elasticsearch/<version>/bin/plugin -install <plugin_name>

36. Plugin - elasticsearch-head
A web front end for an ElasticSearch cluster
https://github.com/mobz/elasticsearch-head

37. Plugin - elasticsearch-head

38. Plugin - elasticsearch-head

39. Plugin - Paramedic
A simple tool to inspect the state and statistics
about ElasticSearch clusters.
https://github.com/karmi/elasticsearch-paramedic

40. Plugin - Paramedic

41. Plugin - BigDesk
Live charts and statistics for ElasticSearch cluster.
https://github.com/lukas-vlcek/bigdesk

42. Plugin - BigDesk

43. Disadvantages
=> Uses lots of memory;
=> No autowarming;

44. Interesting reading / reference
Official guide
http://www.elasticsearch.org/guide/
Language Analyzers
http://www.elasticsearch.org/guide/reference/index-modules/analysis/lang-analyzer.html
Terms of endearment – the ElasticSearch Query DSL explained
http://www.elasticsearch.org/tutorials/2011/08/28/query-dsl-explained.html
Realtime Search: Solr vs Elasticsearch
http://engineering.socialcast.com/2011/05/realtime-search-solr-vs-elasticsearch/
The Ruby Toolbox - Elastic Search
https://www.ruby-toolbox.com/search?utf8=%E2%9C%93&q=elastic+search
Como adicionar consultas ultra-eficientes em grandes bases de documentos
http://prezi.com/tdskmzuxflts/como-adicionar-consultas-ultra-eficientes-em-grandes-bases-de-
documentos-com-elasticsearch/
Rails Casts
http://railscasts.com/episodes/306-elasticsearch-part-1
http://railscasts.com/episodes/307-elasticsearch-part-2 (paid content)

45. Thank you!

46. Questions?