Presentation of the Elasticsearch and Drupal integration - the Elasticsearch Connector module.

1. Hi

2. What we are going to
talk?
• Elasticsearch technology - http://www.elasticsearch.org
• What is Elasticsearch?
• How it works?
• Elasticsearch and Drupal – Demo
http://www.drupal.org/project/elasticsearch_connector

3. Who made
Elasticsearch?
• Shay Banon
• http://www.kimchy.org/
• https://github.com/kimchy
• https://twitter.com/kimchy/

4. Who is using it?

5. Why they use it?
• Distributed out of the box - Incredible easy to make cluster, just start
new node!
• High availability
• Real time index/search
• REST API with JSON
• Build on top of Apache Lucene and Open Source
http://github.com/elasticsearch/elasticsearch
• Schema free
• Document oriented

6. How to install it?

7. How to install it?

8. How to install it?

9. If using Chrome?
Sense

10. Indices API – Create
index
index

11. Node
2
How distributed works?
Node
1
PUT /twitter
index:
number_of_shards:3
number_of_replicas:1
1P 2P
3P
2P 1R
3R
2R
Node
3
3P 1R3R
2R3R

12. Node
2
Multiple indices
Node
1
1P 2P2R
Node
3
3P 1R3R
PUT /news?pretty
index:
number_of_shards:3
number_of_replicas:1
1N
P
2N
R
2N
P
3N
R
3N
P
1N
R

13. Index API - Request
index type id

14. Node
2
Distributed indexing
Node
1
PUT /twitter/tweet/1
{….}
1P 2P2R
Node
3
3P 1R3R

15. Index API - Response

16. Get API - Req and Res

17. Node
2
Distributed GET
Node
1
GET /twitter/tweet/1
1P 2P2R
Node
3
3P 1R3R

18. Search API - Request

19. Node
2
Distributed search
Node
1
GET /twitter/_search?q=kimchy
1P 2P2R
Node
3
3P 1R3R

20. Update document
PUT the document again or…

21. Delete document

22. Delete index

23. How full text search
works?
Search for: “berlin tweet”

24. Inverted index
1. Separate the string into words
2. Create sorted unique list
3. Specify which documents contains this terms
TERMS DOC 1 DOC 2 DOC 3
berlin X
looking X
tweet X X
presentation
s
X
elastic X X
trying X

25. Analysis
Tokenization + Normalization
or
tokenizer + token filters (>=0)

26. More features
DSL Query language
Facets/Aggregation API
Aliasing
Percolating
GEO searching
Attachments
s.o.

27. Video resources
http://www.youtube.com/watch?v=fEsmydn747c
http://www.youtube.com/watch?v=lpZ6ZajygDY
http://www.youtube.com/watch?v=52G5ZzE0XpY
http://www.elasticsearch.org/videos/

28. Elasticsearch and Drupal

29. Drupal Demo time!

30. Roadmap

31. Thank you!
Questions
?