My personal effort to address the option to work with Drupal on Big data projects. I use personal projects and ones available in the market to demonstrate current ways to operate with Drupal CMS framework and the concepts of Big data.

1. Drupal for big data
- is it ready?
Janis Janovskis
Passive Management Ltd
Sunderland, July 26th, 2015

2. LOGISTICS

3. Be proactive

5. Janis
Janovskis
@passivus
Tech Entrepreneur
English, Russian, Latvian,
PHP, Javascript, Python, Go
> 100 Frameworks
Biggest team size 55
Smallest 2
Runer, chef, photographer

7. Drupal - Big?

12. Big Data???
Big data is a broad term for data sets so large or
complex that traditional data processing
applications are inadequate. Challenges include
analysis, capture, curation, search, sharing,
storage, transfer, visualisation, and information
privacy. The term often refers simply to the use of
predictive analytics or other certain advanced
methods to extract value from data, and seldom
to a particular size of data set.
@Wikipedia

13. Volume

14. Velocity

15. Variety

16. Hang on…. What is
Drupal?

20. DataBase

21. Web server

22. Structure

24. Big Data???
Big data is a broad term for data sets so large or
complex that traditional data processing applications are
inadequate. Challenges include analysis, capture,
curation, search, sharing, storage, transfer, visualisation,
and information privacy. The term often refers simply to
the use of predictive analytics or other certain advanced
methods to extract value from data, and seldom to a
particular size of data set.

25. Unstructured data

26. Can We parse
unstructured data
with Drupal???

27. function my_analysis_external_views_plugins() {
$plugin = array();
$plugin['query']
['my_analysis_master_plugin_query'] = array();
…..
}
Views???

28. Views???
public function query($get_count = FALSE){
}

29. function execute(&$view){
$data = drupal_http_request(“what so ever”);
crazy_learn(&$data);
return drupal_render(what_so_ever($data));
}
Views???

30. https://www.lullabot.com/blog/article/building-views-query-
plugins-part-2

32. https://www.drupal.org/project/feeds_crawler

34. Pros
• Great community
• Support
• Reputation
• Myriad of vendors

35. Cons
• Too robust
• Slow
• No lazy loading
• Single threaded
• Heavy
• Structured

36. Case Studies

42. Tracked search results with nodes???

44. Visualizing Big Data In Drupal: Using Data
Visualizations to Drive Knowledge
Discovery

49. https://www.drupal.org/sandbox/cilefen/
1858412

50. Drupal for big data
- is it … ?

51. Acknowledgements
• Nicolas Roberts - niccolo.roberts@gmail.com
• http://www.westridge.com/media/series/out-of-the-box
• Florian Loretan
• My Wife
• Drupal Community
• Organisers

52. Thank You
@PassiveManage
passivemanagement.net/contact