1. BIGdatatodayand
tomorrow
Mariusz Gil

2. / ABOUT ME /

3. BIGDATA
This talk is about

4. BIGDATA?
What is...

6. VOLUMElarge amounts of data

7. VELOCITYneeds to be analyzed quickly

8. VARIETYdifferent types of structured and unstructured data

9. Big Data is data that is too large,
complex and dynamics for any conventional data tools
to capture, store, manage and analyze.

10. 30 billion pieces of content we added past month

11. more than 2 billion videos were watched yesterday

12. more than 58 millions messages were send yesterday

13. WHY?

15. 690 nodes Hadoop cluster for predictions and analytics

16. HOW?

18. HBASE
COLUMNAR STORAGE
HIVE
SQLDATA WAREHOUSE ENGINE
AVRO
DATA SERIALIZATION
MAHOUT
SCALABLE MACHINE LEARNING
OOZIE
WORKFLOWS ORCHESTRATION
ZOOKEEPER
DISTRIBUTED COORDINATION SERVICE
FLUME
LOG COLLECTOR
HDFS
HADOOP DISTRIBUTED FILE SYSTEM
YARN / MapReduce v2
DISTRIBUTED PROCESSING FRAMEWORK
AMBARI
PROVISIONING, MANAGING AND MONITORING CLUSTERS
WHIRR
RUNNING CLOUD SERVICES

19. EVOLVE

20. HADOOP!
The future is not only

21. REALTIME
Future is low latency and

23. Apache Drill
Storm

24. BIGTHING
Data is the next

25. thanksmariusz@mariuszgil.com