Realtime log analytics with elastic stack (source included)
1. Data Science (Big Data)
2017.08.17
Gee Yeol Nahm
Realtime Log Analytics with Elastic Stack
2. Things not covered
• AWS Elasticsearch Service
• Elasticsearch architecture optimization
• Elasticsearch as a search engine
source : L//P
source : (Donald) Trung Manh Nguyen
3. Things covered
• Install Elastic Stack on AWS ec2
• Collect (+preprocess) log data using Filebeat & Logstash
• Send log data to Elasticsearch
• Build Kibana dashboard
5. Basic Concepts (Notation)
Elasticsearch RDBMS
Cluster : a collection of nodes
Node : a single server
Index Database
Type Table
Document Row
Field Column
Mapping Schema