The document discusses two projects using InfluxDB: 1) Transforming email reports by consuming messages from Kafka, aggregating and storing in InfluxDB, and generating dashboards. They solved a high volume mismatch issue by adding unique tags and building a point cache. 2) Anomaly detection by collecting data from various sources, storing counts in InfluxDB, and finding anomalies like sudden drops, volume decay, and deadman events. Anomalies and alerts are stored in InfluxDB and handled via Slack, email, and SMS. Visualizations are created in Grafana by obtaining data from InfluxDB.

1. A platform that provides the tools & services to
connect research & analytics companies to the data
which they depend upon.

3. © 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Project Overview : Transforming Email Reports
• Consume messages from Apache Kafka
• Aggregate and store in Influxdb
• Goal is to generate self serving dashboards
• High volume mismatch issue solved by
• adding unique tag
• building point cache
• randomizing timestamp

4. © 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Architecture
& Usage of
InfluxDB

5. © 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Self Serving Dashboard

6. © 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Project Overview : Anomaly Detection
• into a problem of counts mismatch for high traffic Kafka topics and we solved it by randomizing timestamp and building cache.
• Collecting tons of data from various sources
• Storing count of collected data in InfluxDB
• Goal is to find anomalies in data
• There are three types of anomalies:
• sudden drops
• volume decay
• deadman

7. © 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Usage of InfluxDB
• into a problem of counts mismatch for high traffic Kafka topics and we solved it by randomizing timestamp and building cache.
• Storing results of Anomaly
Detection into InfluxDB
• Alerts - Tick scripts
• Using dynamic thresholds
• Alert handling:
• slack channel
• email (sms)

8. © 2021 InfluxData Inc. All Rights Reserved.
© 2021 InfluxData Inc. All Rights Reserved.
Visualizing
• Slack alert
• which stream
• anomaly strength
• threshold
• Visualization in Grafana
• Obtaining data from
InfluxDB

9. © 2021 InfluxData Inc. All Rights Reserved.
Q&A

10. © 2021 InfluxData Inc. All Rights Reserved.
Thank You