From monitoring…
to analytics…
to understanding
Data Driven NYC #41 - @alq
http://dtdg.co/data-driven-nyc-41

#1: Aggregate
Datadog gathers performance data from all your application components.

#2: Visualize

#3: Alert

Your understanding is
only as good as your
monitoring

Massive increase of
monitoring data

Here’s why: virtualization, distributed architectures &
micro-services

Many more metrics

Overwhelming...

Premium on rate of
change
Unlike the physical lines of production

Many more metrics…
Changing much faster

Extract signal from
noise

Extract signal from
noise
With signal processing and data science

Signal from noise: outliers

Signal from noise: outliers

Signal from noise: anomalies

For technical details
see Pydata NYC 2015
http://nyc2015.pydata.
org/schedule/presentation/116/

Extract signal from
noise
With a better mental model

The importance of the model

Back to basics
https://www.datadoghq.com/blog/monitoring-101-collecting-data/

Not all metrics are created equal

Simplify, simplify, simplify

Focus on metrics
that matter

Deal with massive
increase of monitoring
data with:
(1) data science
(2) education

Thanks!
We. Are. Hiring.
datadoghq.com/jobs

Appendix

DASHBOARDS
Build Real-Time Interactive Dashboards
CORRELATION
Search And Correlate Metrics And Events
See It All In One Place
Your Servers, Your Clouds, Your Metrics, Your Apps, Your team. Together.

COLLABORATION
Share What You Saw, Write What You Did
METRIC ALERTS
Get Alerted On Critical Issues
DEVELOPER API
Instrument Your Apps,
Write New Integrations
See It All In One Place
Your Servers, Your Clouds, Your Metrics, Your Apps, Your team. Together.