Learn how to monitor critical big data metrics and understand how effective capacity planning can help in achieving optimal database performance.

1. Discovery & mapping
Big Data and Non relational database

2. Applications Manager
An all round on-premises application performance solution for IT Ops and DevOps

3. Week Module Date Schedule Status
1. Visibility: From web application
interface to the database
Aug 21 6:00 AM GMT
11:00 AM EDT
Completed
Completed
2. Big Data and the Non Relational
database
Aug 28 6:00 AM GMT
11:00 AM EDT
In Progress
Upcoming
3. Implementing the right website
monitoring strategy
Sept 4 6:00 AM GMT
11:00 AM EDT
Upcoming
Upcoming
4. Monitoring Cloud applications and
Containers
Sept 11 6:00 AM GMT
11:00 AM EDT
Upcoming
Upcoming

4. Agenda
Big data apps:
Apache Hadoop & Spark
NoSQL databases in Big Data
frameworks
Disk and memory issues in
NoSQL databases
Forecasting utilization trends and
planning capacity

5. Discovery & mapping
Big data apps

6. The Hadoop Architecture
Hadoop
Common
HDFS
YARN
MapReduce

7. The key Hadoop
components
• HDFS
• MapReduce
• YARN
• NoSQL Database

8. HDFS

9. MapReduce

10. YARN

11. Apache Spark
architecture
Spark Driver program
Spark Scheduler
Worker node Worker node
HDFS
NoSQ
L
Mesos /YARN

12. Spark key components
• Drivers and Workers in Spark
• Memory and resource utilization
• Spark cores and applications
• Spark RDDs
• NoSQL database

13. Workers

14. Memory

15. Memory

16. Spark Core and
Applications

17. RDDs

18. The NoSQL databases in Big Data set ups

19. MongoDB - Network & connections
• Connections used
• Connections available
• Network traffic received
• Network traffic sent

20. MongoDB - Lock & asserted errors
• Read Lock, Write Lock
• Message, User asserts

21. Cassandra - CPU
usage

22. Cassandra - Keyspace latency
• Read Latency (/min)
• Write Latency (/min)

23. Redis - Keys
• Number of keys
• Expired keys

24. Redis - Clients
• Connected clients
• Blocked clients

25. Discovery & mapping
Disk and Memory issues in NoSQL databases

26. MongoDB memory utilization

27. MongoDB replication

28. Cassandra Memory
Utilization
• Free Memory
• Used Memory

29. Cassandra-Cluster
• Node state
• Unreachable nodes

30. Redis-Memory utilization

31. Redis-Replication

32. Discovery & mapping
Forecasting utilization trends and planning capacity

33. Trend analysis report
Pull at a glance report of the DB server to have a quick glance at all monitored
attributes

34. Trend analysis report
Quick glance at the performance of all monitored attributes:
• History Report
• Hour of Day Report
• Day of Week Report
• Statistical Report
• Heat Chart

35. Compare performance attribute reports of different monitors.
View & compare reports

36. • Balance hardware
costs with computing
needs.
• Plan future utilization
requirements.
Forecast report

37. Contact : eval-apm@manageengine.com
Online Demo : demo.appmanager.com
Quick Recap
Big Data and the non-relational database
• Big data apps: Apache Hadoop & Spark
• NoSQL databases in Big Data frameworks
• Disk and memory issues in NoSQL DBs
• Forecasting utilization trends and planning capacity

38. Contact : eval-apm@manageengine.com
Online Demo : demo.appmanager.com