Code development platform for open source projects from the European Union institutions

Skip to content
Snippets Groups Projects
Simpl-Open-Monitoring-ELK-End-User-Dashboards.md 4.45 KiB
Newer Older
Natalia Szakiel's avatar
Natalia Szakiel committed
# README: Kibana Dashboards User Manual

## Table of Contents
1. [Overview](#overview)
2. [Accessing the Dashboards](#accessing-the-dashboards)
3. [Using the Dashboards](#using-the-dashboards)
4. [Dashboard - ELK infrastructure syslog](#dashboard---elk-infrastructure-syslog)
5. [Dashboard - Kubernetes Cluster Nodes Overview](#dashboard---kubernetes-cluster-nodes-overview)
6. [Dashboard - Agents Usage Monitoring](#dashboard---agents-usage-monitoring)
7. [Dashboard - Heartbeats Monitoring](#dashboard---heartbeats-monitoring)
8. [Dashboard - Technical Monitoring](#dashboard---technical-monitoring)
9. [Dashboard - Business Monitoring](#dashboard---business-monitoring)
10. [Additional Resources](#additional-resources)

## Overview
This document provides an end-user guide for accessing and utilizing Kibana dashboards. 
There are 6 dashboards configured:
- Dashboard - ELK infrastructure syslog
- Kubernetes Cluster Nodes Overview
- Agents Usage Monitoring
- Dashboard For Heartbeats
- Business Monitoring Dashboard
- Technical Monitoring Dashboard

![EndUserDashoards](images/End_user_dashboards_001.png)

## Accessing the Dashboards
Once imported, you can access the dashboards as follows:
1. Open Kibana.
2. Navigate to **Dashboard** from the left menu.
3. Locate the desired dashboard from the list.
4. Click on the dashboard name to open it.

## Using the Dashboards
- **Filtering Data:** Use the filter bar at the top to refine results based on time ranges, namespaces, or specific labels.
- **Drill-down Analysis:** Click on visualizations to explore detailed data.

## Dashboard - ELK infrastructure syslog
This dashboard provides an overview of log levels across ELK components (Elasticsearch, Kibana, and Logstash). It visualizes system logs to help monitor errors, warnings, and informational messages, aiding in troubleshooting and performance analysis.
User can filter for event.dataset (e.x. elasticsearch.gc, deprecetions etc) and event module (e.x. kibana, elasticsearch, logstash).

![EndUserDashoards](images/End_user_dashboards_002.png)

## Dashboard - Kubernetes Cluster Nodes Overview
This dashboard provides insights into the performance and resource usage of Kubernetes cluster nodes. It includes metrics on CPU and memory consumption, network traffic, and energy efficiency per node, helping to monitor system health, optimize resource allocation, and improve overall cluster efficiency.
User can filter for particular nodes (agent.hostname filter) and also for single processes like java, metricbear, postgres etc.

![EndUserDashoards](images/End_user_dashboards_003.png)

## Dashboard - Agents Usage Monitoring
This dashboard tracks resource consumption across deployed agents, providing visibility into CPU and memory usage per pod. It also monitors storage volumes utilized by each pod, helping to optimize resource allocation, detect anomalies, and ensure efficient operation within the environment.
User can filter for pods

![EndUserDashoards](images/End_user_dashboards_004.png)

## Dashboard - Heartbeats Monitoring
This dashboard provides real-time visibility into service availability and health by displaying heartbeat data and statuses. It includes detailed heartbeat logs, helping to track service uptime, detect failures, and troubleshoot issues efficiently.
User can filter for monitors, status and url.

![EndUserDashoards](images/End_user_dashboards_005.png)

## Dashboard - Technical Monitoring
This dashboard aggregates technical logs from all pods and namespaces, providing a centralized view of system activity. Logs are visualized using histograms, categorized by log level (e.g., INFO, WARN, ERROR), enabling efficient troubleshooting, anomaly detection, and performance monitoring.
User can filter for log level and container name.

![EndUserDashoards](images/End_user_dashboards_006.png)

## Dashboard - Business Monitoring
This dashboard provides insights into business processes by visualizing business logs. It tracks key metrics such as business destinations, operations, and message types, helping to analyze workflows, detect anomalies, and optimize operational efficiency.
User can filter for operation, destination, origin and message type 


## Additional Resources
- Kibana Documentation: [https://www.elastic.co/guide/en/kibana/current/index.html](https://www.elastic.co/guide/en/kibana/current/index.html)
- Elasticsearch Documentation: [https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html](https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html)