Introduction
The log volume associated with your DataSet account is stored as metalog data. You can review this log data directly by running a query similar to tag='logVolume'
metric='logBytes'
From here, you can sum the values contained within the value parameter, and alter the host and forlogfile fields as needed with a PowerQuery or a graph query. More information can be found in the Evaluating Log Volume article.
For ease of use, users can refer the "log Volume" dashboard (accessible via the "Dashboards" menu option). Since "log Volume" is a default dashboard, it can be customized to meet customer requirements. If it is deleted, the original version is automatically restored. Users can also create their own log volume dashboards by using the metalog data.
Log volume dashboard
Click "Dashboards" -> "log Volume" for the default dashboard:
The log volume dashboard is dynamic and displays basic log volume by host. The default dashboard also displays log volume by K8s controller, if you're uploading logs from a K8s cluster.
Log volume (beta) dashboard
You also can test our new Log Volume (beta) Dashboard, which employs some of the new widgets that are supported by our platform
Default Graphs
K8s Graphs
Descriptions
| Graph | Description | Uses | Dashboard |
| Top 10 Hosts | This will break down the top 10 serverHosts or K8s-clusters by volume in GB | Top-level host offenders | New |
| Log Breakdown | This will break down DataSet metrics monitors vs all other traffic. (K8s-Events, Linux Metrics, K8s-metrics, Docker Container Metrics) | A good way to determine how many metrics vs logs are coming into the account. Metrics are useful in understanding system health like CPU, Mem, Ram, Pod Restarts and provide critical information into the infrastructure. Logs can be other data you stream to DataSet via agent file monitor, API upload, or integration. | New |
| Ingestion Rate - GB/Day | This provides the average rate/day for the given time period. | A good way to see your average per day ingestion. Closely tied to your bill | New |
| Total Volume for Time Period - GB | This will sum the total volume for the time period | A good way to view the sum for the time period | New |
| Total events for time period | This will count the number of events for the time period | A good way to see the rate of events streaming | New |
| Logfile breakdown | This will show the breakdown of logfiles. If there is data not being written to the logfile system field, "none" will be displayed. | Top-level logfile offenders | New |
| Log Volume over time | This will show a timeseries of logs | Click 'expand' to analyze granular log volume data. | New/Old |
| Log Volume by serverHost | This will show a clickable report in bytes, the total log volume grouped by host and logfile | Useful to sort top offenders and to click into that host directly with the clickable byte value | New/Old |
| Log Volume by Cluster/Controller | This will show a clickable report in bytes, the total log volume grouped by k8s-cluster and k8s-controller | Useful to sort top offenders and to click into that controller directly with the clickable byte value | New/Old |
| Top K8s-Clusters | This will show the top clusters at a high level | This is useful to get a top-level view of each cluster's usage | New |
| Top 10 deployments | This will breakdown the deployments by size | Useful to get a top-level view of deployments | New |
| Top 10 K8s Kind | This is the resource type breakdown | Useful to see what type of resources are sending the most data. | New |
Comments
0 comments
Please sign in to leave a comment.