DataSet has a default "log Volume" dashboard that displays log volume by host and K8s cluster (if applicable).
This is convenient for monitoring ongoing log volume. However, as log volume increases, a more specific solution may be needed.
DataSet PowerQueries enable customers to apply the power of SQL to dissimilar yet highly informative platform logs. In this example, we'll be using a
JOIN to link two otherwise unrelated logs. This will enable us to evaluate the
host values relative to where the log volume originated. Please note that this example was designed to showcase how to use PowerQueries for spot analysis. You may wish to modify it to suit your specific requirements.
For example, if I want to break down log volume by the
serverIP on each host. I can use the following query:
vol = (
tag = "logVolume" metric='logBytes'
| group MB = sum(value)/1024/1024 by host = host ? host : k8s-deployment
ips = (
| group c=count() by serverIP, host = serverHost
| group mb = sum(MB) by serverIP, host
| sort -mb
Please sign in to leave a comment.