Add custom alerts which are not covert by kube-prometheus-stack
i.e.
-
disk pressure
- Today oas.greenhost.net had disk pressure:because of a problem with loki's retention time. I lowered the retention time to I think 8 days last week, but I think Loki saves the retention time of a chunk when it creates it, which means that currently existing old chunks have not been deleted yet.