Query prometheus directly
We query the prometheus pod directly on the cluster using kube-prometheus-tack-kube-prom-prometheus.oas.svc.cluster.local
, , because back then we didn't have an exposed prometheus. This fails now:
curl: (6) Could not resolve host: kube-prometheus-stack-kube-prom-prometheus.oas.svc.cluster.local)
See https://open.greenhost.net/openappstack/openappstack/-/jobs/89871
We should query prometheus.CLUSTER directly since we have the API exposed now.