Loki data seems not to be cleaned up
After reducing the Loki retention period in !450 (merged) and again in !456 (merged), it seems like no disk space is being freed up on our cluster at oas.greenhost.net. This suggests that Loki doesn't currently clean up old files.
A possible reason for this is this line in the loki pod logs:
level=warn ts=2021-07-20T10:05:30.985492757Z caller=grpc_logging.go:38 method=/logproto.Pusher/Push duration=2.97486ms err="rpc error: code = Code(429) desc = Maximum active stream limit exceeded, reduce the number of active streams (reduce labels or reduce label values), or contact your Loki administrator to see if the limit can be increased" msg="gRPC\n"