no space left on device
We frequently get these out-of-disk issues, like
Job #199803 failed for renovate-config@da8fb621:
ERROR: Job failed: failed to pull image "renovate/renovate:32.27.2@sha256:f4c1e6d9762b8dc8012466ac79277472a38a38c1701e10247f69ed52346577e0" with specified policies [always]: write /var/lib/docker/tmp/GetImageBlob028521149: no space left on device (manager.go:203:11s)
The job ran 1 hour ago and was Running with gitlab-runner 14.8.0 (565b6c0b) on Stackspin group runner bzWjYQvG
( which is runner.stackspin.net, 213.108.108.138.
But when I look at the disk usage everything seems fine:
runner ~ # df -h
Filesystem Size Used Avail Use% Mounted on
udev 3.9G 0 3.9G 0% /dev
tmpfs 797M 81M 716M 11% /run
/dev/xvda1 40G 2.2G 38G 6% /
modules 100M 60M 41M 60% /usr/lib/modules
tmpfs 3.9G 8.0K 3.9G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 3.9G 0 3.9G 0% /sys/fs/cgroup
tmpfs 797M 0 797M 0% /run/user/10001
runner ~ # df -hi
Filesystem Inodes IUsed IFree IUse% Mounted on
udev 989K 352 989K 1% /dev
tmpfs 996K 448 995K 1% /run
/dev/xvda1 20M 52K 20M 1% /
modules 996K 1.3K 995K 1% /usr/lib/modules
tmpfs 996K 2 996K 1% /dev/shm
tmpfs 996K 2 996K 1% /run/lock
tmpfs 996K 18 996K 1% /sys/fs/cgroup
tmpfs 996K 11 996K 1% /run/user/10001
Edited by Varac