Block a user
Tracking experiment stability after upgrade
Failed to send Gitea notifications via email
Missing mail-robot group in gitea user:
tent% systemctl show gitea.service
Failed to send Gitea notifications via email
Update to nixpkgs 25.11 (Xantusia)
@rarias Can we delay the upgrade of fox until 17 of January? One day after the wamta deadline, turns out getting results never ends
Sure, I will leave apex, fox, owl1 and owl2 as-is until…
Update to nixpkgs 25.11 (Xantusia)
They are back:
lake2% ls /dev/nvme*
/dev/nvme0 /dev/nvme0n1 /dev/nvme1 /dev/nvme1n1 /dev/nvme2 /dev/nvme2n1 /dev/nvme3 /dev/nvme3n1
lake2% sudo dmesg
Update to nixpkgs 25.11 (Xantusia)
Upgraded bay and lake2 (ceph storage). After rebooting lake2 three (of four) NVME disks are missing:
lake2% ls /dev/nvme*
/dev/nvme0 /dev/nvme0n1
lake2% sudo dmesg
Update to nixpkgs 25.11 (Xantusia)
Fixed infiniband name in hut and switched to 25.11. I have also updated the nixpkgs commit so we pick the backported fixes. Everything else seems to be working fine so far.
I will propagate the…