these 29 derivations will be built: /nix/store/1cbwfyb1bzk7bpv3b0g1g8hz47315dpj-system-path.drv /nix/store/by7qsqacmz4gr6mcqavscg82z308sj99-system-path.drv /nix/store/gkr9n1640s8rabi2fh89zfvczdrkyi2h-dbus-1.drv /nix/store/1i3gbvv6z0qj2xgx067mdhrmyvd1j3ya-X-Restart-Triggers-dbus-broker.drv /nix/store/205ra4xfd4zkm2pzz3zpxk62j3kkj0li-dbus-1.drv /nix/store/9rf64qhxz2i5c0bqpfi2qkp2pz9xw87p-X-Restart-Triggers-dbus-broker.drv /nix/store/23p35k4ligylc89n3s23krfgw7qgflfy-unit-dbus-broker.service.drv /nix/store/gg3k9vwpbxb5ggbph30gg2vmb9lc9ald-unit-dbus-broker.service.drv /nix/store/4dy5r754cznfqf3g78g67kldjh31lckv-system-units.drv /nix/store/jd91f6nqfd221222z3fh3ryb5nwp3i3j-unit-dbus-broker.service.drv /nix/store/4hq0jdwm8bkqhlj9mcrr9swy3s0p5vp3-user-units.drv /nix/store/86pqhzp5lsicibqa7ahaxg83gq338nsz-etc.drv /nix/store/4jxa7rz96l6q9q4s7qsqv468j8almslf-activate.drv /nix/store/hg8wapa64jracr0mm8m3a9zdflc5nsv0-unit-dbus-broker.service.drv /nix/store/fapqysjh63813bcxq8f76zr4fcqa8y33-user-units.drv /nix/store/s0i7ysdnvd2crmr0zny0lg30gacw7vfq-system-units.drv /nix/store/jp3c7fji19l1yn764fpr9dk0a5nf9w4i-etc.drv /nix/store/n9jq6j7giqwiv581r7xhq6q4ska3f31a-activate.drv /nix/store/isslp3yzwrcf3bfxb8xdwd5pl43f86sa-nixos-system-alice-test.drv /nix/store/7ncilvnwwl3rhv40icwsly6ysvb2wpkd-closure-info.drv /nix/store/dyh9mnbjnr969y0gi838lxgicrd59ly1-system-units.drv /nix/store/iyqw37a8849q484vmz0sbsdyj73793fb-etc.drv /nix/store/fa19nigyg8ph44blyn35binr7ijsgjyj-activate.drv /nix/store/s4644xh0mlsghbn4x0sshwj76wwzmagl-nixos-system-clare-test.drv /nix/store/n55jp57sg83kni3aw4i7x4d30kqz8a3g-closure-info.drv /nix/store/zn8yzjd5ffwbfx399rhw7lrsp1pm2rz8-nixos-system-bob-test.drv /nix/store/ncrl41c65gk01vvwsfqjf6zklc91v8c1-closure-info.drv /nix/store/g3nmdbknm40bn6j1l1v8fnivizzdf3df-nixos-test-driver-ncps.drv /nix/store/qlhnqn9960gamzmhvlhnfj1w1w60ns91-container-test-run-ncps.drv building '/nix/store/1cbwfyb1bzk7bpv3b0g1g8hz47315dpj-system-path.drv' building '/nix/store/by7qsqacmz4gr6mcqavscg82z308sj99-system-path.drv' building '/nix/store/dyh9mnbjnr969y0gi838lxgicrd59ly1-system-units.drv' system-path> structuredAttrs is enabled system-path> structuredAttrs is enabled system-path> created 1815 symlinks in user environment system-path> created 1815 symlinks in user environment building '/nix/store/205ra4xfd4zkm2pzz3zpxk62j3kkj0li-dbus-1.drv' building '/nix/store/gkr9n1640s8rabi2fh89zfvczdrkyi2h-dbus-1.drv' building '/nix/store/9rf64qhxz2i5c0bqpfi2qkp2pz9xw87p-X-Restart-Triggers-dbus-broker.drv' building '/nix/store/1i3gbvv6z0qj2xgx067mdhrmyvd1j3ya-X-Restart-Triggers-dbus-broker.drv' building '/nix/store/iyqw37a8849q484vmz0sbsdyj73793fb-etc.drv' building '/nix/store/23p35k4ligylc89n3s23krfgw7qgflfy-unit-dbus-broker.service.drv' building '/nix/store/hg8wapa64jracr0mm8m3a9zdflc5nsv0-unit-dbus-broker.service.drv' building '/nix/store/gg3k9vwpbxb5ggbph30gg2vmb9lc9ald-unit-dbus-broker.service.drv' building '/nix/store/jd91f6nqfd221222z3fh3ryb5nwp3i3j-unit-dbus-broker.service.drv' building '/nix/store/fa19nigyg8ph44blyn35binr7ijsgjyj-activate.drv' building '/nix/store/s0i7ysdnvd2crmr0zny0lg30gacw7vfq-system-units.drv' building '/nix/store/fapqysjh63813bcxq8f76zr4fcqa8y33-user-units.drv' building '/nix/store/4dy5r754cznfqf3g78g67kldjh31lckv-system-units.drv' building '/nix/store/4hq0jdwm8bkqhlj9mcrr9swy3s0p5vp3-user-units.drv' building '/nix/store/s4644xh0mlsghbn4x0sshwj76wwzmagl-nixos-system-clare-test.drv' nixos-system-clare-test> structuredAttrs is enabled building '/nix/store/n55jp57sg83kni3aw4i7x4d30kqz8a3g-closure-info.drv' building '/nix/store/86pqhzp5lsicibqa7ahaxg83gq338nsz-etc.drv' building '/nix/store/jp3c7fji19l1yn764fpr9dk0a5nf9w4i-etc.drv' closure-info> structuredAttrs is enabled building '/nix/store/4jxa7rz96l6q9q4s7qsqv468j8almslf-activate.drv' building '/nix/store/n9jq6j7giqwiv581r7xhq6q4ska3f31a-activate.drv' building '/nix/store/zn8yzjd5ffwbfx399rhw7lrsp1pm2rz8-nixos-system-bob-test.drv' building '/nix/store/isslp3yzwrcf3bfxb8xdwd5pl43f86sa-nixos-system-alice-test.drv' nixos-system-bob-test> structuredAttrs is enabled building '/nix/store/ncrl41c65gk01vvwsfqjf6zklc91v8c1-closure-info.drv' nixos-system-alice-test> structuredAttrs is enabled building '/nix/store/7ncilvnwwl3rhv40icwsly6ysvb2wpkd-closure-info.drv' closure-info> structuredAttrs is enabled closure-info> structuredAttrs is enabled building '/nix/store/g3nmdbknm40bn6j1l1v8fnivizzdf3df-nixos-test-driver-ncps.drv' nixos-test-driver-ncps> Running type check (enable/disable: config.skipTypeCheck) nixos-test-driver-ncps> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck nixos-test-driver-ncps> Success: no issues found in 1 source file building '/nix/store/qlhnqn9960gamzmhvlhnfj1w1w60ns91-container-test-run-ncps.drv' on 'ssh-ng://builder@build-x86-01.clan.lol' building '/nix/store/qlhnqn9960gamzmhvlhnfj1w1w60ns91-container-test-run-ncps.drv' container-test-run-ncps> additionally exposed symbols: container-test-run-ncps> alice, bob, clare, container-test-run-ncps> start_all, machines, driver, Machine, wait_for_signal container-test-run-ncps> Starting alice container-test-run-ncps> Starting bob container-test-run-ncps> Starting clare container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> <<< NixOS Stage 2 >>> container-test-run-ncps> container-test-run-ncps> booting system configuration /nix/store/hmpi8rcwbvqbjydj8x24kpr02d4djkvb-nixos-system-alice-test container-test-run-ncps> running activation script... container-test-run-ncps> setting up /etc... container-test-run-ncps> 2: host0@if3: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 container-test-run-ncps> link/ether 06:dd:de:95:f1:d3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 container-test-run-ncps> setting up age secrets... container-test-run-ncps> starting systemd... container-test-run-ncps> systemd 260.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) container-test-run-ncps> Detected virtualization systemd-nspawn. container-test-run-ncps> Detected architecture x86-64. container-test-run-ncps> Detected first boot. container-test-run-ncps> Initializing machine ID from container UUID. container-test-run-ncps> Applying preset policy. container-test-run-ncps> Populated /etc with preset unit settings. container-test-run-ncps> Queued start job for default target Multi-User System. container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> <<< Welcome to NixOS test (x86_64) - console >>> container-test-run-ncps> + systemd-run /bin/sh -c '/nix/store/61685rbaxmpigwi3z23i33sv3jyfl70q-coreutils-9.11/bin/sleep 999999999 && echo eca569a1-15a8-46f6-87f8-097b7aa31b8e' container-test-run-ncps> Running as unit: run-p304-i4257733.service; invocation ID: 9742cde4274248ff8c8b8e7b797dd4ac container-test-run-ncps> To attach to container alice run on the same machine that runs the test: container-test-run-ncps> sudo nsenter --user --target $(\pgrep -f '^/bin/sh.*eca569a1-15a8-46f6-87f8-097b7aa31b8e') --mount --uts --ipc --net --pid --cgroup /bin/sh -c bash container-test-run-ncps> container-test-run-ncps> To inject external network and continue test, run: container-test-run-ncps> sudo /nix/store/h3l4z7p6wny3phbckwwhy1i2g52pdnj4-python3-3.13.15/bin/python3.13 /nix/store/f960jm4nawb9zr6cb9d0vfpb7hifp96b-test-driver-0.0.1/lib/python3.13/site-packages/test_driver/inject_network.py eca569a1-15a8-46f6-87f8-097b7aa31b8e container-test-run-ncps> container-test-run-ncps> <<< NixOS Stage 2 >>> container-test-run-ncps> container-test-run-ncps> booting system configuration /nix/store/pigc5w247qi6dhj2bswval698vr5rpq8-nixos-system-bob-test container-test-run-ncps> running activation script... container-test-run-ncps> setting up /etc... container-test-run-ncps> 2: host0@if4: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 container-test-run-ncps> link/ether aa:19:d6:6d:3e:38 brd ff:ff:ff:ff:ff:ff link-netnsid 0 container-test-run-ncps> setting up age secrets... container-test-run-ncps> starting systemd... container-test-run-ncps> systemd 260.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) container-test-run-ncps> Detected virtualization systemd-nspawn. container-test-run-ncps> Detected architecture x86-64. container-test-run-ncps> Detected first boot. container-test-run-ncps> Initializing machine ID from container UUID. container-test-run-ncps> Applying preset policy. container-test-run-ncps> Populated /etc with preset unit settings. container-test-run-ncps> Queued start job for default target Multi-User System. container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> <<< Welcome to NixOS test (x86_64) - console >>> container-test-run-ncps> + systemd-run /bin/sh -c '/nix/store/61685rbaxmpigwi3z23i33sv3jyfl70q-coreutils-9.11/bin/sleep 999999999 && echo 2888fccd-7e19-48b3-956a-dc5407f6a733' container-test-run-ncps> Running as unit: run-p361-i4258436.service; invocation ID: 808542b4e4c449c781a339480a807b14 container-test-run-ncps> To attach to container bob run on the same machine that runs the test: container-test-run-ncps> sudo nsenter --user --target $(\pgrep -f '^/bin/sh.*2888fccd-7e19-48b3-956a-dc5407f6a733') --mount --uts --ipc --net --pid --cgroup /bin/sh -c bash container-test-run-ncps> container-test-run-ncps> To inject external network and continue test, run: container-test-run-ncps> sudo /nix/store/h3l4z7p6wny3phbckwwhy1i2g52pdnj4-python3-3.13.15/bin/python3.13 /nix/store/f960jm4nawb9zr6cb9d0vfpb7hifp96b-test-driver-0.0.1/lib/python3.13/site-packages/test_driver/inject_network.py 2888fccd-7e19-48b3-956a-dc5407f6a733 container-test-run-ncps> container-test-run-ncps> <<< NixOS Stage 2 >>> container-test-run-ncps> container-test-run-ncps> booting system configuration /nix/store/dxhm5hhsxhw184m8wsvfazkpp4fzja2m-nixos-system-clare-test container-test-run-ncps> running activation script... container-test-run-ncps> setting up /etc... container-test-run-ncps> 2: host0@if5: mtu 1500 qdisc noop state DOWN mode DEFAULT group default qlen 1000 container-test-run-ncps> link/ether 82:a2:7e:37:e3:3a brd ff:ff:ff:ff:ff:ff link-netnsid 0 container-test-run-ncps> setting up age secrets... container-test-run-ncps> starting systemd... container-test-run-ncps> systemd 260.2 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE) container-test-run-ncps> Detected virtualization systemd-nspawn. container-test-run-ncps> Detected architecture x86-64. container-test-run-ncps> Detected first boot. container-test-run-ncps> Initializing machine ID from container UUID. container-test-run-ncps> Applying preset policy. container-test-run-ncps> Populated /etc with preset unit settings. container-test-run-ncps> Queued start job for default target Multi-User System. container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> <<< Welcome to NixOS test (x86_64) - console >>> container-test-run-ncps> + systemd-run /bin/sh -c '/nix/store/61685rbaxmpigwi3z23i33sv3jyfl70q-coreutils-9.11/bin/sleep 999999999 && echo 551887b9-bc18-4810-b961-a9dc267c399f' container-test-run-ncps> Running as unit: run-p314-i4258447.service; invocation ID: ee8194b6e4824b438709b5ab7ab876a0 container-test-run-ncps> To attach to container clare run on the same machine that runs the test: container-test-run-ncps> sudo nsenter --user --target $(\pgrep -f '^/bin/sh.*551887b9-bc18-4810-b961-a9dc267c399f') --mount --uts --ipc --net --pid --cgroup /bin/sh -c bash container-test-run-ncps> container-test-run-ncps> To inject external network and continue test, run: container-test-run-ncps> sudo /nix/store/h3l4z7p6wny3phbckwwhy1i2g52pdnj4-python3-3.13.15/bin/python3.13 /nix/store/f960jm4nawb9zr6cb9d0vfpb7hifp96b-test-driver-0.0.1/lib/python3.13/site-packages/test_driver/inject_network.py 551887b9-bc18-4810-b961-a9dc267c399f container-test-run-ncps> + systemctl --no-pager show ncps container-test-run-ncps> + systemctl status ncps container-test-run-ncps> + systemctl --no-pager show harmonia container-test-run-ncps> + systemctl status harmonia container-test-run-ncps> alice: waiting for success: curl bob:8502/nix-cache-info container-test-run-ncps> + curl bob:8502/nix-cache-info container-test-run-ncps> % Total % Received % Xferd Average Speed Time Time Time Current container-test-run-ncps> Dload Upload Total Spent Left Speed container-test-run-ncps> 100 50 100 50 0 0 30902 0 0 container-test-run-ncps> (finished: waiting for success: curl bob:8502/nix-cache-info, in 0.01 seconds) container-test-run-ncps> bob: waiting for success: curl clare:5000/nix-cache-info container-test-run-ncps> + curl clare:5000/nix-cache-info container-test-run-ncps> % Total % Received % Xferd Average Speed Time Time Time Current container-test-run-ncps> Dload Upload Total Spent Left Speed container-test-run-ncps> 100 51 100 51 0 0 43330 0 0 container-test-run-ncps> (finished: waiting for success: curl clare:5000/nix-cache-info, in 0.01 seconds) container-test-run-ncps> + nix-build --expr $'\n builtins.derivation {\n name = "hi";\n builder = "/bin/sh";\n args = [ "-c" "echo hi > $out" ];\n system = "x86_64-linux";\n }\n' container-test-run-ncps> + nix-build --expr $'\n builtins.derivation {\n name = "hi";\n builder = "/bin/sh";\n args = [ "-c" "echo hi > $out" ];\n system = "x86_64-linux";\n }\n' container-test-run-ncps> container-test-run-ncps> container-test-run-ncps> upload niks3: failed time=2026-09-10T00:34:58.594Z level=WARN msg="Request returned retryable status, retrying" attempt=1 max_attempts=6 backoff=100ms status=502 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T00:36:03.546Z level=WARN msg="Request returned retryable status, retrying" attempt=2 max_attempts=6 backoff=187.155328ms status=502 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T00:41:38.531Z level=WARN msg="Request returned retryable status, retrying" attempt=1 max_attempts=6 backoff=100ms status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T00:46:38.632Z level=WARN msg="Request returned retryable status, retrying" attempt=2 max_attempts=6 backoff=182.285456ms status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T00:52:05.427Z level=WARN msg="Request returned retryable status, retrying" attempt=1 max_attempts=6 backoff=100ms status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T00:57:05.530Z level=WARN msg="Request returned retryable status, retrying" attempt=2 max_attempts=6 backoff=216.110839ms status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T01:02:05.748Z level=WARN msg="Request returned retryable status, retrying" attempt=3 max_attempts=6 backoff=374.38175ms status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T01:07:06.123Z level=WARN msg="Request returned retryable status, retrying" attempt=4 max_attempts=6 backoff=789.765369ms status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T01:12:06.915Z level=WARN msg="Request returned retryable status, retrying" attempt=5 max_attempts=6 backoff=1.610297597s status=504 url=https://niks3.clan.lol/api/pending_closures time=2026-09-10T01:17:08.527Z level=ERROR msg="Fatal error" error="pushing paths: creating pending closures: creating pending closure: server returned 504: "