build01: building 9hr41kdny3i6f8zi72ymcpsn58m4czp1-container-test-run-dm-dns.drv
Machine state will be reset. To keep it, pass --keep-machine-state
start all VLans
(finished: start all VLans, in 0.00 seconds)

Test will time out and terminate in 3600.0 seconds
run the VM test script
additionally exposed symbols:
    client, server,
    vlan1,
    start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh
start all VMs
client: systemd-nspawn running (pid 52)
server: systemd-nspawn running (pid 53)
client: Waiting for journal at /build/vm-state-client/var/log/journal...
server: Waiting for journal at /build/vm-state-server/var/log/journal...
(finished: start all VMs, in 0.00 seconds)
server: waiting for unit unbound.service
nixos-nspawn(server): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(server): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
░ Spawning container server on /build/vm-state-server.
░ Spawning container client on /build/vm-state-client.
client # No journal files were found.
client # No journal boot entry found for the specified boot (+0).
server # No journal files were found.
server # No journal boot entry found for the specified boot (+0).
client # [2258634.313573] client systemd-journald[90]: Journal started
client # [2258634.313634] client systemd-journald[90]: Runtime Journal (/run/log/journal/00d62fc262dd4fc09108d3c869ee2600) is 8M, max 2.5G, 2.4G free.
client # [2258634.318831] client systemd[1]: Finished Apply Kernel Variables.
client # [2258634.330390] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
client # [2258634.342905] client systemd[1]: Starting Flush Journal to Persistent Storage...
client # [2258634.343698] client systemd[1]: Starting Network Name Resolution...
server # [2258634.321777] server systemd-journald[99]: Journal started
server # [2258634.321833] server systemd-journald[99]: Runtime Journal (/run/log/journal/37a6986ad4bf4eb096835876efa008ea) is 8M, max 2.5G, 2.4G free.
server # [2258634.325919] server systemd[1]: Finished Apply Kernel Variables.
server # [2258634.336876] server systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
server # [2258634.349645] server systemd[1]: Starting Flush Journal to Persistent Storage...
client # [2258634.344588] client systemd[1]: Starting Create Static Device Nodes in /dev...
client # [2258634.354026] client systemd-journald[90]: Time spent on flushing to /var/log/journal/00d62fc262dd4fc09108d3c869ee2600 is 1.145ms for 7 entries.
client # [2258634.354026] client systemd-journald[90]: System Journal (/var/log/journal/00d62fc262dd4fc09108d3c869ee2600) is 8M, max 4G, 3.9G free.
server # [2258634.350610] server systemd[1]: Starting Network Name Resolution...
server # [2258634.351229] server systemd[1]: Starting Create Static Device Nodes in /dev...
server # [2258634.361178] server systemd-journald[99]: Time spent on flushing to /var/log/journal/37a6986ad4bf4eb096835876efa008ea is 1.154ms for 7 entries.
server # [2258634.361178] server systemd-journald[99]: System Journal (/var/log/journal/37a6986ad4bf4eb096835876efa008ea) is 8M, max 4G, 3.9G free.
server # [2258634.377575] server systemd[1]: Finished Create Static Device Nodes in /dev.
server # [2258634.377813] server systemd[1]: Finished Flush Journal to Persistent Storage.
server # [2258634.378874] server systemd[1]: Reached target Preparation for Local File Systems.
server # [2258634.378989] server systemd[1]: Reached target Local File Systems.
server # [2258634.379899] server systemd[1]: Listening on Boot Loader Control Service Socket.
server # [2258634.379951] server systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
server # [2258634.380762] server systemd[1]: Starting Save Transient machine-id to Disk...
server # [2258634.381598] server systemd[1]: Starting Create System Files and Directories...
client # [2258634.368209] client systemd[1]: Finished Flush Journal to Persistent Storage.
server # [2258634.381630] server systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
client # [2258634.368582] client systemd[1]: Finished Create Static Device Nodes in /dev.
server # [2258634.400132] server systemd-tmpfiles[151]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
client # [2258634.369677] client systemd[1]: Reached target Preparation for Local File Systems.
server # [2258634.400373] server systemd-tmpfiles[151]: fchmod() of /var/log/journal failed: Operation not permitted
client # [2258634.369791] client systemd[1]: Reached target Local File Systems.
server # [2258634.400531] server systemd-tmpfiles[151]: fchmod() of /var/log/journal/37a6986ad4bf4eb096835876efa008ea failed: Operation not permitted
client # [2258634.370639] client systemd[1]: Listening on Boot Loader Control Service Socket.
server # [2258634.400766] server systemd-tmpfiles[151]: fchmod() of /run/log/journal failed: Operation not permitted
client # [2258634.370686] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
server # [2258634.402289] server systemd[1]: Finished Create System Files and Directories.
client # [2258634.371584] client systemd[1]: Starting Save Transient machine-id to Disk...
server # [2258634.403313] server systemd[1]: Starting Rebuild Journal Catalog...
client # [2258634.372346] client systemd[1]: Starting Create System Files and Directories...
server # [2258634.404202] server systemd[1]: Starting Record System Boot/Shutdown in UTMP...
client # [2258634.372378] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
server # [2258634.416461] server systemd[1]: Finished Record System Boot/Shutdown in UTMP.
client # [2258634.389712] client systemd-tmpfiles[141]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
server # [2258634.426092] server systemd[1]: Finished Rebuild Journal Catalog.
client # [2258634.389932] client systemd-tmpfiles[141]: fchmod() of /var/log/journal failed: Operation not permitted
server # [2258634.427184] server systemd[1]: Starting Update is Completed...
client # [2258634.390085] client systemd-tmpfiles[141]: fchmod() of /var/log/journal/00d62fc262dd4fc09108d3c869ee2600 failed: Operation not permitted
server # [2258634.438009] server systemd[1]: Finished Update is Completed.
client # [2258634.390314] client systemd-tmpfiles[141]: fchmod() of /run/log/journal failed: Operation not permitted
server # [2258634.494766] server systemd[1]: Finished Firewall.
client # [2258634.391728] client systemd[1]: Finished Create System Files and Directories.
server # [2258634.494921] server systemd[1]: Reached target Preparation for Network.
client # [2258634.392818] client systemd[1]: Starting Rebuild Journal Catalog...
server # [2258634.495125] server systemd[1]: Listening on Network Management Resolve Hook Socket.
client # [2258634.393531] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...
server # [2258634.496164] server systemd[1]: Starting Network Management...
client # [2258634.406801] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.
server # [2258634.754106] server systemd[1]: Finished Save Transient machine-id to Disk.
client # [2258634.416395] client systemd[1]: Finished Rebuild Journal Catalog.
server # [2258635.177349] server systemd-networkd[216]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
client # [2258634.417667] client systemd[1]: Starting Update is Completed...
server # [2258635.177437] server systemd-networkd[216]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
client # [2258634.430273] client systemd[1]: Finished Update is Completed.
server # [2258635.186485] server systemd-networkd[216]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2258634.492587] client systemd[1]: Finished Firewall.
server # [2258635.186653] server systemd-networkd[216]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2258634.492757] client systemd[1]: Reached target Preparation for Network.
server # [2258635.186808] server systemd-networkd[216]: lo: Link UP
client # [2258634.493002] client systemd[1]: Listening on Network Management Resolve Hook Socket.
server # [2258635.186814] server systemd-networkd[216]: lo: Gained carrier
client # [2258634.494208] client systemd[1]: Starting Network Management...
client # [2258634.754079] client systemd[1]: Finished Save Transient machine-id to Disk.
client # [2258635.183824] client systemd-networkd[207]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
client # [2258635.183913] client systemd-networkd[207]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
client # [2258635.192879] client systemd-networkd[207]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2258635.193043] client systemd-networkd[207]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2258635.187003] server systemd-networkd[216]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
server # [2258635.187436] server systemd-networkd[216]: eth1: Link UP
server # [2258635.187748] server systemd-networkd[216]: eth1: Gained carrier
server # [2258635.187831] server systemd[1]: Started Network Management.
server # [2258635.189583] server systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
server # [2258635.240639] server systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
client # [2258635.193181] client systemd-networkd[207]: lo: Link UP
client # [2258635.193186] client systemd-networkd[207]: lo: Gained carrier
client # [2258635.193366] client systemd-networkd[207]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
client # [2258635.193746] client systemd[1]: Started Network Management.
client # [2258635.193776] client systemd-networkd[207]: eth1: Link UP
client # [2258635.194024] client systemd-networkd[207]: eth1: Gained carrier
client # [2258635.232624] client systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
client # [2258635.246016] client systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
client # [2258635.322918] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
client # [2258635.415741] client systemd-resolved[121]: Positive Trust Anchors:
client # [2258635.415751] client systemd-resolved[121]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
client # [2258635.415754] client systemd-resolved[121]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
client # [2258635.415790] client systemd-resolved[121]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
client # [2258635.436457] client systemd-resolved[121]: Using system hostname 'client'.
server # [2258635.332866] server systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [2258635.422290] server systemd-resolved[130]: Positive Trust Anchors:
server # [2258635.422301] server systemd-resolved[130]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
server # [2258635.422304] server systemd-resolved[130]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
server # [2258635.422338] server systemd-resolved[130]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
server # [2258635.442371] server systemd-resolved[130]: Using system hostname 'server'.
server # [2258635.443734] server systemd[1]: Started Network Name Resolution.
server # [2258635.443854] server systemd[1]: Reached target Network.
server # [2258635.443980] server systemd[1]: Reached target System Initialization.
server # [2258635.444221] server systemd[1]: Started Watch for zone file changes.
server # [2258635.444272] server systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
server # [2258635.444328] server systemd[1]: Started Daily Cleanup of Temporary Directories.
server # [2258635.444367] server systemd[1]: Reached target Path Units.
server # [2258635.444444] server systemd[1]: Reached target Timer Units.
server # [2258635.444665] server systemd[1]: Listening on D-Bus System Message Bus Socket.
server # [2258635.444877] server systemd[1]: Listening on Nix Daemon Socket.
server # [2258635.445094] server systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
server # [2258635.445138] server systemd[1]: Reached target Socket Units.
server # [2258635.445230] server systemd[1]: Reached target Basic System.
server # [2258635.447296] server systemd[1]: Starting data mesher daemon...
server # [2258635.476708] server systemd[1]: Starting Import lastlog data into lastlog2 database...
server # [2258635.478221] server systemd[1]: Starting Name Service Cache Daemon (nsncd)...
server # [2258635.481652] server systemd[1]: Starting D-Bus System Message Bus...
server # [2258635.498729] server systemd[1]: Finished Import lastlog data into lastlog2 database.
server # [2258635.666584] server systemd[1]: Started Name Service Cache Daemon (nsncd).
server # [2258635.666696] server systemd[1]: Reached target User and Group Name Lookups.
server # [2258635.667387] server nsncd[225]: Sep 30 10:50:55.653 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [2258635.437814] client systemd[1]: Started Network Name Resolution.
server # [2258635.669145] server systemd[1]: Starting User Login Management...
client # [2258635.437943] client systemd[1]: Reached target Network.
server # [2258635.670675] server systemd[1]: Starting Permit User Sessions...
client # [2258635.438068] client systemd[1]: Reached target System Initialization.
client # [2258635.438225] client systemd[1]: Started Watch for zone file changes.
client # [2258635.438277] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
client # [2258635.438325] client systemd[1]: Started Daily Cleanup of Temporary Directories.
client # [2258635.438360] client systemd[1]: Reached target Path Units.
client # [2258635.438428] client systemd[1]: Reached target Timer Units.
client # [2258635.438654] client systemd[1]: Listening on D-Bus System Message Bus Socket.
client # [2258635.438858] client systemd[1]: Listening on Nix Daemon Socket.
client # [2258635.439084] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
client # [2258635.439129] client systemd[1]: Reached target Socket Units.
client # [2258635.439224] client systemd[1]: Reached target Basic System.
client # [2258635.441475] client systemd[1]: Starting data mesher daemon...
client # [2258635.442809] client systemd[1]: Starting Import lastlog data into lastlog2 database...
client # [2258635.444328] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...
client # [2258635.446554] client systemd[1]: Starting D-Bus System Message Bus...
client # [2258635.495160] client systemd[1]: Finished Import lastlog data into lastlog2 database.
client # [2258635.682484] client systemd[1]: Started Name Service Cache Daemon (nsncd).
client # [2258635.682591] client systemd[1]: Reached target User and Group Name Lookups.
client # [2258635.683249] client nsncd[215]: Sep 30 10:50:55.669 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [2258635.704532] client systemd[1]: Starting User Login Management...
client # [2258635.705953] client systemd[1]: Starting Permit User Sessions...
client # [2258635.717564] client systemd[1]: Finished Permit User Sessions.
client # [2258635.719467] client systemd[1]: Started Console Getty.
client # [2258635.719542] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
client # [2258635.719577] client systemd[1]: Reached target Login Prompts.
client # [2258635.825764] client dbus-broker-launch[216]: Looking up NSS user entry for 'systemd-timesync'...
client # [2258635.827701] client dbus-broker-launch[216]: NSS returned no entry for 'systemd-timesync'
client # [2258635.827701] client dbus-broker-launch[216]: Invalid user-name in /nix/store/3w0xq4rj4wvhkilddbwacmgfr1yln5bn-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
client # [2258635.828433] client systemd[1]: Started D-Bus System Message Bus.
client # [2258635.837238] client dbus-broker-launch[216]: Ready
server # [2258635.711977] server systemd[1]: Finished Permit User Sessions.
server # [2258635.713764] server systemd[1]: Started Console Getty.
server # [2258635.713836] server systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
server # [2258635.713869] server systemd[1]: Reached target Login Prompts.
server # [2258635.812738] server dbus-broker-launch[227]: Looking up NSS user entry for 'systemd-timesync'...
server # [2258635.814264] server dbus-broker-launch[227]: NSS returned no entry for 'systemd-timesync'
server # [2258635.814264] server dbus-broker-launch[227]: Invalid user-name in /nix/store/9646dz8fyvk24rl2i8zaldzg9rz0y1dh-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
server # [2258635.814734] server systemd[1]: Started D-Bus System Message Bus.
server # [2258635.823564] server dbus-broker-launch[227]: Ready
client # [2258636.218360] client data-mesher[213]: time=2026-09-30T10:50:56.204Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
client # [2258636.219433] client data-mesher[213]: time=2026-09-30T10:50:56.205Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4: [/dns/client.test/tcp/7946]} {12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
client # [2258636.219433] client data-mesher[213]: time=2026-09-30T10:50:56.205Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
client # [2258636.222750] client data-mesher[213]: time=2026-09-30T10:50:56.208Z level=INFO msg="checking file integrity"
client # [2258636.222858] client data-mesher[213]: time=2026-09-30T10:50:56.208Z level=INFO msg="file integrity check complete"
client # [2258636.226669] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="libp2p host created" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"
client # [2258636.226709] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="registered HTTP route" method=GET path=/files
client # [2258636.226709] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
client # [2258636.226709] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
client # [2258636.226709] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="starting server"
client # [2258636.226818] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="waiting for DHT to populate" delay=10s
client # [2258636.226952] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="HTTP server listening" address=[::1]:7331
client # [2258636.227188] client data-mesher[213]: time=2026-09-30T10:50:56.212Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
client # [2258636.245196] client data-mesher[213]: time=2026-09-30T10:50:56.230Z level=INFO msg="peer connected" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2258636.261559] client data-mesher[213]: time=2026-09-30T10:50:56.247Z level=INFO msg="peer connected" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2258636.433552] client systemd-logind[233]: New seat seat0.
client # [2258636.433797] client systemd[1]: Started User Login Management.
client # [2258636.436196] client systemd[1]: Starting linger-users.service...
server # [2258636.232503] server data-mesher[222]: time=2026-09-30T10:50:56.218Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
server # [2258636.233552] server data-mesher[222]: time=2026-09-30T10:50:56.219Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4: [/dns/client.test/tcp/7946]} {12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
server # [2258636.233552] server data-mesher[222]: time=2026-09-30T10:50:56.219Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
server # [2258636.234590] server data-mesher[222]: time=2026-09-30T10:50:56.220Z level=INFO msg="checking file integrity"
server # [2258636.234707] server data-mesher[222]: time=2026-09-30T10:50:56.220Z level=INFO msg="file integrity check complete"
server # [2258636.238512] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="libp2p host created" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"
server # [2258636.238572] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
server # [2258636.238572] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
server # [2258636.238572] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="registered HTTP route" method=GET path=/files
server # [2258636.238572] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="starting server"
server # [2258636.238717] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="waiting for DHT to populate" delay=10s
server # [2258636.238754] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="HTTP server listening" address=[::1]:7331
server # [2258636.238796] server data-mesher[222]: time=2026-09-30T10:50:56.224Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
server # [2258636.244555] server data-mesher[222]: time=2026-09-30T10:50:56.230Z level=INFO msg="peer connected" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 remote_addr=/ip4/192.168.1.1/tcp/7946
server # [2258636.262573] server data-mesher[222]: time=2026-09-30T10:50:56.248Z level=INFO msg="peer connected" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 remote_addr=/ip4/192.168.1.1/tcp/60908
server # [2258636.442935] server systemd-logind[242]: New seat seat0.
server # [2258636.443112] server systemd[1]: Started User Login Management.
server # [2258636.480643] server systemd[1]: Starting linger-users.service...
client # [2258636.490374] client systemd[1]: linger-users.service: Deactivated successfully.
client # [2258636.490658] client systemd[1]: Finished linger-users.service.
server # [2258636.494203] server systemd[1]: linger-users.service: Deactivated successfully.
server # [2258636.494301] server systemd[1]: Finished linger-users.service.
client # [2258637.216170] client systemd-networkd[207]: eth1: Gained IPv6LL
server # [2258637.124222] server systemd-networkd[216]: eth1: Gained IPv6LL
server: still waiting for container 'server' to reach ready state...
client # [2258646.227658] client data-mesher[213]: time=2026-09-30T10:51:06.213Z level=INFO msg="performing state exchange with peers on join" count=1
client # [2258646.227658] client data-mesher[213]: time=2026-09-30T10:51:06.213Z level=DEBUG msg="initiating state exchange" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2258646.228997] client data-mesher[213]: time=2026-09-30T10:51:06.214Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2258646.228997] client data-mesher[213]: time=2026-09-30T10:51:06.214Z level=INFO msg="state exchange complete" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2258646.229107] client data-mesher[213]: time=2026-09-30T10:51:06.214Z level=INFO msg="server started"
client # [2258646.229250] client data-mesher[213]: time=2026-09-30T10:51:06.215Z level=INFO msg="starting expired-file sweeper" interval=1m0s
client # [2258646.229405] client systemd[1]: Started data mesher daemon.
client # [2258646.232198] client systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2258646.240319] client data-mesher[213]: time=2026-09-30T10:51:06.226Z level=INFO msg="received state sync from peer" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2258646.240319] client data-mesher[213]: time=2026-09-30T10:51:06.226Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
server # [2258646.228725] server data-mesher[222]: time=2026-09-30T10:51:06.214Z level=INFO msg="received state sync from peer" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2258646.228725] server data-mesher[222]: time=2026-09-30T10:51:06.214Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2258646.239735] server data-mesher[222]: time=2026-09-30T10:51:06.225Z level=INFO msg="performing state exchange with peers on join" count=1
server # [2258646.239824] server data-mesher[222]: time=2026-09-30T10:51:06.225Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2258646.241194] server data-mesher[222]: time=2026-09-30T10:51:06.226Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2258646.241194] server data-mesher[222]: time=2026-09-30T10:51:06.227Z level=INFO msg="state exchange complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2258646.241320] server data-mesher[222]: time=2026-09-30T10:51:06.227Z level=INFO msg="server started"
server # [2258646.241408] server data-mesher[222]: time=2026-09-30T10:51:06.227Z level=INFO msg="starting expired-file sweeper" interval=1m0s
server # [2258646.241541] server systemd[1]: Started data mesher daemon.
server # [2258646.289158] server systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2258647.115017] client unbound-pre-start[275]: Root anchor updated!
client # [2258647.130463] client unbound-pre-start[279]: setup in directory /var/lib/unbound
server # [2258647.115137] server unbound-pre-start[284]: Root anchor updated!
server # [2258647.130495] server unbound-pre-start[288]: setup in directory /var/lib/unbound
server # [2258648.261564] server unbound-pre-start[297]: Certificate request self-signature ok
server # [2258648.261564] server unbound-pre-start[297]: subject=CN=unbound-control
server # [2258648.281212] server unbound-pre-start[288]: removing artifacts
server # [2258648.282873] server unbound-pre-start[288]: Setup success. Certificates created. Enable in unbound.conf file to use
client # [2258648.658169] client unbound-pre-start[288]: Certificate request self-signature ok
client # [2258648.658169] client unbound-pre-start[288]: subject=CN=unbound-control
client # [2258648.677544] client unbound-pre-start[279]: removing artifacts
client # [2258648.679271] client unbound-pre-start[279]: Setup success. Certificates created. Enable in unbound.conf file to use
server: (finished: waiting for unit unbound.service, in 16.18 seconds)
client: waiting for unit unbound.service
server # [2258649.167048] server unbound[301]: [301:0] notice: init module 0: validator
server # [2258649.167124] server unbound[301]: [301:0] notice: init module 1: iterator
server # [2258649.171288] server unbound[301]: [301:0] info: start of service (unbound 1.26.1).
server # [2258649.171461] server systemd[1]: Started Unbound recursive Domain Name Server.
server # [2258649.171981] server systemd[1]: Reached target Multi-User System.
server # [2258649.172280] server systemd[1]: Reached target Host and Network Name Lookups.
server # [2258649.174277] server systemd[1]: Starting Reload unbound zone configuration...
server # [2258649.214548] server unbound[301]: [301:0] info: service stopped (unbound 1.26.1).
server # [2258649.214879] server unbound[301]: [301:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2258649.214884] server unbound[301]: [301:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
server # [2258649.215070] server unbound-control[305]: ok
server # [2258649.215795] server unbound[301]: [301:0] notice: Restart of unbound 1.26.1.
server # [2258649.216443] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2258649.216514] server unbound[301]: [301:0] notice: init module 0: validator
server # [2258649.216570] server unbound[301]: [301:0] notice: init module 1: iterator
server # [2258649.216782] server systemd[1]: Finished Reload unbound zone configuration.
server # [2258649.217427] server systemd[1]: Startup finished in 15.317s.
server # [2258649.220492] server unbound[301]: [301:0] info: start of service (unbound 1.26.1).
client: (finished: waiting for unit unbound.service, in 0.33 seconds)
server: waiting for unit data-mesher.service
server: (finished: waiting for unit data-mesher.service, in 0.02 seconds)
server: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1, in 0.04 seconds)
server: must succeed: data-mesher file update --network-id /nix/store/0a5mpxfya7m0p21561xg0bxln21lryjy-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames
server: (finished: must succeed: data-mesher file update --network-id /nix/store/0a5mpxfya7m0p21561xg0bxln21lryjy-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames, in 0.05 seconds)
??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/drwj5qfqx9axxgf0jvxlavglj43fr2kh-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test
??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/drwj5qfqx9axxgf0jvxlavglj43fr2kh-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
client # [2258649.565321] client unbound[293]: [293:0] notice: init module 0: validator
client # [2258649.565398] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2258649.569542] client unbound[293]: [293:0] info: start of service (unbound 1.26.1).
client # [2258649.569684] client systemd[1]: Started Unbound recursive Domain Name Server.
client # [2258649.570167] client systemd[1]: Reached target Multi-User System.
client # [2258649.570438] client systemd[1]: Reached target Host and Network Name Lookups.
client # [2258649.572430] client systemd[1]: Starting Reload unbound zone configuration...
client # [2258649.621563] client unbound[293]: [293:0] info: service stopped (unbound 1.26.1).
client # [2258649.621918] client unbound-control[296]: ok
client # [2258649.621902] client unbound[293]: [293:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [2258649.621907] client unbound[293]: [293:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
client # [2258649.622814] client unbound[293]: [293:0] notice: Restart of unbound 1.26.1.
client # [2258649.623522] client unbound[293]: [293:0] notice: init module 0: validator
client # [2258649.623576] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2258649.623657] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [2258649.623933] client systemd[1]: Finished Reload unbound zone configuration.
client # [2258649.624431] client systemd[1]: Startup finished in 15.746s.
client # [2258649.627555] client unbound[293]: [293:0] info: start of service (unbound 1.26.1).
server # [2258649.890731] server systemd[1]: Starting Reload unbound zone configuration...
server # [2258649.911222] server data-mesher[222]: time=2026-09-30T10:51:09.897Z level=INFO msg=http_request uri=/files/dns/cnames status=204
server # [2258649.945066] server unbound[301]: [301:0] info: service stopped (unbound 1.26.1).
server # [2258649.945225] server unbound-control[340]: ok
server # [2258649.945507] server unbound[301]: [301:0] info: server stats for thread 0: 5 queries, 2 answers from cache, 3 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2258649.945513] server unbound[301]: [301:0] info: server stats for thread 0: requestlist max 2 avg 1.33333 exceeded 0 jostled 0
server # [2258649.946591] server unbound[301]: [301:0] notice: Restart of unbound 1.26.1.
server # [2258649.946715] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2258649.947047] server systemd[1]: Finished Reload unbound zone configuration.
server # [2258649.947422] server unbound[301]: [301:0] notice: init module 0: validator
server # [2258649.947481] server unbound[301]: [301:0] notice: init module 1: iterator
server # [2258649.951795] server unbound[301]: [301:0] info: start of service (unbound 1.26.1).
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test, in 1.05 seconds)
(finished: run the VM test script, in 17.67 seconds)
test script finished in 18.16s
cleanup
kill NspawnMachine (pid 52)
client # [2258651.230856] client data-mesher[213]: time=2026-09-30T10:51:11.216Z level=DEBUG msg="attempting push/pull" peer_count=1
client # [2258651.230856] client data-mesher[213]: time=2026-09-30T10:51:11.216Z level=DEBUG msg="initiating state exchange" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2258651.231919] client data-mesher[213]: time=2026-09-30T10:51:11.217Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2258651.232032] client data-mesher[213]: time=2026-09-30T10:51:11.217Z level=DEBUG msg="new file detected" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ name=dns/cnames name=dns/cnames
client # [2258651.232032] client data-mesher[213]: time=2026-09-30T10:51:11.217Z level=INFO msg="state exchange complete" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2258651.232152] client data-mesher[213]: time=2026-09-30T10:51:11.217Z level=DEBUG msg="push/pull successful" interval=5s
client # [2258651.232423] client data-mesher[213]: time=2026-09-30T10:51:11.218Z level=INFO msg="scheduling file download" name=dns/cnames
client # [2258651.232491] client data-mesher[213]: time=2026-09-30T10:51:11.218Z level=INFO msg="downloading file" name=dns/cnames signed_at="2026-09-30 10:51:09.87 +0000 UTC" signed_by="9Y0jWyLbOkydLfnHi/etyd277lcgg+7vigYaum+aaFY=" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2258651.240301] client systemd[1]: Starting Reload unbound zone configuration...
client # [2258651.242993] client data-mesher[213]: time=2026-09-30T10:51:11.228Z level=INFO msg="received state sync from peer" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2258651.242993] client data-mesher[213]: time=2026-09-30T10:51:11.228Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2258651.243111] client data-mesher[213]: time=2026-09-30T10:51:11.228Z level=DEBUG msg="new file detected" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ name=dns/cnames name=dns/cnames
client # [2258651.245855] client data-mesher[213]: time=2026-09-30T10:51:11.231Z level=INFO msg="download complete" name=dns/cnames signed_at="2026-09-30 10:51:09.87 +0000 UTC" signed_by="9Y0jWyLbOkydLfnHi/etyd277lcgg+7vigYaum+aaFY=" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ written=true elapsed=13.383224ms
client # [2258651.301181] client unbound[293]: [293:0] info: service stopped (unbound 1.26.1).
client # [2258651.301667] client unbound-control[301]: ok
client # [2258651.301857] client unbound[293]: [293:0] info: server stats for thread 0: 5 queries, 0 answers from cache, 5 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [2258651.301867] client unbound[293]: [293:0] info: server stats for thread 0: requestlist max 2 avg 1.6 exceeded 0 jostled 0
client # [2258651.303757] client unbound[293]: [293:0] notice: Restart of unbound 1.26.1.
client # [2258651.304493] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [2258651.304702] client systemd[1]: Finished Reload unbound zone configuration.
client # [2258651.305600] client unbound[293]: [293:0] notice: init module 0: validator
client # [2258651.305722] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2258651.316095] client unbound[293]: [293:0] info: start of service (unbound 1.26.1).
client # [2258651.457635] client systemd-networkd[207]: eth1: Link DOWN
client # [2258651.457659] client systemd-networkd[207]: eth1: Lost carrier
client # [2258651.484714] client systemd-networkd[207]: eth1: Lost IPv6LL address fe80::3475:4ff:fe7c:3331.
kill NspawnMachine (pid 53)
server # [2258651.231518] server data-mesher[222]: time=2026-09-30T10:51:11.217Z level=INFO msg="received state sync from peer" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2258651.231518] server data-mesher[222]: time=2026-09-30T10:51:11.217Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2258651.233057] server data-mesher[222]: time=2026-09-30T10:51:11.218Z level=INFO msg="received file request" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 network="SsPnUh43hHu+zIo1q0DQhN4pLD7iW5mx/wl6geJG7vo=" name=dns/cnames
server # [2258651.235013] server data-mesher[222]: time=2026-09-30T10:51:11.220Z level=INFO msg="file transfer complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 network="SsPnUh43hHu+zIo1q0DQhN4pLD7iW5mx/wl6geJG7vo=" name=dns/cnames
server # [2258651.242347] server data-mesher[222]: time=2026-09-30T10:51:11.228Z level=DEBUG msg="attempting push/pull" peer_count=1
server # [2258651.242453] server data-mesher[222]: time=2026-09-30T10:51:11.228Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2258651.243305] server data-mesher[222]: time=2026-09-30T10:51:11.229Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2258651.243305] server data-mesher[222]: time=2026-09-30T10:51:11.229Z level=INFO msg="state exchange complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2258651.243425] server data-mesher[222]: time=2026-09-30T10:51:11.229Z level=DEBUG msg="push/pull successful" interval=5s
Container client terminated by signal KILL.
Container server terminated by signal KILL.
(finished: cleanup, in 0.33 seconds)