build01: building n9nybdsc1gjbqhq5isbsq7zz1q1p8ya7-container-test-run-dm-dns.drv
Machine state will be reset. To keep it, pass --keep-machine-state
start all VLans
(finished: start all VLans, in 0.00 seconds)

Test will time out and terminate in 3600.0 seconds
run the VM test script
additionally exposed symbols:
    client, server,
    vlan1,
    start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh
start all VMs
client: systemd-nspawn running (pid 52)
server: systemd-nspawn running (pid 53)
client: Waiting for journal at /build/vm-state-client/var/log/journal...
server: Waiting for journal at /build/vm-state-server/var/log/journal...
(finished: start all VMs, in 0.00 seconds)
server: waiting for unit unbound.service
nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(server): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(server): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
░ Spawning container client on /build/vm-state-client.
░ Spawning container server on /build/vm-state-server.
client # No journal files were found.
client # No journal boot entry found for the specified boot (+0).
server # No journal files were found.
server # No journal boot entry found for the specified boot (+0).
client # [2690094.777162] client systemd-journald[90]: Journal started
client # [2690094.777223] client systemd-journald[90]: Runtime Journal (/run/log/journal/5134bb3640734c0890ae068cdf8983da) is 8M, max 2.5G, 2.4G free.
client # [2690094.793763] client systemd[1]: Finished Apply Kernel Variables.
client # [2690094.805204] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
client # [2690094.818656] client systemd[1]: Starting Flush Journal to Persistent Storage...
client # [2690094.819613] client systemd[1]: Starting Network Name Resolution...
client # [2690094.820382] client systemd[1]: Starting Create Static Device Nodes in /dev...
client # [2690094.830550] client systemd-journald[90]: Time spent on flushing to /var/log/journal/5134bb3640734c0890ae068cdf8983da is 1.876ms for 7 entries.
client # [2690094.830550] client systemd-journald[90]: System Journal (/var/log/journal/5134bb3640734c0890ae068cdf8983da) is 8M, max 4G, 3.9G free.
client # [2690094.854214] client systemd[1]: Finished Flush Journal to Persistent Storage.
client # [2690094.854704] client systemd[1]: Finished Create Static Device Nodes in /dev.
client # [2690094.855862] client systemd[1]: Reached target Preparation for Local File Systems.
client # [2690094.855966] client systemd[1]: Reached target Local File Systems.
client # [2690094.856826] client systemd[1]: Listening on Boot Loader Control Service Socket.
client # [2690094.856891] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
client # [2690094.857825] client systemd[1]: Starting Save Transient machine-id to Disk...
client # [2690094.858595] client systemd[1]: Starting Create System Files and Directories...
client # [2690094.858632] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
client # [2690094.876823] client systemd-tmpfiles[154]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
client # [2690094.877064] client systemd-tmpfiles[154]: fchmod() of /var/log/journal failed: Operation not permitted
client # [2690094.877826] client systemd-tmpfiles[154]: fchmod() of /var/log/journal/5134bb3640734c0890ae068cdf8983da failed: Operation not permitted
client # [2690094.878067] client systemd-tmpfiles[154]: fchmod() of /run/log/journal failed: Operation not permitted
client # [2690094.880011] client systemd[1]: Finished Create System Files and Directories.
client # [2690094.881087] client systemd[1]: Starting Rebuild Journal Catalog...
client # [2690094.881796] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...
client # [2690094.885233] client systemd[1]: Finished Save Transient machine-id to Disk.
client # [2690094.893055] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.
client # [2690094.899798] client systemd[1]: Finished Rebuild Journal Catalog.
client # [2690094.900833] client systemd[1]: Starting Update is Completed...
client # [2690094.911428] client systemd[1]: Finished Update is Completed.
client # [2690094.947529] client systemd[1]: Finished Firewall.
client # [2690094.947713] client systemd[1]: Reached target Preparation for Network.
client # [2690094.947937] client systemd[1]: Listening on Network Management Resolve Hook Socket.
client # [2690094.949167] client systemd[1]: Starting Network Management...
client # [2690095.624286] client systemd-networkd[208]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
client # [2690095.624374] client systemd-networkd[208]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
client # [2690095.633629] client systemd-networkd[208]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2690095.633792] client systemd-networkd[208]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2690095.633943] client systemd-networkd[208]: lo: Link UP
client # [2690095.633948] client systemd-networkd[208]: lo: Gained carrier
client # [2690095.634137] client systemd-networkd[208]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
client # [2690095.634492] client systemd[1]: Started Network Management.
client # [2690095.652265] client systemd-networkd[208]: eth1: Link UP
client # [2690095.652346] client systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
client # [2690095.652580] client systemd-networkd[208]: eth1: Gained carrier
client # [2690095.686511] client systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
client # [2690095.787806] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [2690094.776511] server systemd-journald[97]: Journal started
server # [2690094.776576] server systemd-journald[97]: Runtime Journal (/run/log/journal/304ab615babd4eabbb1c66e7355a2732) is 8M, max 2.5G, 2.4G free.
server # [2690094.793725] server systemd[1]: Finished Apply Kernel Variables.
server # [2690094.805166] server systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
server # [2690094.820713] server systemd[1]: Starting Flush Journal to Persistent Storage...
server # [2690094.821569] server systemd[1]: Starting Network Name Resolution...
server # [2690094.822235] server systemd[1]: Starting Create Static Device Nodes in /dev...
server # [2690094.831450] server systemd-journald[97]: Time spent on flushing to /var/log/journal/304ab615babd4eabbb1c66e7355a2732 is 1.758ms for 7 entries.
server # [2690094.831450] server systemd-journald[97]: System Journal (/var/log/journal/304ab615babd4eabbb1c66e7355a2732) is 8M, max 4G, 3.9G free.
server # [2690094.854191] server systemd[1]: Finished Flush Journal to Persistent Storage.
server # [2690094.854737] server systemd[1]: Finished Create Static Device Nodes in /dev.
server # [2690094.855909] server systemd[1]: Reached target Preparation for Local File Systems.
server # [2690094.856015] server systemd[1]: Reached target Local File Systems.
server # [2690094.856859] server systemd[1]: Listening on Boot Loader Control Service Socket.
server # [2690094.856916] server systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
server # [2690094.857776] server systemd[1]: Starting Save Transient machine-id to Disk...
server # [2690094.858596] server systemd[1]: Starting Create System Files and Directories...
server # [2690094.858633] server systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
server # [2690094.875764] server systemd-tmpfiles[161]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
server # [2690094.876023] server systemd-tmpfiles[161]: fchmod() of /var/log/journal failed: Operation not permitted
server # [2690094.876207] server systemd-tmpfiles[161]: fchmod() of /var/log/journal/304ab615babd4eabbb1c66e7355a2732 failed: Operation not permitted
server # [2690094.876455] server systemd-tmpfiles[161]: fchmod() of /run/log/journal failed: Operation not permitted
server # [2690094.877877] server systemd[1]: Finished Create System Files and Directories.
server # [2690094.879023] server systemd[1]: Starting Rebuild Journal Catalog...
server # [2690094.880225] server systemd[1]: Starting Record System Boot/Shutdown in UTMP...
server # [2690094.885088] server systemd[1]: Finished Save Transient machine-id to Disk.
server # [2690094.893608] server systemd[1]: Finished Record System Boot/Shutdown in UTMP.
server # [2690094.904728] server systemd[1]: Finished Rebuild Journal Catalog.
server # [2690094.905707] server systemd[1]: Starting Update is Completed...
server # [2690094.915962] server systemd[1]: Finished Update is Completed.
server # [2690094.948556] server systemd[1]: Finished Firewall.
server # [2690094.948734] server systemd[1]: Reached target Preparation for Network.
server # [2690094.948974] server systemd[1]: Listening on Network Management Resolve Hook Socket.
server # [2690094.950073] server systemd[1]: Starting Network Management...
server # [2690095.608644] server systemd-networkd[215]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
server # [2690095.608735] server systemd-networkd[215]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
server # [2690095.618774] server systemd-networkd[215]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2690095.618940] server systemd-networkd[215]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2690095.619101] server systemd-networkd[215]: lo: Link UP
server # [2690095.619105] server systemd-networkd[215]: lo: Gained carrier
server # [2690095.619299] server systemd-networkd[215]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
server # [2690095.619730] server systemd[1]: Started Network Management.
server # [2690095.619754] server systemd-networkd[215]: eth1: Link UP
server # [2690095.620674] server systemd-networkd[215]: eth1: Gained carrier
server # [2690095.621435] server systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
server # [2690095.670353] server systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
server # [2690095.787031] server systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [2690095.978935] server systemd-resolved[136]: Positive Trust Anchors:
server # [2690095.978948] server systemd-resolved[136]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
server # [2690095.978950] server systemd-resolved[136]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
server # [2690095.978985] server systemd-resolved[136]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
server # [2690095.999446] server systemd-resolved[136]: Using system hostname 'server'.
server # [2690096.000805] server systemd[1]: Started Network Name Resolution.
server # [2690096.000884] server systemd[1]: Reached target Network.
server # [2690096.000949] server systemd[1]: Reached target System Initialization.
server # [2690096.001031] server systemd[1]: Started Watch for zone file changes.
server # [2690096.001054] server systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
server # [2690096.001076] server systemd[1]: Started Daily Cleanup of Temporary Directories.
server # [2690096.001092] server systemd[1]: Reached target Path Units.
server # [2690096.001124] server systemd[1]: Reached target Timer Units.
server # [2690096.001242] server systemd[1]: Listening on D-Bus System Message Bus Socket.
server # [2690096.001350] server systemd[1]: Listening on Nix Daemon Socket.
server # [2690096.001452] server systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
server # [2690096.001468] server systemd[1]: Reached target Socket Units.
server # [2690096.001504] server systemd[1]: Reached target Basic System.
server # [2690096.002767] server systemd[1]: Starting data mesher daemon...
server # [2690096.003686] server systemd[1]: Starting Import lastlog data into lastlog2 database...
server # [2690096.004567] server systemd[1]: Starting Name Service Cache Daemon (nsncd)...
server # [2690096.005902] server systemd[1]: Starting D-Bus System Message Bus...
server # [2690096.067042] server systemd[1]: Finished Import lastlog data into lastlog2 database.
client # [2690095.983527] client systemd-resolved[128]: Positive Trust Anchors:
client # [2690095.983538] client systemd-resolved[128]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
client # [2690095.983542] client systemd-resolved[128]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
client # [2690095.983576] client systemd-resolved[128]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
client # [2690096.003588] client systemd-resolved[128]: Using system hostname 'client'.
client # [2690096.004922] client systemd[1]: Started Network Name Resolution.
client # [2690096.004995] client systemd[1]: Reached target Network.
client # [2690096.005060] client systemd[1]: Reached target System Initialization.
client # [2690096.005135] client systemd[1]: Started Watch for zone file changes.
client # [2690096.005157] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
client # [2690096.005179] client systemd[1]: Started Daily Cleanup of Temporary Directories.
client # [2690096.005195] client systemd[1]: Reached target Path Units.
client # [2690096.005226] client systemd[1]: Reached target Timer Units.
client # [2690096.005342] client systemd[1]: Listening on D-Bus System Message Bus Socket.
client # [2690096.005444] client systemd[1]: Listening on Nix Daemon Socket.
client # [2690096.005554] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
client # [2690096.005570] client systemd[1]: Reached target Socket Units.
client # [2690096.005604] client systemd[1]: Reached target Basic System.
client # [2690096.006801] client systemd[1]: Starting data mesher daemon...
client # [2690096.049081] client systemd[1]: Starting Import lastlog data into lastlog2 database...
client # [2690096.050630] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...
client # [2690096.054085] client systemd[1]: Starting D-Bus System Message Bus...
client # [2690096.071612] client systemd[1]: Finished Import lastlog data into lastlog2 database.
client # [2690096.310549] client systemd[1]: Started Name Service Cache Daemon (nsncd).
client # [2690096.310666] client systemd[1]: Reached target User and Group Name Lookups.
client # [2690096.311387] client nsncd[216]: Oct 05 10:41:56.297 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [2690096.317805] client systemd[1]: Starting User Login Management...
client # [2690096.319256] client systemd[1]: Starting Permit User Sessions...
client # [2690096.332132] client systemd[1]: Finished Permit User Sessions.
client # [2690096.333462] client systemd[1]: Started Console Getty.
client # [2690096.333527] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
client # [2690096.333553] client systemd[1]: Reached target Login Prompts.
client # [2690096.501441] client dbus-broker-launch[218]: Looking up NSS user entry for 'systemd-timesync'...
client # [2690096.503194] client dbus-broker-launch[218]: NSS returned no entry for 'systemd-timesync'
client # [2690096.503194] client dbus-broker-launch[218]: Invalid user-name in /nix/store/rm3nnhp54336ggb7va6vwyq0bk4fwkjc-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
client # [2690096.503629] client systemd[1]: Started D-Bus System Message Bus.
client # [2690096.512236] client dbus-broker-launch[218]: Ready
server # [2690096.371168] server systemd[1]: Started Name Service Cache Daemon (nsncd).
server # [2690096.371257] server systemd[1]: Reached target User and Group Name Lookups.
server # [2690096.371396] server nsncd[222]: Oct 05 10:41:56.357 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
server # [2690096.372797] server systemd[1]: Starting User Login Management...
server # [2690096.373814] server systemd[1]: Starting Permit User Sessions...
server # [2690096.386342] server systemd[1]: Finished Permit User Sessions.
server # [2690096.387949] server systemd[1]: Started Console Getty.
server # [2690096.388050] server systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
server # [2690096.388094] server systemd[1]: Reached target Login Prompts.
server # [2690096.518150] server dbus-broker-launch[223]: Looking up NSS user entry for 'systemd-timesync'...
server # [2690096.519858] server dbus-broker-launch[223]: NSS returned no entry for 'systemd-timesync'
server # [2690096.519858] server dbus-broker-launch[223]: Invalid user-name in /nix/store/7vryjz4vlh8sj5pbsrw9xzvcaayfaw7d-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
server # [2690096.520328] server systemd[1]: Started D-Bus System Message Bus.
server # [2690096.528790] server dbus-broker-launch[223]: Ready
server # [2690096.898048] server data-mesher[220]: time=2026-10-05T10:41:56.883Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
server # [2690096.899145] server data-mesher[220]: time=2026-10-05T10:41:56.884Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4: [/dns/client.test/tcp/7946]} {12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
server # [2690096.899186] server data-mesher[220]: time=2026-10-05T10:41:56.884Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
server # [2690096.907576] server data-mesher[220]: time=2026-10-05T10:41:56.893Z level=INFO msg="checking file integrity"
server # [2690096.907822] server data-mesher[220]: time=2026-10-05T10:41:56.893Z level=INFO msg="file integrity check complete"
server # [2690096.912548] server data-mesher[220]: time=2026-10-05T10:41:56.898Z level=INFO msg="libp2p host created" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"
server # [2690096.913002] server data-mesher[220]: time=2026-10-05T10:41:56.898Z level=INFO msg="registered HTTP route" method=GET path=/files
server # [2690096.913002] server data-mesher[220]: time=2026-10-05T10:41:56.898Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
server # [2690096.913002] server data-mesher[220]: time=2026-10-05T10:41:56.898Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
server # [2690096.913002] server data-mesher[220]: time=2026-10-05T10:41:56.898Z level=INFO msg="starting server"
server # [2690096.913260] server data-mesher[220]: time=2026-10-05T10:41:56.899Z level=INFO msg="waiting for DHT to populate" delay=10s
server # [2690096.913260] server data-mesher[220]: time=2026-10-05T10:41:56.899Z level=INFO msg="HTTP server listening" address=[::1]:7331
server # [2690096.913894] server data-mesher[220]: time=2026-10-05T10:41:56.899Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
server # [2690096.917897] server data-mesher[220]: time=2026-10-05T10:41:56.903Z level=INFO msg="peer connected" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 remote_addr=/ip4/192.168.1.1/tcp/7946
server # [2690096.945811] server data-mesher[220]: time=2026-10-05T10:41:56.931Z level=INFO msg="peer connected" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 remote_addr=/ip4/192.168.1.1/tcp/42556
server # [2690096.960228] server systemd-networkd[215]: eth1: Gained IPv6LL
server # [2690097.168729] server systemd-logind[240]: New seat seat0.
client # [2690096.904638] client data-mesher[213]: time=2026-10-05T10:41:56.890Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
client # [2690096.905691] client data-mesher[213]: time=2026-10-05T10:41:56.891Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4: [/dns/client.test/tcp/7946]} {12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
client # [2690096.905691] client data-mesher[213]: time=2026-10-05T10:41:56.891Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
client # [2690096.907667] client data-mesher[213]: time=2026-10-05T10:41:56.893Z level=INFO msg="checking file integrity"
client # [2690096.907773] client data-mesher[213]: time=2026-10-05T10:41:56.893Z level=INFO msg="file integrity check complete"
client # [2690096.911643] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="libp2p host created" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"
client # [2690096.911715] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="registered HTTP route" method=GET path=/files
client # [2690096.911715] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
client # [2690096.911715] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
client # [2690096.911715] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="starting server"
client # [2690096.911813] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="waiting for DHT to populate" delay=10s
client # [2690096.911918] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="HTTP server listening" address=[::1]:7331
client # [2690096.911952] client data-mesher[213]: time=2026-10-05T10:41:56.897Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
client # [2690096.918529] client data-mesher[213]: time=2026-10-05T10:41:56.904Z level=INFO msg="peer connected" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2690096.945192] client data-mesher[213]: time=2026-10-05T10:41:56.930Z level=INFO msg="peer connected" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2690097.130223] client systemd-logind[233]: New seat seat0.
client # [2690097.130417] client systemd[1]: Started User Login Management.
client # [2690097.132773] client systemd[1]: Starting linger-users.service...
client # [2690097.151312] client systemd[1]: linger-users.service: Deactivated successfully.
client # [2690097.151586] client systemd[1]: Finished linger-users.service.
client # [2690097.184217] client systemd-networkd[208]: eth1: Gained IPv6LL
server # [2690097.168923] server systemd[1]: Started User Login Management.
server # [2690097.170885] server systemd[1]: Starting linger-users.service...
server # [2690097.187758] server systemd[1]: linger-users.service: Deactivated successfully.
server # [2690097.188073] server systemd[1]: Finished linger-users.service.
server: still waiting for container 'server' to reach ready state...
server # [2690106.913039] server data-mesher[220]: time=2026-10-05T10:42:06.898Z level=INFO msg="received state sync from peer" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2690106.913039] server data-mesher[220]: time=2026-10-05T10:42:06.898Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2690106.913840] server data-mesher[220]: time=2026-10-05T10:42:06.899Z level=INFO msg="performing state exchange with peers on join" count=1
server # [2690106.913840] server data-mesher[220]: time=2026-10-05T10:42:06.899Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2690106.914422] server data-mesher[220]: time=2026-10-05T10:42:06.900Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2690106.914422] server data-mesher[220]: time=2026-10-05T10:42:06.900Z level=INFO msg="state exchange complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2690106.914552] server data-mesher[220]: time=2026-10-05T10:42:06.900Z level=INFO msg="server started"
server # [2690106.914771] server systemd[1]: Started data mesher daemon.
server # [2690106.915357] server data-mesher[220]: time=2026-10-05T10:42:06.900Z level=INFO msg="starting expired-file sweeper" interval=1m0s
server # [2690106.917103] server systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2690106.912305] client data-mesher[213]: time=2026-10-05T10:42:06.898Z level=INFO msg="performing state exchange with peers on join" count=1
client # [2690106.913082] client data-mesher[213]: time=2026-10-05T10:42:06.898Z level=DEBUG msg="initiating state exchange" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2690106.913869] client data-mesher[213]: time=2026-10-05T10:42:06.899Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2690106.914107] client data-mesher[213]: time=2026-10-05T10:42:06.899Z level=INFO msg="state exchange complete" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2690106.914183] client data-mesher[213]: time=2026-10-05T10:42:06.899Z level=INFO msg="received state sync from peer" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2690106.914183] client data-mesher[213]: time=2026-10-05T10:42:06.899Z level=INFO msg="server started"
client # [2690106.914183] client data-mesher[213]: time=2026-10-05T10:42:06.899Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2690106.914324] client data-mesher[213]: time=2026-10-05T10:42:06.900Z level=INFO msg="starting expired-file sweeper" interval=1m0s
client # [2690106.914457] client systemd[1]: Started data mesher daemon.
client # [2690106.917145] client systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2690107.782823] client unbound-pre-start[277]: Root anchor updated!
client # [2690107.800814] client unbound-pre-start[281]: setup in directory /var/lib/unbound
server # [2690107.794075] server unbound-pre-start[282]: Root anchor updated!
server # [2690107.807327] server unbound-pre-start[286]: setup in directory /var/lib/unbound
server # [2690108.489761] server unbound-pre-start[295]: Certificate request self-signature ok
server # [2690108.489761] server unbound-pre-start[295]: subject=CN=unbound-control
server # [2690108.510150] server unbound-pre-start[286]: removing artifacts
server # [2690108.512266] server unbound-pre-start[286]: Setup success. Certificates created. Enable in unbound.conf file to use
server: (finished: waiting for unit unbound.service, in 15.68 seconds)
client: waiting for unit unbound.service
server # [2690109.394191] server unbound[299]: [299:0] notice: init module 0: validator
server # [2690109.394268] server unbound[299]: [299:0] notice: init module 1: iterator
server # [2690109.398435] server unbound[299]: [299:0] info: start of service (unbound 1.26.1).
server # [2690109.398587] server systemd[1]: Started Unbound recursive Domain Name Server.
server # [2690109.399093] server systemd[1]: Reached target Multi-User System.
server # [2690109.399362] server systemd[1]: Reached target Host and Network Name Lookups.
server # [2690109.401221] server systemd[1]: Starting Reload unbound zone configuration...
server # [2690109.441556] server unbound[299]: [299:0] info: service stopped (unbound 1.26.1).
server # [2690109.441897] server unbound-control[303]: ok
server # [2690109.441923] server unbound[299]: [299:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2690109.441929] server unbound[299]: [299:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
server # [2690109.442838] server unbound[299]: [299:0] notice: Restart of unbound 1.26.1.
server # [2690109.443566] server unbound[299]: [299:0] notice: init module 0: validator
server # [2690109.443622] server unbound[299]: [299:0] notice: init module 1: iterator
server # [2690109.444279] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2690109.444557] server systemd[1]: Finished Reload unbound zone configuration.
server # [2690109.445029] server systemd[1]: Startup finished in 15.047s.
server # [2690109.447647] server unbound[299]: [299:0] info: start of service (unbound 1.26.1).
client # [2690110.902128] client unbound-pre-start[290]: Certificate request self-signature ok
client # [2690110.902128] client unbound-pre-start[290]: subject=CN=unbound-control
client # [2690110.921393] client unbound-pre-start[281]: removing artifacts
client # [2690110.923549] client unbound-pre-start[281]: Setup success. Certificates created. Enable in unbound.conf file to use
client # [2690111.793059] client unbound[294]: [294:0] notice: init module 0: validator
client # [2690111.793134] client unbound[294]: [294:0] notice: init module 1: iterator
client # [2690111.797279] client unbound[294]: [294:0] info: start of service (unbound 1.26.1).
client # [2690111.797463] client systemd[1]: Started Unbound recursive Domain Name Server.
client # [2690111.798017] client systemd[1]: Reached target Multi-User System.
client # [2690111.798279] client systemd[1]: Reached target Host and Network Name Lookups.
client # [2690111.799971] client systemd[1]: Starting Reload unbound zone configuration...
client # [2690111.857311] client unbound[294]: [294:0] info: service stopped (unbound 1.26.1).
client # [2690111.857642] client unbound-control[298]: ok
client # [2690111.857643] client unbound[294]: [294:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [2690111.857649] client unbound[294]: [294:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
client # [2690111.858524] client unbound[294]: [294:0] notice: Restart of unbound 1.26.1.
client # [2690111.859241] client unbound[294]: [294:0] notice: init module 0: validator
client # [2690111.859376] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [2690111.859297] client unbound[294]: [294:0] notice: init module 1: iterator
client # [2690111.859696] client systemd[1]: Finished Reload unbound zone configuration.
client # [2690111.860440] client systemd[1]: Startup finished in 17.479s.
client # [2690111.863265] client unbound[294]: [294:0] info: start of service (unbound 1.26.1).
client # [2690111.916191] client data-mesher[213]: time=2026-10-05T10:42:11.901Z level=DEBUG msg="attempting push/pull" peer_count=1
client # [2690111.916858] client data-mesher[213]: time=2026-10-05T10:42:11.902Z level=DEBUG msg="initiating state exchange" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2690111.917396] client data-mesher[213]: time=2026-10-05T10:42:11.903Z level=INFO msg="received state sync from peer" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2690111.917396] client data-mesher[213]: time=2026-10-05T10:42:11.903Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2690111.917784] client data-mesher[213]: time=2026-10-05T10:42:11.903Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2690111.917784] client data-mesher[213]: time=2026-10-05T10:42:11.903Z level=INFO msg="state exchange complete" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2690111.917893] client data-mesher[213]: time=2026-10-05T10:42:11.903Z level=DEBUG msg="push/pull successful" interval=5s
client: (finished: waiting for unit unbound.service, in 2.66 seconds)
server: waiting for unit data-mesher.service
server: (finished: waiting for unit data-mesher.service, in 0.02 seconds)
server: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1, in 0.03 seconds)
server: must succeed: data-mesher file update --network-id /nix/store/0a5mpxfya7m0p21561xg0bxln21lryjy-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames
server # [2690111.916311] server data-mesher[220]: time=2026-10-05T10:42:11.902Z level=DEBUG msg="attempting push/pull" peer_count=1
server # [2690111.917003] server data-mesher[220]: time=2026-10-05T10:42:11.902Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2690111.917003] server data-mesher[220]: time=2026-10-05T10:42:11.902Z level=INFO msg="received state sync from peer" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2690111.917281] server data-mesher[220]: time=2026-10-05T10:42:11.903Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2690111.917715] server data-mesher[220]: time=2026-10-05T10:42:11.903Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2690111.917715] server data-mesher[220]: time=2026-10-05T10:42:11.903Z level=INFO msg="state exchange complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2690111.917822] server data-mesher[220]: time=2026-10-05T10:42:11.903Z level=DEBUG msg="push/pull successful" interval=5s
server: (finished: must succeed: data-mesher file update --network-id /nix/store/0a5mpxfya7m0p21561xg0bxln21lryjy-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames, in 0.04 seconds)
??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/x4i03lhka9aiwxswmbhjfzzbl77nlxmj-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test
??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/x4i03lhka9aiwxswmbhjfzzbl77nlxmj-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server # [2690112.230748] server systemd[1]: Starting Reload unbound zone configuration...
server # [2690112.232655] server data-mesher[220]: time=2026-10-05T10:42:12.218Z level=INFO msg=http_request uri=/files/dns/cnames status=204
server # [2690112.264960] server unbound[299]: [299:0] info: service stopped (unbound 1.26.1).
server # [2690112.265457] server unbound-control[337]: ok
server # [2690112.265639] server unbound[299]: [299:0] info: server stats for thread 0: 9 queries, 2 answers from cache, 7 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2690112.265648] server unbound[299]: [299:0] info: server stats for thread 0: requestlist max 2 avg 1.71429 exceeded 0 jostled 0
server # [2690112.266353] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2690112.266569] server systemd[1]: Finished Reload unbound zone configuration.
server # [2690112.267454] server unbound[299]: [299:0] notice: Restart of unbound 1.26.1.
server # [2690112.269290] server unbound[299]: [299:0] notice: init module 0: validator
server # [2690112.269409] server unbound[299]: [299:0] notice: init module 1: iterator
server # [2690112.279738] server unbound[299]: [299:0] info: start of service (unbound 1.26.1).
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test, in 1.05 seconds)
(finished: run the VM test script, in 19.47 seconds)
test script finished in 19.52s
cleanup
kill NspawnMachine (pid 52)
kill NspawnMachine (pid 53)
Container client terminated by signal KILL.
(finished: cleanup, in 0.28 seconds)
Container server terminated by signal KILL.