build01: building qd2khjpi33mdi0czsj46ykmlnwx10wvy-container-test-run-dm-dns.drv
Machine state will be reset. To keep it, pass --keep-machine-state
start all VLans
(finished: start all VLans, in 0.00 seconds)

Test will time out and terminate in 3600.0 seconds
run the VM test script
additionally exposed symbols:
    client, server,
    vlan1,
    start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh
start all VMs
client: systemd-nspawn running (pid 52)
server: systemd-nspawn running (pid 53)
client: Waiting for journal at /build/vm-state-client/var/log/journal...
server: Waiting for journal at /build/vm-state-server/var/log/journal...
(finished: start all VMs, in 0.00 seconds)
server: waiting for unit unbound.service
nixos-nspawn(server): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(server): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
░ Spawning container server on /build/vm-state-server.
░ Spawning container client on /build/vm-state-client.
client # No journal files were found.
client # No journal boot entry found for the specified boot (+0).
server # No journal files were found.
server # No journal boot entry found for the specified boot (+0).
client # [2465765.076252] client systemd-journald[90]: Journal started
client # [2465765.076314] client systemd-journald[90]: Runtime Journal (/run/log/journal/8519d9a2f6f140aa96f488312dd02558) is 8M, max 2.5G, 2.4G free.
client # [2465765.079373] client systemd[1]: Finished Apply Kernel Variables.
client # [2465765.090631] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
client # [2465765.103141] client systemd[1]: Starting Flush Journal to Persistent Storage...
client # [2465765.104022] client systemd[1]: Starting Network Name Resolution...
client # [2465765.104788] client systemd[1]: Starting Create Static Device Nodes in /dev...
client # [2465765.114435] client systemd-journald[90]: Time spent on flushing to /var/log/journal/8519d9a2f6f140aa96f488312dd02558 is 1.549ms for 7 entries.
client # [2465765.114435] client systemd-journald[90]: System Journal (/var/log/journal/8519d9a2f6f140aa96f488312dd02558) is 8M, max 4G, 3.9G free.
client # [2465765.127415] client systemd[1]: Finished Create Static Device Nodes in /dev.
client # [2465765.127987] client systemd[1]: Reached target Preparation for Local File Systems.
client # [2465765.128126] client systemd[1]: Reached target Local File Systems.
client # [2465765.128993] client systemd[1]: Listening on Boot Loader Control Service Socket.
client # [2465765.129041] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
client # [2465765.129907] client systemd[1]: Starting Save Transient machine-id to Disk...
client # [2465765.129942] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
client # [2465765.131865] client systemd[1]: Finished Flush Journal to Persistent Storage.
client # [2465765.132750] client systemd[1]: Starting Create System Files and Directories...
client # [2465765.152213] client systemd-tmpfiles[140]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
client # [2465765.152424] client systemd-tmpfiles[140]: fchmod() of /var/log/journal failed: Operation not permitted
client # [2465765.152569] client systemd-tmpfiles[140]: fchmod() of /var/log/journal/8519d9a2f6f140aa96f488312dd02558 failed: Operation not permitted
client # [2465765.152788] client systemd-tmpfiles[140]: fchmod() of /run/log/journal failed: Operation not permitted
client # [2465765.154613] client systemd[1]: Finished Create System Files and Directories.
client # [2465765.155949] client systemd[1]: Starting Rebuild Journal Catalog...
client # [2465765.156697] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...
client # [2465765.170469] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.
client # [2465765.174572] client systemd[1]: Finished Save Transient machine-id to Disk.
client # [2465765.180280] client systemd[1]: Finished Rebuild Journal Catalog.
client # [2465765.181896] client systemd[1]: Starting Update is Completed...
client # [2465765.194763] client systemd[1]: Finished Update is Completed.
client # [2465765.256044] client systemd[1]: Finished Firewall.
client # [2465765.256564] client systemd[1]: Reached target Preparation for Network.
client # [2465765.257248] client systemd[1]: Listening on Network Management Resolve Hook Socket.
client # [2465765.258897] client systemd[1]: Starting Network Management...
client # [2465765.947591] client systemd-networkd[208]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
client # [2465765.947680] client systemd-networkd[208]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
client # [2465765.956891] client systemd-networkd[208]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2465765.957058] client systemd-networkd[208]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [2465765.957207] client systemd-networkd[208]: lo: Link UP
client # [2465765.957211] client systemd-networkd[208]: lo: Gained carrier
client # [2465765.957378] client systemd-networkd[208]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
client # [2465765.957798] client systemd[1]: Started Network Management.
client # [2465765.984322] client systemd-networkd[208]: eth1: Link UP
client # [2465765.984658] client systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
client # [2465765.984677] client systemd-networkd[208]: eth1: Gained carrier
client # [2465766.034273] client systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
server # [2465765.075226] server systemd-journald[98]: Journal started
server # [2465765.075290] server systemd-journald[98]: Runtime Journal (/run/log/journal/ef5901844c0c4b96aaa20639de9f8212) is 8M, max 2.5G, 2.4G free.
server # [2465765.084263] server systemd[1]: Finished Apply Kernel Variables.
server # [2465765.097617] server systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
server # [2465765.110446] server systemd[1]: Starting Flush Journal to Persistent Storage...
server # [2465765.111321] server systemd[1]: Starting Network Name Resolution...
server # [2465765.112177] server systemd[1]: Starting Create Static Device Nodes in /dev...
server # [2465765.122172] server systemd-journald[98]: Time spent on flushing to /var/log/journal/ef5901844c0c4b96aaa20639de9f8212 is 1.791ms for 7 entries.
server # [2465765.122172] server systemd-journald[98]: System Journal (/var/log/journal/ef5901844c0c4b96aaa20639de9f8212) is 8M, max 4G, 3.9G free.
server # [2465765.137921] server systemd[1]: Finished Flush Journal to Persistent Storage.
server # [2465765.138480] server systemd[1]: Finished Create Static Device Nodes in /dev.
server # [2465765.139984] server systemd[1]: Reached target Preparation for Local File Systems.
server # [2465765.140119] server systemd[1]: Reached target Local File Systems.
server # [2465765.140968] server systemd[1]: Listening on Boot Loader Control Service Socket.
server # [2465765.141026] server systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
server # [2465765.141853] server systemd[1]: Starting Save Transient machine-id to Disk...
server # [2465765.142695] server systemd[1]: Starting Create System Files and Directories...
server # [2465765.142729] server systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
server # [2465765.162963] server systemd-tmpfiles[153]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
server # [2465765.163184] server systemd-tmpfiles[153]: fchmod() of /var/log/journal failed: Operation not permitted
server # [2465765.163337] server systemd-tmpfiles[153]: fchmod() of /var/log/journal/ef5901844c0c4b96aaa20639de9f8212 failed: Operation not permitted
server # [2465765.163564] server systemd-tmpfiles[153]: fchmod() of /run/log/journal failed: Operation not permitted
server # [2465765.167284] server systemd[1]: Finished Create System Files and Directories.
server # [2465765.169315] server systemd[1]: Starting Rebuild Journal Catalog...
server # [2465765.170025] server systemd[1]: Starting Record System Boot/Shutdown in UTMP...
server # [2465765.174341] server systemd[1]: Finished Save Transient machine-id to Disk.
server # [2465765.183641] server systemd[1]: Finished Record System Boot/Shutdown in UTMP.
server # [2465765.192853] server systemd[1]: Finished Rebuild Journal Catalog.
server # [2465765.193910] server systemd[1]: Starting Update is Completed...
server # [2465765.204066] server systemd[1]: Finished Update is Completed.
server # [2465765.259841] server systemd[1]: Finished Firewall.
server # [2465765.260023] server systemd[1]: Reached target Preparation for Network.
server # [2465765.260255] server systemd[1]: Listening on Network Management Resolve Hook Socket.
server # [2465765.261270] server systemd[1]: Starting Network Management...
server # [2465765.924315] server systemd-networkd[216]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
server # [2465765.924408] server systemd-networkd[216]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
server # [2465765.936114] server systemd-networkd[216]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2465765.936286] server systemd-networkd[216]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2465765.936437] server systemd-networkd[216]: lo: Link UP
server # [2465765.936441] server systemd-networkd[216]: lo: Gained carrier
server # [2465765.936612] server systemd-networkd[216]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
server # [2465765.937078] server systemd[1]: Started Network Management.
server # [2465765.937090] server systemd-networkd[216]: eth1: Link UP
server # [2465765.937392] server systemd-networkd[216]: eth1: Gained carrier
server # [2465765.938350] server systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
server # [2465765.993444] server systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
server # [2465766.083589] server systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
client # [2465766.083798] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
client # [2465766.175208] client systemd-resolved[120]: Positive Trust Anchors:
client # [2465766.175219] client systemd-resolved[120]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
client # [2465766.175222] client systemd-resolved[120]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
client # [2465766.175258] client systemd-resolved[120]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
client # [2465766.196012] client systemd-resolved[120]: Using system hostname 'client'.
client # [2465766.197378] client systemd[1]: Started Network Name Resolution.
client # [2465766.197503] client systemd[1]: Reached target Network.
client # [2465766.197627] client systemd[1]: Reached target System Initialization.
client # [2465766.197787] client systemd[1]: Started Watch for zone file changes.
client # [2465766.197841] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
client # [2465766.197887] client systemd[1]: Started Daily Cleanup of Temporary Directories.
client # [2465766.197923] client systemd[1]: Reached target Path Units.
client # [2465766.197988] client systemd[1]: Reached target Timer Units.
client # [2465766.198209] client systemd[1]: Listening on D-Bus System Message Bus Socket.
client # [2465766.198409] client systemd[1]: Listening on Nix Daemon Socket.
client # [2465766.198625] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
client # [2465766.198670] client systemd[1]: Reached target Socket Units.
client # [2465766.198744] client systemd[1]: Reached target Basic System.
client # [2465766.200982] client systemd[1]: Starting data mesher daemon...
client # [2465766.202333] client systemd[1]: Starting Import lastlog data into lastlog2 database...
client # [2465766.203839] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...
client # [2465766.206046] client systemd[1]: Starting D-Bus System Message Bus...
client # [2465766.259792] client systemd[1]: Finished Import lastlog data into lastlog2 database.
client # [2465766.461682] client systemd[1]: Started Name Service Cache Daemon (nsncd).
client # [2465766.461792] client systemd[1]: Reached target User and Group Name Lookups.
server # [2465766.181229] server systemd-resolved[131]: Positive Trust Anchors:
server # [2465766.181240] server systemd-resolved[131]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
server # [2465766.181243] server systemd-resolved[131]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
server # [2465766.181277] server systemd-resolved[131]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
server # [2465766.201502] server systemd-resolved[131]: Using system hostname 'server'.
server # [2465766.202846] server systemd[1]: Started Network Name Resolution.
server # [2465766.202973] server systemd[1]: Reached target Network.
server # [2465766.203105] server systemd[1]: Reached target System Initialization.
server # [2465766.203266] server systemd[1]: Started Watch for zone file changes.
server # [2465766.203319] server systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
server # [2465766.203368] server systemd[1]: Started Daily Cleanup of Temporary Directories.
server # [2465766.203408] server systemd[1]: Reached target Path Units.
server # [2465766.203476] server systemd[1]: Reached target Timer Units.
server # [2465766.203714] server systemd[1]: Listening on D-Bus System Message Bus Socket.
server # [2465766.203916] server systemd[1]: Listening on Nix Daemon Socket.
server # [2465766.204187] server systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
server # [2465766.204258] server systemd[1]: Reached target Socket Units.
server # [2465766.204347] server systemd[1]: Reached target Basic System.
server # [2465766.206486] server systemd[1]: Starting data mesher daemon...
server # [2465766.240558] server systemd[1]: Starting Import lastlog data into lastlog2 database...
server # [2465766.242205] server systemd[1]: Starting Name Service Cache Daemon (nsncd)...
server # [2465766.245547] server systemd[1]: Starting D-Bus System Message Bus...
server # [2465766.264784] server systemd[1]: Finished Import lastlog data into lastlog2 database.
server # [2465766.425644] server systemd[1]: Started Name Service Cache Daemon (nsncd).
server # [2465766.425754] server systemd[1]: Reached target User and Group Name Lookups.
server # [2465766.425975] server nsncd[224]: Oct 02 20:23:06.411 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
server # [2465766.428053] server systemd[1]: Starting User Login Management...
server # [2465766.429480] server systemd[1]: Starting Permit User Sessions...
client # [2465766.462102] client nsncd[215]: Oct 02 20:23:06.447 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [2465766.468981] client systemd[1]: Starting User Login Management...
client # [2465766.470360] client systemd[1]: Starting Permit User Sessions...
client # [2465766.482681] client systemd[1]: Finished Permit User Sessions.
client # [2465766.484602] client systemd[1]: Started Console Getty.
client # [2465766.484680] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
client # [2465766.484725] client systemd[1]: Reached target Login Prompts.
client # [2465766.590248] client dbus-broker-launch[216]: Looking up NSS user entry for 'systemd-timesync'...
client # [2465766.591220] client dbus-broker-launch[216]: NSS returned no entry for 'systemd-timesync'
client # [2465766.591220] client dbus-broker-launch[216]: Invalid user-name in /nix/store/183nyw6bp01sq9d03j91c48z7962xxr2-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
client # [2465766.591588] client systemd[1]: Started D-Bus System Message Bus.
client # [2465766.600202] client dbus-broker-launch[216]: Ready
server # [2465766.475978] server systemd[1]: Finished Permit User Sessions.
server # [2465766.477246] server systemd[1]: Started Console Getty.
server # [2465766.477298] server systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
server # [2465766.477320] server systemd[1]: Reached target Login Prompts.
server # [2465766.579791] server dbus-broker-launch[226]: Looking up NSS user entry for 'systemd-timesync'...
server # [2465766.581396] server dbus-broker-launch[226]: NSS returned no entry for 'systemd-timesync'
server # [2465766.581396] server dbus-broker-launch[226]: Invalid user-name in /nix/store/8pysqndnwvn0f44956g6vw4ari3gs8bw-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
server # [2465766.581806] server systemd[1]: Started D-Bus System Message Bus.
server # [2465766.589607] server dbus-broker-launch[226]: Ready
client # [2465766.997642] client data-mesher[213]: time=2026-10-02T20:23:06.983Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
client # [2465766.998689] client data-mesher[213]: time=2026-10-02T20:23:06.984Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4: [/dns/client.test/tcp/7946]} {12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
client # [2465766.998689] client data-mesher[213]: time=2026-10-02T20:23:06.984Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
client # [2465767.002668] client data-mesher[213]: time=2026-10-02T20:23:06.988Z level=INFO msg="checking file integrity"
client # [2465767.002795] client data-mesher[213]: time=2026-10-02T20:23:06.988Z level=INFO msg="file integrity check complete"
client # [2465767.006748] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="libp2p host created" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"
client # [2465767.006831] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="registered HTTP route" method=GET path=/files
client # [2465767.006831] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
client # [2465767.006831] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
client # [2465767.006831] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="starting server"
client # [2465767.006952] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="HTTP server listening" address=[::1]:7331
client # [2465767.006952] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
client # [2465767.007027] client data-mesher[213]: time=2026-10-02T20:23:06.992Z level=INFO msg="waiting for DHT to populate" delay=10s
client # [2465767.013524] client data-mesher[213]: time=2026-10-02T20:23:06.999Z level=INFO msg="peer connected" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2465767.041597] client data-mesher[213]: time=2026-10-02T20:23:07.027Z level=INFO msg="peer connected" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2465767.214270] client systemd-logind[233]: New seat seat0.
client # [2465767.214419] client systemd[1]: Started User Login Management.
client # [2465767.215669] client systemd[1]: Starting linger-users.service...
server # [2465766.995363] server data-mesher[221]: time=2026-10-02T20:23:06.981Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
server # [2465766.996697] server data-mesher[221]: time=2026-10-02T20:23:06.982Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4: [/dns/client.test/tcp/7946]} {12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
server # [2465766.996697] server data-mesher[221]: time=2026-10-02T20:23:06.982Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
server # [2465767.002798] server data-mesher[221]: time=2026-10-02T20:23:06.988Z level=INFO msg="checking file integrity"
server # [2465767.002910] server data-mesher[221]: time=2026-10-02T20:23:06.988Z level=INFO msg="file integrity check complete"
server # [2465767.006745] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="libp2p host created" peer_id=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"
server # [2465767.006817] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="registered HTTP route" method=GET path=/files
server # [2465767.006817] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
server # [2465767.006817] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
server # [2465767.006817] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="starting server"
server # [2465767.006996] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="waiting for DHT to populate" delay=10s
server # [2465767.006996] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="HTTP server listening" address=[::1]:7331
server # [2465767.007092] server data-mesher[221]: time=2026-10-02T20:23:06.992Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
server # [2465767.012848] server data-mesher[221]: time=2026-10-02T20:23:06.998Z level=INFO msg="peer connected" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 remote_addr=/ip4/192.168.1.1/tcp/7946
server # [2465767.042428] server data-mesher[221]: time=2026-10-02T20:23:07.028Z level=INFO msg="peer connected" peer_id=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 remote_addr=/ip4/192.168.1.1/tcp/34634
server # [2465767.229664] server systemd-logind[241]: New seat seat0.
server # [2465767.229837] server systemd[1]: Started User Login Management.
server # [2465767.248668] server systemd[1]: Starting linger-users.service...
client # [2465767.257984] client systemd[1]: linger-users.service: Deactivated successfully.
client # [2465767.258278] client systemd[1]: Finished linger-users.service.
server # [2465767.262944] server systemd[1]: linger-users.service: Deactivated successfully.
server # [2465767.263073] server systemd[1]: Finished linger-users.service.
server # [2465767.840233] server systemd-networkd[216]: eth1: Gained IPv6LL
client # [2465767.904162] client systemd-networkd[208]: eth1: Gained IPv6LL
server: still waiting for container 'server' to reach ready state...
client # [2465777.008277] client data-mesher[213]: time=2026-10-02T20:23:16.994Z level=INFO msg="performing state exchange with peers on join" count=1
client # [2465777.008277] client data-mesher[213]: time=2026-10-02T20:23:16.994Z level=DEBUG msg="initiating state exchange" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2465777.009109] client data-mesher[213]: time=2026-10-02T20:23:16.994Z level=INFO msg="received state sync from peer" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465777.009109] client data-mesher[213]: time=2026-10-02T20:23:16.994Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465777.010144] client data-mesher[213]: time=2026-10-02T20:23:16.995Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465777.010144] client data-mesher[213]: time=2026-10-02T20:23:16.995Z level=INFO msg="state exchange complete" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2465777.010266] client data-mesher[213]: time=2026-10-02T20:23:16.995Z level=INFO msg="server started"
client # [2465777.010322] client data-mesher[213]: time=2026-10-02T20:23:16.996Z level=INFO msg="starting expired-file sweeper" interval=1m0s
client # [2465777.010454] client systemd[1]: Started data mesher daemon.
client # [2465777.013114] client systemd[1]: Starting Unbound recursive Domain Name Server...
server # [2465777.007991] server data-mesher[221]: time=2026-10-02T20:23:16.993Z level=INFO msg="performing state exchange with peers on join" count=1
server # [2465777.008831] server data-mesher[221]: time=2026-10-02T20:23:16.993Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2465777.009697] server data-mesher[221]: time=2026-10-02T20:23:16.995Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2465777.009697] server data-mesher[221]: time=2026-10-02T20:23:16.995Z level=INFO msg="state exchange complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2465777.009822] server data-mesher[221]: time=2026-10-02T20:23:16.995Z level=INFO msg="received state sync from peer" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2465777.009822] server data-mesher[221]: time=2026-10-02T20:23:16.995Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2465777.009822] server data-mesher[221]: time=2026-10-02T20:23:16.995Z level=INFO msg="server started"
server # [2465777.010002] server data-mesher[221]: time=2026-10-02T20:23:16.995Z level=INFO msg="starting expired-file sweeper" interval=1m0s
server # [2465777.010097] server systemd[1]: Started data mesher daemon.
server # [2465777.012773] server systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2465777.917147] client unbound-pre-start[276]: Root anchor updated!
client # [2465777.932987] client unbound-pre-start[280]: setup in directory /var/lib/unbound
server # [2465777.917210] server unbound-pre-start[283]: Root anchor updated!
server # [2465777.933282] server unbound-pre-start[287]: setup in directory /var/lib/unbound
client # [2465779.965549] client unbound-pre-start[289]: Certificate request self-signature ok
client # [2465779.965549] client unbound-pre-start[289]: subject=CN=unbound-control
client # [2465779.985602] client unbound-pre-start[280]: removing artifacts
client # [2465779.987587] client unbound-pre-start[280]: Setup success. Certificates created. Enable in unbound.conf file to use
server # [2465780.285574] server unbound-pre-start[296]: Certificate request self-signature ok
server # [2465780.285574] server unbound-pre-start[296]: subject=CN=unbound-control
server # [2465780.305550] server unbound-pre-start[287]: removing artifacts
server # [2465780.307745] server unbound-pre-start[287]: Setup success. Certificates created. Enable in unbound.conf file to use
client # [2465780.865875] client unbound[293]: [293:0] notice: init module 0: validator
client # [2465780.865949] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2465780.870106] client unbound[293]: [293:0] info: start of service (unbound 1.26.1).
client # [2465780.870268] client systemd[1]: Started Unbound recursive Domain Name Server.
client # [2465780.870791] client systemd[1]: Reached target Multi-User System.
client # [2465780.871064] client systemd[1]: Reached target Host and Network Name Lookups.
client # [2465780.873124] client systemd[1]: Starting Reload unbound zone configuration...
client # [2465780.918184] client unbound[293]: [293:0] info: service stopped (unbound 1.26.1).
client # [2465780.918537] client unbound-control[297]: ok
client # [2465780.918545] client unbound[293]: [293:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [2465780.918550] client unbound[293]: [293:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
client # [2465780.919538] client unbound[293]: [293:0] notice: Restart of unbound 1.26.1.
client # [2465780.920285] client unbound[293]: [293:0] notice: init module 0: validator
client # [2465780.920341] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2465780.920481] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [2465780.920741] client systemd[1]: Finished Reload unbound zone configuration.
client # [2465780.921692] client systemd[1]: Startup finished in 16.326s.
client # [2465780.924286] client unbound[293]: [293:0] info: start of service (unbound 1.26.1).
server # [2465781.190462] server unbound[301]: [301:0] notice: init module 0: validator
server # [2465781.190547] server unbound[301]: [301:0] notice: init module 1: iterator
server # [2465781.194788] server unbound[301]: [301:0] info: start of service (unbound 1.26.1).
server # [2465781.194980] server systemd[1]: Started Unbound recursive Domain Name Server.
server # [2465781.195490] server systemd[1]: Reached target Multi-User System.
server # [2465781.195752] server systemd[1]: Reached target Host and Network Name Lookups.
server # [2465781.197608] server systemd[1]: Starting Reload unbound zone configuration...
server # [2465781.253180] server unbound[301]: [301:0] info: service stopped (unbound 1.26.1).
server # [2465781.253489] server unbound[301]: [301:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2465781.253585] server unbound-control[304]: ok
server # [2465781.253494] server unbound[301]: [301:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
server # [2465781.254427] server unbound[301]: [301:0] notice: Restart of unbound 1.26.1.
server # [2465781.255152] server unbound[301]: [301:0] notice: init module 0: validator
server # [2465781.255207] server unbound[301]: [301:0] notice: init module 1: iterator
server # [2465781.256458] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2465781.256641] server systemd[1]: Finished Reload unbound zone configuration.
server # [2465781.257004] server systemd[1]: Startup finished in 16.644s.
server # [2465781.259143] server unbound[301]: [301:0] info: start of service (unbound 1.26.1).
server: (finished: waiting for unit unbound.service, in 17.67 seconds)
client: waiting for unit unbound.service
client: (finished: waiting for unit unbound.service, in 0.02 seconds)
server: waiting for unit data-mesher.service
server: (finished: waiting for unit data-mesher.service, in 0.02 seconds)
server: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1, in 0.03 seconds)
server: must succeed: data-mesher file update --network-id /nix/store/0a5mpxfya7m0p21561xg0bxln21lryjy-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames
server: (finished: must succeed: data-mesher file update --network-id /nix/store/0a5mpxfya7m0p21561xg0bxln21lryjy-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames, in 0.05 seconds)
??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/drwj5qfqx9axxgf0jvxlavglj43fr2kh-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test
??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/drwj5qfqx9axxgf0jvxlavglj43fr2kh-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server # [2465781.802046] server systemd[1]: Starting Reload unbound zone configuration...
server # [2465781.818354] server data-mesher[221]: time=2026-10-02T20:23:21.804Z level=INFO msg=http_request uri=/files/dns/cnames status=204
server # [2465781.850082] server unbound-control[339]: ok
server # [2465781.850121] server unbound[301]: [301:0] info: service stopped (unbound 1.26.1).
server # [2465781.850606] server unbound[301]: [301:0] info: server stats for thread 0: 5 queries, 2 answers from cache, 3 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2465781.850612] server unbound[301]: [301:0] info: server stats for thread 0: requestlist max 2 avg 1.33333 exceeded 0 jostled 0
server # [2465781.851797] server unbound[301]: [301:0] notice: Restart of unbound 1.26.1.
server # [2465781.852483] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2465781.852695] server systemd[1]: Finished Reload unbound zone configuration.
server # [2465781.853690] server unbound[301]: [301:0] notice: init module 0: validator
server # [2465781.853784] server unbound[301]: [301:0] notice: init module 1: iterator
server # [2465781.859505] server unbound[301]: [301:0] info: start of service (unbound 1.26.1).
server # [2465782.010620] server data-mesher[221]: time=2026-10-02T20:23:21.996Z level=DEBUG msg="attempting push/pull" peer_count=1
server # [2465782.010728] server data-mesher[221]: time=2026-10-02T20:23:21.996Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2465782.010933] server data-mesher[221]: time=2026-10-02T20:23:21.996Z level=INFO msg="received state sync from peer" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2465782.010933] server data-mesher[221]: time=2026-10-02T20:23:21.996Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2465782.011594] server data-mesher[221]: time=2026-10-02T20:23:21.997Z level=INFO msg="merging remote state" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4
server # [2465782.011594] server data-mesher[221]: time=2026-10-02T20:23:21.997Z level=INFO msg="state exchange complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 timeout=5s
server # [2465782.011703] server data-mesher[221]: time=2026-10-02T20:23:21.997Z level=DEBUG msg="push/pull successful" interval=5s
server # [2465782.012153] server data-mesher[221]: time=2026-10-02T20:23:21.997Z level=INFO msg="received file request" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 network="SsPnUh43hHu+zIo1q0DQhN4pLD7iW5mx/wl6geJG7vo=" name=dns/cnames
server # [2465782.014506] server data-mesher[221]: time=2026-10-02T20:23:22.000Z level=INFO msg="file transfer complete" peer=12D3KooWEMqCq2mHhk3vBsYYQ9Rh6pG3p5xgG1vwrqUgGDAEiFT4 network="SsPnUh43hHu+zIo1q0DQhN4pLD7iW5mx/wl6geJG7vo=" name=dns/cnames
client # [2465782.010301] client data-mesher[213]: time=2026-10-02T20:23:21.996Z level=DEBUG msg="attempting push/pull" peer_count=1
client # [2465782.010301] client data-mesher[213]: time=2026-10-02T20:23:21.996Z level=DEBUG msg="initiating state exchange" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2465782.011305] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=INFO msg="received state sync from peer" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465782.011305] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465782.011439] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=DEBUG msg="new file detected" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ name=dns/cnames name=dns/cnames
client # [2465782.011439] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=INFO msg="merging remote state" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465782.011439] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=DEBUG msg="new file detected" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ name=dns/cnames name=dns/cnames
client # [2465782.011439] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=INFO msg="state exchange complete" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ timeout=5s
client # [2465782.011614] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=INFO msg="scheduling file download" name=dns/cnames
client # [2465782.011614] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=INFO msg="downloading file" name=dns/cnames signed_at="2026-10-02 20:23:21.78 +0000 UTC" signed_by="9Y0jWyLbOkydLfnHi/etyd277lcgg+7vigYaum+aaFY=" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ
client # [2465782.011614] client data-mesher[213]: time=2026-10-02T20:23:21.997Z level=DEBUG msg="push/pull successful" interval=5s
client # [2465782.017646] client data-mesher[213]: time=2026-10-02T20:23:22.003Z level=INFO msg="download complete" name=dns/cnames signed_at="2026-10-02 20:23:21.78 +0000 UTC" signed_by="9Y0jWyLbOkydLfnHi/etyd277lcgg+7vigYaum+aaFY=" peer=12D3KooWD9g32Bfy6uzDKN3nr9N2ftTopWsLXXybGKvqZEnwgACJ written=true elapsed=6.065843ms
client # [2465782.019795] client systemd[1]: Starting Reload unbound zone configuration...
client # [2465782.073426] client unbound[293]: [293:0] info: service stopped (unbound 1.26.1).
client # [2465782.073796] client unbound-control[301]: ok
client # [2465782.073919] client unbound[293]: [293:0] info: server stats for thread 0: 5 queries, 0 answers from cache, 5 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [2465782.073926] client unbound[293]: [293:0] info: server stats for thread 0: requestlist max 2 avg 1.6 exceeded 0 jostled 0
client # [2465782.075204] client unbound[293]: [293:0] notice: Restart of unbound 1.26.1.
client # [2465782.076289] client unbound[293]: [293:0] notice: init module 0: validator
client # [2465782.076360] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2465782.076508] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [2465782.076704] client systemd[1]: Finished Reload unbound zone configuration.
client # [2465782.081957] client unbound[293]: [293:0] info: start of service (unbound 1.26.1).
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test, in 1.05 seconds)
(finished: run the VM test script, in 18.84 seconds)
test script finished in 18.89s
cleanup
kill NspawnMachine (pid 52)
kill NspawnMachine (pid 53)
Container client terminated by signal KILL.
(finished: cleanup, in 0.28 seconds)
Container server terminated by signal KILL.