Machine state will be reset. To keep it, pass --keep-machine-state
start all VLans
(finished: start all VLans, in 0.00 seconds)

Test will time out and terminate in 3600.0 seconds
run the VM test script
additionally exposed symbols:
    client, server,
    vlan1,
    start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh
start all VMs
client: systemd-nspawn running (pid 52)
server: systemd-nspawn running (pid 53)
client: Waiting for journal at /build/vm-state-client/var/log/journal...
server: Waiting for journal at /build/vm-state-server/var/log/journal...
(finished: start all VMs, in 0.00 seconds)
server: waiting for unit unbound.service
nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(server): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(server): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
░ Spawning container client on /build/vm-state-client.
░ Spawning container server on /build/vm-state-server.
client # No journal boot entry found for the specified boot (+0).
server # No journal boot entry found for the specified boot (+0).
client # [1547171.419199] client systemd-journald[90]: Journal started
client # [1547171.419250] client systemd-journald[90]: Runtime Journal (/run/log/journal/68ddfa8fe65e4fdfba72a1f2745b8c7c) is 8M, max 2.5G, 2.4G free.
client # [1547171.429345] client systemd[1]: Finished Apply Kernel Variables.
client # [1547171.443919] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
client # [1547171.458896] client systemd[1]: Starting Flush Journal to Persistent Storage...
client # [1547171.459872] client systemd[1]: Starting Network Name Resolution...
client # [1547171.461062] client systemd[1]: Starting Create Static Device Nodes in /dev...
client # [1547171.490276] client systemd-journald[90]: Time spent on flushing to /var/log/journal/68ddfa8fe65e4fdfba72a1f2745b8c7c is 1.503ms for 7 entries.
client # [1547171.490276] client systemd-journald[90]: System Journal (/var/log/journal/68ddfa8fe65e4fdfba72a1f2745b8c7c) is 8M, max 4G, 3.9G free.
client # [1547171.509303] client systemd[1]: Finished Create Static Device Nodes in /dev.
client # [1547171.509983] client systemd[1]: Reached target Preparation for Local File Systems.
client # [1547171.510121] client systemd[1]: Reached target Local File Systems.
client # [1547171.511014] client systemd[1]: Listening on Boot Loader Control Service Socket.
client # [1547171.511058] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
client # [1547171.512008] client systemd[1]: Starting Save Transient machine-id to Disk...
client # [1547171.512056] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
client # [1547171.523091] client systemd[1]: Finished Flush Journal to Persistent Storage.
client # [1547171.524463] client systemd[1]: Starting Create System Files and Directories...
client # [1547171.543540] client systemd-tmpfiles[165]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
client # [1547171.543740] client systemd-tmpfiles[165]: fchmod() of /var/log/journal failed: Operation not permitted
client # [1547171.543876] client systemd-tmpfiles[165]: fchmod() of /var/log/journal/68ddfa8fe65e4fdfba72a1f2745b8c7c failed: Operation not permitted
client # [1547171.544102] client systemd-tmpfiles[165]: fchmod() of /run/log/journal failed: Operation not permitted
client # [1547171.546149] client systemd[1]: Finished Create System Files and Directories.
client # [1547171.547235] client systemd[1]: Starting Rebuild Journal Catalog...
client # [1547171.547919] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...
client # [1547171.560077] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.
client # [1547171.567614] client systemd[1]: Finished Rebuild Journal Catalog.
client # [1547171.568939] client systemd[1]: Starting Update is Completed...
client # [1547171.581588] client systemd[1]: Finished Update is Completed.
client # [1547171.590977] client systemd[1]: Finished Firewall.
client # [1547171.591148] client systemd[1]: Reached target Preparation for Network.
client # [1547171.591373] client systemd[1]: Listening on Network Management Resolve Hook Socket.
client # [1547171.592424] client systemd[1]: Starting Network Management...
client # [1547172.221177] client systemd[1]: Finished Save Transient machine-id to Disk.
client # [1547172.413792] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [1547171.425037] server systemd-journald[99]: Journal started
server # [1547171.425101] server systemd-journald[99]: Runtime Journal (/run/log/journal/713555379a994cb29fd19ab6d757f840) is 8M, max 2.5G, 2.4G free.
server # [1547171.432460] server systemd[1]: Finished Apply Kernel Variables.
server # [1547171.446576] server systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
server # [1547171.461072] server systemd[1]: Starting Flush Journal to Persistent Storage...
server # [1547171.461857] server systemd[1]: Starting Network Name Resolution...
server # [1547171.462493] server systemd[1]: Starting Create Static Device Nodes in /dev...
server # [1547171.491785] server systemd-journald[99]: Time spent on flushing to /var/log/journal/713555379a994cb29fd19ab6d757f840 is 1.105ms for 7 entries.
server # [1547171.491785] server systemd-journald[99]: System Journal (/var/log/journal/713555379a994cb29fd19ab6d757f840) is 8M, max 4G, 3.9G free.
server # [1547171.509325] server systemd[1]: Finished Create Static Device Nodes in /dev.
server # [1547171.510051] server systemd[1]: Reached target Preparation for Local File Systems.
server # [1547171.510184] server systemd[1]: Reached target Local File Systems.
server # [1547171.511024] server systemd[1]: Listening on Boot Loader Control Service Socket.
server # [1547171.511072] server systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
server # [1547171.512019] server systemd[1]: Starting Save Transient machine-id to Disk...
server # [1547171.512056] server systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
server # [1547171.523431] server systemd[1]: Finished Flush Journal to Persistent Storage.
server # [1547171.524447] server systemd[1]: Starting Create System Files and Directories...
server # [1547171.539580] server systemd-tmpfiles[177]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
server # [1547171.539765] server systemd-tmpfiles[177]: fchmod() of /var/log/journal failed: Operation not permitted
server # [1547171.539884] server systemd-tmpfiles[177]: fchmod() of /var/log/journal/713555379a994cb29fd19ab6d757f840 failed: Operation not permitted
server # [1547171.540547] server systemd-tmpfiles[177]: fchmod() of /run/log/journal failed: Operation not permitted
server # [1547171.542139] server systemd[1]: Finished Create System Files and Directories.
server # [1547171.543257] server systemd[1]: Starting Rebuild Journal Catalog...
server # [1547171.543953] server systemd[1]: Starting Record System Boot/Shutdown in UTMP...
server # [1547171.555371] server systemd[1]: Finished Record System Boot/Shutdown in UTMP.
server # [1547171.564273] server systemd[1]: Finished Rebuild Journal Catalog.
server # [1547171.565330] server systemd[1]: Starting Update is Completed...
server # [1547171.576251] server systemd[1]: Finished Update is Completed.
server # [1547171.584639] server systemd[1]: Finished Firewall.
server # [1547171.584800] server systemd[1]: Reached target Preparation for Network.
server # [1547171.585017] server systemd[1]: Listening on Network Management Resolve Hook Socket.
server # [1547171.586086] server systemd[1]: Starting Network Management...
server # [1547172.231960] server systemd[1]: Finished Save Transient machine-id to Disk.
server # [1547172.418089] server systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [1547172.733248] server systemd-networkd[216]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
server # [1547172.733361] server systemd-networkd[216]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
server # [1547172.746565] server systemd-networkd[216]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [1547172.746741] server systemd-networkd[216]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [1547172.746973] server systemd-networkd[216]: lo: Link UP
server # [1547172.746977] server systemd-networkd[216]: lo: Gained carrier
server # [1547172.747224] server systemd-networkd[216]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
server # [1547172.747718] server systemd[1]: Started Network Management.
server # [1547172.747834] server systemd-networkd[216]: eth1: Link UP
server # [1547172.748218] server systemd-networkd[216]: eth1: Gained carrier
server # [1547172.750091] server systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
server # [1547172.778317] server systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
client # [1547172.748443] client systemd-networkd[207]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
client # [1547172.748555] client systemd-networkd[207]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
client # [1547172.761195] client systemd-networkd[207]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [1547172.761385] client systemd-networkd[207]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
client # [1547172.761611] client systemd-networkd[207]: lo: Link UP
client # [1547172.761614] client systemd-networkd[207]: lo: Gained carrier
client # [1547172.761902] client systemd-networkd[207]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
client # [1547172.762503] client systemd-networkd[207]: eth1: Link UP
client # [1547172.762763] client systemd[1]: Started Network Management.
client # [1547172.762824] client systemd-networkd[207]: eth1: Gained carrier
client # [1547172.764699] client systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
client # [1547172.814610] client systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
server # [1547173.461231] server systemd-resolved[137]: Positive Trust Anchors:
server # [1547173.461331] server systemd-resolved[137]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
server # [1547173.461354] server systemd-resolved[137]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
server # [1547173.461391] server systemd-resolved[137]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
server # [1547173.486523] server systemd-resolved[137]: Using system hostname 'server'.
server # [1547173.487984] server systemd[1]: Started Network Name Resolution.
server # [1547173.488102] server systemd[1]: Reached target Network.
server # [1547173.488179] server systemd[1]: Reached target System Initialization.
server # [1547173.488271] server systemd[1]: Started Watch for zone file changes.
server # [1547173.488329] server systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
server # [1547173.488356] server systemd[1]: Started Daily Cleanup of Temporary Directories.
server # [1547173.488377] server systemd[1]: Reached target Path Units.
server # [1547173.488408] server systemd[1]: Reached target Timer Units.
server # [1547173.488538] server systemd[1]: Listening on D-Bus System Message Bus Socket.
server # [1547173.488675] server systemd[1]: Listening on Nix Daemon Socket.
server # [1547173.488796] server systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
server # [1547173.488828] server systemd[1]: Reached target Socket Units.
server # [1547173.488868] server systemd[1]: Reached target Basic System.
server # [1547173.490503] server systemd[1]: Starting data mesher daemon...
server # [1547173.491623] server systemd[1]: Starting Import lastlog data into lastlog2 database...
server # [1547173.492864] server systemd[1]: Starting Name Service Cache Daemon (nsncd)...
server # [1547173.494548] server systemd[1]: Starting D-Bus System Message Bus...
server # [1547173.512959] server systemd[1]: Finished Import lastlog data into lastlog2 database.
server # [1547173.755047] server systemd[1]: Started Name Service Cache Daemon (nsncd).
server # [1547173.755126] server systemd[1]: Reached target User and Group Name Lookups.
server # [1547173.755447] server nsncd[224]: Sep 22 05:13:13.741 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [1547173.495541] client systemd-resolved[125]: Positive Trust Anchors:
client # [1547173.495557] client systemd-resolved[125]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
client # [1547173.495569] client systemd-resolved[125]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
client # [1547173.495603] client systemd-resolved[125]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
client # [1547173.523543] client systemd-resolved[125]: Using system hostname 'client'.
client # [1547173.525259] client systemd[1]: Started Network Name Resolution.
client # [1547173.525363] client systemd[1]: Reached target Network.
client # [1547173.525444] client systemd[1]: Reached target System Initialization.
client # [1547173.525544] client systemd[1]: Started Watch for zone file changes.
client # [1547173.525584] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
client # [1547173.525610] client systemd[1]: Started Daily Cleanup of Temporary Directories.
client # [1547173.525633] client systemd[1]: Reached target Path Units.
client # [1547173.525663] client systemd[1]: Reached target Timer Units.
client # [1547173.525806] client systemd[1]: Listening on D-Bus System Message Bus Socket.
client # [1547173.525934] client systemd[1]: Listening on Nix Daemon Socket.
client # [1547173.526039] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
client # [1547173.526070] client systemd[1]: Reached target Socket Units.
client # [1547173.526105] client systemd[1]: Reached target Basic System.
client # [1547173.527957] client systemd[1]: Starting data mesher daemon...
client # [1547173.528942] client systemd[1]: Starting Import lastlog data into lastlog2 database...
client # [1547173.530024] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...
client # [1547173.531429] client systemd[1]: Starting D-Bus System Message Bus...
client # [1547173.551092] client systemd[1]: Finished Import lastlog data into lastlog2 database.
server # [1547173.757894] server systemd[1]: Starting User Login Management...
server # [1547173.758852] server systemd[1]: Starting Permit User Sessions...
server # [1547173.815400] server systemd[1]: Finished Permit User Sessions.
server # [1547173.817606] server systemd[1]: Started Console Getty.
server # [1547173.817660] server systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
server # [1547173.817681] server systemd[1]: Reached target Login Prompts.
client # [1547173.764114] client nsncd[215]: Sep 22 05:13:13.749 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [1547173.763919] client systemd[1]: Started Name Service Cache Daemon (nsncd).
client # [1547173.763991] client systemd[1]: Reached target User and Group Name Lookups.
client # [1547173.811039] client systemd[1]: Starting User Login Management...
client # [1547173.811945] client systemd[1]: Starting Permit User Sessions...
client # [1547173.821530] client systemd[1]: Finished Permit User Sessions.
client # [1547173.822579] client systemd[1]: Started Console Getty.
client # [1547173.822622] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
client # [1547173.822642] client systemd[1]: Reached target Login Prompts.
server # [1547174.016176] server systemd-networkd[216]: eth1: Gained IPv6LL
server # [1547174.196709] server dbus-broker-launch[225]: Looking up NSS user entry for 'systemd-timesync'...
server # [1547174.197411] server dbus-broker-launch[225]: NSS returned no entry for 'systemd-timesync'
server # [1547174.197411] server dbus-broker-launch[225]: Invalid user-name in /nix/store/f9lbh2is5lw4v5nkx496n3ymp5rf2pyx-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
server # [1547174.197857] server systemd[1]: Started D-Bus System Message Bus.
server # [1547174.205069] server dbus-broker-launch[225]: Ready
client # [1547174.196614] client dbus-broker-launch[216]: Looking up NSS user entry for 'systemd-timesync'...
client # [1547174.197755] client dbus-broker-launch[216]: NSS returned no entry for 'systemd-timesync'
client # [1547174.197755] client dbus-broker-launch[216]: Invalid user-name in /nix/store/pdpmvp4r97cgcvimwlbhfb5jkb5aja3i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
client # [1547174.198042] client systemd[1]: Started D-Bus System Message Bus.
client # [1547174.205068] client dbus-broker-launch[216]: Ready
client # [1547174.369481] client systemd-networkd[207]: eth1: Gained IPv6LL
client # [1547174.923577] client data-mesher[213]: time=2026-09-22T05:13:14.909Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
client # [1547174.925507] client data-mesher[213]: time=2026-09-22T05:13:14.911Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9: [/dns/client.test/tcp/7946]} {12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
client # [1547174.925507] client data-mesher[213]: time=2026-09-22T05:13:14.911Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
client # [1547174.936183] client data-mesher[213]: time=2026-09-22T05:13:14.921Z level=INFO msg="checking file integrity"
client # [1547174.936317] client data-mesher[213]: time=2026-09-22T05:13:14.922Z level=INFO msg="file integrity check complete"
client # [1547174.940985] client data-mesher[213]: time=2026-09-22T05:13:14.926Z level=INFO msg="libp2p host created" peer_id=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"
client # [1547174.941081] client data-mesher[213]: time=2026-09-22T05:13:14.926Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
client # [1547174.941081] client data-mesher[213]: time=2026-09-22T05:13:14.926Z level=INFO msg="registered HTTP route" method=GET path=/files
client # [1547174.941081] client data-mesher[213]: time=2026-09-22T05:13:14.926Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
client # [1547174.941081] client data-mesher[213]: time=2026-09-22T05:13:14.926Z level=INFO msg="starting server"
client # [1547174.941171] client data-mesher[213]: time=2026-09-22T05:13:14.926Z level=INFO msg="waiting for DHT to populate" delay=10s
client # [1547174.941267] client data-mesher[213]: time=2026-09-22T05:13:14.927Z level=INFO msg="HTTP server listening" address=[::1]:7331
client # [1547174.941312] client data-mesher[213]: time=2026-09-22T05:13:14.927Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
client # [1547174.952463] client data-mesher[213]: time=2026-09-22T05:13:14.938Z level=INFO msg="peer connected" peer_id=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S remote_addr=/ip6/2001:db8:1::2/tcp/7946
client # [1547174.955861] client data-mesher[213]: time=2026-09-22T05:13:14.941Z level=INFO msg="peer connected" peer_id=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S remote_addr=/ip6/2001:db8:1::2/tcp/39770
client # [1547174.955999] client data-mesher[213]: time=2026-09-22T05:13:14.941Z level=INFO msg="peer connected" peer_id=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S remote_addr=/ip4/192.168.1.2/tcp/7946
server # [1547174.905979] server data-mesher[222]: time=2026-09-22T05:13:14.891Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
server # [1547174.907277] server data-mesher[222]: time=2026-09-22T05:13:14.893Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9: [/dns/client.test/tcp/7946]} {12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
server # [1547174.907323] server data-mesher[222]: time=2026-09-22T05:13:14.893Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
server # [1547174.936128] server data-mesher[222]: time=2026-09-22T05:13:14.921Z level=INFO msg="checking file integrity"
server # [1547174.936650] server data-mesher[222]: time=2026-09-22T05:13:14.922Z level=INFO msg="file integrity check complete"
server # [1547174.941372] server data-mesher[222]: time=2026-09-22T05:13:14.926Z level=INFO msg="libp2p host created" peer_id=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"
server # [1547174.941372] server data-mesher[222]: time=2026-09-22T05:13:14.926Z level=INFO msg="registered HTTP route" method=GET path=/files
server # [1547174.941372] server data-mesher[222]: time=2026-09-22T05:13:14.926Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
server # [1547174.941372] server data-mesher[222]: time=2026-09-22T05:13:14.926Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
server # [1547174.941372] server data-mesher[222]: time=2026-09-22T05:13:14.926Z level=INFO msg="starting server"
server # [1547174.941372] server data-mesher[222]: time=2026-09-22T05:13:14.927Z level=INFO msg="HTTP server listening" address=[::1]:7331
server # [1547174.942480] server data-mesher[222]: time=2026-09-22T05:13:14.928Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
server # [1547174.942749] server data-mesher[222]: time=2026-09-22T05:13:14.928Z level=INFO msg="waiting for DHT to populate" delay=10s
server # [1547174.953651] server data-mesher[222]: time=2026-09-22T05:13:14.939Z level=INFO msg="peer connected" peer_id=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 remote_addr=/ip6/2001:db8:1::1/tcp/7946
server # [1547174.954809] server data-mesher[222]: time=2026-09-22T05:13:14.940Z level=INFO msg="peer connected" peer_id=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 remote_addr=/ip4/192.168.1.1/tcp/7946
server # [1547174.954843] server data-mesher[222]: time=2026-09-22T05:13:14.940Z level=INFO msg="peer connected" peer_id=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 remote_addr=/ip6/2001:db8:1::1/tcp/7946
client # [1547175.227297] client systemd-logind[233]: New seat seat0.
server # [1547175.227300] server systemd-logind[242]: New seat seat0.
server # [1547175.227524] server systemd[1]: Started User Login Management.
server # [1547175.228905] server systemd[1]: Starting linger-users.service...
server # [1547175.244235] server systemd[1]: linger-users.service: Deactivated successfully.
server # [1547175.244502] server systemd[1]: Finished linger-users.service.
client # [1547175.227525] client systemd[1]: Started User Login Management.
client # [1547175.228863] client systemd[1]: Starting linger-users.service...
client # [1547175.244247] client systemd[1]: linger-users.service: Deactivated successfully.
client # [1547175.244476] client systemd[1]: Finished linger-users.service.
server: still waiting for container 'server' to reach ready state...
server # [1547184.941938] server data-mesher[222]: time=2026-09-22T05:13:24.927Z level=INFO msg="received state sync from peer" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
client # [1547184.941293] client data-mesher[213]: time=2026-09-22T05:13:24.927Z level=INFO msg="performing state exchange with peers on join" count=1
server # [1547184.941938] server data-mesher[222]: time=2026-09-22T05:13:24.927Z level=INFO msg="merging remote state" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
client # [1547184.941293] client data-mesher[213]: time=2026-09-22T05:13:24.927Z level=DEBUG msg="initiating state exchange" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S timeout=5s
server # [1547184.943684] server data-mesher[222]: time=2026-09-22T05:13:24.929Z level=INFO msg="performing state exchange with peers on join" count=1
client # [1547184.942148] client data-mesher[213]: time=2026-09-22T05:13:24.927Z level=INFO msg="merging remote state" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
server # [1547184.943742] server data-mesher[222]: time=2026-09-22T05:13:24.929Z level=DEBUG msg="initiating state exchange" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 timeout=5s
client # [1547184.942148] client data-mesher[213]: time=2026-09-22T05:13:24.927Z level=INFO msg="state exchange complete" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S timeout=5s
server # [1547184.944268] server data-mesher[222]: time=2026-09-22T05:13:24.930Z level=INFO msg="merging remote state" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
client # [1547184.942242] client data-mesher[213]: time=2026-09-22T05:13:24.928Z level=INFO msg="server started"
server # [1547184.944268] server data-mesher[222]: time=2026-09-22T05:13:24.930Z level=INFO msg="state exchange complete" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 timeout=5s
client # [1547184.942462] client systemd[1]: Started data mesher daemon.
server # [1547184.944427] server data-mesher[222]: time=2026-09-22T05:13:24.930Z level=INFO msg="server started"
client # [1547184.944257] client data-mesher[213]: time=2026-09-22T05:13:24.928Z level=INFO msg="starting expired-file sweeper" interval=1m0s
server # [1547184.944427] server data-mesher[222]: time=2026-09-22T05:13:24.930Z level=INFO msg="starting expired-file sweeper" interval=1m0s
client # [1547184.944257] client data-mesher[213]: time=2026-09-22T05:13:24.929Z level=INFO msg="received state sync from peer" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
server # [1547184.944605] server systemd[1]: Started data mesher daemon.
client # [1547184.944257] client data-mesher[213]: time=2026-09-22T05:13:24.929Z level=INFO msg="merging remote state" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
server # [1547184.946357] server systemd[1]: Starting Unbound recursive Domain Name Server...
client # [1547184.944621] client systemd[1]: Starting Unbound recursive Domain Name Server...
server # [1547187.446466] server unbound-pre-start[284]: Root anchor updated!
server # [1547187.457384] server unbound-pre-start[288]: setup in directory /var/lib/unbound
client # [1547187.467627] client unbound-pre-start[275]: Root anchor updated!
client # [1547187.479264] client unbound-pre-start[279]: setup in directory /var/lib/unbound
client # [1547188.355142] client unbound-pre-start[288]: Certificate request self-signature ok
client # [1547188.355142] client unbound-pre-start[288]: subject=CN=unbound-control
client # [1547188.373550] client unbound-pre-start[279]: removing artifacts
client # [1547188.375173] client unbound-pre-start[279]: Setup success. Certificates created. Enable in unbound.conf file to use
server # [1547188.427071] server unbound-pre-start[297]: Certificate request self-signature ok
server # [1547188.427071] server unbound-pre-start[297]: subject=CN=unbound-control
server # [1547188.446689] server unbound-pre-start[288]: removing artifacts
server # [1547188.451606] server unbound-pre-start[288]: Setup success. Certificates created. Enable in unbound.conf file to use
client # [1547189.944139] client data-mesher[213]: time=2026-09-22T05:13:29.929Z level=DEBUG msg="attempting push/pull" peer_count=1
server # [1547189.944489] server data-mesher[222]: time=2026-09-22T05:13:29.930Z level=DEBUG msg="attempting push/pull" peer_count=1
client # [1547189.944139] client data-mesher[213]: time=2026-09-22T05:13:29.929Z level=DEBUG msg="initiating state exchange" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S timeout=5s
client # [1547189.944936] client data-mesher[213]: time=2026-09-22T05:13:29.930Z level=INFO msg="merging remote state" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
client # [1547189.944936] client data-mesher[213]: time=2026-09-22T05:13:29.930Z level=INFO msg="state exchange complete" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S timeout=5s
client # [1547189.944996] client data-mesher[213]: time=2026-09-22T05:13:29.930Z level=DEBUG msg="push/pull successful" interval=5s
client # [1547189.945049] client data-mesher[213]: time=2026-09-22T05:13:29.930Z level=INFO msg="received state sync from peer" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
client # [1547189.945049] client data-mesher[213]: time=2026-09-22T05:13:29.930Z level=INFO msg="merging remote state" peer=12D3KooWPMWhBUZhBNtASBNYB7xJUtVJQPGbpTVjP2H5Gim7rk6S
server # [1547189.944489] server data-mesher[222]: time=2026-09-22T05:13:29.930Z level=DEBUG msg="initiating state exchange" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 timeout=5s
server # [1547189.944881] server data-mesher[222]: time=2026-09-22T05:13:29.930Z level=INFO msg="received state sync from peer" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
server # [1547189.944881] server data-mesher[222]: time=2026-09-22T05:13:29.930Z level=INFO msg="merging remote state" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
server # [1547189.945163] server data-mesher[222]: time=2026-09-22T05:13:29.930Z level=INFO msg="merging remote state" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9
server # [1547189.945163] server data-mesher[222]: time=2026-09-22T05:13:29.930Z level=INFO msg="state exchange complete" peer=12D3KooWCPBGmioAQHVvwRCnQqPkCjQVHkVSxecn7GhfR3WTGSm9 timeout=5s
server # [1547189.945220] server data-mesher[222]: time=2026-09-22T05:13:29.931Z level=DEBUG msg="push/pull successful" interval=5s
server: still waiting for container 'server' to reach ready state...
server: (finished: waiting for unit unbound.service, in 22.68 seconds)
client: waiting for unit unbound.service
client: (finished: waiting for unit unbound.service, in 0.01 seconds)
server: waiting for unit data-mesher.service
server: (finished: waiting for unit data-mesher.service, in 0.01 seconds)
server: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1, in 0.02 seconds)
server: must succeed: data-mesher file update --network-id /nix/store/a2g24plkckyii7njyx7z2l25fc7xbz3s-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames
client # [1547192.986791] client unbound[293]: [293:0] notice: init module 0: validator
client # [1547192.986920] client unbound[293]: [293:0] notice: init module 1: iterator
client # [1547192.993295] client unbound[293]: [293:0] info: start of service (unbound 1.26.0).
client # [1547192.993481] client systemd[1]: Started Unbound recursive Domain Name Server.
client # [1547192.994016] client systemd[1]: Reached target Multi-User System.
client # [1547192.994287] client systemd[1]: Reached target Host and Network Name Lookups.
client # [1547192.996114] client systemd[1]: Starting Reload unbound zone configuration...
client # [1547193.009112] client unbound[293]: [293:0] info: service stopped (unbound 1.26.0).
client # [1547193.009469] client unbound-control[296]: ok
client # [1547193.009486] client unbound[293]: [293:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [1547193.009491] client unbound[293]: [293:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
client # [1547193.010749] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [1547193.010990] client systemd[1]: Finished Reload unbound zone configuration.
client # [1547193.011323] client systemd[1]: Startup finished in 21.991s.
client # [1547193.011464] client unbound[293]: [293:0] notice: Restart of unbound 1.26.0.
client # [1547193.012472] client unbound[293]: [293:0] notice: init module 0: validator
client # [1547193.012541] client unbound[293]: [293:0] notice: init module 1: iterator
client # [1547193.017308] client unbound[293]: [293:0] info: start of service (unbound 1.26.0).
server # [1547193.085255] server unbound[302]: [302:0] notice: init module 0: validator
server # [1547193.085382] server unbound[302]: [302:0] notice: init module 1: iterator
server # [1547193.091672] server unbound[302]: [302:0] info: start of service (unbound 1.26.0).
server # [1547193.091943] server systemd[1]: Started Unbound recursive Domain Name Server.
server # [1547193.092214] server systemd[1]: Reached target Multi-User System.
server # [1547193.092332] server systemd[1]: Reached target Host and Network Name Lookups.
server # [1547193.093476] server systemd[1]: Starting Reload unbound zone configuration...
server # [1547193.148787] server unbound[302]: [302:0] info: service stopped (unbound 1.26.0).
server # [1547193.149042] server unbound-control[305]: ok
server # [1547193.149167] server unbound[302]: [302:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [1547193.149172] server unbound[302]: [302:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
server # [1547193.150291] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [1547193.150488] server systemd[1]: Finished Reload unbound zone configuration.
server # [1547193.150857] server systemd[1]: Startup finished in 22.126s.
server # [1547193.151066] server unbound[302]: [302:0] notice: Restart of unbound 1.26.0.
server # [1547193.152038] server unbound[302]: [302:0] notice: init module 0: validator
server # [1547193.152107] server unbound[302]: [302:0] notice: init module 1: iterator
server # [1547193.156847] server unbound[302]: [302:0] info: start of service (unbound 1.26.0).
server # [1547193.261157] server systemd[1]: Starting Reload unbound zone configuration...
server # [1547193.273731] server unbound[302]: [302:0] info: service stopped (unbound 1.26.0).
server # [1547193.273993] server unbound-control[341]: ok
server # [1547193.274154] server unbound[302]: [302:0] info: server stats for thread 0: 2 queries, 1 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [1547193.274161] server unbound[302]: [302:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
server # [1547193.275202] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [1547193.275414] server systemd[1]: Finished Reload unbound zone configuration.
server # [1547193.275591] server unbound[302]: [302:0] notice: Restart of unbound 1.26.0.
server # [1547193.276550] server unbound[302]: [302:0] notice: init module 0: validator
server # [1547193.276613] server unbound[302]: [302:0] notice: init module 1: iterator
server # [1547193.280926] server unbound[302]: [302:0] info: start of service (unbound 1.26.0).
server: (finished: must succeed: data-mesher file update --network-id /nix/store/a2g24plkckyii7njyx7z2l25fc7xbz3s-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames, in 0.19 seconds)
??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/z312acj8n2ggn1w3agk97mbvdsm371iw-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test
??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/z312acj8n2ggn1w3agk97mbvdsm371iw-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test, in 0.02 seconds)
(finished: run the VM test script, in 22.95 seconds)
test script finished in 23.17s
cleanup
kill NspawnMachine (pid 52)
server # [1547193.416436] server data-mesher[222]: time=2026-09-22T05:13:33.402Z level=INFO msg=http_request uri=/files/dns/cnames status=204
kill NspawnMachine (pid 53)
Container client terminated by signal KILL.
Container server terminated by signal KILL.
(finished: cleanup, in 0.38 seconds)