build01: building 02w7kwhsx6ad6y34z6bafppqri15rd52-container-test-run-dm-dns.drv
Machine state will be reset. To keep it, pass --keep-machine-state
start all VLans
(finished: start all VLans, in 0.00 seconds)

Test will time out and terminate in 3600.0 seconds
run the VM test script
additionally exposed symbols:
    client, server,
    vlan1,
    start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh
start all VMs
client: systemd-nspawn running (pid 52)
server: systemd-nspawn running (pid 53)
client: Waiting for journal at /build/vm-state-client/var/log/journal...
server: Waiting for journal at /build/vm-state-server/var/log/journal...
(finished: start all VMs, in 0.00 seconds)
server: waiting for unit unbound.service
nixos-nspawn(server): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(server): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
░ Spawning container server on /build/vm-state-server.
░ Spawning container client on /build/vm-state-client.
client # No journal files were found.
client # No journal boot entry found for the specified boot (+0).
server # No journal files were found.
server # No journal boot entry found for the specified boot (+0).
client # [2023482.377428] client systemd-journald[90]: Journal started
client # [2023482.377486] client systemd-journald[90]: Runtime Journal (/run/log/journal/0ad26f6e5d8d407e931b64a29074757a) is 8M, max 2.5G, 2.4G free.
client # [2023482.384500] client systemd[1]: Finished Apply Kernel Variables.
client # [2023482.396571] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
client # [2023482.410965] client systemd[1]: Starting Flush Journal to Persistent Storage...
client # [2023482.411998] client systemd[1]: Starting Network Name Resolution...
client # [2023482.412697] client systemd[1]: Starting Create Static Device Nodes in /dev...
client # [2023482.422373] client systemd-journald[90]: Time spent on flushing to /var/log/journal/0ad26f6e5d8d407e931b64a29074757a is 1.771ms for 7 entries.
client # [2023482.422373] client systemd-journald[90]: System Journal (/var/log/journal/0ad26f6e5d8d407e931b64a29074757a) is 8M, max 4G, 3.9G free.
client # [2023482.441871] client systemd[1]: Finished Flush Journal to Persistent Storage.
client # [2023482.442256] client systemd[1]: Finished Create Static Device Nodes in /dev.
client # [2023482.443299] client systemd[1]: Reached target Preparation for Local File Systems.
client # [2023482.443417] client systemd[1]: Reached target Local File Systems.
client # [2023482.444299] client systemd[1]: Listening on Boot Loader Control Service Socket.
client # [2023482.444355] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
client # [2023482.445211] client systemd[1]: Starting Save Transient machine-id to Disk...
client # [2023482.445919] client systemd[1]: Starting Create System Files and Directories...
client # [2023482.445947] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
client # [2023482.463548] client systemd-tmpfiles[146]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
client # [2023482.463771] client systemd-tmpfiles[146]: fchmod() of /var/log/journal failed: Operation not permitted
client # [2023482.463929] client systemd-tmpfiles[146]: fchmod() of /var/log/journal/0ad26f6e5d8d407e931b64a29074757a failed: Operation not permitted
client # [2023482.464207] client systemd-tmpfiles[146]: fchmod() of /run/log/journal failed: Operation not permitted
client # [2023482.465724] client systemd[1]: Finished Create System Files and Directories.
client # [2023482.466913] client systemd[1]: Starting Rebuild Journal Catalog...
client # [2023482.467787] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...
client # [2023482.482796] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.
client # [2023482.487180] client systemd[1]: Finished Save Transient machine-id to Disk.
client # [2023482.490623] client systemd[1]: Finished Rebuild Journal Catalog.
client # [2023482.491952] client systemd[1]: Starting Update is Completed...
client # [2023482.503534] client systemd[1]: Finished Update is Completed.
client # [2023482.555749] client systemd[1]: Finished Firewall.
client # [2023482.555904] client systemd[1]: Reached target Preparation for Network.
client # [2023482.556149] client systemd[1]: Listening on Network Management Resolve Hook Socket.
client # [2023482.557213] client systemd[1]: Starting Network Management...
client # [2023483.278651] client systemd-networkd[208]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
client # [2023483.278737] client systemd-networkd[208]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
client # [2023483.288096] client systemd-networkd[208]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2023482.378519] server systemd-journald[100]: Journal started
client # [2023483.288263] client systemd-networkd[208]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2023482.378572] server systemd-journald[100]: Runtime Journal (/run/log/journal/2eb885e7d90947af827632d2b1273daf) is 8M, max 2.5G, 2.4G free.
client # [2023483.288414] client systemd-networkd[208]: lo: Link UP
server # [2023482.385072] server systemd[1]: Finished Apply Kernel Variables.
client # [2023483.288417] client systemd-networkd[208]: lo: Gained carrier
server # [2023482.396819] server systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
client # [2023483.288581] client systemd-networkd[208]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
server # [2023482.411109] server systemd[1]: Starting Flush Journal to Persistent Storage...
client # [2023483.288983] client systemd[1]: Started Network Management.
server # [2023482.411825] server systemd[1]: Starting Network Name Resolution...
client # [2023483.289065] client systemd-networkd[208]: eth1: Link UP
server # [2023482.412496] server systemd[1]: Starting Create Static Device Nodes in /dev...
client # [2023483.289381] client systemd-networkd[208]: eth1: Gained carrier
server # [2023482.422388] server systemd-journald[100]: Time spent on flushing to /var/log/journal/2eb885e7d90947af827632d2b1273daf is 1.557ms for 7 entries.
client # [2023483.290075] client systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
server # [2023482.422388] server systemd-journald[100]: System Journal (/var/log/journal/2eb885e7d90947af827632d2b1273daf) is 8M, max 4G, 3.9G free.
client # [2023483.326395] client systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
server # [2023482.441876] server systemd[1]: Finished Flush Journal to Persistent Storage.
server # [2023482.442323] server systemd[1]: Finished Create Static Device Nodes in /dev.
server # [2023482.443315] server systemd[1]: Reached target Preparation for Local File Systems.
server # [2023482.443422] server systemd[1]: Reached target Local File Systems.
server # [2023482.444343] server systemd[1]: Listening on Boot Loader Control Service Socket.
server # [2023482.444391] server systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
server # [2023482.445207] server systemd[1]: Starting Save Transient machine-id to Disk...
server # [2023482.445916] server systemd[1]: Starting Create System Files and Directories...
server # [2023482.445944] server systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
server # [2023482.464548] server systemd-tmpfiles[156]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
server # [2023482.464763] server systemd-tmpfiles[156]: fchmod() of /var/log/journal failed: Operation not permitted
server # [2023482.464913] server systemd-tmpfiles[156]: fchmod() of /var/log/journal/2eb885e7d90947af827632d2b1273daf failed: Operation not permitted
server # [2023482.465134] server systemd-tmpfiles[156]: fchmod() of /run/log/journal failed: Operation not permitted
server # [2023482.466717] server systemd[1]: Finished Create System Files and Directories.
server # [2023482.467746] server systemd[1]: Starting Rebuild Journal Catalog...
server # [2023482.468474] server systemd[1]: Starting Record System Boot/Shutdown in UTMP...
server # [2023482.484909] server systemd[1]: Finished Record System Boot/Shutdown in UTMP.
server # [2023482.486510] server systemd[1]: Finished Save Transient machine-id to Disk.
server # [2023482.492509] server systemd[1]: Finished Rebuild Journal Catalog.
server # [2023482.493682] server systemd[1]: Starting Update is Completed...
server # [2023482.503283] server systemd[1]: Finished Update is Completed.
server # [2023482.558150] server systemd[1]: Finished Firewall.
server # [2023482.558347] server systemd[1]: Reached target Preparation for Network.
server # [2023482.558603] server systemd[1]: Listening on Network Management Resolve Hook Socket.
server # [2023482.559800] server systemd[1]: Starting Network Management...
server # [2023483.276491] server systemd-networkd[218]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
server # [2023483.276582] server systemd-networkd[218]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
server # [2023483.285983] server systemd-networkd[218]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2023483.286151] server systemd-networkd[218]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
server # [2023483.286309] server systemd-networkd[218]: lo: Link UP
server # [2023483.286313] server systemd-networkd[218]: lo: Gained carrier
server # [2023483.286487] server systemd-networkd[218]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
server # [2023483.286962] server systemd[1]: Started Network Management.
server # [2023483.286986] server systemd-networkd[218]: eth1: Link UP
server # [2023483.287308] server systemd-networkd[218]: eth1: Gained carrier
server # [2023483.288688] server systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
server # [2023483.325979] server systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
client # [2023483.386718] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [2023483.387266] server systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
server # [2023483.573087] server systemd-resolved[132]: Positive Trust Anchors:
server # [2023483.573098] server systemd-resolved[132]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
server # [2023483.573101] server systemd-resolved[132]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
server # [2023483.573136] server systemd-resolved[132]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
server # [2023483.595199] server systemd-resolved[132]: Using system hostname 'server'.
server # [2023483.596566] server systemd[1]: Started Network Name Resolution.
server # [2023483.596687] server systemd[1]: Reached target Network.
server # [2023483.596812] server systemd[1]: Reached target System Initialization.
server # [2023483.596966] server systemd[1]: Started Watch for zone file changes.
server # [2023483.597021] server systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
server # [2023483.597069] server systemd[1]: Started Daily Cleanup of Temporary Directories.
server # [2023483.597110] server systemd[1]: Reached target Path Units.
server # [2023483.597177] server systemd[1]: Reached target Timer Units.
server # [2023483.597394] server systemd[1]: Listening on D-Bus System Message Bus Socket.
server # [2023483.597596] server systemd[1]: Listening on Nix Daemon Socket.
server # [2023483.597808] server systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
server # [2023483.597855] server systemd[1]: Reached target Socket Units.
server # [2023483.597934] server systemd[1]: Reached target Basic System.
server # [2023483.636788] server systemd[1]: Starting data mesher daemon...
server # [2023483.638195] server systemd[1]: Starting Import lastlog data into lastlog2 database...
server # [2023483.639586] server systemd[1]: Starting Name Service Cache Daemon (nsncd)...
server # [2023483.641674] server systemd[1]: Starting D-Bus System Message Bus...
server # [2023483.661990] server systemd[1]: Finished Import lastlog data into lastlog2 database.
server # [2023483.833052] server systemd[1]: Started Name Service Cache Daemon (nsncd).
client # [2023483.558597] client systemd-resolved[123]: Positive Trust Anchors:
client # [2023483.558608] client systemd-resolved[123]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
client # [2023483.558612] client systemd-resolved[123]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
client # [2023483.558646] client systemd-resolved[123]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
client # [2023483.581087] client systemd-resolved[123]: Using system hostname 'client'.
client # [2023483.582458] client systemd[1]: Started Network Name Resolution.
client # [2023483.582581] client systemd[1]: Reached target Network.
client # [2023483.582703] client systemd[1]: Reached target System Initialization.
client # [2023483.582854] client systemd[1]: Started Watch for zone file changes.
client # [2023483.582905] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
client # [2023483.582952] client systemd[1]: Started Daily Cleanup of Temporary Directories.
client # [2023483.582993] client systemd[1]: Reached target Path Units.
client # [2023483.583069] client systemd[1]: Reached target Timer Units.
client # [2023483.583289] client systemd[1]: Listening on D-Bus System Message Bus Socket.
client # [2023483.583492] client systemd[1]: Listening on Nix Daemon Socket.
client # [2023483.583710] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
client # [2023483.583756] client systemd[1]: Reached target Socket Units.
client # [2023483.583849] client systemd[1]: Reached target Basic System.
client # [2023483.586661] client systemd[1]: Starting data mesher daemon...
client # [2023483.588060] client systemd[1]: Starting Import lastlog data into lastlog2 database...
client # [2023483.589534] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...
client # [2023483.591742] client systemd[1]: Starting D-Bus System Message Bus...
client # [2023483.654805] client systemd[1]: Finished Import lastlog data into lastlog2 database.
client # [2023483.846319] client systemd[1]: Started Name Service Cache Daemon (nsncd).
client # [2023483.846602] client nsncd[215]: Sep 27 17:31:43.832 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
client # [2023483.846426] client systemd[1]: Reached target User and Group Name Lookups.
client # [2023483.873063] client systemd[1]: Starting User Login Management...
client # [2023483.874530] client systemd[1]: Starting Permit User Sessions...
client # [2023483.886616] client systemd[1]: Finished Permit User Sessions.
client # [2023483.888293] client systemd[1]: Started Console Getty.
client # [2023483.888372] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
client # [2023483.888416] client systemd[1]: Reached target Login Prompts.
client # [2023484.001358] client dbus-broker-launch[216]: Looking up NSS user entry for 'systemd-timesync'...
client # [2023484.002670] client dbus-broker-launch[216]: NSS returned no entry for 'systemd-timesync'
client # [2023484.002670] client dbus-broker-launch[216]: Invalid user-name in /nix/store/pdpmvp4r97cgcvimwlbhfb5jkb5aja3i-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
client # [2023484.003193] client systemd[1]: Started D-Bus System Message Bus.
client # [2023484.011928] client dbus-broker-launch[216]: Ready
server # [2023483.833267] server nsncd[225]: Sep 27 17:31:43.818 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
server # [2023483.833158] server systemd[1]: Reached target User and Group Name Lookups.
server # [2023483.835314] server systemd[1]: Starting User Login Management...
server # [2023483.836901] server systemd[1]: Starting Permit User Sessions...
server # [2023483.880232] server systemd[1]: Finished Permit User Sessions.
server # [2023483.881950] server systemd[1]: Started Console Getty.
server # [2023483.882034] server systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
server # [2023483.882072] server systemd[1]: Reached target Login Prompts.
server # [2023483.974549] server dbus-broker-launch[226]: Looking up NSS user entry for 'systemd-timesync'...
server # [2023483.976375] server dbus-broker-launch[226]: NSS returned no entry for 'systemd-timesync'
server # [2023483.976375] server dbus-broker-launch[226]: Invalid user-name in /nix/store/g0n529d3yw76mxc12jqzqfrvyqxswrfv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
server # [2023483.976929] server systemd[1]: Started D-Bus System Message Bus.
server # [2023483.985652] server dbus-broker-launch[226]: Ready
server # [2023484.425339] server data-mesher[223]: time=2026-09-27T17:31:44.411Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
server # [2023484.426420] server data-mesher[223]: time=2026-09-27T17:31:44.412Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE: [/dns/client.test/tcp/7946]} {12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs
server # [2023484.426420] server data-mesher[223]: time=2026-09-27T17:31:44.412Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
server # [2023484.427999] server data-mesher[223]: time=2026-09-27T17:31:44.413Z level=INFO msg="checking file integrity"
server # [2023484.428128] server data-mesher[223]: time=2026-09-27T17:31:44.413Z level=INFO msg="file integrity check complete"
server # [2023484.431872] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="libp2p host created" peer_id=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"
server # [2023484.431913] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="registered HTTP route" method=GET path=/files
server # [2023484.431913] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
server # [2023484.431913] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
server # [2023484.431913] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="starting server"
server # [2023484.432011] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="waiting for DHT to populate" delay=10s
server # [2023484.432110] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="HTTP server listening" address=[::1]:7331
server # [2023484.432147] server data-mesher[223]: time=2026-09-27T17:31:44.417Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
server # [2023484.437831] server data-mesher[223]: time=2026-09-27T17:31:44.423Z level=INFO msg="peer connected" peer_id=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE remote_addr=/ip4/192.168.1.1/tcp/7946
server # [2023484.463692] server data-mesher[223]: time=2026-09-27T17:31:44.449Z level=INFO msg="peer connected" peer_id=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE remote_addr=/ip4/192.168.1.1/tcp/33084
server # [2023484.640155] server systemd-networkd[218]: eth1: Gained IPv6LL
server # [2023484.645790] server systemd-logind[243]: New seat seat0.
server # [2023484.645970] server systemd[1]: Started User Login Management.
server # [2023484.648044] server systemd[1]: Starting linger-users.service...
client # [2023484.415165] client data-mesher[213]: time=2026-09-27T17:31:44.400Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
client # [2023484.416912] client data-mesher[213]: time=2026-09-27T17:31:44.402Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE: [/dns/client.test/tcp/7946]} {12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE
client # [2023484.416912] client data-mesher[213]: time=2026-09-27T17:31:44.402Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
client # [2023484.423231] client data-mesher[213]: time=2026-09-27T17:31:44.409Z level=INFO msg="checking file integrity"
client # [2023484.423377] client data-mesher[213]: time=2026-09-27T17:31:44.409Z level=INFO msg="file integrity check complete"
client # [2023484.428640] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="libp2p host created" peer_id=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"
client # [2023484.428715] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="registered HTTP route" method=GET path=/files
client # [2023484.428715] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
client # [2023484.428715] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
client # [2023484.428715] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="starting server"
client # [2023484.428896] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="waiting for DHT to populate" delay=10s
client # [2023484.428896] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="HTTP server listening" address=[::1]:7331
client # [2023484.428995] client data-mesher[213]: time=2026-09-27T17:31:44.414Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
client # [2023484.438569] client data-mesher[213]: time=2026-09-27T17:31:44.424Z level=INFO msg="peer connected" peer_id=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2023484.462738] client data-mesher[213]: time=2026-09-27T17:31:44.448Z level=INFO msg="peer connected" peer_id=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs remote_addr=/ip4/192.168.1.2/tcp/7946
client # [2023484.480164] client systemd-networkd[208]: eth1: Gained IPv6LL
client # [2023484.651323] client systemd-logind[233]: New seat seat0.
client # [2023484.652126] client systemd[1]: Started User Login Management.
client # [2023484.684708] client systemd[1]: Starting linger-users.service...
server # [2023484.694649] server systemd[1]: linger-users.service: Deactivated successfully.
server # [2023484.694818] server systemd[1]: Finished linger-users.service.
client # [2023484.699292] client systemd[1]: linger-users.service: Deactivated successfully.
client # [2023484.699426] client systemd[1]: Finished linger-users.service.
server: still waiting for container 'server' to reach ready state...
server # [2023494.429730] server data-mesher[223]: time=2026-09-27T17:31:54.415Z level=INFO msg="received state sync from peer" peer=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE
server # [2023494.429730] server data-mesher[223]: time=2026-09-27T17:31:54.415Z level=INFO msg="merging remote state" peer=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE
server # [2023494.432687] server data-mesher[223]: time=2026-09-27T17:31:54.418Z level=INFO msg="performing state exchange with peers on join" count=1
server # [2023494.432687] server data-mesher[223]: time=2026-09-27T17:31:54.418Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE timeout=5s
server # [2023494.433377] server data-mesher[223]: time=2026-09-27T17:31:54.419Z level=INFO msg="merging remote state" peer=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE
server # [2023494.433377] server data-mesher[223]: time=2026-09-27T17:31:54.419Z level=INFO msg="state exchange complete" peer=12D3KooWQryehCnsAFKqR4PcfoTesq69tVGZjJzr2YhwLbvG7zAE timeout=5s
server # [2023494.433501] server data-mesher[223]: time=2026-09-27T17:31:54.419Z level=INFO msg="server started"
server # [2023494.433556] server data-mesher[223]: time=2026-09-27T17:31:54.419Z level=INFO msg="starting expired-file sweeper" interval=1m0s
server # [2023494.433746] server systemd[1]: Started data mesher daemon.
server # [2023494.436106] server systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2023494.428926] client data-mesher[213]: time=2026-09-27T17:31:54.414Z level=INFO msg="performing state exchange with peers on join" count=1
client # [2023494.428926] client data-mesher[213]: time=2026-09-27T17:31:54.414Z level=DEBUG msg="initiating state exchange" peer=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs timeout=5s
client # [2023494.429963] client data-mesher[213]: time=2026-09-27T17:31:54.415Z level=INFO msg="merging remote state" peer=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs
client # [2023494.429963] client data-mesher[213]: time=2026-09-27T17:31:54.415Z level=INFO msg="state exchange complete" peer=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs timeout=5s
client # [2023494.430081] client data-mesher[213]: time=2026-09-27T17:31:54.415Z level=INFO msg="server started"
client # [2023494.430334] client systemd[1]: Started data mesher daemon.
client # [2023494.430852] client data-mesher[213]: time=2026-09-27T17:31:54.416Z level=INFO msg="starting expired-file sweeper" interval=1m0s
client # [2023494.432949] client systemd[1]: Starting Unbound recursive Domain Name Server...
client # [2023494.433121] client data-mesher[213]: time=2026-09-27T17:31:54.418Z level=INFO msg="received state sync from peer" peer=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs
client # [2023494.433121] client data-mesher[213]: time=2026-09-27T17:31:54.418Z level=INFO msg="merging remote state" peer=12D3KooWDsHyY5iTVTnuRBfkCBupwbokSS86L6MNChcXiJWXFKVs
client # [2023495.340495] client unbound-pre-start[275]: Root anchor updated!
client # [2023495.354027] client unbound-pre-start[279]: setup in directory /var/lib/unbound
server # [2023495.317750] server unbound-pre-start[286]: Root anchor updated!
server # [2023495.331419] server unbound-pre-start[290]: setup in directory /var/lib/unbound
server # [2023496.002856] server unbound-pre-start[299]: Certificate request self-signature ok
server # [2023496.002856] server unbound-pre-start[299]: subject=CN=unbound-control
server # [2023496.022664] server unbound-pre-start[290]: removing artifacts
server # [2023496.024864] server unbound-pre-start[290]: Setup success. Certificates created. Enable in unbound.conf file to use
client # [2023496.535682] client unbound-pre-start[288]: Certificate request self-signature ok
client # [2023496.535682] client unbound-pre-start[288]: subject=CN=unbound-control
client # [2023496.555564] client unbound-pre-start[279]: removing artifacts
client # [2023496.557456] client unbound-pre-start[279]: Setup success. Certificates created. Enable in unbound.conf file to use
server # [2023496.963322] server unbound[304]: [304:0] notice: init module 0: validator
server # [2023496.963451] server unbound[304]: [304:0] notice: init module 1: iterator
server # [2023496.970011] server unbound[304]: [304:0] info: start of service (unbound 1.26.0).
server # [2023496.970122] server systemd[1]: Started Unbound recursive Domain Name Server.
server # [2023496.970363] server systemd[1]: Reached target Multi-User System.
server # [2023496.970472] server systemd[1]: Reached target Host and Network Name Lookups.
server # [2023496.971520] server systemd[1]: Starting Reload unbound zone configuration...
server # [2023497.034178] server unbound[304]: [304:0] info: service stopped (unbound 1.26.0).
server # [2023497.034513] server unbound-control[307]: ok
server # [2023497.034538] server unbound[304]: [304:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2023497.034544] server unbound[304]: [304:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
server # [2023497.036253] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2023497.036318] server unbound[304]: [304:0] notice: Restart of unbound 1.26.0.
server # [2023497.036668] server systemd[1]: Finished Reload unbound zone configuration.
server # [2023497.037184] server unbound[304]: [304:0] notice: init module 0: validator
server # [2023497.037247] server unbound[304]: [304:0] notice: init module 1: iterator
server # [2023497.041860] server unbound[304]: [304:0] info: start of service (unbound 1.26.0).
server # [2023497.044209] server systemd[1]: Startup finished in 15.133s.
server: (finished: waiting for unit unbound.service, in 16.17 seconds)
client: waiting for unit unbound.service
client: (finished: waiting for unit unbound.service, in 0.09 seconds)
server: waiting for unit data-mesher.service
server: (finished: waiting for unit data-mesher.service, in 0.02 seconds)
server: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1, in 0.03 seconds)
server: must succeed: data-mesher file update --network-id /nix/store/xa27jjjrwdjp58yprvlqv8nxdcqcmydh-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames
server: (finished: must succeed: data-mesher file update --network-id /nix/store/xa27jjjrwdjp58yprvlqv8nxdcqcmydh-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames, in 0.07 seconds)
??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/z312acj8n2ggn1w3agk97mbvdsm371iw-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test
??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/z312acj8n2ggn1w3agk97mbvdsm371iw-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test, in 0.02 seconds)
(finished: run the VM test script, in 16.41 seconds)
client # [2023497.490077] client unbound[293]: [293:0] notice: init module 0: validator
client # [2023497.490193] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2023497.495903] client unbound[293]: [293:0] info: start of service (unbound 1.26.0).
client # [2023497.495988] client systemd[1]: Started Unbound recursive Domain Name Server.
client # [2023497.496237] client systemd[1]: Reached target Multi-User System.
client # [2023497.496348] client systemd[1]: Reached target Host and Network Name Lookups.
client # [2023497.497380] client systemd[1]: Starting Reload unbound zone configuration...
client # [2023497.561562] client unbound[293]: [293:0] info: service stopped (unbound 1.26.0).
client # [2023497.561893] client unbound-control[296]: ok
client # [2023497.561915] client unbound[293]: [293:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting
client # [2023497.561921] client unbound[293]: [293:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0
client # [2023497.563589] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.
client # [2023497.563700] client unbound[293]: [293:0] notice: Restart of unbound 1.26.0.
client # [2023497.563942] client systemd[1]: Finished Reload unbound zone configuration.
client # [2023497.564521] client systemd[1]: Startup finished in 15.658s.
client # [2023497.564607] client unbound[293]: [293:0] notice: init module 0: validator
client # [2023497.564670] client unbound[293]: [293:0] notice: init module 1: iterator
client # [2023497.569260] client unbound[293]: [293:0] info: start of service (unbound 1.26.0).
test script finished in 16.54s
cleanup
kill NspawnMachine (pid 52)
kill NspawnMachine (pid 53)
server # [2023497.680995] server systemd[1]: Starting Reload unbound zone configuration...
server # [2023497.719980] server data-mesher[223]: time=2026-09-27T17:31:57.705Z level=INFO msg=http_request uri=/files/dns/cnames status=204
server # [2023497.733746] server unbound[304]: [304:0] info: service stopped (unbound 1.26.0).
server # [2023497.734079] server unbound-control[342]: ok
server # [2023497.734172] server unbound[304]: [304:0] info: server stats for thread 0: 4 queries, 1 answers from cache, 3 recursions, 0 prefetch, 0 rejected by ip ratelimiting
server # [2023497.734177] server unbound[304]: [304:0] info: server stats for thread 0: requestlist max 2 avg 1.33333 exceeded 0 jostled 0
server # [2023497.735569] server unbound[304]: [304:0] notice: Restart of unbound 1.26.0.
server # [2023497.736102] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.
server # [2023497.736283] server systemd[1]: Finished Reload unbound zone configuration.
server # [2023497.736483] server unbound[304]: [304:0] notice: init module 0: validator
server # [2023497.736541] server unbound[304]: [304:0] notice: init module 1: iterator
server # [2023497.740879] server unbound[304]: [304:0] info: start of service (unbound 1.26.0).
Container client terminated by signal KILL.
(finished: cleanup, in 0.33 seconds)
Container server terminated by signal KILL.