container-test-run-dm-dns
checks.aarch64-linux.dm-dns
· build #570
· raw
1Machine state will be reset. To keep it, pass --keep-machine-state2start all VLans3(finished: start all VLans, in 0.00 seconds)45Test will time out and terminate in 3600.0 seconds6run the VM test script7additionally exposed symbols:8 client, server,9 vlan1,10 start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh11start all VMs12client: systemd-nspawn running (pid 52)13server: systemd-nspawn running (pid 53)14client: Waiting for journal at /build/vm-state-client/var/log/journal...15server: Waiting for journal at /build/vm-state-server/var/log/journal...16(finished: start all VMs, in 0.00 seconds)17server: waiting for unit unbound.service18nixos-nspawn(server): TAP vde-tap1 not found; container will be isolated from VDE19nixos-nspawn(server): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.20nixos-nspawn(client): TAP vde-tap1 not found; container will be isolated from VDE21nixos-nspawn(client): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.22Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.23Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.24░ Spawning container server on /build/vm-state-server.25░ Spawning container client on /build/vm-state-client.26server # No journal files were found.27server # No journal boot entry found for the specified boot (+0).28client # No journal files were found.29client # No journal boot entry found for the specified boot (+0).30server # [7468822.569025] server systemd-journald[96]: Journal started31server # [7468822.569088] server systemd-journald[96]: Runtime Journal (/run/log/journal/2ff996f55b0043e285973bc085317ec3) is 8M, max 2.5G, 2.4G free.32server # [7468822.571461] server systemd[1]: Finished Create Static Device Nodes in /dev gracefully.33server # [7468822.581001] server systemd[1]: Starting Flush Journal to Persistent Storage...34server # [7468822.582120] server systemd[1]: Starting Network Name Resolution...35server # [7468822.583064] server systemd[1]: Starting Create Static Device Nodes in /dev...36server # [7468822.592185] server systemd-journald[96]: Time spent on flushing to /var/log/journal/2ff996f55b0043e285973bc085317ec3 is 1.541ms for 6 entries.37server # [7468822.592185] server systemd-journald[96]: System Journal (/var/log/journal/2ff996f55b0043e285973bc085317ec3) is 8M, max 4G, 3.9G free.38server # [7468822.601117] server systemd[1]: Finished Create Static Device Nodes in /dev.39server # [7468822.602115] server systemd[1]: Reached target Preparation for Local File Systems.40server # [7468822.602748] server systemd[1]: Reached target Local File Systems.41server # [7468822.603747] server systemd[1]: Listening on Boot Loader Control Service Socket.42server # [7468822.603813] server systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container43server # [7468822.605195] server systemd[1]: Starting Save Transient machine-id to Disk...44server # [7468822.605247] server systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys45server # [7468822.648419] server systemd[1]: Finished Flush Journal to Persistent Storage.46server # [7468822.650352] server systemd[1]: Starting Create System Files and Directories...47server # [7468822.666613] server systemd-tmpfiles[157]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted48server # [7468822.666842] server systemd-tmpfiles[157]: fchmod() of /var/log/journal failed: Operation not permitted49server # [7468822.666993] server systemd-tmpfiles[157]: fchmod() of /var/log/journal/2ff996f55b0043e285973bc085317ec3 failed: Operation not permitted50server # [7468822.667226] server systemd-tmpfiles[157]: fchmod() of /run/log/journal failed: Operation not permitted51server # [7468822.674571] server systemd[1]: Finished Create System Files and Directories.52server # [7468822.680354] server systemd[1]: Starting Rebuild Journal Catalog...53server # [7468822.684263] server systemd[1]: Starting Record System Boot/Shutdown in UTMP...54server # [7468822.696751] server systemd[1]: Finished Rebuild Journal Catalog.55server # [7468822.698923] server systemd[1]: Starting Update is Completed...56server # [7468822.700466] server systemd[1]: Finished Record System Boot/Shutdown in UTMP.57server # [7468822.712298] server systemd[1]: Finished Update is Completed.58server # [7468822.747933] server systemd[1]: Finished Firewall.59server # [7468822.748654] server systemd[1]: Reached target Preparation for Network.60server # [7468822.749006] server systemd[1]: Listening on Network Management Resolve Hook Socket.61server # [7468822.750333] server systemd[1]: Starting Network Management...62client # [7468822.551896] client systemd-journald[87]: Journal started63client # [7468822.551964] client systemd-journald[87]: Runtime Journal (/run/log/journal/1f44a97ebfc444a2ac4d824750db8516) is 8M, max 2.5G, 2.4G free.64client # [7468822.568285] client systemd[1]: Finished Create Static Device Nodes in /dev gracefully.65client # [7468822.588201] client systemd[1]: Starting Flush Journal to Persistent Storage...66client # [7468822.592160] client systemd-journald[87]: Time spent on flushing to /var/log/journal/1f44a97ebfc444a2ac4d824750db8516 is 1.656ms for 4 entries.67client # [7468822.592160] client systemd-journald[87]: System Journal (/var/log/journal/1f44a97ebfc444a2ac4d824750db8516) is 8M, max 4G, 3.9G free.68client # [7468822.596256] client systemd[1]: Starting Network Name Resolution...69client # [7468822.601732] client systemd[1]: Starting Create Static Device Nodes in /dev...70client # [7468822.640516] client systemd[1]: Finished Create Static Device Nodes in /dev.71client # [7468822.640780] client systemd[1]: Reached target Preparation for Local File Systems.72client # [7468822.640884] client systemd[1]: Reached target Local File Systems.73client # [7468822.641698] client systemd[1]: Listening on Boot Loader Control Service Socket.74client # [7468822.641751] client systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container75client # [7468822.642761] client systemd[1]: Starting Save Transient machine-id to Disk...76client # [7468822.642811] client systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys77client # [7468822.645796] client systemd[1]: Finished Flush Journal to Persistent Storage.78client # [7468822.647061] client systemd[1]: Starting Create System Files and Directories...79client # [7468822.663883] client systemd-tmpfiles[144]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted80client # [7468822.664598] client systemd-tmpfiles[144]: fchmod() of /var/log/journal failed: Operation not permitted81client # [7468822.664728] client systemd-tmpfiles[144]: fchmod() of /var/log/journal/1f44a97ebfc444a2ac4d824750db8516 failed: Operation not permitted82client # [7468822.664926] client systemd-tmpfiles[144]: fchmod() of /run/log/journal failed: Operation not permitted83client # [7468822.671525] client systemd[1]: Finished Create System Files and Directories.84client # [7468822.674561] client systemd[1]: Starting Rebuild Journal Catalog...85client # [7468822.675596] client systemd[1]: Starting Record System Boot/Shutdown in UTMP...86client # [7468822.688800] client systemd[1]: Finished Record System Boot/Shutdown in UTMP.87client # [7468822.697033] client systemd[1]: Finished Rebuild Journal Catalog.88client # [7468822.698524] client systemd[1]: Starting Update is Completed...89client # [7468822.711912] client systemd[1]: Finished Update is Completed.90client # [7468822.768426] client systemd[1]: Finished Firewall.91client # [7468822.769661] client systemd[1]: Reached target Preparation for Network.92client # [7468822.770005] client systemd[1]: Listening on Network Management Resolve Hook Socket.93client # [7468822.774053] client systemd[1]: Starting Network Management...94client # [7468823.577856] client systemd-networkd[204]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted95client # [7468823.577954] client systemd-networkd[204]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted96client # [7468823.586157] client systemd-networkd[204]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.97client # [7468823.586333] client systemd-networkd[204]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.98client # [7468823.586550] client systemd-networkd[204]: lo: Link UP99client # [7468823.586554] client systemd-networkd[204]: lo: Gained carrier100client # [7468823.586746] client systemd-networkd[204]: eth1: Configuring with /etc/systemd/network/40-eth1.network.101client # [7468823.587284] client systemd[1]: Started Network Management.102client # [7468823.587404] client systemd-networkd[204]: eth1: Link UP103client # [7468823.587639] client systemd-networkd[204]: eth1: Gained carrier104client # [7468823.588785] client systemd[1]: Starting Enable Persistent Storage in systemd-networkd...105client # [7468823.664362] client systemd[1]: Finished Enable Persistent Storage in systemd-networkd.106client # [7468823.865086] client systemd-resolved[121]: Positive Trust Anchors:107client # [7468823.865097] client systemd-resolved[121]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d108client # [7468823.865100] client systemd-resolved[121]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16109server # [7468823.608909] server systemd-networkd[213]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted110server # [7468823.609018] server systemd-networkd[213]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted111server # [7468823.615716] server systemd-networkd[213]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.112server # [7468823.615883] server systemd-networkd[213]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.113server # [7468823.616062] server systemd-networkd[213]: lo: Link UP114server # [7468823.616065] server systemd-networkd[213]: lo: Gained carrier115server # [7468823.616273] server systemd-networkd[213]: eth1: Configuring with /etc/systemd/network/40-eth1.network.116server # [7468823.616646] server systemd[1]: Started Network Management.117server # [7468823.656547] server systemd[1]: Starting Enable Persistent Storage in systemd-networkd...118server # [7468823.656569] server systemd-networkd[213]: eth1: Link UP119server # [7468823.656798] server systemd-networkd[213]: eth1: Gained carrier120server # [7468823.709978] server systemd[1]: Finished Enable Persistent Storage in systemd-networkd.121server # [7468823.825688] server systemd-resolved[122]: Positive Trust Anchors:122server # [7468823.825700] server systemd-resolved[122]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d123server # [7468823.825702] server systemd-resolved[122]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16124server # [7468823.825737] server systemd-resolved[122]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test125server # [7468823.848832] server systemd-resolved[122]: Using system hostname 'server'.126server # [7468823.850249] server systemd[1]: Started Network Name Resolution.127server # [7468823.850331] server systemd[1]: Reached target Network.128server # [7468823.850398] server systemd[1]: Reached target System Initialization.129server # [7468823.850478] server systemd[1]: Started Watch for zone file changes.130server # [7468823.850506] server systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container131server # [7468823.850533] server systemd[1]: Started Daily Cleanup of Temporary Directories.132server # [7468823.850555] server systemd[1]: Reached target Path Units.133server # [7468823.850581] server systemd[1]: Reached target Timer Units.134server # [7468823.850708] server systemd[1]: Listening on D-Bus System Message Bus Socket.135server # [7468823.850892] server systemd[1]: Listening on Nix Daemon Socket.136server # [7468823.851008] server systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.137server # [7468823.851027] server systemd[1]: Reached target Socket Units.138server # [7468823.851065] server systemd[1]: Reached target Basic System.139server # [7468823.852508] server systemd[1]: Starting data mesher daemon...140server # [7468823.853324] server systemd[1]: Starting Import lastlog data into lastlog2 database...141server # [7468823.854150] server systemd[1]: Starting Name Service Cache Daemon (nsncd)...142server # [7468823.855359] server systemd[1]: Starting D-Bus System Message Bus...143client # [7468823.865135] client systemd-resolved[121]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test144client # [7468823.887245] client systemd-resolved[121]: Using system hostname 'client'.145client # [7468823.888578] client systemd[1]: Started Network Name Resolution.146client # [7468823.888660] client systemd[1]: Reached target Network.147client # [7468823.888726] client systemd[1]: Reached target System Initialization.148client # [7468823.888803] client systemd[1]: Started Watch for zone file changes.149client # [7468823.888838] client systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container150client # [7468823.888859] client systemd[1]: Started Daily Cleanup of Temporary Directories.151client # [7468823.888876] client systemd[1]: Reached target Path Units.152client # [7468823.888900] client systemd[1]: Reached target Timer Units.153client # [7468823.889010] client systemd[1]: Listening on D-Bus System Message Bus Socket.154client # [7468823.889121] client systemd[1]: Listening on Nix Daemon Socket.155client # [7468823.889227] client systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.156client # [7468823.889245] client systemd[1]: Reached target Socket Units.157client # [7468823.889278] client systemd[1]: Reached target Basic System.158client # [7468823.964496] client systemd[1]: Starting data mesher daemon...159client # [7468823.965404] client systemd[1]: Starting Import lastlog data into lastlog2 database...160client # [7468823.966383] client systemd[1]: Starting Name Service Cache Daemon (nsncd)...161client # [7468823.969618] client systemd[1]: Starting D-Bus System Message Bus...162client # [7468823.988706] client systemd[1]: Finished Import lastlog data into lastlog2 database.163client # [7468824.071046] client nsncd[211]: Sep 03 10:04:10.124 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"164client # [7468824.071947] client systemd[1]: Started Name Service Cache Daemon (nsncd).165client # [7468824.072069] client systemd[1]: Reached target User and Group Name Lookups.166client # [7468824.073808] client systemd[1]: Starting User Login Management...167client # [7468824.075243] client systemd[1]: Starting Permit User Sessions...168server # [7468823.981115] server systemd[1]: Finished Import lastlog data into lastlog2 database.169server # [7468824.074147] server nsncd[220]: Sep 03 10:04:10.127 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"170server # [7468824.074197] server systemd[1]: Started Name Service Cache Daemon (nsncd).171server # [7468824.074271] server systemd[1]: Reached target User and Group Name Lookups.172server # [7468824.075414] server systemd[1]: Starting User Login Management...173server # [7468824.076220] server systemd[1]: Starting Permit User Sessions...174server # [7468824.123875] server systemd[1]: Finished Permit User Sessions.175server # [7468824.124995] server systemd[1]: Started Console Getty.176server # [7468824.125046] server systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0177server # [7468824.125064] server systemd[1]: Reached target Login Prompts.178server # [7468824.179677] server dbus-broker-launch[221]: Looking up NSS user entry for 'systemd-timesync'...179server # [7468824.180356] server dbus-broker-launch[221]: NSS returned no entry for 'systemd-timesync'180server # [7468824.180356] server dbus-broker-launch[221]: Invalid user-name in /nix/store/51cip6687wc28id69g2dz8siw2hfwrij-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"181server # [7468824.180857] server systemd[1]: Started D-Bus System Message Bus.182server # [7468824.188982] server dbus-broker-launch[221]: Ready183server # [7468824.219089] server systemd[1]: etc-machine\x2did.mount: Deactivated successfully.184server # [7468824.220194] server systemd[1]: Finished Save Transient machine-id to Disk.185client # [7468824.122920] client systemd[1]: Finished Permit User Sessions.186client # [7468824.123987] client systemd[1]: Started Console Getty.187client # [7468824.124042] client systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0188client # [7468824.124063] client systemd[1]: Reached target Login Prompts.189client # [7468824.165874] client dbus-broker-launch[212]: Looking up NSS user entry for 'systemd-timesync'...190client # [7468824.167611] client dbus-broker-launch[212]: NSS returned no entry for 'systemd-timesync'191client # [7468824.167611] client dbus-broker-launch[212]: Invalid user-name in /nix/store/giqgsa6vjp02ngnhasy010jgsrrlrx1x-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"192client # [7468824.168174] client systemd[1]: Started D-Bus System Message Bus.193client # [7468824.175433] client dbus-broker-launch[212]: Ready194client # [7468824.219695] client systemd[1]: etc-machine\x2did.mount: Deactivated successfully.195client # [7468824.220675] client systemd[1]: Finished Save Transient machine-id to Disk.196client # [7468824.511380] client data-mesher[209]: time=2026-09-03T10:04:10.564Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]197client # [7468824.512559] client data-mesher[209]: time=2026-09-03T10:04:10.565Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn: [/dns/client.test/tcp/7946]} {12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn198client # [7468824.512625] client data-mesher[209]: time=2026-09-03T10:04:10.565Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml199client # [7468824.540058] client data-mesher[209]: time=2026-09-03T10:04:10.593Z level=INFO msg="checking file integrity"200client # [7468824.540184] client data-mesher[209]: time=2026-09-03T10:04:10.593Z level=INFO msg="file integrity check complete"201client # [7468824.544382] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="libp2p host created" peer_id=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"202client # [7468824.544476] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name203client # [7468824.544476] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name204client # [7468824.544476] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="registered HTTP route" method=GET path=/files205client # [7468824.544476] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="starting server"206client # [7468824.544563] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="waiting for DHT to populate" delay=10s207client # [7468824.544616] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="HTTP server listening" address=[::1]:7331208client # [7468824.544645] client data-mesher[209]: time=2026-09-03T10:04:10.597Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331209client # [7468824.552610] client data-mesher[209]: time=2026-09-03T10:04:10.605Z level=INFO msg="peer connected" peer_id=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q remote_addr=/ip4/192.168.1.2/tcp/7946210client # [7468824.579415] client data-mesher[209]: time=2026-09-03T10:04:10.631Z level=INFO msg="peer connected" peer_id=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q remote_addr=/ip4/192.168.1.2/tcp/7946211client # [7468824.657477] client systemd-logind[229]: New seat seat0.212client # [7468824.657679] client systemd[1]: Started User Login Management.213client # [7468824.696563] client systemd[1]: Starting linger-users.service...214client # [7468824.708041] client systemd[1]: linger-users.service: Deactivated successfully.215client # [7468824.708139] client systemd[1]: Finished linger-users.service.216server # [7468824.511842] server data-mesher[218]: time=2026-09-03T10:04:10.564Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]217server # [7468824.512916] server data-mesher[218]: time=2026-09-03T10:04:10.566Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn: [/dns/client.test/tcp/7946]} {12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q: [/dns/server.test/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q218server # [7468824.512916] server data-mesher[218]: time=2026-09-03T10:04:10.566Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml219server # [7468824.542766] server data-mesher[218]: time=2026-09-03T10:04:10.595Z level=INFO msg="checking file integrity"220server # [7468824.542889] server data-mesher[218]: time=2026-09-03T10:04:10.596Z level=INFO msg="file integrity check complete"221server # [7468824.547004] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="libp2p host created" peer_id=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"222server # [7468824.547097] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="registered HTTP route" method=GET path=/files223server # [7468824.547097] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name224server # [7468824.547097] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name225server # [7468824.547097] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="starting server"226server # [7468824.547180] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="waiting for DHT to populate" delay=10s227server # [7468824.547201] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="HTTP server listening" address=[::1]:7331228server # [7468824.547245] server data-mesher[218]: time=2026-09-03T10:04:10.600Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331229server # [7468824.551800] server data-mesher[218]: time=2026-09-03T10:04:10.604Z level=INFO msg="peer connected" peer_id=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn remote_addr=/ip4/192.168.1.1/tcp/7946230server # [7468824.579379] server data-mesher[218]: time=2026-09-03T10:04:10.632Z level=INFO msg="peer connected" peer_id=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn remote_addr=/ip4/192.168.1.1/tcp/57080231server # [7468824.639859] server systemd-logind[238]: New seat seat0.232server # [7468824.640157] server systemd[1]: Started User Login Management.233server # [7468824.641830] server systemd[1]: Starting linger-users.service...234server # [7468824.705021] server systemd[1]: linger-users.service: Deactivated successfully.235server # [7468824.705155] server systemd[1]: Finished linger-users.service.236client # [7468824.896260] client systemd-networkd[204]: eth1: Gained IPv6LL237server # [7468825.024152] server systemd-networkd[213]: eth1: Gained IPv6LL238server: still waiting for container 'server' to reach ready state...239client # [7468834.545314] client data-mesher[209]: time=2026-09-03T10:04:20.598Z level=INFO msg="performing state exchange with peers on join" count=1240client # [7468834.545314] client data-mesher[209]: time=2026-09-03T10:04:20.598Z level=DEBUG msg="initiating state exchange" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q timeout=5s241client # [7468834.546224] client data-mesher[209]: time=2026-09-03T10:04:20.599Z level=INFO msg="merging remote state" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q242client # [7468834.546224] client data-mesher[209]: time=2026-09-03T10:04:20.599Z level=INFO msg="state exchange complete" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q timeout=5s243client # [7468834.546312] client data-mesher[209]: time=2026-09-03T10:04:20.599Z level=INFO msg="server started"244client # [7468834.546535] client systemd[1]: Started data mesher daemon.245client # [7468834.547178] client data-mesher[209]: time=2026-09-03T10:04:20.599Z level=INFO msg="starting expired-file sweeper" interval=1m0s246client # [7468834.548861] client data-mesher[209]: time=2026-09-03T10:04:20.602Z level=INFO msg="received state sync from peer" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q247client # [7468834.548907] client data-mesher[209]: time=2026-09-03T10:04:20.602Z level=INFO msg="merging remote state" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q248client # [7468834.549127] client systemd[1]: Starting Unbound recursive Domain Name Server...249server # [7468834.546051] server data-mesher[218]: time=2026-09-03T10:04:20.599Z level=INFO msg="received state sync from peer" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn250server # [7468834.546051] server data-mesher[218]: time=2026-09-03T10:04:20.599Z level=INFO msg="merging remote state" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn251server # [7468834.547996] server data-mesher[218]: time=2026-09-03T10:04:20.601Z level=INFO msg="performing state exchange with peers on join" count=1252server # [7468834.548121] server data-mesher[218]: time=2026-09-03T10:04:20.601Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn timeout=5s253server # [7468834.549125] server data-mesher[218]: time=2026-09-03T10:04:20.602Z level=INFO msg="merging remote state" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn254server # [7468834.549125] server data-mesher[218]: time=2026-09-03T10:04:20.602Z level=INFO msg="state exchange complete" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn timeout=5s255server # [7468834.549246] server data-mesher[218]: time=2026-09-03T10:04:20.602Z level=INFO msg="server started"256server # [7468834.549481] server systemd[1]: Started data mesher daemon.257server # [7468834.549927] server data-mesher[218]: time=2026-09-03T10:04:20.602Z level=INFO msg="starting expired-file sweeper" interval=1m0s258server # [7468834.551966] server systemd[1]: Starting Unbound recursive Domain Name Server...259client # [7468835.181737] client unbound-pre-start[271]: Root anchor updated!260server # [7468835.181745] server unbound-pre-start[283]: Root anchor updated!261server # [7468835.193190] server unbound-pre-start[287]: setup in directory /var/lib/unbound262client # [7468835.193111] client unbound-pre-start[275]: setup in directory /var/lib/unbound263server # [7468836.549500] server unbound-pre-start[296]: Certificate request self-signature ok264server # [7468836.549500] server unbound-pre-start[296]: subject=CN=unbound-control265server # [7468836.568091] server unbound-pre-start[287]: removing artifacts266server # [7468836.569485] server unbound-pre-start[287]: Setup success. Certificates created. Enable in unbound.conf file to use267server: (finished: waiting for unit unbound.service, in 15.68 seconds)268client: waiting for unit unbound.service269server # [7468837.121785] server unbound[301]: [301:0] notice: init module 0: validator270server # [7468837.121898] server unbound[301]: [301:0] notice: init module 1: iterator271server # [7468837.127547] server unbound[301]: [301:0] info: start of service (unbound 1.26.0).272server # [7468837.127654] server systemd[1]: Started Unbound recursive Domain Name Server.273server # [7468837.127906] server systemd[1]: Reached target Multi-User System.274server # [7468837.128036] server systemd[1]: Reached target Host and Network Name Lookups.275server # [7468837.129030] server systemd[1]: Starting Reload unbound zone configuration...276server # [7468837.187066] server unbound[301]: [301:0] info: service stopped (unbound 1.26.0).277server # [7468837.187411] server unbound-control[304]: ok278server # [7468837.187429] server unbound[301]: [301:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting279server # [7468837.187435] server unbound[301]: [301:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0280server # [7468837.188502] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.281server # [7468837.188676] server systemd[1]: Finished Reload unbound zone configuration.282server # [7468837.188947] server systemd[1]: Startup finished in 15.132s.283server # [7468837.189185] server unbound[301]: [301:0] notice: Restart of unbound 1.26.0.284server # [7468837.190050] server unbound[301]: [301:0] notice: init module 0: validator285server # [7468837.190107] server unbound[301]: [301:0] notice: init module 1: iterator286server # [7468837.194681] server unbound[301]: [301:0] info: start of service (unbound 1.26.0).287client # [7468838.053710] client unbound-pre-start[284]: Certificate request self-signature ok288client # [7468838.053710] client unbound-pre-start[284]: subject=CN=unbound-control289client # [7468838.070804] client unbound-pre-start[275]: removing artifacts290client # [7468838.072664] client unbound-pre-start[275]: Setup success. Certificates created. Enable in unbound.conf file to use291client: (finished: waiting for unit unbound.service, in 1.65 seconds)292server: waiting for unit data-mesher.service293server: (finished: waiting for unit data-mesher.service, in 0.02 seconds)294server: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1295server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 server.test A | grep 10.0.0.1, in 0.03 seconds)296server: must succeed: data-mesher file update --network-id /nix/store/r4b214bb25m8xz6smlpxajscf8lr886g-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames297server: (finished: must succeed: data-mesher file update --network-id /nix/store/r4b214bb25m8xz6smlpxajscf8lr886g-shared-data-mesher-network_network.pub /nix/store/4g9kvmaqs34gisvxgf61p42p665lx8dx-shared-dm-dns_zone.conf --url http://localhost:7331 --key /run/secrets/shared/dm-dns-signing-key/signing.key --name dns/cnames, in 0.07 seconds)298??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.299 File "/nix/store/pg5lbaicpvf34wrdmfh8riwp8avk7lk6-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39300server: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test301??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.302 File "/nix/store/pg5lbaicpvf34wrdmfh8riwp8avk7lk6-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39303server: (finished: waiting for success: dig +short @127.0.0.1 -p 5353 myapp.test CNAME | grep server.test, in 0.02 seconds)304(finished: run the VM test script, in 17.47 seconds)305client # [7468838.678241] client unbound[288]: [288:0] notice: init module 0: validator306client # [7468838.678364] client unbound[288]: [288:0] notice: init module 1: iterator307client # [7468838.683990] client unbound[288]: [288:0] info: start of service (unbound 1.26.0).308client # [7468838.684113] client systemd[1]: Started Unbound recursive Domain Name Server.309client # [7468838.684362] client systemd[1]: Reached target Multi-User System.310client # [7468838.684474] client systemd[1]: Reached target Host and Network Name Lookups.311client # [7468838.685755] client systemd[1]: Starting Reload unbound zone configuration...312client # [7468838.731144] client unbound[288]: [288:0] info: service stopped (unbound 1.26.0).313client # [7468838.731420] client unbound-control[292]: ok314client # [7468838.731507] client unbound[288]: [288:0] info: server stats for thread 0: 1 queries, 0 answers from cache, 1 recursions, 0 prefetch, 0 rejected by ip ratelimiting315client # [7468838.731512] client unbound[288]: [288:0] info: server stats for thread 0: requestlist max 1 avg 1 exceeded 0 jostled 0316client # [7468838.732918] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.317client # [7468838.733237] client systemd[1]: Finished Reload unbound zone configuration.318client # [7468838.733289] client unbound[288]: [288:0] notice: Restart of unbound 1.26.0.319client # [7468838.733670] client systemd[1]: Startup finished in 16.686s.320client # [7468838.734199] client unbound[288]: [288:0] notice: init module 0: validator321client # [7468838.734257] client unbound[288]: [288:0] notice: init module 1: iterator322client # [7468838.738858] client unbound[288]: [288:0] info: start of service (unbound 1.26.0).323server # [7468838.963714] server systemd[1]: Starting Reload unbound zone configuration...324server # [7468839.006835] server data-mesher[218]: time=2026-09-03T10:04:25.059Z level=INFO msg=http_request uri=/files/dns/cnames status=204325server # [7468839.011729] server unbound[301]: [301:0] info: service stopped (unbound 1.26.0).326server # [7468839.012367] server unbound[301]: [301:0] info: server stats for thread 0: 6 queries, 1 answers from cache, 5 recursions, 0 prefetch, 0 rejected by ip ratelimiting327server # [7468839.012374] server unbound[301]: [301:0] info: server stats for thread 0: requestlist max 2 avg 1.6 exceeded 0 jostled 0328server # [7468839.012563] server unbound-control[340]: ok329server # [7468839.013727] server unbound[301]: [301:0] notice: Restart of unbound 1.26.0.330server # [7468839.014290] server systemd[1]: unbound-reload-zones.service: Deactivated successfully.331server # [7468839.014562] server systemd[1]: Finished Reload unbound zone configuration.332server # [7468839.014605] server unbound[301]: [301:0] notice: init module 0: validator333server # [7468839.014658] server unbound[301]: [301:0] notice: init module 1: iterator334server # [7468839.018821] server unbound[301]: [301:0] info: start of service (unbound 1.26.0).335client # [7468839.548166] client data-mesher[209]: time=2026-09-03T10:04:25.601Z level=DEBUG msg="attempting push/pull" peer_count=1336client # [7468839.548166] client data-mesher[209]: time=2026-09-03T10:04:25.601Z level=DEBUG msg="initiating state exchange" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q timeout=5s337client # [7468839.549118] client data-mesher[209]: time=2026-09-03T10:04:25.602Z level=INFO msg="merging remote state" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q338client # [7468839.549153] client data-mesher[209]: time=2026-09-03T10:04:25.602Z level=DEBUG msg="new file detected" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q name=dns/cnames name=dns/cnames339client # [7468839.549153] client data-mesher[209]: time=2026-09-03T10:04:25.602Z level=INFO msg="state exchange complete" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q timeout=5s340client # [7468839.549196] client data-mesher[209]: time=2026-09-03T10:04:25.602Z level=DEBUG msg="push/pull successful" interval=5s341client # [7468839.549216] client data-mesher[209]: time=2026-09-03T10:04:25.602Z level=INFO msg="scheduling file download" name=dns/cnames342client # [7468839.549277] client data-mesher[209]: time=2026-09-03T10:04:25.602Z level=INFO msg="downloading file" name=dns/cnames signed_at="2026-09-03 10:04:25.011 +0000 UTC" signed_by="ax7ZxHFCVQJa2SPHYwm74d6gAvQd8SsJBJEwfh/eBUM=" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q343client # [7468839.549963] client data-mesher[209]: time=2026-09-03T10:04:25.603Z level=INFO msg="received state sync from peer" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q344client # [7468839.549989] client data-mesher[209]: time=2026-09-03T10:04:25.603Z level=INFO msg="merging remote state" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q345client # [7468839.549989] client data-mesher[209]: time=2026-09-03T10:04:25.603Z level=DEBUG msg="new file detected" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q name=dns/cnames name=dns/cnames346client # [7468839.554398] client systemd[1]: Starting Reload unbound zone configuration...347client # [7468839.572992] client data-mesher[209]: time=2026-09-03T10:04:25.626Z level=INFO msg="download complete" name=dns/cnames signed_at="2026-09-03 10:04:25.011 +0000 UTC" signed_by="ax7ZxHFCVQJa2SPHYwm74d6gAvQd8SsJBJEwfh/eBUM=" peer=12D3KooWDgdFtAuUBk7ZoVXAFYuycQFEDvRkGhBM16ZscPtxNw3Q written=true elapsed=23.730683ms348client # [7468839.656374] client unbound[288]: [288:0] info: service stopped (unbound 1.26.0).349client # [7468839.656705] client unbound-control[297]: ok350client # [7468839.656812] client unbound[288]: [288:0] info: server stats for thread 0: 3 queries, 0 answers from cache, 3 recursions, 0 prefetch, 0 rejected by ip ratelimiting351client # [7468839.656817] client unbound[288]: [288:0] info: server stats for thread 0: requestlist max 2 avg 1.33333 exceeded 0 jostled 0352client # [7468839.658252] client unbound[288]: [288:0] notice: Restart of unbound 1.26.0.353client # [7468839.658312] client systemd[1]: unbound-reload-zones.service: Deactivated successfully.354client # [7468839.658617] client systemd[1]: Finished Reload unbound zone configuration.355client # [7468839.659200] client unbound[288]: [288:0] notice: init module 0: validator356client # [7468839.659257] client unbound[288]: [288:0] notice: init module 1: iterator357client # [7468839.663759] client unbound[288]: [288:0] info: start of service (unbound 1.26.0).358server # [7468839.548763] server data-mesher[218]: time=2026-09-03T10:04:25.601Z level=INFO msg="received state sync from peer" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn359server # [7468839.548763] server data-mesher[218]: time=2026-09-03T10:04:25.601Z level=INFO msg="merging remote state" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn360server # [7468839.549574] server data-mesher[218]: time=2026-09-03T10:04:25.602Z level=DEBUG msg="attempting push/pull" peer_count=1361server # [7468839.549607] server data-mesher[218]: time=2026-09-03T10:04:25.602Z level=DEBUG msg="initiating state exchange" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn timeout=5s362server # [7468839.549638] server data-mesher[218]: time=2026-09-03T10:04:25.602Z level=INFO msg="received file request" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn network="xL4z0FnFMLT6OZFO9tFrQ42afOAdkOM/rPoymyRrIkc=" name=dns/cnames363server # [7468839.550695] server data-mesher[218]: time=2026-09-03T10:04:25.603Z level=INFO msg="merging remote state" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn364server # [7468839.550695] server data-mesher[218]: time=2026-09-03T10:04:25.603Z level=INFO msg="state exchange complete" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn timeout=5s365server # [7468839.550747] server data-mesher[218]: time=2026-09-03T10:04:25.603Z level=DEBUG msg="push/pull successful" interval=5s366server # [7468839.551340] server data-mesher[218]: time=2026-09-03T10:04:25.604Z level=INFO msg="file transfer complete" peer=12D3KooWEGJpGss3dz3AJReaTxZt7FW1dzLvboCxffqVu784Mdhn network="xL4z0FnFMLT6OZFO9tFrQ42afOAdkOM/rPoymyRrIkc=" name=dns/cnames367server # [7468842.665544] server systemd-resolved[122]: Using degraded feature set UDP instead of UDP+EDNS0 for DNS server 127.0.0.1:5353#test.368test script finished in 22.79s369cleanup370kill NspawnMachine (pid 52)371client # [7468844.128159] client systemd-resolved[121]: Using degraded feature set UDP instead of UDP+EDNS0 for DNS server 127.0.0.1:5353#test.372client # [7468844.357556] client systemd-networkd[204]: eth1: Link DOWN373client # [7468844.357572] client systemd-networkd[204]: eth1: Lost carrier374client # [7468844.408651] client systemd-networkd[204]: eth1: Lost IPv6LL address fe80::380a:2fff:feb2:eca6.375kill NspawnMachine (pid 53)376Container client terminated by signal KILL.377Container server terminated by signal KILL.378(finished: cleanup, in 0.54 seconds)