build01: building avb2h3rn1nbl1v9apxl745y79zplj3rk-container-test-run-data-mesher.drv
Machine state will be reset. To keep it, pass --keep-machine-state
start all VLans
(finished: start all VLans, in 0.00 seconds)

Test will time out and terminate in 3600.0 seconds
run the VM test script
additionally exposed symbols:
    alpha, beta, gamma,
    vlan1,
    start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh
start all VMs
alpha: systemd-nspawn running (pid 52)
beta: systemd-nspawn running (pid 54)
alpha: Waiting for journal at /build/vm-state-alpha/var/log/journal...
gamma: systemd-nspawn running (pid 57)
beta: Waiting for journal at /build/vm-state-beta/var/log/journal...
gamma: Waiting for journal at /build/vm-state-gamma/var/log/journal...
(finished: start all VMs, in 0.00 seconds)
alpha: waiting for unit data-mesher.service
nixos-nspawn(gamma): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(gamma): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(alpha): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(alpha): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
nixos-nspawn(beta): TAP vde-tap1 not found; container will be isolated from VDE
nixos-nspawn(beta): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file.
░ Spawning container gamma on /build/vm-state-gamma.
░ Spawning container beta on /build/vm-state-beta.
░ Spawning container alpha on /build/vm-state-alpha.
alpha # No journal files were found.
alpha # No journal boot entry found for the specified boot (+0).
beta # No journal files were found.
beta # No journal boot entry found for the specified boot (+0).
gamma # No journal files were found.
gamma # No journal boot entry found for the specified boot (+0).
alpha # [2620652.023435] alpha systemd-journald[89]: Journal started
alpha # [2620652.023500] alpha systemd-journald[89]: Runtime Journal (/run/log/journal/6f3960ec6dca451586bd251eb41acd02) is 8M, max 2.5G, 2.4G free.
alpha # [2620652.026561] alpha systemd[1]: Finished Apply Kernel Variables.
alpha # [2620652.037692] alpha systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
alpha # [2620652.050075] alpha systemd[1]: Starting Flush Journal to Persistent Storage...
alpha # [2620652.050955] alpha systemd[1]: Starting Network Name Resolution...
alpha # [2620652.051608] alpha systemd[1]: Starting Create Static Device Nodes in /dev...
alpha # [2620652.060177] alpha systemd-journald[89]: Time spent on flushing to /var/log/journal/6f3960ec6dca451586bd251eb41acd02 is 1.623ms for 7 entries.
alpha # [2620652.060177] alpha systemd-journald[89]: System Journal (/var/log/journal/6f3960ec6dca451586bd251eb41acd02) is 8M, max 4G, 3.9G free.
alpha # [2620652.070605] alpha systemd[1]: Finished Create Static Device Nodes in /dev.
alpha # [2620652.071238] alpha systemd[1]: Reached target Preparation for Local File Systems.
alpha # [2620652.071357] alpha systemd[1]: Reached target Local File Systems.
alpha # [2620652.072270] alpha systemd[1]: Listening on Boot Loader Control Service Socket.
alpha # [2620652.072322] alpha systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
alpha # [2620652.073175] alpha systemd[1]: Starting Save Transient machine-id to Disk...
alpha # [2620652.073213] alpha systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
alpha # [2620652.081297] alpha systemd[1]: Finished Flush Journal to Persistent Storage.
alpha # [2620652.082924] alpha systemd[1]: Starting Create System Files and Directories...
alpha # [2620652.100901] alpha systemd-tmpfiles[141]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
alpha # [2620652.101105] alpha systemd-tmpfiles[141]: fchmod() of /var/log/journal failed: Operation not permitted
alpha # [2620652.101247] alpha systemd-tmpfiles[141]: fchmod() of /var/log/journal/6f3960ec6dca451586bd251eb41acd02 failed: Operation not permitted
alpha # [2620652.101457] alpha systemd-tmpfiles[141]: fchmod() of /run/log/journal failed: Operation not permitted
alpha # [2620652.102847] alpha systemd[1]: Finished Create System Files and Directories.
alpha # [2620652.103947] alpha systemd[1]: Starting Rebuild Journal Catalog...
alpha # [2620652.104710] alpha systemd[1]: Starting Record System Boot/Shutdown in UTMP...
alpha # [2620652.118908] alpha systemd[1]: Finished Record System Boot/Shutdown in UTMP.
alpha # [2620652.127185] alpha systemd[1]: Finished Rebuild Journal Catalog.
alpha # [2620652.128362] alpha systemd[1]: Starting Update is Completed...
beta # [2620652.023634] beta systemd-journald[88]: Journal started
alpha # [2620652.129449] alpha systemd[1]: Finished Save Transient machine-id to Disk.
beta # [2620652.023697] beta systemd-journald[88]: Runtime Journal (/run/log/journal/524c33fbaffd42ad8c6d17fd4ce8de75) is 8M, max 2.5G, 2.4G free.
alpha # [2620652.139577] alpha systemd[1]: Finished Update is Completed.
beta # [2620652.028318] beta systemd[1]: Finished Apply Kernel Variables.
alpha # [2620652.192348] alpha systemd[1]: Finished Firewall.
beta # [2620652.039611] beta systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
alpha # [2620652.192887] alpha systemd[1]: Reached target Preparation for Network.
beta # [2620652.052621] beta systemd[1]: Starting Flush Journal to Persistent Storage...
alpha # [2620652.193186] alpha systemd[1]: Listening on Network Management Resolve Hook Socket.
beta # [2620652.053484] beta systemd[1]: Starting Network Name Resolution...
alpha # [2620652.194268] alpha systemd[1]: Starting Network Management...
gamma # [2620652.035259] gamma systemd-journald[89]: Journal started
alpha # [2620652.814174] alpha systemd-networkd[207]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
gamma # [2620652.035322] gamma systemd-journald[89]: Runtime Journal (/run/log/journal/8fbdd5b630934fda8010c58fd83d794c) is 8M, max 2.5G, 2.4G free.
alpha # [2620652.814261] alpha systemd-networkd[207]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
gamma # [2620652.036640] gamma systemd[1]: Finished Apply Kernel Variables.
beta # [2620652.054095] beta systemd[1]: Starting Create Static Device Nodes in /dev...
gamma # [2620652.047641] gamma systemd[1]: Finished Create Static Device Nodes in /dev gracefully.
beta # [2620652.063340] beta systemd-journald[88]: Time spent on flushing to /var/log/journal/524c33fbaffd42ad8c6d17fd4ce8de75 is 1.797ms for 7 entries.
gamma # [2620652.060322] gamma systemd[1]: Starting Flush Journal to Persistent Storage...
beta # [2620652.063340] beta systemd-journald[88]: System Journal (/var/log/journal/524c33fbaffd42ad8c6d17fd4ce8de75) is 8M, max 4G, 3.9G free.
gamma # [2620652.061159] gamma systemd[1]: Starting Network Name Resolution...
beta # [2620652.088114] beta systemd[1]: Finished Flush Journal to Persistent Storage.
gamma # [2620652.061977] gamma systemd[1]: Starting Create Static Device Nodes in /dev...
beta # [2620652.088490] beta systemd[1]: Finished Create Static Device Nodes in /dev.
gamma # [2620652.071385] gamma systemd-journald[89]: Time spent on flushing to /var/log/journal/8fbdd5b630934fda8010c58fd83d794c is 1.767ms for 7 entries.
beta # [2620652.089615] beta systemd[1]: Reached target Preparation for Local File Systems.
gamma # [2620652.071385] gamma systemd-journald[89]: System Journal (/var/log/journal/8fbdd5b630934fda8010c58fd83d794c) is 8M, max 4G, 3.9G free.
alpha # [2620652.823395] alpha systemd-networkd[207]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
gamma # [2620652.090654] gamma systemd[1]: Finished Flush Journal to Persistent Storage.
alpha # [2620652.823564] alpha systemd-networkd[207]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
gamma # [2620652.091011] gamma systemd[1]: Finished Create Static Device Nodes in /dev.
alpha # [2620652.823727] alpha systemd-networkd[207]: lo: Link UP
gamma # [2620652.092479] gamma systemd[1]: Reached target Preparation for Local File Systems.
alpha # [2620652.823732] alpha systemd-networkd[207]: lo: Gained carrier
gamma # [2620652.092590] gamma systemd[1]: Reached target Local File Systems.
alpha # [2620652.823926] alpha systemd-networkd[207]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
gamma # [2620652.093423] gamma systemd[1]: Listening on Boot Loader Control Service Socket.
alpha # [2620652.824382] alpha systemd-networkd[207]: eth1: Link UP
gamma # [2620652.093481] gamma systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
alpha # [2620652.824601] alpha systemd[1]: Started Network Management.
gamma # [2620652.094310] gamma systemd[1]: Starting Save Transient machine-id to Disk...
beta # [2620652.089728] beta systemd[1]: Reached target Local File Systems.
gamma # [2620652.095010] gamma systemd[1]: Starting Create System Files and Directories...
beta # [2620652.090568] beta systemd[1]: Listening on Boot Loader Control Service Socket.
gamma # [2620652.095049] gamma systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
beta # [2620652.090615] beta systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container
gamma # [2620652.113223] gamma systemd-tmpfiles[141]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
beta # [2620652.091407] beta systemd[1]: Starting Save Transient machine-id to Disk...
alpha # [2620652.824715] alpha systemd-networkd[207]: eth1: Gained carrier
beta # [2620652.092244] beta systemd[1]: Starting Create System Files and Directories...
alpha # [2620652.825904] alpha systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
beta # [2620652.092277] beta systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys
alpha # [2620652.865848] alpha systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
beta # [2620652.107900] beta systemd-tmpfiles[143]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted
gamma # [2620652.113397] gamma systemd-tmpfiles[141]: fchmod() of /var/log/journal failed: Operation not permitted
beta # [2620652.108310] beta systemd-tmpfiles[143]: fchmod() of /var/log/journal failed: Operation not permitted
gamma # [2620652.113520] gamma systemd-tmpfiles[141]: fchmod() of /var/log/journal/8fbdd5b630934fda8010c58fd83d794c failed: Operation not permitted
beta # [2620652.108438] beta systemd-tmpfiles[143]: fchmod() of /var/log/journal/524c33fbaffd42ad8c6d17fd4ce8de75 failed: Operation not permitted
gamma # [2620652.113706] gamma systemd-tmpfiles[141]: fchmod() of /run/log/journal failed: Operation not permitted
beta # [2620652.108620] beta systemd-tmpfiles[143]: fchmod() of /run/log/journal failed: Operation not permitted
gamma # [2620652.117592] gamma systemd[1]: Finished Create System Files and Directories.
beta # [2620652.109879] beta systemd[1]: Finished Create System Files and Directories.
gamma # [2620652.118720] gamma systemd[1]: Starting Rebuild Journal Catalog...
beta # [2620652.110841] beta systemd[1]: Starting Rebuild Journal Catalog...
gamma # [2620652.119428] gamma systemd[1]: Starting Record System Boot/Shutdown in UTMP...
beta # [2620652.111500] beta systemd[1]: Starting Record System Boot/Shutdown in UTMP...
gamma # [2620652.129803] gamma systemd[1]: Finished Save Transient machine-id to Disk.
beta # [2620652.126435] beta systemd[1]: Finished Record System Boot/Shutdown in UTMP.
gamma # [2620652.134740] gamma systemd[1]: Finished Record System Boot/Shutdown in UTMP.
beta # [2620652.129895] beta systemd[1]: Finished Save Transient machine-id to Disk.
gamma # [2620652.143774] gamma systemd[1]: Finished Rebuild Journal Catalog.
beta # [2620652.135087] beta systemd[1]: Finished Rebuild Journal Catalog.
gamma # [2620652.144924] gamma systemd[1]: Starting Update is Completed...
beta # [2620652.136189] beta systemd[1]: Starting Update is Completed...
gamma # [2620652.157710] gamma systemd[1]: Finished Update is Completed.
beta # [2620652.147740] beta systemd[1]: Finished Update is Completed.
gamma # [2620652.209421] gamma systemd[1]: Finished Firewall.
beta # [2620652.198091] beta systemd[1]: Finished Firewall.
gamma # [2620652.209573] gamma systemd[1]: Reached target Preparation for Network.
beta # [2620652.198252] beta systemd[1]: Reached target Preparation for Network.
gamma # [2620652.209791] gamma systemd[1]: Listening on Network Management Resolve Hook Socket.
beta # [2620652.198482] beta systemd[1]: Listening on Network Management Resolve Hook Socket.
gamma # [2620652.210763] gamma systemd[1]: Starting Network Management...
beta # [2620652.199472] beta systemd[1]: Starting Network Management...
gamma # [2620652.840515] gamma systemd-networkd[207]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
beta # [2620652.823701] beta systemd-networkd[206]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted
gamma # [2620652.840603] gamma systemd-networkd[207]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
beta # [2620652.823784] beta systemd-networkd[206]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted
gamma # [2620652.849701] gamma systemd-networkd[207]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
beta # [2620652.834576] beta systemd-networkd[206]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
gamma # [2620652.849864] gamma systemd-networkd[207]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
beta # [2620652.834740] beta systemd-networkd[206]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section.
gamma # [2620652.850022] gamma systemd-networkd[207]: lo: Link UP
beta # [2620652.834888] beta systemd-networkd[206]: lo: Link UP
gamma # [2620652.850027] gamma systemd-networkd[207]: lo: Gained carrier
beta # [2620652.834893] beta systemd-networkd[206]: lo: Gained carrier
gamma # [2620652.850218] gamma systemd-networkd[207]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
beta # [2620652.835058] beta systemd-networkd[206]: eth1: Configuring with /etc/systemd/network/40-eth1.network.
gamma # [2620652.850572] gamma systemd[1]: Started Network Management.
gamma # [2620652.856651] gamma systemd-networkd[207]: eth1: Link UP
gamma # [2620652.857052] gamma systemd-networkd[207]: eth1: Gained carrier
gamma # [2620652.857190] gamma systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
gamma # [2620652.894011] gamma systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
beta # [2620652.835431] beta systemd[1]: Started Network Management.
beta # [2620652.856300] beta systemd-networkd[206]: eth1: Link UP
beta # [2620652.856561] beta systemd[1]: Starting Enable Persistent Storage in systemd-networkd...
beta # [2620652.856742] beta systemd-networkd[206]: eth1: Gained carrier
beta # [2620652.910272] beta systemd[1]: Finished Enable Persistent Storage in systemd-networkd.
gamma # [2620653.029283] gamma systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
alpha # [2620653.032676] alpha systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
beta # [2620653.031738] beta systemd[1]: etc-machine\x2did.mount: Deactivated successfully.
alpha # [2620653.146952] alpha systemd-resolved[120]: Positive Trust Anchors:
alpha # [2620653.146962] alpha systemd-resolved[120]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
alpha # [2620653.146966] alpha systemd-resolved[120]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
alpha # [2620653.147000] alpha systemd-resolved[120]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
alpha # [2620653.167643] alpha systemd-resolved[120]: Using system hostname 'alpha'.
gamma # [2620653.139405] gamma systemd-resolved[118]: Positive Trust Anchors:
alpha # [2620653.169019] alpha systemd[1]: Started Network Name Resolution.
gamma # [2620653.139415] gamma systemd-resolved[118]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
alpha # [2620653.169148] alpha systemd[1]: Reached target Network.
gamma # [2620653.139419] gamma systemd-resolved[118]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
alpha # [2620653.169275] alpha systemd[1]: Reached target System Initialization.
gamma # [2620653.139455] gamma systemd-resolved[118]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
alpha # [2620653.169366] alpha systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
gamma # [2620653.159656] gamma systemd-resolved[118]: Using system hostname 'gamma'.
alpha # [2620653.169424] alpha systemd[1]: Started Daily Cleanup of Temporary Directories.
gamma # [2620653.161763] gamma systemd[1]: Started Network Name Resolution.
alpha # [2620653.169457] alpha systemd[1]: Reached target Timer Units.
gamma # [2620653.161898] gamma systemd[1]: Reached target Network.
alpha # [2620653.169688] alpha systemd[1]: Listening on D-Bus System Message Bus Socket.
gamma # [2620653.162027] gamma systemd[1]: Reached target System Initialization.
alpha # [2620653.169892] alpha systemd[1]: Listening on Nix Daemon Socket.
gamma # [2620653.162125] gamma systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
alpha # [2620653.170130] alpha systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
gamma # [2620653.162173] gamma systemd[1]: Started Daily Cleanup of Temporary Directories.
alpha # [2620653.170177] alpha systemd[1]: Reached target Socket Units.
gamma # [2620653.162214] gamma systemd[1]: Reached target Timer Units.
alpha # [2620653.170267] alpha systemd[1]: Reached target Basic System.
gamma # [2620653.162450] gamma systemd[1]: Listening on D-Bus System Message Bus Socket.
alpha # [2620653.192555] alpha systemd[1]: Starting data mesher daemon...
gamma # [2620653.162664] gamma systemd[1]: Listening on Nix Daemon Socket.
alpha # [2620653.193906] alpha systemd[1]: Starting Import lastlog data into lastlog2 database...
gamma # [2620653.162888] gamma systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
alpha # [2620653.195350] alpha systemd[1]: Starting Name Service Cache Daemon (nsncd)...
gamma # [2620653.162939] gamma systemd[1]: Reached target Socket Units.
alpha # [2620653.197434] alpha systemd[1]: Starting D-Bus System Message Bus...
gamma # [2620653.163028] gamma systemd[1]: Reached target Basic System.
alpha # [2620653.221366] alpha systemd[1]: Finished Import lastlog data into lastlog2 database.
gamma # [2620653.165367] gamma systemd[1]: Starting data mesher daemon...
alpha # [2620653.415116] alpha systemd[1]: Started Name Service Cache Daemon (nsncd).
gamma # [2620653.166730] gamma systemd[1]: Starting Import lastlog data into lastlog2 database...
alpha # [2620653.415214] alpha systemd[1]: Reached target Host and Network Name Lookups.
gamma # [2620653.168202] gamma systemd[1]: Starting Name Service Cache Daemon (nsncd)...
alpha # [2620653.415341] alpha systemd[1]: Reached target User and Group Name Lookups.
gamma # [2620653.170450] gamma systemd[1]: Starting D-Bus System Message Bus...
gamma # [2620653.211622] gamma systemd[1]: Finished Import lastlog data into lastlog2 database.
gamma # [2620653.415116] gamma systemd[1]: Started Name Service Cache Daemon (nsncd).
gamma # [2620653.415214] gamma systemd[1]: Reached target Host and Network Name Lookups.
gamma # [2620653.415345] gamma systemd[1]: Reached target User and Group Name Lookups.
beta # [2620653.171704] beta systemd-resolved[118]: Positive Trust Anchors:
beta # [2620653.171715] beta systemd-resolved[118]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d
beta # [2620653.171719] beta systemd-resolved[118]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16
beta # [2620653.171754] beta systemd-resolved[118]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test
beta # [2620653.191855] beta systemd-resolved[118]: Using system hostname 'beta'.
beta # [2620653.193808] beta systemd[1]: Started Network Name Resolution.
beta # [2620653.193940] beta systemd[1]: Reached target Network.
beta # [2620653.194061] beta systemd[1]: Reached target System Initialization.
beta # [2620653.194153] beta systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container
beta # [2620653.194211] beta systemd[1]: Started Daily Cleanup of Temporary Directories.
beta # [2620653.194249] beta systemd[1]: Reached target Timer Units.
beta # [2620653.194470] beta systemd[1]: Listening on D-Bus System Message Bus Socket.
beta # [2620653.194674] beta systemd[1]: Listening on Nix Daemon Socket.
beta # [2620653.194893] beta systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.
beta # [2620653.194944] beta systemd[1]: Reached target Socket Units.
beta # [2620653.195034] beta systemd[1]: Reached target Basic System.
beta # [2620653.197033] beta systemd[1]: Starting data mesher daemon...
beta # [2620653.198346] beta systemd[1]: Starting Import lastlog data into lastlog2 database...
beta # [2620653.199882] beta systemd[1]: Starting Name Service Cache Daemon (nsncd)...
beta # [2620653.201833] beta systemd[1]: Starting D-Bus System Message Bus...
beta # [2620653.221663] beta systemd[1]: Finished Import lastlog data into lastlog2 database.
beta # [2620653.419153] beta systemd[1]: Started Name Service Cache Daemon (nsncd).
beta # [2620653.419245] beta systemd[1]: Reached target Host and Network Name Lookups.
beta # [2620653.419359] beta systemd[1]: Reached target User and Group Name Lookups.
beta # [2620653.419721] beta nsncd[213]: Oct 04 15:24:33.405 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
beta # [2620653.421514] beta systemd[1]: Starting User Login Management...
beta # [2620653.422791] beta systemd[1]: Starting Permit User Sessions...
beta # [2620653.459670] beta systemd[1]: Finished Permit User Sessions.
beta # [2620653.460757] beta systemd[1]: Started Console Getty.
beta # [2620653.460799] beta systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
beta # [2620653.460815] beta systemd[1]: Reached target Login Prompts.
beta # [2620653.566853] beta dbus-broker-launch[214]: Looking up NSS user entry for 'systemd-timesync'...
beta # [2620653.567912] beta dbus-broker-launch[214]: NSS returned no entry for 'systemd-timesync'
beta # [2620653.567912] beta dbus-broker-launch[214]: Invalid user-name in /nix/store/1p0vnpsk1r0q8v22w7hh1w5n745xy5wm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
beta # [2620653.568322] beta systemd[1]: Started D-Bus System Message Bus.
beta # [2620653.576754] beta dbus-broker-launch[214]: Ready
gamma # [2620653.415597] gamma nsncd[214]: Oct 04 15:24:33.401 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
gamma # [2620653.417790] gamma systemd[1]: Starting User Login Management...
gamma # [2620653.419186] gamma systemd[1]: Starting Permit User Sessions...
gamma # [2620653.460351] gamma systemd[1]: Finished Permit User Sessions.
gamma # [2620653.462056] gamma systemd[1]: Started Console Getty.
gamma # [2620653.462129] gamma systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
gamma # [2620653.462167] gamma systemd[1]: Reached target Login Prompts.
gamma # [2620653.610079] gamma dbus-broker-launch[215]: Looking up NSS user entry for 'systemd-timesync'...
gamma # [2620653.611594] gamma dbus-broker-launch[215]: NSS returned no entry for 'systemd-timesync'
gamma # [2620653.611677] gamma dbus-broker-launch[215]: Invalid user-name in /nix/store/1p0vnpsk1r0q8v22w7hh1w5n745xy5wm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
gamma # [2620653.612143] gamma systemd[1]: Started D-Bus System Message Bus.
gamma # [2620653.620596] gamma dbus-broker-launch[215]: Ready
alpha # [2620653.415608] alpha nsncd[214]: Oct 04 15:24:33.401 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"
alpha # [2620653.417891] alpha systemd[1]: Starting User Login Management...
alpha # [2620653.419211] alpha systemd[1]: Starting Permit User Sessions...
alpha # [2620653.459737] alpha systemd[1]: Finished Permit User Sessions.
alpha # [2620653.460847] alpha systemd[1]: Started Console Getty.
alpha # [2620653.460896] alpha systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0
alpha # [2620653.460916] alpha systemd[1]: Reached target Login Prompts.
alpha # [2620653.580030] alpha dbus-broker-launch[215]: Looking up NSS user entry for 'systemd-timesync'...
alpha # [2620653.581308] alpha dbus-broker-launch[215]: NSS returned no entry for 'systemd-timesync'
alpha # [2620653.581308] alpha dbus-broker-launch[215]: Invalid user-name in /nix/store/1p0vnpsk1r0q8v22w7hh1w5n745xy5wm-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"
alpha # [2620653.581764] alpha systemd[1]: Started D-Bus System Message Bus.
alpha # [2620653.589507] alpha dbus-broker-launch[215]: Ready
beta # [2620653.920131] beta systemd-networkd[206]: eth1: Gained IPv6LL
beta # [2620653.981687] beta data-mesher[211]: time=2026-10-04T15:24:33.967Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
beta # [2620653.982760] beta data-mesher[211]: time=2026-10-04T15:24:33.968Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe: [/dns/alpha.clan/tcp/7946]} {12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy: [/dns/beta.clan/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
beta # [2620653.982760] beta data-mesher[211]: time=2026-10-04T15:24:33.968Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
beta # [2620653.985705] beta data-mesher[211]: time=2026-10-04T15:24:33.971Z level=INFO msg="checking file integrity"
beta # [2620653.985846] beta data-mesher[211]: time=2026-10-04T15:24:33.971Z level=INFO msg="file integrity check complete"
beta # [2620653.989920] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="libp2p host created" peer_id=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.2/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::2/tcp/7946]"
beta # [2620653.989968] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="registered HTTP route" method=GET path=/files
beta # [2620653.989968] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
beta # [2620653.989968] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
beta # [2620653.989968] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="starting server"
beta # [2620653.990072] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="waiting for DHT to populate" delay=10s
beta # [2620653.990157] beta data-mesher[211]: time=2026-10-04T15:24:33.975Z level=INFO msg="HTTP server listening" address=[::1]:7331
beta # [2620653.990196] beta data-mesher[211]: time=2026-10-04T15:24:33.976Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
beta # [2620653.994593] beta data-mesher[211]: time=2026-10-04T15:24:33.980Z level=INFO msg="peer connected" peer_id=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe remote_addr=/ip6/2001:db8:1::1/tcp/7946
gamma # [2620653.966536] gamma data-mesher[212]: time=2026-10-04T15:24:33.952Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
gamma # [2620653.967610] gamma data-mesher[212]: time=2026-10-04T15:24:33.953Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe: [/dns/alpha.clan/tcp/7946]} {12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy: [/dns/beta.clan/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
gamma # [2620653.967610] gamma data-mesher[212]: time=2026-10-04T15:24:33.953Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
gamma # [2620653.970130] gamma data-mesher[212]: time=2026-10-04T15:24:33.955Z level=INFO msg="checking file integrity"
gamma # [2620653.970243] gamma data-mesher[212]: time=2026-10-04T15:24:33.956Z level=INFO msg="file integrity check complete"
gamma # [2620653.974050] gamma data-mesher[212]: time=2026-10-04T15:24:33.959Z level=INFO msg="libp2p host created" peer_id=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.3/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::3/tcp/7946]"
gamma # [2620653.974130] gamma data-mesher[212]: time=2026-10-04T15:24:33.959Z level=INFO msg="registered HTTP route" method=GET path=/files
gamma # [2620653.974130] gamma data-mesher[212]: time=2026-10-04T15:24:33.959Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
gamma # [2620653.974130] gamma data-mesher[212]: time=2026-10-04T15:24:33.959Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
gamma # [2620653.974130] gamma data-mesher[212]: time=2026-10-04T15:24:33.959Z level=INFO msg="starting server"
gamma # [2620653.974308] gamma data-mesher[212]: time=2026-10-04T15:24:33.960Z level=INFO msg="waiting for DHT to populate" delay=10s
gamma # [2620653.974308] gamma data-mesher[212]: time=2026-10-04T15:24:33.960Z level=INFO msg="HTTP server listening" address=[::1]:7331
gamma # [2620653.974903] gamma data-mesher[212]: time=2026-10-04T15:24:33.960Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
gamma # [2620654.203685] gamma systemd-logind[231]: New seat seat0.
gamma # [2620654.203931] gamma systemd[1]: Started User Login Management.
gamma # [2620654.206213] gamma systemd[1]: Starting linger-users.service...
alpha # [2620653.975187] alpha data-mesher[212]: time=2026-10-04T15:24:33.960Z level=DEBUG msg="http config" listen_addresses="[[::1]:7331 127.0.0.1:7331]" port=7331 interfaces=[lo]
alpha # [2620653.978825] alpha data-mesher[212]: time=2026-10-04T15:24:33.964Z level=DEBUG msg="cluster config" port=7946 interfaces=[] bootstrap_peers="[{12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe: [/dns/alpha.clan/tcp/7946]} {12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy: [/dns/beta.clan/tcp/7946]}]" push_pull_interval=5s peer_id=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
alpha # [2620653.978825] alpha data-mesher[212]: time=2026-10-04T15:24:33.964Z level=INFO msg="config loaded" config_file=/etc/data-mesher/dm.toml
alpha # [2620653.979868] alpha data-mesher[212]: time=2026-10-04T15:24:33.965Z level=INFO msg="checking file integrity"
alpha # [2620653.979984] alpha data-mesher[212]: time=2026-10-04T15:24:33.965Z level=INFO msg="file integrity check complete"
alpha # [2620653.984479] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="libp2p host created" peer_id=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe addresses="[/ip4/127.0.0.1/tcp/7946 /ip4/192.168.1.1/tcp/7946 /ip6/::1/tcp/7946 /ip6/2001:db8:1::1/tcp/7946]"
alpha # [2620653.984557] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="registered HTTP route" method=PUT path=/files/:name
alpha # [2620653.984557] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="registered HTTP route" method=DELETE path=/files/:name
alpha # [2620653.984557] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="registered HTTP route" method=GET path=/files
alpha # [2620653.984557] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="starting server"
alpha # [2620653.984743] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="waiting for DHT to populate" delay=10s
alpha # [2620653.984793] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="HTTP server listening" address=[::1]:7331
alpha # [2620653.984848] alpha data-mesher[212]: time=2026-10-04T15:24:33.970Z level=INFO msg="HTTP server listening" address=127.0.0.1:7331
alpha # [2620653.996995] alpha data-mesher[212]: time=2026-10-04T15:24:33.982Z level=INFO msg="peer connected" peer_id=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy remote_addr=/ip6zone/eth1/ip6/fe80::9cb3:6eff:fe72:fa41/tcp/7946
alpha # [2620654.206662] alpha systemd-logind[231]: New seat seat0.
alpha # [2620654.207413] alpha systemd[1]: Started User Login Management.
alpha # [2620654.209622] alpha systemd[1]: Starting linger-users.service...
alpha # [2620654.260579] alpha systemd[1]: linger-users.service: Deactivated successfully.
alpha # [2620654.260798] alpha systemd[1]: Finished linger-users.service.
beta # [2620654.219558] beta systemd-logind[230]: New seat seat0.
beta # [2620654.219756] beta systemd[1]: Started User Login Management.
beta # [2620654.249250] beta systemd[1]: Starting linger-users.service...
beta # [2620654.266575] beta systemd[1]: linger-users.service: Deactivated successfully.
beta # [2620654.266699] beta systemd[1]: Finished linger-users.service.
gamma # [2620654.258320] gamma systemd[1]: linger-users.service: Deactivated successfully.
gamma # [2620654.258604] gamma systemd[1]: Finished linger-users.service.
gamma # [2620654.369312] gamma systemd-networkd[207]: eth1: Gained IPv6LL
alpha # [2620654.848250] alpha systemd-networkd[207]: eth1: Gained IPv6LL
alpha # [2620655.015413] alpha data-mesher[212]: time=2026-10-04T15:24:35.001Z level=INFO msg="peer connected" peer_id=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy remote_addr=/ip6/2001:db8:1::2/tcp/7946
beta # [2620655.017205] beta data-mesher[211]: time=2026-10-04T15:24:35.002Z level=INFO msg="peer connected" peer_id=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe remote_addr=/ip6/2001:db8:1::1/tcp/7946
alpha # [2620658.986564] alpha data-mesher[212]: time=2026-10-04T15:24:38.972Z level=INFO msg="peer connected" peer_id=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu remote_addr=/ip6/2001:db8:1::3/tcp/7946
beta # [2620658.998721] beta data-mesher[211]: time=2026-10-04T15:24:38.984Z level=INFO msg="peer connected" peer_id=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu remote_addr=/ip4/192.168.1.3/tcp/7946
gamma # [2620658.984687] gamma data-mesher[212]: time=2026-10-04T15:24:38.970Z level=INFO msg="peer connected" peer_id=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe remote_addr=/ip6/2001:db8:1::1/tcp/7946
gamma # [2620658.996872] gamma data-mesher[212]: time=2026-10-04T15:24:38.982Z level=INFO msg="peer connected" peer_id=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy remote_addr=/ip4/192.168.1.2/tcp/7946
alpha: still waiting for container 'alpha' to reach ready state...
alpha: (finished: waiting for unit data-mesher.service, in 13.17 seconds)
beta: waiting for unit data-mesher.service
beta: (finished: waiting for unit data-mesher.service, in 0.01 seconds)
gamma: waiting for unit data-mesher.service
gamma: (finished: waiting for unit data-mesher.service, in 0.01 seconds)
alpha: must succeed: echo -n 'hello world' > /tmp/test_file
alpha: (finished: must succeed: echo -n 'hello world' > /tmp/test_file, in 0.00 seconds)
alpha: waiting for success: data-mesher file update /tmp/test_file --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub --url http://[::1]:7331 --key /nix/store/xysmjnpbvgzv55l8s8ixr5y3ih9fz7qc-admin.key
alpha # [2620663.985243] alpha data-mesher[212]: time=2026-10-04T15:24:43.971Z level=INFO msg="performing state exchange with peers on join" count=1
alpha # [2620663.985243] alpha data-mesher[212]: time=2026-10-04T15:24:43.971Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620663.985728] alpha data-mesher[212]: time=2026-10-04T15:24:43.971Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620663.985728] alpha data-mesher[212]: time=2026-10-04T15:24:43.971Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620663.985788] alpha data-mesher[212]: time=2026-10-04T15:24:43.971Z level=INFO msg="server started"
alpha # [2620663.985824] alpha data-mesher[212]: time=2026-10-04T15:24:43.971Z level=INFO msg="starting expired-file sweeper" interval=1m0s
alpha # [2620663.985953] alpha systemd[1]: Started data mesher daemon.
alpha # [2620663.986188] alpha systemd[1]: Reached target Multi-User System.
alpha # [2620663.986980] alpha systemd[1]: Startup finished in 12.418s.
alpha # [2620664.237562] alpha data-mesher[212]: time=2026-10-04T15:24:44.223Z level=INFO msg=http_request uri=/files/test_file status=204
alpha: (finished: waiting for success: data-mesher file update /tmp/test_file --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub --url http://[::1]:7331 --key /nix/store/xysmjnpbvgzv55l8s8ixr5y3ih9fz7qc-admin.key, in 0.02 seconds)
??? Warning (UserWarning): wait_until_succeeds(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/drwj5qfqx9axxgf0jvxlavglj43fr2kh-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
alpha: waiting for success: test -f /var/lib/data-mesher/files/home/test_file && grep -q 'hello world' /var/lib/data-mesher/files/home/test_file
??? Warning (UserWarning): execute(): passing a bare int/float as a duration is deprecated. Use datetime.timedelta instead.
    File "/nix/store/drwj5qfqx9axxgf0jvxlavglj43fr2kh-nixos-test-driver-1.1/lib/python3.14/site-packages/test_driver/duration.py", line 39
alpha: (finished: waiting for success: test -f /var/lib/data-mesher/files/home/test_file && grep -q 'hello world' /var/lib/data-mesher/files/home/test_file, in 0.01 seconds)
beta: waiting for success: test -f /var/lib/data-mesher/files/home/test_file && grep -q 'hello world' /var/lib/data-mesher/files/home/test_file
beta # [2620663.974738] beta data-mesher[211]: time=2026-10-04T15:24:43.960Z level=INFO msg="received state sync from peer" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620663.974738] beta data-mesher[211]: time=2026-10-04T15:24:43.960Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620663.985612] beta data-mesher[211]: time=2026-10-04T15:24:43.971Z level=INFO msg="received state sync from peer" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620663.985612] beta data-mesher[211]: time=2026-10-04T15:24:43.971Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620663.991145] beta data-mesher[211]: time=2026-10-04T15:24:43.976Z level=INFO msg="performing state exchange with peers on join" count=1
beta # [2620663.991202] beta data-mesher[211]: time=2026-10-04T15:24:43.976Z level=DEBUG msg="initiating state exchange" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
beta # [2620663.991573] beta data-mesher[211]: time=2026-10-04T15:24:43.977Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620663.991573] beta data-mesher[211]: time=2026-10-04T15:24:43.977Z level=INFO msg="state exchange complete" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
beta # [2620663.991618] beta data-mesher[211]: time=2026-10-04T15:24:43.977Z level=INFO msg="server started"
beta # [2620663.991703] beta data-mesher[211]: time=2026-10-04T15:24:43.977Z level=INFO msg="starting expired-file sweeper" interval=1m0s
beta # [2620663.991780] beta systemd[1]: Started data mesher daemon.
beta # [2620663.992024] beta systemd[1]: Reached target Multi-User System.
beta # [2620663.992206] beta systemd[1]: Startup finished in 12.391s.
gamma # [2620663.974307] gamma data-mesher[212]: time=2026-10-04T15:24:43.960Z level=INFO msg="performing state exchange with peers on join" count=1
gamma # [2620663.974307] gamma data-mesher[212]: time=2026-10-04T15:24:43.960Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620663.974853] gamma data-mesher[212]: time=2026-10-04T15:24:43.960Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620663.974853] gamma data-mesher[212]: time=2026-10-04T15:24:43.960Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620663.974904] gamma data-mesher[212]: time=2026-10-04T15:24:43.960Z level=INFO msg="server started"
gamma # [2620663.975067] gamma systemd[1]: Started data mesher daemon.
gamma # [2620663.975255] gamma data-mesher[212]: time=2026-10-04T15:24:43.960Z level=INFO msg="starting expired-file sweeper" interval=1m0s
gamma # [2620663.975313] gamma systemd[1]: Reached target Multi-User System.
gamma # [2620663.975484] gamma systemd[1]: Startup finished in 12.388s.
gamma # [2620663.991444] gamma data-mesher[212]: time=2026-10-04T15:24:43.977Z level=INFO msg="received state sync from peer" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620663.991444] gamma data-mesher[212]: time=2026-10-04T15:24:43.977Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
beta: (finished: waiting for success: test -f /var/lib/data-mesher/files/home/test_file && grep -q 'hello world' /var/lib/data-mesher/files/home/test_file, in 5.04 seconds)
gamma: waiting for success: test -f /var/lib/data-mesher/files/home/test_file && grep -q 'hello world' /var/lib/data-mesher/files/home/test_file
alpha # [2620668.986394] alpha data-mesher[212]: time=2026-10-04T15:24:48.972Z level=DEBUG msg="attempting push/pull" peer_count=2
alpha # [2620668.987050] alpha data-mesher[212]: time=2026-10-04T15:24:48.972Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620668.987292] alpha data-mesher[212]: time=2026-10-04T15:24:48.973Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620668.987292] alpha data-mesher[212]: time=2026-10-04T15:24:48.973Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620668.987416] alpha data-mesher[212]: time=2026-10-04T15:24:48.973Z level=DEBUG msg="push/pull successful" interval=5s
alpha # [2620668.987813] alpha data-mesher[212]: time=2026-10-04T15:24:48.973Z level=INFO msg="received file request" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_file
alpha # [2620668.991319] alpha data-mesher[212]: time=2026-10-04T15:24:48.977Z level=INFO msg="file transfer complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_file
alpha # [2620668.992737] alpha data-mesher[212]: time=2026-10-04T15:24:48.978Z level=INFO msg="received state sync from peer" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620668.993267] alpha data-mesher[212]: time=2026-10-04T15:24:48.978Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
beta # [2620668.979375] beta data-mesher[211]: time=2026-10-04T15:24:48.965Z level=INFO msg="received state sync from peer" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620668.979375] beta data-mesher[211]: time=2026-10-04T15:24:48.965Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620668.987016] beta data-mesher[211]: time=2026-10-04T15:24:48.972Z level=INFO msg="received state sync from peer" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620668.987016] beta data-mesher[211]: time=2026-10-04T15:24:48.972Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620668.987140] beta data-mesher[211]: time=2026-10-04T15:24:48.972Z level=DEBUG msg="new file detected" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe name=test_file name=test_file
beta # [2620668.987140] beta data-mesher[211]: time=2026-10-04T15:24:48.972Z level=INFO msg="scheduling file download" name=test_file
beta # [2620668.987247] beta data-mesher[211]: time=2026-10-04T15:24:48.973Z level=INFO msg="downloading file" name=test_file signed_at="2026-10-04 15:24:44.221 +0000 UTC" signed_by="azwT+VhTxA+BF73Hwq0uqdXHG8XvHU2BknoVXgmEjww=" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620668.992173] beta data-mesher[211]: time=2026-10-04T15:24:48.977Z level=DEBUG msg="attempting push/pull" peer_count=2
beta # [2620668.992173] beta data-mesher[211]: time=2026-10-04T15:24:48.978Z level=DEBUG msg="initiating state exchange" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe timeout=5s
beta # [2620668.992995] beta data-mesher[211]: time=2026-10-04T15:24:48.978Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620668.993265] beta data-mesher[211]: time=2026-10-04T15:24:48.978Z level=DEBUG msg="new file detected" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe name=test_file name=test_file
beta # [2620668.993265] beta data-mesher[211]: time=2026-10-04T15:24:48.978Z level=INFO msg="state exchange complete" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe timeout=5s
beta # [2620668.993265] beta data-mesher[211]: time=2026-10-04T15:24:48.978Z level=DEBUG msg="push/pull successful" interval=5s
beta # [2620669.001147] beta data-mesher[211]: time=2026-10-04T15:24:48.986Z level=INFO msg="download complete" name=test_file signed_at="2026-10-04 15:24:44.221 +0000 UTC" signed_by="azwT+VhTxA+BF73Hwq0uqdXHG8XvHU2BknoVXgmEjww=" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe written=true elapsed=13.954553ms
gamma # [2620668.978764] gamma data-mesher[212]: time=2026-10-04T15:24:48.964Z level=DEBUG msg="attempting push/pull" peer_count=2
gamma # [2620668.979457] gamma data-mesher[212]: time=2026-10-04T15:24:48.964Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620668.979564] gamma data-mesher[212]: time=2026-10-04T15:24:48.965Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620668.979564] gamma data-mesher[212]: time=2026-10-04T15:24:48.965Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620668.979687] gamma data-mesher[212]: time=2026-10-04T15:24:48.965Z level=DEBUG msg="push/pull successful" interval=5s
alpha # [2620673.988408] alpha data-mesher[212]: time=2026-10-04T15:24:53.974Z level=DEBUG msg="attempting push/pull" peer_count=2
alpha # [2620673.989050] alpha data-mesher[212]: time=2026-10-04T15:24:53.974Z level=DEBUG msg="initiating state exchange" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
alpha # [2620673.989325] alpha data-mesher[212]: time=2026-10-04T15:24:53.975Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
alpha # [2620673.989325] alpha data-mesher[212]: time=2026-10-04T15:24:53.975Z level=INFO msg="state exchange complete" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
alpha # [2620673.989325] alpha data-mesher[212]: time=2026-10-04T15:24:53.975Z level=DEBUG msg="push/pull successful" interval=5s
gamma: (finished: waiting for success: test -f /var/lib/data-mesher/files/home/test_file && grep -q 'hello world' /var/lib/data-mesher/files/home/test_file, in 5.05 seconds)
beta: waiting for success: data-mesher file delete test_file --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub --url http://[::1]:7331 --key /nix/store/xysmjnpbvgzv55l8s8ixr5y3ih9fz7qc-admin.key
beta # [2620673.981105] beta data-mesher[211]: time=2026-10-04T15:24:53.966Z level=INFO msg="received state sync from peer" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620673.981105] beta data-mesher[211]: time=2026-10-04T15:24:53.966Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620673.982344] beta data-mesher[211]: time=2026-10-04T15:24:53.968Z level=INFO msg="received file request" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_file
beta # [2620673.985604] beta data-mesher[211]: time=2026-10-04T15:24:53.971Z level=INFO msg="file transfer complete" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_file
beta # [2620673.993854] beta data-mesher[211]: time=2026-10-04T15:24:53.979Z level=DEBUG msg="attempting push/pull" peer_count=2
beta # [2620673.993925] beta data-mesher[211]: time=2026-10-04T15:24:53.979Z level=DEBUG msg="initiating state exchange" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
beta # [2620673.994785] beta data-mesher[211]: time=2026-10-04T15:24:53.980Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620673.994785] beta data-mesher[211]: time=2026-10-04T15:24:53.980Z level=INFO msg="state exchange complete" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
beta # [2620673.994965] beta data-mesher[211]: time=2026-10-04T15:24:53.980Z level=DEBUG msg="push/pull successful" interval=5s
beta # [2620674.373670] beta data-mesher[211]: time=2026-10-04T15:24:54.359Z level=INFO msg=http_request uri=/files/test_file status=204
beta: (finished: waiting for success: data-mesher file delete test_file --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub --url http://[::1]:7331 --key /nix/store/xysmjnpbvgzv55l8s8ixr5y3ih9fz7qc-admin.key, in 0.04 seconds)
alpha: waiting for success: test ! -f /var/lib/data-mesher/files/home/test_file
gamma # [2620673.980400] gamma data-mesher[212]: time=2026-10-04T15:24:53.966Z level=DEBUG msg="attempting push/pull" peer_count=2
gamma # [2620673.981248] gamma data-mesher[212]: time=2026-10-04T15:24:53.966Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620673.981557] gamma data-mesher[212]: time=2026-10-04T15:24:53.967Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620673.981636] gamma data-mesher[212]: time=2026-10-04T15:24:53.967Z level=DEBUG msg="new file detected" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy name=test_file name=test_file
gamma # [2620673.981636] gamma data-mesher[212]: time=2026-10-04T15:24:53.967Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620673.981747] gamma data-mesher[212]: time=2026-10-04T15:24:53.967Z level=DEBUG msg="push/pull successful" interval=5s
gamma # [2620673.981747] gamma data-mesher[212]: time=2026-10-04T15:24:53.967Z level=INFO msg="scheduling file download" name=test_file
gamma # [2620673.981842] gamma data-mesher[212]: time=2026-10-04T15:24:53.967Z level=INFO msg="downloading file" name=test_file signed_at="2026-10-04 15:24:44.221 +0000 UTC" signed_by="azwT+VhTxA+BF73Hwq0uqdXHG8XvHU2BknoVXgmEjww=" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620673.989021] gamma data-mesher[212]: time=2026-10-04T15:24:53.974Z level=INFO msg="received state sync from peer" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
gamma # [2620673.989021] gamma data-mesher[212]: time=2026-10-04T15:24:53.974Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
gamma # [2620673.989155] gamma data-mesher[212]: time=2026-10-04T15:24:53.974Z level=DEBUG msg="new file detected" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe name=test_file name=test_file
gamma # [2620673.994534] gamma data-mesher[212]: time=2026-10-04T15:24:53.980Z level=INFO msg="received state sync from peer" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620673.994613] gamma data-mesher[212]: time=2026-10-04T15:24:53.980Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620673.994613] gamma data-mesher[212]: time=2026-10-04T15:24:53.980Z level=DEBUG msg="new file detected" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy name=test_file name=test_file
gamma # [2620674.010710] gamma data-mesher[212]: time=2026-10-04T15:24:53.996Z level=INFO msg="download complete" name=test_file signed_at="2026-10-04 15:24:44.221 +0000 UTC" signed_by="azwT+VhTxA+BF73Hwq0uqdXHG8XvHU2BknoVXgmEjww=" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy written=true elapsed=28.910799ms
alpha # [2620678.990386] alpha data-mesher[212]: time=2026-10-04T15:24:58.976Z level=DEBUG msg="attempting push/pull" peer_count=2
alpha # [2620678.991083] alpha data-mesher[212]: time=2026-10-04T15:24:58.976Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620678.991390] alpha data-mesher[212]: time=2026-10-04T15:24:58.977Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620679.029024] alpha data-mesher[212]: time=2026-10-04T15:24:59.014Z level=DEBUG msg="imported tombstone" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy name=test_file written=true
alpha # [2620679.029024] alpha data-mesher[212]: time=2026-10-04T15:24:59.014Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620679.029156] alpha data-mesher[212]: time=2026-10-04T15:24:59.014Z level=DEBUG msg="push/pull successful" interval=5s
alpha: (finished: waiting for success: test ! -f /var/lib/data-mesher/files/home/test_file, in 5.05 seconds)
beta: waiting for success: test ! -f /var/lib/data-mesher/files/home/test_file
beta: (finished: waiting for success: test ! -f /var/lib/data-mesher/files/home/test_file, in 0.01 seconds)
gamma: waiting for success: test ! -f /var/lib/data-mesher/files/home/test_file
gamma: (finished: waiting for success: test ! -f /var/lib/data-mesher/files/home/test_file, in 0.01 seconds)
alpha: must succeed: cat /nix/store/q6fpanjgvvvfycv4s7c3bjs50wmkb4zq-per-machine-alpha-data-mesher-node-identity_identity.pub
beta # [2620678.984062] beta data-mesher[211]: time=2026-10-04T15:24:58.968Z level=INFO msg="received state sync from peer" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620678.984062] beta data-mesher[211]: time=2026-10-04T15:24:58.969Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620678.991038] beta data-mesher[211]: time=2026-10-04T15:24:58.976Z level=INFO msg="received state sync from peer" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620678.991038] beta data-mesher[211]: time=2026-10-04T15:24:58.976Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620678.995112] beta data-mesher[211]: time=2026-10-04T15:24:58.980Z level=DEBUG msg="attempting push/pull" peer_count=2
beta # [2620678.995214] beta data-mesher[211]: time=2026-10-04T15:24:58.980Z level=DEBUG msg="initiating state exchange" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
beta # [2620679.029083] beta data-mesher[211]: time=2026-10-04T15:24:59.014Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
beta # [2620679.029220] beta data-mesher[211]: time=2026-10-04T15:24:59.014Z level=INFO msg="state exchange complete" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu timeout=5s
beta # [2620679.029220] beta data-mesher[211]: time=2026-10-04T15:24:59.015Z level=DEBUG msg="push/pull successful" interval=5s
alpha: (finished: must succeed: cat /nix/store/q6fpanjgvvvfycv4s7c3bjs50wmkb4zq-per-machine-alpha-data-mesher-node-identity_identity.pub, in 0.01 seconds)
alpha: must succeed: echo -n 'namespace_data' > /tmp/ns_file
alpha: (finished: must succeed: echo -n 'namespace_data' > /tmp/ns_file, in 0.01 seconds)
alpha: waiting for success: data-mesher file update /tmp/ns_file --name 'test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E' --url http://[::1]:7331 --key /run/secrets/per-machine/alpha/data-mesher-node-identity/identity.key --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub --cert /run/secrets/per-machine/alpha/data-mesher-node-identity/identity.cert
gamma # [2620678.982399] gamma data-mesher[212]: time=2026-10-04T15:24:58.968Z level=DEBUG msg="attempting push/pull" peer_count=2
gamma # [2620678.982399] gamma data-mesher[212]: time=2026-10-04T15:24:58.968Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620678.983541] gamma data-mesher[212]: time=2026-10-04T15:24:58.969Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620678.995703] gamma data-mesher[212]: time=2026-10-04T15:24:58.981Z level=INFO msg="received state sync from peer" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620678.995703] gamma data-mesher[212]: time=2026-10-04T15:24:58.981Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
gamma # [2620679.028901] gamma data-mesher[212]: time=2026-10-04T15:24:59.014Z level=DEBUG msg="imported tombstone" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy name=test_file written=true
gamma # [2620679.028901] gamma data-mesher[212]: time=2026-10-04T15:24:59.014Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
gamma # [2620679.028901] gamma data-mesher[212]: time=2026-10-04T15:24:59.014Z level=DEBUG msg="imported tombstone" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy name=test_file written=false
gamma # [2620679.028901] gamma data-mesher[212]: time=2026-10-04T15:24:59.014Z level=DEBUG msg="push/pull successful" interval=5s
alpha: (finished: waiting for success: data-mesher file update /tmp/ns_file --name 'test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E' --url http://[::1]:7331 --key /run/secrets/per-machine/alpha/data-mesher-node-identity/identity.key --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub --cert /run/secrets/per-machine/alpha/data-mesher-node-identity/identity.cert, in 0.03 seconds)
alpha: waiting for success: test -f /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E && grep -q 'namespace_data' /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
alpha: (finished: waiting for success: test -f /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E && grep -q 'namespace_data' /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E, in 0.01 seconds)
beta: waiting for success: test -f /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E && grep -q 'namespace_data' /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
alpha # [2620679.485286] alpha data-mesher[212]: time=2026-10-04T15:24:59.471Z level=INFO msg=http_request uri=/files/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E status=204
alpha # [2620684.029772] alpha data-mesher[212]: time=2026-10-04T15:25:04.015Z level=DEBUG msg="attempting push/pull" peer_count=2
alpha # [2620684.029772] alpha data-mesher[212]: time=2026-10-04T15:25:04.015Z level=DEBUG msg="initiating state exchange" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620684.030605] alpha data-mesher[212]: time=2026-10-04T15:25:04.015Z level=INFO msg="received state sync from peer" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
alpha # [2620684.030605] alpha data-mesher[212]: time=2026-10-04T15:25:04.015Z level=INFO msg="merging remote state" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu
alpha # [2620684.030716] alpha data-mesher[212]: time=2026-10-04T15:25:04.016Z level=INFO msg="received state sync from peer" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620684.030716] alpha data-mesher[212]: time=2026-10-04T15:25:04.016Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620684.031913] alpha data-mesher[212]: time=2026-10-04T15:25:04.017Z level=INFO msg="received file request" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
alpha # [2620684.032896] alpha data-mesher[212]: time=2026-10-04T15:25:04.018Z level=INFO msg="merging remote state" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy
alpha # [2620684.034740] alpha data-mesher[212]: time=2026-10-04T15:25:04.019Z level=INFO msg="state exchange complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy timeout=5s
alpha # [2620684.034913] alpha data-mesher[212]: time=2026-10-04T15:25:04.020Z level=INFO msg="received file request" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
alpha # [2620684.035044] alpha data-mesher[212]: time=2026-10-04T15:25:04.020Z level=INFO msg="file transfer complete" peer=12D3KooWNqn6nTzBv1hT6Mw2ziSWNiEnDc4KpgEeNGxZjgvLhehu network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
alpha # [2620684.035044] alpha data-mesher[212]: time=2026-10-04T15:25:04.020Z level=DEBUG msg="push/pull successful" interval=5s
alpha # [2620684.036313] alpha data-mesher[212]: time=2026-10-04T15:25:04.022Z level=INFO msg="file transfer complete" peer=12D3KooWQ4CcXhy1JWT5tuk7cMcwhkihqFeSbM8LnU53sfMpkHSy network="RIjyaKmGMAjvmZGomkyWdmgDRwi96PNNo6Rqgkrra+4=" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
beta # [2620684.030055] beta data-mesher[211]: time=2026-10-04T15:25:04.015Z level=DEBUG msg="attempting push/pull" peer_count=2
beta # [2620684.030826] beta data-mesher[211]: time=2026-10-04T15:25:04.015Z level=DEBUG msg="initiating state exchange" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe timeout=5s
beta # [2620684.031659] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620684.031659] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=INFO msg="received state sync from peer" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620684.031659] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620684.031886] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=DEBUG msg="new file detected" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe name=test_file name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
beta # [2620684.031886] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=INFO msg="state exchange complete" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe timeout=5s
beta # [2620684.032118] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=DEBUG msg="push/pull successful" interval=5s
beta # [2620684.032118] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=INFO msg="scheduling file download" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
beta # [2620684.032118] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=DEBUG msg="new file detected" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe name=test_file name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
beta # [2620684.032118] beta data-mesher[211]: time=2026-10-04T15:25:04.017Z level=INFO msg="downloading file" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E signed_at="2026-10-04 15:24:59.469 +0000 UTC" signed_by="ezWaNQd+g/WxM0omyTDX7R+ieGqp7/tKxZHgoo1ZU+E=" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
beta # [2620684.037848] beta data-mesher[211]: time=2026-10-04T15:25:04.023Z level=INFO msg="download complete" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E signed_at="2026-10-04 15:24:59.469 +0000 UTC" signed_by="ezWaNQd+g/WxM0omyTDX7R+ieGqp7/tKxZHgoo1ZU+E=" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe written=true elapsed=5.828841ms
gamma # [2620684.029299] gamma data-mesher[212]: time=2026-10-04T15:25:04.015Z level=DEBUG msg="attempting push/pull" peer_count=2
gamma # [2620684.030108] gamma data-mesher[212]: time=2026-10-04T15:25:04.015Z level=DEBUG msg="initiating state exchange" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe timeout=5s
gamma # [2620684.030633] gamma data-mesher[212]: time=2026-10-04T15:25:04.016Z level=INFO msg="merging remote state" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
gamma # [2620684.031064] gamma data-mesher[212]: time=2026-10-04T15:25:04.016Z level=DEBUG msg="new file detected" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe name=test_file name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
gamma # [2620684.031064] gamma data-mesher[212]: time=2026-10-04T15:25:04.016Z level=INFO msg="state exchange complete" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe timeout=5s
gamma # [2620684.031181] gamma data-mesher[212]: time=2026-10-04T15:25:04.016Z level=DEBUG msg="push/pull successful" interval=5s
gamma # [2620684.031181] gamma data-mesher[212]: time=2026-10-04T15:25:04.016Z level=INFO msg="scheduling file download" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
gamma # [2620684.031239] gamma data-mesher[212]: time=2026-10-04T15:25:04.017Z level=INFO msg="downloading file" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E signed_at="2026-10-04 15:24:59.469 +0000 UTC" signed_by="ezWaNQd+g/WxM0omyTDX7R+ieGqp7/tKxZHgoo1ZU+E=" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe
gamma # [2620684.036607] gamma data-mesher[212]: time=2026-10-04T15:25:04.022Z level=INFO msg="download complete" name=test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E signed_at="2026-10-04 15:24:59.469 +0000 UTC" signed_by="ezWaNQd+g/WxM0omyTDX7R+ieGqp7/tKxZHgoo1ZU+E=" peer=12D3KooWJ7KipY8CsBGjAhAxoCJU29DgRdf6r3FL5j2Z5wMzyhXe written=true elapsed=5.384714ms
beta: (finished: waiting for success: test -f /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E && grep -q 'namespace_data' /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E, in 5.05 seconds)
gamma: waiting for success: test -f /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E && grep -q 'namespace_data' /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
gamma: (finished: waiting for success: test -f /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E && grep -q 'namespace_data' /var/lib/data-mesher/files/home/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E, in 0.01 seconds)
alpha: must succeed: echo -n 'no_cert' > /tmp/ns_nocert
alpha: (finished: must succeed: echo -n 'no_cert' > /tmp/ns_nocert, in 0.01 seconds)
alpha: must fail: data-mesher file update /tmp/ns_nocert --name 'test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E' --url http://[::1]:7331 --key /run/secrets/per-machine/alpha/data-mesher-node-identity/identity.key --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub
Error: failed to update file: 403 Forbidden, signer ezWaNQd+g/WxM0omyTDX7R+ieGqp7/tKxZHgoo1ZU+E= is not authorized for this file test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E
alpha: (finished: must fail: data-mesher file update /tmp/ns_nocert --name 'test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E' --url http://[::1]:7331 --key /run/secrets/per-machine/alpha/data-mesher-node-identity/identity.key --network-id /nix/store/drlmynf1lp1339y8k68fd911hz8nl6gc-shared-data-mesher-network_network.pub, in 0.03 seconds)
(finished: run the VM test script, in 33.59 seconds)
test script finished in 33.80s
cleanup
kill NspawnMachine (pid 52)
alpha # [2620684.595343] alpha data-mesher[212]: time=2026-10-04T15:25:04.581Z level=INFO msg=http_request uri=/files/test_ns/ezWaNQd-g_WxM0omyTDX7R-ieGqp7_tKxZHgoo1ZU-E status=403
alpha # [2620684.814106] alpha systemd-networkd[207]: eth1: Link DOWN
alpha # [2620684.814122] alpha systemd-networkd[207]: eth1: Lost carrier
alpha # [2620684.868876] alpha systemd-networkd[207]: eth1: Lost IPv6LL address fe80::50b4:96ff:fe32:6b1a.
kill NspawnMachine (pid 54)
kill NspawnMachine (pid 57)
Container alpha terminated by signal KILL.
Container beta terminated by signal KILL.
(finished: cleanup, in 0.44 seconds)
Container gamma terminated by signal KILL.