don't know how to build these paths: /nix/store/4kmqbig1m2dya9yzn4vj7mv7805vrras-container-test-run-monitoring.drv warning: ignoring the client-specified setting 'store', because it is a restricted setting and you are not a trusted user building '/nix/store/0lp8amh913bj53iv0wn8m8xn2x8mly29-state-commands.drv' on nix-store.geninf.io:50051 state-commands> build01: building 0lp8amh913bj53iv0wn8m8xn2x8mly29-state-commands.drv building '/nix/store/va6210m7w4kpw5jq3cxsj3i6ydhv25mb-system-path.drv' on nix-store.geninf.io:50051 system-path> build01: building va6210m7w4kpw5jq3cxsj3i6ydhv25mb-system-path.drv system-path> structuredAttrs is enabled system-path> created 1868 symlinks in user environment building '/nix/store/c8fxxp5gydbw5xa9v824s0q1afgp9wkh-dbus-1.drv' on nix-store.geninf.io:50051 dbus-1> build01: building c8fxxp5gydbw5xa9v824s0q1afgp9wkh-dbus-1.drv building '/nix/store/5gq7q8ai598pbb43qgbdvxn0aibfxs0h-X-Restart-Triggers-dbus-broker.drv' on nix-store.geninf.io:50051 X-Restart-Triggers-dbus-broker> build01: building 5gq7q8ai598pbb43qgbdvxn0aibfxs0h-X-Restart-Triggers-dbus-broker.drv building '/nix/store/wc16xj2hlyhn90hnir7cspcjyxg0ip4y-unit-dbus-broker.service.drv' on nix-store.geninf.io:50051 unit-dbus-broker.service> build01: building wc16xj2hlyhn90hnir7cspcjyxg0ip4y-unit-dbus-broker.service.drv building '/nix/store/gnmayc5bgblq85kp3iyy0pb8id5g7jpg-unit-dbus-broker.service.drv' on nix-store.geninf.io:50051 unit-dbus-broker.service> build01: building gnmayc5bgblq85kp3iyy0pb8id5g7jpg-unit-dbus-broker.service.drv unit-dbus-broker.service> structuredAttrs is enabled unit-dbus-broker.service> structuredAttrs is enabled building '/nix/store/jm96waw0nkbal41ldf2sznqphskpixaj-system-units.drv' on nix-store.geninf.io:50051 system-units> build01: building jm96waw0nkbal41ldf2sznqphskpixaj-system-units.drv building '/nix/store/crs48ajnfni1dd0xpn1z64vqpbvnqrhh-user-units.drv' on nix-store.geninf.io:50051 user-units> build01: building crs48ajnfni1dd0xpn1z64vqpbvnqrhh-user-units.drv building '/nix/store/lbm4l6m2zw7ra4p7chzfndmgrgma5fvg-etc.drv' on nix-store.geninf.io:50051 etc> build01: building lbm4l6m2zw7ra4p7chzfndmgrgma5fvg-etc.drv building '/nix/store/ksa5shbymynv7qzvcaxzhvz2c62va1sp-activate.drv' on nix-store.geninf.io:50051 activate> build01: building ksa5shbymynv7qzvcaxzhvz2c62va1sp-activate.drv building '/nix/store/apkzzw146nwksiicdp9rpi82bq3hkb5v-nixos-system-machine1-test.drv' on nix-store.geninf.io:50051 nixos-system-machine1-test> build01: building apkzzw146nwksiicdp9rpi82bq3hkb5v-nixos-system-machine1-test.drv nixos-system-machine1-test> structuredAttrs is enabled building '/nix/store/4ycmg7fl105xflr7kc0nqhds9g21jgwi-run-machine1-nspawn.drv' on nix-store.geninf.io:50051 run-machine1-nspawn> build01: building 4ycmg7fl105xflr7kc0nqhds9g21jgwi-run-machine1-nspawn.drv building '/nix/store/7bpsfa2gmq9mbdl9ms1s0wgxai05f4va-driverConfiguration.json.drv' on nix-store.geninf.io:50051 driverConfiguration.json> build01: building 7bpsfa2gmq9mbdl9ms1s0wgxai05f4va-driverConfiguration.json.drv driverConfiguration.json> structuredAttrs is enabled building '/nix/store/qzpk1hwmjavw5zhm2cwsa3j5f5kf4ysf-nixos-test-driver-monitoring.drv' on nix-store.geninf.io:50051 nixos-test-driver-monitoring> build01: building qzpk1hwmjavw5zhm2cwsa3j5f5kf4ysf-nixos-test-driver-monitoring.drv nixos-test-driver-monitoring> Running type check (enable/disable: config.skipTypeCheck) nixos-test-driver-monitoring> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck nixos-test-driver-monitoring> All checks passed! nixos-test-driver-monitoring> Linting test script (enable/disable: config.skipLint) nixos-test-driver-monitoring> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint nixos-test-driver-monitoring> All checks passed! building '/nix/store/4kmqbig1m2dya9yzn4vj7mv7805vrras-container-test-run-monitoring.drv' on nix-store.geninf.io:50051 container-test-run-monitoring> build01: building 4kmqbig1m2dya9yzn4vj7mv7805vrras-container-test-run-monitoring.drv container-test-run-monitoring> Machine state will be reset. To keep it, pass --keep-machine-state container-test-run-monitoring> start all VLans container-test-run-monitoring> (finished: start all VLans, in 0.00 seconds) container-test-run-monitoring> Initializing machine ID from random generator. container-test-run-monitoring> Test will time out and terminate in 3600.0 seconds container-test-run-monitoring> run the VM test script container-test-run-monitoring> additionally exposed symbols: container-test-run-monitoring> machine1, machine2, container-test-run-monitoring> vlan1, container-test-run-monitoring> start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh container-test-run-monitoring> start all VMs container-test-run-monitoring> machine1: systemd-nspawn running (pid 52) container-test-run-monitoring> machine2: systemd-nspawn running (pid 53) container-test-run-monitoring> machine1: Waiting for journal at /build/vm-state-machine1/var/log/journal... container-test-run-monitoring> machine2: Waiting for journal at /build/vm-state-machine2/var/log/journal... container-test-run-monitoring> (finished: start all VMs, in 0.00 seconds) container-test-run-monitoring> machine1: waiting for unit multi-user.target container-test-run-monitoring> nixos-nspawn(machine1): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-monitoring> nixos-nspawn(machine1): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-monitoring> nixos-nspawn(machine2): TAP vde-tap1 not found; container will be isolated from VDE container-test-run-monitoring> nixos-nspawn(machine2): A common reason for this is that /dev/net is not available in the Nix sandbox. Try adding /dev/net to extra-sandbox-paths. container-test-run-monitoring> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-monitoring> Note: in a future version of systemd-nspawn the default set of permitted socket address families will be restricted to AF_INET, AF_INET6 and AF_UNIX. Use --restrict-address-families= to configure the set of permitted socket address families, or set RestrictAddressFamilies= in a .nspawn file. container-test-run-monitoring> ░ Spawning container machine1 on /build/vm-state-machine1. container-test-run-monitoring> ░ Spawning container machine2 on /build/vm-state-machine2. container-test-run-monitoring> machine1 # No journal files were found. container-test-run-monitoring> machine1 # No journal boot entry found for the specified boot (+0). container-test-run-monitoring> machine2 # No journal files were found. container-test-run-monitoring> machine2 # No journal boot entry found for the specified boot (+0). container-test-run-monitoring> machine1 # [879822.631684] machine1 systemd-journald[123]: Journal started container-test-run-monitoring> machine1 # [879822.631741] machine1 systemd-journald[123]: Runtime Journal (/run/log/journal/e722e9c25f3f4f0d8b51726786d6c663) is 8M, max 2.5G, 2.4G free. container-test-run-monitoring> machine1 # [879822.637133] machine1 systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-monitoring> machine1 # [879822.649345] machine1 systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-monitoring> machine1 # [879822.650256] machine1 systemd[1]: Starting Network Name Resolution... container-test-run-monitoring> machine1 # [879822.651024] machine1 systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-monitoring> machine1 # [879822.658929] machine1 systemd-journald[123]: Time spent on flushing to /var/log/journal/e722e9c25f3f4f0d8b51726786d6c663 is 1.718ms for 6 entries. container-test-run-monitoring> machine1 # [879822.658929] machine1 systemd-journald[123]: System Journal (/var/log/journal/e722e9c25f3f4f0d8b51726786d6c663) is 8M, max 4G, 3.9G free. container-test-run-monitoring> machine1 # [879822.664084] machine1 systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-monitoring> machine1 # [879822.664854] machine1 systemd[1]: Reached target Preparation for Local File Systems. container-test-run-monitoring> machine1 # [879822.664980] machine1 systemd[1]: Reached target Local File Systems. container-test-run-monitoring> machine1 # [879822.665919] machine1 systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-monitoring> machine2 # [879822.516170] machine2 systemd-journald[105]: Journal started container-test-run-monitoring> machine1 # [879822.665972] machine1 systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-monitoring> machine2 # [879822.516219] machine2 systemd-journald[105]: Runtime Journal (/run/log/journal/2108d36679f4459f94ecc25b5249d170) is 8M, max 2.5G, 2.4G free. container-test-run-monitoring> machine1 # [879822.666969] machine1 systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-monitoring> machine2 # [879822.519326] machine2 systemd[1]: Finished Create Static Device Nodes in /dev gracefully. container-test-run-monitoring> machine1 # [879822.667012] machine1 systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-monitoring> machine2 # [879822.527564] machine2 systemd[1]: Starting Flush Journal to Persistent Storage... container-test-run-monitoring> machine1 # [879822.680935] machine1 systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-monitoring> machine2 # [879822.528355] machine2 systemd[1]: Starting Network Name Resolution... container-test-run-monitoring> machine1 # [879822.682510] machine1 systemd[1]: Starting Create System Files and Directories... container-test-run-monitoring> machine1 # [879822.697864] machine1 systemd-tmpfiles[173]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-monitoring> machine2 # [879822.528997] machine2 systemd[1]: Starting Create Static Device Nodes in /dev... container-test-run-monitoring> machine2 # [879822.541883] machine2 systemd-journald[105]: Time spent on flushing to /var/log/journal/2108d36679f4459f94ecc25b5249d170 is 1.667ms for 6 entries. container-test-run-monitoring> machine2 # [879822.541883] machine2 systemd-journald[105]: System Journal (/var/log/journal/2108d36679f4459f94ecc25b5249d170) is 8M, max 4G, 3.9G free. container-test-run-monitoring> machine2 # [879822.542838] machine2 systemd[1]: Finished Create Static Device Nodes in /dev. container-test-run-monitoring> machine1 # [879822.698061] machine1 systemd-tmpfiles[173]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-monitoring> machine2 # [879822.543063] machine2 systemd[1]: Reached target Preparation for Local File Systems. container-test-run-monitoring> machine1 # [879822.698185] machine1 systemd-tmpfiles[173]: fchmod() of /var/log/journal/e722e9c25f3f4f0d8b51726786d6c663 failed: Operation not permitted container-test-run-monitoring> machine2 # [879822.543149] machine2 systemd[1]: Reached target Local File Systems. container-test-run-monitoring> machine1 # [879822.698367] machine1 systemd-tmpfiles[173]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-monitoring> machine2 # [879822.543860] machine2 systemd[1]: Listening on Boot Loader Control Service Socket. container-test-run-monitoring> machine1 # [879822.702308] machine1 systemd[1]: Finished Create System Files and Directories. container-test-run-monitoring> machine2 # [879822.543903] machine2 systemd[1]: Update Boot Loader Random Seed skipped, unmet condition check ConditionVirtualization=!container container-test-run-monitoring> machine1 # [879822.703482] machine1 systemd[1]: Starting Rebuild Journal Catalog... container-test-run-monitoring> machine2 # [879822.544705] machine2 systemd[1]: Starting Save Transient machine-id to Disk... container-test-run-monitoring> machine1 # [879822.704337] machine1 systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-monitoring> machine2 # [879822.544741] machine2 systemd[1]: Rule-based Manager for Device Events and Files skipped, unmet condition check ConditionPathIsReadWrite=/sys container-test-run-monitoring> machine1 # [879822.716509] machine1 systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-monitoring> machine2 # [879822.589482] machine2 systemd[1]: Finished Flush Journal to Persistent Storage. container-test-run-monitoring> machine1 # [879822.723610] machine1 systemd[1]: Finished Rebuild Journal Catalog. container-test-run-monitoring> machine2 # [879822.591342] machine2 systemd[1]: Starting Create System Files and Directories... container-test-run-monitoring> machine1 # [879822.724823] machine1 systemd[1]: Starting Update is Completed... container-test-run-monitoring> machine2 # [879822.610867] machine2 systemd-tmpfiles[163]: Cannot set file attributes for '/var/empty', value=0x00000010, mask=0x00000010, ignoring: Operation not permitted container-test-run-monitoring> machine1 # [879822.735582] machine1 systemd[1]: Finished Update is Completed. container-test-run-monitoring> machine2 # [879822.611061] machine2 systemd-tmpfiles[163]: fchmod() of /var/log/journal failed: Operation not permitted container-test-run-monitoring> machine2 # [879822.611193] machine2 systemd-tmpfiles[163]: fchmod() of /var/log/journal/2108d36679f4459f94ecc25b5249d170 failed: Operation not permitted container-test-run-monitoring> machine2 # [879822.611389] machine2 systemd-tmpfiles[163]: fchmod() of /run/log/journal failed: Operation not permitted container-test-run-monitoring> machine2 # [879822.613405] machine2 systemd[1]: Finished Create System Files and Directories. container-test-run-monitoring> machine2 # [879822.614783] machine2 systemd[1]: Starting Rebuild Journal Catalog... container-test-run-monitoring> machine2 # [879822.615745] machine2 systemd[1]: Starting Record System Boot/Shutdown in UTMP... container-test-run-monitoring> machine2 # [879822.629247] machine2 systemd[1]: Finished Record System Boot/Shutdown in UTMP. container-test-run-monitoring> machine2 # [879822.635817] machine2 systemd[1]: Finished Rebuild Journal Catalog. container-test-run-monitoring> machine2 # [879822.637178] machine2 systemd[1]: Starting Update is Completed... container-test-run-monitoring> machine2 # [879822.648156] machine2 systemd[1]: Finished Update is Completed. container-test-run-monitoring> machine2 # [879822.688220] machine2 systemd[1]: Finished Firewall. container-test-run-monitoring> machine2 # [879822.688408] machine2 systemd[1]: Reached target Preparation for Network. container-test-run-monitoring> machine2 # [879822.688671] machine2 systemd[1]: Listening on Network Management Resolve Hook Socket. container-test-run-monitoring> machine2 # [879822.690025] machine2 systemd[1]: Starting Network Management... container-test-run-monitoring> machine1 # [879822.789556] machine1 systemd[1]: Finished Firewall. container-test-run-monitoring> machine1 # [879822.789738] machine1 systemd[1]: Reached target Preparation for Network. container-test-run-monitoring> machine1 # [879822.789997] machine1 systemd[1]: Listening on Network Management Resolve Hook Socket. container-test-run-monitoring> machine1 # [879822.791115] machine1 systemd[1]: Starting Network Management... container-test-run-monitoring> machine2 # [879823.230859] machine2 systemd-networkd[218]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted container-test-run-monitoring> machine2 # [879823.230965] machine2 systemd-networkd[218]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted container-test-run-monitoring> machine2 # [879823.245693] machine2 systemd-networkd[218]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section. container-test-run-monitoring> machine2 # [879823.245868] machine2 systemd-networkd[218]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section. container-test-run-monitoring> machine2 # [879823.246072] machine2 systemd-networkd[218]: lo: Link UP container-test-run-monitoring> machine2 # [879823.246077] machine2 systemd-networkd[218]: lo: Gained carrier container-test-run-monitoring> machine2 # [879823.246268] machine2 systemd-networkd[218]: eth1: Configuring with /etc/systemd/network/40-eth1.network. container-test-run-monitoring> machine2 # [879823.246700] machine2 systemd[1]: Started Network Management. container-test-run-monitoring> machine2 # [879823.246813] machine2 systemd-networkd[218]: eth1: Link UP container-test-run-monitoring> machine2 # [879823.247098] machine2 systemd-networkd[218]: eth1: Gained carrier container-test-run-monitoring> machine2 # [879823.248185] machine2 systemd[1]: Starting Enable Persistent Storage in systemd-networkd... container-test-run-monitoring> machine2 # [879823.297667] machine2 systemd[1]: Finished Enable Persistent Storage in systemd-networkd. container-test-run-monitoring> machine2 # [879823.446499] machine2 systemd-resolved[126]: Positive Trust Anchors: container-test-run-monitoring> machine2 # [879823.446514] machine2 systemd-resolved[126]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d container-test-run-monitoring> machine2 # [879823.446516] machine2 systemd-resolved[126]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 container-test-run-monitoring> machine2 # [879823.446553] machine2 systemd-resolved[126]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test container-test-run-monitoring> machine2 # [879823.469873] machine2 systemd-resolved[126]: Using system hostname 'machine2'. container-test-run-monitoring> machine2 # [879823.471414] machine2 systemd[1]: Started Network Name Resolution. container-test-run-monitoring> machine2 # [879823.471516] machine2 systemd[1]: Reached target Network. container-test-run-monitoring> machine2 # [879823.471599] machine2 systemd[1]: Reached target System Initialization. container-test-run-monitoring> machine2 # [879823.471655] machine2 systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-monitoring> machine2 # [879823.471685] machine2 systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-monitoring> machine2 # [879823.471702] machine2 systemd[1]: Reached target Timer Units. container-test-run-monitoring> machine2 # [879823.471836] machine2 systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-monitoring> machine2 # [879823.471979] machine2 systemd[1]: Listening on Nix Daemon Socket. container-test-run-monitoring> machine2 # [879823.472123] machine2 systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-monitoring> machine2 # [879823.472147] machine2 systemd[1]: Reached target Socket Units. container-test-run-monitoring> machine2 # [879823.472183] machine2 systemd[1]: Reached target Basic System. container-test-run-monitoring> machine2 # [879823.473522] machine2 systemd[1]: Started alloy.service. container-test-run-monitoring> machine2 # [879823.474419] machine2 systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-monitoring> machine2 # [879823.475545] machine2 systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-monitoring> machine2 # [879823.477085] machine2 systemd[1]: Starting D-Bus System Message Bus... container-test-run-monitoring> machine1 # [879823.330358] machine1 systemd-networkd[238]: Failed to increase receive buffer size for general netlink socket, ignoring: Operation not permitted container-test-run-monitoring> machine1 # [879823.330464] machine1 systemd-networkd[238]: Failed to increase receive buffer size for nftables netlink socket, ignoring: Operation not permitted container-test-run-monitoring> machine1 # [879823.337691] machine1 systemd-networkd[238]: /etc/systemd/network/99-ethernet-default-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section. container-test-run-monitoring> machine1 # [879823.337866] machine1 systemd-networkd[238]: /etc/systemd/network/99-wireless-client-dhcp.network: No valid settings found in the [Match] section, ignoring file. To match all interfaces, add Name=* in the [Match] section. container-test-run-monitoring> machine1 # [879823.338073] machine1 systemd-networkd[238]: lo: Link UP container-test-run-monitoring> machine1 # [879823.338077] machine1 systemd-networkd[238]: lo: Gained carrier container-test-run-monitoring> machine1 # [879823.338293] machine1 systemd-networkd[238]: eth1: Configuring with /etc/systemd/network/40-eth1.network. container-test-run-monitoring> machine1 # [879823.338711] machine1 systemd[1]: Started Network Management. container-test-run-monitoring> machine1 # [879823.338813] machine1 systemd-networkd[238]: eth1: Link UP container-test-run-monitoring> machine1 # [879823.339102] machine1 systemd-networkd[238]: eth1: Gained carrier container-test-run-monitoring> machine1 # [879823.339861] machine1 systemd[1]: Starting Enable Persistent Storage in systemd-networkd... container-test-run-monitoring> machine1 # [879823.366395] machine1 systemd[1]: Finished Enable Persistent Storage in systemd-networkd. container-test-run-monitoring> machine1 # [879823.566298] machine1 systemd-resolved[148]: Positive Trust Anchors: container-test-run-monitoring> machine1 # [879823.566310] machine1 systemd-resolved[148]: . IN DS 20326 8 2 e06d44b80b8f1d39a95c0b0d7c65d08458e880409bbc683457104237c7f8ec8d container-test-run-monitoring> machine1 # [879823.566314] machine1 systemd-resolved[148]: . IN DS 38696 8 2 683d2d0acb8c9b712a1948b27f741219298d0a450d612c483af444a4c0fb2b16 container-test-run-monitoring> machine1 # [879823.566350] machine1 systemd-resolved[148]: Negative trust anchors: home.arpa 10.in-addr.arpa 16.172.in-addr.arpa 17.172.in-addr.arpa 18.172.in-addr.arpa 19.172.in-addr.arpa 20.172.in-addr.arpa 21.172.in-addr.arpa 22.172.in-addr.arpa 23.172.in-addr.arpa 24.172.in-addr.arpa 25.172.in-addr.arpa 26.172.in-addr.arpa 27.172.in-addr.arpa 28.172.in-addr.arpa 29.172.in-addr.arpa 30.172.in-addr.arpa 31.172.in-addr.arpa 170.0.0.192.in-addr.arpa 171.0.0.192.in-addr.arpa 168.192.in-addr.arpa d.f.ip6.arpa ipv4only.arpa resolver.arpa corp home internal intranet lan local private test container-test-run-monitoring> machine2 # [879823.556722] machine2 systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-monitoring> machine2 # [879823.789487] machine2 nsncd[225]: Nov 13 10:12:08.739 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-monitoring> machine2 # [879823.789595] machine2 systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-monitoring> machine2 # [879823.789680] machine2 systemd[1]: Reached target Host and Network Name Lookups. container-test-run-monitoring> machine2 # [879823.789761] machine2 systemd[1]: Reached target User and Group Name Lookups. container-test-run-monitoring> machine2 # [879823.791143] machine2 systemd[1]: Starting User Login Management... container-test-run-monitoring> machine2 # [879823.792378] machine2 systemd[1]: Starting Permit User Sessions... container-test-run-monitoring> machine1 # [879823.589718] machine1 systemd-resolved[148]: Using system hostname 'machine1'. container-test-run-monitoring> machine1 # [879823.591220] machine1 systemd[1]: Started Network Name Resolution. container-test-run-monitoring> machine1 # [879823.591321] machine1 systemd[1]: Reached target Network. container-test-run-monitoring> machine1 # [879823.591384] machine1 systemd[1]: Reached target Network is Online. container-test-run-monitoring> machine1 # [879823.591429] machine1 systemd[1]: Reached target System Initialization. container-test-run-monitoring> machine1 # [879823.591484] machine1 systemd[1]: Discard unused filesystem blocks once a week skipped, unmet condition check ConditionVirtualization=!container container-test-run-monitoring> machine1 # [879823.591511] machine1 systemd[1]: Started Daily Cleanup of Temporary Directories. container-test-run-monitoring> machine1 # [879823.591527] machine1 systemd[1]: Reached target Timer Units. container-test-run-monitoring> machine1 # [879823.591660] machine1 systemd[1]: Listening on D-Bus System Message Bus Socket. container-test-run-monitoring> machine1 # [879823.591799] machine1 systemd[1]: Listening on Nix Daemon Socket. container-test-run-monitoring> machine1 # [879823.591911] machine1 systemd[1]: Listening on Virtual Machine and Container Registration Service Socket. container-test-run-monitoring> machine1 # [879823.591936] machine1 systemd[1]: Reached target Socket Units. container-test-run-monitoring> machine1 # [879823.591971] machine1 systemd[1]: Reached target Basic System. container-test-run-monitoring> machine1 # [879823.593253] machine1 systemd[1]: Started alloy.service. container-test-run-monitoring> machine1 # [879823.594236] machine1 systemd[1]: Starting Import lastlog data into lastlog2 database... container-test-run-monitoring> machine1 # [879823.595255] machine1 systemd[1]: Started Loki Service Daemon. container-test-run-monitoring> machine1 # [879823.596224] machine1 systemd[1]: Started mimir Service Daemon. container-test-run-monitoring> machine1 # [879823.597324] machine1 systemd[1]: Starting Nginx Web Server... container-test-run-monitoring> machine1 # [879823.598442] machine1 systemd[1]: Starting Name Service Cache Daemon (nsncd)... container-test-run-monitoring> machine1 # [879823.600956] machine1 systemd[1]: Starting PostgreSQL Server... container-test-run-monitoring> machine1 # [879823.602820] machine1 systemd[1]: Starting D-Bus System Message Bus... container-test-run-monitoring> machine1 # [879823.669455] machine1 systemd[1]: Finished Import lastlog data into lastlog2 database. container-test-run-monitoring> machine2 # [879823.847598] machine2 systemd[1]: Finished Permit User Sessions. container-test-run-monitoring> machine1 # [879823.855887] machine1 nsncd[248]: Nov 13 10:12:08.806 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket" container-test-run-monitoring> machine2 # [879823.849021] machine2 systemd[1]: Started Console Getty. container-test-run-monitoring> machine1 # [879823.855888] machine1 systemd[1]: Started Name Service Cache Daemon (nsncd). container-test-run-monitoring> machine2 # [879823.849064] machine2 systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-monitoring> machine2 # [879823.849094] machine2 systemd[1]: Reached target Login Prompts. container-test-run-monitoring> machine1 # [879823.855951] machine1 systemd[1]: Reached target Host and Network Name Lookups. container-test-run-monitoring> machine2 # [879823.903994] machine2 dbus-broker-launch[226]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-monitoring> machine1 # [879823.856042] machine1 systemd[1]: Reached target User and Group Name Lookups. container-test-run-monitoring> machine2 # [879823.904811] machine2 dbus-broker-launch[226]: NSS returned no entry for 'systemd-timesync' container-test-run-monitoring> machine1 # [879823.857911] machine1 systemd[1]: Starting User Login Management... container-test-run-monitoring> machine2 # [879823.904811] machine2 dbus-broker-launch[226]: Invalid user-name in /nix/store/4vgxxm5pm041xfw8cndff8xyj1921rvv-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-monitoring> machine1 # [879823.858832] machine1 systemd[1]: Starting Permit User Sessions... container-test-run-monitoring> machine2 # [879823.905221] machine2 systemd[1]: Started D-Bus System Message Bus. container-test-run-monitoring> machine1 # [879823.869520] machine1 systemd[1]: Finished Permit User Sessions. container-test-run-monitoring> machine2 # [879823.912403] machine2 dbus-broker-launch[226]: Ready container-test-run-monitoring> machine1 # [879823.870720] machine1 systemd[1]: Started Console Getty. container-test-run-monitoring> machine1 # [879823.870772] machine1 systemd[1]: Getty on tty1 skipped, unmet condition check ConditionPathExists=/dev/tty0 container-test-run-monitoring> machine1 # [879823.870788] machine1 systemd[1]: Reached target Login Prompts. container-test-run-monitoring> machine1 # [879824.064234] machine1 dbus-broker-launch[254]: Looking up NSS user entry for 'systemd-timesync'... container-test-run-monitoring> machine1 # [879824.064982] machine1 dbus-broker-launch[254]: NSS returned no entry for 'systemd-timesync' container-test-run-monitoring> machine1 # [879824.064982] machine1 dbus-broker-launch[254]: Invalid user-name in /nix/store/8g0c972dn7vgz2x051vyivamvcj0rs3r-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync" container-test-run-monitoring> machine1 # [879824.065456] machine1 systemd[1]: Started D-Bus System Message Bus. container-test-run-monitoring> machine1 # [879824.074174] machine1 dbus-broker-launch[254]: Ready container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.041037374Z caller=main.go:232 level=info msg="Starting application" version="(version=3.2.0, branch=unknown, revision=unknown)" container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.043425207Z caller=server.go:401 level=info msg="server listening on addresses" http=[::]:3001 grpc=[::]:9095 container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.064709298Z caller=modules.go:1217 level=info msg="The ruler is not being started because you need to configure the ruler storage." container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.065642591Z caller=inmemory.go:137 level=info msg="created in-memory index cache" maxItemSizeBytes=134217728 maxSizeBytes=1073741824 maxItems=maxInt container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.06700341Z caller=memberlist_client.go:562 level=info component=memberlist msg="Using memberlist cluster label and node name" cluster_label= node=machine1-3e17f399 container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.07211408Z caller=ingester.go:414 level=warn msg="-blocks-storage.backend=filesystem is for development and testing only; you should switch to an external object store for production use or use a shared filesystem" container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.073513019Z caller=ingester.go:584 level=info msg="TSDB idle compaction timeout set" timeout=1h13m43.321219931s container-test-run-monitoring> machine1 # [879824.184544] machine1 mimir[246]: ts=2026-11-13T10:12:09.075444246Z caller=modules.go:1240 level=info msg="The ruler storage has not been configured. Not starting the ruler." container-test-run-monitoring> machine1 # [879824.380171] machine1 systemd-networkd[238]: eth1: Gained IPv6LL container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.263125058Z caller=modules.go:755 level=info msg="The querier worker has not been configured with the query-scheduler address. Because Mimir is running in monolithic mode, it's attempting an automatic worker configuration. If queries are unresponsive, consider explicitly configuring the query-scheduler address for querier worker." address=127.0.0.1:9095 container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.2632221Z caller=worker.go:148 level=info msg="Starting querier worker connected to query-scheduler" scheduler=127.0.0.1:9095 container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.263882309Z caller=modules.go:1038 level=info msg="The query-frontend has not been configured with the query-scheduler address. Because Mimir is running in monolithic mode, it's attempting an automatic frontend configuration. If queries are unresponsive, consider explicitly configuring the query-scheduler address for querier-frontend." address=127.0.0.1:9095 container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.265573732Z caller=module_service.go:82 level=info msg=starting module=sanity-check container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.265634253Z caller=module_service.go:82 level=info msg=starting module=active-groups-cleanup-service container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.265655453Z caller=module_service.go:82 level=info msg=starting module=activity-tracker container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.265706694Z caller=sanity_check.go:34 level=info msg="Checking directories read/write access" container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.266009578Z caller=sanity_check.go:39 level=info msg="Directories read/write access successfully checked" container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.266019458Z caller=sanity_check.go:41 level=info msg="Checking object storage config" container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.26615098Z caller=sanity_check.go:46 level=info msg="Object storage config successfully checked" container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.26617826Z caller=module_service.go:82 level=info msg=starting module=server container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.2662031Z caller=module_service.go:82 level=info msg=starting module=memberlist-kv container-test-run-monitoring> machine1 # [879824.384877] machine1 mimir[246]: ts=2026-11-13T10:12:09.266236101Z caller=module_service.go:82 level=info msg=starting module=query-scheduler container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266288062Z caller=module_service.go:82 level=info msg=starting module=store-gateway container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266284182Z caller=module_service.go:82 level=info msg=starting module=ingester-ring container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266331822Z caller=module_service.go:82 level=info msg=starting module=store-queryable container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266367423Z caller=ring.go:390 level=info msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266371983Z caller=module_service.go:82 level=info msg=starting module=compactor container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266368623Z caller=ring.go:390 level=info msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266439984Z caller=module_service.go:82 level=info msg=starting module=querier-ring container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266485104Z caller=basic_lifecycler.go:324 level=info msg="instance not found in the ring" instance=machine1 ring=store-gateway container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266493624Z caller=ring.go:390 level=info msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266495144Z caller=basic_lifecycler_delegates.go:63 level=info msg="not loading tokens from file, tokens file path is empty" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266554465Z caller=module_service.go:82 level=info msg=starting module=distributor-service container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266610386Z caller=module_service.go:82 level=info msg=starting module=ingester-service container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266683267Z caller=module_service.go:82 level=info msg=starting module=query-frontend container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266718228Z caller=gateway.go:290 level=info msg="waiting until store-gateway is JOINING in the ring" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266765908Z caller=gateway.go:294 level=info msg="store-gateway is JOINING in the ring" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266747108Z caller=ingester_tsdb.go:415 level=info msg="opening existing TSDBs" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266784668Z caller=bucket_stores.go:231 level=info msg="synchronizing TSDB blocks for all users" container-test-run-monitoring> machine1 # [879824.385156] machine1 mimir[246]: ts=2026-11-13T10:12:09.266765108Z caller=module_service.go:82 level=info msg=starting module=querier-lifecycler container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.266829989Z caller=basic_lifecycler.go:324 level=info msg="instance not found in the ring" instance=machine1 ring=querier container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.266840069Z caller=basic_lifecycler.go:324 level=info msg="instance not found in the ring" instance=machine1 ring=distributor container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.266845229Z caller=ring.go:390 level=info msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.26691455Z caller=lifecycler.go:694 level=info msg="not loading tokens from file, tokens file path is empty" container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.26692399Z caller=distributor.go:952 level=info msg="waiting until distributor is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.26693379Z caller=lifecycler.go:721 level=info msg="instance not found in ring, adding with no tokens" ring=ingester container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.266954711Z caller=module_service.go:82 level=info msg=starting module=querier container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.266984191Z caller=lifecycler.go:562 level=info msg="auto-joining cluster after timeout" ring=ingester container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.266997311Z caller=worker.go:248 level=info msg="adding connection" addr=127.0.0.1:9095 in-use=true container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.267015872Z caller=bucket_stores.go:244 level=info msg="successfully synchronized TSDB blocks for all users" container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.267152273Z caller=frontend_scheduler_worker.go:146 level=info msg="adding connection to query-scheduler" addr=127.0.0.1:9095 container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.267309916Z caller=ring.go:390 level=info component=compactor msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.267364956Z caller=basic_lifecycler.go:324 level=info component=compactor msg="instance not found in the ring" instance=machine1 ring=compactor container-test-run-monitoring> machine1 # [879824.385438] machine1 mimir[246]: ts=2026-11-13T10:12:09.267520519Z caller=compactor.go:616 level=info component=compactor msg="waiting until compactor is ACTIVE in the ring" container-test-run-monitoring> machine2 # [879824.448198] machine2 systemd-networkd[218]: eth1: Gained IPv6LL container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.555172342Z level=info msg="Alloy is starting" container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.555357584Z level=info msg="boringcrypto enabled" enabled=false container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.586654093Z level=info msg="memory is not limited, skipping" package=github.com/KimMachineGun/automemlimit/memlimit container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.586784175Z level=info msg="no peer discovery configured: both join and discover peers are empty" service=cluster container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.589607174Z level=info msg="starting complete graph evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.595617656Z level=info msg="replaying WAL, this may take a while" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=wal dir=data-alloy/prometheus.remote_write.mimir/wal container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.597158917Z level=info msg="WAL segment loaded" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=wal segment=0 maxSegment=0 container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.598198291Z level=info msg="Starting WAL watcher" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=ddf2ea url=http://machine1.clan/mimir/api/v1/push queue=ddf2ea container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.598209452Z level=info msg="Starting scraped metadata watcher" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=ddf2ea url=http://machine1.clan/mimir/api/v1/push container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.598222812Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=prometheus.remote_write.mimir duration=8.607878ms container-test-run-monitoring> machine2 # [879824.652971] machine2 alloy[223]: ts=2026-11-13T10:12:09.598681218Z level=info msg="Replaying WAL" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=ddf2ea url=http://machine1.clan/mimir/api/v1/push queue=ddf2ea container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599361547Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=prometheus.relabel.create_nixos_services_metric duration=1.125295ms container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599632551Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=remotecfg duration=262.164µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599654391Z level=info msg="applying non-TLS config to HTTP server" service=http container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599656351Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=http duration=17.96µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599666152Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=cluster duration=1.761µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599674072Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=livedebugging duration=5.8µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599678552Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=ui duration=1.56µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.599691352Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=tracing duration=7.8µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.600483403Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=loki.relabel.journal duration=787.571µs container-test-run-monitoring> machine2 # [879824.656525] machine2 alloy[223]: ts=2026-11-13T10:12:09.600798287Z level=info msg="Parsed flag --collector.filesystem.mount-points-exclude" component_path=/ component_id=prometheus.exporter.unix.local_system collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.600805487Z level=info msg="Parsed flag --collector.filesystem.fs-types-exclude" component_path=/ component_id=prometheus.exporter.unix.local_system collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601080451Z level=info msg="Parsed flag --collector.systemd.unit-include" component_path=/ component_id=prometheus.exporter.unix.local_system collector=systemd flag=.+ container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601094371Z level=info msg="Parsed flag --collector.systemd.unit-exclude" component_path=/ component_id=prometheus.exporter.unix.local_system collector=systemd flag=.+\.(automount|device|mount|scope|slice) container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601312494Z level=info msg="Enabled node_exporter collectors" component_path=/ component_id=prometheus.exporter.unix.local_system container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601315494Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=cpu container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601316494Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=filesystem container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601317374Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=meminfo container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601318254Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=systemd container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.601338334Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=prometheus.exporter.unix.local_system duration=832.491µs container-test-run-monitoring> machine2 # [879824.656751] machine2 alloy[223]: ts=2026-11-13T10:12:09.603141599Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=prometheus.scrape.scrape_metrics duration=1.791824ms container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.603452403Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=logging duration=300.004µs container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.603477564Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=labelstore duration=16.84µs container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.603491644Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=otel duration=6.24µs container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.60394753Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=loki.write.loki duration=445.486µs container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.604187934Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e node_id=loki.source.journal.all duration=218.643µs container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.604211814Z level=info msg="finished complete graph evaluation" controller_path=/ controller_id="" trace_id=ecd49fdf3dde8be4bb27e733957f7e4e duration=14.849484ms container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.604447897Z level=info msg="{^_^} Alloy is running" container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.604520418Z level=info msg="scheduling loaded components and services" controller_id="" container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.605540912Z level=info msg="now listening for http traffic" service=http addr=127.0.0.1:12345 container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.604972784Z level=info msg="starting cluster node" service=cluster peers_count=0 peers="" advertise_addr=127.0.0.1:12345 minimum_cluster_size=0 minimum_size_wait_timeout=0s container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.605773355Z level=error msg="failed to register collector with remote server" service=remotecfg id=be93a86f-43e6-4658-b211-e4c6de6ee8b8 name="" err="noop client" container-test-run-monitoring> machine2 # [879824.656978] machine2 alloy[223]: ts=2026-11-13T10:12:09.605818556Z level=info msg="peers changed" service=cluster peers_count=1 min_cluster_size=0 peers=machine2 container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.337484118Z caller=main.go:146 msg="Starting Loki" version="(version=3.7.7, branch=unknown, revision=unknown)" container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.337546358Z caller=main.go:147 msg="Loading configuration file" filename=/nix/store/58bfbd98frhm1ffisa8x0mqs3c4fynl0-validate-loki-conf container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.337862723Z caller=modules.go:1597 msg="Ruler storage is not configured; ruler will not be started." config_key=ruler.storage container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.339393784Z caller=server.go:397 msg="server listening on addresses" http=[::]:3002 grpc=[::]:9096 container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.344326371Z caller=table_manager.go:300 index-store=tsdb-2025-11-01 msg="query readiness setup completed" duration=1.8µs distinct_users_len=0 distinct_users= container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.344343652Z caller=table_manager.go:136 index-store=tsdb-2025-11-01 msg="uploading tables" container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.344370972Z caller=shipper.go:165 index-store=tsdb-2025-11-01 msg="starting index shipper in RW mode" container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.344679616Z caller=head_manager.go:313 index-store=tsdb-2025-11-01 component=tsdb-head-manager msg="loaded wals by period" groups=0 container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.344713097Z caller=manager.go:86 index-store=tsdb-2025-11-01 component=tsdb-manager msg="loaded leftover local indices" err=null successful=true buckets=0 indices=0 failures=0 container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.344731177Z caller=head_manager.go:313 index-store=tsdb-2025-11-01 component=tsdb-head-manager msg="loaded wals by period" groups=0 container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.35154395Z caller=worker.go:134 component=querier msg="Starting querier worker using query-scheduler and scheduler ring for addresses" container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=warn ts=2026-11-13T10:12:09.351960116Z caller=modules.go:1643 msg="RulerStorage is nil. Not starting the ruler." container-test-run-monitoring> machine1 # [879824.485096] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369074471Z caller=module_service.go:82 msg=starting module=server container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369142432Z caller=module_service.go:82 msg=starting module=cache-generation-loader container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369213433Z caller=module_service.go:82 msg=starting module=memberlist-kv container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369238153Z caller=module_service.go:82 msg=starting module=store container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369251873Z caller=module_service.go:82 msg=starting module=ring container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369295954Z caller=module_service.go:82 msg=starting module=query-scheduler-ring container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369308674Z caller=ring.go:390 msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369369315Z caller=module_service.go:82 msg=starting module=distributor container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=error ts=2026-11-13T10:12:09.369420715Z caller=ratestore.go:110 msg="error getting ingester clients" err="empty ring" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369446756Z caller=ring.go:390 msg="ring doesn't exist in KV store yet" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369451636Z caller=module_service.go:82 msg=starting module=ingester container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369473516Z caller=ingester.go:571 component=ingester msg="recovering from checkpoint" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369480796Z caller=checkpoint.go:549 msg="tmp checkpoint cleanup starting" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369524997Z caller=basic_lifecycler.go:324 msg="instance not found in the ring" instance=machine1 ring=scheduler container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369537317Z caller=basic_lifecycler_delegates.go:63 msg="not loading tokens from file, tokens file path is empty" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369556397Z caller=checkpoint.go:554 msg="tmp checkpoint cleanup done" duration=53.921µs success=true container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369581518Z caller=recovery.go:45 component=ingester msg="no checkpoint found, treating as no-op" container-test-run-monitoring> machine1 # [879824.485710] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369596958Z caller=basic_lifecycler.go:324 component=distributor msg="instance not found in the ring" instance=machine1 ring=distributor container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369659519Z caller=module_service.go:82 msg=starting module=compactor container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369676399Z caller=ringmanager.go:186 msg="waiting until scheduler is JOINING in the ring" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369684519Z caller=ringmanager.go:190 msg="scheduler is JOINING in the ring" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369695079Z caller=module_service.go:82 msg=starting module=ingester-querier container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.369715959Z caller=ringmanager.go:199 msg="waiting until scheduler is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.36974088Z caller=module_service.go:82 msg=starting module=query-frontend-tripperware container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.36976824Z caller=module_service.go:82 msg=starting module=rule-evaluator container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.36976964Z caller=basic_lifecycler.go:324 msg="instance not found in the ring" instance=machine1 ring=compactor container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.36977716Z caller=basic_lifecycler_delegates.go:63 msg="not loading tokens from file, tokens file path is empty" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.370114565Z caller=compactor.go:420 msg="waiting until compactor is JOINING in the ring" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.370134965Z caller=compactor.go:424 msg="compactor is JOINING in the ring" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.370165126Z caller=compactor.go:434 msg="waiting until compactor is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.37047689Z caller=ingester.go:587 component=ingester msg="recovered WAL checkpoint recovery finished" elapsed=1.004534ms errors=false container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.37049337Z caller=ingester.go:593 component=ingester msg="recovering from WAL" container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371359702Z caller=ingester.go:609 component=ingester msg="WAL segment recovery finished" elapsed=1.876386ms errors=false container-test-run-monitoring> machine1 # [879824.485996] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371415783Z caller=ingester.go:557 component=ingester msg="closing recoverer" container-test-run-monitoring> machine1 # [879824.486257] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371485624Z caller=ingester.go:565 component=ingester msg="WAL recovery finished" time=2.013788ms container-test-run-monitoring> machine1 # [879824.486257] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371568345Z caller=lifecycler.go:694 component=ingester msg="not loading tokens from file, tokens file path is empty" container-test-run-monitoring> machine1 # [879824.486257] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371619386Z caller=lifecycler.go:721 component=ingester msg="instance not found in ring, adding with no tokens" ring=ingester container-test-run-monitoring> machine1 # [879824.486257] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371699827Z caller=lifecycler.go:562 component=ingester msg="auto-joining cluster after timeout" ring=ingester container-test-run-monitoring> machine1 # [879824.486257] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371780028Z caller=wal.go:173 msg=started component=wal container-test-run-monitoring> machine1 # [879824.486257] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.371846989Z caller=ingester.go:778 component=ingester msg="sleeping for initial delay before starting periodic flushing" delay=8.873142207s container-test-run-monitoring> machine1 # [879824.488829] machine1 mimir[246]: ts=2026-11-13T10:12:09.386462389Z caller=compactor.go:621 level=info component=compactor msg="compactor is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879824.488829] machine1 mimir[246]: ts=2026-11-13T10:12:09.386883835Z caller=compactor.go:743 level=info component=compactor msg="discovering users from bucket" container-test-run-monitoring> machine1 # [879824.488829] machine1 mimir[246]: ts=2026-11-13T10:12:09.386924035Z caller=compactor.go:753 level=info component=compactor msg="discovered users from bucket" users=0 container-test-run-monitoring> machine1 # [879824.488829] machine1 mimir[246]: ts=2026-11-13T10:12:09.386987516Z caller=blocks_cleaner.go:244 level=info component=cleaner task=clean_up_users_during_startup msg="started blocks cleanup and maintenance" container-test-run-monitoring> machine1 # [879824.488829] machine1 mimir[246]: ts=2026-11-13T10:12:09.387041117Z caller=blocks_cleaner.go:250 level=info component=cleaner task=clean_up_users_during_startup msg="successfully completed blocks cleanup and maintenance" container-test-run-monitoring> machine1 # [879824.582147] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.524930887Z caller=compactor.go:438 msg="compactor is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879824.582147] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.532228867Z caller=ringmanager.go:203 msg="scheduler is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879824.582147] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.532309748Z caller=module_service.go:82 msg=starting module=query-scheduler container-test-run-monitoring> machine1 # [879824.582147] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.532397789Z caller=module_service.go:82 msg=starting module=querier container-test-run-monitoring> machine1 # [879824.582147] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.53243279Z caller=module_service.go:82 msg=starting module=query-frontend container-test-run-monitoring> machine1 # [879824.582147] machine1 loki[245]: level=info ts=2026-11-13T10:12:09.532508191Z caller=loki.go:615 msg="Loki started" startup_time=280.500165ms container-test-run-monitoring> machine1 # [879824.638571] machine1 alloy[243]: ts=2026-11-13T10:12:09.561859553Z level=info msg="Alloy is starting" container-test-run-monitoring> machine1 # [879824.638571] machine1 alloy[243]: ts=2026-11-13T10:12:09.561924394Z level=info msg="boringcrypto enabled" enabled=false container-test-run-monitoring> machine1 # [879824.638571] machine1 alloy[243]: ts=2026-11-13T10:12:09.586148006Z level=info msg="memory is not limited, skipping" package=github.com/KimMachineGun/automemlimit/memlimit container-test-run-monitoring> machine1 # [879824.638571] machine1 alloy[243]: ts=2026-11-13T10:12:09.586332569Z level=info msg="no peer discovery configured: both join and discover peers are empty" service=cluster container-test-run-monitoring> machine1 # [879824.638571] machine1 alloy[243]: ts=2026-11-13T10:12:09.588901164Z level=info msg="starting complete graph evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 container-test-run-monitoring> machine1 # [879824.639031] machine1 alloy[243]: ts=2026-11-13T10:12:09.588999005Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=logging duration=87.521µs container-test-run-monitoring> machine1 # [879824.639031] machine1 alloy[243]: ts=2026-11-13T10:12:09.589092167Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=remotecfg duration=84.722µs container-test-run-monitoring> machine1 # [879824.639031] machine1 alloy[243]: ts=2026-11-13T10:12:09.589167408Z level=info msg="applying non-TLS config to HTTP server" service=http container-test-run-monitoring> machine1 # [879824.639031] machine1 alloy[243]: ts=2026-11-13T10:12:09.589177488Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=http duration=75.601µs container-test-run-monitoring> machine1 # [879824.639031] machine1 alloy[243]: ts=2026-11-13T10:12:09.589183568Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=cluster duration=520ns container-test-run-monitoring> machine1 # [879824.639222] machine1 alloy[243]: ts=2026-11-13T10:12:09.589602614Z level=info msg="Parsed flag --collector.systemd.unit-include" component_path=/ component_id=prometheus.exporter.unix.local_system collector=systemd flag=.+ container-test-run-monitoring> machine1 # [879824.639254] machine1 alloy[243]: ts=2026-11-13T10:12:09.589644574Z level=info msg="Parsed flag --collector.systemd.unit-exclude" component_path=/ component_id=prometheus.exporter.unix.local_system collector=systemd flag=.+\.(automount|device|mount|scope|slice) container-test-run-monitoring> machine1 # [879824.639283] machine1 alloy[243]: ts=2026-11-13T10:12:09.589681695Z level=info msg="Parsed flag --collector.filesystem.mount-points-exclude" component_path=/ component_id=prometheus.exporter.unix.local_system collector=filesystem flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) container-test-run-monitoring> machine1 # [879824.639309] machine1 alloy[243]: ts=2026-11-13T10:12:09.589694415Z level=info msg="Parsed flag --collector.filesystem.fs-types-exclude" component_path=/ component_id=prometheus.exporter.unix.local_system collector=filesystem flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ container-test-run-monitoring> machine1 # [879824.639610] machine1 alloy[243]: ts=2026-11-13T10:12:09.590000379Z level=info msg="Enabled node_exporter collectors" component_path=/ component_id=prometheus.exporter.unix.local_system container-test-run-monitoring> machine1 # [879824.639610] machine1 alloy[243]: ts=2026-11-13T10:12:09.590017859Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=cpu container-test-run-monitoring> machine1 # [879824.639651] machine1 alloy[243]: ts=2026-11-13T10:12:09.590022619Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=filesystem container-test-run-monitoring> machine1 # [879824.639651] machine1 alloy[243]: ts=2026-11-13T10:12:09.590026339Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=meminfo container-test-run-monitoring> machine1 # [879824.639651] machine1 alloy[243]: ts=2026-11-13T10:12:09.590029579Z level=info msg=collector component_path=/ component_id=prometheus.exporter.unix.local_system name=systemd container-test-run-monitoring> machine1 # [879824.639651] machine1 alloy[243]: ts=2026-11-13T10:12:09.59005322Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=prometheus.exporter.unix.local_system duration=863.452µs container-test-run-monitoring> machine1 # [879824.639731] machine1 alloy[243]: ts=2026-11-13T10:12:09.5900693Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=otel duration=2.88µs container-test-run-monitoring> machine1 # [879824.639731] machine1 alloy[243]: ts=2026-11-13T10:12:09.59008226Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=labelstore duration=5.84µs container-test-run-monitoring> machine1 # [879824.639731] machine1 alloy[243]: ts=2026-11-13T10:12:09.59009486Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=livedebugging duration=6.72µs container-test-run-monitoring> machine1 # [879824.639731] machine1 alloy[243]: ts=2026-11-13T10:12:09.5901037Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=ui duration=1.68µs container-test-run-monitoring> machine1 # [879824.641210] machine1 alloy[243]: ts=2026-11-13T10:12:09.591588401Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=loki.write.loki duration=1.47406ms container-test-run-monitoring> machine1 # [879824.641791] machine1 alloy[243]: ts=2026-11-13T10:12:09.592183409Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=loki.relabel.journal duration=555.288µs container-test-run-monitoring> machine1 # [879824.642020] machine1 alloy[243]: ts=2026-11-13T10:12:09.592412572Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=loki.source.journal.all duration=209.843µs container-test-run-monitoring> machine1 # [879824.644122] machine1 alloy[243]: ts=2026-11-13T10:12:09.59447496Z level=info msg="replaying WAL, this may take a while" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=wal dir=data-alloy/prometheus.remote_write.mimir/wal container-test-run-monitoring> machine1 # [879824.644762] machine1 alloy[243]: ts=2026-11-13T10:12:09.59515141Z level=info msg="WAL segment loaded" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=wal segment=0 maxSegment=0 container-test-run-monitoring> machine1 # [879824.646097] machine1 alloy[243]: ts=2026-11-13T10:12:09.596467428Z level=info msg="Starting WAL watcher" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=c24cae url=http://machine1.clan/mimir/api/v1/push queue=c24cae container-test-run-monitoring> machine1 # [879824.646097] machine1 alloy[243]: ts=2026-11-13T10:12:09.596504668Z level=info msg="Starting scraped metadata watcher" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=c24cae url=http://machine1.clan/mimir/api/v1/push container-test-run-monitoring> machine1 # [879824.646154] machine1 alloy[243]: ts=2026-11-13T10:12:09.596527188Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=prometheus.remote_write.mimir duration=4.094216ms container-test-run-monitoring> machine1 # [879824.646512] machine1 alloy[243]: ts=2026-11-13T10:12:09.596902194Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=prometheus.relabel.create_nixos_services_metric duration=352.285µs container-test-run-monitoring> machine1 # [879824.647991] machine1 alloy[243]: ts=2026-11-13T10:12:09.598220452Z level=info msg="Replaying WAL" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=c24cae url=http://machine1.clan/mimir/api/v1/push queue=c24cae container-test-run-monitoring> machine1 # [879824.649072] machine1 alloy[243]: ts=2026-11-13T10:12:09.599455069Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=prometheus.scrape.scrape_metrics duration=2.529435ms container-test-run-monitoring> machine1 # [879824.649109] machine1 alloy[243]: ts=2026-11-13T10:12:09.599508109Z level=info msg="finished node evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 node_id=tracing duration=24.56µs container-test-run-monitoring> machine1 # [879824.649109] machine1 alloy[243]: ts=2026-11-13T10:12:09.599518469Z level=info msg="finished complete graph evaluation" controller_path=/ controller_id="" trace_id=255c281f323eacbf664c3d80771f7a71 duration=10.828628ms container-test-run-monitoring> machine1 # [879824.649375] machine1 alloy[243]: ts=2026-11-13T10:12:09.599768873Z level=info msg="{^_^} Alloy is running" container-test-run-monitoring> machine1 # [879824.651464] machine1 alloy[243]: ts=2026-11-13T10:12:09.601848461Z level=info msg="scheduling loaded components and services" controller_id="" container-test-run-monitoring> machine1 # [879824.652158] machine1 alloy[243]: ts=2026-11-13T10:12:09.60250539Z level=info msg="starting cluster node" service=cluster peers_count=0 peers="" advertise_addr=127.0.0.1:12345 minimum_cluster_size=0 minimum_size_wait_timeout=0s container-test-run-monitoring> machine1 # [879824.652659] machine1 alloy[243]: ts=2026-11-13T10:12:09.603025558Z level=info msg="peers changed" service=cluster peers_count=1 min_cluster_size=0 peers=machine1 container-test-run-monitoring> machine1 # [879824.653323] machine1 alloy[243]: ts=2026-11-13T10:12:09.603698687Z level=info msg="now listening for http traffic" service=http addr=127.0.0.1:12345 container-test-run-monitoring> machine1 # [879824.654111] machine1 alloy[243]: ts=2026-11-13T10:12:09.604456857Z level=error msg="failed to register collector with remote server" service=remotecfg id=5cdc0ed9-2bb9-4fcf-8581-0cb8d2667ae7 name="" err="noop client" container-test-run-monitoring> machine1 # [879824.783486] machine1 nginx-pre-start[379]: nginx: the configuration file /nix/store/2f2ibd7gydgsvcbhqxn4p8ki4jpiyk8c-nginx.conf syntax is ok container-test-run-monitoring> machine1 # [879824.783817] machine1 nginx-pre-start[379]: nginx: configuration file /nix/store/2f2ibd7gydgsvcbhqxn4p8ki4jpiyk8c-nginx.conf test is successful container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: The files belonging to this database system will be owned by user "postgres". container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: This user must also own the server process. container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: The database cluster will be initialized with locale "en_US.UTF-8". container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: The default database encoding has accordingly been set to "UTF8". container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: The default text search configuration will be set to "english". container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: Data page checksums are enabled. container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: creating subdirectories ... ok container-test-run-monitoring> machine1 # [879824.820041] machine1 postgresql-pre-start[383]: selecting dynamic shared memory implementation ... posix container-test-run-monitoring> machine1 # [879824.840034] machine1 postgresql-pre-start[383]: selecting default "max_connections" ... 100 container-test-run-monitoring> machine1 # [879824.845129] machine1 systemd-logind[273]: New seat seat0. container-test-run-monitoring> machine1 # [879824.860602] machine1 systemd[1]: Started User Login Management. container-test-run-monitoring> machine1 # [879824.862617] machine1 systemd[1]: Starting linger-users.service... container-test-run-monitoring> machine1 # [879824.866954] machine1 postgresql-pre-start[383]: selecting default "shared_buffers" ... 128MB container-test-run-monitoring> machine1 # [879824.875075] machine1 systemd[1]: linger-users.service: Deactivated successfully. container-test-run-monitoring> machine1 # [879824.875298] machine1 systemd[1]: Finished linger-users.service. container-test-run-monitoring> machine2 # [879824.838078] machine2 systemd-logind[242]: New seat seat0. container-test-run-monitoring> machine2 # [879824.838323] machine2 systemd[1]: Started User Login Management. container-test-run-monitoring> machine2 # [879824.839813] machine2 systemd[1]: Starting linger-users.service... container-test-run-monitoring> machine2 # [879824.851293] machine2 systemd[1]: linger-users.service: Deactivated successfully. container-test-run-monitoring> machine2 # [879824.851618] machine2 systemd[1]: Finished linger-users.service. container-test-run-monitoring> machine2 # [879824.852118] machine2 systemd[1]: Reached target Multi-User System. container-test-run-monitoring> machine1 # [879825.141133] machine1 postgresql-pre-start[383]: selecting default time zone ... UTC container-test-run-monitoring> machine1 # [879825.142389] machine1 postgresql-pre-start[383]: creating configuration files ... ok container-test-run-monitoring> machine1 # [879825.271924] machine1 postgresql-pre-start[383]: running bootstrap script ... ok container-test-run-monitoring> machine1 # [879825.384872] machine1 mimir[246]: ts=2026-11-13T10:12:10.267264903Z caller=gateway.go:330 level=info msg="waiting until store-gateway is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879825.477553] machine1 systemd[1]: Started Nginx Web Server. container-test-run-monitoring> machine1 # [879825.585201] machine1 mimir[246]: ts=2026-11-13T10:12:10.467797932Z caller=gateway.go:334 level=info msg="store-gateway is ACTIVE in the ring" container-test-run-monitoring> machine1 # [879825.678713] machine1 postgresql-pre-start[383]: performing post-bootstrap initialization ... ok container-test-run-monitoring> machine1 # [879825.878230] machine1 postgresql-pre-start[383]: syncing data to disk ... ok container-test-run-monitoring> machine1 # [879825.878230] machine1 postgresql-pre-start[383]: initdb: warning: enabling "trust" authentication for local connections container-test-run-monitoring> machine1 # [879825.878230] machine1 postgresql-pre-start[383]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb. container-test-run-monitoring> machine1 # [879825.878230] machine1 postgresql-pre-start[383]: Success. You can now start the database server using: container-test-run-monitoring> machine1 # [879825.878230] machine1 postgresql-pre-start[383]: pg_ctl -D /var/lib/postgresql/18 -l logfile start container-test-run-monitoring> machine1 # [879826.284487] machine1 mimir[246]: ts=2026-11-13T10:12:11.20810636Z caller=mimir.go:1170 level=info msg="Application started" container-test-run-monitoring> machine1 # [879827.585723] machine1 loki[245]: level=info ts=2026-11-13T10:12:12.532452354Z caller=scheduler.go:658 msg="this scheduler is in the ReplicationSet, will now accept requests." container-test-run-monitoring> machine1 # [879827.585723] machine1 loki[245]: level=info ts=2026-11-13T10:12:12.532519915Z caller=worker.go:235 component=querier msg="adding connection" addr=127.0.0.1:9096 container-test-run-monitoring> machine1 # [879827.995268] machine1 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-monitoring> machine1 # [879827.996495] machine1 systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-monitoring> machine2 # [879827.999385] machine2 systemd[1]: etc-machine\x2did.mount: Deactivated successfully. container-test-run-monitoring> machine2 # [879828.001044] machine2 systemd[1]: Finished Save Transient machine-id to Disk. container-test-run-monitoring> machine2 # [879828.001284] machine2 systemd[1]: Startup finished in 6.707s. container-test-run-monitoring> machine1 # [879829.585569] machine1 loki[245]: level=info ts=2026-11-13T10:12:14.525652396Z caller=compactor.go:497 msg="this instance has been chosen to run the compactor, starting compactor" container-test-run-monitoring> machine1 # [879829.585569] machine1 loki[245]: level=info ts=2026-11-13T10:12:14.525729437Z caller=tables_manager.go:70 msg="waiting 10m0s for ring to stay stable and previous compactions to finish before starting compactor" container-test-run-monitoring> machine1 # [879830.194161] machine1 postgres[403]: [403] LOG: starting PostgreSQL 18.6 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit container-test-run-monitoring> machine1 # [879830.196674] machine1 postgres[403]: [403] LOG: listening on IPv6 address "::1", port 5432 container-test-run-monitoring> machine1 # [879830.196674] machine1 postgres[403]: [403] LOG: listening on IPv4 address "127.0.0.1", port 5432 container-test-run-monitoring> machine1 # [879830.197184] machine1 postgres[403]: [403] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432" container-test-run-monitoring> machine1 # [879830.200766] machine1 postgres[417]: [417] LOG: database system was shut down at 2026-11-13 10:12:10 GMT container-test-run-monitoring> machine1 # [879830.204562] machine1 postgres[403]: [403] LOG: database system is ready to accept connections container-test-run-monitoring> machine1: still waiting for container 'machine1' to reach ready state... container-test-run-monitoring> machine1 # [879830.988794] machine1 postgresql-post-start[430]: CREATE ROLE container-test-run-monitoring> machine1 # [879831.063291] machine1 postgresql-post-start[435]: CREATE DATABASE container-test-run-monitoring> machine1 # [879831.069082] machine1 systemd[1]: Started PostgreSQL Server. container-test-run-monitoring> machine1 # [879831.070509] machine1 systemd[1]: Starting PostgreSQL Setup Scripts... container-test-run-monitoring> machine1 # [879831.094145] machine1 systemd[1]: Finished PostgreSQL Setup Scripts. container-test-run-monitoring> machine1 # [879831.094645] machine1 systemd[1]: Reached target PostgreSQL. container-test-run-monitoring> machine1 # [879831.096278] machine1 systemd[1]: Starting Grafana Service Daemon... container-test-run-monitoring> machine2 # [879831.241506] machine2 alloy[223]: ts=2026-11-13T10:12:16.191776795Z level=info msg="Done replaying WAL" component_path=/ component_id=prometheus.remote_write.mimir subcomponent=rw remote_name=ddf2ea url=http://machine1.clan/mimir/api/v1/push duration=6.593135218s container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.227943651Z caller=handler.go:95 level=info user=anonymous caller=head.go:776 time=2026-11-13T10:12:16.227914651Z msg="Replaying on-disk memory mappable chunks if any" container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.227990052Z caller=handler.go:95 level=info user=anonymous caller=head.go:862 time=2026-11-13T10:12:16.227979052Z msg="On-disk memory mappable chunks replay completed" duration=1.72µs container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.228016892Z caller=handler.go:95 level=info user=anonymous caller=head.go:870 time=2026-11-13T10:12:16.228007572Z msg="Replaying WAL, this may take a while" container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.229550993Z caller=handler.go:95 level=info user=anonymous caller=head.go:966 time=2026-11-13T10:12:16.229527113Z msg="WAL segment loaded" segment=0 maxSegment=0 duration=1.403419ms container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.229607074Z caller=handler.go:95 level=info user=anonymous caller=head.go:1003 time=2026-11-13T10:12:16.229583154Z msg="WAL replay completed" checkpoint_replay_duration=90.402µs wal_replay_duration=1.45698ms wbl_replay_duration=200ns chunk_snapshot_load_duration=0s mmap_chunk_replay_duration=1.72µs total_replay_duration=1.600382ms container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.233939493Z caller=handler.go:95 level=info user=anonymous caller=db.go:2729 time=2026-11-13T10:12:16.233924133Z msg="Compactions disabled" container-test-run-monitoring> machine1 # [879831.284767] machine1 mimir[246]: ts=2026-11-13T10:12:16.233964254Z caller=ingester_tsdb.go:252 level=info user=anonymous msg="Running compaction after WAL replay" container-test-run-monitoring> machine1: (finished: waiting for unit multi-user.target, in 12.66 seconds) container-test-run-monitoring> machine2: waiting for unit multi-user.target container-test-run-monitoring> machine2: (finished: waiting for unit multi-user.target, in 0.01 seconds) container-test-run-monitoring> machine1: waiting for unit alloy container-test-run-monitoring> machine1: (finished: waiting for unit alloy, in 0.01 seconds) container-test-run-monitoring> machine2: waiting for unit alloy container-test-run-monitoring> machine2: (finished: waiting for unit alloy, in 0.01 seconds) container-test-run-monitoring> machine1: must succeed: test -f /etc/alloy/config.alloy container-test-run-monitoring> machine1: (finished: must succeed: test -f /etc/alloy/config.alloy, in 0.01 seconds) container-test-run-monitoring> machine2: must succeed: test -f /etc/alloy/config.alloy container-test-run-monitoring> machine2: (finished: must succeed: test -f /etc/alloy/config.alloy, in 0.01 seconds) container-test-run-monitoring> machine2: must succeed: test -f /etc/alloy/local-extension.alloy container-test-run-monitoring> machine2: (finished: must succeed: test -f /etc/alloy/local-extension.alloy, in 0.00 seconds) container-test-run-monitoring> machine1: must succeed: systemctl show alloy --property=ExecStart | grep -F '/etc/alloy' container-test-run-monitoring> machine1: (finished: must succeed: systemctl show alloy --property=ExecStart | grep -F '/etc/alloy', in 0.01 seconds) container-test-run-monitoring> machine2: must succeed: systemctl show alloy --property=ExecStart | grep -F '/etc/alloy' container-test-run-monitoring> machine2: (finished: must succeed: systemctl show alloy --property=ExecStart | grep -F '/etc/alloy', in 0.02 seconds) container-test-run-monitoring> machine1: waiting for unit loki container-test-run-monitoring> machine1: (finished: waiting for unit loki, in 0.01 seconds) container-test-run-monitoring> machine1: waiting for unit mimir container-test-run-monitoring> machine1: (finished: waiting for unit mimir, in 0.01 seconds) container-test-run-monitoring> machine1: waiting for unit grafana container-test-run-monitoring> machine1: (finished: waiting for unit grafana, in 0.01 seconds) container-test-run-monitoring> machine2: must succeed: test "$(grep -c '^loki.source.journal ' /etc/alloy/config.alloy)" = 1 container-test-run-monitoring> machine2: (finished: must succeed: test "$(grep -c '^loki.source.journal ' /etc/alloy/config.alloy)" = 1, in 0.01 seconds) container-test-run-monitoring> machine2: must succeed: cat /etc/alloy/config.alloy container-test-run-monitoring> machine2: (finished: must succeed: cat /etc/alloy/config.alloy, in 0.01 seconds) container-test-run-monitoring> (finished: run the VM test script, in 12.81 seconds) container-test-run-monitoring> machine1 # [879833.385377] machine1 systemd[1]: Started Grafana Service Daemon. container-test-run-monitoring> machine1 # [879833.385690] machine1 systemd[1]: Reached target Multi-User System. container-test-run-monitoring> machine1 # [879833.385965] machine1 systemd[1]: Startup finished in 11.383s. container-test-run-monitoring> machine1 # [879833.839609] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.789948651Z level=info msg="Starting Grafana" version=13.1.4 commit=NA branch=main compiled=2026-11-13T10:12:18Z container-test-run-monitoring> machine1 # [879833.840407] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.790788623Z level=info msg="Unified migration configs enforced" storage_type=unified target=[all] container-test-run-monitoring> machine1 # [879833.840451] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.790824583Z level=info msg="Enforcing mode 5 for resource in unified storage" resource=playlists.playlist.grafana.app container-test-run-monitoring> machine1 # [879833.840451] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.790835863Z level=info msg="Enforcing mode 5 for resource in unified storage" resource=folders.folder.grafana.app container-test-run-monitoring> machine1 # [879833.840451] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.790843344Z level=info msg="Enforcing mode 5 for resource in unified storage" resource=dashboards.dashboard.grafana.app container-test-run-monitoring> machine1 # [879833.840604] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791002986Z level=info msg="Config loaded from" file=/var/lib/grafana/conf/defaults.ini container-test-run-monitoring> machine1 # [879833.840604] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791012586Z level=info msg="Config loaded from" file=/nix/store/s2biaj5ahffivfrmmms6abjsx2v0wdll-config.ini container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791018666Z level=info msg=Target target=[all] container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791025706Z level=info msg="Path Home" path=/var/lib/grafana container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791031746Z level=info msg="Path Data" path=/var/lib/grafana/data container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791037666Z level=info msg="Path Logs" path=/var/lib/grafana/data/log container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791042906Z level=info msg="Path Plugins" path="[/var/lib/grafana/plugins /var/lib/grafana/data/plugins-bundled]" container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791050946Z level=info msg="Path Provisioning" path=/nix/store/4namqrvcigq7mhwygmlf9p5v92ll1nif-grafana-provisioning container-test-run-monitoring> machine1 # [879833.840648] machine1 grafana[446]: logger=settings t=2026-11-13T10:12:18.791056907Z level=info msg="App mode production" container-test-run-monitoring> machine1 # [879833.841782] machine1 grafana[446]: logger=featuremgmt t=2026-11-13T10:12:18.792119361Z level=info msg=FeatureToggles alertRuleRestore=true alertingBulkActionsInUI=true alertingImportYAMLUI=true alertingListViewV2=true alertingMigrationUI=true alertingMultiplePolicies=true alertingNavigationV2=true alertingNotificationsStepMode=true alertingQueryAndExpressionsStepMode=true alertingRulePermanentlyDelete=true alertingRuleRecoverDeleted=true alertingRuleVersionHistoryRestore=true alertingSaveStateCompressed=true alertingUIOptimizeReducer=true alertingUIUseBackendFilters=true alertingUIUseFullyCompatBackendFilters=true alertingUseNewSimplifiedRoutingHashAlgorithm=true annotationPermissionUpdate=true annotationsClustering=true awsAsyncQueryCaching=true awsDatasourcesTempCredentials=true azureMonitorEnableUserAuth=true azureMonitorPrometheusExemplars=true azureResourcePickerUpdates=true clearPreviousFieldValues=true cloudWatchCrossAccountQuerying=true cloudWatchNewLabelParsing=true cloudWatchRoundUpEndTime=true dashboardDefaultLayoutSelector=true dashboardNewLayouts=true dashboardSectionVariables=true dashboardUnifiedDrilldownControls=true enableSCIM=true feedbackButton=true grafana.scenesFlickeringFix=true grafanaAdvisor=true grafanaAssistantInProfilesDrilldown=true heatmapRowsAxisOptions=true improvedExternalSessionHandling=true improvedExternalSessionHandlingSAML=true influxdbBackendMigration=true kubernetesShortURLs=true lokiLabelNamesQueryApi=true lokiQuerySplitting=true multiPropsVariables=true newClickhouseConfigPageDesign=true newLogContext=true newLogsPanel=true newUnconfiguredPanel=true onlyStoreActionSets=true panelStyleActions=true profilesExemplars=true prometheusAzureOverrideAudience=true prometheusTypeMigration=true provisioning=true provisioning.readmes=true provisioningFolderMetadata=true pyroscopeUTF8LabelNames=true react19=true rememberUserOrgForSso=true renderAuthJWT=true restrictedPluginApis=true sqlExpressions=true teamFolders=true useKubernetesShortURLsAPI=true useMultipleScopeNodesEndpoint=true useScopeSingleNodeEndpoint=true useSessionStorageForRedirection=true vizLegendFacetedFilter=true vizPresets=true container-test-run-monitoring> machine1 # [879833.841898] machine1 grafana[446]: logger=sqlstore t=2026-11-13T10:12:18.792243203Z level=info msg="Connecting to DB" dbtype=postgres container-test-run-monitoring> machine1 # [879833.849605] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.799989669Z level=info msg="Locking database" container-test-run-monitoring> machine1 # [879833.850097] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.800488556Z level=info msg="Starting DB migrations" container-test-run-monitoring> machine1 # [879833.855629] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.806005791Z level=info msg="Executing migration" id="create migration_log table" container-test-run-monitoring> machine1 # [879833.858749] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.809136874Z level=info msg="Migration successfully executed" id="create migration_log table" duration=3.131763ms container-test-run-monitoring> machine1 # [879833.859698] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.810089927Z level=info msg="Executing migration" id="create user table" container-test-run-monitoring> machine1 # [879833.861354] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.81174959Z level=info msg="Migration successfully executed" id="create user table" duration=1.661343ms container-test-run-monitoring> machine1 # [879833.862058] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.81244968Z level=info msg="Executing migration" id="add unique index user.login" container-test-run-monitoring> machine1 # [879833.864256] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.81465063Z level=info msg="Migration successfully executed" id="add unique index user.login" duration=2.20035ms container-test-run-monitoring> machine1 # [879833.864801] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.815194117Z level=info msg="Executing migration" id="add unique index user.email" container-test-run-monitoring> machine1 # [879833.865961] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.816349853Z level=info msg="Migration successfully executed" id="add unique index user.email" duration=1.156816ms container-test-run-monitoring> machine1 # [879833.866474] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.81686746Z level=info msg="Executing migration" id="drop index UQE_user_login - v1" container-test-run-monitoring> machine1 # [879833.867471] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.817863074Z level=info msg="Migration successfully executed" id="drop index UQE_user_login - v1" duration=995.094µs container-test-run-monitoring> machine1 # [879833.868213] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.818604764Z level=info msg="Executing migration" id="drop index UQE_user_email - v1" container-test-run-monitoring> machine1 # [879833.868992] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.819389855Z level=info msg="Migration successfully executed" id="drop index UQE_user_email - v1" duration=786.011µs container-test-run-monitoring> machine1 # [879833.869574] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.819972503Z level=info msg="Executing migration" id="Rename table user to user_v1 - v1" container-test-run-monitoring> machine1 # [879833.869775] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.820168946Z level=info msg="Migration successfully executed" id="Rename table user to user_v1 - v1" duration=195.323µs container-test-run-monitoring> machine1 # [879833.870257] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.820654752Z level=info msg="Executing migration" id="create user table v2" container-test-run-monitoring> machine1 # [879833.872100] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.822477177Z level=info msg="Migration successfully executed" id="create user table v2" duration=1.821225ms container-test-run-monitoring> machine1 # [879833.872623] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.823020305Z level=info msg="Executing migration" id="create index UQE_user_login - v2" container-test-run-monitoring> machine1 # [879833.873647] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.824041399Z level=info msg="Migration successfully executed" id="create index UQE_user_login - v2" duration=1.021174ms container-test-run-monitoring> machine1 # [879833.874048] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.824446364Z level=info msg="Executing migration" id="create index UQE_user_email - v2" container-test-run-monitoring> machine1 # [879833.875037] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.825433658Z level=info msg="Migration successfully executed" id="create index UQE_user_email - v2" duration=986.174µs container-test-run-monitoring> machine1 # [879833.875472] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.825870104Z level=info msg="Executing migration" id="copy data_source v1 to v2" container-test-run-monitoring> machine1 # [879833.875781] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.826179108Z level=info msg="Migration successfully executed" id="copy data_source v1 to v2" duration=306.884µs container-test-run-monitoring> machine1 # [879833.876164] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.826562873Z level=info msg="Executing migration" id="Drop old table user_v1" container-test-run-monitoring> machine1 # [879833.876880] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.827277203Z level=info msg="Migration successfully executed" id="Drop old table user_v1" duration=713.69µs container-test-run-monitoring> machine1 # [879833.878071] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.828469139Z level=info msg="Executing migration" id="Add column help_flags1 to user table" container-test-run-monitoring> machine1 # [879833.878433] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.828830944Z level=info msg="Migration successfully executed" id="Add column help_flags1 to user table" duration=361.085µs container-test-run-monitoring> machine1 # [879833.878880] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.82927335Z level=info msg="Executing migration" id="Update user table charset" container-test-run-monitoring> machine1 # [879833.880219] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.830609129Z level=info msg="Migration successfully executed" id="Update user table charset" duration=1.336099ms container-test-run-monitoring> machine1 # [879833.880717] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.831112376Z level=info msg="Executing migration" id="Add last_seen_at column to user" container-test-run-monitoring> machine1 # [879833.880915] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.831307898Z level=info msg="Migration successfully executed" id="Add last_seen_at column to user" duration=195.362µs container-test-run-monitoring> machine1 # [879833.881403] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.831796825Z level=info msg="Executing migration" id="Add missing user data" container-test-run-monitoring> machine1 # [879833.882022] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.832403633Z level=info msg="Migration successfully executed" id="Add missing user data" duration=607.488µs container-test-run-monitoring> machine1 # [879833.882537] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.83292856Z level=info msg="Executing migration" id="Add is_disabled column to user" container-test-run-monitoring> machine1 # [879833.882974] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.833368207Z level=info msg="Migration successfully executed" id="Add is_disabled column to user" duration=439.606µs container-test-run-monitoring> machine1 # [879833.883374] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.833771972Z level=info msg="Executing migration" id="Add index user.login/user.email" container-test-run-monitoring> machine1 # [879833.884552] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.834951148Z level=info msg="Migration successfully executed" id="Add index user.login/user.email" duration=1.179896ms container-test-run-monitoring> machine1 # [879833.884989] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.835386754Z level=info msg="Executing migration" id="Add is_service_account column to user" container-test-run-monitoring> machine1 # [879833.885314] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.835712519Z level=info msg="Migration successfully executed" id="Add is_service_account column to user" duration=326.125µs container-test-run-monitoring> machine1 # [879833.885686] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.836083724Z level=info msg="Executing migration" id="Update is_service_account column to nullable" container-test-run-monitoring> machine1 # [879833.885966] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.836349807Z level=info msg="Migration successfully executed" id="Update is_service_account column to nullable" duration=263.763µs container-test-run-monitoring> machine1 # [879833.886477] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.836868254Z level=info msg="Executing migration" id="Add uid column to user" container-test-run-monitoring> machine1 # [879833.886689] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.837083017Z level=info msg="Migration successfully executed" id="Add uid column to user" duration=214.883µs container-test-run-monitoring> machine1 # [879833.887170] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.837561944Z level=info msg="Executing migration" id="Update uid column values for users" container-test-run-monitoring> machine1 # [879833.887613] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.83800439Z level=info msg="Migration successfully executed" id="Update uid column values for users" duration=442.486µs container-test-run-monitoring> machine1 # [879833.888104] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.838493797Z level=info msg="Executing migration" id="Make sure users uid are set" container-test-run-monitoring> machine1 # [879833.888297] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.838692479Z level=info msg="Migration successfully executed" id="Make sure users uid are set" duration=199.002µs container-test-run-monitoring> machine1 # [879833.888764] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.839156206Z level=info msg="Executing migration" id="Add unique index user_uid" container-test-run-monitoring> machine1 # [879833.889987] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.840378663Z level=info msg="Migration successfully executed" id="Add unique index user_uid" duration=1.222657ms container-test-run-monitoring> machine1 # [879833.890490] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.84088375Z level=info msg="Executing migration" id="Add is_provisioned column to user" container-test-run-monitoring> machine1 # [879833.890866] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.841260675Z level=info msg="Migration successfully executed" id="Add is_provisioned column to user" duration=377.085µs container-test-run-monitoring> machine1 # [879833.891316] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.841709801Z level=info msg="Executing migration" id="update login field with orgid to allow for multiple service accounts with same name across orgs" container-test-run-monitoring> machine1 # [879833.891842] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.842235688Z level=info msg="Migration successfully executed" id="update login field with orgid to allow for multiple service accounts with same name across orgs" duration=525.727µs container-test-run-monitoring> machine1 # [879833.892295] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.842688214Z level=info msg="Executing migration" id="update service accounts login field orgid to appear only once" container-test-run-monitoring> machine1 # [879833.892932] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.843326103Z level=info msg="Migration successfully executed" id="update service accounts login field orgid to appear only once" duration=638.049µs container-test-run-monitoring> machine1 # [879833.893383] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.843776229Z level=info msg="Executing migration" id="update login and email fields to lowercase" container-test-run-monitoring> machine1 # [879833.893880] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.844263516Z level=info msg="Migration successfully executed" id="update login and email fields to lowercase" duration=501.047µs container-test-run-monitoring> machine1 # [879833.894367] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.844757843Z level=info msg="Executing migration" id="update login and email fields to lowercase2" container-test-run-monitoring> machine1 # [879833.894596] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.844986846Z level=info msg="Migration successfully executed" id="update login and email fields to lowercase2" duration=229.083µs container-test-run-monitoring> machine1 # [879833.894994] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.845392491Z level=info msg="Executing migration" id="Add index on user.is_service_account and user.last_seen_at" container-test-run-monitoring> machine1 # [879833.896250] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.846646469Z level=info msg="Migration successfully executed" id="Add index on user.is_service_account and user.last_seen_at" duration=1.254098ms container-test-run-monitoring> machine1 # [879833.896744] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.847139035Z level=info msg="Executing migration" id="Expand user.uid length to 190" container-test-run-monitoring> machine1 # [879833.897295] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.847683963Z level=info msg="Migration successfully executed" id="Expand user.uid length to 190" duration=543.208µs container-test-run-monitoring> machine1 # [879833.897816] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.84820689Z level=info msg="Executing migration" id="Prefix SCIM uid for provisioned users" container-test-run-monitoring> machine1 # [879833.898231] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.848620936Z level=info msg="Migration successfully executed" id="Prefix SCIM uid for provisioned users" duration=413.206µs container-test-run-monitoring> machine1 # [879833.898736] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.849127183Z level=info msg="Executing migration" id="create temp user table v1-7" container-test-run-monitoring> machine1 # [879833.900870] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.851252892Z level=info msg="Migration successfully executed" id="create temp user table v1-7" duration=2.124749ms container-test-run-monitoring> machine1 # [879833.901509] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.851899141Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v1-7" container-test-run-monitoring> machine1 # [879833.902686] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.853075997Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v1-7" duration=1.190457ms container-test-run-monitoring> machine1 # [879833.903198] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.853589644Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v1-7" container-test-run-monitoring> machine1 # [879833.904433] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.854819541Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v1-7" duration=1.229777ms container-test-run-monitoring> machine1 # [879833.904968] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.855361588Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v1-7" container-test-run-monitoring> machine1 # [879833.906166] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.856552284Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v1-7" duration=1.190096ms container-test-run-monitoring> machine1 # [879833.906676] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.857069851Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v1-7" container-test-run-monitoring> machine1 # [879833.907797] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.858183627Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v1-7" duration=1.113056ms container-test-run-monitoring> machine1 # [879833.908329] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.858722514Z level=info msg="Executing migration" id="Update temp_user table charset" container-test-run-monitoring> machine1 # [879833.909771] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.860163734Z level=info msg="Migration successfully executed" id="Update temp_user table charset" duration=1.44142ms container-test-run-monitoring> machine1 # [879833.910339] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.860732702Z level=info msg="Executing migration" id="drop index IDX_temp_user_email - v1" container-test-run-monitoring> machine1 # [879833.911279] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.861667714Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_email - v1" duration=935.252µs container-test-run-monitoring> machine1 # [879833.911969] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.862363924Z level=info msg="Executing migration" id="drop index IDX_temp_user_org_id - v1" container-test-run-monitoring> machine1 # [879833.912942] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.863333017Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_org_id - v1" duration=968.893µs container-test-run-monitoring> machine1 # [879833.913591] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.863984826Z level=info msg="Executing migration" id="drop index IDX_temp_user_code - v1" container-test-run-monitoring> machine1 # [879833.914337] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.864735436Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_code - v1" duration=751.05µs container-test-run-monitoring> machine1 # [879833.915907] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.866305298Z level=info msg="Executing migration" id="drop index IDX_temp_user_status - v1" container-test-run-monitoring> machine1 # [879833.916826] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.86721071Z level=info msg="Migration successfully executed" id="drop index IDX_temp_user_status - v1" duration=904.652µs container-test-run-monitoring> machine1 # [879833.917567] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.867958281Z level=info msg="Executing migration" id="Rename table temp_user to temp_user_tmp_qwerty - v1" container-test-run-monitoring> machine1 # [879833.917794] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.868187044Z level=info msg="Migration successfully executed" id="Rename table temp_user to temp_user_tmp_qwerty - v1" duration=228.603µs container-test-run-monitoring> machine1 # [879833.918281] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.86867301Z level=info msg="Executing migration" id="create temp_user v2" container-test-run-monitoring> machine1 # [879833.920239] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.870624117Z level=info msg="Migration successfully executed" id="create temp_user v2" duration=1.950027ms container-test-run-monitoring> machine1 # [879833.920980] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.871370087Z level=info msg="Executing migration" id="create index IDX_temp_user_email - v2" container-test-run-monitoring> machine1 # [879833.922161] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.872549464Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_email - v2" duration=1.179577ms container-test-run-monitoring> machine1 # [879833.922698] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.873088831Z level=info msg="Executing migration" id="create index IDX_temp_user_org_id - v2" container-test-run-monitoring> machine1 # [879833.923792] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.874179566Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_org_id - v2" duration=1.078535ms container-test-run-monitoring> machine1 # [879833.924304] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.874695253Z level=info msg="Executing migration" id="create index IDX_temp_user_code - v2" container-test-run-monitoring> machine1 # [879833.925328] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.875716227Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_code - v2" duration=1.021454ms container-test-run-monitoring> machine1 # [879833.925813] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.876203714Z level=info msg="Executing migration" id="create index IDX_temp_user_status - v2" container-test-run-monitoring> machine1 # [879833.926841] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.877229808Z level=info msg="Migration successfully executed" id="create index IDX_temp_user_status - v2" duration=1.026494ms container-test-run-monitoring> machine1 # [879833.927329] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.877719174Z level=info msg="Executing migration" id="copy temp_user v1 to v2" container-test-run-monitoring> machine1 # [879833.927668] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.878058659Z level=info msg="Migration successfully executed" id="copy temp_user v1 to v2" duration=342.285µs container-test-run-monitoring> machine1 # [879833.928135] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.878525746Z level=info msg="Executing migration" id="drop temp_user_tmp_qwerty" container-test-run-monitoring> machine1 # [879833.928901] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.879290916Z level=info msg="Migration successfully executed" id="drop temp_user_tmp_qwerty" duration=764.69µs container-test-run-monitoring> machine1 # [879833.929752] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.880142128Z level=info msg="Executing migration" id="Set created for temp users that will otherwise prematurely expire" container-test-run-monitoring> machine1 # [879833.930340] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.880725816Z level=info msg="Migration successfully executed" id="Set created for temp users that will otherwise prematurely expire" duration=583.328µs container-test-run-monitoring> machine1 # [879833.930849] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.881240503Z level=info msg="Executing migration" id="create star table" container-test-run-monitoring> machine1 # [879833.932117] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.882403519Z level=info msg="Migration successfully executed" id="create star table" duration=1.163736ms container-test-run-monitoring> machine1 # [879833.932659] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.883044927Z level=info msg="Executing migration" id="add unique index star.user_id_dashboard_id" container-test-run-monitoring> machine1 # [879833.933906] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.884290945Z level=info msg="Migration successfully executed" id="add unique index star.user_id_dashboard_id" duration=1.244858ms container-test-run-monitoring> machine1 # [879833.934411] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.884807552Z level=info msg="Executing migration" id="Add column dashboard_uid in star" container-test-run-monitoring> machine1 # [879833.934590] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.884985474Z level=info msg="Migration successfully executed" id="Add column dashboard_uid in star" duration=178.002µs container-test-run-monitoring> machine1 # [879833.934995] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.88539072Z level=info msg="Executing migration" id="Add column org_id in star" container-test-run-monitoring> machine1 # [879833.935273] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.885664923Z level=info msg="Migration successfully executed" id="Add column org_id in star" duration=272.723µs container-test-run-monitoring> machine1 # [879833.936737] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.887127943Z level=info msg="Executing migration" id="Add column updated in star" container-test-run-monitoring> machine1 # [879833.936986] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.887380827Z level=info msg="Migration successfully executed" id="Add column updated in star" duration=253.644µs container-test-run-monitoring> machine1 # [879833.937417] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.887811353Z level=info msg="Executing migration" id="add index in star table on dashboard_uid, org_id and user_id columns" container-test-run-monitoring> machine1 # [879833.938712] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.889102451Z level=info msg="Migration successfully executed" id="add index in star table on dashboard_uid, org_id and user_id columns" duration=1.291098ms container-test-run-monitoring> machine1 # [879833.939225] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.889615738Z level=info msg="Executing migration" id="create org table v1" container-test-run-monitoring> machine1 # [879833.941148] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.891540164Z level=info msg="Migration successfully executed" id="create org table v1" duration=1.924746ms container-test-run-monitoring> machine1 # [879833.941676] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.892071731Z level=info msg="Executing migration" id="create index UQE_org_name - v1" container-test-run-monitoring> machine1 # [879833.942805] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.893198267Z level=info msg="Migration successfully executed" id="create index UQE_org_name - v1" duration=1.114655ms container-test-run-monitoring> machine1 # [879833.943282] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.893677713Z level=info msg="Executing migration" id="create org_user table v1" container-test-run-monitoring> machine1 # [879833.944526] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.89491957Z level=info msg="Migration successfully executed" id="create org_user table v1" duration=1.242177ms container-test-run-monitoring> machine1 # [879833.945018] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.895414737Z level=info msg="Executing migration" id="create index IDX_org_user_org_id - v1" container-test-run-monitoring> machine1 # [879833.946103] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.896492512Z level=info msg="Migration successfully executed" id="create index IDX_org_user_org_id - v1" duration=1.077615ms container-test-run-monitoring> machine1 # [879833.946552] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.896948638Z level=info msg="Executing migration" id="create index UQE_org_user_org_id_user_id - v1" container-test-run-monitoring> machine1 # [879833.947545] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.897939452Z level=info msg="Migration successfully executed" id="create index UQE_org_user_org_id_user_id - v1" duration=990.974µs container-test-run-monitoring> machine1 # [879833.947969] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.898368378Z level=info msg="Executing migration" id="create index IDX_org_user_user_id - v1" container-test-run-monitoring> machine1 # [879833.948918] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.89931331Z level=info msg="Migration successfully executed" id="create index IDX_org_user_user_id - v1" duration=944.452µs container-test-run-monitoring> machine1 # [879833.949334] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.899732676Z level=info msg="Executing migration" id="Update org table charset" container-test-run-monitoring> machine1 # [879833.950154] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.900551087Z level=info msg="Migration successfully executed" id="Update org table charset" duration=817.771µs container-test-run-monitoring> machine1 # [879833.950575] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.900973013Z level=info msg="Executing migration" id="Update org_user table charset" container-test-run-monitoring> machine1 # [879833.950828] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.901226617Z level=info msg="Migration successfully executed" id="Update org_user table charset" duration=253.764µs container-test-run-monitoring> machine1 # [879833.951213] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.901611262Z level=info msg="Executing migration" id="Migrate all Read Only Viewers to Viewers" container-test-run-monitoring> machine1 # [879833.951551] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.901948747Z level=info msg="Migration successfully executed" id="Migrate all Read Only Viewers to Viewers" duration=337.285µs container-test-run-monitoring> machine1 # [879833.951958] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.902356152Z level=info msg="Executing migration" id="create dashboard table" container-test-run-monitoring> machine1 # [879833.953599] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.903994975Z level=info msg="Migration successfully executed" id="create dashboard table" duration=1.638423ms container-test-run-monitoring> machine1 # [879833.955066] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.905450235Z level=info msg="Executing migration" id="add index dashboard.account_id" container-test-run-monitoring> machine1 # [879833.956217] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.906609011Z level=info msg="Migration successfully executed" id="add index dashboard.account_id" duration=1.157775ms container-test-run-monitoring> machine1 # [879833.956707] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.907100257Z level=info msg="Executing migration" id="add unique index dashboard_account_id_slug" container-test-run-monitoring> machine1 # [879833.957760] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.908152432Z level=info msg="Migration successfully executed" id="add unique index dashboard_account_id_slug" duration=1.052735ms container-test-run-monitoring> machine1 # [879833.958209] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.908604158Z level=info msg="Executing migration" id="create dashboard_tag table" container-test-run-monitoring> machine1 # [879833.959326] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.909716733Z level=info msg="Migration successfully executed" id="create dashboard_tag table" duration=1.111495ms container-test-run-monitoring> machine1 # [879833.959786] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.910182859Z level=info msg="Executing migration" id="add unique index dashboard_tag.dasboard_id_term" container-test-run-monitoring> machine1 # [879833.960854] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.911250834Z level=info msg="Migration successfully executed" id="add unique index dashboard_tag.dasboard_id_term" duration=1.067815ms container-test-run-monitoring> machine1 # [879833.961308] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.91170236Z level=info msg="Executing migration" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" container-test-run-monitoring> machine1 # [879833.962101] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.912492411Z level=info msg="Migration successfully executed" id="drop index UQE_dashboard_tag_dashboard_id_term - v1" duration=790.091µs container-test-run-monitoring> machine1 # [879833.962743] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.91313734Z level=info msg="Executing migration" id="Rename table dashboard to dashboard_v1 - v1" container-test-run-monitoring> machine1 # [879833.962967] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.913363063Z level=info msg="Migration successfully executed" id="Rename table dashboard to dashboard_v1 - v1" duration=225.843µs container-test-run-monitoring> machine1 # [879833.963402] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.913798429Z level=info msg="Executing migration" id="create dashboard v2" container-test-run-monitoring> machine1 # [879833.965061] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.915455172Z level=info msg="Migration successfully executed" id="create dashboard v2" duration=1.657423ms container-test-run-monitoring> machine1 # [879833.965575] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.915969539Z level=info msg="Executing migration" id="create index IDX_dashboard_org_id - v2" container-test-run-monitoring> machine1 # [879833.966622] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.917015833Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_org_id - v2" duration=1.046414ms container-test-run-monitoring> machine1 # [879833.967074] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.917468959Z level=info msg="Executing migration" id="create index UQE_dashboard_org_id_slug - v2" container-test-run-monitoring> machine1 # [879833.968149] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.918543134Z level=info msg="Migration successfully executed" id="create index UQE_dashboard_org_id_slug - v2" duration=1.074135ms container-test-run-monitoring> machine1 # [879833.968622] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.919017741Z level=info msg="Executing migration" id="copy dashboard v1 to v2" container-test-run-monitoring> machine1 # [879833.968970] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.919365465Z level=info msg="Migration successfully executed" id="copy dashboard v1 to v2" duration=347.724µs container-test-run-monitoring> machine1 # [879833.969398] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.919793591Z level=info msg="Executing migration" id="drop table dashboard_v1" container-test-run-monitoring> machine1 # [879833.970158] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.920553722Z level=info msg="Migration successfully executed" id="drop table dashboard_v1" duration=759.851µs container-test-run-monitoring> machine1 # [879833.970980] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.921377293Z level=info msg="Executing migration" id="alter dashboard.data to mediumtext v1" container-test-run-monitoring> machine1 # [879833.971001] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.921395213Z level=info msg="Migration successfully executed" id="alter dashboard.data to mediumtext v1" duration=18.28µs container-test-run-monitoring> machine1 # [879833.971441] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.921833939Z level=info msg="Executing migration" id="Add column updated_by in dashboard - v2" container-test-run-monitoring> machine1 # [879833.971612] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.922010102Z level=info msg="Migration successfully executed" id="Add column updated_by in dashboard - v2" duration=176.403µs container-test-run-monitoring> machine1 # [879833.971987] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.922386587Z level=info msg="Executing migration" id="Add column created_by in dashboard - v2" container-test-run-monitoring> machine1 # [879833.972492] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.922884234Z level=info msg="Migration successfully executed" id="Add column created_by in dashboard - v2" duration=496.927µs container-test-run-monitoring> machine1 # [879833.973030] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.923420081Z level=info msg="Executing migration" id="Add column gnetId in dashboard" container-test-run-monitoring> machine1 # [879833.973252] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.923645884Z level=info msg="Migration successfully executed" id="Add column gnetId in dashboard" duration=226.043µs container-test-run-monitoring> machine1 # [879833.973743] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.924138171Z level=info msg="Executing migration" id="Add index for gnetId in dashboard" container-test-run-monitoring> machine1 # [879833.974977] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.925370628Z level=info msg="Migration successfully executed" id="Add index for gnetId in dashboard" duration=1.229017ms container-test-run-monitoring> machine1 # [879833.975471] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.925865914Z level=info msg="Executing migration" id="Add column plugin_id in dashboard" container-test-run-monitoring> machine1 # [879833.975683] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.926076037Z level=info msg="Migration successfully executed" id="Add column plugin_id in dashboard" duration=209.803µs container-test-run-monitoring> machine1 # [879833.976218] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.926609605Z level=info msg="Executing migration" id="Add index for plugin_id in dashboard" container-test-run-monitoring> machine1 # [879833.977697] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.928088825Z level=info msg="Migration successfully executed" id="Add index for plugin_id in dashboard" duration=1.47946ms container-test-run-monitoring> machine1 # [879833.978218] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.928611712Z level=info msg="Executing migration" id="Add index for dashboard_id in dashboard_tag" container-test-run-monitoring> machine1 # [879833.979357] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.929751168Z level=info msg="Migration successfully executed" id="Add index for dashboard_id in dashboard_tag" duration=1.137656ms container-test-run-monitoring> machine1 # [879833.980204] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.930592299Z level=info msg="Executing migration" id="Update dashboard table charset" container-test-run-monitoring> machine1 # [879833.981416] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.931804996Z level=info msg="Migration successfully executed" id="Update dashboard table charset" duration=1.212377ms container-test-run-monitoring> machine1 # [879833.981947] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.932339843Z level=info msg="Executing migration" id="Update dashboard_tag table charset" container-test-run-monitoring> machine1 # [879833.982229] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.932626447Z level=info msg="Migration successfully executed" id="Update dashboard_tag table charset" duration=287.004µs container-test-run-monitoring> machine1 # [879833.982670] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.933067293Z level=info msg="Executing migration" id="Add column folder_id in dashboard" container-test-run-monitoring> machine1 # [879833.983086] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.933478859Z level=info msg="Migration successfully executed" id="Add column folder_id in dashboard" duration=410.326µs container-test-run-monitoring> machine1 # [879833.983560] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.933952625Z level=info msg="Executing migration" id="Add column isFolder in dashboard" container-test-run-monitoring> machine1 # [879833.983902] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.93429871Z level=info msg="Migration successfully executed" id="Add column isFolder in dashboard" duration=346.645µs container-test-run-monitoring> machine1 # [879833.984428] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.934821197Z level=info msg="Executing migration" id="Add column has_acl in dashboard" container-test-run-monitoring> machine1 # [879833.984812] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.935202562Z level=info msg="Migration successfully executed" id="Add column has_acl in dashboard" duration=380.325µs container-test-run-monitoring> machine1 # [879833.985290] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.935682249Z level=info msg="Executing migration" id="Add column uid in dashboard" container-test-run-monitoring> machine1 # [879833.985487] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.935885012Z level=info msg="Migration successfully executed" id="Add column uid in dashboard" duration=203.643µs container-test-run-monitoring> machine1 # [879833.986021] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.936413179Z level=info msg="Executing migration" id="Update uid column values in dashboard" container-test-run-monitoring> machine1 # [879833.986490] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.936888066Z level=info msg="Migration successfully executed" id="Update uid column values in dashboard" duration=488.407µs container-test-run-monitoring> machine1 # [879833.987016] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.937414673Z level=info msg="Executing migration" id="Add unique index dashboard_org_id_uid" container-test-run-monitoring> machine1 # [879833.988401] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.938790812Z level=info msg="Migration successfully executed" id="Add unique index dashboard_org_id_uid" duration=1.375459ms container-test-run-monitoring> machine1 # [879833.988960] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.939357419Z level=info msg="Executing migration" id="Remove unique index org_id_slug" container-test-run-monitoring> machine1 # [879833.989924] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.940299032Z level=info msg="Migration successfully executed" id="Remove unique index org_id_slug" duration=940.933µs container-test-run-monitoring> machine1 # [879833.990633] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.941028842Z level=info msg="Executing migration" id="Update dashboard title length" container-test-run-monitoring> machine1 # [879833.993185] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.943580837Z level=info msg="Migration successfully executed" id="Update dashboard title length" duration=2.551755ms container-test-run-monitoring> machine1 # [879833.994253] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.944647692Z level=info msg="Executing migration" id="Add unique index for dashboard_org_id_title_folder_id" container-test-run-monitoring> machine1 # [879833.995554] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.94594463Z level=info msg="Migration successfully executed" id="Add unique index for dashboard_org_id_title_folder_id" duration=1.297058ms container-test-run-monitoring> machine1 # [879833.996062] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.946453037Z level=info msg="Executing migration" id="create dashboard_provisioning" container-test-run-monitoring> machine1 # [879833.997725] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.94812342Z level=info msg="Migration successfully executed" id="create dashboard_provisioning" duration=1.670663ms container-test-run-monitoring> machine1 # [879833.998289] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.948684627Z level=info msg="Executing migration" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" container-test-run-monitoring> machine1 # [879833.998504] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.94889239Z level=info msg="Migration successfully executed" id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" duration=206.163µs container-test-run-monitoring> machine1 # [879833.999061] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.949449958Z level=info msg="Executing migration" id="create dashboard_provisioning v2" container-test-run-monitoring> machine1 # [879834.000941] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.951335904Z level=info msg="Migration successfully executed" id="create dashboard_provisioning v2" duration=1.886786ms container-test-run-monitoring> machine1 # [879834.001546] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.951940712Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id - v2" container-test-run-monitoring> machine1 # [879834.002800] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.953196609Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id - v2" duration=1.263897ms container-test-run-monitoring> machine1 # [879834.003268] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.953666936Z level=info msg="Executing migration" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" container-test-run-monitoring> machine1 # [879834.004366] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.954764031Z level=info msg="Migration successfully executed" id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" duration=1.096255ms container-test-run-monitoring> machine1 # [879834.004880] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.955272998Z level=info msg="Executing migration" id="copy dashboard_provisioning v1 to v2" container-test-run-monitoring> machine1 # [879834.005167] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.955564002Z level=info msg="Migration successfully executed" id="copy dashboard_provisioning v1 to v2" duration=291.444µs container-test-run-monitoring> machine1 # [879834.005575] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.955973167Z level=info msg="Executing migration" id="drop dashboard_provisioning_tmp_qwerty" container-test-run-monitoring> machine1 # [879834.006179] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.956576575Z level=info msg="Migration successfully executed" id="drop dashboard_provisioning_tmp_qwerty" duration=591.728µs container-test-run-monitoring> machine1 # [879834.006945] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.957343866Z level=info msg="Executing migration" id="Add check_sum column" container-test-run-monitoring> machine1 # [879834.007114] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.957513228Z level=info msg="Migration successfully executed" id="Add check_sum column" duration=169.522µs container-test-run-monitoring> machine1 # [879834.007526] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.957924394Z level=info msg="Executing migration" id="Add index for dashboard_title" container-test-run-monitoring> machine1 # [879834.008709] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.95910705Z level=info msg="Migration successfully executed" id="Add index for dashboard_title" duration=1.183336ms container-test-run-monitoring> machine1 # [879834.009121] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.959518816Z level=info msg="Executing migration" id="delete tags for deleted dashboards" container-test-run-monitoring> machine1 # [879834.009738] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.960136824Z level=info msg="Migration successfully executed" id="delete tags for deleted dashboards" duration=618.168µs container-test-run-monitoring> machine1 # [879834.010137] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.96053443Z level=info msg="Executing migration" id="delete stars for deleted dashboards" container-test-run-monitoring> machine1 # [879834.010515] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.960913435Z level=info msg="Migration successfully executed" id="delete stars for deleted dashboards" duration=379.085µs container-test-run-monitoring> machine1 # [879834.010918] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.9613162Z level=info msg="Executing migration" id="Add index for dashboard_is_folder" container-test-run-monitoring> machine1 # [879834.012080] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.962464496Z level=info msg="Migration successfully executed" id="Add index for dashboard_is_folder" duration=1.147736ms container-test-run-monitoring> machine1 # [879834.012474] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.962872702Z level=info msg="Executing migration" id="Add isPublic for dashboard" container-test-run-monitoring> machine1 # [879834.012883] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.963276987Z level=info msg="Migration successfully executed" id="Add isPublic for dashboard" duration=403.605µs container-test-run-monitoring> machine1 # [879834.013398] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.963788834Z level=info msg="Executing migration" id="Add deleted for dashboard" container-test-run-monitoring> machine1 # [879834.013617] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.964014157Z level=info msg="Migration successfully executed" id="Add deleted for dashboard" duration=218.523µs container-test-run-monitoring> machine1 # [879834.014047] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.964443923Z level=info msg="Executing migration" id="Add index for deleted" container-test-run-monitoring> machine1 # [879834.015243] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.96563114Z level=info msg="Migration successfully executed" id="Add index for deleted" duration=1.185537ms container-test-run-monitoring> machine1 # [879834.015770] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.966161027Z level=info msg="Executing migration" id="Add column dashboard_uid in dashboard_tag" container-test-run-monitoring> machine1 # [879834.015962] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.96636087Z level=info msg="Migration successfully executed" id="Add column dashboard_uid in dashboard_tag" duration=199.963µs container-test-run-monitoring> machine1 # [879834.016473] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.966866877Z level=info msg="Executing migration" id="Add column org_id in dashboard_tag" container-test-run-monitoring> machine1 # [879834.016796] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.967193081Z level=info msg="Migration successfully executed" id="Add column org_id in dashboard_tag" duration=326.605µs container-test-run-monitoring> machine1 # [879834.017239] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.967636847Z level=info msg="Executing migration" id="Add missing dashboard_uid and org_id to dashboard_tag" container-test-run-monitoring> machine1 # [879834.017961] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.968345377Z level=info msg="Migration successfully executed" id="Add missing dashboard_uid and org_id to dashboard_tag" duration=707.41µs container-test-run-monitoring> machine1 # [879834.018433] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.968830303Z level=info msg="Executing migration" id="Add apiVersion for dashboard" container-test-run-monitoring> machine1 # [879834.018631] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.969024866Z level=info msg="Migration successfully executed" id="Add apiVersion for dashboard" duration=193.803µs container-test-run-monitoring> machine1 # [879834.019110] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.969500913Z level=info msg="Executing migration" id="Add index for dashboard_uid on dashboard_tag table" container-test-run-monitoring> machine1 # [879834.020273] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.970667849Z level=info msg="Migration successfully executed" id="Add index for dashboard_uid on dashboard_tag table" duration=1.166936ms container-test-run-monitoring> machine1 # [879834.020797] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.971192296Z level=info msg="Executing migration" id="Add missing dashboard_uid and org_id to star" container-test-run-monitoring> machine1 # [879834.021222] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.971619982Z level=info msg="Migration successfully executed" id="Add missing dashboard_uid and org_id to star" duration=435.926µs container-test-run-monitoring> machine1 # [879834.023098] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.973489527Z level=info msg="Executing migration" id="create data_source table" container-test-run-monitoring> machine1 # [879834.025131] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.975521235Z level=info msg="Migration successfully executed" id="create data_source table" duration=2.030828ms container-test-run-monitoring> machine1 # [879834.025716] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.976110963Z level=info msg="Executing migration" id="add index data_source.account_id" container-test-run-monitoring> machine1 # [879834.026884] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.977280579Z level=info msg="Migration successfully executed" id="add index data_source.account_id" duration=1.168096ms container-test-run-monitoring> machine1 # [879834.027325] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.977723425Z level=info msg="Executing migration" id="add unique index data_source.account_id_name" container-test-run-monitoring> machine1 # [879834.028456] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.978853401Z level=info msg="Migration successfully executed" id="add unique index data_source.account_id_name" duration=1.129376ms container-test-run-monitoring> machine1 # [879834.028891] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.979288007Z level=info msg="Executing migration" id="drop index IDX_data_source_account_id - v1" container-test-run-monitoring> machine1 # [879834.029750] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.980138818Z level=info msg="Migration successfully executed" id="drop index IDX_data_source_account_id - v1" duration=848.531µs container-test-run-monitoring> machine1 # [879834.030454] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.980844788Z level=info msg="Executing migration" id="drop index UQE_data_source_account_id_name - v1" container-test-run-monitoring> machine1 # [879834.031323] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.98171424Z level=info msg="Migration successfully executed" id="drop index UQE_data_source_account_id_name - v1" duration=868.212µs container-test-run-monitoring> machine1 # [879834.032041] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.982402929Z level=info msg="Executing migration" id="Rename table data_source to data_source_v1 - v1" container-test-run-monitoring> machine1 # [879834.032266] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.982659053Z level=info msg="Migration successfully executed" id="Rename table data_source to data_source_v1 - v1" duration=255.604µs container-test-run-monitoring> machine1 # [879834.032755] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.98315114Z level=info msg="Executing migration" id="create data_source table v2" container-test-run-monitoring> machine1 # [879834.037447] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.987838124Z level=info msg="Migration successfully executed" id="create data_source table v2" duration=4.687224ms container-test-run-monitoring> machine1 # [879834.038086] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.988480533Z level=info msg="Executing migration" id="create index IDX_data_source_org_id - v2" container-test-run-monitoring> machine1 # [879834.039349] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.98973519Z level=info msg="Migration successfully executed" id="create index IDX_data_source_org_id - v2" duration=1.252697ms container-test-run-monitoring> machine1 # [879834.039873] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.990264157Z level=info msg="Executing migration" id="create index UQE_data_source_org_id_name - v2" container-test-run-monitoring> machine1 # [879834.041171] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.991548135Z level=info msg="Migration successfully executed" id="create index UQE_data_source_org_id_name - v2" duration=1.282258ms container-test-run-monitoring> machine1 # [879834.041800] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.992192864Z level=info msg="Executing migration" id="Drop old table data_source_v1 #2" container-test-run-monitoring> machine1 # [879834.042598] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.992995195Z level=info msg="Migration successfully executed" id="Drop old table data_source_v1 #2" duration=802.331µs container-test-run-monitoring> machine1 # [879834.043509] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.993902367Z level=info msg="Executing migration" id="Add column with_credentials" container-test-run-monitoring> machine1 # [879834.043936] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.994329213Z level=info msg="Migration successfully executed" id="Add column with_credentials" duration=426.086µs container-test-run-monitoring> machine1 # [879834.044452] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.99484614Z level=info msg="Executing migration" id="Add secure json data column" container-test-run-monitoring> machine1 # [879834.044646] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.995043983Z level=info msg="Migration successfully executed" id="Add secure json data column" duration=197.843µs container-test-run-monitoring> machine1 # [879834.045107] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.995502069Z level=info msg="Executing migration" id="Update data_source table charset" container-test-run-monitoring> machine1 # [879834.046520] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.996913768Z level=info msg="Migration successfully executed" id="Update data_source table charset" duration=1.411419ms container-test-run-monitoring> machine1 # [879834.047031] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.997427695Z level=info msg="Executing migration" id="Update initial version to 1" container-test-run-monitoring> machine1 # [879834.047435] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.997828381Z level=info msg="Migration successfully executed" id="Update initial version to 1" duration=400.126µs container-test-run-monitoring> machine1 # [879834.047889] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.998284827Z level=info msg="Executing migration" id="Add read_only data column" container-test-run-monitoring> machine1 # [879834.048116] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.99849487Z level=info msg="Migration successfully executed" id="Add read_only data column" duration=209.763µs container-test-run-monitoring> machine1 # [879834.048584] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.998974437Z level=info msg="Executing migration" id="Migrate logging ds to loki ds" container-test-run-monitoring> machine1 # [879834.048886] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.999279321Z level=info msg="Migration successfully executed" id="Migrate logging ds to loki ds" duration=293.204µs container-test-run-monitoring> machine1 # [879834.049324] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.999719727Z level=info msg="Executing migration" id="Update json_data with nulls" container-test-run-monitoring> machine1 # [879834.049467] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:18.999863929Z level=info msg="Migration successfully executed" id="Update json_data with nulls" duration=136.002µs container-test-run-monitoring> machine1 # [879834.049848] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.000244494Z level=info msg="Executing migration" id="Add uid column" container-test-run-monitoring> machine1 # [879834.050314] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.00070886Z level=info msg="Migration successfully executed" id="Add uid column" duration=463.566µs container-test-run-monitoring> machine1 # [879834.050806] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.001197147Z level=info msg="Executing migration" id="Update uid value" container-test-run-monitoring> machine1 # [879834.051057] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.001453631Z level=info msg="Migration successfully executed" id="Update uid value" duration=258.204µs container-test-run-monitoring> machine1 # [879834.051533] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.001925477Z level=info msg="Executing migration" id="Add unique index datasource_org_id_uid" container-test-run-monitoring> machine1 # [879834.052931] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.003319176Z level=info msg="Migration successfully executed" id="Add unique index datasource_org_id_uid" duration=1.392659ms container-test-run-monitoring> machine1 # [879834.053450] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.003842583Z level=info msg="Executing migration" id="add unique index datasource_org_id_is_default" container-test-run-monitoring> machine1 # [879834.054713] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.005101481Z level=info msg="Migration successfully executed" id="add unique index datasource_org_id_is_default" duration=1.257698ms container-test-run-monitoring> machine1 # [879834.055237] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.005629408Z level=info msg="Executing migration" id="Add is_prunable column" container-test-run-monitoring> machine1 # [879834.055689] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.006082054Z level=info msg="Migration successfully executed" id="Add is_prunable column" duration=451.166µs container-test-run-monitoring> machine1 # [879834.056247] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.006637862Z level=info msg="Executing migration" id="Add api_version column" container-test-run-monitoring> machine1 # [879834.056487] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.006874505Z level=info msg="Migration successfully executed" id="Add api_version column" duration=238.323µs container-test-run-monitoring> machine1 # [879834.056910] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.007307631Z level=info msg="Executing migration" id="Update secure_json_data column to MediumText" container-test-run-monitoring> machine1 # [879834.056933] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.007323151Z level=info msg="Migration successfully executed" id="Update secure_json_data column to MediumText" duration=16.04µs container-test-run-monitoring> machine1 # [879834.057340] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.007731837Z level=info msg="Executing migration" id="Update json_data column to MediumText" container-test-run-monitoring> machine1 # [879834.057361] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.007756197Z level=info msg="Migration successfully executed" id="Update json_data column to MediumText" duration=25.6µs container-test-run-monitoring> machine1 # [879834.057793] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.008189483Z level=info msg="Executing migration" id="create api_key table" container-test-run-monitoring> machine1 # [879834.059643] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.010041148Z level=info msg="Migration successfully executed" id="create api_key table" duration=1.851905ms container-test-run-monitoring> machine1 # [879834.060299] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.010690917Z level=info msg="Executing migration" id="add index api_key.account_id" container-test-run-monitoring> machine1 # [879834.061502] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.011890574Z level=info msg="Migration successfully executed" id="add index api_key.account_id" duration=1.198777ms container-test-run-monitoring> machine1 # [879834.062068] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.012460182Z level=info msg="Executing migration" id="add index api_key.key" container-test-run-monitoring> machine1 # [879834.063284] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.013672878Z level=info msg="Migration successfully executed" id="add index api_key.key" duration=1.210977ms container-test-run-monitoring> machine1 # [879834.063836] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.014227726Z level=info msg="Executing migration" id="add index api_key.account_id_name" container-test-run-monitoring> machine1 # [879834.064986] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.015382782Z level=info msg="Migration successfully executed" id="add index api_key.account_id_name" duration=1.155136ms container-test-run-monitoring> machine1 # [879834.065497] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.015876828Z level=info msg="Executing migration" id="drop index IDX_api_key_account_id - v1" container-test-run-monitoring> machine1 # [879834.066400] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.016789321Z level=info msg="Migration successfully executed" id="drop index IDX_api_key_account_id - v1" duration=912.053µs container-test-run-monitoring> machine1 # [879834.067054] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.01744549Z level=info msg="Executing migration" id="drop index UQE_api_key_key - v1" container-test-run-monitoring> machine1 # [879834.067913] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.018307902Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_key - v1" duration=862.812µs container-test-run-monitoring> machine1 # [879834.068615] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.019006711Z level=info msg="Executing migration" id="drop index UQE_api_key_account_id_name - v1" container-test-run-monitoring> machine1 # [879834.069477] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.019873203Z level=info msg="Migration successfully executed" id="drop index UQE_api_key_account_id_name - v1" duration=866.292µs container-test-run-monitoring> machine1 # [879834.070119] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.020514692Z level=info msg="Executing migration" id="Rename table api_key to api_key_v1 - v1" container-test-run-monitoring> machine1 # [879834.070593] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.020990538Z level=info msg="Migration successfully executed" id="Rename table api_key to api_key_v1 - v1" duration=476.726µs container-test-run-monitoring> machine1 # [879834.071164] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.021554706Z level=info msg="Executing migration" id="create api_key table v2" container-test-run-monitoring> machine1 # [879834.073103] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.023489733Z level=info msg="Migration successfully executed" id="create api_key table v2" duration=1.933947ms container-test-run-monitoring> machine1 # [879834.073805] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.024197822Z level=info msg="Executing migration" id="create index IDX_api_key_org_id - v2" container-test-run-monitoring> machine1 # [879834.075096] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.02548764Z level=info msg="Migration successfully executed" id="create index IDX_api_key_org_id - v2" duration=1.289138ms container-test-run-monitoring> machine1 # [879834.075628] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.026021047Z level=info msg="Executing migration" id="create index UQE_api_key_key - v2" container-test-run-monitoring> machine1 # [879834.076830] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.027221144Z level=info msg="Migration successfully executed" id="create index UQE_api_key_key - v2" duration=1.185257ms container-test-run-monitoring> machine1 # [879834.077342] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.027735751Z level=info msg="Executing migration" id="create index UQE_api_key_org_id_name - v2" container-test-run-monitoring> machine1 # [879834.078512] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.028904167Z level=info msg="Migration successfully executed" id="create index UQE_api_key_org_id_name - v2" duration=1.167056ms container-test-run-monitoring> machine1 # [879834.079057] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.029449734Z level=info msg="Executing migration" id="copy api_key v1 to v2" container-test-run-monitoring> machine1 # [879834.079389] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.029782339Z level=info msg="Migration successfully executed" id="copy api_key v1 to v2" duration=331.925µs container-test-run-monitoring> machine1 # [879834.079878] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.030268946Z level=info msg="Executing migration" id="Drop old table api_key_v1" container-test-run-monitoring> machine1 # [879834.080619] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.031011596Z level=info msg="Migration successfully executed" id="Drop old table api_key_v1" duration=741.89µs container-test-run-monitoring> machine1 # [879834.081577] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.031969769Z level=info msg="Executing migration" id="Update api_key table charset" container-test-run-monitoring> machine1 # [879834.082655] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.033050944Z level=info msg="Migration successfully executed" id="Update api_key table charset" duration=1.081575ms container-test-run-monitoring> machine1 # [879834.083214] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.033607231Z level=info msg="Executing migration" id="Add expires to api_key table" container-test-run-monitoring> machine1 # [879834.083446] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.033840115Z level=info msg="Migration successfully executed" id="Add expires to api_key table" duration=217.443µs container-test-run-monitoring> machine1 # [879834.084082] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.034402602Z level=info msg="Executing migration" id="Add service account foreign key" container-test-run-monitoring> machine1 # [879834.084260] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.034654046Z level=info msg="Migration successfully executed" id="Add service account foreign key" duration=251.044µs container-test-run-monitoring> machine1 # [879834.084779] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.035171253Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" container-test-run-monitoring> machine1 # [879834.085212] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.035603459Z level=info msg="Migration successfully executed" id="set service account foreign key to nil if 0" duration=431.406µs container-test-run-monitoring> machine1 # [879834.085718] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.036109946Z level=info msg="Executing migration" id="Add last_used_at to api_key table" container-test-run-monitoring> machine1 # [879834.085919] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.036313028Z level=info msg="Migration successfully executed" id="Add last_used_at to api_key table" duration=203.042µs container-test-run-monitoring> machine1 # [879834.086442] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.036835116Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" container-test-run-monitoring> machine1 # [879834.086749] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.03714392Z level=info msg="Migration successfully executed" id="Add is_revoked column to api_key table" duration=308.204µs container-test-run-monitoring> machine1 # [879834.087307] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.037701008Z level=info msg="Executing migration" id="create dashboard_snapshot table v4" container-test-run-monitoring> machine1 # [879834.089145] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.039531953Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v4" duration=1.825025ms container-test-run-monitoring> machine1 # [879834.089764] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.040128361Z level=info msg="Executing migration" id="drop table dashboard_snapshot_v4 #1" container-test-run-monitoring> machine1 # [879834.090365] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.040762409Z level=info msg="Migration successfully executed" id="drop table dashboard_snapshot_v4 #1" duration=633.848µs container-test-run-monitoring> machine1 # [879834.091200] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.041596701Z level=info msg="Executing migration" id="create dashboard_snapshot table v5 #2" container-test-run-monitoring> test script finished in 13.46s container-test-run-monitoring> cleanup container-test-run-monitoring> kill NspawnMachine (pid 52) container-test-run-monitoring> machine1 # [879834.093159] machine1 grafana[446]: logger=migrator t=2026-11-13T10:12:19.043554968Z level=info msg="Migration successfully executed" id="create dashboard_snapshot table v5 #2" duration=1.936426ms container-test-run-monitoring> kill NspawnMachine (pid 53) container-test-run-monitoring> Container machine1 terminated by signal KILL. container-test-run-monitoring> Container machine2 terminated by signal KILL. container-test-run-monitoring> (finished: cleanup, in 0.38 seconds)