tests: dom0 update via qubes-vm-update by marmarek · Pull Request #861 · QubesOS/qubes-core-admin

marmarek · 2026-08-03T01:12:08Z

No description provided.

codecov · 2026-08-03T01:25:37Z

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.42%. Comparing base (35d28d3) to head (f0ef90c).

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #861      +/-   ##
==========================================
- Coverage   70.44%   70.42%   -0.03%     
==========================================
  Files          61       61              
  Lines       14165    14165              
==========================================
- Hits         9979     9976       -3     
- Misses       4186     4189       +3

Flag	Coverage Δ
unittests	`70.42% <ø> (-0.03%)`	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

qubesos-bot · 2026-08-03T09:18:11Z

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=202608040214-devel&flavor=pull-requests

Test run included the following:

tests: dom0 update via qubes-vm-update #861 (f0ef90c)

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026050504-devel&flavor=update

system_tests_network_updates
- TC_00_Dom0Upgrade_whonix-gateway-18: test_000_update_qubes_vm_update (failure)
  ~~~~~~~~~^^^^^^^^^^^^^^^^^^... AssertionError: qubes-vm-update failed:
- VmUpdates_fedora-44-xfce: test_011_pkcon_via_proxy (failure)
  AssertionError: 7 not found in [0, 100] : pkcon install -y test-pkg...

Failed tests

2 failures

system_tests_network_updates
- TC_00_Dom0Upgrade_whonix-gateway-18: test_000_update_qubes_vm_update (failure)
  ~~~~~~~~~^^^^^^^^^^^^^^^^^^... AssertionError: qubes-vm-update failed:
- VmUpdates_fedora-44-xfce: test_011_pkcon_via_proxy (failure)
  AssertionError: 7 not found in [0, 100] : pkcon install -y test-pkg...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/176874#dependencies

15 fixed

system_tests_pvgrub_salt_storage
- system_tests: Fail (unknown)
  Tests qubes.tests.integ.grub failed (exit code 1), details reported...
- system_tests: Failed (test died)
  # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
- TC_41_HVMGrub_debian-13-xfce: test_000_standalone_vm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_41_HVMGrub_debian-13-xfce: test_001_standalone_vm_dracut (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_41_HVMGrub_debian-13-xfce: test_010_template_based_vm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_41_HVMGrub_debian-13-xfce: test_011_template_based_vm_dracut (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_41_HVMGrub_fedora-43-xfce: test_010_template_based_vm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
system_tests_audio
- system_tests: Fail (unknown)
  Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
- system_tests: Failed (test died)
  # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
- TC_20_AudioVM_Pulse_debian-13-xfce: test_252_audio_playback_audiovm_switch_hvm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_fedora-43-xfce: test_252_audio_playback_audiovm_switch_hvm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_whonix-workstation-18: test_223_audio_play_hvm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_whonix-workstation-18: test_225_audio_rec_unmuted_hvm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_Pulse_whonix-workstation-18: test_252_audio_playback_audiovm_switch_hvm (error)
  qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
- TC_20_AudioVM_PipeWire_debian-13-xfce: test_251_audio_playback_audiovm_pipewire_late_start (failure)
  AssertionError: pacat for test-inst-vm1 (xid 48) running(False) in ...

Unstable tests

Details

system_tests_pvgrub_salt_storage
system_tests/Fail (1/5 times with errors)
- job 188967 Tests qubes.tests.integ.grub failed (exit code 1), details reported...
system_tests/Fail (1/5 times with errors)
- job 188967 Tests qubes.tests.integ.salt failed (exit code 1), details reported...
system_tests/Fail (1/5 times with errors)
- job 188967 Tests qubes.tests.integ.storage failed (exit code 1), details repor...
system_tests/Failed (1/5 times with errors)
- job 190298 # Test died: command 'curl --form upload=@nose2-junit.xml --form up...
system_tests/Failed (1/5 times with errors)
- job 188967 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
TC_41_HVMGrub_debian-13-xfce/test_000_standalone_vm (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_41_HVMGrub_fedora-43-xfce/test_000_standalone_vm (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
StorageReflinkOnExt4/test_000_volatile (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_10_VMSalt_fedora-43-xfce/test_001_multi_state_highstate (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_41_HVMGrub_debian-13-xfce/test_001_standalone_vm_dracut (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_41_HVMGrub_debian-13-xfce/test_010_template_based_vm (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_41_HVMGrub_fedora-43-xfce/test_010_template_based_vm (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_41_HVMGrub_debian-13-xfce/test_011_template_based_vm_dracut (1/5 times with errors)
- job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
system_tests_network_updates
TC_00_Dom0Upgrade_whonix-gateway-18/test_000_update (1/5 times with errors)
- job 189379 Error: Failed to download metadata for repo 'test': Cannot download...
TC_00_Dom0Upgrade_whonix-gateway-18/test_000_update_salt (2/5 times with errors)
- job 190297 ?[0;31mDuration: 140907.985 ms?[0;0m... ?[0;31m Changes: ?[0;0m
- job 190312 ?[0;31mDuration: 135117.105 ms?[0;0m... ?[0;31m Changes: ?[0;0m
TC_00_Dom0Upgrade_whonix-gateway-18/test_001_update_check (4/5 times with errors)
- job 188966 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
- job 189164 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
- job 190297 ^... AssertionError: '' is not true
- job 190312 ^... AssertionError: '' is not true
TC_00_Dom0Upgrade_whonix-gateway-18/test_006_update_flag_clear (1/5 times with errors)
- job 188966 Error: Failed to download metadata for repo 'test': Cannot download...
TC_00_Dom0Upgrade_whonix-gateway-18/test_030_install_unsigned (1/5 times with errors)
- job 189379 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
system_tests/wait_serial (1/5 times with errors)
- job 188966 # Command: curl --form upload=@/var/log/libvirt/libxl/libxl-driver....
system_tests_audio
system_tests/Fail (2/5 times with errors)
- job 188639 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
- job 189136 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
system_tests/Failed (2/5 times with errors)
- job 188639 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
- job 189136 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
TC_20_AudioVM_Pulse_fedora-43-xfce/test_223_audio_play_hvm (1/5 times with errors)
- job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_20_AudioVM_Pulse_fedora-43-xfce/test_224_audio_rec_muted_hvm (1/5 times with errors)
- job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_20_AudioVM_Pulse_whonix-workstation-18/test_224_audio_rec_muted_hvm (1/5 times with errors)
- job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
TC_20_AudioVM_Pulse_whonix-workstation-18/test_225_audio_rec_unmuted_hvm (1/5 times with errors)
- job 188639 AssertionError: too short audio, expected 10s, got 6.83272108843537...
TC_20_AudioVM_PipeWire_whonix-workstation-18/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)
- job 189136 AssertionError: too short audio, expected 10s, got 9.09505668934240...
TC_20_AudioVM_Pulse_fedora-43-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)
- job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

Performance Tests

Performance degradation:

No issues

Remaining performance tests:

No remaining performance tests

Timing precision is not great in nested virt. This test usually fails with error like "too short audio, expected 10s, got 7.768299319727891". The test is already running also on real hardware, and there it's more reliable, but keep running it on nested virt, as it's more flexible scheduling-wise.

I missed one of the grub tests. Fixes: 7448ed2 "tests: reduce maxmem of HVM when running in nested virt"

marmarek · 2026-08-04T02:07:16Z

openQArun TEST=system_tests_audio,system_tests_pvgrub_salt_storage,system_tests_network_updates MACHINE=64bit

tests: dom0 update via qubes-vm-update

66de564

marmarek added the openqa-pending label Aug 3, 2026

qubesos-qa Bot temporarily deployed to qa August 3, 2026 03:31 Inactive

marmarek added 2 commits August 4, 2026 00:53

tests: reduce maxmem of HVM on nested virt cont

f0ef90c

I missed one of the grub tests. Fixes: 7448ed2 "tests: reduce maxmem of HVM when running in nested virt"

qubesos-qa Bot deployed to qa August 4, 2026 02:07 Active

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

tests: dom0 update via qubes-vm-update - #861

tests: dom0 update via qubes-vm-update#861
marmarek wants to merge 3 commits into
QubesOS:mainfrom
marmarek:tests-dom0-vm-update

marmarek commented Aug 3, 2026

Uh oh!

codecov Bot commented Aug 3, 2026 •

edited

Loading

Uh oh!

qubesos-bot commented Aug 3, 2026 •

edited

Loading

Uh oh!

marmarek commented Aug 4, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Uh oh!

Uh oh!

Conversation

marmarek commented Aug 3, 2026

Uh oh!

codecov Bot commented Aug 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Codecov Report

Uh oh!

qubesos-bot commented Aug 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

OpenQA test summary

New failures, excluding unstable

Failed tests

Fixed failures

Unstable tests

Performance Tests

Performance degradation:

Remaining performance tests:

Uh oh!

marmarek commented Aug 4, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

codecov Bot commented Aug 3, 2026 •

edited

Loading

qubesos-bot commented Aug 3, 2026 •

edited

Loading