Skip to content

Lint with mypy on CI - #219

Open
ben-grande wants to merge 2 commits into
QubesOS:mainfrom
ben-grande:mypy
Open

Lint with mypy on CI#219
ben-grande wants to merge 2 commits into
QubesOS:mainfrom
ben-grande:mypy

Conversation

@ben-grande

Copy link
Copy Markdown
Contributor

I'd like mypy to run on #213.

@ben-grande
ben-grande marked this pull request as draft July 24, 2026 09:05
@ben-grande

Copy link
Copy Markdown
Contributor Author

@nihalxkumar You modified some of these files in your PR, I think that it is easier:

  • We enable CI in your PR
  • You check what new issues were introduced and fix them in the same PR

Rather than fixing those errors in a separate PR, as that might cause some merge conflicts.

@nihalxkumar

Copy link
Copy Markdown
Contributor

I ran the mypy check on my branch. It reports the same 34 errors already present on main, with no new errors from my changes
I think we should use #219 to fix the baseline errors before this CI job is brought into qvm-template-upgrade branch

@ben-grande
ben-grande marked this pull request as ready for review July 27, 2026 10:52
@ben-grande

Copy link
Copy Markdown
Contributor Author

with no new errors from my changes

Bodies of untyped functions are not checked, so you can add return type to functions you added to make mypy lint them.

@codecov-commenter

codecov-commenter commented Jul 27, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 55.55556% with 8 lines in your changes missing coverage. Please review.
✅ Project coverage is 71.37%. Comparing base (4973653) to head (6cc2017).

Files with missing lines Patch % Lines
vmupdate/update_manager.py 60.00% 6 Missing ⚠️
vmupdate/agent/source/common/process_result.py 0.00% 2 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #219      +/-   ##
==========================================
- Coverage   71.42%   71.37%   -0.06%     
==========================================
  Files          12       12              
  Lines        1344     1345       +1     
==========================================
  Hits          960      960              
- Misses        384      385       +1     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@nihalxkumar

Copy link
Copy Markdown
Contributor

🙋 01027e3 (This PR) L431 renames the dom0 list to entrypoint_cmd, but L463 still passes entrypoint.
on the AdminVM + dom0 path it's unassigned and qubes-vm-update --dom0 raises UnboundLocalError.

My patch for 213: https://gist.github.com/nihalxkumar/b5d76eb71ba8ebaa45ac90af08d6e9b2
will commit and rebase after this PR lands

@ben-grande

Copy link
Copy Markdown
Contributor Author

🙋 01027e3 (This PR) L431 renames the dom0 list to entrypoint_cmd, but L463 still passes entrypoint.
on the AdminVM + dom0 path it's unassigned and qubes-vm-update --dom0 raises UnboundLocalError.

I was trying to circumvent a mypy error that entrypoint had two types, str and list. I now see that I missed one step.

Comment thread vmupdate/agent/source/dnf/dnf5_api.py Outdated

def add_new_download(
self, _user_data, description: str, total_to_download: float
self, _user_data, description: str, total_to_download: int

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This (and other changes to function signatures in this class) is wrong - the function is called by libdnf and according to its documentation it uses float here:

 |  add_new_download(self, user_data, description, total_to_download)
 |      Notify the client that a new download has been created.
 |      :type user_data: void
 |      :param user_data: User data entered together with url/package to download.
 |      :type description: string
 |      :param description: The message describing new download (url/packagename).
 |      :type total_to_download: float
 |      :param total_to_download: Total number of bytes to download.
 |      :rtype: void
 |      :return: Associated user data for new download.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. Was this automatic detection somehow that I could have done via editor or some other tool? To fix, I looked at help(libdnf5.repo.DownloadCallbacks.add_new_download).

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nope, I just checked type changes in this PR that looked suspicious to me.

@qubesos-bot

qubesos-bot commented Jul 31, 2026

Copy link
Copy Markdown

OpenQA test summary

Complete test suite and dependencies: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026073102-devel&flavor=pull-requests

Test run included the following:

Upload failures

  • system_tests_usbproxy
    • system_tests: Failed (test died)
      # Test died: command 'curl --form upload=@tests-qubes.tests.extra.l...

New failures, excluding unstable

Compared to: https://openqa.qubes-os.org/tests/overview?distri=qubesos&version=4.3&build=2026050504-devel&flavor=update

  • system_tests_pvgrub_salt_storage

    • TC_41_HVMGrub_fedora-44-xfce: test_010_template_based_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_extra

    • TC_00_QVCTest_fedora-44-xfce: test_010_screenshare (failure + cleanup)
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1179648 != 0

    • TC_00_PDFConverter_fedora-44-xfce: test_004_cancel_stops_conversion (failure)
      AssertionError: DispVM not cleaned up 20s after cancel: ['disp6691']

  • system_tests_qrexec

  • system_tests_network_updates

  • system_tests_dispvm

  • system_tests_audio@hw1

Failed tests

16 failures
  • system_tests_pvgrub_salt_storage

    • [unstable] TC_41_HVMGrub_debian-13-xfce: test_010_template_based_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • [unstable] TC_41_HVMGrub_debian-13-xfce: test_011_template_based_vm_dracut (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_fedora-44-xfce: test_010_template_based_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • system_tests_extra

    • TC_00_QVCTest_fedora-44-xfce: test_010_screenshare (failure + cleanup)
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1179648 != 0

    • TC_00_PDFConverter_fedora-44-xfce: test_004_cancel_stops_conversion (failure)
      AssertionError: DispVM not cleaned up 20s after cancel: ['disp6691']

  • system_tests_qrexec

  • system_tests_network_updates

    • TC_00_Dom0Upgrade_whonix-gateway-18: test_005_update_flag_clear (failure + timed out)
      Error: Failed to download metadata for repo 'test': Cannot download...

    • [unstable] TC_00_Dom0Upgrade_whonix-gateway-18: test_006_update_flag_clear (failure + timed out)
      Error: Failed to download metadata for repo 'test': Cannot download...

    • VmUpdates_debian-13-xfce: test_020_updates_available_notification (error)
      subprocess.CalledProcessError: Command '/usr/lib/qubes/upgrades-sta...

  • system_tests_dispvm

  • system_tests_audio

    • [unstable] TC_20_AudioVM_Pulse_whonix-workstation-18: test_225_audio_rec_unmuted_hvm (failure)
      AssertionError: too short audio, expected 10s, got 7.75671201814059...
  • system_tests_audio@hw1

  • system_tests_whonix@hw1

    • [unstable] whonixcheck: fail (unknown)
      Whonixcheck for sys-whonix failed...

    • [unstable] whonixcheck: Failed (test died)
      # Test died: systemcheck failed at qubesos/tests/whonixcheck.pm lin...

  • system_tests_guivm_gpu_gui_interactive@hw13

    • shutdown: unnamed test (unknown)
    • shutdown: Failed (test died)
      # Test died: no candidate needle with tag(s) 'text-logged-in-root' ...

Fixed failures

Compared to: https://openqa.qubes-os.org/tests/176874#dependencies

21 fixed
  • system_tests_whonix

    • whonixcheck: Failed (test died)
      # Test died: command 'qvm-shutdown --wait anon-whonix ' failed at /...
  • system_tests_pvgrub_salt_storage

    • TC_41_HVMGrub_debian-13-xfce: test_000_standalone_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_debian-13-xfce: test_001_standalone_vm_dracut (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_41_HVMGrub_fedora-43-xfce: test_010_template_based_vm (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • system_tests_extra

    • TC_01_InputProxyExclude_debian-13-xfce: test_000_qemu_tablet (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_01_InputProxyExclude_fedora-43-xfce: test_000_qemu_tablet (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

    • TC_00_QVCTest_fedora-43-xfce: test_010_screenshare (failure + cleanup)
      ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 1179648 != 0

    • TC_00_QVCTest_whonix-gateway-18: test_010_screenshare (failure + cleanup)
      AssertionError: 2.3156185715769593 not less than 2.0

    • TC_00_PDFConverter_fedora-43-xfce: test_004_cancel_stops_conversion (failure)
      AssertionError: DispVM not cleaned up 10s after cancel: {<DispVM at...

  • system_tests_usbproxy

    • system_tests: Fail (unknown)
      Tests qubes.tests.extra failed (exit code 1), details reported sepa...

    • system_tests: wait_serial (wait serial expected)
      # wait_serial expected: qr/h3uXO-\d+-/...

    • TC_20_USBProxy_core3_fedora-43-xfce: test_090_attach_stubdom (error)
      qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...

  • system_tests_network_ipv6

    • system_tests: Fail (unknown)
      Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...

    • system_tests: Failed (test died)
      # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...

    • VmIPv6Networking_fedora-43-xfce: test_001_simple_networking_paused_from_none_to_existent (error)
      raise TimeoutError from exc_val... TimeoutError

  • system_tests_audio

  • system_tests_audio@hw1

Unstable tests

Details
  • system_tests_whonix

    whonixcheck/Failed (2/5 times with errors)
    • job 188935 # Test died: command 'qvm-run -ap whonix-gateway-18 'LC_ALL=C whon...
    • job 189348 # Test died: command 'qvm-run -ap whonix-gateway-18 'LC_ALL=C whon...
    whonixcheck/fail (2/5 times with errors)
    whonixcheck/wait_serial (2/5 times with errors)
    • job 188935 # Command: qvm-run -ap whonix-gateway-18 'LC_ALL=C whonixcheck --v...
    • job 189348 # Command: qvm-run -ap whonix-gateway-18 'LC_ALL=C whonixcheck --v...
    whonixcheck/wait_serial (1/5 times with errors)
    • job 189348 # Command: curl --form upload=@/var/log/libvirt/libxl/libxl-driver....
  • system_tests_gui_tools

    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/Failed (1/5 times with errors)
    • job 189375 # Test died: no candidate needle with tag(s) 'qubes-update-finish' ...
  • system_tests_network

    system_tests/Fail (2/5 times with errors)
    • job 188964 Tests qubes.tests.integ.network failed (exit code 1), details repor...
    • job 190295 Tests qubes.tests.integ.network failed (exit code 1), details repor...
    system_tests/Failed (2/5 times with errors)
    • job 188964 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190295 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    VmNetworking_debian-13-xfce/test_001_simple_networking_paused_from_none_to_existent (1/5 times with errors)
    • job 190295 raise TimeoutError from exc_val... TimeoutError
    VmNetworking_debian-13-xfce/test_110_dynamic_attach (2/5 times with errors)
    • job 188964 ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^... AssertionError: 125 != 0
    • job 190295 raise TimeoutError from exc_val... TimeoutError
    VmNetworking_fedora-43-xfce/test_114_reattach_after_provider_crash (1/5 times with errors)
    • job 188964 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_pvgrub_salt_storage

    system_tests/Fail (1/5 times with errors)
    • job 188967 Tests qubes.tests.integ.grub failed (exit code 1), details reported...
    system_tests/Fail (1/5 times with errors)
    • job 188967 Tests qubes.tests.integ.salt failed (exit code 1), details reported...
    system_tests/Fail (1/5 times with errors)
    • job 188967 Tests qubes.tests.integ.storage failed (exit code 1), details repor...
    system_tests/Failed (1/5 times with errors)
    • job 190298 # Test died: command 'curl --form upload=@nose2-junit.xml --form up...
    system_tests/Failed (1/5 times with errors)
    • job 188967 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_41_HVMGrub_debian-13-xfce/test_000_standalone_vm (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_fedora-43-xfce/test_000_standalone_vm (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    StorageReflinkOnExt4/test_000_volatile (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_10_VMSalt_fedora-43-xfce/test_001_multi_state_highstate (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_debian-13-xfce/test_001_standalone_vm_dracut (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_debian-13-xfce/test_010_template_based_vm (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_fedora-43-xfce/test_010_template_based_vm (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_41_HVMGrub_debian-13-xfce/test_011_template_based_vm_dracut (1/5 times with errors)
    • job 188967 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_splitgpg

    system_tests/Failed (1/5 times with errors)
    • job 189167 # Test died: command 'testfunc qubes.tests.extra' timed out at qube...
    system_tests/wait_serial (1/5 times with errors)
    • job 189167 # Command: testfunc qubes.tests.extra...
  • system_tests_extra

    system_tests/Fail (1/5 times with errors)
    • job 188661 Tests qubes.tests.extra failed (exit code 1), details reported sepa...
    system_tests/Failed (1/5 times with errors)
    • job 188661 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_01_InputProxyExclude_debian-13-xfce/test_000_qemu_tablet (1/5 times with errors)
    • job 188661 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_01_InputProxyExclude_fedora-43-xfce/test_000_qemu_tablet (1/5 times with errors)
    • job 188661 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_00_PDFConverter_debian-13-xfce/test_004_cancel_stops_conversion (1/5 times with errors)
    • job 188661 AssertionError: DispVM not cleaned up 20s after cancel: ['disp7751']
    TC_00_PDFConverter_fedora-43-xfce/test_004_cancel_stops_conversion (1/5 times with errors)
    • job 188661 AssertionError: DispVM not cleaned up 20s after cancel: ['disp8125']
    TC_00_Direct_whonix-workstation-18/test_060_import_secret (1/5 times with errors)
    • job 188661 AssertionError: key generation failed: b''b"gpg: keybox '/home/user...
  • system_tests_usbproxy

    system_tests/Fail (1/5 times with errors)
    • job 188934 Tests qubes.tests.extra failed (exit code 1), details reported sepa...
    system_tests/Failed (1/5 times with errors)
    • job 188934 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_USBProxy_core3_debian-13-xfce/test_090_attach_stubdom (1/5 times with errors)
    • job 188934 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_USBProxy_core3_fedora-43-xfce/test_090_attach_stubdom (1/5 times with errors)
    • job 188934 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_qrexec

    system_tests/Fail (2/5 times with errors)
    • job 190299 Tests qubes.tests.integ.qrexec failed (exit code 1), details report...
    • job 190314 Tests qubes.tests.integ.qrexec failed (exit code 1), details report...
    system_tests/Failed (2/5 times with errors)
    • job 190299 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190314 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_00_Qrexec_whonix-workstation-18/test_095_qrexec_service_socket_vm (2/5 times with errors)
    • job 190299 AssertionError: waiting for /etc/qubes-rpc/test.Socket in VM timed out
    • job 190314 AssertionError: waiting for /etc/qubes-rpc/test.Socket in VM timed out
  • system_tests_network_ipv6

    system_tests/Fail (4/5 times with errors)
    • job 188666 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    • job 188965 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    • job 189378 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    • job 190296 Tests qubes.tests.integ.network_ipv6 failed (exit code 1), details ...
    system_tests/Failed (4/5 times with errors)
    • job 188666 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 188965 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 189378 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 190296 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    VmIPv6Networking_debian-13-xfce/test_001_simple_networking_paused_from_none_to_existent (1/5 times with errors)
    • job 189378 subprocess.CalledProcessError: Command 'qubes.WaitForNetworkUplink'...
    VmIPv6Networking_debian-13-xfce/test_001_simple_networking_paused_restart_netvm (1/5 times with errors)
    • job 190296 AssertionError: Timeout while waiting for VM test-inst-netvm1 shutdown
    VmIPv6Networking_fedora-43-xfce/test_030_firewallvm_firewall (1/5 times with errors)
    • job 188965 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    VmIPv6Networking_fedora-43-xfce/test_040_inter_vm (1/5 times with errors)
    • job 188666 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    VmIPv6Networking_fedora-43-xfce/test_112_reattach_after_provider_shutdown (1/5 times with errors)
    • job 188666 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    VmIPv6Networking_fedora-43-xfce/test_113_reattach_after_provider_kill (1/5 times with errors)
    • job 188666 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    VmIPv6Networking_fedora-44-xfce/test_510_ipv6_simple_proxyvm (1/5 times with errors)
    • job 190296 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_network_updates

    TC_00_Dom0Upgrade_whonix-gateway-18/test_000_update (1/5 times with errors)
    • job 189379 Error: Failed to download metadata for repo 'test': Cannot download...
    TC_00_Dom0Upgrade_whonix-gateway-18/test_000_update_salt (2/5 times with errors)
    • job 190297 ?[0;31mDuration: 140907.985 ms?[0;0m... ?[0;31m Changes: ?[0;0m
    • job 190312 ?[0;31mDuration: 135117.105 ms?[0;0m... ?[0;31m Changes: ?[0;0m
    TC_00_Dom0Upgrade_whonix-gateway-18/test_001_update_check (4/5 times with errors)
    • job 188966 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
    • job 189164 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
    • job 190297 ^... AssertionError: '' is not true
    • job 190312 ^... AssertionError: '' is not true
    TC_00_Dom0Upgrade_whonix-gateway-18/test_006_update_flag_clear (1/5 times with errors)
    • job 188966 Error: Failed to download metadata for repo 'test': Cannot download...
    TC_00_Dom0Upgrade_whonix-gateway-18/test_030_install_unsigned (1/5 times with errors)
    • job 189379 subprocess.CalledProcessError: Command 'timeout=120; while ! tor-ci...
    system_tests/wait_serial (1/5 times with errors)
    • job 188966 # Command: curl --form upload=@/var/log/libvirt/libxl/libxl-driver....
  • system_tests_kde_gui_interactive

    gui_keyboard_layout/Failed (2/5 times with errors)
    • job 188640 # Test died: command 'qvm-shutdown --wait work' timed out at /usr/l...
    • job 189137 # Test died: command 'qvm-shutdown --wait work' timed out at /usr/l...
    gui_keyboard_layout/wait_serial (2/5 times with errors)
    • job 188640 # Command: qvm-shutdown --wait work...
    • job 189137 # Command: qvm-shutdown --wait work...
  • system_tests_basic_vm_qrexec_gui_zfs

    system_tests/Fail (1/5 times with errors)
    • job 189155 Tests qubes.tests.integ.vm_qrexec_gui failed (exit code 1), details...
    switch_pool/Failed (1/5 times with errors)
    • job 189183 # Test died: command 'qvm-start --skip-if-running sys-firewall sys-...
    system_tests/Failed (1/5 times with errors)
    • job 189155 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_NonAudio_whonix-gateway-18-pool/test_012_qubes_desktop_run (1/5 times with errors)
    • job 189155 raise TimeoutError from exc_val... TimeoutError
  • system_tests_audio

    system_tests/Fail (2/5 times with errors)
    • job 188639 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    • job 189136 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    system_tests/Failed (2/5 times with errors)
    • job 188639 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 189136 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_AudioVM_Pulse_fedora-43-xfce/test_223_audio_play_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_AudioVM_Pulse_fedora-43-xfce/test_224_audio_rec_muted_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_AudioVM_Pulse_whonix-workstation-18/test_224_audio_rec_muted_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_AudioVM_Pulse_whonix-workstation-18/test_225_audio_rec_unmuted_hvm (1/5 times with errors)
    • job 188639 AssertionError: too short audio, expected 10s, got 6.83272108843537...
    TC_20_AudioVM_PipeWire_whonix-workstation-18/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)
    • job 189136 AssertionError: too short audio, expected 10s, got 9.09505668934240...
    TC_20_AudioVM_Pulse_fedora-43-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_audio@hw1

    system_tests/Fail (2/5 times with errors)
    • job 188639 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    • job 189136 Tests qubes.tests.integ.audio failed (exit code 1), details reporte...
    system_tests/Failed (2/5 times with errors)
    • job 188639 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    • job 189136 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_AudioVM_Pulse_fedora-43-xfce/test_223_audio_play_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_AudioVM_Pulse_fedora-43-xfce/test_224_audio_rec_muted_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_AudioVM_Pulse_whonix-workstation-18/test_224_audio_rec_muted_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    TC_20_AudioVM_Pulse_whonix-workstation-18/test_225_audio_rec_unmuted_hvm (1/5 times with errors)
    • job 188639 AssertionError: too short audio, expected 10s, got 6.83272108843537...
    TC_20_AudioVM_PipeWire_whonix-workstation-18/test_251_audio_playback_audiovm_pipewire_late_start (1/5 times with errors)
    • job 189136 AssertionError: too short audio, expected 10s, got 9.09505668934240...
    TC_20_AudioVM_Pulse_fedora-43-xfce/test_252_audio_playback_audiovm_switch_hvm (1/5 times with errors)
    • job 188639 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_basic_vm_qrexec_gui_btrfs

    system_tests/Fail (1/5 times with errors)
    • job 188655 Tests qubes.tests.integ.basic failed (exit code 1), details reporte...
    system_tests/Fail (1/5 times with errors)
    • job 188655 Tests qubes.tests.integ.vm_qrexec_gui failed (exit code 1), details...
    system_tests/Failed (1/5 times with errors)
    • job 188655 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_NonAudio_debian-13-xfce-pool/test_000_start_shutdown (1/5 times with errors)
    • job 188655 qubes.exc.QubesVMShutdownTimeoutError: Domain shutdown timed out: '...
    TC_00_Basic/test_210_bootmode_template (1/5 times with errors)
    • job 188655 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
  • system_tests_basic_vm_qrexec_gui_ext4

    system_tests/Fail (1/5 times with errors)
    • job 188955 Tests qubes.tests.integ.vm_qrexec_gui failed (exit code 1), details...
    system_tests/Failed (1/5 times with errors)
    • job 188955 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_NonAudio_debian-13-xfce-pool/test_500_gui_agent_env_sync (1/5 times with errors)
    • job 188955 qubes.exc.QubesVMShutdownTimeoutError: Domain shutdown timed out: '...
    TC_20_NonAudio_fedora-43-xfce-pool/test_500_gui_agent_env_sync (1/5 times with errors)
    • job 188955 OSError: Volume /var/lib/qubes-pool/appvms/test-inst-envsync/privat...
    TC_20_NonAudio_whonix-gateway-18-pool/test_500_gui_agent_env_sync (1/5 times with errors)
    • job 188955 OSError: Volume /var/lib/qubes-pool/appvms/test-inst-envsync/privat...
    TC_20_NonAudio_whonix-workstation-18-pool/test_500_gui_agent_env_sync (1/5 times with errors)
    • job 188955 OSError: Volume /var/lib/qubes-pool/appvms/test-inst-envsync/privat...
  • system_tests_basic_vm_qrexec_gui_xfs

    startup/ (1/5 times with errors)
    system_tests/Fail (1/5 times with errors)
    • job 188956 Tests qubes.tests.integ.vm_qrexec_gui failed (exit code 1), details...
    startup/Failed (1/5 times with errors)
    • job 189154 # Test died: no candidate needle with tag(s) 'luks-prompt, login-pr...
    system_tests/Failed (1/5 times with errors)
    • job 188956 # Test died: Some tests failed at qubesos/tests/system_tests.pm lin...
    TC_20_NonAudio_fedora-43-xfce-pool/test_101_qrexec_filecopy_with_autostart (1/5 times with errors)
    • job 188956 AssertionError: qvm-copy-to-vm failed: b'In order to avoid typing t...
    TC_20_NonAudio_fedora-43-xfce-pool/test_400_long_window_title (1/5 times with errors)
    • job 188956 qubes.exc.QubesVMError: Cannot connect to qrexec agent for 120 seco...
    startup/wait_serial (1/5 times with errors)
    • job 189154 # wait_serial expected: qr/login:\s*$|root@.*#\s*$/ui...
    startup/wait_serial (1/5 times with errors)
    • job 189154 # wait_serial expected: qr/PS1="root# "/u...
    startup/wait_serial (1/5 times with errors)
    startup/wait_serial (1/5 times with errors)
    • job 189154 # wait_serial expected: "export TERM=dumb; stty cols 2048 rows 25; ...
  • system_tests_gui_tools@hw7

    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/ (1/5 times with errors)
    qui_widgets_update/Failed (1/5 times with errors)
    • job 189375 # Test died: no candidate needle with tag(s) 'qubes-update-finish' ...
  • system_tests_whonix@hw1

    whonixcheck/Failed (2/5 times with errors)
    • job 188935 # Test died: command 'qvm-run -ap whonix-gateway-18 'LC_ALL=C whon...
    • job 189348 # Test died: command 'qvm-run -ap whonix-gateway-18 'LC_ALL=C whon...
    whonixcheck/fail (2/5 times with errors)
    whonixcheck/wait_serial (2/5 times with errors)
    • job 188935 # Command: qvm-run -ap whonix-gateway-18 'LC_ALL=C whonixcheck --v...
    • job 189348 # Command: qvm-run -ap whonix-gateway-18 'LC_ALL=C whonixcheck --v...
    whonixcheck/wait_serial (1/5 times with errors)
    • job 189348 # Command: curl --form upload=@/var/log/libvirt/libxl/libxl-driver....

Performance Tests

Performance degradation:

22 performance degradations
  • whonix-gateway-18_exec-root: 153.73 🔻 ( previous job: 126.14, degradation: 121.87%)
  • whonix-gateway-18_socket: 10.33 🔻 ( previous job: 8.63, degradation: 119.75%)
  • whonix-gateway-18_exec-data-simplex: 70.04 🔻 ( previous job: 62.50, degradation: 112.06%)
  • whonix-workstation-18_exec: 9.28 🔻 ( previous job: 8.14, degradation: 114.09%)
  • whonix-workstation-18_exec-root: 168.27 🔻 ( previous job: 144.02, degradation: 116.84%)
  • whonix-workstation-18_socket: 8.60 🔻 ( previous job: 7.66, degradation: 112.31%)
  • whonix-workstation-18_exec-data-duplex-root: 153.60 🔻 ( previous job: 130.67, degradation: 117.55%)
  • dom0_root_seq1m_q1t1_write 3:write_bandwidth_kb: 141614.00 🔻 ( previous job: 199974.00, degradation: 70.82%)
  • dom0_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 5699.00 🔻 ( previous job: 6899.00, degradation: 82.61%)
  • dom0_varlibqubes_seq1m_q8t1_read 3:read_bandwidth_kb: 309679.00 🔻 ( previous job: 429040.00, degradation: 72.18%)
  • dom0_varlibqubes_seq1m_q1t1_read 3:read_bandwidth_kb: 119350.00 🔻 ( previous job: 446202.00, degradation: 26.75%)
  • dom0_varlibqubes_seq1m_q1t1_write 3:write_bandwidth_kb: 126926.00 🔻 ( previous job: 201978.00, degradation: 62.84%)
  • dom0_varlibqubes_rnd4k_q32t1_read 3:read_bandwidth_kb: 14831.00 🔻 ( previous job: 102155.00, degradation: 14.52%)
  • dom0_varlibqubes_rnd4k_q32t1_write 3:write_bandwidth_kb: 9407.00 🔻 ( previous job: 10623.00, degradation: 88.55%)
  • debian-13-xfce_dom0-dispvm-gui-api (mean:8.854): 106.25 🔻 ( previous job: 93.50, degradation: 113.63%)
  • debian-13-xfce_dom0-dispvm-preload-2-delay-0-api (mean:3.191): 38.29 🔻 ( previous job: 34.29, degradation: 111.66%)
  • debian-13-xfce_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:2.769): 33.23 🔻 ( previous job: 28.74, degradation: 115.60%)
  • whonix-workstation-18_dom0-dispvm-api (mean:9.938): 119.25 🔻 ( previous job: 97.14, degradation: 122.77%)
  • whonix-workstation-18_dom0-dispvm-gui-api (mean:12.05): 144.60 🔻 ( previous job: 121.86, degradation: 118.67%)
  • whonix-workstation-18_dom0-dispvm-preload-2-api (mean:4.695): 56.33 🔻 ( previous job: 48.39, degradation: 116.41%)
  • whonix-workstation-18_dom0-dispvm-preload-2-delay-0-api (mean:4.6): 55.20 🔻 ( previous job: 48.26, degradation: 114.37%)
  • whonix-workstation-18_dom0-dispvm-preload-4-api (mean:3.68): 44.16 🔻 ( previous job: 38.29, degradation: 115.33%)

Remaining performance tests:

89 tests
  • debian-13-xfce_exec: 8.41 🔻 ( previous job: 7.85, degradation: 107.13%)
  • debian-13-xfce_exec-root: 27.44 🔻 ( previous job: 26.74, degradation: 102.62%)
  • debian-13-xfce_socket: 9.05 🔻 ( previous job: 8.37, degradation: 108.10%)
  • debian-13-xfce_socket-root: 8.78 🟢 ( previous job: 9.13, improvement: 96.24%)
  • debian-13-xfce_exec-data-simplex: 61.58 🟢 ( previous job: 63.05, improvement: 97.66%)
  • debian-13-xfce_exec-data-duplex: 65.57 🔻 ( previous job: 62.45, degradation: 104.99%)
  • debian-13-xfce_exec-data-duplex-root: 83.81 🔻 ( previous job: 78.04, degradation: 107.39%)
  • debian-13-xfce_socket-data-duplex: 87.94 🔻 ( previous job: 85.67, degradation: 102.66%)
  • fedora-44-xfce_exec: 9.42
  • fedora-44-xfce_exec-root: 71.46
  • fedora-44-xfce_socket: 8.76
  • fedora-44-xfce_socket-root: 9.20
  • fedora-44-xfce_exec-data-simplex: 67.17
  • fedora-44-xfce_exec-data-duplex: 70.35
  • fedora-44-xfce_exec-data-duplex-root: 109.98
  • fedora-44-xfce_socket-data-duplex: 79.60
  • whonix-gateway-18_exec: 8.02 🔻 ( previous job: 8.01, degradation: 100.12%)
  • whonix-gateway-18_socket-root: 8.58 🔻 ( previous job: 8.37, degradation: 102.57%)
  • whonix-gateway-18_exec-data-duplex: 67.39 🟢 ( previous job: 68.01, improvement: 99.08%)
  • whonix-gateway-18_exec-data-duplex-root: 149.21 🔻 ( previous job: 137.28, degradation: 108.69%)
  • whonix-gateway-18_socket-data-duplex: 90.53 🔻 ( previous job: 90.03, degradation: 100.55%)
  • whonix-workstation-18_socket-root: 9.24 🔻 ( previous job: 8.87, degradation: 104.23%)
  • whonix-workstation-18_exec-data-simplex: 64.59 🟢 ( previous job: 66.36, improvement: 97.34%)
  • whonix-workstation-18_exec-data-duplex: 69.11 🔻 ( previous job: 65.56, degradation: 105.42%)
  • whonix-workstation-18_socket-data-duplex: 85.26 🟢 ( previous job: 92.97, improvement: 91.71%)
  • dom0_root_seq1m_q8t1_read 3:read_bandwidth_kb: 442997.00 🟢 ( previous job: 388793.00, improvement: 113.94%)
  • dom0_root_seq1m_q8t1_write 3:write_bandwidth_kb: 237019.00 🟢 ( previous job: 119690.00, improvement: 198.03%)
  • dom0_root_seq1m_q1t1_read 3:read_bandwidth_kb: 422302.00 🟢 ( previous job: 245223.00, improvement: 172.21%)
  • dom0_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 96861.00 🟢 ( previous job: 13948.00, improvement: 694.44%)
  • dom0_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 9876.00 🟢 ( previous job: 8963.00, improvement: 110.19%)
  • dom0_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 4860.00 🔻 ( previous job: 5055.00, degradation: 96.14%)
  • dom0_varlibqubes_seq1m_q8t1_write 3:write_bandwidth_kb: 347901.00 🟢 ( previous job: 257066.00, improvement: 135.34%)
  • dom0_varlibqubes_rnd4k_q1t1_read 3:read_bandwidth_kb: 8041.00 🔻 ( previous job: 8179.00, degradation: 98.31%)
  • dom0_varlibqubes_rnd4k_q1t1_write 3:write_bandwidth_kb: 4672.00 🟢 ( previous job: 4404.00, improvement: 106.09%)
  • fedora-44-xfce_root_seq1m_q8t1_read 3:read_bandwidth_kb: 343008.00
  • fedora-44-xfce_root_seq1m_q8t1_write 3:write_bandwidth_kb: 166556.00
  • fedora-44-xfce_root_seq1m_q1t1_read 3:read_bandwidth_kb: 310965.00
  • fedora-44-xfce_root_seq1m_q1t1_write 3:write_bandwidth_kb: 25540.00
  • fedora-44-xfce_root_rnd4k_q32t1_read 3:read_bandwidth_kb: 83424.00
  • fedora-44-xfce_root_rnd4k_q32t1_write 3:write_bandwidth_kb: 1806.00
  • fedora-44-xfce_root_rnd4k_q1t1_read 3:read_bandwidth_kb: 8649.00
  • fedora-44-xfce_root_rnd4k_q1t1_write 3:write_bandwidth_kb: 297.00
  • fedora-44-xfce_private_seq1m_q8t1_read 3:read_bandwidth_kb: 242725.00
  • fedora-44-xfce_private_seq1m_q8t1_write 3:write_bandwidth_kb: 127904.00
  • fedora-44-xfce_private_seq1m_q1t1_read 3:read_bandwidth_kb: 388793.00
  • fedora-44-xfce_private_seq1m_q1t1_write 3:write_bandwidth_kb: 46406.00
  • fedora-44-xfce_private_rnd4k_q32t1_read 3:read_bandwidth_kb: 63845.00
  • fedora-44-xfce_private_rnd4k_q32t1_write 3:write_bandwidth_kb: 1153.00
  • fedora-44-xfce_private_rnd4k_q1t1_read 3:read_bandwidth_kb: 7552.00
  • fedora-44-xfce_private_rnd4k_q1t1_write 3:write_bandwidth_kb: 414.00
  • fedora-44-xfce_volatile_seq1m_q8t1_read 3:read_bandwidth_kb: 308042.00
  • fedora-44-xfce_volatile_seq1m_q8t1_write 3:write_bandwidth_kb: 118036.00
  • fedora-44-xfce_volatile_seq1m_q1t1_read 3:read_bandwidth_kb: 368827.00
  • fedora-44-xfce_volatile_seq1m_q1t1_write 3:write_bandwidth_kb: 32086.00
  • fedora-44-xfce_volatile_rnd4k_q32t1_read 3:read_bandwidth_kb: 81958.00
  • fedora-44-xfce_volatile_rnd4k_q32t1_write 3:write_bandwidth_kb: 1405.00
  • fedora-44-xfce_volatile_rnd4k_q1t1_read 3:read_bandwidth_kb: 8893.00
  • fedora-44-xfce_volatile_rnd4k_q1t1_write 3:write_bandwidth_kb: 1552.00
  • debian-13-xfce_dom0-dispvm-api (mean:6.658): 79.90 🔻 ( previous job: 74.50, degradation: 107.25%)
  • debian-13-xfce_dom0-dispvm-preload-2-api (mean:3.239): 38.87 🔻 ( previous job: 37.79, degradation: 102.86%)
  • debian-13-xfce_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:3.471): 41.66 🔻 ( previous job: 38.52, degradation: 108.15%)
  • debian-13-xfce_dom0-dispvm-preload-4-api (mean:2.658): 31.90 🔻 ( previous job: 30.73, degradation: 103.79%)
  • debian-13-xfce_dom0-dispvm-preload-4-delay-0-api (mean:2.552): 30.63 🔻 ( previous job: 29.50, degradation: 103.82%)
  • debian-13-xfce_dom0-dispvm-preload-2-gui-api (mean:4.751): 57.01 🔻 ( previous job: 53.65, degradation: 106.26%)
  • debian-13-xfce_dom0-dispvm-preload-4-gui-api (mean:3.893): 46.71 🔻 ( previous job: 44.40, degradation: 105.20%)
  • debian-13-xfce_dom0-dispvm-preload-6-gui-api (mean:3.216): 38.60 🟢 ( previous job: 41.47, improvement: 93.08%)
  • debian-13-xfce_dom0-vm-api (mean:0.03): 0.35 🟢 ( previous job: 0.62, improvement: 57.26%)
  • debian-13-xfce_dom0-vm-gui-api (mean:0.028): 0.34 🟢 ( previous job: 0.47, improvement: 72.26%)
  • fedora-44-xfce_dom0-dispvm-api (mean:8.653): 103.84
  • fedora-44-xfce_dom0-dispvm-gui-api (mean:10.784): 129.41
  • fedora-44-xfce_dom0-dispvm-preload-2-api (mean:4.154): 49.85
  • fedora-44-xfce_dom0-dispvm-preload-2-delay-0-api (mean:3.968): 47.61
  • fedora-44-xfce_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:4.307): 51.69
  • fedora-44-xfce_dom0-dispvm-preload-4-api (mean:2.994): 35.92
  • fedora-44-xfce_dom0-dispvm-preload-4-delay-0-api (mean:2.927): 35.12
  • fedora-44-xfce_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:3.132): 37.58
  • fedora-44-xfce_dom0-dispvm-preload-2-gui-api (mean:5.672): 68.07
  • fedora-44-xfce_dom0-dispvm-preload-4-gui-api (mean:4.237): 50.84
  • fedora-44-xfce_dom0-dispvm-preload-6-gui-api (mean:3.622): 43.47
  • fedora-44-xfce_dom0-vm-api (mean:0.025): 0.30
  • fedora-44-xfce_dom0-vm-gui-api (mean:0.031): 0.37
  • whonix-workstation-18_dom0-dispvm-preload-2-delay-minus-1d2-api (mean:4.834): 58.01 🟢 ( previous job: 59.22, improvement: 97.96%)
  • whonix-workstation-18_dom0-dispvm-preload-4-delay-0-api (mean:3.498): 41.98 🟢 ( previous job: 43.23, improvement: 97.10%)
  • whonix-workstation-18_dom0-dispvm-preload-4-delay-minus-1d2-api (mean:3.834): 46.01 🔻 ( previous job: 42.67, degradation: 107.83%)
  • whonix-workstation-18_dom0-dispvm-preload-2-gui-api (mean:5.979): 71.75 🟢 ( previous job: 72.05, improvement: 99.59%)
  • whonix-workstation-18_dom0-dispvm-preload-4-gui-api (mean:4.651): 55.81 🔻 ( previous job: 52.81, degradation: 105.67%)
  • whonix-workstation-18_dom0-dispvm-preload-6-gui-api (mean:4.148): 49.77 🟢 ( previous job: 50.72, improvement: 98.13%)
  • whonix-workstation-18_dom0-vm-api (mean:0.029): 0.35 🟢 ( previous job: 0.43, improvement: 81.52%)
  • whonix-workstation-18_dom0-vm-gui-api (mean:0.043): 0.52 🟢 ( previous job: 0.56, improvement: 92.63%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants