Native coverage for end to end tests - #5524
Open
Nicholas L (nmlud21) wants to merge 6 commits into
Open
Conversation
Nicholas L (nmlud21)
force-pushed
the
native-program-test-coverage
branch
from
August 25, 2026 18:24
c9879b5 to
c4660eb
Compare
Signed-off-by: Nicholas Ludwig <nludwig@microsoft.com>
Signed-off-by: Nicholas Ludwig <nludwig@microsoft.com>
Signed-off-by: Nicholas Ludwig <nludwig@microsoft.com>
Signed-off-by: Nicholas Ludwig <nludwig@microsoft.com>
Two failures, both caused by this PR: 1. sanitize_unit_tests: the ASAN job excludes printk by exact test name, because printk cannot redirect stdout when usersim is linked with the static CRT. Converting printk to per-execution-type variants renamed it to printk-jit/-native/-interpret, so the exclusion silently stopped matching and all three variants ran and failed. Widen the filter to ~printk*. 2. jit_native_test_coverage: the two ebpf_stress_tests_km baseline entries are stale. Those JIT stress tests no longer exist, so the guard correctly reported the entries as stale. Remove them. Also add the license header to the allow list, and emit it when the file is regenerated, so the file satisfies the pre-commit license check. The multi_attach_concurrency_test1 failure in driver_native_only_tests is a pre-existing flake in tests/socket/socket_tests.cpp, which this PR does not modify. See issue 4947. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: a8d41ea3-605c-47c0-8742-8d669eb50812
The coverage guard (scripts/check_jit_native_test_coverage.ps1, its allow list, the jit_native_test_coverage CI job, and the accompanying docs section) is being split into its own pull request. It reports a backlog of test cases that still need native equivalents, so landing it alongside this change would block this PR on work that is not yet complete. This PR now contains only the native test equivalents plus the ~printk* sanitizer filter fix that those tests require. The guard is preserved on the jit-native-coverage-guard branch. Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com> Copilot-Session: a8d41ea3-605c-47c0-8742-8d669eb50812
Nicholas L (nmlud21)
force-pushed
the
native-program-test-coverage
branch
from
August 31, 2026 21:42
010fb35 to
2eb07b9
Compare
Nicholas L (nmlud21)
marked this pull request as ready for review
August 31, 2026 21:57
Nicholas L (nmlud21)
requested review from
Alan Jowett (Alan-Jowett),
Andrew Beltrano (abeltrano),
Dave Thaler (dthaler),
Laksh (lakshk98),
Matthew Ige (matthewige),
Maksim S. (maxsud),
D. Michael Agun (mikeagun),
Michael Friesen (mtfriesen),
poornagmsft,
Anurag Saxena (saxena-anurag) and
Shankar Seal (shankarseal)
as code owners
August 31, 2026 21:57
Nicholas L (nmlud21)
changed the title
Nicholas L (nmlud21)
changed the title
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Adds native program equivalents for tests that previously only ran under JIT or the
interpreter. Progress toward #5439, which tracks ensuring every JIT-covered scenario is
also covered natively before JIT support is withdrawn.
Ten test cases gained native coverage across end_to_end and sample_ext_app.
Testing
Documentation
No
Installation
No