Skip to content

[lldb] Discern embedded swift tests that can't run vs buggy ones - #13545

Open
augusto2112 wants to merge 2 commits into
swiftlang:stable/21.xfrom
augusto2112:embedded-decorator-change
Open

[lldb] Discern embedded swift tests that can't run vs buggy ones#13545
augusto2112 wants to merge 2 commits into
swiftlang:stable/21.xfrom
augusto2112:embedded-decorator-change

Conversation

@augusto2112

@augusto2112 augusto2112 commented Jul 28, 2026

Copy link
Copy Markdown
`@skipEmbeddedSwift` doesn't really tell us if the test is skipped
because there's a bug vs tests that simply can't run in embedded swift
mode (for example, dylibs, objc interop, resiliency, etc).

Introduce requiresNonEmbeddedSwift to mean "this can't run in embedded
swift mode" and leave skipEmbeddedSwift to identify tests that should be
fixed.

The split was measured by removing every annotation and running
check-lldb-swift in the swiftembed variant:

                                          annotations   test files
  moved to requiresNonEmbeddedSwift               349          268
  removed, the test already passes                 25           18
  kept as skipEmbeddedSwift (a bug to fix)        101           85
                                          -----------   ----------
  before                                          475          371

Assisted-by: claude

@augusto2112

Copy link
Copy Markdown
Author

@swift-ci test

@augusto2112
augusto2112 force-pushed the embedded-decorator-change branch from 562209c to d53524a Compare July 28, 2026 23:31
@augusto2112

Copy link
Copy Markdown
Author

@swift-ci test

@augusto2112
augusto2112 force-pushed the embedded-decorator-change branch from d53524a to cadcabd Compare July 29, 2026 23:13
@augusto2112

Copy link
Copy Markdown
Author

@swift-ci test

@augusto2112
augusto2112 marked this pull request as ready for review July 30, 2026 02:50
@augusto2112
augusto2112 requested a review from a team as a code owner July 30, 2026 02:50
@augusto2112

Copy link
Copy Markdown
Author

@swift-ci test Windows

`@skipEmbeddedSwift` doesn't really tell us if the test is skipped
because there's a bug vs tests that simply can't run in embedded swift
mode (for example, dylibs, objc interop, resiliency, etc).

Introduce requiresNonEmbeddedSwift to mean "this can't run in embedded
swift mode" and leave skipEmbeddedSwift to identify tests that should be
fixed.

The split was measured by removing every annotation and running
check-lldb-swift in the swiftembed variant:

                                          annotations   test files
  moved to requiresNonEmbeddedSwift               369          284
  narrowed to skipEmbeddedSwiftOnLinux              2            2
  removed, the test already passes                 21           16
  kept as skipEmbeddedSwift (a bug to fix)         83           73
                                          -----------   ----------
  before                                          475          371

The test-file column adds up to more than 371 because four files have
annotations in more than one row.

That first measurement only covered macOS arm64. CI also covers macOS x86_64
and Linux x86_64, where four of the tests it had cleared still fail, so those
keep an annotation:

  TestSwiftArchetypeResolution  skipEmbeddedSwiftOnLinux: the inferior does not
                                link, undefined reference to arc4random_buf
                                from the embedded stdlib's hashing seed.
  TestSwiftCommandMemoryFind    skipEmbeddedSwiftOnLinux: `memory find -e`
                                reports "data not found within the range".
  TestSwiftStepping             skipEmbeddedSwift: steps to line 174 instead of
                                172 on x86_64, and hits the same arc4random_buf
                                link failure on Linux.
  TestSwiftTypes                skipEmbeddedSwift: `frame variable --raw
                                float80` crashes LLDB with "80 != 128". Float80
                                only exists on x86_64, which is why arm64
                                passed.

Assisted-by: claude
@augusto2112
augusto2112 force-pushed the embedded-decorator-change branch from cadcabd to 3110ac1 Compare July 30, 2026 19:22
@augusto2112

Copy link
Copy Markdown
Author

@swift-ci test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant