ci: speed up validation feedback by JustYannicc · Pull Request #591 · SuperCmdLabs/SuperCmd

JustYannicc · 2026-07-04T19:31:20Z

What changed

Reordered project checks so i18n, main build/typecheck, and renderer typecheck run before unit and perf tests.
Added npm run test:ci, backed by scripts/run-node-tests.mjs --exclude-perf, so CI unit tests do not rerun browser/file/root perf harnesses owned by test:perf:ci.
Added structured perf budget evidence for browser, file, and root search CI logs, including budget utilization.

Why

TypeScript and i18n failures were previously hidden behind the full unit suite and perf budgets.
CI was duplicating standalone perf harness work in npm test and npm run test:perf:ci.
File perf CI passed budgets but did not leave the same audit-friendly evidence as browser/root perf logs.

Compatibility impact

Validation-only change; no app runtime behavior is changed.
npm test remains unchanged for the broad local test sweep.
CI now uses npm run test:ci for non-perf Node tests and keeps perf budgets in npm run test:perf:ci.

How tested

SUPERCMD_SKIP_ELECTRON_TESTS=1 npm run check:i18n
SUPERCMD_SKIP_ELECTRON_TESTS=1 npm run build:main
SUPERCMD_SKIP_ELECTRON_TESTS=1 npm run typecheck:renderer
SUPERCMD_SKIP_ELECTRON_TESTS=1 npm run test:ci
SUPERCMD_SKIP_ELECTRON_TESTS=1 npm run test:perf:ci
SUPERCMD_SKIP_ELECTRON_TESTS=1 npm run build:renderer
Focused: SUPERCMD_SKIP_ELECTRON_TESTS=1 SUPERCMD_PERF_CI=1 SUPERCMD_PERF_REPORT=1 node --test scripts/test-file-search-perf-harness.mjs

Performance evidence

Before local baseline: npm test passed in 4.90s and included perf harness work; test:perf:ci passed in 30.11s.
After local validation: test:ci passed in 3.70s, running 73 Node test files and excluding 3 perf harness files; test:perf:ci passed in 28.59s.
Final browser 50k CI evidence: index 675.62ms / 7000ms, ranked max avg 20.25ms / 260ms, ordered max avg 19.22ms / 260ms, ranked event-loop delay 415.84ms / 7500ms, ordered event-loop delay 385.09ms / 7500ms.
Final file CI evidence: 33,964 indexed entries, initial index 929.898ms / 60000ms, path query p95 15.779ms / 3000ms, event-loop p95 6.432ms / 5000ms, cleanup completed.
Final root CI evidence: optimized median 599.912ms / 900ms, indexed median 86.795ms / 350ms, compile median 63.686ms / 500ms, indexed speedup 21.873x / 1.05x minimum.

Stack validation

Base commit verified at 206eab8280a2eb91a57e4e74ea6df99e45a55cb4.
Before timings: i18n 0.19s, main build/typecheck 1.46s, renderer typecheck 3.59s, renderer build 4.44s.
Final timings: i18n 0.16s, main build/typecheck 1.35s, renderer typecheck 3.43s, renderer build 4.10s.
Main process TypeScript is clean via npm run build:main.
Renderer TypeScript is clean via npm run typecheck:renderer.
Codex LSP: TypeScript diagnostics clean for touched .mjs files; Biome unavailable for JSON; YAML LSP configured but crashed due missing vscode-languageserver-protocol.

Replaces

Replaces the prior CI ordering where npm test and npm run test:perf:ci ran before i18n/typecheck feedback.

…perf-wave2-integration-stack-20260704

…perf-wave2-integration-stack-20260704 # Conflicts: # src/renderer/src/raycast-api/list-runtime.tsx

…perf-wave2-integration-stack-20260704 # Conflicts: # scripts/bench-script-command-discovery.mjs # scripts/benchmark-file-search-delete-batch.mjs # scripts/lib/script-command-runner-harness.mjs # scripts/lib/ts-import.mjs # scripts/test-file-search-delete-batch.mjs # scripts/test-script-command-runner.mjs # src/main/file-search-index.ts # src/main/main.ts

…perf-wave2-integration-stack-20260704 # Conflicts: # scripts/lib/script-command-runner-harness.mjs # scripts/lib/ts-import.mjs # scripts/test-extension-lifecycle-sandbox.mjs # scripts/test-script-command-runner.mjs # src/main/main.ts # src/renderer/src/ExtensionView.tsx

…perf-wave2-integration-stack-20260704 # Conflicts: # .github/workflows/project-checks.yml # scripts/test-root-search-perf.mjs # src/renderer/src/CameraExtension.tsx # src/renderer/src/raycast-api/list-runtime.tsx

…-integration-stack-20260704

…e3-integration-stack-20260704

…erf-wave3-integration-stack-20260704 # Conflicts: # package.json # scripts/measure-extension-bundle-cache.mjs # scripts/test-icon-runtime-file-icon-cache.mjs # src/main/extension-runner.ts # src/renderer/src/components/HiddenExtensionRunners.tsx # src/renderer/src/raycast-api/icon-runtime-render.tsx

…/perf-wave3-integration-stack-20260704 # Conflicts: # scripts/test-browser-search-performance.mjs # scripts/test-root-search-perf.mjs

…ignal' into codex/perf-wave4-ci-validation-signal # Conflicts: # .github/workflows/project-checks.yml # scripts/test-file-search-perf-harness.mjs

JustYannicc · 2026-07-05T00:38:40Z

Superseded by #600, which consolidates the CI validation feedback changes and reruns the full requested project-checks stack.

JustYannicc added 30 commits July 3, 2026 22:19

Batch AI chat stream updates

5ae51b3

Batch cursor prompt stream updates

18481a2

perf(ai): batch Raycast useAI streaming

be66d99

ci: add project regression checks

a1d8c7b

Add bundled TS import helper for tests

a1225c6

fix(types): make renderer typecheck clean

0799e71

ci(claude): fix review action on fork PRs

835bf3a

fix(i18n): restore Italian parity checks

4605c88

fix(pnpm): approve native build scripts

d4c6a9f

perf: cache local icon asset existence checks

986c87a

Virtualize emoji grid list rendering

9e4eed3

Memoize Phosphor icon resolution

5245253

Cache emoji caret session state

cfe2ec3

Stabilize list item registry order

83d6b0b

perf(launcher): window command list rendering

e03ad3e

perf(grid): virtualize grid rendering

f07b554

perf(settings): coalesce AI status polling

6f06eb4

perf(icons): coalesce file icon IPC

949a6fd

Remove root search ranking diagnostics

8ca7ec9

perf: optimize file search delete batches

fb857f2

perf: memoize frecency sorting defaults

dee7108

Avoid interval file-index rebuilds

68cb050

Avoid full script reads for command headers

9f246ce

Optimize root search command scoring

12f951e

perf(runtime): reduce extension and menubar churn

a2737ce

Speed up path-like file search queries

7ed6c2a

Add file search perf harness

dff8539

perf(browser-search): index hot query path

caa78e1

fix(browser-search): narrow indexed nickname candidates

321d103

test: trim benchmark script eof whitespace

644e72d

JustYannicc added 26 commits July 4, 2026 13:21

Merge remote-tracking branch 'refs/remotes/origin/pr/555' into codex/…

ba47b63

…perf-wave2-integration-stack-20260704

Merge remote-tracking branch 'refs/remotes/origin/pr/556' into codex/…

fc4d48e

…perf-wave2-integration-stack-20260704

Merge remote-tracking branch 'refs/remotes/origin/pr/558' into codex/…

c710784

…perf-wave2-integration-stack-20260704

Merge remote-tracking branch 'refs/remotes/origin/pr/572' into codex/…

55817f4

…perf-wave2-integration-stack-20260704 # Conflicts: # src/renderer/src/raycast-api/list-runtime.tsx

fix(list): preserve conditional virtual row behavior

34a04d4

perf(search): reuse renderer ranking work

33194c1

perf(runtime): reduce menu bar and background churn

4c180c6

perf(raycast): reduce runtime hook and registry churn

fbe3ece

perf(files): reduce main-process search and IPC cost

6bd8e50

perf(media): reduce audio and overlay churn

d38e957

perf(startup): reduce renderer and asset load cost

fc80ea6

test(perf): add search regression budgets

531a188

Merge branch 'codex/perf-wave3-renderer-search' into codex/perf-wave3…

73b25ec

…-integration-stack-20260704

Merge branch 'codex/perf-wave3-file-index-main' into codex/perf-wave3…

1411f8b

…-integration-stack-20260704

Merge branch 'codex/perf-wave3-raycast-runtime' into codex/perf-wave3…

ca9d081

…-integration-stack-20260704

Merge branch 'codex/perf-wave3-ai-media-ui-retry' into codex/perf-wav…

81166b3

…e3-integration-stack-20260704

Merge branch 'codex/perf-wave3-validation-harnesses-retry' into codex…

33d0c68

…/perf-wave3-integration-stack-20260704 # Conflicts: # scripts/test-browser-search-performance.mjs # scripts/test-root-search-perf.mjs

test(perf): support CommonJS facade harness exports

206eab8

Improve CI validation signal

bb25b1b

ci: speed up validation feedback

0af9037

Merge remote-tracking branch 'origin/codex/perf-wave4-ci-validation-s…

c019107

…ignal' into codex/perf-wave4-ci-validation-signal # Conflicts: # .github/workflows/project-checks.yml # scripts/test-file-search-perf-harness.mjs

test: fix file perf report emission

69561a6

JustYannicc changed the title ~~ci: improve validation feedback signal~~ ci: speed up validation feedback Jul 4, 2026

JustYannicc mentioned this pull request Jul 5, 2026

fix(validation): consolidate project checks #600

Open

JustYannicc closed this Jul 5, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

ci: speed up validation feedback#591

ci: speed up validation feedback#591
JustYannicc wants to merge 118 commits into
SuperCmdLabs:mainfrom
JustYannicc:codex/perf-wave4-ci-validation-signal

JustYannicc commented Jul 4, 2026 •

edited

Loading

Uh oh!

JustYannicc commented Jul 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Uh oh!

Conversation

JustYannicc commented Jul 4, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What changed

Why

Compatibility impact

How tested

Performance evidence

Stack validation

Replaces

Uh oh!

JustYannicc commented Jul 5, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

JustYannicc commented Jul 4, 2026 •

edited

Loading