root/fusion
1
0
Fork 0
Code Issues Pull Requests Actions 1 Packages Projects Releases Wiki Activity

test: quarantine 3 failing CI full-suite tests (#1775)

Browse Source 
## Summary

Quarantine 3 test files consistently failing on the non-blocking
full-suite CI on `main`. Per the AGENTS.md deletion-ratchet policy, each
is added to `scripts/lib/test-quarantine.json` with a matching exclude
in its package's vitest config. Tests will be deleted after 14 days
unless rescued with a root-cause fix.

## Quarantined Tests

| File | Shard | Failure | CI Run |
|------|-------|---------|--------|
|
`engine/src/__tests__/self-healing-fn-5488-fast-path-regressions.test.ts`
| 1/4 | `expected +0 to be 1` + `parseFileScopeFromPrompt is not a
function` | [run
28206337202](https://github.com/Runfusion/Fusion/actions/runs/28206337202)
|
| `engine/src/__tests__/in-review-merge-stall-deadlock-recovery.test.ts`
| 2/4 | `expected 'FN-5485' to be null` | [run
28206337202](https://github.com/Runfusion/Fusion/actions/runs/28206337202)
|
| `dashboard/app/components/__tests__/DevServerView.mobile.test.tsx` |
4/4 | `expected +0 to be 1` (mobile CSS structure) | [run
28206337202](https://github.com/Runfusion/Fusion/actions/runs/28206337202)
|

## Verification

- `pnpm test:gate` passes (313 core + 58 ci-shape tests)
- `pnpm lint` clean


<!-- stage-review-badge-begin -->

---

<a href="https://stagereview.app/Runfusion/Fusion/pull/1775">
  <picture>
<source media="(prefers-color-scheme: dark)"
srcset="https://stagereview.app/assets/gh-open-in-stage-dark.svg">
<img src="https://stagereview.app/assets/gh-open-in-stage-light.svg"
alt="Open in Stage">
  </picture>
</a>

<!-- stage-review-badge-end -->

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

* **Chores**
* Updated the test quarantine list to exclude several flaky or failing
tests from routine dashboard and engine test runs.
* Added records for newly quarantined tests, including the date they
were marked and the CI issue they were linked to.
* Continued using the quarantine list across relevant test projects to
keep CI runs more stable.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
This commit is contained in:
gsxdsm
2026-06-25 17:22:23 -07:00
committed by GitHub
parent 0346ea0f6b 5ce577842e
commit 55b9c548ad
3 changed files with 32 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
packages/dashboard/vitest.config.ts
View File

@@ -319,7 +319,13 @@ FN-6860 rescued dev-server-process by settling stdout detection and fallback-pro
FNXC:DashboardTestQuarantine 2026-06-22-18:05:
FN-6937 verified that FN-6860's claimed session-cross-tab ledger removal had not landed: the file was active because this exclude list was empty, but `test-quarantine.json` still carried the stale 2026-06-19 row. The repeated loaded `dashboard-api-quality-backfill` runs and lock-holder mutation proof confirmed FN-6742's rescue still holds, so remove the orphaned ledger row and keep this list empty to restore ledger↔config lockstep.
*/
const quarantinedDashboardTests: string[] = [];
/*
FNXC:DashboardTestQuarantine 2026-06-25-09:50:
Quarantine DevServerView.mobile.test.tsx: CI full-suite shard 4/4 fails with 'expected +0 to be 1' on the mobile CSS structure assertion. Under the deletion ratchet — see scripts/lib/test-quarantine.json.
*/
const quarantinedDashboardTests: string[] = [
"app/components/__tests__/DevServerView.mobile.test.tsx",
];
const qualityApiTests = [
// Critical HTTP/server behavior: auth, task/project/settings mutation,

8
packages/engine/vitest.config.ts
View File

@@ -120,6 +120,14 @@ export default defineConfig({
// / `test:all` invoked from the root `test:full` script.
"src/**/*.slow.test.ts",
/*
FNXC:EngineTests 2026-06-25-09:50:
Quarantine self-healing-fn-5488-fast-path-regressions.test.ts: CI full-suite shard 1/4 fails with 'expected +0 to be 1' and 'this.store.parseFileScopeFromPrompt is not a function'. No corresponding source bug in recent changes.
Quarantine in-review-merge-stall-deadlock-recovery.test.ts: CI full-suite shard 2/4 fails with 'expected FN-5485 to be null'. Self-healing FN-5488 overlap blocker behavior is flaky under CI load.
Both under the deletion ratchet — see scripts/lib/test-quarantine.json.
*/
"src/__tests__/self-healing-fn-5488-fast-path-regressions.test.ts",
"src/__tests__/in-review-merge-stall-deadlock-recovery.test.ts",
/*
FNXC:EngineTests 2026-06-16-19:05:
FN-6492 verification caught cli-agent-executor as a package-lane-only flake: the hard-cancel assertion failed once and left an ENOTEMPTY temp hook directory, then the file passed in isolation. Quarantine the whole file under the deletion ratchet instead of weakening timing or process assertions.

18
scripts/lib/test-quarantine.json
View File

@@ -1,4 +1,20 @@
{
"$comment": "Flaky-test quarantine ledger (deletion ratchet — see AGENTS.md 'Flaky tests: quarantine on sight' and docs/testing.md 'Quarantine ledger and the deletion ratchet'). A test observed failing without a corresponding real bug is quarantined ON SIGHT: add an entry here AND a matching one-line `exclude` entry in that package's vitest config, in the same commit. Every entry needs a non-empty `reason` (link the failing run) and a `quarantinedAt` date — the entry expires 14 days later, at which point the test file is DELETED unless someone rescues it with evidence it catches real regressions plus a root-cause fix (never appeasement). There is deliberately no loader module and no automation around this file: it is a dated record, the vitest config exclude is the mechanism, and the sweep is policy executed by whoever touches the suite.",
"entries": []
"entries": [
{
"file": "packages/engine/src/__tests__/self-healing-fn-5488-fast-path-regressions.test.ts",
"reason": "Failing in CI full-suite shard 1/4: 'expected +0 to be 1' + 'this.store.parseFileScopeFromPrompt is not a function'. Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
"quarantinedAt": "2026-06-25"
},
{
"file": "packages/engine/src/__tests__/in-review-merge-stall-deadlock-recovery.test.ts",
"reason": "Failing in CI full-suite shard 2/4: 'expected FN-5485 to be null'. Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
"quarantinedAt": "2026-06-25"
},
{
"file": "packages/dashboard/app/components/__tests__/DevServerView.mobile.test.tsx",
"reason": "Failing in CI full-suite shard 4/4: 'expected +0 to be 1' (mobile CSS structure assertion). Run: https://github.com/Runfusion/Fusion/actions/runs/28206337202",
"quarantinedAt": "2026-06-25"
}
]
}