c12e7e39fb
Rescue deterministic dashboard route/API tests from the curated skip-list and quarantine the remaining stale suites. - Remove dashboard src route/API tests from the curated skip-list once they either run in backfill or move to quarantine. - Add dated quarantine coverage for stale mission, planning, and session reconnect suites. - Update rescued route/API test expectations and FNXC comments to match current deterministic behavior. Files changed: .../dashboard/src/__tests__/chat-manager.test.ts | 4 ++ .../dashboard/src/__tests__/evals-routes.test.ts | 8 +++- .../src/__tests__/github-tracking-delete.test.ts | 4 ++ ...ithub-tracking-periodic-reconcile-sweep.test.ts | 8 +++- .../src/__tests__/insights-routes.test.ts | 12 ++++-- .../__tests__/routes-run-audit-goal-events.test.ts | 6 ++- .../src/__tests__/routes-run-cited-goals.test.ts | 6 ++- .../shared-branch-group-entry-points.test.ts | 6 +-- packages/dashboard/src/__tests__/usage.test.ts | 4 ++ packages/dashboard/vitest.config.ts | 6 +++ scripts/lib/dashboard-curated-skiplist.json | 44 ---------------------- scripts/lib/test-quarantine.json | 15 ++++++++ 12 files changed, 66 insertions(+), 57 deletions(-) Fusion-Task-Id: FN-6444 Fusion-Task-Lineage: f314da67-d05e-48c5-9c9c-890c28cf0e5b
76 lines
5.7 KiB
JSON
76 lines
5.7 KiB
JSON
{
|
|
"$comment": "Flaky-test quarantine ledger (deletion ratchet \u2014 see AGENTS.md 'Flaky tests: quarantine on sight' and docs/testing.md 'Quarantine ledger and the deletion ratchet'). A test observed failing without a corresponding real bug is quarantined ON SIGHT: add an entry here AND a matching one-line `exclude` entry in that package's vitest config, in the same commit. Every entry needs a non-empty `reason` (link the failing run) and a `quarantinedAt` date \u2014 the entry expires 14 days later, at which point the test file is DELETED unless someone rescues it with evidence it catches real regressions plus a root-cause fix (never appeasement). There is deliberately no loader module and no automation around this file: it is a dated record, the vitest config exclude is the mechanism, and the sweep is policy executed by whoever touches the suite.",
|
|
"entries": [
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/ChatView.regular-composer-no-right-line.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone; ChatView emits act warnings and regular-composer right-line invariant assertion fails. Quarantined instead of widening waits or weakening assertions.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/MissionManager.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone with stale mission hierarchy/progress/status expectations while most cases pass. Quarantined for rescue/delete ratchet instead of assertion appeasement.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/ModalReentry.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone because PlanningModal cases render outside ToastProvider. Quarantined for harness rescue instead of product/source changes.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/ModelSelectorTab.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone across model selector cases because expected Executor Model labels/options are no longer rendered by the current component contract. Quarantined for harness/expectation rescue.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/NewAgentDialog.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone across broad dialog flows with duplicate fetch/update calls and stale favorite labels. Quarantined for focused rescue rather than timeout/assertion appeasement.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/OAuthReloginBanner.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test times out every case under current async/polling behavior. Quarantined instead of increasing test timeouts.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/PlanningModeModal.favorites.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone because PlanningModeModal favorite/keyboard cases render outside ToastProvider. Quarantined for harness rescue.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/PlanningModeModal.questions.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone because PlanningModeModal question/summary cases render outside ToastProvider. Quarantined for harness rescue.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/PlanningModeModal.swipe-back.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard component test fails standalone because PlanningModeModal mobile navigation cases render outside ToastProvider. Quarantined for harness rescue.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/SkillsView.css.test.ts",
|
|
"reason": "FN-6441: orphaned dashboard CSS guardrail fails standalone because runtime-card toggle positioning expectation no longer matches current stylesheet. Quarantined for rescue/delete review without weakening assertion.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/app/components/__tests__/mobile-css.test.tsx",
|
|
"reason": "FN-6441: orphaned dashboard CSS foundation test fails standalone on stale workflow-step-manager modal and breakpoint assertions. Quarantined for rescue/delete review without broad CSS changes.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/src/__tests__/mission-e2e.test.ts",
|
|
"reason": "FN-6444: orphaned dashboard mission API test fails standalone across broad stale mission creation/update/backfill/shared-branch assertions. Quarantined for focused rescue/delete ratchet instead of weakening assertions or editing product route source.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/src/__tests__/planning.test.ts",
|
|
"reason": "FN-6444: orphaned dashboard planning route/API test is slow and fails standalone across stale agent/session mocks plus temp cleanup leakage. Quarantined instead of widening waits/timeouts or weakening assertions.",
|
|
"quarantinedAt": "2026-06-14"
|
|
},
|
|
{
|
|
"file": "packages/dashboard/src/__tests__/session-reconnect.test.ts",
|
|
"reason": "FN-6444/FN-6447: dashboard API backfill shard 1 observed ENOTEMPTY temp cleanup leakage while replaying planning buffered events. Quarantined on sight for focused rescue/delete review instead of adding waits or weakening assertions.",
|
|
"quarantinedAt": "2026-06-14"
|
|
}
|
|
]
|
|
}
|