f150a176b4
Add a weekly baseline workflow for tracking test feedback-loop speed and flake pressure. - Add a stdlib-only script to record gate and pnpm test timings alongside slowest test files and quarantine counts. - Publish generated markdown and JSON baseline artifacts for #leads reporting. - Document the weekly refresh process and add package scripts plus coverage for the baseline helper. Files changed: docs/test-feedback-loop-baseline.md | 48 ++++++ docs/test-feedback-loop-baselines.json | 122 ++++++++++++++ docs/testing.md | 12 ++ package.json | 1 + scripts/__tests__/test-feedback-baseline.test.mjs | 90 ++++++++++ scripts/test-feedback-baseline.mjs | 192 ++++++++++++++++++++++ 6 files changed, 465 insertions(+) Fusion-Task-Id: FN-6612 Fusion-Task-Lineage: 72bdc070-50e3-4e6b-a07d-3b8aeb9c2e92
49 lines
3.3 KiB
Markdown
49 lines
3.3 KiB
Markdown
# Test feedback-loop baseline
|
|
|
|
> Publish this page's latest-cycle summary in #leads each week. The objective is signal-per-second: keep the merge gate thin, keep `pnpm test` flat or faster, and ratchet flaky/low-signal tests toward rescue or deletion.
|
|
|
|
## Latest #leads summary
|
|
|
|
- Cycle: **2026-W25** (2026-06-18T02:11:11.998Z)
|
|
- Gate suite wall-time: **7.2s** (trend: n/a)
|
|
- `pnpm test` wall-time: **36.9s** (trend: n/a)
|
|
- Flake/quarantine count: **5** ledger entries across **4** files
|
|
- Timing snapshot source: `scripts/test-timings.json` captured at **2026-06-03T23:45:49.672Z**
|
|
|
|
## Slowest 20 test files
|
|
|
|
| Rank | File | Package | Duration |
|
|
|---:|---|---|---:|
|
|
| 1 | `packages/engine/src/__tests__/reliability-interactions/shared-branch-group-lifecycle.test.ts` | @fusion/engine | 13.9s |
|
|
| 2 | `packages/core/src/__tests__/agent-store.test.ts` | @fusion/core | 11.6s |
|
|
| 3 | `packages/dashboard/src/__tests__/routes-agents.test.ts` | @fusion/dashboard | 11.2s |
|
|
| 4 | `packages/core/src/__tests__/mission-store.test.ts` | @fusion/core | 10.7s |
|
|
| 5 | `packages/core/src/__tests__/db.test.ts` | @fusion/core | 10.1s |
|
|
| 6 | `packages/dashboard/src/__tests__/routes-git.test.ts` | @fusion/dashboard | 9.4s |
|
|
| 7 | `packages/engine/src/__tests__/reliability-interactions/branch-group-automerge-precedence.test.ts` | @fusion/engine | 9.0s |
|
|
| 8 | `packages/engine/src/__tests__/merger-ai.test.ts` | @fusion/engine | 8.7s |
|
|
| 9 | `packages/engine/src/__tests__/reliability-interactions/branch-group-merge-routing.test.ts` | @fusion/engine | 8.4s |
|
|
| 10 | `packages/engine/src/__tests__/reliability-interactions/branch-group-promotion-gate.test.ts` | @fusion/engine | 8.4s |
|
|
| 11 | `packages/core/src/__tests__/task-documents.test.ts` | @fusion/core | 8.3s |
|
|
| 12 | `packages/engine/src/runtimes/__tests__/in-process-runtime.test.ts` | @fusion/engine | 7.8s |
|
|
| 13 | `packages/cli/src/__tests__/extension.test.ts` | @runfusion/fusion | 7.0s |
|
|
| 14 | `packages/core/src/__tests__/run-audit.test.ts` | @fusion/core | 6.9s |
|
|
| 15 | `packages/engine/src/__tests__/reliability-interactions/branch-group-promotion.test.ts` | @fusion/engine | 6.1s |
|
|
| 16 | `packages/dashboard/src/__tests__/routes-planning.test.ts` | @fusion/dashboard | 5.6s |
|
|
| 17 | `packages/core/src/__tests__/store-merge-queue.test.ts` | @fusion/core | 5.2s |
|
|
| 18 | `packages/dashboard/app/components/__tests__/FileEditor.test.tsx` | @fusion/dashboard | 5.1s |
|
|
| 19 | `packages/engine/src/__tests__/reliability-interactions/integration-worktree-state.test.ts` | @fusion/engine | 4.9s |
|
|
| 20 | `packages/engine/src/__tests__/self-healing-already-merged.real-git.test.ts` | @fusion/engine | 4.9s |
|
|
|
|
## Trend
|
|
|
|
| Cycle | Captured at | Gate suite | `pnpm test` | Quarantine entries | Quarantined files |
|
|
|---|---|---:|---:|---:|---:|
|
|
| 2026-W25 | 2026-06-18T02:11:11.998Z | 7.2s | 36.9s | 5 | 4 |
|
|
|
|
## Operating rules
|
|
|
|
- Record a new row weekly with `node scripts/test-feedback-baseline.mjs --record --gate-ms <ms> --test-ms <ms>` after running `pnpm test:gate` and `pnpm test`.
|
|
- Use the slowest-file list as the candidate queue for FN-5048 rewrites or deletion-ratchet review; do not add coverage for its own sake.
|
|
- Quarantined tests remain on the 14-day rescue-or-delete clock in `scripts/lib/test-quarantine.json`; deleting a low-signal expired test is a valid positive outcome.
|