b545083249
Restore the stable extension suite by quarantining only the dist-barrel recompilation case. - Move the built @fusion/core dist-barrel extension test into its own file. - Re-admit extension.test.ts while keeping the isolated dist-barrel file quarantined. - Update the quarantine ledger and velocity baseline to reflect the narrowed quarantine. Files changed: docs/test-velocity-baseline.md | 10 +- .../src/__tests__/extension-dist-barrel.test.ts | 230 +++++++++++++++++++++ packages/cli/src/__tests__/extension.test.ts | 103 +-------- packages/cli/vitest.config.ts | 5 +- scripts/lib/test-quarantine.json | 4 +- 5 files changed, 247 insertions(+), 105 deletions(-) Fusion-Task-Id: FN-7530 Fusion-Task-Lineage: 7b07540f-689b-4133-b590-a39427095397 Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
4.5 KiB
4.5 KiB
Test velocity baseline
Weekly FN-6612 signal-per-second baseline. Measure and report feedback-loop velocity; do not add slow tests or wire this report into blocking PR checks. The merge gate remains the existing thin Lint, Typecheck, Build, and Gate path.
Latest baseline
- Cycle: 2026-W27
- Captured at: 2026-07-02T08:47:17.721Z
- Timing snapshot:
scripts/test-timings.jsoncaptured at 2026-06-27T05:41:42.568Z - Quarantine ledger:
scripts/lib/test-quarantine.json
Metrics
| Metric | Current | Delta vs previous |
|---|---|---|
Merge gate wall-time (pnpm test:gate) |
7.7s | +778ms |
Boot smoke wall-time (pnpm smoke:boot) |
17.4s | -557ms |
Changed-only test wall-time (pnpm test) |
9.3s | -4.4s |
| Quarantine / flake count | 1 | +1 |
| Deletion-due quarantines | 0 | n/a |
Measurement failures
- None recorded.
Timing snapshot notes
- No stale or missing timing metadata detected in the rendered slowest-file rows.
Slowest 20 test files
| Rank | File | Package | Duration |
|---|---|---|---|
| 1 | packages/dashboard/src/__tests__/insights-routes.test.ts |
@fusion/dashboard | 26.5s |
| 2 | packages/engine/src/runtimes/__tests__/in-process-runtime.test.ts |
@fusion/engine | 24.7s |
| 3 | packages/dashboard/src/__tests__/workflow-routes.test.ts |
@fusion/dashboard | 22.0s |
| 4 | packages/core/src/__tests__/db.test.ts |
@fusion/core | 21.2s |
| 5 | packages/dashboard/app/components/__tests__/GitManagerModal.test.tsx |
@fusion/dashboard | 16.9s |
| 6 | packages/core/src/__tests__/mission-store.test.ts |
@fusion/core | 16.0s |
| 7 | packages/cli/src/__tests__/extension.test.ts |
@runfusion/fusion | 15.7s |
| 8 | packages/dashboard/app/components/__tests__/AgentPromptsManager.test.tsx |
@fusion/dashboard | 14.8s |
| 9 | packages/dashboard/app/components/__tests__/App.test.tsx |
@fusion/dashboard | 14.6s |
| 10 | packages/dashboard/app/components/__tests__/TaskDetailModal.inline-editing-and-integrations.test.tsx |
@fusion/dashboard | 14.1s |
| 11 | packages/dashboard/app/components/__tests__/TaskDetailModal.rendering.test.tsx |
@fusion/dashboard | 13.7s |
| 12 | packages/dashboard/src/__tests__/routes-auth.test.ts |
@fusion/dashboard | 13.6s |
| 13 | packages/core/src/__tests__/agent-store.test.ts |
@fusion/core | 13.4s |
| 14 | packages/engine/src/__tests__/workspace-merger-idempotency.test.ts |
@fusion/engine | 12.7s |
| 15 | packages/engine/src/__tests__/self-healing-workspace.test.ts |
@fusion/engine | 11.8s |
| 16 | packages/engine/src/__tests__/pr-response-run.test.ts |
@fusion/engine | 11.6s |
| 17 | packages/dashboard/app/components/__tests__/ListView.test.tsx |
@fusion/dashboard | 11.3s |
| 18 | plugins/fusion-plugin-compound-engineering/src/__tests__/sync.test.ts |
@fusion-plugin-examples/compound-engineering | 11.0s |
| 19 | packages/dashboard/app/components/__tests__/AgentDetailView.settings.test.tsx |
@fusion/dashboard | 10.7s |
| 20 | packages/dashboard/app/components/__tests__/SecretsView.test.tsx |
@fusion/dashboard | 10.7s |
Quarantine age buckets
| Age bucket | Count |
|---|---|
| 0-6 days | 1 |
| 7-13 days | 0 |
| deletion due (>=14 days) | 0 |
| unknown/future | 0 |
Deletion-due entries
| File | Quarantined at | Age (days) |
|---|---|---|
| — | — | — |
Before / after trend
| Row | Captured at | Gate | Boot smoke | pnpm test |
Quarantine count |
|---|---|---|---|---|---|
| Previous | 2026-06-27T05:43:17.293Z | 6.9s | 18.0s | 13.7s | 0 |
| Latest | 2026-07-02T08:47:17.721Z | 7.7s | 17.4s | 9.3s | 1 |
| Delta | — | +778ms | -557ms | -4.4s | +1 |
Future weekly rows append to scripts/test-velocity-history.json; compare the latest row against the previous row before posting to #leads.
Post to #leads
FN-6612 weekly test velocity: gate 7.7s (+778ms), boot smoke 17.4s (-557ms), pnpm test 9.3s (-4.4s), quarantine ledger 1 (+1). Slowest file: packages/dashboard/src/__tests__/insights-routes.test.ts at 26.5s. Deletion-due quarantines: 0.
How to refresh
pnpm test:velocity -- --measure --write-report
In measure mode, the script runs a non-measured pnpm build preflight before timing pnpm test:gate, pnpm smoke:boot, or pnpm test. The preflight time is setup only and is excluded from lane metrics; if it fails, the Measurement failures section records Build preflight (pnpm build) as the reason. Use --skip-build-preflight only when the workspace is already built by CI.
Report-only regeneration is cheap and does not run any suite:
pnpm test:velocity