1f49cea6c0
Refresh the weekly test velocity baseline after the pnpm test lane recovered. - Update the latest baseline with green gate, boot smoke, and pnpm test timings. - Drop stale timing rows for removed or split test files. - Append the new weekly history entry with current slowest-file data. Files changed: docs/test-velocity-baseline.md | 48 +++++++--------- scripts/test-timings.json | 14 +---- scripts/test-velocity-history.json | 112 +++++++++++++++++++++++++++++++++++++ 3 files changed, 133 insertions(+), 41 deletions(-) Fusion-Task-Id: FN-7092 Fusion-Task-Lineage: 0b2cfa7a-953b-4cf8-ac4b-c81a0580a4e0 Co-authored-by: Fusion (runfusion.ai) <noreply@runfusion.ai>
99 lines
4.5 KiB
Markdown
99 lines
4.5 KiB
Markdown
# Test velocity baseline
|
|
|
|
> Weekly FN-6612 signal-per-second baseline. Measure and report feedback-loop velocity; do **not** add slow tests or wire this report into blocking PR checks. The merge gate remains the existing thin Lint, Typecheck, Build, and Gate path.
|
|
|
|
## Latest baseline
|
|
|
|
- Cycle: **2026-W26**
|
|
- Captured at: **2026-06-27T05:43:17.293Z**
|
|
- Timing snapshot: `scripts/test-timings.json` captured at **2026-06-27T05:41:42.568Z**
|
|
- Quarantine ledger: `scripts/lib/test-quarantine.json`
|
|
|
|
## Metrics
|
|
|
|
| Metric | Current | Delta vs previous |
|
|
|---|---:|---:|
|
|
| Merge gate wall-time (`pnpm test:gate`) | 6.9s | -1.2s |
|
|
| Boot smoke wall-time (`pnpm smoke:boot`) | 18.0s | +436ms |
|
|
| Changed-only test wall-time (`pnpm test`) | 13.7s | n/a |
|
|
| Quarantine / flake count | 0 | 0 |
|
|
| Deletion-due quarantines | 0 | n/a |
|
|
|
|
## Measurement failures
|
|
|
|
- None recorded.
|
|
|
|
## Timing snapshot notes
|
|
|
|
- No stale or missing timing metadata detected in the rendered slowest-file rows.
|
|
|
|
## Slowest 20 test files
|
|
|
|
| Rank | File | Package | Duration |
|
|
|---:|---|---|---:|
|
|
| 1 | `packages/dashboard/src/__tests__/insights-routes.test.ts` | @fusion/dashboard | 26.5s |
|
|
| 2 | `packages/engine/src/runtimes/__tests__/in-process-runtime.test.ts` | @fusion/engine | 24.7s |
|
|
| 3 | `packages/dashboard/src/__tests__/workflow-routes.test.ts` | @fusion/dashboard | 22.0s |
|
|
| 4 | `packages/core/src/__tests__/db.test.ts` | @fusion/core | 21.2s |
|
|
| 5 | `packages/dashboard/app/components/__tests__/GitManagerModal.test.tsx` | @fusion/dashboard | 16.9s |
|
|
| 6 | `packages/core/src/__tests__/mission-store.test.ts` | @fusion/core | 16.0s |
|
|
| 7 | `packages/cli/src/__tests__/extension.test.ts` | @runfusion/fusion | 15.7s |
|
|
| 8 | `packages/dashboard/app/components/__tests__/AgentPromptsManager.test.tsx` | @fusion/dashboard | 14.8s |
|
|
| 9 | `packages/dashboard/app/components/__tests__/App.test.tsx` | @fusion/dashboard | 14.6s |
|
|
| 10 | `packages/dashboard/app/components/__tests__/TaskDetailModal.inline-editing-and-integrations.test.tsx` | @fusion/dashboard | 14.1s |
|
|
| 11 | `packages/dashboard/app/components/__tests__/TaskDetailModal.rendering.test.tsx` | @fusion/dashboard | 13.7s |
|
|
| 12 | `packages/dashboard/src/__tests__/routes-auth.test.ts` | @fusion/dashboard | 13.6s |
|
|
| 13 | `packages/core/src/__tests__/agent-store.test.ts` | @fusion/core | 13.4s |
|
|
| 14 | `packages/engine/src/__tests__/workspace-merger-idempotency.test.ts` | @fusion/engine | 12.7s |
|
|
| 15 | `packages/engine/src/__tests__/self-healing-workspace.test.ts` | @fusion/engine | 11.8s |
|
|
| 16 | `packages/engine/src/__tests__/pr-response-run.test.ts` | @fusion/engine | 11.6s |
|
|
| 17 | `packages/dashboard/app/components/__tests__/ListView.test.tsx` | @fusion/dashboard | 11.3s |
|
|
| 18 | `plugins/fusion-plugin-compound-engineering/src/__tests__/sync.test.ts` | @fusion-plugin-examples/compound-engineering | 11.0s |
|
|
| 19 | `packages/dashboard/app/components/__tests__/AgentDetailView.settings.test.tsx` | @fusion/dashboard | 10.7s |
|
|
| 20 | `packages/dashboard/app/components/__tests__/SecretsView.test.tsx` | @fusion/dashboard | 10.7s |
|
|
|
|
## Quarantine age buckets
|
|
|
|
| Age bucket | Count |
|
|
|---|---:|
|
|
| 0-6 days | 0 |
|
|
| 7-13 days | 0 |
|
|
| deletion due (>=14 days) | 0 |
|
|
| unknown/future | 0 |
|
|
|
|
### Deletion-due entries
|
|
|
|
| File | Quarantined at | Age (days) |
|
|
|---|---:|---:|
|
|
| — | — | — |
|
|
|
|
## Before / after trend
|
|
|
|
| Row | Captured at | Gate | Boot smoke | `pnpm test` | Quarantine count |
|
|
|---|---|---:|---:|---:|---:|
|
|
| Previous | 2026-06-27T02:02:13.530Z | 8.1s | 17.6s | unavailable | 0 |
|
|
| Latest | 2026-06-27T05:43:17.293Z | 6.9s | 18.0s | 13.7s | 0 |
|
|
| Delta | — | -1.2s | +436ms | n/a | 0 |
|
|
|
|
_Future weekly rows append to `scripts/test-velocity-history.json`; compare the latest row against the previous row before posting to #leads._
|
|
|
|
## Post to #leads
|
|
|
|
```text
|
|
FN-6612 weekly test velocity: gate 6.9s (-1.2s), boot smoke 18.0s (+436ms), pnpm test 13.7s (n/a), quarantine ledger 0 (0). Slowest file: packages/dashboard/src/__tests__/insights-routes.test.ts at 26.5s. Deletion-due quarantines: 0.
|
|
```
|
|
|
|
## How to refresh
|
|
|
|
```bash
|
|
pnpm test:velocity -- --measure --write-report
|
|
```
|
|
|
|
In measure mode, the script runs a non-measured `pnpm build` preflight before timing `pnpm test:gate`, `pnpm smoke:boot`, or `pnpm test`. The preflight time is setup only and is excluded from lane metrics; if it fails, the Measurement failures section records `Build preflight (pnpm build)` as the reason. Use `--skip-build-preflight` only when the workspace is already built by CI.
|
|
|
|
Report-only regeneration is cheap and does not run any suite:
|
|
|
|
```bash
|
|
pnpm test:velocity
|
|
```
|