feat(FN-3394): add evals dashboard view with API routes and client hooks

Adds a full evals dashboard view (FN-3394) with a client hook, server-side read routes, and navigation integration across the Header and mobile nav, backed by comprehensive tests. Wires Hermes chat message tools with mailbox behavior documentation (FN-3620), and extends the agent heartbeat and tools

Fusion-Task-Id: FN-3394
This commit is contained in:
Fusion
2026-05-07 17:20:35 -07:00
committed by gsxdsm
parent f894bdc1d6
commit f43a5fd029
21 changed files with 1084 additions and 7 deletions

View File

@@ -277,6 +277,7 @@ Intentional exclusions from shared snapshots:
### Task Evaluations
- `EvalStore` (`eval-store.ts`, `eval-types.ts`) persists eval runs and task-level eval outcomes.
- Dashboard/API surface is implemented under `/api/evals` (`packages/dashboard/src/evals-routes.ts`) with `EvalsView.tsx` in the app.
- Backed by `eval_runs`, `eval_task_results`, and `eval_run_events`.
- Data model stores structured scoring/evidence/signal payloads plus durable `taskSnapshot` metadata so historical eval results remain readable even if the live task row later changes or is removed.
- Lifecycle safeguards mirror other core stores: deterministic list ordering, transition guards, terminal immutability for run rows, and active-run conflict protection for scheduled/task-completion triggers.
@@ -642,6 +643,7 @@ Key server capabilities:
- Note: this **hyphenated `dev-server-*` family is the canonical runtime owner** today; see `docs/dev-server-module-boundary-audit.md` for the FN-2212 boundary/consolidation audit covering parallel `devserver-*` modules.
- Plugin management routes (`plugin-routes.ts`)
- Insights routes (`insights-routes.ts`)
- Evals routes (`evals-routes.ts`) — `/api/evals` read surface for eval result listing/filtering, drill-down detail, and eval run metadata
- Research routes (`research-routes.ts`) — `/api/research` surface for runs, details, cancel/retry, exports, create-task, and attach-task actions; supports graceful degradation envelopes via availability payloads when capabilities are unavailable
- Roadmap routes (`roadmap-routes.ts`)
- Project-scoped store reuse via `project-store-resolver.ts`

View File

@@ -245,6 +245,20 @@ Features:
For mission planning context and handoff structure, see [Missions guide](./missions.md).
## Evals View
Evals view is a dedicated dashboard surface for reviewing scheduled task-evaluation output.
Navigation:
- Desktop: **Header → More views → Evals**
- Mobile: **More** sheet → **Evals**
Features:
- Filter eval results by free-text query, run, and score range
- Review list summaries (task, eval/run identity, timestamps, and score)
- Drill into full rationale, category scores, evidence references, and suggested follow-ups
- Open Scheduled Evals settings directly when setup is disabled
## Insights View
Insights view surfaces categorized project insights and lets you turn findings into work.