fix: harden Agent Harness on a 62-file legal workload - #437
Conversation
feat(agent): add dynamic runtime context and domain plugin boundaries
Maintainer attention: base branch was force-resetAfter this PR was opened,
This branch intentionally remains based on As a result, GitHub currently shows this PR as 56 changed files / 12 commits ahead of Please approve and merge only if restoring |
Preserve the legal-runtime harness work while integrating the latest artifact, office-skill, and UI changes from main. Add generic hard-case fixes, focused regressions, and sanitized 62-file legal QA evidence.
Record only aggregate 321-checkpoint results; keep raw legal content and the Judge payload outside git.
|
Verification gate update: all CodeQL checks passed on head |
Summary
This PR hardens generic PilotDeck Agent/Harness behavior using a fresh 62-file legal due-diligence workload as the end-to-end proving ground. Legal reasoning, milestone policy, and review criteria remain in a temporary Domain Plugin/Skill; PilotDeck Core receives only reusable runtime mechanisms and reliability fixes.
The branch now includes the latest
mainthrough merge commit845fc260, preserving both histories after resolving the earlier base divergence.Changes
Generic Harness behavior
artifact_emptyinstead of treating file existence as completion.terminated,connection terminated, andstream terminated) as retryable connection resets, including Anthropic-compatible SSE errors.Existing runtime and office delivery work
main.QA & Evidence
Real 62-file legal workload
createLocalGatewayin an isolated home/project with 37 DOCX, 16 PDF, 5 XLSX, 3 PNG, and 1 PPTX; temporary legal Domain Plugin/Skill; per-request dynamic prompt patches; required Markdown artifact..omo/evidence/20260723-legal-hard-runtime/hard-run-summary.jsonIndependent hard-quality gate
fb8e30384b89faa0e975db0cf92aa8463b77d04ffe8da88302a9b8d16609b68a..omo/evidence/20260723-legal-hard-runtime/hard-quality-gate.jsonRegression and office surfaces
npm testpassed 192/192 after merging currentmain.npm run buildpassed..omo/evidence/20260723-legal-hard-runtime/regression-summary.jsonand.omo/evidence/20260723-legal-hard-runtime/known-ui-baselines.mdRisks & Residuals
origin/mainbaseline issues (stream-smoothing expectations,node:sqliteunder jsdom, Playwright collection, and mixed React 18/19 type trees). The implicated files/configuration are unchanged; the filtered suite and production build pass..omo/evidence/20260723-legal-hard-runtime/judge-status.json.