Skip to content

docs(triage): quarterly upstream sweep, REBUILD vocabulary, cadence change - #152

Merged
jramos merged 2 commits into
mainfrom
docs/triage-sweep-and-quarterly-cadence
Sep 1, 2026
Merged

jramos merged 2 commits into
mainfrom
docs/triage-sweep-and-quarterly-cadence

Conversation

@jramos

@jramos jramos commented Aug 31, 2026

Copy link
Copy Markdown
Owner

What

Records this cycle's review of the upstream backlog (NousResearch/hermes-agent-self-evolution) and changes how the review runs.

Ledger. 72 -> 92 open: 31 opened, 11 closed (5 opened and closed inside the window), 6 of the previously-tracked 72 closed. That leaves 26 new PRs to disposition: 21 already covered or superseded, 1 a verified defect in our tree, 3 not adoptable but worth rebuilding from, 1 hostile.

Changes

  • CHERRY-PICK -> REBUILD. We never apply upstream diffs — every adopted idea is implemented against our own tree, so the old label misdescribed the work. Re-letters the snapshot legend and the two live row tokens that used it.
  • Cadence -> quarterly, plus a title pre-filter step. Yield per cycle is falling (an early cycle mined ~7 actionable items from 70 PRs; this one found 1 defect and 2 liftable ideas in 26 new PRs) while upstream has merged 3 PRs ever and this fork is 156 commits ahead, 0 behind. Waiting accrues no merge risk, and most of the backlog can be dispositioned on the title against the settled-cluster list without reading a diff.
  • Three new action items with our-code anchors: importer relevance ranking (the verified defect, which also closes a long-deferred recall follow-up), code-evolution test containment, and a minimum-detectable-effect diagnostic.
  • Declines recorded with reasons so they are not re-litigated: a fact-table "objective verifier" whose answer key is memorizable by the very artifact under evolution; a post-deploy canary that is infrastructure ahead of demand here (and whose PR shells out to an undisclosed AGPL tool); and a per-tool interference gate that is a real gap but costly, parked with its anchor.
  • Settled clusters extended — they are the cache the new pre-filter reads.
  • A hostile submission added to do-not-merge.

Notes

Docs-only; no code paths touched. The three action items land as their own PRs, each flipping its own row in the same PR as the fix.

One correction worth flagging: the draft ledger did not reconcile because the previously-tracked set had been derived by grepping issue and cluster references out of the doc rather than from the API. The figures here come from gh directly and close exactly.

jramos added 2 commits August 31, 2026 14:30
…hange

Backlog 72 -> 92 open: 31 opened, 11 closed (5 opened and closed inside the
window), leaving 26 new PRs to triage. Of those, 21 were already covered or
superseded, 1 is a verified defect in our tree, 3 prompted native work without
being adoptable themselves, and 1 is hostile.

- Renames the CHERRY-PICK disposition to REBUILD throughout. We never apply
  upstream diffs; every adopted idea is implemented against our own tree, so
  the old label misdescribed the work. Re-letters the snapshot legend and the
  two live row tokens that used it.
- Moves the review cadence to quarterly and adds a title-level pre-filter as
  an explicit step. Yield per cycle is falling while upstream is unmaintained
  and this fork is 0 commits behind it, so waiting accrues no merge risk and
  most of the backlog can be dispositioned without reading a diff.
- Records the sweep with a ledger that reconciles, the disposition of all 26
  new PRs, three new action items with their our-code anchors, and the
  declines with reasons so future cycles do not re-litigate them.
- Extends the settled clusters, which are the cache the new pre-filter reads.
- Adds a hostile submission to the do-not-merge list.
Review of this entry surfaced one factual error and several arithmetic
inconsistencies. Fixes, in order of consequence:

- Correct the characterization of the full-feature upstream PR. It was
  described as shelling out to an "undisclosed" AGPL tool; it is not
  undisclosed. That PR carries a README section on the AGPL boundary, module
  docstrings explaining the licensing chain, and a test asserting nothing under
  evolution/ imports the AGPL package. The SKIP disposition stands on its own
  merits — the canary is premature here and the entanglement is real — but the
  characterization was wrong and unfair, so it is restated accurately.
- Drop two PRs from this cycle's remainder list. They were dispositioned in the
  previous cycle, so listing them here inflated the entry's own enumeration
  past the 26 it claims to cover.
- Remove a test count that does not reproduce. The figure came from a
  verification run that cannot be reconstructed at any plausible suite scope;
  the substantive claim (the importer suites pass with a real populated state.db
  present, so the autouse fixtures do isolate them) is kept without it.
- Reconcile the disposition split with the snapshot's own S/R/X tags: 24 skip,
  1 action item, 1 do-not-merge. Three of those skips still prompted native
  work, and are now named explicitly rather than folded into a separate count
  that agreed with nothing.
- Move the prompt-section and MIPROv2 reconstructions out of the phase-mega-PR
  bucket into the cluster this same change defines for them. The title
  pre-filter matches against these buckets, so mislabeling works against it.
- Fix an identifier: the per-importer concatenation lives in
  build_dataset_from_external.
- Add action-item rows for the importer/dataset-builder hardening and the
  MIPROv2 valset items, so every tracked item has a row to flip and the
  reference to "the hardening item" resolves.
- Restore the author attribution the two prior sweep entries use, add a group
  count that reconciles, describe the verifier PR's oracle as a 17-paper fact
  table rather than 17 facts, and cross-reference the parked statistics item to
  the action item that now absorbs half of it.
@jramos
jramos merged commit a972a94 into main Sep 1, 2026
5 checks passed
@jramos
jramos deleted the docs/triage-sweep-and-quarterly-cadence branch September 1, 2026 01:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant