DIPs testing#67
Draft
MoonBoi9001 wants to merge 27 commits intomainfrom
Draft
Conversation
MoonBoi9001
force-pushed
the
samuel/dips-dev-environment
branch
3 times, most recently
from
cb0c65b to
39e989f
Compare
MoonBoi9001
changed the title
MoonBoi9001
force-pushed
the
samuel/dips-dev-environment
branch
from
39e989f to
28089bd
Compare
MoonBoi9001
force-pushed
the
samuel/dips-dev-environment
branch
from
7c68181 to
0345ff8
Compare
MoonBoi9001
force-pushed
the
samuel/dips-dev-environment
branch
2 times, most recently
from
962e3f7 to
972b4af
Compare
Mount local checkouts of contracts, indexer-rs, dipper, iisa, and the eligibility-oracle-node so the stack runs your branches end-to-end. Also adds a separate eligibility-oracle overlay and aligns the base compose file with the dev overrides. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Add dev run-dips.sh entrypoints for indexer-agent and indexer-service so they consume mounted source. Refresh dipper, iisa, eligibility-oracle, tap-agent, and tap-escrow-manager run scripts to drive the end-to-end DIPs pipeline against horizon contracts. Drop the iisa local-scoring stub set (replaced by API-push design from the cronjob). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Add scripts for sending indexing requests, deploying test subgraphs, generating extra indexers, monitoring the DIPs pipeline, checking subgraph sync, and snapshotting network status. These drive the end-to-end testing flow against the local stack. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Add reusable .claude/skills entries for the recurring DIPs testing operations (fresh deploy, add indexers, deploy subgraphs, send indexing request, network status). Add BUGS.md to log every issue surfaced during end-to-end testing, CLAUDE.md for project-level guidance, and TESTING-STATUS.md to track progress. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Switch the env file to the testing-targeted config: enable the indexing-payments profile, point all *_SOURCE_ROOT at local checkouts, pin contracts to mb9/dips-local-testing-fixes, and add the x402 receiver wallet for the gateway. Refresh .gitignore alongside. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Base stack now brings up every service from pinned commits or images. Per-service dips-*.yaml overlays opt individual components into a source-mount mode that builds in-container from a local checkout. dips.yaml stays as the mount-everything preset. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
MoonBoi9001
force-pushed
the
samuel/dips-dev-environment
branch
from
9dd0111 to
77db3a0
Compare
The DIPs source-mount overlays were a parallel build pipeline that duplicated the image-only path. They hard-coded Mac host paths in the env file and broke on any non-Mac clone. Drop them; rely on the pinned image versions. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The cronjob image is published to GHCR by the upstream subgraph-dips-indexer-selection workflow. Pull it via image: instead of cloning the private source and building locally, so fresh deployments work without GitHub auth in the build container. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The eligibility-oracle-node repo is private. Cloning at build time fails on machines without GitHub auth. Each developer drops a local clone at the gitignored containers/oracles/eligibility- oracle-node/source/ path; the Dockerfile COPYs from there. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
graph-contracts no longer writes tap-contracts.json — TAP-related addresses (GraphTallyCollector, PaymentsEscrow) live in horizon.json now. wait_for_config blocked 300s waiting for the missing file; dipper read TAPVerifier from it. Both updated. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
indexer-agent crashes at SubgraphClient.create when the spec has tapSubgraph or indexingPaymentsSubgraph as empty objects (truthy in JS). Restore both endpoints. The TAP subgraph isn't deployed on this branch, but a stale URL still lets the agent start. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The agent's @semiotic-labs/tap-contracts-bindings library has no chainId 1337 baked in. Without a tap-contracts.json address book the binding library rejects Network.create and the management API never starts. Stub it from horizon.json: TAPVerifier <- GraphTallyCollector, Escrow <- PaymentsEscrow. Addresses aren't exercised on the DIPs path. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The Rust tap-agent and indexer-service crash on startup with "missing field query_url for default.subgraphs.escrow" — the schema hard-requires this section even though semiotic/tap subgraph isn't deployed on this branch. Stale URL satisfies the schema; queries against it fail gracefully and the DIPs flow doesn't use this path. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Extras now use the same build context, image versions, healthchecks, and run.sh as the primary indexer-agent and indexer-service. Drops the dockerfile_inline wrapper, the host source-mount volumes, and the run-dips.sh entrypoint override. Per-indexer identity and hostnames flow in via compose environment overrides. Also fixes the generator's ENV_FILE path from a non-existent .environment to .env, so the COMPOSE_FILE entry is actually written. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The dips overlay was removed in commit 325ec70; the add-indexers skill still chained it into every docker compose invocation, which would fail on a fresh clone with "no such file or directory". Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Old skill was a soft reset (containers + volumes only) plus several references that no longer hold on this branch — the dips compose overlay was deleted, tap-escrow-manager was renamed, the TAP subgraph isn't deployed any more, and run.sh is no longer volume- mounted. The new skill targets the lnet-test VM, wipes containers, volumes, networks, all images, and the clone itself, then re-clones from origin, repopulates eligibility-oracle-node/source via rsync from the Mac, runs build --pull, brings up the stack, and streams per-service health to the user. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The old skill ran every command (docker, curl, python) against the local docker daemon. That doesn't work on the Mac+VM setup where docker lives on lnet-test and the generator script lives on the Mac. Rewrite makes the split explicit: generator runs on Mac, the yaml and updated .env are scp'd to the VM, all docker / docker-pause / curl-localhost commands are SSH-wrapped. Drop stale claims about flock-serialized cargo builds (no Rust compile happens any more — extras use primary's thin-wrapper Dockerfile), the legacy TAP subgraph, the DOCKER_DEFAULT_PLATFORM= prefix (VM is amd64-native), and the orphan reference to /fresh-deploy's down -v handling. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The contract-address helper chained an overlay file that was removed earlier on this branch, breaking the script with "no such file or directory" on a fresh clone. Let docker compose read the overlay list from .env. Also drop an unused import. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The scripts hit localhost-only endpoints and shell out to cast and the graph CLI, so they must run on the VM via SSH. Document the one-time install of foundry from a release tarball, plus Node 22 from NodeSource since the apt default is too old for graph CLI. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Script hits localhost-only endpoints and shells out to docker exec. Wrap the invocation with ssh so it runs where those resolve. Note the local-only path for users running the stack on Mac directly. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Stack lives on the VM but the dipper CLI is a Mac-built binary. Use an SSH local-forward on port 9000 so the Mac binary can hit dipper without cross-compile or copying. Wrap docker, curl, and helper scripts with ssh. Drop stale references to the deleted overlay. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
The 200-query loop in step 9 used bare `curl ... || (set -e abort)`, so a single --max-time timeout (exit 28) killed the heredoc before the unpause step ran. Wrap each curl in if/then/else with explicit success/fail counts and add `|| true` to the docker unpause. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
…or deployed Removing the DIPs source-mount overlay reverted the indexer-service container to a TAP-only run.sh, so /dips/info returned 404. IISA's probe got no info, every indexer ended up with empty supported networks, and dipper rejected every indexing request. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
Without this, indexer-service falls back to the public Graph IPFS gateway from indexer-rs's default_values.toml. The DIPs flow fetches subgraph manifests to validate proposals; the public gateway can't serve manifests only present on the local IPFS, so every DIPs proposal hits SUBGRAPH_MANIFEST_UNAVAILABLE. Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Dev environment for end-to-end DIPs testing against Horizon contracts. Sharing as a draft.