fix: support groq compound defaults - #3281
Conversation
Route groq-prefixed models through the OpenAI-compatible client, apply Groq token-limit metadata, and skip local tool injection for compound models. Add regression coverage for routing, token limits, and compound local-tool behavior. Co-Authored-By: Oz <oz-agent@warp.dev>
|
Nice fix. Routing groq models through the OpenAI-compatible client is the right approach for maintainability. The compound model token-limit metadata is a detail that's easy to overlook but important for correct truncation behavior. The regression coverage for local tool injection is also a good defensive measure — compound models with tool use can produce surprising behavior without it. |
|
Nice catch — Groq compound defaults were silently ignored before. The explicit handling makes provider behavior predictable across different model families. |
|
Nice work on the Groq integration. The compound model handling with disabled local tool injection looks correct — compound models typically don't support tool calling the same way standard models do. One thing to verify: the token-limit metadata for llama-4-scout should be cross-checked against the latest Groq API docs, as their limits have shifted between model versions in the past. Otherwise LGTM. |
Summary
groq/model IDs through the OpenAI-compatible clientValidation
cargo test --manifest-path rust/Cargo.toml groq_ --workspacecargo build --manifest-path rust/Cargo.toml --release --workspacezsh -lic 'mkdir -p /Users/abdullah/tools/claw-smoke && claw --cwd /Users/abdullah/tools/claw-smoke --permission-mode read-only prompt "Reply exactly READY"'Conversation: https://app.warp.dev/conversation/9443f8d1-a24e-42ea-9f04-0dd8bf608859
Co-Authored-By: Oz oz-agent@warp.dev