| Class | Mixture-of-experts code model, quantized (GGUF, Ollama registry default) |
|---|---|
| Served via | the inference proxy (LiteLLM) → the model host |
| Consumers | openclaw-agent (CLI coding agent) |
| Pinned deps | litellm[proxy], fastapi==0.115.6, langfuse==2.60.9 |
Intended use
Autonomous and semi-autonomous code editing, refactors, and shell-level tasks issued through openclaw-agent. Runs alongside a native Ollama provider path that was left untouched — this is an additive LiteLLM route, not a replacement.
Limitations
- Quantized weights — no benchmark run against the full-precision checkpoint on this fleet; treat generated code as unreviewed until tested, same as any LLM output.
- No sandboxed execution boundary beyond openclaw-agent's own allowlist — the model does not independently rate-limit or scope its own tool calls.
Deployment notes
Version pins exist because litellm==1.95.0
breaks on newer FastAPI (get_flat_dependant
import error) and langfuse 4.x drops the
attribute LiteLLM's callback expects. Upgrade either only after
re-verifying both constraints.