Skip to content- Sources: primary, discussion, discussion
- Summary: The caller sends a state plus typed questions and receives a probability per option, following the existing System One format, so switching an existing client is a base URL change. Five GGUF models are listed, four under Apache 2.0 and the 27B OpenJev under CC BY-NC 4.0, with stated median times of 3 ms to 43 ms per question on one NVIDIA RTX PRO 6000. The post states Cloudflare's Clef, covered in the 2026-10-01 digest, is next.
- Why it matters: Routing a request, moderating content, or checking that an agent step worked stops needing a chat model and an output parser.