Kimchi · United Kingdom
Skills: Docker
<h4>Why Kimchi?</h4> <p>Great models are raw ingredients. Kimchi is what happens when you ferment them with good engineering. We started inside CAST AI helping companies run LLMs on their own Kubernetes clusters; today we run our own coding harness on any model you pick, and the router deciding which model answers each request is ours too.<br><br><strong>The Auto Router</strong></p> <p>Our promise is one enforcement layer for your AI: budgets, spend attribution, and model routing, applied before a request ever hits a model. The Auto Router makes the call: for every request, which model serves it. Eight open-source models whose input prices span more than 20×, cached input up to 50× cheaper than fresh, frontier providers on customers' own keys, and a coding agent that fires hundreds of requests before its task is done. Frontier-level task success at a fraction of the token cost: that sentence is the product, and it stays true only if the model inside the router keeps getting better. That model is yours.</p> <p><em data-prosemirror-content-type="mark" data-prosemirror-mark-name="em"><span id="edb2bdea-40e7-48f0-9485-a0bd7169c7c7" data-mark-type="annotation" data-mark-annotation-type="inlineComment" data-id="edb2bdea-40e7-48f0-9485-a0bd7169c7c7" data-prosemirror-content-type="mark" data-prosemirror-mark-name="annotation">Made </span></em><em data-prosemirror-content-type="mark" data-prosemirror-mark-name="em"><span id="edb2bdea-40e7-48f0-9485-a0bd7169c7c7" data-mark-type="annotation" data-mark-annotation-type="inlineComment" data-id="edb2bdea-40e7-48f0-9485-a0bd7169c7c7" data-prosemirror-content-type="mark" data-prosemirror-mark-name="annotation">by Cast AI — a Miami-headquartered, globally distributed team across 34 countries that hit unicorn status in January 2026 with a $50B+ backed investment pushing its valuation past $1 billion.</span></em></p> <h4>About the role</h4> <p>Every request gets a decision: which model serves it.</p> <p>This is an applied-ML seat, not…
Sign in to see the original posting
Browse more developer jobs on RoleBurst