Kraken · Brazil
Skills: Python, Rust, Docker
Building the Future of Open Finance ---------------------------------------
Payward - the parent company behind Kraken, NinjaTrader, Breakout, xStocks, Payward Services and CF Benchmarks - has spent the last 15 years building one of the most modern and globally accessible financial infrastructure platforms in the industry, built to advance an open, global financial system.
The Team
Founded in 2011, Kraken is one of the world's longest-standing crypto platforms, trusted by over 10 million individuals and institutions across the globe. It offers spot trading, margin, futures, staking, and OTC services, with products built for both individual investors and institutional clients.
The Dev Platform team builds the internal platform that Kraken's engineers use to build, ship and run software. Within Dev Platform, the AI Gateway is Kraken's company-wide LLM gateway: a single, governed entry point that gives teams self-service access to leading models from providers such as Anthropic, OpenAI and Google, with visibility into usage and cost, configurable budgets and rate limits, and routing across models and providers for efficiency and resilience.
The Opportunity
Own the reliability, availability and performance of the AI Gateway as a production-critical service used across the company, including SLOs, error budgets and on-call practices Design the gateway's resilience: multi-provider routing, failover, retries, rate limiting and graceful degradation when an upstream model provider is slow or unavailable Set the technical direction for gateway architecture, capacity planning and scaling as LLM traffic grows and more workloads move onto the gateway Build observability for LLM traffic, covering latency, errors, token usage and cost, attributed by team and use case Partner with Security, Finance and AI governance stakeholders to put access controls, budgets, audit logging and data-handling requirements into the platform Lead incident response and blameless post-incident rev …truncated…
Sign in to see the original posting
Browse more developer jobs on RoleBurst