kong · Milan, Italy
Skills: Rust, AWS, Docker
Are you ready to unlock intelligence? If you don’t think you meet all of the criteria below but are still interested in the job, please apply. Nobody checks every box - we’re looking for candidates that are particularly strong in a few areas, and have some interest and capabilities in others. THE MISSION You will join the engineering team that builds the Kong AI gateway, empowering companies and developers around the world to govern every step of their AI & LLM based innovation. As a Software Engineer in the AI Gateway Team, you will be working on core features such as multi-LLM routing and balancing, semantic caching and routing, MCP, and more. WHAT YOU’LL DO - Partake in the entire lifecycle of core AI Gateway features, from design to production rollout. - Build and maintain high-performance components for Kong’s AI Gateway in Rust and Lua. - Implement gateway features such as multi-LLM routing and load balancing, caching, guardrails, and observability for AI traffic. - Design integrations with LLM providers and AI platforms, filling the gaps between Kong and third-party deployment platforms and tooling. - Troubleshoot production issues in the hot path. - Work with product management and other engineering teams to turn customer requirements into reliable, documented product features. WHAT YOU’LL BRING THE TOOLKIT - 3+ years of programming in server-side applications and components, in a language such as Rust or Go. - Experience building and debugging applications that are highly scalable, distributed, reliable and resilient. - Knowledge of networking fundamentals and protocols on both L4 and L7 (TCP/IP, HTTP/2, gRPC). - Familiarity with cutting-edge AI models concepts, agentic AI protocols, and AI applications development. - Solid hands-on expertise in Linux systems. THE KONG DNA - Ownership: You have a strong sense of ownership, including the documentation: engineers at Kong write the documentation for their products. - Collaboration: You have excellent verbal an…
Sign in to see the original posting
Browse more developer jobs on RoleBurst