Senior Software Engineer, AI Gateway

The AI Gateway team at Kong builds critical infrastructure connecting enterprises to generative AI. The role involves designing core components of the AI Gateway, leading implementation of features like prompt engineering, caching, observability, writing Golang/Python code, influencing technical roadmap, architecting LLM integrations, mentoring junior engineers, driving full development lifecycle in Kubernetes, and collaborating with product managers.

Extensive backend development experience with Golang/Python; deep understanding of distributed systems, microservices, API design; proven cloud-native experience (Kubernetes, Docker, AWS/GCP/Azure); familiarity with API gateways/service mesh; strong CS fundamentals. Nice-to-have: AI/ML infrastructure, LLMs, LangChain, LlamaIndex, open-source contributions, performance tuning, Lua/OpenResty.