Senior/Staff Software Engineer (Back-End), Inference

Model Vault is Cohere's inference platform for deploying models securely at enterprise scale. As a Back-End Engineer, you will evolve and scale backend systems for authentication, authorization, deployment management, billing, and metering, and lead architectural initiatives across identity, payments, and platform scalability. You will design APIs and distributed systems with strong correctness, consistency, and security guarantees, solving complex problems spanning backend systems, cloud infrastructure, security, and AI inference.

Strong backend engineer with excellent fundamentals in distributed systems, databases, networking, operating systems, and security. Experience building production systems in Go, Python, Java, C++, Rust, or similar. Proven track record of designing and operating production systems at significant scale. Strong systems-design instincts including concurrency, consistency, caching, queues, rate limiting, and idempotency. Deep understanding of security boundaries, authentication, authorization, identity, cryptography, and tenant isolation.