Staff Software Engineer, Inference

The Inference team builds and operates CoreWeave’s Kubernetes-native inference platform, powering low-latency, high-throughput AI workloads at massive scale. The team is responsible for request routing, scheduling, GPU resource management, and system-wide optimizations that drive performance, efficiency, and reliability across real-time inference systems. As a Staff Software Engineer (IC5), you will act as a technical leader driving architecture, performance, and reliability across multiple serv

8–12+ years of experience building and operating large-scale distributed systems or cloud platforms. Proven experience leading cross-team technical initiatives impacting multiple services or organizations. Strong programming skills in Go, Python, or C++. Deep expertise in Kubernetes at production scale, including orchestration, scheduling, and service design. Strong understanding of distributed systems, networking, and performance optimization. Experience designing and operating low-latency, h