Systems Generalist, GPT Infrastructure

We are seeking an experienced systems generalist who can work comfortably across the stack to help build an automated inference optimization platform. Given a workload, target hardware profile, compiler and runtime context, and a trusted verifier, the system runs durable optimization campaigns that generate, compile, execute, grade, and improve candidate kernels, runtime configurations, and serving-stack changes. You will design both the OpenAI-hosted control plane and the partner-side software.

8+ years of professional software engineering experience building large-scale distributed systems, infrastructure platforms, or cloud services, or equivalent depth of experience. Strong programming skills in one or more of C++, Python, Go, or Rust. Experience designing and operating highly available backend systems, APIs, job orchestration systems, or durable workflows for production workloads. Strong understanding of distributed systems, Linux, networking, storage, containers, and modern cloud.