Software Engineer, GPT Infrastructure

The role is about building infrastructure for qualifying and optimizing inference workloads across heterogeneous compute environments. Responsibilities include designing APIs, building secure partner-side software, integrating model workloads, developing evaluation systems, automating optimization, diagnosing performance issues, and collaborating with teams.

Strong software engineering experience building distributed systems, infrastructure platforms, or production services. Proficiency in Python, C++, Go, or Rust. Experience with APIs, job orchestration, durable workflows, or large-scale backend services. Understanding of Linux, networking, storage, containers, distributed execution. Ability to reason about model execution and diagnose problems. Experience with profiling, tracing, benchmarking. Strong ownership and cross-team collaboration.