Member of Technical Staff - Distributed Systems

Gimlet is building a multi-silicon neocloud for AI inference. This role involves building distributed systems for scheduling, routing, and coordinating AI workloads across heterogeneous hardware. Responsibilities include designing scheduling and orchestration systems, control planes, APIs, and fault tolerance mechanisms to manage independently scalable stages of inference pipelines. The work spans production infrastructure, reliability, and scaling across new hardware and data centers.

Experience building or operating distributed systems in production, strong software engineering and systems fundamentals, ability to reason about concurrency and failure modes. Experience with scheduling, resource management, RPC, or asynchronous messaging. Bachelor's degree or equivalent. Strong candidates also have experience with Kubernetes, service-oriented architectures, reliable APIs, and systems languages like Go, C++, Python.