← All roles

Member of Technical Staff - Distributed Systems

Gimlet Labs ·San Francisco, CA ·Onsite 10d ago
KubernetesGoC++PythonDistributed Systems

About the role

Gimlet is building the first multi-silicon neocloud for fast, efficient AI inference. The platform intelligently partitions and routes workloads across heterogeneous hardware, enabling performance and efficiency improvements. Customers deploy through production-grade APIs without managing hardware. The role involves designing and operating distributed systems that schedule, route, and coordinate AI workloads across thousands of nodes and diverse hardware architectures. In the first 12-18 months,

Requirements

Strong software engineering fundamentals. Experience building or operating distributed systems in production environments. Comfort reasoning about concurrency, failure modes, and tradeoffs in large-scale systems. Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience. Preferred: Experience with Kubernetes or Kubernetes-adjacent systems, service-oriented architectures using RPC or asynchronous messaging, scheduling or resource

About the company

Gimlet Labs

Gimlet Labs is an applied research lab focused on developing the next generation of computing systems for AI workloads. They offer serverless inference for AI agents through their Gimlet Cloud platform and provide autonomous kernel generation for optimized AI performance with kforge. Their value proposition lies in efficiently and scalably serving AI, accelerating both training and inference without manual code changes.

View company page →
$150k–350k
Onsite San Francisco, CASan Francisco, US
Posted 10d ago
Apply for this role
Opens jobs.ashbyhq.com ↗
About the company
Gimlet Labs
https://www.gimletlabs.ai

Gimlet Labs is an applied research lab focused on developing the next generation of computing systems for AI workloads. They offer serverless inference for AI agents through their Gimlet Cloud platform and provide autonomous kernel generation for optimized AI performance with kforge. Their value proposition lies in efficiently and scalably serving AI, accelerating both training and inference without manual code changes.

View company page →