← All roles
Member of Technical Staff - Distributed Systems
KubernetesGoC++PythonDistributed Systems
About the role
Gimlet is building the first multi-silicon neocloud for fast, efficient AI inference. The platform intelligently partitions and routes workloads across heterogeneous hardware, enabling performance and efficiency improvements. Customers deploy through production-grade APIs without managing hardware. The role involves designing and operating distributed systems that schedule, route, and coordinate AI workloads across thousands of nodes and diverse hardware architectures. In the first 12-18 months,
Requirements
Strong software engineering fundamentals. Experience building or operating distributed systems in production environments. Comfort reasoning about concurrency, failure modes, and tradeoffs in large-scale systems. Bachelor's degree in a relevant field, or an equivalent combination of education, training, and professional experience. Preferred: Experience with Kubernetes or Kubernetes-adjacent systems, service-oriented architectures using RPC or asynchronous messaging, scheduling or resource
About the company
Gimlet Labs
Gimlet Labs is an applied research lab focused on developing the next generation of computing systems for AI workloads. They offer serverless inference for AI agents through their Gimlet Cloud platform and provide autonomous kernel generation for optimized AI performance with kforge. Their value proposition lies in efficiently and scalably serving AI, accelerating both training and inference without manual code changes.
View company page →More from Gimlet Labs
Member of Technical Staff - Infrastructure
KubernetesTerraformAnsibleHelmPythonGoCUDALinuxPrometheusOTELGrafana
$150k–350k
Onsite · San Francisco, CA
Member of Technical Staff - Infrastructure
$150k–350k
KubernetesTerraformAnsibleHelmPythonGoCUDALinuxPrometheusOTELGrafana
Similar roles
Software Engineer - Training Infrastructure
$165k–330k
Software Engineer - Training Infrastructure
$165k–330k
Senior Staff Software Engineer (AI)
$265k
Senior Staff Software Engineer (AI)
$265k
Staff Software Engineer, Inference
$188k–275k
Staff Software Engineer, Inference
$188k–275k
Senior Software Engineer II, AI Workload Orchestration
$165k–242k
Senior Software Engineer II, AI Workload Orchestration
$165k–242k
Member of Technical Staff
$175k–220k
Member of Technical Staff
$175k–220k