About the role
Baseten is hiring an Engineering Manager for the Runtime Fabrics team to lead the development of container runtime and storage layers specifically optimized for AI inference workloads. The role involves managing a team of systems engineers, guiding extend and hardening of containerd/runc/OCI ecosystem projects for GPU-specific requirements, overseeing the architecture of the Baseten Delivery Network for fast model weight delivery, and championing open-source contributions. The team owns the end-
Requirements
Experience managing/growing engineering teams in systems/infrastructure context; deep familiarity with Linux container ecosystem (containerd, runc, OCI spec, namespaces, cgroups); contributions to containerd/runc/gvisor/kata-containers or similar OSS projects; strong systems programming in Go/C/C++; experience with distributed storage/content-addressable storage/caching; understanding of container image structure/delivery; strong communication skills.
About the company
Baseten
Baseten provides the Baseten Inference Stack, a platform for high-performance AI model deployment and management across any cloud. They offer the fastest model runtimes, cross-cloud high availability, and seamless developer workflows to help businesses bring AI products to market quickly and efficiently.
View company page →More from Baseten
OS / K8s Systems Engineer
KubernetesPythonGoLinux
$165k–330k
Onsite · San Francisco
OS / K8s Systems Engineer
$165k–330k
KubernetesPythonGoLinux
Software Engineer - Training Infrastructure
GoPythonKubernetesAWSGCPDistributed SystemsTemporalApache AirflowPyTorch
$165k–330k
Onsite · San Francisco
Software Engineer - Training Infrastructure
$165k–330k
GoPythonKubernetesAWSGCPDistributed SystemsTemporalApache AirflowPyTorch
Software Engineer - Internal Platform
GoPythonKubernetesDockerHelmTerraform
$165k–330k
Remote · CA, US
Software Engineer - Internal Platform
$165k–330k
GoPythonKubernetesDockerHelmTerraform
Software Engineer - Infrastructure
PythonGoKubernetesDistributed Systems
$165k–330k
Remote · CA, US
Software Engineer - Infrastructure
$165k–330k
PythonGoKubernetesDistributed Systems
Product Engineer - Dedicated Inference
PythonGoJavaScript
$165k–330k
Onsite · San Francisco
Product Engineer - Dedicated Inference
$165k–330k
PythonGoJavaScript
Similar roles
Senior Software Engineer, Sandboxes & Virtualization
$139k–242k
Senior Software Engineer, Sandboxes & Virtualization
$139k–242k
Member of Technical Staff - Sandbox Service
£107k–262k
Member of Technical Staff - Sandbox Service
£107k–262k
Senior Systems Engineer, Virtualization
$182k–242k
Senior Systems Engineer, Virtualization
$182k–242k
Staff Software Engineer, Platform Infrastructure (Foundations)
$215k–265k
Staff Software Engineer, Platform Infrastructure (Foundations)
$215k–265k
Production Engineer
$180k–270k
Production Engineer
$180k–270k