About the role
Baseten powers mission-critical inference for AI companies. The Engineering Manager of the Runtime Fabric team will lead a team building purpose-built container runtime and storage layers for AI inference workloads. Responsibilities include team leadership, technical direction on containerd/runc extensions for GPU-specific requirements, overseeing the Baseten Delivery Network for faster cold starts, and championing open-source contributions. The role requires deep container ecosystem knowledge,
Requirements
Proven experience managing engineering teams in systems/infrastructure. Deep familiarity with Linux container ecosystem: containerd, runc, OCI spec, namespaces, cgroups. Contributions to containerd/runc or related open-source projects. Strong systems programming in Go and/or C/C++. Experience with distributed storage, content-addressable storage, or large-scale caching. Understanding of container image structure and delivery. Strong communication skills.
About the company
Baseten
Baseten provides the Baseten Inference Stack, a platform for high-performance AI model deployment and management across any cloud. They offer the fastest model runtimes, cross-cloud high availability, and seamless developer workflows to help businesses bring AI products to market quickly and efficiently.
View company page →More from Baseten
Global Capacity Manager
KubernetesGoPython
$170k–230k
Onsite · San Francisco
Global Capacity Manager
$170k–230k
KubernetesGoPython
Software Engineer - Identity & Authorization
KubernetesPythonGoOIDC
$240k–285k
Onsite · San Francisco
Software Engineer - Identity & Authorization
$240k–285k
KubernetesPythonGoOIDC
Software Engineer - AI Developer Productivity
PythonGoKubernetesDocker
$165k–330k
Onsite · San Francisco
Software Engineer - AI Developer Productivity
$165k–330k
PythonGoKubernetesDocker
Software Engineer - Testing Frameworks
GoPythonpytestk6KubernetesDocker
$165k–330k
Onsite · San Francisco
Software Engineer - Testing Frameworks
$165k–330k
GoPythonpytestk6KubernetesDocker
Software Engineer - Observability
PrometheusGrafanaClickHouseOTELPythonRustGo
$165k–330k
Onsite · San Francisco
Software Engineer - Observability
$165k–330k
PrometheusGrafanaClickHouseOTELPythonRustGo
Similar roles
Member of Technical Staff - Sandbox Service
£107k–262k
Member of Technical Staff - Sandbox Service
£107k–262k
Senior Engineering Manager, Containers at the Edge
$228k–274k
Senior Engineering Manager, Containers at the Edge
$228k–274k
Staff Software Engineer, Sustaining
$205k–231k
Staff Software Engineer, Sustaining
$205k–231k
Member of Technical Staff - Infrastructure
$150k–250k
Member of Technical Staff - Infrastructure
$150k–250k
Forward Deployed Engineer - Physical AI Cloud Platform
$180k–224k
Forward Deployed Engineer - Physical AI Cloud Platform
$180k–224k