← All roles

Engineering Manager, Runtime Fabric

Baseten ·San Francisco ·Onsite 55d ago
Go

About the role

Baseten powers mission-critical inference for AI companies. The Engineering Manager of the Runtime Fabric team will lead a team building purpose-built container runtime and storage layers for AI inference workloads. Responsibilities include team leadership, technical direction on containerd/runc extensions for GPU-specific requirements, overseeing the Baseten Delivery Network for faster cold starts, and championing open-source contributions. The role requires deep container ecosystem knowledge,

Requirements

Proven experience managing engineering teams in systems/infrastructure. Deep familiarity with Linux container ecosystem: containerd, runc, OCI spec, namespaces, cgroups. Contributions to containerd/runc or related open-source projects. Strong systems programming in Go and/or C/C++. Experience with distributed storage, content-addressable storage, or large-scale caching. Understanding of container image structure and delivery. Strong communication skills.

About the company

Baseten

Baseten provides the Baseten Inference Stack, a platform for high-performance AI model deployment and management across any cloud. They offer the fastest model runtimes, cross-cloud high availability, and seamless developer workflows to help businesses bring AI products to market quickly and efficiently.

View company page →
$165k–330k
Onsite San FranciscoSan Francisco, United States
Posted 55d ago
Apply for this role
Opens jobs.ashbyhq.com ↗
About the company
Baseten
https://www.baseten.co

Baseten provides the Baseten Inference Stack, a platform for high-performance AI model deployment and management across any cloud. They offer the fastest model runtimes, cross-cloud high availability, and seamless developer workflows to help businesses bring AI products to market quickly and efficiently.

View company page →