About the role
As an Infrastructure Software Engineer at Baseten, you'll build and maintain components of our ML inference platform that powers production AI applications. You'll contribute to the core infrastructure, enabling developers to deploy, scale, and monitor ML models with high performance. Responsibilities include developing infrastructure components using Python and Go, implementing Kubernetes deployments, building monitoring systems, and supporting infrastructure automation. You'll work on ML model
Requirements
Bachelor's degree or higher in Computer Science or related field. Proficient coding abilities in one or more popular programming or scripting languages; Go proficiency is a plus. Working knowledge of Kubernetes and containerization. Basic understanding of machine learning concepts and model serving. Familiarity with distributed systems concepts. Experience with basic monitoring and logging tools. Interest in ML/AI infrastructure and willingness to learn. Strong collaboration and communication
About the company
Baseten
Baseten provides the Baseten Inference Stack, a platform for high-performance AI model deployment and management across any cloud. They offer the fastest model runtimes, cross-cloud high availability, and seamless developer workflows to help businesses bring AI products to market quickly and efficiently.
View company page →More from Baseten
Engineering Manager, Runtime Fabric
GoLinuxKubernetesDistributed Systems
$165k–330k
Onsite · San Francisco
Engineering Manager, Runtime Fabric
$165k–330k
GoLinuxKubernetesDistributed Systems
OS / K8s Systems Engineer
KubernetesPythonGoLinux
$165k–330k
Onsite · San Francisco
OS / K8s Systems Engineer
$165k–330k
KubernetesPythonGoLinux
Software Engineer - Training Infrastructure
GoPythonKubernetesAWSGCPDistributed SystemsTemporalApache AirflowPyTorch
$165k–330k
Onsite · San Francisco
Software Engineer - Training Infrastructure
$165k–330k
GoPythonKubernetesAWSGCPDistributed SystemsTemporalApache AirflowPyTorch
Software Engineer - Internal Platform
GoPythonKubernetesDockerHelmTerraform
$165k–330k
Remote · CA, US
Software Engineer - Internal Platform
$165k–330k
GoPythonKubernetesDockerHelmTerraform
Product Engineer - Dedicated Inference
PythonGoJavaScript
$165k–330k
Onsite · San Francisco
Product Engineer - Dedicated Inference
$165k–330k
PythonGoJavaScript
Similar roles
Senior Platform Engineer
$157k–172k
Senior Platform Engineer
$157k–172k
Senior Software Engineer, Infrastructure
$180k–250k
Senior Software Engineer, Infrastructure
$180k–250k
Staff Software Engineer, Platform Infrastructure (Foundations)
$215k–265k
Staff Software Engineer, Platform Infrastructure (Foundations)
$215k–265k
Staff Software Engineer (Hardware Infrastructure)
$175k–225k
Staff Software Engineer (Hardware Infrastructure)
$175k–225k
Staff Software Engineer, ML Infrastructure
$147k–215k
Staff Software Engineer, ML Infrastructure
$147k–215k