← All roles

Senior Director of Engineering - Inference Serving

SambaNova Systems ·San Jose, California, United States ·Onsite 9d ago
PythonGoRustKubernetesHelm

About the role

The SambaStack team is seeking an Engineering Director to lead a software engineering team while remaining a hands-on technical contributor. You will own team growth, technical quality, and the roadmap for the inference serving platform. Responsibilities include leading and inspiring a team, hiring, career development, setting goals, and partnering with cross-functional leadership. Technically, you will design systems, write code, lead design reviews, establish engineering standards, and address

Requirements

12+ years of software engineering experience including 2+ years leading teams. Must have demonstrated ability to manage and hire engineers while remaining hands-on. Strong technical depth in backend systems with Python, Go, or Rust. Experience with AI inference serving, orchestration, and LLM workloads at production scale. Proven ability to drive engineering excellence. Excellent communication skills. Experience running iterative engineering processes in a fast-paced environment. Preferred: Ku

About the company

SambaNova Systems

SambaNova is a hardware and software company specializing in AI infrastructure. They provide a unified platform for AI inference, enabling customers to run large-scale AI models efficiently and at high speeds. Their solutions are designed to offer premium inference performance for AI agents and support sovereign AI initiatives.

View company page →

More from SambaNova Systems

Cloud Platform Engineer - New Grad
PythonGoLinuxDockerKubernetesTerraformAnsiblePrometheusGrafanaDatadogAWSGCPAzureJenkinsArgoCDvLLMvLLMInfrastructure as Code
$131k–197k
Onsite · Austin, Texas, United States; San Jose, California, United States
Cloud Platform Engineer - New Grad
$131k–197k
Onsite · Austin, Texas, United States; San Jose, California, United States
PythonGoLinuxDockerKubernetesTerraformAnsiblePrometheusGrafanaDatadogAWSGCPAzureJenkinsArgoCDvLLMvLLMInfrastructure as Code
Software Architect - SambaStack
PythonGoRustKubernetesHelmDistributed Systems
₹10300k–12500k
Onsite · Bengaluru, Karnataka, India
Software Architect - SambaStack
₹10300k–12500k
Onsite · Bengaluru, Karnataka, India
PythonGoRustKubernetesHelmDistributed Systems
Software Architect
PythonGoRustKubernetesHelmDistributed Systems
$245k–325k
Onsite · San Jose, California, United States
Software Architect
$245k–325k
Onsite · San Jose, California, United States
PythonGoRustKubernetesHelmDistributed Systems
Principal Cloud Platform Engineer
DevOpsPythonGoDockerKubernetesPrometheusGrafanaDatadogTerraformLinuxvLLMRedisAWS
$210k–280k
Onsite · Austin, Texas, United States; San Jose, California, United States
Principal Cloud Platform Engineer
$210k–280k
Onsite · Austin, Texas, United States; San Jose, California, United States
DevOpsPythonGoDockerKubernetesPrometheusGrafanaDatadogTerraformLinuxvLLMRedisAWS
Principal Engineer - SambaRack
GoRustPythonCC++LinuxDistributed SystemsPrometheusGrafanaKubernetesHelm
₹6000k–8000k
Onsite · Bengaluru, Karnataka, India
Principal Engineer - SambaRack
₹6000k–8000k
Onsite · Bengaluru, Karnataka, India
GoRustPythonCC++LinuxDistributed SystemsPrometheusGrafanaKubernetesHelm
$245k–325k
Onsite San Jose, California, United StatesSan Jose, United States
Posted 9d ago
Apply for this role
Opens sambanova.ai ↗
About the company
SambaNova Systems
https://sambanova.ai

SambaNova is a hardware and software company specializing in AI infrastructure. They provide a unified platform for AI inference, enabling customers to run large-scale AI models efficiently and at high speeds. Their solutions are designed to offer premium inference performance for AI agents and support sovereign AI initiatives.

View company page →