About the role
SambaNova is an AI infrastructure company building a full-stack inference platform using its custom RDU (Reconfigurable Dataflow Unit) hardware. As a Software Architect on the SambaStack team, you will define the technical direction, own end-to-end architecture, lead design reviews, and ensure scalability, reliability, and performance for enterprise AI workloads. You will work across teams, mentor engineers, and evaluate emerging technologies.
Requirements
12+ years software engineering with organization-wide influence; proven track record owning large-scale distributed systems; expertise in Python, Go, or Rust; expert-level Kubernetes; strong distributed systems principles; experience setting technical direction across teams; excellent communication; mentoring. Preferred: AI inference serving, custom hardware accelerators, ML productionization, cloud-native platforms, AI coding assistants, high-growth AI company.
About the company
SambaNova Systems
SambaNova is a hardware and software company specializing in AI infrastructure. They provide a unified platform for AI inference, enabling customers to run large-scale AI models efficiently and at high speeds. Their solutions are designed to offer premium inference performance for AI agents and support sovereign AI initiatives.
View company page →More from SambaNova Systems
Cloud Platform Engineer - New Grad
PythonGoLinuxDockerKubernetesTerraformAnsiblePrometheusGrafanaDatadogAWSGCPAzureJenkinsArgoCDvLLMvLLMInfrastructure as Code
$131k–197k
Onsite · Austin, Texas, United States; San Jose, California, United States
Cloud Platform Engineer - New Grad
$131k–197k
PythonGoLinuxDockerKubernetesTerraformAnsiblePrometheusGrafanaDatadogAWSGCPAzureJenkinsArgoCDvLLMvLLMInfrastructure as Code
Software Architect
PythonGoRustKubernetesHelmDistributed Systems
$245k–325k
Onsite · San Jose, California, United States
Software Architect
$245k–325k
PythonGoRustKubernetesHelmDistributed Systems
Senior Director of Engineering - Inference Serving
PythonGoRustKubernetesHelm
$245k–325k
Onsite · San Jose, California, United States
Senior Director of Engineering - Inference Serving
$245k–325k
PythonGoRustKubernetesHelm
Principal Cloud Platform Engineer
DevOpsPythonGoDockerKubernetesPrometheusGrafanaDatadogTerraformLinuxvLLMRedisAWS
$210k–280k
Onsite · Austin, Texas, United States; San Jose, California, United States
Principal Cloud Platform Engineer
$210k–280k
DevOpsPythonGoDockerKubernetesPrometheusGrafanaDatadogTerraformLinuxvLLMRedisAWS
Principal Engineer - SambaRack
GoRustPythonCC++LinuxDistributed SystemsPrometheusGrafanaKubernetesHelm
₹6000k–8000k
Onsite · Bengaluru, Karnataka, India
Principal Engineer - SambaRack
₹6000k–8000k
GoRustPythonCC++LinuxDistributed SystemsPrometheusGrafanaKubernetesHelm
Similar roles
Principal AI Architect
$254k–356k
Principal AI Architect
$254k–356k
Staff Backend Software Engineer
$190k–261k
Staff Backend Software Engineer
$190k–261k
Senior Software Engineer
$170k–200k
Senior Software Engineer
$170k–200k
AI Engineer - AI Platform
$163k–204k
AI Engineer - AI Platform
$163k–204k
Sr. Software Engineer - AI/ML - AI Platform
$188k–235k
Sr. Software Engineer - AI/ML - AI Platform
$188k–235k