← All roles

Staff Engineer, Distributed Storage and HPC & AI Infrastructure

Together AI ·Worldwide ·Remote 9d ago
KubernetesGoPythonS3TerraformPrometheusGrafanaInfrastructure as Code

About the role

Staff Engineer responsible for architecting and scaling multi-petabyte storage systems for AI training and inference workloads. Key duties include operating high-performance parallel filesystems (Ceph, Weka, Lustre), building Kubernetes-native storage operators, implementing intelligent caching and tiered storage, optimizing KV-cache offload and data paths for GPU clusters, and driving the storage roadmap.

Requirements

8+ years in storage engineering with multi-petabyte scale. Experience with GPU/HPC clusters for training/inference, including KV-cache offload and model-weight distribution. Deep Kubernetes and cloud-native storage. Strong Go and Python coding. BS/MS in CS or equivalent. Technical leadership in performance, reliability, and cost efficiency. Expertise in parallel filesystems (Ceph, WekaFS, Lustre, Vast), object storage (S3, MinIO), and storage optimization for GPU workloads.

About the company

Together AI

Together AI is a leading AI company providing on-demand access to powerful AI models and accelerated compute infrastructure. They offer a comprehensive platform for inference, fine-tuning, and research, enabling developers and businesses to build and deploy cutting-edge AI applications efficiently and affordably.

View company page →

More from Together AI

Staff Platform Infrastructure Engineer
KubernetesAWSTerraformGoPythonTypeScriptApache KafkaHelmAmazon EKS
$240k–280k
Onsite · San Francisco
Staff Platform Infrastructure Engineer
$240k–280k
Onsite · San Francisco
KubernetesAWSTerraformGoPythonTypeScriptApache KafkaHelmAmazon EKS
Senior Software Engineer - Together Cloud Platform
GoKubernetesPostgreSQLAWSAzureGCPAmazon KinesisApache AirflowApache KafkaDistributed Systems
$160k–230k
Remote · Worldwide
Senior Software Engineer - Together Cloud Platform
$160k–230k
Remote · Worldwide
GoKubernetesPostgreSQLAWSAzureGCPAmazon KinesisApache AirflowApache KafkaDistributed Systems
Senior Software Engineer, Observability
PrometheusGrafanaClickHouseOTELGoPythonTerraformAnsibleHelmAWSGCPAzureDockerKubernetesPostgreSQLMongoDBRedisDistributed Systems
$200k–280k
Remote · Worldwide
Senior Software Engineer, Observability
$200k–280k
Remote · Worldwide
PrometheusGrafanaClickHouseOTELGoPythonTerraformAnsibleHelmAWSGCPAzureDockerKubernetesPostgreSQLMongoDBRedisDistributed Systems
Senior Software Engineer, Customer Insights
GoPythonJavaTypeScriptC++Distributed Systems
$180k–250k
Onsite · San Francisco
Senior Software Engineer, Customer Insights
$180k–250k
Onsite · San Francisco
GoPythonJavaTypeScriptC++Distributed Systems
Platform Engineer, Model Shaping
KubernetesPythonGoTerraformAnsiblePrometheusGrafanaArgoCDAWSGCPAzureHPC
$200k–290k
Hybrid · San Francisco
Platform Engineer, Model Shaping
$200k–290k
Hybrid · San Francisco
KubernetesPythonGoTerraformAnsiblePrometheusGrafanaArgoCDAWSGCPAzureHPC
$250k–330k
Remote San Francisco
Posted 9d ago
Apply for this role
Opens job-boards.greenhouse.io ↗
About the company
Together AI
https://www.together.ai

Together AI is a leading AI company providing on-demand access to powerful AI models and accelerated compute infrastructure. They offer a comprehensive platform for inference, fine-tuning, and research, enabling developers and businesses to build and deploy cutting-edge AI applications efficiently and affordably.

View company page →