← All roles
Member of Technical Staff, Cloud Orchestration
KubernetesPythonRustGoTerraformHelmAWSGCPAzurevLLM
About the role
We're looking for a cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design systems for cluster management, deployment automation, and production monitoring to serve AI models without friction, ensuring deployments are observable, debuggable, and recoverable.
Requirements
Minimum qualifications: Bachelor's degree or equivalent in computer science or engineering. Strong experience with Kubernetes and container orchestration at scale. Experience designing custom Kubernetes operators. Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm). Experience managing GPU clusters and debugging hardware issues. Ability to work across AWS, GCP, Azure, and on-premise. Preferred: Experience with ML orchestration tools (Ray, Slurm). Knowledge of GPU s
About the company
Inferact
Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.
View company page →More from Inferact
Member of Technical Staff, Forward Deployed Engineer
PythonGoTypeScriptvLLMvLLMCUDAKubernetes
$200k–400k
Remote · US
Member of Technical Staff, Forward Deployed Engineer
$200k–400k
PythonGoTypeScriptvLLMvLLMCUDAKubernetes
Member of Technical Staff, Production Site Reliability Engineer
vLLMDistributed SystemsPythonGoBashLinuxKubernetesDockerTerraform
$200k–400k
Remote · US
Member of Technical Staff, Production Site Reliability Engineer
$200k–400k
vLLMDistributed SystemsPythonGoBashLinuxKubernetesDockerTerraform
Member of Technical Staff, Performance and Scale
RustGoC++Distributed SystemsvLLM
$200k–400k
Remote · US
Member of Technical Staff, Performance and Scale
$200k–400k
RustGoC++Distributed SystemsvLLM
Similar roles
Senior/Staff Platform Engineer
$220k–280k
Senior/Staff Platform Engineer
$220k–280k
Principal Engineer, Cluster Orchestration
$206k–303k
Principal Engineer, Cluster Orchestration
$206k–303k
Software Engineer, Infrastructure
$200k–240k
Software Engineer, Infrastructure
$200k–240k
Senior Staff Software Engineer – Compute Engineering
$191k–334k
Senior Staff Software Engineer – Compute Engineering
$191k–334k
Software Engineer, Cloud Infrastructure
$180k–300k
Software Engineer, Cloud Infrastructure
$180k–300k