← All roles

Member of Technical Staff, Cloud Orchestration

Inferact ·US ·Onsite, Remote 102d ago
KubernetesPythonRustGoTerraformHelmAWSGCPAzurevLLM

About the role

We're looking for a cloud orchestration engineer to build the operational backbone that keeps vLLM running reliably at massive scale. You'll design systems for cluster management, deployment automation, and production monitoring to serve AI models without friction, ensuring deployments are observable, debuggable, and recoverable.

Requirements

Minimum qualifications: Bachelor's degree or equivalent in computer science or engineering. Strong experience with Kubernetes and container orchestration at scale. Experience designing custom Kubernetes operators. Proficiency in Python/Rust/Go and infrastructure-as-code tools (Terraform, Helm). Experience managing GPU clusters and debugging hardware issues. Ability to work across AWS, GCP, Azure, and on-premise. Preferred: Experience with ML orchestration tools (Ray, Slurm). Knowledge of GPU s

About the company

Inferact

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

View company page →
$200k–400k
Onsite, Remote San FranciscoSan Francisco, US
Posted 102d ago
Apply for this role
Opens jobs.ashbyhq.com ↗
About the company
Inferact
https://inferact.ai/

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

View company page →