← All roles
Member of Technical Staff, Production Site Reliability Engineer
vLLMDistributed SystemsPythonGoBashLinuxKubernetesDockerTerraform
About the role
Inferact is hiring a Site Reliability Engineer to ensure the reliability of its vLLM-powered AI inference services in production. The role involves defining SLOs, building monitoring and automation, leading incident response and post-mortems, and partnering with engineering on capacity planning and operational readiness. The ideal candidate thinks about failure before launch and simplifies operations.
Requirements
Minimum qualifications: Bachelor's degree or equivalent in CS/engineering; experience with production distributed systems; programming in Python, Go, Bash; incident response and root cause analysis; understanding of SLOs/SLIs/error budgets; strong Linux, networking, and debugging skills; clear communication under pressure. Preferred: AI inference/ML infrastructure; Kubernetes; observability; deployment safety; resource scheduling.
About the company
Inferact
Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.
View company page →More from Inferact
Member of Technical Staff, Forward Deployed Engineer
PythonGoTypeScriptvLLMvLLMCUDAKubernetes
$200k–400k
Remote · US
Member of Technical Staff, Forward Deployed Engineer
$200k–400k
PythonGoTypeScriptvLLMvLLMCUDAKubernetes
Member of Technical Staff, Cloud Orchestration
KubernetesPythonRustGoTerraformHelmAWSGCPAzurevLLM
$200k–400k
Remote · US
Member of Technical Staff, Cloud Orchestration
$200k–400k
KubernetesPythonRustGoTerraformHelmAWSGCPAzurevLLM
Member of Technical Staff, Performance and Scale
RustGoC++Distributed SystemsvLLM
$200k–400k
Remote · US
Member of Technical Staff, Performance and Scale
$200k–400k
RustGoC++Distributed SystemsvLLM
Similar roles
Senior Site Reliability Engineer
$152k–205k
Senior Site Reliability Engineer
$152k–205k
Staff Site Reliability Engineer
$218k–328k
Staff Site Reliability Engineer
$218k–328k
Staff Site Reliability Engineer, Ads
$217k–304k
Staff Site Reliability Engineer, Ads
$217k–304k
Site Reliability Engineer
$180k–250k
Site Reliability Engineer
$180k–250k
Staff Site Reliability Engineer
$211k–263k
Staff Site Reliability Engineer
$211k–263k