← All roles

Member of Technical Staff, Production Site Reliability Engineer

Inferact ·US ·Onsite, Remote 70d ago
vLLMDistributed SystemsPythonGoBashLinuxKubernetesDockerTerraform

About the role

Inferact is hiring a Site Reliability Engineer to ensure the reliability of its vLLM-powered AI inference services in production. The role involves defining SLOs, building monitoring and automation, leading incident response and post-mortems, and partnering with engineering on capacity planning and operational readiness. The ideal candidate thinks about failure before launch and simplifies operations.

Requirements

Minimum qualifications: Bachelor's degree or equivalent in CS/engineering; experience with production distributed systems; programming in Python, Go, Bash; incident response and root cause analysis; understanding of SLOs/SLIs/error budgets; strong Linux, networking, and debugging skills; clear communication under pressure. Preferred: AI inference/ML infrastructure; Kubernetes; observability; deployment safety; resource scheduling.

About the company

Inferact

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

View company page →
$200k–400k
Onsite, Remote San FranciscoSan Francisco, United States
Posted 70d ago
Apply for this role
Opens jobs.ashbyhq.com ↗
About the company
Inferact
https://inferact.ai/

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

View company page →