← All roles

Member of Technical Staff, Forward Deployed Engineer

Inferact ·US ·Onsite, Remote 27d ago
PythonGoTypeScriptvLLMvLLMCUDAKubernetes

About the role

Inferact seeks a Forward Deployed Engineer to work directly with customers deploying and optimizing vLLM inference systems. This hands-on role involves architecture discussions, implementation, debugging, and turning field learnings into product capabilities. Requires strong software engineering, ML systems experience, and systems debugging skills.

Requirements

Minimum: Bachelor's in CS/engineering or equivalent, strong software engineering in Python/Go/TypeScript, hands-on ML systems deployment, ability to work with customer teams, systems debugging skills, reasoning about latency/throughput/scaling. Preferred: experience with vLLM, SGLang, TensorRT-LLM, GPUs, CUDA/ROCm, enterprise deployments, building APIs/CLIs, profiling performance.

About the company

Inferact

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

View company page →
$200k–400k
Onsite, Remote San FranciscoSan Francisco, United States
Posted 27d ago
Apply for this role
Opens jobs.ashbyhq.com ↗
About the company
Inferact
https://inferact.ai/

Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.

View company page →