← All roles
Member of Technical Staff, Forward Deployed Engineer
PythonGoTypeScriptvLLMvLLMCUDAKubernetes
About the role
Inferact seeks a Forward Deployed Engineer to work directly with customers deploying and optimizing vLLM inference systems. This hands-on role involves architecture discussions, implementation, debugging, and turning field learnings into product capabilities. Requires strong software engineering, ML systems experience, and systems debugging skills.
Requirements
Minimum: Bachelor's in CS/engineering or equivalent, strong software engineering in Python/Go/TypeScript, hands-on ML systems deployment, ability to work with customer teams, systems debugging skills, reasoning about latency/throughput/scaling. Preferred: experience with vLLM, SGLang, TensorRT-LLM, GPUs, CUDA/ROCm, enterprise deployments, building APIs/CLIs, profiling performance.
About the company
Inferact
Inferact is a startup in the AI inference industry, founded by the creators of the popular vLLM open-source LLM inference engine. The company's mission is to make AI inference significantly cheaper and faster by optimizing the vLLM engine, thereby accelerating AI progress and making advanced models more accessible.
View company page →More from Inferact
Member of Technical Staff, Production Site Reliability Engineer
vLLMDistributed SystemsPythonGoBashLinuxKubernetesDockerTerraform
$200k–400k
Remote · US
Member of Technical Staff, Production Site Reliability Engineer
$200k–400k
vLLMDistributed SystemsPythonGoBashLinuxKubernetesDockerTerraform
Member of Technical Staff, Cloud Orchestration
KubernetesPythonRustGoTerraformHelmAWSGCPAzurevLLM
$200k–400k
Remote · US
Member of Technical Staff, Cloud Orchestration
$200k–400k
KubernetesPythonRustGoTerraformHelmAWSGCPAzurevLLM
Member of Technical Staff, Performance and Scale
RustGoC++Distributed SystemsvLLM
$200k–400k
Remote · US
Member of Technical Staff, Performance and Scale
$200k–400k
RustGoC++Distributed SystemsvLLM
Similar roles
Research Engineer, Post-Training Inference
$200k–290k
Research Engineer, Post-Training Inference
$200k–290k
ML Deployment Engineer
$133k–250k
ML Deployment Engineer
$133k–250k
Senior AI Serving Engineer, Backend
$190k–250k
Senior AI Serving Engineer, Backend
$190k–250k
Senior Backend Engineer, Inference Platform
$200k–290k
Senior Backend Engineer, Inference Platform
$200k–290k
Software Engineer - Training Infrastructure
$165k–330k
Software Engineer - Training Infrastructure
$165k–330k