← All roles
Forward Deployed Engineer, Inference
KubernetesPythonGoC++Distributed SystemsGCPAzureAWSvLLM
About the role
Cohere seeks a Staff Forward Deployed Engineer to act as the principal technical translation layer between core engineering teams and strategic partners. The role involves owning architecture for customer-specific inference challenges, including multi-tenant model serving, multi-datacenter disaster recovery, and custom hardware validation.
Requirements
8+ years of engineering experience with production infrastructure and large-scale distributed systems. Deep knowledge of Kubernetes multi-cluster orchestration and hybrid/multi-cloud environments (GCP, Azure, AWS, OCI). Strong understanding of LLM inference dynamics and hands-on experience with inference engines like vLLM, TensorRT-LLM, lmd, or Dynamo. Exceptional customer-facing technical leadership and ability to scope ambiguous problems. Proficiency in Python, Go, or C++.
About the company
Cohere
Cohere is a leader in the AI industry, providing enterprise-ready AI platforms and generative models that enhance workplace productivity and data insights. Their solutions, including North and Compass, empower businesses by leveraging advanced retrieval and natural language processing technologies. Cohere's value proposition lies in offering scalable, secure, and customizable AI solutions that keep data within the customer's infrastructure.
View company page →More from Cohere
Engineering Manager, Cohere APIs and DevEx
GoTypeScriptReact
CA$300k–375k
Remote · CA, DE, FR +3
Engineering Manager, Cohere APIs and DevEx
CA$300k–375k
GoTypeScriptReact
Senior/Staff Software Engineer (Back-End), Inference
GoPythonJavaC++RustDistributed Systems
$205k–315k
Remote · Worldwide
Senior/Staff Software Engineer (Back-End), Inference
$205k–315k
GoPythonJavaC++RustDistributed Systems
Product Security Engineer, North Security
PythonGoTypeScriptOIDCKubernetes
CA$230k–330k
Remote · CA, US
Product Security Engineer, North Security
CA$230k–330k
PythonGoTypeScriptOIDCKubernetes
Data Engineer, Data Foundations
PythonApache SparkApache FlinkBigQueryApache AirflowJavaGoKubernetes
$160k–325k
Remote · CA, US
Data Engineer, Data Foundations
$160k–325k
PythonApache SparkApache FlinkBigQueryApache AirflowJavaGoKubernetes
Site Reliability Engineer, Inference Infrastructure
KubernetesGCPAzureAWSLinuxGoDistributed Systems
$160k–260k
Remote · Worldwide
Site Reliability Engineer, Inference Infrastructure
$160k–260k
KubernetesGCPAzureAWSLinuxGoDistributed Systems
Similar roles
Staff Software Engineer, ML Infrastructure
$147k–215k
Staff Software Engineer, ML Infrastructure
$147k–215k
Principal Machine Learning Engineer
$240k–420k
Principal Machine Learning Engineer
$240k–420k
Forward Deployed Engineer
$137k–228k
Forward Deployed Engineer
$137k–228k
Staff Software Engineer, Inference
$188k–275k
Staff Software Engineer, Inference
$188k–275k
Member of Technical Staff, Forward Deployed Engineer
$200k–400k
Member of Technical Staff, Forward Deployed Engineer
$200k–400k