← All roles
Site Reliability Engineer, Inference Infrastructure
KubernetesGCPAzureAWSLinuxGoDistributed Systems
About the role
Cohere is hiring a Site Reliability Engineer to join the Model Serving team, responsible for deploying and operating the AI platform that delivers large language models via API endpoints. The role involves working with multiple teams to optimize NLP model deployments in low-latency, high-throughput environments, and interfacing with customers for custom deployments.
Requirements
5+ years of engineering experience running production infrastructure at scale; experience with Kubernetes, GPU workloads, multi-cloud (GCP, Azure, AWS, OCI); Linux-based environments; compute/storage/network management; familiarity with accelerators and distributed systems; proficiency in Golang, C++, or similar high-performance languages.
About the company
Cohere
Cohere is a leader in the AI industry, providing enterprise-ready AI platforms and generative models that enhance workplace productivity and data insights. Their solutions, including North and Compass, empower businesses by leveraging advanced retrieval and natural language processing technologies. Cohere's value proposition lies in offering scalable, secure, and customizable AI solutions that keep data within the customer's infrastructure.
View company page →More from Cohere
Forward Deployed Engineer, Inference
KubernetesPythonGoC++Distributed SystemsGCPAzureAWSvLLM
$240k–415k
Remote · Worldwide
Forward Deployed Engineer, Inference
$240k–415k
KubernetesPythonGoC++Distributed SystemsGCPAzureAWSvLLM
Engineering Manager, Cohere APIs and DevEx
GoTypeScriptReact
CA$300k–375k
Remote · CA, DE, FR +3
Engineering Manager, Cohere APIs and DevEx
CA$300k–375k
GoTypeScriptReact
Senior/Staff Software Engineer (Back-End), Inference
GoPythonJavaC++RustDistributed Systems
$205k–315k
Remote · Worldwide
Senior/Staff Software Engineer (Back-End), Inference
$205k–315k
GoPythonJavaC++RustDistributed Systems
Product Security Engineer, North Security
PythonGoTypeScriptOIDCKubernetes
CA$230k–330k
Remote · CA, US
Product Security Engineer, North Security
CA$230k–330k
PythonGoTypeScriptOIDCKubernetes
Data Engineer, Data Foundations
PythonApache SparkApache FlinkBigQueryApache AirflowJavaGoKubernetes
$160k–325k
Remote · CA, US
Data Engineer, Data Foundations
$160k–325k
PythonApache SparkApache FlinkBigQueryApache AirflowJavaGoKubernetes
Similar roles
Site Reliability Engineer
$180k–250k
Site Reliability Engineer
$180k–250k
Site Reliability Engineer
€70k–90k
Site Reliability Engineer
€70k–90k
Senior Site Reliability Engineer, PaaS
€70k–97k
Senior Site Reliability Engineer, PaaS
€70k–97k
Senior Site Reliability Engineer
$160k–208k
Senior Site Reliability Engineer
$160k–208k
Principal Site Reliability Engineer, Google Cloud
$240k–250k
Principal Site Reliability Engineer, Google Cloud
$240k–250k