About the role
Cohere is hiring a Software Engineer for GPU Infrastructure to build and operate GPU Kubernetes clusters across clouds, automate fault detection, improve fleet utilization, and troubleshoot production failures. The role involves working with AI researchers and ML engineers, and includes a compensated on-call rotation.
Requirements
Experience running GPU Kubernetes clusters with thousands of GPUs, debugging Linux/networking/performance issues, familiarity with RDMA/NCCL, software development in Python or Go, and working with researchers/ML engineers. Ability to identify bottlenecks and drive fixes in a fast-paced environment.
About the company
Cohere
Cohere is a leader in the AI industry, providing enterprise-ready AI platforms and generative models that enhance workplace productivity and data insights. Their solutions, including North and Compass, empower businesses by leveraging advanced retrieval and natural language processing technologies. Cohere's value proposition lies in offering scalable, secure, and customizable AI solutions that keep data within the customer's infrastructure.
View company page →More from Cohere
Software Engineer, ML Workload Platform
KubernetesPythonGoDistributed SystemsInfrastructure as Code
$175k–325k
Remote · CA, US
Software Engineer, ML Workload Platform
$175k–325k
KubernetesPythonGoDistributed SystemsInfrastructure as Code
Forward Deployed Engineer, Inference
KubernetesGCPAzureAWSvLLMPythonGoDistributed Systems
$240k–415k
Onsite · United States
Forward Deployed Engineer, Inference
$240k–415k
KubernetesGCPAzureAWSvLLMPythonGoDistributed Systems
Engineering Manager, Cohere APIs and DevEx
GoTypeScriptReact
CA$300k–375k
Remote · CA
Engineering Manager, Cohere APIs and DevEx
CA$300k–375k
GoTypeScriptReact
Senior/Staff Software Engineer (Back-End), Inference
GoPythonJavaC++RustDistributed Systems
$205k–315k
Remote · Worldwide
Senior/Staff Software Engineer (Back-End), Inference
$205k–315k
GoPythonJavaC++RustDistributed Systems
Product Security Engineer, North Security
PythonGoTypeScriptKubernetesOIDC
CA$230k–330k
Remote · Worldwide
Product Security Engineer, North Security
CA$230k–330k
PythonGoTypeScriptKubernetesOIDC
Similar roles
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
Global Capacity Manager
$170k–230k
Global Capacity Manager
$170k–230k
Engineering Manager, Core Cloud Platform
$297k–440k
Engineering Manager, Core Cloud Platform
$297k–440k
Principal Engineer, Cluster Orchestration
$206k–303k
Principal Engineer, Cluster Orchestration
$206k–303k
AI Infrastructure Engineer
$200k–400k
AI Infrastructure Engineer
$200k–400k