← All roles
Software Engineer, ML Workload Platform
KubernetesPythonGoDistributed SystemsInfrastructure as Code
About the role
Cohere is building the infrastructure and tools to train, evaluate, and serve its foundation models. This role involves owning the platform that schedules and runs training, evaluation, and reinforcement-learning jobs on Kubernetes, building networking and runtime isolation, working with data infrastructure on storage, troubleshooting production failures, and building automation and observability. The team works with AI researchers and ML engineers to accelerate the models behind Cohere's North.
Requirements
Experience running a job platform, batch system, or Kubernetes controllers in production with scheduling, queues, and multi-tenant fairness. Distributed systems judgment including retries and partial failure. Worked on ML training workflows, RL sandboxes, container networking, or checkpoint storage at scale. Written software in Python or Go. Experience working with researchers or ML engineers. Ability to find bottlenecks, propose fixes, and drive in a fast-moving environment.
About the company
Cohere
Cohere is a leader in the AI industry, providing enterprise-ready AI platforms and generative models that enhance workplace productivity and data insights. Their solutions, including North and Compass, empower businesses by leveraging advanced retrieval and natural language processing technologies. Cohere's value proposition lies in offering scalable, secure, and customizable AI solutions that keep data within the customer's infrastructure.
View company page →More from Cohere
Software Engineer, GPU Infrastructure
KubernetesPythonGoLinuxHPC
$175k–325k
Remote · CA, US
Software Engineer, GPU Infrastructure
$175k–325k
KubernetesPythonGoLinuxHPC
Forward Deployed Engineer, Inference
KubernetesGCPAzureAWSvLLMPythonGoDistributed Systems
$240k–415k
Onsite · United States
Forward Deployed Engineer, Inference
$240k–415k
KubernetesGCPAzureAWSvLLMPythonGoDistributed Systems
Engineering Manager, Cohere APIs and DevEx
GoTypeScriptReact
CA$300k–375k
Remote · CA
Engineering Manager, Cohere APIs and DevEx
CA$300k–375k
GoTypeScriptReact
Senior/Staff Software Engineer (Back-End), Inference
GoPythonJavaC++RustDistributed Systems
$205k–315k
Remote · Worldwide
Senior/Staff Software Engineer (Back-End), Inference
$205k–315k
GoPythonJavaC++RustDistributed Systems
Product Security Engineer, North Security
PythonGoTypeScriptKubernetesOIDC
CA$230k–330k
Remote · Worldwide
Product Security Engineer, North Security
CA$230k–330k
PythonGoTypeScriptKubernetesOIDC
Similar roles
Software Engineer - Training Infrastructure
$165k–330k
Software Engineer - Training Infrastructure
$165k–330k
AI Platform Engineer, Backend
$180k–325k
AI Platform Engineer, Backend
$180k–325k
Member of Technical Staff (Software Engineer, Training Infrastructure)
$220k–405k
Member of Technical Staff (Software Engineer, Training Infrastructure)
$220k–405k
Machine Learning Engineer
$175k–220k
Machine Learning Engineer
$175k–220k
Staff Machine Learning Engineer, ML Infrastructure
$184k–245k
Staff Machine Learning Engineer, ML Infrastructure
$184k–245k