About the role
This role owns the end-to-end reference architecture for rack-scale inference systems at DigitalOcean, covering GB300 NVL72 and future Vera Rubin systems. Responsibilities include defining NVLink domain partitioning, scale-out RDMA fabric design, making Kubernetes topology-aware, driving multi-node disaggregated serving, owning failure semantics and validation, and partnering with NVIDIA on pre-silicon enablement.
Requirements
12+ years in large-scale compute, HPC, or GPU infrastructure engineering. Deep understanding of GPU interconnect and system topology (NVLink, NVSwitch, PCIe, NUMA). Strong RDMA networking background (RoCEv2 or InfiniBand at scale, GPUDirect RDMA). Practical NCCL expertise. Substantial Kubernetes depth for accelerated workloads. Strong systems programming in Go and Python. Experience operating fleets where hardware failure is routine. Excellent communication and cross-organizational leadership.
About the company
DigitalOcean
DigitalOcean provides a cloud computing platform for developers and businesses to build, deploy, and scale applications. They offer a range of products including virtual machines, managed databases, storage solutions, and networking services, emphasizing simplicity and ease of use.
View company page →More from DigitalOcean
Staff Engineer, Serverless Inference
KubernetesGovLLM
$191k–239k
Hybrid · Seattle
Staff Engineer, Serverless Inference
$191k–239k
KubernetesGovLLM
Staff Product Security Engineer, Secure Design (Kernel and Virtualization)
GoRustC
$180k–215k
Remote · Worldwide
Staff Product Security Engineer, Secure Design (Kernel and Virtualization)
$180k–215k
GoRustC
Staff Engineer, Network Infrastructure
GoPythonDistributed SystemsKubernetes
$191k–239k
Hybrid · Seattle
Staff Engineer, Network Infrastructure
$191k–239k
GoPythonDistributed SystemsKubernetes
Staff AI Architect
PythonGoTypeScriptJavaKubernetesOWASPOTEL
$191k–239k
Remote · Worldwide
Staff AI Architect
$191k–239k
PythonGoTypeScriptJavaKubernetesOWASPOTEL
Senior Software Engineer, Security Products
GoJavaScriptApache KafkaKubernetesTerraformHelmAWSGCPAzureDistributed Systems
$141k–176k
Hybrid · Seattle
Senior Software Engineer, Security Products
$141k–176k
GoJavaScriptApache KafkaKubernetesTerraformHelmAWSGCPAzureDistributed Systems
Similar roles
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
Staff Software Engineer - Compute
$314k–465k
Staff Software Engineer - Compute
$314k–465k
Software Engineer, Core Network Engineering
$230k–342k
Software Engineer, Core Network Engineering
$230k–342k
Senior Software Engineer, Compute Platform
$165k–225k
Senior Software Engineer, Compute Platform
$165k–225k
Member of Technical Staff - Machines
$250k–300k
Member of Technical Staff - Machines
$250k–300k