← All roles

Staff Engineer, Serverless Inference

DigitalOcean ·Seattle ·Hybrid 9d ago
KubernetesGovLLM

About the role

Staff Engineer role focused on implementing and contributing to the design and optimization of Serverless Inference infrastructure and APIs. Tackle challenges of large-scale AI workloads, focusing on throughput, GPU utilization, and fault tolerance. Involves building scalable multi-tenant services, strengthening platform resiliency, and providing technical leadership.

Requirements

7+ years building and operating multi-tenant platforms or distributed backend systems. Strong experience with high-scale distributed services, SRE principles (observability, incident management, reliability engineering). 1+ years Go/Golang, 2+ years Kubernetes. Cloud-native architectures, microservices, debugging production issues. Observability proficiency including inference metrics.

About the company

DigitalOcean

DigitalOcean provides a cloud computing platform for developers and businesses to build, deploy, and scale applications. They offer a range of products including virtual machines, managed databases, storage solutions, and networking services, emphasizing simplicity and ease of use.

View company page →
$191k–239k
Hybrid Seattle
Posted 9d ago
Apply for this role
Opens www.digitalocean.com ↗
About the company
DigitalOcean
https://www.digitalocean.com

DigitalOcean provides a cloud computing platform for developers and businesses to build, deploy, and scale applications. They offer a range of products including virtual machines, managed databases, storage solutions, and networking services, emphasizing simplicity and ease of use.

View company page →