← All roles
Senior Software Engineer I, Inference
PythonGoC++KubernetesPrometheusGrafanaOTELvLLMCUDADistributed Systems
About the role
Senior Software Engineer I, Inference at CoreWeave: Lead design reviews, define SLIs/SLOs, implement optimizations (micro-batch schedulers, speculative decoding, KV-cache reuse), strengthen incident posture, mentor engineers. Own area spanning multiple services. Requires experience building distributed systems, strong coding in Python/Go, Kubernetes, inference internals.
Requirements
IC3: ~3-5 years, IC4: ~5-8 years industry experience building distributed systems or cloud services. Strong coding in Python or Go, deep familiarity with networked systems and performance. Hands-on experience with Kubernetes at production scale, CI/CD, observability stacks (Prometheus, Grafana, OpenTelemetry). Practical knowledge of inference internals: batching, caching, mixed precision, streaming token delivery. Proven track record improving tail latency (P95/P99) and service reliability. B.S.
About the company
CoreWeave
CoreWeave is a cloud provider specializing in an AI-native platform built to power complex AI workloads. They offer GPU and CPU compute, storage, and infrastructure control solutions, positioning themselves as the essential cloud for AI innovation and significantly reducing total cost of ownership.
View company page →More from CoreWeave
Senior Productivity Platforms Developer
PythonGoKubernetesTerraformAnsibleDevOps
$139k–185k
Onsite · Dallas, TX, Bellevue, WA, Sunnyvale, CA
Senior Productivity Platforms Developer
$139k–185k
PythonGoKubernetesTerraformAnsibleDevOps
Senior Software Engineer, Network Development
PythonGoLinuxKubernetesAnsiblePrometheusGrafanaHPC
$165k–220k
Onsite · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA
Senior Software Engineer, Network Development
$165k–220k
PythonGoLinuxKubernetesAnsiblePrometheusGrafanaHPC
Engineering Manager, Launch & Sandboxes
GoPythonKubernetesDistributed SystemsHPC
$165k–242k
Onsite · Livingston, NJ / New York, NY / San Francisco, CA / Sunnyvale, CA / Bellevue, WA
Engineering Manager, Launch & Sandboxes
$165k–242k
GoPythonKubernetesDistributed SystemsHPC
Software and AI Engineer
TypeScriptPythonGoJavaC#C++ReactNode.jsFastAPILangChainGitAWSAzureGCPDocker
$120k–160k
Onsite · Sunnyvale, CA / Bellevue, WA / Dallas, TX
Software and AI Engineer
$120k–160k
TypeScriptPythonGoJavaC#C++ReactNode.jsFastAPILangChainGitAWSAzureGCPDocker
Senior Security Engineer, Vulnerability Management
PythonGoRustLinuxKubernetes
$165k–242k
Onsite · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA
Senior Security Engineer, Vulnerability Management
$165k–242k
PythonGoRustLinuxKubernetes
Similar roles
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
Staff Software Engineer, ML Infrastructure
$147k–215k
Staff Software Engineer, ML Infrastructure
$147k–215k
Principal Software Engineer
$277k–390k
Principal Software Engineer
$277k–390k
Staff Engineer, Serverless Inference
$191k–239k
Staff Engineer, Serverless Inference
$191k–239k
Forward Deployed Engineer, Inference
$240k–415k
Forward Deployed Engineer, Inference
$240k–415k