← All roles
Senior Software Engineer I, Inference
PythonGoC++KubernetesPrometheusGrafanaOTELvLLMCUDADistributed Systems
About the role
Senior Software Engineer I, Inference at CoreWeave: Lead design reviews, define SLIs/SLOs, implement optimizations (micro-batch schedulers, speculative decoding, KV-cache reuse), strengthen incident posture, mentor engineers. Own area spanning multiple services. Requires experience building distributed systems, strong coding in Python/Go, Kubernetes, inference internals.
Requirements
IC3: ~3-5 years, IC4: ~5-8 years industry experience building distributed systems or cloud services. Strong coding in Python or Go, deep familiarity with networked systems and performance. Hands-on experience with Kubernetes at production scale, CI/CD, observability stacks (Prometheus, Grafana, OpenTelemetry). Practical knowledge of inference internals: batching, caching, mixed precision, streaming token delivery. Proven track record improving tail latency (P95/P99) and service reliability. B.S.
About the company
CoreWeave
CoreWeave is a cloud provider specializing in an AI-native platform built to power complex AI workloads. They offer GPU and CPU compute, storage, and infrastructure control solutions, positioning themselves as the essential cloud for AI innovation and significantly reducing total cost of ownership.
View company page →More from CoreWeave
Principal Engineer, Distributed Systems
GoJavaRustC++PythonKubernetes
$227k–303k
Onsite · New York, NY / Sunnyvale, CA
Principal Engineer, Distributed Systems
$227k–303k
GoJavaRustC++PythonKubernetes
Senior Security Engineer, eDiscovery, Insider Risk
PythonGo
$165k–220k
Remote · US
Senior Security Engineer, eDiscovery, Insider Risk
$165k–220k
PythonGo
Engineering Manager, Storage
GoRust
$182k–242k
Onsite · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA
Engineering Manager, Storage
$182k–242k
GoRust
Senior Engineer, Prime Systems & Services
KubernetesGoPythonLinuxInfrastructure as CodeDevOpsDistributed Systems
$182k–242k
Onsite · Bellevue, WA
Senior Engineer, Prime Systems & Services
$182k–242k
KubernetesGoPythonLinuxInfrastructure as CodeDevOpsDistributed Systems
Senior Engineer, Security Products
GoJavaC++PythongRPCKubernetesOAuth2Terraform
$182k–242k
Onsite · Sunnyvale, CA
Senior Engineer, Security Products
$182k–242k
GoJavaC++PythongRPCKubernetesOAuth2Terraform
Similar roles
Senior Backend Software Engineer - Core Services
£50k–95k
Senior Backend Software Engineer - Core Services
£50k–95k
Staff Software Engineer, ML Infrastructure
$147k–215k
Staff Software Engineer, ML Infrastructure
$147k–215k
Principal Software Engineer
$277k–390k
Principal Software Engineer
$277k–390k
Staff+ Software Engineer, Node Infra
$320k–485k
Staff+ Software Engineer, Node Infra
$320k–485k
Sr. Staff Observability Software Engineer
$174k–299k
Sr. Staff Observability Software Engineer
$174k–299k