← All roles
Software Engineer, Inference
PythonGoKubernetesPrometheusGrafanaOTELvLLMDistributed Systems
About the role
CoreWeave, an AI cloud for GPU workloads, seeks a Junior Software Engineer (IC1/IC2) to join the Inference team. The role involves owning a model-serving service end-to-end: design, implementation, deployment, and ops. Responsibilities include improving observability, latency/throughput via micro-batching and caching, participating in on-call, and peer code reviews.
Requirements
0–3 years of software engineering experience building cloud/distributed services. Proficiency in Python or Go; familiarity with gRPC/HTTP APIs and containerized deployments. Working knowledge of Kubernetes and CI/CD pipelines. Experience with metrics/alerting (Prometheus/Grafana) and structured logging. Basic understanding of GPU inference concepts (KV caching, mixed precision, streaming tokens).
About the company
CoreWeave
CoreWeave is a cloud provider specializing in an AI-native platform built to power complex AI workloads. They offer GPU and CPU compute, storage, and infrastructure control solutions, positioning themselves as the essential cloud for AI innovation and significantly reducing total cost of ownership.
View company page →More from CoreWeave
Senior Productivity Platforms Developer
PythonGoKubernetesTerraformAnsibleDevOps
$139k–185k
Onsite · Dallas, TX, Bellevue, WA, Sunnyvale, CA
Senior Productivity Platforms Developer
$139k–185k
PythonGoKubernetesTerraformAnsibleDevOps
Senior Software Engineer, Network Development
PythonGoLinuxKubernetesAnsiblePrometheusGrafanaHPC
$165k–220k
Onsite · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA
Senior Software Engineer, Network Development
$165k–220k
PythonGoLinuxKubernetesAnsiblePrometheusGrafanaHPC
Engineering Manager, Launch & Sandboxes
GoPythonKubernetesDistributed SystemsHPC
$165k–242k
Onsite · Livingston, NJ / New York, NY / San Francisco, CA / Sunnyvale, CA / Bellevue, WA
Engineering Manager, Launch & Sandboxes
$165k–242k
GoPythonKubernetesDistributed SystemsHPC
Software and AI Engineer
TypeScriptPythonGoJavaC#C++ReactNode.jsFastAPILangChainGitAWSAzureGCPDocker
$120k–160k
Onsite · Sunnyvale, CA / Bellevue, WA / Dallas, TX
Software and AI Engineer
$120k–160k
TypeScriptPythonGoJavaC#C++ReactNode.jsFastAPILangChainGitAWSAzureGCPDocker
Senior Security Engineer, Vulnerability Management
PythonGoRustLinuxKubernetes
$165k–242k
Onsite · Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA
Senior Security Engineer, Vulnerability Management
$165k–242k
PythonGoRustLinuxKubernetes
Similar roles
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
[Junior / Senior / Staff] Software Engineer, Inference / Compute Infrastructure Engineering
$160k–280k
Senior Software Engineer, Compute Platform
$165k–225k
Senior Software Engineer, Compute Platform
$165k–225k
AI Infrastructure Engineer
$200k–400k
AI Infrastructure Engineer
$200k–400k
Software Engineer, Infrastructure
$200k–240k
Software Engineer, Infrastructure
$200k–240k
Senior Software Engineer - Compute
$266k–395k
Senior Software Engineer - Compute
$266k–395k