Senior Software Engineer, CoreWeave
Inference
$165-242k
+ Discretionary bonus & Equity awards for eligible roles; + Employee Stock Purchase Program
3 days a week in office (Sunnyvale, CA)
The essential cloud for AI
Open for applications
The essential cloud for AI
1001+ employees
Open for applications
$165-242k
+ Discretionary bonus & Equity awards for eligible roles; + Employee Stock Purchase Program
3 days a week in office (Sunnyvale, CA)
1001+ employees
Company mission
To manage the complexities of AI growth to make supercomputing accessible and push the limits of what's possible.
Role
Who you are
- ~5–8 years industry experience building distributed systems or cloud services
- Strong coding in Python or Go (C++ a plus) and deep familiarity with networked systems and performance
- Hands-on experience with Kubernetes at production scale, CI/CD, and observability stacks (Prometheus, Grafana, OpenTelemetry)
- Practical knowledge of inference internals: batching, caching, mixed precision (BF16/FP8), streaming token delivery
- Proven track record improving tail latency (P95/P99) and service reliability through metrics-driven work
Desirable
- Contributions to inference frameworks (vLLM, Triton, TensorRT-LLM, Ray Serve, TorchServe)
- Experience with CUDA kernels, NCCL/SHARP, RDMA/NUMA, or GPU interconnect topologies
- Leading multi-team initiatives or partnering with customers on mission-critical launches
What the job involves
- Senior engineers are area owners who lead designs, raise engineering standards, and deliver measurable improvements to latency, throughput, and reliability across multiple services
- You’ll partner with product, orchestration, and hardware teams to evolve our Kubernetes-native inference platform and meet strict P99 SLAs at scale
- Lead design reviews and drive architecture within the team; decompose multi-service work into clear milestones
- Define and own SLIs/SLOs; ensure post-incident actions land and reliability improves release-over-release
- Implement advanced optimizations (e.g., micro-batch schedulers, speculative decoding, KV-cache reuse) and quantify impact
- Strengthen incident posture: capacity planning, autoscaling policy, graceful degradation, rollback/traffic-shift strategies
- Mentor IC1/IC2 engineers; review cross-team designs and elevate coding/testing standards
- Own an area spanning multiple services and teams (e.g., request routing & adaptive scheduling, cost-per-token analytics, GPU resource isolation)
Our take
As AI continues to dominate the tech landscape, the demand for faster, more efficient cloud infrastructure is only intensifying. Traditional cloud providers often struggle with the sheer speed and scale required to power advanced AI models, leaving a gap for more specialized players. And that's where CoreWeave comes in, a company purpose-built to handle the heavy computational lift that the AI era demands.
CoreWeave's story is an interesting one too. What began in 2017 as a small crypto mining venture has evolved into one of the leading AI-focused cloud providers in the world. Its data centers are packed with high-end GPUs optimized for machine learning and generative AI, serving major clients like Microsoft and OpenAI. By designing its infrastructure around the needs of modern AI workloads rather than retrofitting older systems, CoreWeave has carved out a distinct and highly valuable niche in the market.
That focus in paying off in a big way too. Analyst project CoreWeave's revenue to soar from $5.3B in 2025 to the mid-$20Bs by 2028, up from just $16M in 2022. While there is competition from tech giants like Amazon and Google, CoreWeave's speed, specialization, and bold investment strategy put in in avery powerful position to keep riding (and helping shape) the AI boom.
Steph
Company Specialist at Welcome to the Jungle
Insights
194% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
May 2024
$1.1bn
SERIES C
May 2023
$200m
SERIES B
Total funding: $1.7bn
Company benefits
- Medical, dental, and vision insurance - 100% paid for by CoreWeave
- Company-paid Life Insurance
- Voluntary supplemental life insurance
- Short and long-term disability insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Ability to Participate in Employee Stock Purchase Program (ESPP)
- Mental Wellness Benefits through Spring Health
- Family-Forming support provided by Carrot
- Paid Parental Leave
- Flexible, full-service childcare support with Kinside
- 401(k) with a generous employer match
- Flexible PTO
- Catered lunch each day in our office and data center locations
- A casual work environment
- A work culture focused on innovative disruption
Company HQ
Civic Center, New York, NY
Leadership
Michael Intrator
(Co-Founder & CEO)Previously, Michael was a Principal Portfolio Manager at Natsource Asset Management for over 15 years. He also served as the CEO of Hudson Ridge Asset Management before co-founding CoreWeave in 2018.
Brian Venturo
(Co-Founder & CSO)Brian spent nearly 6 years at Natsource Asset Management as a Portfolio Manager before becoming a Partner at Hudson Ridge Asset Management. After co-founding CoreWeave he served as the CTO until 2024 when he moved into his current role of Chief Strategy Officer.
Brannin McBee
(Co-Founder & CDO)Brannin has a history in Proprietary Trading, having previously worked at Windy Bay Power and Active Power Investments. He also served as a VP at Fourth Floor Coastal and as an Associate at Elustria Capital PArtners.
Peter Salanki
(Co-Founder & CTO)Peter Previously served as a Director of Americas at Sandvine. Prior to that, he spent 11 years at Procera Networks as a Solutions Architect, Lead Architect, and Principal Solutions Architect.
Nitin Agrawal
(CFO)Nitin joined CoreWeave in 2024 as CFO. Prior to this, he was the VP of Finance at Google Cloud and CFO at Mapbox. He also spent nearly 5 years at AWS as CFO of Compute Services and 7 years at Microsoft as Group Manager of Finance.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 94 more jobs at CoreWeave