Staff Software Engineer, CoreWeave
Inference
The essential cloud for AI
Posted today
The essential cloud for AI
1001+ employees
Posted today
1001+ employees
Company mission
To manage the complexities of AI growth to make supercomputing accessible and push the limits of what's possible.
Role
Who you are
- ~8–12+ years of experience building large-scale distributed systems or cloud platforms
- Proven track record of leading cross-team or organization-level technical initiatives at scale
- Strong coding skills in Go, Python, or C++
- Deep expertise in Kubernetes at production scale, including orchestration, scheduling, and service design
- Strong understanding of networked systems, performance optimization, and distributed system design
- Hands-on engineering experience with inference systems, including batching/micro-batching strategies, caching, memory optimization, mixed precision (BF16/FP8), and streaming token delivery
- Demonstrated ability to systematically improve tail latency (P95/P99) and platform reliability through metrics-driven engineering
- Experienced in owning system-wide SLIs/SLOs, capacity planning, autoscaling strategies, and mentoring senior and mid-level engineers
- Bachelor’s degree in Computer Science, Engineering, or a related technical field
Desirable
- Direct open-source or production contributions to modern inference frameworks such as vLLM, Triton, TensorRT-LLM, Ray Serve, or TorchServe
- Deep experience with GPU systems engineering and hardware performance optimization (CUDA, NCCL, RDMA, NUMA, or GPU interconnects)
- Direct exposure to large-scale AI/ML infrastructure or hyperscale cloud environments
What the job involves
- Experience leading Data Engineering, Platform Engineering or Data Platform teams
- We'd love to hear from experienced Senior Data Engineering Managers, Heads of Data Engineering, Heads of Platform Engineering or similar technology leaders looking for their next challenge
- Proven experience leading managers and building high-performing engineering teams
- Strong programme delivery experience, with a track record of delivering strategic roadmaps across multiple teams
- Excellent stakeholder management skills, with the ability to influence technical and non-technical leaders
- Experience managing technology vendors, supplier relationships and commercial governance
- Comfortable balancing operational delivery with long-term planning and organisational priorities
- Strong understanding of engineering operations, governance and platform reliability
- A background in Data Engineering, Platform Engineering or Data Platforms, with the ability to work effectively alongside technical specialists
- Deep technical architecture expertise isn't essential
- Confident leading through ambiguity, bringing clarity and direction in evolving environments
- Experience with cloud data platforms such as Snowflake, dbt and AWS would be beneficial
- Experience working within a high-growth technology business or exposure to AI and Machine Learning platforms would be an advantage
Salary benchmarks
Our take
As AI continues to dominate the tech landscape, the demand for faster, more efficient cloud infrastructure is only intensifying. Traditional cloud providers often struggle with the sheer speed and scale required to power advanced AI models, leaving a gap for more specialized players. And that's where CoreWeave comes in, a company purpose-built to handle the heavy computational lift that the AI era demands.
CoreWeave's story is an interesting one too. What began in 2017 as a small crypto mining venture has evolved into one of the leading AI-focused cloud providers in the world. Its data centers are packed with high-end GPUs optimized for machine learning and generative AI, serving major clients like Microsoft and OpenAI. By designing its infrastructure around the needs of modern AI workloads rather than retrofitting older systems, CoreWeave has carved out a distinct and highly valuable niche in the market.
That focus in paying off in a big way too. Analyst project CoreWeave's revenue to soar from $5.3B in 2025 to the mid-$20Bs by 2028, up from just $16M in 2022. While there is competition from tech giants like Amazon and Google, CoreWeave's speed, specialization, and bold investment strategy put in in a very powerful position to keep riding (and helping shape) the AI boom.
Steph
Company Specialist at Welcome to the Jungle
Insights
194% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
May 2024
$1.1bn
SERIES C
May 2023
$200m
SERIES B
Total funding: $1.7bn
Company HQ
Civic Center, New York, NY
Leadership
Michael Intrator
(Co-Founder & CEO)Previously, Michael was a Principal Portfolio Manager at Natsource Asset Management for over 15 years. He also served as the CEO of Hudson Ridge Asset Management before co-founding CoreWeave in 2018.
Brian Venturo
(Co-Founder & CSO)Brian spent nearly 6 years at Natsource Asset Management as a Portfolio Manager before becoming a Partner at Hudson Ridge Asset Management. After co-founding CoreWeave he served as the CTO until 2024 when he moved into his current role of Chief Strategy Officer.
Brannin McBee
(Co-Founder & CDO)Brannin has a history in Proprietary Trading, having previously worked at Windy Bay Power and Active Power Investments. He also served as a VP at Fourth Floor Coastal and as an Associate at Elustria Capital PArtners.
Peter Salanki
(Co-Founder & CTO)Peter Previously served as a Director of Americas at Sandvine. Prior to that, he spent 11 years at Procera Networks as a Solutions Architect, Lead Architect, and Principal Solutions Architect.
Nitin Agrawal
(CFO)Nitin joined CoreWeave in 2024 as CFO. Prior to this, he was the VP of Finance at Google Cloud and CFO at Mapbox. He also spent nearly 5 years at AWS as CFO of Compute Services and 7 years at Microsoft as Group Manager of Finance.
Share this job
View 161 more jobs at CoreWeave