Staff Product Manager, CoreWeave
AI Performance and Benchmarking
$188-275k
+ Discretionary bonus; + Equity & Ability to Participate in Employee Stock Purchase Program
More information about location
Office located in New York, NY or Sunnyvale, CA
The essential cloud for AI
Open for applications
The essential cloud for AI
1001+ employees
Open for applications
$188-275k
+ Discretionary bonus; + Equity & Ability to Participate in Employee Stock Purchase Program
More information about location
Office located in New York, NY or Sunnyvale, CA
1001+ employees
Company mission
To manage the complexities of AI growth to make supercomputing accessible and push the limits of what's possible.
Role
Who you are
- The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud-native technologies, and low-level constructs such as CUDA, NCCL, and kernels
- Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged
- Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL
- Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations
- Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments
- Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills
- Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions
- Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders
- Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space
- Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations
- Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus
- You love to build technology solutions that power innovations
- You’re curious about the future of AI development with emerging technologies
- You’re an expert in foundation model architectures and AI infrastructure
What the job involves
- We are looking for a Staff Product Manager for AI Platform Services to lead performance optimization and benchmarking for foundation model training and inference on CoreWeave
- In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You’ll have a direct impact on shaping the future of AI infrastructure and services
- You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler
- Product Strategy: Define and evolve CoreWeave's strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads
- Performance & Benchmarking: Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf
- Model Development & Customization: Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware
- Cross-Functional Collaboration: Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution
- Customer Success: Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale
- Market Analysis: Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation
- Pricing Strategy & Execution: Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value
- Performance Monitoring: Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions
- Go-to-Market Strategy: Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events
Our take
As AI continues to dominate the tech landscape, the demand for faster, more efficient cloud infrastructure is only intensifying. Traditional cloud providers often struggle with the sheer speed and scale required to power advanced AI models, leaving a gap for more specialized players. And that's where CoreWeave comes in, a company purpose-built to handle the heavy computational lift that the AI era demands.
CoreWeave's story is an interesting one too. What began in 2017 as a small crypto mining venture has evolved into one of the leading AI-focused cloud providers in the world. Its data centers are packed with high-end GPUs optimized for machine learning and generative AI, serving major clients like Microsoft and OpenAI. By designing its infrastructure around the needs of modern AI workloads rather than retrofitting older systems, CoreWeave has carved out a distinct and highly valuable niche in the market.
That focus in paying off in a big way too. Analyst project CoreWeave's revenue to soar from $5.3B in 2025 to the mid-$20Bs by 2028, up from just $16M in 2022. While there is competition from tech giants like Amazon and Google, CoreWeave's speed, specialization, and bold investment strategy put in in avery powerful position to keep riding (and helping shape) the AI boom.
Steph
Company Specialist at Welcome to the Jungle
Insights
194% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
May 2024
$1.1bn
SERIES C
May 2023
$200m
SERIES B
Total funding: $1.7bn
Company benefits
- Medical, dental, and vision insurance - 100% paid for by CoreWeave
- Company-paid Life Insurance
- Voluntary supplemental life insurance
- Short and long-term disability insurance
- Flexible Spending Account
- Health Savings Account
- Tuition Reimbursement
- Ability to Participate in Employee Stock Purchase Program (ESPP)
- Mental Wellness Benefits through Spring Health
- Family-Forming support provided by Carrot
- Paid Parental Leave
- Flexible, full-service childcare support with Kinside
- 401(k) with a generous employer match
- Flexible PTO
- Catered lunch each day in our office and data center locations
- A casual work environment
- A work culture focused on innovative disruption
Company HQ
Civic Center, New York, NY
Leadership
Michael Intrator
(Co-Founder & CEO)Previously, Michael was a Principal Portfolio Manager at Natsource Asset Management for over 15 years. He also served as the CEO of Hudson Ridge Asset Management before co-founding CoreWeave in 2018.
Brian Venturo
(Co-Founder & CSO)Brian spent nearly 6 years at Natsource Asset Management as a Portfolio Manager before becoming a Partner at Hudson Ridge Asset Management. After co-founding CoreWeave he served as the CTO until 2024 when he moved into his current role of Chief Strategy Officer.
Brannin McBee
(Co-Founder & CDO)Brannin has a history in Proprietary Trading, having previously worked at Windy Bay Power and Active Power Investments. He also served as a VP at Fourth Floor Coastal and as an Associate at Elustria Capital PArtners.
Peter Salanki
(Co-Founder & CTO)Peter Previously served as a Director of Americas at Sandvine. Prior to that, he spent 11 years at Procera Networks as a Solutions Architect, Lead Architect, and Principal Solutions Architect.
Nitin Agrawal
(CFO)Nitin joined CoreWeave in 2024 as CFO. Prior to this, he was the VP of Finance at Google Cloud and CFO at Mapbox. He also spent nearly 5 years at AWS as CFO of Compute Services and 7 years at Microsoft as Group Manager of Finance.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 95 more jobs at CoreWeave