Staff Product Manager, CoreWeave
AI Performance and Benchmarking
$188-275k
+ Discretionary bonus; + Equity & Ability to Participate in Employee Stock Purchase Program
More information about location
Office located in New York, NY or Sunnyvale, CA
Specialized cloud provider
Open for applications
Specialized cloud provider
201-500 employees
Open for applications
$188-275k
+ Discretionary bonus; + Equity & Ability to Participate in Employee Stock Purchase Program
More information about location
Office located in New York, NY or Sunnyvale, CA
201-500 employees
Company mission
CoreWeave's mission is to deliver a massive scale of GPU compute resources on top of the industry’s fastest and most flexible infrastructure.
Role
Who you are
- The ideal candidate is passionate about AI and infrastructure technologies, with a deep understanding of GPUs, networking, and storage systems, foundation model architectures, AI workloads, frameworks and engines (e.g., PyTorch, JAX, vLLM), cloud-native technologies, and low-level constructs such as CUDA, NCCL, and kernels
- Experience: 8+ years of professional experience, with at least 5 years in Product Management of AI/ML or infrastructure products. Former engineers, solutions architects, or researchers with deep optimization and infra experience strongly encouraged
- Technical Knowledge: Deep understanding of HPC and AI/ML workloads including foundation model training, fine-tuning, inference, and RL
- Domain Knowledge: Expertise in model architectures and frameworks such as PyTorch, JAX, Ray, vLLM; strong grasp of CUDA, NCCL, kernels, and low-level GPU optimizations
- Infrastructure Knowledge: Strong understanding of GPUs, networking, and storage systems in distributed training/inference environments
- Leadership: Proven ability to lead cross-functional initiatives and teams, with strong decision-making and product management skills
- Customer-Centric Approach: Demonstrated experience working closely with customers to identify performance needs and translate them into product solutions
- Communication Skills: Excellent verbal and written communication skills with the ability to influence cross-functional teams and stakeholders
- Results-Oriented: Proven track record of driving business growth through innovative product solutions in the AI and infrastructure space
- Hands-On: Comfortable working with engineering teams to prototype, build, and test optimizations
- Education: Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field. MBA or equivalent experience is a plus
- You love to build technology solutions that power innovations
- You’re curious about the future of AI development with emerging technologies
- You’re an expert in foundation model architectures and AI infrastructure
What the job involves
- We are looking for a Staff Product Manager for AI Platform Services to lead performance optimization and benchmarking for foundation model training and inference on CoreWeave
- In this pivotal role, you will work closely with our top customers across AI Labs, startups, and enterprises to identify performance bottlenecks and partner with engineering to deliver product capabilities that maximize infrastructure efficiency and performance. You’ll have a direct impact on shaping the future of AI infrastructure and services
- You will leverage industry and customer insights as well as technical expertise to define the product vision, roadmap, and go-to-market strategy, ensuring that CoreWeave builds on its market-segment position as the leading AI Hyperscaler
- Product Strategy: Define and evolve CoreWeave's strategic software offerings for performance optimization and benchmarking of foundation model development and inference. Identify new opportunities and optimize existing approaches to deliver the highest infrastructure efficiency and performance for AI workloads
- Performance & Benchmarking: Drive the charter for platform capabilities that continually benchmark and monitor AI workload performance on CoreWeave. Lead submissions in industry benchmarking efforts such as MLPerf
- Model Development & Customization: Support customer workflows including pre-training, fine-tuning, evaluation, RL, and inference. Solve novel problems related to scaling AI model development and inference on specialized hardware
- Cross-Functional Collaboration: Partner with engineering, sales, finance, and marketing teams to ensure alignment on adoption and monetization goals, effective product launches, and seamless go-to-market execution
- Customer Success: Work closely with customers and go-to-market teams to ensure successful outcomes from onboarding to POC to scale
- Market Analysis: Conduct in-depth market research and competitive analysis to identify industry landscape, best practices, emerging trends, open source efforts, and opportunities for differentiation
- Pricing Strategy & Execution: Develop and implement pricing strategies considering market trends, competitive landscape, customer segmentation, and product value
- Performance Monitoring: Define key metrics and establish robust reporting to monitor adoption, identify areas for improvement, and inform future decisions
- Go-to-Market Strategy: Partner with industry partners, open-source projects (e.g., PyTorch, vLLM, llm-d), marketing, and sales teams to develop and execute effective go-to-market strategies, including positioning, messaging, and competitive differentiation. Represent CoreWeave in external conferences and industry events
Our take
Many cloud service providers can suffer from slow prediction speeds when they are used for data modeling. CoreWeave solves this problem with its specialized cloud service provider.
CoreWeave reduces prediction times and makes service requests faster and more efficient. This, in turn, cuts cloud costs considerably. This has proven to be a strong draw for many companies, with CoreWeave signing a lucrative partnership with GPU heavyweight NVIDIA as well as partnering with BitOoda, which has allowed it to expand its operations to the financial market.
However, in 2023 it closed three very significant rounds of funding (Series B and debt and secondary extensions), which is being invested into expanding its US-based data centers, opening two new ones in the coming year. The question remains whether, despite 2023's big investments in the sector, CoreWeave can maintain this momentum and whether generative AI's stock will continue to rise.
Steph
Company Specialist at Welcome to the Jungle
Insights
194% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
May 2024
$1.1bn
SERIES C
May 2023
$200m
SERIES B
Total funding: $1.7bn
Company benefits
- Medical, dental, and vision coverage
- Life and disability insurance
- Flexible Spending Account
- 401k with employer match
- Flexible PTO
- Catered lunch
- Kinside Childcare Concierge Service
- Gym reimbursement
Company HQ
Civic Center, New York, NY
Leadership
Michael Intrator
(CEO, not founder)Was Principal Portfolio Manager at Natsource Asset Managment for over 15 years. Served as CEO of The Atlantic Crypto Corporation and Hudson Ridge Asset Management.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 93 more jobs at CoreWeave