Senior ML Infrastructure Engineer, CoreWeave
$175-210k
Office located in Livingston, NJ, Sunnyvale, CA
Specialized cloud provider
Be an early applicant
Specialized cloud provider
201-500 employees
Be an early applicant
$175-210k
Office located in Livingston, NJ, Sunnyvale, CA
201-500 employees
Company mission
CoreWeave's mission is to deliver a massive scale of GPU compute resources on top of the industry’s fastest and most flexible infrastructure.
Role
Who you are
- You have six or more years of experience in a software engineering industry with a specialization in developing and troubleshooting distributed systems in production and at scale
- You have a drive to learn and grow in a rapidly evolving technology space and have interest or experience in some of the current core technologies supported by the team such as Slurm, KNative, and/or Istio
- You are comfortable with the idea of using Go as your primary programming language and are capable of navigating a Linux operating environment
- You have experience using Kubernetes with an applicable understanding of its major components and ingress/service meshes
- You have thorough knowledge of cloud-native development including experience with container technologies, microservice design and architectural patterns
- You have familiarity with complex event processing and event-driven architecture
- You can transform problems in elastic architectures, decompose them into achievable tasks, and socialize both to your teammates
- You’re interested in reliability engineering concepts such as the different types of testing, progressive deployments, error budgets, the role observability, and fault-tolerant design
- You’re excited about being part of a team of diverse perspectives and backgrounds that believe in tackling challenges, growing hand in hand, and winning together
What the job involves
- The ML Infrastructure Team plays a key role in CoreWeave’s customer journey as the team responsible for supporting and innovating the interfaces our customers use to schedule and drive their machine learning workloads
- Initially supporting our Slurm and Inference interfaces, this team has a mandate to keep their fingers on the pulse of the Machine Learning community and provide commoditized solutions targeted to their needs that reduce friction and increase the efficiency and reliability of consuming CoreWeave’s world-class GPU cloud
- We are seeking a Senior Engineer to join the ML Infrastructure Team and help us build the interfaces of consumption that CoreWeave’s customers need in order to be successful
- This individual will join a team of mixed-skill engineers and have the opportunity to work on the full gamut of rewarding challenges that come with the business of building a cloud in a communicative, supportive, and high-performing environment
- Identify and implement scalable and fault-tolerant interfaces for consuming GPU resources that are responsive to the needs and practices of the ML community
- Create test plans, deployment automation, dashboards, alerts, and insights into our product’s operations as well as participate in the ML Infrastructure on-call rotation
- Grow, change, invest in your teammates, be invested-in, share your ideas, listen to others, be curious, have fun, and, above all, be yourself
Our take
Many cloud service providers can suffer from slow prediction speeds when they are used for data modeling. CoreWeave solves this problem with its specialized cloud service provider.
CoreWeave reduces prediction times and makes service requests faster and more efficient. This, in turn, cuts cloud costs considerably. This has proven to be a strong draw for many companies, with CoreWeave signing a lucrative partnership with GPU heavyweight NVIDIA as well as partnering with BitOoda, which has allowed it to expand its operations to the financial market.
However, in 2023 it closed three very significant rounds of funding (Series B and debt and secondary extensions), which is being invested into expanding its US-based data centers, opening two new ones in the coming year. The question remains whether, despite 2023's big investments in the sector, CoreWeave can maintain this momentum and whether generative AI's stock will continue to rise.
Steph
Company Specialist at Welcome to the Jungle
Insights
194% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
May 2024
$1.1bn
SERIES C
May 2023
$200m
SERIES B
Total funding: $1.7bn
Company benefits
- Medical, dental, and vision coverage
- Life and disability insurance
- Flexible Spending Account
- 401k with employer match
- Flexible PTO
- Catered lunch
- Kinside Childcare Concierge Service
- Gym reimbursement
Company HQ
Civic Center, New York, NY
Leadership
Michael Intrator
(CEO, not founder)Was Principal Portfolio Manager at Natsource Asset Managment for over 15 years. Served as CEO of The Atlantic Crypto Corporation and Hudson Ridge Asset Management.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 59 more jobs at CoreWeave