Cloud Inference Tech Lead, Modular
$261-305k
+ Stock options, $247,000.00 - $288,000.00 CAD.
Fast, scalable Gen AI inference platform
Job no longer available
Fast, scalable Gen AI inference platform
201-500 employees
Job no longer available
$261-305k
+ Stock options, $247,000.00 - $288,000.00 CAD.
201-500 employees
Company mission
To have real, positive impact in the world by reinventing the way AI technology is developed and deployed into production with a next-generation developer platform.
Role
Who you are
- 10+ years of experience in the field of cloud infrastructure
- Proven experience in developing production-quality high-performance cloud solutions
- Proven experience in AI/ML infrastructure, model serving, or related field
- Proven technical leadership and cross team collaboration
- Track record of customer excellence
- A robust understanding of the principles and execution of operating large scale systems on cloud infrastructure
What the job involves
- Developers face challenges deploying trained machine learning models due to fragmented, incomplete solutions necessitating extensive adjustments and model-specific optimizations
- Modular's next-generation platform aims to revolutionize AI development and deployment
- As the Cloud Inference Tech Lead you will focus your efforts on a critical component of Modular's enterprise offering, focusing on a GenAI cluster-level inference product
- You will use your skills and background to design and implement key features and provide a technical leadership and mentorship to others in the engineering and product organization influencing the strategic direction and helping facilitate tactical decisions
- Mammoth is our Kubernetes-native cluster solution that ensures reliable, effortless deployment of customer’s GenAI models with top-tier large-scale performance, independent of using different types of GPUs or other accelerator hardware
- Technical Leadership: Mentor others and help set the technical direction of the team and Modular at large in the domain of large scale GenAI inference
- Strategic Vision: Drive product strategy and design decisions for enterprise-grade cloud inference serving platform, work closely with customers to ensure their success while advancing Modular platform as the best platform for AI inference in production
- Technical Excellence: Drive, and support Modular fast-paced growth of supporting customers and enabling new use-cases, with changing priorities, while applying technical expertise and cutting-edge technology solutions
- Customer Success: Collaborate with product and other engineers and leaders to support the best customer experience of fully integrated, large scale Gen AI cloud inference deployment solutions
Our take
AI development is booming, but the tools behind it? Not so much. Developers are often stuck dealing with messy, disconnected systems that slow everything down and bump up costs.
To address this, Modular has developed a unified AI platform that streamlines the development process. It's AI Engine enhances the performance of models on CPUs and GPUs, supporting popular frameworks like TensorFlow and PyTorch. And on top of that, it's built Mojo, a programming language that's as easy as Python but much faster (35,000 times faster).
In 2023, the company raised an impressive $100M to power its mission. It's been using this funding to grow its team, support more hardware, and push Mojo even further. With the hopes of making AI development faster, smoother, and a whole lot more fun for everyone.
Kirsty
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Sep 2025
$250m
LATE VC
Aug 2023
$100m
LATE VC
Total funding: $380m
Company benefits
- A variety of fantastic health benefits (health, dental, vision insurance; life insurance etc) are available
- A 401k plan with up to 5% match
- Free tax advice on Carta
- Generous work-from-home stipend of $1500 to help you improve your home office
- Unlimited paid time off and flexible work hours
Leadership
Chris Lattner
(Co-Founder & CEO)Founder, Architect, Engineer and BDFL for the LLVM Organization. Former President of Engineering and Product at SiFive, as well as working in various roles at Google, Tesla, and Apple.
Tim Davis
(Co-Founder & President)Worked at Google for 5 years, ultimately as Group Product Lead for Google ML. Previously founded Fluc Inc, where they developed the entire ML powered delivery system with their co-founder, and mapping software system CrowdSend.
Share this job
View 5 more jobs at Modular