Technical Program Manager, Modular
AI/ML Infrastructure
$167-242k
Salary applicable to candidates based in the US. For Canada based roles: $158,000.00 - $229,000.00 CAD
More information about location
Fast, scalable Gen AI inference platform
Open for applications
Fast, scalable Gen AI inference platform
201-500 employees
Open for applications
$167-242k
Salary applicable to candidates based in the US. For Canada based roles: $158,000.00 - $229,000.00 CAD
More information about location
201-500 employees
Company mission
To have real, positive impact in the world by reinventing the way AI technology is developed and deployed into production with a next-generation developer platform.
Role
Who you are
- 6+ years of proven experience in Technical Program Management, specifically driving the development and delivery of complex software platforms, ideally within the AI/ML domain. Your background demonstrates a deep understanding of the challenges faced by ML developers in deploying models
- A strong technical foundation in AI/ML infrastructure, including a solid grasp of machine learning runtimes, graph compilers, and the critical aspects of achieving state-of-the-art performance across diverse model families and hardware types
- Demonstrated success in partnering with engineering and product teams to translate a strategic vision into well-defined project plans, including the establishment of clear milestones, measurable success criteria, and effective resource allocation strategies
- Experience in actively managing and contributing to relevant open-source software projects and communities that are critical to the development and success of a next-generation AI platform
- Proven ability to proactively identify and manage project risks, dependencies, and conflicts, implementing effective mitigation strategies to maintain project momentum and clarity of priorities within dynamic environments
- Exceptional communication and interpersonal skills, with a demonstrated ability to serve as the primary point of contact for projects, effectively managing communication flow and building strong relationships with development teams, stakeholders, and customers
- Excellent ability to provide clear, concise, and timely updates on project status, progress, and potential issues to both technical and non-technical stakeholders, including senior management, ensuring organizational alignment and transparency
What the job involves
- ML developers today face significant friction in taking trained models into deployment. They work in a highly fragmented space, with incomplete and patchwork solutions that require significant performance tuning and non-generalizable/ model-specific enhancements. At Modular, we are building the next generation AI platform that will radically improve the way developers build and deploy AI models
- A core part of this offering is providing a platform that allows customers to achieve state-of-the-art performance across model families and hardware types.
- In this role you will leverage your extensive technical and project management expertise to gather the necessary information required to manage projects of various size and scope by working closely with a team of engineers specializing in state of the art compiler technology, such as graph compilers and runtimes, and overlook the development of Mojo and MAX as the next generation technology platform for AI developers, and help revolutionize AI development and research
- Collaborate closely with Modular’s development team, including leading AI application researchers and kernel developers, to drive the creation and deployment of our next-generation AI platform
- Partner with engineering and product teams to translate the vision for a unified AI platform into actionable project plans, clearly defining milestones, success criteria, and resource allocation strategies
- Oversee the development lifecycle of Mojo and MAX, acting as a key driver in ensuring the on-time and successful delivery of this revolutionary AI technology platform
- Understand the intricate technical requirements for achieving state-of-the-art performance across diverse model families and hardware types, managing project scope accordingly
- Proactively identify and manage project risks, dependencies, and conflicts, implementing effective mitigation strategies to ensure smooth progress and maintain clarity on priorities
- Serve as the primary point of contact for assigned projects, effectively managing communication flow between the development team, stakeholders, and customers
- Provide clear and concise updates on project status, progress, and any potential issues to stakeholders and senior management, ensuring organizational alignment
- Work cross-functionally to identify opportunities for process improvement, implement best practices, and establish robust tools and sustainable processes within our dynamic environment
- Actively manage and contribute to Modular's engagement with relevant open-source software projects and communities that are critical to the development and success of the next-generation AI platform
Our take
AI development is booming, but the tools behind it? Not so much. Developers are often stuck dealing with messy, disconnected systems that slow everything down and bump up costs.
To address this, Modular has developed a unified AI platform that streamlines the development process. It's AI Engine enhances the performance of models on CPUs and GPUs, supporting popular frameworks like TensorFlow and PyTorch. And on top of that, it's built Mojo, a programming language that's as easy as Python but much faster (35,000 times faster).
In 2023, the company raised an impressive $100M to power its mission. It's been using this funding to grow its team, support more hardware, and push Mojo even further. With the hopes of making AI development faster, smoother, and a whole lot more fun for everyone.
Kirsty
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Sep 2025
$250m
LATE VC
Aug 2023
$100m
LATE VC
Total funding: $380m
Company benefits
- A variety of fantastic health benefits (health, dental, vision insurance; life insurance etc) are available
- A 401k plan with up to 5% match
- Free tax advice on Carta
- Generous work-from-home stipend of $1500 to help you improve your home office
- Unlimited paid time off and flexible work hours
Leadership
Chris Lattner
(Co-Founder & CEO)Founder, Architect, Engineer and BDFL for the LLVM Organization. Former President of Engineering and Product at SiFive, as well as working in various roles at Google, Tesla, and Apple.
Tim Davis
(Co-Founder & President)Worked at Google for 5 years, ultimately as Group Product Lead for Google ML. Previously founded Fluc Inc, where they developed the entire ML powered delivery system with their co-founder, and mapping software system CrowdSend.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 7 more jobs at Modular