AI Performance Engineer, Modular

$198-286k

Salary range shown is for US candidates. Canadian salary range is $187,000.00 - $270,000.00 CAD. Salary dependent on location

Python

Senior and Expert level

Remote in Canada, US

San Francisco Bay Area

AI infrastructure for developers

Open for applications

AI infrastructure for developers

201-500 employees

B2BArtificial IntelligenceMachine Learning

Open for applications

$198-286k

Salary range shown is for US candidates. Canadian salary range is $187,000.00 - $270,000.00 CAD. Salary dependent on location

Python

Senior and Expert level

Remote in Canada, US

San Francisco Bay Area

201-500 employees

B2BArtificial IntelligenceMachine Learning

Company mission

To have real, positive impact in the world by reinventing the way AI technology is developed and deployed into production with a next-generation developer platform.

Job

Company

Role

Who you are

5+ years of professional or postgraduate academic experience working on or researching performance analysis, tooling or benchmarking
Expertise in performance measurement (i.e. benchmarking), modeling, and analysis on real-world workloads
Extensive experience with Python
Creativity and curiosity for solving complex problems
Experience writing production-quality software
Strong written and verbal communication skills

What the job involves

As an AI Performance Engineer, you will join a small team of generalist engineers that optimize the performance of Modular’s MAX product in both breadth and depth
As part of deep dives on high-value models, you will collaborate with Kernel, Graph Compiler, and Cloud engineers to push Modular’s cutting-edge performance even further
Simultaneously, the performance team builds and applies performance analysis tooling to study and optimize the performance of MAX Engine and MAX Serve over a vast array of user configurations on a wide variety of CPU, GPU and Accelerator hardware
Measure, analyze, and identify opportunities to improve the performance of the MAX product under realistic and relevant usage patterns
Partner with the product and customer teams to understand the performance of the MAX product in both standard and cutting edge AI applications and design benchmarks to reflect them
Collaborate with the kernels and GenAI modeling team to bring up new model families
Collaborate with the kernels and runtime team to bring up and optimize new GPUs and accelerators
Collaborate with the cloud team to design and benchmark advanced serving features and new serving algorithms
Build statistical models and tools to operate on benchmarking & telemetry data and help develop key insights for performance, cloud costs, etc

Our take

Modular has been developing a programming language optimized for developing AI software, to make it easier for developers to complete their AI projects faster and more effectively.

Most of the time, developers will write AI models in Python because of its relatively simple and concise syntax. However, with this simplicity comes performance issues that can slow down programs and code, a problem that Modular hopes to address.

The company's language, named Mojo, combines the usability of Python with the performance of C; which, the company says, brings unparalleled programmability of AI hardware and extensibility of AI models.

With significant funding at its back, the company plans to enhance Mojo moving forward, as well as invest in its other product - a software tool called AI Engine that is designed to make companies’ neural networks faster.

Kirsty

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Aug 2023

$100m

LATE VC

Jun 2022

$30m

EARLY VC

Total funding: $130m

Company benefits

Leading medical, dental and vision packages
Equity packages
Generous maternity & paternity leave
401K Plan
Work wherever you want
Unlimited Vacation & PTO
Corporate perks & epic team fun
Great set up

Leadership

Chris Lattner

(CEO)

Founder, Architect, Engineer and BDFL for the LLVM Organization. Former President of Engineering and Product at SiFive, as well as working in various roles at Google, Tesla, and Apple.

Tim Davis

(President)

Worked at Google for 5 years, ultimately as Group Product Lead for Google ML. Previously founded Fluc Inc, where they developed the entire ML powered delivery system with their co-founder, and mapping software system CrowdSend.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 2 more jobs at Modular