Staff Software Engineer, d-Matrix

Inference Runtime Systems

$142.5-230k

Offers Equity and Bonus

Python

C++

PyTorch

CMake

Mid, Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

AI computing and efficiency software

Open for applications

AI computing and efficiency software

201-500 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Open for applications

$142.5-230k

Offers Equity and Bonus

Python

C++

PyTorch

CMake

Mid, Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

201-500 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Company mission

To unleash the potential of generative AI to power the transformation of technology.

Job

Company

Role

Who you are

The ideal candidate will have a strong background in C++ development, with experience in building distributed systems or high-performance computing (HPC) applications
Familiarity with PyTorch internals or similar machine learning frameworks is a significant advantage
Education: Bachelor’s with a minimum of 6+ years of professional experience in software development with a focus on C++, Master’s degree preferred in computer science, Engineering, or a related field with 3+ years of professional experience in software development with a focus on C++
Experience in architecting and building complex software systems
Experience with distributed systems or high-performance computing (HPC) applications
Familiarity with PyTorch internals or similar machine learning frameworks
Strong proficiency in modern C++ (C++11 and above) and Python
Solid understanding of software design patterns and best practices
Experience with parallel and concurrent programming
Proficient in CMake, Pytest, and other development tools
Knowledge of GPU programming and acceleration techniques is a plus
Proficient in using development tools and frameworks for building and deploying large-scale applications
Excellent problem-solving and analytical skills
Strong communication and interpersonal abilities

What the job involves

We are seeking a skilled and experienced Staff Software Engineer to contribute to the architecture and development of our next-generation AI inference runtime
Architect and Develop: Lead the design and implementation of a high-performance inference runtime that leverages d-Matrix's advanced hardware capabilities
Integrate Frameworks: Integrate the inference runtime with PyTorch to enable upstream software capabilities like inference and finetuning
Collaborate: Work closely with cross-functional teams including hardware engineers, data scientists, and product managers to define requirements and deliver integrated solutions
Optimize Performance: Develop and implement optimization techniques to ensure low latency and high throughput in distributed and HPC environments
Code Quality: Ensure the code quality, and performance through rigorous testing and code reviews
Documentation: Create technical documentation to support development, deployment, and maintenance activities

Our take

d-Matrix is redesigning how AI gets done, tackling the limit f traditional chips with its Corsair platform. Using digital in-memory computing and a chiplet-based design, it delivers fast, power-efficient AI interface that's built for today's data-heavy models, without the energy overload.

Recently, the company has been making some serious moves. Its secured substantial funding, with backing from Microsoft, and partnering with HTEC to boost its software capabilities. With Corsair already showing serious speed gains over GPUs like Nvidia's H100, d-Matrix is proving it can deliver real-world performance at scale.

But instead of competing head-on with GPU giants, d-Matrix is focusing on where AI meets people. And with AI growing fast, especially for interactive and generative applications, d-Matrix is building the hardware that helps AI keep up with this demand.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Sep 2023

$110m

SERIES B

Apr 2022

$44m

SERIES A

Total funding: $154m

Company benefits

Equity
Health care
Flexible time-off
Paid paternity leave
401k retirement plan
Remote & hybrid working model
Work with world-leading engineers and researchers
Peer coaching & development
Team-building activities
Happy hours
Free food and snacks
On-site fitness center

Company HQ

Santa Clara, CA

Leadership

Sid Sheth

(Co-Founder, CEO & President)

Previously Director at NetLogic Microsystems, Director of Marketing at Broadcom Inc and SVP/GM at Inphi Corporation.

Sudeep Bhoja

(Co-Founder & CTO)

Previously CTO at Inphi Corporation, Technical Director at Broadcom and Chief Architect at Big Bear Networks.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 12 more jobs at d-Matrix