Senior/Staff Systems Software Engineer, d-Matrix

ML Infra Systems

Salary not provided

Kubernetes

Python

Linux

Tensorflow

C++

PyTorch

Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

AI computing and efficiency software

Open for applications

AI computing and efficiency software

201-500 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Open for applications

Salary not provided

Kubernetes

Python

Linux

Tensorflow

C++

PyTorch

Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

201-500 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Company mission

To unleash the potential of generative AI to power the transformation of technology.

Job

Company

Role

Who you are

The role requires you to be part of the team that helps productize the SW stack for our AI compute engine
You have had past experience working across all aspects of the full stack tool chain and understand the nuances of what it takes to optimize and trade-off various aspects of hardware-software co-design
BS in Computer Science, Engineering, Math, Physics or related degree with 8+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics or related degree preferred with 6+ years
Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals
Proficient in C/C++/Python development in Linux environment and using standard development tools
Experience with distributed, high performance software design and implementation
Self-motivated team player with a strong sense of ownership and leadership

Desirable

MS or PhD in Computer Science, Electrical Engineering, or related fields
Experience with inference servers/model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)
Experience with deep learning frameworks (such as PyTorch, Tensorflow)
Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, etc.)
Experience with distributed systems collectives such as NCCL, OpenMPI
Experience with software testing fundamentals
Experience deploying ML workloads (LLMs, VLMs, NLP, etc.) on distributed systems
Experience with Kubernetes, Ray or other MLOps tools and techniques used from definition to deployment
Prior startup, small team or incubation experience
Work experience at a cloud provider or AI compute / sub-system company

What the job involves

As part of the Software team, you will be responsible for the development, enhancement, and maintenance of the next-generation AI Deployment software
You are able to build and scale software deliverables in a tight development window
You will work with a team of system software experts to build out the deployment infrastructure working closely with other software (ML, Compilers) and hardware experts in the company

Our take

d-Matrix is redesigning how AI gets done, tackling the limit f traditional chips with its Corsair platform. Using digital in-memory computing and a chiplet-based design, it delivers fast, power-efficient AI interface that's built for today's data-heavy models, without the energy overload.

Recently, the company has been making some serious moves. Its secured substantial funding, with backing from Microsoft, and partnering with HTEC to boost its software capabilities. With Corsair already showing serious speed gains over GPUs like Nvidia's H100, d-Matrix is proving it can deliver real-world performance at scale.

But instead of competing head-on with GPU giants, d-Matrix is focusing on where AI meets people. And with AI growing fast, especially for interactive and generative applications, d-Matrix is building the hardware that helps AI keep up with this demand.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Sep 2023

$110m

SERIES B

Apr 2022

$44m

SERIES A

Total funding: $154m

Company benefits

Equity
Health care
Flexible time-off
Paid paternity leave
401k retirement plan
Remote & hybrid working model
Work with world-leading engineers and researchers
Peer coaching & development
Team-building activities
Happy hours
Free food and snacks
On-site fitness center

Company HQ

Santa Clara, CA

Leadership

Sid Sheth

(Co-Founder, CEO & President)

Previously Director at NetLogic Microsystems, Director of Marketing at Broadcom Inc and SVP/GM at Inphi Corporation.

Sudeep Bhoja

(Co-Founder & CTO)

Previously CTO at Inphi Corporation, Technical Director at Broadcom and Chief Architect at Big Bear Networks.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 14 more jobs at d-Matrix