Senior/Staff Systems Software Engineer, d-Matrix

ML Infra Systems

Salary not provided

Kubernetes

Python

Linux

Tensorflow

C++

PyTorch

Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

AI computing and efficiency software

Be an early applicant

AI computing and efficiency software

21-100 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Be an early applicant

Salary not provided

Kubernetes

Python

Linux

Tensorflow

C++

PyTorch

Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

21-100 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Company mission

To deliver best-in-class economics for AI inference acceleration in the datacenter.

Job

Company

Role

Who you are

The role requires you to be part of the team that helps productize the SW stack for our AI compute engine
You have had past experience working across all aspects of the full stack tool chain and understand the nuances of what it takes to optimize and trade-off various aspects of hardware-software co-design
BS in Computer Science, Engineering, Math, Physics or related degree with 8+ years of industry software development experience and MS in Computer Science, Engineering, Math, Physics or related degree preferred with 6+ years
Strong grasp of system software, data structures, computer architecture, and machine learning fundamentals
Proficient in C/C++/Python development in Linux environment and using standard development tools
Experience with distributed, high performance software design and implementation
Self-motivated team player with a strong sense of ownership and leadership

Desirable

MS or PhD in Computer Science, Electrical Engineering, or related fields
Experience with inference servers/model serving frameworks (such as TensorRT-LLM, vLLM, SGLang, etc.)
Experience with deep learning frameworks (such as PyTorch, Tensorflow)
Experience with deep learning runtimes (such as ONNX Runtime, TensorRT, etc.)
Experience with distributed systems collectives such as NCCL, OpenMPI
Experience with software testing fundamentals
Experience deploying ML workloads (LLMs, VLMs, NLP, etc.) on distributed systems
Experience with Kubernetes, Ray or other MLOps tools and techniques used from definition to deployment
Prior startup, small team or incubation experience
Work experience at a cloud provider or AI compute / sub-system company

What the job involves

As part of the Software team, you will be responsible for the development, enhancement, and maintenance of the next-generation AI Deployment software
You are able to build and scale software deliverables in a tight development window
You will work with a team of system software experts to build out the deployment infrastructure working closely with other software (ML, Compilers) and hardware experts in the company

Our take

The explosion in the field of AI puts significant strain on traditional computers, and the silicon architectures currently in use are a bottleneck on the speed and effectiveness of emerging AI models. d-Matrix aims to tackle this challenge by with its digital in-memory computing accelerator for AI. Using a combination of machine learning software tools and modular chiplets it delivers a huge increase in AI computing efficiency without a corresponding increase in energy use.

D-Matrix has major competitors in the race to deliver the next generation of scalable AI solutions. These include the likes of Nvidea which is developing GPU architecture that runs at ten times the efficiency of existing models. However the flexibility and easy scalability of d-Matrix's solution helps it stand out, and its novel approach has gained a high degree of support from investors. The company is currently expanding its operations in the US, India and Australia, and is well poised for success as demand for AI compute solutions continues to grow exponentially.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Sep 2023

$110m

SERIES B

Apr 2022

$44m

SERIES A

Total funding: $154m

Company HQ

Santa Clara, CA

Leadership

Sid Sheth

(CEO)

Previously Director at NetLogic Microsystems, Director of Marketing at Broadcom Inc and SVP/GM atInphi Corporation.

Sudeep Bhoja

(CTO)

Previously CTO at Inphi Corporation, Technical Director at Broadcom and Chief Architect at Big Bear Networks.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 16 more jobs at d-Matrix