Staff Software Engineer, d-Matrix

Inference Runtime Systems

$142.5-230k

Offers Equity and Bonus

Python

C++

PyTorch

CMake

Mid, Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

AI computing and efficiency software

Be an early applicant

AI computing and efficiency software

21-100 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Be an early applicant

$142.5-230k

Offers Equity and Bonus

Python

C++

PyTorch

CMake

Mid, Senior and Expert level

San Francisco Bay Area

3 days a week in office (Santa Clara, CA)

21-100 employees

B2BArtificial IntelligenceMachine LearningSaaSAutomation

Company mission

To deliver best-in-class economics for AI inference acceleration in the datacenter.

Job

Company

Role

Who you are

The ideal candidate will have a strong background in C++ development, with experience in building distributed systems or high-performance computing (HPC) applications
Familiarity with PyTorch internals or similar machine learning frameworks is a significant advantage
Education: Bachelor’s with a minimum of 6+ years of professional experience in software development with a focus on C++, Master’s degree preferred in computer science, Engineering, or a related field with 3+ years of professional experience in software development with a focus on C++
Experience in architecting and building complex software systems
Experience with distributed systems or high-performance computing (HPC) applications
Familiarity with PyTorch internals or similar machine learning frameworks
Strong proficiency in modern C++ (C++11 and above) and Python
Solid understanding of software design patterns and best practices
Experience with parallel and concurrent programming
Proficient in CMake, Pytest, and other development tools
Knowledge of GPU programming and acceleration techniques is a plus
Proficient in using development tools and frameworks for building and deploying large-scale applications
Excellent problem-solving and analytical skills
Strong communication and interpersonal abilities

What the job involves

We are seeking a skilled and experienced Staff Software Engineer to contribute to the architecture and development of our next-generation AI inference runtime
Architect and Develop: Lead the design and implementation of a high-performance inference runtime that leverages d-Matrix's advanced hardware capabilities
Integrate Frameworks: Integrate the inference runtime with PyTorch to enable upstream software capabilities like inference and finetuning
Collaborate: Work closely with cross-functional teams including hardware engineers, data scientists, and product managers to define requirements and deliver integrated solutions
Optimize Performance: Develop and implement optimization techniques to ensure low latency and high throughput in distributed and HPC environments
Code Quality: Ensure the code quality, and performance through rigorous testing and code reviews
Documentation: Create technical documentation to support development, deployment, and maintenance activities

Our take

The explosion in the field of AI puts significant strain on traditional computers, and the silicon architectures currently in use are a bottleneck on the speed and effectiveness of emerging AI models. d-Matrix aims to tackle this challenge by with its digital in-memory computing accelerator for AI. Using a combination of machine learning software tools and modular chiplets it delivers a huge increase in AI computing efficiency without a corresponding increase in energy use.

D-Matrix has major competitors in the race to deliver the next generation of scalable AI solutions. These include the likes of Nvidea which is developing GPU architecture that runs at ten times the efficiency of existing models. However the flexibility and easy scalability of d-Matrix's solution helps it stand out, and its novel approach has gained a high degree of support from investors. The company is currently expanding its operations in the US, India and Australia, and is well poised for success as demand for AI compute solutions continues to grow exponentially.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Sep 2023

$110m

SERIES B

Apr 2022

$44m

SERIES A

Total funding: $154m

Company values

All ideas get heard
Intellectual honesty prevails
Everyone feels included.

Company HQ

Santa Clara, CA

Articles

d-Matrix gets $44m in quest for efficient AI server chiplets

d-Matrix Raises $44M in Series A Funding

D-Matrix AI Chip Promises Efficient Transformer Processing

Leadership

Sid Sheth

(CEO)

Previously Director at NetLogic Microsystems, Director of Marketing at Broadcom Inc and SVP/GM atInphi Corporation.

Sudeep Bhoja

(CTO)

Previously CTO at Inphi Corporation, Technical Director at Broadcom and Chief Architect at Big Bear Networks.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 4 more jobs at d-Matrix