Principal of AI Infrastructure Solution Architect, d-Matrix
$175-260k
+ Offers Equity + Offers Bonus
3-5 days a week in office (Santa Clara, CA)
AI computing and efficiency software
Be an early applicant
AI computing and efficiency software
201-500 employees
Be an early applicant
$175-260k
+ Offers Equity + Offers Bonus
3-5 days a week in office (Santa Clara, CA)
201-500 employees
Company mission
To unleash the potential of generative AI to power the transformation of technology.
Role
Who you are
- Bachelor's or Master’s degree in Computer Science, or related technical field
- 10+ years of experience in infrastructure solution architecture, systems management, DevOps, or platform engineering roles
- Experience working with GPUs, custom AI accelerators or heterogeneous compute environments
- Proven expertise in building, managing, and monitoring full-stack AI infrastructure at scale
- Strong scripting/automation skills: Python, Bash, Ansible, Terraform, Helm, Docker/Kubernetes
- Deep understanding of orchestration technologies (Kubernetes, Ray, KServe, etc.), containerization, server clusters, multi-tenant serving, etc
- Experience with observability stacks (Prometheus, Grafana, OpenTelemetry, etc.)
- Strong skills in scripting and automation (e.g., Python, Bash, Ansible, Terraform, Helm)
- Familiarity with model serving and orchestration platforms (e.g., Triton Inference Server, Ray Serve, Kubeflow)
- Strong system debugging and incident response skills
- Outstanding collaboration and communication skills
What the job involves
- We are seeking a Solution Architect to develop and deliver comprehensive reference solutions that enable scalable, observable, and manageable deployment of AI inference workloads with d-Matrix hardware and software
- You will define and implement full-stack reference solutions including provisioning, telemetry, alerting, and performance monitoring for Gen AI inference clusters
- And you will collaborate closely with customers and ecosystem (OEMs, ISVs) to enable successful integration and deployment d-Matrix based solutions
- Develop end-to-end AI infrastructure reference solutions optimized for d-Matrix servers including compute, networking, storage, and orchestration layers, in collaboration with various internal teams
- Create reference blueprints that integrate smoothly into cloud-native and on-prem environments
- Develop infrastructure-as-code templates and examples using Ansible, Terraform, and Helm for provisioning d-Matrix-based nodes and clusters
- Integrate with Kubernetes-based systems to enable model deployment, auto-scaling, and fault-tolerant execution
- Design and deploy telemetry and monitoring frameworks to support real-time visibility into d-Matrix cluster health, job status, and system performance
- Integrate with industry-standard observability stacks (e.g., Prometheus, Grafana, OpenTelemetry) for data collection, visualization, and alerting
- Develop dashboards, health check systems, and metric pipelines that track performance, availability, and operational KPIs
- Collaborate with performance and software teams to validate infrastructure using real-world workloads and benchmarks
- Incorporate telemetry hooks for benchmark reporting and feedback-driven tuning
- Create and publish detailed infrastructure deployment guides, monitoring configuration templates, and operational best practices
- Collaborate with customers and OEM/ISV ecosystem, enable them to adopt and customize reference solutions to their specific datacenter environments and/or software stacks
Our take
d-Matrix is redesigning how AI gets done, tackling the limit f traditional chips with its Corsair platform. Using digital in-memory computing and a chiplet-based design, it delivers fast, power-efficient AI interface that's built for today's data-heavy models, without the energy overload.
Recently, the company has been making some serious moves. Its secured substantial funding, with backing from Microsoft, and partnering with HTEC to boost its software capabilities. With Corsair already showing serious speed gains over GPUs like Nvidia's H100, d-Matrix is proving it can deliver real-world performance at scale.
But instead of competing head-on with GPU giants, d-Matrix is focusing on where AI meets people. And with AI growing fast, especially for interactive and generative applications, d-Matrix is building the hardware that helps AI keep up with this demand.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Nov 2025
$275m
SERIES C
Sep 2023
$110m
SERIES B
Total funding: $429m
Company benefits
- Equity
- Health care
- Flexible time-off
- Paid paternity leave
- 401k retirement plan
- Remote & hybrid working model
- Work with world-leading engineers and researchers
- Peer coaching & development
- Team-building activities
- Happy hours
- Free food and snacks
- On-site fitness center
Company HQ
Santa Clara, CA
Leadership
Sid Sheth
(Co-Founder, CEO & President)Previously Director at NetLogic Microsystems, Director of Marketing at Broadcom Inc and SVP/GM at Inphi Corporation.
Sudeep Bhoja
(Co-Founder & CTO)Previously CTO at Inphi Corporation, Technical Director at Broadcom and Chief Architect at Big Bear Networks.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 18 more jobs at d-Matrix