AI Software Applications Engineer, d-Matrix
Technical Lead / Principal
$180-300k
+ Bonus & Equity
AI computing and efficiency software
Open for applications
AI computing and efficiency software
21-100 employees
Open for applications
$180-300k
+ Bonus & Equity
21-100 employees
Company mission
To deliver best-in-class economics for AI inference acceleration in the datacenter.
Role
Who you are
- The ideal candidate will have expertise in AI/ML infrastructure, with a focus on inference solutions and performance optimization for data center environments
- Engineering degree in Electrical Engineering, Computer Engineering, Computer Science, or related field, with substantial experience in AI/ML software and infrastructure with 10+ years of experience in customer engineering and field support for enterprise-level AI and datacenter products, with a focus on AI/ML software and generative AI inference
- In-depth knowledge and hands-on experience with generative AI inference at scale, including the integration and deployment of AI models in production environments
- Experience with automation tools and scripting languages (Linux or Windows shell scripting, Python, Go) to streamline deployment, monitoring, and issue resolution processes
- Ability to communicate complex technical concepts to diverse audiences, from developers to business stakeholders
Desirable
- Hands-on experience with AI/ML infrastructure accelerators (e.g., GPUs, TPUs) and expertise in optimizing performance for generative AI inference workloads
- Strong analytical skills with a proven track record of solving complex problems in AI/ML systems, including performance optimization and troubleshooting in AI/ML frameworks
- Extensive experience with the deployment of AI/ML frameworks such as PyTorch, OpenAI Triton, VLLM, and familiarity with container orchestration platforms like Kubernetes
- Excellent communication and presentation skills, with a demonstrated ability to guide customers through complex AI/ML system integration and troubleshooting
What the job involves
- D-Matrix is seeking an experienced AI Applications Engineer to drive the successful deployment and support of d-Matrix’s cutting-edge AI products and solutions, specifically in the realm of generative AI inference and AI/ML software support
- In this highly technical role, you will work closely with customers and internal teams to resolve complex software, hardware, and firmware challenges related to AI workloads
- This position requires a strong blend of engineering acumen and customer-facing skills to ensure the seamless deployment and continued success of our products
- Customer Enablement & Support: Provide expert guidance and support to customers deploying generative AI inference models, including assisting with integration, troubleshooting, and optimizing AI/ML software stacks. Respond promptly to customer queries, perform root cause analysis, and develop timely resolutions for complex issues
- AI/ML Inference Optimization: Work directly with customers to understand their generative AI inference needs and deliver solutions that maximize performance across their AI workloads. Collaborate with customers to implement best practices for model deployment and inference tuning
- System Design & Consultation: Conduct design reviews and provide consultation on AI/ML infrastructure, focusing on optimizing systems for generative AI workloads in datacenters. Develop reference solutions and technical documentation tailored to the needs of AI/ML applications
- AI/ML Software Stack Installation & Validation: Lead the installation, configuration, and bring-up of d-Matrix’s AI software stack. Perform functional and performance validation testing, ensuring that generative AI models run efficiently and meet customer expectations
- Collaboration on Technical Collateral: Partner with internal engineering and product teams to produce developer guides, technical notes, and other supporting materials that facilitate the adoption of our AI/ML solutions by customers
Our take
The explosion in the field of AI puts significant strain on traditional computers, and the silicon architectures currently in use are a bottleneck on the speed and effectiveness of emerging AI models. d-Matrix aims to tackle this challenge by with its digital in-memory computing accelerator for AI. Using a combination of machine learning software tools and modular chiplets it delivers a huge increase in AI computing efficiency without a corresponding increase in energy use.
D-Matrix has major competitors in the race to deliver the next generation of scalable AI solutions. These include the likes of Nvidea which is developing GPU architecture that runs at ten times the efficiency of existing models. However the flexibility and easy scalability of d-Matrix's solution helps it stand out, and its novel approach has gained a high degree of support from investors. The company is currently expanding its operations in the US, India and Australia, and is well poised for success as demand for AI compute solutions continues to grow exponentially.
Freddie
Company Specialist at Welcome to the Jungle
Company
Funding (2 rounds)
Sep 2023
$110m
SERIES B
Apr 2022
$44m
SERIES A
Total funding: $154m
Company HQ
Santa Clara, CA
Leadership
Sid Sheth
(CEO)Previously Director at NetLogic Microsystems, Director of Marketing at Broadcom Inc and SVP/GM atInphi Corporation.
Sudeep Bhoja
(CTO)Previously CTO at Inphi Corporation, Technical Director at Broadcom and Chief Architect at Big Bear Networks.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 16 more jobs at d-Matrix