Senior Software Engineer, CentML
LLM Inference
+ Employee stock options
Machine learning training platform
Open for applications
Machine learning training platform
21-100 employees
Open for applications
+ Employee stock options
21-100 employees
Company mission
To pioneer novel technology to enhance computing efficiency, making AI accessible for innovation and to benefit the global community.
Role
Who you are
- Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
- Strong coding skills in Python and C/C++
- 5+ years of industry experience in software engineering
- Knowledgeable and passionate about machine learning and performance engineering
Desirable
- Solid fundamentals in machine learning and deep learning
- Solid fundamentals in operating systems, computer architecture, and parallel programming
- Research experience in systems or machine learning
- Industry experience in building enterprise-scale large distributed systems
- Experience with training, deploying, or optimizing the inference of LLMs in production is a plus
- Experience with performance modeling, profiling, debugging, and code optimization or architectural knowledge of CPU and GPU is a plus
What the job involves
- As a member of the LLM inference team, you will help build state-of-the-art software with the goal of enabling LLM inference to become more efficient, scalable, and accessible. Are you interested in architecting and implementing the best inference stacks in the LLM world? Work and collaborate with a diverse set of teams involving resource orchestration, distributed systems, inference engine optimization, and writing high-performance GPU kernels
- Write safe, scalable, modular, and high-quality (C++/Python) code for our core backend software
- Perform benchmarking, profiling, and system-level programming for GPU applications
- Provide code reviews, design docs, and tutorials to facilitate collaboration among the team
- Conduct unit tests and performance tests for different stages of the inference pipeline
Our take
In an increasingly AI and ML-driven world, the demand for these technologies is skyrocketing, alongside their costs, leaving numerous companies without access to tools that could enhance their operations. CentML emerges as a solution, aiming to democratize AI and ML by making them more accessible and cost-effective for all.
Backed by a team with extensive expertise in AI, ML compilers, and ML hardware, CentML possesses a deep understanding of the inefficiencies prevalent in the industry. Among the challenges it addresses is the scarcity of AI chips. By meticulously analyzing clients' AI/ML requirements, CentML advises on suitable hardware options to optimize performance and minimize costs.
With its inception in 2022, CentML has swiftly garnered attention and funding, underscoring the market's appetite for its offerings. Recent funding will enable the company to further refine its product and conduct pivotal research in the field, solidifying its position as a pioneering force in democratizing AI and ML technologies.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Some candidates hear
back within 2 weeks
Company
Funding (2 rounds)
Sep 2023
$26.5m
SEED
Jun 2022
$3.5m
SEED
Total funding: $30m
Company benefits
- An open and inclusive culture and work environment
- Fully stocked kitchen at the office
- Full health and dental benefits
- Parental Leave top-up for 6 months
- Continuous education budget
- Generous vacation - we're not saying unlimited, but if you need extra time to recharge, just ask
Company HQ
Yonge-Bay Corridor, Toronto, ON
Leadership
Gennady Pekhimenko
(Co-Founder & CEO)Also an Associate Professor at the University of Toronto, a Faculty Member at Vector Institute, and a Research Co-Chair at MLCommons.
Shang Wang
(Co-Founder & CTO)Graduate Student Researcher at Vector Institute. Previously a Senior Software Engineer at Nvidia.
Akbar Nurlybayev
(Co-Founder & COO)Prior work includes Director of Engineering (Data Platform) at KAR Global and Software Development Manager at TradeRev.
Anand Jayarajan
(Co-Founder)Previously a Research Fellow at the Indian Institute of Technology, and a Software Development Engineer at Flipkart.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 8 more jobs at CentML