DevOps Infrastructure Engineer, Etched
More information about location
Office located in Cupertino, CA
Designing specialized chips for language model inference
Open for applications
Designing specialized chips for language model inference
21-100 employees
Open for applications
More information about location
Office located in Cupertino, CA
21-100 employees
Company mission
To create the world’s most powerful servers for transformer inference.
Role
Who you are
- Are highly technical
- Strong knowledge of Linux, containerization, CI/CD, and programming languages such as Python/C++. You will be asked coding questions during your interview
- Proven ability to lead technical teams and mentor junior members
- Have 4+ years of experience with either infrastructure engineering or software development
- Experience debugging complex hardware and software issues with server infrastructure Strong candidates may also have experience with
- In-depth understanding of workflows used in the semiconductor industry, especially those involving Synopsys and Cadence EDA tooling and Verilator
- Proficiency with cloud computing technology and experience working with a Big 3 Cloud
- Experience monitoring and installing datacenter hardware
- In-depth understanding of workflows used in the semiconductor industry,
What the job involves
- You will drive adoption of cutting-edge tooling, to improve the speed and reliability of our toolchains
- You will help us innovate to do better than the industry norm, by running massively parallel CI jobs, specifying and building our own fully-redundant SSD-only server infrastructure, and making sure these tools run automatically and reliability
- You will work with an IT contracting firm to do the day-to-day maintenance and installation - while you must be knowledgeable enough about IT to work with this firm, most of your time will be spent designing new toolchains entirely
- The scope and title of this role can be modified for exceptional candidates
- Spec out a server using a 6 GHz desktop CPU to speed up single-threaded workloads
- Decide if moving our servers to the cloud/a colo facility makes sense to improve uptime
- Set up networking infrastructure to allow Jupyter notebook users to connect to our servers, without waiting for them to be restarted
- Parallelize our CI stack to run on dozens of different machines at once, designing a policy to avoid unnecessary CI failures if a machine goes down
Our take
With AI developing rapidly, the chips that power them are doing so too. The computing requirements of technologies such as Chat GPT will increasingly require customised, hard-wired chips called ASICS, designed specially for the execution of AI models. Whilst GPUs are currently used for AI computing, Etched is making a bet on AI-hardwired chips becoming the predominant powering force of AI.
It’s a gamble, the founders themselves know that if transformers become obsolete, so will their AI-powering product. The SOHU chip that Etched builds differs from GPUs in that it has the AI architecture etched into the chip itself. General Processing Units are “general” and costly, so Etched is betting on specialised transformers taking their place in the near future.
Investors are drawn to Etched’s boldness. The 2022-founded company achieved $120 million in Series A funding just two years into its life. Etched plans to use this to become a main competitor of GPU company Nvidia, and claims to be 20 times faster than the latter’s AI-powering general processor - and significantly less costly too. Time will tell if Etched’s exciting and potentially revolutionary bet on tailored AI chips and transformers pays off.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (2 rounds)
Jun 2024
$120m
SERIES A
May 2023
$5.4m
SEED
Total funding: $125.4m
Company benefits
- Competitive Salary and Equity - We offer a competitive salary and equity package that aligns with industry standards
- Benefits - Your wellbeing is important to us. We offer unlimited PTO, life insurance, and a 401(k)
- Full Insurance Coverage - Our insurance includes full medical, dental, and vision with 100% of premium covered
Company HQ
Cupertino, CA
Articles
Leadership
Robert Wachen
(COO & Co-Founder)Also the Co-Founder of Prod and Mentor Labs, Birthday Cakes 4 Free Maryland and Generate Sales Online.
Gavin Uberti
(CEO & Co-Founder)Previously Software Engineer at OctoML, Algorithms and BAckend Engineer at Coursedog and was a Software Engineer Intern at Xnor.ai.
Chris Zhu
(Co-Founder)Was a Teaching Fellow at Harvard and a Software Engineering Intern at Amazon and AvantStay. Was an Analyst at Harvard Undergraduate Capital Partners.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 8 more jobs at Etched