HPC Engineer, Hugging Face
Machine Learning Infrastructure
Community-driven platform for ML models
Job no longer available
Community-driven platform for ML models
501-1000 employees
Job no longer available
501-1000 employees
Company mission
Hugging Face is on a mission to democratize good machine learning, one commit at a time.
Role
Who you are
- The ideal candidate will have experience provisioning large compute clusters for AI workflows and strong experience supporting teams to create best practices for reliability and scalability
- 7+ years of experience in a DevOps or infrastructure Engineer role building machine learning infrastructure and working with large GPU clusters
- Knowledge of cloud providers such as AWS, GCP, infra-as-code frameworks and observability tools
- Familiarity with Python Scientific stack, Pytorch
- Experience with data structures, data modeling, and database management as well as object and file storage systems
- Strong communication, collaboration, and documentation skills
- Experience with Linux, Git, containers, networking and command line tools
- Strong programming skills in Python, Golang, and/or Rust
- If you are a passionate Infrastructure Engineer with a keen interest in AI and thrive in a challenging and innovative setting, we would love to hear from you
What the job involves
- We are looking for a HPC Engineer responsible for developing and scaling our distributed large cluster
- Design, develop, deploy, and maintain reliable and scalable infrastructure that enables efficient training workloads
- Manage large compute clusters for AI Training and development
- Create tooling and infrastructure that abstract compute and storage in ML workflows
- Measure and optimize system performance
- Monitor and troubleshoot infrastructure issues, ensuring high availability and performance of AI workloads
- Stay up to date with the latest advancements in AI infrastructure technologies and recommend improvements to enhance system efficiency and performance
- Work closely with AI software engineering teams to ensure infrastructure can handle all system requirements
- Provide primary operational support and engineering for multiple teams
Our take
Large language models, which recognise and generate text, are already being used to auto-complete sentences, power chatbots, moderate content, summarise news articles, and translate text online. However, many of these advances are happening behind closed doors, stifling innovation and raising ethical concerns.
To combat this, Hugging Face is building the "GitHub of machine learning". It’s a community-driven platform with a ton of repositories, where developers can create, discover and collaborate on ML models, datasets and ML apps. This work led to the creation of BLOOM in 2022, an open-access LLM with similar architecture to OpenAI’s GPT, but that is multilingual by design.
The company also launched the Hugging Chat Assistant, an open-source tool creating personalised chat assistants, in direct competition with OpenAI's paid service ChatGPT Plus. By continually creating value based on a global community, not just for Microsoft or Google, HuggingFace should be able to carve out its own path for success.
Freddie
Company Specialist at Welcome to the Jungle
Insights
36% employee growth in 12 months
Company
Funding (last 2 of 7 rounds)
Aug 2023
$235m
SERIES D
May 2022
$100m
SERIES C
Total funding: $395.8m
Company benefits
- Flexible Work Environment
- Health Insurance
- Unlimited PTO
- Equity
- Growth, Training, & Conferences
- Generous Parental Leave
Company HQ
Dumbo, NY
Leadership
Clem Delangue
(Co-Founder & CEO)Created Moodstocks, a startup building machine learning for computer vision acquired by Google. Also built Mention where they were head of Product and CMO until the company was acquired by MyNewsDesk.
Julien Chaumond
(Co-Founder & CTO)Former advisor for the Deputy Minister for Digital Affairs in Paris, and Senior engineer for Stupefix app that was acquired by GoPro. Also co-founded and was CTO of Glose.
Thomas Wolf
(Co-Founder & CSO)After graduating from Ecole Polytechnique, they worked on laser-plasma interactions at the BELLA Center of the Lawrence Berkeley National Laboratory. Also worked as a European Patent Attorney for 5 years.
Share this job
View 4 more jobs at Hugging Face