Machine Learning Research Engineer Internship, Hugging Face
SmolLMs Pretraining and Datasets
Community-driven platform for ML models
Open for applications
Community-driven platform for ML models
201-500 employees
Open for applications
201-500 employees
Company mission
Hugging Face is on a mission to democratize good machine learning, one commit at a time.
Role
Who you are
- If you love open-source but also have an eye for art and creativity, are passionate about making complex technology more accessible to engineers and artists, and want to contribute to one of the fastest-growing ML ecosystems, then we can't wait to see your application!
- If you're interested in joining us, but don't tick every box above, we still encourage you to apply
- We're building a diverse team whose skills, experiences, and background complement one another
- We're happy to consider where you might be able to make the biggest impact
What the job involves
- Smol models are an exciting area of research as they enable cheaper inference and can be run on-device allowing for more customization and ensuring privacy
- The SmolLM team at Hugging Face is pushing the frontier of smol models by building high quality pre-training and post-training datasets [1,2], and applying the latest architecture and training techniques to develop state-of-the-art models [2,3]
- The dataset processing can leverage our scalable CPU cluster and the models are trained on a state-of-the-art H100 cluster with close to 100 nodes
- In this internship you will work alongside the SmolLM team and work towards building the next generation of smol language models by iterating on datasets and models quickly and finally training models on our distributed training infrastructure
- If you are passionate about training LLMs and building high-quality datasets, proficient in Python, we would love to hear from you
- Join the SmolLM team and collaborate on developing the best smol models in the field
Application process
- Please provide a cover letter mentioning why you would like to work in open-source at Hugging Face. We encourage you to mention your skills, potential expertise, and topics on which you would like to work
Our take
Large language models, which recognize and generate text, are already being used to auto-complete sentences, power chat bots, moderate content, summarize news articles, and translate text online. However, many of these advances are happening behind closed doors, stifling innovation and raising ethicacy concerns.
To combat this, Hugging Face is building the "GitHub of machine learning". It’s a community-driven platform with a ton of repositories, where developers can create, discover and collaborate on ML models, datasets and ML apps. This work led to the creation of BLOOM in 2022, an open-access LLM with similar architecture to OpenAI’s GPT, but that is multilingual by design.
The company also launched the Hugging Chat Assistant, an open-source tool to create personalised chat assistants, in direct competition to OpenAI's paid service ChatGPT Plus. By continually creating value based on a global community, not just for Microsoft or Google, HuggingFace should be able to carve out its own path for success.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 7 rounds)
Aug 2023
$235m
SERIES D
May 2022
$100m
SERIES C
Total funding: $395.8m
Company benefits
- Flexible Work Environment
- Health Insurance
- Unlimited PTO
- Equity
- Growth, Training, & Conferences
- Generous Parental Leave
Company values
- A strong bias for action and impact
- A generalist & diverse mindset
- A decentralized, progressive and nimble approach
- A kind ambition
Company HQ
Dumbo, NY
Articles
Leadership
Clem Delangue
(CEO)Created Moodstocks, a startup building machine learning for computer vision acquired by Google. Also built Mention where they were head of Product and CMO until the company was acquired by MyNewsDesk.
Julien Chaumond
(CTO)Former advisor for the Deputy Minister for Digital Affairs in Paris, and Senior engineer for Stupefix app that was acquired by GoPro. Also co-founded and was CTO of Glose.
Thomas Wolf
(CSO)After graduating from Ecole Polytechnique, they worked on laser-plasma interactions at the BELLA Center of the Lawrence Berkeley National Laboratory. Also worked as a European Patent Attorney for 5 years.
People progressing
Lysandre started as an intern back in 2019 and now leads our Open Source team!
Diversity, Equity & Inclusion at Hugging Face
Emily Witko (DEIB and People Generalist)
- DEIB, at its core, is simply a set of daily practices and behaviors shaped by values that help us understand each other better, respectfully, and with care, despite what we have learned and believe.
- We are a values-driven organization motivated by a shared mission – good ML. To achieve this mission, we must invest in our people. We must foster a diverse and inclusive culture where employees at every level feel empowered to do their best work, are comfortable speaking up and sharing different perspectives, and are met with a strong sense of belonging. A culture where all employees are recognized and valued for their contributions, awarded ample access to opportunity, and are held accountable for how they show up for each other
Share this job
View 40 more jobs at Hugging Face