Member of Technical Staff, Essential AI

Research Engineer, Pre-Training

$225-250k

+ Equity

Python

PyTorch

Junior, Mid and Senior level

San Francisco Bay Area

More information about location

AI products for enterprise

Job no longer available

AI products for enterprise

21-100 employees

B2BArtificial IntelligenceEnterpriseInternal toolsBusiness IntelligenceSaaS

Job no longer available

$225-250k

+ Equity

Python

PyTorch

Junior, Mid and Senior level

San Francisco Bay Area

More information about location

21-100 employees

B2BArtificial IntelligenceEnterpriseInternal toolsBusiness IntelligenceSaaS

Company mission

To build an open platform to fuel and accelerate AI breakthroughs globally.

Job

Company

Role

Who you are

Self-motivated and takes a proactive approach to constantly iterate by continuously experimenting, inferring, and deciding the right set of next experiments
Research experience with a focus on pre-training and building large language models using frameworks such as Megatron, DeepSpeed, MaxText, etc
You have strong ML fundamentals and first principles thinking that guides your approach to research
You have experience of coming up with new methods or improving existing techniques in ML or related fields
Proficiency in programming languages such as Python and frameworks such as JAX, PyTorch or TF
Experience with data engineering and preprocessing, in particular, optimization of data pipelines, feature engineering, and model evaluation is beneficial
Strong problem solving, analytical, communication, and collaboration skills with the ability to analyze complex datasets and derive actionable insights
Ability to prototype and deploy pre-trained models in production environments
You enjoy building things from the ground up in a fast-paced, collaborative environment

What the job involves

The Research Engineer, Pre-Training will be responsible for designing and implementing novel pre-training approaches to create powerful foundation models that can be fine-tuned/further aligned for a variety of downstream tasks
You will work very closely with our Research Scientists to identify key challenges and opportunities, and then develop and test new pre-training techniques and architectures
This may involve exploring different model architectures, training objectives, data sources, and scaling approaches
You will also be responsible for running large-scale experiments, analyzing results, and iterating on your approaches
You will lead or be a core contributor to our research bets that advance the the real-world capabilities of our models
You will collaborate closely with our data and product teams to close the loop between research and product, identify capability gaps and evaluate progress
Design novel pre-training architectures and algorithms to improve model performance and efficiency
Design and execute experiments to evaluate the efficacy of pre-training techniques across various datasets; Analyze experimental results to gain insights into model behavior and identify areas for improvement
Develop efficient and scalable pre-training pipelines to train models on massive amounts of data
Implement pre-training models and algorithms; Optimize model performance and scalability for deployment in production environments

Our take

Essential AI is on a mission to make frontier AI accessible to everyone. The team builds open models, easy-to-use tools, and reliable pipelines so anyone can experiment, iterate, and create faster. Founded by a team with experience at Google and other tech giants, the company combines deep know-how with a curiosity-driven approach to AI.

Even though it's still early days, Essential AI is making waves by sharing cutting-edge models and open science along the way. This approach doesn't just accelerate research but it invites collaboration and helps new talent jump in as well as turns complex AI breakthrough into real-world tools people can actually use.

With funding and a growing team too, Essential AI is now focused on building products that can really change how businesses work, making workflows smarter and productivity smoother. By partnering with builders and developers around the world, the company is shaping the future of AI in a way that's open, practical, and pretty exciting.

Freddie

Company Specialist at Welcome to the Jungle

Company

Funding (2 rounds)

Dec 2023

$56.5m

SERIES A

Mar 2023

$8.3m

SEED

Total funding: $64.8m

Company HQ

SoMa, San Francisco, CA

Leadership

Ashish Vaswani

(Co-Founder & CEO)

Previously co-founder and Chief Scientist of Adept AI Labs and Staff Research Scientist at Google Brain.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 1 more job at Essential AI