Full Stack Engineering Manager, Scale AI
GenAI Safety & Evaluation
$212.8-255.4k
Plus equity
1-2 days a week in office
Training and validation data for AI applications
Job no longer available
Training and validation data for AI applications
1001+ employees
Job no longer available
$212.8-255.4k
Plus equity
1-2 days a week in office
1001+ employees
Company mission
To develop reliable AI systems for the world's most important decisions.
Role
Who you are
- 5+ years of full-time engineering experience, post-graduation
- 1+ year of prior engineering management or equivalent experience, and have managed eng team of 5+
- Have extensive experience in fullstack software development
- Experience scaling products at hyper-growth startups
- Excitement to work with AI technologies
- Extremely strong track record as an individual contributor
- Show a track record of mentoring and leading teams in successful projects
- Possess excellent communication and collaboration skills, and the ability to translate complex technical concepts to non-technical stakeholders
Desirable
- Deep technical knowledge of Software Development, willing to get deep into the weeds to solve problems alongside the team
- Have experience with AI platforms and technologies, including generative models and LLMs
- A knowledge of and interest in the latest developments in AI safety and evaluation
What the job involves
- The GenAI Safety & Evaluation product team at Scale is at the heart of this work, building a world-class customer-facing model evaluation platform
- This platform enables customers to easily launch new evaluation workflows, deep dive into evaluation results down to the test case level to understand weaknesses and benchmark performance, and use these insights to drive model development roadmaps
- In building this product, you will have a chance to shape the way that models across the industry are evaluated, impacting billions of people around the world. And as a newer product at Scale, you will have the opportunity to build something impactful from the ground up
- As part of the T&E team, you will partner closely with researchers from Scale’s Safety, Evaluations, and Analysis Lab (SEAL) on productization of novel research, as well as Scale’s expert red team, which supports AI safety via rigorous model testing trusted by the White House, major enterprises, and leading model developers
- We’re looking for Senior Engineering Managers to join our team. You will be responsible for hiring, training and managing a high performing engineering team
- Recruit a high performing engineering team to support the function that you are owning
- Drive engineering productivity. Provide guidance, mentorship, and technical leadership to a team of researchers and engineers working on Generative AI projects
- Work closely with customers - some of the most sophisticated ML organizations in the world - to build out products and platforms to achieve customer’s research goals
- Collaborate with cross-functional teams to define, design, and execute strategic roadmap
Our take
When training AI models, lack of access to large scale, high quality, labelled data is often the barrier preventing machine learning teams from building something great. In fact, labelled data is even more essential than the algorithms themselves. Scale AI is solving this by providing easy access through developer APIs to a huge variety of labelled data sets covering a large range of areas within computer vision and natural language processing.
It seems that almost every company now is offering artificial intelligence enabled products to automate every aspect of our lives. So, by positioning themselves as the go-to source for high quality tagged data, Scale AI is in an excellent position as the AI sector continues it's exponential growth.
With innovative AI projects across a range of sectors including retail, energy, and healthcare, Scale AI is now a leader in the industry alongside OpenAI. It continues to forge partnerships with fintech tools and software engine developers such as Brex and Luminar to continue its evolution of digital markets.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 7 rounds)
May 2024
$1bn
SERIES F
Apr 2021
$325m
SERIES E
Total funding: $1.6bn
Company benefits
- Health & Wellbeing: Our holistic approach to supporting Scaliens includes comprehensive health coverage, dental and vision insurance, mental healthcare services, and more. PTO policies and accommodating schedules ensure you’ll get time off when you need it to relax and recharge. Note that our offerings may vary by region as we strive to respond to the unique needs of Scaliens around the globe.
- Personal & Career Growth: Continuously learn and grow through annual learning & development stipend, attending leadership breakfasts, manager training, speaker series, and joining an ERG.
- Building Scale Community: We welcome guests to our offices, and you can expect to see Scalien families and friends around. Join local happy hours, and accept invites to game nights, book clubs, and many other employee-led community events.
- Parental Support: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life.
Company HQ
Rincon Hill, San Francisco, CA
Leadership
Alexandr Wang
(Founder & CEO)Previously, Alexandr was an Algorithm Developer at Hudson River Trading, a Tech Lead and Quora and a Software Engineer at Addepar.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 102 more jobs at Scale AI