Senior Software Engineer, Scale AI
GenAI Model Evaluation
$160-225k
+Equity
Training and validation data for AI applications
Open for applications
Training and validation data for AI applications
1001+ employees
Open for applications
$160-225k
+Equity
1001+ employees
Company mission
To accelerate the development of AI applications.
Role
Who you are
- We’re looking for entrepreneurial Software Engineers to join our team
- The ideal person is a natural entrepreneurial engineer who can take an ambiguous scope and lead the execution of outcomes, doing what it takes to hit them including both backend and frontend coding, defining requirements, coordinating with other eng and operations teams at Scale, etc
- We strongly believe the best engineers own outcomes and deeply understand customer problems
- 5+ years of full-time engineering experience, post-graduation
- Proficiencies in one or more of Python, Node, React, Next.js and MongoDB
- Solid background in algorithms, data structures, and object-oriented programming
- Experience scaling products at hyper-growth startups
- Excitement to work with AI technologies
- Strong written and verbal communication skills, to be able to thrive in a writing-first culture
- Strong problem-solving skills, and be able to work both independently and as part of a team
Desirable
- Strong knowledge of software engineering best practices
- Have experience with AI platforms and technologies, including generative models and LLMs
- Experience building ML infrastructure and AI-powered solutions
- Experience growing new products from 0 to 1
What the job involves
- The GenAI Safety & Evaluation product team at Scale is at the heart of this work, building a world-class customer-facing model evaluation platform
- This platform enables customers to easily launch new evaluation workflows, deep dive into evaluation results down to the test case level to understand weaknesses and benchmark performance, and use these insights to drive model development roadmaps
- In building this product, you will have a chance to shape the way that models across the industry are evaluated, impacting billions of people around the world. And as a newer product at Scale, you will have the opportunity to build something impactful from the ground up
- As part of the Safety & Evaluation product team, you will partner closely with researchers from Scale’s Safety, Evaluations, and Alignment Lab (SEAL) on productization of novel research, as well as Scale’s expert red team, which supports AI safety via rigorous model testing trusted by the White House, major enterprises, and leading model developers
- In this role, you'll be given the opportunity to build these products and drive millions of dollars in revenue. You’ll also get widespread exposure to the forefront of the AI race as Scale sees it in enterprises, startups, governments, and large tech companies
- Own large new areas within our product, delivering customer-ready features with engineering excellence that stands up to rigorous quality standards
- Work across backend, frontend, and interacting with LLMs and/or other ML models
- Work across the entire product lifecycle from conceptualization through production
- Be able, and willing, to multi-task and learn new technologies quickly
- Collaborating with cross-functional teams to define, design, and ship new product features and experiences
- Be ready to jump in on fast-turnaround product requests for high value customers
Our take
When training AI models, lack of access to large scale, high quality, labelled data is often the barrier preventing machine learning teams from building something great. In fact, labelled data is even more essential than the algorithms themselves. Scale AI is solving this by providing easy access through developer APIs to a huge variety of labelled data sets covering a large range of areas within computer vision and natural language processing.
It seems that almost every company now is offering artificial intelligence enabled products to automate every aspect of our lives. By positioning themselves as the go-to source for high quality tagged data, Scale AI is in an excellent position as the AI sector continues it's exponential growth.
With innovative AI projects across a range of sectors including retail, energy, and healthcare, Scale AI is now a leader in the industry alongside OpenAI. It continues to forge partnerships with fintech tools and software engine developers such as Brex and Luminar to continue its evolution of digital markets.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Some candidates hear
back within 2 weeks
31% female employees
38% employee growth in 12 months
Company
Funding (last 2 of 7 rounds)
May 2024
$1bn
SERIES F
Apr 2021
$325m
SERIES E
Total funding: $1.6bn
Company benefits
- Health, Dental & Vision Coverage: Our health plans give you the flexibility to select the right coverage for you and eligible family members through a variety of plan options
- Easy to use 401(K): Plan and invest for the future with a 401(k) via Guideline. Scale’s 401(k) plan provides you an opportunity to defer compensation for your long-term savings
- Wellness Fund: We care about the physical, mental, and emotional wellbeing of all Scaliens. Our $100/month wellness stipend can be used for gym memberships, acupuncture, meditation apps, and so much more
- Virtual Social Activities: Being remote has not stopped us from hosting fun virtual events. From trivia night to candle making, we ensure employees are fostering connections & building strong relationships
- Learning & Development: We know how important career growth is for Scaliens, so we offer a $500/year L&D stipend to help support continued development throughout your journey
- Flexible Work Hours: Flexible hours allow you to work when you are most productive. You can work with your manager to best plan your daily work schedule
- Generous Paid Time Off: Enjoy time to travel or plan a staycation. We encourage employees to take time off to recharge and prevent burnout. We have a flexible PTO policy where each employee is afforded the flexibility to take planned time-off as needed
- Commuter Benefits: Set aside pre-tax dollars to use on qualified transportation expenses to help ease your commute
- Parental Leave: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life
Company values
- Earn customer love: We are passionate about our customers and devoted to their success. We know that customer trust and confidence is earned, not given, with every interaction, every delivery, and every time we solve a customer problem
- Intellectual rigor, open mind: We think in clear verifiable hypotheses and continuously obtain data that validates or refutes them. We ask questions and challenge assumptions to get consistently to the truth
- Ambition shapes reality: We are extremely ambitious in what we can accomplish. We set high standards, expecting to fail in the short-term but knowing that failure guides us to learn and ultimately succeed
- Team flow: We are energized by each other’s success and actively invest in others with care, candor, and focus. Ideas flow openly between us because we treat each other with trust and respect
- Ownership is the job: We think like owners. We embody expansive ownership and are big believers in our ability to drive outcomes and enact change
- Run through walls: We are undaunted by barriers and race towards overcoming them. We step outside of our comfort zone, test our ideas, and do the hard work to get to the right solution to a hard problem
- Up the tempo: We move with agility and intent, and swiftly make two-way door decisions that allow us to learn faster, adapt quickly, and ultimately do more
- Results speak loudest: We define goals with intent and evaluate our outcomes with objectivity. At the end of the day, we measure ourselves by our results
Company HQ
Rincon Hill, San Francisco, CA
Articles
Leadership
Alexander Wang
(CEO)Dropped out of a bachelors degree at MiT in Computer Science and Mathematics. Previously worked for 2 years as a Software Engineer and Algorithm Developer in the finance industry and 2 years as a Tech Lead at Quora. Youngest founder funded by Accel as a teenager.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 81 more jobs at Scale AI