Operations Program Manager, Scale AI
Quality Control
$105-129k
Plus equity
Training and validation data for AI applications
Open for applications
Training and validation data for AI applications
1001+ employees
Open for applications
$105-129k
Plus equity
1001+ employees
Company mission
To accelerate the development of AI applications.
Role
Who you are
- 1-3 years of experience
- A strong orientation towards outcomes, and a history of being scrappy when it counts – you are excited about building things from scratch and are able to solve difficult problems in high-stakes environments
- Strong written and verbal communication skills with the ability to lead dialectic discussions for the purpose of training our workforce to evaluating tasks consistently
- Ability to solve difficult problems in high-stakes environments. This will usually involve getting into the weeds to ensure the success of “must win” projects
- Entrepreneurial experience and mindset - you are excited about building things from scratch
- Experience planning, organizing, and managing resources to bring about the successful completion of specific project goals and objectives. Solid project management abilities, including the ability to prioritize tasks, manage resources, and meet deadlines
- A penchant for digging deep into data, thinking from first principles, and iterating quickly to deliver results
- Excellent qualitative and quantitative analytical skills
Desirable
- Must have experience with reading and writing SQL
- Work Experience with Product Management, Machine Learning, Deep Learning, Generative AI, Large Language Models, Natural Language Processing
- Professional certifications in quality management (e.g., Certified Quality Manager, Six Sigma)
What the job involves
- Scale is at the forefront of enabling Machine Learning across multiple industries including Generative AI (e.g., chatbots)
- As a Program Manager (PgM) for Quality Control, you will cultivate a highly calibrated workforce of quality control specialists who inspect and validate our GenAI deliverables before they are sent to our customers
- Own quality for a set of projects in STEM and/or Business domains
- Own outcomes in their entirety: from ideation and strategy to in-the-weeds delivery of Quality Control audit results and insights
- Develop systems to monitor auditor performance and analytics to identify areas for improvement and ensure adherence to quality standards
- Design and execute quality control processes to monitor and evaluate product/service quality throughout the organization. Establish and maintain quality performance metrics and key performance indicators (KPIs) to measure and report on quality levels
- Build, maintain, and regularly communicate detailed reporting for other leaders across the company who will use your team's data to inform their own operations and strategy. Work with product operations, customer operations, engineering, and other quality operations teams to execute on delivering SLAs for high-priority pilots
- Help hire and maintain a 50+ contractor workforce of GenAI quality control; coach and develop leaders in the workforce to achieve high-impact outcomes
- Develop and administer training programs to ensure Quality Control auditors are set up for succes
Our take
When training AI models, lack of access to large scale, high quality, labelled data is often the barrier preventing machine learning teams from building something great. In fact, labelled data is even more essential than the algorithms themselves. Scale AI is solving this by providing easy access through developer APIs to a huge variety of labelled data sets covering a large range of areas within computer vision and natural language processing.
It seems that almost every company now is offering artificial intelligence enabled products to automate every aspect of our lives. By positioning themselves as the go-to source for high quality tagged data, Scale AI is in an excellent position as the AI sector continues it's exponential growth.
With innovative AI projects across a range of sectors including retail, energy, and healthcare, Scale AI is now a leader in the industry alongside OpenAI. It continues to forge partnerships with fintech tools and software engine developers such as Brex and Luminar to continue its evolution of digital markets.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 7 rounds)
May 2024
$1bn
SERIES F
Apr 2021
$325m
SERIES E
Total funding: $1.6bn
Company benefits
- Health, Dental & Vision Coverage: Our health plans give you the flexibility to select the right coverage for you and eligible family members through a variety of plan options
- Easy to use 401(K): Plan and invest for the future with a 401(k) via Guideline. Scale’s 401(k) plan provides you an opportunity to defer compensation for your long-term savings
- Wellness Fund: We care about the physical, mental, and emotional wellbeing of all Scaliens. Our $100/month wellness stipend can be used for gym memberships, acupuncture, meditation apps, and so much more
- Virtual Social Activities: Being remote has not stopped us from hosting fun virtual events. From trivia night to candle making, we ensure employees are fostering connections & building strong relationships
- Learning & Development: We know how important career growth is for Scaliens, so we offer a $500/year L&D stipend to help support continued development throughout your journey
- Flexible Work Hours: Flexible hours allow you to work when you are most productive. You can work with your manager to best plan your daily work schedule
- Generous Paid Time Off: Enjoy time to travel or plan a staycation. We encourage employees to take time off to recharge and prevent burnout. We have a flexible PTO policy where each employee is afforded the flexibility to take planned time-off as needed
- Commuter Benefits: Set aside pre-tax dollars to use on qualified transportation expenses to help ease your commute
- Parental Leave: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life
Company HQ
Rincon Hill, San Francisco, CA
Leadership
Alexander Wang
(CEO)Dropped out of a bachelors degree at MiT in Computer Science and Mathematics. Previously worked for 2 years as a Software Engineer and Algorithm Developer in the finance industry and 2 years as a Tech Lead at Quora. Youngest founder funded by Accel as a teenager.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 111 more jobs at Scale AI