Product Manager, Scale AI
Public Sector GenAI Test & Evaluation
$205.6-257k
+ Equity Grant
Training and validation data for AI applications
Open for applications
Training and validation data for AI applications
1001+ employees
Open for applications
$205.6-257k
+ Equity Grant
1001+ employees
Company mission
To develop reliable AI systems for the world's most important decisions.
Role
Who you are
- Engineering Depth: 3+ years of experience in software engineering, systems architecture, or highly technical program management. You must be able to read code, understand system architecture, and participate in technical design reviews alongside engineering teams
- Evaluation Systems Expertise: Proven experience designing, owning the roadmap for, or operating the infrastructure required to continuously measure, improve, and show the performance of AI applications
- Problem Distillation: Demonstrated experience taking a vaguely defined problem (e.g., "our evaluation cycles are too slow") and delivering a technical roadmap, resource requirements, and measurable success metrics within a narrow time window
- Ambiguity Management: Proven track record of taking a project from "stalled/undefined" to "shipped" in a high-pressure environment. You can point to at least two instances where you inherited a failing project and saw it through to production
- Cross-Functional Leadership: Led multiple projects that required direct alignment between at least three distinct engineering organizations (e.g., Infrastructure, ML Research, and Product)
- Operational Execution: Experience using technical project management frameworks (e.g., Linear) to provide consistent weekly reporting on delivery velocity and blockers to executive stakeholders
Desirable
- Security Clearance: Active Secret, Top Secret, or TS/SCI clearance
- GenAI Implementation: Practical experience developing or evaluating features built specifically on LLMs, RAG, or autonomous agent workflows
- Technical Rigor: Advanced degree in Computer Science, Engineering, or a related field
- Public Sector Expertise: 2+ years of experience working with DoD, IC, or Civil agencies on mission-critical software deployments
What the job involves
- The Public Sector GenAI T&E Product Manager will be a high-horsepower technical leader, defining the vision and owning the roadmap for our evaluation capabilities
- This role requires thriving in unscripted, high-stakes environments, as you will be the primary owner for the T&E tech stack—the robust infrastructure required to continuously measure, improve, and prove the superiority and sustained performance of our agentic applications
- Traversing multiple engineering organizations across Scale, you will identify bottlenecks, distill technical friction into actionable plans, and drive execution
- You will work across Scale’s commercial and public sector teams to define requirements, ensuring our evaluation services are robust enough for the most demanding government use cases
- Key objectives include refining the tech stack that allows ML teams to hillclimb, and surfacing critical performance information to stakeholders
Our take
When training AI models, lack of access to large scale, high quality, labelled data is often the barrier preventing machine learning teams from building something great. In fact, labelled data is even more essential than the algorithms themselves. Scale AI is solving this by providing easy access through developer APIs to a huge variety of labelled data sets covering a large range of areas within computer vision and natural language processing.
It seems that almost every company now is offering artificial intelligence enabled products to automate every aspect of our lives. So, by positioning themselves as the go-to source for high quality tagged data, Scale AI is in an excellent position as the AI sector continues it's exponential growth.
With innovative AI projects across a range of sectors including retail, energy, and healthcare, Scale AI is now a leader in the industry alongside OpenAI. It continues to forge partnerships with fintech tools and software engine developers such as Brex and Luminar to continue its evolution of digital markets.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 7 rounds)
May 2024
$1bn
SERIES F
Apr 2021
$325m
SERIES E
Total funding: $1.6bn
Company benefits
- Health & Wellbeing: Our holistic approach to supporting Scaliens includes comprehensive health coverage, dental and vision insurance, mental healthcare services, and more. PTO policies and accommodating schedules ensure you’ll get time off when you need it to relax and recharge. Note that our offerings may vary by region as we strive to respond to the unique needs of Scaliens around the globe.
- Personal & Career Growth: Continuously learn and grow through annual learning & development stipend, attending leadership breakfasts, manager training, speaker series, and joining an ERG.
- Building Scale Community: We welcome guests to our offices, and you can expect to see Scalien families and friends around. Join local happy hours, and accept invites to game nights, book clubs, and many other employee-led community events.
- Parental Support: Balancing work and family is essential, and Scale understands the importance of having adequate leave policies in place to promote a healthy home and work life.
Company HQ
Rincon Hill, San Francisco, CA
Leadership
Alexandr Wang
(Founder & CEO)Previously, Alexandr was an Algorithm Developer at Hudson River Trading, a Tech Lead and Quora and a Software Engineer at Addepar.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 99 more jobs at Scale AI