Project Lead, NewtonX
AI Model Training
$150-240k
OTE
+ participation in our company stock buying program
More information about location
AI-powered B2B research
Be an early applicant
AI-powered B2B research
201-500 employees
Be an early applicant
$150-240k
OTE
+ participation in our company stock buying program
More information about location
201-500 employees
Company mission
To uncover world-class knowledge
Role
Who you are
- 3+ years of experience in data labeling, RLHF/SFT, or AI evaluation delivery — you have shipped real annotation or evaluation projects at a data labeling company (Scale, Surge, Mercor, Snorkel, Handshake, Centific, Labelbox, SuperAnnotate, or similar) or inside an AI lab. This is a firm requirement; we are not looking for a generalist project manager
- An operator who goes into the weeds. You are comfortable owning quality metrics, debugging a stalled queue, and rewriting a rubric that is not holding up in production
- Client-facing and credible. You can run a scoping call with a technical buyer, deliver bad news without losing the room, and translate operational mechanics into terms a client cares about
- Analytically rigorous. Data analysis skills using SQL or Python are a strong plus
- A builder. Processes here are young and some are still manual. You want to stand things up rather than inherit a finished machine
- Exceptional at holding many threads. You will run several concurrent projects with different clients, quality bars, and annotator pools
- Adaptable and resilient. Specs change, clients change their minds, and no two weeks look the same. You roll with it and find the new angle
- Discreet. This role handles annotator personal data and client-confidential information under strict data-security and confidentiality standards; all work stays within approved systems
- Valid US or Canadian work authorization required. Visa sponsorship is not available for this role
What the job involves
- NewtonX is turning the world’s largest verified expert network into the evaluation, post-training, and audit data that enterprises and AI labs need to deploy AI in production
- We build high-quality, expert-generated datasets that train and evaluate frontier AI systems — spanning domain eval sprints, custom data solutions, model behavior audits, agentic RL environments, and domain QA-as-a-service
- This business is taking off, and we are expanding our Delivery team to meet it
- We are hiring a Project Lead to own client engagements end to end, from scoping through delivery, on our data operations platform
- You will be the client’s point of contact and the person accountable for the operational execution and the quality outcome across a portfolio of concurrent projects — many of them complex agentic-workflow evaluations
- Our commercial team wins the business
- From the moment it is won, it is yours: you scope it, configure it, run it, defend its quality, and deliver it
- When a client asks how it is going, you are the person who answers
- When the spec turns out to be wrong at scale, you are the person who fixes it
- You will be joining a small, early Delivery team, working closely with our ML Lead, annotator delivery team, commercial team, and product and engineering
- Because the team is still young, you will help build and scale the delivery function itself — the playbooks, quality standards, and processes that everyone who follows you will run on — and you will have direct exposure to NewtonX’s C-level
- This is a ground-floor seat in a business we expect to grow extremely quickly, with the career path that comes with it
- 1. Scope and set up every engagement
- Translate the client’s need into a bounded statement of work. Turn a training or evaluation objective into concrete task design, a defined quality bar (defect-rate and inter-annotator agreement targets), an annotator profile, and — for agentic projects — an environment and tool strategy
- Configure the project on the platform. Stand up the multi-layer quality pipeline, task forms, grading rubrics, annotator enablement, and routing
- Author the first-draft guidelines and gold set with the ML Lead, and pressure-test them before production starts. Most delivery failures are scoping failures; your job is to catch them here
- 2. Run production
- Own quality, throughput, and cost. Track how each project is performing against its targets, diagnose what is drifting, and act before it reaches the client
- Manage the annotator pool on your projects. Assignment, layer access, qualification, and performance — working with the annotator delivery team to get the right experts on the right tasks
- Keep annotators aligned. Run project channels and calibration sessions, handle exceptions and escalations, and adjust configuration as the work reveals what the spec missed
- 3. Own the client relationship
- Be the client’s point of contact throughout — scoping calls, mid-project updates, quality escalations, and delivery
- Manage expectations against scope, and diagnose acceptance issues candidly when they arise. Clients trust the person who tells them early
- Grow the account from the inside. Surface expansion opportunities and new use cases to the commercial team, and act as the technical subject matter expert on calls when new work is being scoped
- 4. Deliver and close out
- Assemble and deliver batches on schedule, and own the handoff to the client
- Run client acceptance testing against agreed criteria, capture sign-off, and trigger the commercial milestone
- Run the post-mortem and feed what you learned back into guidelines, tooling, and the next scope
- 5. Build the machine as you run it
- Turn each engagement into repeatable process. Codify what works into playbooks, templates, and quality standards that the next Project Lead can run from day one
- Be the voice of delivery to product and engineering. You will be running on a platform that is still being built; what you flag gets built
Our take
In business, every decision needs data, but reaching those who have the expertise a company is looking for can be difficult and time-consuming. NewtonX is democratizing access to data and research, by enabling access to high-quality knowledge for all businesses, beyond those who employ a panel of experts.
The premise of NewtonX is that it matches questions to those who are verified to know the answer. Searches are custom and AI-led, and each one teaches the system so that it constantly improves at finding the most relevant professionals. As such, businesses have access to knowledge from a vast array of sources, without having to spend time sifting through irrelevant hits.
NewtonX works with an array of companies, including financial institutions and Fortune 500 consulting firms, showcasing the confidence that the industry has in its platform. It has raised impressive funding over the years, which will ensure that its proprietary search tech continues to be at the forefront of the space.
Freddie
Company Specialist at Welcome to the Jungle
Insights
31% employee growth in 12 months
Company
Funding (last 2 of 3 rounds)
Dec 2021
$32m
SERIES B
Jun 2019
$12m
SERIES A
Total funding: $46m
Company benefits
- Medical, dental, and vision insurance
- 401K 3% match, immediate vesting
- Paid Vacation and Public Holidays
- Paid Sick Days
- Pre-tax commuter benefits
- Health Savings / Flexible Savings Account
- Paid Parental / Family Leave
- Office snacks and refreshments
- Lunch and learns
- Monthly team outings and bimonthly happy hours
- Annual company retreat
- Volunteering
- Virtual fun, social activities (e.g., happy hours, painting, escape rooms, trivia, cooking classes, meditation, and more!)
Company HQ
Murray Hill, New York, NY
Leadership
Sascha J. E.
(Co-Founder & CEO)Former Consultant with McKinsey & Company and with The Boston Consulting Group. Also previously worked as a Financial Business Analyst.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 4 more jobs at NewtonX