Research Engineer, Prolific
AI Services
+ Equity
High-quality human-powered data at scale
Open for applications
High-quality human-powered data at scale
101-200 employees
Open for applications
+ Equity
101-200 employees
Company mission
To accelerate human understanding.
Role
Who you are
- 3+ years of experience in AI/ML research, research engineering, or applied ML
- Strong knowledge of LLM evaluation methodologies, data collection design, and human feedback approaches
- Experience designing AI-assisted or model-in-the-loop workflows - you think creatively about where AI can augment human judgment
- Track record of executing research or applied AI/ML projects with clear outcomes
- Can build quickly when needed - you're comfortable prototyping solutions and build your own tooling
- Strong communicator across contexts - you can hold your own with AI lab researchers, translate methodology into actionable recommendations for customers, and bring internal teams along on what matters and why. Prior customer-facing or consulting experience is a plus but not required
- Based in US, Canada, or Mexico (or able to work US timezone hours)
What the job involves
- We're seeking an AI Research Engineer to serve as Prolific's technical research partner to AI labs and enterprise customers
- You'll work directly with customers on AI evaluation and data collection projects - advising on methodology, designing frameworks, and delivering research engagements end-to-end as part of our services team
- You'll contribute to how organizations approach evaluation, alignment, and human data challenges while shaping Prolific's own capabilities
- Your work will directly impact how we understand, evaluate, and improve AI systems through high-quality human data
- You'll serve as Prolific's technical research partner on customer engagements with AI labs and enterprise AI teams
- Advise and prototype bespoke solutions like evaluation methodology, rubric design, data collection approaches, quality frameworks, verifiers and validation frameworks, as well as RL environments
- Own methodology for projects - from scoping through delivery - working alongside our services team
- Build trusted relationships with customer research and engineering teams
- Surface patterns from customer work that should become platform capabilities, partnering with Product and Engineering to shape roadmap priorities
- Work with Services and Account teams to qualify opportunities and shape proposals
- Share learnings across the Research Engineering function to strengthen our collective expertise
- Contribute to Prolific's research publications and external collaborations as opportunities arise
- Collaborate with product teams to translate research insights into practical applications
- Mentor team members on advanced AI concepts and emerging research
- Communicate complex technical concepts to diverse stakeholders
Our take
Founded in 2014, Prolific is a marketplace and data analysis company that provides researchers with a network of test participants. From eye-tracking to human-facing AI applications, Prolific’s network acts as both a recruiter for test participants and as a marketplace for researchers scientists to hire said participants.
Founded in 2014, it’s already used by the likes of Google, Stanford, Oxford and Kings College London Universities to test new AI products, providing “stress tests” for its clients. Prolific’s user base now counts over 2000 potential test subjects, whilst researchers leverage its network to launch surveys, tests and evaluation tasks every 2 minutes.
An indicator of Prolific’s success is maintaining of profitability for years after its initial Y Combinator investment. In 2024, it raised $32 million in Series A to maintain its healthy position. This funding will allow it to expand its operations.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (1 round)
Jul 2023
$33.2m
Series A
Total funding: $33.2m
Company benefits
- Bank holiday swaps
- Enhanced sick pay
- L&D budget – £1000 per year
- 25 days annual leave + bank holidays
Company values
- We win together
- We care deeply about our customers
- We make every minute count
- We're optimistic and find a way
- We embrace change
- We aim high
Company HQ
Kings Cross, London, UK
Leadership
Phelim Bradley
(Co-Founder & CEO)Currently also Venture Partner at Pioneer Fund. Previously Dphil at Wellcome Trust Centre for Human Genetics, Bioinformatics Intern at Illumina and MPhil of Computer Biology at University of Cambridge.
Diversity, Equity & Inclusion at Prolific
- At Prolific, we want all of our employees, researchers, and participants to be included and so we commit to having ongoing discussions about diversity and inclusion and regularly look at areas where we can improve. This policy aims to: - treat all our employees fairly and respectfully, regardless of their job status, location, or work hours ⏰ - avoid any illegal discrimination based on age, disability, gender, gender identity, marriage or civil partnership, pregnancy and maternity, race or ethnicity, religion or belief, sexual orientation, and traveler status. These are protected by the UK Equality Act (2010), Ireland Employment Equality Act (2004), Americans with Disabilities Act (ADA) at the federal level and the New York State Human Rights Law (NYSHRL) at the state level. ⚖️ - refuse to tolerate any kind of illegal discrimination 🙅🏻♀️. This includes pay and benefits, work conditions, grievance and discipline handling, termination, redundancy, parental leave, flexible working requests, employment selection, promotion, training, and other opportunities for development.
Share this job
View 22 more jobs at Prolific