Senior MLOps Engineer, Prolific
High-quality human-powered data at scale
Be an early applicant
High-quality human-powered data at scale
101-200 employees
Be an early applicant
101-200 employees
Company mission
To accelerate human understanding.
Role
Who you are
- 5+ years experience with cloud infrastructure and infrastructure as code
- Previous experience with the ML and LLM lifecycle - training, hosting, optimisation, observability
- Used to working closely with researchers and data scientists - taking experiments from worksheets into production
- Strong grasp of ML fundamentals and modern GenAI stack
What the job involves
- As a Senior ML/LLMOps Engineer, you will be the backbone of our AI production lifecycle
- You will bridge the gap between research and real-world application, ensuring our Data Scientists and AI Researchers have the high-performance infrastructure, automated pipelines, and deployment strategies needed to ship state-of-the-art models at scale
- We deploy models and infrastructure responsible for a host of AI tasks, ranging from fraud detection to RAG based search
- Infrastructure as Code (IaC): Design and maintain scalable cloud environments (GCP/AWS) using Terraform
- Resource Provisioning: Manage GPU/TPU resource allocation for training, fine-tuning, and interactive notebooks
- Custom Tooling: Build internal services and CLI tools to streamline the developer experience for the AI team
- Automated Pipelines: Design CI/CD/CT (Continuous Training) pipelines using tools such as GitHub Actions, MLFlow, Vertex AI Pipelines. Ensure high quality training data (e.g. introducing a feature store)
- Deployment Methodology: Develop reusable patterns for model serving. Managing service deployments to Kubernetes
- Vector Infrastructure: Manage and optimize vector databases and embedding pipelines for RAG-based systems
- Inference Optimization: Implement techniques to reduce latency and increase throughput
- Cold Start Mitigation: Solve scaling bottlenecks for serverless or containerized model deployments
- Cost Management: Optimize GPU utilization and cloud spend without compromising performance
- Traditional MLOps: Monitor for model drift, data skew, and resource utilization
- LLM-Specific Ops: Implement LLM Tracing to monitor prompts, agent actions and general service health
Our take
Founded in 2014, Prolific is a marketplace and data analysis company that provides researchers with a network of test participants. From eye-tracking to human-facing AI applications, Prolific’s network acts as both a recruiter for test participants and as a marketplace for researchers scientists to hire said participants.
Founded in 2014, it’s already used by the likes of Google, Stanford, Oxford and Kings College London Universities to test new AI products, providing “stress tests” for its clients. Prolific’s user base now counts over 2000 potential test subjects, whilst researchers leverage its network to launch surveys, tests and evaluation tasks every 2 minutes.
An indicator of Prolific’s success is maintaining of profitability for years after its initial Y Combinator investment. In 2024, it raised $32 million in Series A to maintain its healthy position. This funding will allow it to expand its operations.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (1 round)
Jul 2023
$34m
Series A
Total funding: $34m
Company benefits
- Bank holiday swaps
- Enhanced sick pay
- L&D budget – £1000 per year
- 25 days annual leave + bank holidays
Company values
- We win together
- We care deeply about our customers
- We make every minute count
- We're optimistic and find a way
- We embrace change
- We aim high
Company HQ
Kings Cross, London, UK
Leadership
Phelim Bradley
(Co-Founder & CEO)Currently also Venture Partner at Pioneer Fund. Previously Dphil at Wellcome Trust Centre for Human Genetics, Bioinformatics Intern at Illumina and MPhil of Computer Biology at University of Cambridge.
Diversity, Equity & Inclusion at Prolific
- At Prolific, we want all of our employees, researchers, and participants to be included and so we commit to having ongoing discussions about diversity and inclusion and regularly look at areas where we can improve. This policy aims to: - treat all our employees fairly and respectfully, regardless of their job status, location, or work hours ⏰ - avoid any illegal discrimination based on age, disability, gender, gender identity, marriage or civil partnership, pregnancy and maternity, race or ethnicity, religion or belief, sexual orientation, and traveler status. These are protected by the UK Equality Act (2010), Ireland Employment Equality Act (2004), Americans with Disabilities Act (ADA) at the federal level and the New York State Human Rights Law (NYSHRL) at the state level. ⚖️ - refuse to tolerate any kind of illegal discrimination 🙅🏻♀️. This includes pay and benefits, work conditions, grievance and discipline handling, termination, redundancy, parental leave, flexible working requests, employment selection, promotion, training, and other opportunities for development.
Share this job
View 24 more jobs at Prolific