AI Evaluation Data Scientist, Multiverse Computing

• Master’s degree in Computer Science, Data Science, Mathematics, Engineering, or related field
• 2+ years of experience in AI/ML model evaluation or large-scale data analysis
• Strong proficiency in Python, and evaluation/data analysis libraries (NumPy, Pandas, scikit-learn, etc.)
• Direct experience creating evaluation pipelines for AI or data-driven systems, with a track record in metric definition and performance analysis
• Familiarity with ML infrastructure (experiment tracking, model versioning, continuous evaluation)
• Experience working with large unstructured datasets and data visualization/reporting to communicate findings

Desirable

• Build robust evaluation pipelines that accurately mirror real production use cases for AI agentic systems and SML components
• Define and track success metrics for both agentic workflows and key model components, focusing on measurement aligned with practical production performance rather than pure benchmarks
• Design annotation frameworks and automated evaluation tools to conduct rigorous, repeatable analysis of model/system output
• Execute deep-dive data investigations, monitor success and failure cases, and deliver actionable feedback loops to guide model/system improvements
• Collaborate with engineers and researchers to shape experiments, validate hypotheses, and iterate toward higher performing model deployments
• Communicate evaluation methodologies, results, and insights to technical and non-technical stakeholders, supporting ongoing improvement and transparency
• You’ll be working alongside world-leading experts in quantum computing and AI, developing solutions that deliver real-world impact for global clients