Machine Learning Systems Engineer, Anthropic

• Are proficient in Python and data analysis libraries (Pandas, NumPy, etc.)
• Have experience creating data visualizations and interactive dashboards
• Enjoy translating complex research questions into concrete measurement approaches
• Possess strong software engineering fundamentals with an emphasis on clean APIs
• Can communicate technical concepts clearly to both engineers and researchers
• Have experience with web development for interactive tools (JavaScript, React, etc.)
• Are passionate about measuring and improving AI capabilities and safety
• Strong candidates need not have:
• Formal certifications or education credentials
• Prior experience with reinforcement learning research
• We require at least a Bachelor's degree in a related field or equivalent experience

Desirable

• As a Data & Evaluation Engineer on the Horizons team, you will build the software infrastructure that enables our AI models to use tools effectively and measure their performance.
• You'll develop and extend our agent framework, create and implement evaluations, manage training data pipelines, and apply data science techniques to improve model capabilities. This engineering-focused role combines software development with empirical analysis to drive advances in model performance and capabilities
• Extend and improve our agent framework that enables models to interact with tools and environments
• Design and implement evaluation systems that rigorously measure model capabilities across tasks
• Build and maintain data pipelines for collecting, processing, and managing RL training data
• Develop dashboards and analysis tools to extract insights from model performance data
• Collaborate with researchers to translate evaluation needs into scalable, production-grade systems