Research Engineer, Anthropic

• We're hiring at both junior and senior levels
• Have shipped an evaluation, data product, or research library end to end
• Prototype fast and are comfortable throwing code away
• Handle messy, large-volume data without over-engineering
• Have run experiments on large language models, not just moved their outputs around
• Can work from a vague question rather than a spec
• Communicate results clearly and collaborate closely with the researchers whose questions your instruments answer
• We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed

Desirable

• As a Research Engineer on Takeoff Intel you'll build and run the evaluation and measurement instruments that make this research possible
• This is a generalist role on a small team: you'll work across evals infrastructure, large-scale data processing, and analysis tooling, and you'll prioritize shipping
• We build instruments that answer real questions and help set priorities, not dashboards that surface noise
• We value working prototypes, rapid iteration, accuracy and good prioritization. We often need to go from a vague research question to a running instrument quickly
• Design, build, and run capability evaluations and measurement instruments at scale
• Build the data and analysis pipelines that turn large volumes of model outputs and telemetry into reliable metrics
• Prototype new instruments fast, validate them, and decide what to keep
• Review and supervise AI-written code as a normal part of the workflow
• Work closely with research scientists on the team and with partner teams to define what's worth measuring
• Contribute to internal write-ups and public reporting
• Some examples of our work:
• Anthropic ECI: our adaptation of Epoch Capabilities Index published in all recent system cards to measure capability acceleration
• AI R&D capability assessments in the Claude system cards
• When AI Builds Itself: all data in the article comes from our team