Evals Platform Engineer, Apollo Research

• Experience leading infrastructure projects from start to finish
• Experience implementing security best practices for cloud and containerised environments
• Solid knowledge of AWS, including IAM and EKS
• Strong hands-on experience with Kubernetes
• Experience with Infrastructure as Code toolsStrong software engineering skills, preferably in Python

Desirable

• We're seeking a Platform Engineer who will design, build, and maintain the secure infrastructure foundation that powers our frontier AI evaluations
• As the infrastructure specialist on our team, you'll have broad decision-making authority over our tech stack and directly enable our research mission through robust, scalable systems
• What You'll Accomplish in Your First Year
• Accelerate our frontier LLM evaluations research by building an internal platform with both robust backend infrastructure and intuitive researcher-facing interfaces
• Define the vision and roadmap for the team’s infrastructure that securely and reliably supports our research
• Establish a comprehensive security posture across our cloud resources and deployments to protect sensitive data and maintain the trust of our partners
• Optimize infrastructure costs, ensuring efficient use of resources as our demand increases
• Design, implement, scale, and maintain infrastructure for running frontier LLM evals using Infrastructure as Code (IaC)
• Choose and integrate appropriate technologies for our infrastructure stack (e.g. decision to adopt Kubernetes)
• Collaborate with software engineers to build internal software tools that leverage our infrastructure, for tasks including job orchestration, project access, results storage, and more
• Administer and secure internal AWS accounts (IAM, resource deployments, spending, etc)
• Help set up and manage organisation-wide security processes
• Additionally, you are someone who will:
• Take ownership of our infrastructure and drive solutions from concept to implementation
• Balance security requirements with researcher productivity
• Communicate complex technical concepts clearly to both technical and non-technical team members
• Anticipate infrastructure needs before they become bottlenecks
• Respond to user requests with fast turnaround
• Advocate for good security practices in the team

• The final date for submissions is 25 April 2025
• Our multi-stage process includes a screening interview, a take-home test (approx. 2 hours), 3 technical interviews, and a final interview with Marius (CEO)
• The technical interviews will be closely related to tasks the candidate would do on the job
• There are no leetcode-style general coding interviews
• If you want to prepare for the interviews, we suggest working on hands-on LLM evals projects (e.g. as suggested in our starter guide), such as building LM agent evaluations in Inspect
• Start Date: Target of 2-3 months after the first interview