Manager of AI Operations & Evaluation, Chime
$150-208k
+ Bonus + Equity Package
More information about location
Mobile banking for the everyday person
Be an early applicant
Mobile banking for the everyday person
1001+ employees
Be an early applicant
$150-208k
+ Bonus + Equity Package
More information about location
1001+ employees
Company mission
To make financial peace of mind a reality for millions of everyday people.
Role
Who you are
- 7+ years in AI/ML operations, quality, or evaluation with at least 2+ years of people leadership experience
- Deep understanding of LLM behavior, prompt testing, and evaluation methodologies
- Familiarity with human-in-the-loop frameworks and prompt testing tools
- Strong program management and stakeholder communication skills
- Technical proficiency in SQL, Python (preferred), or data visualization platforms (Looker, Snowflake)
- Experience collaborating with Engineering, Data Science, and Risk/Compliance partners on AI-related initiatives
- A passion for operational excellence and responsible innovation
What the job involves
- AI Operations (AIOPS) defines how AI is governed, evaluated, and continuously improved across OMX. We ensure every model in Operations is accurate, fair, and aligned with Chime’s standards for operational excellence and member trust
- As Manager, AI Evaluation & Insights, you’ll lead the team responsible for operationalizing and executing AI evaluation standards across OMX
- You’ll run human and automated evaluation systems, manage model health monitoring, and apply testing and simulation frameworks that detect hallucinations, bias, or drift before they impact members or agents
- You’ll manage a team of TPM’s and evaluation specialists who measure AI performance across risk, compliance, agent experience, and bot experience domains. You’ll ensure AI deployments meet the standards set by the AI Governance pillar and deliver measurable value to Operations
- Lead the AI Evaluation team, owning staffing, coaching, performance management, and delivery of evaluation and testing frameworks
- Manage the AI evaluation lifecycle — including pre-launch testing, simulation, and post-deployment health monitoring — ensuring alignment with governance standards and expectations
- Create domain-specific evaluation tracks (e.g., Compliance & Risk, Bot Experience, Agent Experience) to assess AI quality from multiple perspectives
- Operationalize human-in-the-loop testing, integrating reviewer feedback into continuous improvement loops
- Oversee simulation environments (3rd-party tools) for stress-testing LLMs and identifying hallucinations or performance regressions
- Partner closely with AI Platform & Governance to implement evaluation metrics, reporting, and health signals in alignment with Responsible AI principles
- Develop dashboards and reporting frameworks to track evaluation coverage, accuracy, and confidence scores across models
- Collaborate with Enablement, Speech Analytics, and Data Operations to ensure AI evaluation results inform retraining, policy, and member impact analysis
- Coach and develop TPM’s to become domain experts in responsible AI measurement. Foster a high-performing, collaborative team culture, ensuring career development and continuous skill enhancement for all team members
- This role creates the execution layer between AI experimentation and operational reality — ensuring governance standards are consistently applied and AI systems are safe, fair, and high-performing in production. You’ll lead the teams that deliver the evaluation signals Operations relies on to trust every AI model deployed
Our take
Chime is part of the growing realm of fintech banks and providers, emphasising straightforward, cost-effective banking solutions. It cuts the expenses tied to basic bank accounts and provides users with greater autonomy in managing their finances.
In contrast to many traditional banks that levy steep fees and hefty penalties for overdrafts while offering meagre interest rates on savings, Chime addresses a crucial gap in the banking sector. Its primary focus is on catering to individuals with modest savings who seek the convenience of automated digital banking.
With a remarkable ascent in its trajectory, Chime's current valuation stands at $11.6B since its 2025 IPO. However, competition remains fierce, with other neobanks like Ally offering similar features and vying for the same customer base. That being said, Chime's IPO, rare in a financially uncertain period, proves that it has shifted from challenger to major player.
Freddie
Company Specialist at Welcome to the Jungle
Insights
0% employee growth in 12 months
Company
Funding (last 2 of 9 rounds)
Aug 2021
$750m
SERIES G
Sep 2020
$485m
SERIES F
Total funding: $2.0bn
Company benefits
- Physical: We believe in taking care of your physical health, so as a Chimer you’ll get medical, dental, and vision insurance, as well as benefits to support your physical activity, family planning, and all of your little Chimers
- Emotional: We know that staying healthy involves a lot more than doctor’s checkups. We partner with Modern Health to help you navigate your mental health, give monthly Take Care of Yourself Days, and want you to take time off when you need it
- Financial: We want Chimers to save and feel financially supported, so we offer savings plans with competitive matching, as well as access to financial planning and legal assistance so that you can find your financial peace of mind
- Social: We’ll celebrate your milestones together with travel stipends, swag, and high-fives and make sure you’re connected to fellow Chimers through our Chime Resource Groups (CRGs) and company events
Company HQ
Nob Hill, San Francisco, CA
Leadership
Chris Britt
(Co-Founder & CEO)Chris worked as an Accenture Management Consultant for 4 years before roles at CMGI, Comscore Networks, and Visa. They left their position as an SVP of Corporate Development at Green Dot Corporation to co-found Chime in November 2012.
Ryan King
(Co-Founder)Ryan worked at Plaxo for 8 years, first as Lead Engineer and then working their way up to VP of Engineering & COO. They went on to be CTO & Vice President at Comcast Silicon Valley Innovation Centre before co-founding Chime.
Share this job
View 43 more jobs at Chime