Quality Assurance Analyst, Cresta

• 1–3 years in QA or data labeling
• Exceptional attention to detail and analytical rigor
• Strong documentation and communication skills
• Comfort with accuracy-driven tasks

Desirable

• We’re looking for a Quality Assurance Analyst to ensure Cresta’s AI systems perform with accuracy, fairness, and compliance
• You’ll audit AI-generated conversations, evaluate model behavior, and deliver feedback that improves model performance and customer trust
• Review AI-generated summaries for accuracy and completeness; provide feedback to improve models
• Conduct behavioral audits to verify agent triggers and responses match expected outcomes
• Perform redaction audits to protect sensitive customer data
• Run bias audits to detect and document fairness issues
• Compare audio and text for transcription accuracy
• Support Opera platform maintenance and rule configuration to keep AI outputs accurate