QA Engineer, Blenheim Chalcot

• Are you curious, excited by experimentation and always looking for a better way of doing things?
• Do you want to keep learning and developing whilst getting hands-on, entrepreneurial, business building experience?
• Do you want to make your mark in the future of marketing measurement?
• While experience with dbt (data build tool) is a plus, it's not mandatory. We do, however, require a strong understanding of SQL to verify data consistency, accuracy, and ensure product outputs remain correct across different releases and new features
• 2+ years of experience in Quality Assurance, with a strong focus on data-centric products
• Strong proficiency in SQL is a must
• Proficiency in Python is essential for test automation and data manipulation
• Solid understanding of data warehousing concepts
• Familiarity with machine learning concepts and methodologies
• Strong analytical and problem-solving skills with a keen eye for detail
• Excellent communication skills, both written and verbal, with the ability to explain complex technical concepts to diverse audiences
• Ability to work collaboratively within cross-functional teams (Engineering, Product, Data Science)
• Proactive and self-motivated with a strong sense of ownership

Desirable

• As a QA Engineer specializing in Data and ML, you'll be responsible for guaranteeing the integrity and accuracy of our product's most critical components
• Your work will directly impact the effectiveness of our marketing solutions and the trust our clients place in our data
• You'll own the quality assurance of our data pipelines
• We have established robust practices here, and you'll be key in helping us further refine our processes by developing and implementing even more comprehensive automated QA solutions for our data pipelines
• During the initial setup and evolution phases, you'll also perform thorough manual QA to identify and address any discrepancies, helping us to strengthen our quality assurance efforts
• You'll be a champion for data integrity, identifying and flagging any anomalies or regressions in our data outputs
• You'll be responsible for rigorously testing the outputs of our machine learning models
• This involves ensuring that model predictions and behaviors are accurate and align precisely with the expectations and research conducted by our Data Science team
• We're looking for someone to help us enhance our existing testing frameworks for ML models, driving greater confidence in our predictive capabilities
• You'll also work to validate the performance and accuracy of our ML models against defined metrics and benchmarks
• Design, develop, and execute comprehensive test plans and test cases for data pipelines and ML models
• Implement and maintain automated testing frameworks for data and ML quality assurance, helping us advance our automation efforts
• Perform thorough manual testing during initial development and complex feature releases, ensuring we maintain a high standard of quality
• Collaborate closely with Data Engineers, Data Scientists, and Product Managers to gain a deep understanding of features under development, including technical implementation details, to inform effective testing strategies
• Proactively identify, document, and track bugs and quality issues
• Communicate and justify changes in data to wider audiences, including non-technical stakeholders, clearly and concisely
• Contribute to the continuous improvement of our QA processes and methodologies, actively seeking ways to optimize our approach
• Participate in code reviews and provide constructive feedback from a QA perspective
• Advocate for quality throughout the software development lifecycle, helping us deepen our commitment to quality