AI QA Specialist, Notion
Contract
The connected workspace for your docs, projects, knowledge, and AI
Job no longer available
The connected workspace for your docs, projects, knowledge, and AI
1001+ employees
Job no longer available
1001+ employees
Company mission
To make it possible for everyone to shape the tools that shape their lives.
Role
Who you are
- You have experience in Customer Experience as a Product specialist or QA Specialist, analyzing support responses (both agent and AI) at scale
- You excel at analyzing support interactions with a critical eye, identifying improvements while balancing empathy, clarity, and solution-focused communication
- You have strong written communication and the ability to turn insights into clear actions
- You are organized, effectively manage your time and can work independently
- You’re a collaborative partner who can work across CX, Ops, and vendor teams
Desirable
- Deep knowledge of Notion's product and feature set
- Experience with MaestroQA or other QA platforms with LLM-powered systems
- Familiarity with knowledge base management and conversational design best practices
- Experience with AI prompt engineering and understanding prompt design principles to optimize AI-generated responses
What the job involves
- This is a 6 month remote-friendly contractor role with potential to extend, requiring [30-40 hours/week]
- We are seeking an AI Support QA Specialist to raise the quality bar for Notion’s AI-powered support. You’ll run systematic QA on our AI chat and email experiences and accelerate validation for our AutoQA system so quality metrics remain accurate before and after launch
- You’ll turn insights into action by updating conversational design and our knowledge base, and by partnering closely with User Operations and our QA Ambassadors
- Perform routine, structured QA reviews of AI support interactions across chat and email for qualitative and quantitative accuracy
- Validate and continuously improve AutoQA scoring and metrics prior to deployment and in ongoing operation
- Translate QA findings into recommendations and updates to conversational design and the CX knowledge base
- Partner with User Operations and CX leadership to ensure QA efforts align with strategic initiatives
- Monitor and report on trends, gaps, and opportunities for automation or targeted reviews
- Weekly QA reviews and reporting on AI chat and email interactions
- AutoQA validation reports before and after feature launches
- Clear documentation of QA findings and recommendations for conversational and knowledge base improvements
- Support for an internal QA Ambassador program including training and documentation
- Proactive identification of process gaps and opportunities for automation or targeted review
Our take
Managing busy workflows using fragmented systems can be a headache for both individuals and businesses. Notion aims to combat this problem by enabling users to work from one central hub, customizing their workflows to suit their exact needs. This includes managing files, scheduling tasks, saving documents, writing to-do lists, and setting reminders.
The company counts enterprise companies such as McDonald’s, The Wall Street Journal, Verizon, Samsung, and IBM as its customers. In spite of economic uncertainty, Notion reached a $2B valuation in 2020, helped by record signups as more people were forced to work from home. Its value has since risen to over 5 times this value, an impressive reflection of its success.
Notion has also made several strategic acquisitions that, coupled with its enormous market value and enviable customer list, have positioned it well to continue dominating the market. However, with a growing wave of competitors emerging, including offerings like Microsoft Loop, Notion will need to keep innovating and evolving to maintain its edge and stay ahead in an increasingly crowded market.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 3 rounds)
Oct 2021
$275m
LATE VC
Apr 2020
$50m
LATE VC
Total funding: $335m
Company HQ
Yerba Buena, San Francisco, CA
Leadership
Ivan Zhao
(CEO)Ivan worked for Inkling for 2 years in Product, but was disappointed by the lack of a simple way of collaborating on projects. To fit this need, he co-founded Notion in 2013, serving as CEO since.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 84 more jobs at Notion