AI QA Specialist, Notion
The connected workspace for your docs, projects, knowledge, and AI
Be an early applicant
The connected workspace for your docs, projects, knowledge, and AI
501-1000 employees
Be an early applicant
501-1000 employees
Company mission
To help everyone build beautiful tools for their life’s work.
Role
Who you are
- You have experience in Customer Experience as a Product specialist or QA Specialist, analyzing support responses (both agent and AI) at scale
- You excel at analyzing support interactions with a critical eye, identifying improvements while balancing empathy, clarity, and solution-focused communication
- You have strong written communication and the ability to turn insights into clear actions
- You are organized, effectively manage your time and can work independently
- You’re a collaborative partner who can work across CX, Ops, and vendor teams
Desirable
- Deep knowledge of Notion's product and feature set
- Experience with MaestroQA or other QA platforms with LLM-powered systems
- Familiarity with knowledge base management and conversational design best practices
- Experience with AI prompt engineering and understanding prompt design principles to optimize AI-generated responses
What the job involves
- This is a 6 month remote-friendly contractor role with potential to extend, requiring [30-40 hours/week]
- We are seeking an AI Support QA Specialist to raise the quality bar for Notion’s AI-powered support. You’ll run systematic QA on our AI chat and email experiences and accelerate validation for our AutoQA system so quality metrics remain accurate before and after launch
- You’ll turn insights into action by updating conversational design and our knowledge base, and by partnering closely with User Operations and our QA Ambassadors
- Perform routine, structured QA reviews of AI support interactions across chat and email for qualitative and quantitative accuracy
- Validate and continuously improve AutoQA scoring and metrics prior to deployment and in ongoing operation
- Translate QA findings into recommendations and updates to conversational design and the CX knowledge base
- Partner with User Operations and CX leadership to ensure QA efforts align with strategic initiatives
- Monitor and report on trends, gaps, and opportunities for automation or targeted reviews
- Weekly QA reviews and reporting on AI chat and email interactions
- AutoQA validation reports before and after feature launches
- Clear documentation of QA findings and recommendations for conversational and knowledge base improvements
- Support for an internal QA Ambassador program including training and documentation
- Proactive identification of process gaps and opportunities for automation or targeted review
Our take
Managing busy workflows using fragmented systems can be a headache for both individuals and businesses. Notion aims to combat this problem by enabling users to work from one central hub, customizing their workflows to suit their exact needs. This includes managing files, scheduling tasks, saving documents, writing to-do-lists, and setting reminders.
The company counts enterprise companies such as McDonald’s, The Wall Street Journal, Verizon, Samsung, and IBM as its customers. In spite of economic uncertainty, Notion reached a $2 billion valuation in 2020, helped by record signups as more people were forced to work from home. Its value has since risen to over 5 times this value, an impressive reflection of its success.
The company has made a number of strategic acquisitions that, coupled with its enormous market value and enviable customer list, have Notion well-placed to continue dominating the market. That being said, the launch of Microsoft-built competitor Loop at the end of 2023 will put Notion's market dominance to the test.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 3 rounds)
Oct 2021
$275m
LATE VC
Apr 2020
$50m
LATE VC
Total funding: $335m
Company benefits
- Dog-friendly office
- 401k matching
- Parental leaave
- Free lunches
- Equipment stipend
- Monthly commuter credits
- Work from home opportunities
- Health insurance
Company values
- We are drivers of our mission. We’re driven by our commitment to empower every person on the planet to use software exactly the way they want.
- We are pace setters. We move with urgency so we can set the cadence for our market, cover more ground, and ship more great products and programs for our users, faster.
- We are truth seekers. We pursue the best data, ideas, and solutions with rigor and open-mindedness, always guided by our users’ most pressing needs.
- We are kind and direct. We deliver feedback in the spirit of helping our colleagues improve, balancing sensitivity with caring honesty. We’re in this together.
Company HQ
Yerba Buena, San Francisco, CA
Leadership
Ivan Zhao
(CEO)Ivan worked for Inkling for 2 years in Product, but was disappointed by the lack of a simple way of collaborating on projects. To fit this need, he co-founded Notion in 2013, serving as CEO since.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 70 more jobs at Notion