Software Engineer, Otter.ai
AI Agent & LLM
$155-185k
3 days a week in office (Mountain View, CA)
AI notetaker, transcription & insights
Be an early applicant
AI notetaker, transcription & insights
201-500 employees
Be an early applicant
$155-185k
3 days a week in office (Mountain View, CA)
201-500 employees
Company mission
To create smarter tools that free people up to do their best work.
Role
Who you are
- Has 3+ years of AI Agent engineering, machine learning engineering, or related experience
- Brings strong backend or distributed-systems engineering skills
- Has hands-on experience building and shipping AI-agent or LLM-powered products
- Has a strong focus on AI quality and experience evaluating nondeterministic systems
- Can use data, traces, logs, and qualitative examples to identify and resolve complex failures
- Works effectively across services, technical domains, and organizational boundaries
- Combines strong product judgment with rigorous engineering and evaluation practices
- Operates with high agency, strong ownership, and a bias toward action
- Can take ambiguous problems from initial exploration through production launch and continuous improvement
- Demonstrated ability to use coding agents effectively while rigorously reviewing and controlling the quality of their output is a plus
What the job involves
- We are looking for a Senior AI Agent & LLM Engineer who combines strong software engineering capabilities with a deep focus on AI quality
- You will help build and improve the AI systems behind Otter’s conversational knowledge engine and AI Chat, spanning user-facing agent experiences, evaluation systems, and the shared platform required to operate them reliably at scale
- This is a hands-on role for someone who can move from an ambiguous product problem to a working production solution, define how quality should be measured, and drive improvements across services, models, and user experience
- Build AI-agent experiences for Otter AI Chat that help users reason over conversations, retrieve knowledge, and complete complex tasks
- Advance Otter’s conversational knowledge engine through better knowledge extraction, annotation, and indexing
- Develop robust evaluation datasets, automated graders, regression tests, and release gates for AI quality
- Diagnose failures across models, prompts, retrieval, tools, data pipelines, backend services, and product workflows
- Build shared agent infrastructure for orchestration, tracing, debugging, retries, sandboxed execution, and observability
- Improve task completion, correctness, groundedness, reliability, latency, and cost
- Turn production traces, customer feedback, and usage signals into measurable product and model improvements
- Collaborate across AI, product, infrastructure, data, security, and application teams to deliver end-to-end capabilities
Our take
Otter specifically thought of business professionals who are running from one meeting to the next, while juggling multiple projects with various teams. The company's technology integrates with platforms like Zoom, providing a way to record meetings and convert speech to text in real-time. It then streamlines communications for smarter, more collaborative, and more productive meetings—the first use of conversational AI to turn meetings into an actionable workflow.
This allows people to benefit from captioning, as well as teams to have a written record of the conversation, which can be edited and shared. Its AI can also highlight and comment on important sections of a meeting transcript, and automatically tag action items. In addition to businesses, students and universities – including UCLA, Tulane, and Western Kentucky – use the tool to increase accessibility.
The platform is used in more than 230 countries and has transcribed over 100 million meetings. Otter is far from alone in the audio transcription market, estimated to be worth nearly $41.89 billion by 2030, with Google’s free transcription tool posing a potential threat, as well as competitors such as Rev.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
27% employee growth in 12 months
Company
Funding (last 2 of 5 rounds)
Feb 2021
$10m
CONVERTIBLE
Feb 2021
$40m
SERIES B
Total funding: $73m
Company benefits
- Compensation: With highly competitive salaries and equity option packages, everyone's an owner here.
- Hybrid Working: You can mix and match working from our Mountain View or San Francisco office, plus a couple days from home.
- Social Gatherings: Quarterly gatherings in the Bay Area for some team real fun and authentic connection.
- Health and Wellness: Comprehensive medical, dental, vision, life insurance, disability, and wellness benefits that start the first day you do.
- PTO: Start with a minimum of 15 days of paid time off, plus up to 18 weeks for maternity leave and 8 weeks for paternity leave.
- 401(k): Plans to help meet your retirement goals because we care about your future.
Company HQ
Old Mountain View, Mountain View, CA
Leadership
Sam Liang
(Co-Founder & CEO)Earned a PhD from Stanford and then joined Cisco as a Senior Software Engineer. Worked as a Tech Lead at Google and is a member of the Forbes Technology Council.
Yun Fu
(Co-Founder & CTO)Has a PhD in Computer Science from Duke. Worked as Yahoo's Principal Software Engineer and was Head of Infrastructure at Particle Media.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 25 more jobs at Otter.ai