AI Agent Software Engineer, Assembled
Agent Performance Engineering
$120-270k
+ Offers Commission + Stock options
Customer support workforce management platform
Be an early applicant
Customer support workforce management platform
101-200 employees
Be an early applicant
$120-270k
+ Offers Commission + Stock options
101-200 employees
Company mission
To create a support operations platform that helps companies maintain exceptional customer experiences, no matter what lies ahead.
Role
Who you are
- Have 5+ years of experience in software engineering as an individual contributor
- Have experience with AI evaluation systems, data pipelines, or AI model optimization
- Are passionate about building systems that measure and improve AI performance
- Have worked with retrieval systems, knowledge bases, or information extraction
- Enjoy building tools and infrastructure that enable other engineers and AI systems to perform better
- Are highly ambitious and driven, setting high goals for yourself and others
- Put customers first, focusing on solving real problems that impact support quality
- Enjoy fast-paced environments and can quickly adjust when new insights emerge
- Have a bit of a maverick streak that helps you come up with creative solutions
- Have made a noticeable impact on small teams and have solid experience in startups or smaller companies
- Stay humble and open to feedback, value teamwork, and are always ready to learn and grow
- Technologies You'll Work With
- Python/Golang for evaluation systems and data processing
- LLMs and prompt optimization frameworks
- Vector databases and retrieval systems
- AI evaluation and benchmarking tools
- Data pipeline and automation infrastructure
What the job involves
- As part of the Agent Performance Engineering team, you'll be working on the core systems that make our AI agents smarter, more accurate, and more capable of handling complex customer interactions.
- You'll be building the evaluation frameworks, knowledge automation systems, and intelligence optimization tools that directly impact our ability to automate customer support at enterprise scale
- Build foundational evaluation infrastructure: Develop comprehensive evaluation systems from the ground up, including golden dataset creation, automated benchmarking, and model comparison tools. You'll help create the frameworks that enable us to measure and optimize AI agent performance across all communication channels
- Automate knowledge generation: Design and implement systems that automatically create synthetic guides, documentation, and metadata to improve agent knowledge bases. You'll work on cutting-edge approaches to knowledge extraction and augmentation
- Optimize AI agent accuracy: Enhance our retrieval systems, implement advanced prompt optimization techniques, and build tools that continuously improve agent responses through automated evaluation and refinement
- Develop intelligence infrastructure: Architect systems that enable rapid model upgrades, A/B testing of different AI approaches, and scalable evaluation pipelines that support enterprise deployment
- Drive volume automation: Focus on the north star goal of maximizing automated resolutions across voice, chat, and email by building the intelligence systems that make it possible
Our take
Assembled's platform helps companies manage and scale their customer support services. Customer service management is just one of the many areas that are being overhauled by digital transformation. Assembled helps streamline cumbersome and error-prone customer support processes - such as planning support rosters, forecasting demand, and evaluating team performance.
Assembled already counts companies like Zoom, GoFundMe and Stripe on its customer books, and finds huge opportunity in key industries like eCommerce and food deliveries that have been seeing massive digital overhauls. Having received significant investment, the company seems set on continued growth, with funds cited to support product development as well as help launch its CX Scholars initiative, that will commit a percentage of revenue to continuing education for support workers.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
11% employee growth in 12 months
Company
Funding (last 2 of 3 rounds)
May 2022
$51m
SERIES B
Mar 2021
$16.6m
SERIES A
Total funding: $70.7m
Company benefits
- Equity package
- Insurance coverage
- 401k
- CSA Credit
- Stipend for use at any Assembled customer
- Professional development stipend
- Wellness stipend
Company HQ
Mission District, San Francisco, CA
Leadership
Ryan Wang
(CEO & Co-Founder)Studied at the University of Chicago and worked as a Senior Consultant at The Greatest Good. Previously a Software Engineer at Stripe.
John Wang
(CTO & Co-Founder)Studied Computer Science at MIT and worked as a Freelance Software Developer before joining Stripe.
Brian Sze
(Co-Founder)A Stanford graduate who worked in Investment Banking at RBC Capital Markets. Previously Head of Business Operations at Stripe.
Share this job
View 17 more jobs at Assembled