Engineering Manager, Retool
Evaluations & Observability
$188.4-251.9k
The application layer for AI
Be an early applicant
The application layer for AI
201-500 employees
Be an early applicant
$188.4-251.9k
201-500 employees
Company mission
To create the future of internal software by making software development for engineers simpler and more accessible.
Role
Who you are
- 3+ years of experience successfully leading and managing teams
- Familiarity with AI evaluation & observability systems – we use Braintrust, but exposure to general evaluation & LLM observability systems is a plus
- Deep technical curiosity. You’ll be writing code, engaging deeply on design and architecture, and tinkering to uncover what’s really happening under the hood
- A strong ability to champion an engineering team through macro process changes
- A history of orienting teams and setting strategy toward engineering goals, with a bias toward impact
- A propensity to operate as a business-owner—caring deeply about our customers, product, and team
- Thoughtfulness around engineering culture, process, and identity
- Proficiency in navigating through ambiguity, managing stakeholders, communicating in a structured manner, as well as driving maximal accountability and excellence
- A collaborative skillset to partner effectively with product, design, and go-to-market teams
What the job involves
- Our engineering leaders are at the forefront of Retool’s product development, bridging the gap between engineering excellence and customer impact
- We look for leaders who not only bring strong technical expertise but also the strategic vision to shape Retool’s product direction, balancing day-to-day execution with long-term thinking
- In this role, you’ll lead Retool’s Evaluations & Observability platform
- You’ll own setting the bar for what “good” looks like across our newly-launched Assist experience, making sure it works and works consistently, at scale
- You’ll build the systems, tools, and culture that let us measure, understand, and improve quality in real time, driving relentless iteration across everything we ship
- Evaluation platforms: building the frameworks that let us test and compare performance across LLM providers and model versions
- Quality systems: defining and enforcing rubrics, metrics, and evaluation loops that answer the hardest question in AI: “Is this actually good?”
- Data curation: managing the datasets that power and test our AI models, sourced from real-world usage to keep our systems grounded and relevant
- Search & retrieval quality: owning the retrieval layer that underpins both AI and non-AI experiences ensuring results are relevant, accurate, and fast
- Reusable AI quality infrastructure: creating the building blocks (evaluation tools, pipelines, and feedback systems) that other teams can leverage to maintain quality across Retool’s AI surface area
- Culture of continuous improvement: embed a data-driven approach to AI quality, where experimentation and measurement are the default as we scale our capabilities
- Communicate and collaborate effectively with Product and other Engineering counterparts
- Manage a team of engineers; support the team by identifying growth opportunities, providing continuous feedback, and performance management as appropriate
- Understand the needs of our Assist roadmap, helping define rubrics & automated systems that allow engineers to iterate quickly on product features, with confidence
- Establish and define your team's strategy to ensure execution maximizes business impact
- Introduce scalable, repeatable processes that help engineering and product teams deliver a successful product
- Partner with recruiting on building out a diverse team of exceptionally motivated engineers
Our take
Retool allows developers to build internal applications quickly using a complete set of ready-made building blocks. These internal applications can be used to display company data from a range of sources, including Redis, Salesforce, Google Cloud, and Slack.
For a monthly fee, the platform enables companies to save time that they would have otherwise spent on developing their own internal applications. Retool brands itself as 'low-code,' meaning that it is easy to use and customize. There is a huge demand for systems that allow teams to analyze the data they already have. Retool already counts brands such as Amazon, Philips, Peloton, NBC, and Mercedes-Benz as customers.
Founded in 2017, the company is now valued at over $3.6B. Founded by Oxford graduate David Hsu, the management team includes ex-Stripe and ex-Airbnb employees with plenty of experience in taking a company from a start-up to a global brand.
Steph
Company Specialist at Welcome to the Jungle
Insights
38% employee growth in 12 months
Company
Funding (last 2 of 7 rounds)
Jul 2022
$45m
SERIES C
Dec 2021
$20m
SERIES C
Total funding: $165.3m
Company benefits
- Your health: Our healthcare plans include flexible, competitive options for medical, vision, dental, life insurance, and disability benefits.
- Your fuel: Fully snack-stocked kitchens at every turn, with breakfast, lunch and dinner provided at our San Francisco and New York offices.
- Your growth: We provide a $1,200 annual stipend that can be utilized for all learning-related expenses, including books, conferences, classes, and more.
- Your family: Access to comprehensive family planning services, generous paid parental leave for new parents, and a remarkable $10,000 lifetime benefit towards fertility support.
- Your time: Flexible freedom for a healthier you: take the time off that you need, when you need it! Discover flexible PTO and our 4 week Work From Anywhere policy to rejuvenate on your time.
- Your sidekick: Bring your favorite sidekick to work and enjoy our dog-friendly offices!
- Your future: Plan for your future. We offer enrollment and matching up to 4% for our US-based employees.
- Your wellbeing: Enjoy a suite of perks and memberships that enable you to thrive both personally and professionally.
Company HQ
Mission District, San Francisco, CA
Leadership
David Hsu
(Founder & CEO)David studied Philosophy and Computer Science at the University of Oxford, before founding Retool in 2017. He has served as CEO ever since.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 33 more jobs at Retool