AI Data Scientist, Ironclad
Evaluation & Insights
$125-170k
Offers Equity
Enterprise software for managing contracts
Open for applications
Enterprise software for managing contracts
501-1000 employees
Open for applications
$125-170k
Offers Equity
501-1000 employees
Company mission
To power the world’s contracts.
Role
Who you are
- Bachelor's or Master's degree in a quantitative field (e.g., Statistics, Computer Science, Data Science, Applied Math)
- 1–3 years of experience in applied ML or data science, preferably in NLP or LLM-based applications
- Strong SQL and Python skills; experience with Jupyter, Pandas, and experiment tracking tools
- Comfortable navigating ambiguity, slicing large datasets, and communicating insights clearly to cross-functional stakeholders
- Experience with prompt analysis, clustering, or user behavior modeling is a plus
- Bonus: familiarity with LLM eval techniques, Reinforcement Learning from Human Feedback (RLHF), or agentic system design.Experience with program management
What the job involves
- Ironclad is accelerating its investment in AI to redefine how legal teams manage and understand contracts. As part of this effort, we are hiring an AI Evaluation Engineer to work within our AI Pillar
- This role is focused on unlocking insights from our training data, designing feedback loops, and ensuring the continuous improvement of our agentic and ML or LLM-based systems through data-driven evaluation and iteration
- You’ll partner closely with AI Engineers and Product Managers to drive better model quality through systematic analysis, experimentation, and the curation of high-leverage datasets
- Your work will directly impact the effectiveness of features like Smart Import, contract understanding, and agentic workflows
- Analyze training and evaluation datasets to identify distributional gaps, labeling inconsistencies, and long-tail opportunities
- Design and execute labeling campaigns, including development of golden datasets and annotation guidelines
- Build and maintain dashboards that track model accuracy, regression trends, and product-specific KPIs like success rate or answer helpfulness
- Investigate failure modes via prompt clustering, error taxonomy development, and user intent classification
- Operationalize feedback loops: mine product telemetry and human-in-the-loop reviews for signal, then translate into data-driven model improvement strategies
- Partner with engineers and PMs to run structured A/B tests and human evaluations for new models or features
- Support the development of scalable data and evaluation infrastructure for LLMs and agents
- Work with product, engineering and legal to create clear & transparent processes for the handling of customer data in AI training, fine-tuning and evaluation
- AI is critical to the value Ironclad customers get from their contracts, allowing their business to manage risk, close revenue faster and operate more effectively. None of this is possible without reliable and accurate data
- This role will lead these efforts, becoming a key contributor to the development of AI solutions in an industry that is likely to be transformed by the new generation of models
Our take
Business contracting is often inefficient and messy, with approvals required from various stakeholders and many processes still paper-based. Ironclad is a platform that digitises, automates, and streamlines contract workflows, allowing legal teams to focus on legal work rather than paperwork. Ironclad’s platform features collaborative tools that facilitate business operations and extract and catalog contract metadata, making information easier to access and act upon. Its enterprise customers include Dropbox, Mastercard, Pixar, Fox, and L’Oréal.
Despite its success, Ironclad faces competition in the $3 billion contract lifecycle management industry from major players like DocuSign and emerging ones like Contractbook. The company recently announced Ironclad Signature, marking its entry into the $25 billion eSignature market. The new feature speeds up the signature process by an estimated 80% and provides summaries and approval histories to users. This new tool is expected to strengthen Ironclad's position in the sell-side contract lifecycle management market.
Additionally, Ironclad introduced value-based pricing, charging only for completed, signed agreements, unlike other providers who charge for every signature packet sent out. Ironclad, backed by investors like Accel, Sequoia, Y Combinator, and BOND, remains committed to innovating and maintaining its leadership in the contract lifecycle management space.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
-3% employee growth in 12 months
Company
Funding (last 2 of 7 rounds)
Jan 2022
$150m
SERIES E
Dec 2020
$100m
SERIES D
Total funding: $334.1m
Company benefits
- Dental, and vision insurance
- 401K
- Wellness reimbursement
- Flexible vacation policy
- Generous parental leave for both primary and secondary caregivers
- Work from home opportunities
- Health insurance
Company HQ
South Beach, San Francisco, CA
Leadership
Cai GoGwilt
(CTO & Chief Architect)Studied HSPS at Cambridge, and Computer Science at MIT. Was a Summer Technology Analayst at Goldman Sachs. Worked as a Research Assistant at MIT. Was a Software Engineer at Palantir.
Jason Boehmig
(CEO)Former Corporate Lawyer at Fenwick and Professor of Law at the University of Notre Dame before founding Ironclad in 2014.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 39 more jobs at Ironclad