Senior Director of Engineering, MongoDB
Inference Platform
$185-363k
+401(k) plan
Office located in Palo Alto or San Francisco
Developer data platform
Be an early applicant
Developer data platform
1001+ employees
Be an early applicant
$185-363k
+401(k) plan
Office located in Palo Alto or San Francisco
1001+ employees
Company mission
To empower innovators to create, transform, and disrupt industries by unleashing the power of software and data.
Role
Who you are
- 10+ years of engineering leadership experience, including managing multiple teams and scaling large, distributed systems
- Proven experience building and maintaining ML inference platforms in production
- Deep expertise in distributed systems, large-scale data processing, and search infrastructure (e.g., Lucene, Elasticsearch, or similar technologies)
- Strong understanding of ML model deployment, vector search, embeddings, and inference optimizations
- Experience working with cloud-native architectures and platforms like AWS, GCP, Azure, and Kubernetes
- Proficiency in high-performance API development and integrating ML pipelines into production systems
- Excellent leadership, strategic thinking, and ability to influence cross-functional stakeholders
- Strong technical background in Python, C++, Java, or Go and experience with ML frameworks like TensorFlow, PyTorch, or ONNX is a plus
- Experience in hiring, mentoring, and scaling world-class engineering teams
What the job involves
- We are seeking a Senior Director of Engineering to lead the development of our Inference Platform within MongoDB
- This is a high-impact role where you will drive the technical vision, execution, and growth of a critical component in our AI/ML ecosystem
- You will be responsible for building and scaling a world-class team, shaping the future of inference infrastructure, and integrating our cutting-edge models into Atlas, MongoDB’s cloud-managed solution
- Lead and Manage the Voyage Inference Engineering Team – Oversee engineering efforts to design, develop, and scale our inference platform, ensuring high performance, reliability, and efficiency
- Architect and Optimize Large-Scale Inference Pipelines – Work closely with Research Engineers to deploy new embedding models and ensure seamless integration into production environments
- Develop and Scale API Endpoints – Design and maintain the Voyage API to support real-time inference at scale
- Integrate with MongoDB Atlas – Work with cross-functional teams to integrate the inference platform into Atlas, enhancing MongoDB’s AI-powered search and vector capabilities
- Recruit and Build a High-Performance Team – Attract, hire, and mentor top-tier engineering talent, fostering a culture of innovation, collaboration, and technical excellence
- Define Product and Engineering Strategy – Collaborate with product, research, and engineering leaders to define the long-term vision, roadmap, and architecture of the inference platform
- Ensure Operational Excellence – Drive best practices for monitoring, reliability, and performance of ML inference services in production
- Stay Ahead of AI Trends – Keep up with advancements in ML inference, vector search, distributed computing, and hardware acceleration to maintain MongoDB’s leadership in AI-driven search
Our take
MongoDB is an open-source, cross-platform, document-oriented database system. It stores data as JSON-like documents and is written in C++, Go, JavaScript and Python.
Essentially, the company develops tools and blueprints to help businesses and organisations modernise their legacy applications, migrating them to the MongoDB database and the MongoDB Atlas cloud database. With this initiative, MongoDB is particularly taking aim at Oracle customers with ageing applications running on the Oracle relational database system.
Since its release, MongoDB has become one of the most popularly used NoSQL database systems due to its ease of use and efficiency. It is also the fastest-growing database ecosystem, and boasts hundreds of millions of downloads. Recently, the company announced a partnership with Patronus AI, an automated evaluation and security platform, through which it will bring automated LLM evaluation and testing capabilities to enterprise customers.
Freddie
Company Specialist at Welcome to the Jungle
Insights
13% employee growth in 12 months
Company
Funding (last 2 of 8 rounds)
Jan 2015
$80m
SERIES G
Oct 2013
$150m
SERIES F
Total funding: $311.1m
Company benefits
- Rich health insurance coverage
- Virtual & on-site fitness classes
- Health screenings & telemedicine
- Access to transgender-inclusive health insurance coverage
- Global and internal mobility opportunities
- Equity & Employee Stock Purchase Program
- Pension & retirement programs
- Income Protection
- Flexible PTO is offered to every US employee & competitive time off policies for non-US employees
- Employee Assistance Program
- Mental health counseling
- Free meditation app access
- Fertility & adoption financial assistance
- Parental counseling for new parents
- 20 weeks of fully paid gender neutral parental leave & flexible work arrangements
- 4 weeks of emergency care leave
Company HQ
Theater District, New York, NY
Leadership
Dwight Merriman
(Co-Founder)Previously CTO and Co-founder at DoubleClick for 10 years, and Chairman at AlleyCorp for 15 years.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 275 more jobs at MongoDB