Principal Software Engineer, DataRobot
Value-Driven AI for business
Job no longer available
Value-Driven AI for business
501-1000 employees
Job no longer available
501-1000 employees
Company mission
To change the way businesses all over the world make their most important decisions.
Role
Who you are
- A technical leader with 8+ years of software engineering experience, including 3+ years in AI/ML systems (Generative AI preferred)
- Deep expertise in:
- Scalable systems: Distributed computing, containerization (Docker/K8s), and multi-cloud deployments (AWS/GCP/Azure/Openshift)
- Software craftsmanship: Python, API design, and infrastructure-as-code (Terraform, Pulumi)
- Proven track record of delivering multi-year, high-impact projects with cross-functional dependencies
- A systems thinker who balances innovation with operational pragmatism (e.g., cost-to-serve, technical debt)
- Exceptional communication and influence skills—you can rally teams behind a technical vision
Desirable
- Deep expertise in Generative AI stack: LLMs (open/closed-source), fine-tuning, RAG, orchestration, and evaluation metrics
- Experience with MLOps tools and AI-specific infra (e.g., vector DBs, GPU optimization)
- Contributions to open-source AI projects or published research in ML/GenAI
- Background in enterprise SaaS or B2B AI products
What the job involves
- As a Principal Software Engineer for Generative AI at DataRobot, you will be the technical anchor for our GenAI Tooling and Systems teams, shaping the architecture, ensuring scalability, and defining the future direction of our AI platform
- This is not just a hands-on coding role; it’s a technical leadership position where you’ll drive multi-year projects, mentor senior engineers, and ensure our Generative AI solutions deliver real business impact
- You’ll work together with research, engineering, and product, translating cutting-edge AI advancements into robust system capabilities that power real-world applications
- Shape the long-term technical strategy for Generative AI at DataRobot, ensuring our systems are scalable, maintainable, and aligned with business goals
- Lead architectural decisions for GenAI tooling (e.g. Agents and Agentic Workflows, Prompt Management, Frameworks & Libraries, LLM Onboarding,Tools, Multi-Agent Evaluations, Multimodality, etc.) and GenAI systems (e.g. Inference optimization, Distributed Training, Finetuning, Distillation, LLM Moderation and Guardrails, etc.)
- Anticipate technical risks and propose mitigation strategies before they become roadblocks
- Hands-on development: Build, ship and operate critical AI infrastructure, balancing rapid iteration with long-term technical health
- Solve cross-pillar challenges, such as optimizing LLM latency/cost, improving Agentic workflows, RAG workflows, or ensuring reproducibility in generative outputs
- Drive operational excellence by improving observability, reliability, and performance of AI systems in production
- Act as the technical advisor to engineering leadership (VPs, Directors) and product teams, influencing roadmap priorities
- Mentor Staff/Senior Engineers, elevating the team’s technical bar through design reviews, best practices, and knowledge sharing
- Foster a culture of innovation and rigor, ensuring AI solutions are both cutting-edge and production-ready
- Partner with Research, Product, and GTM teams to align technical efforts with customer needs and market opportunities
- Communicate complex technical concepts to executives and non-technical stakeholders, enabling data-driven decisions
Our take
DataRobot is an enterprise AI platform that helps business analysts develop predictive analytics without requiring any knowledge of programming or machine learning. The platform uses machine learning to build and distribute accurate predictive models quickly by automating users' end-to-end journeys.
Unlike its competitors, such as Domino Data Lab, Captricity, and Datameer, DataRobot's primary selling point is its extensibility. Depending on the job function or comfort level users opt for, they have the option to take complete control of their workflow. Business analysts are free to use the platform as a wizard, but more experienced data scientists have the opportunity to alter many parameters in order to develop precise models.
DataRobot's customers have developed over 500 million models on the DataRobot Cloud on AWS after it earned Amazon Web Services (AWS) ML Competency status. By selling its AI toolkits to more than a third of the Fortune 50, including Kroger, Nationwide, and Lenovo, the company has continued to go from strength to strength and has been recognised as a leader in the space.
Freddie
Company Specialist at Welcome to the Jungle
Insights
-35% employee growth in 12 months
Company
Funding (last 2 of 10 rounds)
Jun 2021
$300m
SERIES G
Dec 2020
$50m
SERIES F
Total funding: $1.1bn
Company benefits
- Medical, Dental & Vision Insurance
- Flexible Time Off Program
- Paid Holidays
- Paid Parental Leave
- Global Employee Assistance Program (EAP)
- Work from Home Opportunities
- A World-class Team
- Company Outings
- Open Door Policy
Company HQ
Financial District, Boston, MA
Leadership
Debanjan Saha
(CEO)Previously the VP of Data Analytics at Google and VP of managed database services at Amazon.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 5 more jobs at DataRobot