Senior DevOps Engineer, deepset
+ Stock Options
Build custom AI and LLM applications
Be an early applicant
Build custom AI and LLM applications
21-100 employees
Be an early applicant
+ Stock Options
21-100 employees
Company mission
To make custom AI solutions accessible to every organisation, driving adoption and impact.
Role
Who you are
- 5+ years managing large-scale production infrastructure
- Strong experience with service-oriented architecture design
- Proficient in AWS, Kubernetes, GitOps (ArgoCD), and CI/CD practices
- Hands-on with Infrastructure as Code (Terraform, Crossplane preferred)
- Experience supporting customer-hosted deployments (private cloud/on-prem)
- Solid troubleshooting skills, ownership mindset, and pragmatic approach
- Interest in Machine Learning / LLMs—or motivation to learn quickly
Desirable
- Exposure to multi-region infrastructure or high-security environments
- Experience in AI/ML platforms, or data-heavy backend systems
- Contributions to DevOps tooling or open-source infrastructure projects
- Background supporting B2B SaaS or enterprise products
What the job involves
- We’re hiring a Senior DevOps Engineer to build and scale the infrastructure behind the deepset AI Platform
- You’ll own CI/CD, automate deployments, and improve performance across both cloud and on-prem environments
- You’ll work closely with engineering teams on reliability, monitoring, security, and debugging to ensure the platform is fast, stable, and ready for real-world enterprise use
- Solve performance and scalability challenges for LLM-powered enterprise apps
- Own and evolve CI/CD pipelines and automation for smooth deployments
- Define and maintain monitoring and alerting strategies for production health
- Work cross-functionally on firefighting, GitHub workflows, and system debugging
- Configure infrastructure for both SaaS and on-prem enterprise deployments
- Collaborate with customer infrastructure teams and internal stakeholders
- Drive best practices for security, scalability, and system reliability
Our take
Natural Language Processing (NLP) is at the core of many modern enterprise data processing workflows, from complex data processes to customer service chatbots. However, NLP systems are not one-size-fits-all, and the development and deployment of bespoke NLP systems require the niche and expensive help of programmers with expertise in machine learning and semantic syntax.
Deepset provides an open-source API-driven framework called Haystack for the quick and efficient development of production-ready NLP systems. The company's goal is to make modern NLP as easy as possible to apply in a practical and scalable way, and states major use cases of its API for automated data analysis, customer satisfaction, fraud monitoring, and regulatory actions.
Whilst NLP has been implemented by many enterprises such as Amazon AWS and Microsoft, options for companies without dedicated AI experts have been limited, making Deepset's open-source approach highly beneficial to many industries. Lately, the company has introduced custom AI agent solution architecture, which will enable companies to deploy AI agents across cloud and on-premise environments.
Steph
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Aug 2023
$30m
EARLY VC
Apr 2022
$14m
SERIES A
Total funding: $45.6m
Company benefits
- Ownership: Join as an owner with employee stock options - you're building your future here
- Wellbeing: Health, dental, and vision coverage, plus retirement plans in specific locations
- Connection: Remote and in-office collaboration, plus a home office budget and tech setup
- Growth: Support for learning, conference opportunities, and professional development
- Community: Team gatherings and global events to build strong connections, virtually and in-person
Company HQ
Mitte, Berlin, Germany
Leadership
Milos Rusic
(Co-Founder & CEO)Experience as Director of Market Development for KONUX from 2016 to 2018.
Malte Pietsch
(Co-Founder & CTO)Experience as Data Scientist for plista from 2016 to 2018.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 5 more jobs at deepset