Site Reliability Engineer, deepset
+ Stock options
Build custom AI and LLM applications
Open for applications
Build custom AI and LLM applications
21-100 employees
Open for applications
+ Stock options
21-100 employees
Company mission
To make custom AI solutions accessible to every organisation, driving adoption and impact.
Role
Who you are
- 2-5 years of experience working with large-scale production infrastructure
- Fluent German language skills
- Experience with distributed or service-oriented architectures
- Hands-on expertise with:
- AWS
- Kubernetes
- CI/CD and GitOps (e.g. ArgoCD)
- Working knowledge of Infrastructure as Code (Terraform preferred)
- Solid troubleshooting skills - you can debug across systems, not just within one layer
- A pragmatic mindset: you balance speed, simplicity, and reliability
- Ownership and accountability - you take responsibility for systems end-to-end
- Ability to work independently while staying aligned with the team’s goals
Desirable
- Familiarity with observability stacks (e.g. Datadog, Prometheus)
- Experience optimizing cloud costs at scale
- Interest or experience in Machine Learning / LLM systems
- Experience improving developer experience and platform tooling using AI agents
- Contributions to SRE practices like postmortems, SLIs/SLOs, and reliability engineering culture
What the job involves
- We're hiring a Site Reliability Engineer to own and evolve deepset's cloud and customer infrastructure end to end. You'll work across SaaS, private cloud, and on-prem environments to make our self-hosted platform production-ready, drive CI/CD and GitOps maturity, and reduce complexity at scale. Your work will directly shape how deepset's AI platform is built, deployed, and scaled for our own cloud and for customers running it in their own environments
- You won’t just “keep things running” - you’ll help define how our platform is built, deployed, and scaled across cloud and customer environments
- Build and operate real-world infrastructureDesign, configure, and evolve infrastructure that runs both in our cloud and inside customer environments (SaaS, private cloud, on-prem)
- Make self-hosted production-readyHelp us deliver a production-grade, self-hosted platform that can be deployed on any Kubernetes setup in weeks - not months
- Drive automation & platform maturityImprove CI/CD pipelines, GitHub workflows, and GitOps setups so teams can ship faster with confidence
- Reduce complexity and costContinuously simplify systems and optimize infrastructure spend without compromising performance or reliability
- Shape how we buildChampion best practices in reliability, scalability, and security across the organization, not as rules, but as working systems
Our take
Natural Language Processing (NLP) is at the core of many modern enterprise data processing workflows, from complex data processes to customer service chatbots. However, NLP systems are not one-size-fits-all, and the development and deployment of bespoke NLP systems require the niche and expensive help of programmers with expertise in machine learning and semantic syntax.
Deepset provides an open-source API-driven framework called Haystack for the quick and efficient development of production-ready NLP systems. The company's goal is to make modern NLP as easy as possible to apply in a practical and scalable way, and states major use cases of its API for automated data analysis, customer satisfaction, fraud monitoring, and regulatory actions.
Whilst NLP has been implemented by many enterprises such as Amazon AWS and Microsoft, options for companies without dedicated AI experts have been limited, making Deepset's open-source approach highly beneficial to many industries. Lately, the company has introduced custom AI agent solution architecture, which will enable companies to deploy AI agents across cloud and on-premise environments.
Steph
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 3 rounds)
Aug 2023
$30m
EARLY VC
Apr 2022
$14m
SERIES A
Total funding: $45.6m
Company benefits
- Ownership: Join as an owner with employee stock options - you're building your future here
- Wellbeing: Health, dental, and vision coverage, plus retirement plans in specific locations
- Connection: Remote and in-office collaboration, plus a home office budget and tech setup
- Growth: Support for learning, conference opportunities, and professional development
- Community: Team gatherings and global events to build strong connections, virtually and in-person
Company HQ
Mitte, Berlin, Germany
Leadership
Milos Rusic
(Co-Founder & CEO)Experience as Director of Market Development for KONUX from 2016 to 2018.
Malte Pietsch
(Co-Founder & CTO)Experience as Data Scientist for plista from 2016 to 2018.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 4 more jobs at deepset