MLOps Engineer, Cognigy
Enterprise conversational AI platform
Open for applications
Enterprise conversational AI platform
201-500 employees
Open for applications
201-500 employees
Company mission
To lead the automation of conversations to make life easier for everyone.
Role
Who you are
- Hands-on experience running production ML or LLM workloads in Kubernetes
- Familiarity with distributed ML frameworks such as KubeRay, Ray Serve, or similar
- Deep understanding of Kubernetes internals, especially GPU scheduling, autoscaling, and multi-tenant environments
- Proficiency with CI/CD systems for ML models, and versioned deployment strategies
- Strong experience with cloud platforms (AWS, GCP, or Azure), networking, and security best practices
- Skilled in monitoring and observability for ML workloads (e.g., Prometheus, Grafana)
- Passion for automation, performance tuning, and cost optimization for LLM workloads
- Clear communicator and proactive team player who thrives in fast-paced, cross-functional environments
- MLOps or DevOps certifications (nice to have)
What the job involves
- We are looking for a skilled and ambitious MLOps Engineer to join our Engineering team and take ownership of building and operating scalable, secure infrastructure for Large Language Models (LLMs)
- You will support our Machine Learning, Product, and SRE teams in deploying and maintaining production-grade AI workloads on Kubernetes using cutting-edge technologies like KubeRay
- You’ll help ensure optimal performance, reliability, observability, and cost-efficiency of Cognigy’s AI infrastructure, automating processes and championing modern MLOps best practices
- Build & Operate LLM Infrastructure – Design and maintain scalable LLM-serving systems using Kubernetes and KubeRay
- Automate & Optimize – Automate deployments, rollbacks, and scaling of LLMs while optimizing resource usage and performance
- Enhance Observability – Ensure robust monitoring, logging, and alerting for LLM operations (Prometheus, Grafana, etc.)
- Support AI Teams – Empower ML and product engineers with self-service pipelines and scalable infrastructure
- Prioritize Security – Enforce secure deployments, compliance practices, and robust incident response strategies
- Improve Documentation – Create and maintain technical documentation to streamline knowledge sharing and onboarding
- Drive Innovation – Evaluate, adopt, and integrate the latest MLOps and LLM-serving technologies
- Reduce SRE Toil – Eliminate repetitive tasks and improve operational efficiency across the platform
Our take
Artificial intelligence is becoming an increasingly common part of how customer service works — a trend that has been accelerated in recent years as so many other services went virtual and digital.
Cognigy is at the forefront of this trend, delivering a set of low-code tools to help enterprises integrate more AI into their customer service processes. As AI has developed, so has the company's suite, and it has launched new features such as AI agents for sales and marketing interactions.
The company has raised substantial funding across the years to accelerate this product development, as well as support its geographic expansion. With the artificial intelligence boom far from over, the future looks bright for Cognigy.
Freddie
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 5 rounds)
Jun 2024
$100m
SERIES C
Feb 2022
$15m
SERIES B
Total funding: $167.6m
Company benefits
- Virtual stock options plan to top performers
- Attractive and performance-oriented salary
- Flat hierarchies and the possibility to shape the organization
- Flexible working hours and ability to work remotely in the UK
Company HQ
Düsseldorf-Hafen, Düsseldorf, Germany
Leadership
Benjamin Mayr
(Co-Founder & Chief Software Architect)Earned a BS in Software Development and Gamedesign at Mediadesign University of Applied Sciences. After this, they became an Independent Software Development Consultant.
Philipp Heltewig
(Co-Founder & CEO)Previously CIO of Sitecore, a leader in digital marketing solutions. Also worked at SAP and attended Harvard Business School.
Sascha Poggemann
(Co-Founder & COO)Previously Head of Technical Development at iExergy in Germany.
Share this job
View 5 more jobs at Cognigy