Staff Machine Learning Engineer, Lily AI

• 10+ years in building large-scale machine learning solutions and ML Ops practices
• Working with LLM APIs and serving LLMs in-house at scale
• Kubernetes, RDBMS, and API-driven development
• Model serving in low-latency, high-throughput use cases
• Observability, data pipeline design, service scaling, and cost optimization
• Strong emphasis on code hygiene, including review, documentation, testing, and CI/CD practices
• Proficiency in Python and PyTorch
• Extensive experience with the scientific Python ecosystem
• Proficiency in cloud-native application development
• Action-oriented with the ability to articulate complex concepts into thoughtful, actionable iterations

Desirable

• As a Staff Machine Learning Engineer, you will design and develop scalable platforms and services focused on driving business impact, while raising the bar for technical excellence
• You will work with other machine learning scientists, engineers, and product managers to help define the ML roadmap, make key architectural decisions around MLOps and contribute to the overall AI strategy of the company
• Define, design, and maintain scalable Machine Learning data pipelines, training infrastructure, and inference systems
• Optimize, benchmark, and productionize deep learning models to extract high-value product attributes, that drive revenue up in onsite search and google ads offerings
• Drive cost efficiency and throughput improvements, owning relevant KPIs
• Promote and implement software engineering best practices across the team
• Shape and evolve the technical stack to meet emerging business and technical needs
• Transition research prototypes into robust, production-ready systems
• Deploy, monitor, and continuously improve models in production environments
• Optimize model performance, focusing on memory usage and latency
• Automate workflows by building efficient pipelines and orchestration frameworks
• Develop tools and shared libraries to boost team productivity and accelerate development