Principal Data Engineer, IDEXX

• You have 5 or more years of experience working in machine learning and have delivered solutions into production in a professional setting
• You have 5 or more years of experience using Python, SQL, Spark
• Nice to have: Experience with Databricks, Spark, with Big Data

Desirable

• As a Principal Data Engineer, you will work with ML research scientists across IDEXX R&D to enable our product related to be leveraged for ML modeling
• You will design and implement end-to-end data workflows for ML model building and monitoring for complex products, including imaging and clinical and operational solutions data
• Additional data engineering work will impact the search, retrieval, processing, tagging, and publishing of curated data sets, with a focus on improving ML model performance over time
• You will design and implement scalable, reliable distributed data processing frameworks and analytical infrastructure using multiple technologies, including data sets or data warehouses, data virtualization and services, and repositories of semi-structured data sets
• You will design automated software deployment functionality that efficiently manages applications across distributed platforms
• You will monitor structural performance and utilization, identify problems, and implement solutions
• You will lead the creation of standards, best practices, and new processes for the operational integration of new technology solutions
• You will ensure environments are compliant with defined standards and operational procedures
• You will implement measures to ensure data accuracy and accessibility, constantly monitoring and refining the performance of data management systems
• You will understand structural requirements and define standards for storing, consuming, integrating, and managing data for machine learning applications
• You will collaborate with data scientists and analysts to understand their data needs and develop solutions to meet those needs
• You will develop and maintain data systems, processes, and procedures documentation
• You will complete problem tickets, including bug fixes, design modifications, and enhancement based on customer requirements