Data Engineer, Interstellar Lab

• The ideal candidate will have a strong foundation in data engineering principles, experience with data pipeline development, and a passion for working on and creating large data sets
• Master’s degree in Computer Science, Engineering, or a related field with 2 years of experience in data engineering or 5 years of experience as a data engineer
• Proficiency in SQL and NoSQL databases
• Experience with data pipeline and ETL tools (e.g., Apache Airflow, Talend)
• Experience with Elasticsearch is a plus
• Familiarity with big data technologies (e.g., Hadoop, Spark) and cloud platforms (e.g., AWS) is a plus
• Proficient in programming with Python. Go is a plus
• Strong problem-solving skills and attention to detail
• Good communication and teamwork abilities

Desirable

• We are seeking a talented and motivated Junior/Mid-Level Data Engineer to join our growing team
• You will work closely with our data scientists, software developers, plant scientists and other stakeholders to ensure the integrity, efficiency, and accessibility of our data
• Design, develop, and maintain scalable data pipelines and ETL processes
• Integrate data from various sources, ensuring data quality and consistency
• Laboratory equipment’s data (GS-MS, SPME etc.)
• Text data
• Image data
• Other plant health analytics (NDVI, LAI etc.)
• Collaborate with data scientists and analysts to support their data needs
• Optimize data workflows and improve data processing efficiency
• Troubleshoot and resolve data-related issues
• Participate in code reviews and contribute to a high-quality codebase
• Continuously learn and apply new data engineering technologies and best practices
• Manage & deploy databases and datalake
• Define data gouvernance strategy for cross team applications