Data Engineer, Veeva

• 3+ years of experience developing data pipelines using cloud-managed Spark clusters (e.g. AWS EMR, Databricks)
• Fluent in Python programming language and PySpark (3+ years of experience)
• Previous experience building tools and libraries to automate and streamline data processing workflows
• Proficient with SQL/SparkSQL
• Hands-on experience working with a Data Lakehouse
• Good verbal and written communication and proven experience of working and delivering in an Agile environment

Desirable

• As a Data Engineer in OpenData, you will take responsibility for the OpenData data processing workflows in US
• You will be building and maintaining data processing tools, pipelines and reports, ensuring data quality in our reference data
• We value end-to-end ownership, which gives you the freedom to determine the correct course of action, do all due diligence, and execute solutions in your own creative way
• Build and maintain data processing pipeline and tools using state-of-the-art technologies
• Work with Python on Spark-based data pipelines
• Develop algorithms to build complex data relationships
• Build analytical data structures to support reporting
• Build and maintain Data Quality processes
• Collaborate with Product team to adapt our reference data to changing demands in the market