Lead Data Engineer, Wunderkind

• Wunderkind is seeking a Lead Data Engineer with high familiarity in pipeline tools, as well as experience with Spark, Scala, and Python
• BA/BS or MS degree in Computer Science preferred, or equivalent work experience
• Understanding of distributed data systems
• Previous experience working with big data tools such as Beam, Spark, Scala, Bigtable, BigQuery, Pub/Sub, Informatica, and Airflow
• Eagerness to learn new technologies and experience working with CI/CD to ship features to production

Desirable

• The Data Platform team is developing the backbone of Wunderkind solutions.
• To do this, the team is using cutting-edge technologies and frameworks such as Apache Beam, Apache Spark, Scala, Bigtable, or BigQuery to process and analyze data, to help create the pipelines required to handle millions of events daily, and collaborate with the data science team to enable the innovative work in machine learning and AI to be utilized in our production environment
• Contribute to the development of Wunderkind Micro Batch/Real Time streaming pipelines
• Contribute to the development of Wunderkind Data Ingestion Feeds
• Work closely with the engineering team on data preprocessing and data structure
• Collaborate with key stakeholders to drive the architecture strategies
• Participate in architecture reviews
• Maintain a culture of innovation, in an environment that requires high levels of scalability, security, and reliability
• Help mentoring data engineers and leading good data design at Wunderkind