Data Platform Engineer, King

• Expertise in Python, including application frameworks (Flask, FastAPI), pytest, TDD, API design and pydantic
• In-depth knowledge of Airflow components, architecture, and best practices in DAG development, including advanced topics like DAG factories
• Proven experience with GCP, AWS or Azure
• Experience working with Terraform, and CI/CD pipelines
• Familiarity with BigQuery or similar cloud DWH platforms such as Snowflake or AWS Redshift
• SQL and data modeling

Desirable

• We’re looking for a self-starting and enthusiastic Data Platform Engineer with a focus on data platforms and tooling to join our team
• With over 16 Petabytes of data and over 130 billion events generated every day, data at King is at the heart of the business
• The Data & ML organisation at King - split across Barcelona, London and Stockholm - is responsible for ingesting and processing all the data we receive each day and to use it to drive all of King's data, analytics and machine learning needs
• You will be part of the Data Foundations team, in charge of providing data products and services used by the whole company
• You’ll take ownership and accountability of projects, spot opportunities for technical and platform improvements, and drive our data systems to the next level
• You will work in a highly collaborative team to devise solutions to data systems, tooling and engineering problems, bringing your skills and ideas into every discussion
• Develop, operate and maintain components of our data platform including our Airflow based orchestration platform and framework (450k tasks per week), our data catalog and our proprietary data notification system built with python, GCP pub/sub and GCP datastore
• You’ll take ownership and responsibility for the quality of the solutions, testing them and ensuring best practices are used throughout the development process - particularly with regard to self-explanatory code, maintainability, cost efficiency and scalability
• You’ll learn new technical skills when needed and use them to help the team achieve success
• Use your expertise in Python to build out our Airflow framework, enhance our data notification system and contribute to the wider python community and ecosystem
• You will collaborate with other teams within the Shared Tech organisation to ensure the consistent and coherent growth of our collective data capabilities
• You will engage directly with our stakeholders to understand the way they work and their problems
• Champion data literacy and engineering best practice with our stakeholders and wider cross functional teams, and share your knowledge with King’s Data Engineering craft