Data Engineer, AND Digital
Contract
Developing & delivering digital products and platforms
Be an early applicant
Developing & delivering digital products and platforms
1001+ employees
Be an early applicant
1001+ employees
Company mission
To close the world's digital skills gap.
Role
Who you are
- Complete fluency in Dutch is required for this role in order to communicate with our Dutch Stakeholders
- Strong expertise in Python and PySpark/Spark for building scalable data pipelines
- Strong knowledge of SQL for querying structured data and interacting with databases, including PostgreSQL
- Strong understanding of data modelling, ETL/ELT processes and data governance
- Experience with data warehousing concepts and delivering analytical insights to internal stakeholders
- Deep expertise in at least one major cloud platform (AWS, Azure, or GCP)
- Experience with Apache Airflow for workflow orchestration and pipeline scheduling
- Hands-on experience with AWS services, particularly Glue and Redshift
Desirable
- Experience with Apache Kafka or similar streaming technologies
- Experience with Delta Lake/Delta Table, Lakehouse or Medallion Architecture (Bronze/Silver/Gold)
- Deep expertise in modern data platforms such as Databricks or Snowflake
- Experience with data migration, including familiarity with tools such as AWS DMS
- Consulting or client-facing experience, translating business requirements into data solutions
- Familiarity with Data Vault 2.0 and Star Schema design
- Infrastructure as Code experience (Terraform or AWS CloudFormation)
- Familiarity with enterprise tooling such as Informatica (ETL, Data Governance, Data Quality) or Data Mesh enablers
- Dataiku experience
What the job involves
- 6 month initial contract
- As a Data Engineer, you will spend your time helping clients achieve their data engineering needs. Primarily the development, deployment and maintenance of data products in a fast moving, Agile environment
- You’ll also make a real impact by taking an active role in the team’s Agile Development practices, technical decision making and development, generating value and continuously striving to improve the quality and reliability of our data and processes
- You will spend the majority of your time helping deliver client data engineering opportunities and supporting the growth of our junior-mid level technologists; both within AND and for our clients
- Stack Migration: Migrating the existing data processing stack (PostgreSQL/Jenkins/Python) to a modern cloud-based stack (AWS/Airflow/Redshift/Python/PySpark/Spark), ensuring continuity and data integrity throughout the transition
- Design and Build Scalable ETL Pipelines: Build and optimise ETL/ELT data pipelines, focusing on performance, scalability, and data integrity. Ensure pipelines integrate smoothly within the broader data ecosystem and internal Data Warehouse
- Maintain and Develop Data Pipelines: Support and maintain existing pipelines while building new ones to meet evolving business needs and stakeholder requirements
- Streaming & Integration: Develop and maintain both batch and real-time data processing pipelines from multiple data sources, with awareness of streaming solutions such as Kafka/Confluent
- Support DevOps Practices: Contribute to CI/CD processes for testing, building, and deploying data pipelines, including supporting the transition away from Jenkins-based workflows
- Performance Optimisation: Tune pipeline performance for both batch and real-time data processing. Troubleshoot and debug complex issues in distributed and cloud-native environments
- Collaboration and Mentorship: Partner with internal teams and engineers to ensure seamless data integration. Provide technical leadership, mentorship and guidance to junior engineers, fostering best practices
Our take
As the need for digital transformation continues to grow, many organisations find themselves lacking the skills to keep up. AND Digital has stepped in to help bridge this gap, with a clear mission to close the world's digital skills shortage. Rather than simply delivering digital solutions, they focus on helping businesses understand how to work digitally, so they can continue to grow and adapt long after a project is finished.
The company is standing out from the crowd too, by working alongside their clients instead of working for them. Combining their own people with client teams into one collaborative unit, they identify challenges, build digital products, and share skills throughout the process, so clients can take full ownership of their apps, websites, and future digital work.
Unsurprisingly, this approach has had a strong impact and continues to drive AND Digital's growth. With cross-functional teams across the UK, the Netherlands, and the US East Coast, the company scales based on demand. And their city-based 'Club' model blends local, personalised service with the strength of a global organisation, putting AND Digital in a strong position for the future.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (2 rounds)
Apr 2021
$10.8m
EARLY VC
Feb 2020
$14.8m
EARLY VC
Total funding: $25.6m
Company HQ
Maidenhead, UK
Leadership
Paramjit Uppal
(Founder)Former Founder of Qedis (brought out by North Highland UK in 2013) and Director at Deloitte.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 25 more jobs at AND Digital