Data Engineer, On the Beach

• Strong Python and SQL skills for data manipulation, cleansing, transformation and pipeline development
• Building and maintaining production data pipelines in a cloud or lakehouse environment
• Working with Databricks, Delta Lake, Delta Live Tables, BigQuery, Snowflake or similar technologies
• Batch processing, workflow orchestration and data transformation patterns
• Event-driven or streaming data concepts, including ingestion patterns, APIs or event routing
• Applying software engineering practices to data, including Git, pull requests, testing, documentation and CI/CD
• Monitoring and troubleshooting data pipelines, including performance, reliability and cost considerations
• Working with data quality checks, data contracts, governance standards or access controls
• Collaborating with engineers, analysts and business stakeholders to turn data requirements into practical, maintainable solutions
• Making pragmatic decisions in fast-moving environments, balancing delivery, quality and long-term maintainability

Desirable

• We’re looking for a Data Engineer to help design, build and optimise the data pipelines that power our core lakehouse ecosystem
• This role sits at the heart of our data platform, helping turn raw, complex source data into reliable, structured and performant data products that can be trusted by teams across the business
• You’ll work across batch and event-driven data, supporting the way we ingest, transform, test and make data available for analytics, reporting, AI use cases and future data products
• As a Data Engineer, you’ll work closely with Data Engineering, Analytical Engineering, Product, Commercial and Technology teams to build high-quality data pipelines and platform capabilities
• You’ll help improve how data moves through the business, making sure our pipelines are reliable, observable, cost-effective and built using strong software engineering practices
• Designing, building and maintaining robust data pipelines across batch, streaming and event-driven data sources
• Ingesting, cleansing and transforming raw application, operational and enterprise data into reliable, structured data products
• Working with lakehouse technologies such as Databricks, Delta Lake, BigQuery or similar cloud data platforms
• Supporting data readiness for analytics, machine learning and AI-enabled use cases, including structured and unstructured datasets
• Improving pipeline reliability, performance and cost efficiency through monitoring, observability and operational best practice
• Building automated tests, documentation and validation checks to improve data quality and reduce downstream issues
• Working closely with Analytical Engineers and stakeholders to make sure upstream data products are fit for reporting, insight and business use
• Applying engineering standards across version control, code review, CI/CD, deployment and incident resolution
• Using AI-assisted engineering tools where appropriate to support development, testing, documentation and optimisation
• Contributing to data governance, security, naming standards and data contract practices across the platform
• What success looks like
• Success in this role is about building data pipelines and products that teams can trust
• You’ll help improve the reliability, quality and performance of our data platform, making it easier for teams across On the Beach to access and use the data they need. You’ll reduce friction for downstream analytics and AI use cases by creating well-structured, well-tested and well-documented data products
• You’ll also contribute to a strong engineering culture within the data team, where standards are clear, pipelines are observable, and continuous improvement is part of how we work

• We’ll run a multiple stage interview process, one stage of which will be an in-person interview at our fabulous Aeroworks office in Manchester city centre
• We want to make sure everybody has the opportunity to perform at their best. If you require any reasonable adjustments during the interview process please let the Talent Acquisition team know and they will be happy to assist