Senior Data Platform Engineer, NCC Group

• Strong experience in data engineering within AWS cloud environments
• Hands-on experience with AWS big data technologies such as EMR, S3 and SageMaker
• Proficiency in Python for building scalable data pipelines and processing frameworks. Experience with Apache Spark for distributed data processing
• Experience designing and maintaining scalable batch and real-time data pipelines
• Solid understanding of ETL/ELT design patterns and data modelling techniques
• Experience with workflow orchestration tools such as Apache Airflow (ideally deployed on AWS)
• Familiarity with containerisation and orchestration using Docker and Kubernetes (EKS)
• Experience with infrastructure as code (e.g. Terraform) and CI/CD/GitOps practices
• Proven ability to optimise performance and reduce cloud costs through partitioning, clustering and workload management
• Understanding of data security principles, including data loss prevention (DLP)

Desirable

• We are looking for a Data Engineer to work closely with the Data Science team to develop robust data pipelines that feed analytics and machine learning tools such as Amazon SageMaker and third-party platforms like Databricks
• You will leverage AWS technologies such as EMR, S3, EKS and Airflow to process and orchestrate high-volume datasets, ensuring solutions are scalable, resilient and cost-efficient
• You will also play a key role in embedding data loss prevention (DLP) principles and controls into data pipelines to protect sensitive information, while ensuring data is reliable, accessible, well-governed and optimised for downstream consumption

• Stage 1
• Screening call with your Talent Acquisition Team
• A 30-minute screening call with a member of our Talent Acquisition team to discuss your experience, skills, and suitability for the role. You’ll also have the opportunity to ask any questions you may have about the position, the team, the company, or the overall recruitment process
• Stage 2
• First Stage Interview
• In this first-stage interview, you'll meet with the hiring manager to discuss your skills and how they align with the role. You'll also have the opportunity to ask questions about the team and position. To prepare, we recommend researching our company and the work we do, as well as reviewing the role and job description. It may also be helpful to revisit any notes or questions from your initial conversation with the Talent Acquisition partner
• Stage 3
• Second Stage Interview
• The final stage interview will focus on two main areas:
• 1. A review of your technical skills based on the assessment you completed
• 2. A deeper conversation around topics discussed in your first-stage interview
• This is an opportunity for us to better understand your experience and how you approach challenges and opportunities relevant to the role
• Stage 4
• Offer
• This is where we share the details of the role and formalise the offer with successful candidates