Senior Data Engineer, Croud

• Proactive and Self-Motivated: Demonstrates initiative, is highly self-driven, and eager to take ownership of tasks and challenges
• Technical Expertise in Python and SQL: Advanced skills in Python, SQL, and database design; experienced with SQL development frameworks such as dbt, Dataform, or similar tools
• Cloud-Based Data Warehousing: Proficiency with cloud data warehousing technologies, particularly Google Cloud Platform (GCP) and BigQuery, or equivalent expertise in other major cloud platforms
• Best Practices in Engineering and AI: Strong knowledge of best practices in data and software engineering, including unit testing, code quality, and maintaining clean, maintainable code
• Clear Technical Communication: Ability to communicate technical topics effectively with both technical and non-technical stakeholders
• Production Data Pipelines: Hands-on experience in developing and maintaining production-grade data pipelines, with a focus on serverless architectures
• Software Productionisation: Skilled in productionising software applications, with experience using Docker
• Infrastructure Automation: Proficiency with infrastructure automation, especially with Terraform, as well as CI/CD pipeline configuration

Desirable

• The Senior Data Engineer position sits within the Data Engineering team and reports to the Principal Data Engineer
• The team’s remit is to drive innovation & revenue through the development & delivery of revenue-generating/client-facing data engineering solutions used across the agency
• Support the Principal Data Engineer in delivering robust data engineering solutions by actively engaging in technical decision-making and project execution
• Lead project implementation efforts, collaborating closely with junior team members to ensure successful delivery of client solutions and services
• Advocate for data, software engineering, and data security best practices, ensuring adherence across all projects
• Provide guidance and mentorship to team members, fostering the implementation of industry best practices
• Develop innovative solutions tailored to client needs, ensuring deliverables meet project specifications
• Maintain clear and proactive communication with clients regarding project progress, requirements, and updates
• Act as a key contributor in the implementation and maintenance of DataOps, governance policies, processes, and standards
• Engage in hands-on tasks related to data integration, warehousing, automation, and other engineering functions
• Oversee project deliveries across multiple clients, ensuring solutions achieve the highest quality standards within project constraints
• Conduct research and development on emerging technologies, assisting both the team and clients in adopting appropriate solutions
• Identify potential risks and develop effective mitigation plans to address them proactively
• Contribute to new business initiatives and cross-sell proposals by providing detailed insights into implementation work and estimating time and effort required for proposed projects
• Standard hours are from 9.00am to 5.30pm, there’s flexibility if agreed in advance with your line managers (it may also be necessary on occasions to work outside of these hours)