Senior Data Engineer, Methods
Analytics
More information about location
IT services consultancy
Job no longer available
IT services consultancy
501-1000 employees
Job no longer available
More information about location
501-1000 employees
Company mission
To help safeguard public-facing services and apply digital thinking to make sure the future of our public services is centred around our citizens.
Role
Who you are
- Proven experience leading technical aspects of data projects
- Strong data architecture and modelling skills with the ability to design scalable data solutions
- Experience mentoring junior engineers and providing technical guidance
- Deep understanding of data warehouse design principles and methodologies
- Advanced knowledge of optimisation techniques for large-scale data processing
- Strong proficiency in SQL and Python for handling complex data problems
- Hands-on experience with Apache Spark (PySpark or Spark SQL)
- Experience with the Azure data stack
- Knowledge of workflow orchestration tools like Apache Airflow
- Experience with containerisation technologies like Docker
- Proficiency in dimensional modelling techniques
- Experience with CI/CD pipelines for data solutions
- Experience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworks
- Strong communication skills for translating complex technical concepts
- Track record of successful project delivery in a technical leadership capacity
- UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process
Desirable
- Experience designing and implementing data mesh or data fabric architectures
- Knowledge of cost optimisation strategies for cloud data platforms
- Experience with data quality frameworks and implementation
- Understanding of data lineage and metadata management
- Experience with technical project management
- Experience with data visualisation tools like Power BI or Apache Superset
- Experience with other cloud data platforms like AWS, GCP or Oracle
- Experience with modern unified data platforms like Databricks or Microsoft Fabric
- Experience with Kubernetes for container orchestration
- Understanding of streaming technologies (Apache Kafka, event-based architectures)
- Software engineering background with SOLID principles understanding
- Experience with high-performance, large-scale data systems
- Knowledge of recent innovations in AI/ML and GenAI
- Defence or Public Sector experience
- Consultant experience
What the job involves
- Methods Analytics (MA) is recruiting for a Senior Data Engineer to join our team a permanent basis
- Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineers
- Design and architect modern data solutions that align with business objectives and technical requirements
- Design and implement advanced ETL/ELT pipelines using Python, SQL, and Apache Airflow
- Build highly scalable and performant data solutions leveraging cloud platforms and technologies
- Develop complex data models to handle enterprise-level analytical needs
- Make critical technical decisions on tools, frameworks, and approaches for complex data challenges
- Optimise large-scale data processing systems for performance and cost-efficiency
- Implement robust data quality frameworks and monitoring solutions
- Evaluate new technologies to enhance our data engineering capabilities
- Collaborate with stakeholders to translate business requirements into technical specifications
- Present technical solutions to leadership and non-technical stakeholders
- Contribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practice
Application process
- Internal Application Review
- Initial Phone Screen
- Technical Interview
- Pair Programming Exercise
- Final Interview
- Offer
Salary benchmarks
Our take
The UK public sector has long understood the need for digital transformation, but antiquated systems and outdated processes can make even the most ambitious plans for adaptation fall short. Methods has existed for more than 30 years to assist government departments and agencies make the leap, helping them understand the possibilities of digital transformation and guiding them through strategic planning, data migration and implementation phases.
Methods is an acknowledged leader in IT consultancy within the public sector, praised for their human touch and focus on sustainability which it believes sets it apart from firms. Indeed it is trusted by huge swathes of the UK public sector including the NHS, the Office for National Statistics, the Cabinet Office and the Ministry of Defence, to name just a few.
Methods was acquired by the Alten Group in mid-2022. This acquisition will help to reinforce Method's position as a leading player in the public sector while also allowing it to broaden its role in the private sector. It is poised for growth and is investing heavily in talent to make this a reality.
Steph
Company Specialist at Welcome to the Jungle
Insights
Company
Company benefits
- Autonomy to develop and grow your skills and experience
- Be part of exciting project work that is making a difference in society
- Strong, inspiring and thought-provoking leadership
- A supportive and collaborative environment
- Development access to LinkedIn Learning, a management development programme and training
- Wellness 24/7 Confidential employee assistance programme
- Social - Breakfast Tuesdays, Pizza Thursday monthly, weekly social in the office and commitment to charitable causes
- Time off 25 days a year
- Pension Salary Exchange Scheme with 4% employer contribution and 5% employee contribution
- Discretionary Company Bonus based on company and individual performance
- Life Assurance of 4 times base salary
- Private Medical Insurance which is non-contributory (spouse and dependants included)
- Worldwide Travel Insurance which is non-contributory (spouse and dependants included)
- Benefits Platform offering various retail and leisure discounts
Company HQ
Farringdon, London, UK
Articles
Leadership
Pat Crossley-Smith
(Executive Diretor (Not Founder))Previously worked in Agile Product at BUPA and Senior Manager in Development at British Airways.
Share this job
View 1 more job at Methods