Principal Data Engineer, London Stock Exchange
Stock exchange in the City of London
Be an early applicant
Stock exchange in the City of London
1001+ employees
Be an early applicant
1001+ employees
Company mission
To make things happen, out there in the real world, where it matters.
Role
Who you are
- Applicants should demonstrate deep expertise in modern data engineering practices, a passion for innovation, and a proactive, solution-oriented approach
- Minimum 10 years of industry experience, preferably in financial services
- Hands-on experience with Snowflake (including administration) is an essential requirement for this role
- Strong SQL skills for querying and optimizing data within Snowflake
- Proven skills in cost optimization techniques
- Hands-on experience with modern data engineering tools and frameworks such as dbt (data transformation), Apache Airflow (workflow orchestration), and streaming technologies like Apache Kafka, along with similar platforms for data integration and pipeline automation
- Hands-on experience of scripting languages (Python, Shell Script etc) for automation of tasks and processes
- Good understanding of data through previous hands-on contributions to design, development, and implementation of IT systems
- Familiarity with cloud platforms, as Snowflake is often deployed on popular cloud providers like AWS, Azure, or Google Cloud Platform
- Good Understanding of automating infrastructure provisioning via Terraform, DevOps skills
- Previous experience in Docker, Gitlab, Jenkins is advantageous
- Excellent communication and interpersonal skills
- Proactive, determined, and resilient, with a positive attitude
- Extensive and demonstrable problem-solving and decision-making capabilities
- Nice to have AWS, Snowflake certifications
What the job involves
- Our Snowflake infrastructure is critical to the organization, and it’s essential that every Principal Data Engineer drives improvements in the design and build quality of our data platforms. This role involves close collaboration with data scientists, analysts, and BI teams to deliver robust, scalable, and high-performance data solutions
- A great opportunity exists for an experienced Principal Data Engineer to provide technical leadership, shape architectural decisions, and mentor a team of skilled engineers
- Identifying, designing, and implementing internal process improvements including redesigning infrastructure for greater scalability, optimizing data delivery, and automating manual processes
- Maintaining the Landing Zone (LZ) and template to keep pace with the frequency of Snowflake change
- Assembling large, sophisticated sets of data that meet non-functional and functional business requirements
- Building required infrastructure for efficient extraction, transformation and loading of data from various data sources
- Building analytical tools to use the data pipeline, providing actionable insight into key business performance metrics
- Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure while assisting with data-related technical issues
- Reduce risk by continuously introducing automation over processes which require human intervention
- Lead historical cost allocation of the existing data stack and forecast costs as the business continues to grow and new deployments adopt the platform
- Seek opportunities to engage the business on how to improve cost / performance ratios
- Ensure all work is documented, conforming to security, infrastructure, product and other internal requirements
- Contribute to the Snowflake Centre for Enablement delivering: a) Preferred integration patterns and stanndards; b) Advice, mentorship and assistance to partner teams; c) Evolving our company policies and standards
Salary benchmarks
Our take
The London Stock Exchange is one of the world’s oldest stock exchanges, with a history dating back over 300 years. It operates as a part of LSEG (London Stock Exchange Group), one of the world’s leading providers of financial markets infrastructure, as a marketplace to enable stock brokers and traders to buy and sell stocks, bonds, and other securities.
The London Stock Exchange has lived through a stream of innovations; from telegraph and telephone, to the Market Price Display System, automatic trade matching, and the digitisation of issuer services. In 2019 it acquired Refinitiv, a financial information company, and in doing so became a global financial news and data business.
Most recently, the London Stock Exchange has made moves to support the evolution of private markets, and further build its presence in this space. It partnered with Floww, a platform that connects investors with private companies, with aims to launch a private primary capital raising facility, as well as explore new technologies and secondary market options for the platform.
Steph
Company Specialist at Welcome to the Jungle
Insights
21% employee growth in 12 months
Company
Company HQ
City of London, London, UK
Leadership
David Schwimmer
(CEO)Prior to joining LSEG in 2018, David was a Managing Director at Goldman Sachs for over 20 years.
Share this job
View 98 more jobs at London Stock Exchange