Principal Platform Engineer, London Stock Exchange
Office located in Exchange Tower, Edinburgh
Stock exchange in the City of London
Be an early applicant
Stock exchange in the City of London
1001+ employees
Be an early applicant
Office located in Exchange Tower, Edinburgh
1001+ employees
Company mission
To make things happen, out there in the real world, where it matters.
Role
Who you are
- You will bring 5–10+ years of experience building and operating highly scalable systems in production, ideally within data‑intensive or analytics‑heavy environments
- You’ve worked hands‑on with Azure and have experience operating Databricks platforms supporting both streaming and batch workloads
- You will have practical experience working with Kafka or Azure Event Hubs, including designing partitions, managing consumer groups, and understanding delivery semantics
- You’re confident working with SQL, have experience with data modelling, and know how to diagnose and improve query performance on large datasets
- A proven understanding of distributed systems fundamentals, such as fault tolerance, stateful processing, and system resilience
- You’ve worked with event‑driven architectures and have supported systems that handle high request volumes and low‑latency analytical workloads
- You’re comfortable working in at least one data‑focused programming language, such as Python or Scala, and you bring a good sense of ownership
- You enjoy influencing technical direction, mentoring other specialists, and helping teams converge on shared standards and guidelines
Desirable
- While not required, experience in some of the following areas would be advantageous
- This could include working with Delta Live Tables, Unity Catalog, or broader Lakehouse governance approaches, or exposure to additional data and streaming technologies such as Flink, Azure Data Explorer (Kusto), or Cosmos DB
- Experience crafting serving layers, stream‑out patterns, or feature stores for analytics or machine learning is also valuable
- Familiarity with SRE practices, such as defining SLOs and handling error budgets in data‑intensive systems, is a plus
What the job involves
- You will work on a modern, cloud‑native data platform built on Microsoft Azure, and you’ll have substantial input into how the platform evolves over time
- The environment supports large‑scale, business‑critical workloads and is developed for both real‑time and batch processing
- The platform makes extensive use of Azure Databricks, Apache Spark, and Delta Lake to support high‑throughput data pipelines
- Kafka and Azure Event Hubs are used to implement reliable, event‑driven architectures, with schema management and stream processing forming core parts of the system
- Datasets are stored and served primarily using ADLS Gen2 and Delta tables, with additional technologies such as Azure Data Explorer, Cosmos DB, or Synapse used where they are the right fit
- Engineers work closely with SQL, Python, and Scala to model data, optimise query performance, and support high‑QPS analytical use cases
- The platform places a strong emphasis on reliability, observability, and secure delivery
- Teams use Datadog and Azure Monitor, follow Open Telemetry standards, and handle environments using Git‑based workflows and Infrastructure as Code
- Automated testing and well‑defined release strategies are central to how changes are built and shipped
Our take
The London Stock Exchange is one of the world’s oldest stock exchanges, with a history dating back over 300 years. It operates as a part of LSEG (London Stock Exchange Group), one of the world’s leading providers of financial markets infrastructure, as a marketplace to enable stock brokers and traders to buy and sell stocks, bonds, and other securities.
The London Stock Exchange has lived through a stream of innovations; from telegraph and telephone, to the Market Price Display System, automatic trade matching, and the digitisation of issuer services. In 2019 it acquired Refinitiv, a financial information company, and in doing so became a global financial news and data business.
Most recently, the London Stock Exchange has made moves to support the evolution of private markets, and further build its presence in this space. It partnered with Floww, a platform that connects investors with private companies, with aims to launch a private primary capital raising facility, as well as explore new technologies and secondary market options for the platform.
Steph
Company Specialist at Welcome to the Jungle
Insights
21% employee growth in 12 months
Company
Company HQ
City of London, London, UK
Leadership
David Schwimmer
(CEO)Prior to joining LSEG in 2018, David was a Managing Director at Goldman Sachs for over 20 years.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 96 more jobs at London Stock Exchange