Principal Data Engineer, Moneyhub

• Leader of the design and development of large-scale data systems from scratch, making key design decisions and providing technical oversight of projects
• Expert-level, hands-on experience with Apache Kafka, including designing, deploying, and operating it in a high-throughput production environment
• Experience designing, managing, and running relational databases at a terabyte scale
• Deep knowledge of how technologies such as Apache Spark, BigQuery or AWS Athena work including principles such as map/reduce and schema-on-read
• Strong software engineering fundamentals with proficiency in a backend language, preferably JavaScript/Node.js
• Demonstrable experience building solutions on a major public cloud platform (GCP, AWS, or Azure) with an ability to price expected running costs of solutions
• A pragmatic and autonomous problem-solver who takes end-to-end ownership, can unblock themselves by digging into documentation, and knows when to create a simple solution vs. an architecturally complex one

Desirable

• We have offices in London and Bristol together with access to co-working space across the UK. We offer the opportunity to work remotely within in the UK (role, business and client dependent) with support for your home office set-up if required. We have regular all company away days and other company, client and team meetings, your attendance at which will be mandatory
• For this particular role, the role holder will be expected to work from our brand new office in London (near Bank station) 2 - 3 days per week, or be spending time face to face with our clients 2 - 3 days per week
• As a Principal Data Engineer at Moneyhub, you'll join a team of senior engineers to provide the crucial, deep expertise needed to evolve our most demanding data systems
• You will be the technical authority for our high-performance data enrichment engine, a Kafka-based platform that processes tens of thousands of transactions per second
• We deploy this engine directly into our enterprise clients' cloud environments and also run it as a service for major financial services customers
• This is a senior individual contributor role for someone who has lived the challenges of engineering for scale
• You will use your experience to provide technical leadership, bridging the gap between complex software engineering and scalable cloud infrastructure to ensure our core data services are robust, efficient, and future-proof
• Evolve a Mission-Critical System: Take technical ownership of our Kafka-based Data Enrichment Engine, a platform that runs multiple analytical models at 20,000+ transactions per second
• Architect for Scale: Design and implement architectural improvements to enhance the platform's performance, reliability, and scalability across both our SaaS and client-deployed environments
• Solve Complex Engineering Challenges: Tackle deep technical problems related to high-throughput data ingestion, distributed systems, data consistency, and operational efficiency in a live production environment
• Act as the Subject Matter Expert (SME): As the go-to expert for the toughest data infrastructure challenges, you'll partner closely with our DevSecOps team to ensure production excellence. You will guide and mentor other engineers, establishing best practices for building and operating large-scale data systems
• Apache Kafka, Big Data, Architectural Design, Technical Contribution, AWS, JavaSCript, Node