Lead Data Engineer, Two Circles
6 Month Contract
Data-driven sports marketing
Posted today
Data-driven sports marketing
501-1000 employees
Posted today
501-1000 employees
Company mission
To use data to grow the value of sports.
Role
Who you are
- We are looking for a Data Engineer with 3+ years' experience working on enterprise-scale data architectures, preferably within a cloud-native environment (AWS) to join us on a 6 month contract
- You will bring deep expertise in designing and operating secure, highly available, and cost-optimized pipelines, with hands-on experience using tools like Spark, Kinesis, Airflow, and Terraform
- 3+ years of professional experience as a Data Engineer in cloud environments, working with high-throughput, enterprise-scale data pipelines
- Strong experience with AWS services: S3, Lambda, Kinesis, DynamoDB, Redshift, EC2, EMR, IAM
- Demonstrated success managing secure data architectures with sensitive or regulated data (e.g., PII)
- Proven expertise in big data architectures, including Data Lakes and Lake houses, leveraging AWS services like S3, Athena, Glue, Redshift, and distributed computing with Apache Spark
- Practical experience with real-time data streaming using AWS Kinesis (Firehose and Data Streams) for scalable ingestion and processing
- Experience integrating with APIs, third-party data platforms, and real-time ingestion services
- Bonus points for experience and/or strong interest in AI-assisted programming tools and workflows
- Strong programming experience in Python and at least one of Scala or C#
- Proven experience with Apache Airflow (or equivalent orchestration tools) for job scheduling and workflow management
- Proficient with containerization technologies like Docker and orchestration with ECS or Kubernetes
- Experience with infrastructure as code (e.g., Terraform, CloudFormation)
- Experience in setting up observability stacks and using tools such as New Relic, CloudWatch, Prometheus, or Datadog
- Expertise in data testing and CI/CD, including unit testing (e.g., PyTest), data validation, and schema enforcement
- Understanding of streaming vs batch-oriented architectures, and when to use each approach
- Self-directed and highly proactive, with strong ownership of delivery and quality
- Excellent written and verbal communication skills; able to translate technical requirements into business impact
- Strong collaboration skills and a mindset for mentorship and knowledge-sharing
- Agile mindset, comfortable working in Scrum or Kanban environments
- Outcome-oriented, with a passion for delivering high-quality, maintainable, and secure data products
- Thrives in a fast-paced, evolving product landscape
- Values transparency, open communication, and a collaborative team culture
What the job involves
- You'll collaborate closely with architects, DevOps engineers, analysts, and stakeholders to shape the future of our SaaS-based fan intelligence platform and ensure it meets the needs of high-volume, real-time data use cases
- Lead the design and implementation of scalable, secure, and fault-tolerant data pipelines supporting batch and streaming workloads
- Champion enterprise data governance, monitoring, and alerting practices, ensuring compliance with data protection regulations (e.g., GDPR, CCPA)
- Collaborate with cross-functional teams (Product, DevOps, BI, Client Services) to drive end-to-end delivery of data features
- Take ownership of pipeline performance, observability, cost efficiency, and CI/CD workflows
- Provide technical guidance, mentor junior team members, and uphold high standards of code quality and engineering practices
- Contribute to the reliability and scalability of the platform through strong infrastructure-as-code, monitoring, and automated testing frameworks
Our take
Two Circles is a digital sports marketing agency that develops and executes marketing strategies for sports-based companies, supplying the means to maximise sponsorship rights fees, increase commercial performance, engage the right audiences, and use data to inform future strategy.
As well as delivering front-running marketing tech and services for the sports industry, the company also dedicates itself to improving diversity and inclusion in sports, including its "Diversity in Sports" mentoring program that aims to accelerate the growth of under-represented talent across the industry.
Two Circles works with more than 300 sports rights holders including the likes of the NFL, UEFA, F1, and the ICC as well as $1bn sponsorship revenues. A series of acquisitions have contributed to the expansion of the business - for example, that of Australia-based digital specialist Codeware, which came alongside the opening of a Melbourne office, has enabled it to grow its presence in the Oceania region and bolster its tech offering
Freddie
Company Specialist at Welcome to the Jungle
Insights
18% employee growth in 12 months
Company
Company benefits
- Renowned Team Days often throughout the year
- Discretionary Bonus based on company performance
- Performance Reviews every 6 months with discretionary salary increases
Company HQ
Holborn, London, UK
Leadership
Gareth Balch
(Chief Executive)Previously worked in Commercial Strategy at Manchester City Football Club. Also a Former Director at Goodform.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 14 more jobs at Two Circles