Big Data DBT/Redshift Engineer, Two Circles
Contract
Salary: $450 - $500 CADp/d
2+ days a week in office
Data-driven sports marketing
Be an early applicant
Data-driven sports marketing
501-1000 employees
Be an early applicant
Salary: $450 - $500 CADp/d
2+ days a week in office
501-1000 employees
Company mission
To use data to grow the value of sports.
Role
Who you are
- Streaming experience preferred
- 6+ years of data engineering experience in big data environments
- Proven experience designing and implementing streaming architectures
- Extensive hands-on DBT experience (models, macros, tests, documentation)
- Strong Amazon Redshift architecture and performance optimization expertise
- Experience building CI/CD pipelines for data platforms
- Experience working in client-facing delivery contexts
- AWS: Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, EMR
- Strong SQL and Redshift performance tuning expertise
- Python and PySpark (or equivalent distributed processing frameworks)
- Git-based version control workflows
- Deep understanding of data warehousing, modeling, and big data systems
What the job involves
- 12 Month contract
- We are seeking a Lead Data Engineer to join a client-focused data pod delivering large-scale data engineering solutions within a cloud-native AWS environment
- This is a delivery-first role requiring deep hands-on expertise in streaming data architectures, big data systems, and modern data warehousing practices. You will own streaming architectural direction while remaining actively involved in implementation
- The environment is AWS-centric (Redshift, S3, Glue, Step Functions, Lambda, EMR), with DBT as the transformation framework. We are actively integrating streaming data from GCP sources into our AWS data platform
- You will define engineering standards across data modeling, DBT implementation, testing, CI/CD, and production resiliency while collaborating directly with the client’s data team
- Own the architectural direction for streaming data ingestion from GCP into AWS
- Design resilient ingestion frameworks including error handling, retry strategies, monitoring, and failure isolation
- Implement distributed processing pipelines using Spark / PySpark or similar frameworks
- Create and maintain scalable data warehouses and associated ETL/ELT processes using DBT models in Amazon Redshift
- Design and implement DBT projects including macros, tests, documentation, and reusable modeling patterns
- Conduct Redshift query and DBT performance tuning to optimize warehouse efficiency and cost
- Define and enforce best practices for:
- Data modeling
- Version control (Git-based workflows)
- CI/CD pipelines for DBT deployments
- Automated testing at model, transformation, and pipeline levels
- Ensure robust testing is embedded into every DBT model (schema tests, custom tests, data validation checks)
- Lead code reviews and architectural design reviews
- Work with AWS services including Redshift, S3, Glue, Step Functions, Lambda (Python), Athena, and EMR
Our take
Two Circles is a digital sports marketing agency that develops and executes marketing strategies for sports-based companies, supplying the means to maximise sponsorship rights fees, increase commercial performance, engage the right audiences, and use data to inform future strategy.
As well as delivering front-running marketing tech and services for the sports industry, the company also dedicates itself to improving diversity and inclusion in sports, including its "Diversity in Sports" mentoring program that aims to accelerate the growth of under-represented talent across the industry.
Two Circles works with more than 300 sports rights holders, including the likes of the NFL, UEFA, F1, and the ICC, as well as $1bn in sponsorship revenues. A series of acquisitions has contributed to the expansion of the business - for example, that of Australia-based digital specialist Codeware, which came alongside the opening of a Melbourne office, has enabled it to grow its presence in the Oceania region and bolster its tech offering.
Freddie
Company Specialist at Welcome to the Jungle
Insights
18% employee growth in 12 months
Company
Funding (1 round)
Sep 2024
$317.5m
GROWTH EQUITY VC
Total funding: $317.5m
Company benefits
- Renowned Team Days often throughout the year
- Discretionary Bonus based on company performance
- Performance Reviews every 6 months with discretionary salary increases
Company HQ
Holborn, London, UK
Leadership
Gareth Balch
(Co-Founder & CEO)Previously worked in Commercial Strategy at Manchester City Football Club. Also a Former Director at Goodform.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 8 more jobs at Two Circles