Lead Data Engineer, FXC Intelligence
Offers annual bonus/option scheme
1-2 days a week in office (Liverpool Street, London )
Specialist provider of global payments data
Be an early applicant
Specialist provider of global payments data
21-100 employees
Be an early applicant
Offers annual bonus/option scheme
1-2 days a week in office (Liverpool Street, London )
21-100 employees
Company mission
FXC Intelligence's mission is to break the mould for industry standard global payments data.
Role
Who you are
- Advanced skills in Python and SQL
- Involvement in web scraping and/or backend development
- Experience utilising AI to increase team productivity, efficiency and data quality
- A proactive approach, with the ability to set and exemplify high standards
- The ability to work in a fast-paced environment and adapt to change quickly
- Excellent communication skills, with the ability to communicate clearly and effectively
- Proven experience and a desire to manage a team
- A desire to understand and engage with the business domain and product
- A love for learning and improving your skills
Desirable
- Prior experience working for a data product company or being involved with Big Data
- Experience with advanced database management and data modelling
- Experience building or maintaining third-party or in-house data quality and cataloguing solutions
- DBT, Airflow (or other task orchestration tools), Kafka/RabbitMQ
- Experience with documentation of system architecture
- Experience collaborating with a BI, DA and/or ML team
What the job involves
- We are looking for a Lead Data Engineer to lead our Data Ingest team, responsible for scraping the data that fuels our products. You’ll play a pivotal role in shaping how we capture, process and scale the data pipelines that underpin our insights
- Line management of the Data Ingest team engineers
- Translating the strategic roadmap into actionable small tasks and providing visibility on delivery progress to stakeholders
- Doing or overseeing research and technical investigations, representing and prioritising the resulting improvements against other stakeholder priorities
- Improving and automating team processes – release of new features, cross-team collaboration and inspiring the culture of innovation and growth in the team
- Implementation of new and maintenance of existing scrapers
- Migration of scrapers to AWS and from old Jenkins-based orchestration to a new microservice-based system
- Improvements to the scraping platform in the areas of data quality, performance and observability
- You will join a technical team of c. 40 technologists with a key purpose of continuously and reliably collecting large amounts of financial data describing cross-border payments, then processing the data, checking the quality and serving it to our users so that they can make the best business decisions
- The Data Ingest team is the oldest team at FXC Intelligence, existing in some form for over six years now. We provide the platform for collecting unstructured data from open third-party websites and mobile apps, and make sure that the data collected corresponds to the company's data quality standards and SLAs
- As the business grows and requirements change, so do we – the platform has survived several iterations and is currently in the process of being migrated to its fourth generation. The team also maintains over 100 scrapers for different providers of data, which power most of the company’s critical datasets
- Tech Stack: Python, PostgreSQL, RabbitMQ, Redis, Puppeteer, Playwright, Selenium, Pandas, Numpy and SKlearn
Salary benchmarks
Our take
FXC Intelligence is the self-proclaimed 'industry standard' for cross-border payments data. It focuses on creating and developing high grade datasets, which give businesses in the card and international payments sector access to deep, predictive analysis. Its services are used by clients ranging from banks to regulators - all of whom need access to quality data in what can otherwise be a hugely opaque market.
For its clients, the perks of signing up are clear. FXC Intelligence's services give clients the ability to enhance their decision-making processes, prepare better for changes in the market, and build new, improved products. It is no surprise, then, that big industry names like Lloyds Bank and Ripple are already onboard. And, with its reputation having been boosted by the likes of Forbes and the Economist running publications based on its data, FXC Intelligence could be looking at even greater demand in future.
Furthermore, FXC Intelligence now has the ability to capitalise on a growing number of financial institutions looking to establish themselves in a new digital era. If FXC Intelligence can continue its run of current successes, as well as harnessing this potential increase in demand, it has great prospects moving forward.
Freddie
Company Specialist at Welcome to the Jungle
Insights
75% employee growth in 12 months
Company
Company benefits
- Flexible working arrangements
- Receive a 20% annual bonus and share options
- A brand new Mac or PC it's your choice!
- 5% Workplace pension scheme contribution
- Professional/Career coaching sessions with an external coach
- Perkbox subscription for exclusive deals and discounts
- AXA private healthcare for employee and spouse/partner and/or children
Company HQ
Westminster, London, UK
Leadership
Daniel Webber
(CEO & Founder)A first-class economics graduate from the University of Cambridge, Daniel was previously Director at SuperVision Media and The Rival Group.
Share this job
View 2 more jobs at FXC Intelligence