Senior Data Engineer, Vitesse

• Developing data processing pipelines in python and SQL for Databricks including many of the following technologies: Spark, Delta, Delta Live Tables, PyTest, Great Expectations (or similar) and Jobs
• Developing data pipelines for batch and stream processing and analytics
• Building data pipelines for enterprise data and one other business domain
• Building and orchestrating data pipelines and analytical processing for streaming data with technologies such as Kafka, AWS Kinesis or Azure Stream Analytics
• Knowledge of data governance, privacy regulations (e.g. GDPR), and security best practices
• Delivering data engineering and designing for cloud native data platforms (AWS/ Azure/ Databricks)
• Building DevOps pipelines for data engineering solutions using Terraform, GitHub, DevOps
• Working within highly agile multidisciplinary scrum teams in Scrum/Kanban
• Mentoring data engineers, carrying out PR review

Desirable

• As a Senior Data Engineer, you will collaborate closely with our business and engineering teams to design, implement, and maintain data engineering solutions while ensuring security and data best practices
• You will work on internal and/or Vitesse SaaS platform data initiatives
• As a senior you will work mostly independently with light touch leadership from the squad lead
• You will join a multidisciplinary squad of 5 data professionals within the organisations wider data team
• We work remotely with regular contact time in our London based offices
• Design, build, and maintain scalable data pipelines for batch and real time data handling large volumes of structured and unstructured data
• Develop, enhance, and optimize ELT processes to ingest, transform, enrich and publish data
• Build quality, trusted, secure data products for consumption in reporting, analytics and science
• Assure the privacy, security and legal compliance of data in data engineering
• Optimise data pipelines and queries for better performance and cost-efficiency
• Integrate data pipelines with monitoring and observability to proactively detect and resolve issues before they impact business operations
• Design and build data models for lake house storage and analytics
• Implement and maintain CI/CD pipelines for data engineering
• Collaborate with business teams, product owners, analysts and data scientists to understand their needs and ensure availability of relevant data
• Capture and maintain data documentation enabling self-service communities to understand, assess and utilise reusable data assets
• Research and evaluate cutting-edge data technologies, tools, and practices to improve data engineering processes
• Mentor early in career data engineers, support the squad lead in PR review

• 25 days Holiday per year (increasing by 1 day per years' service, up to 30 days) + Bank Holidays
• Hybrid working arrangements – minimum 2 days in the office, Tuesday - Thursday
• Contributory pension scheme
• Enhanced Parental leave
• Cycle to Work Scheme
• Private Medical Insurance with AXA
• Unlimited access to therapy sessions through our partner, Oliva
• Discounted Gym membership through Gympass
• Financial Coaching with Octopus Wealth
• 2 days of volunteering leave per year
• Sabbatical after 5 years’ service
• Life Assurance - MetLife (UK employees only)
• Ongoing Learning and Development to support you reach your career goals

Total funding: $127.6m

Vitesse is a payment business providing global payment services to a range of businesses. Operating on one of the largest domestic banking and payment networks in the world, Vitesse gives its customers direct access to over 180 countries' domestic payment networks and processes over $10B in transactions.