Senior Data Engineer, Octopus Energy Group
Octopus Energy
2+ days a week in office
The UK's most awarded energy supplier
Job no longer available
The UK's most awarded energy supplier
1001+ employees
Job no longer available
2+ days a week in office
1001+ employees
Company mission
To make a big green dent in the universe by building a truly sustainable energy system globally.
Role
Who you are
- Strong aptitude with SQL, Python and Airflow
- Experience in kubernetes, docker, django, Spark and related monitoring tools for devops a big plus (e.g. Grafana, Prometheus)
- Experience with dbt for pipeline modelling also beneficial
- Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them
- Able to quickly understand new domain areas and visualise data effectively
- Team player excited at the idea of ownership across lots of different projects and tools;Passion for driving towards Net Zero
- Drives knowledge sharing and documentation for a more effective platform
- Open to travelling to Octopus offices across Europe and the US
What the job involves
- The Energy Markets team at Octopus Energy is responsible for making sure that we always have the electricity and gas we need to support our customer demand whilst also supporting the grid to enable the Net Zero transition
- To achieve this mission across all Octopus international regions, we have sub-teams focused on forecasting energy demand and generation, hedging and shaping our trade position, tracking and reporting the ongoing risk to Octopus, and driving the proportion of our supply directly from generators via PPA agreements
- The Engineering sub-team owns our global technical platform that supports these different processes and drives forward long-term solutions to enhance Group capabilities
- We are looking for a Data Engineer to help achieve this goal - ideally someone who is comfortable diving into different tasks to support each team using a variety of coding languages across our platform setup, who enjoys developing relationships across the company while explaining technical processes in the most appropriate way, and who keeps an eye on scalable solutions to support data growth
- This is therefore an exciting opportunity to take on a role that combines complex data engineering, visual analytics and business critical need
- Supporting different Energy Markets teams to design and build key operational and reporting pipelines across all Octopus Energy regions
- Taking responsibility for the maintenance of these critical data pipelines supporting core trading, forecasting, risk and PPA processes
- Developing automations and alerts to quickly debug where these pipelines are failing or showing unprecedented trends
- Setting up and maintaining processes for capturing, preparing and loading valuable new data into the data lake
- Designing and building dashboards that cover operational processes and reporting requirements
- Working with international teams across the Octopus Energy Group to ensure everyone shares the best possible practises and code is standardised where possible
- Taking ownership of data platform improvements that enhance the capabilities for all Energy Markets teams and drives trust in the stability of the setup
- Sharing, enhancing and upskilling team members on available tools and best practices
- Our Data Stack:
- SQL-based pipelines built with dbt on Databricks
- Analysis via Python jupyter notebooks
- Pyspark in Databricks workflows for heavy lifting
- Streamlit and Python for dashboarding
- Airflow DAGs with Python for ETL running on kubernetes and docker
- Django for custom app/database development
- Kubernetes for container management, with Grafana/Prometheus for monitoring
- Hugo/Markdown for data documentation
Salary benchmarks
Our take
According to Octopus, the energy industry in the UK is ruled by a handful of complacent companies peddling fossil fuels, pricing trickery, and poor customer service. Aiming to disrupt the status quo with sustainable energy, Octopus entered the market in 2016 and now supplies energy to millions of homes in a number of countries. Octopus has made a name for itself in energy circles largely because of its “Kraken” technology platform, which it claims is able to reroute energy from renewable sources around a network far more efficiently than competitors.
Octopus further differentiates itself through its aspiration to make everything as easy as possible for consumers, from the simplicity of their bills and the fact that customers are not locked into a contract, so they can leave at any time, to offering customer service over email and social media at times that suit customers. It aims to make the eco‐friendly choice the easy choice, so all of its tariffs use 100% green electricity, while being cheaper than competitors' non-green tariffs.
Its continually creating innovative new products too. For example, Octopus Tracker, where prices change daily to guarantee you get the market rate; Agile, where the price changes every half hour to enable you to benefit from cheap electricity when the sun shines, the wind blows, and the networks are under-utilised. One of the current challenges the company faces is that its products are more complex than its competitors, given that it uses 1000x more data than traditional energy companies. Because of this, it's exploring ways to explain to customers exactly how their products work.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 6 rounds)
Dec 2023
$800m
GROWTH EQUITY VC
Jul 2022
$225m
GROWTH EQUITY VC
Total funding: $2.6bn
Company benefits
- Equity Option Scheme
- Pension Scheme: We'll pay 5%. You can decide what you contribute, starting from 3%
- Money Coach: You may want to think about financial planning. The company has an arrangement with Octopus Money Coach . They offer the opportunity to talk with a professional coach
- Holidays: We're all grown ups, so we don't count your holidays here. We work hard and so we know you need to play hard as well (within reason of course)
- Flexible working: We're passionate about a genuine work-life balance here and we don't pay people to watch a clock. Need to catch that school nativity or work from home? That's cool
- Free Breakfast + other stuff: ice lollies if you're lucky)! Weekly on a Friday we all get together (this happens virtually too) for company updates and drinks - we call it Family Dinner
- Tech: We want to get the best out of our people and get that everyone is slightly different. Have a certain tech requirement? We’ll do our best to get it
- Car Salary Sacrifice: Browse the wide selection of electric vehicles and get a sample quote under our workplace salary sacrifice scheme. If approved, the monthly leasing costs are taken directly from your gross salary each month meaning you're saving on paying some tax
- Cycle to Work Scheme: The Cycle to Work Scheme is a cost effective way to “buy” a bike up to a value of £2.5K, which hopefully is enough for a decent commuting bike, even an electric one. This extends to the cost of accessories and safety equipment as well as the bike
- Season Ticket Loan: Commuting to the office on the regs? If you travel more than twice a week, it’s worthwhile getting an annual ticket. With our Season Ticket Loan, you can spread out the cost over 10 months. It’s quick and easy to sort. Once approved and ordered, your season ticket will be posted to you within 5 days or so
- Maternity leave: 16 weeks full pay + 8 weeks half pay + 15 weeks statutory maternity pay
- Paternity leave: 12 weeks full pay
- Private Medical Insurance: Say goodbye to long waiting lists! For anyone who wants some additional peace of mind when it comes to their health, we offer Private Healthcare Insurance at different levels of cover. The monthly costs are taken directly from your gross salary and spread across 12 months. You even save on National Insurance
- Gym & Yoga: You can get up to 25% discount on gym memberships and we have 45 minute live yoga classes open to all Octopus staff twice a week!
- Headspace: Need some calm in your life? We have 'Octopus Headspace Licences' available
- Eye Test: Free eye test vouchers for all colleagues who use Visual Display Units (VDU). Long spells of VDU work can often be visually demanding and can lead to tired eyes, discomfort, temporary short sightedness and headaches
Company HQ
Soho, London, UK
Articles
Leadership
Greg Jackson
(Co-Founder & CEO)Previously an Adviser at Ashcombe Advisers for 9 years and a Non-Executive Director at Zopa for 7 years.
James Eddison
(CTO)Previously CEO at Claripoint for 7 years and CTO at Tangent Labs also for 7 years.
Stuart Jackson
(Co-Founder & CFO)Previously a Director of "Foundation" Business Unit at Barclaycard for 2 years and Chief of Staff, Secured Lending SBU at Barclays also for 2 years.
People progressing
Joined as Marketing Assistant, being promoted to Marketing Executive after 6 months and again to Junior Product and Marketing Manager after 7 months. After 8 months they became a full Product and Marketing Manager.
Joined as Senior Talent Partner, being promoted to Talent Manager after 1 year and again to Head of Talent Acquisition after 8 months.
Diversity, Equity & Inclusion at Octopus Energy Group
- Unconscious Bias workshops for interviewers and hiring managers
- Octopus Energy Equality Foundation
- Partnership with the Saracens High School - inspiring future generations - https://www.saracens.com/powering-futures-together-saracens-high-school-octopus-energy/
- Octopus Energy Internships - https://octopus.energy/blog/ada-lovelace-tech-internship/
Share this job
View 40 more jobs at Octopus Energy Group