Mid-Level Data Engineer, Octopus Energy Group
Energy Markets, Octopus Energy UK
More information about location
2+ days a week in office
Entech company
Be an early applicant
Entech company
1001+ employees
Be an early applicant
More information about location
2+ days a week in office
1001+ employees
Company mission
Octopus Energy's mission is to speed the transition to a sustainable, low carbon future through renewable energy and technology whilst putting customers at the heart of everything they do.
Role
Who you are
- Strong aptitude with SQL, Python and Airflow
- Experience in kubernetes, docker, django, Spark and related monitoring tools for devops a big plus (e.g. Grafana, Prometheus)
- Experience with dbt for pipeline modelling also beneficial
- Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them
- Able to quickly understand new domain areas and visualise data effectively
- Team player excited at the idea of ownership across lots of different projects and tools;Passion for driving towards Net Zero
- Drives knowledge sharing and documentation for a more effective platform
What the job involves
- We are looking for a Data Engineer to help achieve this goal - ideally someone who is comfortable diving into different tasks to support each team using a variety of coding languages across our platform setup, who enjoys developing relationships across the company while explaining technical processes in the most appropriate way, and who keeps an eye on scalable solutions to support data growth
- This is therefore an exciting opportunity to take on a role that combines complex data engineering, visual analytics and business critical need
- Supporting different Energy Markets teams to design and build key operational and reporting pipelines across all Octopus Energy regions
- Taking responsibility for the maintenance of these critical data pipelines supporting core trading, forecasting, risk and PPA processes
- Developing automations and alerts to quickly debug where these pipelines are failing or showing unprecedented trends
- Setting up and maintaining processes for capturing, preparing and loading valuable new data into the data lake
- Designing and building dashboards that cover operational processes and reporting requirements
- Working with international teams across the Octopus Energy Group to ensure everyone shares the best possible practises and code is standardised where possible
- Taking ownership of data platform improvements that enhance the capabilities for all Energy Markets teams and drives trust in the stability of the setup
- Sharing, enhancing and upskilling team members on available tools and best practices
- Our Data Stack:
- SQL-based pipelines built with dbt on Databricks
- Analysis via Python jupyter notebooks
- Pyspark in Databricks workflows for heavy lifting
- Streamlit and Python for dashboarding
- Airflow DAGs with Python for ETL running on kubernetes and docker
- Django for custom app/database development
- Kubernetes for container management, with Grafana/Prometheus for monitoring
- Hugo/Markdown for data documentation
Salary benchmarks
Our take
According to Octopus, the energy industry in the UK is ruled by a handful of complacent companies peddling fossil fuels, pricing trickery, and poor customer service. Aiming to disrupt the status quo with sustainable energy, Octopus entered the market in 2016 and they now supply energy to millions of homes in a number of countries. Octopus has made a name for itself in energy circles largely because of its “Kraken” technology platform, which it claims is able to reroute energy from renewable sources around a network far more efficiently than competitors.
Octopus Energy further differentiates itself through its aspiration to make everything as easy as possible for consumers, from the simplicity of their bills and the fact that customers are not locked into a contract so they can leave at any time to offering customer service over email and social media at times that suit customers. They aim to make the eco‐friendly choice the easy choice, so all of their tariffs use 100% green electricity, while not being more expensive than their competitors' non-green tariffs.
They are continually creating innovative new products. For example, Octopus Tracker where prices changes daily to guarantee you get the market rate; Agile where the price changes every half hour to enable you to benefit from cheap electricity when the sun shines, the wind blows, and the networks are under-utilised. One of the current challenges they face is that their products are more complex than their competitors, given they use 1000x more data than traditional energy companies. They're exploring ways to explain to customers exactly how their products work.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Employee endorsements
Challenging work
"The work that I am doing is often quite difficult. I am constantly challenged and problem solving, which I find rewarding as it means I am always..."
Funding (last 2 of 6 rounds)
Dec 2023
$800m
GROWTH EQUITY VC
Jul 2022
$225m
GROWTH EQUITY VC
Total funding: $2.5bn
Company benefits
- Your development is important - we support and help with development including internal and external courses, learning, study support etc, all bespoke to you
- Flexi working environment
- Equity Options Scheme - you own your own part of the business, share options in the whole Octopus Energy Group so we all work together towards success
- Unlimited paid time off policy
- Work from home opportunities
- Equity Option Scheme - Everyone owns part of what we’re building with shares
- Tech - We want to get the best out of our people and get that everyone is slightly different. Have a certain tech requirement? We’ll do our best to get it
- Money Coach - You may want to think about financial planning. The company has an arrangement with Octopus Money Coach. They offer the opportunity to talk with a professional coach
- Wellbeing - Need some calm in your life? We have 'Octopus Headspace Licences' available. Twice a week we have 45 Minute live yoga class open to all Octopus staff!
- Parents - get access to tax free childcare and maternity and paternity pay. We’re always looking for new ways to support parents, during lockdown we created OctoKids TV to help keep your kids occupied and entertained (https://octopus.energy/blog/octopuskids/)
- Office culture - Our offices are stocked with fruit, breakfast, great coffee, and soft drinks (and ice lollies if you're lucky)! Weekly on a Friday we all get together (this happens virtually too) for company updates and drinks - we call it Family Dinner. We won best company to work for in 2019 and our CEO, Greg has recorded a podcast about our culture and how we empower our people. Check out what our people say at Glassdoor!
- Car Salary Sacrifice - Browse the wide selection of electric vehicles and get a sample quote under our workplace salary sacrifice scheme. If approved, the monthly leasing costs are taken directly from your gross salary each month meaning you're saving on paying some tax
Company values
- Autonomy
- Empathy
- Innovation
- Impact
Company HQ
Fitzrovia, London, UK
Articles
Leadership
Greg Jackson
(CEO)Previously Adviser at Ashcombe Advisers for 9 years and Non-Executive Director at Zopa for 7 years.
James Eddison
(CTO)Previously CEO at Claripoint for 7 years and CTO at Tangent Labs also for 7 years.
Stuart Jackson
(CFO)Previously Director of "Foundation" Business Unit at Barclaycard for 2 years and Chief of Staff, Secured Lending SBU at Barclays also for 2 years.
People progressing
Joined as Marketing Assistant, being promoted to Marketing Executive after 6 months and again to Junior Product and Marketing Manager after 7 months. After 8 months they became a full Product and Marketing Manager.
Joined as Senior Talent Partner, being promoted to Talent Manager after 1 year and again to Head of Talent Acquisition after 8 months.
Diversity, Equity & Inclusion at Octopus Energy Group
- Unconscious Bias workshops for interviewers and hiring managers
- Octopus Energy Equality Foundation
- Partnership with the Saracens High School - inspiring future generations - https://www.saracens.com/powering-futures-together-saracens-high-school-octopus-energy/
- Octopus Energy Internships - https://octopus.energy/blog/ada-lovelace-tech-internship/
Share this job
View 22 more jobs at Octopus Energy Group