Senior Data Engineer, Spotify

Platform Engineering

Salary not provided

AWS

Docker

GCP

Python

Airflow

Cassandra

Hadoop

Spark

Luigi

Storm

Scalding

Senior and Expert level

London

Commercial music streaming service

Posted today

Commercial music streaming service

1001+ employees

B2CMusicEntertainmentDigital MediaSaaSMobile

Posted today

Salary not provided

AWS

Docker

GCP

Python

Airflow

Cassandra

Hadoop

Spark

Luigi

Storm

Scalding

Senior and Expert level

London

1001+ employees

B2CMusicEntertainmentDigital MediaSaaSMobile

Company mission

To unlock the potential of human creativity—by giving a million creative artists the opportunity to live off their art and billions of fans the opportunity to enjoy and be inspired by it

Job

Company

Role

Who you are

You have Data Engineering experience and know how to work with high-volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS
You have experience building clean, high-quality datasets for training large-scale models
You have experience with one or more higher-level Python or Java-based data processing frameworks such as Beam, Dataflow, Crunch, Scalding, Storm, Spark, etc
You have strong Python programming abilities. You might have worked with Docker as well as Luigi, Airflow, or similar tools
You care about quality and know what it means to ship high-quality code
You have experience managing data retention policies
You care about agile software processes, data-driven development, reliability, and responsible experimentation
You understand the value of collaboration and partnership within teams

What the job involves

As a Senior Data Engineer in our new Central Data Engineering team in the Platform Mission, you will be leading work that is mission-wide in terms of scope
Our new Central Data Engineering team will inform data quality standards, access standards, create templatised solutions, assist in managing mission-level datasets/dashboards, and prepare our mission’s data for the AI Future that expected to impact every squad and product area
As the Senior engineer on the team, you will deal with bringing structure to ambiguity and be the bridge between business goals and translating them to technical deliverables
Build large-scale data pipelines using frameworks like Google Cloud Platform and Apache Beam
Work on projects powering new generative AI experiences and helping to build models
Learn and contribute to the team's best practices and techniques for building data pipelines for large-scale models, including cleaning, filtering, classifying, and labeling
Collaborate with other engineers, researchers, product managers, and stakeholders, taking on learning and leadership opportunities that arise
Deliver scalable, testable, maintainable, and high-quality code
Share knowledge, promote standard methodologies, and improve the team through mentorship and constructive accountability

Salary benchmarks

Our take

Spotify was founded in an attempt to combat the rampant music piracy that was causing significant harm to the industry. The company has since taken music streaming mainstream and now has 180m+ paying subscribers across the world.

With features that include a highly accessible interface and a vast catalogue of artists, Spotify's strong brand has been able to maintain growth in spite of fierce competition from deep-pocketed rivals like Amazon and Apple. The company has achieved this by making smart acquisitions to move into other verticals to strengthen its offerings, especially podcasting, by acquiring Gimlet Media, Anchor and Parcast.

Spotify's future plans include rapid growth with a goal to become a one-stop destination for all digital sound, as well as AI and NFT integrations. However, high costs incurred from the acquisition of exclusive podcasts, increasing competitor strength, and weak bottom-line growth mean that the company must find a balance to maintain its position in the sector.

Freddie

Company Specialist at Welcome to the Jungle

Insights

Top investors

23% employee growth in 12 months

Glassdoor (4)

Trustpilot (1.6)

Company

Funding (last 2 of 8 rounds)

Jan 2016

$1bn

CONVERTIBLE

Jun 2015

$526m

SERIES G

Total funding: $2.1bn

Company benefits

Extensive learning opportunities, through our dedicated team, GreenHouse
Flexible share incentives letting you choose how you share in our success
Global parental leave, six months off - fully paid - for all new parents
All The Feels, our employee assistance program and self-care hub
Flexible public holidays, swap days off according to your values and beliefs

Company HQ

Norrmalm, Stockholm, Stockholms län

Leadership

Daniel Ek

(CEO & Chairman)

Founded Spotify in 2006. Previously worked as an executive at Tradera, an auction company that was sold to eBay and was briefly the CEO of uTorrent.

Share this job

View 29 more jobs at Spotify