Data Engineer, Spotify
Personalization
$160.1-228.7k
+ Equity
More information about location
Commercial music streaming service
Be an early applicant
Commercial music streaming service
1001+ employees
Be an early applicant
$160.1-228.7k
+ Equity
More information about location
1001+ employees
Company mission
To unlock the potential of human creativity—by giving a million creative artists the opportunity to live off their art and billions of fans the opportunity to enjoy and be inspired by it
Role
Who you are
- You are passionate about data and proficient in data modeling, data access, and data storage optimization
- You have experience building high-scale production data pipelines with one or more data processing frameworks such as Scio (built on Apache Beam), and major props if you know Ray
- You might have worked with orchestration frameworks such as Flyte
- You care about agile software processes, data-driven development, reliability, and responsible experimentation
- You value collaboration and partnership within teams
- Experience, exposure, or curiosity about ML Data processing and inference pipelines, LLM fine-tuning, and/or using LLMs for data analysis
- Bonus if you have experience with NRT (near real time) systems
- Bonus if you experience with prompt engineering for LLMs and prompt optimization tools like DSPy
What the job involves
- We are looking for a Data Engineer with interest in ML techniques to join our team and help build the future of podcast and audiobook listening experiences for millions of listeners at Spotify.
- This is a unique opportunity to help develop and shape Spotify recommendations. You’ll grow your skills in engineering at scale, work with a cross-functional team of Machine Learning Engineers, Backend Engineers, Data Engineers, and researchers, and join a super motivated and supportive team
- Work with large-scale data pipelines using data processing frameworks like Scio (built on Apache Beam), Hendrix ML, Ray, PyTorch, and Dataflow and other Google Cloud Platform offerings
- Support streaming and batch inference of core LLM models
- Develop new data pipelines to meet emerging needs and maintain our existing data systems as necessary to ensure they are reliable, scalable, and well tested
- Work with ML engineers to develop training and evaluation datasets for Generative LLM models
- Own the development of data solutions from architecture to delivery
- Collaborate with other backend and data engineers, ML engineers, data scientists, researchers, and other stakeholders
- Develop monitoring tools to automatically track AI product quality. This likely involves the use of LLMs to evaluate results as well as closer monitoring of performance indicators, and creation and maintenance of metrics datasets and dashboards
- Work in an agile team to continuously experiment, iterate and deliver on new product objectives
- Share knowledge, promote standard methodologies, making your team the best version of itself through mentorship and constructive accountability
Our take
Spotify was founded in an attempt to combat the rampant music piracy that was causing significant harm to the industry. The company has since taken music streaming mainstream and now has 180m+ paying subscribers across the world.
With features that include a highly accessible interface and a vast catalogue of artists, Spotify's strong brand has been able to maintain growth in spite of fierce competition from deep-pocketed rivals like Amazon and Apple. The company has achieved this by making smart acquisitions to move into other verticals to strengthen its offerings, especially podcasting, by acquiring Gimlet Media, Anchor and Parcast.
Spotify's future plans include rapid growth with a goal to become a one-stop destination for all digital sound, as well as AI and NFT integrations. However, high costs incurred from the acquisition of exclusive podcasts, increasing competitor strength, and weak bottom-line growth mean that the company must find a balance to maintain its position in the sector.
Freddie
Company Specialist at Welcome to the Jungle
Insights
23% employee growth in 12 months
Company
Funding (last 2 of 8 rounds)
Jan 2016
$1bn
CONVERTIBLE
Jun 2015
$526m
SERIES G
Total funding: $2.1bn
Company benefits
- Extensive learning opportunities, through our dedicated team, GreenHouse
- Flexible share incentives letting you choose how you share in our success
- Global parental leave, six months off - fully paid - for all new parents
- All The Feels, our employee assistance program and self-care hub
- Flexible public holidays, swap days off according to your values and beliefs
Company HQ
Norrmalm, Stockholm, Stockholms län
Leadership
Daniel Ek
(CEO & Chairman)Founded Spotify in 2006. Previously worked as an executive at Tradera, an auction company that was sold to eBay and was briefly the CEO of uTorrent.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 36 more jobs at Spotify