Product Manager, Spotify
AI Observability/Evaluation Platform
CA$98.2-140.2k
Plus equity
More information about location
Commercial music streaming service
Be an early applicant
Commercial music streaming service
1001+ employees
Be an early applicant
CA$98.2-140.2k
Plus equity
More information about location
1001+ employees
Company mission
To unlock the potential of human creativity—by giving a million creative artists the opportunity to live off their art and billions of fans the opportunity to enjoy and be inspired by it
Role
Who you are
- 2+ years of experience as a Product Manager, Technical Product Manager, or equivalent product ownership role
- Familiar with ML and AI development flows, and comfortable reasoning about LLM application patterns (prompting, RAG/agents, evaluation basics)
- Aware of LLM evaluation approaches (golden datasets, regression testing, human-in-the-loop review, LLM-as-a-judge)
- Comfortable partnering with engineers on technical tradeoffs and system design, even if you are not writing production code
- Strong product fundamentals: discovery, prioritization, roadmap communication, and stakeholder alignment
- Metrics-oriented and pragmatic; you can define outcomes and iterate based on evidence
What the job involves
- We are looking for a Product Manager to join the ML/AI Platform team at Spotify
- The team helps various groups build, deliver, and run ML and AI-enabled experiences at scale
- We want a Product Manager to oversee AI Observability and Evaluation. These platform tools assist teams in tracking LLM behavior during production, quickly resolving issues, measuring performance, and consistently refining our AI products
- This is an internal platform role with highly technical customers (ML engineers, backend engineers, data scientists)
- You will partner closely with engineering leaders to define the paved road for instrumenting, monitoring, and operating AI workloads end-to-end
- Own the product roadmap for Spotify’s AI observability capabilities across instrumentation, data contracts, and debugging workflows
- Collaborate with stakeholders to develop the roadmap for Spotify’s AI/Agentic evaluation capabilities via LLM-as-judges and other approaches
- Build golden path instrumentation defaults (SDKs/libraries/templates) that make LLM workloads observable by default
- Partner with engineering to deliver root-cause workflows across LLM chains/agents (what changed, where time/cost is spent, which step fails, which prompt/template/model version regressed)
- Drive adoption with internal teams through discovery, pilots, documentation, and ongoing enablement
- Define and track success metrics (coverage, time-to-first-trace, regressions caught pre-prod, MTTR, cost anomalies detected early)
- Partner with Privacy/Security to establish safe logging and retention guidance that supports both compliance and debuggability
Our take
Spotify was founded in an attempt to combat the rampant music piracy that was causing significant harm to the industry. The company has since taken music streaming mainstream and now has 180m+ paying subscribers across the world.
With features that include a highly accessible interface and a vast catalogue of artists, Spotify's strong brand has been able to maintain growth in spite of fierce competition from deep-pocketed rivals like Amazon and Apple. The company has achieved this by making smart acquisitions to move into other verticals to strengthen its offerings, especially podcasting, by acquiring Gimlet Media, Anchor and Parcast.
Spotify's future plans include rapid growth with a goal to become a one-stop destination for all digital sound, as well as AI and NFT integrations. However, high costs incurred from the acquisition of exclusive podcasts, increasing competitor strength, and weak bottom-line growth mean that the company must find a balance to maintain its position in the sector.
Freddie
Company Specialist at Welcome to the Jungle
Insights
23% employee growth in 12 months
Company
Funding (last 2 of 8 rounds)
Jan 2016
$1bn
CONVERTIBLE
Jun 2015
$526m
SERIES G
Total funding: $2.1bn
Company benefits
- Extensive learning opportunities, through our dedicated team, GreenHouse
- Flexible share incentives letting you choose how you share in our success
- Global parental leave, six months off - fully paid - for all new parents
- All The Feels, our employee assistance program and self-care hub
- Flexible public holidays, swap days off according to your values and beliefs
Company HQ
Norrmalm, Stockholm, Stockholms län
Leadership
Daniel Ek
(CEO & Chairman)Founded Spotify in 2006. Previously worked as an executive at Tradera, an auction company that was sold to eBay and was briefly the CEO of uTorrent.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 77 more jobs at Spotify