Senior Product Manager, Alluxio

$200-250k

+ Equity

AWS

Kubernetes

GCP

Tensorflow

Azure

PyTorch

Mid and Senior level

San Francisco Bay Area

Office located in Foster City, CA

Open-source virtual distributed file system

Be an early applicant

Open-source virtual distributed file system

21-100 employees

B2BData storageBig dataAnalyticsBusiness IntelligenceMachine LearningSaaS

Be an early applicant

$200-250k

+ Equity

AWS

Kubernetes

GCP

Tensorflow

Azure

PyTorch

Mid and Senior level

San Francisco Bay Area

Office located in Foster City, CA

21-100 employees

B2BData storageBig dataAnalyticsBusiness IntelligenceMachine LearningSaaS

Company mission

To streamline data pipelines for business intelligence, applied machine learning, and model training.

Job

Company

Role

Who you are

4-8 years of experience in product management, AI infrastructure, or ML engineering roles, with at least 2 years focused on AI/ML workloads
Deep understanding of AI/ML workflows, including model deployment, inference optimization, and data‑access patterns
Proven track record of delivering features with measurable improvements in latency, throughput, or GPU utilization, or equivalent experience
Technical proficiency in distributed systems and cloud platforms (Kubernetes, AWS/GCP/Azure) and familiarity with frameworks like PyTorch, TensorFlow, Triton Inference Server or similar
Excellent communication and cross‑functional leadership skills, enabling clear translation of complex technical concepts to varied audiences

What the job involves

As a Senior Product Manager, you will own the product strategy and roadmap for AI inference capabilities, collaborating with ML engineers and practitioners to deliver low‑latency, high‑throughput data access for LLMs, generative AI, computer vision, and NLP
Your focus is on features that optimize resource utilization and reduce total cost of ownership
Define product roadmaps for AI‑inference workflows, focusing on latency, throughput, and GPU utilization improvements
Engage deeply with technical users to understand bottlenecks in model serving, caching, and scaling and translate them into product specifications
Partner with engineering to design and deliver inference‑oriented features such as GPU scheduling, sharding, and streaming data access
Work with customers to validate features and measure their impact, incorporating feedback into iteration cycles
Stay current with AI infrastructure trends (hybrid clouds, edge inference, multi‑model serving) and integrate them into product planning

Our take

Alluxio builds open source data orchestration software which helps bring data closer to compute across clusters, regions, clouds, and countries. The recent shift in enterprise architecture to hybrid and multi-cloud environments allows more flexibility but also brings challenges in data management across frameworks and storage systems.

Venture-backed by Andreessen Horowitz and Seven Seas Partners, its data orchestration platform is able to solve the challenges that have come out of decoupled architectures in modern workloads. Enterprises must be able to scale compute independently from storage due to the rise of compute intensive workloads and cloud adoption.

The company offers pay-as-you-go pricing for deployment in the cloud and software subscriptions for whole enterprise use and is used by a host of global enterprises, including Alibaba Cloud, China Unicom, Development Bank of Singapore, WalmartLabs, Ryte, Bazaarvoice, Rakuten, EA and more.

Freddie

Company Specialist at Welcome to the Jungle

Insights

Led by a woman

Top investors

10% employee growth in 12 months

Glassdoor (3.6)

Company

Funding (last 2 of 4 rounds)

Nov 2021

$50m

SERIES C

Apr 2020

$15.5m

SERIES B

Total funding: $81.5m

Company benefits

Stay healthy, stay happy. Medical, dental, and vision
Work hard, play hard. Happy hour, game tournaments, and company outings
Gym, food trucks, and wellness programs. Small company with big office perks
High quality input yields high quality output – it’s all about the I/O
We’re a diverse team where all are respected and welcomed
In the heart of Silicon Valley, minutes from San Mateo Caltrain

Company HQ

Hayward Park, San Mateo, CA

Leadership

Amelia Wong

(VP of Marketing)

Previous experience as Founder and Board Director and as an investor for local and national ventures.

Haoyuan Li

(Chairman and CEO)

Holds a BS, MS, and PHD in Computer Science. Experience in software engineering and as a research associate for Google.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 3 more jobs at Alluxio