Junior Technical Program Manager, Together AI
Infrastructure Operations
$150-175k
+ Equity
Cloud platform for building generative AI
Be an early applicant
Cloud platform for building generative AI
101-200 employees
Be an early applicant
$150-175k
+ Equity
101-200 employees
Company mission
To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.
Role
Who you are
- Some prior experience in a TPM role - we're open to candidates who came into TPM from engineering, ops, or another technical function, but you should have done the work in practice: owning programs end-to-end, driving cross-functional resolution, managing external dependencies
- A technical background or demonstrated experience in a highly technical environment - you don't need to know GPUs on day one, but you need to be able to engage meaningfully with technical problems and earn credibility with infrastructure engineers
- A genuine bias toward action - you see a problem and start moving, even when the path forward isn't fully clear
- Resilience in a fast-paced, sometimes chaotic environment - you adapt quickly, stay effective under pressure, and don't wait for perfect conditions to make progress
- Strong organizational instincts - you can manage multiple workstreams, track dependencies, and keep things moving without losing the thread
- Ability to zoom out - you can be deep in the weeds on an operational problem while keeping the bigger picture in view
What the job involves
- Together AI runs one of the most demanding GPU fleets in the industry
- Keeping that fleet healthy - every node online, every GPU performing, every datacenter transition running on schedule - is operationally complex and genuinely high-stakes
- We're looking for a Junior TPM to own that operational reality
- This is not a coordination or status-reporting role
- You will own the end-to-end node lifecycle - from the moment a node goes down through repair, return, and re-integration - and you'll drive the cross-functional work to close every gap as fast as possible
- You'll manage datacenter bring-ups, hunt down GPU utilization loss, and build the processes and dashboards that make our fleet operations more visible and accountable over time
- The environment moves fast and doesn't always come with a clear playbook
- Much of what you'll work on is genuinely novel - you'll be figuring things out alongside engineers who are building at the frontier
- If that sounds like an obstacle, this isn't the right role
- If it sounds like the best possible way to learn, keep reading
- Own the end-to-end node lifecycle - from failure through repair, return, and re-integration — across provider ticketing, internal tooling, and the state machine that governs each stage
- Drive node remediation to resolution with urgency, eliminating gaps in ownership at every handoff
- Manage project timelines for new datacenter bring-ups, coordinating across internal teams and external providers to keep milestones on track
- Identify and diagnose GPU utilization loss across the fleet, working with engineering leads to drive resolution
- Build dashboards and tracking processes that make efficiency gaps visible and ensure they get closed
- Continuously improve operational workflows through process improvements and lightweight automation
- Develop and maintain relationships with external datacenter providers
Our take
Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.
Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.
The company has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to expand its AI Acceleration Cloud product and prepare a large deployment of its GPUs, all while securing its position as an open-source model-building platform.
Steph
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 4 rounds)
Feb 2025
$305m
SERIES B
Mar 2024
$106m
SERIES A
Total funding: $533.5m
Company benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene
Company HQ
Design District, San Francisco, CA
Leadership
Ce Zhang
(Co-Founder & CTO)Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.
Vipul Ved Prakash
(Co-Founder & CEO)Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 45 more jobs at Together AI