Engineering Manager, Together AI
Site Reliability Engineering
$250-325k
+ Equity
4+ days a week in office
Cloud platform for building generative AI
Posted today
Cloud platform for building generative AI
101-200 employees
Posted today
$250-325k
+ Equity
4+ days a week in office
101-200 employees
Company mission
To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.
Role
Who you are
- Prior experience managing SRE, infrastructure, or platform engineering teams - ideally including time leading through a reliability or culture turnaround
- Deep technical credibility in at least one of: bare-metal infrastructure with Ansible-based config management, Kubernetes on public cloud, or Kubernetes with virtualization
- Strong Kubernetes and Terraform fundamentals, with hands-on production experience
- A genuine player-coach orientation - you want to stay close to the technology and contribute as an engineer, not just review the work of others
- Experience leading teams through serious production incidents and on-call rotations (PagerDuty or equivalent)
- A track record of coaching engineers and shifting team culture through engineering systems - not just process or frameworks. You can point to specific things you put in place and the change they produced
- Comfort operating in a matrix structure where technical direction is shared with tech leads
- Adaptability - the 50/50 management/IC balance shifts based on what the team needs, and you're at home with that
- Based in (or willing to relocate to) San Francisco, with the ability to be in the office regularly
What the job involves
- We're hiring an Engineering Managers for our Site Reliability Engineering organization to lead the team that keeps Together AI's production infrastructure running
- SRE at Together is roughly 20 engineers organized into three function areas: bare-metal / day-0 / day-2 operations, our inference platform, and our virtual clusters platform
- Each function area is led by a technical lead; you'll partner with them to manage and develop the engineers in your timezone
- This is a true player-coach role -roughly 50-60% management and 40-50% hands-on technical work
- You'll code, participate in architectural discussions, lead incident response, and stay close enough to the systems to coach effectively
- You'll also do the work that makes a team great over time: build trust, develop engineers, hire, and shape the operating rhythms that determine whether the team thrives or burns out
- The honest version: the team is talented but currently stretched thin, and a major part of this role is helping them shift from reactive, manual operations to systemic, automation-first work
- Together's infrastructure isn't a standard cloud setup- we run substantial bare-metal GPU compute, public-cloud Kubernetes for our inference platform, and Kubernetes-with-virtualization for our virtual clusters platform
- The two EM hires will complement each other across these areas, so we're looking at the team profile holistically
- Lead and develop a team of ~10 SRE engineers across multiple function areas, partnering with technical leads on direction
- Drive the team's shift from manual operations to systemic, automated, scalable infrastructure -including making toil visible, capping it, and prioritizing engineering work that reduces it
- Stay hands-on: code, review architecture, lead incidents, and participate meaningfully in technical decisions
- Build coaching and feedback rhythms that develop engineers over time, especially around incident leadership, on-call habits, and systemic problem-solving
- Strengthen on-call practices and incident response, including blameless postmortems that produce real engineering follow-through
- Partner with the other SRE EM (across timezone) to shape org-wide practices, hiring, and operational maturity
- Help grow the team- own hiring, leveling, and career development for engineers in your region
- Plan capacity, prioritize work across function areas in your portfolio, and represent SRE in broader engineering conversations
Our take
Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.
Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.
The company has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to expand its AI Acceleration Cloud product and prepare a large deployment of its GPUs, all while securing its position as an open-source model-building platform.
Steph
Company Specialist at Welcome to the Jungle
Company
Funding (last 2 of 4 rounds)
Feb 2025
$305m
SERIES B
Mar 2024
$106m
SERIES A
Total funding: $533.5m
Company benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene
Company HQ
Design District, San Francisco, CA
Leadership
Ce Zhang
(Co-Founder & CTO)Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.
Vipul Ved Prakash
(Co-Founder & CEO)Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 45 more jobs at Together AI