Senior DevOps Engineer, Together AI

$160-230k

+ Equtiy

Kubernetes

Python

Java

Linux

Terraform

C++

Ansible

Puppet

Chef

Pulumi

Senior and Expert level

San Francisco Bay Area

4 days a week in office

Cloud platform for building generative AI

Be an early applicant

Cloud platform for building generative AI

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Be an early applicant

$160-230k

+ Equtiy

Kubernetes

Python

Java

Linux

Terraform

C++

Ansible

Puppet

Chef

Pulumi

Senior and Expert level

San Francisco Bay Area

4 days a week in office

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Company mission

To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.

Job

Company

Role

Who you are

The best applicants for this role are deeply technical, enthusiastic, great collaborators, and intrinsically motivated to deliver high quality infrastructure
You have experience practicing infrastructure-as-code, including the use of tools like Terraform and Ansible
You also have strong software development fundamentals, systems knowledge, troubleshooting abilities, and a deep sense of responsibility
Minimum of 5 years of prior relevant experience in DevOps, cloud computing, data center operations and Linux systems administration
Experience in programming in at least one of the following languages: Go, Python, Java, and C++
Experience designing and building advanced CI/CD pipeline frameworks
Experience with cloud computing toolsets like Terraform, Vault, and Packer
Experience with configuration management tools like Ansible, Pulumi, Chef and Puppet
Experience with Kubernetes and containerization
Strong sense of ownership and desire to build great tools for others
Introduce tools to facilitate greater automation and operability of services
Design, build, and maintain CI/CD infrastructure
Architect, deploy, and scale observability infrastructure
Create runtime tools/processes that optimize cloud triaging and limit downtime
Define best practices to make our systems and services measurable
Work closely with internal teams to ensure best practices are appropriately applied
Build tools to help engineering and research teams measure and improve their velocity
Analyze and decompose complex software systems
Collaborate with and influence others to improve the overall design

What the job involves

We are hiring a talented Senior DevOps Engineer to develop the software and processes for orchestration of AI workloads over large fleets of distributed GPU hardware
In this role, you'll be part of a cloud engineering organization that aims to automate everything and build failure-resistant and horizontally scalable cloud infrastructure for GPU-resident applications
As a Senior DevOps Engineer, you'll build deep understanding of Together AI’s services and use that knowledge to optimize and evolve our infrastructure's reliability, availability, serviceability, and profitability

Our take

Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.

Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.

The company has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to expand its AI Acceleration Cloud product and prepare a large deployment of its GPUs, all while securing its position as an open-source model-building platform.

Steph

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 4 rounds)

Feb 2025

$305m

SERIES B

Mar 2024

$106m

SERIES A

Total funding: $533.5m

Company benefits

Competitive health insurance plans
Dental and vision insurance
Pre-tax flexible spending accounts
Mental health support and services
Income protection & retirement
401(k) plan
AD&D insurance
Life insurance
STD & LTD insurance
Monthly team lunches
Flexible time off policy
Team-driven celebrations and events
Monthly commuting stipend + pre-tax bene

Company HQ

Design District, San Francisco, CA

Leadership

Ce Zhang

(Co-Founder & CTO)

Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.

Vipul Ved Prakash

(Co-Founder & CEO)

Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 23 more jobs at Together AI