Lead Cloud Infrastructure Engineer, Together AI

$160-240k

+ Equity

AWS

Kubernetes

Python

Kafka

Bash

Terraform

Teamcity

Kinesis

Senior and Expert level

San Francisco Bay Area

4+ days a week in office

Cloud platform for building generative AI

Open for applications

Cloud platform for building generative AI

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Open for applications

$160-240k

+ Equity

AWS

Kubernetes

Python

Kafka

Bash

Terraform

Teamcity

Kinesis

Senior and Expert level

San Francisco Bay Area

4+ days a week in office

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Company mission

To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.

Job

Company

Role

Who you are

5+ years of experience in infrastructure, SRE, or DevOps roles
Deep experience with Terraform and AWS infrastructure design, including VPCs, IAM, S3, EC2, etc
Experience with access control and permissions in AWS, including Lake Formation or similar
Experience supporting data infrastructure or working alongside data engineering teams (Kafka/Kinesis/ClickHouse a plus)
Familiarity with CI/CD for infrastructure (GitHub Actions, TeamCity, ArgoCD, etc.)
Proficiency in scripting or programming (Python, Go, or Bash preferred)
Comfortable working autonomously and supporting multiple stakeholders
Bonus: experience with Kubernetes, hybrid cloud/on-prem infrastructure, or cost optimization at scale

What the job involves

Together AI is hiring a Lead Cloud Infrastructure Engineer to own and operate the cloud foundation that powers our rapidly scaling data platforms
In this role, you will be the primary engineer responsible for defining, building, and maintaining the AWS infrastructure that underpins data engineering systems across the company — from internal analytics pipelines to customer-facing metering and billing systems
You will work closely with multiple data engineering teams, enabling them to move faster by building reliable, secure-by-default infrastructure they can depend on
You’ll partner with our dedicated security engineering team to ensure best practices around IAM, network design, and data lake access — while focusing on platform reliability, scalability, and developer experience
This is a high-ownership, hands-on engineering role
You’ll manage everything from Terraform modules and CI/CD pipelines to Lake Formation permissions and observability tools — with a mandate to build infrastructure that just works, and keeps working
Own the design, implementation, and operation of all AWS-based infrastructure supporting data systems
Build and maintain reproducible, well-documented Terraform infrastructure modules
Collaborate with multiple data engineering teams to understand and support their infrastructure needs
Implement and maintain IAM policies and Lake Formation permissions in partnership with the security engineering team
Build internal tooling and automation to support self-service infra provisioning
Monitor infrastructure health and cost, and drive continuous improvements in reliability and efficiency
Serve as the point person for infrastructure questions, issues, and requests across the company’s data platforms

Our take

Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.

Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.

The company has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to expand its AI Acceleration Cloud product and prepare a large deployment of its GPUs, all while securing its position as an open-source model-building platform.

Steph

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 4 rounds)

Feb 2025

$305m

SERIES B

Mar 2024

$106m

SERIES A

Total funding: $533.5m

Company benefits

Competitive health insurance plans
Dental and vision insurance
Pre-tax flexible spending accounts
Mental health support and services
Income protection & retirement
401(k) plan
AD&D insurance
Life insurance
STD & LTD insurance
Monthly team lunches
Flexible time off policy
Team-driven celebrations and events
Monthly commuting stipend + pre-tax bene

Company HQ

Design District, San Francisco, CA

Leadership

Ce Zhang

(Co-Founder & CTO)

Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.

Vipul Ved Prakash

(Co-Founder & CEO)

Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 22 more jobs at Together AI