Senior AI Infrastructure Engineer, Together AI

$160-230k

Plus Equity

AWS

Kubernetes

GCP

Tensorflow

Azure

CUDA

PyTorch

Senior level

San Francisco Bay Area

Cloud platform for building generative AI

Job no longer available

Cloud platform for building generative AI

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Job no longer available

$160-230k

Plus Equity

AWS

Kubernetes

GCP

Tensorflow

Azure

CUDA

PyTorch

Senior level

San Francisco Bay Area

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Company mission

To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.

Job

Company

Role

Who you are

5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
Demonstrated experience with high performance or distributed cloud microservices architectures and ideally experience building them in operation at a global scale using multiple cloud providers such as AWS, Azure, or GCP
Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking and storage, performance, and scale
Pragmatic, methodical, well-organized, detail-oriented, and self-starting
Experience with Kubernetes and containerization, VPNs, AI workloads, and blockchain based protocols a plus
GPU programming, NCCL, CUDA knowledge a plus
Experience with Pytorch or Tensorflow a plus
5+ years experience writing high-performance, well-tested, production quality code

What the job involves

As a Senior Cloud Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI’s rapid growth
This system spans many diverse environments (Kubernetes, VMs, bare metal compute, and edge deployments) and provides a cohesive and reliable abstraction for running AI workloads in them
You will get to be a technology thought leader, evangelize new, cutting-edge technologies, and solve complex problems
To be successful, you’ll need to be deeply technical and possess excellent communication, collaboration, and diplomacy skills
You have experience practicing infrastructure-as-code, including using tools like Terraform and Ansible
You have strong software development fundamentals and skills. In addition, you have strong systems knowledge and troubleshooting abilities
Perform architecture and research work for decentralized AI workloads
Work on the core, open-source Together AI platform
Create services, tools, and developer documentation
Create testing frameworks for robustness and fault-tolerance

Our take

Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.

Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.

The company has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to expand its AI Acceleration Cloud product and prepare a large deployment of its GPUs, all while securing its position as an open-source model-building platform.

Steph

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 4 rounds)

Feb 2025

$305m

SERIES B

Mar 2024

$106m

SERIES A

Total funding: $533.5m

Company benefits

Competitive health insurance plans
Dental and vision insurance
Pre-tax flexible spending accounts
Mental health support and services
Income protection & retirement
401(k) plan
AD&D insurance
Life insurance
STD & LTD insurance
Monthly team lunches
Flexible time off policy
Team-driven celebrations and events
Monthly commuting stipend + pre-tax bene

Company HQ

Design District, San Francisco, CA

Leadership

Ce Zhang

(Co-Founder & CTO)

Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.

Vipul Ved Prakash

(Co-Founder & CEO)

Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 20 more jobs at Together AI