Platform Engineer, Together AI

Machine Learning

$160-250k

+ Equity

Kubernetes

Python

Terraform

Haskell

C++

Rust

Golang

Senior and Expert level

Amsterdam

San Francisco Bay Area

4 days a week in office

Cloud platform for building generative AI

Open for applications

Cloud platform for building generative AI

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Open for applications

$160-250k

+ Equity

Kubernetes

Python

Terraform

Haskell

C++

Rust

Golang

Senior and Expert level

Amsterdam

San Francisco Bay Area

4 days a week in office

101-200 employees

B2BArtificial IntelligenceDeep TechSaaSCloud Computing

Company mission

To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.

Job

Company

Role

Who you are

5+ years of demonstrated experience in building large scale, fault tolerant, distributed systems and API microservices
Experience running serverless inference platforms, doing model bring-up on short notice, being on call, or general cloud provider is a very big plus
Good taste and ability to thoughtfully discuss how what you’ve built has failed over time
Experience designing, analyzing and improving efficiency, scalability, and stability of various system resources
Excellent understanding of low level operating systems concepts including concurrency, networking and storage, performance and scale
Expert-level programmer in one or more of Golang, Rust, Python, C++, or Haskell
Proficiency in writing and maintaining Infrastructure as Code (IaC) using tools like Terraform
Experience with Kubernetes or other container orchestration systems
Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
Writing-heavy roles or companies are a plus

What the job involves

This role focuses on enabling custom models and dedicated inference on Together
We are responsible for optimizing autoscaling, minimizing cold starts, achieving the best end-to-end model performance, and providing a best-in-class developer experience with great tooling
New hires may work on multi-cluster orchestration, portfolio optimization, predictive autoscaling, control panes, model bring-up, light model optimization, APIs for managing deployments, inference worker SDKs, and CLI tools
Analyze and improve the robustness and scalability of existing distributed systems, APIs, databases, and infrastructure
Partner with product teams to understand functional requirements and deliver solutions that meet business needs
Write clear, well-tested, and maintainable software and IaC for both new and existing systems
Conduct design and code reviews, create developer documentation, and develop testing strategies for robustness and fault tolerance

Our take

Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.

Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.

The company has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to expand its AI Acceleration Cloud product and prepare a large deployment of its GPUs, all while securing its position as an open-source model-building platform.

Steph

Company Specialist at Welcome to the Jungle

Company

Funding (last 2 of 4 rounds)

Feb 2025

$305m

SERIES B

Mar 2024

$106m

SERIES A

Total funding: $533.5m

Company benefits

Competitive health insurance plans
Dental and vision insurance
Pre-tax flexible spending accounts
Mental health support and services
Income protection & retirement
401(k) plan
AD&D insurance
Life insurance
STD & LTD insurance
Monthly team lunches
Flexible time off policy
Team-driven celebrations and events
Monthly commuting stipend + pre-tax bene

Company HQ

Design District, San Francisco, CA

Leadership

Ce Zhang

(Co-Founder & CTO)

Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.

Vipul Ved Prakash

(Co-Founder & CEO)

Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.

Salary benchmarks

We don't have enough data yet to provide salary benchmarks for this role.

Submit your salary to help other candidates with crowdsourced salary estimates.

Share this job

View 33 more jobs at Together AI