Senior DevOps Engineer, Together AI
$160-230k
Plus Equity
Cloud platform for building generative AI
Job no longer available
Cloud platform for building generative AI
21-100 employees
Job no longer available
$160-230k
Plus Equity
21-100 employees
Company mission
To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.
Role
Who you are
- Minimum of 5 years of prior relevant experience in DevOps, cloud computing, data center operations, SRE, and Linux systems administration
- Experience in programming in at least one of the following languages: Java, Python, Go, C++
- Experience designing and building advanced CI/CD pipeline frameworks
- Experience with cloud computing toolsets like Terraform, Vault, and Packer
- Experience with configuration management tools like Ansible, Pulumi, Chef and Puppet
- Experience with Kubernetes, containerization and VPNs
- Strong sense of ownership and desire to build great tools for others
- Self-driven and motivated, with a strong work ethic and a passion for problem solving
- Experience with AI workloads and blockchain based protocols a plus
- GPU programming, NCCL, CUDA knowledge a plus
- Experience with Pytorch or Tensorflow a plus
What the job involves
- We are hiring a talented Senior DevOps Engineer to develop the software and processes for orchestration of AI workloads over large fleets of distributed GPU hardware
- In this role, you'll be part of a cloud engineering organization that aims to automate everything and build failure-resistant and horizontally scalable cloud infrastructure for GPU-resident applications
- As a Senior DevOps Engineer, you'll build deep understanding of Together AI’s services and use that knowledge to optimize and evolve our infrastructure's reliability, availability, serviceability, and profitability
- The best applicants for this role are deeply technical, enthusiastic, great collaborators, and intrinsically motivated to deliver high quality infrastructure
- You have experience practicing infrastructure-as-code, including the use of tools like Terraform and Ansible
- You also have strong software development fundamentals, systems knowledge, troubleshooting abilities, and a deep sense of responsibility
- Create a highly automated infrastructure pipeline for deploying and scaling distributed and multi-tenant GPU-resident compute to new cloud and data center environments
- Create infrastructure to auto-scale AI models, create training clusters, and wrestle with CUDA dependencies
- Introduce tools to facilitate greater automation and operability of services
- Design, build, and maintain CI/CD infrastructure
- Architect, deploy, and scale observability infrastructure
- Participate in on-call rotation and ensure uptime of services
- Investigate production issues and help prevent their reoccurrence
- Create runtime tools/processes that optimize cloud triaging and limit downtime
- Define best practices to make our systems and services measurable
- Work closely with internal teams to ensure best practices are appropriately applied
- Build tools to help engineering and research teams measure and improve their velocity
- Analyze and decompose complex software systems
- Collaborate with and influence others to improve the overall design
Our take
Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.
Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.
The company has has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to develop its products to cater for larger organisations, as well as expanding its compute capacity across the world.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (last 2 of 3 rounds)
Mar 2024
$106m
SERIES A
Nov 2023
$102.5m
SERIES A
Total funding: $228.5m
Company benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene
Company values
- Empower Innovation - Everything works best when we help the open-source community work better together
- Discover the magic - Our wonder, curiosity, and hope drive us to find ways to make everyone’s lives better
- Do more with less - We are optimizers, making the most with what we have and not taking more than what we need
- Open to any prompt - We don’t know what’s possible until we try
- Model stewardship - We build everything with the purpose of benefiting society
Company HQ
The Castro, San Francisco, CA
Articles
Leadership
Ce Zhang
(CTO)Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.
Vipul Ved Prakash
(CEO)Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 14 more jobs at Together AI