Senior AI Infrastructure Engineer, Together AI
$160-230k
Plus Equity
Cloud platform for building generative AI
Open for applications
Cloud platform for building generative AI
21-100 employees
Open for applications
$160-230k
Plus Equity
21-100 employees
Company mission
To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.
Role
Who you are
- 5+ years of professional software development experience and proficiency in at least one backend programming language (Golang desired)
- Demonstrated experience with high performance or distributed cloud microservices architectures and ideally experience building them in operation at a global scale using multiple cloud providers such as AWS, Azure, or GCP
- Excellent understanding of low level operating systems concepts including multi-threading, memory management, networking and storage, performance, and scale
- Pragmatic, methodical, well-organized, detail-oriented, and self-starting
- Experience with Kubernetes and containerization, VPNs, AI workloads, and blockchain based protocols a plus
- GPU programming, NCCL, CUDA knowledge a plus
- Experience with Pytorch or Tensorflow a plus
- 5+ years experience writing high-performance, well-tested, production quality code
What the job involves
- As a Senior Cloud Engineer, you will be responsible for building the next generation, highly available, global, multi-cloud PaaS platform with open-source technologies to enable and accelerate Together AI’s rapid growth
- This system spans many diverse environments (Kubernetes, VMs, bare metal compute, and edge deployments) and provides a cohesive and reliable abstraction for running AI workloads in them
- You will get to be a technology thought leader, evangelize new, cutting-edge technologies, and solve complex problems
- To be successful, you’ll need to be deeply technical and possess excellent communication, collaboration, and diplomacy skills
- You have experience practicing infrastructure-as-code, including using tools like Terraform and Ansible
- You have strong software development fundamentals and skills. In addition, you have strong systems knowledge and troubleshooting abilities
- Perform architecture and research work for decentralized AI workloads
- Work on the core, open-source Together AI platform
- Create services, tools, and developer documentation
- Create testing frameworks for robustness and fault-tolerance
Our take
Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.
Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.
The company has has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to develop its products to cater for larger organisations, as well as expanding its compute capacity across the world.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (last 2 of 3 rounds)
Mar 2024
$106m
SERIES A
Nov 2023
$102.5m
SERIES A
Total funding: $228.5m
Company benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene
Company values
- Empower Innovation - Everything works best when we help the open-source community work better together
- Discover the magic - Our wonder, curiosity, and hope drive us to find ways to make everyone’s lives better
- Do more with less - We are optimizers, making the most with what we have and not taking more than what we need
- Open to any prompt - We don’t know what’s possible until we try
- Model stewardship - We build everything with the purpose of benefiting society
Company HQ
The Castro, San Francisco, CA
Articles
Leadership
Ce Zhang
(CTO)Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.
Vipul Ved Prakash
(CEO)Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 13 more jobs at Together AI