Machine Learning Engineer, Together AI
$160-220k
+ Equity
Cloud platform for building generative AI
Be an early applicant
Cloud platform for building generative AI
21-100 employees
Be an early applicant
$160-220k
+ Equity
21-100 employees
Company mission
To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.
Role
Who you are
- 5+ years experience writing high-performance, well-tested, production quality code
- Bachelor’s degree in computer science or equivalent industry experience
- Familiar with LLM inference ecosystem, including frameworks and engines (e.g. LLVM, SGLang, TRT, ...)
- Demonstrated experience in building large scale, fault tolerant, distributed systems like storage, search, and computation
- Expert level programmer in one or more of Python, Go, Rust, or C/C++
- Experience implementing runtime inference services at scale or similar
What the job involves
- Together AI is looking for an ML Engineer who will develop systems and APIs that enable our customers to perform inference and fine tune LLMs
- Relevant experience includes implementing runtime systems that perform inference at scale using AI/ML models from simple models up to the largest LLMs
- Design and build the production systems that power the Together Cloud inference and fine-tuning APIs, enabling reliability and performance at scale
- Partner with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world
- Analyze and improve efficiency, scalability, and stability of various system resources
- Conduct design and code reviews
- Create services, tools & developer documentation
- Create testing frameworks for robustness and fault-tolerance
- Participate in an on-call rotation to respond to critical incidents as needed
Our take
Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.
Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.
The company has has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to develop its products to cater for larger organisations, as well as expanding its compute capacity across the world.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (last 2 of 3 rounds)
Mar 2024
$106m
SERIES A
Nov 2023
$102.5m
SERIES A
Total funding: $228.5m
Company benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene
Company values
- Empower Innovation - Everything works best when we help the open-source community work better together
- Discover the magic - Our wonder, curiosity, and hope drive us to find ways to make everyone’s lives better
- Do more with less - We are optimizers, making the most with what we have and not taking more than what we need
- Open to any prompt - We don’t know what’s possible until we try
- Model stewardship - We build everything with the purpose of benefiting society
Company HQ
The Castro, San Francisco, CA
Articles
Leadership
Ce Zhang
(CTO)Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.
Vipul Ved Prakash
(CEO)Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 26 more jobs at Together AI