Machine Learning Engineer, Together AI
Inference
$160-230k
+ Equity
Cloud platform for building generative AI
Open for applications
Cloud platform for building generative AI
21-100 employees
Open for applications
$160-230k
+ Equity
21-100 employees
Company mission
To empower developers and researchers at organizations of all sizes to train, fine-tune, and deploy generative AI models.
Role
Who you are
- If you are passionate about AI inference, PyTorch, and developing high-performance systems, we want to hear from you
- 3+ years of experience writing high-performance, well-tested, production-quality code
- Proficiency with Python and PyTorch
- Demonstrated experience in building high performance libraries and tooling
- Excellent understanding of low-level operating systems concepts including multi-threading, memory management, networking, storage, performance, and scale
- Preferred: Knowledge of existing AI inference systems such as TGI, vLLM, TensorRT-LLM, Optimum
- Preferred: Knowledge of AI inference techniques such as speculative decoding
- Preferred: Knowledge of CUDA/Triton programming
- Nice to have: Knowledge of Rust, Cython and compilers
What the job involves
- Together AI is seeking a Machine Learning Engineer to join our Inference Engine team, focusing on optimizing and enhancing the performance of our AI inference systems
- This role involves working with state-of-the-art large language models models and ensuring they run efficiently and effectively at scale
- This position offers the chance to collaborate closely with AI researchers and engineers to create cutting-edge AI solution
- Design and build the production systems that power the Together AI inference engine, enabling reliability and performance at scale
- Develop and optimize runtime inference services for large-scale AI applications
- Collaborate with researchers, engineers, product managers, and designers to bring new features and research capabilities to the world
- Conduct design and code reviews to ensure high standards of quality
- Create services, tools, and developer documentation to support the inference engine
- Implement robust and fault-tolerant systems for data ingestion and processing
Our take
Founded in 2022, Together AI is a research-driven AI company that operates a cloud platform for building and running generative AI. The company also contributes to open-source research, models and datasets to advance the use of machine learning.
Together AI's platform enables developers, researchers and businesses to train, fine-tune and deploy generative AI for their needs. With Generative AI gaining a lot of attention recently, the company has some high-profile competitors such as ChatGPT, but its focus on research makes it stand out.
The company has has an incredibly strong start, evidenced by its substantial funding and Unicorn status. It is using these funds to develop its products to cater for larger organisations, as well as expanding its compute capacity across the world.
Steph
Company Specialist at Welcome to the Jungle
Insights
Few candidates hear
back within 2 weeks
Company
Funding (last 2 of 3 rounds)
Mar 2024
$106m
SERIES A
Nov 2023
$102.5m
SERIES A
Total funding: $228.5m
Company benefits
- Competitive health insurance plans
- Dental and vision insurance
- Pre-tax flexible spending accounts
- Mental health support and services
- Income protection & retirement
- 401(k) plan
- AD&D insurance
- Life insurance
- STD & LTD insurance
- Monthly team lunches
- Flexible time off policy
- Team-driven celebrations and events
- Monthly commuting stipend + pre-tax bene
Company values
- Empower Innovation - Everything works best when we help the open-source community work better together
- Discover the magic - Our wonder, curiosity, and hope drive us to find ways to make everyone’s lives better
- Do more with less - We are optimizers, making the most with what we have and not taking more than what we need
- Open to any prompt - We don’t know what’s possible until we try
- Model stewardship - We build everything with the purpose of benefiting society
Company HQ
The Castro, San Francisco, CA
Articles
Leadership
Ce Zhang
(CTO)Previously Professor at ETH Zurich, Postdoc Researcher at Stanford University and Research Assistant at University of Wisconsin-Madison.
Vipul Ved Prakash
(CEO)Previously Senior Director at Apple, CEO and CTO at Topsy and Founder at Cloudmark.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 13 more jobs at Together AI