AI/ML Engineer, Anyscale
Large Language Models
$170.1-237k
+ Equity
3 days a week in office
Open-source framework for AI software development
Open for applications
Open-source framework for AI software development
201-500 employees
Open for applications
$170.1-237k
+ Equity
3 days a week in office
201-500 employees
Company mission
To remove distributed systems expertise from the critical path of realizing the business potential of AI.
Role
Who you are
- Master’s degree with at least 3+ years of experience, or Ph.D. in a relevant field
- Strong technical skills, with a keen eye for API design and a deep understanding of LLM architecture, training, and inference
- Had hands on experience on at least one of the following topics:
- Training: LLM Pretraining, LLM fine-tuning, RLHF, distillation, parameter-efficient methods like LoRA, quantization, etc
- Inference: Building inference engine / server, Writing optimized kernels, inference + training co-optimizations (speculative decoding), etc
- Have experience with observability, monitoring, debugging, and measuring success for LLM training / inference systems
- Excellent technical writing skills, with the ability to create clear, concise, and engaging documentation for various audiences
- Proactive and self-driven, with a strong sense of ownership over the systems you work on
- Adaptable to the ever-changing startup environment, embracing pivots and new challenges
- Strong problem-solving skills and the ability to thrive in a collaborative environment
What the job involves
- We are seeking exceptional AI/ML Engineers to join our hybrid research and product development team
- In this role, you will collaborate closely with cross-functional teams to expand the usability of open source LLMs within Anyscale’s ecosystem for enterprise applications
- You will have the opportunity to experiment directly with models, build features for fine-tuning and inference, and work hand-in-hand with customers to push the boundaries of their LLM use cases on our AI platform
- Design, develop, and deploy cutting-edge AI/ML solutions for enterprise applications, making it easy and self-sufficient for customers to adopt AI in their applications
- Contribute to the development of features and enhancements for fine-tuning and inference of LLMs, ensuring a clear value proposition, elegant API design, and intuitive user experience
- Collaborate with customers to understand their needs, help them grow their use cases on our platform, and enable them to achieve their desired outcomes
- Conduct experiments and research to push the practical boundaries of open source LLMs within Anyscale’s ecosystem
- Continuously improve the performance, scalability, and usability of our AI platform, adopting a full-stack approach to deliver value for LLM platform features
- Create top-notch technical documentation, including design docs for internal discussions, engineering docs and tutorials for customers, and compelling data-driven case studies for marketing purposes
- Drive influence through meetings, mentorship, collaboration, and other non-coding activities
Our take
AnyScale is a platform facilitating the development of distributed applications with high computing demands on its Ray platform. It answers an increasing requirement for higher-level tech strategies among companies which are incorporating AI and machine learning into their products, and a similarly broad and growing demand for easier access to cloud programming.
AnyScale launched its first commercial offering in 2021, and intends to continue developing products that will lower the skill and resource threshold for cloud programming. In 2023 it released Aviary, a project to simplify open-source large language model (LLM) deployment. What is promising, and lucrative, about its proposition is that it offers a general-use distributed system, this sidesteps the cumbersome process of stitching together disparate distributed systems, previously a requirement for novel applications. It is currently finding use in a range of applications such as supply chain, environmental restoration and retail by organisations including Amazon and Uber.
Anyscape has raised considerable funding led by Andreessen Horowitz and Addition. This is being used to scale its team and further develop the Ray platform. As the demand for AI apps rapidly increases, Anyscape is poised to disrupt a $13 trillion market.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 4 rounds)
Aug 2022
$99m
SERIES C
Dec 2021
$100m
SERIES C
Total funding: $259.6m
Company benefits
- We offer a wide range of health, dental, and vision coverage options for you and your family — including many that are 99% covered by Anyscale
- Whether you’re hopping on public transit or driving in yourself, Anyscale covers a portion of your commuting costs each month
- Lunch is served every day in our San Francisco office. Dinner, too, if you’re ever working late. And did we mention daily boba runs?
- Give back to the causes and communities you love with paid time off specifically for volunteer work
- Anyscalers can take advantage of 12 weeks of paid leave following the arrival of a new little one
- Paid time off at Anyscale is flexible and unlimited. We encourage all Anyscalers to rest up and recharge when needed
Company values
- Openness: Anyscale values transparency and honesty, fostering an open culture that encourages communication and feedback
- Empowerment: Anyscale empowers its employees to take ownership of their work and make decisions that drive the company's success
- Inclusivity: Anyscale is committed to creating a diverse and inclusive workplace, where everyone feels valued and respected
- Continuous learning: Anyscale encourages continuous learning and growth, providing opportunities for employees to develop their skills and advance their careers
Company HQ
Yerba Buena, San Francisco, CA
Articles
Leadership
Robert Nishihara
(CEO)Former research intern at Facebook and Software engineer intern at Google. Phd in Computer Science at Berkley.
Phillip Moritz
(CTO)Former employee at Ambi Robotics with PHD in Computer Science from Berkley.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 19 more jobs at Anyscale