Deep Learning Performance Engineer, Anyscale
$170.1-237k
+ Equity
3+ days a week in office
Open-source framework for AI software development
Open for applications
Open-source framework for AI software development
201-500 employees
Open for applications
$170.1-237k
+ Equity
3+ days a week in office
201-500 employees
Company mission
To remove distributed systems expertise from the critical path of realizing the business potential of AI.
Role
Who you are
- Prior experience working on GPUs / CUDA
- Solid understanding of operating systems and/or networking fundamentals and experience in such optimizations
- Familiarity with deep learning and deep learning frameworks (e.g. PyTorch)
Desirable
- ML Systems knowledge
- Experience training deep learning models
- Contributions to deep learning frameworks (PyTorch, TensorFlow)
- Contributions to deep learning compilers (Triton, TVM, MLIR)
- Experience using Ray
What the job involves
- As a Deep Learning Performance Engineer, you will help build systems and optimizations that push the boundaries of performance across cutting edge ML models
- This is an incredibly critical role to Anyscale as it allows us to provide market leading performance and price point for AI infrastructure
- Iterate very quickly with product teams to ship the latest optimizations to Anyscale platform, Anyscale Endpoints, and various open source offerings
- Work closely with research teams on LLM engines like vLLM, TensorRT-LLM
- Follow the latest state-of-the-art in the open source and the research community, implementing and extending best practices
Our take
AnyScale is a platform facilitating the development of distributed applications with high computing demands on its Ray platform. It answers an increasing requirement for higher-level tech strategies among companies which are incorporating AI and machine learning into their products, and a similarly broad and growing demand for easier access to cloud programming.
AnyScale launched its first commercial offering in 2021, and intends to continue developing products that will lower the skill and resource threshold for cloud programming. In 2023 it released Aviary, a project to simplify open-source large language model (LLM) deployment. What is promising, and lucrative, about its proposition is that it offers a general-use distributed system, this sidesteps the cumbersome process of stitching together disparate distributed systems, previously a requirement for novel applications. It is currently finding use in a range of applications such as supply chain, environmental restoration and retail by organisations including Amazon and Uber.
Anyscape has raised considerable funding led by Andreessen Horowitz and Addition. This is being used to scale its team and further develop the Ray platform. As the demand for AI apps rapidly increases, Anyscape is poised to disrupt a $13 trillion market.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 4 rounds)
Aug 2022
$99m
SERIES C
Dec 2021
$100m
SERIES C
Total funding: $259.6m
Company benefits
- We offer a wide range of health, dental, and vision coverage options for you and your family — including many that are 99% covered by Anyscale
- Whether you’re hopping on public transit or driving in yourself, Anyscale covers a portion of your commuting costs each month
- Lunch is served every day in our San Francisco office. Dinner, too, if you’re ever working late. And did we mention daily boba runs?
- Give back to the causes and communities you love with paid time off specifically for volunteer work
- Anyscalers can take advantage of 12 weeks of paid leave following the arrival of a new little one
- Paid time off at Anyscale is flexible and unlimited. We encourage all Anyscalers to rest up and recharge when needed
Company values
- Openness: Anyscale values transparency and honesty, fostering an open culture that encourages communication and feedback
- Empowerment: Anyscale empowers its employees to take ownership of their work and make decisions that drive the company's success
- Inclusivity: Anyscale is committed to creating a diverse and inclusive workplace, where everyone feels valued and respected
- Continuous learning: Anyscale encourages continuous learning and growth, providing opportunities for employees to develop their skills and advance their careers
Company HQ
Yerba Buena, San Francisco, CA
Articles
Leadership
Robert Nishihara
(CEO)Former research intern at Facebook and Software engineer intern at Google. Phd in Computer Science at Berkley.
Phillip Moritz
(CTO)Former employee at Ambi Robotics with PHD in Computer Science from Berkley.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 19 more jobs at Anyscale