Software Engineer, Anyscale
Model Serving Infrastructure
$170.1-237k
Plus equity
3+ days a week in office
Open-source framework for AI software development
Open for applications
Open-source framework for AI software development
201-500 employees
Open for applications
$170.1-237k
Plus equity
3+ days a week in office
201-500 employees
Company mission
To remove distributed systems expertise from the critical path of realizing the business potential of AI.
Role
Who you are
- A solid background in algorithms, data structures, and system design
- Experience working with modern machine learning tooling, including PyTorch, TensorFlow, and JAX
- At least 2+ year of relevant work experience
- Bonus points!
- Experience in building highly available serving systems
Desirable
- Experience in building and maintaining open-source projects
- Experience in building and operating machine learning infrastructure in production
What the job involves
- The Serving Infrastructure team is dedicated to creating world-class systems for serving ML models in production
- This includes building and maintaining the open-source Ray Serve library and contributing directly to the Anyscale platform used by our customers for critical applications
- Our work is often user-facing, allowing you to collaborate with open-source users and customers ranging from lean ML engineering teams at small startups to industry-leading companies such as Uber, Shopify, and ByteDance
- Develop a highly available service for ML model serving
- Enhance Ray Serve and our other libraries to simplify the development of next-generation ML applications in production
- Improve our autoscaling capabilities to drive performance enhancements and cost savings
- Optimize latency and throughput for both single- and multi-model serving scenarios
Our take
AnyScale is a platform facilitating the development of distributed applications with high computing demands on its Ray platform. It answers an increasing requirement for higher-level tech strategies among companies which are incorporating AI and machine learning into their products, and a similarly broad and growing demand for easier access to cloud programming.
AnyScale launched its first commercial offering in 2021, and intends to continue developing products that will lower the skill and resource threshold for cloud programming. In 2023 it released Aviary, a project to simplify open-source large language model (LLM) deployment. What is promising, and lucrative, about its proposition is that it offers a general-use distributed system, this sidesteps the cumbersome process of stitching together disparate distributed systems, previously a requirement for novel applications. It is currently finding use in a range of applications such as supply chain, environmental restoration and retail by organisations including Amazon and Uber.
Anyscape has raised considerable funding led by Andreessen Horowitz and Addition. This is being used to scale its team and further develop the Ray platform. As the demand for AI apps rapidly increases, Anyscape is poised to disrupt a $13 trillion market.
Kirsty
Company Specialist at Welcome to the Jungle
Insights
Company
Funding (last 2 of 4 rounds)
Aug 2022
$99m
SERIES C
Dec 2021
$100m
SERIES C
Total funding: $259.6m
Company benefits
- We offer a wide range of health, dental, and vision coverage options for you and your family — including many that are 99% covered by Anyscale
- Whether you’re hopping on public transit or driving in yourself, Anyscale covers a portion of your commuting costs each month
- Lunch is served every day in our San Francisco office. Dinner, too, if you’re ever working late. And did we mention daily boba runs?
- Give back to the causes and communities you love with paid time off specifically for volunteer work
- Anyscalers can take advantage of 12 weeks of paid leave following the arrival of a new little one
- Paid time off at Anyscale is flexible and unlimited. We encourage all Anyscalers to rest up and recharge when needed
Company values
- Openness: Anyscale values transparency and honesty, fostering an open culture that encourages communication and feedback
- Empowerment: Anyscale empowers its employees to take ownership of their work and make decisions that drive the company's success
- Inclusivity: Anyscale is committed to creating a diverse and inclusive workplace, where everyone feels valued and respected
- Continuous learning: Anyscale encourages continuous learning and growth, providing opportunities for employees to develop their skills and advance their careers
Company HQ
Yerba Buena, San Francisco, CA
Articles
Leadership
Robert Nishihara
(CEO)Former research intern at Facebook and Software engineer intern at Google. Phd in Computer Science at Berkley.
Phillip Moritz
(CTO)Former employee at Ambi Robotics with PHD in Computer Science from Berkley.
Salary benchmarks
We don't have enough data yet to provide salary benchmarks for this role.
Submit your salary to help other candidates with crowdsourced salary estimates.
Share this job
View 20 more jobs at Anyscale