Senior/Staff Machine Learning Engineer, Zoox

• MS or PhD in Computer Science, Machine Learning, or related technical field
• Demonstrated experience training and deploying large language models (LLMs)
• Experience building and maintaining ML training pipelines, including data preprocessing, model training, and evaluation
• Proficiency in Python and ML libraries (PyTorch, NumPy) demonstrated through professional or research projects
• Experience training with large scale datasets (e.g. tens of millions of videos)
• You do not need to match every listed expectation to apply for this position

Desirable

• The Offline Driving Intelligence (ODIN) team at Zoox is leveraging the latest in AI to craft algorithms that understand the world. We leverage large models first offline and we devise a path of impact into our self-driving robot, enabling safe and efficient navigation in complex environments
• As an engineer in the ODIN team, you will develop advanced multimodal large language models that enhance environmental understanding
• You'll develop and fine-tune these models for off-vehicle analysis while working with the onboard team to deliver impact in our robotaxi platform, ensuring they can efficiently identify hazards and interpret driving restrictions with minimal latency
• Working alongside world-class engineers and researchers, you'll leverage premium sensor data and cutting-edge infrastructure to validate your algorithms in real-world conditions, directly impacting productivity, safety and the capability of Zoox's autonomous system
• Lead the development of multimodal large language models that enhance our robotaxis' understanding of complex urban environments
• Design effective model architectures and sophisticated training techniques, leveraging all the inputs from our sensor stack and the overall large scale data we have at Zoox
• Drive end-to-end ML solutions from research to production, utilizing Zoox's extensive data pipelines and infrastructure to improve autonomous driving capabilities
• Collaborate with perception, planning, safety, and systems teams to integrate your models into the vehicle's decision-making pipeline
• Validate and optimize your solutions using real-world driving scenarios, directly contributing to the safety and reliability of Zoox's autonomous system