MS/PhD Software Engineer, Waymo

• Experience with deep learning concepts and reinforcement learning and reward functions
• Proficient in Python and deep learning frameworks
• Proficiency in dealing with large amount of data
• Currently pursuing a Masters / PhD degree in Computer Science, Machine Learning, Robotics, or related field
• Experience in integrating ML models into complicated systems
• Proficient in PyTorch, JAX, or TensorFlow

Desirable

• As we drive millions of RO miles, we need mechanisms to learn from suboptimal driving
• With this project, you will be building new levers in the ML models to learn from such data
• This involves exploring SOTA fine tuning techniques such as (but not limited to) reinforcement learning
• LoRA base finetuning,contrastive learning, etc, improving Waymo driver's abilities to navigate complex real world scenarios
• Waymo interns partner with leaders in the industry on projects that create impact to the company
• We believe learning is a two-way street: applying your knowledge while providing you with opportunities to expand your skill-set
• Interns are an important part of our culture and our recruiting pipeline
• This role will frame the open-ended real-world problems into well-defined ML problems; apply deep learning, reinforcement learning, imitation learning to these problems
• Develop novel ways to learn from unsupervised driving data. Be able to apply SOTA techniques within Waymo's tooling/infrastructure
• Build data tooling/infrastruction to unblock experimentation
• Use data-driven decision making to evaluate and compare different approaches
• Collaborate closely with partner teams such as perception, research, simulation, and evaluation

• We will accept resumes on a rolling basis until the role is filled