Research Intern, Pony.ai

• Currently pursuing a Masters or PhD program in Computer Science, Machine Learning, Robotics, or similar field
• Strong background in deep learning, with experience in model design, training and evaluation
• Experience with deep learning research and tools
• Proficiency in software design and development using Python and C++
• Experience working with large-scale datasets, data preprocessing, and pipeline management

Desirable

• Work with experts in the field of self-driving vehicles on designing and developing large-scale foundation models trained on vast amounts of real world data
• Frame the open-ended real-world problems into well-defined ML problems; develop and apply cutting-edge ML approaches (deep learning, reinforcement learning, imitation learning, etc) to these problems; scale them to data pipelines; and streamline them to run in real-time on the cars
• Develop and deploy deep learning models, including vision language models (VLMs) and Large Language Models (LLMs)
• Design and implement multi-modality and multi-task perception models focusing on 3D object detection and tracking, segmentation, semantics understanding, video understanding, scene understanding, traffic control, or trajectory prediction, etc
• Optimize deep learning models to run robustly under tight run-time constraints
• This position is fully onsite in Fremont, at least 3 months