Senior/Staff Machine Learning Engineer, Nuro

• Bachelor's or Master's Degree in Computer Science, Engineering, or a related field
• Extensive experience with AI models, including but not limited to LLMs
• Strong understanding of retrieval-augmented generation (RAG) and Language Models (LLMs)
• Ability to self-motivate, undertake complex assignments independently, and while enjoying to balance innovative exploration with practical considerations

Desirable

• We are looking for an experienced, goal-oriented Machine Learning Engineer to lead our GenAI-assisted GPU kernel optimizations project delivery
• This project stands to serve the dual objectives of improving maximum flop utilization and reducing inference latency, to surpass human-engineered performance through the application of advanced AI technologies
• Implement AI-driven methods for GPU kernel optimizations to enhance program efficiency and performance leveraging tools such as CompilerGym, KernelLLM, etc
• Develop strategies for resource-efficient deployment of intelligent optimization processes using frameworks such as AutoFDO
• Guide high-level optimizations that include both highly optimized kernels, as well as AI-driven neural architecture search (NAS) to optimize training efficiency and inference latency
• Assess performance improvements via evaluation metrics and real-world feedback
• Collaborate with internal teams to benchmark processes and strategies for future AI-assisted optimizations
• Utilize state-of-the-art leaderboard scoring systems to test the ability of different AI models to generate efficient GPU kernels
• Stay current with industry advances