2027 Summer Intern, PhD, Research, RSI for Autonomous Driving
Waymo, Mountain View, CA +1
What you will do
- Literature research of SOTA in RSI, physics AI foundational models, autonomous driving foundational models, World Action models and connect the SOTA to their research projects to improve driver quality
- Design new data and post-training recipe to RL the driver with the critic model and world model in a close loop setup
- Coding and implementing the RSI system
- Inspect training results and ablation studies to iterate the algorithm design
What you need
- Currently pursuing a PhD in Computer Science, Robotics, Machine Learning, or a related quantitative field
- Depth in foundational AI model post-training, especially RL
- Fluency in using AI coding agents, fluency in one of the RL training framework such as Rex, Verl, NeMo-RL
- Fluency in AI model training basics such as transformer architecture, hyperparameter tuning, overfitting debug