Member of Technical Staff, Vision/Language Research

We're hiring a Research Scientist to lead technical efforts at the intersection of vision-language models and robot learning. You will lead an exploratory project on what data a model actually needs in order to reason about and act in the physical world. This is an open question across the field, and the role is largely about finding the answer: studying how frontier models currently fail at embodied tasks, forming hypotheses about which kinds of structured annotations on egocentric video would close those gaps, prototyping them on our data, and running experiments that show whether they help.

The ideal candidate has a research background in representation learning, and some of the following: vision, robotics, and language models.

• Develop and evaluate representations that bridge visual perception, language, and low-level robot action conditioned on different modalities Collaborate directly with partner labs to define data requirements and close the loop between data quality and downstream policy performance