Research Scientist, Multi-Modal Human Understanding

About the job

Meta is seeking a Research Scientist to advance multi-modal AI technologies for human understanding and synthesis. In this role, you will develop Vision-Language Models (VLMs) and video foundation models that enable machines to perceive, interpret, and generate rich representations of human behavior, expression, and interaction. Your research will span multi-modal reasoning, video understanding, and generative synthesis, enabling more natural and intuitive human-computer interaction at scale.

Responsibilities

Design and implement novel multi-modal architectures that fuse vision, language, and temporal signals for holistic human understanding Develop and train Vision-Language Models (VLMs) for tasks including visual question answering, image-text reasoning, and grounded human-centric understanding Build video foundation models capable of temporal reasoning, action synthesis and long-form video synthesis with applications to human behavior synthesis Research generative synthesis techniques for human-centric content including video generation, motion synthesis, and multi-modal content creation Conduct rigorous experiments to evaluate model performance across diverse benchmarks, analyze failure modes, and iterate on architectures to improve accuracy and generalization Contribute to the full research lifecycle from problem formulation and dataset curation through model development and evaluation