Research Scientist – Full Body Motion

Our recording rigs are egocentric: a head-mounted stereo or mono camera, sometimes with body-worn sensors, plus a smaller multi-camera ego-exo volume that gives us triangulated ground truth. From the wearer's point of view the hands and forearms are almost always visible, the torso partly, the legs and feet rarely. Today our pipeline fits Meta's Momentum Human Rig (MHR) to the hands, the upper-body keypoints and the metric camera trajectory, and places the result in the world.

The lower body is inferred, the feet are an ankle-plus-offset pushed onto an assumed flat floor, and contact is a check that removes frames rather than a property of the estimate.

You will build the model that replaces that. The evidence you can condition on: the metric camera trajectory, hand and wrist poses, upper-body keypoints, 2D detections of whatever leg is in frame, and, in the ego-exo volume, full-body ground truth. The output we need: a full-body pose per frame in one metric world frame, on MHR / SOMA-X, that stands on the floor it is standing on, does not slide or sink, kneels and lies down when the wearer does — floor yoga is a real case — and reports per-frame contact with calibrated confidence.