Research Engineer, Safety Evaluation

About the job

Meta is seeking a Research Engineer to join the Safety Evaluation team within Meta Superintelligence Labs. Our mission is to make the safety of Meta's frontier AI systems measurable — turning ambiguous notions of "safe" into rigorous, defensible metrics that model developers, product teams, and company leadership rely on to make launch decisions. Safety evaluation is the ground truth for every safety claim Meta makes. This role owns that ground truth: designing the evaluations that detect emerging risks in text, image, voice, video, and agentic systems; building the infrastructure that runs them continuously against training checkpoints and production traffic; and setting the technical direction for how safety is measured across Meta's AI portfolio. You will define measurement standards that outlast any single model generation, and your results will directly gate what ships to billions of people.

Responsibilities

Set the technical strategy for safety evaluation across multiple model families and modalities, and drive it to execution across teams Design, implement, and validate novel evaluations for safety-critical behaviors — policy adherence, adversarial robustness, agentic risk, jailbreak resistance, and emerging harm categories — including for capabilities with no established benchmark Build and harden the distributed evaluation platform so that hundreds of evals run reliably and continuously against checkpoints throughout large-scale training runs Own the measurement quality bar: signal-to-noise, statistical power, saturation, contamination, and construct validity — and establish when an eval is trustworthy enough to gate a launch Create, curate, and analyze high-quality safety datasets, including adversarial, borderline, multilingual, and long-tail cases; convert real-world incidents and red-team findings into durable, repeatable safety signals Diagnose anomalous eval results mid-training-run, determine whether the cause is a model change or an infrastructure artifact, and communicate a clear answer under time pressure Own the dashboards and reporting that researchers, product partners, and leadership use to monitor safety during training and post-launch Translate evolving global safety policy and regulatory standards into concrete, testable measurement criteria, partnering with Policy, Legal, and Integrity Influence the roadmaps of partner research and product teams; mentor engineers and researchers and raise the evaluation bar across the org Represent Meta's safety evaluation methodology to internal leadership and, where appropriate, to external audiences and the research community