Member of Technical Staff, Frontier Evals

You'll define how frontier AI models are measured. You'll design new benchmarks, run experiments, analyze model behavior, and build evaluation methodologies that become trusted signals for the industry. Your work will shape our public leaderboards and the evaluation tools we share with frontier labs.

Here’s an example of a piece of industry-leading work done in this field. This is a SOTA STS benchmark, advised by OpenAI: https://audioarena.ai/. Email us for the pre-print.

• Your work will be tracked and followed by the likes of Elon Musk https://x.com/elonmusk/status/2019164163906629852, Mark Zuckerberg https://x.com/DesignArena/status/2079665987977404460?s=20, Alexandr Wang https://x.com/alexandr_wang/status/2079707328287547723, Demis Hassabis, Andrew Ng, Amjad Massad https://x.com/amasad/status/2013329269812834678, and more
• Design genuinely hard and useful evaluations that measure frontier model performance on real-world tasks, and that become industry-leading gold-standards