Researcher, Recursive Self-Improvement Safety
OpenAI, San Francisco +1
The role
Preparedness is hiring strong technical executors to support preparations for accelerated AI development, which may culminate in recursive self-improvement. This work relies on anticipating misalignment risks that might exist in the future, but might not exist now; so it’s especially important that people in this role are tasteful and strategic.
The role is wide-ranging, covering any mitigation for loss of control risk, spanning the design and implementation of better pre-deployment risk-assessment https://openai.com/index/deployment-simulation/, control measures https://openai.com/index/how-we-monitor-internal-coding-agents-misalignment/, RSI-relevant training interventions, and turning one’s technical work into established institutional practices and external-facing communications.
What you will do
- Carefully consider the problems OpenAI might face in the future and how to prepare for them.
- Turn an open-ended objective like “prepare for future misalignment threats” into a much more concrete direction (e.g. “stress-test monitors for scheming”) – prioritizing the work that is most useful to start right now.