Research Engineer, Evals & RL Environments
Nolla Health, New York City
About the job
New York City · Full-time
BUILD THE ENVIRONMENTS THAT TEACH US WHAT HEALTHCARE AI CAN DO—AND WHERE IT NEEDS TO IMPROVE.
At Nolla Health, we’re building AI-powered healthcare. To improve the systems involved in delivering care, we need realistic ways to test them: cases that unfold over time, tools an agent can use, and clear criteria for judging what happens.
We’re looking for a research engineer to build evaluation harnesses, simulated environments, and data pipelines that turn clinical knowledge and appropriately governed data into useful evaluation and training assets.
You’ll work with engineers and clinicians to define tasks, build the systems that run them, and make the results trustworthy. The work will support our own agents and models, with the opportunity to develop benchmarks and environments for external AI teams.
What you'll do
- Build harnesses that run agents through reproducible tasks, capture their actions, and make failures easy to investigate.
- Develop multi-step and multi-visit environments with patient state, clinical tools, and realistic consequences for an agent’s decisions.