Member of Technical Staff — Research Engineering, Evaluation
Causal Labs, San Francisco +1
What you will do
- Design and build a central, reusable evaluation framework that every model and every team runs through
- Implement evaluation pipelines, benchmark suites, and baselines that make model quality measurable and comparable across efforts
- Build the visualization and dashboard tools that turn raw results into shared, actionable understanding for the whole team
- Establish sound statistical methodology for evaluation, so teams can distinguish real improvements from noise
- Partner with research and domain teams to translate what "good" means in each domain into standardized, automated metrics
What you need
We value a relentless approach to problem-solving, rapid execution, and the ability to quickly learn in unfamiliar domains.
- Strong software engineering skills and experience building data or evaluation pipelines at scale
- Experience turning research or model outputs into metrics, benchmarks, and visualizations that teams rely on