Senior Research Engineer - Enterprise Products
NVIDIA, US, WA, Remote +2
What you will do
- Design and evaluate routing policies for LLM traffic to best use mixture of model systems.
- Build and run agentic benchmarks (e.g., Terminal-Bench ) to measure algorithm quality, and turn results into calibration data and routing profiles
- Ship to an open-source repo: design docs, code review, docs, and community contributions
- Collaborating with engineering teams across all of NVIDIA to ensure our software integrates seamlessly up and down the NVIDIA accelerated serving stack.
What you need
- Bachelor's of Master's degree in Computer Science or equivalent experience.
- 8+ years of industry experience in Deep Learning frameworks (PyTorch or TensorFlow).
- Experience designing or running LLM evaluations/benchmarks — ideally agentic ones — and drawing statistically sound conclusions from them