Agent Evaluation & Evolution Researcher Graduate (AML-Ark-US) - 2027 Start (PhD)
ByteDance, San Jose, California
The role
We are looking for talented individuals to join our team. As a graduate, you will get opportunities to pursue bold ideas, tackle complex challenges, and unlock limitless growth. Successful candidates must be able to commit to an onboarding date by the end of the year. Please state your availability and graduation date clearly in your resume.
What you will do
- Design evaluation systems for LLM-based agents, covering task success, tool use, reasoning quality, and reliability.
- Build benchmarks and automated judging pipelines, combining rule-based checks, model-based judging, and human review, etc.
- Analyze agent execution traces and user feedback to identify failure patterns and turn them into concrete system improvements.
- Support the closed loop from experience to capability, and work with research, platform, and product teams to bring methods into production.