Staff Software Engineer, Gustie Assist
Gusto, Inc., Denver, CO - Hybrid +2
What you will do
- Design and build across the Otto platform, including the runtime and agent graph, the tool/action layer, the Rails/GraphQL backend, and the advocate-facing experience, owning a meaningful slice end-to-end
- Expand what the agent can safely do: autonomous, tool-using actions with human-in-the-loop approval, built on a secure, auditable identity and permissions model
- Build the eval and observability systems (LLM-as-judge + deterministic scorers, offline gates and online production monitoring) that let us change the agent in production weekly without regressing correctness or escalation behavior
- Work directly with LLMs, including prompting, tool/function design, retrieval, and the feedback loops that turn real advocate interactions into a better Otto
- Partner closely with Product, Data, Design, and our CX teams to turn advocate and customer pain into shipped capabilities
- Mentor engineers and set the bar for how we build agentic systems responsibly and at scale