Software Engineering Manager, Business AI Agent
Google, Mountain View, California
About the job
Minimum qualifications
- Bachelor’s degree in Computer Science, a related technical field, or
equivalent practical experience.
- 8 years of experience coding in one or more general-purpose programming
languages (e.g., Python, Java, C++, or Go) focused on backend system architecture.
- Experience building automated LLM evaluation pipelines, automated rating
systems (AutoRaters), or defining LLM-specific reliability metrics (e.g., measuring grounding, helpfulness, safety, and hallucination/error reduction).
- Experience with backend, distributed systems, or AI/ML systems
infrastructure.
- Experience managing software engineers, including performance management,
mentoring, and team growth.
Preferred qualifications
- Master's degree or PhD in Computer Science or related technical field.
- 3 years of experience working in a complex, matrixed organization.
- Experience developing, calibrating, and productionizing LLM-based AutoRater
