Senior Machine Learning Engineer
Ambience Healthcare, San Francisco
The role
As a Senior Machine Learning Engineer at Ambience, you will build and improve the AI systems that power our clinical products. You’ll own complex projects end-to-end, from diagnosing production failures and designing evaluations to building, deploying, and iterating on model and agentic systems. This is a highly hands-on role with significant technical ownership. You’ll work closely with clinicians, product managers, and fellow engineers to translate cutting-edge research into reliable, production-grade AI systems.
Our engineering roles are hybrid – working onsite at our San Francisco office three days per week.
What you will do
- Build Trustworthy AI Evaluation Systems: Design and own evaluation pipelines for LLM and agentic systems, combining automated graders, regression testing, production feedback, and human evaluation to measure real product quality.