AI Engineer – AI Agents (Healthcare)
100MS, Bengaluru
The role
We’re looking for an AI Engineer to help us design, evaluate, and scale our next generation of LLM-powered agents. This role is deeply technical, but also product and customer-oriented: you’ll build datasets, run evaluations, improve model performance, and ensure our agents deliver real value in real workflows.
As an AI Engineer, you’ll work across Engineering, Product, and Customer teams to continuously improve our agent quality, reliability, and speed. You won’t just build agents — you’ll build the systems, metrics, and feedback loops that make those agents better over time.
What you will do
- Build, curate, and maintain agentic workflows along with datasets for training and evaluation.
- Run systematic LLM evaluations, track regressions, and ensure models meet quality bars.
- Define and implement LLM performance metrics(e.g., correctness, latency, hallucination control, safety).
- Work closely with Product and Customer-facing teams, experiment with prompting techniques, fine-tuning datasets, retrieval strategies, and model configurations and ensure agent behaviour aligns with user expectations.