Software Engineer Architect – AI Agents (Healthcare)
100MS, Bengaluru
What you will do
- Own the end-to-end architecture of the AI agents platform — services, APIs, data models, async task pipelines, LLM/voice agent orchestration, and integrations with payer systems, EMRs, and telephony.
- Design for reliability, latency, and safety: define patterns for fault tolerance, idempotency, retries, observability, and graceful degradation across agent workflows that run at scale in production.
- Set the architecture for multi-tenancy, data isolation, and PHI handling in partnership with our Security and Compliance Lead, keeping HIPAA and SOC 2 requirements designed in rather than bolted on.
- Make and document high-leverage technical decisions — build vs. buy, service boundaries, storage and queueing choices, LLM provider and inference strategy — through lightweight design reviews and ADRs.
- Stay hands-on: prototype critical paths, write production code on the most ambiguous and highest-risk problems, and unblock teams when they hit hard technical walls.
- Partner with the platform team on how workloads run on our Kubernetes (GKE) infrastructure — autoscaling, deployment topology, cost, and SLOs for agent and voice workloads.