Senior ML Platform Engineer (GenAI Platform)
Preply, London
What you will do
What you’ll be doing
GenAI is central to Preply's product strategy. As a Senior ML Platform Engineer, you'll design and build the systems behind production GenAI workloads. You will drive the expansion of our GenAI Platform, and turn recurring engineering needs into reliable self-service capabilities.
This is a hands-on senior role with broad technical influence. You'll write production code, shape platform abstractions and operational standards, and partner with Applied Science, Data, Product, Security and Engineering teams.
In this role, your responsibilities include
- Architect unified gateway with automated routing, quota controls, and resilient fallback systems across model vendors.
- Drive system efficiency and low latency via dynamic traffic management, response caching, token budgeting, and cost allocation controls.
- Establish robust evaluation mechanisms to guarantee high precision, stability, and safety in model outputs.
- Deliver system observability, providing deep tracing, performance telemetry, cost analytics, continuous monitoring, and alerting across GenAI lifecycles.