Backend Engineer - Machine Learning Storage Infra (Singapore)

About the job

The mission of our AML team is to push the next-generation AI infrastructure and recommendation platform for the ads ranking, search ranking, live & e-Commerce ranking in our company. We also drive substantial impact on core businesses of the company.

Responsibilities

• Design and build a unified platform/middleware system that can support diverse business requirements across different scenarios, including low cost, high availability, high throughput, high performance, and large-scale storage capacity.
• Design and optimize complex multi-tier storage architectures beyond GPU memory, CPU memory, and external storage, with a focus on efficient data placement and resource utilization.
• Keep up with the latest advances in software and hardware architectures, and proactively evaluate and experiment with emerging technologies.
• As an internal platform serving multiple teams, plan and optimize the utilization of large volumes of heterogeneous resources across multiple hardware generations, data centers, service tiers, and resource pools. Develop automated and dynamic optimization strategies based on changes in model size, service traffic, and workload characteristics.