Senior Software Engineer (Seed Model - Infrastructures - SRE)
ByteDance, Seattle, Washington
About the job
About the Team
The Seed Infrastructures team oversees the distributed training, reinforcement learning framework, high-performance inference, and heterogeneous hardware compilation technologies for AI foundation models.
The Seed Infra SRE team is responsible for the delivery and stability of the compute infrastructure behind Seed's foundation models. We own the reliability of large-scale heterogeneous GPU clusters, the training and inference platforms that run on them, and the capacity, network and storage systems that keep them running. Our work directly determines how fast and how reliably we can train and serve the models.
Responsibilities
- Own the stability of training systems and heterogeneous inference systems for large-scale generative AI workloads (LLM, text-to-image, text-to-video, multimodal understanding); drive deep performance optimization and resolve core issues such as training interruptions, inference latency and throughput bottlenecks.
- Design and iterate a flexible, efficient resource scheduling system; improve scheduling efficiency, resource utilization and scheduling explainability; support fine-grained scheduling and priority management across workload types (training, offline inference, online serving).