Research Engineer, Infrastructure, Training Systems
Thinking Machines Lab, San Francisco
About the job
About thinking machines
The mission of Thinking Machines is to build AI that extends human will and judgment. We are training frontier models with Inkling, developing Tinker to let people make models their own, and crafting interfaces that broaden human-AI communication. We believe the future worth building is human, and we're hiring people who want to build it.
About the role
Frontier model training depends on systems that can keep large accelerator clusters working efficiently and reliably through runs lasting days or weeks. We’re looking for engineers to build and improve those systems, working closely with researchers on the infrastructure behind large-scale pre-training and mid-training.
The work spans the training stack: dividing models across accelerators, improving numerical and hardware efficiency, coordinating distributed workloads, and recovering from failures without losing valuable training time. You might optimize FP4/FP8 training, implement a parallelism strategy, remove a communication bottleneck, or make a large training workload more reliable.