HPC/ML Infrastructure Engineer
Spellbrush, San Francisco or Tokyo
About the job
[https://app.ashbyhq.com/api/images/user-content/89c1442c-bd9c-46be-a910-20b49b5d9ffc/7832bc0a-28e2-4339-a413-1e13b747c3b5/hpc-admin-wide.png]
We’re looking for an experienced HPC infrastructure engineer to lead bringup, administration, and operations on is probably the largest anime AI training cluster in the world. You’ll serve as the bridge between our researchers and the bare GPU machines, helping to make sure that SLURM jobs are running, parallel filesystems are serving, network is transmitting, and that the anime models are training.
You may be a good fit if
YOU LOVE ANIME AND THE ANIME AESTHETIC.
This probably one of the only jobs in the world where you will get to combine your love of anime and large-scale GPU systems.
You’re familiar with the modern hpc software landscape
Once upon a time, our team could install SLURM on a few bare metal nodes and get away with it. Now the landscape has become unbelievable complex, with SLURM deploys through Slinky on K8s, provisioning through warewulf/MAAS/ansible, filesystems through WEKA/VAST/Ceph, VPN and access through tailscale, and monitoring via the Grafana/Prometheus stack. We’re looking for someone with relevant experience up and down the stack (and maybe a papercut or two to show for it!)