Research Engineer Intern
Pluralis Research, Australia
About the job
Pluralis Research works on Protocol Learning: training and serving large models in a fully decentralized way on small consumer-grade devices connected via the internet. Despite being dismissed as infeasible, we have made significant advances on this problem, most recently Agora, a permissionless run that pretrained an 8B model from scratch on consumer GPUs spread over the internet, with no single participant ever holding the full weights (tech report https://arxiv.org/abs/2607.13332). While many of the core research problems have been solved, Protocol Learning unlocks a series of new challenges. For the mission in full, read A Third Path: Protocol Learning https://pluralis.ai/blog/a-third-path-protocol-learning/.
As a Research Engineer Intern you'll work on Agora, our production decentralized training system, alongside the engineers running real multi-node training at scale. Intern projects are well-scoped pieces of our live roadmap, not side experiments: you'll ship real work in week one and own a genuine open problem by the end of your internship.
Key responsibilities
- Ship a roadmap project: Design, build, and ship a well-scoped project on the Agora roadmap, with a final presentation to the engineering and research teams.