Pre-training Research Engineer
Sciforium, San Francisco, CA
About the job
Sciforium is an AI infrastructure company developing next-generation multimodal AI models and a proprietary, high-efficiency serving platform. Backed by multi-million-dollar funding and direct sponsorship from AMD with hands-on support from AMD engineers the team is scaling rapidly to build the full stack powering frontier AI models and real-time applications.
About the role
As a Pre-training Research Engineer, you’ll focus on model implementation, pertaining and scaling, and improving the quality of our byte-native and multimodal foundation models. You’ll build and iterate quickly on research ideas, contribute production-grade training code and infrastructure, and help deliver high-quality base models that can serve real-world use cases at scale.
Key responsibilities
Pre-training & scaling
- Train large byte-native and multimodal foundation models across massive, heterogeneous corpora.
- Implement and evaluate new model architectures, training objectives, and optimization methods.
- Develop stable pre-training recipes and run scaling experiments for novel architectures.