Member of Technical Staff - Foundation Model Architecture & AI Infrastructure
Vinci, Palo Alto HQ
What you will do
This role is about AI architecture and systems engineering - not low-level GPU kernel work. You will help define and scale the core operator intelligence layer.
Evolve the Foundation Architecture
- Design and refine transformer variants for structured spatial domains
- Explore sparse and locality-aware attention mechanisms
- Build hierarchical attention across multi-resolution fields
- Develop graph-transformer systems for multi-entity interactions
- Improve modeling depth across nonlinear operator regimes
This is architectural ownership.
Scale Training & Continuous Learning
- Expand distributed training beyond 45TB-scale datasets
- Improve generalization across heterogeneous operator distributions
- Design scalable data and curriculum strategies
- Maintain reproducibility and determinism across distributed systems