Member of Technical Staff - Pre-Training Data
Reflection, San Francisco, CA
What you will do
- Design and implement techniques for sourcing, curating, and filtering large-scale web, text, and code data, with opportunities to extend into other modalities as our models evolve.
- Develop data quality metrics and analyses that measure coverage, diversity, and representativeness across sources.
- Join the pre-training research team to design and run data experiments, working with infrastructure teams to scale the supporting data systems efficiently and reproducibly
- Investigate and mitigate data risks, including privacy, safety, and licensing concerns, to support responsible and ethical data use.
- Evaluate dataset changes through ablations and scaling experiments, tracing their downstream effects on model learning and behavior.
- Publish and present research, and share code, datasets, and insights that move the open AI community forward.