Member of Technical Staff, Pretraining Data

About the job

Mirendil

Mirendil is a tech-first company focused on solving core bottlenecks that unlock step-change acceleration across science and technology. Our first goal is to democratize frontier AI R&D across scientific disciplines. We are building a frontier AI research company and training our own models end-to-end.

The role

We pretrain our own models and we are scaling to larger models now. Agents handle much of the engineering, but deciding what goes into training still depends on strong human judgment.

You will set the direction for what our models train on and use agents to run the ablations, pipelines, and analyses that test it. You will work closely with the researchers who own architecture and training runs.

What you’ll do

• Work on building data pipelines for pretraining, including repository-scale code and technical documents.
• Get more out of public data through better extraction, filtering, and deduplication of web pages, open-source code, and public datasets.
• Decide the data mixture for each run, and design the ablations and data scaling experiments that justify it.