AI Engineer – LLM Data
Institute of Foundation Models, Abu Dhabi
The role
As an AI Engineer specializing in LLM data, you will build and improve high-quality training data for foundation models across pre-training, mid-training, and post-training. Your work will include large-scale data curation and processing, LLM-based data synthesis, data quality evaluation, and experimentation to understand how different data choices affect model performance.
What you will do
- Build, curate, and improve large-scale datasets for LLM pre-training, mid-training, and post-training.
- Rapidly support time-sensitive data and model development tasks in a fast-moving research environment.
- Develop and improve data processing pipelines including data extraction, cleaning, filtering, deduplication, quality scoring, transformation, and dataset composition.
- Design and implement LLM-based data synthesis and augmentation pipelines, including prompt-based generation, filtering, refinement, and quality control of synthetic data.