Member of Technical Staff — Data Ingestion & Quality
Causal Labs, San Francisco +1
What you will do
Your mission is to own every dataset end to end — from discovering the source and securing access, to writing the pipelines that ingest it, to guaranteeing it enters training clean, standardized, and correct.
- Research and source new modalities of multimodal physical data (e.g. sparse sensors, point clouds, hyperspectral imagery, radar), and secure access through partnerships, vendors, and public archives
- Build petabyte-scale data pipelines (e.g. Apache Spark) that ingest each source into our storage in standardized, training-ready form, across both batch and streaming — including the orchestration, storage, and monitoring they need where shared platform infrastructure doesn't yet exist
- Develop quality metrics that measure coverage, correctness, and consistency across sources — and catch the subtle inconsistencies (sensor bias, drift, processing artifacts) that silently degrade models
- Design and implement automated QA checks that continuously measure and monitor data quality over time, and own the verdicts they produce