Senior AI Data Pipeline Engineer (Autonomous Driving)
42dot, Sunnyvale
What you will do
- Develop high scale, reliable data extraction pipeline to extract millions of raw data from data collection fleet and convert to high-value scene data
- Develop data labeling pipelines to perform the auto labeling inferences for autonomous driving algorithms
- Develop advanced autonomous driving data SDK, including scene data search, datasets preparation, dataset loading, etc.
- Build up the data lakehouse for autonomous driving scene dataset, including the sensor data, calibration data, as well as annotation data
- Dig into performance bottlenecks all along the data processing pipelines, from data processing latency, data search latency to Test Procedure (TP) coverage.
- Bootstrap and maintain infrastructure for data platform components—data processing pipeline, database, data lakehouse and data serving.
- Collaborate with cross-functional teams, including ML algorithm, ML application, and Cloud Infra to align data pipelines with overall autonomous driving system architecture.