Data Platform Engineer
QED.ai, Warsaw
About the job
QED (https://qed.ai) is a tech company focused on public health and food security in Sub-Saharan Africa. We build the digital infrastructure and AI used at the intersection of aid and scientific inquiry, including surveillance of HIV/malaria/TB, and nutrient analysis of crops and soils, working at national-scale in several African countries. Our funding comes from multiple philanthropic and governmental organizations, including the Global Fund, Gates Foundation, and the CDC.
We are looking for a mid/senior Data Platform Engineer (backend) to join our team in Warsaw. Desired skills include:
- experience designing and maintaining data pipelines using ETL and/or ELT approaches, with the ability to reason about trade-offs rather than defaulting to a single pattern
- understanding of data pipeline reliability concepts, including idempotency, backfills, and handling late or corrected data
- ability to structure data systems into clear layers (e.g. raw, cleaned, curated) and reason about their different purposes and guarantees
- experience deciding between batch, micro-batch, and streaming approaches based on latency, correctness, and operational complexity
- strong background in software engineering, version control, writing readable code and tests, robust design, and basic data structures and algorithms