Data Engineer
Matterworks, Inc., Somerville, MA (Hybrid)
What you will do
- Build and Operate Pipelines: Own well-scoped pipelines end to end: designed, tested, instrumented, documented, and running on a schedule.
- Labels and Enrichment: Turn raw data into datasets people can actually use, with consistent schemas, trustworthy metadata, and documented definitions.
- Data Quality Checks: Design, build and extend our quality checks so that each build gets compared against the last one before it publishes, and a failure stops the pipeline instead of shipping.
- Ingest and Acquisition: Bring new public and partner datasets into the platform: fetching, converting, validating, and reconciling them against what we already hold. Expect messy scientific and vendor formats and file that require continuous improvements to our systems to handle at scale.
What you need
- 2+ years of professional experience building data pipelines in production.