Senior Data Engineer
Health-eCommerce.com, United States +1
About the job
About the Role
We are seeking an experienced Senior Data Engineer to join our growing Data & Analytics team. This role will be responsible for designing, developing and maintaining scalable data pipelines and infrastructure to support our organization’s data needs.
Specific Responsibilities
- Design, develop, and maintain robust data pipelines and infrastructure to support data integration, processing, and storage
- Collaborate with analysts and other stakeholders to understand data requirements and translate them into technical solutions
- Implement best practices for data governance, security, and quality assurance to ensure the reliability and accuracy of data
- Explore and evaluate new technologies and tools to enhance our data infrastructure and capabilities
- Design and implement complex data models on Azure Synapse Analytics to support data warehousing Utilize Azure DevOps for continuous integration, continuous delivery, and agile project management.
- Manage and optimize Apache Spark pools for high-performance data processing tasks.