Data Engineer

About the role

Overview:

The Data Engineer is responsible for developing, maintaining, and supporting data pipelines using Python and SQL Server (T-SQL), while assisting with data integration from internal and external systems within a modern Azure-based data platform. The role supports critical data operations in regulated environments and provides opportunities for hands-on learning and growth under the guidance of senior data engineers.

Job Description:

- Develop and maintain ETL pipelines using Python and SQL Server for data ingestion, transformation, and integration from various data sources, including structured files and RESTful APIs.

- Write, test, and debug Python code for data processing, automation, and basic integrations following established standards and best practices.

- Create and maintain T-SQL queries, views, and stored procedures to support business logic and reporting requirements.

- Assist in building and operating data workflows using Azure Data Factory, Azure SQL, and Azure Blob Storage.

- Support the monitoring of data pipelines and help troubleshoot data quality issues, pipeline failures, and performance problems.

- Follow defined data quality, security, and compliance procedures in regulated environments such as healthcare and financial services.

- Collaborate with data analysts, software engineers, and DevOps teams to understand data requirements and upstream systems.

- Participate in code reviews, implement feedback, and continuously improve coding and engineering practices.

- Create and maintain clear documentation for data pipelines, logic, and operational processes.

Qualifications and Experience:

Education

- Bachelor’s Degree — Preferred

Experience

- 1–4 years of professional experience in Data Engineering, Software Engineering, or a related technical role — Required

- Strong hands-on proficiency in Python, including writing functions, handling errors, and debugging code — Required

- Experience working with relational databases, preferably SQL Server — Required

- Strong working knowledge of SQL, including joins, aggregations, subqueries, and basic performance considerations — Required

- Exposure to integrating or consuming data from RESTful APIs or external data sources — Required

- Familiarity with Git or similar version control systems — Required

- Strong analytical and problem-solving skills with the ability to learn quickly — Required

Preferred Experience

- Experience with additional Azure services such as Azure Synapse, Azure DevOps, and Azure Functions

- Understanding of data modeling and warehousing concepts

- Exposure to cybersecurity data, SIEM tools, or SOC operations

- Knowledge of .NET Framework and C#-based APIs, particularly in data consumption contexts