Lead Data Engineer

About the role

Job Title: Lead Data Engineer

Key Skills: Azure Databricks, Snowflake, DBT, Python, SQL, Terraform, Data Architecture, ETL/ELT, Data Migration, CI/CD, Data Modeling

Experience: 8+ YOE.

Location: Costa Rica, Peru, Colombia, Bolivia

Mode: Remote

We at Coforge are hiring Lead Data Engineer (#22145) with the following skill set.

Key Responsibilities

-

Lead and mentor a team of data engineers, setting technical direction, conducting code reviews, and driving engineering excellence across the data ecosystem.

-

Own the end-to-end architecture, design, and implementation of scalable data platforms, pipelines, and data models, ensuring reliable and production-ready solutions.

-

Define and lead data migration strategies from Snowflake/SSIS to Azure Databricks and DBT, including architecture decisions, cloud integration, data quality, and observability.

-

Drive Infrastructure as Code with Terraform, CI/CD adoption, architectural standards, troubleshooting, and collaboration with data, product, architecture, and business stakeholders.

Required Skills & Qualifications

-

8+ years of Data Engineering experience, including at least 2–3 years in a Lead or Staff-level role.

-

Proven experience owning system design and leading implementations of large-scale data platforms.

-

Strong hands-on expertise with Snowflake, Azure Databricks, DBT, Python, and advanced SQL.

-

Experience with large-scale data transformations involving thousands of DBT models and pipelines processing terabytes of data daily.

-

Deep understanding of data architecture, data modeling, distributed data systems, and ETL/ELT frameworks.

-

Extensive experience with Terraform, Infrastructure as Code, CI/CD pipelines, and Git-based version control.

-

Experience leading cloud-to-cloud data migration projects, preferably from AWS to Azure.

-

Previous experience in insurance or financial services, with knowledge of domains such as claims, policies, underwriting, and risk.

-

Proven experience leading and developing engineering teams, including mentoring, training, and managing different performance levels.

-

Strong problem-solving, architectural decision-making, communication, and stakeholder management skills.

Preferred Skills:

-

Experience implementing data governance, observability, and data quality frameworks.

-

Strong knowledge of security and compliance standards within insurance or financial services.

-

Experience with Kafka, Event Hubs, Delta Live Tables, or other real-time and streaming technologies.