Senior Data Software Engineer

About the role

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Software Engineer based in Brazil.

We are looking for an experienced Senior Data Software Engineer to design and build scalable, reliable data solutions that support critical business decisions. In this role, you will develop and maintain data pipelines, ingestion processes, and data workflows across multiple source systems. You will work with modern data engineering technologies, including PySpark, Spark SQL, Delta Lake, and Databricks ecosystem tools. Collaborating with cross-functional and international teams, you will translate business data requirements into robust technical solutions. You will also contribute to data quality, system reliability, and continuous improvements in engineering standards. This opportunity offers exposure to international projects, a collaborative engineering environment, and ongoing professional development.

Accountabilities: -

Design, develop, and maintain scalable data pipelines that enable reliable data movement across multiple systems.

-

Build and manage data ingestion processes from a variety of source systems.

-

Write clean, efficient, maintainable, and well-tested code in accordance with established software engineering practices.

-

Collaborate with cross-functional teams to understand data requirements and translate them into effective technical solutions.

-

Monitor data pipeline performance and proactively identify and resolve issues to maintain system reliability.

-

Participate in code reviews, uphold engineering quality standards, and share technical knowledge with colleagues.

-

Troubleshoot data quality issues and ensure accuracy, consistency, and reliability across datasets.

-

Contribute to the continuous improvement of data architecture, engineering practices, and development standards.

-

Document technical processes, solutions, and workflows to support knowledge sharing and team onboarding.

-

Participate in agile development activities, including sprint planning and other team ceremonies.

Requirements:

-

At least 3 years of relevant professional experience in data engineering or a related software engineering field.

-

Strong hands-on experience with PySpark and Spark SQL for building and processing large-scale data workflows.

-

Experience building and managing Lakeflow pipelines and Jobs for data orchestration.

-

Proficiency with Auto Loader and JDBC/CDC ingestion methods, working with source systems such as DB2 and SQL Server.

-

Solid experience with Delta Lake and Unity Catalog for data storage, management, and governance.