Data Engineer - Open Application

About the role

ABOUT TRUELOGIC

At Truelogic we are a leading provider of nearshore staff augmentation services headquartered in New York. For over two decades, we’ve been delivering top-tier technology solutions to companies of all sizes, from innovative startups to industry leaders, helping them achieve their digital transformation goals.

Our team of 600+ highly skilled tech professionals, based in Latin America, drives digital disruption by partnering with U.S. companies on their most impactful projects. Whether collaborating with Fortune 500 giants or scaling startups, we deliver results that make a difference.

By applying for this position, you’re taking the first step in joining a dynamic team that values your expertise and aspirations. We aim to align your skills with opportunities that foster exceptional career growth and success while contributing to transformative projects that shape the future.

RESPONSIBILITIES

- 5+ years working on the role professionally.

- Coding: - Coding Python and use in data processing solutions and related data technologies like Pandas, and PySpark. - Consume data from different sources like REST APIs.

- Data Stores: - Work with relational and non-relational data stores (like: HBASE, Cassandra or MongoDB; S3, blobs). - Consumption; - Design. - Data Streams (Kafka, Kinesis, Flume,) and message queuing (SQS, SNS, RabbitMQ, etc). - Ensure that the data model scales and enables high performance. - Distributed data stores.

- Processing: - Data/Stream processing (Spark, Flink, Hadoop). - Data pipelines, data ingestion pipelines, scalable streaming data pipelines processing. - ETL using solutions: - Talend; - Informatica; - SQL Server Integration Services (SSIS).

- Reporting & Analytics: - Data warehouse (Snowflake, Redshift, Hive). - Implementation of data warehouse solutions, providing near real-time data to a variety of client systems; - Using SQL databases to construct data storage. - Reporting / BI, design, implementation, and enhancement of BI tool is a plus. - Looker; - Power BI; - Tableau.

- Experience designing and implementing data applications and services on the public cloud, AWS, GCP, or Azure using PaaS platforms.

- Familiarity with data privacy regulations and best practices

IT WILL BE GREAT IF YOU ALSO KNOW

- Experience with Data Visualization tools such as Tableau.

- Data processing architecture like Lambda Architecture.

- Indexing (SolR or ElasticSearch).

- Prior experience converting Jupyter Notebooks into production processes.

- Data pipeline and workflow management tools. - Airflow.

- Data lakes.

WHAT WE OFFER

- 100% Remote Work: Enjoy the freedom to work from the location that helps you thrive. All it takes is a laptop and a reliable internet connection.