Data Engineer (FedD024)
Defense Unicorns, United States - Remote
About the job
EMPLOYER IS A CONTRACTOR FOR THE U.S. GOVERNMENT. THIS POSITION WILL REQUIRE U.S. CITIZENSHIP.
RESPONSIBILITIES:
- Designing data workflows, pipelines, and pathways to support ETL/ELT, while ensuring data-quality and exchange of sensitive information across AWS cloud and on-prem environments.
- Implementing systems engineering principles to ensure the reliability, scalability, and maintainability of data layer systems, including backup and recovery strategies
- Architecting, deploying, and operating data streaming technologies (Kafka, Redpanda, Kinesis, etc ) on Kubernetes with an emphasis on declarative definitions to reduce complexity in day-2 operations
- Working with a platform team to implement best practices for configuration management, security, and performance optimization within Kubernetes and AWS environments
- Working with a platform team to automate infrastructure provisioning, monitoring, and scaling using tools such as Terraform working with cybersecurity SMEs to incorporate best practices and techniques to defend our data layer against potential threats