Data Engineer - Expert

About the role

Dark Wolf constructs and deploys data management and analytics solutions for the defense and intelligence communities. We’re proud to boast a world-class engineering team that thrives on rolling up their sleeves to solve your mission’s biggest challenges.

Dark Wolf is seeking an Expert Data Engineer to lead the architectural development, scaling, and governance of enterprise-grade data platforms. You will be responsible for designing high-throughput data meshes, establishing automated data quality frameworks, optimizing distributed compute clusters, and ensuring high resilience across air-gapped and multi-cloud networks.

Key Responsibilities

- Lead the architectural design and implementation of distributed, high-throughput batch and streaming data platforms.

- Optimize distributed execution engines (Spark, Trino/Presto) to handle petabyte-scale datasets under strict SLAs.

- Implement Infrastructure as Code (IaC) to provision data platform assets across multi-cloud infrastructure.

- Establish zero-trust security controls, data lineage tools, and automated compliance scanning for regulated data environments.

- Act as a Technical Pod Lead, driving Agile sprint deliverables, establishing technical standards, and mentoring data engineering staff.

Qualifications:

- Clearance: Must be a US Citizen holding an active TS/SCI security clearance with an active Full-Scope Polygraph.

- Education: Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field (Master’s degree preferred).

- Experience: 7-10+ years of data engineering experience.

Technical Competencies:

- Data Processing Frameworks: Expert-level mastery of Apache Spark, Flink, Kafka, Ray, and workflow orchestration engines.

- Database Systems: Deep understanding of distributed systems internals, LSM trees, column-family stores, and lakehouse storage formats (Delta Lake, Apache Iceberg, Apache Hudi).

- Data Modeling: Enterprise data strategy, conceptual-to-physical data modeling, and streaming data schema contracts.

- Programming & Scripting: Mastery of Python, Scala, SQL, and Go for high-performance data platform development.

- Containerization: Advanced Kubernetes cluster management, custom operators for data platforms, and service mesh integration.

- Agile Frameworks: Proven experience acting as a Technical Lead or Scrum Master directing engineering pods.

- Multi-Cloud Architecture: Advanced experience architecting multi-cloud and hybrid cloud data platform solutions (IaC via Terraform).

- Security Scanning Tooling: Deep understanding of DevSecOps pipelines, automated compliance testing, and secret rotation management.

Desired Qualifications:

- Advanced Certifications: AWS Certified Solutions Architect – Professional, CISSP, or Databricks Certified Professional Data Engineer.