Senior Data Engineer
Senior
Apache Airflow
Big Data
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Product
Database
Elasticsearch
Engineer
ETL
Nifi
Programming Languages
Pyspark
Reporting and Analytics
Software Development
Spark
SQL
Streaming Data
Workflow Orchestration
Job Description
Kentro is hiring a Senior Data Engineer to help design, build, and operate data pipelines and data products that support USASOC EDAT missions. This role focuses on production engineering work that brings mission and enterprise data together in a common data environment, enabling analysts and decision-makers with reliable, governed datasets.
This position is based in Fayetteville, NC and requires work in classified and air-gapped environments. The work combines pipeline development, data modeling, and operations, with attention to security, lineage, and data quality.
Responsibilities
- Design, build, test, and maintain scalable batch and streaming data pipelines (ETL/ELT) in classified and air-gapped environments.
- Develop transformation logic in Python, SQL, and PySpark to ingest, clean, normalize, and enrich structured and unstructured data.
- Integrate data from mission systems, operational applications, databases, APIs, and file-based sources into enterprise data platforms.
- Design data models, schemas, and entity relationships that support analytics, reporting, and downstream applications.
- Build and publish curated datasets and data products with clear documentation, versioning, and service-level expectations.
- Implement data quality checks, validation, monitoring, and alerting to support pipeline reliability and trusted outputs.
- Establish and maintain data lineage, metadata, and cataloging aligned with data governance policies.
- Apply data security controls, including role-based and attribute-based access, data tagging and labeling, and need-to-know enforcement.
- Automate deployment and operations using CI/CD, version control, and infrastructure-as-code practices.
- Troubleshoot production issues, perform root cause analysis, and optimize pipeline performance and cost.
- Support deployment of analytics and ML/AI workflows into operational systems.
- Collaborate with mission owners, analysts, data scientists, security staff, and system administrators to translate requirements into engineered solutions.
Requirements
- Bachelor’s degree in computer science, data science, information systems, or a related technical field, plus 7 years of relevant experience.
- 8140 compliance in certification/training may substitute for a degree.
- Meets DoD 8140 foundational and residential qualification requirements for the assigned work role, including approved certification, education, or training (trainings include: SecurityX / CASP+, CCSP, Cloud+, CSC, GCLD, GCSA, GSEC).
- 7+ years of professional data engineering experience.
- Strong Python and SQL development skills demonstrated through production pipelines or applications.
- Experience with distributed data processing using PySpark / Apache Spark.
- Experience with relational and non-relational data stores, including data modeling and schema design.
- Experience integrating multiple source systems into a centralized data platform.
- Proficiency in Linux, Git, and CI/CD workflows.
- Working knowledge of data governance, data lineage, and metadata management.
- Active TS/SCI clearance.
- US Citizen.
Technologies
- Python, SQL, PySpark, Apache Spark, ETL/ELT
- CI/CD, infrastructure-as-code, Git
- MSS (Microsoft SQL Server), T-SQL
- Linux, Airflow, NiFi, Kafka
- Elasticsearch/OpenSearch, graph databases, geospatial data
- Docker, Kubernetes, Palantir Foundry, Databricks
- JWICS, SIPRNet
Benefits
- Competitive benefits package including paid time off
- Healthcare benefits
- Supplemental benefits
- 401k with an employer match
- Discount perks
- Rewards
- Education reimbursement for certifications, degrees, or professional development
- Funds for activities (virtual and in-person), including happy hours, holiday events, fitness & wellness events, and annual celebrations
- Charity galas/events
Preferred Qualifications
- Hands-on experience with Microsoft SQL Server (MSS), including T-SQL development and performance tuning.
- Prior work for USASOC, USSOCOM, or another special operations or Army component.
- Experience building and operating data platforms in classified or air-gapped environments (JWICS, SIPRNet).
- Experience with modern data platforms such as Palantir Foundry, Databricks, or comparable (pipelines, ontology/object modeling, application building).
- Experience with pipeline orchestration and streaming tools (e.g., Airflow, NiFi, Kafka).
- Experience with Elasticsearch/OpenSearch, graph databases, or geospatial data.
- Experience with containers and orchestration (Docker, Kubernetes) and infrastructure as code.
- Experience deploying ML/AI models or analytics into operational systems.
- Familiarity with RMF, ATO processes, and secure software development practices.
- Cloud experience in classified or government cloud environments.
Clearance Requirement
- Active TS/SCI clearance
- US Citizen