Data Engineer, Mid
Analytics
Apache Airflow
Application Security
Automation
Big Data
Bigdata
Business Intelligence
Cloud
Cloud Infrastructure
Cloud Native
Cloud Platform
Cloud Platforms
Cloud Technology
Container Security
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Visualization
Data Warehouse
Database
Databases
DevOps
Devops Tools
DevSecOps
Digital Marketing
Docker
Engineer
Engineering
ETL
Event Driven Architecture
Facilities Management
Informatica
Information Technology (IT)
Infrastructure As Code
Platform Engineering
Reporting and Analytics
Security
Security Automation
Security Devops
Software Security
Spark
SQL
Stream Processing
Streaming Data
Visual Design
Workflow Orchestration
Job Description
Modernize a U.S. Army program’s ability to capture, preserve, and reuse data from high-value system test events by building secure, organized, searchable storage and processing capabilities.
Responsibilities
- Design and implement reliable data storage and processing capabilities that replace manual file transfers and fragmented local copies with secure, organized, searchable repositories.
- Maintain dataset discoverability, accuracy, and usefulness as deployed software and configurations evolve.
- Partner with software developers, systems engineers, test personnel, and AI/ML practitioners to automate ingestion, quality validation, relevance-based curation, indexing, version tracking, and backup and recovery.
- Preserve data provenance, including test-event context and software-version context, to support performance analysis, government reporting, partner-facing metrics, and model training.
- Establish a foundation for future automated dashboards and controlled data access for authorized stakeholders.
- Implement data ingestion pipelines with validation, relevance-based filtering, logging, alerts, automated retries, and failure recovery.
- Manage data retention and reuse using test-event and source metadata, dataset provenance, software-version traceability, relevance-based curation, automated backups, and recovery testing.
Requirements
- 4+ years of experience in data engineering, database development, or data-platform work supporting software or test environments, including Python, SQL, data transformation, complex queries, Git source control, automated testing, and peer review.
- Experience deploying, configuring, securing, monitoring, tuning, backing up, and troubleshooting locally hosted relational or NoSQL databases, including schema and data modeling, indexing, query optimization, data integrity, and controlled access.
- Experience building and operating scheduled batch or near-real-time ETL/ELT pipelines that ingest from files, APIs, applications, and databases, with validation, relevance-based filtering, logging, alerts, automated retries, and failure recovery.
- Experience managing data retention and reuse using test-event and source metadata, dataset provenance, software-version traceability, relevance-based curation, automated backups, and recovery testing.
- Ability to translate developer, tester, and stakeholder needs into supportable data solutions.
- Secret clearance.
- HS diploma or GED.
Technologies
- Python, SQL, Git
- ETL, ELT
- Redis, PostgreSQL, object storage
- Apache Airflow, Dagster, Prefect
- GitLab, Azure DevOps, Jira
- DVC, lakeFS
- Power BI, Grafana, Tableau
- Linux, Docker, Kafka, Spark
Benefits
- Health, life, disability, financial, and retirement benefits
- Paid leave
- Professional development
- Tuition assistance
- Work-life programs
- Dependent care
- Recognition awards program
- Full-time and part-time employees working at least 20 hours per week on a regular basis are eligible to participate in Booz Allen’s benefit programs
Nice If You Have
- Experience supporting U.S. Army or other DoD software development, testing, evaluation, or sustainment programs, especially with test-event datasets, telemetry, application logs, system performance metrics, or technical reporting.
- Experience with Redis architectures, including data structures, indexing, and persistence, alongside complementary technologies such as PostgreSQL, object storage, or on-premises data platforms for durable, high-performance retrieval.
- Experience preparing reproducible AI/ML training, evaluation, or inference datasets through profiling, labeling, normalization, deduplication, feature preparation, and version tracking.
- Experience supporting Agile or Scrum teams with CI/CD and repeatable deployments, including workflow orchestration tools such as Apache Airflow, Dagster, or Prefect, and planning or release tools such as GitLab, Azure DevOps, or Jira.
- Experience implementing data catalogs, metadata management, data lineage, schema-evolution controls, or dataset versioning using DVC, lakeFS, data contracts, or comparable governance practices.
- Experience building automated performance dashboards and traceable reports with Power BI, Grafana, Tableau, or Python visualization tools, including drill-down links or references to source datasets.
- Experience working in Linux-based, on-premises, restricted, or disconnected environments using Docker or other containers, secure networking, role-based access, audit logging, or controlled remote or API access.
- Experience with event-driven or distributed data processing such as Kafka or Spark.
Clearance
- Applicants selected will be subject to a security investigation and may need to meet eligibility requirements for access to classified information; Secret clearance is required.
Work Model
- Onsite: Work will primarily be performed full-time at a customer facility, with collaboration with colleagues and customers as required by the role.
Identity Statement
- Identity verification will use advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud.
- Interviews and assessments may require being on camera.
- The employer may take your picture to verify identity and prevent fraud.
Candidate AI Usage Policy
- Using AI or other tools to assist with responses during interviews (in-person or virtual) is prohibited unless permission is explicitly provided.
Similar Jobs
G