Data Engineer, Senior
Big Data
Bigdata
Code Repositories
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Database
Databases
ETL
Foundry Ecosystem
Informatica
Information Technology (IT)
Pipeline Builder
Programming Language
Programming Languages
Pyspark
SQL
Job Description
Booz Allen Hamilton is seeking a Senior Data Engineer to design, build, and optimize data infrastructure for a Service-level Headquarters organization. In this role, you will support production ETL/ELT workflows and data models in the Palantir Foundry ecosystem, helping teams enable advanced analytics and a common operating picture (COP) from Arlington, VA.
This onsite position centers on handling highly unstructured data, engineering reliable pipelines and ontology-backed models, and ensuring performance and data integrity across cloud and classified compute environments.
Responsibilities
- Architect, build, and maintain scalable ETL/ELT pipelines using Palantir Foundry components such as Pipeline Builder and Code Repositories to ingest and process highly unstructured data sources.
- Design, implement, and optimize the Foundry Ontology to create secure, logically structured data models that support advanced analytics and Activity Based Intelligence (ABI).
- Develop high-performance transformation logic using PySpark, Python, and SQL for distributed, large-scale data processing.
- Partner with data scientists and analysts to operationalize statistical models and custom algorithms in secure production environments.
- Diagnose and resolve system bottlenecks to maintain high performance across both cloud and classified compute environments.
- Create data quality and validation frameworks and implement automated pipeline monitoring to protect the integrity of inputs feeding analytics models.
Requirements
- 5+ years of experience in data engineering or big data.
- Hands-on experience with PySpark, Python, and SQL.
- Experience building complex data pipelines and transformations within distributed platforms such as Palantir Foundry.
- Experience structuring, formatting, and optimizing large-scale datasets for use by engineering teams and mathematical or statistical models.
- Knowledge of distributed systems, data warehousing concepts, and data governance in secure enclaves.
- TS/SCI clearance.
- Bachelor’s degree in Computer Science or Engineering.
Technologies
- Palantir Foundry
- Pipeline Builder
- Code Repositories
- Foundry Ontology
- PySpark, Python, SQL
- AWS, Azure
Nice if You Have
- Experience with AWS, Azure, or similar cloud computing architectures that support large data platforms.
- Experience processing and scaling geospatial datasets for intelligence or operational mapping.
- Experience with CI/CD pipelines and version control best practices.
- Experience with DoW Global Force Management policies and processes.
- Knowledge of mathematical modeling and statistical analysis frameworks.
- Knowledge of DoW institutional datasets such as War Data Platform.
Security and Candidate Requirements
- Selected applicants will be subject to a security investigation and may need to meet eligibility requirements for access to classified information. TS/SCI clearance is required.
- During the hiring process, you will complete an identity verification process that uses advanced biometrics and AI to confirm authenticity and protect against identity fraud.
- You are expected to be on camera during interviews and assessments, and Booz Allen may take your picture to verify your identity.
- Use of AI or other tools to assist with responses during interviews is prohibited unless permission is explicitly provided.
Work Model
- Onsite: work will primarily be performed full-time at a customer facility, with collaboration alongside colleagues and customers as required by the role.
- Employees working virtually are generally expected to have their cameras on during meetings.
Compensation
USD 77,600 - 176,000 per year.
Education
Bachelor’s degree in Computer Science or Engineering.
Benefits
- Health, life, disability, financial, and retirement benefits.
- Paid leave.
- Professional development.
- Tuition assistance.
- Work-life programs.
- Dependent care.
- Recognition awards program.
- Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs.