Data Engineer

General Dynamics Information Technology is seeking a Data Engineer to build and sustain the POTFF Enterprise Data and Analytics foundation. The role focuses on acquiring, integrating, and preparing data, engineering scalable ETL/ELT pipelines, and applying data quality, lineage, and governance controls. You will collaborate with the enterprise data science team to deliver analysis-ready datasets and support analytic and AI-enabled use cases.

Key Responsibilities

• Design, implement, and maintain scalable extract-transform-load and extract-load-transform (ETL/ELT) pipelines on Government-furnished technologies (including SQL Server, Databricks, and Apache Spark using PySpark) for batch and scheduled processing and transformations.
• Integrate disparate structured, semi-structured, and unstructured data sources across the POTFF enterprise, including the Government-designated Human Performance System of Record (HPDMS), assessment and wearable data, and other Government-approved systems, to produce curated, analysis-ready datasets.
• Establish data quality controls, validation rules, lineage documentation, and performance tuning to support reliable, reproducible, and secure pipelines; monitor scheduled and orchestrated workloads and resolve pipeline failures.
• Develop and maintain data models, data dictionaries, metadata, and transformation logic in version control, and document data sources, assumptions, and processing steps to support transparency and operational continuity.
• Prepare and curate text and other unstructured data to support Natural Language Processing (NLP) and Large Language Model (LLM) use cases executed by the data science team within Government-approved tools.
• Support integration of curated data products into Government-furnished visualization and low-code tools and deployment of analytic products into operational workflows, including basic MLOps practices where directed by the Government.
• Apply Government data governance, security, and privacy requirements, including DoW Impact Level 5 (IL5), HIPAA, and Privacy Act protocols, and implement data access controls as directed by the Government.
• Work with Government personnel, clinicians, program staff, and the data science team to identify new data sources, improve the quality of data entered into Government systems, and translate analytic requirements into data requirements.
• Provide data engineering expertise and technical guidance to Data Scientists and Senior Data Scientists.

Required Qualifications

• Bachelor’s degree in a quantitative or computing discipline, such as computer science, computer engineering, software engineering, information systems, data science, data engineering, mathematics, statistics, or geospatial science or geoinformatics, with documented coursework or professional application in programming, databases, and quantitative analysis. A candidate without the degree must meet the experience requirement stated under Required Minimum Experience/Skills.
• Minimum of three (3) years of professional experience in data engineering, database development, or data pipeline development. Without the bachelor’s degree, a minimum of five (5) years is required.
• Proficiency in SQL and Python or a comparable data engineering language, demonstrated through professional work experience.
• Experience building and operating data pipelines, including ETL/ELT design, data modeling, data quality checks, reproducible pipeline design, and version control using Git.
• Ability to clearly communicate with analysts and non-technical stakeholders and document technical work for continuity.

Technology Stack

• SQL Server, Databricks, Apache Spark (PySpark), SQL, Python
• Git
• Natural Language Processing (NLP), Large Language Model (LLM)
• Power BI semantic modeling
• Microsoft Power Platform (Power Apps and Power Automate)
• MLOps
• HIPAA, Privacy Act, DoW Impact Level 5 (IL5)

Preferred Experience

• Experience with Palantir Foundry (including ontology development) or a comparable data-integration platform.
• Experience with distributed processing frameworks such as Databricks and Apache Spark (PySpark).
• Familiarity with Power BI semantic modeling and the Microsoft Power Platform (Power Apps and Power Automate).
• Experience deploying analytics or machine-learning models into applications and familiarity with MLOps concepts.
• Experience working in a DoW-authorized cloud environment.
• Experience with human performance, health, clinical, or biomedical data.

Location and Clearance

• Onsite locations: Fort Bragg, North Carolina; Joint Base Lewis-McChord, Washington; Coronado, California
• Clearance level: Top Secret
• Public trust: None listed
• Citizenship: U.S. Citizenship Required
• Travel required: Less than 10%

Employment Type

• Requisition type: Regular

Compensation and Benefits

The likely salary range for this position is $83,927 - $113,549 per year.

• 401K with company match
• Comprehensive health and wellness packages
• Internal mobility team dedicated to helping you own your career
• Professional growth opportunities including paid education and certifications
• Cutting-edge technology you can learn from
• Paid vacation and holidays

Identity Verification Process

• You are expected to be on camera during virtual interviews.
• We reserve the right to take your picture to verify your identity and prevent fraud.
• By proceeding, you authorize the collection, processing, and use of your biometric data for identity verification and security purposes.