Data Engineer, Senior
Job Description
BigBear.ai is seeking a Lead Data Engineer for onsite work in Norfolk, Virginia supporting defense and intelligence operations. In this role, you will build and sustain data pipelines and reporting datasets while enabling analytics applications built on Databricks, Python, Spark, and SQL.
The work spans data engineering, operational reporting, and mission-facing analytics, including Qlik Sense dashboards for users. You will also collaborate with engineering and operations teams on production support, migrations, and upgrades, with a strong emphasis on data quality, governance, and secure access.
What you’ll do
- Develop, maintain, and troubleshoot data pipelines and transformations in Databricks using Python, PySpark, and SQL.
- Clean and validate source data, investigate discrepancies, and deliver datasets for operational reporting and analytics.
- Build and maintain Qlik Sense applications, dashboards, and SQL reports for mission users.
- Manage user access and permissions across data and analytics platforms in alignment with security and data governance requirements.
- Support database upgrades, system migrations, and production troubleshooting in coordination with engineering and operations teams.
- Document data workflows, reporting logic, and support procedures so other team members can maintain them.
- Partner with mission stakeholders to translate operational reporting needs into data products and application improvements.
Required qualifications
- Active TS/SCI clearance with the ability to maintain it.
- Bachelor’s degree in Information Systems, Information Technology, Computer Science, Engineering, or a related field.
- 5+ years of combined experience supporting data or information systems through data engineering, analytics, database administration, or technical systems support.
- Hands-on experience with Databricks, Python, Spark or PySpark, and SQL to transform, validate, or analyze data.
- Experience maintaining data pipelines and developing reports, dashboards, or analytics applications.
- Experience troubleshooting production data or application issues and administering user access in a secure environment.
- Ability to work full time onsite in Norfolk, Virginia.
Technologies
- Databricks
- Python
- Spark and PySpark
- SQL
- Qlik Sense
- AWS
Additional experience that would help
- Experience supporting the Joint Staff, Combatant Commands, or other Department of Defense or intelligence organizations.
- Familiarity with Global Force Management data, systems, or workflows.
- Experience developing and supporting Qlik Sense applications.
- Experience supporting database upgrades, system migrations, or DoD security hardening.
- AWS Certified Cloud Practitioner certification or experience with AWS data services.
- Familiarity with API-based data integration.