The Senior Data Engineer leads data engineering initiatives for high-priority government programs, designing data pipelines and architectures in a hybrid work setup at Fort Bragg, NC.
Responsibilities
- Design, develop, and implement data pipelines and ETL processes using Python, Airflow, and NiFi as required to ensure secure and efficient data handling.
- Build scalable microservices for data ingestion and transformation capable of processing large data volumes.
- Curate, cleanse, and secure data to enable accurate transfers across multiple classification levels.
- Develop solutions supporting both batch and streaming data processing.
- Interface data pipelines with data lakes, data warehouses, and databases to improve accessibility and efficiency.
- Collaborate with cross-functional teams to meet mission-critical data requirements.
- Adhere to data handling best practices and security requirements when working with classified datasets.
- Apply data visualization techniques to render data insights actionable for mission teams.
Requirements
- Proficiency in Python and regular expression scripting.
- SQL experience with PostgreSQL and T-SQL preferred.
- Git for version control and Docker for containerization.
- Familiarity with Trino, Kubernetes, and Helm charts; experience deploying in Kubernetes with Argo.
- Airflow and NiFi for workflow orchestration; Elasticsearch and AWS OpenSearch for search and analytics.
- Comfort working in a Linux environment and optimizing database performance.
- Familiarity with graph databases.
- Education: Bachelor’s degree.
Technologies
- Python
- Airflow
- NiFi
- PostgreSQL
- TSQL
- Git
- Docker
- Trino
- Kubernetes
- Helm charts
- Argo
- Elasticsearch
- AWS OpenSearch
- Linux
- Databricks
- Snowflake
- AWS
- GCP
- Graph database management familiarity
Benefits
- Growth: AI-powered career tool that identifies career steps and learning opportunities
- Support: An internal mobility team focused on helping you achieve your career goals
- Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay and paid time off
- Community: Award-winning culture of innovation and a military-friendly workplace
Work Requirements
- Experience: 8+ years of related experience
- Note: May vary based on technical training, certification(s), or degree
- Certifications: Not specified
- Travel: None required
- Citizenship: U.S. Citizenship Required
- Education: Bachelor’s degree
Salary and Benefits Information
The likely salary range for this position is $111,350 to $150,650 per year. This range is not a guaranteed figure and may be adjusted based on experience, geographic location, and contractual considerations. Additional details about benefits and the total rewards program are available.
Identity Verification
As part of the hiring process, candidates may be asked to complete an identity verification process that leverages biometrics and artificial intelligence to verify authenticity and prevent identity fraud. Interviews may be conducted on camera, and images may be captured for verification purposes. By proceeding, you authorize the collection, processing, and use of biometric data for identity verification and security purposes.
About Our Work
We are GDIT. A global technology and professional services company delivering technology and mission services to every major agency across the U.S. government, defense and intelligence community. Our 26,000 experts extract the power of technology to create immediate value and deliver solutions at the edge of innovation. We operate across over 50 countries worldwide, offering leading capabilities in digital modernization, AI/ML, cloud, cyber and application development.
