Data Engineer - Active TS/SCI
Job Description
Senior Data Engineer with an active TS/SCI clearance, onsite in Washington, DC, responsible for designing and delivering data governance, pipelines, and information systems in a government context, with AWS integration and collaboration with product teams. Salary range USD 119,000 to 161,000 per year.
Responsibilities
- Identify and implement internal process improvements, including restructuring infrastructure to improve scalability, optimizing data delivery, and automating manual tasks.
- Build and architect end-to-end data pipelines to support comprehensive solutions.
- Create and maintain artifacts such as schemas, data dictionaries, and ETL transforms.
- Integrate data pipelines with AWS cloud services to drive actionable insights.
- Collaborate with stakeholders to address data infrastructure needs and troubleshoot data-related technical issues.
- Design and implement robust data flows to handle raw data and target datasets.
- Provide Tier 3 support for deployed applications and data flows.
- Define and communicate a product vision for client software products, aligned with user needs and business objectives.
- Create and maintain product roadmaps balancing innovation with growth goals.
- Collaborate with a government product owner and a product team of seven to eight full-time equivalents.
- Work with the data engineering team to design and deploy new features.
- Coordinate and document data flows and capabilities.
- Provide occasional off-hours deployment support, including evenings or weekends.
Requirements
- 5+ years of experience in data engineering or a related field.
- Bachelor’s degree or equivalent practical experience.
- Expertise with distributed computing frameworks for large-scale data processing.
- Experience with AWS or other cloud platforms.
- Hands-on experience with data stores such as PostgreSQL, S3, Redshift, MongoDB or DynamoDB, Redis, Elasticsearch/OpenSearch, and SQL.
- Proficiency in Python with libraries including pandas and PySark, plus NiFi, Airflow, and AWS Lambda or equivalents.
- Working knowledge of Docker, Kubernetes, JMS/SQS, SNS, and Kafka.
- Experience with Linux/Unix server environments.
- Experience working in an Agile development environment.
- Experience publishing and presenting design reports.
- Ability to coordinate with team members to meet milestones and deadlines.
- Familiar with collaboration tools such as Jira and Confluence.
- Ability to obtain and maintain a DHS EOD clearance.
Technologies
- AWS and GovCloud
- PostgreSQL, S3, Redshift, MongoDB, DynamoDB, Redis, Elasticsearch/OpenSearch, SQL
- Python, pandas, PySark
- NiFi, Airflow, AWS Lambda
- Docker, Kubernetes
- JMS, SQS, SNS, Kafka
- Linux, Unix
- Jira, Confluence
- DevOps, object oriented programming languages, scripting
Benefits
- Growth: AI powered career tool identifying career steps and learning opportunities
- Support: Internal mobility team dedicated to helping you reach your goals
- Rewards: Comprehensive benefits and wellness packages, 401K with company match, competitive pay, and paid time off
- Community: Award winning culture of innovation and a military friendly workplace
Work Requirements
- 5+ years of related experience
- May vary based on technical training, certifications, or degree
- Travel: None
- Citizenship: U.S. Citizenship Required