Senior Data Engineer

Castalia Systems is seeking a Senior Level Data Engineer to help ensure data is available when it matters most. This role supports the smooth movement, modification, and storage of critical data, while enabling scalable deployment of data pipelines for high-priority national security users. You will collaborate with Software Engineers and Data Scientists to deliver reliable data capabilities in support of national security missions.

Work location: Arlington, VA (hybrid)
Job type: Full-time
Clearance: Active Secret clearance
Citizenship: U.S. Citizen
Compensation: USD 150,000 - 160,000 per year

Benefits and support

• Medical, dental, vision coverage
• 401k matching
• Generous PTO
• Paid holidays
• Professional training opportunities
• Pet insurance

What you’ll do

Develop and maintain data pipeline capabilities that support the availability of critical data through its seamless movement, modification, and storage. Contribute to scalable deployment of data pipelines and support high-priority national security users.

• Design and implement ETL processes to move and transform data reliably
• Support the development and execution of data pipelines in collaboration with Software Engineers and Data Scientists
• Work with platforms and tools including Databricks, Python, and database systems
• Enable data storage and processing patterns using technologies such as Data Lakes and related tools

Requirements

• BS Degree
• 8+ years of professional experience for most opportunities
• Python experience with data manipulation and scripting
• Databricks experience
• Proficiency in designing and implementing ETL data processes
• Experience with at least one relational database, such as PostgreSQL, MySQL, or SQLite
• Experience with Agile SCRUM methodologies

Preferred qualifications

• Familiarity with database design, server management, connection protocols, database normalization, and principles of information theory
• Experience with data cleaning or data organization
• Familiarity with NiFi, SQL, NoSQL, Graph Databases, and Data Lakes
• Familiarity with dashboarding tools similar to Qlik
• Familiarity with cybersecurity with design and implementation of unique data transfer protocols

Tools you may work with

Python, Databricks, ETL, PostgreSQL, MySQL, SQLite, Agile SCRUM, NiFi, SQL, NoSQL, Graph Databases, Data Lakes, Qlik

Schedule and environment

• Onsite: 3-5 days per week
• Environment: Normal office environment
• Travel: As needed

Mission context: Castalia Systems develops and deploys AI and Machine Learning applications that directly support national security missions, empowering 19 key Principal Staff members within the Office of the Undersecretary of Defense (OUSD) and the Intelligence Community.