Senior IT Data Engineer
Job Description
System One is seeking a Senior IT Data Engineer to support the Federal Reserve Board’s Division of Research & Statistics. This contract role focuses on expanding and optimizing data architecture and pipelines, improving data flow and delivery for economic policy and research teams through automated ETL/ELT workflows and scalable data platforms.
Role Overview
The position supports researchers and technical stakeholders by designing and developing data delivery architecture, optimizing data flow and collection, and modernizing the Division’s data architecture to enable next generation data initiatives. The engineer will build reliable integration pipelines, scalable databases, and data processing frameworks, while also performing root cause analysis to improve data and business processes.
Responsibilities
- Expand and optimize data and data pipeline architecture.
- Optimize data flow and collection for economic policy and research teams.
- Design and develop optimal data delivery architecture.
- Support economists and technical experts to ensure effective data delivery architecture.
- Collaborate across multiple teams and systems with data needs.
- Optimize or re-design the R&S division’s data architecture to support next generation data initiatives.
- Design, develop, and automate ETL/ELT workflows and data integration pipelines.
- Build, optimize, and maintain scalable databases, data pipelines, and data processing frameworks.
- Conduct root cause analysis on internal and external data and business processes to address business questions and identify improvement opportunities.
Required Qualifications
- Bachelor’s degree in computer science, Information Technology, Engineering, or a related technical field, plus at least 7 years of related experience; advanced degree preferred.
- Advanced working knowledge of SQL.
- Experience with relational databases including PostgreSQL, Microsoft SQL Server, and MySQL.
- Advanced working knowledge of Python, R, and other scripting languages used for data engineering and analytics.
- Experience with large-scale data systems, including distributed computing, scalable data processing, data storage architecture, and optimization of high-volume data workloads.
- Experience designing, developing, and automating ETL/ELT workflows and data integration pipelines.
- Experience building, optimizing, and maintaining scalable databases, data pipelines, and data processing frameworks.
- Experience with workflow orchestration and pipeline automation tools such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
- Experience migrating workflows and data pipelines between on-premises and cloud environments.
- Experience processing, analyzing, and integrating structured and unstructured data sources.
- Experience developing in Linux environments and using source control platforms such as GitLab and/or GitHub.
- Experience performing root cause analysis on internal and external data and business processes.
- Ability to design and communicate enterprise information architecture at conceptual, logical, and physical levels.
- In-depth experience designing and implementing database, data lake, and enterprise data platform solutions.
- Strong hands-on software engineering experience, including development, testing, and deployment of data applications and services.
- Excellent oral and written communication skills with a strong customer service orientation.
- Exceptional analytical, problem-solving, and troubleshooting skills.
- Understanding of time series data and related analytical and forecasting techniques.
- Experience working in a research environment and/or with economic or financial data.
- Experience with NoSQL and graph database technologies.
- Experience developing, training, deploying, and maintaining machine learning models.
- Working experience with cloud technologies such as AWS, Microsoft Azure, and Snowflake.
- Experience implementing data warehouses utilizing Change Data Capture (CDC) methodologies.
- Experience implementing and maintaining CI/CD pipelines and DataOps platforms.
- Working knowledge of additional programming and scripting languages such as Java, Scala, JavaScript, or Perl.
- US citizenship required per government contact.
- Must be able to obtain Public Trust clearance.
Technologies
- SQL
- PostgreSQL
- Microsoft SQL Server
- MySQL
- Python
- R
- Apache Airflow
- Prefect
- Dagster
- AWS Step Functions
- Linux
- GitLab
- GitHub
- NoSQL
- Graph database technologies
- Machine learning models
- AWS
- Microsoft Azure
- Snowflake
- Change Data Capture (CDC)
- CI/CD pipelines
- DataOps platforms
- Java
- Scala
- JavaScript
- Perl
Compensation and Contract Details
- Job type: Contract
- Contract duration: Multi-Year Contract supporting Federal Reserve Board
- Work arrangement: Washington, DC (onsite)
- Experience required: 7+ years
- Work authorization: Open to W2 and C2C
Benefits
- Health and welfare benefits coverage options including medical, dental, vision
- Spending accounts
- Life insurance
- Voluntary plans
- Participation in a 401(k) plan
Application Deadline
Must apply by: 12pm on July 2nd