ETL Data Engineer
Azure Data Factory
Azure Data Lake
Azure Data Platform
Azure Synapse Analytics
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Factory
Data Factory Azure
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
ETL
Informatica
Information Technology (IT)
Microsoft Azure
Nifi
SQL
Tableau
Job Description
NFF Inc is seeking an experienced ETL Data Engineer to support the Enterprise Data team in delivering reliable data curation, processing, and transformation. This onsite role in Washington, DC focuses on building and maintaining end-to-end ETL pipelines with strong data governance, automation, and monitoring across cloud and on-prem systems.
What you will do
- Analyze, design, develop, implement, replicate, and support complex enterprise data projects across the full ETL lifecycle.
- Gather and document requirements, review existing code, and deliver enhancements or new development for district data systems.
- Partner with other agencies and user departments to advise on system requirements, environment constraints, and operating challenges, then help resolve issues using cloud-based solutions.
- Design and implement ETL pipelines that load data from multiple source systems into landing layers and SQL tables.
- Establish cloud and on-prem connectivity across systems such as ADLS, ADF, Synapse, and Databricks.
- Develop and standardize data workflows and pipelines using best practices, with an emphasis on accuracy, consistency, security, and reliability.
- Automate, monitor, alert, and manage pipeline execution and operational workflows.
- Evaluate system changes for feasibility, provide alternative approaches, and define backup and rollback procedures.
- Create complex database programs and reports using database query language, and support data visualization and reporting where needed.
- Handle and secure sensitive data according to its level of sensitivity.
- Support the development of new systems, upgrades, and enhancements while maintaining approved standards and consistency after changes.
What you bring
- Bachelor’s degree in Information Technology or related field, or equivalent experience.
- 15+ years with ETL process development, including end-to-end pipelines for loading data from multiple sources.
- 15+ years gathering and documenting requirements for extraction, transformation, and loading.
- 15+ years understanding of data warehousing, data lake, business intelligence, and information management concepts and standards.
- 15+ years ability to advise internal and external customers on tools and systems for complex data processing.
- 15+ years knowledge and use of SQL for relational databases.
- 11+ years experience with data formats including Oracle, SQL Server, Postgres, DB2, Quickbase, CSV, XML, Parquet, and AVRO.
- 11+ years contributing to enterprise data governance standards for accuracy, consistency, security, and reliability.
- 7+ years working with Microsoft Azure tools including Azure Data Factory, Synapse, SQL Database, Data Lake Storage Gen2, and Blob Storage.
- Required 5+ years with data integration and pipeline tools such as Informatica PowerCenter, Apache NiFi, Apache Airflow, and FME.
- 5+ years visualization and reporting tools including MicroStrategy, Tableau, and Esri ArcGIS.
- Highly desired 3+ years communication skills (oral and written).
- Required 3+ years providing excellent customer service to external partners.
- Required 3+ years working independently or as part of a larger team.
- Highly desired 3+ years performing data functions with Databricks.
Tools you’ll work with
- Azure Data Factory, Azure Synapse, Databricks
- Informatica, Informatica PowerCenter
- MSSQL Db, Azure SQL DB
- Azure Data Lake Storage Gen2, Blob Storage, ADLS, ADF, Synapse
- Python
- Apache NiFi, Apache Airflow, FME
- Oracle, SQL Server, DB2, Quickbase
- Data formats: CSV, XML, Parquet, AVRO
- SQL and Postgres
- MicroStrategy, Tableau, Esri ArcGIS
Benefits
- Medical, Dental, and Vision
- Health Savings Account
- Flexible Spending Account
- STD, LTD, Supplemental life insurance, and ADD and AD&D
- Comprehensive 401k plan
- Paid Time Off