Azure Data Engineer
Backend Developer
Python
Analytics
Azure
Azure Data Engineer
Azure Data Factory
Azure Data Lake
Azure Data Platform
Azure DevOps
Big Data
Bigdata
Business Analytics
Business Intelligence
CI/CD
Cloud
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Visualization
Data Warehouse
Database
Databases
Databricks
DevOps
Devops Tools
Digital Marketing
ETL
Informatica
Microsoft
Microsoft Azure
Power BI
Power Platform
Pyspark
Reporting and Analytics
Software Development
Spark
SQL
Visual Design
Job Description
NSD International, Inc. is hiring an Azure Data Engineer for contract work supporting an Azure-based data platform.
Responsibilities
- Support the active development of an Azure data platform in close coordination with the team
- Begin with establishing a reference data system for securities and pricing data, then expand to additional data domains
- Follow internal development standards to contribute to the overall Data Strategy agenda
- Implement Azure Cloud Platform solutions and apply relevant know-how across the qualifications listed below
Requirements
- 10+ years of software development experience using Python and PySpark and associated frameworks
- Proven background as a Data Engineer and/or Data Quality Engineer with Azure cloud experience
- Experience implementing solutions with Azure cloud services
- Hands-on experience implementing Azure Data Factory
- Hands-on experience implementing Azure Lake Gen 2
- Hands-on experience implementing Azure Databases
- Hands-on experience implementing Azure Databricks
- Experience implementing a Data Quality Framework/Solution
- Experience implementing Collibra Data Quality or other data quality tools including IDQ, IBM, or Ab-Initio
- Experience implementing Collibra Data Governance with knowledge of data lineage
- Experience implementing Power BI
- Well versed with Azure Databricks
- Strong SQL skills with RDMs or noSQL databases
- Familiarity with the DevOps lifecycle including git and Jenkins
- Experience with CI/CD processes
- Good understanding of ETL/ELT processes
- Financial services industry experience is a plus, including financial instruments, asset classes, and market data
Key Technologies
- Python, PySpark
- Azure cloud services
- Azure Data Factory
- Azure Lake Gen 2
- Azure Databases
- Azure Databricks
- Data Quality Framework/Solution
- Collibra Data Quality, IDQ, IBM, Ab-Initio
- Collibra Data Governance, data lineage
- Power BI
- SQL, RDMs, noSQL
- DevOps lifecycle: git, Jenkins, CI/CD processes
- ETL, ELT
Benefits
- 401(k) matching
- Dental insurance
- Health insurance
- Vision insurance
Contract Details
- Job type: contract
- Term: 1 year (possibility of extension)
- Pay: $74.00 per hour
- Expected hours: 35.0 – 45.0 per week
- Work location: Hybrid remote in Charlotte, NC 28202