Data Engineer II
Artificial Intelligence
Azure
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Data Warehouse
Cloud Data Warehouse
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
ETL
Informatica
SQL
Job Description
Curant Health Georgia LLC is seeking a Data Engineer II in Smyrna, GA (onsite) to build and support secure, scalable data solutions. In this role, you will design ETL/ELT pipelines and data integrations while leveraging AI, Generative AI, and AI-assisted development tools to improve development efficiency and automate data engineering workflows.
What you’ll do
- Design, develop, test, and maintain secure, reliable, scalable ETL/ELT pipelines aligned to business requirements and user stories.
- Develop and enhance data processing frameworks using SQL, C#, SSIS, and Azure technologies.
- Build and maintain integrations between internal systems, external data sources, applications, and reporting environments.
- Write and optimize complex SQL queries, stored procedures, and transformation logic.
- Design and support relational databases, data warehouses, and dimensional data models.
- Monitor pipeline execution and troubleshoot processing failures, data discrepancies, and performance issues.
- Implement data validation and quality controls throughout data pipelines.
- Create cloud-based solutions using Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
- Use Azure Key Vault and other security tools to support secure data access and credential management.
- Support additional modern data processing technologies as applicable, including Snowflake and Spark.
- Identify opportunities to improve infrastructure, scalability, reliability, and data delivery.
AI-assisted data engineering
- Leverage AI, Generative AI, and AI-assisted tools to accelerate ETL/ELT pipeline development.
- Apply AI technologies to support automation, testing, documentation, and optimization of data engineering workflows.
- Identify opportunities to automate repetitive data engineering and operational processes.
- Evaluate emerging AI and data technologies for potential application within Curant Health’s data environment.
- Ensure AI-assisted solutions align with security, privacy, data governance, and data quality standards.
Build, release, and collaborate
- Develop, test, debug, and maintain code to ensure solutions meet technical and business requirements.
- Design and support Azure DevOps CI/CD pipelines for automated deployment and release management.
- Participate in code reviews, testing, troubleshooting, and production deployment activities.
- Estimate and plan development work, track progress, and deliver projects within established timelines.
- Maintain technical documentation for pipelines, integrations, processes, configurations, and troubleshooting procedures.
- Take ownership of assigned projects from requirements gathering through ongoing support.
- Partner with business stakeholders, analysts, developers, and IT team members to understand requirements and implement solutions.
- Translate business requirements into technical specifications and scalable data solutions.
- Communicate project status, technical challenges, risks, and recommended solutions clearly to relevant stakeholders.
Additional platform support
- Support administration, maintenance, and development of SharePoint and SharePoint Online as needed.
- Assist with creation and management of SharePoint sites, permissions, integrations, and related solutions.
- Troubleshoot SharePoint-related issues and coordinate resolutions as appropriate.
Required qualifications
- Strong experience with SQL, C#, SSIS, Azure data technologies, and modern data engineering practices.
- Ability to work closely with technical and business partners to translate requirements into secure, reliable, and scalable data solutions.
Technologies: SQL, C#, SSIS, Azure, ETL/ELT, Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, Azure Functions, Azure Key Vault, Snowflake, Spark, AI, Generative AI, AI-assisted development tools, Azure DevOps CI/CD, SharePoint, SharePoint Online