Curant Health Georgia LLC is seeking a Data Engineer II in Smyrna, GA (onsite) to build and support secure, scalable data solutions. In this role, you will design ETL/ELT pipelines and data integrations while leveraging AI, Generative AI, and AI-assisted development tools to improve development efficiency and automate data engineering workflows.
What you’ll do
- Design, develop, test, and maintain secure, reliable, scalable ETL/ELT pipelines aligned to business requirements and user stories.
- Develop and enhance data processing frameworks using SQL, C#, SSIS, and Azure technologies.
- Build and maintain integrations between internal systems, external data sources, applications, and reporting environments.
- Write and optimize complex SQL queries, stored procedures, and transformation logic.
- Design and support relational databases, data warehouses, and dimensional data models.
- Monitor pipeline execution and troubleshoot processing failures, data discrepancies, and performance issues.
- Implement data validation and quality controls throughout data pipelines.
- Create cloud-based solutions using Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, and Azure Functions.
- Use Azure Key Vault and other security tools to support secure data access and credential management.
- Support additional modern data processing technologies as applicable, including Snowflake and Spark.
- Identify opportunities to improve infrastructure, scalability, reliability, and data delivery.
AI-assisted data engineering
- Leverage AI, Generative AI, and AI-assisted tools to accelerate ETL/ELT pipeline development.
- Apply AI technologies to support automation, testing, documentation, and optimization of data engineering workflows.
- Identify opportunities to automate repetitive data engineering and operational processes.
- Evaluate emerging AI and data technologies for potential application within Curant Health’s data environment.
- Ensure AI-assisted solutions align with security, privacy, data governance, and data quality standards.
Build, release, and collaborate
- Develop, test, debug, and maintain code to ensure solutions meet technical and business requirements.
- Design and support Azure DevOps CI/CD pipelines for automated deployment and release management.
- Participate in code reviews, testing, troubleshooting, and production deployment activities.
- Estimate and plan development work, track progress, and deliver projects within established timelines.
- Maintain technical documentation for pipelines, integrations, processes, configurations, and troubleshooting procedures.
- Take ownership of assigned projects from requirements gathering through ongoing support.
- Partner with business stakeholders, analysts, developers, and IT team members to understand requirements and implement solutions.
- Translate business requirements into technical specifications and scalable data solutions.
- Communicate project status, technical challenges, risks, and recommended solutions clearly to relevant stakeholders.
Additional platform support
- Support administration, maintenance, and development of SharePoint and SharePoint Online as needed.
- Assist with creation and management of SharePoint sites, permissions, integrations, and related solutions.
- Troubleshoot SharePoint-related issues and coordinate resolutions as appropriate.
Required qualifications
- Strong experience with SQL, C#, SSIS, Azure data technologies, and modern data engineering practices.
- Ability to work closely with technical and business partners to translate requirements into secure, reliable, and scalable data solutions.
Technologies: SQL, C#, SSIS, Azure, ETL/ELT, Azure Data Factory, Azure SQL, Azure Databricks, Azure Synapse Analytics, Azure Functions, Azure Key Vault, Snowflake, Spark, AI, Generative AI, AI-assisted development tools, Azure DevOps CI/CD, SharePoint, SharePoint Online
