Sr Data Engineer

The American Medical Association’s Insurance Technology team is hiring a Senior Data Engineer to support hybrid data integration and automation needs. In this role, you will help deliver reliable file-based workflows, transform and validate incoming claims and administration datasets, and ensure downstream reporting can run with confidence. The position is based in Chicago, IL with 3 days per week in-office, and the salary range is USD 99,410 to 131,637 per year.

What you’ll do

• Process and clean Excel, CSV, and other flat files carrying claims and administration-related data at high volumes
• Detect and resolve duplicates, inconsistencies, and data quality issues in incoming files
• Transform flat files into required schemas and formats for downstream systems
• Load, stage, update, and extract data in Snowflake
• Run and support manual and scheduled Snowflake jobs
• Prepare and transform rate data across multiple processing stages and generate outbound data files, including CSV uploads to EXL
• Apply best-practice patterns for ingestion, transformation, modeling, and orchestration in a modern lakehouse environment
• Develop and maintain PowerShell scripts from scratch and enhance existing scripts as needed
• Automate file transfers, FTP interactions, directory management, and email notifications
• Write and optimize SQL queries, including complex joins and transformations
• Update backend tables and implement data corrections when issues are identified
• Prepare reports and datasets, and provide recommendations for analytics and operational needs
• Perform database troubleshooting and data validation activities
• Create Python scripts for file-based automation such as file movement, copying, editing, and integration tasks
• Own end-to-end automation of data and file workflows
• Proactively profile queries, tune execution plans, define efficient indexing strategies, and set partitioning layers to reduce latency in high-compute workloads

Requirements

• Bachelor’s degree required (P1+/M1+)
• 5+ years of experience in ETL/ELT pipeline development, data integration, and process automation
• Demonstrated ability to multi-task and manage multiple concurrent projects with minimal supervision

Tools and technologies

• Snowflake, PowerShell, SQL, Python
• Excel, CSV, FTP, EXL

Benefits

• Employees are eligible to participate in an incentive plan