Senior Data Engineer

Senior Data Engineer responsible for designing, developing, implementing, and maintaining data integrations, pipelines, and solutions, with a leadership role on cross functional teams, available in Worcester, MA or remote.

Responsibilities

• Design, build, deploy, and maintain data integrations, pipelines, and analytics solutions across Azure and on prem environments.
• Design and implement data solutions using Azure resources such as Azure Data Factory, Azure Synapse, and ADLS.
• Develop data integration, ETL processes, and data warehousing capabilities.
• Write and optimize code in SQL, Python, and PowerShell.
• Demonstrate expertise in data modeling, governance, and engineering patterns and practices.
• Optimize ingestion pipelines and notebooks for scale, performance, reliability, and cost efficiency.
• Work with integration connectors including APIs, File transfers, SFTP/FTPS, streaming data, DB connectors, SOAP, and REST.
• Bring strong problem solving, communication, and collaboration skills to cross functional teams.
• Document data processes and solutions for clarity and reuse.
• Maintain data security and ensure compliance with industry standards.
• Participate in agile development and DevOps practices.
• Use Git or GitHub for CI/CD workflows.
• Provide coaching and technical guidance to junior team members.
• Profile and analyze large data sets with strong analytical skills.
• Apply critical thinking and meticulous attention to detail.
• Debug data solution issues and troubleshoot bottlenecks.
• Collaborate with data scientists, analysts, and stakeholders to align solutions with needs.
• Monitor and maintain data pipelines to ensure reliability.
• Design, develop, and test data mappings with transformation rules.
• Ensure data quality and reliability across data flows.
• Develop and maintain documentation for data integration and ETL solutions.

Requirements

• Bachelor’s degree or higher in data science, mathematics, statistics, computer science, information systems, business information technology, or equivalent field.
• 5+ years of professional experience in data engineering, data architecture, or data integration.
• Must be eligible to work in the United States without sponsorship now or in the future (US citizen or green card holder).

Technologies

• Azure Data Factory
• Azure Synapse
• ADLS
• SQL
• Python
• PowerShell
• APIs
• Git/GitHub
• Power BI
• Microsoft Fabric

Compensation

Salary: USD 100,000 - 125,000 per year

Benefits

• Medical, dental, vision, life, and disability insurance
• 401K with company match
• Tuition reimbursement
• PTO
• Company paid holidays
• Flexible work arrangements
• Cultural Awareness Day in support of IDE
• On-site medical and wellness center (Worcester only)

Career Development

It is a career oriented role with ongoing support through on the job experiences, coaching, and robust learning and development programs. The company encourages growth at every level to help you succeed and stay fulfilled.

Preferred qualifications

• Microsoft DP-203 or DP-700 certification
• Microsoft Fabric experience
• Power BI experience
• Master’s degree in data science, mathematics, statistics, computer science, information systems, business information technology, or equivalent