Senior Data Engineer

Senior Data Engineer on The Hanover Insurance Group's Claims Analytics team in Worcester, MA, offering hybrid or remote work options. Focused on building scalable data models and ETL pipelines, upholding data quality and governance, and enabling analytics and reporting.

Responsibilities

• Lead large, intricate projects independently while managing multiple initiatives concurrently.
• Design scalable data models, structures, and ETL pipelines that support analytics, reporting, and downstream consumers.
• Embed data quality through validation checks, monitor accuracy and completeness, and document data pipelines and processes clearly.
• Collaborate with business partners and cross-functional teams on data and reporting requests.
• Own the end-to-end lifecycle of data pipelines and solutions, including design, development, implementation, optimization, and maintenance.
• Foster a data governance mindset, establishing controls and standards to keep the platform secure, compliant, and scalable.
• Prioritize work by weighing business impact, technical risk, and domain knowledge to maximize value.
• Coach less experienced teammates and participate in code and data reviews.

Requirements

• Bachelor’s degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent.
• 8+ years of professional experience in data engineering, data architecture, or data analytics.
• Advanced SQL, Python, Java, and familiarity with Scala (nice to have).
• Experience building SQL stored procedures and ETL pipelines using Azure Synapse (Synapse Pipelines / Data Factory).
• Active Azure DP-203 or equivalent certification, with other Azure DP certifications or equivalents applicable.
• Familiarity with insurance data, with claims data highly preferred.
• Data modeling expertise across conceptual, logical, and physical models, including object attributes and relationships.
• Strong analytical abilities for large datasets, including profiling and deriving conclusions.
• Clear communication skills to present findings and translate data into accessible documentation.
• Critical thinking, meticulous attention to detail, and strong mathematical capabilities; insurance experience is required.
• Proven debugging skills and the ability to devise remediation plans for data solution issues.
• Experience delivering data engineering best practices for storage, access, integration, and transformation within Azure.
• Hands-on experience with Databricks and Delta Live Tables in data engineering contexts.
• Proven ability to optimize pipelines for scale, performance, reliability, and cost efficiency.
• Proficiency with relational, NoSQL, hierarchical, and ER data modeling approaches.
• Experience creating accessible documentation of data processes to aid knowledge transfer.
• Background in agile development, high-quality coding, and DevOps practices.
• Eligibility to work in the United States without sponsorship now or in the future.

Technologies

• SQL, Python, Java, Scala
• Azure Synapse, Synapse Pipelines, Data Factory
• Databricks, Delta Live Tables

Benefits

• Medical, dental, vision, life, and disability insurance
• 401K with company match
• Tuition reimbursement
• Paid time off
• Company paid holidays
• Flexible work arrangements
• Cultural Awareness Day in support of IDE
• On-site medical and wellness center (Worcester campus)
• Full benefits overview available

Career development

It is a true career path with ongoing support through on-the-job experiences, personalized coaching, and structured learning and development programs designed to help you grow at every level.

EEO Statement

The Hanover values diversity in the workplace and among our customers. We provide equal opportunity for employment and promotion to all qualified applicants based on experience, training, education, and ability to perform the work, without regard to race, religion, color, age, sex or gender, sexual orientation, national origin, gender identity, disability, marital status, veteran status, genetic information, ancestry or any other status protected by law.

Privacy Policy

To view our privacy policy and online privacy statement, please reference our official site.

Applicants who are California residents

For information about what we may collect from applicants and employees and how it is used, see our California residents notice.

Compensation

The target hiring range may vary by geographic location and other factors, including merit or performance, demonstrated proficiency and skills for the role, education, travel requirements, and experience. Additional compensation may include an annual bonus, long-term incentives, or spot recognition awards.