Data Engineer II (Snowflake, Databricks, Ab Initio)

The Travelers Companies, Hartford, CT onsite, seeks a Data Engineer II to design, build, and operate complex data solutions using Snowflake, Databricks, and Ab Initio to enable AI, ML, and analytics across the enterprise.

Responsibilities

• Design, build, and operationalize multi-faceted data solutions; troubleshoot issues; apply transformations; and recommend data cleansing and quality improvements.
• Architect complex data solutions that meet business needs.
• Analyze diverse data sources to assess value and suitability for analytics, and recommend data to include in analytical workflows.
• Incorporate data governance, data security, and data quality practices across projects.
• Collaborate with teams to support delivery and educate end users on data products and the analytic environment.
• Analyze data and systems to identify, assess, and resolve complex defects and incidents.
• Test data movement, transformation code, and data components to ensure quality and reliability.
• Perform other duties as assigned.

Requirements

• Bachelor’s degree in computer science, a related STEM field, or equivalent education/experience.
• Eight years of related experience.
• Expert-level experience designing, developing, and maintaining scalable data pipelines and ETL/ELT workflows using Snowflake, Databricks, and Ab Initio platforms.
• Strong programming skills in Python, SQL, and Spark with a track record of optimizing complex queries and data transformations for performance and cost efficiency.
• Experience with data quality frameworks, data governance practices, and implementing monitoring and alerting solutions for data pipelines.
• Proficiency with cloud platforms, modern software engineering practices, and a broad set of tools and languages.
• Ability to deliver work at a steady, predictable pace, release in small batches, and identify and negotiate important tradeoffs.
• Demonstrated domain expertise and knowledge of current industry trends, plus in-depth understanding of the immediate systems worked on and awareness of adjacent systems.
• Strong problem-solving skills to ensure durable systems and innovative approaches to issue resolution.
• Excellent written and verbal communication skills with the ability to collaborate effectively with teammates and business partners.
• Ability to lead team members and foster a safe environment for learning and growth as engineers.
• Proven self-motivation in identifying opportunities and tracking team efforts.
• Four additional years of data engineering experience.

Technologies

• Snowflake
• Databricks
• Ab Initio
• Python
• SQL
• Spark
• Cloud platforms

Benefits

• Health Insurance
• 401(k) contributions match up to 5% of eligible pay
• Paying it Forward Savings Program (student loan)
• Pension Plan that is 100% funded by Travelers
• Paid Time Off
• Wellness Program
• Volunteer Encouragement