Data Engineer II (Tech Lead) - AWS, Ab Initio, Databricks, Snowflake, Teradata
Job Description
The Travelers Companies, Inc. is seeking a Data Engineer II (Tech Lead) to design, build, and deploy data solutions that support AI/ML and business intelligence initiatives. This role leverages AWS, Ab Initio, Databricks, Snowflake, and Teradata to deliver scalable data platforms. This on-site position is based in Hartford, CT.
Responsibilities
- Design, implement, and operationalize sophisticated data solutions; troubleshoot issues; apply transformations; and recommend data cleansing and quality improvements.
- Develop intricate data architectures and pipelines.
- Analyze complex data sources to assess value, determine applicability, and advise what data should be included in analytics workflows.
- Embed core data management practices, emphasizing governance, security, and data quality.
- Collaborate across teams to support delivery and educate end users about complex data products and analytical environments.
- Conduct data and system analyses to assess, diagnose, and resolve complex defects and incidents.
- Validate data movement, transformation scripts, and data components through testing.
- Other duties as assigned.
Requirements
- Bachelor's degree in a STEM field or equivalent.
- Eight years of related experience.
- Extensive experience with ETL tools such as Ab Initio and Databricks, proficiency with AWS cloud services, programming in Python and SQL, and a solid grasp of contemporary data engineering practices.
- Ability to maintain a steady, predictable delivery pace, ship complete solutions in incremental releases, and identify and negotiate key tradeoffs.
- Proven domain expertise with understanding of relevant technical concepts and industry trends, plus in-depth knowledge of current systems and familiarity with related systems.
- Strong problem solver focused on building durable systems and devising innovative solutions to issues.
- Excellent written and verbal communication, with ability to collaborate effectively with teammates and business partners.
- Ability to lead team members, foster a supportive environment for learning and growth, and demonstrate self-motivation in identifying opportunities and tracking team progress.
- Bachelor's degree in computer science or a related STEM field, or equivalent education and work experience.
- An additional four years of data engineering experience.
Technologies
- Ab Initio
- Databricks
- AWS
- Python
- SQL
- Snowflake
- Teradata
Benefits
- Health Insurance
- 401(k) match
- Pension Plan
- Paid Time Off
- Wellness Program
- Volunteer Encouragement