Associate - Data Engineer

New York Life is hiring an Associate Data Engineer for its Tech Data AI Ventures team. You will help deliver clean, reliable enterprise data to support analytics and AI initiatives, working in a hybrid setup based in Lebanon, NJ (3 days per week). This role centers on building scalable data pipelines and data models while partnering closely with data scientists, technology teams, and business stakeholders.

What you can expect

• Reliable data foundation: Build and maintain scalable models and pipelines so teams can trust the data used for analytics, data science, and AI.
• Engineering discipline: Apply software engineering best practices, including version control, testing, integration, code reviews, and pull request approvals.
• Cross-functional collaboration: Work with data scientists, data stewards, and stakeholders to align delivery plans with data governance standards.
• Hybrid work in Lebanon, NJ: Scheduled office attendance at 3 days per week.

Responsibilities

• Develop and support scalable data models and pipelines using dbt, PySpark, AWS Glue, Databricks, and streaming technologies to produce clean, well-structured data.
• Use software engineering practices to improve consistency and quality across data development, including version control, testing, integration, code reviews, and pull request approvals.
• Partner with data scientists, business stakeholders, and data stewards to source strategic enterprise data, address quality and availability needs, and support governance standards.
• Convert business and technical requirements into actionable development plans and Jira stories, establish milestones, and manage work through delivery.
• Collaborate with Technology teams on data strategy, tooling, system integrations, and deployment processes, communicating technical concepts and recommendations to varied audiences.

Requirements

• 2–5+ years of relevant data engineering or related experience, including hands-on work building and maintaining dbt models and transformation pipelines.
• Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration, plus PySpark experience for data processing.
• Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
• Experience with Kafka (or comparable streaming technologies) for real-time ingestion and processing.
• Strong analytical and problem-solving skills, including troubleshooting complex data and engineering issues.
• Effective communication and collaboration skills across technical and business teams, including explaining technical concepts to diverse audiences.

Compensation and work details

• Salary range: USD 81,000 - 115,500 per year
• Overtime: Exempt (Overtime eligible: Exempt)
• Bonus/incentives: Annual discretionary bonus; eligibility to participate in an incentive program (Discretionary bonus eligible: Yes; Sales bonus eligible: No)
• Level: LEVELPF2
• Department / job function: Tech Data AI Ventures
• Job requisition ID: 95121

Benefits

• Leave programs
• Adoption assistance
• Student loan repayment programs
• Annual discretionary bonus
• In addition to base salary, eligibility to participate in an incentive program
• Overtime eligible: Exempt

Preferred skills

• Experience with Google Cloud Platform (GCP) or related cloud data technologies
• Experience working in the insurance, financial services, or another regulated industry
• Experience partnering with data science teams to support analytics, machine learning, or AI use cases