Senior Data Engineer

Join PGIM in Newark, NJ for a hybrid Senior Data Engineer role focused on designing, building, and maintaining scalable data and AI solutions on modern cloud platforms. You will collaborate with senior engineers and key stakeholders to develop data pipelines, analytics, and AI capabilities. This position requires on-site work three days per week. The base salary ranges from $115,000 to $155,000 per year, with potential for an annual bonus.

Responsibilities

• Design, implement, and maintain scalable ETL and ELT data pipelines
• Develop data solutions using Microsoft Fabric, Azure Data Factory, or equivalent tools
• Incorporate data quality checks, data transformations, and data modeling practices
• Work with large-scale datasets using PySpark and SQL
• Deploy and integrate machine learning models into data pipelines
• Develop AI powered capabilities including semantic search, embeddings, and retrieval augmented generation (RAG)
• Create and expose data and AI services through APIs
• Contribute to CI/CD pipelines using GitHub Actions or Azure DevOps
• Apply data security, governance, and access control best practices
• Monitor and troubleshoot data pipelines and AI systems
• Collaborate with data analysts, data scientists, and business stakeholders
• Contribute to documentation and reusable components

Requirements

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field
• 3–6 years of experience in data or AI engineering
• Strong Python and SQL skills
• Experience with data pipeline tools such as Azure Data Factory, Microsoft Fabric, AWS Glue, or equivalent
• Experience with Spark or PySpark
• Familiarity with data lakes and data warehouses
• Experience deploying machine learning models
• Basic understanding of MLOps
• Exposure to Generative AI concepts (embeddings, RAG, LLM APIs)
• Experience with REST APIs and microservices
• Familiarity with CI/CD and Git
• Understanding of data governance and data security
• Strong problem-solving and communication skills

Technologies

• Microsoft Fabric
• Azure Data Factory
• AWS Glue
• PySpark
• Spark
• Python
• SQL
• REST APIs
• GitHub Actions
• Azure DevOps
• LLM APIs

Benefits

• Market-competitive base salary with annual bonus potential
• Medical, dental, vision, life, and disability insurance; PTO and parental/military leave
• 401(k) with company match up to 4%
• Company-funded pension plan
• Wellness programs with up to $1,600 per year reimbursement
• Work/Life resources
• Education benefit for degree or certificate programs
• Employee Stock Purchase Plan (ESPP) with 85% purchase price after one year