Data Engineer - Senior Associate

Senior Associate Data Engineer at PwC responsible for designing and building data infrastructure, pipelines, integration, and transformation solutions to enable efficient data processing and actionable insights for clients, leveraging AWS, Azure, and Databricks.

Responsibilities

• Design and implement data infrastructure and systems to facilitate efficient data processing and analysis
• Develop and maintain data pipelines, integration, and transformation solutions to support client needs
• Utilize Amazon Web Services (AWS) and Azure Data Factory to enhance data engineering capabilities
• Apply data architecture development and database management skills to optimize data solutions
• Leverage Apache Airflow and Apache Hadoop for scalable data processing and workflow management
• Build and manage data lakes and data warehouses to support large-scale data storage and retrieval
• Confirm data quality and validation through rigorous testing and performance tuning
• Collaborate with clients to understand their data requirements and deliver actionable insights
• Utilize Databricks Unified Data Analytics Platform for advanced data analytics and visualization
• Implement data security best practices to protect sensitive information and maintain compliance
• Apply dimensional modeling and directed acyclic graphs (DAGs) for efficient data organization and processing
• Support the development of data strategies to drive business growth and informed decision-making

Requirements

• Bachelor's degree
• Minimum 2 years of experience

Technologies

• Amazon Web Services (AWS)
• Azure Data Factory
• Microsoft Azure
• Apache Airflow
• Apache Hadoop
• Databricks Unified Data Analytics Platform

Benefits

• Annual discretionary bonus
• Medical, dental, and vision benefits
• 401k
• Holiday pay
• Vacation
• Personal and family sick leave