Data Engineer - Experienced Associate
Job Description
PwC is seeking an experienced Data Engineer to support client work focused on modernizing data platforms within Advisory. The role involves designing cloud-based pipelines, strengthening data integration for analytics, and contributing to technical discussions using a range of data engineering tools and platforms.
Role Overview
In this position, you will build and enhance data pipelines that move, transform, and integrate client data across cloud environments. You will also support migration efforts for legacy systems, develop data models for analytics platforms, and apply techniques that improve data quality and warehouse performance. Work will span AWS and Microsoft Azure, including technologies such as Apache Airflow, Azure Data Factory, Databricks, and Snowflake.
Responsibilities
- Build cloud data pipelines to ingest, transform, and integrate client data across AWS and Azure environments using Apache Airflow and Azure Data Factory.
- Support migration of legacy data systems to cloud-based data lakes and data warehouses by documenting infrastructure, mapping dependencies, and implementing assigned components.
- Develop data models and dimensional schemas for Snowflake and Databricks, aligning storage structures with analytics needs and documented architecture.
- Write SQL and Java transformations across MySQL, PostgreSQL, and data engineering platforms, including validation checks to investigate data quality issues.
- Configure workflow dependencies in directed acyclic graphs and support data processing with Apache Hadoop, documenting pipeline behavior and troubleshooting failures.
- Apply database administration, indexing, and query optimization techniques to investigate warehouse performance and address data management issues.
- Implement data anonymization and database security controls within assigned tasks and verify data movement against documented client requirements.
- Participate in client project discussions by clarifying requirements, sharing technical findings, incorporating feedback, and using digital and AI-assisted tools to explore integration options.
Required Qualifications
- Education: Bachelor’s degree.
- Experience: At least 1 years of experience.
Preferred Profile
- Preference for at least one of the following fields of study: Analytics/Data Science, Business Administration/Management, Computer Science/Information Systems, Economics, Engineering, Finance, Mathematics/Statistics, Operations/Supply Chain.
- Experience building data pipelines using Apache Airflow or Azure Data Factory to integrate and transform data.
- Experience applying data modeling and validation techniques while contributing to cloud data platform projects.
- Experience working with AWS or Microsoft Azure Databricks to support migration from legacy data systems.
- Ability to troubleshoot Snowflake data warehouse queries and explore performance improvements with project teams.
- Ability to incorporate feedback while communicating data quality findings and asking questions during client project work.
Technologies
- AWS, Microsoft Azure, Google Cloud
- Apache Airflow, Azure Data Factory, Databricks, Snowflake
- SQL, Java
- MySQL, PostgreSQL
- Apache Hadoop, directed acyclic graphs, data lakes, data warehouses
Compensation and Location
Location: United States (onsite).
Salary: USD 63,000 - 140,000 per yearly.
Benefits
- Annual discretionary bonus
- Medical
- Dental
- Vision
- 401k
- Holiday pay
- Vacation
- Personal and family sick leave