Data Engineer
Apache Airflow
Big Data
Bigdata
Cloud
Cloud Data Engineering
Cloud Data Platform
Cloud Infrastructure
Cloud Native
Cloud Native Technologies
Cloud Operations
Cloud Platform
Cloud Platforms
Cloud Platforms Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Integration Tools
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
DevOps
Devops Tools
DevSecOps
Engineer
Engineering
Engineering Software
ETL
Informatica
Information Technology (IT)
Kubernetes
Platform Engineering
Programming
Programming Language
Programming Languages
Security Devops
Software Development
SQL
Vector Databases
Job Description
PNC Financial Services Group is hiring a Data Engineer in its Data and Automation organization to help advance large-scale enterprise big data platforms. This onsite role in Phoenix, AZ supports cloud-native, modern data solutions with a focus on platform health, observability, ETL/ELT monitoring, modernization efforts, and translating business analytical needs into technical outcomes.
What you will do
- Monitor, maintain, and continuously improve the health and performance of the data platform.
- Help ensure stability, reliability, and scalability of data systems.
- Apply best practices for platform operations and data engineering standards, supporting understanding and adherence across technical and business customers.
- Conduct frequent reviews of data platform architecture to identify opportunities for automation, optimization, right-sizing, and cost reduction.
- Drive user migration to a unified data platform.
- Modernize legacy Hadoop-based systems to cloud-native architectures.
- Design and build scalable data observability analytics to support site reliability.
- Develop ETL/ELT pipeline monitoring solutions to detect bottlenecks, failures, and abnormal processing metrics.
- Create intelligent alerts to identify high-utilization Spark and Trino jobs to protect service ability for users.
- Capture and report compute usage across containers in Kubernetes, Docker, and similar environments to support job and query optimization.
- Build dashboards and visualizations for real-time visibility into enterprise data platform health, performance, and availability.
- Partner with business stakeholders to translate analytical needs into technical solutions, including through data and BI tools.
- Act as an internal consultant on big data tools and capabilities for internal customers.
- Optimize query performance and data structures to support analytical workloads.
- Guide stakeholders in leveraging data to generate business insights.
- Design, implement, and standardize the use of AI and Generative AI tools to automate tasks, accelerate development, and streamline platform efficiency and governance.
- Use code generation for query and cost optimization to maximize platform resources.
- Engineer solutions using vector databases, embedding pipelines, feature stores, and Retrieval-Augmented Generation workflows.
- Maintain integrity of engineering code and data through automated code generation, profiling, and data cleansing tools.
- Develop detailed analytics that drive internal process improvements and provide actionable insights into key business performance metrics.
- Develop, support, and implement data services for multiple applications to meet business objectives and user requirements, including building and maintaining technology solutions.
- Work with users, developers, operations, and business partners to define data service requirements and develop data preparation processes.
- Design and build data service infrastructure across multiple data platforms aligned to business processes and workflows.
- Implement scalable, available, and maintainable data solutions for multiple applications.
- Carry out data migration and transformation activities to ensure accuracy and security of data solutions.
Requirements
- Strong proficiency in programming languages such as Python, Spark, and Scala.
- Strong background and practical experience in SQL development and enterprise database systems (for example, Oracle and Teradata).
- Experience with modern, cloud-native and open-source tools including Apache Iceberg, Apache Airflow, and Trino (highly valued).
- Strong experience in modern data engineering and big data ecosystems/frameworks.
- Hands-on experience building scalable data platforms and analytical solutions using data Lakehouse architecture.
- Knowledge and experience with machine learning concepts for automation development.
- Familiarity with cloud platforms such as Azure and AWS and related data services.
- Experience with dedicated data observability tools (for example, Monte Carlo or Acceldata) or broad monitoring stacks (such as Datadog, Grafana, or Prometheus) is a plus.
- Proven ability to go beyond data movement and contribute to solution design.
- Strong communication skills with the ability to translate between technical and non-technical audiences, and to bridge business and engineering teams.
- Collaborative mindset with experience across cross-functional teams.
- Strong problem-solving and critical thinking skills.
- Typically requires a Bachelors degree and 3+ years of relevant/direct industry experience; in lieu of a degree, a comparable combination of education, job-specific certifications, and experience (including military service) may be considered.
Salary and location
- Location: Phoenix, AZ (onsite)
- Salary: USD 86,250 to 158,125 per year
- Pay transparency: Base salary ranges may vary based on geographic location, market data, and individual skills, experience, and education. The role is incentive eligible, with payment based on company, business, and/or individual performance.
Benefits
- Medical/prescription drug coverage with a Health Savings Account feature
- Dental and vision options
- Employee and spouse/child life insurance
- Short and long-term disability protection
- 401(k) with PNC match
- Pension and stock purchase plans
- Dependent care reimbursement account
- Back-up child/elder care
- Adoption, surrogacy, and doula reimbursement
- Educational assistance, including select programs fully paid
- Robust wellness program with financial incentives
- Maternity and/or parental leave
- Up to 11 paid holidays each year
- 9 occasional absence days each year, unless otherwise required by law
- Between 15 to 25 vacation days each year, depending on career level
- Years of service
Key technologies mentioned
- Python, Spark, Scala, SQL
- Oracle, Teradata
- Apache Iceberg, Apache Airflow, Trino, Hadoop
- Azure, AWS, cloud-native tooling
- Monte Carlo, Acceldata, Datadog, Grafana, Prometheus
- Kubernetes, Docker, ETL, ELT
- Vector databases, embedding pipelines, feature stores, Retrieval-Augmented Generation
- AI, Generative AI, data Lakehouse architecture, data observability analytics, data cleansing
Application window: Generally expected to be posted for two business days from 11/09/2026, though it may be longer with business discretion.