Data Engineer - Project Delivery Senior Analyst
Job Description
Deloitte seeks a Data Engineer - Project Delivery Senior Analyst in Jersey City, NJ (onsite) to design, build, and operate scalable data pipelines and curated datasets on AWS and Snowflake for analytics and downstream applications.
Responsibilities
- Design, build, and operate scalable batch and near real-time data pipelines on AWS.
- Create robust ingestion patterns from source systems into S3 and Snowflake.
- Develop transformation layers and curated datasets in Snowflake, including dimensional and data product modeling for analytics and downstream applications.
- Implement orchestration and workflow automation on AWS, with retry logic, backfills, and idempotent processing.
- Develop reusable Python components for ingestion, validation, and transformations; enforce standards through code reviews and testing.
- Support Snowflake performance and cost optimization through warehouse sizing, concurrency strategies, query tuning, clustering/micro-partitioning, and workload isolation.
- Collaborate with stakeholders to translate requirements into well-defined datasets and data contracts.
- Maintain regular communication with Engagement Managers (Directors), project teams, and cross-functional stakeholders, escalating issues that require engagement management attention.
- Lead and collaborate on client engagement workstreams focused on improvement, optimization, and transformation of processes, including implementing best-practice workflows and driving operational outcomes.
Requirements
- 4+ years of experience as a Data Engineer delivering production-grade data pipelines and curated datasets.
- 4+ years of hands-on experience with SQL and Python, including Snowflake and/or PySpark for scalable data processing and ELT.
- 4+ years designing, building, and supporting batch and near real-time data pipelines on cloud platforms (AWS preferred; Azure/GCP acceptable).
- Experience with data integration frameworks and orchestration tools.
- Working knowledge of Lakehouse/warehouse architectures and ELT patterns.
- Knowledge of DevOps principles, including CI/CD pipelines, version control, Infrastructure-as-Code.
- Ability to optimize data storage, partitioning, file formats (Delta, Parquet), and overall performance.
- Understanding of data quality, data governance, and metadata management.
- Bachelor's degree in Computer Science, Information Technology, Computer Engineering, or a related IT discipline, or equivalent experience.
- Limited immigration sponsorship may be available.
- Ability to travel approximately 10 percent, depending on client engagement and project needs.
Technologies
- AWS
- Snowflake
- S3
- Python
- PySpark
- SQL
- Delta
- Parquet
Benefits
- Discretionary annual incentive program
Preferred
- Agile delivery experience
- Analytical ability to manage multiple projects and prioritize tasks into manageable work products
- Ability to operate independently or with minimal supervision
- Excellent written and verbal communication skills
- Ability to deliver technical demonstrations