Data Engineer- Consultant AI& E
Job Description
Deloitte is hiring an experienced Data Engineer-Consultant under its Project Talent Model to help build and support data pipelines and integrations used for client delivery. This role is based in Morristown, NJ and is designed to minimize extensive travel while you collaborate with business and architecture stakeholders.
In this position, you will develop and unit test low-level data pipeline specifications using Databricks and Apache Hadoop with Apache Spark, coordinate buildout efforts with onshore and offshore teammates, and support system validation activities through SIT and UAT. You will also assist with pipeline deployment and ongoing post-production maintenance and monitoring, including regular communication with engagement leadership and relevant functional and technical teams.
Responsibilities
- Partner with Business Analysts to understand requirements
- Work with the Application Architect to understand the design
- Build low-level data pipeline specifications in Azure Databricks and Apache Hadoop using Apache Spark
- Perform unit testing for the data pipelines
- Coordinate with other team members (onshore/offshore) to complete integration buildout
- Support SIT and UAT
- Support pipeline deployment
- Support post-production maintenance and monitoring
- Communicate regularly with Engagement Managers (Directors), project team members, and representatives across functional and technical teams, escalating items that require additional attention from engagement management
Requirements
- 4+ years of hands-on experience in data engineering
- Technical background in SQL, Azure Databricks, and Apache Spark
- Bachelor's degree, preferably in Computer Science, Information Technology, Computer Engineering, or a related IT discipline, or equivalent experience
- Limited immigration sponsorship may be available
- Ability to travel 10% on average, based on work and client/industry needs
Technologies
- SQL
- Azure Databricks
- Apache Hadoop
- Apache Spark
Benefits
- Eligibility to participate in a discretionary annual incentive program
Preferred Qualifications
- Analytical and decision-making responsibilities
- Ability to manage multiple projects and prioritize tasks into manageable work products
- Ability to operate independently or with minimum supervision
- Excellent written and communication skills
- Ability to deliver technical demonstrations
Salary range: USD 95,000 to 112,000 per year. The estimate may vary based on the applicable geographic differential for the location where the role is filled. You may also be eligible for a discretionary annual incentive program.