Data Engineer II

The Data Engineer II role supports data engineering activities across data modeling, quality, profiling, acquisition, ingestion, and ETL and metadata practices. You will also contribute to governance, compliance, testing and release support, and documentation of technical decisions.

Key Responsibilities

• Provide data engineering functions including data modeling, data quality, data profiling, data acquisition and ingestion, ETL, metadata enrichment and management, and data provenance and lineage.
• Perform data analysis to assess data management requirements for a specific Platform or Journey, including analysis spanning multiple pods or products.
• Maintain expert knowledge of upstream data using outputs from data profiling and data quality reporting, and through production of metadata.
• Articulate complex, large-scale technical design and development details to non-technical business partners.
• Elicit, analyze, and translate business and data requirements into business solutions, including entity relationship diagrams, dimensional data models, ETL and business rules, data life-cycle management, governance, lineage, and metadata.
• Ensure data is maintained in compliance with enterprise data standards, policies, and guidelines.
• Develop and maintain complex data models using industry standard modeling tools.
• Develop and maintain complex ETL jobs and frameworks using TD Bank standard tools.
• Support development and testing teams to resolve data issues, including escalation support for complex problems.
• Support partners and stakeholders in interpreting and analyzing data.
• Build effective relationships within your pod and across partner teams to support collaboration on pod deliverables.
• Coordinate with technology work teams such as ITS, ARE, Architecture, and Enterprise Protect to support overall delivery success.
• Support QA by performing data analysis and investigations of complex issues and test cases as part of SIT/UAT/PAT testing.
• Provide oversight during post-implementation activities in the warranty period.
• Execute and approve code check-in and check-out into the source code repository as part of source code management.
• Work with ITS/ARE teams to support code packaging and deployment using CI/CD into higher environments.
• Participate as a lead participant in design and architecture reviews or application.
• Raise ServiceNow requests and work with the change management team to support release management activities.
• Lead data engineering initiatives and capabilities, and apply data governance principles across the organization.
• Ensure metadata and data lineage are captured and compatible with enterprise metadata and data management tools and processes.
• Adhere to standard security coding practices to help ensure applications are free of common coding vulnerabilities.
• Identify and document technical decisions, technical risks, and lessons learned, and implement enhancements accordingly.
• Protect organizational interests by identifying and managing risks and escalating non-standard, high-risk activities as necessary.
• Adhere to internal policies and procedures and applicable regulatory guidelines.
• Keep current on emerging trends and developments, and grow knowledge of the business and related tools and techniques.
• Enable team members through knowledge sharing and engineering best practices, provide guidance, and proactively identify and resolve issues.
• Participate in personal performance management and development activities, including cross training within your team.
• Keep others informed of project and day-to-day activity status and progress.
• Lead, motivate, and develop relationships with internal and external stakeholders to build productive working relationships.
• Contribute to a fair, positive, and equitable environment that supports a diverse workforce.
• Act as a brand ambassador for your business area/function and the bank internally and/or externally.

Required Qualifications

• Degree, Postgraduate Degree, or Technical Certificate in Data Management or a related discipline (for example, Computer Science or Engineering), or equivalent practical experience.
• 3+ years of relevant experience.
• Advanced knowledge of data engineering frameworks, technologies, tools, processes, patterns, and procedures, including impact on other technology areas such as Architecture or Infrastructure.
• Ability to perform complex technical tasks independently.
• Advanced knowledge of TD applications, systems, networks, innovation, design activities, business, organization, best practices, and standards.
• Capability to design and develop to meet business and technical requirements, including analysis, adaptation, integration, coding, testing, debugging, and execution.
• Ability to use and evolve established patterns to solve complex problems and lead development of new patterns when needed.
• May be recognized as a subject matter expert in areas directly related to key accountabilities.
• 3+ years with: Azure Databricks, PySpark, SQL, Azure Data Factory (ADF), Big Data, ETL, Data Engineering, GitHub or Bitbucket, and analytical and problem-solving skills.
• 1+ years with: Delta Lake, Unity Catalog, CI/CD and DevOps practices, data governance and lineage, and cloud migration and modernization.

Technology Stack

• Azure Databricks, Apache Spark, PySpark, SQL
• Azure Data Factory (ADF), ETL
• Delta Lake, Unity Catalog, data governance, data catalogs
• GitHub, Bitbucket
• CI/CD, DevOps
• SIT/UAT/PAT testing, ServiceNow

Location and Schedule

• Work location: Mount Laurel, New Jersey, United States of America (onsite)
• Hours: 40

Compensation

• Base salary and pay range: $79,160 - $127,670 USD per year
• Incentives: Eligibility for cash and/or equity incentive awards generally through participation in an incentive plan

Benefits

• Health and well-being benefits
• Savings and retirement programs
• Paid time off, including Vacation PTO, Flex PTO, and Holiday PTO
• Banking benefits and discounts
• Career development and reward and recognition
• Training and onboarding sessions

Accommodation

If you are an applicant with a disability and need accommodations to complete the application process, email [email protected]. Include your full name, best way to reach you, and the accommodation needed to assist you with the applicant process.