Data Engineer with Financial Services, Databricks and MDM Experience
Job Description
Yoh, A Day & Zimmermann Company invites you to join a data engineering team in Jersey City, NJ on a hybrid schedule. This role offers a competitive hourly rate of USD 65 to 80 and a benefits-rich environment for professionals working on financial services data. You will design and operate scalable data pipelines, support master data management, and build cloud-native solutions on platforms like Databricks and Snowflake to meet operational, analytical, and regulatory needs. A Bachelor’s degree in Computer Science, Information Systems, or Engineering is required.
Responsibilities
- Design, develop, and support scalable data pipelines and enterprise data integration solutions.
- Build and maintain batch and real-time data ingestion, transformation, and processing frameworks.
- Develop cloud-native data engineering solutions supporting enterprise data lake, warehouse, and lakehouse platforms.
- Implement ETL and ELT processes for structured, semi-structured, and unstructured data sources.
- Support Master Data Management initiatives across security, account, client, and reference data domains.
- Collaborate with data architects, business analysts, governance teams, and application teams to support enterprise data initiatives.
- Implement data quality validation, monitoring, metadata management, and lineage processes.
- Support cloud migration and modernization efforts involving legacy and enterprise data platforms.
- Optimize data processing, storage, and pipeline performance for scalability and operational efficiency.
- Ensure compliance with enterprise security, governance, and regulatory standards within financial services environments.
- Support reporting, analytics, and downstream consumption platforms through reliable and trusted data delivery.
Requirements
- Strong hands-on experience in Data Engineering and enterprise-scale data integration.
- Proven experience developing scalable ETL/ELT pipelines and distributed data processing solutions.
- Experience working with modern cloud-based data platforms and data ecosystems.
- Strong SQL expertise along with programming or scripting experience in Python, PySpark, or Snowpark.
- dbt for data transformation and modeling
- dbt for ELT pipeline development within Snowflake/Databricks
- dbt for modular, reusable SQL-based data workflows
- dbt for data testing, documentation, and version control integration
- Experience with cloud platforms such as Azure, AWS, or GCP, including integration with Snowflake and Databricks.
- Solid understanding of data lake, data warehouse, and lakehouse architectures, and their implementation across platforms.
- Experience with orchestration and workflow tools (e.g., Airflow, Databricks Workflows, Snowflake Tasks) for pipeline scheduling and automation.
- Experience supporting Master Data Management and enterprise data governance initiatives.
- Familiarity with metadata management, data lineage, data cataloging, and data quality processes.
- Experience integrating APIs and microservices.
- Experience integrating file-based ingestion (batch).
- Real-time/streaming data experience (e.g., Kafka, Spark Streaming).
Must Haves
- Financial services experience
- Data pipeline development
- Databricks and Delta Lake
- Master Data Management integration (Golden Source)
- Strong SQL and data engineering skills
- Oracle to Cloud migration experience
- Data quality and reconciliation
Preferred Qualifications
- Financial services or banking industry experience
- Experience supporting regulatory, risk, compliance, or operational reporting data environments
- Exposure to real-time data processing and streaming technologies
- Familiarity with CI/CD processes and infrastructure automation
- Strong analytical, troubleshooting, and problem-solving skills
- Excellent communication and collaboration skills
Education
Bachelor’s degree in Computer Science, Information Systems, or Engineering
Tech Stack
- Databricks, Delta Lake, Snowflake, Snowpark
- Python, PySpark, SQL
- dbt
- Azure, AWS, GCP
- Airflow, Databricks Workflows, Snowflake Tasks
- Kafka, Spark Streaming
Compensation
Estimated rate: USD 65.00 - 80.00 per hour
Benefits
- Medical, Prescription, Dental & Vision Benefits (for employees working 20+ hours per week)
- Health Savings Account (HSA) (for employees working 20+ hours per week)
- Life & Disability Insurance (for employees working 20+ hours per week)
- MetLife Voluntary Benefits
- Employee Assistance Program (EAP)
- 401K Retirement Savings Plan
- Direct Deposit & weekly epayroll
- Referral Bonus Programs
- Certification and training opportunities