DataJobs.io
← Back to all jobs
E Logic

Senior Data Engineer

E Logic
Baltimore, MD $120k+/yr Full time Posted 14d ago
Senior Big Data Bigdata Cloud Operations Data Architecture Data Engineer Data Governance Data Integration Data Lake Data Pipeline Data Platform Data Processing Data Security Databricks ETL Spark SQL
Apply Now

Job Description

This on-site Senior Data Engineer role is based in Baltimore, MD and supports IRS related projects. The position offers an annual salary of USD 120,000 and requires a strong background in data engineering, governance, and cloud-native data platforms.

Summary

The Senior Data Engineer leads data management, governance, and administration initiatives within the Enterprise Data Platform, utilizing Databricks and cloud-native environments to support IRS projects.

Responsibilities

  • Design, scale, and sustain data pipelines for data intake, governance, and tenant services on the Enterprise Data Platform.
  • Tune and optimize Databricks clusters, oversee workspaces, and enforce platform policies.
  • Collaborate closely with cloud infrastructure and security teams to implement secure guardrails for data ingestion.

Requirements

  • At least eight years of dedicated experience with cloud technologies, with AWS or Azure preferred.
  • Three to five years of hands-on experience deploying, governing, and administering Databricks environments.
  • Strong proficiency in PySpark, SQL, Python, Delta Lake, and building robust ETL/ELT pipelines.
  • Eligibility to pass a federal government background check (Public Trust).

Technologies

  • Databricks
  • PySpark
  • SQL
  • Python
  • Delta Lake
  • AWS
  • Azure

Important Notice

This role is part of a proposal for Internal Revenue Services. Hiring is contingent upon the selection of the consultant. Selected candidates will be included in the proposal and must authorize the use of their resume for submission.

Similar Jobs