DataJobs.io
← Back to all jobs

Job Description

Support a Federal agency as a Senior Performance Data Engineer focused on ETL lifecycle performance, tuning, and a scalable cloud Data Lakehouse platform.

Responsibilities

  • Provide data modeling expertise and performance-tuning guidance to optimize ETL workloads and database queries, including queries supporting MicroStrategy reporting within the EDS Application.
  • Lead engineering for a scalable, cloud-based Data Lakehouse platform, known internally as the Unified Analytics Platform (UAP), powered by Databricks and hosted in Microsoft Azure for enterprise data governance, observability, and operational value.
  • Perform application development and maintenance work that delivers direct technical assistance.
  • Provide 24×7 on-call remote support for production server application support, including installation and upkeep of ETL solutions and delivery of complementary services to meet customer and business needs.

Requirements

  • Bachelor’s degree in Computer Science or a related field (highly preferred).
  • 15+ years of hands-on experience with data modeling and querying.
  • Focus on development and maintenance of applications providing ETL services supporting the Postal Data Asset Services group.
  • Significant experience with the Teradata optimizer.
  • Ability to read SQL “explain” plans and take action to effectively leverage the database engine’s massively parallel architecture.
  • Proficiency with Teradata SQL due to business logic embedded in queries.
  • Thorough understanding of internal “DBC Accounting” information to measure performance of application code.
  • Ability to obtain and maintain a Public Trust and successfully pass a thorough Government background screening process requiring completion of detailed forms and fingerprinting.
  • U.S. residency requirement: selected candidate must have resided in the U.S. (including U.S. Territories) for the last five years per USPS security clearance rules (including limits on time outside the U.S. and exceptions where applicable).

Technologies

  • Ab Initio
  • Ab Initio Extract Transform Load (ETL) Tool
  • Teradata SQL
  • Teradata optimizer
  • MicroStrategy
  • Databricks
  • Microsoft Azure
  • SQL “explain” plans
  • DBC Accounting
  • GDE (Graphical Development Environment)
  • Web API development
  • Kafka
  • MQSeries
  • JMS
  • JDBC

Key Skills for Success

  • Ab Initio
  • Ab Initio Extract Transform Load (ETL) Tool
  • Teradata SQL

Desired Skills and Abilities

  • Working knowledge of how MicroStrategy and other OLAP tools interact with Teradata.
  • Knowledge of Ab Initio tools, architecture, process, and analytics.
  • Working knowledge of major competing data warehouse modeling techniques, including Third-Normal-Form and dimensional modeling, and how modeling decisions affect performance of ETL, structured report queries, and unstructured data analysis.
  • Working knowledge of GDE (Graphical Development Environment used by Ab Initio).
  • Working knowledge of Web API development.
  • Working knowledge of storing, reading, and analyzing streaming data, such as Kafka, MQSeries, or similar technologies like JMS.
  • Working knowledge of cloud technology, including developing and architecting.

Location

  • Raleigh, NC (hybrid preferred)
  • Remote considered

Travel Required

  • None

Compensation

  • $129,813 - $166,750 per year

Identity Verification Process

  • Identity verification process using advanced biometrics and artificial intelligence to ensure authenticity and protect against identity fraud.
  • Virtual interviews require being on camera.
  • Company may take your picture to verify identity and prevent fraud.
  • Proceeding authorizes collection, processing, and use of biometric data for identity verification and security purposes.

Similar Jobs