Data Engineer -3

Realign LLC is hiring an onsite Data Engineer for a Production Support focused role in Charlotte, NC. You will help keep critical data flows running smoothly while improving quality, enforcing data management standards, and partnering with teams to resolve production incidents across multiple technology stacks. The salary for this role is USD 98,000 per year, with a requirement of 5+ years of relevant experience.

What you’ll do

• Implement and maintain data flows, including ETL/ELT pipelines, ingestion processes, and distributed data processing jobs.
• Support production issues through root-cause analysis across different platforms and systems, including Hadoop, Oracle, and MongoDB.
• Enforce data management standards with a focus on data quality, metadata, and data lineage.
• Monitor and troubleshoot pipeline health by applying monitoring and observability practices such as logs, metrics, and health checks.
• Perform advanced performance tuning for SQL, Spark, or other distributed data workflows, and address performance bottlenecks and data discrepancies.
• Contribute to automated test suites by analyzing failures and supporting test-driven development practices.
• Collaborate across engineering, product, and business teams using strong communication skills.
• Apply secure data management practices, including encryption, masking, and PII handling.
• Support enterprise governance by adhering to data governance, compliance, and operational risk frameworks.
• Manage deployments with knowledge of CI/CD pipelines, Git, and automated deployment practices.

Systems and platforms you may work with

• Distributed data: Apache Spark, Databricks, Hadoop ecosystems
• Data platforms: Teradata, Snowflake, SQL Server, Azure, AWS, GCP
• Scheduling / tooling: Autosys
• Datastores / ecosystems: Oracle, MongoDB
• Governance-related delivery: App Gov and other mandates (dev work)

What you bring

• 5 to 10 years of experience in Data Engineering, Software Engineering, or a related technical discipline.
• Strong proficiency in Python and SQL, including advanced transformations.
• Hands-on experience building and maintaining distributed ETL/ELT pipelines and ingestion workflows.
• Practical experience with PySpark and Hive, plus distributed tooling such as Apache Spark, Databricks, and Hadoop.
• Experience building and managing datasets in relational and/or cloud-based platforms such as Teradata, Snowflake, SQL Server, and Azure/AWS/GCP.
• Solid understanding of data modeling, metadata, data quality controls, data lineage, and secure data management.
• Knowledge of Unix, Agile, and base support.
• Experience implementing monitoring and observability for data pipelines (logs, metrics, health checks).
• Experience with DevOps-related practices (listed as DevOps Engineer) and automated deployments.
• Prior experience in a financial institution or another regulated industry.