Data Engineer

TG Administration LLC is seeking a Data Engineer to design, build, and maintain scalable data integration pipelines and Azure-based data architectures. This role focuses on governed data flows that use medallion layering to support analytics and downstream applications, while keeping data reliable through quality controls and operational monitoring.

You will work across the data lifecycle, from ingesting internal and external sources to transforming raw inputs into clean, validated datasets. The position is based in Scottsdale, AZ and is onsite, with a minimum of 3+ years of relevant experience.

Responsibilities

• Design, develop, and maintain end-to-end data pipelines to ingest data from internal and external systems into Azure data platforms
• Build and manage data integration processes using tools such as Azure Data Factory, Azure Synapse, and/or Azure Data Lake
• Implement and enforce medallion architecture (bronze, silver, gold) for structured refinement and consumption
• Transform raw data into clean, validated, and enriched datasets for analytics and business use
• Develop and optimize data models and transformation logic for performance and scalability
• Integrate data from APIs, SaaS platforms, databases, and third-party systems
• Ensure data quality, consistency, and integrity across pipeline stages
• Implement monitoring, alerting, and logging for pipeline performance and failures
• Collaborate with data analysts, data scientists, and product teams to support reporting and advanced analytics needs
• Maintain and optimize data storage solutions (for example, Azure Data Lake and Synapse) for cost and performance efficiency
• Follow best practices for version control, CI/CD, and deployment of data pipelines
• Document data flows, transformations, and system dependencies

Requirements

• 3+ years of experience in data engineering, ETL/ELT development, or data integration
• Hands-on experience building and maintaining production-grade data pipelines
• Experience working within cloud-based data platforms (Azure preferred)
• Strong proficiency in SQL and data transformation techniques
• Experience with Azure data services: Azure Data Factory, Azure Data Lake, and Synapse Analytics
• Expertise in ETL/ELT pipeline design and orchestration
• Strong understanding of data modeling (relational and dimensional)
• Experience working with APIs, file-based ingestion, and streaming data sources
• Knowledge of data quality, validation, and error-handling techniques
• Strong problem-solving and troubleshooting skills
• Bachelor’s degree in Computer Science, Information Technology, Engineering, or related field
• Equivalent combination of education and experience may be considered

Technologies

Azure, Azure Data Factory, Azure Synapse, Azure Data Lake, Synapse Analytics, SQL, ETL/ELT, APIs, SaaS, PySpark, Spark, Databricks, Delta Lake, CI/CD, DevOps

Benefits

• Healthcare Benefits – Medical, Dental, and Vision coverage
• Retirement Benefits – 401(k) with employer match (19 years of age and older)
• Time Off – Paid time off (PTO) and leaves of absence, in accordance with applicable law and eligibility criteria

Preferred Qualifications

• Experience implementing medallion architecture (bronze/silver/gold layers)
• Experience integrating multiple enterprise systems (CRM, ERP, SaaS platforms)
• Experience supporting analytics or BI environments

Preferred Knowledge and Skills

• Experience with PySpark, Spark, or Databricks
• Familiarity with Delta Lake and lakehouse architectures
• Experience with CI/CD pipelines and DevOps practices in Azure
• Knowledge of data governance, lineage, and cataloging tools
• Experience optimizing performance and cost in cloud environments