Data Engineer (Warehouse, BI & SQL DBA)
Job Description
Barrett-Jackson Auction Co, LLC is seeking a Data Engineer to own the end-to-end Microsoft data platform for its Scottsdale IT team. The role centers on designing, administering, and delivering ELT/ETL development and governance for a warehouse/lakehouse built on Azure Synapse and/or Microsoft Fabric, enabling analytics and reporting in Power BI.
Responsibilities
- Design and manage SQL Server and Azure SQL databases, covering schema design, indexing approaches, constraints, and data integrity controls.
- Own core DBA functions such as backup/restore, high availability and disaster recovery, patching and upgrades, capacity planning, monitoring/alerts, and routine maintenance.
- Build and optimize ELT/ETL pipelines using Microsoft tooling (Azure Data Factory, Synapse Pipelines, and/or Fabric Data Factory), integrating data from on‑premises and cloud sources.
- Develop scalable transformation patterns with T-SQL and Spark where applicable, delivering repeatable, testable data-processing frameworks.
- Design and operate the enterprise Data Warehouse or Lakehouse, including dimensional modeling (star/snowflake), incremental loads, historization (SCD), and semantic layer alignment for BI.
- Administer and optimize Azure Synapse and/or Microsoft Fabric (Lakehouse/Warehouse), including workspace organization, resource governance, and performance and cost tuning.
- Enable Power BI reporting by delivering curated datasets, developing and supporting semantic models, and partnering with analysts on performance, refresh strategies, and best practices.
- Implement data quality, reconciliation, and observability (logging, lineage, SLAs), and drive root-cause analysis for data issues across pipelines and reporting.
- Establish and enforce security and governance controls (RBAC, least privilege, encryption, PII handling, auditability) across databases, lakehouse/warehouse, and BI.
- Automate deployments and operations using Git-based workflows and CI/CD (Azure DevOps/GitHub), including infrastructure-as-code where appropriate.
- Create technical documentation for data models, source-to-target mappings, operational runbooks, and support procedures.
- Collaborate with application engineering, product, and business stakeholders to translate requirements into reliable data products and deliver iteratively in an Agile environment.
Requirements
- 6+ years of hands-on data engineering and/or data warehouse engineering experience, including production-grade pipelines and curated datasets.
- 4+ years administering and tuning SQL Server and/or Azure SQL (query optimization, indexing, security, backup/restore, maintenance).
- Strong proficiency with T-SQL, relational data modeling, and performance tuning (execution plans, statistics, partitioning, concurrency patterns).
- Experience building ELT/ETL with Azure Data Factory/Synapse Pipelines and/or Fabric Data Factory; familiarity with event- or file-based ingestion patterns.
- Experience designing and operating a modern warehouse/lakehouse using Azure Synapse and/or Microsoft Fabric (Lakehouse/Warehouse, notebooks/Spark, and orchestration).
- Solid understanding of data warehouse concepts and modeling techniques (Kimball dimensional modeling, SCD, data marts, and semantic layer alignment).
- Power BI experience supporting enterprise reporting (datasets/semantic models, refresh strategies, and workspace governance).
- Experience with Azure security and identity patterns (Azure AD, managed identities, Key Vault, RBAC) and protecting sensitive data (PII) end-to-end.
- Hands-on DevOps experience: Git branching, code reviews, CI/CD, and automated deployments (Azure DevOps and/or GitHub).
- Strong troubleshooting skills across data pipelines, databases, and BI; ability to communicate clearly with technical and non-technical stakeholders.
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience.
Technologies
- SQL Server
- Azure SQL
- Azure Data Factory
- Synapse Pipelines
- Fabric Data Factory
- Spark
- T-SQL
- Azure Synapse
- Microsoft Fabric
- Power BI
- Azure AD
- Key Vault
- RBAC
- Azure DevOps
- GitHub
- Git
Culture
The culture at Barrett-Jackson is built around an in-person, on-site work environment. Team members are in the Scottsdale headquarters five days a week, 8:00 am to 5:00 pm. During live events, the team travels together to ensure events run smoothly, which may involve weekend work and longer hours. The setting is characterized by high energy and a strong sense of shared purpose around each event.