Cloud Data Engineer
Job Description
S&N Infrastructure is seeking a Cloud Data Engineer to architect, build, and sustain Azure-based data pipelines and Power BI solutions as part of an ERP cloud migration. This role focuses on delivering a robust data foundation, scalable semantic models, and executive-ready reporting to support strategic decisions. The position is hybrid and based in Louisa, Virginia, offering the chance to collaborate across multiple entities as the organization scales.
Responsibilities
- Develop and scale the cloud data foundation that underpins enterprise reporting and analytics.
- Design and operate reliable data pipelines linking ERP and other business-critical systems with an emphasis on reliability, maintainability, and performance.
- Own end-to-end data ingestion, transformation, storage, and orchestration across the data platform.
- Maintain a dependable, high-performing environment that can grow with the business.
- Serve as a key technical contributor on the ERP cloud migration project.
- Lead governance and evolution of the Power BI environment, including workspace structure, deployment standards, security, and performance optimization.
- Create, optimize, and maintain datasets, dataflows, models, and business-critical reports.
- Collaborate with stakeholders to translate reporting needs into actionable insights.
- Develop scalable semantic models, DAX measures, and data layers to support informed decision-making.
- Uphold governance standards and manage secure user access across the Power BI platform.
- Set and enforce standards for data quality, consistency, and trust across the platform.
- Build and maintain data dictionaries, lineage documentation, and metadata that scale with the organization.
- Monitor platform health, troubleshoot issues promptly, and implement proactive alerting.
- Collaborate with business teams to improve data accuracy and confidence in reporting.
- Engage with business leaders to understand priorities and shape reporting solutions that matter.
- Translate business questions into intuitive data models, dashboards, and visual insights.
- Foster adoption through training, guidance, and documentation for Power BI users.
- Work with software development and IT teams on application and integration data needs.
- Support data-related priorities and roadmap discussions alongside IT leadership.
Requirements
- Hands-on experience with Microsoft Azure, including Azure Data Factory, Azure Data Lake Gen2, and Azure Synapse Analytics (serverless SQL).
- Experience configuring, deploying, and monitoring Self-Hosted Integration Runtime (SHIR), with heartbeat alerting.
- Strong knowledge of Change Data Capture (CDC) on SQL Server for near real-time inserts, updates, and deletes.
- Proven track record building and supporting ADF incremental pipeline patterns in production, including LSN watermark logic from on-premises SQL to Azure.
- Familiarity with Delta Parquet / Delta Lake architecture, including raw-to-curated layer design.
- Experience building unified analytical views with Azure Synapse serverless SQL.
- Deep Power BI experience across administration and development—DirectQuery, composite models, governance, datasets, dataflows, DAX, and semantic layers.
- Platform monitoring with Azure Monitor, SQL Agent alerts, SHIR heartbeat, and Power BI freshness dashboards.
- Strong ETL/ELT pipeline development with ADF, including incremental loads, watermarking, and orchestration.
- Advanced SQL and T-SQL for data modeling, transformation logic, and cross-database analytics.
- Implementing and managing Change Data Capture (CDC) on SQL Server 2016+.
- Designing data lake architectures using raw-to-curated Delta format patterns.
- Python or PySpark for data processing and transformation.
- Integrating ERP data into reporting and analytics environments.
- 5+ years in data engineering or BI development.
- Ability to work independently, make sound technical decisions, and own critical deliverables with limited oversight.
- Comfort working in a growing, multi-entity environment with evolving priorities.
- dbt or other SQL-based transformation framework experience in a modern analytics stack.
- Azure DevOps and CI/CD experience for data pipelines, release management, and environment promotion.
- Experience implementing Power BI governance standards, deployment pipelines, row-level security, and usage monitoring.
- Experience with Microsoft Fabric, Power Automate, or broader Azure ecosystem.
- Background in acquisition-heavy, multi-entity, or fast-scaling organizations with complex reporting needs.
- Prior experience supporting ERP modernization, cloud migration, or enterprise reporting transformation.
Technologies
- Azure Data Factory
- Azure Data Lake Gen2
- Azure Synapse Analytics (serverless SQL)
- Self-Hosted Integration Runtime (SHIR)
- Change Data Capture (CDC) on SQL Server
- Delta Parquet
- Delta Lake
- Azure Synapse serverless SQL
- Power BI
- DirectQuery
- DAX
- Dataflows
- SQL Server
- Python
- PySpark
- dbt
- Azure DevOps
- Microsoft Fabric
- Power Automate
- SQL Agent
- Azure Monitor
Benefits
- 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Life insurance
- Paid time off
- Vision insurance
Pay
From USD 95,000 per year
Location
Louisa, VA 23093 (hybrid)