Data Engineer II

Lewis Energy Group is seeking a Data Engineer II to design, build, and maintain a modern data platform on Microsoft Fabric. This onsite role in San Antonio, TX focuses on delivering reliable data pipelines, scalable transformations, and Power BI-ready semantic models, with strong emphasis on data quality, governance, and clear communication across technical and non-technical stakeholders.

What you’ll do

• Design, build, and maintain Microsoft Fabric data pipelines using Data Factory pipelines, Dataflows Gen2, and notebooks to move data into Lakehouses and Warehouses.
• Develop transformation logic in Python and PySpark within Fabric notebooks, including work with Delta tables and large or complex datasets.
• Write and optimize T-SQL (stored procedures, views, and transformation logic) to support processing and reporting needs.
• Apply data modeling best practices using medallion architecture and star schema patterns within OneLake for performance and ease of use.
• Monitor pipeline runs, troubleshoot failures, and implement alerting and error handling to help ensure timely and accurate data delivery.
• Evaluate existing on-premises SQL Server databases, SSIS packages, and scheduled jobs to plan migration to Microsoft Fabric.
• Rebuild or refactor legacy ETL processes as Fabric-native pipelines and PySpark notebooks to improve performance and maintainability.
• Coordinate migration timelines with the team and stakeholders to minimize disruption to reporting and operations.
• Build and maintain Power BI semantic models, including relationships, measures, ontology, and Direct Lake or Import configurations.
• Tune data models and queries to improve report performance and refresh reliability.
• Implement data quality checks and validation rules to help catch issues before they reach end users.
• Manage Fabric workspace organization, access permissions, and security settings aligned to company data governance standards.
• Use Azure DevOps / Git source control and deployment pipelines to manage changes across development, test, and production.
• Create and maintain clear documentation for data sources, pipelines, models, dictionaries, and business logic.

What you bring

• Demonstrated ability to design relational and dimensional data models, including fact and dimension tables, keys, relationships, referential integrity, and historical changes.
• Strong T-SQL skills for complex joins, transformations, query tuning, and troubleshooting.
• Hands-on experience building and supporting integrations across databases, APIs, or file-based sources, including scheduling, incremental processing, and recovery.
• Ability to validate data completeness and accuracy, reconcile source and target results, and investigate duplicates and broken relationships.
• Experience using Python (or a comparable scripting language) for data processing or automation, along with version control for maintainable development.
• Ability to translate business requirements into documented models and clearly explain technical decisions; willingness to learn unfamiliar platforms.

Helpful experience

• Power BI semantic models, Power Query, DAX, or comparable business intelligence tools.
• Microsoft SQL Server, SSIS, SSAS, or comparable database and integration technologies.
• Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks, or Azure DevOps.
• Oil and gas production data, including SCADA, telemetry, time-series data, IoT, or streaming data.

Benefits

• Insurance: Medical/Dental/Vision, Basic Life and AD&D, and other options to meet personal needs
• 401K with immediate matching contribution
• Annual Discretionary Bonus
• Generous Paid Time Off and Paid Holidays
• Employee Assistance Program (EAP) with free, confidential support for you and your dependents
• Wellness & Company Events throughout the year

Location and requirements

Onsite in San Antonio, TX. Candidates must be able to work full-time from the San Antonio office.

Minimum experience: 2 years. Education: Bachelor’s degree from a four-year college or university.

Technologies: Microsoft Fabric, Data Factory, Dataflows Gen2, PySpark, Python, T-SQL, SQL Server, SSIS, OneLake, Lakehouses, Warehouses, Delta, Power BI, Power Query, DAX, SSAS, Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks, Azure DevOps, Azure Git.