Lewis Energy Group is seeking a Data Engineer II to design, build, and maintain a modern data platform on Microsoft Fabric. This onsite role in San Antonio, TX focuses on delivering reliable data pipelines, scalable transformations, and Power BI-ready semantic models, with strong emphasis on data quality, governance, and clear communication across technical and non-technical stakeholders.
What you’ll do
- Design, build, and maintain Microsoft Fabric data pipelines using Data Factory pipelines, Dataflows Gen2, and notebooks to move data into Lakehouses and Warehouses.
- Develop transformation logic in Python and PySpark within Fabric notebooks, including work with Delta tables and large or complex datasets.
- Write and optimize T-SQL (stored procedures, views, and transformation logic) to support processing and reporting needs.
- Apply data modeling best practices using medallion architecture and star schema patterns within OneLake for performance and ease of use.
- Monitor pipeline runs, troubleshoot failures, and implement alerting and error handling to help ensure timely and accurate data delivery.
- Evaluate existing on-premises SQL Server databases, SSIS packages, and scheduled jobs to plan migration to Microsoft Fabric.
- Rebuild or refactor legacy ETL processes as Fabric-native pipelines and PySpark notebooks to improve performance and maintainability.
- Coordinate migration timelines with the team and stakeholders to minimize disruption to reporting and operations.
- Build and maintain Power BI semantic models, including relationships, measures, ontology, and Direct Lake or Import configurations.
- Tune data models and queries to improve report performance and refresh reliability.
- Implement data quality checks and validation rules to help catch issues before they reach end users.
- Manage Fabric workspace organization, access permissions, and security settings aligned to company data governance standards.
- Use Azure DevOps / Git source control and deployment pipelines to manage changes across development, test, and production.
- Create and maintain clear documentation for data sources, pipelines, models, dictionaries, and business logic.
What you bring
- Demonstrated ability to design relational and dimensional data models, including fact and dimension tables, keys, relationships, referential integrity, and historical changes.
- Strong T-SQL skills for complex joins, transformations, query tuning, and troubleshooting.
- Hands-on experience building and supporting integrations across databases, APIs, or file-based sources, including scheduling, incremental processing, and recovery.
- Ability to validate data completeness and accuracy, reconcile source and target results, and investigate duplicates and broken relationships.
- Experience using Python (or a comparable scripting language) for data processing or automation, along with version control for maintainable development.
- Ability to translate business requirements into documented models and clearly explain technical decisions; willingness to learn unfamiliar platforms.
Helpful experience
- Power BI semantic models, Power Query, DAX, or comparable business intelligence tools.
- Microsoft SQL Server, SSIS, SSAS, or comparable database and integration technologies.
- Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks, or Azure DevOps.
- Oil and gas production data, including SCADA, telemetry, time-series data, IoT, or streaming data.
Benefits
- Insurance: Medical/Dental/Vision, Basic Life and AD&D, and other options to meet personal needs
- 401K with immediate matching contribution
- Annual Discretionary Bonus
- Generous Paid Time Off and Paid Holidays
- Employee Assistance Program (EAP) with free, confidential support for you and your dependents
- Wellness & Company Events throughout the year
Location and requirements
Onsite in San Antonio, TX. Candidates must be able to work full-time from the San Antonio office.
Minimum experience: 2 years. Education: Bachelor’s degree from a four-year college or university.
Technologies: Microsoft Fabric, Data Factory, Dataflows Gen2, PySpark, Python, T-SQL, SQL Server, SSIS, OneLake, Lakehouses, Warehouses, Delta, Power BI, Power Query, DAX, SSAS, Azure Data Lake Storage, Azure SQL, Synapse Analytics, Databricks, Azure DevOps, Azure Git.
