Senior Data Engineer

Design, build, and run enterprise-grade data platforms by engineering data warehouses/lakehouses and reliable pipelines across Microsoft technologies.

Responsibilities

• Design, develop, and maintain enterprise data warehouses, lakehouses, and data pipelines with emphasis on data reliability, performance, quality, and security.
• Partner with software developers, data analysts, and other stakeholders to deliver trusted data for reporting, analytics, and business processes.
• Create and maintain database structures and dimensional data models, including tables, views, indexes, and schemas using Microsoft SQL Server, Azure SQL, and Microsoft Fabric Warehouse and Lakehouse.
• Develop complex SQL assets including queries, stored procedures, functions, and triggers for application development and data processing.
• Improve performance through indexing, query optimization, and other performance tuning techniques.
• Build ETL and ELT workflows using SQL Server Integration Services (SSIS), Azure Data Factory, and Microsoft Fabric Data Factory pipelines and notebooks for ingestion and transformation from multiple sources.
• Ensure data quality, consistency, and integrity across systems and environments.
• Monitor and troubleshoot pipeline execution, including logging and error handling to support timely and accurate processing.
• Analyze SQL to improve execution time and reduce resource consumption.
• Apply indexing strategies to accelerate data retrieval operations.
• Rewrite complex queries to improve efficiency and maintainability.
• Collaborate with developers to optimize SQL embedded within applications.
• Design and maintain cloud data solutions using Azure SQL Database, Azure Data Lake Storage, and Microsoft Fabric OneLake, Lakehouse, and Warehouse.
• Develop and maintain data integration solutions connecting SQL Server, Azure data services, and Microsoft Fabric, including incremental loads and bronze, silver, and gold data layers.
• Apply Azure and Microsoft Fabric best practices covering workspace organization, access controls, monitoring, and performance and cost optimization.
• Provide technical support and troubleshooting for database-related issues.
• Mentor and guide junior data engineers and other team members.
• Create and maintain comprehensive documentation for database designs, processes, and procedures.
• Support compliance with data governance, security policies, and industry regulations.

Requirements

• Minimum 9 years of experience in data engineering and database development focused on Microsoft technologies.
• Proven experience with Microsoft SQL Server and T-SQL, SSIS, Azure data services, and Microsoft Fabric; familiarity with SSRS and Power BI.
• Expertise with Azure data services and Microsoft Fabric for enterprise data warehousing and lakehouse solutions.
• Experience with Microsoft Fabric medallion architecture, Delta tables, incremental processing, and pipeline orchestration.
• Knowledge of data modeling and database design principles.
• Familiarity with Azure Synapse Analytics, Microsoft Purview, and Git-based version control and CI/CD for data solutions.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Ability to work independently and manage multiple tasks and projects simultaneously.
• Detail-oriented approach focused on quality and accuracy.

Education

• Bachelor’s degree in computer science, Information Technology, or a related field
• Master’s degree preferred

Location

• United States (onsite)

Compensation

• USD 109,000 - 152,000 per year

Technologies

• Microsoft SQL Server
• Azure SQL
• Microsoft Fabric Warehouse
• Microsoft Fabric Lakehouse
• T-SQL
• SQL Server Integration Services (SSIS)
• Azure Data Factory
• Microsoft Fabric Data Factory pipelines
• Microsoft Fabric notebooks
• Azure SQL Database
• Azure Data Lake Storage
• Microsoft Fabric OneLake
• Microsoft Fabric medallion architecture
• Delta tables
• Pipeline orchestration
• Azure Synapse Analytics
• Microsoft Purview
• SSRS
• Power BI
• Git-based version control
• CI/CD