Senior Data Engineer (Databricks & Cloud Analytics)
Senior
Azure Data Factory
Azure Data Lake
Big Data
Data Analytics
Data Architecture
Data Engineer
Data Factory Azure
Data Governance
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databricks
Databricks Mlflow
Delta Lake
Delta Live Tables
Engineer
ETL
Microsoft Azure
Spark
SQL
Job Description
CGI Group, Inc. is seeking a Senior Data Engineer (Databricks & Cloud Analytics) to design, develop, and support secure, scalable, high-performing enterprise data platforms. This role is onsite in the Salt Lake City, UT area and focuses on building cloud data pipelines and analytics capabilities using Databricks, Apache Spark, and Azure services.
Compensation: USD 79,600 to 139,300 per year. Experience: 6+ years.
What you’ll be doing
- Design, develop, test, deploy, and maintain enterprise data engineering solutions using modern cloud and big data technologies.
- Build scalable ETL/ELT pipelines with Databricks, Apache Spark (PySpark), Delta Lake, and Azure Data Factory.
- Create high-performance ingestion, transformation, and integration frameworks that support enterprise analytics and reporting.
- Develop, optimize, and maintain complex SQL queries, stored procedures, and transformation processes.
- Design scalable data models for business intelligence, analytics, and AI initiatives.
- Integrate enterprise data exchange using RESTful APIs, event-driven architectures, and legacy SOAP services.
- Develop and maintain streaming and messaging solutions using Apache Kafka.
- Monitor, troubleshoot, and optimize production pipelines, performing root cause analysis and implementing long-term fixes.
- Apply data quality, governance, security, and performance best practices across enterprise platforms.
- Use Git and follow CI/CD and enterprise DevOps best practices.
- Work with Solution Architects, Product Owners, Business Analysts, and cross-functional engineering teams to translate business needs into technical solutions.
- Participate in Agile ceremonies, including sprint planning, backlog refinement, architecture discussions, code reviews, and retrospectives.
- Create technical documentation, deployment artifacts, testing documentation, and operational runbooks.
- Mentor junior engineers and contribute to engineering standards, best practices, and continuous improvement initiatives.
What you bring
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related technical discipline (or equivalent professional experience).
- 6+ years designing, developing, and supporting enterprise data platforms, cloud analytics solutions, or large-scale data engineering initiatives.
- Strong hands-on experience with Databricks.
- Strong hands-on experience with Apache Spark (PySpark).
- Strong hands-on experience with Python and SQL.
- Strong hands-on experience with Scala.
- Experience with Databricks Workspaces, Delta Lake, and Unity Catalog.
- Experience with Delta Live Tables (DLT), Databricks SQL, MLflow, and Databricks Jobs.
- Strong SQL development experience, including query optimization and performance tuning.
- Experience designing and implementing ETL/ELT with Azure Data Factory (or comparable cloud integration platforms).
- Experience with Apache Kafka (or other event streaming technologies).
- Experience integrating enterprise applications using REST APIs, JSON, XML, and SOAP web services.
- Experience with Azure Data Lake Storage (ADLS Gen2) (or comparable cloud storage platforms).
- Experience using Git for source code management in collaborative development.
- Experience working in Linux, including shell scripting and command-line utilities.
- CI/CD experience using Azure DevOps, GitHub Actions, or similar DevOps platforms is preferred.
- Terraform familiarity is preferred.
- Strong analytical, troubleshooting, and problem-solving skills; ability to manage multiple priorities and work independently while mentoring teammates and contributing to technical leadership.
- Experience in Agile environments using Scrum, Kanban, or SAFe methodologies.
Beneficial ways CGI supports you
- Competitive compensation
- Comprehensive insurance options
- 401(k) matching contributions and the share purchase plan
- Paid time off for vacation, holidays, and sick time
- Paid parental leave
- Learning opportunities and tuition assistance
- Wellness and well being programs
Collaboration and communication
- Clearly communicate complex technical concepts to both technical and non-technical audiences.
- Collaborate effectively with architects, developers, business analysts, product owners, and client stakeholders.
- Build trusted relationships across cross-functional teams while delivering high-quality solutions.
- Foster knowledge sharing, continuous learning, and engineering excellence.
Similar Jobs
