Senior Data Engineer
Senior
Azure
Azure Data Factory
Azure Databricks
Big Data
Bigdata
Data Engineer
Data Engineering
Data Factory
Data Factory Azure
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Quality
Databricks
Databricks Pyspark
ETL
Hadoop
Microsoft Azure
Pyspark
Software Testing
Spark
SQL
Test Automation
Job Description
Work remotely from Oregon (USA) as a Senior Data Engineer at CGI Group, Inc., helping deliver reliable enterprise data platforms and ETL/ELT pipelines through rigorous testing, validation, and automation. This role combines strong technical depth with Agile/Scrum collaboration, supported by competitive compensation (USD 62,900 - 139,300 yearly) and a benefits package designed for your wellbeing and long-term growth.
You will design and execute end-to-end test plans that validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems. If you enjoy turning quality concepts into repeatable testing assets and SQL-based checks, this position is built for that kind of impact.
What you’ll do
- Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.
- Run end-to-end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across systems.
- Write complex SQL queries to support backend testing and data validation.
- Test large-scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF).
- Perform functional, integration, regression, system, and data quality testing for data pipelines and data-driven applications.
- Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments.
- Identify, document, track, and retest defects while partnering with developers, data engineers, business analysts, and other stakeholders.
- Develop and maintain reusable test scripts and automation solutions where applicable.
- Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives.
What you bring
- 8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing.
- Strong hands-on SQL skills, including complex queries for source-to-target validation, reconciliation, and data quality testing.
- Experience testing large-scale data platforms and ETL/ELT pipelines.
- Hands-on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).
- Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.
- Experience working in Unix/Linux and using enterprise job scheduling tools such as Control M.
- Solid understanding of data quality concepts, data transformations, data mappings, and source-to-target validation.
- Experience with defect management and test management processes in Agile/Scrum delivery environments.
- Strong analytical, troubleshooting, communication, and collaboration skills.
Benefits
- Competitive compensation including a profit participation program
- Comprehensive medical, dental, and vision benefits
- Basic life and accidental death & dismemberment insurance
- 401(k) matching contributions and a CGI share purchase plan
- Flexibility and paid accrued vacation leave of 10 to 20 days per year, based on job level, years of relevant prior experience, and years of service
- 10 paid holidays per year
- At least 80 consecutive hours of paid sick/safe leave (with exceptions where state/local law requires more)
- Paid parental leave ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws
- Bereavement leave ranging from 1 to 7 days per year based on relationship
- Paid jury duty leave, up to time summoned
- Learning opportunities and tuition assistance
- Wellness and Well being programs
Similar Jobs
L