Spring Batch Data Jobs

1 job found

Today

CGI Group, Inc. Cary, NC

Cary, NC

Today

$92k - $161k/yr Full time Backend Developer Aws Data Engineer Big Data

CGI is seeking an experienced Data Engineer for an on-site role in Cary, NC, focused on building and operating ETL and external-facing API solutions.

Design, develop, test, deploy, and maintain ETL batch jobs using Spring Batch and Apache Spark on EMR
Schedule, monitor, and debug Spring Batch and Spark batch processing workflows
Build Java clients for REST and SOAP API consumption
Develop Scala Spark batch applications for data movement and processing
Use Apache Spark to process big data and write outputs to NoSQL databases such as Cassandra or Yugabyte
Build and deploy software solutions on AWS cloud infrastructure
Provide technical support to squads across the product area for building, deploying, and maintaining applications in AWS
Work across multiple development workstreams while supporting scalable, resilient, and extensible architecture
Ensure technology decisions align with Fidelity architecture standards and strategies
Evaluate and recommend technologies and frameworks to support flexibility, long-term viability, and time to market
Collaborate with peers via code reviews, pair programming, and daily discussions across multiple squads

Bachelor's degree in Computer Science, Information Systems, or a related field, with a proven track record in data engineering
6+ years of software development experience
6+ years developing Spark or Spring Batch services for data movement
Experience scheduling, monitoring, and debugging ETL batch jobs using Spring Batch and Spark
Hands-on experience with Java clients consuming REST and SOAP APIs, plus Scala Spark batch applications
Experience developing, testing, deploying, and maintaining ETL batch jobs using Spring Batch and Apache Spark/EMR
Experience using Apache Spark for big data processing and writing to Cassandra or Yugabyte
Proven experience building and deploying solutions on public cloud providers such as AWS
Strong understanding of the full software development lifecycle: analysis, design, coding, testing, problem resolution, and planning
Strong collaboration and communication skills, including working across multiple squads and adapting to change
Experience with cloud-based data warehousing and data lake solutions such as Snowflake
Experience with data storage and management for large datasets, including Parquet and HDF5

Competitive compensation
Comprehensive insurance options
Matching contributions through the 401(k) plan and the share purchase plan
Paid time off for vacation, holidays, and sick time
Paid parental leave
Learning opportunities and tuition assistance
Wellness and well-being programs

CGI is required in some jurisdictions to include a reasonable estimate of the compensation range for this role.
CGI benefits are offered to eligible professionals on their first day of employment.
All U.S. employment offers are contingent upon successful completion of a background investigation.
Qualified applicants will receive consideration without regard to protected statuses as required by applicable laws.
CGI provides reasonable accommodations to qualified individuals with disabilities; to request an accommodation to apply in the U.S., email US_Employment_Compliance@cgi.com.

New Spring Batch Data Jobs, daily.