DataJobs.io
← Back to all jobs
Capgemini

AWS/Kafka Data Engineer - Senior Software Engineer

Capgemini
Atlanta, GA $89k - $166k/yr Full time Posted 3d ago
Backend Developer Aws Data Engineer Aws Data Engineering Big Data Cloud Engineer Data Analysis Data Analytics Data Architecture Data Engineer Data Engineering Data Engineering Director Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Database Databases Engineer Event Driven Architecture Kafka Kafka Connect Kafka Streams SQL Stream Processing Streaming Data
Apply Now

Job Description

Capgemini is hiring a Senior AWS and Kafka Data Engineer to design, build, and deploy real-time and batch data pipelines. This hybrid position supports delivery across multiple U.S. locations, including Atlanta, and involves using AWS and Apache Kafka to integrate enterprise data sources with downstream data lakes and platforms.

Role Responsibilities

  • Design, build, and deploy robust real-time and batch data pipelines that integrate disparate ERP sources with downstream data lakes and platforms.
  • Use Apache Kafka, Kafka Connect, and stream processing engines such as Kafka Streams or Apache Flink to process and transform high-volume change data capture (CDC) and transactional data.
  • Build resilient microservices and integration layers using Java and Spring Boot to coordinate complex data flows and enterprise APIs.
  • Package applications into Docker containers and support scalable deployments using Kubernetes, including service discovery and container orchestration.
  • Optimize multi-database environments across PostgreSQL, MySQL, SQL Server, and Oracle.
  • Manage Infrastructure as Code with Terraform or AWS CloudFormation and implement automated CI/CD deployment pipelines using GitHub Actions.
  • Implement end-to-end monitoring, APM, log management, and alerting using tools such as DataDog, New Relic, or Splunk to support pipeline health and transactional accuracy.

Required Qualifications

  • 10+ years of software and/or data engineering experience.
  • Strong proficiency in AWS, Kafka, Java, Spring Boot, and Python.
  • Expertise in AWS Managed Kafka (data and integration), including experience designing and configuring AWS Managed Kafka.
  • Experience working with PostgreSQL, MySQL, SQL Server, and Oracle.

Technologies

AWS, Apache Kafka, Kafka Connect, Kafka Streams, Apache Flink, Java, Spring Boot, Docker, Kubernetes, PostgreSQL, MySQL, SQL Server, Oracle, Terraform, AWS CloudFormation, GitHub Actions, DataDog, New Relic, Splunk, AWS Managed Kafka.

Compensation

The base compensation range for this role in the posted location is USD 89,400 - 166,398 per year.

In addition to base salary, this role may be eligible for additional compensation such as variable incentives, bonuses, or commissions, depending on the position and applicable laws.

Benefits

  • Paid time off based on employee grade (A-F): vacation 12-25 days depending on grade, plus company paid holidays, personal days, and sick leave.
  • Medical, dental, and vision coverage (or provincial healthcare coordination in Canada).
  • Retirement savings plans (for example, 401(k) in the U.S., RRSP in Canada).
  • Life and disability insurance.
  • Employee assistance programs.

Location

This is a hybrid role based across locations, including Atlanta, Dallas, Chicago, Nashville, and New Jersey. The posted location is Atlanta, GA 30305.

Similar Jobs