DataJobs.io
← Back to all jobs
Robert Half

Data Engineer

Robert Half
Brookfield, WI $100k - $130k/yr Full time Posted 12d ago
Big Data Bigdata Data Data Analysis Data Architecture Data Engineer Data Integration Data Pipeline Data Pipelines Data Platform Data Processing Data Warehouse Database Engineer ETL Hadoop Informatica Information Technology (IT) Kafka Spark Streaming Data
Apply Now

Job Description

The Data Engineer position in Brookfield, WI is responsible for developing and expanding a cloud-focused data environment that supports analytics, reporting, automation, and emerging AI use cases. The role partners with technical and business teams to deliver scalable and dependable pipelines and platform solutions.

Responsibilities

  • Design, build, and maintain scalable data pipelines that move and transform information for analytics, reporting, and operational needs.
  • Work with business stakeholders, analysts, software developers, and leaders to understand data requirements and deliver reliable engineering solutions.
  • Develop and refine data models and platform architecture to support performance, flexibility, and long-term growth.
  • Implement ETL processes that integrate data from multiple sources while improving consistency, completeness, and accessibility.
  • Use Python and distributed data technologies, including Apache Spark and Hadoop, to process large and complex datasets efficiently.
  • Support streaming and event-driven workflows using tools such as Apache Kafka when real-time delivery is required.
  • Monitor data quality, troubleshoot pipeline issues, and optimize workflows to ensure dependable delivery and strong system performance.
  • Identify opportunities to improve scalability, automation, and engineering standards across ongoing data platform enhancements.
  • Bring experience in data engineering with a strong record of building and supporting production data pipelines.

Requirements

  • Hands-on proficiency in Python for data processing, transformation, and workflow development.
  • Experience working with Apache Spark for large-scale data workloads.
  • Familiarity with Hadoop-based ecosystems and distributed data processing concepts.
  • Practical knowledge of Apache Kafka or similar streaming technologies for real-time data movement.
  • Strong understanding of ETL design, implementation, and optimization across varied data sources.
  • Ability to collaborate with cross-functional teams and translate business needs into technical solutions.

Technology Stack

  • Python
  • Apache Spark
  • Hadoop
  • Apache Kafka

Location

Brookfield, WI (onsite)

Compensation

USD 100,000 - 130,000 per year

Benefits

  • Medical, vision, dental, and life and disability insurance (for contract/temporary professionals)
  • 401(k) plan eligibility for hired contract/temporary professionals

Similar Jobs