DataJobs.io
← Back to all jobs
Dahl Consulting

Data Engineer

Dahl Consulting
Brooklyn Park, MN $48 - $75/hr Contract Posted 13d ago
Big Data Bigdata Cloud Cloud Infrastructure Cloud Native Cloud Platform Cloud Platforms Cloud Technology Data Data Analysis Data Analytics Data Architecture Data Engineer Data Integration Data Lake Data Lakehouse Data Pipeline Data Pipelines Data Platform Data Processing Data Warehouse Database Databases Dataproc DevOps DevSecOps Engineer ETL Google Cloud Google Cloud Bigquery Informatica Information Technology (IT) Kafka Programming Language Programming Languages Spark SQL Stream Processing Streaming Data
Apply Now

Job Description

Dahl Consulting is hiring a Data Engineer for a contract position in Brooklyn Park, MN with a hybrid work arrangement. The role supports large-scale data modernization and analytics initiatives, with a focus on scalable data platforms and dependable batch and streaming pipelines on Google Cloud Platform.

Key Responsibilities

  • Design, develop, test, and maintain scalable data pipelines and ETL/ELT workflows for high-volume datasets.
  • Build and optimize distributed data processing solutions using Apache Spark and GCP Dataproc.
  • Create and maintain analytical datasets and processing workloads in BigQuery.
  • Develop reliable batch and streaming data solutions using Spark, Hadoop, and Kafka.
  • Design and support data ingestion and transformation pipelines spanning source systems, data lakes, and analytics platforms.
  • Optimize Spark and BigQuery workloads for performance, scalability, reliability, and cost efficiency.
  • Investigate and resolve production issues through troubleshooting, root-cause analysis, and implementation of long-term fixes.
  • Implement data quality controls, monitoring, logging, and alerting, along with operational processes.
  • Apply software engineering and DevOps best practices, including source control, CI/CD pipelines, automated testing, and deployment automation.
  • Collaborate with cross-functional teams to translate business requirements into scalable data solutions.
  • Participate in code reviews and contribute to reusable frameworks, standards, and engineering best practices.

Required Qualifications

  • Proven experience in Data Engineering with a track record of building and supporting production-grade data pipelines.
  • Hands-on experience designing and developing ETL/ELT solutions.
  • Experience working with Google Cloud Platform (GCP).
  • Strong expertise with BigQuery, including SQL development, performance tuning, and query optimization.
  • Hands-on experience with Apache Spark and distributed data processing frameworks.
  • Experience with GCP Dataproc.
  • Knowledge of Hadoop, Hive, Kafka, and the Apache Spark ecosystem.
  • Strong SQL skills, including processing and analyzing large datasets.
  • Proficiency in Python and/or Java/Scala.
  • Understanding of data modeling, partitioning strategies, distributed computing concepts, and common data storage formats.
  • Experience with DevOps practices, including Git, CI/CD, automated deployments, and production support.
  • Strong analytical, troubleshooting, and problem-solving skills.

Preferred Qualifications

  • Experience with Looker and/or LookML.
  • Experience working with Google Cloud Storage (GCS), BigLake, Hive, Apache Iceberg, and Parquet.
  • Experience with Infrastructure as Code (IaC) tools such as Terraform.
  • Experience building and supporting Kafka-based streaming pipelines.
  • Experience migrating data platforms or workloads from on-premises Hadoop/Hive environments to GCP.
  • Experience supporting large-scale data lake, cloud migration, or data platform modernization initiatives.
  • Familiarity with data governance, data quality, lineage, metadata management, and related best practices.

Technologies

Google Cloud Platform (GCP), Google Cloud Dataproc, BigQuery, Apache Spark, Apache Hadoop, Kafka, Apache Hive, SQL, Python, Java, Scala, Git, CI/CD, Hadoop, GCS, BigLake, Apache Iceberg, Parquet, Terraform, Looker, LookML, Infrastructure as Code (IaC).

Compensation and Job Details

  • Location: Brooklyn Park, MN (hybrid)
  • Job Type: Contract
  • Pay: USD 48 - 75 per hour

Benefits

Dahl Consulting is proud to offer a comprehensive benefits package to eligible employees that will allow you to choose the best coverage to meet your family’s needs. For details, please review the DAHL Benefits Summary: https://www.dahlconsulting.com/benefits-w2fta/.

How to Apply

Click the apply button to complete the mobile-friendly online application. After the application is reviewed, a recruiter will reach out with next steps.

Similar Jobs