DataJobs.io
← Back to all jobs

Job Description

Phoenix, AZ (onsite)

Join Sgn Global Technologies to build and improve large-scale Big Data and analytics solutions on GCP. This role focuses on designing reliable data pipelines, optimizing data models for performance, and supporting event-driven processing using modern cloud tooling. If you bring hands-on data engineering experience (6 to 8 years) and strong Big Data fundamentals, you will have the opportunity to deliver data platforms that scale.

What you’ll do

  • Design, develop, and optimize data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
  • Use SQL and database systems to design and optimize data models with a focus on performance and scalability.
  • Build event processing pipelines using Kafka or GCP PubSub.
  • Apply knowledge of distributed (multi-tiered) systems, algorithms, and relational databases to support scalable data solutions.

What you bring

  • 6 to 8 years of Data Engineering experience in a Big Data environment.
  • Hands-on software development experience with Big Data & Analytics solutions.
  • Experience with Hadoop Hive, Spark, Python, and shell scripting, plus GCP services such as BigQuery, Airflow, DataProc, and PubSub.
  • Proficiency in SQL and database systems.
  • Experience designing and optimizing data models for performance and scalability.
  • Experience building event processing pipelines using Kafka or GCP PubSub.
  • Experience with CI/CD pipelines, automated test frameworks, and source code management tools including XLR, Jenkins, and Git.
  • Good knowledge and experience with configuration management tools such as GitHub.

Technologies you’ll work with

Hadoop Hive, Spark, Python, shell scripting, GCP BigQuery, Airflow, DataProc, PubSub, SQL, Kafka, CI/CD pipelines, automated test frameworks, XLR, Jenkins, Git, GitHub.

Compensation

$85,700 - $104,000 per year

Similar Jobs