Phoenix, AZ (onsite)
Join Sgn Global Technologies to build and improve large-scale Big Data and analytics solutions on GCP. This role focuses on designing reliable data pipelines, optimizing data models for performance, and supporting event-driven processing using modern cloud tooling. If you bring hands-on data engineering experience (6 to 8 years) and strong Big Data fundamentals, you will have the opportunity to deliver data platforms that scale.
What you’ll do
- Design, develop, and optimize data pipelines for large-scale data processing, transformation, and analysis using Big Data and GCP technologies.
- Use SQL and database systems to design and optimize data models with a focus on performance and scalability.
- Build event processing pipelines using Kafka or GCP PubSub.
- Apply knowledge of distributed (multi-tiered) systems, algorithms, and relational databases to support scalable data solutions.
What you bring
- 6 to 8 years of Data Engineering experience in a Big Data environment.
- Hands-on software development experience with Big Data & Analytics solutions.
- Experience with Hadoop Hive, Spark, Python, and shell scripting, plus GCP services such as BigQuery, Airflow, DataProc, and PubSub.
- Proficiency in SQL and database systems.
- Experience designing and optimizing data models for performance and scalability.
- Experience building event processing pipelines using Kafka or GCP PubSub.
- Experience with CI/CD pipelines, automated test frameworks, and source code management tools including XLR, Jenkins, and Git.
- Good knowledge and experience with configuration management tools such as GitHub.
Technologies you’ll work with
Hadoop Hive, Spark, Python, shell scripting, GCP BigQuery, Airflow, DataProc, PubSub, SQL, Kafka, CI/CD pipelines, automated test frameworks, XLR, Jenkins, Git, GitHub.
Compensation
$85,700 - $104,000 per year