Senior Data Engineer

Senior Data Engineer role at Sgn Global Technologies, a remote W2 position focused on building and maintaining SQL databases, ELT/ETL pipelines, and data processing using Python, PySpark/Polars, Azure Synapse Analytics, and Azure Machine Learning.

Responsibilities

• Maintain SQL databases and perform advanced SQL and T‑SQL operations to ensure data integrity and performance.
• Design, implement, and sustain ELT/ETL pipelines within cloud-based analytics environments.
• Collaborate with Azure Synapse Analytics and Azure Machine Learning in the modern data stack; DP-203 certification or equivalent is preferred.
• Manipulate and transform data using Python, with Pandas proficiency required.
• Work with PySpark and/or Polars to process large-scale datasets as needed.

Requirements

• Bachelor’s degree in Data Engineering, Computer Science, Data Science, Machine Learning, Mathematics, or a related field, or 5+ years of relevant applied work experience.
• 5+ years hands-on experience maintaining SQL databases and performing advanced SQL and T‑SQL operations.
• 5+ years hands-on experience designing, implementing, and maintaining ELT/ETL pipelines in cloud-based data analytics environments.
• 3+ years hands-on experience with Azure Synapse Analytics and Azure Machine Learning using the modern data stack; DP-203 (or equivalent) certification is preferred.
• Data manipulation using Python with Pandas required.
• Experience with PySpark and/or Polars is preferred.

Technologies

• SQL
• T‑SQL
• Azure Synapse Analytics
• Azure Machine Learning
• Python
• Pandas
• PySpark
• Polars