Data Factory

Data Factory Jobs

3 jobs found

2d ago

Senior Data Engineer

United Therapeutics Research Triangle Park, NC

Research Triangle Park, NC

2d ago

Full time Senior Azure Azure Data Factory

Apply Now

Job Description

Senior Data Engineer role at United Therapeutics focused on designing and operating enterprise data and analytics infrastructure with reliable data delivery across the organization.

Responsibilities

Design, build, and optimize ETL/ELT pipelines using Databricks and Azure Data Factory for enterprise data warehousing and analytics
Partner with stakeholders to deliver data access and security controls
Support daily data processing operations, including monitoring, alerting, and issue resolution
Collaborate with analysts, data scientists, and other stakeholders to translate data requirements into solutions
Provide technical guidance and mentorship to junior data engineers and teammates, including reviewing and validating work delivered by external consultants
Monitor and troubleshoot data systems such as SQL databases and Databricks to maintain performance and reliability
Implement best practices for data management and lead initiatives to improve tools, practices, and processes
Participate in code reviews, design discussions, and contribute to technical documentation
Provide consultation and leadership for business intelligence and analytics platforms

Requirements

5+ years of experience building and maintaining business-critical EDW and pipelines with a Bachelor’s Degree
3+ years of data architecting and engineering with a proven record of delivering complex data solutions
3+ years of Tier 1 SaaS integration experience (e.g., Salesforce) or equivalent
3+ years working with AppDev and/or BI/AI team members
Advanced SQL skills, including complex query development, performance tuning/optimization, and stored procedure development
Hands-on, production-level experience with Azure Databricks including Spark data processing, notebooks, and Delta Lake
Hands-on, production-level experience with Azure Data Factory building, orchestrating, and monitoring ETL/ELT pipelines
Hands-on experience with cloud platforms, with Azure preferred
Proficiency in Python (or comparable programming languages listed)
Understanding of data warehousing concepts
Highly proficient working with custom applications and complex data platforms beyond off-the-shelf systems
Excellent problem solving and analytical skills with strong communication and interpersonal skills
Ability to manage multiple priorities and projects in or outside of a team
Demonstrated experience delivering data processing reliability
Proficiency working with business intelligence and analytical platforms

Technologies

Databricks
Azure Data Factory
SQL Databases
SQL
Azure Databricks
Spark
Notebooks
Delta Lake
Azure
ETL/ELT
Salesforce
Python

Benefits

Medical / dental / vision / prescription coverage
Employee wellness resources
Savings plans (401k and ESPP)
Paid time off
Paid parental leave benefits
Disability benefits

Location

Located in the RTP, NC office of United Therapeutics
Hybrid role requiring at least three days per week in the office
In-office requirements could increase based on business needs

View full job page →

7d ago

Senior Data Engineer

Suncoast Credit Union Tampa, FL 📍 Florida Remote

Tampa, FL

7d ago

$86k - $115k/yr Full time Senior Azure Data Factory Azure Data Platform

Apply Now

Job Description

As a Senior Data Engineer at Suncoast Credit Union, you will design, evaluate, and test data infrastructure that enables reliable data ingestion, processing, and interpretation. This role supports ETL pipeline development, data modeling and governance, analytics and natural language processing modules, and ongoing collaboration with business partners to translate requirements into scalable data architecture.

Key Responsibilities

Build systems and infrastructure to collect and process data aligned to company needs and goals.
Build, evolve, and scale infrastructure to ingest, process, and extract meaning from data.
Design, develop, and implement statistical models for classification and information extraction.
Use existing infrastructure to fulfill data-related requests, including data housekeeping, cleansing, normalization, hashing, and implementing required data model changes.
Analyze data to identify anomalies, trends, and correlations across related datasets.
Design, develop, and implement natural language processing software modules.
Troubleshoot issues, identify potential solutions, and resolve them accordingly.
Partner with business counterparts to define data requirements and update requirement document templates.
Work with the manager to translate business requirements into appropriate schema and data models.
Ensure design efficiency to minimize data refresh lag between systems so reporting remains timely.
Deploy data architectures based on manager-defined standards that support Suncoast’s data strategy and information architecture.
Follow measurable processes, tools, and engineered data management solutions to support data platforms including data warehouses, lakes, visualization tools, master data management, and advanced analytics tools.
Design and develop ETL processes to extract data from multiple source systems, transform it for usability, and load it into data platforms.
Establish data governance and quality standard operating procedures and best practices.
Use Azure Data Factory to create pipelines that create, move, and transform data across the data stack.
Architect advanced data solutions for current and future processes.
Mentor teammates and provide advisory support.
Maintain knowledge of current trends, laws, and issues impacting the area of expertise.
Attend educational events to increase professional knowledge.
Complete annual compliance and information security training to understand employee responsibilities related to effective programs.

Required Qualifications

Bachelor’s degree in finance, economics, computer science, mathematics, or a related field (a comparable combination of work experience and training may substitute for education).
7+ years of experience making data usable to end users in a complex data environment.
7+ years of experience with Microsoft SQL Server platforms, including SSRS, SSAS, stored procedure creation, trigger definition and implementation, and optimizing and indexing, plus foundational knowledge of views, tables, database DDL, and SQL Server Integration Services (SSIS).
Experience using Development Transact SQL.
Microsoft Azure (5 years): portal and resource navigation.
Azure Data Factory (5 years): developing pipelines, pipeline activities, troubleshooting, etc.
REST API experience.
GitHub experience creating, updating, and submitting code.
Agile methodology (1 year): Kanban method of limiting work in progress.
Experience developing ETL processes.
Experience with Delta Lakes and Lakehouse Architecture.
2+ years of experience designing data structure for a production environment.
Ability to prioritize tasks by managing competing and changing priorities to meet deadlines.
Accurate, detail-oriented, and organized approach to task management.
Ability to analyze and resolve difficult and often complex problems.
Strong written, verbal, and interpersonal communication skills to work with members, staff, vendors, and government regulators.
Strong knowledge of credit union products, services, policies, and procedures, including credit union computer systems and required software applications.
Strong knowledge and understanding of regulatory compliance.

Technologies

Microsoft SQL Server
SSRS
SSAS
Stored Procedure Creation
Trigger definition and implementation
SQL Server Integration Services (SSIS)
Development Transact SQL
Microsoft Azure
Azure Data Factory
REST API
GitHub
Agile Methodology and Kanban
Delta Lakes
Lakehouse Architecture

Compensation and Position Details

Compensation: $86,000 to $115,000 per year (based on credentials and experience).
Location: Remote; candidate must reside in Florida.
Position Type: Full Time.

Benefits

Bonus Program up to 12%
401K Matching up to 8%
Retirement Planning
Pay Increases based on Competency
Employee Loan Discounts
Flex Spending Accounts
Medical Coverage
Dental and Vision Coverage
Access to 4,000+ Gyms
Mental Health Resources
PTO Wellness Days
Short Term and Long Term Disability Coverage
11 Paid Holidays
3 weeks of Paid Time Off
4 weeks of Paid Parental Leave
Birthday PTO
Paid Volunteer Hours
Degree Assistance up to $5,000 per year

For more information, including additional benefits, please visit: https://careers.suncoastcreditunion.com/benefits.

Company Overview

Suncoast Credit Union is consistently chosen as a Tampa Bay Times Top Workplace because its employees genuinely #LOVEWORK! Employees flourish in an inclusive culture celebrating growth and prioritizing the community. For more information, please visit https://careers.suncoastcreditunion.com/.

View full job page →

7d ago

Data Engineer

Baker Group Ankeny, IA

Ankeny, IA

7d ago

Full time Azure Data Factory Azure Data Platform Azure Platform

Apply Now

Job Description

Baker Group is hiring a Data Engineer to design, build, and maintain data pipelines and infrastructure in Microsoft Fabric. In this onsite role in Ankeny, IA, you will help establish a single source of truth by owning ingestion, transformation, orchestration, governance, and preparation of data for reporting and AI/ML workloads.

You will work across the full data lifecycle, from integrating enterprise systems into Fabric to ensuring curated, trustworthy datasets are ready for analysts, data scientists, and downstream applications. The role also includes infrastructure stewardship, monitoring, and ongoing improvements to support reliable and timely data availability.

What you’ll do

Design, build, and maintain ETL/ELT pipelines that ingest data from enterprise systems into Microsoft Fabric.
Architect and maintain the Fabric medallion Lakehouse structure (bronze, silver, gold) as Baker Group’s single source of truth.
Develop infrastructure and environment best practices, including Development/Test/Production setups and Git-based version control.
Own pipeline orchestration, scheduling, and monitoring to support reliable, timely, and accurate data availability.
Curate and maintain core datasets across employee, finance, project, service, and manufacturing domains.
Establish and enforce data quality controls, including validation and reconciliation across pipelines.
Design and manage data models, schemas, and semantic layers that support Data Analyst reporting and Data Scientist modeling.
Define and maintain data ontologies and canonical business definitions (for example, what constitutes a “project,” “employee,” or “cost code”).
Prepare data for AI and machine learning use cases, including feature-ready datasets, RAG pipelines, and vector embedding storage.
Manage Fabric capacity planning, workspace organization, and performance optimization.
Implement data governance practices aligned with Baker Group’s data classification standards, including access controls, lineage tracking, and metadata management.
Partner with business system owners (including ERP, HRIS, and MRP) to understand upstream structures and manage change impacts.
Collaborate with Data Scientists and Data Analysts to ensure pipeline outputs support modeling, paginated reporting, dashboards, and self-service BI.
Coordinate with Software Development and DevOps teams to support application development needs.
Work with 3rd party consultants when needed to deliver data engineering projects and augment capacity.
Develop and maintain documentation for pipelines, schemas, and integration logic.
Troubleshoot and resolve pipeline failures, latency issues, and data quality incidents.
Monitor and maintain data infrastructure, including Fabric capacity, orchestration tools, and monitoring/alerting systems.
Evaluate and recommend new data engineering tools, patterns, and best practices, and stay current on emerging trends.

What you bring

Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or another relevant quantitative field.
3 to 5 years of experience in data engineering, ETL/ELT development, or a related field.
Proficiency with SQL and database technologies for data extraction, transformation, and loading.
Experience with Microsoft Fabric, Azure Data Factory, or similar cloud ETL/orchestration tools.
Experience with medallion architecture and modern data warehousing patterns.
Programming experience with Python, PySpark, or T-SQL for data transformation.
Familiarity with data modeling techniques such as dimensional modeling and star schema.
Understanding of data governance, data quality, and metadata management practices.

Preferred add-ons

Experience preparing data for AI/ML consumption (for example, vector embeddings and RAG architectures).
Business acumen with understanding of construction or related industries.

Tools and technologies

Microsoft Fabric
ETL, ELT
Azure Data Factory
Git
SQL
Python, PySpark, T-SQL
Medallion architecture
Dimensional modeling, star schema
Retrieval-augmented generation (RAG)
Vector embedding storage

Certifications

No specific requirements; relevant certifications such as Microsoft Certified: Fabric Data Engineer Associate, Azure Data Engineer Associate, or similar are a plus.

Work environment

Prolonged periods of sitting at a desk and working on a computer.
Must be able to lift 10 pounds occasionally.
May have occasional visits to a job site requiring periods of standing, walking, and/or climbing stairs.
Use a computer for 8 hours a day.

View full job page →

Data Factory Jobs

Senior Data Engineer

Senior Data Engineer

Data Engineer

Get Data Factory Jobs alerts