DataJobs.io
← Back to all jobs

Job Description

Data Engineer II role focused on building and modernizing enterprise data integration pipelines for operational analytics and machine learning.

Responsibilities

  • Work within the Data & Analytics team in the Warehousing & Pipelines function, partnering with DBAs, Data Architects, BI Developers, Data Scientists, Software Engineers, and business stakeholders
  • Design, develop, test, deploy, and maintain batch and streaming data pipelines for payment processing systems with strict availability and performance requirements
  • Build data integration solutions using SQL, C#, Python, PowerShell, and related automation technologies
  • Develop and support event-driven architectures using Change Data Capture (CDC), Kafka, messaging platforms, and stream-processing technologies
  • Develop, maintain, and modernize legacy data integration solutions, including SQL Server Integration Services (SSIS), moving workloads toward code-first, version-controlled development practices
  • Create and maintain CI/CD pipelines for data integration, analytics, and data platform solutions
  • Implement monitoring, logging, alerting, and observability capabilities for data platforms and pipelines
  • Coordinate with Data Architects and enterprise data governance teams to populate and maintain enterprise data warehouse, lakehouse, and analytical data platform solutions
  • Tune SQL queries and database interactions to reduce impact to source systems and improve application performance
  • Optimize pipelines to improve throughput, scalability, resiliency, and cost efficiency
  • Produce and maintain technical documentation, architectural diagrams, operational runbooks, and deployment procedures
  • Use AI-assisted development tools responsibly to improve productivity and code quality, while independently validating, reviewing, and testing all generated code
  • Participate in on-call rotations and provide after-hours support as required
  • Perform other job duties as assigned

Requirements

  • Bachelor's degree in Computer Science, Information Technology, or Engineering
  • Minimum 3 years of experience in data engineering, software engineering, or database development
  • Experience developing solutions on relational database platforms such as SQL Server and/or MySQL
  • Experience developing applications or services using C# or similar object-oriented programming languages
  • Experience developing and supporting ETL/ELT and data integration solutions
  • Experience with Git and code review or pull request workflows
  • Experience with containerization technologies such as Docker

Nice to Have

  • Experience modernizing legacy analytics platforms, OLAP solutions, or analytical workloads
  • Experience with cloud services and data platforms in GCP, AWS, and/or Azure
  • Experience with Infrastructure as Code (IaC) using Terraform, Pulumi, Bicep, Ansible, or similar technologies
  • Experience building and supporting Kubernetes-based applications and services
  • Experience building and supporting data lakes, lakehouses, and open table format solutions using technologies such as Apache Iceberg, Delta Lake, Hudi, Parquet, or similar platforms
  • Experience operating under PCI DSS, SOC, financial services, healthcare, or similar regulatory frameworks

Technologies

  • SQL, C#, Python, PowerShell
  • Change Data Capture (CDC), Kafka
  • SQL Server Integration Services (SSIS)
  • CI/CD, Git, Docker
  • MySQL, ETL/ELT

Location / Onsite Interview Requirement

  • Remote role located in Allen, TX 75013; candidates must live within approximately a 70-mile radius of office locations in Allen, TX, Lenexa, KS, Springfield, MO, Monett, MO, Louisville, KY, Troy, MI, or Birmingham, AL
  • All positions may require an onsite interview or in-person onboarding to verify identity

Similar Jobs