Data Engineer II
Job Description
Data Engineer II role focused on building and modernizing enterprise data integration pipelines for operational analytics and machine learning.
Responsibilities
- Work within the Data & Analytics team in the Warehousing & Pipelines function, partnering with DBAs, Data Architects, BI Developers, Data Scientists, Software Engineers, and business stakeholders
- Design, develop, test, deploy, and maintain batch and streaming data pipelines for payment processing systems with strict availability and performance requirements
- Build data integration solutions using SQL, C#, Python, PowerShell, and related automation technologies
- Develop and support event-driven architectures using Change Data Capture (CDC), Kafka, messaging platforms, and stream-processing technologies
- Develop, maintain, and modernize legacy data integration solutions, including SQL Server Integration Services (SSIS), moving workloads toward code-first, version-controlled development practices
- Create and maintain CI/CD pipelines for data integration, analytics, and data platform solutions
- Implement monitoring, logging, alerting, and observability capabilities for data platforms and pipelines
- Coordinate with Data Architects and enterprise data governance teams to populate and maintain enterprise data warehouse, lakehouse, and analytical data platform solutions
- Tune SQL queries and database interactions to reduce impact to source systems and improve application performance
- Optimize pipelines to improve throughput, scalability, resiliency, and cost efficiency
- Produce and maintain technical documentation, architectural diagrams, operational runbooks, and deployment procedures
- Use AI-assisted development tools responsibly to improve productivity and code quality, while independently validating, reviewing, and testing all generated code
- Participate in on-call rotations and provide after-hours support as required
- Perform other job duties as assigned
Requirements
- Bachelor's degree in Computer Science, Information Technology, or Engineering
- Minimum 3 years of experience in data engineering, software engineering, or database development
- Experience developing solutions on relational database platforms such as SQL Server and/or MySQL
- Experience developing applications or services using C# or similar object-oriented programming languages
- Experience developing and supporting ETL/ELT and data integration solutions
- Experience with Git and code review or pull request workflows
- Experience with containerization technologies such as Docker
Nice to Have
- Experience modernizing legacy analytics platforms, OLAP solutions, or analytical workloads
- Experience with cloud services and data platforms in GCP, AWS, and/or Azure
- Experience with Infrastructure as Code (IaC) using Terraform, Pulumi, Bicep, Ansible, or similar technologies
- Experience building and supporting Kubernetes-based applications and services
- Experience building and supporting data lakes, lakehouses, and open table format solutions using technologies such as Apache Iceberg, Delta Lake, Hudi, Parquet, or similar platforms
- Experience operating under PCI DSS, SOC, financial services, healthcare, or similar regulatory frameworks
Technologies
- SQL, C#, Python, PowerShell
- Change Data Capture (CDC), Kafka
- SQL Server Integration Services (SSIS)
- CI/CD, Git, Docker
- MySQL, ETL/ELT
Location / Onsite Interview Requirement
- Remote role located in Allen, TX 75013; candidates must live within approximately a 70-mile radius of office locations in Allen, TX, Lenexa, KS, Springfield, MO, Monett, MO, Louisville, KY, Troy, MI, or Birmingham, AL
- All positions may require an onsite interview or in-person onboarding to verify identity