Senior Data Engineer

Mastercard offers a hybrid data engineering role in O’Fallon, MO (three days onsite per week) where you’ll design and scale cloud-enabled data platforms and Lakehouse/warehouse solutions. This position supports analytics, BI, regulatory reporting, and data-driven decision making while working with modern distributed computing and enterprise architecture standards.

What you’ll do

• Design, develop, test, and deploy secure, scalable, high-performance, resilient data pipelines using Apache Spark, Java/Scala, Hadoop, and cloud object storage.
• Build and maintain batch and near-real-time processing frameworks for petabyte-scale workloads and strict enterprise data requirements.
• Create reusable engineering components, frameworks, and design patterns to speed up data product delivery while meeting enterprise architecture and engineering standards.
• Implement build once, run anywhere architectures that support deployment across on-premises and public cloud environments without code changes.
• Deliver enterprise data capabilities such as data lineage, metadata management, data cataloging, data quality, monitoring, and observability across the data ecosystem.
• Partner with architects and platform teams to establish scalable architecture patterns, distributed computing practices, and engineering standards, driving adoption of modern Lakehouse approaches.
• Support cloud modernization by migrating legacy ETL, data warehouse, and analytics workloads to cloud-native architectures using Amazon S3, EMR, and AWS Glue.
• Lead end-to-end engineering activities, including requirements analysis, solution design, coding, testing, deployment, production support, and continuous optimization.
• Troubleshoot complex production incidents, perform root cause analysis, and implement sustainable remediation aligned with Mastercard’s security, quality, and operational governance standards.
• Mentor engineers through code reviews, technical coaching, knowledge sharing, and best practices, and identify opportunities to improve performance, automation, monitoring, and engineering efficiency.

What you bring

• Hands-on experience as a Data Engineer or Senior Data Engineer delivering enterprise-scale Data Warehouse, Data Lake, or Data Lakehouse solutions.
• Proven ability delivering multiple end-to-end data engineering initiatives in large-scale distributed computing environments.
• Hands-on experience migrating ETL/ELT, data warehouse, and analytics workloads from on-premises to cloud-native architectures.
• Strong development experience with Apache Spark, Scala and/or Java, the Hadoop ecosystem, and cloud object storage platforms.
• Experience building orchestration and workflow solutions using Apache Airflow, Apache NiFi, or comparable enterprise scheduling frameworks.
• Strong SQL skills and experience working with relational and NoSQL databases, including Oracle, SQL Server, Cassandra, and DynamoDB.
• Working knowledge of cloud platforms, preferably AWS, including Amazon S3, EMR, AWS Glue, and other cloud-native data services.
• Strong understanding of security, privacy, regulatory, and compliance requirements for sensitive financial and customer data.
• Proven ability to lead complex technical initiatives across teams and influence engineering direction without direct authority.
• Demonstrated mentorship capability, including design guidance, knowledge sharing, and constructive feedback.
• Excellent communication and stakeholder management skills, with the ability to explain technical concepts, trade-offs, risks, dependencies, and recommendations to technical and business audiences.
• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related STEM discipline (or equivalent practical experience).

Tools you’ll use

• Apache Spark
• Java, Scala
• Hadoop
• Apache Airflow, Apache NiFi
• Amazon S3, Amazon EMR, AWS Glue

Benefits

• Competitive base salary; may be eligible for an annual bonus or commissions depending on the role.
• Insurance including medical, prescription drug, dental, vision, disability, and life.
• Flexible spending account and health savings account.
• Paid leaves including 16 weeks of new parent leave and up to 20 days of bereavement leave.
• 80 hours of Paid Sick and Safe Time, 25 days of vacation time, and 5 personal days (pro-rated based on date of hire).
• 10 annual paid U.S. observed holidays.
• 401(k) with a best-in-class company match.
• Deferred compensation for eligible roles.
• Fitness reimbursement or on-site fitness facilities.
• Eligibility for tuition reimbursement.
• For eligible interns: 56 hours of Paid Sick and Safe Time, jury duty leave, and on-site fitness facilities in some locations.

Security responsibility

• Abide by Mastercard’s security policies and practices.
• Ensure confidentiality and integrity of information accessed.
• Report suspected information security violations or breaches.
• Complete all periodic mandatory security trainings per Mastercard guidelines.

Pay range (O'Fallon, Missouri): $115,000 - $184,000 USD per year.