Data Engineer 4 - Payment Networks

Capital One is building cloud-first data solutions for payment networks, and is looking for a Data Engineer 4 to help drive scalable, secure data platforms and pipelines. You will work across Agile teams to design and deliver production-ready solutions, using modern distributed systems and lakehouse architecture while mentoring and sharing knowledge with the data community.

Compensation & location

• McLean, VA (onsite)
• Salary: USD 197,300 - 225,100 per year

What you’ll do

• Collaborate across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
• Guide a team of developers, data analysts, and data scientists with experience spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Build and iterate with Python and Spark, leveraging open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
• Deliver cloud-first data solutions with product managers and software engineers to support experiences that help millions of Americans achieve financial empowerment
• Independently design, build, and deliver world-class cloud data solutions with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability
• Create data pipelines and platforms focused on scalability, resilience, and operational efficiency, maintaining performance as data volume and business demands grow
• Implement data security standards, including encryption at rest/transit and fine-grained access control, to support compliance with data privacy regulations
• Act as an ambassador for the data engineering team by communicating technical concepts and data outcomes clearly to internal and external stakeholders
• Stay current with data trends, experiment with new technologies, and mentor others through internal and external technical communities

Skills and qualifications

• Bachelor’s degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• 4+ years of experience in application development (internship experience does not apply)
• 2+ years of experience in distributed data
• 2+ years of experience with SQL
• 2+ years with one programming language: Python, Java, or Scala
• 2+ years of experience in data pipeline design and development
• 1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Technology areas

• Python, Spark
• Databricks, Snowflake
• SQL
• Open-source relational databases and NoSQL databases
• Encryption at rest/transit and fine-grained access control
• Relational database systems and non-relational database systems

Benefits

• Comprehensive, competitive, and inclusive set of health, financial and other benefits
• Performance based incentive compensation may include cash bonus(es) and/or long term incentives (LTI)

Preferred qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years of hands-on experience designing, deploying, and operating data workloads in a public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
• 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years of experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years of experience working in an Agile development environment
• 2+ years of experience developing user-centric reusable data products

Employment authorization / immigration support: Capital One will not sponsor a new applicant for employment authorization, or offer any immigration related support for this position.

Other details

• Applications are expected to be accepted for a minimum of 5 business days
• No agencies please
• Capital One is an equal opportunity employer committed to non-discrimination in compliance with applicable laws
• Capital One promotes a drug-free workplace
• Capital One will consider for employment qualified applicants with a criminal history in a manner consistent with applicable laws
• If you require an accommodation, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected]
• For technical support or questions about Capital One’s recruiting process, email [email protected]