Data Engineer 5 (Enterprise Platforms Technology)

Capital One is building cloud-first data platforms to support a major transformation across the enterprise, and is looking for a Data Engineer 5 to help deliver and operate modern data solutions. This role works at the intersection of engineering and analytics, collaborating with teams to design, develop, test, implement, and run scalable data pipelines and platforms using contemporary data engineering practices.

This position is based in New York, NY (onsite) and offers an annual salary range of USD 250,800 - 286,200. Capital One expects candidates to bring 6+ years of relevant experience and a Bachelor’s Degree in Computer Science or a related quantitative field.

What you’ll do

• Work with Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
• Influence developers, data analysts, and data scientists with experience spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Build solutions using Python and Spark, leveraging open-source relational and NoSQL databases and cloud data warehousing platforms including Databricks and Snowflake
• Collaborate with product managers and software engineers to deliver robust cloud-first data solutions that help power customer experiences for millions of Americans
• Independently design, build, and deliver cloud data solutions and applications with limited guidance from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
• Design and build pipelines and platforms with a focus on scalability, resilience, and operational efficiency to meet increasing performance needs
• Serve as a data engineering ambassador by communicating technical concepts and data outcomes clearly to internal and external stakeholders
• Act as a force-multiplier by balancing hands-on engineering contribution and innovation with mentoring and elevating peers and junior engineers
• Lead end-to-end, large-scale data initiatives, including critical architectural decisions and platform evaluations (for example, Snowflake vs. Databricks) based on technical and business requirements

Requirements

• Bachelor’s Degree or higher in Computer Science or a related quantitative field: Statistics, Economics, Operations Research, Analytics, Mathematics, or Engineering
• 6+ years of application development experience (internship experience does not apply)
• 4+ years of experience with distributed data
• 4+ years of experience with SQL
• 4+ years of programming with at least one: Python, Java, or Scala
• 4+ years designing and developing data pipelines
• 2+ years in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Technologies you may work with

• Python, Spark, Databricks, Snowflake, SQL, NoSQL databases
• EMR, Glue, AWS, Microsoft Azure, Google Cloud
• Airflow, Dagster, Monte Carlo, Splunk
• MongoDB, Cassandra, DynamoDB, Redshift
• Java, Scala

Additional information

• This role may include performance-based incentive compensation, which may consist of cash bonus(es) and/or long term incentives (LTI)
• Capital One will consider sponsoring a new qualified applicant for employment authorization for this position
• Applications are expected to be accepted for a minimum of 5 business days
• No agencies please
• Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
• Capital One promotes a drug-free workplace
• Accommodation and recruiting contact details are available via Capital One Recruiting and [email protected]