Data Engineer 4 (Manager, IC)

Capital One is building robust, cloud-first data capabilities to support a major transformation, with a focus on scalable, secure data pipelines and platforms. This role partners closely with product managers and software engineers while working within Agile teams to design, develop, test, implement, and support end-to-end solutions. You will also contribute as a technical influencer and mentor, helping drive shared understanding of data outcomes across stakeholders.

What you’ll do

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
• Influence a team of developers, data analysts, and data scientists with experience spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Build using Python and Spark, leveraging open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
• Design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across pipelines and platforms
• Create data pipelines and platforms focused on scalability, resilience, and operational efficiency, maintaining performance as data volume and business demands grow
• Implement data security standards, including encryption at rest and in transit and fine-grained access control, aligned to data privacy regulations
• Serve as an ambassador for the data engineering team by communicating technical concepts and data outcomes clearly to internal and external stakeholders
• Stay current with data trends, experiment with and learn new technologies, participate in internal and external technology communities, and mentor other members of the data community

Technology focus

• Python, Spark, SQL, Databricks, Snowflake
• NoSQL and open-source relational databases
• Encryption at rest and transit, fine-grained access control

Requirements

• Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
• At least 4 years of experience in application development (internship experience does not apply)
• At least 2 years of experience in distributed data
• At least 2 years of experience with SQL
• At least 2 years of experience with one programming language: Python, Java, or Scala
• At least 2 years of experience in data pipeline design and development
• At least 1 year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Preferred qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years of hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years of experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
• 4+ years of experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years of experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years of experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years of experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years of experience working in an Agile development environment
• 2+ years of experience developing user-centric reusable data products

Location and compensation

• New York, NY (onsite): USD 215,200 - 245,600 per year
• McLean, VA: USD 197,300 - 225,100 per year

Benefits

Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits that support your total well-being.

Additional eligibility and employment information

• Capital One will not sponsor a new applicant for employment authorization or provide immigration related support for this position.
• This role may be eligible for performance-based incentive compensation, including cash bonus(es) and/or long term incentives (LTI).
• Capital One expects to accept applications for a minimum of 5 business days.
• No agencies please. Capital One is an equal opportunity employer (EOE), committed to non-discrimination in compliance with applicable federal, state, and local laws.
• Capital One promotes a drug-free workplace.
• If you need an accommodation to apply, contact Capital One Recruiting at 1-800-304-9102 or via email at [email protected].
• For technical support or questions about the recruiting process, email [email protected].