Data Engineer 4 (Manager, IC)
Job Description
Build cloud-first data solutions while helping enable financial empowerment for millions of Americans. At Capital One, this Data Engineer 4 (Manager, IC) role blends hands-on engineering with influence across teams as you design, deliver, and continuously improve data pipelines and platforms in a major transformation effort.
What you’ll do
- Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies
- Influence and mentor a team of developers, data analysts, and data scientists with deep expertise spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems
- Develop data pipelines and platforms using Python and Spark, leveraging open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
- Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
- Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability
- Focus on scalability, resilience, and operational efficiency, ensuring strong performance as data volume and business demands grow
- Implement data security standards, including encryption at rest/transit and fine-grained access control, to support compliance with data privacy regulations
- Serve as a data engineering ambassador by communicating technical concepts and data outcomes clearly to internal and external stakeholders
- Stay current with data trends, experiment with new technologies, and participate in internal and external technology communities
- Partner with product managers and software engineers to deliver robust cloud-first data solutions
Skills and qualifications
- Bachelor’s Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
- At least 4 years of experience in application development (internship experience does not apply)
- At least 2 years of experience in distributed data
- At least 2 years with SQL
- At least 2 years with one programming language: Python, Java, or Scala
- At least 2 years of experience in data pipeline design and development
- At least 1 year designing and delivering end-to-end data solutions using both relational and non-relational database systems
Tools and technologies
Python, Spark, Databricks, Snowflake, SQL, NoSQL databases, relational databases, machine learning, distributed microservices, lakehouse architecture, encryption at rest/transit, fine-grained access control, AWS, Microsoft Azure, Google Cloud, EMR, Glue, Airflow, Dagster, Monte Carlo, Splunk, MongoDB, Cassandra, DynamoDB, Redshift, Scala, Java.
Preferred qualifications
- 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
- 4+ years designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
- 4+ years building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
- 4+ years designing, implementing, and operating real-time or streaming data pipelines
- 2+ years in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
- 4+ years working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
- 4+ years designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
- 2+ years working in an Agile development environment
- 2+ years developing user-centric reusable data products
Location, salary, and incentives
Location: Richmond, VA (onsite)
Salary range: USD 179,400 - 204,700 per year for Data Engineer 4
This role may be eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI).
Additional information
- Application window: expected to accept applications for a minimum of 5 business days
- Immigration authorization: Capital One will not sponsor a new applicant for employment authorization or offer immigration-related support for this position
- No agencies: no agencies please
- Equal opportunity: Capital One is an equal opportunity employer (EOE, including disability/veteran), committed to non-discrimination in compliance with applicable laws
- Workplace: promotes a drug-free workplace
- Accommodation requests: contact Capital One Recruiting at 1-800-304-9102 or [email protected]
- Recruiting process support: [email protected]
Note: Any position posted in Canada is for Capital One Canada; any position posted in the United Kingdom is for Capital One Europe; any position posted in the Philippines is for Capital One Philippines Service Corp. (COPSSC).