Capital One is hiring a Data Engineer 4 to design, build, and support cloud-first data solutions and pipelines.

Collaborate with Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools
Influence delivery through deep experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
Build and support solutions using Python, Spark, and open-source relational and NoSQL databases
Work with cloud data warehousing platforms such as Databricks and Snowflake
Experiment with and adopt new data technologies; participate in internal and external technology communities; mentor data engineering peers
Partner with product managers and software engineers to deliver robust cloud-first data solutions
Independently design, build, and deliver cloud data solutions and applications with minimal supervision
Architect and enforce shared data engineering design patterns to improve code quality, maintainability, and reusability
Design and build data pipelines and platforms for scalability, resilience, and operational efficiency
Implement data security standards, including encryption at rest and in transit and fine-grained access control, aligned to data privacy regulations
Communicate technical concepts and data outcomes clearly to internal and external stakeholders to support alignment

Bachelor's Degree or higher in Computer Science or a related quantitative field (Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering)
4+ years of experience in application development (internship experience does not apply)
2+ years of experience in distributed data
2+ years of experience with SQL
2+ years of experience with one programming language: Python, Java, or Scala
2+ years of experience in data pipeline design and development
1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

7+ years of application development experience with demonstrated proficiency in Python, SQL, Scala, or Java
4+ years hands-on experience designing, deploying, and operating data workloads in a public cloud (AWS, Microsoft Azure, or Google Cloud)
4+ years experience building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks
4+ years experience designing, implementing, and operating real-time or streaming data pipelines
2+ years experience in data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
4+ years experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
4+ years experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
2+ years experience working in an Agile development environment
2+ years experience developing user-centric reusable data products

Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)

Applications expected to be accepted for a minimum of 5 business days
No agencies please
Capital One is an equal opportunity employer (EOE, including disability/vet) committed to non-discrimination
Capital One promotes a drug-free workplace

Capital One will not sponsor a new applicant for employment authorization or provide immigration-related support for this position (including H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-3, O-1, and other work authorizations requiring employer immigration support)

Data Engineer 4 (Python, AWS)

Job Description