Data Engineer 4
Job Description
Capital One is looking for a Data Engineer 4 to design, develop, implement, and support cloud-first data solutions and pipelines. This onsite role in McLean, VA brings together scalable platform work, modern lakehouse and warehousing technologies, and a team environment across Agile delivery. You will build secure, resilient data engineering capabilities that help drive experiences for millions of Americans working toward financial empowerment.
Compensation: USD 197,300 - 225,100 per year.
What you’ll do
- Partner with and across Agile teams to design, develop, test, implement, and support technical solutions across full-stack development tools and technologies.
- Lead and influence delivery by working closely with developers, data analysts, and data scientists with experience spanning machine learning, distributed microservices, lakehouse architecture, and full-stack systems.
- Build and operate data platforms using Python and Spark, leveraging open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake.
- Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across pipelines and data platforms.
- Design and deliver data pipelines with an emphasis on scalability, resilience, and operational efficiency, ensuring performance as data volume and business demand grow.
- Implement data security standards, including encryption at rest/transit and fine-grained access control, aligned with data privacy regulations.
- Collaborate with product managers and software engineers to deliver robust cloud-first solutions that power strong customer experiences.
- Communicate technical concepts and data outcomes clearly as an ambassador for the data engineering team to align stakeholders.
- Stay current with data engineering trends by experimenting, learning new technologies, participating in technology communities, and mentoring others in the data engineering space.
Required qualifications
- Bachelor’s Degree or higher in Computer Science or a related quantitative field: Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering.
- 4+ years of experience in application development (internship experience does not apply).
- 2+ years of experience in distributed data.
- 2+ years of experience with SQL.
- 2+ years of experience with one programming language: Python, Java, or Scala.
- 2+ years of experience in data pipeline design and development.
- 1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems.
Technology exposure
Python, Spark, Databricks, Snowflake, SQL, EMR, Glue, NoSQL, MongoDB, Cassandra, DynamoDB, Redshift, Airflow, Dagster, Monte Carlo, Splunk, AWS, Microsoft Azure, Google Cloud.
Preferred qualifications
- 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java.
- 4+ years designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud).
- 4+ years building or supporting distributed data or compute workloads using EMR, Spark, Glue, or Databricks.
- 4+ years designing, implementing, and operating real-time or streaming data pipelines.
- 2+ years working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster).
- 4+ years working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB).
- 4+ years designing and supporting data warehousing solutions (e.g., Snowflake, Redshift).
- 2+ years working in an Agile development environment.
- 2+ years developing user-centric reusable data products.
Benefits
Capital One offers a comprehensive, competitive, and inclusive set of health, financial, and other benefits.
Work authorization note: Capital One will not sponsor a new applicant for employment authorization, or offer immigration-related support for this position (including H1B, F-1 OPT, F-1 STEM OPT, F-1 CPT, J-1, TN, E-3, O-1, and other work authorization forms requiring employer immigration support).