Data Engineer 4 (Manager, IC)

Capital One seeks a Data Engineer 4 (Manager, IC) to lead cloud-first data transformation efforts through design, delivery, and ongoing support of scalable data platforms.

Responsibilities

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions using full-stack development tools and technologies
• Influence developers, data analysts, and data scientists with experience in machine learning, distributed microservices, lakehouse architecture, and full-stack systems
• Use Python and Spark with open-source relational and NoSQL databases and cloud data warehousing platforms such as Databricks and Snowflake
• Drive robust cloud-first data solutions alongside product managers and software engineers to help deliver powerful customer experiences
• Independently design, build, and deliver cloud data solutions and applications with little or no support from supervisors or managers
• Architect and enforce common data engineering design patterns to improve code quality, maintainability, and reusability across platforms and pipelines
• Build data pipelines and platforms focused on scalability, resilience, and operational efficiency to maintain performance as volume and demand increase
• Implement data security standards including encryption at rest, encryption in transit, and fine-grained access control to support data privacy compliance
• Serve as a data engineering ambassador by communicating technical concepts and data outcomes clearly to internal and external stakeholders
• Stay current with data trends, experiment with new technologies, participate in technology communities, and mentor members of the data community

Requirements

• Bachelor’s Degree or higher in Computer Science or a related quantitative field: Statistics, Economics, Operations Research, Analytics, Mathematics, Engineering
• 4+ years of experience in application development (internship experience does not apply)
• 2+ years of experience with distributed data
• 2+ years of experience with SQL
• 2+ years of experience with one programming language: Python, Java, or Scala
• 2+ years of experience in data pipeline design and development
• 1+ year of experience in data modeling and designing end-to-end data solutions using both relational and non-relational database systems

Technologies

• Python, Spark
• Databricks, Snowflake
• SQL
• EMR, Glue, Airflow, Dagster
• NoSQL: MongoDB, Cassandra, DynamoDB
• Relational/warehouse: Redshift
• Data observability: Monte Carlo, Splunk
• Cloud: AWS, Microsoft Azure, Google Cloud
• Languages: Scala, Java
• Security: encryption at rest, encryption in transit, fine-grained access control

Preferred Qualifications

• 7+ years of experience in application development with demonstrated proficiency in Python, SQL, Scala, or Java
• 4+ years hands-on experience designing, deploying, and operating data workloads in at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud)
• 4+ years experience building or supporting distributed data or compute workloads using tools such as EMR, Spark, Glue, or Databricks
• 4+ years experience designing, implementing, and operating real-time or streaming data pipelines
• 2+ years experience working on data observability (e.g., Monte Carlo, Splunk) or data orchestration tools (e.g., Airflow, Dagster)
• 4+ years experience working with unstructured or semistructured data using NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB)
• 4+ years experience designing and supporting data warehousing solutions (e.g., Snowflake, Redshift)
• 2+ years of experience working in an Agile development environment
• 2+ years of experience developing user-centric reusable data products

Location and Salary

• Richmond, VA (onsite): $179,400 - $204,700 per year
• Cambridge, MA: $197,300 - $225,100 for Data Engineer 4
• McLean, VA: $197,300 - $225,100 for Data Engineer 4
• Eligible for performance-based incentive compensation, which may include cash bonus(es) and/or long term incentives (LTI)
• Comprehensive, competitive, and inclusive health, financial, and other benefits to support total well-being