Lead Data Engineer (Finance Tech)
Job Description
The Lead Data Engineer role in Capital One's Finance Tech group focuses on designing, building, testing, implementing, and supporting data engineering solutions, delivering cloud-based data platforms via Agile teams to empower financial decision-making.
Responsibilities
- Partner with cross-functional Agile teams to design, build, test, deploy, and support technical solutions across full‑stack development tools and technologies
- Collaborate with developers who specialize in machine learning, distributed microservices, and full‑stack systems
- Work with Java, Scala, and Python, plus open source RDBMS and NoSQL databases, and cloud data warehouses such as Redshift and Snowflake
- Share enthusiasm for emerging technologies, experiment with new tools, participate in internal and external tech communities, and mentor other engineers
- Collaborate with digital product managers to deliver robust cloud based solutions that enable financial empowerment for millions
- Perform unit tests and participate in code reviews to ensure designs are solid, code is clean, and performance is tuned
Requirements
- Bachelor’s Degree
- Minimum 4 years of experience in application development (internships do not count)
- Minimum 2 years of experience with big data technologies
- At least 1 year of cloud computing experience (AWS, Microsoft Azure, or Google Cloud)
Technologies
- Java
- Scala
- Python
- Redshift
- Snowflake
- MongoDB
- Cassandra
- Hadoop
- Hive
- MapReduce
- EMR
- Kafka
- Spark
- Gurobi
- MySQL
- UNIX/Linux
- Shell scripting
- AWS
- Microsoft Azure
- Google Cloud
Benefits
- Health benefits
- Financial benefits
- Performance-based incentive compensation including cash bonuses and long-term incentives