The Lead Data Engineer - AWS role at Vaco by Highspring centers on guiding a data engineering team within an AWS centric environment, delivering scalable, production ready data pipelines on AWS while remaining hands on.
Responsibilities
- Direct a team of data engineers by setting technical direction, reviewing code, and driving delivery, while also performing senior engineering duties as needed.
- Design, build, and maintain scalable data pipelines and platforms on AWS, prioritizing reliability, performance, and maintainability.
- Develop and optimize data pipelines using AWS native services including S3, Glue, Lambda, and EventBridge.
- Bridge data engineering with business stakeholders, translating requirements into practical, production ready solutions.
- Own end-to-end data workflows, covering ingestion, transformation, orchestration, and exposure via APIs or downstream systems.
- Implement infrastructure as code using Terraform to enable repeatable and scalable delivery.
- Monitor pipeline health, troubleshoot issues, and enforce data quality, governance, and security standards in a highly regulated sector.
- Mentor engineers through code reviews, design discussions, and hands-on collaboration to raise overall team competency.
Requirements
- Previous leadership or managerial experience with the ability to influence without direct authority.
- Extensive AWS expertise focusing on S3, Glue, Lambda, and EventBridge.
- Advanced Python and SQL experience in complex production environments.
- Experience with infrastructure as code, preferably Terraform.
- Comfort working across the full data stack from infrastructure to consumption layers.
- Strong understanding of data modeling, ETL/ELT processes, and pipeline orchestration concepts and best practices.
- Desirable background in finance, banking, wealth management, or related fields.
- Proficiency in API development and exposing data services within structured environments.
- Experience implementing or scaling Snowflake environments is a plus.
- Demonstrated communication skills and the ability to translate stakeholder business needs into technical solutions.
Technologies
- AWS
- S3
- Glue
- Lambda
- EventBridge
- Terraform
- Python
- SQL
- Snowflake
Benefits
- Discretionary bonuses
- Medical, dental, and vision benefits
- 401(k) retirement plan
- Relocation assistance available
Additional Details
- Employment Type: Direct-Hire with Client
- Primary Schedule: Monday – Friday / 8a – 5p
- Location: Germantown, TN
- Cadence: Onsite
- Target Total Compensation: $180k – $230k
- Relocation: Assistance is available
- Engagement Status: Applicants must be currently authorized to work in the U.S. without the need for employment-based sponsorship, now or in the future, including: H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT, or any other employment-based visa programs.
EEO Notice
Vaco by Highspring is an Equal Opportunity Employer and does not discriminate against any employee or applicant for employment because of race, color, sex, religion or creed, national origin, citizenship, age, disability, veteran status, union membership, ethnicity, gender, gender identity, gender expression, sexual orientation, or marital status.
Vaco by Highspring and its affiliates are committed to the full inclusion of all qualified individuals. Reasonable accommodations will be provided to enable participation in the job application or interview process, or to perform essential job functions, where needed.
Workplace discrimination is illegal. By submitting to this position, you authorize Vaco by Highspring to present you as a candidate and confirm that the information provided is accurate and complete to the best of your knowledge. You agree to maintain the confidentiality of information learned during the process to the fullest extent permitted by law.
Privacy Notice
California residents may access Vaco by Highspring HR Notice at Collection for California Applicants and Employees here.
Virginia residents may access our state specific policies here.
Residents of all other states may access our policies here.
Canadian residents may access our policies in English here and in French here.
Residents of GDPR-governed countries may access our policies here.
Pay Transparency Notice
Determining compensation for this role and others at Vaco by Highspring depends on a wide array of factors including skill sets, experience, training, licensure and certification requirements, office location, and other business needs. The base salary range above reflects the minimum and maximum values for geographies where salary range disclosure is required. Discretionary bonuses may also be available.
