Asset&Wealth Management-Senior Cloud Data Engineer-Vice President
Senior
Ai Workflows
Analytics
Apache Airflow
Asset Management
Automation
AWS
AWS CDK
Cloud
Cloud Architecture
Dagster
Data Analysis
Data Analytics
Data Engineer
Data Integration
Data Lake
Data Processing
Data Warehouse
DevOps
Docker
Engineer
ETL
Goldman Sachs
Kafka
Opentelemetry
Snowflake
Technical Lead
Terraform
Wealth Management
Job Description
Goldman Sachs' Asset & Wealth Management division is seeking a Senior Cloud Data Engineer at the Vice President level to lead hands-on data pipeline work, containerization on Amazon ECS, and the migration of legacy on‑prem systems to AWS. This role combines practical engineering with architectural guidance to enable scalable data solutions that support wealth management initiatives.
Responsibilities
- Active Migration Execution: Directly execute the migration of legacy ETL and microservices to AWS. This includes refactoring monolithic code into containerized services and deploying them to Amazon ECS (Fargate/EC2).
- Containerization & Orchestration: Build and maintain Docker images, write complex ECS Task Definitions, and configure service-to-service communication using Amazon ECS Service Connect and AWS Cloud Map.
- Data Pipeline Engineering: Develop end-to-end data flows using AWS Glue (PySpark), Amazon EMR, and Snowflake. Implement "Lakehouse" patterns using Apache Iceberg to ensure data portability.
- IaC Development: Write and maintain production-grade Terraform or AWS CDK modules to provision VPCs, ECS clusters, and RDS instances. Ensure all infrastructure is version-controlled and deployed via GitHub Actions or GitLab CI.
- AI-Augmented Coding: Actively use AI coding assistants (e.g., GitHub Copilot) to refactor legacy SQL, generate unit tests, and automate the creation of boilerplate pipeline code.
- Toil Reduction: Identify manual bottlenecks in the migration process and build custom automation tools in Python or Go to streamline data validation and schema conversion.
- Code Reviews & Standards: Lead rigorous peer code reviews, enforcing standards for performance, security (IAM least privilege), and maintainability.
- Observability Implementation: Hands-on configuration of Amazon CloudWatch Container Insights, and OpenTelemetry to ensure deep visibility into migrated microservices and data jobs.
- Performance Tuning: Directly optimize Spark job configurations, Snowflake warehouse sizing, and ECS auto-scaling policies to balance performance.
Requirements
- 8+ years of hands-on experience in Data Engineering and Cloud Infrastructure, focusing on building and migrating production workloads.
- Deep technical expertise in Amazon ECS (Fargate/EC2), including networking (ALB/NLB), task placement strategies, and container security.
- Proven experience with modern data platforms such as Snowflake (AI Data Cloud) and cloud-native services, with a good understanding of open-source table formats, specifically Apache Iceberg, to enable interoperability, schema evolution, and high-performance analytics across multiple engines.
- Expert-level proficiency in Java, Python and SQL.
- Hands-on experience with Spark, Kafka, and orchestration tools like Apache Airflow, Dagster, or dbt.
- Deep understanding of data warehousing and modern data lakehouse architecture.
- Mentorship: Proven track record of upskilling junior engineers.
- Communication: Ability to explain complex technical concepts to non-technical stakeholders in the wealth management business.
- Problem Solving: A "builder" mindset with the ability to navigate ambiguity in a fast-paced environment.
- Bachelor’s or Master’s degree in computer science, Engineering, Mathematics, or a related field.
Technologies
- Amazon ECS (Fargate/EC2)
- Docker
- AWS Cloud Map
- Amazon ECS Service Connect
- AWS Glue (PySpark)
- Amazon EMR
- Snowflake
- Apache Iceberg
- Terraform
- AWS CDK
- GitHub Actions
- GitLab CI
- Java
- Python
- SQL
- Spark
- Kafka
- Apache Airflow
- Dagster
- dbt
- OpenTelemetry
- Amazon CloudWatch Container Insights
Benefits
- Health Insurance
- Holiday & Vacation Policies
- Financial Wellness & Retirement
- Health Services
- Fitness
- Child Care & Family Care
- Benefits at Goldman Sachs
Best-in-Class Benefits
- Healthcare & Medical Insurance: We offer medical, dental, short-term disability, long-term disability, life, accidental death, labor accident and business travel accident insurance.
- Holiday & Vacation Policies: We offer competitive vacation policies based on employee level and office location, with generous vacation entitlements and a minimum of three weeks expected vacation usage each year.
- Financial Wellness & Retirement: We assist employees in saving and planning for retirement, offer financial support for higher education, and provide live financial education and content on a variety of topics.
- Health Services: We offer medical advocacy, counseling and referral services through EAP, Global Medical, Security and Travel Assistance, Workplace Ergonomics Program, and on-site health centers where available.
- Fitness: On-site fitness centers in some offices; reimbursements for fitness club membership or activity up to a pre-approved amount.
- Child Care & Family Care: On-site child care centers, back-up care, mother and baby rooms, homework rooms, and resources for expectant parents and returning parents; stipends for adoption, surrogacy, egg donation.
Opportunity Overview
- Corporate Title: Vice President
- Office Location(s): Dallas
- Job Function: Software Engineering
- Division: Asset & Wealth Management