AWS Data Engineer
Job Description
Wipro Limited is hiring an AWS Data Engineer to help build scalable AWS-based data engineering solutions from the ground up. Based in Torrance, California, this onsite role focuses on designing and developing ETL/ELT pipelines, AWS data lake and warehouse capabilities, and production-ready data processing frameworks, alongside data quality, monitoring, and security controls.
Role Focus
The purpose of this role is to develop minimum viable product (MVP) and comprehensive AI solutions that meet and exceed client expectations and add value to the business.
Responsibilities
- Design and develop scalable ETL/ELT data pipelines using AWS services including AWS Glue, Amazon S3, Lambda, Step Functions, and Amazon Redshift.
- Build data ingestion frameworks for structured and semi-structured data from enterprise applications, databases, APIs, files, and streaming sources.
- Develop data transformation and processing using Python, PySpark, and SQL.
- Design and optimize cloud-based data lake and data warehouse solutions on AWS.
- Implement data quality, reconciliation, monitoring, logging, and exception-handling frameworks.
- Develop performant data models and datasets for downstream analytics, reporting, machine learning, and AI use cases.
- Collaborate with business stakeholders, solution architects, data analysts, and application teams to translate requirements into scalable technical solutions.
- Optimize AWS data workloads for performance, scalability, reliability, and cloud cost.
- Implement security controls including AWS IAM, encryption, secrets management, and role-based access.
- Support CI/CD, automated deployment, production support, troubleshooting, and operational monitoring for data pipelines.
AI and Product Delivery
- Manage product and solution development using desired AI techniques.
- Lead development and implementation of custom solutions through thoughtful use of modern AI technology.
- Review and evaluate use cases and determine whether product development can create business value.
- Create the overall product development strategy and coordinate integration with larger interfaces.
- Create AI models and frameworks, implement them to address business problems, and align model work with product requirements.
- Draft the desired user interface and create AI models according to business needs.
- Analyze technology environment and client requirements to define product solutions using AI framework and architecture.
- Implement necessary security features based on product requirements.
- Review used cases for the latest AI approaches that can be incorporated into product development.
- Identify problem areas, perform root cause analysis, and propose relevant solutions.
- Track industry and application trends and connect them to current and future AI needs.
- Create and delegate work plans to the programming team for product development.
- Interact with the Holmes advisory board for knowledge sharing and best practices.
- Develop and maintain client relationships with key strategic partners and decision makers, and participate in client interactions to gather inputs on product development.
- Provide consultation around product design aligned to customer needs, assist with product demonstrations, and incorporate client feedback.
- Design presentations for seminars, meetings, and enclaves focused on the product.
Team Management and Delivery Metrics
- Perform team management tasks including resourcing, onboarding, training, talent pool building, and attrition management.
- Drive diversity in leadership positions.
- Conduct performance management including setting goals, timely performance reviews, and constructive feedback, while following “Performance Nxt” for the team.
- Lead engagement initiatives, track team satisfaction scores, and identify initiatives to build engagement within the team.
- Delivery performance parameters include continuous technical project management and delivery, client centricity, and capability building and team management.
Requirements
- Strong hands-on experience with AWS Glue, Amazon S3, Amazon Redshift, Lambda, IAM, CloudWatch, and Step Functions.
- Strong programming experience in Python and PySpark.
- Advanced SQL experience working with large-scale relational and analytical datasets.
- Experience implementing ETL/ELT pipelines, data lakes, data warehouses, and dimensional or data modeling.
- Experience with Apache Spark and distributed data processing.
- Good understanding of AWS security, networking, encryption, and access-control concepts.
- Experience with Git and CI/CD practices for data engineering deployments.
- Strong troubleshooting, performance optimization, and production-support skills.
Preferred Qualifications
- Experience with Amazon EMR, Kinesis, Athena, Lake Formation, MWAA/Airflow, or DynamoDB.
- Experience with automotive, manufacturing, supply-chain, connected-vehicle, sales, dealer, or customer datasets.
- Exposure to Terraform or AWS CloudFormation for Infrastructure as Code.
- AWS certification such as AWS Certified Data Engineer – Associate is preferred.
- Experience supporting enterprise data platforms with strong data governance and data-quality requirements.
Technologies
- AWS Glue, Amazon S3, Lambda, Step Functions, Amazon Redshift
- Python, PySpark, SQL
- AWS, data lake, data warehouse
- Amazon IAM (IAM), CloudWatch
- Git, CI/CD
- Apache Spark, Amazon EMR, Kinesis, Athena, Lake Formation
- MWAA, Airflow, DynamoDB
- Terraform, AWS CloudFormation
- AWS Certified Data Engineer – Associate
- Encryption, secrets management, role-based access
Benefits
- Full range of medical and dental benefits options
- Disability insurance
- Paid time off, inclusive of sick leave
- Other paid and unpaid leave options
Location and Compensation
Location: Torrance, California (onsite). Salary: USD 60,000 to 148,500 per year. Final compensation depends on factors including geographical location, minimum wage obligations, skills, and relevant experience.