Data Engineer II, Professional Services Strategy & Operation, Analytics & Insights Center (PAIC)

The Data Engineer II role within AWS Professional Services Strategy & Operation (PAIC) focuses on building and scaling data products and pipelines. This position owns the data platform to empower analytics and AI/ML capabilities for internal customers across the organization.

Location

Irvine, California, onsite

Responsibilities

• Develop and support ETL pipelines with robust monitoring and alerting
• Design data models optimized for business needs and aggregation
• Create and optimize data tables using best practices for partitioning, compression, and parallelization
• Build scalable data integration pipelines using SQL, Python, and AWS services such as Glue, Lambda, and Step Functions
• Implement data structures following best practices in data modeling, ETL/ELT processes, and SQL/Redshift
• Collaborate with business customers to gather requirements and deliver comprehensive reporting solutions
• Continuously improve reporting and analysis workflows while automating self-service support for customers
• Investigate and adopt the latest AWS technologies to enable new capabilities and improve efficiency
• Work closely with business owners, analysts, and BI Engineers to explore new data sources and deliver new data products

Requirements

• 3+ years of developing and operating large-scale data structures for business intelligence analytics using ETL/ELT processes
• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience
• Experience with SQL and Python scripting
• Experience applying data solutions within large-scale distributed systems (for example EMR, Spark, Elasticsearch, Hadoop, Pig, and Hive)

Technologies

• SQL
• Python
• AWS Glue
• AWS Lambda
• AWS Step Functions
• Redshift
• S3
• EMR
• Kinesis
• Firehose
• Hive
• Hadoop
• Spark
• Pig
• Elasticsearch

Benefits

• Health coverage including medical, dental, vision, prescription drugs, and life/AD&D insurance with optional supplemental life plans
• EAP and mental health support services
• Flexible Spending Accounts
• Adoption and surrogacy reimbursement coverage
• 401(k) matching
• Paid time off and parental leave
• Sign-on incentives and restricted stock units (RSUs)

A Day in the Life

You will contribute to an analytics platform that spans both a data warehouse and a data lake, supporting reporting, advanced analytics, and generative AI for a large global enterprise. On a day-to-day basis, you will build and maintain data pipelines, optimize queries, and ensure platform reliability. Collaboration with data engineers, BI engineers, and data scientists will be routine to deliver accurate, timely data. The role extends beyond traditional data engineering, with responsibility for CI/CD pipelines and managing associated infrastructure to support ongoing data product delivery.