Data Engineer

Data Engineer on the AWS Infrastructure Services team contributes to building and maintaining ETL pipelines, shaping data architectures, and delivering analytics solutions to internal customers. The role collaborates with BI engineers and software teams to translate data into actionable insights and standardize metrics. This onsite position is based in Seattle, WA, with a salary range of USD 101,300 to 160,000 per year and a minimum of one year of experience.

Responsibilities

• Develop and maintain automated ETL pipelines with monitoring, using Python, Spark, SQL, and AWS services such as S3, Glue, Lambda, SNS, SQS, and KMS.
• Set up and support reporting and analytics infrastructure for internal business customers.
• Design and sustain data security and access controls for enterprise scale data warehouse and data lake implementations, including encryption, user permissions, and logging.
• Create data objects for business analytics using data modeling techniques.
• Optimize data warehouse and data lake tables following best practices for DDL, physical and logical design, data partitioning, compression, and parallelization.
• Develop and maintain metadata, data catalog, and user documentation for internal data consumers of data warehouse and data lake assets.
• Collaborate with internal business customers and software teams to gather and document requirements for data publishing and consumption via data warehouse, data lake, and analytics solutions.

Requirements

• Minimum of one year of data engineering experience.
• Experience with data modeling, warehousing, and building ETL pipelines.
• Experience with one or more query languages, such as SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, or Scala.
• Experience with one or more scripting languages, such as Python or KornShell.

Technologies

• Python
• Spark
• SQL
• AWS services: S3, Glue, Lambda, SNS, SQS, KMS
• Hadoop
• Hive
• EMR
• Informatica
• ODI
• SSIS
• BODI
• Datastage

Benefits

• Sign-on payments
• Restricted stock units (RSUs)
• Health insurance including medical, dental, vision, prescription coverage, Basic Life and AD&D insurance with optional supplemental life plans, EAP, mental health support, Medical Advice Line, Flexible Spending Accounts, and Adoption or Surrogacy reimbursement
• 401(k) matching
• Paid time off
• Parental leave

A Day in the Life

• Exploring advanced data transformation techniques
• Developing intelligent, automated reporting solutions
• Collaborating with cross functional teams to address complex analytical challenges
• Researching emerging technologies to enhance the data strategy