Data Engineer, Applied AI Solutions
Amazon Web Services
Apache Airflow
Artificial Intelligence
Automation
AWS
Aws Bedrock
Aws Data Warehouse
Aws Glue
Aws Sagemaker
Big Data
Bigdata
Cloud
Cloud Computing
Cloud Data Warehouse
Cloud Data Warehouse
Data Architecture
Data Engineer
Data Integration
Data Lake
Data Pipeline
Data Platform
Data Processing
Data Warehouse
ETL
Spark
SQL
Workflow Orchestration
Job Description
Design and operate next-generation data infrastructure that powers applied AI solutions for both human analysis and machine consumption.
Key Responsibilities
- Design, build, and maintain next-generation data infrastructure that serves both human analysts and AI systems.
- Partner across organizational boundaries with data scientists, engineers, analytics teams, and business stakeholders to deliver innovative, scalable solutions using data assets.
- Maintain dataset accuracy, consistency, and observability by implementing monitoring, lineage tracking, and self-healing mechanisms for data quality at scale.
- Deliver infrastructure interfaces, documentation, and metadata for analysts/scientists and autonomous AI agents.
- Drive a forward-looking infrastructure strategy that accounts for evolving AI system needs while meeting reliability and performance expectations for business operations.
- Contribute to a technical roadmap for data systems supporting the organization’s AI transformation.
- Build and operate production pipelines and warehouses (5+ years).
- Build AI-serving data infrastructure, including machine-consumable interfaces, metadata, and documentation for autonomous agents.
- Implement GenAI data patterns end to end: chunking, embeddings, and vector stores for retrieval-augmented generation.
- Build and maintain datasets and feature pipelines for ML/GenAI training, fine-tuning, and inference (Amazon SageMaker, Bedrock, or equivalent).
- Implement data quality, lineage, and observability for AI workloads, including validation, freshness/anomaly monitoring, and alerting at scale.
- Use advanced SQL and a production mindset to deliver performance-tuned data systems.
- Operate batch and streaming ETL/ELT on AWS (Glue, EMR/Spark, S3, Athena) and a production cloud data warehouse (Amazon Redshift or equivalent).
- Design data models and schemas for analytical, operational, and AI/retrieval workloads.
- Use workflow orchestration such as Step Functions, Airflow, or Glue Workflows.
Requirements
- 3+ years of data engineering experience.
- 1+ years developing and operating large-scale data structures for business intelligence analytics, including data modeling experience.
- Bachelor’s degree or foreign equivalent in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
- Experience with data modeling, warehousing, and building ETL pipelines.
- Experience building data infrastructure that serves AI systems and autonomous agents, including machine-consumable interfaces, metadata, and documentation.
Technologies
- Python, Scala, Java, SQL
- Amazon SageMaker, Amazon Bedrock
- Amazon Glue, EMR, Spark, S3, Athena
- Amazon Redshift
- Step Functions, Airflow, Glue Workflows
- Kinesis, FireHose, Lambda
- IAM roles and permissions
- Vector stores, retrieval-augmented generation
- Chunking, embeddings
Benefits
- Sign-on payments
- Restricted stock units (RSUs)
- Health insurance (medical, dental, vision, prescription)
- Basic Life & AD&D insurance and option for Supplemental life plans
- EAP
- Mental Health Support
- Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
Location: Seattle, WA (onsite)
Salary: USD 132,100 - 178,800 per year
Similar Jobs
C