Data Engineer II

Data Engineer II with Amazon Security AmSec focuses on building data infrastructure and reliable pipelines that support security investigations, threat modeling, and detection. The role harnesses AWS data services and AI enabled data objects within a large scale data lake. This position is onsite in Seattle, WA.

Benefits

• Health insurance
• 401(k) matching
• Paid time off
• Parental leave
• Sign-on payments
• Restricted stock units (RSUs)
• Employee Assistance Program (EAP)
• Mental Health Support
• Medical Advice Line
• Flexible Spending Accounts
• Adoption and Surrogacy Reimbursement coverage

Amazon Security AmSec seeks a Data Engineer II to join a team focused on resource and application discovery. The product Veritas serves as a foundational service that supplies data for security reviews, threat modeling, detection, access control, and incident response. The AmSec organization spans more than ten countries, supporting security initiatives across a wide footprint.

Responsibilities

• Help shape the data strategy and storage roadmap through close collaboration with partner teams
• Lead data governance design, define schemas, and build tools that enable secure data sharing with customers under strict confidentiality guidelines
• continually improve data quality and operations through automation and end-to-end CI/CD data pipelines
• Adopt best practices for data integrity, modeling, testing, analysis, validation, and documentation
• Build end-to-end data pipelines to ingest and transform data from diverse sources and systems
• Use AI and large language models to automate repetitive data engineering tasks
• Evaluate and deploy big-data technologies such as Redshift, Iceberg, Hive/EMR, Spark, SNS, and SQS to optimize processing of very large datasets
• Analyze business processes, logical data models, and relational database implementations
• Write high-performing, optimized SQL queries

Requirements

• Minimum four years of data engineering experience
• Experience designing data models, data warehousing, and building ETL pipelines
• At least four years analyzing and interpreting data with Redshift, Oracle, NoSQL, and related technologies
• Familiarity with professional software engineering practices across the full software development life cycle, including coding standards, architectures, code reviews, source control, continuous deployments, testing, and operational excellence

Technologies

• Amazon EMR
• AWS Glue
• Amazon Athena
• Amazon Redshift
• Amazon S3
• Amazon SNS
• Amazon SQS
• Apache Airflow
• Iceberg
• Hive
• Spark
• SQL
• AI/LLM