Amazon Kinesis Firehose Data Jobs

1 job found

Today

Data Engineer II, Business Data Technologies

Amazon.com Services LLC Seattle, WA

Seattle, WA

Today

$132k - $179k/yr Full time Amazon Emr Amazon Kinesis Firehose Amazon Web Services

Apply Now

Job Description

Amazon eCommerce Foundation’s Business Data Technologies team is hiring a Data Engineer II to build and operate large-scale data structures for analytics and deep learning in a high-volume data environment.

Responsibilities

Design, develop, implement, test, and operate large-scale, high-volume, high-performance data structures for analytics and deep learning
Build real-time and batch data ingestion routines using data modeling and ETL/ELT best practices with AWS and big data tools
Collect business and functional requirements and translate them into robust, scalable, operable solutions aligned with the overall data architecture
Analyze source data systems and help drive best practices within source teams
Own the end-to-end development lifecycle, including design, implementation, testing, documentation, delivery, support, and maintenance
Create comprehensive, usable dataset documentation and metadata
Evaluate and make decisions on dataset implementations proposed by peer data engineers
Evaluate and make decisions on the use of new or existing software products and tools
Mentor junior data engineers

Requirements

3+ years of data engineering experience
Experience with data modeling, warehousing, and building ETL pipelines

Technologies

AWS
Amazon Redshift
Hive
Apache Spark
Amazon EMR
RDBMS
Amazon S3
AWS Glue
Amazon Kinesis
Kinesis Firehose (FireHose)
AWS Lambda
IAM roles and permissions
Real-time and batch ingestion
ETL/ELT
Non-relational databases / data stores
Object storage
Document or key-value stores
Graph databases
Column-family databases

Benefits

Health insurance (medical, dental, vision, prescription; Basic Life & AD&D; Supplemental life options; EAP; Mental Health Support; Medical Advice Line; Flexible Spending Accounts; Adoption and Surrogacy Reimbursement coverage)
401(k) matching
Paid time off
Parental leave
Sign-on payments
Restricted stock units (RSUs)

Preferred Qualifications

Experience with AWS technologies such as Redshift, S3, AWS Glue, EMR, Kinesis, FireHose, Lambda, and IAM roles and permissions
Experience with non-relational databases / data stores including object storage, document or key-value stores, graph databases, and column-family databases

About the Team

BDT collects petabytes of data from thousands of sources inside and outside Amazon, including the Amazon catalog system, inventory system, customer order system, page views, and Alexa systems
Supports Amazon subsidiaries such as IMDB and Audible
Enables internal customers to access and query data hundreds of thousands of times per day using AWS Redshift, Hive, and Spark
Builds scalable solutions that grow with the Amazon business

Role Context

Amazon’s eCommerce Foundation (eCF) organization is responsible for core components driving the Amazon website and customer experience
In this role, you will design, develop, implement, test, and operate data structures for analytics and deep learning in a cloud-based data lake

Location: Seattle, WA (onsite) | Experience: 3+ years | Salary: USD 132,100 - 178,800 per year

View full job page →

Get Amazon Kinesis Firehose Data Jobs alerts

New Amazon Kinesis Firehose Data Jobs, daily.