Senior Data Engineer
Backend Developer
Senior
3d Design Tools
Amazon Web Services
Automation
AWS
Aws Cloudformation
Aws Data Lake
Aws Data Warehouse
Aws Fargate
Aws Glue
Big Data
Bigdata
Cloud
Cloud Computing
Cloud Data Warehouse
Cloud Infrastructure
Cloud Native
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Engineering Lead
Data Integration
Data Lake
Data Lakehouse
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Databricks
DevOps
DevSecOps
Engineer
Engineering
ETL
Informatica
Information Technology (IT)
Infrastructure As Code
IT Services
Kubernetes
Platform Engineering
Programming
Programming Language
Programming Languages
Rendering Engines
Security Automation
Spark
SQL
Job Description
The Senior Data Engineer role at Hearst Media Services (MOTOR Information Systems) focuses on architecting, designing, building, and evolving an AWS-based data platform. The position requires technical ownership across scalability, reliability, performance, and cost while delivering data pipelines and data products.
Responsibilities
- Analyze large and complex data sets to support pipeline and platform decisions.
- Design, develop, and coordinate the generation of data pipelines.
- Collaborate with the team to plan and solve complex technical problems.
- Design for, or optimize existing pipelines, with emphasis on performance and cost efficiency.
Requirements
- Expert Python and SQL development.
- Strong AWS experience, including: AWS Lambda, AWS Glue, AWS State Machines, AWS Fargate, AWS CloudFormation, and Amazon RedShift.
- Strong experience with semi-structured data such as XML, CSV, JSON, and Parquet.
- Strong automation experience.
- Experience with Databricks, including Delta Lake, notebooks, and SQL analytics.
- Experience with Kubernetes, including cluster orchestration, container networking, and pod management.
- Experience with DevOps and CI/CD, including deployment orchestration with Octopus Deploy.
- Experience with agentic AI, including LangGraph, MCP servers, and agent frameworks.
- Experience with data handling, including Pandas/NumPy, Apache Spark, and Ray.
Technologies
- Python, SQL
- AWS Lambda, AWS Glue, AWS Step Functions, AWS Fargate, AWS CloudFormation, Amazon RedShift
- XML, CSV, JSON, Parquet
- Databricks, Delta Lake, Databricks Notebooks, SQL Analytics
- Kubernetes
- Octopus Deploy
- LangGraph, MCP Servers
- Pandas, NumPy, Apache Spark, Ray
- Agent frameworks
Location & Schedule
- Location: Troy, MI (hybrid)
- Hybrid schedule: 3 days onsite in Troy, MI
Education
Bachelor's Degree.
Benefits
- No visa sponsorship available at this time.
Helpful Experience (Nice to Have)
- Experience with LLMs, machine learning & deep learning libraries, AI application frameworks, and vector databases.
- Experience with automotive data or the automotive industry.
- Experience with Agile or Scrum.
About MOTOR Information Systems (Hearst)
MOTOR is the industry leader in automotive data and insights. The organization powers the aftermarket ecosystem with comprehensive datasets, and is investing in modernizing its data platform to support the next generation of products and AI-driven capabilities.
Similar Jobs
