Senior Data Engineer
Senior
Artificial Intelligence
Aws Data Engineer
Big Data
Change Data Capture
CI/CD
Cloud
Cloud Native
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Databricks
Databricks Workflows
ETL
Event Driven Architecture
Graph Databases
Kubernetes
NoSQL
Spark
Streaming Data
Vector Databases
Workflow Orchestration
Job Description
Grainger is hiring a Senior Data Engineer to design and operate governed batch and real-time data products for Product Discovery, supporting search, machine learning, analytics, and AI-enabled experiences.
Responsibilities
- Design and operate reliable, governed batch and real-time data products using Databricks, Snowflake, Spark, Kubernetes, vector/search technologies, and cloud-native services
- Build pipelines, data assets, orchestration patterns, and search and retrieval capabilities that make trusted data available to search, machine learning, analytics, and engineering teams
- Design, develop, and maintain scalable data solutions to integrate and transform data for business and analytical use
- Apply data engineering practices to deliver reliable, high-quality data products while improving performance, scalability, and automation
- Partner with technical and business stakeholders to translate requirements into effective data solutions
- Design, develop, test, and maintain scalable data pipelines and data products integrating information from multiple sources
- Extract, transform, integrate, and deliver reliable data for analytical and business needs
- Develop and enhance data engineering capabilities to improve data accessibility, performance, quality, and scalability
- Analyze business and technical needs and translate them into data designs, specifications, and solutions
- Identify and implement improvements to data engineering processes, including automation, optimization, and increased reliability
- Resolve data-related challenges with stakeholders and deliver solutions aligned to business requirements
- Provide technical guidance, review designs, and help establish engineering practices for less-experienced team members
- Design and deliver scalable batch and streaming data pipelines and data products across modern data and cloud platforms
- Define reusable Data Engineering patterns for CDC, event-driven processing, workflow orchestration, data products, and AI/search-enabled workloads
- Partner with Engineering, Product, and Applied Science on architecture, roadmap, adoption, and operational ownership of data capabilities
Requirements
- Bachelor's Degree or equivalent experience in Computer Science, Computer Engineering, Information Systems, Data Science, Software Engineering, or a related technical field
- 3+ years of related data engineering or software engineering experience
- Experience building and operating production batch and streaming data pipelines on Databricks or similar modern data platforms
- Strong software engineering skills in Python, with hands-on experience using Spark or other distributed processing frameworks
- Hands-on experience with CDC, streaming/event-driven architectures, and workflow orchestration, including selecting patterns based on scale, reliability, and use case
- Experience with containerization and orchestration such as Docker and Kubernetes, plus cloud platforms such as AWS or equivalent
- Experience implementing CI/CD and automated testing using GitHub Actions or equivalent platforms
- Experience working across relational, NoSQL, vector, graph, or other database technologies and choosing storage patterns based on the use case
- Experience designing and developing scalable data pipelines, data integration solutions, and data products
- Proficiency with programming, scripting, and data query languages used to develop and manipulate data solutions
- Experience translating requirements into technical designs and implementing solutions involving multiple data sources
- Knowledge of modern data engineering
Technologies
- Databricks, Snowflake, Spark, Kubernetes
- Vector/search technologies
- Python
- Docker, AWS
- GitHub Actions
- CDC, streaming/event-driven architectures, workflow orchestration
- CI/CD
- NoSQL, graph, relational, vector
- Tableflow, Airflow, Databricks Workflows
- AWS DMS, Debezium
- Machine learning, AI
Preferred
- Experience with CDC and orchestration platforms such as AWS DMS, Debezium, Tableflow, Airflow, Databricks Workflows, or equivalent technologies
- Experience using machine learning or AI within data pipelines to classify, enrich, standardize, match, or improve data
- Experience with e-commerce, search, recommendations, or personalization platforms
- Working knowledge of machine learning models and production of ML workflows
Compensation
- Anticipated base pay range: $104,500.00 - $174,200.00 per year
- Incentive target: eligible for up to 10% (or $), based on individual and company performance objectives per the incentive program terms (subject to change)
Benefits
- Medical, dental, vision, and life insurance plans with coverage starting on day one
- 6 free sessions each year with a licensed therapist for emotional wellbeing support
- 18 paid time off (PTO) days annually for full-time employees (accrual prorated based on employment start date)
- 6 company holidays per year
- 6% company contribution to a 401(k) Retirement Savings Plan each pay period; no employee contribution required
- Employee discounts, tuition reimbursement, student loan refinancing, and free access to financial counseling, education, and tools
- Maternity support programs, nursing benefits, and up to 14 weeks paid leave for birth parents and up to 4 weeks paid leave for non-birth parents
Location and Work Type
- Lake Forest, IL (Hybrid)
Sponsorship
- This position is not eligible for any form of sponsorship now or in the future
- Individuals requiring sponsorship (e.g., OPT or H1B) should not apply
- Only individuals authorized to work in the United States now and for the foreseeable future will be considered