Staff, Data Engineer
Big Data
Bigdata
Cassandra
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Integration Tools
Data Management
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Security
Data Warehouse
Database
Databases
Engineer
ETL
Event Driven Architecture
Google Cloud Dataproc
Hadoop
Hive
Informatica
Kafka
Nosql Databases
Scala
Software Development
Software Engineering
SQL
Stream Processing
Streaming Data
Job Description
Build scalable data architectures and pipelines that enable measurement, reporting, and decision support.
Responsibilities
- Translate complex business requirements into scalable data engineering solutions aligned with organizational strategy.
- Design, develop, and maintain robust data pipelines and architectures using Apache Kafka, Hive, and Cassandra.
- Implement data governance practices to support regulatory and ethical requirements for data privacy, quality, and security.
- Collaborate with cross-functional teams to identify and integrate data sources for analytics and reporting.
- Develop and test code for data transformation, integration, and storage across cloud and big data environments.
- Provide guidance on data modeling, metadata management, and documentation for enterprise data initiatives.
Requirements
- Scala proficiency and experience with data engineering and architecture principles.
- Expertise building and managing data pipelines, data lakes, and ETL processes with Apache Kafka, Hive, and Cassandra.
- Strong knowledge of query languages, including SQL and NoSQL, for data modeling and integration.
- Experience with cloud platforms such as Google Cloud Dataproc and big data environments.
- Understanding of data governance, data quality frameworks, and regulatory requirements related to data privacy and security.
- Ability to translate complex business requirements into scalable data solutions aligned with enterprise strategy.
- Familiarity with data strategy development and implementation to drive business insights and value.
- Master’s degree in Computer Science or related field, plus 4 years of software engineering or related field experience.
- Alternative experience paths listed:
- Bachelor’s degree in Computer Science and 4 years of software engineering or related field experience.
- 6 years of software engineering or related field experience.
- Master’s degree in Computer Science and 2 years of software engineering or related field experience.
- 3 years of data engineering, database engineering, business intelligence, or business analytics experience.
- Knowledge of inclusive digital experiences, including implementing WCAG 2.2 AA standards, assistive technologies, and integrating digital accessibility.
Technologies
- Scala
- Apache Kafka
- Hive
- Cassandra
- SQL
- NoSQL
- Google Cloud Dataproc
Benefits
- Health benefits: medical, vision, and dental coverage.
- Financial benefits: 401(k), stock purchase, and company-paid life insurance.
- Paid time off: PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
- Other benefits: short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
- Live Better U: Walmart-paid education benefit program for full-time and part-time associates (tuition, books, and fees fully paid).
Position Summary
- Design, develop, and maintain scalable data architectures and pipelines that support business insights and decision-making.
About the Team
- Measurement & Reporting Team within the Global Data Foundation supports omnichannel measurement for Walmart Connect.
- Designs and scales enterprise attribution and reporting systems processing billions of digital and in-store customer interactions daily.
- Develops multi-touch attribution models and builds resilient distributed data pipelines using Scala, Apache Kafka, and cloud-based data lakes.
- Delivers trusted analytics that support advertising decisions and retail intelligence across Walmart’s global ecosystem.
Location
- Sunnyvale, CA (onsite)
- 815 Eleventh Ave, Sunnyvale, CA 94089-4731, United States of America
Compensation
- USD 143,000 - 286,000 per year