Senior Quality Data and AI Engineer
Job Description
Senior Quality Data and AI Engineer role within GM’s Quality & Safety Data Platform team in Austin, TX (hybrid).
Responsibilities
- Design and productionize reliable batch and streaming data products in Azure Databricks using Spark Declarative Pipelines and Delta Lake, including Unity Catalog and Bronze, Silver, and Gold patterns for quality, warranty, and AI use cases.
- Spot opportunities to apply AI across data workflows and deliver solutions that improve efficiency, data quality, or decision-making.
- Build and maintain data services and APIs that securely expose trusted, well-documented datasets to applications.
- Create responsive front-end features using React with JavaScript or TypeScript and modern web practices.
- Partner with product designers and stakeholders to translate workflow and data requirements into usable interfaces.
- Implement data quality checks, observability, lineage, and alerting; investigate and resolve pipeline and application issues.
- Improve performance, reliability, security, and cost efficiency across data and application systems.
- Apply engineering best practices across delivery, including code review, automated testing, CI/CD, workload identity, security, cost, observability, and production support.
- Gate agent releases using evaluation of task success, tool use, grounding, latency, and cost.
- Mentor engineers, provide technical guidance, and contribute to roadmaps and architectural decisions.
Requirements
- 5+ years of professional experience in data engineering, software engineering, or a closely related field.
- Bachelor’s degree in Computer Science, Software Engineering, Data Science, or related field, or equivalent experience.
- Strong proficiency in SQL, Python, PySpark, and a data-engineering programming language such as Scala or Java.
- Experience designing production-grade ETL/ELT pipelines and working with data warehouses, data lakes, or lakehouse platforms.
- Hands-on experience using AI tools and services to improve data engineering workflows, with an understanding of responsible and secure AI use.
- Experience building or maintaining front-end applications with React, including familiarity with component-based UI patterns.
- Experience integrating front-end applications with REST or similar APIs, including asynchronous data states, error handling, and loading behavior.
- Understanding of data modeling, schema evolution, data quality, and distributed processing concepts.
- Strong experience with Databricks on a cloud platform, building and supporting scalable data pipelines.
- Strong communication and problem-solving skills, able to work across technical and nontechnical teams.
Technologies
- Azure Databricks
- Spark Declarative Pipelines
- Delta Lake
- Unity Catalog
- Bronze, Silver, Gold patterns
- Spark
- React
- JavaScript, TypeScript
- SQL, Python, PySpark
- Scala, Java
- REST, REST-like APIs, APIs
- ETL, ELT
- CI/CD
- Databricks
Preferred Qualifications
- Experience with tools such as Apache Spark, Kafka, Airflow, or comparable technologies.
- Experience with cloud data platforms such as Snowflake, BigQuery, Redshift, or comparable services.
- Familiarity with Docker, Kubernetes, infrastructure as code, and cloud-native architectures.
- Experience with front-end testing tools, accessibility practices, and design systems.
- Experience implementing authentication, authorization, and secure handling of sensitive data.
- A track record of mentoring teammates and leading delivery across multiple systems or teams.
Compensation
- Expected base compensation: $125,000 - $168,650 (USD) per year.
- Actual base compensation within the range may vary based on factors relevant to the position.
- Bonus potential: incentive pay program with payouts based on company performance, job level, and individual performance.
Benefits
- Medical, dental, vision
- Health Savings Account
- Flexible Spending Accounts
- Retirement savings plan
- Sickness and accident benefits
- Life insurance
- Paid vacation & holidays
- Tuition assistance programs
- Employee assistance program
- GM vehicle discounts
Accommodations
If you need a reasonable accommodation to assist with your job search or application for employment, email us or call 1-800-865-7580. Include a description of the specific accommodation requested, along with the job title and requisition number.