Senior Data Engineer
Job Description
The Senior Data Engineer role in General Motors’ Intelligent Manufacturing organization focuses on building scalable industrial data pipelines using Fivetran tooling, supporting Business Intelligence and Advanced Analytics. This hybrid position is based in Austin, TX and emphasizes end-to-end ETL, monitoring and troubleshooting, and modern software engineering practices across cloud and streaming technologies.
Responsibilities
- Assemble large, complex data sets that satisfy functional and non-functional business requirements.
- Identify and implement process improvements, including automation, data delivery optimization, and infrastructure redesign for scalability.
- Lead and deliver data-driven solutions across multiple languages, tools, and technologies.
- Develop and configure end-to-end data pipelines using Fivetran to support efficient extraction, transformation, and loading (ETL).
- Set up integrations by connecting multiple data sources (APIs, SaaS platforms, databases) to Fivetran, managing schema mapping and transformations.
- Monitor pipeline performance, troubleshoot issues, and implement improvements that enhance scalability and reliability.
- Contribute to architecture discussions, solution design, and strategic technology adoption.
- Build and optimize highly scalable data pipelines that include complex transformations and efficient code.
- Design and develop new source system integrations from varied formats, including files, database extracts, and APIs.
- Design and implement solutions for delivering data that meets SLA requirements.
- Partner with operations teams to resolve production issues related to the platform.
- Apply best practices such as Agile methodologies, design thinking, and continuous deployment.
- Develop tooling and automation to improve repeatability of deployments and production monitoring.
- Collaborate with business and technology partners by providing leadership, best practices, and coaching.
- Mentor peers and junior engineers, and educate colleagues on emerging industry trends and technologies.
Requirements
- Bachelor’s degree in Computer Science, Software Engineering, or related field, or equivalent experience.
- 7+ years of data engineering and development experience, including Python or Scala, SQL, and relational and non-relational data storage (ETL frameworks, big data processing, NoSQL).
- 3+ years of experience with distributed data processing (Spark) and container orchestration (Kubernetes).
- Proficiency in data streaming in Kubernetes and Kafka.
- Proven experience with Fivetran (pipeline setup, connectors, transformations).
- Experience with cloud platforms: Azure preferred; AWS or GCP also considered.
- Solid understanding of CI/CD principles and tools.
- Familiarity with big data technologies such as Hadoop, Hive, HBase, Object Storage (ADLS/S3), and Event Queues.
- Strong understanding of performance optimization techniques such as partitioning, clustering, and caching.
- Proficiency with SQL, key-value datastores, and document stores.
- Familiarity with data architecture and modeling concepts to support efficient data consumption.
- Advanced understanding of data normalization and denormalization techniques.
- Translate enterprise requirements into effective data models and address project requirements as applicable.
- Design, build, and optimize scalable batch and streaming data pipelines using Databricks (Apache Spark, Delta Lake) to support Medalion Architecture.
- Automate workflows and maintain clear documentation for data processes.
- Contribute to the design and operational management of a cloud-native data platform on Azure, integrating Azure Data Lake Storage, Event Hubs, Azure SQL, and AKS.
- Monitor and troubleshoot data pipelines and platform workloads, optimizing Spark jobs, cluster configurations, and SQL warehouses for performance improvements.
- Strong collaboration and communication skills, with the ability to work across multiple teams and disciplines.
Technology Focus
- Fivetran
- Python, Scala, SQL
- ETL frameworks, Spark
- Kubernetes, Kafka
- Azure (preferred), AWS, GCP
- CI/CD, Hadoop, Hive, HBase
- Object Storage (ADLS/S3), Event Queues
- Databricks, Apache Spark, Delta Lake
- Medalion Architecture, Azure Data Lake Storage, Event Hubs, Azure SQL, AKS
- Agile methodologies, continuous deployment
The Role
As a Data Engineer with a Fivetran tooling focus, you will design, build, and optimize industrialized data assets and data pipelines that support Business Intelligence and Advanced Analytics objectives. Within the Intelligent Manufacturing organization under Data Engineering Software, you will deliver high-quality, scalable solutions aligned with functional and non-functional business requirements. The scope includes projects across databases, streaming technologies, CI/CD, and cloud platforms.
Intelligent Manufacturing Team Context
The Intelligent Manufacturing teams are responsible for ideating, incubating, and delivering new plant data solutions for General Motors. Work includes integrating with business and IT teams to develop real-time solutions that leverage plant floor data to support decisions, plant asset maintenance, safety, and operational performance, as well as Vehicle Build Data.
Preferred Qualifications
- Master’s degree in Computer Science, Software Engineering, or related field.
- Knowledge of data governance, metadata management, or data quality and observability.
- Familiarity with schema design and data contracts.
- Experience handling various file formats (video, audio, image).
- Experience with Databricks, Snowflake, or similar platforms.
Compensation
Base compensation: USD 125,000 - 168,650 per year. Actual base compensation within the identified range will vary based on factors relevant to the position.
Bonus potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
Benefits
- Medical
- Dental
- Vision
- Health Savings Account
- Flexible Spending Accounts
- Retirement savings plan
- Sickness and accident benefits
- Life insurance
- Paid vacation and holidays
- Tuition assistance programs
- Employee assistance program
- GM vehicle discounts
Location and Work Arrangement
Austin, TX (hybrid)
Immigration Sponsorship
General Motors does not provide immigration-related sponsorship for this role. Do not apply if you will need GM immigration sponsorship now or in the future, including direct company sponsorship, entry of GM as the immigration employer of record on a government form, or any work authorization requiring a written submission or other immigration support from the company (for example, H-1B, OPT, STEM OPT, CPT, TN, J-1, etc.).
Accommodations
General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email or call 1-800-865-7580.