Data Engineer Sr

Oshkosh Corporation’s Advanced Analytics team is seeking a Sr. Data Engineer in Oshkosh, WI (onsite) to build and scale data engineering capabilities for preventive maintenance and intelligent vehicle control.

Responsibilities

• Design and develop scalable Change Data Capture (CDC) and ETL solutions to move data from source systems to analytics platforms (structured and unstructured; batch and streaming).
• Implement data engineering using tools and platforms including Terraform, Spark, Databricks, Snowflake, and Git, with Azure infrastructure management.
• Work with Azure services such as ADLS Gen2, Azure Compute, Azure Data Factory, AI Foundry, AKS, VPC’s, and Storage Accounts, plus other supporting components.
• Support data governance activities, including quality and security across data lake and enterprise data warehouse systems across business segments.
• Assist with performance tuning for data processes and troubleshoot data processing issues.
• Coordinate and communicate across disciplines, departments, and segments.
• Develop rapid prototyping and design processes to speed delivery to the business.
• Maintain reference architecture and documentation for architectural governance and application roadmap purposes.
• Assist with education on best practices for data work, including data modeling, database design, ETL design, and job scheduling and monitoring.
• Assist or direct feasibility studies and help produce project estimates (manpower, budget development, and timelines) for proposed R&D projects.
• Follow the supervisor/program manager guidance on a mutually agreed schedule with minimum mentoring.
• Provide clear feedback on technical hurdles, progress, and priority alignment based on business needs.

Requirements

• Bachelor’s degree in computer science, data science, or a related field, plus 4+ years working as a data engineer, ETL developer, and/or data warehouse DBA.
• 3-5 years experience in a Data Engineering or Analytics organization in a technical role.
• 2+ years software development experience (Python/Go preferred).
• 3+ years experience with a major cloud provider (AWS/Azure/GCP).
• Strong proficiency with SQL, Bash, and Python, including experience with Anaconda.
• 2+ years operating in Unix/Linux and Windows server environments.
• 2+ years operating in an Agile / Scrum environment.
• Experience with cloud-based data services and solutions, including Azure Synapse / Data Lake, AWS RedShift, Snowflake, and GCP Big Query.
• Experience partnering with Analytics and Data Science teams to build production-grade GenAI/ML solutions.
• Familiarity with CDC tools such as Qlik Replicate, Striim, and Debeezium.
• Experience with big data tools and architectures including Cloudera Hadoop, HDFS, Hive, and Spark.
• Working knowledge of telematics interfaces and streaming solutions such as MQTT, NiFi, and Kafka.
• Automotive or heavy duty on/off-road vehicle experience, including digital data bus concepts such as Ethernet or Controller Area Network (CAN).
• Highly organized and detail-oriented with strong critical thinking, analytical, and problem-solving skills.
• Ability to manage multiple tasks in a fast-paced environment independently and as part of a team.
• Excellent interpersonal skills and ability to present information and respond to questions from leadership and peers.

Technologies

• Change Data Capture (CDC), ETL, Terraform, Spark, Databricks, Snowflake, Git
• Azure infrastructure management: ADLS Gen2, Azure Compute, Azure Data Factory, AI Foundry, AKS, VPC’s, Storage Accounts
• SQL, Bash, Python, Anaconda
• AWS, Azure, GCP
• Azure Synapse, Data Lake, AWS RedShift, GCP BigQuery
• GenAI/ML
• Qlik Replicate, Striim, Debeezium
• Cloudera Hadoop, HDFS, Hive
• MQTT, NiFi, Kafka
• Ethernet, Controller Area Network (CAN)

Pay Range

• $104,100.00 - $173,900.00 per year