Software Data Engineer
Backend Developer
Python
Application Security
Automation
Automation Developer
Big Data
Bigdata
CI/CD
Cloud
Cloud Infrastructure
Cloud Native
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Database
Databases
Databricks
DevOps
Devops Tools
DevSecOps
Docker
Engineer
Engineering
ETL
Informatica
Information Technology (IT)
Infrastructure As Code
Platform Engineering
Programming
Programming Language
Programming Languages
Security Automation
Software Development
Software Security
Spark
SQL
Workflow Orchestration
Job Description
This early-career Software Data Engineer role focuses on building internal tooling, automating job orchestration, and maintaining CI/CD pipelines. You will work alongside vehicle data engineers and analysts in a heads-down engineering environment where improvements directly support team productivity.
Location and Employment Details
- Location: Fuquay-Varina, NC (onsite)
- Salary: USD 40 - 45 per hour
- Experience: 2+ years
- Work location: On the road
Core Responsibilities
- Design, build, and maintain internal tooling that supports team data workflows and reduces manual effort
- Own and improve GitHub CI/CD pipelines to support reliable, repeatable deployments
- Develop and manage automated Databricks job orchestration and workflow scheduling
- Collaborate with data engineers to support pipeline development as needed
- Write clear documentation for tooling, processes, and automation solutions
- Support repo management, including participation in code reviews, maintaining software quality standards, and contributing to engineering practices
- Develop or consume REST APIs to connect internal systems or trigger automated workflows
Required Qualifications
- 2+ years of professional software development experience, including internships or co-op roles
- Bachelor’s degree in Computer Science, Software Engineering, or a closely related field (or equivalent practical experience)
- Demonstrated ability to write clean, maintainable Python code
- Experience working in a collaborative Git-based development workflow
- Ability to identify business needs and develop recommendations and solutions
- Python: 2 years (Required)
- GitHub: 2 years (Required)
- SQL: 2 years (Required)
Technical Skills
- Python: primary language for tooling, automation, and scripting
- GitHub / Git: branching strategies, pull request workflows, GitHub Actions, and CI/CD pipeline management
- Databricks / Snowflake (or equivalent): notebooks, jobs, and workflows for orchestration and scheduling
- SQL: querying and transforming structured data, with foundational ETL/data engineering concepts
- Workflow orchestration: dependency management, scheduling, and pipeline patterns
- VS Code: proficiency with extensions, debugging, integrated terminal workflows, and GitHub Copilot integration
Technologies
- Python, GitHub, Git
- GitHub Actions, CI/CD
- Databricks, Snowflake
- SQL
- Workflow orchestration
- VS Code, GitHub Copilot
- REST APIs
- FastAPI, Flask, requests
- Databricks Asset Bundles
- Docker, containers
- Delta Lake, Parquet
- CAN bus, telematics
Nice to Have
- REST APIs: experience building or consuming RESTful APIs in Python (FastAPI, Flask, requests)
- Databricks Asset Bundles: or equivalent infrastructure-as-code approaches for Databricks resource management
- Docker / Containers: basic containerization concepts for reproducible environments
- Delta Lake / Parquet: familiarity with columnar and transactional data formats used in lakehouse architectures
- Off-Road / Telematics: exposure to vehicle data, CAN bus, or telematics systems
Benefits
- Dental insurance
- Health insurance
- Paid time off
- Vision insurance