Data Engineer (On-Premise and Hybrid)
Aws Data Engineering
Big Data
Data
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Integration Tools
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Engineer
ETL
Flink
Informatica
Information Technology (IT)
Integration
Software Development
SQL
Job Description
JetHead Development Inc. is hiring a Data Engineer to design and run data pipelines, streaming systems, and hybrid cloud infrastructure in support of analytics and operational decisions.
Responsibilities
- Build and maintain streaming and batch data pipelines using Python, Apache Flink, and Kafka
- Connect data sources using Kafka Connect and AWS Managed Streaming for Apache Kafka (Amazon MSK)
- Create and maintain datasets with Apache Iceberg and enable SQL access through Amazon Athena
- Implement data validation, schema evolution, and error handling to keep pipelines dependable as upstream data changes
- Package, deploy, and operate applications with Docker, Kubernetes, and AWS EKS
- Enable repeatable releases using Helm, Terraform, and GitHub Actions
- Track pipeline health, performance, and failures with Prometheus and Grafana
- Partner with analysts and customers to clarify requirements, troubleshoot issues, and document solutions
Requirements
- Practical Python skills and experience working with structured data
- Experience building data pipelines or applications that ingest, transform, and store data
- Familiarity with containerization and CI/CD practices
- Understanding of Kafka or equivalent event-streaming concepts
- Familiarity with data schemas, data quality checks, and managing data format changes
- Foundational knowledge of cloud infrastructure including compute, storage, networking, and access controls
- Working knowledge of SQL and Git with collaborative development practices
- Strong problem-solving, documentation, and interpersonal skills
- Ability to work a hybrid schedule with on-site time in Carlsbad, CA
- Authorization to work in the United States without employer sponsorship
Technologies
- Python
- Apache Flink
- Kafka
- Kafka Connect
- AWS Managed Streaming for Apache Kafka (Amazon MSK)
- Apache Iceberg
- Amazon Athena
- Docker
- Kubernetes
- AWS EKS
- Helm
- Terraform
- GitHub Actions
- Prometheus
- Grafana
- SQL
- Git
Preferred Qualifications
- Hands-on experience with Apache Flink, Kafka Connect, Apache Iceberg, Athena, or AWS Batch
- Experience with Kubernetes, Helm, Terraform, and GitHub Actions
- Familiarity with Prometheus and Grafana
- Experience with specification-driven development, including tools such as OpenSpec
- Familiarity with Model Context Protocol (MCP) and preparing documented, governed datasets for access through MCP tools
- Knowledge of network or satellite systems
Benefits
- 401(k) retirement plan with employer matching
- Medical, dental, and vision coverage
- Health savings account
- Life insurance
- Paid time off
- 401(k)
- 401(k) matching
- Dental insurance
- Health insurance
- Vision insurance
Job Details
- Job type: Full-time
- Compensation: $90,000.00 - $190,000.00 per year
- Work location: Hybrid remote in Carlsbad, CA 92008
- Commute: Carlsbad, CA 92008 (Required)
- Relocation: Carlsbad, CA 92008 (Relocate before starting work, Required)