Senior Data Engineer
Senior
Analytics
Apache Beam
Big Data
Cloud
Cloud Infrastructure
Cloud Native
Cloud Platform
Cloud Platforms
Cloud Technology
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Data Warehousing
Database
Databases
Databricks
DevOps
Engineer
Engineering
ETL
Flink
GitHub
Gitlab
Kafka Streams
Kubernetes
PostgreSQL
Programming Languages
Snowflake
Software Development
SQL
Job Description
This contract Senior Data Engineer opportunity is based in Lake Buena Vista, FL, with a hybrid work arrangement. The role centers on designing, building, and implementing data engineering systems and ETL/ELT pipelines, with on-site presence required Monday through Thursday and remote work available on Fridays.
Responsibilities
- Collaborate with stakeholders to gather and refine data requirements.
- Define source-to-target data mappings to support integration efforts.
- Develop and review data validation scripts to ensure data quality.
- Design, implement, and monitor ETL and ELT data pipelines.
- Produce datasets used as inputs for analytical models and visualizations.
- Participate in technical reviews to ensure high quality deliverables.
- Develop an understanding of business domains and processes to inform assigned work.
- Communicate data engineering progress to project leadership.
- Actively contribute to meetings and discussions with the project team.
Requirements
- Bachelor's degree in Computer Science, Mathematics, Software Engineering, or a related field, or equivalent experience.
- Minimum of 2 years of experience in ELT/ETL development.
- 5+ years of experience building ELT/ETL pipelines using SQL and Python.
- 2+ years developing and maintaining data pipelines with a framework such as Apache Flink, Apache Beam, or Kafka Streams.
- Experience and understanding of one or more business domains to assist in gathering and refining data requirements and data design solutions.
- Experience developing in multiple environments (Dev, QA, Prod) and implementing DevOps procedures for code deployment and promotion.
- Strong database design knowledge and proficiency with platforms such as PostgreSQL or Snowflake.
- Experience managing and deploying code using GitLab or GitHub.
- Ability to articulate solutions and communicate complex technical concepts to non-technical team members.
Technologies
- Snowflake
- SQL
- Python
- Apache Flink
- Apache Beam
- Kafka Streams
- Docker
- Kubernetes
- AWS
- Databricks
- PostgreSQL
- GitLab
- GitHub
Benefits
- Medical, dental, and vision coverage
- 401(k) with company match
- Short-term disability
- Life insurance with AD&D