Data Engineer
Apache Spark
Big Data
Bigdata
Cloud Data Engineering
Cloud Data Platform
Cloud Platform
Data
Data Architecture
Data Engineer
Data Engineering
Data Governance
Data Integration
Data Lakehouse
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Security
Databricks
Databricks Lakehouse
Databricks Lakehouse Platform
Engineer
Hadoop
Pii/npi
Spark
SQL
Streaming Data
Job Description
The Data Engineer role is available onsite in Tampa, FL and supports a 12-month contract with the possibility of extension. The engagement focuses on data engineering and architecture work centered on the Databricks lakehouse platform, with responsibilities spanning platform design, migration planning, and reliability and cost modeling for production workloads.
Role Details
- Location: Tampa, FL (onsite)
- Duration: 12 Months + Extension
- Bill Rate: $78/hour
- Salary/Hourly: USD 78 - 78 per hourly
- Job ID: J54394
- Employment Type: W-2, 1099, C2C
- Client: To Be Discussed Later
- Domain Exposure: Manufacturing
Key Responsibilities
- Manage stakeholders and vendors
- Produce clear architecture documentation
Required Experience and Skills
- Experience: 12+ years in data engineering or architecture, including 5+ years on the Databricks lakehouse platform
- Databricks and data engineering: strong Databricks lakehouse development with Spark, Delta Lake, and SQL
- Data modeling: medallion and dimensional modeling experience
- AWS architecture: networking, IAM, encryption, and multi-account design
- PII/NPI design: platform design including PII/NPI access models using Unity Catalog and support for lineage
- Migration: plan migration from legacy Hadoop/Hive/warehouse systems
- Batch and streaming: ability to choose between batch and streaming, including Kafka and Structured Streaming designs
- Reliability: disaster recovery and high-availability design
- Cost and capacity: FinOps and Databricks cost and capacity modeling, including development of a business case
Technology Scope
- Databricks lakehouse platform
- Spark
- Delta Lake
- SQL
- Data modeling (medallion, dimensional)
- AWS, IAM, Unity Catalog
- Hadoop, Hive
- Kafka
- Structured Streaming
- PII/NPI
Work Authorization
- US-Citizen, H-1B, OPT-EAD, GC-EAD
- US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other