Data Engineer - Databricks

Vaco by Highspring seeks a Data Engineer with strong Databricks expertise to modernize and scale BI capabilities within its Tampa, Florida operations. The role centers on designing end-to-end data pipelines, deploying machine learning solutions, and operationalizing intelligent analytics to inform decision-making across the organization. This on-site position requires a minimum of five years of data engineering experience and a relevant bachelor’s or master’s degree in computer science, data engineering, statistics, or a related field.

Location

Tampa, FL (onsite)

Salary

USD 100,000 per yearly

Responsibilities

• Create and maintain full data pipelines and integration workflows
• Design and construct robust data pipelines
• Implement and deploy machine learning models and solutions
• Operationalize analytics to inform strategic decisions across the business

Requirements

• Databricks expertise
• Advanced SQL optimization and complex query design
• Kafka streaming applications and connector development
• Databricks workflow development with medallion architecture
• Data governance implementation and compliance
• Performance tuning for large-scale data processing
• Data security and privacy best practices
• Apache NiFi pipeline development for invoice and PO processing
• Integration with purpose-built data stores (Druid, MongoDB, OpenSearch, PostgreSQL)
• Build and maintain end-to-end ML pipelines for training, deployment, and monitoring of models
• Design and optimize data architectures for large-scale ML workloads
• Explore and implement LLM-based solutions, RAG architectures, and generative AI for business use cases
• Cross-functional collaboration with product and engineering teams
• Technical mentoring for junior data engineers
• Analytical thinking for complex data problems
• Stakeholder communication for data requirements
• Process improvement and efficiency focus
• Direct communication with data platform vendors
• Evaluates vendor tools for specific data use cases
• Provides technical feedback on vendor product roadmaps
• Coordinates with vendors for data integration projects
• 5+ years in data engineering
• 2+ years applying ML in production
• Bachelor's or Master's in Computer Science, Data Engineering, Statistics, or related field

Technologies

• Databricks platform
• SQL
• Kafka
• Apache NiFi
• Medallion architecture
• Druid
• MongoDB
• OpenSearch
• PostgreSQL

Benefits

• Discretionary bonuses
• Medical benefits
• Dental benefits
• Vision benefits
• 401(k) retirement plan