Data Engineer
Apache Airflow
Automation
Batch And Streaming
Big Data
Bigdata
Cloud
Cloud Infrastructure
Cloud Platform
Cloud Platforms
Cloud Technology
Data
Data Analysis
Data Analytics
Data Analytics Tools
Data Architecture
Data Build Tool
Data Engineer
Data Engineering
Data Integration
Data Management
Data Modeling
Data Operations
Data Pipeline
Data Pipelines
Data Platform
Data Processing
Data Transforms
Data Warehouse
Database
Databases
DevOps
DevSecOps
Engineer
ETL
Event Driven Architecture
Facilities Management
Flink
Information Technology (IT)
Infrastructure As Code
Integration
Kafka
Programming
Programming Language
Programming Languages
Project Management
Security Automation
Security Devops
Software Development
Spark
SQL
Stream Processing
Streaming Data
Workflow Orchestration
Job Description
CapTech Sports is seeking a mid-level Data Engineer to build pipelines and platforms that translate live and historical competition feeds into reliable datasets, data products, and APIs. The role focuses on integrating scoring and tracking inputs, reconciling discrepancies across sources, and enabling downstream analytics and AI-driven applications.
Responsibilities
- Build and operate batch and streaming pipelines that ingest data from scoring systems, tracking and sensor providers, and camera and officiating systems, as well as league and partner sources.
- Process real-time and near-real-time event data with attention to availability and latency requirements for live competition.
- Model competition data including athletes, teams, events, schedules, results, and positional and tracking information into trusted, documented datasets.
- Reconcile data across providers and systems, accounting for late, corrected, and out-of-order events.
- Implement data quality tests, monitoring, lineage, and alerting to surface issues before events.
- Deliver data products and APIs supporting officiating, analytics, broadcast and media, and AI use cases such as computer vision.
- Partner with architects, strategists, and analysts to convert requirements into designs, and communicate work clearly to client stakeholders.
- Review code and mentor less experienced engineers.
Requirements
- Typically 4 to 8 years of experience building and running production data pipelines in a cloud environment.
- Strong proficiency in Python and SQL.
- Experience with streaming or event-driven data, and experience with at least one modern data platform such as Databricks or Snowflake.
- Ability to own a pipeline or data domain end to end, make trade-offs between speed, cost, and reliability, and work independently with client technical teams.
- Clear written and verbal communication skills.
- Interest in sports; prior experience with competition, scoring, tracking, or sensor data is a plus.
- Consulting or client-facing experience preferred.
- Preferred: cloud data certification (AWS, Azure, or GCP) and experience with computer vision, tracking, or sensor data.
Technical Skills & Tools
- Languages: Python, SQL
- Streaming and real-time: Kafka, Kinesis, Event Hubs, Pub/Sub, Spark Structured Streaming, Flink
- Data platforms: Databricks, Snowflake, Spark (lakehouse and warehouse patterns)
- Data types: time-series and spatial data; event, tracking, and sensor data formats; positional data modeling
- Transformation and orchestration: dbt, Airflow, or equivalent
- Cloud: AWS, Azure, or GCP including storage, compute, and managed data services
- Engineering practice: Git, CI/CD, infrastructure as code (such as Terraform), automated testing
- APIs and integration: REST and event-based integrations with scoring, tracking, and vendor systems
Benefits
- Generous PTO
- Health coverage
- Disability insurance
- Paid family leave
- CapFlex supporting a remote and hybrid workforce with daily flexibility while servicing clients
- Learning & Development programs including certification and tuition support, digital on-demand learning, mentorship, and skill development paths
- Modern Health mental health and well-being platform with 1:1 care, group support sessions, and self-serve resources
- Carrot Fertility inclusive fertility and family-forming coverage for all paths to parenthood and employer-sponsored funds
- Fringe company-paid stipend program for personalized lifestyle benefits
- Employee Resource Groups
- Philanthropic Partnerships
- 401(k) Matching with generous matching and no vesting period
Additional Information
- Location: Atlanta, GA (hybrid).
- At this time, CapTech cannot transfer nor sponsor a work visa for this position. Applicants must be authorized to work directly for any employer in the United States without visa sponsorship.
- Tags: #LI-JB1; #LI-Hybrid.
Similar Jobs
S
G