DataJobs.io
← Back to all jobs

Job Description

CapTech Consulting, through CapTech Sports, is hiring a Data Engineer to help build batch and streaming pipelines and platforms for fan, consumer, brand, and media data. This role focuses on integrating data across multiple sources, applying entity and identity resolution, and enforcing consent, privacy, and access controls so teams can deliver trusted datasets, APIs, and analytics for personalization and measurement. The position is based in Charlotte, NC with a hybrid work setup.

What you’ll do

  • Build and operate batch and streaming pipelines that ingest first-party data from ticketing, streaming, app, CRM, loyalty, commerce, and email and marketing platforms.
  • Ingest brand and media data, including paid and owned media performance, social, broadcast and streaming audience data, sponsorship and brand tracking, and platform and partner feeds.
  • Integrate third-party data such as syndicated audience and consumer data, data clean rooms, and partner-shared datasets, including managing contracts and usage limits.
  • Implement entity and identity resolution to unify one fan as a single record across ticketing, streaming, app, retail, and media touchpoints, and match first-party records to third-party audiences.
  • Model and transform raw data into trusted, documented fan, consumer, brand, and media datasets, including audience segments, engagement metrics, and campaign performance.
  • Apply consent, privacy, and access controls from the first line of the pipeline, with clear separation of first-party and third-party data rights.
  • Deliver data products and APIs that support personalization, campaign activation, media and sponsorship measurement, marketing mix analysis, and AI use cases.
  • Add data quality tests, monitoring, and lineage so issues are detected before clients are impacted.
  • Collaborate with architects, strategists, and analysts to convert requirements into designs, and contribute to estimates and technical proposals.
  • Document work clearly for client engineers and business stakeholders.
  • With experience, own pipeline and platform designs end to end, lead workstreams, review code, and mentor other engineers.

Required skills and experience

  • Python and SQL for production-grade development.
  • Databricks, Snowflake, and Spark, including lakehouse and warehouse patterns.
  • dbt, Airflow, or an equivalent tool.
  • AWS, Azure, or GCP, including storage, compute, and managed data services.
  • Customer data platform patterns, entity and identity resolution, and master data management.
  • Ad platform and media measurement APIs, social and audience data feeds, and experience with clean rooms (such as Snowflake or Databricks clean rooms).
  • REST and event-based integrations with ticketing, CRM, commerce, marketing, and third-party data providers.
  • Consent management and privacy regimes such as CCPA and GDPR, including first-party versus third-party data governance.
  • Git, CI/CD, and infrastructure as code (such as Terraform), plus automated testing.
  • Experience with at least one modern data platform such as Databricks or Snowflake.
  • An interest in sports, media, entertainment, or consumer data, with prior experience in fan, customer, marketing, brand, or media data (including third-party sources) as a plus.
  • Consulting or client-facing experience preferred.
  • Preferred: cloud data certification (AWS, Azure, or GCP) and experience with entity/identity resolution, customer data platforms, or data clean rooms.

Tools and technologies

  • Python, SQL
  • Databricks, Snowflake, Spark
  • dbt, Airflow
  • AWS, Azure, GCP
  • CCPA, GDPR
  • Git, CI/CD
  • Terraform (infrastructure as code)

Benefits

  • CapFlex supporting a remote and hybrid workforce, with daily flexibility while servicing client needs.
  • Learning & Development including certification and tuition support, digital on-demand learning, mentorship, and skill development paths.
  • Modern Health offering 1:1 mental health care, group support sessions, and self-serve resources for employees and their families.
  • Carrot Fertility with inclusive fertility and family-forming coverage and employer-sponsored funds for care.
  • Fringe, a company-paid stipend program for personalized lifestyle benefits.
  • Employee Resource Groups focused on diversity and inclusion in day-to-day operations.
  • Philanthropic Partnerships for community support through partnerships and pro-bono projects.
  • 401(k) Matching with generous matching and no vesting period.

CapTech aims to support long-term career growth with customizable progression and a comprehensive benefits package, including traditional benefits such as generous PTO, health coverage, disability insurance, and paid family leave, plus extended benefits to meet employee needs. CapTech is an equal opportunity employer committed to fostering equality, inclusion, and fairness. CapTech cannot transfer nor sponsor a work visa for this position; applicants must be authorized to work directly for any employer in the United States without visa sponsorship.

#LI-JB1 #LI-Hybrid

Similar Jobs