Fortune is hiring a Senior Data Engineer based in New York, NY (onsite) to design, build, and operate production ELT pipelines that bring multi-source data into an Amazon Redshift warehouse. The role also owns key platform integrations, data migrations, and analytics structures that support reporting in Looker.
What You Will Do
- Design, build, and maintain production ELT pipelines, primarily in Python, to ingest, clean, and upsert data into Fortune’s Redshift warehouse.
- Ingest data from REST APIs, emailed reports, shared online documents, third-party web portals (using browser automation), and large hourly event streams (via AWS Glue).
- Own platform pipelines for key systems including BigQuery, Google Ad Manager, Google Search Console, Apple News, LinkedIn, YouTube, Piano, and affiliate marketing partners.
- Own data migrations between business systems, including moving data into Salesforce Sales Cloud and Cvent, and subscriber data from Piano into Recurly, with mapping, cleaning, deduplication, and validation for accuracy and usability.
- Design and maintain aggregated analytics tables and data models that power Looker reporting.
- Add testing, monitoring, and documentation to improve reliability and reduce time to resolve pipeline issues.
- Optimize Redshift performance and cost using distribution and sort keys, workload management, and query tuning.
- Partner with business units including marketing, sales, product, editorial, finance, and others to understand data needs and deliver usable outputs.
- Mentor engineers and analysts through code reviews, design reviews, and pairing.
Required Qualifications
- 5+ years of data engineering experience, including ownership of production pipelines.
- Python and SQL proficiency.
- Hands-on experience with a cloud data warehouse, ideally Amazon Redshift (experience with BigQuery or Snowflake is also considered).
- Experience with AWS data services: Glue, S3, Lambda, and IAM.
- Experience pulling data from third-party sources, including paginated and rate-limited APIs, file drops, emailed reports, and web portals.
- Experience leading data migrations across CRM, event, and subscription platforms, including mapping, cleaning, deduplication, and validation.
- Dimensional modeling experience, including building tables for Looker.
- Experience with workflow orchestration (e.g., Airflow) and Git; familiarity with CI/CD and code review processes.
- Ability to explain technical work to people outside engineering.
- Ability to work from the NYC office 4 days per week.
Technologies
Python, SQL, Amazon Redshift, BigQuery, Snowflake, REST APIs, AWS Glue, AWS S3, AWS Lambda, AWS IAM, Salesforce Sales Cloud, Cvent, Recurly, Looker, Airflow, Git, CI/CD, Google Ad Manager, Google Search Console, Apple News, LinkedIn, YouTube, Piano, browser automation, Playwright, Selenium, dbt, Salesforce, Amazon Redshift distribution and sort keys, workload management, query tuning.
Nice to Have
- Experience in digital media or publishing, such as audience, ad revenue, subscription, or syndication data.
- Familiarity with data sources including Google Ad Manager, Search Console, Apple News, YouTube, LinkedIn, or Piano.
- Browser automation experience (e.g., Playwright or Selenium).
- dbt or similar transformation frameworks.
- Experience migrating or rebuilding legacy databases.
- Experience designing engagement or scoring metrics.
Compensation and Work Location
- Salary range: $155,000 to $175,000 base salary per year.
- Bonus eligibility: Discretionary variable annual bonus.
- Location: NYC; 4 days in office (onsite).
Benefits
- 20 vacation days and 2 personal days, plus 11 company holidays, and an honor-based sick leave policy.
- Health, dental, and vision coverage (90% paid for individuals and families), with flexible spending accounts where Fortune contributes to your HSA.
- 401(k) plan.
- Generous parental leave.
- Dependent care, commuter, and cell phone benefits.
- Tuition reimbursement program.