Multivariate Testing

Multivariate Testing Data Jobs

2 jobs found

Today

Data Scientist, Experimentation

News Corp Austin, TX

Austin, TX

Today

Full time Python Analytics Artificial Intelligence

Apply Now

Job Description

Join News Corp in Austin, TX as a senior analytics partner helping teams make better product decisions through experimentation, business analytics, and reporting. This role partners across Product, Engineering, Finance, Marketing, and Business Intelligence to optimize product development and improve the consumer experience using advanced analytics and performance measurement. You will also be part of an in-person culture that balances creativity and innovation with strong data maturity.

What you’ll do

Support short- and long-term strategic goals across core product initiatives.
Lead exploratory analyses to identify and size product development opportunities, weighing trade-offs between feature growth and optimization.
Own learning agendas, design multivariate tests, and translate complex findings into recommendations that shape critical business decisions and inform the product roadmap.
Define success metrics for strategic initiatives and deliver high-quality, data-driven analyses focused on consumer behavior, segmentation, and quality acquisition.
Build and advance self-service AI-enabled reporting tools so cross-functional teams can explore, measure, and monitor performance independently.
Improve tracking and data quality through continuous iteration, including deep-dive analyses to answer key product and business questions.
Use descriptive, statistical, and predictive analytics to uncover foundational insights into consumer preferences, behaviors, and intent, with a direct path to influencing product direction.

What you’ll bring

MS/BS in computer science, statistics, mathematics, operations research, or a related field, plus 2+ years of relevant experience in data science, machine learning, or applied statistics.
Strong background in product analytics or experimentation.
Proficiency in SQL, Python, Tableau, and Amplitude (or similar analytics tools).
Experience with AI-enabled tools: Streamlit, Claude/MCP, n8n, Windsurf (required).
Ability to create ETL pipelines using dbt + Airflow.
Strong creative thinking and problem-solving skills, with a focus on experimentation and measurable user experience impact.
Excellent communication skills to explain analytical, statistical, or ML concepts to both technical and non-technical stakeholders.

Tools you’ll work with

Python, SQL, Tableau, Amplitude
dbt, Airflow
Streamlit, MCP, Windsurf, Claude, n8n

Benefits and support

Inclusive and competitive medical, Rx, dental, and vision coverage
Family forming benefits
13 Paid Holidays
Flexible Time Off
8 hours of paid Volunteer Time Off
Immediate eligibility into the Company 401(k) plan with 3.5% company match
Tuition Reimbursement program for degreed and non-degreed programs
1:1 personalized Financial Planning Sessions
Student Debt Retirement Savings Match program
Free snacks and refreshments in each office location

How you’ll work

News Corp balances creativity and innovation with a foundation of in-person collaboration. For most roles, employees work four or more days in the Austin headquarters.

View full job page →

2mo ago

AI Engineer

Wayy Research Remote 🌍 Remote

Remote

2mo ago Closed

$60 - $70/hr Full time Marketing Python Algorithms

This position is no longer accepting applications (closed Aug 29, 2026).

Job Description

Wayy Research is advancing the precision of measurement in digital marketing analytics. As an AI Engineer, you will own the algorithms for budget allocation, attribution, and rigorous experimental measurement, determining whether cross-channel effects are real or simply noise, all in a remote-friendly setting.

Responsibilities

Develop and maintain a multi-armed bandit engine using Thompson Sampling on Beta-Bernoulli reward models, with contextual extensions as needed. Manage exploration-exploitation tuning, cold-start handling, and non-stationary reward drift.
Build an attribution system around Shapley value-based multi-touch credit assignment, benchmarking against first-touch, last-touch, and position-based baselines.
Design and operate experiment infrastructure for A/B and multivariate tests, including power analyses, sequential testing with alpha spending, and significance testing that remains valid despite peeking.
Execute cross-channel causal measurement using geo holdouts, incrementality tests, and difference-in-differences designs to isolate true interaction effects from mere correlations.

Requirements

Strong Python skills with experience in NumPy, SciPy, pandas, and scikit-learn.
Hands-on experience with multi-armed bandits—Thompson Sampling, UCB, and epsilon-greedy—and a solid understanding of regret bounds, not just APIs.
Expertise in hypothesis testing and experimental design, including power analysis, multiple comparisons correction, sequential testing, and addressing the peeking problem.
Proven track record shipping production-grade A/B tests, not solely performing analysis.
Causal inference experience—DiD, synthetic control, instrumental variables, or incrementality testing.
Advanced SQL proficiency with PostgreSQL.

Technologies

Python
NumPy
SciPy
pandas
scikit-learn
PostgreSQL
PyMC
Stan
NumPyro

Benefits

Pay: USD 60.00 - 70.00 per hour
Remote

You’ll fit if

You are uncomfortable with lift numbers reported without a control group and can articulate the difference between a channel that converts and a channel that causes conversions to a CMO without condescension.

Strongly preferred

Marketing mix modeling or media measurement background
Bayesian methods experience with PyMC, Stan, or NumPyro
Shapley values or cooperative game theory applied to attribution
Production ML deployment experience, not just notebooks

View full job page →

Multivariate Testing Data Jobs

Data Scientist, Experimentation

AI Engineer

Get Multivariate Testing Data Jobs alerts