DataJobs.io
← Back to all jobs
OpenAI

Data Scientist, Integrity

San Francisco, CA $265k - $380k/yr Full time Posted 1d ago

Job Description

Join OpenAI’s Integrity team to analyze emerging abuse patterns and support data-driven decisions across detection, enforcement, and product launches.

Responsibilities

  • Investigate anomalous activity across products
  • Estimate prevalence, who is affected, and user or business impact, then use evidence to prioritize where to focus
  • Define outcome metrics and guardrails
  • Build and evaluate detection rules, classifiers, and human review workflows
  • Use labeled samples and review outcomes to understand what systems miss, where they flag legitimate activity, and how errors vary by user and product
  • Design randomized holdouts
  • Apply quasi-experimental or observational methods when randomization is impractical
  • Estimate harm or fraud losses prevented alongside effects on legitimate users, revenue, compute costs, and review workload
  • Recommend whether to launch, expand, adjust, or retire a control
  • Identify where signals, review decisions, or enforcement actions break down
  • Partner with teams to close gaps and build reusable datasets, analyses, and investigation tools
  • Collaborate with Product, Engineering, Research, Policy, and Operations to turn findings into improvements and measure outcomes after changes ship

Requirements

  • Ability to use AI tools to investigate large, messy datasets, test hypotheses quickly, and automate recurring analyses
  • Fluency in SQL and Python and ability to verify AI-generated queries, code, and conclusions against underlying data
  • Strong statistical judgment with experience in experimentation, causal inference, or observational analysis
  • Ability to reason with incomplete or biased labels and explain how uncertainty affects decisions
  • Ownership of open-ended problems, including deciding what to measure, recommending actions, and checking results
  • Clear communication with both technical and nontechnical partners, including explaining tradeoffs behind recommendations
  • Helpful: experience in integrity, trust and safety, fraud or risk analytics, security analytics, or applied ML evaluation
  • Plus: experience evaluating detection systems, human review, or LLM-based classifiers

Technologies

  • SQL
  • Python
  • LLM-based classifiers

Compensation

  • Base salary: USD 265,000 - 380,000 per year
  • Additional: Offers Equity
  • Base pay may vary based on individualized factors

Benefits

  • Medical, dental, and vision insurance for you and your family, with employer contributions to Health Savings Accounts
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses (parking and transit)
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents and 20 weeks for non-birthing parents), plus paid medical and caregiver leave (up to 8 weeks)
  • Paid time off: flexible PTO for exempt employees and up to 15 days annually for non-exempt employees
  • 13+ paid company holidays, multiple paid coordinated company office closures, and paid sick or safe time (1 hour per 30 hours worked, or more as required by applicable state or local law)
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in offices and meal delivery credits as eligible
  • Relocation support for eligible employees
  • Additional taxable fringe benefits may be provided, including charitable donation matching and wellness stipends

About the Team

  • Protects people and businesses using ChatGPT, Codex, and the API from fraud, abuse, and harmful misuse
  • Work includes payment and promotional abuse, compromised accounts and API credentials, business and advertiser integrity, and emerging misuse of frontier AI capabilities
  • Supports product teams with measurement of authentic usage so abuse does not distort product growth decisions
  • Integrity Data Science helps teams decide where to intervene and whether interventions work

Location

  • San Francisco, CA (onsite)

Similar Jobs