Staff Data Scientist

Intuit (CK Intelligence) is hiring a Staff Data Scientist in San Diego, CA (onsite) to lead measurement strategy and analytical direction for Credit Karma’s AI products.

Responsibilities

• Identify, evaluate, and size AI use cases against business value; apply personalization and automation frameworks to influence what gets built
• Build and run AI evaluation programs, including golden datasets and LLM-as-judge calibration, to certify non-deterministic experiences
• Diagnose evaluation gaps and improve where experiences need to get better
• Develop measurement strategies for AI products when established benchmarks do not yet exist
• Define leading indicators, learning milestones, success criteria, and quality, latency, and reliability bars before experiences reach members
• Use causal inference and counterfactual reasoning to determine what actually moved a metric
• Design and run experiments and holdouts to confirm whether AI delivers incremental value versus simple adoption
• Own predictive models through their lifecycle
• Frame the right questions before analysis begins and drive AI product strategy with evidence
• Generate insights and testable hypotheses that inform roadmaps and resource decisions
• Define business metrics and causal levers the business manages to
• Deepen understanding of how members discover, adopt, and return to AI experiences, including which jobs-to-be-done are truly solved
• Differentiate experiences that create genuine member value from those that merely shift where activity happens
• Build and maintain the data products CK Intelligence and its agents depend on
• Prototype the data model, pipeline, and surface; partner with engineering to harden what sticks and govern decision systems between data and member experience
• Automate analytical bottlenecks into agentic systems stakeholders can run independently
• Own agent context so it inherits analytical rigor; decide with evidence which work can run without human in the loop
• Create visualizations, dashboards, and presentations that help leadership understand performance, tradeoffs, and emerging opportunities
• Bring clarity to complex or incomplete analytical narratives
• Act as a trusted data science partner to senior leaders across Product, Engineering, Design, and Marketing
• Facilitate cross-functional alignment using data to build shared understanding of hypotheses, performance drivers, risks, and opportunities
• Champion best practices in experimentation, AI evaluation, measurement, and decision science
• Mentor data scientists and analysts; contribute to a culture of rigorous, data-informed innovation

Requirements

• 8+ years of experience in data science, analytics, business intelligence, or a related field, ideally in consumer technology, financial technology, marketplaces, or SaaS
• Proven record of shaping strategy and influencing executive decisions through data
• Experience supporting zero to one products, emerging business models, growth initiatives, or similarly ambiguous environments
• Experience measuring or evaluating AI, machine learning, or personalization products, including evaluation approaches for generative or non-deterministic experiences (e.g., golden datasets, LLM-as-judge, human review, quality and latency monitoring)
• Strong expertise in experimentation, performance measurement, customer analytics, and causal or decision-oriented analysis
• Ability to define success metrics and learning frameworks for initiatives without established benchmarks
• Strong business acumen across customer acquisition, engagement, retention, product strategy, and operations
• Expertise in data visualization tools such as Tableau, Power BI, Looker, or similar
• Advanced SQL; experience using Python or R for analysis, modeling, and automation
• Exceptional storytelling and communication skills for clear business narratives from complex or incomplete data
• Demonstrated ability to lead cross-functional initiatives and deliver impact in ambiguous, fast-moving settings
• Ability to balance analytical rigor with speed, judgment, and pragmatic decision-making

Technologies

• Tableau
• Power BI
• Looker
• SQL
• Python
• R
• Golden datasets
• LLM-as-judge
• Human review

Benefits

• Competitive compensation package with pay for performance rewards approach
• This position may be eligible for a cash bonus
• This position may be eligible for equity rewards and benefits
• Benefits described in Intuit®: Careers | Benefits

Company overview

• Intuit is a global financial technology platform that powers prosperity for the people and communities it serves
• Approximately 100 million customers worldwide use products such as TurboTax, Credit Karma, QuickBooks, and Mailchimp
• Intuit believes everyone should have the opportunity to prosper and continues innovating to make that possible

Team overview

• CK Intelligence builds Credit Karma’s AI products
• Developing AI-native experiences across three pillars: Chat (members ask anything about their finances), Agents (complete multi-step work on a member’s behalf), and Insights (proactively surface what changed and what to do next)
• This role helps shape the strategy and measurement of Credit Karma’s next generation of AI capabilities

Role overview

• Own measurement strategy and analytical direction for Credit Karma’s AI products across Chat, Agents, and Insights
• Partner with leaders across Product, Engineering, Design, and Marketing to assess emerging opportunities, shape experimentation strategy, and determine which AI capabilities to refine, scale, or deprioritize
• Own evaluation to certify these experiences are good enough to ship
• Combine rigorous analysis with business judgment to clarify ambiguous questions and support confident investment decisions when the model is imperfect

Pay

• Estimated base pay range: San Diego $185,500 - $251,000 per year