Senior Data Scientist III - AI Assurance Researcher
Job Description
The Senior Data Scientist III role supports AI assurance research at Pacific Northwest National Laboratory. The position focuses on how AI models learn and make decisions, and on developing approaches to evaluate and improve reliability, including uncertainty, robustness, and the impact of adversarial inputs.
Key Responsibilities
- Lead research projects or major components of larger efforts by coordinating technical direction, team contributions, and research milestones.
- Define research questions, develop or adapt methods, and design and execute deep learning experiments, including large-scale experimentation when appropriate using high-performance computing (HPC) infrastructure.
- Analyze how model architectures, training dynamics, and internal computations influence behavior, drawing on findings from large language and vision models to explain capabilities and failure modes.
- Create methods to quantify uncertainty and evaluate robustness under distribution shift or adversarial inputs. Use red and blue teaming to identify vulnerabilities and assess defensive approaches.
- Build reproducible evaluation processes to study model reliability and failure modes, compare methods against appropriate baselines, and communicate results, including uncertainty and limitations.
- Develop reproducible research code and collaborate with engineers to convert research findings and prototypes into practical tools and capabilities.
- Lead preparation of publications, technical reports, and presentations that convey team findings.
- Provide mentorship to researchers and engineers through technical discussions, feedback, and collaboration.
- Generate research ideas and contribute to proposals with collaborators.
- Perform work in secure environments in accordance with operational security requirements.
Required Qualifications
- BS/BA with 5+ years of data science experience, or MS/MA with 3+ years of data science experience, or PhD with 1+ year of data science experience.
- Experience conducting deep learning research to investigate how models learn, behave, or generalize.
- Experience using Python and PyTorch for deep learning research.
- Ability to obtain and maintain a federal security clearance.
- U.S. Citizenship.
- Applicants selected will be subject to a Federal background investigation and must meet eligibility requirements for access to classified matter in accordance with 10 CFR 710, Appendix B.
- Drug testing requirements for Testing Designated Positions, including pre-employment and random post-employment drug testing. Applicants must demonstrate non-use of illegal drugs, including marijuana, for the 12 consecutive months preceding completion of the requisite Questionnaire for National Security Positions (QNSP).
- Note: Applicants will be considered ineligible for security clearance processing by the U.S. Department of Energy if non-use of illegal drugs, including marijuana, for 12 months cannot be demonstrated.
Preferred Qualifications
- Experience explaining model behavior through analysis of internal representations and computations, including mechanistic interpretability of large language or vision models.
- Experience developing or evaluating methods to assess tool-using models and multi-step agentic workflows, including analysis of execution traces, task outcomes, and failure modes.
- Experience designing and executing large-scale deep learning experiments.
- Experience leading research projects or major technical efforts, including formulating research questions, developing or adapting methods, coordinating contributors, and evaluating and communicating results.
- Experience translating research prototypes into tools or capabilities, or contributing peer-reviewed publications or other technical contributions in relevant research areas.
- Experience supporting national security missions.
Technologies
- Python
- PyTorch
- HPC infrastructure
- Large language models
- Vision models
Benefits
- Medical insurance, dental insurance, and vision insurance.
- Robust telehealth care options, several mental health benefits, and free wellness coaching.
- Health savings account and flexible spending accounts.
- Basic life insurance and disability insurance*.
- Employee assistance program and business travel insurance.
- Tuition assistance and relocation support.
- Backup childcare.
- Legal benefits, supplemental parental bonding leave, surrogacy and adoption assistance, and fertility support.
- Company-funded pension plan* and a 401(k) savings plan with company match*.
- Accrue up to 120 vacation hours per year and receive 10 paid holidays per year.
Security and Work Environment Requirements
- Testing Designated Position (TDP): This position is a Testing Designated Position. The selected candidate will be subject to pre-employment and random drug testing for illegal drugs, including marijuana.
- HSPD-12 PIV Credential Requirement: New employees must obtain and maintain a HSPD-12 Personal Identity Verification (PIV) Credential in line with Homeland Security Presidential Directive 12 (HSPD-12) and Department of Energy (DOE) Order 473.1A. Credential issuance requires successful completion of the applicable tier of federal background investigation after hire and favorable federal adjudication.
- All tiers of investigation include a declaration of illegal drug activities within the last 1 to 7 years (depending on the applicable tier). Marijuana and cannabis derivatives are considered illegal under federal law regardless of state laws.
- Foreign national candidates: If the candidate has not resided in the U.S. for three consecutive years, they are not eligible for the PIV credential and must obtain a favorable Local Site Specific Only (LSSO) Federal risk determination to maintain employment. After meeting the three-year residency requirement, a PIV credential is required to maintain employment.
Role Details
- Location: Richland, WA (onsite)
- Salary: USD 140,200 to 228,800 per year
- Minimum Experience: 1 year
- Education: PhD