Senior Data Scientist (Internal Audit Model & AI Risk)

Lead independent internal audit reviews focused on AI and model risk at Navy Federal Credit Union.

Responsibilities

• Assess AI and model governance activities, including inherent risk ratings, model validations, materiality of model changes, and ongoing performance monitoring
• Plan and conduct independent internal audit engagements covering AI products, AI-enabled systems, and models, coordinating scope, timelines, stakeholder expectations, and communication
• Develop and execute model testing plans using specialized model risk knowledge and technical approaches
• Evaluate model development, implementation, and use across conceptual soundness, assumptions, methodology, limitations, data quality, and monitoring
• Extract meaningful insights from large data and metadata sources
• Test hypotheses, analyze results, and interpret findings using sound judgment within defined procedures
• Develop and code moderately complex software programs, algorithms, and automated processes to support analysis and assurance activities
• Use modeling and trend analysis to analyze data and produce insights
• Apply understanding of best practices and ethical AI
• Transform data into charts and tables that support effective decision making
• Build working relationships with team members and subject matter experts; lead small projects and initiatives
• Document and present analysis findings using effective written and verbal communication for diverse stakeholders
• Provide independent assurance through assessments of complex data science, machine learning, generative AI, and agentic AI capabilities across the organization
• Evaluate relevant ecosystems by reviewing governance frameworks, risk management practices, AI/model lifecycle controls, and oversight effectiveness across first and second lines of defense
• Assess risks tied to advanced analytics and AI-enabled solutions, including complexity, uncertainty, transparency, and operational risk
• Act as a subject matter expert to Internal Audit, senior management, and business partners on end-to-end AI/model lifecycle management, monitoring, regulatory expectations, and industry practices

Requirements

• 5-7 years experience in data analysis, statistical modeling, or regression analysis, including language models, LLMs, and/or Generative AI technologies
• Basic understanding of business and operating environment
• Statistics
• Programming, data modeling, simulation, and advanced mathematics
• SQL and at least one of: R, Python, Hadoop, SAS, SPSS, Scala
• Knowledge of AI platforms and ecosystems supporting machine learning, generative AI, and LLM-enabled systems, including Microsoft Copilot Studio, Azure AI Foundry, AWS, and Databricks
• Model lifecycle execution including model development, validation, and governance
• Technical writing; data storytelling and technical presentation skills
• Research skills, interpersonal skills, and working knowledge of procedures, instructions, and validation techniques
• Communication, critical thinking, collaboration and relationship building, and initiative using sound judgment
• Technical capabilities such as Big Data analysis, coding, project management, and technical writing
• Problem solving with responsiveness to issues and problems as identified
• Bachelor’s degree in Data Science, Statistics, Mathematics, Computers Science, Engineering, or similar quantitative fields

Technologies

• SQL, R, Python, Hadoop, SAS, SPSS, Scala
• Microsoft Copilot Studio, Azure AI Foundry, AWS, Databricks
• LLMs, Generative AI

Additional Information

• Location: Pensacola, FL (onsite)
• Address: 5510 Heritage Oaks Drive, Pensacola, FL 32526
• Salary: USD 99,400 - 155,850 per year
• Hours: Monday - Friday, 8:00AM - 4:30PM
• Sponsorship: Navy Federal Credit Union currently does not provide sponsorship for this role
• Work authorization: Applicants must be authorized to work in the United States without current or future sponsorship
• Referral eligibility: This position is eligible for the TalentQuest employee referral program

Desired Qualifications

• Experience with model validation/model risk management, AI and agentic risk management, enterprise risk management, or internal audit
• Deep knowledge of SR 11-7 and/or ASOP 56
• Understanding of model practices used in credit risk management, fraud detection, BSA/AML, operations, treasury & finance, and marketing models
• Knowledge of regulations and frameworks including CECL, CCAR, Anti-Money Laundering, ECOA, FCRA, NIST AI Risk Management Framework, and ISO/IEC 42001 Artificial Intelligence Management System
• Advanced knowledge of Navy Federal Credit Union instructions, standards, and procedures
• Master’s degree in a quantitative field such as Data Science, Statistics, Mathematics, Computer Science, Engineering, or a related area