Vice President - Data Science (AI Model Risk and Evaluation)

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are—with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways. Moody’s is transforming how the world sees risk. As a global leader in ratings and integrated risk assessment, we’re advancing AI to move from insight to action—enabling intelligence that not only understands complexity but responds to it. We decode risk to unlock opportunity, helping our clients navigate uncertainty with clarity, speed, and confidence.

If you are excited about this opportunity but do not meet every single requirement, please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship, lead with curiosity, champion diverse perspectives, turn inputs into actions, and uphold trust through integrity. 

Skills and Competencies

• 7+ years in machine learning, with deep understanding of GenAI and Agentic AI risks and evaluation frameworks
• Experience with NLP, prompt engineering, RAG, agentic AI, and cloud deployment preferred
• Comfortable with programming in multiple languages such as Python, SQL, .Net
• Excellent communication skills for technical and non-technical audiences.
• Previous experience in corporate finance or debt markets is preferred.
• Excellent knowledge of cloud services. Experience with AWS and/or Microsoft Azure is a plus
• Clear Thinker with strong analytical skills to review complex processes. 
• Effective communication skills, both verbal and written.
• Ability to work independently with or without direction and/or supervision.
• Demonstrated ability to effectively interface with a diverse, global, and cross-functional team and led large-scale projects. 
• Ability to prioritize and multitask, flexibility and adaptability in work approach.

Education

• Master’s or bachelor’s degrees in data science, computer science, statistics, mathematics, or similar quantitative disciplines are required.

Responsibilities

The VP-Data Science leads independent validation, evaluation, and governance of advanced AI systems, including Machine Learning, Generative AI (GenAI), and Agentic AI models. This role is central to ensure use of AI in Moody’s Ratings is robust, reliable, and compliant with governance and regulatory standards.

• Lead and mentor small team in the evaluation and validation of AI and Machine Learning models.
• Design and execute evaluation frameworks for GenAI, Agentic AI, and machine learning models, including prompt engineering and model benchmarking.
• Develop and run systematic model evaluations to benchmark performance and safety, leveraging industry leaderboards, SME review, and LLM-as-a-judge frameworks.
• Independently test and validate ML models following best practices such as conceptual soundness, implementation integrity, and model performance.
• Assess risks in AI systems, focusing on accuracy, bias, explainability, and operational integrity.
• Collaborate with technology, risk, compliance, and business stakeholders to ensure alignment with governance and regulatory standards.
• Communicate complex validation results and recommendations to both technical and non-technical audiences.
• Maintain high standards of documentation, reporting, and continuous improvement in model risk management processes.
• Advanced quantitative and analytical skills, with experience in financial, credit, or equity analysis
• Hands-on and proficient in developing software tools and models to evaluate performance of AI systems
• Skilled in using statistical distributions to analyze model outputs and use various software applications
• Excellent communication and documentation skills, including drafting requirements and user guides
• Demonstrated proficiency in AI concepts, with hands-on experience using AI tools to run evaluation and testing of LLM based applications
• Experience leading small teams in the evaluation and validation of AI and machine learning models.
• Demonstrates strong awareness of AI risk management and a commitment to responsible AI use

About the team

Digital Economy team at Moody’s Ratings focuses on assessing and managing risks emerging from digital finance, artificial intelligence, and cyber threats, which are reshaping global financial systems and credit markets. The team provides thought leadership and analytical insights into how technologies like blockchain, AI, and digital assets impact operational resilience.

Moody’s is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender expression, gender identity or any other characteristic protected by law.

Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody’s Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy, including remediation of positions in those holdings as necessary.