Software Engineer - AI Observability

At Moody's, we unite the brightest minds to turn today’s risks into tomorrow’s opportunities. We do this by striving to create an inclusive environment where everyone feels welcome to be who they are-with the freedom to exchange ideas, think innovatively, and listen to each other and customers in meaningful ways. 

If you are excited about this opportunity but do not meet every single requirement, please apply! You still may be a great fit for this role or other open roles. We are seeking candidates who model our values: invest in every relationship, lead with curiosity, champion diverse perspectives, turn inputs into actions, and uphold trust through integrity. 

Moody’s CRE provides a data driven analytics platform which supports agile investment teams, asset / portfolio managers, banks and brokers. Our SaaS solution offers vertical business intelligence, atomised rent roll analysis, and market analytics applying state-of-the-art big data and AI technologies. The platform makes holistic market data instantly accessible, creates transparency and thereby digitises the industry.

Be part of our journey! We are looking for a self-driven and passionate developer to join our tech team.

As an AI Model Observability Engineer, you will play a critical role in ensuring the stability, reliability, and performance of our existing AI models. You will be responsible for monitoring the system, detecting anomalies, and implementing solutions to address bottlenecks and maintain data consistency. This role requires a unique blend of AI engineering expertise, QA automation skills, and DevOps knowledge.

Responsibilities:

• Maintain the stability and functionality of the current AI model, preventing new iterations from causing disruptions.
• Monitor system performance and detect unusual patterns (hallucinations) that may indicate errors or anomalies.
• Develop and implement systems for tracking AI model performance and behavior.
• Maintain logging infrastructure to capture relevant data for analysis.
• Configure and manage alert systems to detect anomalies and performance degradation.
• Analyze metrics to identify optimization opportunities and scalability challenges.
• Propose and implement solutions to address performance issues and ensure scalability in system design.
• Create and maintain datasets and prompts for analyzing the application's behavior.
• Ensure consistency of data across different releases to maintain model integrity.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related field.
• Proven experience in AI model development and maintenance.
• Strong proficiency in programming languages such as Python, Langchain, Langsmith.
• Familiarity with cloud platforms such as AWS, Azure, etc.
• Experience with QA automation and DevOps practices.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Why Join Us

• Opportunity to work at the forefront of AI technology and contribute to impactful projects.
• Collaborative and dynamic work environment fostering continuous learning and growth.
• Competitive compensation package and benefits, including opportunities for professional development and career advancement.

If you are passionate about leveraging AI to drive meaningful improvements and thrive in a challenging yet rewarding environment, we encourage you to apply for this exciting opportunity. Join us in shaping the future of AI-powered systems!

#LI-ER1

Moody’s is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status, sexual orientation, gender expression, gender identity or any other characteristic protected by law.

Candidates for Moody's Corporation may be asked to disclose securities holdings pursuant to Moody’s Policy for Securities Trading and the requirements of the position. Employment is contingent upon compliance with the Policy, including remediation of positions in those holdings as necessary.