First Citizens Bank - Charlotte, NC
posted 27 days ago
Full-time - Senior
Remote - Charlotte, NC
Credit Intermediation and Related Activities
About the position
The Senior Risk Analyst, Model Validator position at First Citizens Bank focuses on validating the bank's AI/ML models used in marketing and operations. This remote role requires strong expertise in AI/ML and risk management to ensure models align with business objectives and perform as expected. The analyst will conduct independent validations, manage teams, and communicate findings to stakeholders, while also suggesting enhancements to the validation process.
Responsibilities
- Conduct independent model validations to ensure AIML models align with business objectives and design objectives.
- Write detailed model validation reports that present the results from executing a thoughtful and thorough model validation plan.
- Manage internal and external teams performing model validations.
- Communicate the model validation findings to model owners, senior management, and regulatory agencies as required.
- Perform annual reviews and review the ongoing monitoring reports to ensure that the models are performing as intended.
- Interact with all key stakeholders including model users, model owners, vendors, Model Risk Governance, and other Validators throughout the model lifecycle including validation, ongoing performance evaluation.
- Suggest enhancements to the existing AIML validation process including Validation templates, ongoing monitoring of models, automation of repetitive tasks.
- Guide junior team members on model validations.
Requirements
- Bachelor's Degree and 4 years of experience in Risk management, financial analysis, or statistical modeling, or high school and 10 years of risk management, financial analysis, or marketing analytics.
- Minimum 7+ years of experience in model development and implementation or model validation within the financial industry.
- Minimum 5+ years of AIML models and analytics experience with software (such as Python, SAS, R).
- Experience developing or validating AIML, Marketing, and operations models (lifetime value, scoring, classification, deep learning, large language models, fraud, anomaly detection, etc.).
- Experience with Large language model use cases, prompt engineering, and metrics.
- Experience maintaining or validating vendor developed models.
- Good writers of technical reports.
- Strong analytical skills and ability to find patterns in transactional data.
- Well-versed with various performance metrics and the use cases.
- Advanced programming skills in Python, SQL, SAS, or R.
- Experience using SQL to pull data from enterprise warehouse databases.
- Exceptional understanding of the banking industry and business lines.
- Experience communicating validation standards and technical concepts to key stakeholders.
- Good understanding of federal guidance related to model risk management (SR 11-7, OCC 2011-12).
Nice-to-haves
- Advanced degree (master's or Ph.D.) in a quantitative field (e.g., Data Science, Operations Research, Finance, Applied Statistics, or a related quantitative discipline).
Benefits
- Comprehensive benefits program designed to support families, however defined.
