(prehensive back-testing at a frequency higher thanrequired, such as quarterly,
with sufficient defaultobservations to ensure the reliability of the back-testingresults) to ensure the accuracy of their rating systems.The HKMA will not accept cost implications as the solejustification for not using external benchmarks.
For external benchmark, it may not be applicable since currently in HK and PRC region, no bank has fully completed the IFRS9 modelling work, including HSBC. And that’s why we suggest using a higher frequency data to do the back testing.
−Where a relevant external benchmark is not available(e.g. PD of SME and retail exposures, LGD and EAD),an AI should develop an internal benchmark. Forexample, to benchmark against a model-based ratingsystem, an AI might employ internal rating reviewers tore-rate a sample of credits on an expert-judgementbasis.
Internal benchmark will be useful for IRB since we could ask rating reviewers to do the judgmental rating for some sampling. However our IFRS9 methodology is based on Basel rating, this is not applicable for IFRS9 validation. And normally we do not build new models with other methodology since it is not comparable for the model performance under different methodologies.
−the HKMA willnormally expect AIs to use in validating their ratingsystems and internal estimates:
∙comparison of internal estimates with benchmarkswith respect to a common or similar set ofborrowers/facilities;
∙comparison of internal ratings and migrationmatrices with the ratings and migration matrices ofthird parties such as rating agencies or data pools;
∙comparison of internal ratings with external expertjudgements, for example, where a portfolio has notexperienced recent losses but historical experiencesuggests that the
risk of loss is greater than zero;
∙comparison of internal ratings or estimates withmarket-based proxies for credit quality, such asequity prices, bond spreads, or premiums for creditderivatives;
∙analysis of the rating characteristics of similarlyrated exposures; and
∙comparison of the average rating output for theportfolio as a whole with actual experience for theportfolio rather than focusing on estimates forindividual
borrowers/facilities.
As HKMA required, if we choose external benchmark, we need to assess the quality in adequately representing the riskcharacteristics of the portfolio under consideration, including definition of default, rating criteria, data quality, frequency of rating updates and assessment horizon.This will be challenging to us since it is not easy to get all these information for peers.Also currently in HK and PRC region, no bank has fully completed the IFRS9 modelling work, including HSBC.
6. The other information that HKMA mentioned in CA-G-4:
Validation methodology mentioned in Terminology:
−“k-fold cross validation” means a kind of testemploying resamplingtechniques. The data set isdivided into k subsets. Each time, one of the ksubsets is used as the validation data set and theother k-1 subsets are put together to form thedevelopment data set. By