WPS7538


Policy Research Working Paper                       7538




    Contingent Liabilities Risk Management:
       A Credit Risk Analysis Framework
   for Sovereign Guarantees and On-Lending
 Country Experiences from Colombia, Indonesia, Sweden,
                       and Turkey

                           Fritz Florian Bachmair




World Bank Treasury
Government Debt and Risk Management Unit
January 2016
Policy Research Working Paper 7538


  Abstract
 Sovereign credit guarantees and government on-lending                              applied in Colombia, Sweden, and Turkey. It also discusses
 can catalyze private sector investment and fulfill specific                        how the proposed framework is applied in Indonesia as it
 policy objectives. However, contingent liabilities stem-                           develops a credit risk management framework for sovereign
 ming from guarantees and contingent assets stemming                                guarantees. Country experiences show that although sov-
 from on-lending expose governments to risk. Prudent risk                           ereign risk managers can draw on insights from credit risk
 management, including risk analysis and measurement,                               management in the private sector, academic literature, and
 can help identify and mitigate these risks. This paper pro-                        practices in other countries, approaches to risk management
 poses a four-step structure for analyzing and measuring                            need to be highly context-specific. Key differentiating fac-
 credit risk: (i) defining key characteristics to determine the                     tors include characteristics of the guarantee and on-lending
 choice of a risk analysis approach; (ii) analyzing risk drivers;                   portfolio, the sovereign’s specific risk exposure, the avail-
 (iii) quantifying risks; and (iv) applying risk analyses and                       ability of market information and data, and resources and
 quantification to the design of risk management tools. This                        capacity in the public sector. Developing a sound risk
 structure is based on an assessment of approaches discussed                        analysis and measurement framework requires significant
 in academia and applied in practice. The paper demon-                              investments in resources, capacity building, and time. Gov-
 strates how the four steps of credit risk management are                           ernments should view this process as iterative and long-term.




  This paper is a product of the Government Debt and Risk Management Unit, World Bank Treasury. It is part of a larger
  effort by the World Bank to provide open access to its research and make a contribution to development policy discussions
  around the world. Policy Research Working Papers are also posted on the Web at http://econ.worldbank.org. The author
  may be contacted at fbachmair@worldbank.org.




         The Policy Research Working Paper Series disseminates the findings of work in progress to encourage the exchange of ideas about development
         issues. An objective of the series is to get the findings out quickly, even if the presentations are less than fully polished. The papers carry the
         names of the authors and should be cited accordingly. The findings, interpretations, and conclusions expressed in this paper are entirely those
         of the authors. They do not necessarily represent the views of the International Bank for Reconstruction and Development/World Bank and
         its affiliated organizations, or those of the Executive Directors of the World Bank or the governments they represent.


                                                       Produced by the Research Support Team
Contingent	Liabilities	Risk	Management:	
A	Credit	Risk	Analysis	Framework	for	
Sovereign	Guarantees	and	On‐Lending	
Country 	 Experiences 	 from 	 Colombia, 	 Indonesia, 	 Sweden, 	 and 	 Turkey


Fritz Florian Bachmair1




JEL classification: H81, H63, G32
Keywords: credit risk, risk management, fiscal risks, contingent liabilities, guarantees, on-
lending, public debt management.




1
 The author is a Financial Officer in the Financial Advisory and Banking Department at the World Bank Treasury.
He can be contacted at fbachmair@worldbank.org or +1 202 473 0749.
Table of Contents
Acknowledgments........................................................................................................................... 3 

Acronyms ........................................................................................................................................ 4 

1      Introduction ............................................................................................................................. 5 

2      Risk analysis and measurement process .................................................................................. 7 

     2.1     Context and defining characteristics ................................................................................ 7 

     2.2     Credit risk analysis ........................................................................................................... 9 

     2.3     Credit risk quantification................................................................................................ 13 

     2.4     Application in risk management .................................................................................... 15 

3      Country examples in developing and applying a risk analysis and measurement framework
       18 

     3.1     Colombia ........................................................................................................................ 18 

     3.2     Sweden ........................................................................................................................... 22 

     3.3     Turkey ............................................................................................................................ 26 

     3.4     Indonesia ........................................................................................................................ 29 

     3.5     Key insights from country examples .............................................................................. 36 

4      Considerations in implementing a risk analysis and measurement framework..................... 38 

5      Conclusion ............................................................................................................................. 40 

Appendix A - Stylized summary of risk management practices in four countries ....................... 42 

Bibliography ................................................................................................................................. 43 




                                                                                                                                   2|Page
Acknowledgments
The author is indebted to a large number of institutions and individuals who offered him the opportunity
to learn about sound practices in contingent liabilities risk management. The support received enabled
him to apply insights in writing this paper and in providing advisory services to World Bank clients.
Debt management offices in Colombia, Sweden, and Turkey supported the World Bank’s efforts in
facilitating a peer-to-peer group dialogue, and the author is grateful to many staff in the respective offices.
Representing their staff the heads of the respective credit risk and guarantee units Cristhian Prado, his
colleague Andres Quevedo (both from Colombia), Magnus Thor, his successor Eva Cassel (both from
Sweden), and Emre Elmadağ, and his successor Harun Akkas (both from Turkey) deserve special thanks.
In Indonesia, Lalu Taruna and his team at the contingent liabilities unit at the Directorate General for
Finance and Risk Management have made significant progress in improving risk management practices
around government guarantees, and the author appreciates the very productive working relationship and
the opportunity to learn much about the Indonesian context. The author also appreciates the comments
and feedback received from all country representatives on the respective sections describing their country
cases in this paper.
The peer-to-peer group exchange among sovereign risk managers, and the World Bank’s advisory work
in Indonesia and other countries would not have been possible without the generous support of the Swiss
State Secretariat of Economic Affairs (SECO) and their funding of the Government Debt and Risk
Management program. SECO’s continued support will enable further advisory work on contingent
liabilities risk management in Egypt, Ghana, South Africa, Tunisia, and Vietnam.
Katya Gratcheva, Naoko Kojo, Nadir Mohammed, Dmitry Pevzner, and Chunlan Wang provided valuable
guidance in conceptualizing various approaches to analyzing risks related to government credit guarantees
and on-lending. Cigdem Aslan, Abha Prasad, Fred Haddad, and Tim Irwin helped to improve earlier
drafts of this paper.
The author especially appreciates input from colleagues at the World Bank Treasury’s Financial Advisory
and Banking Department, including Phillip Anderson, Lars Jessen, Elizabeth Currie, Rodrigo Cabral,
Antonio Velandia, Jean-Paule Blardony, Cristina Griffa, Patrick Saner, Colleen Keenan, Aneesha
Madugalle, Florent Antoine, Nicolle Aya Konai, and Christopher Dychala.




                                                                                                   3|Page
Acronyms
CDS        Credit default swaps
CL         Contingent liabilities
COP        Colombian Peso
DD         Distance to default
DG         Directorate General
DGCPTN     Directorate General Public Credit and National Treasury (in Colombia)
DFRM       Directorate General of Financing and Risk Management (in Indonesia)
EAD        Exposure at default
EU         European Union
FPO        Fiscal Policy Office (Indonesia)
FTP1       Fast Track Program Phase 1
GDP        Gross Domestic Product
IFRS       International Financial Reporting Standards
IPPs       Independent power producers
IRB        Internal ratings-based
LGD        Loss given default
LIBOR      London interbank offered rates
PDs        Default probabilities
PLN        Perusahaan Listrik Negara
PPPs       Public private partnerships
SECO       Swiss State Secretariat of Economic Affairs
SMI        Directorate Investment Management System (in Indonesia)
SNDO       Swedish National Debt Office
SOEs       State-owned enterprises
S&P        Standard and Poor’s
USD        United States dollar




                                                                                   4|Page
1     Introduction
Sovereign credit guarantees and government on-lending can help to fulfill specific policy objectives by
lowering borrowing costs and increasing investment for entities in prioritized sectors.2 However, credit
guarantees and on-lending imply risks to government finances. Guarantees and on-lending are sources of
fiscal risks. Their materialization can create fiscal costs and may even impair fiscal sustainability.
In the case of credit guarantees, the government promises the respective lender to service debt the
beneficiary entity has contracted in the event the entity is not able or willing to do so. As such, credit
guarantees create an explicit contingent liability on a government’s balance sheet. The liability is a
contractual obligation contingent upon a specific but uncertain event that may materialize in the future.3
In the case of on-lending, the government borrows funds and on-lends proceeds to a beneficiary entity.
On-lending creates a direct liability matched by a contingent asset on a government’s balance sheet. The
materialization of these risks creates a fiscal cost for the government. The government can either adjust
current revenues or expenditures or borrow funds to cover associated costs, thereby increasing
government debt.
In either case – guarantees or on-lending – the government is exposed to credit risk4 of the beneficiary
entity. Credit risk stems from the possibility of an entity’s inability or unwillingness to service its debt
obligations to a third party lender in the case of guarantees or to the government in the case of on-lending.
An entity’s ability to repay depends primarily on the financial health of that entity while the willingness
to repay may be influenced by arrangements in the risk sharing agreement and the relationship between
the government and the beneficiary entity.5
Governments can manage these types of risks through a broad risk management framework that
encompasses government debt and other explicit and potentially implicit6 contingent liabilities emanating
from public private partnerships (PPPs), the debt of state-owned enterprises (SOEs), (natural) disasters,
and the financial sector. A sound risk management framework includes well-defined risk management
objectives, an analysis of risks, and the design and implementation of a risk management strategy
incorporating monitoring, reporting, and reassessment procedures, as illustrated in Figure 1.1.
Risk analysis and measurement constitute the foundation for various stages in the risk management
process, including the design of a strategy, the implementation of risk mitigation tools, and risk
monitoring and reporting. Credit risk measurement helps to make costs explicit. It supports a full cost-
benefit analysis where various mechanisms to achieve a policy objective can be weighed against each


2
  In some cases, government risk sharing may be a prerequisite for funds to become available to beneficiary entities.
3
  Explicit contingent liabilities are government legal obligations to make a payment if a particular event occurs. Implicit contingent liabilities
depend on the occurrence of a particular future event and on government willingness to act on them. Such obligations are typically not officially
recognized until after a failure occurs. The triggering event, the cost at risk, and the required size of government outlay are uncertain. In most
countries, the financial system represents the most serious contingent implicit government liability. For a detailed discussion of various types of
fiscal risks and contingent liabilities see Polackova Brixi and Moody, 2002.
4
  Credit risk generally refers to the risk of non-performance by borrowers on loans or other financial assets, or by a counterparty on financial
contracts.
5
  Similarly, the choice of instrument by governments (i.e. guarantee vs. on-lending) is only partly driven by risk considerations but also other
factors such as governance structures (e.g. degree of centralization, responsibilities for sub-nationals, governance of state-owned enterprises, etc.)
and public sector accounting and reporting standards (as on-lending directly impacts governments’ debt levels while guarantees create an off-
balance sheet contingent liability without directly affecting the size of outstanding debt).
6
  A risk management framework may start with explicit contingent liabilities as they are more straightforward to identify and may expand to
include implicit CLs as a second step.

                                                                                                                                      5|Page
other. This includes, for example, comparing credit guarantees to on-lending, and direct government
subsidies as well as the direct provisioning of services by the government.
Figure 1.1: Fiscal risk management framework




                                                                            1. Definition of 
                                                         6. Monitor, 
                                                                             objectives for 
                                                         report, and 
                                                                                  risk 
                                                           reassess
                                                                             management




                                                 5.                                     2. Analysis of 
                                           Implementation                                    risk




                                                        4. Decide on        3. Analysis of 
                                                              risk          government's 
                                                        management           capacity to 
                                                           strategy          absorb risk




Source: Anderson and Abousleiman, 2011.
This paper provides guidance for sovereign risk managers7 interested in developing or improving a risk
management framework related to guarantees and on-lending. While it focuses on explicit credit
guarantees and on-lending, the framework presented applies to various types of government risks, with
the caveat that it addresses risks related to individual obligations, not to portfolios of obligations.8 The
paper does not address other types of government guarantees, including those used in PPP projects, such
as minimum revenue guarantees; fiscal risks related to state-owned enterprises, such as subsidies; and the
absorption of currency risk related to on-lending utilizing foreign currency borrowing. The paper does not
fully explore issues related to other risk mitigation tools, governance aspects,9 legal aspects with respect
to guarantee/on-lending agreements,10 and the recording of risk exposure.
Section 2 proposes a four-step process for credit risk analysis and measurement. Section 3 demonstrates
how these steps apply to credit guarantee and on-lending risk management in Colombia, Sweden, Turkey,




7
  Often risks from credit guarantees and on-lending are managed in debt management offices. However, this institutional setup is not uniform and
not necessary for sound risk management. Depending on the respective beneficiaries of credit guarantees they may be managed in specialized
units (e.g. in an Export-Import Bank, student loan agency, etc.). If fiscal risk management units exist, they may also be responsible for managing
risks from credit guarantees and on-lending. For on-lending specifically, a lending unit may exist within the Ministry of Finance responsible for
risk management.
8
  The conclusion highlights portfolio risk estimation as a topic for further discussion. Portfolio risk estimation requires estimating correlations
between individual risks and adds value for significantly large portfolios. However, this is beyond the scope of this paper. Of the country cases
discussed here, only Sweden has recently started analyzing portfolio risks using an approach that goes beyond merely summing up individual
risks.
9
  Including the institutional setup for risk management, the decision making process for guarantee issuance and on-lending, etc.
10
   Including the use of collateral, the collection of receivables, penalties for late payments, etc.

                                                                                                                                   6|Page
and Indonesia. The conclusion addresses some additional issues governments should consider while
implementing the risk measurement and analysis framework, and proposes topics for future research.


2      Risk analysis and measurement process
Sovereign risk managers can design a framework for credit risk analysis and measurement to inform the
implementation of risk management tools. A risk analysis and measurement framework can be set up in
four steps as depicted in Figure 2.1. First, risk managers need to have clear understanding of the context
in which they are operating in and of important defining characteristics with respect to the credit
guarantee and on-lent portfolio.11 Second, key industry-specific risk drivers need to be identified and
analyzed before credit risk assessment can be translated into quantifiable measures, such as expected
losses or market values. Finally, the insights from credit risk analysis and quantification can be applied to
design and improve various risk management tools, such as structuring guarantee agreements, risk-based
guarantee fees, financial provisioning for losses, and risk monitoring and reporting (Figure 2.1).
Figure 2.1: Credit risk analysis and measurement framework




Source: Bachmair, 2014.
Designing and implementing a risk management framework is iterative. As risk managers develop a
deeper understanding about credit risk management they may adapt their views on how insights from risk
analysis can be used to design risk mitigation tools.

2.1 Context and defining characteristics
A consideration of country-specific institutional and economic contexts should be the first step in
designing risk analysis and measurement. This includes defining a sovereign’s risk exposure,
understanding the guarantee and lending portfolio, evaluating the availability of data, and realistically
assessing the government’s capacity to execute effective risk management.

11
   While portfolio risk estimation is not in scope of this paper, an understanding of the characteristics of the guarantee/on-lent portfolio is
important in choosing risk analysis approaches.

                                                                                                                                        7|Page
Definition of risk exposure
The discussion in this paper focuses on explicit credit guarantees and on-lending. The framework
presented, however, is flexible to capture various types of risks governments are exposed to. Such risks
could include implicit guarantees to SOEs and risks from (government guarantees to) PPPs. The
definition of scope is particularly relevant when governments extend credit guarantees or on-lend to
entities to which they are exposed to from other sources. For example, when governments provide credit
guarantees to SOEs the explicit guarantee provided may be relatively small compared to an implicit
guarantee that precedes the granting of an explicit guarantee.
Similarly, risk managers need to clearly define what triggers the materialization of risk (i.e. definition of
default). For example, monopolistic SOEs providing essential services, such as electricity, may rarely
default on loans to third party creditors because governments inject resources (e.g. subsidies,
recapitalization) to avoid defaults. A narrow focus in defining risk as actual defaults may significantly
underestimate a beneficiary’s credit risk in such cases. Alternative definitions of a credit event could
include the following: the government servicing individual debt payments in lieu of the beneficiary,
without the beneficiary defaulting to the creditor; the government providing loans to the beneficiary to
avoid default to a creditor; unexpected capital injections (i.e. capital injections to avoid default rather than
planned capital injections to allow the beneficiary to undertake capital expenditure investments); the roll-
over of a guarantee/on-lent loan if the beneficiary was not able to secure funding otherwise. The exact
definition of a credit event needs to be highly context-specific and adapted to institutional arrangements
in a country.

Characteristics of guarantee and on-lending portfolio
Key characteristics of guarantee and on-lending portfolios include size, both in absolute and relative
terms, such as the portfolio size as a ratio to gross domestic product (GDP) or revenues, and the number
of beneficiary entities.12 Beneficiary entities can be classified by type, e.g. corporations (private vs. state-
owned), sub-nationals, government agencies, or financial institutions (private vs. public such as
development banks). Entities should also be differentiated by the industries or sectors they operate in.
Common industries include power generation, power distribution, toll roads, airports, seaports, financial
sector institutions, etc. Other context-specific characteristics may include the degree to which
beneficiaries are systemically important to the economy, the relationship with the government, the degree
to which an entity provides essential/politically sensitive goods and services, and the geography of
operations. The degree of essentiality of the beneficiary’s service provided will further inform the extent
to which the government will step in to avoid a default. Analysis should not only comprise the current
portfolio of credit guarantees and on-lending but also include the pipeline of future projects.

Data availability
Available approaches to risk analysis depend on the type and quality of data available. Simulation
models, for example, require large amounts of data, while credit scoring may require more qualitative
information. Relevant data include historic information on credit events (consistent with the type of
default definition discussed above) matched with information on beneficiaries’ risk factors. Risk factors

12
     Governments may also compile and track measures such as direct debt (including on-lending) plus guarantees in relation to GDP.

                                                                                                                                 8|Page
may include financial information, the assessment of business risks such as regulatory environment,
competitive environment, and management quality.
When entering a guarantee/on-lending agreement risk managers should define information to be collected
and assessed in the future. Risk managers may also want to explore third party and market information on
beneficiaries and the sectors they operate. Third party information may include risk assessment by banks,
rating agencies, or credit bureaus. Market information may include prices of traded debt and equity as
well as credit derivatives (e.g. credit default swaps (CDS)).
However, governments should recognize that market conditions pertaining to beneficiaries and potential
beneficiaries might reflect perceptions of implicit government support. Furthermore, the provision of a
guarantee/on-lending may change the perceived implicit guarantee by market participants. In such cases,
market prices would not accurately reflect risk, and risk managers may instead need to rely on market
data from proxies with risk characteristics similar to the stand-alone13 risk of the beneficiary.

Resources and capacity
Sovereign risk managers need to invest in capacity and resources to implement a sound risk management
framework. Different approaches to risk analysis and measurement require different skills. For example,
fundamental risk analysis (e.g. credit scoring) requires an understanding of industries and their respective
risk drivers. Governments should model their risk management framework around available capabilities
and financial resources, and adapt the framework over time as capacities improve through training, hiring
of new staff, and support from external consultants.

2.2 Credit risk analysis
Assessing the credit quality of entities benefitting from credit guarantees and on-lending is a core part of a
risk management framework. First, risk managers need to understand what industry-specific factors are
driving the risk of beneficiaries not servicing their debt obligations. Second, risk managers have to assess
these risk drivers by beneficiary and on a regular basis.14
Governments can choose from a variety of approaches to credit risk analysis and tailor them to specific
situations.15 The most common approaches include credit scoring, statistical models, scenario analysis,
and structural models, which are discussed below.

Credit scoring
Credit scoring involves scoring and aggregating individual risk factors to arrive at an ordinal risk rating
for an entity that is compared against other entities. Industry-specific scorecards can be used to guide
credit analysts in their assessments, as exemplified in Table 2.1.
Rating agencies and financial institutions often apply credit scoring towards risk assessment.16 Financial
institutions can also base risk analyses on an internal ratings-based (IRB) approach, as outlined by The

13
   Refers to credit risk of beneficiary without implicit government support. For example, rating agencies sometimes provide stand-alone ratings.
14
   Risk analysis should be undertaken before guarantees are issued or funds are on-lent and on a regular basis for risk monitoring.
15
   This decision will depend on the size and complexity of the guarantee portfolio and available resources.
16
   Rating agencies publish a significant amount of literature explaining their credit risk assessments. The three major rating agencies include
Standard & Poor’s, Moody’s Investor Service, and Fitch.

                                                                                                                                  9|Page
Basel Committee (Basel Committee on Banking Supervision, 2004 and 2005). The World Bank Group
also uses credit scoring approaches to rate sovereign borrowers, counterparties in financial derivative
transactions, investment targets, and private sector borrowers.
Table 2.1: Moody's Investor Service score card for regulated electric and gas utilities17
                                     Factor / Sub - Factor Weighting - Regulated Utilities
                                 Broad Rating                                                                              Sub-Factor
Broad Rating Factor            Factor Weighting Rating Sub-Factor                                                          Weighting
Regulatory Framework                   25%            Legislative and Judicial Underpinnings of the Regulatory                12.5%
                                                      Framework
                                                      Consistency and Predictability of Regulation                            12.5%
Ability to Recover Costs               25%            Timeliness of Recovery of Operating and Capital Costs                   12.5%
and Earn Returns
                                                      Sufficiency of Rates and Returns                                        12.5%
Diversification                        10%            Market Position                                                           5%
                                                      Generation and Fuel Diversity                                             5%
Financial Strength, Key                40%            CFO pre-WC + Interest / Interest                                         7.5%
Financial Metrics
                                                      CFO pre-WC / Debt                                                        15%
                                                      CFO pre-WC - Dividends / Debt                                            10%
                                                      Debt/Capitalization                                                      7.5%
Total                                 100%                                                                                    100%
Notching Adjustment                                   Holding Company Structural Subordination                                0 to -3
Source: Moody’s Investor Service, 2013.
Score cards offer a flexible approach to conduct credit risk analysis since they can be tailored to reflect
the specific risk exposure and facilitate a standardized evaluation of credit risk among entities in the same
industry. However, developing scorecards and scoring guidelines requires a deep understanding of
industry-specific risk drivers. Since scoring reflects credit analysts’ subjective assessments, guidelines
that prescribe scores for specific outcomes of the assessed credit metrics can be used improve objectivity.
Credit committees that review analysts’ ratings may also help to improve objectivity.

Statistical models
In statistical models, credit quality is measured using observable characteristics (e.g. financial ratios,
competitive position, regulatory environment, etc.). A statistical model is estimated regressing historic
outcomes (e.g. defaults) on historic characteristics. The output from a statistical model is a measure of the
likelihood that a credit event will occur (default probability).
Edward Altman (1968) pioneered a statistical model using Z-scores to predict corporate defaults. To
calibrate the model Altman chose financial ratios that most significantly drove bankruptcy in his data set
(as shown in Figure 2.2.).18 Turkish Treasury’s credit rating approach described below is based on a
statistical model.

17
   Moody’s Investor Service 2013 provides a detailed rationale for the inclusion and definition of the various rating (sub-)factors included in this
score card. This rating methodology paper also provides detailed scoring guidance for each rating (sub-) factor. Rating (sub-) factors shown in
this score card are specific to utilities. Score cards for entities in other sectors would show different (sub-) factors. E.g. fuel diversity in the
generation of power (such as coal, oil, gas, etc.) is a highly sector-specific driver of credit quality. CFO stands for cash flow from operating
activities. WC stands for working capital.
18
   The Risk Metrics Group developed a commercial product based on Altman’s Z-score methodology (Altman, et al., 2010)

                                                                                                                                   10 | P a g e
Figure 2.2: Original Altman Z-score model

Z-Score = 1.2A + 1.4B + 3.3C + 0.6D + 1.0E

Where:

A = Working Capital / Total Assets
B = Retained Earnings / Total Assets
C = Earnings Before Interest & Tax / Total Assets
D = Market Value of Equity / Total Liabilities
E = Sales / Total Assets

Source: Altman, 1968.
When based on internal data to be estimated, a statistical model can capture specific risks the government
is exposed to and be based on actual performance by beneficiary entities. Calibrating a model based on
internal data requires a significant amount of historical information.

Scenario analysis
In scenario analysis, various scenarios for key risk drivers (e.g. macroeconomic variables, revenue
drivers, cost drivers, etc.) are constructed. Risk managers then estimate how scenarios impact financial
performance of beneficiaries and their ability to service debt.19 A scenario analysis model has to make
assumptions about how key risk drivers interact with each other and how they affect an entity’s
performance. Also, risk managers may need to define a threshold beyond which financial performance
translates into a credit event, such as a default.
Scenarios can be constructed using deterministic or stochastic processes. Scenario analysis based on
deterministic processes usually uses a smaller number of discrete scenarios and often no probabilities are
attached to the respective scenarios. Risk managers may define a base case (most likely scenario) and
several risk scenarios defined by an adverse development in individual risk drivers or a combination of a
few risk drivers. If stochastic processes are constructed, a probability distribution for key risk drivers and
their dependent relationships are estimated. A large number of scenarios can be simulated (e.g. using
Monte Carlo simulation).20
The outcome of scenario analysis can be an estimate of the frequency of default events. A default
probability distribution may be estimated if stochastic modeling of risk drivers has been employed.
The Swedish National Debt Office has implemented scenario analysis using simulation models as a tool
to evaluate more complex guarantees. Also the Turkish Treasury developed a macroeconomic simulation
model in the past (see below for both country examples).




19
   Stress testing is one approach to scenario analysis. In stress tests macroeconomic, financial, and idiosyncratic shocks beneficiaries may be
exposed to are designed. Next, the impact on beneficiaries is estimated and an assessment of credit risk in stress scenarios is deduced.
20
   In debt management scenario analysis is usually employed to assess the impact of market risks (interest rate and exchange rate risks) on debt
portfolios.

                                                                                                                                 11 | P a g e
Scenario analysis models can capture project and context-specific situations and can be flexible in
modeling particular risks the government may be exposed to. On the other hand, they can be quite
complex and demand significant resource to be developed (e.g. time, data and quantitative skills).

Structural models
Structural models are based on the assumption that default events occur when an entity’s asset value
reaches a significantly low level compared to its liabilities. In this approach equity of an entity is viewed
as a call option and option pricing theory is used to calculate default probabilities. The threshold asset
level at which default occurs represents the strike price. If a firm’s asset value is below the strike price
equity holders do not exercise the option and sell the entity to debt holders.
Structural models were pioneered by Robert Merton in its original form based on the Black-Scholes
option pricing theory.21 Kealhofer, McQuown, and Vasicek have developed a commercially successful
model based on this approach, illustrated in Figure 2.3, below. In their model distance to default22 (DD) is
measured using option pricing theory and DD is then matched with historic credit events to estimate
default probabilities.
Figure 2.3: Illustration of KMV model based on Merton model23




Source: Crosbie and Bohn, 2003.
Structural models offer the advantage of being relatively intuitive. Once assumptions have been made
about model parameters an analytical or simulated solution can be obtained. On the other hand, estimating
these underlying parameters, especially future asset value volatility, can be very difficult, particularly in
the context of government credit guarantees and on-lending extended to non-publicly traded entities.
Additionally, structural models dependent on similar assumptions as the Black-Scholes model may not be
applicable in practice.24


21
   Sundaresan 2013 discusses the original Merton model further evolution in research on structural models.
22
   DD represents the difference between an entity’s asset value and the assumed default threshold.
23
   EDF is the expected default frequency, or default probability.
24
   Key assumptions in the Black-Scholes model include constant volatility, efficient markets, no dividends, constant interest rates, perfect
liquidity, and the absence of transaction costs (Black & Scholes, 1973).

                                                                                                                                   12 | P a g e
The approaches presented are primarily tools to assess entities’ ability to service debt. Sovereign risk
managers need to complement this analysis with a view on the drivers of willingness to repay which may
be dependent on the institutional relationship with various parts of the government. Also, the willingness
to repay may be driven by the respective arrangement. For example, willingness to repay may differ
between credit guarantees and on-lending, as in some instances a default on payments to the government
in the case of on-lending may be associated with lower default costs as a default on payments to
commercial creditors. Willingness to repay may be estimated based on the historic relationship between
the government and the beneficiary.
Irrespective of the credit risk analysis approach used, risk managers should critically assess the results
obtained, reflect on the assumptions made and modeling techniques employed. The results obtained from
credit risk analysis should not be blindly taken at face value but risk managers should be aware of the
limitations of the model used and should complement the results from a risk analysis model with common
sense, experience of risk managers, and other information available.

2.3 Credit risk quantification
The analysis of credit risk forms the basis for quantification. Credit risk analysis may already result in
some quantified measures (e.g. default probabilities (PDs) in statistical models, distance to default in
structural models that can be translated into PDs, losses attached to certain probabilities in scenario
analysis) or ordinal measures (e.g. rating in credit scoring).
Policy makers, however, likely have an interest in understanding the cost of guarantees and on-lending in
nominal amounts and to estimate the potential impact of guarantees and on-lending on the government’s
budget and balance sheet, including the sustainability of government finances. Results from credit risk
analysis can be converted into nominal amounts or prices using two primary approaches. The first uses
differentials in market prices. The value of a guarantee is seen as the difference between the price of a
risky debt instrument (non-guaranteed) and the price of a risk-free debt instrument (guaranteed by the
government) with the same characteristics. The prices of the respective debt instruments can be directly
observed if the beneficiary entity has guaranteed and non-guaranteed traded debt outstanding. If this is not
the case, market prices for proxies with similar risk characteristics (e.g. rating) may be used. Market
information aggregated from rating agencies may be useful to compare average bond spreads for the
beneficiary with those of the guarantor, as shown in Figure 2.4.25
Using price differentials has the advantage of basing risk estimates on prices actually transacted in the
market. If prices are available, the quantification of risk is fairly straightforward. On the other hand,
market prices may not reflect the government’s risk exposure if they reflect implicit government support.
The second approach prices risk bottom-up through the use of default probabilities. Expected losses are
estimated by multiplying PDs with the respective exposure at default (EAD) and loss given default
(LGD). Loss given default is an estimate of the share of the guaranteed/on-lent amount the guarantor/on-
lender has to undertake in the event of default that cannot be recovered later (e.g. through the collection of
receivables). This bottom-up approach requires an estimation of all three components described above.


25
   Alternatively, CDS spreads may be used. Both bond spreads and CDS spreads may be an imperfect proxy for loan spreads. Also, spreads
fluctuate over time, hence a longer term average may be useful for the context of sovereign guarantees/on-lending.

                                                                                                                           13 | P a g e
PDs are estimated either directly through the respective credit risk analysis approach applied or can be
inferred from historic information if credit scoring is applied (example from Moody’s in Table 2.2).
Figure 2.4: Median bond spreads over LIBOR by selected rating and maturity for corporate bonds




Source: Moody’s Investor Service, 2015.
Table 2.2: Default probabilities from 1970 – 2013 by letter rating and maturity in years (in percent)

       Rating              1           2           3           4           5            6           7           8           9          10
         Aaa           0.000       0.013       0.013       0.037       0.104        0.170       0.241       0.318       0.401       0.489
         Aa            0.022       0.068       0.136       0.260       0.410        0.550       0.682       0.800       0.900       1.017
          A            0.062       0.199       0.434       0.679       0.958        1.271       1.615       1.995       2.387       2.759
         Baa           0.174       0.504       0.906       1.373       1.862        2.375       2.872       3.386       3.965       4.623
         Ba            1.110       3.071       5.371       7.839      10.065       12.123      13.911      15.700      17.479      19.323
          B            3.904       9.274      14.723      19.509      23.869       27.957      31.774      34.993      37.936      40.560
        Caa-C         15.894      27.003      35.800      42.796      48.828       53.270      56.878      60.366      63.730      66.212
      Inv Grade        0.091       0.272       0.519       0.802       1.113        1.441       1.776       2.126       2.498       2.887
     Spec Grade        4.460       9.161      13.634      17.571      21.014       24.042      26.690      29.035      31.212      33.234
      All Rated        1.675       3.407       5.015       6.398       7.587        8.619       9.513      10.312      11.062      11.771
Source: Moody’s Investor Service, 2014.
In any approach used, EAD is an essential requirement to quantify risk. EAD may be based on a debt
repayment schedule and could include principal only or principal and interest payments, depending on the
guaranteed amount.
LGDs may be estimated based on historical losses incurred by the guarantor/on-lender, commonly used
estimates in the private sector,26 or models where LGD is dependent on other factors, such as debt type
and seniority, capital structure, industry, and macro-economic factors.27 Another important factor driving

26
   The Basel Committee on Banking Supervision gives guidelines for financial institutions using an internal rating-based approach for credit risk
assessment (Basel Committee on Banking Supversion, 2004).
27
   Moody’s has developed a model estimating LGDs based on various factors and their approach is described in more detail in (Gupton & Stein,
2002).

                                                                                                                                 14 | P a g e
LGDs will be a government’s collection policy, i.e. the contractual and institutional set up for recovering
receivables.
This bottom-up pricing approach offers flexibility to base estimates on in-house credit risk analysis (e.g.
of stand-alone risk not reflecting implicit government support). On the other hand, estimates of the three
components are more subjective than reliance on traded market prices and their quality will depend on
data availability.
When pricing risk, sovereign risk managers can target various measures. The choice between target
measures mainly depends on how risk managers intend to use these measures in designing and
implementing risk mitigation and management tools. Target measures include the face value of
guarantees, maximum probable exposure, expected losses, market values, and unexpected losses. The
face value of a guarantee reflects the loss to government if the beneficiary defaults on the entire amount
guaranteed or on-lent. Identifying the face value does not require any risk analysis. Maximum probable
exposure reflects the amount the government is exposed to in adverse scenarios such as a currency
depreciation. It may be estimated if debt payments are uncertain (e.g. in the case of borrowing in foreign
currency or at variable interest rates if interest payments are also guaranteed). Expected losses and market
values are the most commonly used target measures for pricing credit risk. Expected losses reflect the
average loss a government sustains in a large and well-diversified portfolio or over a long time horizon.
Market values reflect the risk premium investors charge to hold credit risk in addition to expected losses.
The risk premium investors charge depends on investors’ estimation of credit risk, their degree of risk
aversion and other factors such as liquidity premia. Unexpected losses relate to potentially large losses
that occur rather rarely, beyond expectations (i.e. expected loss). Expected and unexpected losses together
reflect the loss governments may incur in adverse scenarios, as illustrated in Figure 2.5.
Figure 2.5: Conceptual loss distribution illustrating expected and unexpected losses




Source: Based on Basel Committee on Banking Supervision, 2005.

2.4 Application in risk management
Insights from credit risk analysis and measurement can be used to design and improve risk mitigation and
management tools. Initially, sovereign risk managers may design risk management tools that are not
based on thorough credit risk analysis. For example, governments may choose to charge flat

                                                                                                15 | P a g e
guarantee/on-lending fees that apply to every beneficiary irrespective of creditworthiness. Over time,
however, risk managers may aim to refine risk mitigation and management tools and differentiate these
tools (e.g. guarantee fees) based on beneficiaries’ credit quality.
Some countries use a combination of tools to meet risk management objectives, driven by context-
specific factors such as the types of beneficiaries, the institutional setup and political economy, and the
approach towards credit risk analysis. The most commonly applied tools include the setting of
guarantee/on-lending limits, the decision making process for issuing guarantees or on-lending funds to a
specific beneficiary, the structuring of guarantee agreements, the financial provisioning for losses, and
risk reporting and monitoring.
Limits are a tool for governments to define their risk appetite. They can be set either based on the stock or
the flow of guarantees/on-lending. Limits may also be differentiated by the degree of beneficiaries’ risk.
Higher limits can be set for less risky firms and vice versa. Also, an overall limit may be based on the risk
composition of individual beneficiaries and adjusted over time based on the evolution of credit risk in the
portfolio. Nominal limits on risk exposure are more common. These limits can be set based on an
estimate of expected fiscal costs if guarantees were issued and on-lending was granted up to that amount.
Also, risk managers may derive a limit based on assessment of the marginal cost of funding if
materialized credit risk leads to an increase in government borrowing. In a holistic risk management
framework guarantee/on-lending limits should be embedded in a view of the riskiness of the overall
government balance sheet, including liabilities, such as direct debt and other contingent liabilities.
The decision-making process for issuing guarantees or on-lending funds may be standardized in
secondary law or ministerial regulations. Such regulation may require credit risk analysis of the potential
beneficiary before any decision on guarantee issuance/on-lending is taken. The decision should be based
on a thorough cost-benefit analysis to which the analysis of the beneficiaries’ creditworthiness is one
element in the cost estimate. For example, governments may set risk thresholds to make beneficiaries
eligible for guarantees/on-lending. Requiring risk analysis prior to guarantee issuance/on-lending
increases the transparency of the process and helps in assuring that governments take a decision based on
clearly defined criteria rather than taking decisions driven by ad hoc political considerations.28
Following a decision to issue a guarantee/on-lend, risk managers should be involved in structuring the
respective agreement between the government and the beneficiary. Elements of such an agreement that
can be informed by credit risk analysis include the setting of guarantee/on-lending fees, the degree of risk
coverage, and the use of collateral.29 Guarantee/on-lending fees can be based on the riskiness of the
beneficiary and are in most cases based on estimates of expected losses or market values. Fees may be
charged directly to the beneficiary or a sponsoring entity, such as a line ministry, municipal government,
or government agency. Fees may be charged upfront at the time a guarantee is granted or funds are on-
lent, or at regular intervals (e.g. annually). Guarantee/on-lending fees create a cash inflow on the
government budget and can reduce the cost of guarantees/on-lending to the government by offering
compensation for the risk taken and may be a tool to reduce a bias towards guarantees/on-lending as

28
   Operational guidelines for approval and issuance of loan guarantees and for government on-lending should exist. These guidelines should
provide details of how credit risk should be assessed, together with measures to minimize the budget effect of a credit event. This risk assessment
should occur before the decision has been made to support a certain activity by the use of guarantees or on-lending.
29
     Types of collateral may vary and include government securities, future revenue streams, physical assets, and cash, among others.

                                                                                                                                  16 | P a g e
beneficiaries do not receive the respective support instrument at no cost. On the other hand, fees may
reduce the viability of a specific project by raising beneficiaries’ capital costs. When providing credit
guarantees, governments may structure them to only provide partial credit risk coverage. The degree of
coverage may be derived from an assessment of the beneficiary’s creditworthiness. Partial guarantees can
reduce moral hazard by the lender by making it assume part of the credit risk as well as by the beneficiary
by potentially increasing their cost of default. On the other hand, partial coverage may increase the
borrowing costs for riskier firms and make their operations less viable. Requiring beneficiaries to post
collateral for the time the government is exposed to credit risk is another risk mitigation tool that may be
part of a guarantee/on-lending agreement. The amount and quality of collateral to be posted may be
differentiated by beneficiaries’ riskiness. Collateral can reduce the government’s loss in the event a
beneficiary does not service its guaranteed/on-lent debt obligations. On the other hand, posting collateral
involves a cost for the beneficiary.
To prepare for the materialization of guarantees or the event that on-lent funds are not repaid,
governments may provision actual funds for future losses. Provisions may come from various sources,
including the government’s budget, guarantee/on-lending fees, investment income on retained provisions,
and the recovery of receivables from guarantees materialized in the past or on-lent funds not repaid.
Provisions may be set aside at the time the government assumes the respective risk or over time (e.g.
annually in the budgeting process). Governments may accumulate provisions in a contingency reserve
account to create fiscal buffers. These reserve accounts may be actual, i.e. funds set aside in a separate
account, or notional, i.e. accounting entries where provisions are for example used to pay down direct
government debt. Actual or funded reserve accounts imply a cost of carry by absorbing governments’
financial resources.
Once governments issue guarantees or on-lend funds beneficiary entities’ creditworthiness should be
regularly monitored and the government should report on the risk it has assumed. Risk monitoring and
surveillance may allow risk managers to detect a deterioration in credit quality early, engage with various
stakeholders to identify potential initiatives to mitigate risk, and trigger pre-specified responses. The
surveillance function is often the most meaningful element of a guarantee program. The ability to identify
and correct credit weakness early can greatly reduce financial losses. Risk reporting is important to
provide transparency on a government’s operations with respect to guarantees and on-lending. Reporting
may be differentiated based on the target audience. For example, reporting to the public may not include a
risk assessment by the government of individual entities due to the potentially detrimental effect on
borrowing costs for these entities. Reporting on risks from government credit guarantees and on-lending
may be embedded in a holistic reporting format on fiscal risks and contingent liabilities. Risks from
contingent liabilities may also be an input in government planning, for example when developing a
medium-term fiscal framework and in assessing debt sustainability.
All risk mitigation and management tools discussed have in common that they raise transparency and
accountability with respect to governments’ activities related to guarantees and on-lending. Thereby, they
increase the comparability between these activities and alternative policies, such as subsidies, and
contribute to a more explicit dialogue weighing the costs and benefits of issuing credit guarantees and on-
lending funds.



                                                                                               17 | P a g e
3     Country examples in developing and applying a risk analysis and
      measurement framework
Chapter 2 outlined four steps in the risk analysis and measurement process, and highlighted various
approaches used for risk analysis. This chapter provides practical examples on how countries manage
risks related to credit guarantees and on-lending. Practices in Colombia, Sweden, and Turkey illustrate
three countries with substantial experience in managing risks from credit guarantees and on-lending. The
chosen cases aim to highlight the diversity in approaches used and the degree to which the respective
context drives the choice in approaches and their detailed design and implementation.30 The fourth
country case on Indonesia illustrates how public risk managers have recently started developing a risk
management framework for sovereign guarantees with the support from the World Bank Group. This case
provides more detail as it focuses on the process of developing a risk management framework, while the
other country cases illustrate the current status quo in risk management. The sections below highlight
practices along the four steps in the risk analysis and measurement process rather than provide a
comprehensive description of the entire risk management framework.

3.1 Colombia

Defining characteristics
During the 1990s, the Colombian government entered into PPP arrangements to promote private sector
investment in critical infrastructure projects, including power generation, toll roads, and
telecommunications. To attract private investors, the government guaranteed specific project risks,
particularly demand risk (Lewis & Mody, 1997). As a result of an economic recession in the late 1990s
several guarantees were triggered. Cumulative payments by the government amounted to 2 percent of
GDP by 2004 (Cebotari, 2008). Following the crisis, the Colombian government passed legislation to
require the national government and sub-national entities to improve CL risk management, including the
provisioning for potential losses. Measures included requiring the government and sub-national entities to
include debt service appropriations in budgets to cover potential losses from CLs, as well as the creation
of a contingency reserve fund. Since 2004, CLs have also been incorporated in Colombia’s medium-term
fiscal framework.
The government differentiates between four major types of explicit CLs: legal claims against the nation,
PPPs, callable capital from commitments to multilateral organizations, and guarantees to public credit
operations, as shown in Figure 3.1. Natural disasters constitute an implicit CL.
This section focuses on public credit operations where credit guarantees are extended to public entities.
The total guaranteed debt outstanding (i.e. exposure) stands at about USD 2.3 bn. (Figure 3.2). Potential
beneficiaries include 1,134 municipalities, 32 departments, and 200 SOEs. Private entities are not eligible
for government guarantees. Most beneficiaries the government is currently exposed to (12 municipalities
and departments, and 16 SOEs) have a public credit rating from one Colombian rating agency.

30
   Representatives from Sweden, Turkey, and Colombia, were part of a peer-to-peer group dialogue between debt managers from several
countries facilitated by the World Bank. Debt managers exchanged their respective risk management practices, shared their current work
programs to further improve risk management, and discussed in depth various aspects of risk management, from credit risk assessment, to the
setting of guarantee fees, and organizational structures, among others.

                                                                                                                              18 | P a g e
The Directorate General Public Credit and National Treasury (DGCPTN) has wide ranging authority with
respect to government guarantees and is empowered to approve or deny any credit operation generating
CLs to the government. It also sets fees and monitors and reports on risk. The credit risk team consists of
three staff.
Figure 3.1: Stock of four types of explicit contingent liabilities in Colombia (in USD bn.)31




Source: Sub-directorate of Risk at the Directorate General Public Credit and National Treasury of
Colombia
Figure 3.2: Stock of credit guarantees in Colombia

             2,500

             2,000

             1,500
 USD mill




             1,000

              500

                ‐
                     2004 2005 2006 2007 2008 2009 2010 2011 2012 2013 2014



Source: Sub-directorate of Risk at the Directorate General Public Credit and National Treasury of
Colombia



31
  Amounts shown reflect size of reported contingent liability, not exposure. For guarantees to public credit operations, the reported CL represents
the 99.9th percentile of losses, for other types of CLs different valuation methodologies are used. Exposure from credit guarantees amounts to
about USD 2.3 bn., i.e. reported CLs are about 30 percent of total exposure for credit guarantees. Assuming an exchange rate of 2500 COP per
USD.

                                                                                                                                 19 | P a g e
Credit risk analysis
DGCPTN does not conduct its own assessment of credit risk of beneficiaries but relies on the risk
assessment (i.e. rating) by domestic and international rating agencies. These public ratings form the basis
for the quantification of risk. If beneficiaries are not rated by any rating agency endorsed in the country,
DGCPTN assumes the lowest rating above default.

Credit risk quantification
DGCPTN estimates expected and unexpected losses from credit guarantees. Expected loss calculations
are used in setting guarantee fees. The sum of expected and unexpected losses (explained below)
represents the value of contingent liabilities reported by the government.32 Total exposure to guaranteed
debt is also reported.
Expected losses are the product of exposure at default, probability of default and loss given default.
Exposure at default is defined as the product of the guaranteed principal outstanding multiplied by the
exchange rate between Colombian pesos and the borrowing currency. For the calculation of both,
expected and unexpected losses, the exchange rate is stressed assuming a depreciation of the Colombian
pesos by one standard deviation of annual historic exchange rate volatility.
The estimation of PDs is based on PDs for the Colombian sovereign. DGCPTN estimates a solvency
curve for the Republic of Colombia. The solvency curve plots the probability of non-default for the
sovereign over time. Based on the sovereign’s solvency curve, solvency curves per rating category are
estimated and applied to the respective guarantee beneficiaries depending on their rating relative to the
sovereign.33
LGDs are estimated at 75 percent if beneficiaries do not post sufficient counter-guarantees (i.e. collateral
or lien). However, given sufficient (in amount and quality) counter-guarantees, DGCPTN may lower the
estimate of LGDs. The adjustment of the LGD parameter is based on DGCPTN’s assessment of counter-
guarantees.
To estimate unexpected losses, DGCPTN follows the internal rating based approach outlined by the Basel
Committee on Banking Supervision (Basel Committee on Banking Supervision, 2005). The Basel
Committee provides a formula assuming a normal distribution of losses to estimate unexpected losses.
DGCPTN chose the 99.9th percentile of the estimated distribution of losses (i.e. a confidence level of 99.9
percent) as the value of contingent liabilities, constituting the sum of expected and unexpected losses (see
Figure 2.5 (end of section 2.3) for illustration of expected and unexpected losses).

Application in risk management
The DGCPTN applies various risk management tools, including the requirement of collateral from
beneficiaries, guarantee fees, a contingency reserve account, and risk monitoring and reporting.


32
   Size of contingent liability was defined as sum of expected and unexpected losses to strike a balance between potential over-reporting of
liabilities when reporting face values and under-reporting of liabilities if only expected losses were reported.
33
   DGCPTN models the evolution of a firm’s credit ratings as a Markov process. The respective credit rating is therefore a random variable that
evolves in time and whose future value given its current state is independent from previous ratings. Given the nature of the Markov process, if the
probabilities of migrating from one rating to another are known, it is possible to determine the probability of future ratings (Ministry of Finance
and Public Credit. Republic of Colombia, 2012).

                                                                                                                                 20 | P a g e
A collateral generally covers at least 100 percent of the maximum guaranteed debt service payment in a
given year. The level of the guarantee fee will be equivalent to the expected loss estimated. As the
expected loss is based on an estimate for PD and LGD, the fee collected from the beneficiary will depend
on its credit rating and the amount and quality of counter-guarantees posted. A higher credit rating will
correspond to a lower PD, and better counter-guarantees will lower the LGD estimate, hence reducing the
guarantee fee charged. Fees are to be paid annually or semi-annually and the first installment must be paid
before the first disbursement of the guaranteed loan is made.
The contingency reserve account is an actual (i.e. funded) fund aimed at reducing the volatility of budget
expenditures by creating buffers in case guarantees materialize and the government is required to
undertake debt service payments on behalf of the beneficiary. The fund was introduced in 2005 and
currently manages about USD 47 m. So far, the reserve fund has not been tapped to meet payments from
materialized guarantees but has rather been built up over time. In addition to guarantee fees, the fund may
be funded through budget appropriations and the collection of receivables on undertaken guarantees (loan
recovery). The account also retains investment earnings from investments in fixed income instruments
only.
DGCPTN monitors and reports on risks from guarantees. For monitoring, the maximum annual expected
losses and the total contingent liabilities from individual guarantees over a ten year period are tracked as a
signal for the potential materialization of credit risk. Reporting to the public includes a projection of
guaranteed amounts by rating, based on the disbursement and amortization schedule of guaranteed
borrowing (Figure 3.3; shown credit ratings are domestic credit ratings34).
Figure 3.3: Reporting on guarantee exposure by domestic credit rating in Colombia

                     8
                                                                          CCC        BBB‐         A       AA‐        AAA
                     7
                     6
                     5
     COP trillions




                     4
                     3
                     2
                     1
                     0
                         2015   2016   2017   2018    2019      2020      2021      2022      2023      2024      2025

Source: Sub-directorate of Risk at the Directorate General Public Credit and National Treasury of
Colombia




34
  Domestic ratings are relative to the respective sovereign. An AAA domestic rating is equivalent to that of the sovereign. For example, if the
sovereign is rated BBB and the domestic rating of the beneficiary is A, the converted international rating of the beneficiary would be B.



                                                                                                                                 21 | P a g e
Another risk management tool not based on credit risk analysis and quantification is a guarantee limit
imposed by law. The Colombian government has established a total guarantee limit of USD 9 bn. in the
past.35

3.2 Sweden

Defining characteristics
The size of Sweden’s total credit guarantee and on-lending portfolio stands at about USD 71 bn.36 (about
12 percent of gross domestic product (GDP)), split into export credit guarantees (about 32 percent of
total), student loans (about 35 percent), and other guarantees/on-lending (about 35 percent). Figure 3.4
shows guarantee and on-lending levels since 2001.
Figure 3.4: Stock of credit guarantee and on-lending portfolio in Sweden (in USD m)




Source: Swedish National Debt Office
The Guarantee and Loan department at the Swedish National Debt Office (SNDO) is tasked with
managing the credit risk from non-standardized guarantees37 and on-lending. The unit manages a portfolio
of guarantees of about USD 4.4 bn. (about 40 entities) and on-lending of about USD 1.5 bn. (6 entities).
Guarantees and loans managed by the Guarantee and Loan department are usually non-standardized
instruments and one-off deals. Guarantee structures may be more complex and tailored to the individual
beneficiary. Beneficiary entities include to a significant extent SOEs but no sub-national entities. Sweden
has only a few existing PPP projects. In defining default events, SNDO follows Moody’s definition of
default.38
The risk management framework for guarantees and on-lending is characterized by a strong legal
framework and governance mechanisms that were introduced after a financial crisis in the 1990s. The



35
   Currently it has an available space of USD 2.2 bn. for new guaranteed credits (about 0.7% of the GDP).
36
   Not including deposit insurance scheme (about USD 178 bn.).
37
   Standardized guarantees include export credit guarantees and housing credit guarantees. Non-standardized guarantees represent credit
guarantees with individually negotiated and structured guarantee agreements to specific entities.
38
   Four events constitute default under Moody’s definition. Missed or delayed interest or principal payment; bankruptcy filing or legal
receivership; distressed exchange; and a change in payment terms of a credit agreement.

                                                                                                                               22 | P a g e
Swedish Parliament decides on the amount and purpose of a guarantee/on-lending and then, via the
government, tasks the SNDO with pricing, negotiations, and risk management (see Figure 3.5).
Figure 3.5: Issuance process for government guarantee or loan in Sweden




Source: Swedish National Debt Office
The Guarantee and Loan department at the SNDO currently consists of 11 staff members primarily with
backgrounds in credit risk analysis, financial markets, and quantitative analysis. The size of the team
fluctuates with the size of the guarantee/on-lending portfolio (plus/minus 2–3 persons).

Credit risk analysis
The SNDO applies a toolbox of approaches to analyze credit risk. These include fundamental risk
analysis based on a rating methodology, the use of simulation models, and other methods such as
structural models. SNDO heavily favors the rating approach due to its ease of replication, transparency,
cost efficiency, and the access to information from third parties such as rating agencies. Simulation
models are primarily used for unique, complex, and large risks due to the significant resource investment
(quantitative skills, time, and cost) required. Structural models based on option pricing theory have been
scarcely used in the past but not currently. With the proper adjustments such models could be useful for
risk monitoring regarding publically traded companies (e.g. Moody’s Public Expected Default Frequency
Model). However, structural models are deemed less useful for pricing, as the assumptions required for
the model rarely hold in practice, in the view of SNDO credit analysts.
The rating based approach relies heavily on rating methodologies used by international rating agencies. If
beneficiaries have public ratings, SNDO is mostly relying on these ratings. However, SNDO may deviate
from rating agencies’ assessment due to the specific risk exposure the government is taking. If no public
ratings are available, SNDO performs its own credit rating assessment based on score cards developed by
Moody’s as they are most explicit in describing their rating methodologies (Table 3.1 provides an


                                                                                              23 | P a g e
example of a rating methodology score card SNDO is applying, adopted from Moody’s). To acquire
information and skills, SNDO subscribes to Moody’s and S&P for access to rating methodologies, and
sometimes staff attends credit risk analysis courses offered by rating agencies.
Table 3.1: Rating methodology score card for government owned infrastructure projects used in
Sweden
Broad Rating           Factor                                                      Sub-Factor
Factor                Weighting Rating Sub-Factor                                  Weighting
Market Position            40% Asset Type                                                    10%
                                 Operating History                                           10%
                                 Competition                                                 10%
                                 Service  Area Characteristics                               10%
 Performance               30% Annual  Traffic                                                5%
 Trends                          Traffic Profile                                              5%
                                 5 ‐ Year Traffic CAGR                                        5%
                                 Ability and Willingness to Raise  Rates                     15%
 Financial  Metrics        20% Debt Service  Coverage  Ratio                                 10%
                                 Debt to Operating Revenue                                   10%
 Capacity, Capital         10% Capital  Needs                                                 5%
 Plan and                        Limitations to Growth / Operational                          5%
 Leverage                        Restrictions
 Total                    100% Total                                                       100%
Source: Moody’s Investor Service; Swedish National Debt Office
When developing a simulation model for a specific guarantee, SNDO analysts follow a seven-step
approach. These include the identification of significant risk drivers with respect to the specific guarantee
or loan; the construction of a loss function from the relationship between these risk drivers (e.g. construct
a dependent variable that determines default); make assumptions about the stochastic behavior of the risk
factors (i.e. probability distributions), factoring in potential correlations between risk factors; collect and
adapt available data to estimate parameter distributions; estimate the expected value of the resulting loss
function through simulations; and stress-test the model to validate it.
SNDO has developed a simulation model for the Öresund link, a bridge between Denmark and Sweden.
At an exposure of about USD 2.5 bn. this bridge constitutes the largest guarantee in portfolio managed by
the Guarantee and Loan department at SNDO. The key risk drivers identified were traffic revenues,
operational and financial costs, extraordinary events (e.g. disasters), and dividends. SNDO contracted
several consulting firms to model behavior of the respective risk drivers and then simulate their behavior
in a loss function to estimate the probability of default, and hence the guarantee being called.
In addition to analyzing risks of individual guarantees/loans, the Swedish government has tasked SNDO
to conduct an analysis of the government’s aggregated guarantee and on-lending portfolio. This analysis
includes an analysis of credit risk and liquidity risk (i.e. the risk of marginally higher borrowing costs if
the payment of a guarantee is very large and/or needs to be executed in an extraordinary short period of
time). The analysis includes behavior of risk drivers with respect to idiosyncratic risk (i.e. concentration

                                                                                                   24 | P a g e
of a significant share of total exposure to individual entities), and systematic risk, such as geographic
concentration, industry concentration, and general economic volatility. Additionally, the deposit insurance
scheme39 and the new bank recovery and resolution framework are included in the analysis as well.

Credit risk quantification
SNDO calculates expected losses or market values for guarantees/on-lending.40
To calculate expected losses when a rating methodology has been applied to analyze a beneficiary, SNDO
needs to estimate PDs and LGDs. Default probabilities are derived from the respective default rate tables
of rating agencies based on historic data for similar types of entities. LGDs are also derived from rating
agencies’ information on historic bond and loan recoveries. LGDs are differentiated by the bond/loan
seniority stipulated in the respective agreement. If SNDO requires collateral to underwrite a guarantee/on-
lend, LGD estimates may be adjusted accordingly. The valuation of collateral may be outsourced to third
parties. Additionally, SNDO sometimes adjusts LGD estimates based on a qualitative assessment.
If a simulation model has been used to estimate the distribution of a loss function, expected losses are
inferred from the frequency of losses resulting in default. LGDs can be inferred from the severity of
losses in default events.
To conduct a market value assessment, SNDO compares yields to maturity for corporate bonds and
comparable government bonds. Yields of corporate bonds are taken from corporates with the same credit
rating as the guarantee beneficiary’s internal credit rating as assessed by SNDO. Differences in yield
hence reflect credit and liquidity premia. SNDO also studies credit default swaps (CDS) to perform
market value assessments.

Application in risk management
SNDO applies various risk mitigation tools to manage the fiscal risk stemming from exposure to credit
risk from guarantees and on-lending, including guarantee fees, partial guarantee coverage, appropriations
to a notional reserve account, and risk reporting.41 Sweden has currently not set an aggregated limit on the
flow or stock of guarantees and on-lending. However, in several cases there are annual limits set for
specific agencies.
Fees charged to beneficiaries are set to cover expected costs which comprise expected losses from the
guarantee/on-lending operation and administrative costs for the issuance and monitoring of the
guarantee/loan. Fees are mostly charged on an annual basis. Parliament can decide to reduce or waive fees
to be paid by beneficiaries. In such cases, the subsidy element must be recorded as budget expenditure
and appropriated to the reserve account. In SNDO’s portfolio, about half of the exposure refers to
guarantees and loans where the fee is subsidized (in part or full). In other areas, e.g. export credit
guarantees, there are no such subsidies at all. In cases where European Union (EU) state aid rules apply
(e.g. where beneficiaries’ operations have cross-border effects), a fee reflecting the market value of a



39
   The deposit insurance scheme is also managed at SNDO. It is managed under the Financial Stability and Consumer Protection department, not
the Guarantee and Loan department discussed in this paper.
40
   Depending on the application of EU state aid rules discussed below.
41
   On a case by case basis, SNDO may also incorporate the requirement to post collateral in guarantee agreements.

                                                                                                                            25 | P a g e
guarantee must be charged from the beneficiary. Also, if EU state aid rules apply, the maximum degree of
risk coverage is 80 percent.
Guarantee/on-lending fees are booked against a notional contingency reserve account. This account is
unfunded (i.e. an accounting entry) and appropriations to the fund are used to pay down sovereign debt
thereby creating space for marginal borrowing for the undertaking of defaulted loans or bonds. Only
expected losses are appropriated to the fund. Administrative fees collected are paid in a separate account
and the portion of fees exceeding expected loss (e.g. if market based fees are charged) is transferred to the
state budget.
SNDO closely monitors guarantee/loan beneficiaries through a semi-annual risk assessment (e.g. updating
risk rating applying credit score cards). SNDO also publishes an annual report of the aggregated
guarantee and on-lending portfolio, including overall exposure, governance principles around the issuance
of guarantees and risk management, and expected losses.

3.3 Turkey

Context	and	defining	characteristics	
Contingent liabilities are not managed centrally in Turkey, but different types of CLs are managed in
various government units. The Undersecretariat of the Treasury is mandated to manage risks from
government guarantees and on-lending. Government guarantees include credit and investment42
guarantees, as well as debt assumption commitments in PPP projects. Guarantees or on-lending are only
provided for external borrowing. The stock of guaranteed debt stood at about USD 11.2 bn. (about 4.24
percent of government debt) at the end of 2014, and hardly any new on-lending was extended in recent
years (Figure 3.6 shows flows over last 12 years). The Undersecretariat of the Treasury extends
guarantees and on-lending to four major types of beneficiaries: SOEs, public banks and development
banks, municipalities, and affiliates of municipalities. About 83 percent of guarantees outstanding are to
banks, 9 percent to SOEs and 8 percent to municipalities.
The Turkish Treasury has been issuing guarantees for more than 30 years and has been able to collect data
on historic default events and financial information of the respective beneficiaries, allowing the credit risk
team to adopt a statistical model based on Treasury’s historic risk materialization.
Importantly, Treasury defines default of beneficiaries on an annual basis and as default on payments to
Treasury in the case of on-lending or when Treasury has to undertake payments to creditors in the case of
credit guarantees. Hence, a guaranteed entity that cannot meet its payment obligations does not default to
creditors but applies to Treasury to undertake a payment installment.43
Risks from guarantees and on-lending are managed by the credit risk management unit which constitutes
one of four sub-units in the middle office of the Directorate General (DG) of Public Finance. The unit
consists of four experts and one head of department.



42
  Investment guarantees refer to counter-guarantees provided by Treasury on certain commitments of public institutions in PPP contracts.
43
  In some instances, beneficiaries may receive capital injections from Treasury to support their businesses. These injections, however, are not
defined as defaults and hence the definition of default applied in the risk model may overestimate credit quality of beneficiaries.

                                                                                                                                 26 | P a g e
Figure 3.6: Flow of credit guarantees and on-lending in Turkey44




Source: Turkish Treasury

Credit	risk	analysis	and	quantification	
In response to Turkey’s financial sector crisis in the early 2000s, the government aimed for improved
management of contingent liabilities, including the analysis and quantification of risks related to
guarantees and on-lending. The first model Treasury developed with the support of an external consultant
in 2002 was a macroeconomic simulation model that estimated default probabilities and expected losses
derived from simulated paths of macroeconomic variables and their impact on specific sectors and
entities, including electricity, gas, the Turkish Investment Bank, the Izmit Water Build-Operate-Transfer,
state owned entities in general, and municipalities. Treasury, however, found the model difficult to
maintain and assessed the simulation of macroeconomic variables not to be the core competency of the
credit risk team.
In 2006, Treasury developed a statistical model based on insights from the Altman Z-Score methodology
discussed above to estimate expected losses on government credit guarantees. Expected losses are
estimated based on a statistical credit scoring model to estimate default probabilities and an estimate of
recovery values in the case of default, based on historic experiences of Treasury in collecting receivables
from undertaken guarantees (Figure 3.6). In the model, PDs are a combination of PDs given non-default
(i.e. the beneficiary did service its debt in the previous period) and PDs given default (i.e. Treasury had to
undertake debt service payments on behalf of the beneficiary in the previous period). PDs given non-
default are derived from a regression analysis of historic defaults on historic financial performance of
beneficiaries (Z-score methodology). Regression models are calibrated individually for the four different
types of entities to which guarantees and on-lending are provided. This allows the model to reflect sector-


44
     On-lending has been included in limit since 2009.

                                                                                                 27 | P a g e
specific risk drivers. Financial information from beneficiaries is obtained from audited balance sheets and
income statements for SOEs and banks and from realized budget figures for municipalities. PDs given
non-default are based on Treasury’s own historic record of collecting receivables from defaulted
beneficiaries. Resulting annual PDs are then multiplied with annual debt service payments, discounted
using the Treasury yield curve, and added up to arrive and a present value for expected losses at the time
of guarantee issuance.
Figure 3.7: Structure of Turkish credit rating model




Source: Turkish Treasury
Treasury was able to use a statistical model for risk analysis due to its rich history of information,
stemming from the collection of data for a 30 year time period and a large number of beneficiaries.
Although the quality of financial statements available to Treasury has significantly improved after a
public fiscal management reform in 2002, data quality can still be an issue. Treasury attempts to deal with
such issues by working with other government entities to obtain quantitative and qualitative information.
The internal credit rating model is run on MS Excel and the regressions to estimate Z-scores are
conducted in EViews. The financial ratios used in the model are updated annually while the coefficients
of the model are updated every five years. Going forward, Treasury is considering complementing the
statistical model through the use of more qualitative information in risk assessment.

Application	in	risk	management	
Turkish Treasury applies the insights from its statistical risk model in various risk management and
mitigation tools. Model outcomes support the decision on whether to grant guarantees/on-lend funds, the



                                                                                              28 | P a g e
setting of guarantee and on-lending limits, the setting of guarantee fees, the degree of risk coverage, and
appropriations to the risk account (Figure 3.8).
While the issuance of guarantees and the on-lending of funds is a political decision taken by the minister
in charge of the Treasury reflecting considerations beyond a credit risk perspective, risk analysis for the
potential beneficiary is undertaken before a guarantee/on-lending is granted and the result helps inform
the decision makers about the potential risks.
Limits on flows are set annually on the nominal amount of new guarantees and on-lending and have been
fairly stable at USD 3 bn. in recent years. Treasury recommends limits based on the expected risk
exposure from new issuances and changes in the risk profile of the existing guarantee/on-lent portfolio.
By law fees are capped at 1 percent of the guaranteed/on-lent amount. Within that limit, fees are an
increasing concave function of expected losses, as shown in Figure 3.8. Receipts from fees are transferred
to a reserve account.
Figure 3.8: Guarantee and on-lending fee in Turkey, based on expected losses




Source: Turkish Treasury
Partial guarantees cover a maximum of 95 percent of borrowing and the degree of risk coverage is
inversely related to the expected loss from a guarantee.45
Turkey has established a contingency reserve account to provision for future losses from guarantees.
Revenue sources of the account are not only guarantee/on-lending fees but also collected receivables from
undertaken payments by Treasury, investment returns, and budget appropriations if the account does not
cover expected losses. The central bank acts as an agent for Treasury in managing the account.

3.4 Indonesia	
The cases of Colombia, Sweden, and Turkey illustrate situations where sovereign risk managers have
well-established risk analysis and measurement frameworks that inform risk management around

45
   In the case of borrowing from multilateral sources and export credit agencies, up to 100 percent of the borrowed amount can be guaranteed by
Treasury.

                                                                                                                               29 | P a g e
sovereign credit guarantees and on-lending. In many countries, however, such frameworks are not in
place yet and risk managers have to design a framework from a basic level. To provide guidance, this
section outlines how the contingent liabilities unit at the Directorate General of Financing and Risk
Management (DGFRM) in the Indonesian Ministry of Finance went through the process of establishing a
risk analysis and measurement framework and how the insights from this analysis will influence the
design and implementation of risk management tools. DGFRM is going through an iterative process
covering the four steps in the risk analysis and measurement framework outlined in chapter 2. In setting
up a context-specific framework, DGFRM draws upon experiences from other countries through a peer-
to-peer group dialogue, risk managers at the World Bank, and third party information (such as rating
methodologies by rating agencies). DGFRM then integrates these insights to capture the idiosyncrasies in
Indonesia.
The World Bank Group has been supporting DGFRM in improving its risk management practices around
contingent liabilities since October 2012. Contingent liabilities risk management constitutes one of three
components of the Government Debt and Risk Management technical assistance program between the
World Bank and Indonesia, which is funded by the Swiss State Secretariat of Economic Affairs (SECO).
The risk analysis and measurement framework developed by DGFRM currently focuses on explicit
government guarantees, but the approach and insights from designing a risk analysis system could be
quite easily amended to include risks from other types of contingent liabilities, such as on-lending and
implicit CLs to SOEs and sub-nationals.

Context	and	defining	characteristics	
The Indonesian government is exposed to a range of contingent liabilities, including legal claims against
the government, banking crises, implicit support to state-owned enterprises, an emergency fund facility, a
deposit insurance scheme, support for export credit, callable capital to international organizations, and
explicit government credit and investment guarantees. DGFRM’s mandate is to manage risks from
explicit government credit and investment guarantees.

Definition of risk exposure
Guarantee beneficiaries are mostly owned and/or controlled by the government and hence risk exposure
to the government from these entities comprises various types of fiscal risks, including volatility in
dividends paid, their ability to provision essential public services, implicit contingent liabilities (e.g.
default on non-guaranteed debt). The risk exposure in scope for DGFRM, however, is risks from explicit
government credit and investment guarantees.
Credit guarantees are extended to the power sector (i.e. PLN) through Fast Track Program Phase 1 (FTP1)
and to the water sector through the Clean Water Availability Program. These guarantees insure default
risk of beneficiaries (PLN and water utilities) in corporate finance lending. Investment guarantees can be
extended to the power sector through FTP2 and to PPPs in various sectors through the Indonesia
Infrastructure Guarantee Fund (IIGF). Investment guarantees protect investors against the termination risk
caused by the materialization of political risk in project finance deals. Investment guarantees are also
extended to independent power producers (IPPs) to guarantee the off-take of electricity at a pre-set tariff
by PLN (see Figure 3.9). Under this scheme, if PLN fails to pay for electricity delivered by IPPs in

                                                                                               30 | P a g e
accordance with an off-take agreement, the government’s guarantee is called and the government is
obliged to make payments to IPPs to cover PLNs shortfall. DGFRM defines a credit event as an
unexpected payment by the government to the beneficiary entity which would otherwise not be able to
meet a debt service payment or a situation where the government takes over the full amount of guaranteed
debt.
Figure 3.9: Credit and investment guarantee schemes managed by DGFRM in Indonesia




Source: Indonesian Directorate General of Financing and Risk Management

Characteristics of guarantee portfolio
DGFRM manages risks from government guarantees extended under four presidential decrees. Within
this portfolio, the government’s largest exposure is to Perusahaan Listrik Negara (PLN), the state-owned
electric utility with a monopoly on electricity distribution (about USD 13.5 bn. or 1.6 percent of GDP)
and credit guarantees to water utilities (about USD 16 mn.). Additionally, the government engages in a
co-guarantee scheme with IIGF that results in about UD 3.2 bn. exposure. 46 While the total size of the
current guarantee portfolio is fairly limited, the Ministry of Finance expects the portfolio to grow
significantly in the future given the government’s ambitious infrastructure investment aspirations. To
finance infrastructure investments the government intends to leverage private sector funding through the
use of risk sharing mechanisms such as credit and investment guarantees. In addition to current exposure
in the power and water sectors, the government expects growing exposure in infrastructure sectors such as
toll roads, air ports, sea ports, railways, and waste management, as well as telecoms.



46
   IIGF was set up to promote private investment to finance infrastructure projects by providing investment guarantees under PPP schemes. Due
to its limited capital, IIGF currently is only able to take relatively small guarantee exposure.

                                                                                                                              31 | P a g e
On-lending is not managed by DGFRM but by the DG Treasury. Hence, on-lending is not in scope of the
risk management framework developed at DGFRM. However, due to the similar nature of credit risk
involved in on-lending, the design and implementation of the risk management process described here
could be easily extended to include on-lending.47

Data availability
DGFRM has recently started to collect historic information on the performance of guarantee beneficiaries,
including information from financial statements such as balance sheets and income statements as well as
qualitative information (e.g. assessment of regulatory environment, management quality, competitive
environment, etc.). Outright defaults of beneficiaries where beneficiaries default to commercial creditors
who then accelerate debt service payments have not materialized in the past. PLN has not defaulted.
Water utilities have defaulted in the past and information on defaults is available. However, defaults have
only occurred at water utilities that borrowed through on-lending from the government, not at water
utilities conducting commercial borrowing with government guarantees. Given the potential difference in
willingness to repay in on-lending operations discussed above, and a potential bias towards less viable
water utilities borrowing through on-lending from the government, historic default events at water utilities
may be inappropriate for use in the analysis of guaranteed water utilities. Going forward DGFRM has
discussed an adaptation of the definition of default. Rather than focusing on outright defaults to
commercial creditors, DGFRM may define default as missed debt service payments (e.g. individual
installments) that are paid for to the creditor by the government.
PLN has been rated by international rating agencies (Moody’s, S&P, and Fitch) and has traded corporate
bonds outstanding for which information is available on Bloomberg. It is important to note that market
prices factor in implicit government support and spreads between the Indonesian government and PLN
are relatively tight. For water utilities, however, only very few companies are rated by local rating
agencies and no traded corporate debt securities are outstanding.

Resources and capacity
The contingent liabilities team at DGFRM consists of three sub-units, including risk analysis, the
structuring of guarantee agreements, and risk monitoring and reporting. The head of the team is supported
by seven staff who rotate between sub-units to balance workloads and build skills across the entire
spectrum of guarantee risk management. Staff have a general background in finance and economics and
have often worked in various units of the debt management office. However, staff mostly do not have
previous professional experience in credit risk analysis.
The Risk Management Unit from the Fiscal Policy Office (FPO) has recently been integrated into
DGFRM. This unit also has responsibilities with respect to managing risks from government guarantees
and state-owned enterprises. The integration of this team into DGFRM could help strengthen risk
management capacity. Other government(-related) entities involved in credit risk analysis include the



47
   Attention has to be given to differences in the institutional setup of guarantees and on-lending. While ability to repay would be the same in both
cases and only dependent on the credit quality of the respective beneficiary, willingness to repay may differ depending on whether on-lending or
guarantee agreements are in place.

                                                                                                                                   32 | P a g e
Directorate Investment Management System (SMI) under DG Treasury which manages on-lending by the
central government, and IIGF which provides guarantees to PPP projects.

Credit	risk	analysis	
DGFRM has studied several approaches for risk analysis before deciding to develop an internal credit
scoring system to analyze risks from explicit guarantees. With the support of a consultant from the
Turkish Treasury, DGFRM reviewed the Turkish approach to risk analysis and quantification based on a
statistical model building on the Altman Z-Score methodology. DGFRM also reviewed literature on
alternative approaches to risk analysis, such as structural models and scenario analysis. DGFRM was
involved in a peer-to-peer group exchange facilitated by the World Bank. Through this exchange
DGFRM was exposed to practices with respect to CL risk management in Colombia, Sweden, Turkey, as
well as South Africa.
Based on this review of approaches in literature and country practices and an assessment of the specific
context, including the characteristics of the guarantee portfolio, the government’s risk exposure, data
availability, and resources and capacity at DGFRM, the CL team decided to implement a credit scoring
approach. Given the limited information on historic financial performance and credit events of
beneficiaries and the relatively small number of beneficiaries, a statistical model would have been
difficult to implement. A credit scoring model allows DGFRM to leverage information on rating
methodologies available from rating agencies when developing score cards. Also, a scoring model is very
flexible in incorporating qualitative information and being specific to the particular risk exposure of the
government. Furthermore, credit scoring helps the CL team at DGFRM to build capacity for a
fundamental understanding of credit risk which facilitates ongoing credit monitoring and the
implementation of risk mitigation measures. On the other hand, the relative subjectivity in scoring risk
factors may make it more difficult to convince policy makers of the validity of risk assessment. To
manage this concern, the formalization of a clear scoring methodology, including scoring guidelines for
each scoring factor, based on a methodology by a major rating agency can help raise credibility of the
chosen risk analysis approach.
Given the current guarantee portfolio, DGFRM decided to start developing score cards for the electric
utility and water utilities. The development of score cards is an iterative process. The first score card for
electric utilities DGFRM developed was very closely related to Moody’s methodology for rating
regulated electric and gas utilities. As DGFRM staff applied the scoring methodology for the electric
utility, discussed the results and sought feedback from the World Bank team, and researched further
rating methodologies (e.g. corporate score card from S&P), the score card was refined by changing and
adding scoring factors (e.g. management quality), adding modifiers (e.g. liquidity, financial policy), and
changing weights for factors (see Table 3.2).
DGFRM followed a similar process developing a score card for water systems. To test the validity of the
score card for water utilities, DGFRM applied it to several water utilities that have defaulted in the past.
Using information from financial statements and other assessments by the government of defaulted water




                                                                                                  33 | P a g e
utilities before they defaulted, DGFRM checked if their score card was useful in picking up deteriorating
credit quality. Based on insights from this back testing, DGFRM was able to further refine its score card.
To institutionalize the process of developing credit rating methodologies and to conduct the assessment of
individual beneficiaries, the Ministry of Finance is planning to form a credit committee staffed by
professionals from various related backgrounds and headed by the head of the middle office of DGFRM
with a leading role for the head of the CL unit at DGFRM. This committee can have an important role in
further refining score cards, developing new scoring methodologies, and discussing the assessment of
entities thereby ensuring that the major risks have been identified.
Table 3.2: DGFRM's score card for electric utilities

 Internal Credit Rating SPU for Company XYZ Weight Sub Score Final Score
Regulatory Framework                               20.0%        0.70
a. Legislative and Judicial Underpinnings of the   10.0% 4
b. Consistency and Predictability of Regulation    10.0% 3
Ability to Recover Cost and Earn Return            20.0%        2.60
a. Timeliness of Recovery of Operating and Capital 10.0% 12
b. Sufficiency of Rates and Return                 10.0% 14
Diversification                                    10.0%        1.30
a. Market Position                                  5.0% 12
b. Generation and Fuel Diversity                    5.0% 14
Management                                         10.0%        1.40
a. Strategic Positioning                            3.3% 15
b. Operational Effectiveness                        3.3% 12
c. Governance (BoD)                                 3.3% 15
Key Credit Metrics                                 40.0%         5.1
a. (CFO pre + Interest)/(Interest + Principal)     15.0% 12
b. CFO pre/WC Debt                                 15.0% 12
c. Debt/Total Asset                                 5.0% 18
d. Foreign Currency Debt/Domestic Currency Debt     5.0% 12
                                                                Ba1
Base Rating                                                     11.0
Modifiers       Factors        Base Notch Adjusted Score
            Base Rating        11.10
            Liquidity            3      0         11.10
            Financial Policy 2          0         11.11
Source: Indonesian Directorate General of Financing and Risk Management
Next steps in risk analysis for DGFRM will be to further refine the existing score cards based on insights
from their application and discussions in the credit committee. DGFRM may consider applying the score
cards not only for guaranteed beneficiaries but also entities in the same industry as beneficiaries to
broaden the scored universe. Also, DGFRM is in the process of developing additional score cards for
municipalities (given the recourse agreement to municipalities in investment guarantees) and more
complex structures such as project finance deals in sectors currently in the pipeline (e.g. toll roads,


                                                                                              34 | P a g e
seaports, airports). As DGFRM guarantees types of political risk when issuing investment guarantees,
DGFRM may develop a scoring methodology to assess various peril types it insures through these types
of guarantees (e.g. expropriation, breach of contract, and change in law).

Credit	risk	quantification	
DGFRM is considering to use expected losses and market values as metrics for quantifying credit risk
from sovereign guarantees. Calculating two metrics allows DGFRM to compare different estimates and
draw conclusions (e.g. about risk premia demanded by investors, difference in government’s perception
of credit risk and that of market participants) from the comparison of results. DGFRM can also use the
results from the two metrics and the range between them in designing risk management tools depending
on the respective policy objective.
To estimate expected losses, DGFRM converts internal credit scores from the application of its score
cards into letter ratings that correspond to those of international rating agencies. Using information on
historic defaults by rating and time horizon published by rating agencies (see Table 3.1. for an example
from Moody’s) DGFRM converts the letter rating into default probabilities for the maturity of its
guarantee or annual values.48 DGFRM estimates LGDs to be 50 percent, based on international standards
and Indonesia specific experience (especially for water utilities). Exposure at default (EAD) is derived
from previous disbursements and amortizations on guaranteed loans for credit guarantees and the
termination purchase price (which consists of an equity and debt component) in the case of political risk
insurance in the case of investment guarantees. Expected losses are then estimated as the product of EAD,
PD, and LGD.
To estimate market values two approaches are used. To estimate the marginal value of explicit guarantees
for beneficiaries where traded debt securities are outstanding, DGFRM compares the yield on Indonesian
government bonds with those of the beneficiary entity with the same maturity. In the current guarantee
portfolio this is only possible in the case of PLN. This spread represents the marginal annual value of an
explicit guarantee. Alternatively, for beneficiaries without outstanding traded debt securities or to value a
guarantee, including explicit and implicit government support, DGFRM calculates the spread of
government bonds and corporate bonds of a large sample of entities with the same rating as the rating
DGFRM assigns the beneficiary in its internal scoring process.
Going forward, DGFRM builds an internal database recording the performance of beneficiaries.
Information recorded includes financial performance from financial statements, the assessment of
qualitative factors deemed important for credit scoring, as well as credit events (e.g. outright defaults or
proxies such as capital injections from the government). Over the long run and assuming a growth in the
guarantee portfolio, DGFRM may be able to use this information to calibrate an in-house credit risk
model to quantify credit risk based on risks specific to the Indonesian government when issuing
guarantees, rather than relying on information from third parties such as rating agencies.




48
  Dependent on application in risk management tools (e.g. annual PDs for budget appropriations; maturity of guarantee to guide decision on
guarantee issuance and structuring of guarantee agreement).

                                                                                                                              35 | P a g e
Application	in	risk	management	
DGFRM is currently in the process of designing and amending risk management and mitigation tools to
incorporate insights gained from risk analysis and quantification based on their internal credit scoring
approach. A ministerial regulation has been drafted and is currently being discussed. This regulation
covers sovereign guarantees managed anywhere in the Ministry of Finance and establishes a firmer
mandate for DGFRM in the process of issuing and monitoring sovereign guarantees and to implement
stronger risk management tools. The regulation covers the use of various risk management and mitigation
tools such as the setting of a guarantee limit, assessment of a guarantee application, the structuring of
guarantee agreements, the proposal of guarantee fees, the provisioning for financial losses, and the
recording, monitoring and reporting of risks from guarantees. The regulation is fairly high-level and does
not detail the exact specifications of the respective risk management tools, giving DGFRM discretion in
designing and improving them in an iterative process based on experience gained over time.
Indonesia’s medium-term debt management strategy for 2013 – 2016 currently limits the flow of
sovereign guarantees to 2.57 percent of GDP over that time period. DGFRM is considering to propose a
refined limit based on the assessed credit risk by beneficiary. Such a limit may be based on the
government’s marginal borrowing capacity in an adverse situation, where the adverse situation may be
defined by economic circumstances and a high incidence of guarantees being called.
When applying for government guarantees, potential beneficiaries need to submit information to facilitate
the assessment of project feasibility and creditworthiness of beneficiaries, including cash flow projections
for the project to be financed, audited financial statements of the beneficiary, projections for future
financial performance, and a proposal for risk sharing. Before a decision on the issuance of a guarantee
can be made, an assessment based on internal credit scoring approach must be conducted and risks must
be quantified (expected losses). The assessment will be undertaken by a credit committee once it is
established. The committee will issue a recommendation to the minister of finance on the issuance of a
guarantee.
DGFRM proposes budget allocations for contingent liabilities from government guarantees to be set
based on the estimation of expected losses. If not used for the undertaking of guarantees in a given budget
year, allocated resources should then be transferred to a contingency reserve account . This reserve
account would act as a buffer for future government payments under guarantee agreements ensuring
timely payment and minimizing significant adverse impacts on the budget in a given year.
Under the proposed regulation, DGFRM would be responsible for submitting regular reports to the
minister of finance on portfolio exposure and the results of regular risk evaluations. These reports shall
include an assessment of credit risk of the overall portfolio, quantified credit risk analysis based on the
internal credit scoring approach, and recommended risk mitigation tools. To conduct regular risk
monitoring, DGFRM is authorized to request information on project progress, audited financial
statements, and other information to assess credit risk from beneficiaries.

3.5 Key insights from country examples
The four country cases discussed illustrate the heterogeneity of frameworks used for analyzing and
managing credit risk from guarantees and on-lending. Even if the same general approaches are used in

                                                                                                 36 | P a g e
risk analysis, quantification, and application in risk management, the design details differ significantly
and are very context-specific. Appendix A provides a stylized summary of country cases.
Key context-specific drivers that lead to a differentiation in risk analysis and measurement frameworks
include the following: The characteristics of the guarantee and on-lending portfolios (e.g. overall size
relative to debt or GDP, diversity of guaranteed entities). The relationship between the government and
the respective beneficiary institutions (e.g. governance structures, regulation, ownership). The availability
of historic data (e.g. financial information of beneficiaries, past credit events such as default or capital
injections) and third party information (e.g. credit rating by rating agencies, traded debt securities).
Available resources (e.g. number of staff, staff capacity, and financial resources to purchase third-party
information).
Risk analysis is conducted in-house in Indonesia, Sweden and Turkey. Indonesia and Sweden rely on
methodologies developed by rating agencies for credit scoring. Sweden complements a rating approach
with simulation models for individual guarantees/loans. Turkey developed a statistical model relying on
internal and quantitative information. On the other hand, Colombia does not conduct its own risk analysis
but relies on credit risk assessments from rating agencies.
To quantify risks all four countries estimate either market values or expected losses, or both. The chosen
target measure depends on its use in risk management. In Sweden expected losses are usually calculated
for setting fees and reserve account appropriations while market values are used if EU rules require it. In
Colombia both market values and expected losses are estimated for different uses, to set guarantee fees
and for risk monitoring and reporting respectively. Indonesia intends to follow similar practices as
Colombia. Turkey relies on expected losses to inform various risk management tools.
In all four countries the insights from risk analysis and quantification inform important risk mitigation
and management tools. Colombia, Sweden, and Turkey all charge guarantee fees differentiated by
beneficiaries’ creditworthiness.49 While Turkey bases fees on expected losses, in Colombia they are based
on market values, and in Sweden both approaches are used. All three countries also use contingency
reserve accounts to provision for financial losses but these can be either notional accounts (Sweden) or
actual accounts (Colombia, Turkey). Risk monitoring and risk reporting is an integral part of the
respective risk managers in all four countries but the degree to which information is made available to the
public differs. Only the Colombian DGCPTN consistently requires collateral while in Sweden collateral
is requested on a case by case basis. Turkey and Colombia have set guarantee and on-lending limits based
on nominal amounts in exposure while Sweden has not set a guarantee/on-lending limit.
While Colombia, Sweden, and Turkey have significant and varied experience in measuring and managing
risks from sovereign credit guarantees and on-lending, risk managers in all three countries are
continuously improving their practices and emphasize that designing and implementing a risk
management framework is an iterative process. Similarly, Indonesia sees the development of strong credit
risk management practices as a long-term process.




49
     Indonesia plans to do the same.

                                                                                                37 | P a g e
4     Considerations in implementing a risk analysis and measurement
      framework
Governments which intend to implement a risk analysis and measurement framework for government
guarantees and on-lending need to consider several factors to ensure sound risk management practices.50
These factors include the institutional setup and governance arrangements for risk management, the
sequencing of the scale up of a risk management framework, political economy considerations, and the
avoidance of common pitfalls in implementation.
The institutional setup for risk management includes the organizational structure of the guarantee and on-
lending risk management team as well as the integration of risk management across various types of CLs.
In many countries, credit guarantees and on-lending are managed by separate units (often within the
ministry of finance). Given the very significant similarities in credit risk between these two options of
government support, governments may consider integrating credit risk management of both in one unit or
at least ensuring strong collaboration. In the countries discussed in this paper, sovereign credit guarantees
are managed by the respective debt management offices. While it is useful to ensure strong coordination
with debt managers (e.g. by including a strategy on guarantees and on-lending in the government’s debt
management strategy), it is not necessary for guarantee and on-lending risk management to be conducted
within debt management offices. The organizational setup may depend on the specific history of
institutional development and should take into account the skill set required of staff to conduct risk
analysis and quantification. Staff with previous professional experience in credit risk analysis (e.g. at
commercial banks) and a strong quantitative background are usually good fits for the tasks required.
Often the management of various types of CLs (e.g. natural disasters, guarantees, on-lending, financial
sector vulnerabilities, deposit insurance, etc.) are managed by separate units, although usually within
ministries of finance. Strong coordination and closer integration of CL risk management may be
recommended in many instances to facilitate a government’s holistic view on risks from CLs and to be
able to develop a comprehensive risk management strategy.
Sovereign risk managers should develop a clear view on sequencing the various steps, as well as scope
and depth of a guarantee and on-lending risk management framework. It may be advisable to start
developing a framework with a narrower scope in the beginning and then scale it up over time. This
approach is being followed by DFRM in Indonesia. DFRM first started developing a risk analysis
approach for credit guarantees to the most important types of beneficiaries in the guarantee portfolio.
Credit guarantees are the most common type of guarantees and are more straightforward in risk analysis
than more complex structures such as investment guarantees. Over time, DFRM plans to expand its risk
analysis to other types of guarantees and beneficiaries in the current portfolio and then develops risk
analysis and quantification approaches to assess risks with respect to guarantees in the pipeline.
Technical level staff responsible for risk analysis and quantification need to consider how to best
communicate and present the insights from their work, so to increase the likelihood of policy makers
taking their recommendations and insights into consideration when making decisions. Ultimately, the


50
  This section only provides a short overview on considerations in implementation which is not the focus of this paper. A deeper understanding
of these factors requires an in-depth discussion with risks managers from countries experienced in developing a risk analysis and measurement
framework and with experienced experts.

                                                                                                                               38 | P a g e
granting of guarantees or on-lending should be a political decision based on a cost-benefit analysis. By
assessing credit risk, risk managers provide an important insight on potential costs but they usually do not
conduct a full cost-benefit analysis. Risk managers should, however, ensure that their cost assessment is
made explicit and to present it so policy makers taking decisions on the granting of guarantees and on-
lending (including aspects such as the setting of guarantee fees and provisioning for financial losses) are
more likely to factor in the cost of guarantees and on-lending when weighing these instruments against
other policy alternatives. When deciding between the instruments of credit guarantees or on-lending, risk
managers need to weigh several factors. These may include a difference in willingness to repay as
discussed above. Additional factors include the different impact on direct government debt: While on-
lending immediately increases government debt, credit guarantees to not at the moment of issuance.
Related, credit guarantees may facilitate hiding risks and transfers to beneficiaries while on-lending
makes those more explicit. On the other hand, on-lending likely reduces the cost of borrowing for the
beneficiary as even with a guarantee it would incur borrowing costs higher than those of the sovereign
(See (Danemarks Nationalbank) for a more detailed discussion of differences between credit guarantees
and on-lending). Secondary legislation requiring a proper risk assessment before guarantees are granted or
on-lending is extended can help institutionalizing a sound decision making process. Furthermore,
reporting (internally and to the public) can support transparency and accountability by highlighting risks
for issuing guarantees and on-lending.
Learning from their own experience and that of other countries, sovereign risk managers should aim to
avoid common pitfalls in implementing a risk analysis and measurement framework. Sometimes risk
managers try to accomplish too much at once. They may aim to develop a full risk analysis approach
covering all sectors, types of guarantees, and beneficiaries before starting to actually conduct risk
analysis. Developing a risk analysis approach or model is an iterative process. By applying a first cut of a
model, risk managers can draw many insights to improve the model in further iterations. Also, risk
managers may start with a model for a specific industry or beneficiary and only develop models for other
industries/beneficiaries once capacity and skills have been built from the application of the first model.
Furthermore, risk managers may have an interest in developing a quantitative model that provides
unambiguous answers (i.e. risk estimates) and leaves little room for judgment that may be more difficult
to be questioned by superiors or policy makers. Doing so risk managers may choose a risk analysis
approach that does not match the country specific context (e.g. resources and capacity, availability of
historic information). A sophisticated-looking quantitative model may also mask a lack of understanding
of the fundamental drivers of credit risk. As every model’s output heavily depends on the assumptions
made in specifying a model and the quality of data input, there is no shortcut for fundamentally
understanding risk drivers to arrive at valuable insights from risk analysis. Also, it is important to
understand how single point risk estimates derived from models should be questioned using common
sense and a full understanding of the respective beneficiary. Risk analysis tools can be very powerful in
structuring the process of analyzing risks and creating valuable insights, however, human skills in
contextualizing results and judging interdependencies between risk drivers and factoring in more
qualitative information are invaluable complements.
Similarly, risk managers may relatively quickly focus on risk analysis before investing enough time and
effort in understanding the specific risk exposure. Guarantee structures (especially with respect to types

                                                                                               39 | P a g e
other than credit guarantees, such as government guarantees in PPP projects) may be very complex and
the exact exposure of governments may be difficult to define. Additionally, the relationship between
beneficiaries and the government may complicate the definition of risk exposure given the
interdependencies between several factors (e.g. in the case of SOEs where the government may act as
owner, regulator, and banker to the SOE).
Lastly, collaboration in risk management among various units in the government may prove difficult.
Often various government units are involved in managing risks from guarantees and on-lending and
information on the respective beneficiaries may be spread across government units. Especially if
beneficiaries are SOEs or sub-national governments, information on these entities (e.g. financial
statements, past performance vis-à-vis the government, risk assessment, and other qualitative information)
may be available within the government (e.g. in the ministry of SOEs) but not the units tasked with
guarantee and on-lending risk management. In other instances, government units managing risks may not
be authorized to seize beneficiaries’ assets and collect receivables in the case of credit events. Strong
collaboration and information sharing among various government units involved can create significant
synergies by reducing the cost of duplicating risk analysis and by decreasing the likelihood of missing
important information on risk drivers in risk analysis. Furthermore, collaboration between units
responsible for managing risks related to various types of CLs can help in forming a holistic view of the
government on CL risk management and may allow for the spill-over of sound risk management practices
across units.


5    Conclusion
Sovereign credit guarantees and on-lending can create significant contingent liabilities and assets on
governments’ balance sheets. Risks related to these contingent liabilities and assets should be managed in
an integrated risk management framework. This allows leveraging private sector resources for important
investments through risk sharing by the government while maintaining prudent risk levels. Analyzing and
measuring credit risk from guarantees and on-lending is a core foundation for such a risk management
framework. Also, making costs related to guarantees and on-lending explicit and transparent helps create
a level playing field to compare alternative policy options for government support.
This paper outlined a structure for analyzing and measuring credit risk in four steps – the definition of key
characteristics to determine the choice of risk analysis approach, the analysis of risk drivers, the
quantification of risks, and the application of insights from risk analysis and quantification in risk
management tools.
Country practices discussed in this paper illustrate how context-specific the design and implementation of
risk analysis and measurement frameworks is. While sovereign risk managers can draw important insights
from risk management practices in peer countries, academic literature, and approaches used in the private
sector, they need to base any framework on a deep understanding of the defining characteristics with
respect to their specific risk exposure, the guarantee and on-lent portfolio, and institutional setup within
the government. For risk analysis, risk managers should not be too optimistic for gaining valuable insights
from quantitative models without a solid understanding of risk drivers specific to the respective industry
of the beneficiary. A sophisticated-looking quantitative model may mask a lack of understanding of the

                                                                                                40 | P a g e
fundamental drivers of credit risk. As a result, developing a sound risk analysis and measurement system
requires significant investments in resources, capacity building, and time. Governments should view this
process as iterative and long-term.
Strong technical understanding of risk analysis and measurement alone is not sufficient to ensure sound
risk management practices. Risk managers need to take into consideration the institutional setup and
political economy questions to tailor risk management frameworks. Policy makers need to be convinced
that risk managers’ recommendations add significant value in helping policy makers take decisions.
This paper has focused on risk analysis and measurement of individual explicit sovereign credit
guarantees and on-lending, and how insights from risk analysis and measurement can inform the design of
risk management and mitigation tools. Some broader issues with respect to risk management and other
types of government guarantees have been touched upon but not fully explored. Further work with respect
to contingent liabilities risk management may discuss these issues in more depth. This may include a
broader discuss on risk management practices and cover CLs related to implicit government guarantees,
government guarantees in PPP projects. Additionally, the valuation of risks from guarantee and on-
lending portfolios may be addressed. Countries in early stages of the risk management process may
require additional guidance in setting a baseline, i.e. identifying risks they are exposed to. This may
require an analysis of outstanding guarantees, on-lending, and potentially other types of CLs managed by
various government units.




                                                                                            41 | P a g e
Appendix	A	‐	Stylized	summary	of	risk	management	practices	in	four	countries	
     Process/                Colombia                                  Sweden                         Turkey                        Indonesia51
     country
     Context and              USD 700 m. exposure                      USD 4 bn. exposure            USD 11.2 bn. exposure       USD 16.7 bn. exposure
     defining                  managed by DGCPTN                         managed by Guarantee           managed by credit risk       managed by CL team at
     characteristics          SOEs and sub-nationals                    and Lending unit at SNDO       team at Treasury             DGFRM
                               potential beneficiaries                  Beneficiaries mostly          Beneficiaries SOEs, banks,  Beneficiaries SOEs and
                              3 staff in credit risk team               SOEs, no sub-nationals         municipalities               infrastructure fund
                                                                        11 staff                      5 staff                     8 staff
     Credit risk              No internal risk                         Credit rating models          Statistical regression       Industry-specific internal
     analysis                  assessment; public credit                 favored, simulation            model for each type of        credit rating methodology
                               rating used                               models, and structural         beneficiary                   developed for electric
                                                                         models;                       Model calibrated using        utilities and water systems
                                                                        Industry-specific score        historic data of             Score cards based on
                                                                         cards using rating             beneficiaries performance     rating agencies’
                                                                         agencies’ methodologies        vis-à-vis Treasury            methodologies
     Credit risk              Expected and unexpected                  Expected losses and           Expected losses as result    Expected losses and
     quantification            losses                                    market values                  of regression model           market values
                              PDs based on transition                  PDs based on rating           PDs estimated using          PDs based on rating
                               matrices and solvency                     agency databases               financial ratios of           agency databases
                               curve                                    LGDs based on rating           beneficiaries                LGDs based on. standards
                              LGDs at 75 percent,                       agency databases              LGDs based on historic        and historic performance
                               adjusted for collateral                  Market values based on         performance vis-à-vis        Market values based on
                                                                         spreads in borrowing costs     Treasury                      spreads in borrowing costs
     Application in  Guarantee approval,            Guarantee fees, partial        Decision to grant                Potential tools include
     risk              collateral, guarantee fees,     guarantee coverage,              guarantees, guarantee fee,      guarantee approval,
     management        actual contingency reserve      notional reserve account,        partial guarantee coverage,     guarantee fees, reserve
                       account, monitoring and         monitoring and reporting         limit setting, actual reserve   account, limit setting,
                       reporting                     Fees based on expected            account, monitoring             monitoring and reporting
                     Fees equal expected losses       costs or market values
Source: Sub-directorate of Risk at the Directorate General Public Credit and National Treasury of Colombia, Swedish National Debt Office, Turkish
Undersecretariat of the Treasury, Directorate General of Financing and Risk Management in the Indonesian Ministry of Finance, author



51
     Credit risk management practices are currently being developed.
                                                                                                                                                          42 | P a g e
Bibliography
Altman, E. (1968). Financial Ratios, Discriminant Analysis and the Prediction of Corporate Bankruptcy.
        The Journal of Financ, 589 - 609.
Altman, E., Rijken, H., Balan, D., Watt , M., Forero, J., & Mina, J. (2010). The Z-Metrics Methodology
        For Estimating Company Credit Ratings And Default Risk Probabilities. RiskMetrics Group.
Anderson, P., & Abousleiman, I. (2011). Risk Management Framework and Financial Solutions.
        Presentation.
Bachmair, F. (2014). Risk Measurement Process. Presentation at Sovereign Debt Management Forum.
        Washington.
Basel Committee on Banking Supervision. (2005). An Explanatory Note on the Basel II IRB Risk Weight
        Functions. Bank for International Settlements.
Basel Committee on Banking Supversion. (2004). International Convergence of Capital Measurement
        and Capital Standards. Bank for International Settlements.
Benzschawel, T. (2012). Credit Risk Modelling - Facts, Theory and Applications. London: Risk Books.
Black, F., & Scholes, M. (1973). The Pricing of Options and Corporate Liabilities. Journal of Political
        Economy, 637-654.
Capuano, C., Chan-Lau , J., Gasha , G., Medeiros, C., Santos, A., & Souto, M. (2009). Recent Advances
        in Credit Risk Modeling. International Monetary Fund Working Paper.
Cebotari, A. (2008). Contingent Liabilities: Issues and Practice. International Monetary Fund Working
        Paper.
Crosbie, P., & Bohn, J. (2003). Modeling Default Risk. Moody's KMV.
Ekstrom, K. (2013). Quantitative tools - pricing of guarantees and loans. Swedish National Debt Office.
Gupton, G., & Stein, R. (2002). LossCalc: Model for Predicting Loss Given Default (LGD). Moody's
        KMV.
Irwin, T., Klein , M., Perry, G., & Tobani, M. (1997). Dealing with Public Risk in Private Infrastructure.
        Washington, DC: The World Bank.
Marrison, C. (2001). Risk Management for Contingent Liabilities. Presentation.
Ministry of Finance and Public Credit. Republic of Colombia. (2012). Contingent Liabilities -
        Methodologies in Colombia. Bogota.
Moody's Investor Service. (2010). Government-Related Issuers: Methodology Update. Rating
        Methodology.
Moody's Investor Service. (2013). Rating Methodology: Regulated Electric and Gas Utilities.
Moody's Investor Service. (2014). Annual Default Study: Corporate Default and Recovery Rates, 1920 -
        2013.
Polackova Brixi, H., & Mody, A. (2002). Dealing with Government Fiscal Risk: An Overview. In H.
        Polackova Brixi, & E. Schick , Government at Risk. Washington: Oxford University Press.
Sundaresan, S. (2013). A Review of Merton's Model of the Firm's Capital Structure with its Wide
        Applications. Annual Review of Financial Economics, 5:5.1 - 5.21.




                                                                                              43 | P a g e