Site icon RISK-ACADEMY Blog

ISO and COSO haven’t got a clue. You can and should quantify compliance risks

Every organisation is required to comply with laws within the countries it operates in, the legal and regulatory requirements vary between different regions adding to the need to have understanding and confidence in the risk management processes in place. Organisations face considerable uncertainty when making decisions and taking actions that may have significant compliance consequences. The management of compliance risks helps organisations protect and increase its value.

This series of publications will provide guidance on the activities to be undertaken to support decision makers to assess and treat compliance risks efficiently and cost effectively to meet the expectations of a wide range of stakeholders. Failure to meet legal requirements and stakeholder expectations can have considerable and immediate negative consequences that could affect performance, reputation and might lead to criminal prosecution of top management.

Compliance risk within this series of publications is broadly defined and is not limited to, for example, risk related to compliance or contractual matters, including risks from or to third parties where there may be no contractual relationship but where there may be a possibility of litigation or other action depending on that third parties’ contractual requirements with their stakeholders.

This methodology is developed in line with the requirements of ISO 31022:2020 Risk management — Guidelines for the management of legal risk and Compliance Risk Management: Applying the COSO ERM Framework. Just kidding, it’s light years ahead of the nonsense written in the Compliance Risk Management: Applying the COSO ERM Framework. See my page by page review to understand why you should never apply COSO to compliance risks. 

For the purposes of this article, compliance risk management includes:

Risk identification

The purpose of identifying compliance risks is to find, recognize and describe the risks that can help or prevent an organization to achieve or from achieving its objectives.

To have a comprehensive understanding of compliance risks, organisations may do the following:

Identified compliance risks have to be mapped against the legal entities to make sure no significant risks are missed:

Licensed activities and subsoil use Environmental management (ecology) Sanctions compliance Anti-monopoly compliance Tax compliance Fire supervision, emergency protection Labor and industrial safety Covenant compliance Economic and information security, state secret Land and property relations Construction and reconstruction of hazardous facilities Physical security of production facilities and vehicles
Group of companies
Legal entity 1 X X X X
Legal entity 2 X X X X X X X X
Legal entity 3 X X X X X

Compliance risks can be documented in a manual or online risk register for further analysis.

Risk Analysis

Wherever possible companies should apply quantitative risk analysis to measure and prioritize compliance risks. Wait what? We can do better than a compliance heatmap? Apparently :))

The following information should be collected and recorded for each identified risk:

Step 1. Represent each risk as a bow-tie diagram

Each risk can be graphically represented as a bow-tie diagram. A bow tie is a graphical depiction of pathways from the causes of an event or risk to its consequences in a simple cause-consequence diagram. It is a simplified combination of a fault tree that analyses the cause of an event or risk, the left hand side of the diagram, and an event tree that analyses the consequences, the right hand side. I borrowed some diagrams and generic words from a wonderful article by Broadleaf https://broadleaf.com.au/resource-material/bow-tie-analysis/

The focus of bow tie analysis is on the barriers or controls depicted to the left-hand side of the knot that can change the likelihood of the event or circumstance, or on those on the right-hand side that can change its consequences. It is used when assessing the completeness of controls, to check that each pathway from cause to event and event to consequence has effective controls, and that factors that could cause controls to fail (including management systems failures) are recognized:

Any compliance risk can be depicted as a bow-tie diagram by following these steps:

  1. Select the risk to be examined in the bow tie analysis.
  2. Describe the risk, in the form [something happens] and leads to [a consequence for our objectives], and note the main risk analysis outcomes from the risk register.
  3. List the causes of the risk on the left and the consequences of the risk on the right, using the information from the regulations as well as through consultation with risk owners and subject matter experts.
  4. List the existing controls on the causes (preventive controls) below the causes on the left, and the controls on the consequences (corrective controls) below the consequences on the right. If a control acts on both causes and consequences, then show it twice, on each side of the template.
  5. Identify options for enhancing existing controls, to improve their effectiveness or to fill gaps. This may include enhanced monitoring and more frequent review, for example using control self-assessment.

Step 2. Identify causes and consequence scenarios

Causes and consequences for the bow-tie diagram are normally derived from the regulations as well as through consultation with risk owners and subject matter experts.

Common consequence scenarios for compliance risks (just a quick example, there is more) include:

Risk area Examples of consequence scenarios
Licensed activities and subsoil use
  • The need to re-obtain a license
  • Redemption of rights from other owners of the object
  • Fines for operating without the license
Environmental management (ecology)
  • Administrative fines
  • 3rd party claims
  • Production halt or stop
  • Criminal prosecution or management disqualification
Sanctions compliance
  • Fines as a proportion of revenue
  • Restrictions on existing or potential markets
  • Restrictions on capital markets and ability to refinance existing loans
  • Restrictions on the use of foreign technology or equipment
  • Losing control over overseas assets
Anti-monopoly compliance
  • Fines up to 2% of revenue
Tax compliance
  • Administrative fines
  • Additional taxes to be paid
Fire supervision, emergency protection
  • Administrative fines
  • 3rd party claims
  • Production halt or stop
  • Criminal prosecution or management disqualification
Labor and industrial safety
  • Administrative fines
  • 3rd party claims
  • Production halt or stop
  • Criminal prosecution or management disqualification
Covenant compliance
  • Repayment of existing loans
  • Increase in financing costs
  • Difficulty in refinancing
Economic and information security, state secret
  • Administrative fines
  • Criminal prosecution or management disqualification
Land and property relations
  • Administrative fines
  • 3rd party claims
  • Production halt or stop
  • Criminal prosecution or management disqualification
Construction and reconstruction of hazardous facilities
  • Administrative fines
  • 3rd party claims
  • Production halt or stop
  • Criminal prosecution or management disqualification
Physical security of production facilities and vehicles
  • Administrative fines
  • Criminal prosecution or management disqualification

An example for a bow-tie for a typical compliance risk is presented below:

Where, V – means several events can occur at the same time, and XOR means the variability of either one event or the other. For example, fines can be either for three days of water pollution (small), or for a year (moderate) or three years (large), and criminal prosecution and termination of business can occur simultaneously.

Step 3. Determine the range of consequences for each scenario

In order to quantitatively assess compliance risks the next step involves defining the possible range of values for each consequence scenario. Typical consequences can involve the following factors:

Consequence scenario Range of consequences
A.     Small fine for violation, for example a fine for three days of water pollution
  • Analysis of legislation in terms of violation of the quality of the spillway
  • Analysis of the structure of the drainage system of the entity
  • Analysis of the volatility of the discharge indicators for supervisory and internal inspections of water quality.
  • Statistics of court decisions (sanctions) in similar cases

 

B.     Moderate fine calculated cumulatively for the year using extrapolation of supervisory audit results
C.    Large fine calculated cumulatively for the three years using extrapolation of supervisory audit results
D.    Suspension of business
  • Statistics of business suspensions adjusted for our company
  • Calculate the cost of a plant’s downtime per day multiplied by the range of days
E.     Criminal prosecution of company management
  • Expert legal assessment of the cost of legal defense and possible reputational losses due to criminal prosecution or disqualification of management.

Depending on the availability and reliability of the data various severity distributions can be used (only examples, relax, could be others):

For each consequence scenario a distribution is selected and the range of possible values are determined, for example minimum, expected loss and maximum loss.

Step 4. Allocate weights to each scenario

In order to determine the weight allocated to each consequence scenario of events triggered by compliance risk, historical data, modelling, as well as expert opinions, can all be used, individually or in combination.

Weight of each scenario can involve the following factors:

Wherever possible historical data on each of the consequence scenarios is collected. When no historical data is available or no claims have been made against the company in the past, we use Bayesian statistics to estimate the weights for the scenario. Depending on the availability and reliability of the data various distributions can be used to estimate the weight of each of the consequence scenarios:

Current controls, their effectiveness and other factors affecting the probability of claims against the company have to be accounted for when allocating weights to each of the scenarios.

Step 5. Measure the effect of risks on decisions

In order to account for the uncertainty both in the consequences of each scenario and its weight, consequence distributions are multiplied by weight distributions using the Monte-Carlo simulation method. Normally 10000 simulation runs should be sufficient for most compliance risks, however more simulation runs may be required for highly unlikely and catastrophic events.

The output of risk analysis can be represented as a distribution or box plot as shown below:

The distribution of the possible outcomes shows:

An integral part of the risk analysis is a tornado diagram showing which of the consequence scenarios is having the most effect on the overall risk exposure level. An example is shown below:

In the situation where the risk exposure is deemed significant, risk mitigation measures need to be discussed and agreed upon.

Often it may be insufficient to just estimate the compliance risk exposure, instead it may be required to measure how compliance risks would affect an investment decision, a performance target or business plan or budget. In such cases it may be necessary to estimate how compliance risks change the project NPV / other decision making metric or how compliance risks change the probability of successfully finishing the project on time and budget.

Risk mitigation and trade-off

The treatment of compliance risks refers to the corresponding strategies implemented by an organization to deal with its risks. A risk treatment plan should consider a range of treatment options, which may include legal remedies as well as financial, operational and reputational remedies for each prioritized risk.

The following factors should be considered when choosing an appropriate option for the treatment of compliance risks:

Different mitigation and treatment strategies can be tested to determine which option provides the best value in risk reduction for the cost involved. Different mitigation strategies can be graphically represented as on the diagram below:

Reporting and monitoring

The monitoring and review of the management of compliance risks includes the following:

An organization should consider the following issues in relation to record-keeping and reporting:

An organization should report on the progress of changes in implementing the management of compliance risks and adherence to the measures.

Exit mobile version