Forget about risk management. Measure the likelihood of success instead. #ChangingRisk

My friend, Norman Marks, has been talking about rebranding risk management for years. Norman calls for risk professionals to focus on enabling success rather than avoiding failure. I think this is brillian advice. A way to communicate risk management insights to executives and the Board is to talk about the likelihood of success

Well, the good news is that likelihood of success is actually easily quantifiable. Myself and many of the risk managers I know have been doing exactly that for the last 7 years. 

Here is a step by step guide: 

Step 1. Determine what is considered success

This should be quite easy to do, because most modern day organizations have some form of strategic objectives that are designed to measure whether the strategy is being achieved or not. So, in the context of this article, the likelihood of success is the same as the likelihood of achieving an objective. Different objectives will have different likelihoods of being achieved. Usually there is more than one objective. 

For arguments sake, let’s use “profitability above 10%” as our measure of success. The company will consider it a good year if it managed to achieve profitability 10% or higher. I could’ve choosen any objective whatsoever, this one was the easiest because I already have the diagrams saved and won’t need to run the calculations again. Again, any objective can be the measure of success. 

Step 2. Use influence diagram to determine key stakeholders, assumptions and risks

Once we determined the objective, we need to break it down into smaller components, because our brain is not very good at thinking about abstract problems with multiple factors at play. An influence diagram or a causal map seem like a good tool to use.

These simple visual tools help us identify key stakeholders and determine what are some of the assumptions / inputs that influence the achievement of the objective (a key assumption is any hypothesis that management have accepted to be true).

At this stage I would usually use a CIA tool called key assumptions check, it comes handy to validate the assumptions. Here are some questions to ask:

  • How much confidence exists that this assumption is correct?
  • What explains the degree of confidence in the assumption?
  • What circumstances or information might undermine this assumption?
  • Could the assumption have been true in the past but less so now?
  • If the assumption proves to be wrong, would it significantly affect the objetcive?

If the objective value (in our case is profitability) is calculated using MS Excel we would normally try and trace from the output cell (objective) to all the inputs cells (assumptions). This will become the foundation for the later analysis.

Some of the assumptions that would go into our hypothetical “profitability above 10%” example include: 

  • forecasted cost of raw materials
  • forecasted FX rates and inflation 
  • forecasted sales prices
  • forecasted sales volume
  • forecasted amount of investment needed for new equipment
  • forecasted loan interest rates  
  • forecasted admin expenses and so on…

Another part of assumption validation is to make sure that all significant risks have been considered when calculating the objective. Chances are they haven’t. So we need to double check by identifying potential risks and adding them to the business plan. For example, all calculations could be done in local currency. This implies that there is no FX exposure, which may not be true, so sometimes, the risk manager needs to add FX rate to the formula to make sure FX risk is accounted for. 

Step 3. Add volatility and run the simulation

By the end of this step risk managers should have a list of management assumptions. For every management assumption identified, risk managers should work with the process owners, internal auditors and utilise internal and external information sources to determine the ranges of possible values and their likely distribution shape. Replacing single point assumptions with distributions is the key risk management task. Sam Savage in his book Flaw of Averages did a great job at summarising the math on why using single point estimates, the so called “most likely” or “average” figures is pretty much guarantees to lead to bad decisions.

For example, management believes next year it will sell 15 engines, but this is uncertain, they could sell less or could sell more. Sales volume is actually a distribution and because management can’t sell 12.34 engines, it’s actually a discrete distribution. 

Once all key assumptions have been changed to distributions, we can run a simulation. Running simulations is now almost effortless, because the software is free (ModelRisk, SIPMath) and computers are powerful enough.

This is what we get after a simulation with 10000 trials:

ms simulation

So what does the likelihood of success looks like?

Unless the management makes changes to its assumptions and business plan, the likelihood of achieveing the objective “profitability above 10%” is 3.7%, that means 96.3% of the time the objective will not be achieved. Not a very good business plan if your salary and bonus depend on it. 

So what’s next? Any ideas? Write in the comments.

– – – – – – – – – – – – – – – – – – – – –

RISK-ACADEMY offers decision making and risk management training and consulting services. Our corporate risk management training programs are specifically designed to promote risk-based decision making and integrating risk management into business processes. Risk managers all over the world call us in to help sell idea of integrating risk analysis into decision making and using quantitative risk analysis techniques. Check out most popular course for decision makers https://riskacademy.blog/product/risk-based-decision-making-executives/ or our dedicated programs to help risk managers learn the foundations of quant risk analysis https://riskacademy.blog/product/risk-managers-training/. We can also help audit risk management effectiveness or develop a roadmap for risk management integration into decision making https://riskacademy.blog/product/g31000-risk-management-maturity-assessment/ 

Check out other risk management books

RISK-ACADEMY offers online courses

sample85
+

Informed Risk Taking

Learn 15 practical steps on integrating risk management into decision making, business processes, organizational culture and other activities!

$149,99$49,99
sample85
+

ISO31000 Integrating Risk Management

Alex Sidorenko, known for his risk management blog http://www.riskacademy.blog, has created a 25-step program to integrate risk management into decision making, core business processes and the overall culture of the organization.

$199,99$49,99
sample85
+

Advanced Risk Governance

This course gives guidance, motivation, critical information, and practical case studies to move beyond traditional risk governance, helping ensure risk management is not a stand-alone process but a change driver for business.

$795

9 thoughts on “Forget about risk management. Measure the likelihood of success instead. #ChangingRisk

  1. Hi Alex. This is very similar in concept to progressive science in the field of safety management, most prominently by Erik Hollnagel (Safety-II) and Sidney Dekker (Safety Differently). If you haven’t read up on these I recommend it. They essentially say that safety should not be seen as the absence of failure, but rather the presence of capacities to be successful in varying conditions (complex systems). Whilst the detail doesn’t fully link to your blog here, I think the principle of learning from what goes right, and reporting safety/risk as a positive is the same to me.

  2. There is a lot that is not being mentioned in this article. My understanding of this article is similar to what I’ve learned with Primavera Quantitative Risk Analysis tool. In simple is garbage in, garbage out. When you validate your assumptions, it’s the accuracy of the collected information and data that counts and experience. Single point values in most cases reflects the level of confidence in the accuracy/ reliability of information or values. It is simple now days due to the fact that most organisation are more focused on preserving data and information. Data analytics being the in thing. The most likely values becomes reasonable enough to assist in simulations. Your first outcome in the scenario given is uncertainty analysis. We need to know more about what is our confidence level if we consider the events that could hinder us from achieving the targeted 10% and against run a simulation to see how well can we mitigate those risk considered. The outcome based on confidence level will tell if more capital/time need to be injected or reject the decision. This will mean our mitigations considered were not appropriate, sufficient and reliable to reduce our risks to an acceptable level. Again, in the example given, it discount the efforts made by management when setting a 10% increase in revenue is target that they have considered the environmental forces that can influence operations, hence may be you you say the risk managers has to test the assumptions.
    Best practice the risk manager should be part of the planning session with managemt when those target are set to afford him first line information and to challenge it immediately. In simple, I am saying objective are set and measured and seen as the opportunity during planning

    1. I did not understand your comment or rather numerous points you were trying to make. What is your point exactly?

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.