WATCH REPLAY: How expert are your experts?

Whenever subject matter experts make quantitative assessments in a business process, we check those assessments after the fact and report back on precision and bias so that our SMEs can improve their future assessments. This is rather more difficult where the assessments are probabilities because the verification is necessarily statistical. Traditional methods can reveal optimism and pessimism in predictions, but they are not so effective at revealing cases where the impact of positive or negative evidence is over- or under-incorporated into an assessment and probabilities are either polarized – i.e. too extreme – or sitting on the fence – i.e .not extreme enough. They also demand substantial numbers of assessments.

I present an alternative approach to exposing systematic bias, which is based on a deeper look at how systematic bias effects probabilities. The tool produces a “bias footprint” which in a single figure shows not only the optimism or pessimism in a sequence of assessments, but also the tendency to polarize or fence-sit, together with a clear sense of the extent to which the data support those conclusions, which is dependent on both the number of assessments and the consistency of the bias.

I will demonstrate the method on Hubbard Decision Research’s FrankenSME aggregation methodology, showing how the aggregation method substantially improves predictions by removing systematic biases.

https://2021.riskawarenessweek.com/talks/how-expert-are-your-experts/

Alex has created a short bootcamp designed to help companies implement quantitative risk management. Imagine saving the company so much money that investing in risk management competencies and resources becomes a no brainer for the executives. That's exactly what Alex Sidorenko did at a global $10B chemical company and he has been kind enough to share his top tips and lessons learned with you each week. Sign up now!

RISK-ACADEMY offers online courses

sample85
+ Buy now

Informed Risk Taking

Learn 15 practical steps on integrating risk management into decision making, business processes, organizational culture and other activities!

$149,99$49,99
sample85
+ Buy now

ISO31000 Integrating Risk Management

Alex Sidorenko, known for his risk management blog http://www.riskacademy.blog, has created a 25-step program to integrate risk management into decision making, core business processes and the overall culture of the organization.

$199,99$49,99
sample85
+ Buy now

Advanced Risk Governance

This course gives guidance, motivation, critical information, and practical case studies to move beyond traditional risk governance, helping ensure risk management is not a stand-alone process but a change driver for business.

$795

Leave a Reply

This site uses Akismet to reduce spam. Learn how your comment data is processed.