Last year Hubbard Decision Research (HDR) presented the potential value of new methods for aggregating expert estimates.
Now the HDR tool has been completed.
Decades of experiments by researchers have shown that subjective assessment of probabilities is both a teachable skill and that combining the estimates of multiple subject matter experts (SMEs) can further improve the accuracy of estimates. In the last 22 years, over 2000 individuals have gone through calibrated probability assessment training by Hubbard Decision Research and HDR has used data from hundreds of individuals and tens of thousands of estimates to create an improved method for aggregating multiple experts. Data analytics and Bayesian methods are used to determine how to combine multiple experts in a way that not only produces well-calibrated estimates (i.e., 90% of actuals fall within the estimated 90% confidence intervals) but also produces estimates with a higher information value (e.g., narrower ranges) than the best individual SME on average.
The HDR methods also outperform simple averages and linear weighting methods developed by earlier researchers. Powerful expert aggregation methods should be the cornerstone of all expert estimation methods in risk analysis.
Doug Hubbard founded the uniquely powerful and proven Applied Information Economics (AIE) method. He is an entrepreneur, an accomplished consultant and an author of five books. Applying his proprietary AIE method, Mr. Hubbard has transformed Risk Management into a competitive advantage for his clients across the globe.
Check out other decision making books
RISK-ACADEMY offers online courses
Informed Risk Taking
Learn 15 practical steps on integrating risk management into decision making, business processes, organizational culture and other activities!
ISO31000 Integrating Risk Management
Alex Sidorenko, known for his risk management blog http://www.riskacademy.blog, has created a 25-step program to integrate risk management into decision making, core business processes and the overall culture of the organization.
Advanced Risk Governance
This course gives guidance, motivation, critical information, and practical case studies to move beyond traditional risk governance, helping ensure risk management is not a stand-alone process but a change driver for business.
