Noise

From Forecasting Wiki
The author would be happy about help on this article.

Noise has at least two related but different meanings in the context of forecasting. The first type of noise is related to the issue of signal detection. The second type of noise is variability in judgment and is related to the idea of Cognitive Biases. The two types of noise are closely related.

Noise in signal detection[edit]

Making accurate forecasts requires that one is able to find valid evidence indicating what will be the true state of the world at the close of the question. Valid evidence is called signal, while everything that is not valid, and which could get in the way of identifying valid evidence, is called noise. Thus the goal of accurate forecasting is to find the signal in the noise, and then to make reasonable inferences based on the signal.

Noise in judgment[edit]

Noise, in this second sense, is all variability in judgment that is not directional (i.e., not a bias). In forecasting, noise can arise due to differences in information, or differences in reasoning between or within forecasters. Noise is different than bias in one important way, which is that you do not need to know what the correct answer is in order to detect noise.

Noise is preferable to bias in collective forecasting as noise tends to cancel out, and may even at times decrease bias due to the Bias-Variance Tradeoff. However, reducing noise is the principal way through which Superforecasters perform better than other forecasters.

Noise can be caused by Cognitive Biases. Cognitive biases are deviations away from how one should reason, and this can sometimes lead to errors in judgment. This can lead to noise if one person exhibits a cognitive bias, and another does not, or if two people exhibit different cognitive biases. This could also happen within a single individual. For example, someone using the Affect Heuristic may give two different answers at different points in time due to variability in mood.

References[edit]