Figure 1.
Example of estimating confidence intervals.
In this example, we estimated the confidence intervals of instances. The left-hand plot shows the confidence interval widths and the corresponding absolute errors. The corresponding CEC equals
. Although the CEC is not very large, it is possible to see an increased number of small confidence intervals for predictions with a low error. In the right-hand plot, the estimated confidence interval borders are displayed. In addition, every prediction defined by its prediction error and its normalized confidence score is depicted by a red circle. On average, the absolute error is smaller for predictions with a high
and a small confidence interval.
Table 1.
Performance of confidence estimators on artificial data with different properties.
Table 2.
Performance of confidence estimators on biological datasets.