Fig 1.
Graphical illustration of the prepaid parameter estimation method.
Fig 2.
The RMSE versus the time needed for the estimation of the three parameters of the Ricker model (see Eq 1).
The RMSE and time are based on 100 test data sets with Tobs = 1000. The three colors represent the three parameters (blue for r, red for σ and yellow for ϕ). Solid lines represent the SLOrig approach, dashed lines the approach (using only nearest neighbors), and dotted lines the
approach (using interpolation). The stars and the dots represent the time needed for the
and the
estimation, respectively. The estimates for SLOrig are posterior means, based on the second half of the finished MCMC iterations. The time of the prepaid method shown in this picture does not include the creation of the prepaid grid, but only the time needed for any researcher to estimate the parameters once a prepaid grid is available.
Table 1.
The RMSE of the estimates of the test set of the trait model.
Tobs refers to the number of observations (i.e., vector with species frequencies) and Ω is the number of prepaid points.
Fig 3.
The mean absolute error of the estimates of four central parameters of the LCA (common input v, leakage γ, mutual inhibition κ, evidence threshold a) as a function of sample size (abscissa) and for three different methods: (1) choosing the nearest neighbor grid point in the space of summary statistics (, triangles); (2) using the average of a set of nearest neighbor grid points based on bootstrap samples (
, open circles) and (3) using SVM interpolation between the 100 nearest neighbors (
, crosses).
Fig 4.
Parameter recovery for the LCA model with 1200 observations (300 in each of the four difficulty conditions); the true value on the abscissa and estimated value on the ordinate.
The same parameters as in Fig 3 are shown. The method used to produce these estimates is the averaged bootstrap approach (, see Methods for details).
Fig 5.
RMSE (based on a simulation study) of the toy example estimation as function of the gap size (Δ) and number of nearest neighbors selected to carry out the interpolation (N).
The left panel is called situation 1 in which and the right panel is situation 2 (
). For the second situation, the trade-off between Δ and N is clearly visible.
Fig 6.
Estimated versus true parameters of the Ricker model of 100 data sets with Tobs = 1000.
The SLOrig estimation has some problems with outliers.
Fig 7.
The accuracy of all estimation methods versus the number of time points Tobs.
The left panel shows the mean squared error, while the right panel shows the median absolute error. The three colors represent the three parameters. Blue lines refer to the parameter r, red lines to the parameter σ and yellow lines to the parameter ϕ. The solid line represents the original synthetic likelihood approach SLOrig (stopping at Tobs = 103), the dashed line the prepaid approach and the dotted line the
prepaid approach.
Fig 8.
The estimation of the three parameters of the Ricker model of 100 data sets with Tobs = 105.
The estimation clearly outperforms the
estimation.
Table 2.
RMSE for the estimation of the parameters of the Ricker model for T = 105 using the ,
and
prepaid methods.
Table 3.
Average time in seconds needed for the SLOrig estimation for multiple Tobs and the speed up for the and
methods.
The time for Tobs = 104 and Tobs = 105 was not measured, so these values are estimated and between brackets. (Fig 7 shows the corresponding accuracies).
Table 4.
The effective coverages of the test set for different Tobs.
Table 5.
RMSE of estimation of test sets with Tobs = 100 created with priors P1, P2 and P3 and estimated by using priors P1, P2 and P3.
For each test set and parameter the best result is shown in bold.
Table 6.
RMSE for Ricker model data where Tobs = 100 for an experimental set up with two conditions where r and σ are equal over the conditions.
Parameters are estimated by using with a flat prior (same as
)and with a prior from Eq 11.
Table 7.
Population dynamics of the Chilo partellus [16, 15].
We show the estimates, the 95% confidence intervals and computation time of the prepaid and synthetic likelihood estimation techniques.
Fig 9.
Samples for Tobs = 1 of the summary statistics of the trait model for parameter set log(I) = 3.0621, log(A) = 0.8302, h = 86.8924 and log(σ) = −0.6899.
Fig 10.
Scatter plot matrix of the clustering that occurs for the 100 nearest neighbors for the summary statistics for Tobs = 1000 of parameter log(I) = 3.9081, log(A) = −2.0343, h = 36.4150 and log(σ) = 2.9762.
The red cross shows the true value of this parameter.
Table 8.
The MAE of the estimations of the test set of the trait model.
Table 9.
The effective 95% coverage of the estimations of the test set of the trait model.
Fig 11.
Illustration of how different coherences are incorporated.
The gray plane is a simplified representation of the three dimensional (v′, γ′, κ′)-space. For each point g, 50 coherences are chosen. Corresponding to each coherence, there is a pair of RT distributions (which each integrate to the probability of selecting the corresponding option).
Fig 12.
Illustration of the transformation of the original parameter space (called A) to a new one (called B) in which D is one of the parameters.
The projections of the three parameter points on the red axis governing the width of the B area are denoted with open circle and these are the parameter points g. For each of these open circle points, the RT distribution scales are set to 1 (i.e., s = 1) by choosing an appropriate diffusion coefficient (denoted as ) and any parameter point in B can be reached by selecting an appropriate g and then adjusting the scale up- or downwards (this is indicated by the dotted lines in the length direction of the new parameter space B.
Fig 13.
Recovery for the original parameters of the LCA model with Tobs = 1000 observation per stimulus.
See Fig 4 for detailed information.
Fig 14.
Recovery for the original parameters of the LCA model with Tobs = 10000 observation per stimulus.
See Fig 4 for detailed information.
Fig 15.
The MAE of the estimates of the parameters of the LCA as a function of sample size (abscissa) and for different methods.
More details can be found in the caption of Fig 3.
Fig 16.
The RMSE of the estimates of the parameters of the LCA as a function of sample size (abscissa) and for different methods.
More details can be found in the caption of Fig 3.
Fig 17.
The coverage of LCA estimates for different number of observations Tobs.
Each line represents one of the nine LCA parameters and plots the fraction of estimates between the [α, 1 − α] quantiles of their bootstrapped confidence intervals. The closer the line to the second diagonal, the better the coverage. Black lines are the result of non-parametric bootstraps obtained through nearest neighbor estimates; red lines are the result of SVM enhanced estimates.