Dose-response analysis can be carried out using multi-purpose commercial statistical software, but except for a few special cases the analysis easily becomes cumbersome as relevant, non-standard output requires manual programming. The extension package drc for the statistical environment R provides a flexible and versatile infrastructure for dose-response analyses in general. The present version of the package, reflecting extensions and modifications over the last decade, provides a user-friendly interface to specify the model assumptions about the dose-response relationship and comes with a number of extractors for summarizing fitted models and carrying out inference on derived parameters. The aim of the present paper is to provide an overview of state-of-the-art dose-response analysis, both in terms of general concepts that have evolved and matured over the years and by means of concrete examples.
Citation: Ritz C, Baty F, Streibig JC, Gerhard D (2015) Dose-Response Analysis Using R. PLoS ONE 10(12): e0146021. https://doi.org/10.1371/journal.pone.0146021
Editor: Yinglin Xia, University of Rochester, UNITED STATES
Received: October 30, 2015; Accepted: December 11, 2015; Published: December 30, 2015
Copyright: © 2015 Ritz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Dose-response analysis can be carried out using multi-purpose commercial statistical software. However, except for a few special cases the analysis easily becomes cumbersome as relevant, but non-standard output requires manual programming. Availability of specialized commercial statistical software for dose-response analysis is limited. We are aware of the commercial software GraphPad (http://www.graphpad.com) as well as a few standalone programmes (e.g., http://www.unistat.com and http://www.bioassay.de).
Over the last 20 years the open-source environment R  has developed into an extremely powerful statistical computing environment. The programming infrastructure has fuelled the development of highly sophisticated sub systems for more or less specialized statistical analyses within a number of scientific areas (e.g., the Bionconductor suite of packages: http://www.bioconductor.org). One such specialized sub system for analysis of dose-response data is provided through the add-on package drc . There also exist a number of other R packages related to dose-response analysis: DoseFinding , drfit , grofit , MCPMod , and nlstools .
Originally, drc was developed to provide nonlinear model fitting for specialized analyses that were routinely carried out in weed science . Subsequently the package has been modified and extended substantially, mostly in response to inquiries and questions from the user community. Meanwhile it has become a flexible and versatile package for dose-response analyses in general. Thus the present version of the package drc provides a user-friendly interface for specification of model assumptions about the dose-response relationship (including a flexible suite of built-in model functions) as well as for summarizing fitted models and making inference on derived parameters. The aim of the present paper is to provide an up-to-date account of state of the art for dose-response analysis as reflected in the functionality of drc.
Dose-response models are regression models where the independent variable is usually referred to as the dose or concentration whilst the dependent variable is usually referred to as response or effect.
Types of responses
We define a dose (metameter) as any pre-specified amount of biological, chemical, or radiation stress eliciting a certain, well-defined response. Other kinds of exposure or stress could also be imagined, e.g., time elapsed in germination experiments. The dose is a non-negative quantity and it is often but not always assumed to be measured without error as is often the case in designed experiments .
Specifically, we define the response to a given dose as the quantification of a biologically relevant effect and as such it is subject to random variation. The most common type is a continuous response such as biomass, enzyme activity, or optical density. A binary or aggregated binary (binomial) response is also frequently used to describe results such as dead/alive, immobile/mobile, or present/absent . The response may also be discrete as in number of events observed in a specific time interval such as number of juveniles, offspring, or roots ; this setting also encompassses Wadley’s problem considered in Example 6 in S1 File . Dose-response curves may also be used to summarize experiments where the response is the event time, that is the time elapsed before some specific event is being observed [12, 13].
Modelling the mean
The full specification of a statistical dose-response (regression) model involves specifying how the mean is described by a parametric function of dose as well as specifying assumptions about the distribution of the response.
We will focus on ways to model the mean trends through mostly s-shaped or related biphasic functions because these functions have in common that they reflect a basic understanding about the causal relationship between the dose and the response, e.g., when a dose increases the response monotonically decreases or increases one way or another towards minimum or maximum response limits, respectively. Consequently, these functions have turned out to be extremely versatile for describing various biological mechanisms involving model parameters that allow the interpretation of observed effects within a biologically plausible framework.
So we define dose-response models to be a collection of statistical models having a certain mean structure in common; this is not a strict mathematical definition, but rather a definition driven by applications. Consequently, dose-response models encompass a range of statistical models from nonlinear regression, generalized (non)linear regression, and parametric survival analysis.
Let y denote an observed response value, possibly aggregated in some way, corresponding to a dose value x ≥ 0. The values of y are often positive but may take arbitrary positive or negative values. Furthermore, we will assume that observation of y is subject to sampling variation, necessiating the specification of a statistical model describing the random variation. Specifically, we will focus on characterizing the mean of y (denoted E(y) below) in terms of a model function f that depends on the dose x: (1) So, for a given dose x, the corresponding observed response values will be distributed around f(x, β). The function f is completely known as it reflects the assumed relationship between x and y, except for the values of the model parameters β = (β1, …, βp), which will be estimated from the data to obtain the best fitting function. The remaining distributional assumptions on y will depend on the type of response. For instance, for a continuous response the normal distribution is commonly assumed whereas for a binary or quantal response the binomial distribution is commonly assumed.
Built-in dose-response models.
A large number of more or less well-known model functions are built-in in drc (see Table 1). These models are parameterized using a unified structure with a coefficient b denoting the steepness of the dose-response curve, c, d the lower and upper asymptotes or limits of the response, and, for some models, e the effective dose ED50.
By far the log-logistic models are the most used dose-response models . The four-parameter log-logistic model corresponds to the model function: (2) Two slightly different parameterizations are available: one where ED50 is a model parameter, that is e in Eq (2), and another where the logarithm of ED50 denoted by , say, is a model parameter as in the following Eq (3): (3) This second version of the four-parameter log-logistic model may be preferred for dose-response analysis involving very small datasets (<15–20) where a normally distributed parameter estimate may more reasonably be assumed on a logarithm-transformed dose scale than the original dose scale.
Model functions derived from the log-logistic model include the generalized five-parameter log-logistic model, which results in an asymmetric dose-response curve , the five-parameter baroflex model (with two slope parameters b) , and the non-monotonous hormesis models [16, 17]. Log-logistic type fractional polynomial dose-response models were introduced for a binomial response . These models have been implemented in drc in novel, extended four-parameter versions that are also equally suitable for describing a dose-response curve for a continuous response. Biphastic functions obtained as the sum of two four-parameter log-logistic models may also be fitted using drc . Recently, other types of biphasic dose-response models were proposed in the context of biosensors .
Log-normal models, which result in dose-responses curves very similar to curves obtained from the corresponding log-logistic models, and two types of asymmetric Weibull models are also available in drc. In passing we note that there is a close link between the two-parameter log-logistic, log-normal, and Weibull type I models available in drc (where only the two parameters b and e are not fixed) and the log-logistic, log-normal, and Weibull models available in the package survival . Generalized four- and five-parameter versions of the gamma and (quadratic) multistage models, respectively, are also implemented . Another built-in model is the so-called “no effect concentration” (NEC) threshold model .
Most of these functions are scale invariant in the sense that the magnitude of doses is accommodated by the model itself through the parameter b. For instance, for log-logistic functions the slope parameter b acts as a scaling factor, centering doses around 1. In contrast the Brain-Cousens and Cedergreen-Ritz-Streibig models are sensitive to the magnitudes of the doses, which may need to be manually up- or downscaled appropriately prior to model fitting. Moreover, some of these functions may be used for fitting both decreasing and increasing dose-response curves. One exception is the hormesis models, which can only describe decreasing trends, i.e., they are so-called inverse j-shaped hormesis models. However, modified functions for u-shaped hormesis models for increasing dose-response curves are also available . It is also possible to define your own model function .
Hierarchical model structure.
A key distinguishing feature of drc is the hierarchical structure of the built-in model functions, which provides a convenient way to specify special cases obtained by fixing one or more parameters a priori at certain given values. These parameters will not be estimated from the data, but will be kept fixed at the specified values. In practice such special cases occur quite frequently. For instance, various special cases may be derived from the general four-parameter log-logistic model function  (see also Example 4 in S1 File).
All built-in model functions accept the argument fixed, which is used for fixing parameters at given values. For instance, log-logistic models with varying number of model parameters may be specified as follows:
- Fixing f = 1: In drc: LL.5(fixed = c(NA, NA, NA, NA, 1)) or abbreviated LL.4()
- Fixing both f = 1 and c = 0: In drc: LL.4(fixed = c(NA, 0, NA, NA)) or abbreviated LL.3()
- Fixing f = 1, c = 0, and d = 1: In drc: LL.4(fixed = c(NA, 0, 1, NA)) or abbreviated LL.2()
Note that NAs are used to indicate that parameters have to be estimated from the data. Note also that the order of model parameters is b, c, d, e, f.
Fixing model parameters at a priori chosen values should not be confused with constrained optimisation where the ranges of some parameters are constrained, but they are still being estimated.
Models for several dose-response curves.
Some experiments result in data corresponding to several dose-response curves. One example is fixed-ratio ray design mixture toxicity experiments where data consist of a number of dose-response curves corresponding to the different mixture ratios applied . Such data may be modelled using joint models where individual dose-response curves are still assumed but with constraints on parameters across curves. Recently, it was described how to use drc for fitting such models .
For complex, hierarchical dose-response experiments it may be advantageous to fit separate models initially. In a second step relevant parameter estimates extracted from these separate model fits are treated as response in another statistical analysis: one such example of a two-step approach used drc initially and subsequently the package flexmix .
In drc estimation of parameters is based on the maximum likelihood principle, which under the assumption of normally distributed response values simplifies to nonlinear least squares. Estimation of the parameters in dose-response models or any derived parameters will use all observations but for specific parameters observations may still contribute in an unequal way, e.g., some parameters will be more determined by observations in one of the tails than other parameters.
The model fitting function in drc is called drm(). Contrary to most other statistical software programmes for dose-response analysis the dose 0 is left as is during the estimation using drm(), meaning that no value (such as 0.1 or 0.01) is added to the dose to be able to calculate values for dose 0. This is achieved by incorporating in the implementation that the model functions are mathematically well-defined also for dose 0.
Nonlinear least squares
Assume that x1, …, xn are the dose values and y1, …, yn the corresponding observed response values. The nonlinear least squares estimates are obtained by minimizing the following sum of squares: (4) where wi’s are user-specified weights (often left unspecified, i.e., equal to 1). In drm() weights are specified through the argument weights and they should be on the same scale as the response, e.g., expressed as standard deviations and not empirical variances. Weights may be used for addressing variance heterogeneity in the response. However, the transform-both-sides approach should be preferred over using often very imprecisely determined weights (see the next subsection).
Eq (4) has to be solved numerically in an iterative manner. One approach is to use iteratively weighted least squares as is done in nls(), which is part of standard installation in R . Another approach is to use a general-purpose minimizer directly, as in drm() where optim() is used in combination with some pre-scaling of parameters. In our experience drm() is more robust than nls(); lack of robustness of nls() has also been pointed out previously .
The estimated variance-covariance of the parameter estimates () is obtained as the scaled inverse of the observed information matrix, which consists of second-order partial derivatives of f w.r.t. the model parameters β1, …, βp: (5) The scaling factor is the residual standard error, which is estimated in the same way as in linear regression based on residuals. The observed information matrix (“hessian”) in Eq (5) is approximated numerically in optim() upon convergence. However, it is not even a requirement that the inverse is available: if it is not then NAs are returned for standard errors; see Example 1 in S1 File.
The transform-both-sides approach implies that both the response and the nonlinear model function are shifted by a constant C and then transformed by a suitable function gλ . The resulting model for the mean of the transformed response looks like this: (6) with the transformed response on the left-hand side and the transformed model function on the right-hand side. Usually the function gλ is taken to be the Box-Cox transformation gλ(y) = (yλ − 1)/λ for some suitable choice of . The value λ = 1 implies no transformation whilst λ = 0 corresponds to the logarithm transformation. All other values of λ correspond to power transformations. It is noteworthy that the Box-Cox transformation may alleviate variance heterogeneity and some skewness in the distribution of the response and thus recover a normal distribution, but it may not remedy other problems with the distributional assumptions such as counts observed with ties .
The package drc provides a method boxcox, which has been implemented in much the same way as the corresponding method for linear models available in the package MASS . There is, however, a choice between a profiling approach as used for linear models in MASS or a more robust analysis of variance (ANOVA) approach where the optimal λ is estimated from a more general ANOVA model, i.e., a linear model, and not from the specified dose-response model; the latter requires replicate observations for at least some doses.
Manual specification of the transformation is also possible through the arguments bcVal and bcAdd, which correspond to λ and C in Eq (6), respectively. Using a specific transformation (i.e., a specific value of λ and possibly C) based on previous experience should be preferred over using a data-driven choice.
Maximum likelihood estimation
In case of maximum likelihood estimation the following expression has to be maximized in terms of β values in order to obtain parameter estimates: (7) where l denotes the logarithm-transformed likelihood function for a single measurement or observation. The likelihood in turn depends on the distributional assumptions made for the dose-response model. The estimated variance-covariance of the parameter estimates is found as the inverse of the observed information matrix : (8) Maximum likelihood estimation is used for fitting dose-response models to bionomial, count, and event-time data, including models for binomial data where natural immunity and/or natural mortality is present .
One way to handle observations that seem to be extreme or deviating in one way or another as compared to the bulk of the observations is to apply a robust estimation procedure, which will weigh down the influence of such observations.
Robust nonlinear regression is available through the function nlrob() in the R package robustbase. This function relies on nls() through an iterated weighted least squares approach. However, no self starter functionality is currently available. The commercial software GraphPad also has some limited functionality for robust nonlinear regression, but the resulting model fits are provided without standard errors of parameter estimates .
In drc robust dose-response analysis with a continuous response is available using the same models as considered in the case of robust linear regression , except for the model based on Hampel’s ψ, which is currently not implemented. However, it may be difficult to fit such robust nonlinear models unless fairly accurate starting values for the model parameters are provided.
The estimated “information”-type variance-covariance has the following form [36, 37]: where the function ρ controls the influence of observations on the estimation procedure (e.g., ρ(y) = y2 corresponds to ordinary nonlinear least squares estimation). Once parameter estimates have been obtained all methods and extractors available in drc may be used as if the model fit had been obtained using maximum likelihood estimation.
By default unconstrained estimation is carried out by drm() although for most models there are actually constraints on at least some of the model parameters, e.g., ED50 needs to be positive. Likewise, there may also be constraints needed to ensure uniqueness of the model fits, e.g., the slope parameter b should be negative for an increasing dose-response relationship to ensure the interpretation that c is the lower asymptote and d the upper asymptote. In practice such constraints are indirectly enforced through the appropriate choice of starting values.
However, in principle any of the aforementioned estimation procedures may be combined with the use of constraints where the range of one or more parameters is restricted, e.g., to certain intervals by setting lower and upper bounds (so-called box constraints) that are different from −∞ and ∞, respectively. This is possible with drm() using the arguments lowerl and upperl, which, if specified, will invoke constrained optimisation through the method “L-BFGS-B” in optim().
Self starter functions
The estimation procedures introduced in this section are iterative and to ensure convergence towards optimal parameter estimates they need to be initiated through the provision of starting values for the model parameters. The choice of starting values may crucially affect whether convergence is eventually achieved. Thus, availability of good starting values facilitate parameter estimation in nonlinear models. Starting values may be obtained either by using parameter estimates previously reported for similar experiments or, in a data-driven way, by using the dose-response data themselves to elicit relevant information. For instance, within weed science, routine calculation of starting values for log-logistic models from simple linear regression models of transformed responses dates back at least to , utilizing extending linearization techniques previously used for probit analysis .
The flexibility of R has made it possible to implement so-called self starter functions that return data-driven starting values for the model parameters. In R self starter functions are available for the function nls(). In drc the above-mentioned data-driven linearization technique has been extended to other types of dose-response models and it is now available for all built-in models. It is the default setting, which may, however, be overruled by supplying starting values manually through the argument start. The function getInitial() may be used to obtain the starting values that were actually used for obtaining a particular model fit.
More sophisticated self starter functions have been proposed , but so far they have not implemented in drc except for some log-logistics models.
Choice of model
Ideally, either a single dose-response model is fitted based on established knowledge or a number of plausible candidate models are identified and a model-averaging approach is adopted. However, in reality a decision-tree approach is typically used to find the best-fitting model among several candidates. For this approach the function mselect() may be useful as it returns values for information criteria or, if models are nested, p-values from lack-of-fit/goodness-of-fit tests as implemented in the function modelFit().
Obtaining relevant parameter estimates
The methods summary() and coef() may be used to retrieve the estimated model parameters with and without the corresponding naive standard errors and derived z- or t-test statistics and p-values. Standard errors, which are robust against misspecification of the distributional assumptions, may easily be obtained by means of the packages lmtest and sandwich as shown in Example 2 in S1 File [41, 42].
By default the p-values reported in the summary() output are unadjusted. However, adjusted p-values controlling the family-wise error rate may be obtained using the function glht() in the package multcomp, assuming that test statistics jointly follow a multivariate normal or t distribution . Note that it is even possible to use robust standard errors and then carry out simultaneous inference.
In case several dose-response curves are fitted simultaneously the function compParm() is useful for comparisons between groups within a single model parameter; see Example 3 in S1 File. Occassionally, global F tests and, in general, chi-square likelihood ratio tests may be useful for assessing if a number of parameters could be identical, e.g., several ED50 values. Specifically, these tests need two dose-response model fits such that one fit should be nested within the other. The model fits may then be compared using the anova() method; see again Example 3 in S1 File. A related convenience function is noEffect(), which may be used to test if there is any dose-response relationship at all, i.e., comparing the dose-response model to a model where the response is on average constant and hence not changing with dose.
Next, we will consider how to estimate various derived parameters that are functions of the model parameters and that are often of key interest in dose-response analysis.
Estimating doses corresponding to specific response levels is often of particular interest in dose-response analysis. Such estimates are obtained by solving an inverse regression problem, which may be approached either through after-fitting or re-parameterization. After-fitting means solving the inverse regression problem after having fitted the model. For some models the solution may be derived explicitly (e.g., log-logistic models [2, 44]) whereas for other models only numerical solutions are available (e.g., hormesis models ). After-fitting relies on the so-called delta method, which enables the calculation of approximate standard errors for derived parameter estimates . Reparameterization means fitting the model using a reparameterized model function where the solution is an actual model parameter.
A practical implication of the after-fitting approach is that it suffices to fit a dose-response model once, in a parameterization that has proven to be the most stable for estimation. In our opinion, after-fitting provides a major improvement over the often quite instable re-parameterization approaches still being used with other statistical software programmes .
Estimating effective doses.
The most prominent example of a derived parameter obtained using inverse regression is the dose that results in a halfway reduction between the lower and upper limits of the dose-response curve f as doses approach infinity and 0, respectively. This parameter is often denoted ED50 or EC50 for continuous responses, LD50 or LC50 for binomial responses, and T50 for event-time responses. We will use the term effective dose.
For a decreasing mean function f the effective dose for 0 < α < 1 (ED100α) is defined as the solution to the following equation: (9) Note that these limits are well-defined and finite for dose-response models (for most models in drc they correspond to the parameters d and c, respectively).
The resulting effective dose is a relative quantity, defined in terms of a percentage reduction. For instance, ED50 (α = 0.50) is the dose resulting in a 50% reduction in the average response relative to the lower and upper limits of f. Such relative effective doses are mostly suitable for continuous responses. For increasing α the corresponding ED100α will be increasing as a consequence of f being a decreasing function.
For binomial responses absolute effective doses referring to the entire probability scale [0, 1], which not necessarily coincide with the lower and upper limits of the estimated dose-response curve, are usually more relevant. In general, an absolute effective dose EDy0 corresponding to an average response y0 may be defined as the solution to the following equation: (10) An absolute effective dose for y0 ∈]c, d[ may always be calculated as some relative effective dose for suitably derived α value. In some cases this approach will involve parameter estimates for the lower and upper limits, but at present the variation in these estimates will not be propagated to the estimated effective dose.
Estimated effective doses are obtained by inserting parameter estimates and solve Eq (9) w.r.t. the derived parameter ED100α. In drc the function ED() will calculate estimated effective doses. Estimation of ED values is shown in Example 2 and 5 in S1 File. In ED() the argument type controls the type of effective dose being calculated: relative (default) or absolute. Note also that for hormesis models effective doses may also be meaningfully defined for some α < 0 (by setting the argument bound = TRUE in ED()). Model-averaged estimated ED values may be obtained through the function maED() .
The ratio of effective doses at levels 100α1 and 100α2, respectively, of two fitted dose-response curves denoted A and B, say, is defined as follows: For the important special case where α1 = α2 the ratio is referred to as the relative potency , and it is interpreted as a measure for quantifying the strength of one substance over another, i.e., a pairwise comparison based on a ratio. The term selectivity index is also sometimes used . In general, the ratio may be interpreted as the order of magnitude of the window between harmful and safe for appropriate choices of α1 and α2, e.g., 0.1 an 0.9. In some special cases (“parallelism”) the relative potency is constant between two dose-response curves for all values satisfying α1 = α2. More often it will change with the value of α1 = α2 and this may be investigated using the function relpot() .
In drc the extractor function EDcomp() may be used for obtaining estimated relative potencies or differences between effective doses. By default the corresponding standard errors are derived using the delta method and confidence intervals are based on these standard errors (indicated through the argument interval = “delta”) in combination with t- or z-value (percentile in an appropriate t- or normal distribution). Alternatively, confidence intervals based on the approach of Fieller may be used (interval = “fieller”). For the special case of the log-logistic model where log(ED50) is a model parameter () confidence intervals on the original dose scale may be retrieved through back transformation (interval = “fls”).
Benchmark dose estimation.
For any type of response (e.g., binomial and continuous) benchmark dose (BMD) estimation may be reduced to a special case of estimating effective doses . The key implication is that dose-response modelling (in all kinds of extensions and modifications) will allow subsequent BMD estimation, opening up for using the BMD concept much more broadly than what is currently done. Specifically, there is no longer a need for special modelling approaches that differ depending on the type of response. The R package bmd provides BMD estimation for single dose-response curves fitted using drm(), using either added or excess risk definitions. Finally, simultaneous inference for multiple BMD levels is also possible .
There are a number of functions available in drc for obtaining predicted values from a dose-response model fit. Notably, there are the general-purpose methods fitted() and predict(). The latter may also provide confidence or prediction intervals (controlled through the argument type). The function backfit() may be used for obtaining the estimated doses that correspond to the observed average response at each dose.
The predict() method is useful for obtaining data for construction of plots using the traditional graphical functionality in R. In particular, the plot() method may be used to show the original or summarized data together with the fitted dose-response curve(s) superimposed. Such plots are often shown in articles as they are useful for assessing model fit and they could be used together with residual and normal probability plots. By default plot() uses a logarithmic dose axis, which may be switched off with the argument log = “”. The argument broken allows dose 0 also to be shown in plot together with the logarithmic axis. Normalization of the response relative to the control (dose 0) may be achieved using normal = TRUE and possibly the argument normref for setting the reference, which is by default 1, as suggested by . This normalization is based on the model fit and it does not involve modification of the original data.
For more sophisticated plots, however, we suggest to use the package ggplot2 as shown in Example 2 in S1 File.
We have described the key functionality presently available in the R extension package drc. An important feature is that the package drc may be used in combination with other extension packages in R such as ggplot2 and multcomp, enhancing the flexibility and usefulness of the package.
There is still room for extending the capabilities of the built-in models and for incorporating methods for handling additional types of responses such as ordinal responses, e.g., obtained from the assessment of severity of damage on weeds after applying a herbicide (a score between 0 and 10). It could also be useful to have beta-binomial dose-response models implemented. The functionality for benchmark dose estimation could also be extended. Likewise robust dose-response analysis for other types of responses could be a useful extension.
It would also be useful to implement alternative ways of estimating the uncertainty of (derived) parameter estimates, e.g., bootstrap and profiling approaches or inversion of confidence/prediction intervals.
The presented framework has also some limitations. Notably, we have throughout the entire paper assumed that responses are mutually independent. Certain correlation structures may readily be implemented within the framework of drc, e.g., correlation that is a function of the dose-response model function . More generally, for continuous responses the package medrc extends many of the capabilities of drc to correlated dose-response data fitted through nonlinear mixed-effects regression models . Specifically medrc utilizes the capabilities of the package nlme , but medrc allows both estimation of conditional and population-based ED levels; the latter has not been available for dose-response analysis previously.
Conceived and designed the experiments: CR JCS. Performed the experiments: CR JCS. Analyzed the data: CR FB JCS DG. Wrote the paper: CR FB JCS DG.
- 1. R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria; 2015. Available from: http://www.R-project.org/.
- 2. Ritz C, Streibig JC. Bioassay Analysis using R. J Stat Softw. 2005;12:1–22.
- 3. Pinheiro J, Bornkamp B, Glimm E, Bretz F. Model-based dose finding under model uncertainty using general parametric model. Stat Med. 2014;33:1646–1661. pmid:24302486
- 4. Ranke J. Fitting dose-response curves from bioassays and toxicity testing. R News. 2006;6:7–12.
- 5. Kahm M, Hasenbrink G, Lichtenberg-Fraté H, Ludwig J, Kschischo M. grofit: Fitting Biological Growth Curves with R. J Stat Softw. 2010;33(7):1–21.
- 6. Bornkamp B, Pinheiro J, Bretz F. MCPMod: An R Package for the Design and Analysis of Dose-Finding Studies. J Stat Softw. 2009;29(7):1–23.
- 7. Baty F, Ritz C, Charles S, Brutsche M, Flandrois JP, Delignette-Muller ML. A Toolbox for Nonlinear Regression in R: The Package nlstools. J Stat Softw. 2015;66:1–21.
- 8. Rudemo M, Ruppert D, Streibig JC. Random-Effect Models in Nonlinear Regression with Applications to Bioassay. Biometrics. 1989;45:349–362.
- 9. Van der Vliet L, Ritz C. Statistics for Analyzing Ecotoxicity Test Data. In: Férard J, Blaise C, editors. Encyclopedia of Aquatic Ecotoxicology. New York: Springer; 2013. p. 1081–1096.
- 10. Ritz C, Van der Vliet L. Handling non-normality and variance heterogeneity for quantitative sublethal toxicity tests. Environ Toxicol Chem. 2009;28:2009–2017. pmid:19364187
- 11. Finney DJ. Probit Analysis. 3rd ed. London: Cambridge University Press; 1971.
- 12. Ritz C, Pipper CB, Streibig JC. Analysis of germination data from agricultural experiments. Eur J Agron. 2013;45:1–6.
- 13. Andreasen C, Kemezys AH, Müller R. The Effect of Fertilizer Level and Foliar-applied Calcium on Seed Production and Germination of Gerbera hybrida. HortScience. 2014;49:538–543.
- 14. Finney DJ. Bioassay and the Practice of Statistical Inference. Int Stat Rev. 1979;47:1–12.
- 15. Ricketts JH, Head GA. A five-parameter logistic equation for investigating asymmetry of curvature in baroreflex studies. Am J Physiol (Regul Integr Comp Physiol 46). 1999;277:441–454.
- 16. Brain P, Cousens R. An equation to describe dose responses where there is stimulation of growth at low dose. Weed Res. 1989;29:93–96.
- 17. Cedergreen N, Ritz C, Streibig JC. Improved empirical models describing hormesis. Environ Toxicol Chem. 2005;24:3166–3172. pmid:16445100
- 18. Namata H, Aerts M, Faes C, Teunis P. Model Averaging in Microbial Risk Assessment Using Fractional Polynomials. Risk Analysis. 2008;28(4):891–905. pmid:18564995
- 19. Cornou C, Storm IMLD, Hindrichsen IK, Worgan H, Bakewell E, Yáñez DR, et al. A ring test of a wireless in vitro gas production system. Anim Prod Sci. 2013;53:585–592.
- 20. Martin-Betancor K, Ritz C, Fernández-Piñas F, Leganés F, Rodea-Palomares I. Defining an additivity framework for mixture research in inducible whole-cell biosensors. Sci Rep. 2015; 5:17200. pmid:26606975
- 21. Therneau TM, Grambsch PM. Modeling Survival Data: Extending the Cox Model. Springer Verlag; 2000.
- 22. Wheeler M, Bailer AJ. Comparing model averaging with other model selection strategies for benchmark dose estimation. Environ Ecol Stat. 2009;16(1):37–51.
- 23. Pires AM, Branco JA, Picado A, Mendonça E. Models for the estimation of a’no effect concentration’. Environmetrics. 2002;13(1):15–27.
- 24. Garnier-Laplace J, Della-Vedova C, Andersson P, Copplestone D, Cailes C, Beresford NA, et al. A multi-criteria weight of evidence approach for deriving ecological benchmarks for radioactive substances. J Radiol Prot. 2010;30(2):215. pmid:20530866
- 25. Kniss AR, Vassios JD, Nissen SJ, Ritz C. Nonlinear regression analysis of herbicide absorption studies. Weed Sci. 2011;59(4):601–610.
- 26. Ritz C. Towards a unified approach to dose-response modeling in ecotoxicology. Environ Toxicol Chem. 2010;29:220–229. pmid:20821438
- 27. Streibig JC, Kudsk P, Jensen JE. A General Joint Action Model for Herbicide Mixtures. Pest Sci. 1998;53:21–28.
- 28. Ritz C, Streibig JC. From additivity to synergism—A modelling perspective. Synergy. 2014;1(1):22–29.
- 29. Altop EK, Mennan H, Streibig JC, Budak U, Ritz C. Detecting ALS and ACCase herbicide tolerant accession of Echinochloa oryzoides (Ard.) Fritsch. in rice (Oryza sativa L.) fields. Crop Prot. 2014;65(0):202–206.
- 30. Ritz C, Streibig JC. Nonlinear regression with R. useR! series. New York: Springer; 2008.
- 31. Nash JC. On Best Practice Optimization Methods in R. J Stat Softw. 2014 9;60(2):1–14.
- 32. Carroll RJ, Ruppert D. Power transformations when fitting theoretical models to data. J Am Stat Assoc. 1984;79:321–328.
- 33. Venables WN, Ripley BD. Modern Applied Statistics with S. 4th ed. New York: Springer; 2002. ISBN 0-387-95457-0. Available from: http://www.stats.ox.ac.uk/pub/MASS4.
- 34. van der Vaart AW. Asymptotic Statistics. Cambridge: Cambridge University Press; 1998.
- 35. Motulsky HJ, Brown RE. Detecting outliers when fitting data with nonlinear regression—a new method based on robust nonlinear regression and the false discovery rate. BMC Bioinform. 2006;7:123:1–20.
- 36. Huber PJ. Robust Statistics. Hoboken: John Wiley & Sons; 1981.
- 37. Stromberg AJ. Computation of High Breakdown Nonlinear Regression Parameters. J Am Stat Assoc. 1993;88(421):pp. 237–244.
- 38. Streibig JC, Rudemo M, Jensen JE. Dose-response curves and statistical models. In: Streibig JC, Kudsk P, editors. Herbicide Bioassays. Boca Raton: CRC Press; 1993. p. 29–55.
- 39. Streibig JC. A Method for Determining the Biological Effect of Herbicide Mixtures. Weed Sci. 1981;29:469–473.
- 40. Normolle D. An Algorithm for Robust Non-linear Analysis of Radioimmunoassays and other Bioassays. Stat Med. 1993;12:2025–2042. pmid:8296112
- 41. Zeileis A, Hothorn T. Diagnostic Checking in Regression Relationships. R News. 2002;2(3):7–10.
- 42. Zeileis A. Object-oriented Computation of Sandwich Estimators. J Stat Softw. 2006;16:1–16.
- 43. Hothorn T, Bretz F, Westfall P. Simultaneous Inference in General Parametric Models. Biom J. 2008;50:346–363. pmid:18481363
- 44. Streibig JC, Jensen JE. Actions of herbicides in mixtures. In: Herbicides and their Mechanisms of Action. Sheffield: Sheffield Academic Press; 2000.
- 45. Weisberg S. Applied Linear Regression. 3rd ed. New York: John Wiley & Sons; 2005.
- 46. Belz RG, Piepho HP. Statistical modeling of the hormetic dose zone and the toxic potency completes the quantitative description of hormetic dose responses. Environ Toxicol Chem. 2015;34(5):1169–1177. pmid:25523646
- 47. Kang SH, Kodell RL, Chen JJ. Incorporating Model Uncertainties along with Data Uncertainties in Microbial Risk Assessment. Regul Toxicol Pharmacol. 2000;32(1):68–72. pmid:11029270
- 48. Christensen MG, Teicher HB, Streibig JC. Linking fluorescence induction curve and biomass in herbicide screening. Pest Manag Sci. 2003;59:1303–1310. pmid:14667052
- 49. Ritz C, Cedergreen N, Jensen JE, Streibig JC. Relative potency in nonsimilar dose-response curves. Weed Sci. 2006;54:407–412.
- 50. Ritz C, Gerhard D, Hothorn LA. A Unified Framework for Benchmark Dose Estimation Applied to Mixed Models and Model Averaging. Stat Biopharm Res. 2013;5(1):79–90.
- 51. Jensen SM, Ritz C. Simultaneous Inference for Model Averaging of Derived Parameters. Risk Anal. 2015;35:68–76. pmid:24952957
- 52. Weimer M, Jiang X, Ponta O, Stanzel S, Freyberger A, Kopp-Schneider A. The impact of data transformations on concentration–response modeling. Toxicol Lett. 2012;213(2):292–298. pmid:22828011
- 53. Strodl Andersen J, Holst H, Spliid H, Andersen H, Baun A, Nyholm N. Continuous Ecotoxicological Data Evaluated Relative to a Control Response. J Agric Biol Environ Stat. 1998;3(4):pp. 405–420.
- 54. Gerhard D, Ritz C. Marginalization in nonlinear mixed-effects models—with an application to dose-response analysis. Submitted. 2015.
- 55. Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team. nlme: Linear and Nonlinear Mixed Effects Models; 2015. R package version 3.1-120.