https://orcid.org/0000-0001-8421-090X
Figures
Abstract
Biomedical research often utilizes Cox regression for the analysis of time-to-event data. The pervasive use of frequentist inference for these analyses implicates that the evidence for or against the presence (or absence) of an effect cannot be directly compared and that researchers must adhere to a predefined sampling plan. As an alternative, the use of Bayes factors improves upon these limitations, which is especially important for costly and time-consuming biomedical studies. However, Bayes factors involve their own difficulty of specifying priors for the parameters of the statistical model. In this article, we develop data-driven priors centered around zero for Cox regression tailored to nine subfields in biomedicine. To this end, we extracted hazard ratios and associated confidence intervals from the abstracts of large corpora of already existing studies within the nine biomedical subfields. We used these extracted data to inform priors for the nine subfields. All of our suggested priors are Normal distributions with means of 0 and standard deviations closely scattered around 1. We propose that researchers use these priors as reasonable starting points for their analyses.
Citation: Linde M, Jochim L, Tendeiro JN, van Ravenzwaaij D (2025) Data-driven prior elicitation for Bayes factors in Cox regression for nine subfields in biomedicine. PLoS One 20(5): e0322144. https://doi.org/10.1371/journal.pone.0322144
Editor: Robin Haunschild, Max Planck Institute for Solid State Research, GERMANY
Received: May 6, 2024; Accepted: March 17, 2025; Published: May 23, 2025
Copyright: © 2025 Linde et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data used in section ‘Example Application’ was shared with the authors by NIAID and may not be distributed beyond the first and last author (for more information, see https://accessclinicaldata.niaid.nih.gov/). All other data may be obtained from the OSF page associated with the project: https://osf.io/ua4ys/.
Funding: This research was supported by a Dutch scientific organization VIDI fellowship grant (016.Vidi.188.001) awarded to Don van Ravenzwaaij and a Japanese JSPS KAKENHI grant (21K20211) awarded to Jorge N. Tendeiro. Neither of the funders played any role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The collection and analysis of time-to-event data forms a central part of modern biomedical research (see, e.g., [1–6]). In these types of designs, the outcome variable is the time until an event of interest occurs, which is commonly called the survival time. In the medical context, this event of interest could be, for example, death, relapse towards alcoholism, disease/symptom onset, or recovery. Using survival analysis (we refer the interested reader to other sources, which treat survival analysis more thoroughly; e.g., [7–15]), it is possible to estimate differences in event rates between conditions, which makes it particularly appealing for clinical trials. For instance, evidence about the effectiveness of an oncological treatment of cancer patients could be gathered by comparing the survival times of patients receiving the treatment to the survival times of patients receiving a placebo or an active control treatment (for examples see [1,16,17]).
The use of frequentist inference for the analysis of survival data has a long tradition in biomedical research and is still very common today [18]. Classical frequentist inference, however, is not well suited to quantify evidence in favor of the absence of an effect. In addition, frequentist inference requires fixing the study sample size in advance to avoid an inflation of the Type I and/or Type II error rates [19], a downside that can be particularly costly in the realm of resource-intensive biomedical research and clinical trials [18,20,21]. A prominent way to deal with this issue within the frequentist framework is the use of group sequential designs, whereby sequential testing and optional stopping of data collection is permitted at the cost of implementing some procedure that controls the Type I and/or Type II error rates. These designs have a long and successful tradition in biomedicine (e.g., [22]). As an alternative, Bayesian statistics have gained popularity among researchers [23]. In particular, Bayes factors [24–27] do not suffer from the two limitations mentioned before and are therefore a valuable alternative for conducting inference in biomedical research [28].
Bayesian modeling with the goal of either hypothesis testing or parameter estimation requires the specification of a prior distribution for the parameters of the model. The prior expresses one’s beliefs about the plausibility of parameter values before observing the data [29–31]. Oftentimes, it is notoriously difficult to express these beliefs. Moreover, within Bayesian hypothesis testing, different priors sometimes lead to qualitatively different Bayes factors [30,32–36]. As a result, some researchers lament that the use of Bayesian statistics involves subjectivity (e.g., [37]) and that proper guidance is missing, possibly resulting in hesitation to use Bayesian inference. Hence, recommendations for well-established default priors in Bayesian survival analysis - in particular Cox proportional hazards regression (henceforth called Cox regression or Cox model; [38]) - are missing and urgently needed.
In this article, we propose default priors for Bayesian Cox regression tailored to nine subfields within biomedicine. The construction of these priors harnesses historical records consisting of large corpora of hazard ratios and associated confidence intervals from existing studies within the respective subfields. We argue that these proposed priors can be used as reasonable defaults or starting points for biomedical researchers wishing to conduct a Bayesian Cox regression.
The remainder of this article is structured as follows: First, we provide an overview of Cox regression and Bayes factors. Second, we briefly review how priors can be defined. Third, we explain our process of generating priors for nine subfields in biomedicine and present the corresponding results. Fourth, we reflect on our findings and implications thereof, and conclude with recommendations.
Bayes factors in Cox regression
Survival analysis is a statistical method to analyze time-to-event/survival data. Among the many existing forms of survival analysis - for example, Kaplan-Meier product-limit estimator [39], parametric survival analyses (e.g., Exponential, Gompertz, and Weibull), and Cox regression [38] - the latter is used most frequently within biomedicine (e.g., [10]). Therefore, our treatment of priors for survival analysis is limited to the case of Cox regression.
In Cox regression, the hazard function presents the risk of an event happening in a small time period around a specific time t within cases for which the event has not yet happened before time t (see, e.g., [7,8]). The specific
is allowed to have any shape but must be proportional across all values of an independent variable x. Usually, the main goal is not to estimate
but rather to estimate the
parameter of the Cox model:
Here and throughout, we work with the specific case where x is dichotomous and dummy-coded (i.e., there are two conditions, a common situation in biomedical designs). For this scenario, a hazard ratio can be calculated
which provides information about the relative hazard rates between conditions.
In clinical trials, is often the key indicator regarding the effectiveness of a treatment.
(or
) means that the two conditions have the same risk of the event happening at any t;
(or
) means that the experimental condition has a higher risk of the event happening at any t;
(or
) means that the control condition has a higher risk of the event happening at any t. Frequentist inference on
or
is then conducted either in the form of null hypothesis significance testing (i.e., test statistic and p-value) or in the form of estimation (i.e., a point estimate accompanied with a confidence interval).
The reliance on frequentist inference [40,41] has some undesirable consequences for biomedical research. Here, we focus on two of these consequences, namely (1) the impossibility to obtain evidence for the null hypothesis and (2) the inability to adjust the sampling plan based on interim results. Concerning (1), it is important to not only determine whether a treatment is working but also whether a treatment is not working over and above a placebo effect. The frequentist approach is not suitable for this because it only allows rejecting the hypothesis that there is no effect, but not accepting it (e.g., [35,42–46]).
Concerning (2), the use of frequentist inference prescribes the diligent adherence to a predefined sampling plan, prohibiting to continue or prematurely stop data collection based on interim data analyses (e.g., [47–50]). Further criticism is described elsewhere (see, e.g., [41,46,51–53]).
Bayesian testing in the form of Bayes factors permits a direct comparison between the evidence for the null hypothesis that there is no effect and an alternative hypothesis that operationalizes that there is some effect [42]. For instance, with , it allows the interpretation that the obtained data is 14 times more likely under the chosen hypothesis that there is some effect compared to the hypothesis that there is no effect; similarly,
indicates that the obtained data is 1/0.2 = 5 times more likely under the hypothesis that there is no effect compared to the chosen hypothesis that there is some effect.
Moreover, using Bayes factors, it is legitimate to monitor the results and stop data collection once a predetermined evidence threshold is reached [47–50,54,55]. Thus, Bayes factors take the evidence for and against both the null and alternative hypotheses into account, yield more substantial interpretations, and empower researchers to sample just the sufficient amount of cases. These characteristics of Bayes factors are critical for biomedical research as studies (especially clinical trials) can be expensive and time-consuming.
In the case where there is a point null hypothesis stating that there is no effect
and an interval alternative hypothesis stating that there is an effect
the Bayes factor is a ratio of a marginal likelihood and a likelihood evaluated at . Here,
represents any probability density function and
the associated parameters. Let
be the parameter space under the alternative hypothesis; then the Bayes factor is:
In Eq 5, the integral constitutes a weighted average of the likelihood, with weights supplied by the prior. Depending on the complexity of the underlying statistical model, computing the expression in Eq 5 can be challenging. Through concerted efforts of researchers to develop closed-form solutions and through the explosion of computational power over recent decades that allows applying complex numerical methods (e.g., Monte Carlo sampling and bridge sampling; [56–60]), computing the expression in Eq 5 and variants of it has become feasible. These efforts have led to method developments and software implementations for calculating Bayes factors for survival analyses [61–64] and many other designs (e.g., [42,53,65–71]).
Choosing priors
Even though it is possible nowadays to calculate Bayes factors for various sorts of designs, it remains difficult to specify an appropriate prior distribution (or prior for short) for the parameters of interest (cf. Eq 5). The prior is a probability distribution that is placed on the statistical model’s parameters of interest and it expresses belief over the plausibility across all possible parameter values before taking into account new data. In the context of null hypothesis Bayes factor calculations, the prior is one important element of the alternative hypothesis. Even among researchers who advocate Bayesian statistics, there is disagreement on how the prior should be specified (see, e.g., [72,73]).
Objective Bayesians strive to define non-informative priors that are as “objective” as possible. Objective Bayesians assert that the results of Bayesian analyses should depend only to a minimal extent on the beliefs of different people. They promote default priors that can be used when no other information is available and often seek to find priors that “behave well” and fulfill certain mathematical properties (see, e.g., [74,75] for more details). Subjective Bayesians, on the other hand, counter that the subjective nature of the prior is an integral part of Bayesian analyses. According to them, the prior allows the incorporation of domain knowledge and results from prior studies into Bayesian analyses and therefore permits tests of theories [32,76]. Further, they state that it is questionable whether a truly “objective” prior even exists.
Recently, the opportunities that well-defined priors open were increasingly recognized in biomedical research. Prior elicitation procedures, in which informed priors are defined by means of using external sources, gained popularity within biomedical research (e.g., [77–81]). There are various forms of prior elicitation. For example, through structured interviews, information about prior beliefs can be extracted by one or multiple experts in the respective field, which is subsequently combined into one prior (see, e.g., [79,80,82,83]). Tools like the MATCH software [84] have been developed for this purpose. Alternatively, the results of meta-analyses and prior research in general can be used to create a prior (e.g., [80,85]). That is, researchers could use the overall effect size combined with a measure of uncertainty from a meta-analysis to construct an informed prior for their own analysis; or they could conduct their own literature search and extract the relevant statistics and use them for developing priors. This approach of using prior study results can also be combined with an empirical Bayes approach, which utilizes the current data to create a prior instead of predefining it (e.g., [86]). Such a procedure was proposed by [87].
In this article, we follow the approach of using results of prior studies to create priors. For this, we conducted our own literature search instead of relying on meta-analyses. The reason for this is that we aim to suggest priors that are generic, such that they apply to entire medical subfields; most meta-analyses do not offer this generality.
The current study
In the present article, we develop priors centered around zero for Bayesian Cox regression for nine subfields that we believe are representative for different areas of research within biomedicine. For the construction of these priors we make use of reported hazard ratios and associated confidence intervals from large corpora of existing studies. These extracted data are then combined through pooling to generate priors. These priors apply to two-sided alternative hypotheses. Since we are ignorant of the direction of effects, our proposed priors can be truncated at 0 for directional hypotheses.
Methods
We selected the subfields in biomedicine considered for further investigation based on a taxonomy provided by Scimago (available at https://www.scimagojr.com/journalrank.php; [88]). On the Scimago website, we used “Medicine” as a subject area, upon which a list of medical subfields were provided (see Fig 1). Among those, we selected the following nine subfields for further consideration:
- Anesthesiology and pain medicine
- Cardiology and cardiovascular medicine
- Gastroenterology
- Hematology
- Immunology and allergy
- Neurology
- Oncology
- Psychiatry and mental health
- Pulmonary and respiratory medicine
Our selection was based on three criteria: (1) we aimed to obtain a manageable number of subfields (between eight and twelve); (2) we aimed to obtain subfields with limited overlap; and (3) we aimed to obtain subfields that represent relatively large areas of study within biomedicine. For each of the nine subfields, we obtained a list of the top journals from Scimago. We considered only journals (i.e., neither book series, nor conferences and proceedings, nor trade journals); we considered journals from all regions/countries; and the journal list was based on the year 2022 (see Fig 1 for an example of the settings on the Scimago website for the subfield of “Anesthesiology and pain medicine”). The extraction of the top journals for all nine subfields yielded 2,469 journals in total (see columns 1 and 2 of Table 1). Some subfields shared a set of journals; for example, the journal “Pain” is a top journal for both the subfields of “Anesthesiology and pain medicine” and “Neurology”. We found that there was not a lot of overlap of journals between the subfields, with 2,196 of the 2,469 journals being uniquely assigned to only one subfield.
The first column indicates the subfield, the second column the number of used (i.e., matched between Scopus data and Scimago data) journals (not necessarily unique) from all Scimago journals, the third column the number of studies allocated, the fourth column the number of studies for which there was a match and data extraction was successful, and the fifth column the number of studies remaining after excluding studies that provide flawed results.
As a separate step, we used Scopus to obtain a list of medical articles. We used the following search query:
ABS(("hazard ratio" OR hr) AND cox) AND
SUBJAREA(medi) AND
PUBYEAR > 1999 AND PUBYEAR < 2021 AND
(LIMIT-TO(SRCTYPE,"j")) AND
(LIMIT-TO(PUBSTAGE,"final")) AND
(LIMIT-TO(DOCTYPE,"ar")) AND
(LIMIT-TO(LANGUAGE,"English"))
Only fully published (line 5) articles (line 6) from a journal (line 4) written in English (line 7) were considered. Furthermore, the results had to belong to the field of medicine (line 2) and be published between the years 2000 and 2020, inclusive (line 3). Lastly, the abstracts of the results needed to contain the keywords “hazard ratio” or “HR” and the keyword “Cox”, ignoring case (line 1). Note, however, that this search query was generic such that it did not restrict the results towards one of the nine subfields. The Scopus query yielded 59,669 results, of which 23 could not be exported, leaving 59,646 results in total (see column 3 of Table 1).
The 59,646 Scopus results were allocated to the nine subfields by matching the journal names indicated by Scopus to the Scimago lists of journal names for the nine subfields. Importantly, a Scopus result could be allocated to multiple subfields as some subfields had journals in common. Before the allocation of Scopus results to the nine subfields, both the Scopus journal names and the Scimago lists of journal names were cleaned and standardized in order to accommodate slight differences in their presentation. This included replacing “&” and “&” with “AND”, removing all characters that are not alphabetic or white space, repositioning the word “the” (e.g., “Lancet Oncology, The” was turned into “The Lancet Oncology”), and transforming all characters to uppercase. The number of matched journal names relative to the total number of Scimago journal names for the nine subfields are shown in column 2 of Table 1 and the number of allocated results for each of the nine subfields can be seen in column 3 of Table 1.
Once the individual Scopus results were allocated to the nine subfields, we extracted hazard ratios and associated confidence intervals from the abstracts of the results. This was done in an automatic fashion through the use of regular expressions (see [89] for the standard reference on regular expressions). We extracted the following information from the abstracts:
- Hazard ratio (
)
- Confidence level of the confidence interval (
) for
(i.e.,
)
- Lower boundary of the
for
(
)
- Upper boundary of the
for
(
)
There are several important details about our implemented text-mining procedure. First, we exclusively considered the abstracts for data extraction. In an attempt to ascertain that this did not result in bias in the extracted effect sizes, we randomly sampled 100 articles for which we could match results in the abstract with our regular expression and another 100 articles for which we could not match results in the abstract with our regular expression. For these articles, we applied our regular expression on the main text (i.e., not the abstracts). The effect size distributions from this sample looked very similar, indicating no strong evidence for a bias as a result of focusing our search on abstracts only (see Fig 5 in Appendix A). Second, if the regular expression yielded multiple matches for a given abstract, only the first match was considered; any other matches were discarded. The justification for this decision was that we assumed that the main findings are commonly reported first, followed by secondary or exploratory findings.
The histograms show the distribution of bi (and −bi), ignoring . The red curves display the densities of the Normal priors on
, where
is presented at the top of each panel.
The nine panels correspond to the nine subfields. The box plots show of the priors when each ni is drawn randomly from
(i.e., studies have different sample sizes); this process was repeated 100,000 times.
The blue and red lines show the development of the Bayes factor as new data enter the study for the “immunology and allergy” and “pulmonary and respiratory medicine” priors. The blue and red lines heavily overlap, so the blue line is hardly visible. The gray lines show the development of the Bayes factor for the sensitivity analysis (i.e., various Normal priors). Data collection is stopped once the Bayes factor exceeds 1/20 or 20.
Third, data extraction was only done when all of the four above-mentioned information were available in the abstract. We disregarded abstracts where results were not complete or were presented in any other form. For instance, presentations of a coupled with a p-value and potentially a test statistic were ignored. Although this seems like an overly drastic measure, the number of matches was still very high (see column 4 of Table 1). Fourth, we did not distinguish between variations of Cox regression (e.g., multivariate, stratified, multiple predictors).
Fifth, we allowed various forms of the displayed results. For example, the following variations were all captured by our regular expression: “” (with or without spaces around =), “
”, “
”, “
”, “
”, “
”, “
”, “
”, and many more. Thus, we attempted to make the regular expression as flexible as possible, so that it could capture the maximum amount of valid text, while still maintaining a healthy level of restrictions. For more details, please consult our code, available at https://osf.io/ua4ys/. In total, we were able to extract data for 21,768 out of 36,431 results (see column 4 of Table 1).
We applied additional checks on the extracted data to make sure that both the regular expression worked properly and the information in the abstracts themselves was correct. As a first step, we checked whether the confidence level of the was between 0 and 100. Second, we tested whether
,
, and
were higher than 0 (because the possible range goes from 0 to
). Third, we examined whether the
was approximately (because of rounding) in the middle of
and
. Here, we also excluded results where the
and at least one of
or
had the same value due to rounding. Any extracted data that did not fulfill all of these criteria was discarded. Column 5 of Table 1 shows that for all nine subfields only a small number of extracted data had to be excluded (170 out of 21,768 in total), leaving a final number of considered results of 21,598.
With this step completed, the nine subfields and their hazard ratios and associated confidence intervals were considered separately. For each study i in
within one of the nine subfields (where N is the number of studies within one of the nine subfields), the extracted
was
-transformed (bi). Also, the standard error of bi was calculated based on the confidence interval (e.g., [90]) of
(i.e.,
and
):
where and
is the quantile function of the standard Normal distribution. The sign of bi, however, is meaningless because it depends on how the independent variable is coded. For instance, commonly the control condition is coded with 0 and the experimental condition with 1; occasionally, the opposite is the case, which would reverse the sign of bi. We take this arbitrariness into account in any further calculations.
The obtained bi and within a subfield could then be used for the construction of a prior for each subfield separately. We decided to use the Normal distribution for the prior. To obtain a prior, we combined the data through pooling (e.g., [90]). Using this procedure, bi and
were treated as coming from separate samples that were combined into a single pooled sample. One desirable feature of this pooling method is that bi values with higher
are central to (rather than discarded for) the calculation of the pooled standard error. In other words, the
around the bi values had a direct influence on the calculation of the pooled standard error: All else being equal, the higher the
of a sample, the more it would increase the pooled standard error. We deemed this behavior desirable since we wanted the prior to reflect uncertainty. The resulting mean and standard error of a single pooled sample served as the mean and standard deviation of the prior.
We decided against using the inverse-variance weighting procedure that is commonly used in meta-analyses (see, e.g., [91]). The reason for this was that the prior would get increasingly narrow as the corpus of considered studies increases. In addition, bi with high values have a relatively low influence (they are less diagnostic in determining the mean), which was undesirable for our purposes of trying to estimate the spread of the prior. Also, we decided to not use the partly empirical Bayes procedure described in [87] because the nature of it prescribes that the current data (i.e., not only the corpus of prior studies) is used to determine the prior.
Assuming a constant n across studies i and taking into consideration the arbitrariness of the sign of bi by using both bi and −bi for each study i, we can compute the mean of the prior (cf. [90]). Since we consider both bi and −bi for each study i,
must necessarily be 0:
Similarly, we can compute the standard deviation of the prior :
In essence, Eq (8) sums up and it sums up
. Thus, all else being equal,
increases as any of the two quantities increases. Note that our extracted information did not provide information on the sample size ni within each study. We used an arbitrary sample size of n = 200 for all ni. However, in order to verify the robustness of the assumption of equal sample size per study, we randomly varied ni across studies, so that it could take on values sampled from
. We repeated this procedure 100,000 times to accommodate many possible arrangements of ni.
Results
The results for the construction of the Normal priors for the nine subfields through the pooling method [90] can be seen in Fig 2. The panels represent the nine subfields. Histograms show the distributions of bi (and −bi) for the different corpora, independent of . The red curves show the priors resulting from the application of the pooling method [90]. Descriptive statistics can be found in Appendix B.
For all nine subfields, the center of the Normal prior was located at as a necessary consequence of our decision to ignore the sign of bi. The more interesting parameter of the Normal prior is the standard deviation
because it reflects both the effect sizes and the uncertainties around them based on past studies within a subfield. From the histograms and the Normal priors it can be seen that the effect sizes, and therefore also the Normal priors, were similar across the nine subfields.
ranged between 0.915 for “Psychiatry and mental health” and 1.079 for “Gastroenterology”.
Since the calculation of through the pooling method [90] was based on an arbitrary choice of n = 200 that was the same for all studies within a corpus of a specific subfield, we also investigated the dependence of
on n. Fig 3 shows this dependence, where the panels represent the different subfields. The box plots represent the variation of
as a function of ni, where ni for each study i was sampled from
(i.e., different sample sizes were possible across studies), over 100,000 repetitions.
When ni were allowed to vary across studies, some variation in was observed, as shown by the box plots. Still, the variation in
was not radical enough to question our heuristic of using n = 200 for all studies within a corpus of a subfield.
Example application
To illustrate how the obtained priors can be used, we conducted a Bayesian Cox regression on a medical data set, which is described in [92]. In this study, the authors aimed to examine a drug called Remdesivir, which promised to be beneficial for treating patients with Covid-19. The study included participants, of which nc = 521 were randomly placed in the placebo condition and ne = 541 in the Remdesivir condition. All participants had a Covid-19 infection. The primary analysis focused on the amount of time until participants recovered.
It can be argued that this study falls both in the realm of “immunology and allergy” as well as “pulmonary and respiratory medicine” (i.e., and
, respectively). Therefore, we conducted our analyses with both priors. Furthermore, we think that it is always good practice to conduct sensitivity analyses. So, we further extended our used priors to entail Normal priors centered on
with
. We argued that a major advantage of Bayesian statistics is to monitor and optionally stop data collection based on interim results. We demonstrate this procedure on the basis of the data set by [92]. Unfortunately, the data file does not record the order in which participants entered the study. However, for the purposes of this demonstration, we deemed it appropriate to simply take a random order. In essence, we pretend that the study is still ongoing and we stop data collection once the resulting Bayes factor falls outside the decision threshold of 1/20 or 20. In general, the choice for a specific decision threshold should be tailored to the research at hand. There are scenarios where the priority lies with more certainty and scenarios where the priority lies with more efficiency. However, researchers should be aware of the tradeoff between certainty and resource demands; the more certain we want to be, the more cases must be sampled. Lastly, for our analysis we use a one-sided positive alternative hypothesis because it is hypothesized that patients receiving Remdesivir recover quicker than patients receiving a placebo.
Fig 4 shows the development of the Bayes factors as new data enter the study for various priors. The blue and red lines correspond to the “immunology and allergy” and “pulmonary and respiratory medicine” priors and the gray lines to the priors used in the sensitivity analyses. It can be seen that all Bayes factor trajectories cross the upper threshold of 20 at some point, demonstrating the robustness of the findings. For some extreme priors, the upper threshold is already crossed at about 300 observations.
Discussion
Survival analysis, and in particular Cox regression [38], is an indispensable statistical tool for biomedical research. The ubiquitous frequentist framework is limited in that it cannot quantify evidence in favor of the null hypothesis that there is no effect [42] and in that it does not allow continuing or stopping data collection based on interim analyses [47–50,54,55]. Bayes factors remedy these shortcomings and permit intuitive interpretations. Nevertheless, the specification of priors that are required for Bayesian analyses can be difficult.
In this paper, we have developed priors for the parameter in Cox regression for nine subfields in biomedicine (see column 1 in Table 1). These priors were informed by large corpora of already existing studies within the respective subfields and therefore provide reasonable approximations to the to-be-expected effect sizes and uncertainties thereof. For all nine subfields, we decided to use a Normal prior, which is centered on
. We found very similar standard deviations for the Normal priors across the nine subfields, ranging from
for “Psychiatry and mental health” to
for “Gastroenterology”, suggesting considerable similarities across subfields. Since our developed priors differ only slightly across the nine subfields, we believe that it is reasonable to use a standard Normal prior (i.e.,
) for all nine subfields, forming a compromise among the nine individual priors, as a starting point. Still, any choice of prior is always arbitrary to some degree. Therefore, we urge researchers to complement their analysis using a specific prior with sensitivity analyses (e.g., [31,93–95]), in which parameters of the prior are systematically varied and even entirely different (reasonable) priors are chosen, in order to examine the robustness of the resulting Bayes factors.
We caution the reader to not take our proposed priors to be set in stone. The choice of prior always depends to some extent on the goals of the researcher. For example, it might not always be desirable for the prior to accurately reflect expected effects. Sometimes, the focus might be on ensuring sufficient shrinkage of the parameter estimate (e.g., [87,96,97]). Furthermore, we strongly advice researchers to only apply these priors in settings where they are appropriate. That is, these priors should only be applied in Cox regressions. We discourage the transfer of these priors to other methods, such as meta analysis or linear regression. In addition, our developed priors represent expected effect sizes of entire medical fields at a very global level. It is likely that researchers often have access to information that is more tailored to their research question. In that case, we encourage researchers to utilize this more informed and problem-specific information for the construction of a prior. We also want to highlight that researchers should define their prior, including the priors for any sensitivity analyses, before they inspect the data. Trying out multiple priors and then reporting those few that yield favorable results, is bad scientific practice.
Moreover, our process of arriving at the priors contained decisions, assumptions, and heuristics that might be questioned. First, the allocation of the articles to the nine subfields based alone on the journal is a drastic heuristic. A proportion of the articles is therefore probably classified into the wrong subfield. Second, the regular expression that we created to extract hazard ratios and associated confidence intervals from the abstracts of the articles might have been biased to some extent. Some journals have very specific reporting guidelines for the abstracts, which might not have been captured by our regular expression. Thus, it is possible that certain journals were systematically underrepresented in our results. We investigated this potential bias by examining the number of articles that remain after conducting the processing steps shown in Table 1 for each journal in each field. We did not find convincing evidence for a systematic underrepresentation of certain journals (see Appendix C). Third, we only matched abstracts where a hazard ratio is combined with a confidence interval but not abstracts where a hazard ratio is combined with a p-value. We made this decision because p-values often do not map directly onto the confidence intervals. Additional information on how the p-value was calculated would be needed, which is rarely available in abstracts. Fourth, for the Cox regression analyses, we did not differentiate between different types of predictors (e.g., categorical, continuous) and types of analyses (e.g., stratified, multivariate), leaving open the possibility that certain nuances are ignored by our calculations. Fifth, our results are predicated on articles that have come up in the Scopus search engine. Any articles that were published in predatory journals, but that were somehow not screened out as such (see e.g., https://www.elsevier.com/connect/the-guardians-of-scopus), may have introduced bias in the estimate of effect size variance, because of lack of proper peer review. Sixth, we assumed that HR refers to hazard ratio in the abstracts. However, HR could also be an abbreviation for other terms like heart rate. To mitigate this concern, we manually screened a random sample of 88 articles for which we could obtain a match and found that in all cases HR corresponded to hazard ratio.
It is clear that our proposed priors for Bayesian Cox regressions are very generic, such that one individual prior accommodates an entire subfield (or even all nine subfields if we are willing to accept the standard Normal prior). These priors might still be appropriate approximations for smaller specializations within subfields. However, in these cases it might be worthwhile to obtain more informed and precise priors that are tailored to these smaller subfields.
Conclusion
The analysis of time-to-event data with Cox regression [38] is pervasive in biomedical research. Cox regression combined with Bayes factors has much to offer over traditional frequentist inference because it allows researchers to directly contrast the evidence for the null and alternative hypotheses [42] and because it allows monitoring results during data collection and continue or stop at any time [47–50,54,55]. These characteristics of Bayes factors have the potential to reduce the waste of scarce resources in biomedical research and especially clinical trials [53,98]. However, the specification of priors for these Bayesian analyses can be challenging and be perceived as overly subjective. We propose default priors in Cox regression that are informed by large corpora of already existing studies for nine subfields. These priors are all Normal distributions centered on 0 with standard deviations that are close to 1. They can be used as a default or starting point for medical researchers and can be augmented with sensitivity analyses.
Appendix A: Comparison of abstract and main text matches
To mitigate the possibility that the effect size distributions are biased, we took our database of articles found on Scopus that matched any of the journals listed in Scimago, yielding 36,431 articles (see Table 1 in the manuscript). Of those articles, we randomly sampled 100 articles for which we could not match results in the abstract with our regular expression (no-match group); and we randomly sampled 100 articles for which we could match results in the abstract with our regular expression (match group). Then, we tried to obtain the full texts of these 200 articles. We were able to obtain 86 full texts for the no-match group and 88 full texts for the match group (some articles were not accessible to us). We transformed the PDF files into txt files using the pdftotext command from the Xpdfreader tool https://www.xpdfreader.com/. Then we manually removed the abstracts from the txt files. Subsequently, we used the same regular expression to match results in the main text of the txt files. Fig 5 shows a plot that compares the effect size distributions for extracted results from the abstracts and the main text. As can be seen, the effect size distributions look similar across the different panels, providing evidence that there is probably no strong bias.
1. Descriptive statistics for medical fields
See Tables 2, 3, 4, 5, 6, 7, 8, 9, and 10.
2. Article retention rate across processing steps
We further investigated the possibility that certain journals are underrepresented in our results by examining the article retention rates over processing steps across fields and journals. In particular, looking at Table 1, it can be seen that there are three processing steps involved: First, Scopus articles are selected based on whether they match the Scimago journal names. Second, articles are selected for which we could obtain a match for the regular expression. Third, of the matched articles, we filtered out articles for which our regular expression yielded ambiguous/wrong results. Fig 6 shows the proportion of articles remaining in a specific field (panels) and journal (lines) when transitioning from the first to the second step (S1) and from the second to the third step (S2). However, journals for which the number of articles is 0 at some processing step are filtered out because the division with 0 is problematic. It can be seen that there is some variation between journals at S1 for all fields. This variation decreases drastically at S2 for all fields.
Note that journals for which the number of articles is 0 at some processing step were not considered here.
References
- 1. Stupp R, Hegi ME, Mason WP, van den Bent MJ, Taphoorn MJB, Janzer RC, et al. Effects of radiotherapy with concomitant and adjuvant temozolomide versus radiotherapy alone on survival in glioblastoma in a randomised phase III study: 5-year analysis of the EORTC-NCIC trial. Lancet Oncol. 2009;10(5):459–66. pmid:19269895
- 2. D’Agostino RB Sr, Vasan RS, Pencina MJ, Wolf PA, Cobain M, Massaro JM, et al. General cardiovascular risk profile for use in primary care: the Framingham Heart Study. Circulation. 2008;117(6):743–53. pmid:18212285
- 3. Kenchaiah S, Evans JC, Levy D, Wilson PWF, Benjamin EJ, Larson MG, et al. Obesity and the risk of heart failure. N Engl J Med. 2002;347(5):305–13. pmid:12151467
- 4. Boney CM, Verma A, Tucker R, Vohr BR. Metabolic syndrome in childhood: association with birth weight, maternal obesity, and gestational diabetes mellitus. Pediatrics. 2005;115(3):290–6. pmid:15741354
- 5. Diener HC, Bogousslavsky J, Brass LM, Cimminiello C, Csiba L, Kaste M, et al. Aspirin and clopidogrel compared with clopidogrel alone after recent ischaemic stroke or transient ischaemic attack in high-risk patients (MATCH): randomised, double-blind, placebo-controlled trial. The Lancet. 2004;364(9431):331–7.
- 6. Singh R, Mukhopadhyay K. Survival analysis in clinical trials: basics and must know areas. Perspect Clin Res. 2011;2(4):145–8. pmid:22145125
- 7.
Harrell FE. Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. 2nd ed. New York, NY: Springer; 2015.
- 8. Clark TG, Bradburn MJ, Love SB, Altman DG. Survival analysis part I: basic concepts and first analyses. Br J Cancer. 2003;89(2):232–8.
- 9. Clark TG, Bradburn MJ, Love SB, Altman DG. Survival analysis part IV: further concepts and methods in survival analysis. Br J Cancer. 2003;89(5):781–6. pmid:12942105
- 10. Bradburn MJ, Clark TG, Love SB, Altman DG. Survival analysis part II: multivariate data analysis - an introduction to concepts and methods. Br J Cancer. 2003;89(3):431–6. pmid:12888808
- 11. Bradburn MJ, Clark TG, Love SB, Altman DG. Survival analysis Part III: multivariate data analysis - choosing a model and assessing its adequacy and fit. Br J Cancer. 2003;89(4):605–11. pmid:12915864
- 12.
Hosmer DW, Lemeshow S, May S. Applied survival analysis: regression modeling of time-to-event data. 2nd ed. Hoboken, NJ: Wiley; 2008.
- 13.
Klein JP, Moeschberger ML. Survival analysis: techniques for censored and truncated data. Springer: New York, NY; 1997.
- 14.
Therneau TM, Grambsch PM. Modeling survival data: extending the Cox model. New York, NY: Springer; 2000.
- 15.
Collett D. Modelling survival data in medical research. 3rd ed. Boca Raton, FL: CRC Press; 2015.
- 16. Kantoff PW, Higano CS, Shore ND, Berger ER, Small EJ, Penson DF, et al. Sipuleucel-T immunotherapy for castration-resistant prostate cancer. N Engl J Med. 2010;363(5):411–22. pmid:20818862
- 17. Rinke A, Müller H-H, Schade-Brittinger C, Klose K-J, Barth P, Wied M, et al. Placebo-controlled, double-blind, prospective, randomized study on the effect of octreotide LAR in the control of tumor growth in patients with metastatic neuroendocrine midgut tumors: a report from the PROMID Study Group. J Clin Oncol. 2009;27(28):4656–63. pmid:19704057
- 18. Brard C, Le Teuff G, Le Deley M-C, Hampson LV. Bayesian survival analysis in clinical trials: what methods are used in practice? Clin Trials. 2017;14(1):78–87. pmid:27729499
- 19. Yu EC, Sprenger AM, Thomas RP, Dougherty MR. When decision heuristics and science collide. Psychonom Bull Rev. 2014;21:268–82.
- 20. Berry DA. Bayesian clinical trials. Nat Rev Drug Discov. 2006;5(1):27–36.
- 21. Moye LA. Bayesians in clinical trials: asleep at the switch. Statist Med. 2008;27(4):469–82.
- 22. Pocock SJ. Group sequential methods in the design and analysis of clinical trials. Biometrika. 1977;64(2):191–9.
- 23. van de Schoot R, Winter SD, Ryan O, Zondervan-Zwijnenburg M, Depaoli S. A systematic review of Bayesian articles in psychology: the last 25 years. Psychol Methods. 2017; 22(2):217–39.
- 24.
Jeffreys H. Theory of probability. Oxford, UK: The Clarendon Press; 1939.
- 25.
Jeffreys H. Theory of probability. 2nd ed. Oxford, UK: The Clarendon Press; 1948.
- 26.
Jeffreys H. Theory of probability. 3rd ed. Oxford, UK: Oxford University Press; 1961.
- 27. Kass RE, Raftery AE. Bayes factors. J Am Statist Assoc. 1995;90(430):773–95.
- 28. Goodman S. Toward evidence-based medical statistics. 2: the Bayes factor. Ann Intern Med. 1999;130(12):1005–13. pmid:10383350
- 29. Kruschke JK. Bayesian data analysis. Wiley Interdiscip Rev Cogn Sci. 2010;1(5):658–76. pmid:26271651
- 30. Kruschke JK, Liddell TM. Bayesian data analysis for newcomers. Psychon Bull Rev. 2018;25(1):155–77. pmid:28405907
- 31.
Kruschke JK. Doing Bayesian data analysis: a tutorial with R, JAGS, and Stan. 2nd ed. Boston, MA: Academic Press; 2015.
- 32. Vanpaemel W. Prior sensitivity in theory testing: an apologia for the Bayes factor. J Math Psychol. 2010;54(6):491–8.
- 33. Sinharay S, Stern HS. On the sensitivity of Bayes factors to the prior distributions. Am Statist. 2002;56(3):196–201.
- 34. Liu CC, Aitkin M. Bayes factors: prior sensitivity and model generalizability. J Math Psychol. 2008;52(6):362–75.
- 35. Gallistel CR. The importance of proving the null. Psychol Rev. 2009;116(2):439–53. pmid:19348549
- 36. Tendeiro JN, Kiers HAL. A review of issues about null hypothesis Bayesian testing. Psychol Methods. 2019;24(6):774–95.
- 37. Efron B. Why isn’t everyone a Bayesian? Am Statist. 1986;40(1):1–5.
- 38. Cox DR. Regression models and life-tables. J Roy Statist Soc Ser B: Statist Methodol. 1972;34(2):187–202.
- 39. Kaplan EL, Meier P. Nonparametric estimation from incomplete observations. J Am Statist Assoc. 1958;53(282):457–81.
- 40. Chavalarias D, Wallach JD, Li AHT, Ioannidis JPA. Evolution of reporting P values in the biomedical literature, 1990–2015. JAMA. 2016;315(11):1141–8. pmid:26978209
- 41. Goodman SN. Toward evidence-based medical statistics. 1: the p value fallacy. Annal Intern Med. 1999;130(12):995–1004. pmid:10383371
- 42. Rouder JN, Speckman PL, Sun D, Morey RD, Iverson G. Bayesian t tests for accepting and rejecting the null hypothesis. Psychonom Bull Rev. 2009;16(2):225–37.
- 43. Bakan D. The test of significance in psychological research. Psychol Bull. 1966;66(6):423–37.
- 44. Ioannidis JPA. Why most published research findings are false. PLoS Med. 2005;2(8):e124. pmid:16060722
- 45. Hoekstra R, Monden R, van Ravenzwaaij D, Wagenmakers EJ. Bayesian reanalysis of null results reported in medicine: strong yet variable evidence for the absence of treatment effects. PLoS ONE. 2018;13(4):e0195474. pmid:29694370
- 46. Wagenmakers EJ. A practical solution to the pervasive problems of p values. Psychon Bull Rev. 2007;14(5):779–804.
- 47. Armitage P, McPherson CK, Rowe BC. Repeated significance tests on accumulating data. J Roy Statist Soc Ser A (Gen). 1969;132(2):235–44.
- 48. Rouder JN. Optional stopping: no problem for Bayesians. Psychon Bull Rev. 2014;21(2):301–8.
- 49. Tendeiro JN, Kiers HAL, van Ravenzwaaij D. Worked-out examples of the adequacy of Bayesian optional stopping. Psychon Bull Rev. 2022;29(1):70–87. pmid:34254263
- 50. Schönbrodt FD, Wagenmakers EJ, Zehetleitner M, Perugini M. Sequential hypothesis testing with Bayes factors: efficiently testing mean differences. Psychol Methods. 2017;22(2):322–39.
- 51. International Committee of Medical Journal Editors. Uniform requirements for manuscripts submitted to biomedical journals. Pathology. 1997;29(4):441–7.
- 52. Rennie D. Vive la différence (p less than 0.05). N Engl J Med. 1978;299:828–9. pmid:692566
- 53. van Ravenzwaaij D, Monden R, Tendeiro JN, Ioannidis JPA. Bayes factors for superiority, non-inferiority, and equivalence designs. BMC Med Res Methodol. 2019;19(1):71. pmid:30925900
- 54. Schönbrodt FD, Wagenmakers EJ. Bayes factor design analysis: planning for compelling evidence. Psychon Bull Rev. 2018;25(1):128–42. pmid:28251595
- 55. Stefan AM, Schönbrodt FD, Evans NJ, Wagenmakers EJ. Efficiency in sequential testing: comparing the sequential probability ratio test and the sequential Bayes factor test. Behav Res Methods. 2022;54(6):3100–17.
- 56. Gronau QF, Sarafoglou A, Matzke D, Ly A, Boehm U, Marsman M, et al. A tutorial on bridge sampling. J Math Psychol. 2017;81:80–97. pmid:29200501
- 57. van Ravenzwaaij D, Cassey P, Brown SD. A simple introduction to Markov Chain Monte-Carlo sampling. Psychon Bull Rev. 2018;25(1):143–54. pmid:26968853
- 58.
Gilks WR, Richardson S, Spiegelhalter D. Markov chain Monte Carlo in practice. Boca Raton, FL: Chapman & Hall/CRC; 1995.
- 59.
Brooks S, Gelman A, Jones GL, Meng XL. Handbook of Markov chain Monte Carlo. New York, NY: Chapman & Hall/CRC; 2011.
- 60.
Betancourt M. A conceptual introduction to Hamiltonian Monte Carlo; 2018. Available from: https://arxiv.org/abs/1701.02434
- 61. Bartoš F, Aust F, Haaf JM. Informed Bayesian survival analysis. BMC Med Res Methodol. 2022;22(1):238. pmid:36088281
- 62.
Linde M, Tendeiro JN, van Ravenzwaaij D. Bayes factors for two-group comparisons in Cox regression. 2022.
- 63.
Linde M, van Ravenzwaaij D, Tendeiro JN. Baymedr: computation of Bayes factors for common biomedical designs. 2022. Available from: https://github.com/maxlinde/baymedr
- 64.
Bartoš F. RoBSA: an R package for robust Bayesian survival analyses; 2022. Available from: https://CRAN.R-project.org/package=RoBSA
- 65. Rouder JN, Morey RD, Speckman PL, Province JM. Default Bayes factors for ANOVA designs. J Math Psychol. 2012;56(2):356–74.
- 66. Gronau QF, Ly A, Wagenmakers EJ. Informed Bayesian t-tests. Am Statist. 2020;74(2):137–43.
- 67.
Morey R, Rouder J. BayesFactor: computation of Bayes factors for common designs. 2018. Available from: https://CRAN.R-project.org/package=BayesFactor
- 68.
Gu X, Hoijtink H, Mulder J, van Lissa CJ. Bain: Bayes factors for informative hypotheses. 2021. Available from: https://CRAN.R-project.org/package=bain
- 69. van Lissa CJ, Gu X, Mulder J, Rosseel Y, van Zundert C, Hoijtink H. Teacher’s corner: evaluating informative hypotheses using the Bayes factor in structural equation models. Struct Eq Model: Multidiscip J. 2021;28(2):292–301.
- 70.
Heck DW, Boehm U, Böing-Messing F, Bürkner PC, Derks K, Dienes Z, et al. A review of applications of the Bayes factor in psychological research. 2020. Available from: https://psyarxiv.com/cu43g
- 71.
JASP Team. JASP (Version 0.17.2). 2023. Available from: https://jasp-stats.org/
- 72. Berger J. The case for objective Bayesian analysis. Bayesian Anal. 2006;1(3):385–402.
- 73. Goldstein M. Subjective Bayesian analysis: principles and practice. Bayesian Anal. 2006;1(3):403–20.
- 74. Bayarri MJ, Berger JO, Forte A, García-Donato G. Criteria for Bayesian model choice with application to variable selection. Ann Statist. 2012;40(3):1550–77.
- 75. Consonni G, Fouskakis D, Liseo B, Ntzoufras I. Prior distributions for objective Bayesian analysis. Bayesian Anal. 2018;13(2):627–79.
- 76. Dienes Z. Bayesian versus orthodox statistics: which side are you on? Perspect Psychol Sci. 2011;6(3):274–90.
- 77. Thall PF, Cook JD. Dose-finding based on efficacy-toxicity trade-offs. Biometrics. 2004;60(3):684–93.
- 78. Guo B, Park Y, Liu S. A utility-based Bayesian Phase I–II design for immunotherapy trials with progression-free survival end points. J Roy Statist Soc Ser C: Appl Statist. 2019;68(2):411–25.
- 79. Johnson SR, Tomlinson GA, Hawker GA, Granton JT, Feldman BM. Methods to elicit beliefs for Bayesian priors: a systematic review. J Clin Epidemiol. 2010;63:355–69. pmid:19716263
- 80. van de Schoot R, Sijbrandij M, Depaoli S, Winter SD, Olff M, van Loey NE. Bayesian PTSD-trajectory analysis with informed priors based on a systematic literature search and expert elicitation. Multiv Behav Res. 2018;53(2):267–91.
- 81. Zondervan-Zwijnenburg M, Peeters M, Depaoli S, van de Schoot R. Where do priors come from? Applying guidelines to construct informative priors in small sample research. Res Hum Develop. 2017;14(4):305–20.
- 82. Stefan AM, Evans NJ, Wagenmakers EJ. Practical challenges and methodological flexibility in prior elicitation. Psychol Methods. 2022;27(2):177–97. pmid:32940511
- 83.
O’Hagan A, Buck CE, Daneshkhah A, Eiser JR, Garthwaite PH, Jenkinson DJ, et al. Uncertain judgements: eliciting experts’ probabilities. Chichester, UK: John Wiley & Sons; 2006.
- 84. Morris DE, Oakley JE, Crowe JA. A Web-based tool for eliciting probability distributions from experts. Environ Model Softw. 2014;52:1–4.
- 85. Rietbergen C, Klugkist I, Janssen KJM, Moons KGM, Hoijtink HJA. Incorporation of historical data in the analysis of randomized therapeutic trials. Contemp Clin Trials. 2011;32(6):848–55. pmid:21729767
- 86. Casella G. An introduction to empirical Bayes data analysis. Am Statist. 1985;39(2):83–7.
- 87. van Zwet E, Gelman A. A proposal for informative default priors scaled by the standard error of estimates. Am Statist. 2022;76(1):1–9.
- 88.
SCImago. SJR - SCImago Journal & Country Rank [Portal]; n.d. Available from: http://www.scimagojr.com
- 89.
Friedl JEF. Mastering regular expressions. 4th ed. Sebastopol, CA: O’Reilly Media; 2006.
- 90.
Higgins JPT, Li T, Deeks JJ. Choosing effect measures and computing estimates of effect. In: Higgins JPT, Thomas J, Chandler J, Cumpston M, Li T, Matthew PJ, et al., editors. Cochrane handbook for systematic reviews of interventions. 2nd ed. Chichester, UK: John Wiley & Sons; 2019. pp. 143–76.
- 91.
Borenstein M, Hedges LV, Higgins JPT, Rothstein HR. Introduction to meta-analysis. 2nd ed. Hoboken, NJ: John Wiley & Sons; 2021.
- 92. Beigel JH, Tomashek KM, Dodd LE, Mehta AK, Zingman BS, Kalil AC, et al. Remdesivir for the treatment of Covid-19 - final report. N Engl J Med. 2020;383(19):1813–26. pmid:32445440
- 93. Berger JO, Moreno E, Pericchi LR, Bayarri MJ, Bernardo JM, Cano JA, et al. An overview of robust Bayesian analysis. Test. 1994;3(1):5–124.
- 94. Du H, Edwards MC, Zhang Z. Bayes factor in one-sample tests of means with a sensitivity analysis: a discussion of separate prior distributions. Behav Res Methods. 2019;51(5):1998–2021. pmid:31161425
- 95. Depaoli S, van de Schoot R. Improving transparency and replication in Bayesian statistics: the WAMBS-checklist. Psychol Methods. 2017;22(2):240–61. pmid:26690773
- 96. van Erp S, Oberski DL, Mulder J. Shrinkage priors for Bayesian penalized regression. J Math Psychol. 2019;89:31–50.
- 97. Park T, Casella G. The Bayesian Lasso. J Am Statist Assoc. 2008;103(482):681–6.
- 98. Macleod MR, Michie S, Roberts I, Dirnagl U, Chalmers I, Ioannidis JPA, et al. Biomedical research: increasing value, reducing waste. The Lancet. 2014;383(9912):101–4. pmid:24411643