Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

Vitamin D, acute respiratory infections, and Covid-19: The curse of small-size randomised trials. A critical review with meta-analysis of randomised trials

  • Philippe Autier ,

    Roles Conceptualization, Data curation, Methodology, Supervision, Validation, Visualization, Writing – original draft

    Philippe.autier@i-pri.org

    Affiliation International Prevention Research Institute (iPRI), Bat. L’Américain, Dardilly, France

  • Giulia Doi,

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Experimental Oncology, European Institute of Oncology, IRCCS, Milano, Italy

  • Patrick Mullie,

    Roles Conceptualization, Data curation, Formal analysis, Writing – review & editing

    Affiliations Academic Centre for General Practice, Department of Public Health and Primary Care, Catholic University Leuven, Leuven, Belgium, Belgian Centre for Evidence-Based Medicine, Cochrane Belgium, Leuven, Belgium, DG H&WB, Queen Elisabeth Barracks, Belgian Defence, Evere, Belgium

  • Patrick Vankrunkelsven,

    Roles Writing – review & editing

    Affiliations Academic Centre for General Practice, Department of Public Health and Primary Care, Catholic University Leuven, Leuven, Belgium, Belgian Centre for Evidence-Based Medicine, Cochrane Belgium, Leuven, Belgium

  • Oriana D’Ecclesiis,

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Experimental Oncology, European Institute of Oncology, IRCCS, Milano, Italy

  • Sara Gandini

    Roles Formal analysis, Writing – review & editing

    Affiliation Department of Experimental Oncology, European Institute of Oncology, IRCCS, Milano, Italy

Abstract

Background

Randomised trials conducted from 2006 to 2021 indicated that vitamin D supplementation (VDS) was able to prevent severe COVID-19 and acute respiratory infections (ARI). However, larger randomised trials published in 2022 did not confirm the health benefits of VDS in COVID-19 patients.

Objective

To examine through a systematic review with meta-analysis the characteristics of randomised trials on VDS to COVID-19 patients and admission to intensive care unit (ICU), and of randomised trials on VDS for the prevention of ARI.

Method

A systematic search retrieved randomised trials on VDS to COVID-19 patients and admission to ICU. Data on VDS and ARI were extracted from the meta-analysis of Jolliffe et al. 2021. Groups were formed including trials with total numbers of patients below or above the median size of all trials. The associations between VDS vs no VDS, and admission to ICU were evaluated using random-effects models from which summary odds ratios (SOR) and 95% confidence intervals (CI) were obtained. Meta-analyses were done for all trials and for each group of trials, which allowed testing a possible effect modification of trial size. Publication bias was assessed using the Louis-Furuya-Kanaruori (LFK) index (no bias if index between -1 and +1) and the trim and fill method.

Results

Nine trials on VDS for preventing admission to ICU were identified, including 50 to 548 patients. The summary odds ratio (SOR) was 0.61 (95% CI: 0.39–0.95) for all trials, 0.34 (0.13–0.93) for trials including 50 to <106 patients and 0.88 (0.62–1.24) for trials including 106 to 548 patients (interaction p = 0.04). The LFK index was -3.79, and after trim and fill, the SOR was 0.80 (0.40–1.61). The SOR for the 37 trials on VDS for ARI prevention included 25 to 16,000 patients. The SOR was 0.92 (0.86–0.99) for all trials, 0.69 (0.57–0.83) for trials including 25 to <248 patients and 0.98 (0.94–1.03) for trials including 248 to 16,000 patients (interaction p = 0.0001). The LFK index was -3.11, and after trim and fill, the SOR was 0.96 (0.88–1.05).

Conclusion

Strong publication bias affected small randomised trials on VDS for the prevention of severe COVID-19 and of ARI. Systematic reviews should beware of small-size randomised trials that generally exaggerate health benefits.

Introduction

When the COVID-19 pandemic struck the World in 2019–2021, many thought that vitamin D supplementation (VDS) was an option for reducing the risk of COVID-19 and progression to severe disease [13]. The VDS option was nurtured by a wealth of data. First, laboratory studies have documented the involvement of physiologically active forms of vitamin D in immunological mechanisms dealing with infectious agents [47]. Second, the serum concentration of 25-hydroxyvitamin D (hereafter s-25OHD) is usually considered reflecting individual vitamin D status. Numerous observational studies done before and after the pandemic onset found first that patients with low s-25OHD were at higher risk of severe acute respiratory infections (ARI) and severe COVID-19 [810], and second that COVID-19 patients taking VDS had less severe disease course [11]. Third, a meta-analysis of aggregated data from 37 trials conducted between 2006 and 2019 found that VDS was associated with a 8% (95% confidence interval [CI]: 1% to 14%) reduction in the risk of ARI [12]. Fourth, randomised trials published in 2020 and 2021 obtained results compatible with a favourable effect of VDS on COVID-19 outcomes [13].

However, the promises of the VDS option were tempered by the publication in 2022 of large size randomised trials that found no effect of VDS on the incidence and severity of COVID-19 [1416]. In addition, six Mendelian randomisation studies examined the risk of incidence and severity of COVID-19 in patients whose s-25OHD is lower than average because of their genetic background. Patients with naturally low s-25OHD had no greater risk of COVID-19 incidence or severity than patients with higher s-25OHD [1722].

Systematic reviews play a pivotal role in the development of clinical practice guidelines and the formulation of healthcare policies, serving as a robust foundation for setting standards of care [23]. Therefore the disillusionment caused by Mendelian and large-size randomised trials called for a review of the thread of data which resulted in considering VDS as an option for the treatment of COVID-19. This article is a systematic review with meta-analysis of randomised trials on VDS for the prevention of severe COVID-19 in patients infected with the SARS-CoV-2 virus. This article also revisited the meta-analysis of randomised trials of VDS done before 2020 for the prevention of ARI [12].

Methods

Literature search

This review was not registered. A scoping review of the literature end of 2022 showed that the most robust outcome indicating severe COVID-19 disease was the admission to intensive care unit (ICU). Other possible outcomes were less robust (e.g. admission to hospital), or possibly influenced by subjectivity (e.g. self-reported dyspnoea, resolution of symptoms, duration of hospitalisation).

In October 2022, PA and PM performed a systematic search restricted to PubMed of randomised trials published since January 2000 on VDS and outcomes of COVID-19 patients aged 18 years or more. The search was done in two successive steps (S1 File). We also searched references cited in review articles.

Studies were selected if (i) they reported on randomised trials that compared rates of admission to ICU or COVID-19 patients receiving VDS with patients not receiving VDS, (ii) VDS was the unique intervention, (iii) COVID-19 patients enrolled in trials were not taking VDS before trial enrolment, (iv) comparison groups included COVID-19 patients who did not receive any type of VDS during trial courses, and (v) published in English language. All forms of vitamin D were considered (ergocalciferol (vitamin D2), cholecalciferol (vitamin D3), calcifediol (25-hydroxycholecalciferol), calcitriol (1α,25-dihydroxycholecalciferol)). The selection of article was performed by all authors, with disagreements resolved via consensus.

Data extraction

Key study characteristics and data of selected studies were first extracted by PA and PM, and then independently verified by GD and OD. Disagreements were resolved via consensus.

Extracted information were first author, publication year, patient numbers by randomisation group, intervention, comparison groups (i.e. whether the VDS intervention was tested against a placebo, or no placebo), and numbers of patients with outcome by randomisation group. Key data on patient numbers and outcomes (i.e. odds ratios [OR] and 95% CI) included in the meta-analysis of Jolliffe et al. 2021 [12] were extracted by PA and PM. There was no missing data.

Risk of bias assessment

For trials on VDS in COVID-19 patients and admission to ICU, we assessed seven sources of bias following items of the Cochrane’s risk of bias (RoB-1) tool [24]:

  • patient selection and randomisation procedure,
  • placebo control, yes or no,
  • blinding to evaluate the risk of performance bias due to knowledge of the allocated interventions by participants and personnel during the study,
  • allocation concealment to evaluate the risk of selection bias (biased allocation to interventions) due to inadequate concealment of allocations prior to assignment,
  • outcome assessment to assess the risk of reporting bias due to selective outcome reporting.
  • analysis to evaluate the risk of attrition bias due to amount, nature or handling of incomplete outcome data.
  • other sources of bias.

In order to illustrate the RoB results, we used a bar plot of the distribution of risk-of-bias judgments within each bias domain and a "traffic light" plot [25].

Statistical analysis

For trials in COVID-19 patients, risks of admission to ICU were computed as odds ratios with 95% CI following a per-protocol approach. Hence, statistical analyses were done using data from patients who took the VDS or the placebo (when applicable) according to trial protocols.

Standard errors (SE) of odds ratios (OR) were derived from the equation SQRT(1/a+1/b+1/c+1/d), where a and b are the numbers of patients admitted to ICU in the VDS and in the comparison group, respectively, and c and d are the numbers of patients not admitted to ICU in the VDS and in the comparison group, respectively.

For the meta-analysis on VDS of COVID-19 patients and admission in ICU, we used random-effects models to calculate summary odds ratios and 95% CI of admission to ICU of COVID-19 patients.

Random-effects models necessitate the estimation of the between-study variance τ2. Various methods exist for computing an estimator of the between-study variance τ2 and for estimating its confidence interval. Mathematical simulations have shown that the widely used Der Simonian-Laird estimator is known to be negatively biased in scenarios with small studies and in scenarios with a rare binary outcome [26].

Because most randomised trials found in the systematic search were of small and medium size, i.e. from about 40 to 400 patients enrolled, we opted to use the REML (Restricted Maximum Likelihood) estimator, and the REML estimator combined with the HKSJ (Hartung-Knapp-Sidik-Jonkman) method for estimating the 95% CI [27, 28].

For the meta-analysis on VDS for ARI prevention [12], we computed pooled estimate applying the Der Simonian-Laird method in order to reproduce the original analysis.

Then for both meta-analyses, statistical heterogeneity was evaluated through the I2 index: a value <50% was considered indicative of low or moderate between-study heterogeneity [29]. To investigate the between-study heterogeneity and the stability of the pooled estimate, we carried out a sensitivity analysis by excluding from the meta-analysis one of the trials at a time.

We evaluated the presence of possible publication bias, using Egger’s regression test, and the Makaskill test. We also used the method proposed by Furuya-Kanamori et al. [30], which displays in a Doi plot the weight of each trial (i.e. the sample size of each trial relative to the size of all trials combined, expressed as a Z-score) against the natural logarithm of odds ratios reported by trials. The Louis-Furuya-Kanaruori (LFK) index derived from the Doi plot provides a quantitative estimate of the asymmetry of odds ratios included in the meta-analysis. A LFK index of zero indicates an absence of asymmetry. Asymmetry, and thus the possibility of publication bias, is suggested by a LFK index less than -1 (studies not in favour of VDS less likely to be published) or greater than +1 (studies in favour of VDS less likely to be published).

We performed an exploratory analysis of publication bias using the trim and fill method [31], which provides summary odds ratios adjusted for publication bias.

We studied the effect of the sample size through a subgroup analysis, by dividing the trials based on their sample sizes (lower or greater than the median), and including in our statistical models the trial size as a possible effect modifier.

All reported p-values were two sided and p<0.05 was considered statistically significant. Meta-analyses were carried out by using the R-Studio software (R version 4.1.1).

Results

VDS to COVID-19 patients and admission to ICU

The literature search is depicted in Fig 1. Three articles [3234] were found during hand search of review articles. After full article reading, nine articles [16, 32, 3541] were selected for review and 11 articles were excluded (S2 Table). Reasons for exclusion were: high vs. low dose VDS [42, 43], no specific numbers of patients who were admitted in ICU [14, 15, 34, 4447], failure of randomisation [33], and not a randomised trial [48].

Characteristics of the nine selected randomised trials are summarized in Table 1. Data extracted for the meta-analysis are displayed in S3 Table.

thumbnail
Table 1. Randomised trials on vitamin D supplementation of COVID-19 patients and admission in ICU.

https://doi.org/10.1371/journal.pone.0303316.t001

The vitamin D compound were cholecalciferol (5 trials), calcifediol (2 trials), or calcitriol (1 trial). VDS dosages and regimens were variable with daily intake in six trials and bolus administration in three trials. Four trials were placebo controlled and five trials were open-label. The numbers of COVID-19 patients enrolled in trials ranged from 50 to 548. The odds ratios for admission in ICU ranged from 0.02 to 1.06, with wide 95% CI. The risk of bias analysis is detailed in S1 Fig. Five trials had a low risk of bias, and four had a high risk of bias due to lack of placebo groups.

The meta-analysis of the nine trials based on the RMLE estimator resulted in a summary odds ratio of 0.61 (95% CI: 0.39–0.95) (Fig 2, Table 2), with low heterogeneity (I2 = 35%), suggesting that overall COVID-19 patients taking VDS would have a substantially decreased risk of admission to ICU.

thumbnail
Fig 2. Forest plot of randomised trials on VDS of COVID-19 patients and admission to ICU.

https://doi.org/10.1371/journal.pone.0303316.g002

thumbnail
Table 2. Meta-analysis of randomised trials on VDS of COVID-19 patients and admission in ICU.

https://doi.org/10.1371/journal.pone.0303316.t002

The Egger and the modified Macaskill tests indicated significant publication bias (Table 2). The display of odds ratios from the nine trials in a Doi plot (Fig 3A) showed a distribution markedly stretched to the left, witnessing a negative publication bias, i.e. trials not favouring a reduction of admissions to ICU associated with VDS were less likely to be published than trials favouring a reduction of admissions to ICU associated with VDS. Of note, the smaller the trial size (i.e. the higher the Z-score), the greater the risk reductions, i.e. ln(OR) moving towards negative values far from zero.

thumbnail
Fig 3.

Doi plot (a) and funnel plot after trim and fill correction (b) for randomised trials on VDS and admission to ICU.

https://doi.org/10.1371/journal.pone.0303316.g003

The LFK index of -3.79, well below -1.0, quantifies the strong imbalance by which trials in favour of VDS had a much greater probability to be published than trials in favour of VDS.

The trim and fill method resulted in the addition of four open circles on the funnel plot (Fig 3B). These open circles are imputations of results of four hypothetical smaller-size trials not in favour of VDS that should have been published for completely excluding the possibility of publication bias. After application of the trim and fill method, the summary odds ratio increased to 0.80 (95% CI: 0.40–1.61), which was no longer significant.

Exclusion of one trial at a time from the meta-analysis showed that exclusion of Entrenas-Castillo et al. 2020 [35] of the meta-analysis ended up in a non-significant summary odds ratio of 0.78, with a drastic drop in heterogeneity between results of the eight other trials (I2 = 4%).

After stratification of trials according to numbers of patients enrolled (Table 2), the summary odds ratios were 0.34 (95% CI: 0.13–0.93) for the five trials including 50 to 105 COVID-19 patients, and 0.88 (95% CI: 0.62–1.24) for the four trials including 106 to 548 patients. The interaction between random group allocation and trial size had a p-value of 0.04, suggesting that sample size was an effect modifier.

Use of the RMLE estimator with Hartung-Knapp-Sidik-Jonkman (HKSJ) method for the 95% CI resulted in a summary odds ratio of 0.61 (95% CI: 0.32–1.16). If the summary odds ratio remained the same, the 95% CI was wider, from 0.56 (= 0.95 minus 0.39) when the RMLE estimator only was used to 0.72 (= 1.16 minus 0.32) when the RMLE estimator and the HKSJ methods were used. Because of the wider 95% CI, the risk of admission to ICU was no longer significant. All other meta-analysis results remained equivalent or close to results when the RMLE estimator only was used, but owing to the larger confidence interval, the interaction between random group allocation and trial size was no longer significant.

VDS for ARI prevention

The 37 trials on VDS for the prevention of ARI included in the publication of Jolliffe et al. 2021 [12] enrolled 25 to 16,000 participants (median of 247). The meta-analysis of the 37 trials resulted in a summary odds ratio of 0.92 (95% CI: 0.86–0.99), suggesting a beneficial effect of VDS on the risk of ARI. But the Egger and the modified Macaskill tests provided evidence for significant publication bias (Table 3).

thumbnail
Table 3. Meta-analysis of randomised trials on VDS of the prevention of ARI and admission in ICU.

https://doi.org/10.1371/journal.pone.0303316.t003

The display of odds ratios from the 37 trials in a Doi plot (Fig 4A) showed a distribution markedly stretched to the left, witnessing a negative publication bias, i.e. trials not favouring a reduction of ARI associated with VDS were less likely to be published than trials favouring a reduction of ARI associated with VDS. The smaller the trial size (i.e. the higher the Z-Score), the greater the reduction of the risk of ARI, i.e. ln(OR) moving towards negative values far from zero.

thumbnail
Fig 4.

Doi plot (a) and funnel plot after trim and fill correction (b) for randomised trials on VDS and occurrence of ARI.

https://doi.org/10.1371/journal.pone.0303316.g004

The LFK index of -3.11, well below -1.0, quantifies the strong imbalance by which trials in favour of VDS had a much greater probability to be published than trials not in favour of VDS.

The trim and fill method resulted in the addition of eight open-circle points on the funnel plot (Fig 4B). These open-circle points are imputed results of hypothetical smaller-size trials not in favour of VDS that should have been published for completely excluding the possibility of publication bias. After application of the trim and fill method, the summary odds ratio increased to 0.96 (95% CI: 0.88–1.95), which was no longer significant.

The meta-analysis of the 19 trials including 25 to 247 patients obtained a summary odds ratio of 0.69 (95% CI: 0.57–0.83) suggesting marked protective effect of VDS. Instead, the meta-analysis of the 18 trials including 250 to 16,000 patients or more resulted in a summary odds ratio of 0.98 (95% CI: 0.94–1.03) indicating no protective effect of VDS. The interaction between random group allocation and trial size had a p-value of 0.0001, suggesting that sample size was an effect modifier.

Discussion

Our review on VDS for COVID-19 patients and the risk of admission to ICU, and on VDS for the prevention of ARI shows that the majority of small-size randomised trials obtained results in sharp contrast with results of medium-to-large-size randomised trials. Results of medium-size randomised trials in the COVID-19 setting are in agreement with the six aforementioned Mendelian randomisation studies that examined the risk of incidence and severity of COVID-19 according to s-25OHD. They also agree with the negative results of large-size randomised trials conducted before 2020 on high-dose VDS for critically ill, vitamin D deficient patients admitted in intensive care unit [49, 50].

Hence publication bias was probably present, meaning that a number of small-size trials that obtained odds ratio not in favour of VDS were not published because either authors did not consider that their work was worth being submitted to medical journals, or because submissions were turned down by medical journals.

When the COVID-19 pandemic expanded, many new open-source resources were created for rapid dissemination of research findings, with the consequence of more lenience on the quality of research [51].

Jolliffe et al. 2021 [12] considered that virtually all 37 trials were at low risk of bias, which is surprising in view of the contrasting results between small-size and large-size trials. Although in the original publication, a funnel plot highlighted a left-sided asymmetry with Egger’s test having a p-value of 0.007, the authors considered that these results “might reflect heterogeneity of effect across trials, or publication bias arising from omission of small trials showing non-protective effects of vitamin D supplementation from the meta-analysis”.

The interpretation of small-size trial effects is notoriously tricky. Overrepresentation of small-size trials with substantial effect on outcome can be due to publication bias and to other reasons like poorer quality of small-size trials compared to large-size trials, or selective reporting of results [5255].

Systematic reviews with meta-analyses of randomised trials are considered the optimal methodology for evaluating treatment efficacy. However, our study shows that, regardless of being the result of publication bias or poor-quality research, small-size randomised trials can lead to overestimate the efficacy of interventions [55, 56]. The undesirable effects of small-size trials have been reported for a variety of therapeutic areas [57], including critical care [58].

Study limitations

Our study has several limitations. The study unfolded with the uncovering of the effects of trial sizes on the associations between VDS and acute respiratory infections or COVID-19 severity. In this regard, the study did not follow a protocol written before looking at the data. We reused data from Jolliffe et al. 2021 without a literature search for more recent publication on randomised trials testing VDS for acute respiratory infections. The literature search on VDS for COVID-19 was restricted to the PubMed and reference lists of review articles published in 2022. The selection criteria we adopted led to the exclusion of 11 randomised trials, and we did not explore the grey literature, considering that in this particular setting, the published literature had more influence on clinical practice. However, we believe that more extensive literature searches were not likely to find other publications relevant to this work.

Tests for publication bias have known limitations, including the LFK index [59]. Therefore, our analyses used four different tests, all of which confirmed the likelihood of publication bias.

Low vitamin D status and reverse causation

The negative results of medium-size trials on VDS are in striking contrast with the common observation that low s-25OHD is associated with more severe COVID-19 and death. This contrast underscores that low s-25OHD would have no detrimental role in COVID-19 but would rather be the consequence of two sets of factors (i.e. reverse causation). First, s-25OHD seems to behave like a negative surface reactant whose serum concentration fall during inflammatory states, just like albumin, transferrin and other compounds [44, 6063]. Second, patient’s characteristics and medical history known to precipitate severe COVID-19, like age, diabetes, obesity, frailty, cardiovascular conditions, are also known risk factors for low s-25OHD [64].

The associations between low s-25OHD and COVID-19 severity echoes the many observational studies showing that patients with low s-25OHD are at higher risk of acute and chronic disease, including cardiovascular diseases, diabetes, and fractures, and of premature death [64, 65]. However, randomised trials and their meta-analyses have failed to confirm that VDS could prevent or treat any of these diseases and prolong life-expectancy [6669].

Conclusions

Our review showed that the alleged protection of VDS against severe COVID-19 was the consequence of the of small-size randomised trials published before and in the early stages of the COVID-19 pandemic. If in 2022, it was recognised that VDS brought no benefit to COVID-19 patients [70, 71], mechanistic data, observational studies and small-size randomised trials done before have contributed to treating many COVID-19 patients with VDS. The expectation is that in the future, a same thread of laboratory and observational studies, combined with small size randomised trials would not lead to the adoption of poorly effective but unsafe preventive or therapeutic interventions, until larger randomised trials, that take more time to deliver results, would discourage their use.

Supporting information

S1 File. Keywords used for literature search in PubMed and PRISMA flow chart.

https://doi.org/10.1371/journal.pone.0303316.s001

(DOCX)

S1 Fig. Risk of bias in randomised trials on VDS of COVID-19 patients and admission to ICU.

https://doi.org/10.1371/journal.pone.0303316.s002

(DOCX)

S1 Table. Studies identified during the literature search, with inclusions and exclusions.

https://doi.org/10.1371/journal.pone.0303316.s003

(DOCX)

S2 Table. Data extracted for the meta-analysis.

https://doi.org/10.1371/journal.pone.0303316.s004

(DOCX)

References

  1. 1. Chakhtoura M, Napoli N, El Hajj Fuleihan G. Commentary: Myths and facts on vitamin D amidst the COVID-19 pandemic. Metabolism. 2020;109:154276. Epub 2020/05/30. pmid:32470350; PubMed Central PMCID: PMC7250097 Fuleihan, Nicola Napoli receives research funds from Abiogen.
  2. 2. Bergman P. The link between vitamin D and COVID-19: distinguishing facts from fiction. J Intern Med. 2021;289(1):131–3. Epub 2020/07/12. pmid:32652766; PubMed Central PMCID: PMC7405052.
  3. 3. Martineau AR, Forouhi NG. Vitamin D for COVID-19: a case to answer? Lancet Diabetes Endocrinol. 2020;8(9):735–6. Epub 2020/08/08. pmid:32758429; PubMed Central PMCID: PMC7398646.
  4. 4. Liu PT, Stenger S, Li H, Wenzel L, Tan BH, Krutzik SR, et al. Toll-like receptor triggering of a vitamin D-mediated human antimicrobial response. Science. 2006;311(5768):1770–3. pmid:16497887.
  5. 5. Sjoding MW, Luo K, Miller MA, Iwashyna TJ. When do confounding by indication and inadequate risk adjustment bias critical care studies? A simulation study. Crit Care. 2015;19(1):195. Epub 2015/05/01. pmid:25925165; PubMed Central PMCID: PMC4432515.
  6. 6. Lopez DV, Al-Jaberi FAH, Woetmann A, Ødum N, Bonefeld CM, Kongsbak-Wismann M, et al. Macrophages Control the Bioavailability of Vitamin D and Vitamin D-Regulated T Cell Responses. Front Immunol. 2021;12:722806. Epub 2021/10/09. pmid:34621269; PubMed Central PMCID: PMC8490813.
  7. 7. Chauss D, Freiwald T, McGregor R, Yan B, Wang L, Nova-Lamperti E, et al. Autocrine vitamin D signaling switches off pro-inflammatory programs of T(H)1 cells. Nat Immunol. 2022;23(1):62–74. Epub 2021/11/13. pmid:34764490; PubMed Central PMCID: PMC7612139.
  8. 8. Li-Ng M, Aloia JF, Pollack S, Cunha BA, Mikhail M, Yeh J, et al. A randomized controlled trial of vitamin D3 supplementation for the prevention of symptomatic upper respiratory tract infections. Epidemiology and infection. 2009;137(10):1396–404. pmid:19296870.
  9. 9. Pham H, Rahman A, Majidi A, Waterhouse M, Neale RE. Acute Respiratory Tract Infection and 25-Hydroxyvitamin D Concentration: A Systematic Review and Meta-Analysis. International journal of environmental research and public health. 2019;16(17). Epub 2019/08/24. pmid:31438516; PubMed Central PMCID: PMC6747229.
  10. 10. Dissanayake HA, de Silva NL, Sumanatilleke M, de Silva SDN, Gamage KKK, Dematapitiya C, et al. Prognostic and Therapeutic Role of Vitamin D in COVID-19: Systematic Review and Meta-analysis. The Journal of clinical endocrinology and metabolism. 2022;107(5):1484–502. Epub 2021/12/12. pmid:34894254; PubMed Central PMCID: PMC8689831.
  11. 11. D’Ecclesiis O, Gavioli C, Martinoli C, Raimondi S, Chiocca S, Miccolo C, et al. Vitamin D and SARS-CoV2 infection, severity and mortality: A systematic review and meta-analysis. PloS one. 2022;17(7):e0268396. pmid:35793346
  12. 12. Jolliffe DA, Camargo CA, Jr., Sluyter JD, Aglipay M, Aloia JF, Ganmaa D, et al. Vitamin D supplementation to prevent acute respiratory infections: a systematic review and meta-analysis of aggregate data from randomised controlled trials. Lancet Diabetes Endocrinol. 2021;9(5):276–92. Epub 2021/04/03. pmid:33798465.
  13. 13. Kummel LS, Krumbein H, Fragkou PC, Hunerbein BL, Reiter R, Papathanasiou KA, et al. Vitamin D supplementation for the treatment of COVID-19: A systematic review and meta-analysis of randomized controlled trials. Front Immunol. 2022;13:1023903. Epub 2022/11/18. pmid:36389703; PubMed Central PMCID: PMC9659578.
  14. 14. Jolliffe DA, Holt H, Greenig M, Talaei M, Perdek N, Pfeffer P, et al. Effect of a test-and-treat approach to vitamin D supplementation on risk of all cause acute respiratory tract infection and covid-19: phase 3 randomised controlled trial (CORONAVIT). BMJ (Clinical research ed). 2022;378:e071230. Epub 2022/10/11. pmid:36215226;
  15. 15. Brunvoll SH, Nygaard AB, Ellingjord-Dale M, Holland P, Istre MS, Kalleberg KT, et al. Prevention of covid-19 and other acute respiratory infections with cod liver oil supplementation, a low dose vitamin D supplement: quadruple blinded, randomised placebo controlled trial. BMJ (Clinical research ed). 2022;378:e071245. Epub 2022/10/11. pmid:36215222;
  16. 16. Cannata-Andia JB, Diaz-Sottolano A, Fernandez P, Palomo-Antequera C, Herrero-Puente P, Mouzo R, et al. A single-oral bolus of 100,000 IU of cholecalciferol at hospital admission did not improve outcomes in the COVID-19 disease: the COVID-VIT-D-a randomised multicentre international clinical trial. BMC medicine. 2022;20(1):83. Epub 2022/02/19. pmid:35177066; PubMed Central PMCID: PMC8853840.
  17. 17. Ma H, Zhou T, Heianza Y, Qi L. Habitual use of vitamin D supplements and risk of coronavirus disease 2019 (COVID-19) infection: a prospective study in UK Biobank. The American journal of clinical nutrition. 2021;113(5):1275–81. Epub 2021/01/31. pmid:33515005; PubMed Central PMCID: PMC7929381.
  18. 18. Butler-Laporte G, Nakanishi T, Mooser V, Morrison DR, Abdullah T, Adeleye O, et al. Vitamin D and COVID-19 susceptibility and severity in the COVID-19 Host Genetics Initiative: A Mendelian randomization study. PLoS Med. 2021;18(6):e1003605. Epub 2021/06/02. pmid:34061844; PubMed Central
  19. 19. Patchen BK, Clark AG, Gaddis N, Hancock DB, Cassano PA. Genetically predicted serum vitamin D and COVID-19: a Mendelian randomisation study. BMJ Nutr Prev Health. 2021;4(1):213–25. Epub 2021/07/27. pmid:34308129; PubMed Central PMCID: PMC8098235.
  20. 20. Cui Z, Tian Y. Using genetic variants to evaluate the causal effect of serum vitamin D concentration on COVID-19 susceptibility, severity and hospitalization traits: a Mendelian randomization study. J Transl Med. 2021;19(1):300. Epub 2021/07/12. pmid:34246301; PubMed Central PMCID: PMC8271325.
  21. 21. Li X, van Geffen J, van Weele M, Zhang X, He Y, Meng X, et al. An observational and Mendelian randomisation study on vitamin D and COVID-19 risk in UK Biobank. Scientific reports. 2021;11(1):18262. Epub 2021/09/16. pmid:34521884; PubMed Central PMCID: PMC8440633.
  22. 22. Amin HA, Drenos F. No evidence that vitamin D is able to prevent or affect the severity of COVID-19 in individuals with European ancestry: a Mendelian randomisation study of open data. BMJ Nutr Prev Health. 2021;4(1):42–8. Epub 2021/07/27. pmid:34308111; PubMed Central PMCID: PMC7798425.
  23. 23. Chiari W, Amirah S, Lemu YK, Subbaram K, Edwards RJ, Kretchy J-P, et al. Trends in publication and collaboration of health-themed systematic reviews before and during the COVID-19 pandemic: A bibliometric study. Narra X. 2024;2(1).
  24. 24. Higgins JPT TJ, Chandler J, Cumpston M, Li T, Page MJ, Welch VA (editors). Cochrane Handbook for Systematic Reviews of Interventions version 6.4 (updated August 2023). Cochrane, 2023. Available from www.training.cochrane.org/handbook.
  25. 25. McGuinness LA, Higgins JPT. Risk-of-bias VISualization (robvis): An R package and Shiny web app for visualizing risk-of-bias assessments. Research synthesis methods. 2021;12(1):55–61. Epub 2020/04/27. pmid:32336025.
  26. 26. Cornell JE, Mulrow CD, Localio R, Stack CB, Meibohm AR, Guallar E, et al. Random-effects meta-analysis of inconsistent effects: a time for change. Ann Intern Med. 2014;160(4):267–70. Epub 2014/04/15. pmid:24727843.
  27. 27. Langan D, Higgins JPT, Jackson D, Bowden J, Veroniki AA, Kontopantelis E, et al. A comparison of heterogeneity variance estimators in simulated random-effects meta-analyses. Research synthesis methods. 2019;10(1):83–98. Epub 2018/08/02. pmid:30067315.
  28. 28. Veroniki AA, Jackson D, Viechtbauer W, Bender R, Bowden J, Knapp G, et al. Methods to estimate the between-study variance and its uncertainty in meta-analysis. Research synthesis methods. 2016;7(1):55–79. Epub 2015/09/04. pmid:26332144; PubMed Central PMCID: PMC4950030.
  29. 29. Thorlund K, Imberger G, Walsh M, Chu R, Gluud C, Wetterslev J, et al. The Number of Patients and Events Required to Limit the Risk of Overestimation of Intervention Effects in Meta-Analysis—A Simulation Study. PloS one. 2011;6(10):e25491. pmid:22028777
  30. 30. Furuya-Kanamori L, Barendregt JJ, Doi SAR. A new improved graphical and quantitative method for detecting bias in meta-analysis. International journal of evidence-based healthcare. 2018;16(4):195–203. Epub 2018/04/06. pmid:29621038.
  31. 31. Duval S, Tweedie R. Trim and fill: A simple funnel-plot-based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63. Epub 2000/07/06. pmid:10877304.
  32. 32. Lakkireddy M, Goud Gadiga S, Malathi RD, Latha Karra M, Murthy Raju IP, Ragini , et al. Effect of Short Term High Dose Oral Vitamin D Therapy on the Inflammatory Markers in Patients with COVID 19 Disease. Archives of Clinical and Biomedical Research. 2022;06(04).
  33. 33. Soliman AR, Abdelaziz TS, Fathy A. Impact of Vitamin D Therapy on the Progress COVID-19: Six Weeks Follow-Up Study of Vitamin D Deficient Elderly Diabetes Patients. Proceedings of Singapore Healthcare. 2021;31.
  34. 34. Sanchez-Zuno GA, Gonzalez-Estevez G, Matuz-Flores MG, Macedo-Ojeda G, Hernandez-Bello J, Mora-Mora JC, et al. Vitamin D Levels in COVID-19 Outpatients from Western Mexico: Clinical Correlation and Effect of Its Supplementation. J Clin Med. 2021;10(11). Epub 2021/06/03. pmid:34071293; PubMed Central PMCID: PMC8198869.
  35. 35. Entrenas Castillo M, Entrenas Costa LM, Vaquero Barrios JM, Alcala Diaz JF, Lopez Miranda J, Bouillon R, et al. "Effect of calcifediol treatment and best available therapy versus best available therapy on intensive care unit admission and mortality among patients hospitalized for COVID-19: A pilot randomized clinical study". The Journal of steroid biochemistry and molecular biology. 2020;203:105751. Epub 2020/09/02. pmid:32871238; PubMed Central PMCID: PMC7456194.
  36. 36. Maghbooli Z, Sahraian MA, Jamalimoghadamsiahkali S, Asadi A, Zarei A, Zendehdel A, et al. Treatment With 25-Hydroxyvitamin D(3) (Calcifediol) Is Associated With a Reduction in the Blood Neutrophil-to-Lymphocyte Ratio Marker of Disease Severity in Hospitalized Patients With COVID-19: A Pilot Multicenter, Randomized, Placebo-Controlled, Double-Blinded Clinical Trial. Endocr Pract. 2021;27(12):1242–51. Epub 2021/10/16. pmid:34653608; PubMed Central PMCID: PMC8511889.
  37. 37. Murai IH, Fernandes AL, Antonangelo L, Gualano B, Pereira RMR. Effect of a Single High-Dose Vitamin D3 on the Length of Hospital Stay of Severely 25-Hydroxyvitamin D-Deficient Patients with COVID-19. Clinics (Sao Paulo). 2021;76:e3549. Epub 2021/12/02. pmid:34852148; PubMed Central PMCID: PMC8595591.
  38. 38. De Niet S, Tremege M, Coffiner M, Rousseau AF, Calmes D, Frix AN, et al. Positive Effects of Vitamin D Supplementation in Patients Hospitalized for COVID-19: A Randomized, Double-Blind, Placebo-Controlled Trial. Nutrients. 2022;14(15). Epub 2022/07/28. pmid:35893907; PubMed Central PMCID: PMC9330587.
  39. 39. Elamir YM, Amir H, Lim S, Rana YP, Lopez CG, Feliciano NV, et al. A randomized pilot study using calcitriol in hospitalized COVID-19 patients. Bone. 2022;154:116175. Epub 2021/09/12. pmid:34508882; PubMed Central PMCID: PMC8425676.
  40. 40. Karonova TL, Golovatyuk KA, Kudryavtsev IV, Chernikova AT, Mikhaylova AA, Aquino AD, et al. Effect of Cholecalciferol Supplementation on the Clinical Features and Inflammatory Markers in Hospitalized COVID-19 Patients: A Randomized, Open-Label, Single-Center Study. Nutrients. 2022;14(13). Epub 2022/07/10. pmid:35807783; PubMed Central PMCID: PMC9268385.
  41. 41. Mariani J, Antonietti L, Tajer C, Ferder L, Inserra F, Sanchez Cunto M, et al. High-dose vitamin D versus placebo to prevent complications in COVID-19 patients: Multicentre randomized controlled clinical trial. PloS one. 2022;17(5):e0267918. Epub 2022/05/28. pmid:35622854;
  42. 42. Annweiler C, Beaudenon M, Gautier J, Gonsard J, Boucher S, Chapelet G, et al. High-dose versus standard-dose vitamin D supplementation in older adults with COVID-19 (COVIT-TRIAL): A multicenter, open-label, randomized controlled superiority trial. PLoS Med. 2022;19(5):e1003999. Epub 2022/06/01. pmid:35639792;
  43. 43. Sabico S, Enani MA, Sheshah E, Aljohani NJ, Aldisi DA, Alotaibi NH, et al. Effects of a 2-Week 5000 IU versus 1000 IU Vitamin D3 Supplementation on Recovery of Symptoms in Patients with Mild to Moderate Covid-19: A Randomized Clinical Trial. Nutrients. 2021;13(7). Epub 2021/07/03. pmid:34202578; PubMed Central PMCID: PMC8308273.
  44. 44. Smaha J, Kuzma M, Jackuliak P, Nachtmann S, Max F, Tibenska E, et al. Serum 25-hydroxyvitamin D Concentration Significantly Decreases in Patients with COVID-19 Pneumonia during the First 48 Hours after Hospital Admission. Nutrients. 2022;14(12). Epub 2022/06/25. pmid:35745092; PubMed Central PMCID: PMC9228147.
  45. 45. Villasis-Keever MA, López-Alarcón MG, Miranda-Novales G, Zurita-Cruz JN, Barrada-Vázquez AS, González-Ibarra J, et al. Efficacy and Safety of Vitamin D Supplementation to Prevent COVID-19 in Frontline Healthcare Workers. A Randomized Clinical Trial. Arch Med Res. 2022;53(4):423–30. Epub 2022/04/30. pmid:35487792; PubMed Central PMCID: PMC9013626.
  46. 46. Abroug H, Maatouk A, Bennasrallah C, Dhouib W, Ben Fredj M, Zemni I, et al. Effect of vitamin D supplementation versus placebo on recovery delay among COVID-19 Tunisian patients: a randomized-controlled clinical trial. Trials. 2023;24(1):123. Epub 2023/02/22. pmid:36803273; PubMed Central PMCID: PMC9940050.
  47. 47. Bishop CW, Ashfaq A, Melnick JZ, Vazquez-Escarpanter E, Fialkow JA, Strugnell SA, et al. REsCue trial: Randomized controlled clinical trial with extended-release calcifediol in symptomatic COVID-19 outpatients. Nutrition. 2023;107:111899. Epub 2022/12/19. pmid:36529089; PubMed Central PMCID: PMC9639413.
  48. 48. Jevalikar G, Mithal A, Singh A, Sharma R, Farooqui KJ, Mahendru S, et al. Lack of association of baseline 25-hydroxyvitamin D levels with disease severity and mortality in Indian patients hospitalized for COVID-19. Scientific reports. 2021;11(1):6258. Epub 2021/03/20. pmid:33737631; PubMed Central PMCID: PMC7973709.
  49. 49. National Heart L, Blood Institute PCTN, Ginde AA, Brower RG, Caterino JM, Finck L, et al. Early High-Dose Vitamin D(3) for Critically Ill, Vitamin D-Deficient Patients. The New England journal of medicine. 2019;381(26):2529–40. Epub 2019/12/12. pmid:31826336; PubMed Central PMCID: PMC7306117.
  50. 50. Amrein K, Schnedl C, Holl A, Riedl R, Christopher KB, Pachler C, et al. Effect of high-dose vitamin D3on hospital length of stay in critically ill patients with vitamin D deficiency: The VITdAL-ICU randomized clinical trial. JAMA—Journal of the American Medical Association. 2014;312(15):1520–30. pmid:25268295
  51. 51. Else H. How a torrent of COVID science changed research publishing—in seven charts. Nature. 2020;588(7839):553. Epub 2020/12/18. pmid:33328621.
  52. 52. Sterne JA, Sutton AJ, Ioannidis JP, Terrin N, Jones DR, Lau J, et al. Recommendations for examining and interpreting funnel plot asymmetry in meta-analyses of randomised controlled trials. BMJ (Clinical research ed). 2011;343:d4002. Epub 2011/07/26. pmid:21784880.
  53. 53. Borenstein M. Common mistakes in meta-analysis. New Jersey: Biostat, Inc.; 2019.
  54. 54. Lau J, Ioannidis JP, Terrin N, Schmid CH, Olkin I. The case of the misleading funnel plot. BMJ (Clinical research ed). 2006;333(7568):597–600. Epub 2006/09/16. pmid:16974018; PubMed Central PMCID: PMC1570006.
  55. 55. Schwab S, Kreiliger G, Held L. Assessing treatment effects and publication bias across different specialties in medicine: a meta-epidemiological study. BMJ open. 2021;11(9):e045942. Epub 2021/09/16. pmid:34521659; PubMed Central PMCID: PMC8442042.
  56. 56. Ioannidis JP, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet (London, England). 2014;383(9912):166–75. Epub 2014/01/15. pmid:24411645; PubMed Central PMCID: PMC4697939.
  57. 57. Kjaergard LL, Villumsen J, Gluud C. Reported methodologic quality and discrepancies between large and small randomized trials in meta-analyses. Ann Intern Med. 2001;135(11):982–9. Epub 2001/12/04. pmid:11730399.
  58. 58. Zhang Z, Xu X, Ni H. Small studies may overestimate the effect sizes in critical care meta-analyses: a meta-epidemiological study. Crit Care. 2013;17(1):R2. Epub 2013/01/11. pmid:23302257; PubMed Central PMCID: PMC4056100.
  59. 59. Schwarzer G, Rücker G, Semaca C. LFK index does not reliably detect small-study effects in meta-analysis: A simulation study. Research synthesis methods. 2024;15(4):603–15. Epub 2024/03/12. pmid:38467140.
  60. 60. Hopefl R, Ben-Eltriki M, Deb S. Association Between Vitamin D Levels and Inflammatory Markers in COVID-19 Patients: A Meta-Analysis of Observational Studies. J Pharm Pharm Sci. 2022;25:124–36. Epub 2022/04/06. pmid:35379386.
  61. 61. Antonelli M, Kushner I. Low Serum Levels of 25-Hydroxyvitamin D Accompany Severe COVID-19 Because it is a Negative Acute Phase Reactant. Am J Med Sci. 2021;362(3):333–5. Epub 2021/06/25. pmid:34166653; PubMed Central PMCID: PMC8216860.
  62. 62. Silva MC, Furlanetto TW. Does serum 25-hydroxyvitamin D decrease during acute-phase response? A systematic review. Nutrition Research. 2015;35(2):91–6. pmid:25631715
  63. 63. Binkley N, Coursin D, Krueger D, Iglar P, Heiner J, Illgen R, et al. Surgery alters parameters of vitamin D status and other laboratory results. Osteoporosis international: a journal established as result of cooperation between the European Foundation for Osteoporosis and the National Osteoporosis Foundation of the USA. 2017;28(3):1013–20. Epub 2016/11/09. pmid:27826645.
  64. 64. Autier P, Boniol M, Pizot C, Mullie P. Vitamin D status and ill health: a systematic review. Lancet Diabetes Endocrinol. 2014;2(1):76–89. Epub 2014/03/14. pmid:24622671.
  65. 65. Looker AC. Serum 25-hydroxyvitamin D and risk of major osteoporotic fractures in older U.S. adults. J Bone Miner Res. 2013;28(5):997–1006. pmid:23184640.
  66. 66. Autier P, Mullie P, Macacu A, Dragomir M, Boniol M, Coppens K, et al. Effect of vitamin D supplementation on non-skeletal disorders: a systematic review of meta-analyses and randomised trials. Lancet Diabetes Endocrinol. 2017;5(12):986–1004. Epub 2017/11/06. pmid:29102433.
  67. 67. Scragg R, Stewart AW, Waayer D, Lawes CM, Toop L, Sluyter J, et al. Effect of Monthly High-Dose Vitamin D Supplementation on Cardiovascular Disease in the Vitamin D Assessment Study: A Randomized Clinical Trial. JAMA cardiology. 2017. Epub 2017/04/07. pmid:28384800.
  68. 68. Pittas AG, Dawson-Hughes B, Sheehan P, Ware JH, Knowler WC, Aroda VR, et al. Vitamin D Supplementation and Prevention of Type 2 Diabetes. The New England journal of medicine. 2019;381(6):520–30. Epub 2019/06/08. pmid:31173679; PubMed Central PMCID: PMC6993875.
  69. 69. Yao P, Bennett D, Mafham M, Lin X, Chen Z, Armitage J, et al. Vitamin D and Calcium for the Prevention of Fracture: A Systematic Review and Meta-analysis. JAMA Netw Open. 2019;2(12):e1917789. Epub 2019/12/21. pmid:31860103; PubMed Central PMCID: PMC6991219 UK Medical Research Council during the conduct of the study. No other disclosures were reported.
  70. 70. Subramanian S, Griffin G, Hewison M, Hopkin J, Kenny RA, Laird E, et al. Vitamin D and COVID-19-Revisited. J Intern Med. 2022;292(4):604–26. Epub 2022/07/08. pmid:35798564; PubMed Central PMCID: PMC9349414.
  71. 71. Martineau AR. Vitamin D in the prevention or treatment of COVID-19. Proceedings of the Nutrition Society. 2022:1–8. Epub 2022/11/11. pmid:36366796