To examine whether religious and spiritual interventions (RSIs) can promote physical health and quality of life in individuals.
The following databases were used to conduct a systematic review: PubMed, Scopus, Web of Science, EMBASE, PsycINFO, Cochrane, and Scielo. Randomized controlled trials that evaluated RSIs regarding physical health outcomes and/or quality of life in English, Spanish or Portuguese were included. RSI protocols performed at a distance (i.e. intercessory prayer) or for psychiatric disorders were excluded. This study consisted of two phases: (a) reading titles and abstracts, and (b) assessing the full articles and their methodological quality using the Cochrane Back Review Group scale.
In total, 7,070 articles were identified in the search, but 6884 were excluded in phase 1 because they were off topic or repeated in databases. Among the 186 articles included in phase 2, 140 were excluded because they did not fit the inclusion criteria and 16 did not have adequate randomization process. Thus, a final selection of 30 articles remained. The participants of the selected studies were classified in three groups: chronic patients (e.g., cancer, obesity, pain), healthy individuals and healthcare professionals. The outcomes assessed included quality of life, physical activity, pain, cardiac outcomes, promotion of health behaviors, clinical practice of healthcare professionals and satisfaction with protocols. The divergence concerning scales and protocols proposed did not allow a meta-analysis. RSIs as a psychotherapy approach were performed in 40% of the studies, and the control group was more likely to use an educational intervention (56.7%). The results revealed small effect sizes favoring RSIs in quality of life and pain outcomes and very small effects sizes in physical activity, promotion of health behaviors and clinical practice of health professionals compared with other complementary strategies. Other outcomes, such as cardiac measures and satisfaction with the protocols, revealed no evidence for RSIs. Regarding the quality of the selected articles according to the Cochrane Back Review Group Scale, the average score was 6.83 (SD = 9.08) on a scale of 11, demonstrating robustness in the studies.
Clinical trials on RSIs demonstrated that they had small benefits compared with other complementary health therapies by reducing pain and weight, improving quality of life and promoting health behaviors. The lack of clinical trials that included biological outcomes and the diversity of approaches indicate a need for more studies to understand the possible mechanisms of action of RSIs and their roles in health care.
Citation: Gonçalves JPdB, Lucchetti G, Menezes PR, Vallada H (2017) Complementary religious and spiritual interventions in physical health and quality of life: A systematic review of randomized controlled clinical trials. PLoS ONE 12(10): e0186539. https://doi.org/10.1371/journal.pone.0186539
Editor: Gianni Virgili, Universita degli Studi di Firenze, ITALY
Received: December 20, 2016; Accepted: October 3, 2017; Published: October 19, 2017
Copyright: © 2017 Gonçalves et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The “Associação Mantenedora João Evangelista” financed the research work with support to the materials needed during the study, with no affiliation from the researchers regarding the Institution.
Competing interests: Funding from “Associação Mantenedora João Evangelista” does not alter our adherence to PLOS ONE policies on sharing data and materials.
The current literature contains evidence about the impact of the religious/spiritual beliefs and practices on human health [1, 2]. Chronic health problems, such as hypertension, coronary artery disease and acquired immunodeficiency syndrome (AIDS/HIV+), seem to exhibit more control and stability in individuals with high levels of R/S practices [3, 4]. Data on different types of cancer also revealed better outcomes when patients have greater faith and spirituality during treatment .
Regarding mortality, a study demonstrated an increase in survival rates from 18% to 25% in people with higher levels of religiosity/spirituality (R/S) compared with other primary prevention in health prevention . Even some health professionals reported improvements on their patient´s health, and were able to fulfill their patients’ spiritual needs in clinical practice when they were trained to increased awareness of the spiritual dimension in care . These clinical findings highlight the need to integrate R/S into health care, aiming at complete physical, psychological, social and spiritual well-being , particularly in chronic patients.
Chronic health problems are a major public health issue due to the ageing of the world’s population, which is increasing the number of functionally compromised individuals . In this context, patients tend to seek complementary therapies that may alleviate their discomfort and offer new possibilities of treatment. Complementary therapies are practiced by at least 40% of patients in the United States . In fact, the prevention of these problems and the use of complementary medicine can reduce costs per individual  and improve quality of life . Complementary therapies include religious/spiritual aspects, based on evidence of a positive association between R/S and health outcomes in general .
In recent years, the number of publications concerning R/S in the medical literature has been steadily increasing. In 1999, were published a total of 1,507 articles that included the terms *spiritual or *religio in at least one field of a bibliometric search. In 2013, the number of publications that included the same words had increased to 2,763 . However, most studies are theoretical and observational, and some health professionals have doubts about how to approach R/S topics in clinical practice .
Thus, some authors have developed strategies to stimulate and develop the spiritual dimension of the patient to promote the clinical improvements identified in observational studies. These strategies are conventionally called religious and/or spiritual interventions (RSIs). These strategies are conventionally called religious and/or spiritual interventions (RSIs). RSIs typically propose the introduction of reflective discussion of R/S values and beliefs into the patient´s treatment as a complementary health therapy. The purpose of RSIs in this context is to improve the spiritual and physical dimension of patients and help them better cope with the disease through religious beliefs and traditions [15, 16] and/or spiritual transcendence [17, 18].
Other authors consider strategies based on ancient practices, such as yoga , meditation  and tai chi chuan  as RSISs. Although theses interventions offer good health outcomes, they involve pre-defined protocols based on specific practices and typically require the patient to follow a particular lifestyle. Previous research has already systematically investigated this type of intervention and is therefore not the focus of the present study.
Despite the clinical possibilities of RSIs, few randomized controlled clinical trials are available in the literature. This methodology offers the most robust scientific evidence to assess the possible mechanisms of action of R/S and to develop the clinical applicability of the discussed constructs . Therefore, the present study aimed to focus on previously published controlled clinical trials to examine whether RSIs can promote healthy behaviors and improve physical health and quality of life. As a secondary goal, this study proposed to identify the types of protocols described and used in the literature, and which populations received the RSIs.
A systematic review following the PRISMA guidelines (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) was conducted as described below . The study was conducted between January 2011 and July 2016. Data on mental health outcomes are reported elsewhere .
Randomized clinical trials that used any RSI protocol for outcomes in physical health or quality of life were included. There were no restrictions with respect to diagnosis or publication date (to July 2016); however, the search was limited to English, Spanish, and Portuguese. Due to the importance of the randomization method in the quality of a clinical trial, this procedure was defined according to the international guidelines for clinical trials methodology proposed by CONSORT (Consolidated Standards of Reporting Trials) .
A Boolean expression was created to search the literature to discover the most relevant articles on the topic: "(spiritu* OR relig* OR faith OR holistic OR multifaith) AND (assistance OR intervention OR treatment OR therapy OR assessment OR group OR meditation) AND (clinical trial OR meta-analysis OR randomized controlled trial OR controlled clinical trial)". Seven different databases were screened: PubMed, Scopus, Web of Science, PsycINFO, The Cochrane Collaboration, Embase and Scielo. For these last two databases, the search terms were adapted to fit their particular search requirements.
Phase 1: The title and abstract of all papers were reviewed by two independent researchers (CBC and JPBG). Studies were excluded if (a) R/S was not assessed, (b) other methodologies were presented, and (c) repeated versions in databases were identified.
Phase 2: All included articles were fully read to assess: (a) the RSI protocols, (b) the randomization process, and (c) the methodological quality of the articles. The authors of the studies who did not provide full details of randomization were contacted by email, and only those who provided adequate data were included.
Data items for extraction
The outcomes selected from the final articles included (a) diagnosis of the participants; (b) type of approach used in the RSIs; (c) frequency, duration and follow-up procedures; (d) facilitator of the intervention; and (e) clinical outcomes and their results (physical, preventive, quality of life, spiritual care in practice and satisfaction with the procedure).
Risk of bias in individual studies
The risk of bias across studies was assessed through the Cochrane Back Review scale, an instrument from The Cochrane Collaboration composed of eleven methodological items that offer an extensive evaluation of a clinical trial design . The score was chosen to provide a better understanding of the items because it was very similar to the CONSORT guidelines for non-pharmacological clinical trials that do not blind patients or providers of interventions. The cut-off was six or more points . Three independent researchers (GL, HV and JPBG) classified the items, and the disagreements were resolved topic by topic by consensus.
Given that the present study is a systematic review, a description of the outcomes found in the selected articles is presented in the tables and figures. Due to the diversity of primary diagnoses and clinical outcomes assessed in the data, it was not possible to perform a meta-analysis. Data extracted in the articles were transformed and presented in Cohen d effect size with 95% confidence interval (CI) when possible using the Campbell Collaboration online calculator . The Cohen-d effect size thresholds used included small (0.20), medium (0.50), large (0.80) and very large (1.30) .
To evaluate the reliability of the reviewers in assessing the methodological quality, we used the intraclass correlation coefficient that quantifies the variability among different investigators. The coefficient score ranges from 0 to 1.00: the closer to 1.00. The closer to 10.00, the less variability among the reviewers. For the analysis, the SPSS version 17.0 (SPSS, Inc.) was used.
Fig 1 presents the flowchart for the selection of the articles in the databases. The search returned a total of 7,070 articles, of which 1,134 were excluded because they were duplicates in different databases. In Phase 1, 5,750 articles were eliminated because they were off topic, used other methodologies other than clinical trials, or were in languages not defined in the inclusion criteria. Of the remaining 186 articles examined in Phase 2, we excluded 125 articles that were incompatible with the inclusion criteria and 15 that exclusively assessed mental health outcomes. In total, 46 articles remained in this phase, including 30 articles that did not elucidate the randomization procedure. The authors of these articles were contacted, and 15 of them did not return the e-mails, and one study used an inadequate process. Thus, 14 studies were included. The final included articles totaled 30.
The 30 final studies presented very different characteristics. Therefore, we decided to group them into their main research outcomes as follows: a) quality of life, b) weight and physical activity, c) pain, d) other outcomes, e) promotion of healthy behaviors, f) clinical practice of health professionals, and g) satisfaction with protocols proposed.
Quality of life– 10 studies.
Table 1 presents RSIs proposed to investigate quality of life in different chronic diseases with a total sample of 756 individuals. Patients with cancer (assessed in 4 studies) represented 45.5% of the total sample. Most the interventions (90%) focused on spiritual approaches with only one (10%) using religious aspects to improve quality of life. A predominance of psychotherapy protocols (50%) was noted followed by meditation (40%).
Concerning the scales adopted by the authors, only the Life Satisfaction Index was used in two different studies. The Quality of Life Enjoyment and Satisfaction Questionnaire was used in both a full and brief forms in two studies. The mean score of the methodological quality on the Cochrane Scale was 6.6 (SD = 1.17) points. Risk of bias was suspected in two studies in this group (20%).
Concerning quality of life, four of the five studies on the psychotherapy approach presented statistical significance favoring RSIs with different effect sizes: one large (d = 2.17, 95% CI [1.55; 2.78]) , two small (d = 0.43, 95% CI [0.04; 0.82]; d = 0.48, 95% CI [-0.13; -0.83]) [30, 31] and one insignificant (d = 0.01, 95% CI [-0.47; 0.49]) . Similarly, two of four studies that used meditation protocols were significant with large (d = 0.93, 95% CI [-1.18; 3.05])  and small (d = 0.25, 95% CI [-0.66; 0.15])  effect sizes.
Weight and physical activity– 5 studies.
The studies that investigated outcomes related to weight and physical activity assessed 191 individuals from mainly obese and sedentary populations, which represented 74.3% of the total sample (Table 2). The protocols used included church environment (60%) and psychotherapy (40%), and the predominant focus of intervention in these outcomes involved religion in 60% of the articles.
All studies used control groups (with another type of activity), and the mean score of the Cochrane Scale was 7 (SD = 0.71) points. The RSI protocols concerning loss of weight exhibited insignificant effect sizes in three of the four studies [33–35]. In addition, RSIs on physical activity exhibited a small effect size (d = 0.22, 95% CI [-0.55; 0.99])  and two insignificant results [34, 35]. Finally, RSIs exhibited an insignificant effect size when assessing eating habits (d = 0.11, 95% CI [-0.49; 0.70]) in one of the three studies evaluated .
Pain– 5 studies.
Studies on pain assessed individuals with chronic disease (63.7%) and those in a healthy population (36.3%) in a total sample of 403 (Table 3). The protocols were mostly spiritual (80%) and based on meditation approaches (60%), and all protocols were facilitated by the authors. Meditation protocols compared the intervention with therapeutic approaches in the control groups, whereas the others used educational approaches. The Cochrane scale revealed a mean of 8 points (SD = 0.71).
RSI assessed pain tolerance using the same method in three articles. Two studies exhibited a small effect size (d = 0.12, 95% CI [-0.42; 0.66]; d = 0.27, 95% CI [-0.85; 0.30]) [37, 38], and the third study was not significant . Concerning the frequency of pain measured in two studies, RSI exhibited one small effect size (d = 0.26, 95% CI [-0.86; 0.35])  and a very small effect size . Severity of pain was also assessed in the two articles, and the RSIs assessed exhibited very small effect sizes in both [37, 39].
Other outcomes– 5 studies.
In S1 Table, we present other physical outcomes investigated with RSIs in individuals with chronic diseases. No pattern was noted regarding the type or focus of intervention. Facilitators were mainly the authors of the studies (80%).
RSI on levels of salivary cortisol exhibited a small effect size (d = 0.28, 95% CI [-0.75; 0.19]) measured post-treatment that was not maintained in follow up . Other outcomes assessed in the RSI, including daily activity (d = 0.09, 95% CI [-0.43; 0.26]), management of chronic disease (d = 0.19, 95% CI [-0.24; 0.61]) and energy, exhibited insignificant effect sizes (d = 0.18, 95% CI [-0.24; 0.61]). Concerning cardiac measures, the RSI was not statistically significant .
Promotion of healthy behaviors– 5 studies.
Some studies were designed to stimulate healthy behaviors (S2 Table). Three articles evaluated RSIs in 849 health individuals in church environments (81.7% of the total sample), and two studies assessed chronic conditions of health in 190 individuals through psychotherapy models (18.3%). Most control groups (80%) used educational approaches to compare the RSIs, and the mean score on Cochrane scale was of 6.2 points (SD = 1.10).
RSIs on organ donations outcomes exhibited small to medium effect sizes (d = 0.33, 95% CI [0.14; 0.53]; d = 0.63, 95% CI [0.42; 0.82]) favoring RSIs . Concerning cancer screening, RSIs showed small effect sizes in the ideas about health impacts (d = 0.22, 95% CI [-0.15; 0.04]) , on the benefits of cancer screening (d = 0.22, 95% CI [-0.05; 0.48]) and on the benefits of colonoscopy (d = 0.19, 95% CI [-0.07; 0.46] . Other measures of cancer as barriers and benefits of screening tests were insignificant in RSIs.
The prevention of HIV by sexual transmission revealed no differences between the groups assessed , but the measures of the risk behavior exhibited significant differences in the RSI protocol .
Clinical practice of healthcare professionals– 4 studies.
There were four studies that investigated the impact of the RSIs on the clinical practice of 216 health professionals (S3 Table). Half of the studies used psychotherapy approaches, and the other half used meditation protocols. However, all of them focused on spiritual models facilitated by the authors of the studies. Only one used an educational protocol as a control group, whereas the other three studies compared RSIs with a waiting list group. The mean score on Cochrane scale was 6.25 points (SD = 0.96).
Eleven different measures regarding burnout, spiritual care and spiritual practice of the professional were assessed in the four studies and only the personal accomplishment exhibited no significance between the groups . Effect sizes of RSIs evidenced a large effect on emotional exhaustion (d = 1.0, 95% CI [-4.33; 2.33]) , small effect on relational self-assessed caregiving (d = 0.40, 95% CI [0.08; 0.72])  and an insignificant effect on job satisfaction (d = 0.08, 95% CI [-0.44; 0.60]) .
Satisfaction with the proposed protocols– 3 studies.
Some authors also investigated the satisfaction of individuals with RSIs protocols. Patients with generalized anxiety disorder received religious intervention by audiovisual resources, and the Client Satisfaction Questionnaire revealed no significant difference (d = 0.90, [0.42; 1.35]) . Another study assessed this measure in patients with post-traumatic stress disorder after spiritual mediation, and the authors reported moderate to high approval of the protocol by 86% of participants . The latter study evaluated spiritual psychotherapy in drug users, and the client´s credibility of the protocol exhibited a mean of 3.44 (SD = 0.42) on a scale of 0 to 4. Client´s satisfaction exhibited a mean of 8.85 (SD = 1.15) on a scale of 0 to 10 .
Regarding the protocols used, we noted a basic distinction of RSIs into two models: spiritual and religious. The spiritual models focused on moral/spiritual values and coping with the disease through transcendence and personal beliefs. Authors claimed that this approach can include atheists and agnostics due to the general approach of the beliefs discussed. The religious models used the traditions of religious beliefs, such as those of Catholicism or Judaism, to help people who already identified themselves as belonging to a specific religious tradition. Of the 30 articles included, the approaches were distributed in 19 (63.3%) spiritual and 11 (36.7%) religious models. Regardless of the religious or spiritual focus, different protocols were proposed for each model that shared some features as presented below.
Psychotherapy– 12 studies.
The authors who used psychotherapy to promote RSIs introduced religious/spiritual values and beliefs into the program to help cope with the diseases. Ideas, such as “God is a source of hope, forgiveness, peace and acceptance”, “Higher Power gives relief and meaning in the end-of-life” or “feel the connection with others through love”, were used as topics. Some authors also provided practical activities, i.e., as prayers and reading of sacred texts in groups, discussion to promote transcendence and changes in unhealthy behaviors and habits.
Therapeutic [17, 30, 31, 34, 35, 44, 49] or educational approaches [29, 45, 50–52] were used. Control groups included traditional psychotherapy [34, 35, 44, 49], educational models [17, 29–31, 45, 50, 52] and waiting list . Only one study offered an individual protocol , and the remaining proposals used group discussion.
Meditation– 8 studies.
The R/S meditations consisted of phrases about God or a Higher Power being chosen and mentally repeated by patients. Stories about spiritual leaders were also supplied by some authors to be as examples of attitudes. Control groups in this type of intervention used traditional meditation methods [37–39], waiting list [32, 46, 48] and informational videos about the disease [18, 41]. Facilitators met with participants before and/or during the study period to eliminate doubts about the protocol.
Church approaches– 6 studies.
Church approaches were typically performed by religious ministers (priests, clerics and pastors) and occasionally by the authors of the study concomitantly. Reading sacred texts, praying in groups, discussing and demystifying polemic subjects with the religious leaders (i.e. sex, organ donation) were some of the teachings incorporated into RSI to promote valuing life and responsibility with the body.
The material used in church interventions was developed by the corresponding authors of the studies in collaboration with the religious ministers [15, 16, 33, 36, 53]. The authors trained the leaders prior to the procedures. As a comparison group, regular protocols performed by institutions that focused on health promotion and diseases prevention were used.
Audiovisual resources– 2 studies.
In this type of intervention, both studies created videos that were available for patients to watch on their own. The contents included religious/spiritual themes to cope with stress, to change unhealthy habits and to inspire gratitude and forgiveness. Patients were asked to write down reflective notes after watching the videos. One study compared the RSIs with a video showing muscular exercises and a waiting list group , whereas the other study exclusively used individuals who viewed an educational video about the disease as the control group .
Guided visualization– 2 studies.
The guided visualization studies used exercises concerning visualization of divine/spiritual beings helping and accompanying the patient’s life. Images of light surrounding the ambient and love connecting the person with the rehabilitation were verbally conducted by the authors. The RSIs were compared with brief psychotherapy  and respiratory relaxation .
Another point regarding the facilitators of the interventions should be made. Some of the facilitators had previous knowledge of the technique that was used in the intervention and experience of working with R/S topics [29, 30, 32, 40, 46, 49, 52–54]. For those who did not, training was both offered to health professionals when they were not familiar with the subject of the R/S [33, 39, 43, 47] and to the religious ministers about the technique´s approach [15, 16, 35, 45]. Each intervention contained a program for the adequate training for the proper use of the process, and the quality of the content offered was thoroughly assessed regardless of the type of protocols used.
Methodological quality of the articles
Concerning the reliability between examiners, the intraclass correlation coefficient demonstrated positive reliability in the interpretation of the scales (0.832, 95% confidence interval: 0.752 to 0.893).
Table 4 presents the items assessed on the Cochrane scale. The final score ranged from five to nine points, with an average of 6.83 (SD = 9.08). In total, 86.7% of studies were above the cut-off point, and 30% had a score of eight or nine. We observed that none of the research fulfilled the fields for patient and facilitator blinding (D and E), which prevented the articles from achieving the maximum score. The blinding of the outcome assessor (F) was present in 6 studies but not mentioned in 11 studies. Despite the use of different protocols, the intensity, duration and frequency of the procedures (H and J) were reported in 73.3% of the articles. Risk of bias was suspected in 13.3% [29, 45, 52, 54] of the studies based on the final scores received.
Due to the growing interest in the effects of R/S as a complementary treatment in health care, we conducted a systematic review of randomized controlled trials without delimitation of time of publication. The studies revealed a low risk of bias with an average of 6.83 points in the Cochrane scale, which is greater than the cut-off of 6 points. Although diverse populations were assessed in the articles, the main outcomes investigated were grouped into seven items. The RSIs on quality of life, physical activity, pain, promotion of health behaviors and clinical practice of health professionals tended to exhibit small effect sizes favoring the RSIs compared with other complementary strategies used as control groups. Other outcomes, such as cardiac measures, and satisfaction with the protocols, showed no consensus, due to the absence of similar instruments of assessment of the outcomes among the studies. The five different types of intervention–psychotherapy, meditation, church approaches, audiovisual resources and guided visualization–adopted either a religious or spiritual approach, and the most commonly used approach was psychotherapy in 40% of the articles.
Indeed, a significant increase in the search for different types of complementary therapies has occurred in recent decades. A previous systematic review revealed an increase of 9% to 65% in the prevalence of the use of complementary therapy in health care between 1988 and 1997 . These therapies have demonstrated promising results when combined with conventional treatment, including a reduction of physical symptoms and an increase in quality of life, especially in chronic conditions  and with terminally ill patients . Treatments, such as herbal therapies, relaxation techniques, chiropractic, acupuncture, meditation and yoga, are very popular among patients with chronic diseases . Similarly, Barnes et al.  demonstrated that praying for oneself and for others is the complementary therapy most used by Americans.
RSIs applied to mental health are more common than those applied for physical outcomes. Therefore, the similarities in the validated scales and measures for the symptoms provided a few meta-analyses [24, 60–62]. Those published more recently considered the methodological quality in the processes of the systematic review. Oh and Kim revealed a moderate effect size for depression and anxiety (d = 0.69, 95% CI [0.05; 1.34]) , and Gonçalves et al. presented a moderate effect (d = 0.43, 95% CI [0.25; 0.61]) for anxiety, but insignificant effect (d = 0.11, 95% CI [0.03; 0.25]) for depression .
Kruizinga et al.  assessed quality of life in patients with cancer and found that RSIs had a moderate effect size (d = 0.50, 95% CI [0.20; 0.79]) after 2 weeks of treatment. However, the result was insignificant (d = 0.14, 95% CI [0.05; 0.33]) when the articles met the criteria of allocation concealment. In contrast to our study, they considered practices, such as yoga, meditation and tai chi chuan, as RSIs. Given the particularities and the long history of these approaches as complementary therapies [19–21], we did not include them in our study. The final 10 articles that assessed RSIs on quality of life in our review used different scales to measure it. Therefore, we opted not to perform a meta-analysis . Four of the studies revealed no significant differences between the groups. Two studies demonstrated large effect size of RSIs, however it should be interpreted more carefully given that one study had a low score on Cochrane scale and the other study used a waiting list as the control group. Of the remaining four studies, three showed a small effect size, and the remaining study revealed a very small effect favoring RSIs. Our findings are consistent with the aforementioned meta-analyses in which RSIs with better methodological quality exhibit small effects on quality of life when compared with other complementary therapies.
To investigate RSIs in relation to biological outcomes, Oh and Kim  performed a meta-analysis with different diagnoses and observed a small effect size favoring RSIs regarding pain (d = 0.39, 95% CI [0.55; 0.23]). The heterogeneity between the articles was high (I2 = 72%), likely because the study included non-randomized controlled trials. Our five final studies that investigated pain presented the best average on the Cochrane scale (8 points). Although these studies assessed pain using different concepts and methods, similarities were noted concerning the type and focus of interventions. A small effect size favoring RSIs was noted, based on the trustworthy nature of the methodological quality of the articles.
Hulett and Armer  also assessed psychoneuroimmunological outcomes in survivors of cancer and argued that RSIs improve or stabilize the outcomes despite their designs limitations. In our review, studies that investigated cortisol, daily activity and management of chronic diseases exhibited very small effect sizes. Cardiac outcomes, however, did not differ between the groups assessed. Biological outcomes should be further investigated before any conclusions regarding the efficacy of the RSIs are drawn.
We identified additional outcomes that were investigated from the perspective of the RSIs proposals that were not mentioned in previous systematic reviews in the literature. Similar types and focuses of intervention were employed for the loos of weight/physical activity and promotion of health behaviors, and good methodological quality analyses were performed. However, very different scales and outcomes were assessed. Nevertheless, the majority of the results revealed very small results favoring RSIs compared with the control groups proposed (either educational and therapeutic approaches). RSIs do not better influence these outcomes compared with other complementary therapies proposed. Finally, regarding RSIs in the clinical practice of healthcare professionals, the results of the studies were imprecise. No conclusions about the efficacy of RSIs on these types of outcomes could be drawn.
The evidences of the efficacy of RSIs in health identified in our study does not support a high quality of clinical recommendation. Specific recommendations concerning an action would be beyond the scope of a systematic review and should be made by clinical practice guideline developers . The choice of RSIs to the detriment of others should be considered carefully and made in agreement between the health professional and the patient, and even include the family, if necessary. Many patients claim a need to discuss their R/S beliefs during health treatments [2, 67], and some health professionals feel motivated when verify clinical improvements in their patients are verified after approaching the subject [14, 51]. However, caution is recommended when using these treatments, as this is a private and personal matter that should be considered but not used as a prescription . In addition, some doctors do not feel prepared to integrate R/S in clinical practice [69–71]. These observations endorse the necessity of introducing the R/S topic into medical schools to clarify the clinical implications and professional conduct in the field [72, 73].
In reference to the types of interventions, the R/S topic was explored using different methods according to the objective of the intervention. Some were developed by the authors to include any or no religious affiliation, and others were related to a specific religious tradition. The main theme also seemed to be flexible and involve different complementary therapy techniques. The notions of sacredness and the transcendence were stimulated in patients and healthy people through different pathways, such as discursive talk, dynamic group, individual meditation or audiovisual reflections.
Another important point to note in the clinical trials was the exchange of knowledge between the research team and the facilitators of the RSIs. Proper preparation to conduct the RSIs also seemed to be an important factor in avoiding an impression of a punitive approach that religion can occasionally suggests. In cases where a condition is viewed as a “divine punishment”, levels of anxiety, depression and even mortality can increase . If the approach is misinterpreted by patients, the outcomes can provide grief rather than relief [75, 76]. Thus, it is notable that the facilitators ensured that they generally produced the intended positive effect in the patients.
Finally, regarding to the methodological quality of RSIs, we emphasize the importance of minimizing bias in these studies. Due to the absence of double blinding in the studies, meaning that both patient and facilitator are aware of the type of intervention that is being offered, clinical trials in this field have limitations in their performance. With this in mind, it is fundamental to follow the CONSORT guidelines. In 2008, was published an extension to the CONSORT statement that focused on non-pharmacological research and highlighted the relevance of some methodological items that could make a difference in the quality of these studies . These items included the randomization sequence and allocation of participants. It was suggested that these tasks be performed by a person who has no influence on the eligibility of the patients. A second item covered the impartiality of an assessor for the outcomes to avoid biases during final data assessment . Of the final thirty studies considered in our review, only 4 described the use of this strategy, whereas 11 do not mention it. These items do not demand too much additional effort and are attainable for RSIs. Thus, these items should be considered. The similarity in the protocols regarding the experimental and control groups is also another point that should be noted . With respect to the frequency, duration and follow-up of interventions, authors should try to develop standard procedures. Giving proper attention to the methodological design for RSIs can help to produce more solid evidence regarding the effects of this complementary therapy on health.
Directions for future research
Further investigation in this area is imperative to better understand the mechanisms of action behind RSIs. Although the literature revealed evidence of the benefits of R/S on health, the number and quality of these studies are limited. Knowledge about the mechanisms of action of the RSIs is lacking. The consequences of better understanding will greatly impact in clinical practice.
To contribute to future research in this area, we have suggested a standardized RSI protocol described in a brief flowchart for the conceptualization and construction of this type of intervention (Fig 2). In item 1 (Population), we propose the independent use of religious and spiritual measures into the same research, aiming to understand the possible relationship of the different constructs on the outcome assessed. Item 2 (Approach) seeks to reproduce previously published protocols. We suggest using the same structure in new research, allowing a deeper understanding of the effect of R/S on health. Actual protocols are very divergent, and it is difficult to compare studies. This practice is very important and should always be performed. In item 3 (Facilitators), we recommend exploring the exchange between the research team and the religious/spiritual counselors to guarantee a better instrument of intervention. It would also be interesting if studies could investigate the impact of different facilitators on the planned outcomes. We would also like to highlight the importance of following item 4 (CONSORT), which recommends using these guidelines when preparing and standardizing the content and the training of the facilitators.
Similar to other systematic reviews, it is possible that publications that were not indexed in the databases or written in other languages were not included in this study. However, the medical databases employed and the languages chosen are widely used by the scientific community, covering most of the published studies. The inability to perform a meta-analysis was due to the heterogeneous protocols and outcomes reported in each selected study. Another limitation involves the exclusion of studies that investigated ancient practices and philosophies, due to the specific characteristics of their approach, which follow a pre-determined concept and were previously discussed elsewhere [19–21].
Compared with other complementary health therapies, systematically selected clinical trials of RSIs have demonstrated small benefits concerning improvements in quality of life and reducing pain, and similar results on weight loss and health behavior promotion were noted. The diversity of approaches in this field indicate a need for more studies using comparable methodologies to understand the mechanisms of action of RSIs and their role as complementary treatments in health care.
S1 File. PRISMA 2009-checklist.
Checklist of the items of the article following PRISMA guidelines (Preferred Reporting Items for Systematic Reviews and Meta-Analysis).
S2 File. List of excluded articles.
List of the excluded articles in the selection articles process.
S3 File. Search strategy.
Boolean expression with the key words used for the search of the articles are presented for each database used.
- 1. Koenig H, King D, Carson VB. Handbook of religion and health. 2012.
- 2. Puchalski CM. Spirituality and the care of patients at the end-of-life: an essential component of care. Omega (Westport). 2007;56(1):33–46. pmid:18051018.
- 3. Ironson G, Stuetzle R, Fletcher MA. An increase in religiousness/spirituality occurs after HIV diagnosis and predicts slower disease progression over 4 years in people with HIV. J Gen Intern Med. 2006;21 Suppl 5:S62–8. pmid:17083503; PubMed Central PMCID: PMCPMC1924782.
- 4. Guimarães H, Avezum A. Impact of spirituality on physical health. Archives of Clinical Psychiatry (São Paulo). 2007;34:88–94.
- 5. Messina G, Lissoni P, Marchiori P, Bartolacelli E, Brivio F, Magotti L. Enhancement of the efficacy of cancer chemotherapy by the pineal hormone melatonin and its relation with the psychospiritual status of cancer patients. J Res Med Sci. 2010;15(4):225–8. pmid:21526086; PubMed Central PMCID: PMCPMC3082810.
- 6. Lucchetti G, Lucchetti AL, Koenig HG. Impact of spirituality/religiosity on mortality: comparison with other health interventions. Explore (NY). 2011;7(4):234–8. pmid:21724156.
- 7. Baldacchino D. Teaching on the spiritual dimension in care: The perceived impact on undergraduate nursing students. Nurse Education Today. 2008;28(4):501–12. WOS:000256119400014. pmid:18039550
- 8. Larson J. The World Health Organization's definition of health: Social versus spiritual health. Social Indicators Research. 1996;38(2):181–92. WOS:A1996VR86200005.
- 9. Collaborators GBoDS. Global, regional, and national incidence, prevalence, and years lived with disability for 301 acute and chronic diseases and injuries in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;386(9995):743–800. pmid:26063472; PubMed Central PMCID: PMCPMC4561509.
- 10. Tindle HA, Davis RB, Phillips RS, Eisenberg DM. Trends in use of complementary and alternative medicine by US adults: 1997–2002. Altern Ther Health Med. 2005;11(1):42–9. pmid:15712765.
- 11. Baars EW, Kooreman P. A 6-year comparative economic evaluation of healthcare costs and mortality rates of Dutch patients from conventional and CAM GPs. BMJ Open. 2014;4(8):e005332. pmid:25164536; PubMed Central PMCID: PMCPMC4156802.
- 12. Wieland LS, Manheimer E, Berman BM. Development and classification of an operational definition of complementary and alternative medicine for the Cochrane collaboration. Altern Ther Health Med. 2011;17(2):50–9. pmid:21717826; PubMed Central PMCID: PMCPMC3196853.
- 13. Lucchetti G, Lucchetti AL. Spirituality, religion, and health: over the last 15 years of field research (1999–2013). Int J Psychiatry Med. 2014;48(3):199–215. pmid:25492714.
- 14. Moreira-Almeida A, Koenig HG, Lucchetti G. Clinical implications of spirituality to mental health: review of evidence and practical guidelines. Rev Bras Psiquiatr. 2014;36(2):176–82. pmid:24839090.
- 15. Holt CL, Lee C, Wright K. A spiritually based approach to breast cancer awareness: cognitive response analysis of communication effectiveness. Health Commun. 2008;23(1):13–22. pmid:18443989.
- 16. Holt CL, Scarinci IC, Debnam K, McDavid C, Litaker M, McNeal SF, et al. Spiritually based intervention to increase colorectal cancer awareness among african americans: intermediate outcomes from a randomized trial. J Health Commun. 2012;17(9):1028–49. pmid:22724562.
- 17. Breitbart W, Poppito S, Rosenfeld B, Vickers AJ, Li Y, Abbey J, et al. Pilot randomized controlled trial of individual meaning-centered psychotherapy for patients with advanced cancer. J Clin Oncol. 2012;30(12):1304–9. pmid:22370330; PubMed Central PMCID: PMCPMC3648880.
- 18. Bormann JE, Gifford AL, Shively M, Smith TL, Redwine L, Kelly A, et al. Effects of spiritual mantram repetition on HIV outcomes: a randomized controlled trial. J Behav Med. 2006;29(4):359–76. pmid:16847590.
- 19. Cramer H, Lauche R, Azizi H, Dobos G, Langhorst J. Yoga for multiple sclerosis: a systematic review and meta-analysis. PLoS One. 2014;9(11):e112414. pmid:25390344; PubMed Central PMCID: PMCPMC4229199.
- 20. Abbott RA, Whear R, Rodgers LR, Bethel A, Thompson Coon J, Kuyken W, et al. Effectiveness of mindfulness-based stress reduction and mindfulness based cognitive therapy in vascular disease: A systematic review and meta-analysis of randomised controlled trials. J Psychosom Res. 2014;76(5):341–51. pmid:24745774.
- 21. Wang F, Lee EK, Wu T, Benson H, Fricchione G, Wang W, et al. The effects of tai chi on depression, anxiety, and psychological well-being: a systematic review and meta-analysis. Int J Behav Med. 2014;21(4):605–17. pmid:24078491.
- 22. Moher D, Hopewell S, Schulz KF, Montori V, Gøtzsche PC, Devereaux PJ, et al. CONSORT 2010 explanation and elaboration: updated guidelines for reporting parallel group randomised trials. Int J Surg. 2012;10(1):28–55. pmid:22036893.
- 23. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. PLoS Med. 2009;6(7):e1000100. pmid:19621070; PubMed Central PMCID: PMCPMC2707010.
- 24. Gonçalves JP, Lucchetti G, Menezes PR, Vallada H. Religious and spiritual interventions in mental health care: a systematic review and meta-analysis of randomized controlled clinical trials. Psychol Med. 2015;45(14):2937–49. Epub 2015/07/23. pmid:26200715; PubMed Central PMCID: PMCPMC4595860.
- 25. Berger VW, Alperson SY. A general framework for the evaluation of clinical trial quality. Rev Recent Clin Trials. 2009;4(2):79–88. pmid:19463104; PubMed Central PMCID: PMCPMC2694951.
- 26. van Tulder M, Furlan A, Bombardier C, Bouter L, Group EBotCCBR. Updated method guidelines for systematic reviews in the cochrane collaboration back review group. Spine (Phila Pa 1976). 2003;28(12):1290–9. pmid:12811274.
- 27. Lipsey MW, Wilson DB. Practical Meta-Analysis Effect Size Calculator. 2001 [cited 2017 May, 6,7,8,9,10.]. Available from: https://www.campbellcollaboration.org/escalc/html/EffectSizeCalculator-Home.php.
- 28. Cohen J. Statistical Power Analysis for the Behavioral Sciences. 2nd Edition ed: Hillsdale: Lawrence Erlbaum. 1988.
- 29. Jafari N, Zamani A, Farajzadegan Z, Bahrami F, Emami H, Loghmani A. The effect of spiritual therapy for improving the quality of life of women with breast cancer: a randomized controlled trial. Psychol Health Med. 2013;18(1):56–69. pmid:22533516.
- 30. Piderman KM, Johnson ME, Frost MH, Atherton PJ, Satele DV, Clark MM, et al. Spiritual quality of life in advanced cancer patients receiving radiation therapy. Psychooncology. 2014;23(2):216–21. pmid:24019196; PubMed Central PMCID: PMCPMC4332624.
- 31. Wu LF, Koo M. Randomized controlled trial of a six-week spiritual reminiscence intervention on hope, life satisfaction, and spiritual well-being in elderly with mild and moderate dementia. Int J Geriatr Psychiatry. 2016;31(2):120–7. pmid:25965388.
- 32. Oman D, Hedberg J, Thoresen CE. Passage meditation reduces perceived stress in health professionals: a randomized, controlled trial. J Consult Clin Psychol. 2006;74(4):714–9. pmid:16881779.
- 33. Krukowski RA, Lueders NK, Prewitt TE, Williams DK, West DS. Obesity treatment tailored for a Catholic faith community: a feasibility study. J Health Psychol. 2010;15(3):382–90. pmid:20348359.
- 34. Fitzgibbon ML, Stolley MR, Ganschow P, Schiffer L, Wells A, Simon N, et al. Results of a faith-based weight loss intervention for black women. J Natl Med Assoc. 2005;97(10):1393–402. pmid:16355489; PubMed Central PMCID: PMCPMC2594697.
- 35. Djuric Z, Mirasolo J, Kimbrough L, Brown DR, Heilbrun LK, Canar L, et al. A pilot trial of spirituality counseling for weight loss maintenance in African American breast cancer survivors. J Natl Med Assoc. 2009;101(6):552–64. pmid:19585923; PubMed Central PMCID: PMCPMC2719839.
- 36. Anderson KJ, Pullen CH. Physical activity with spiritual strategies intervention: a cluster randomized trial with older African American women. Res Gerontol Nurs. 2013;6(1):11–21. pmid:23244565.
- 37. Feuille M, Pargament K. Pain, mindfulness, and spirituality: A randomized controlled trial comparing effects of mindfulness and relaxation on pain-related outcomes in migraineurs. J Health Psychol. 2015;20(8):1090–106. pmid:24203489.
- 38. Wachholtz AB, Pargament KI. Is spirituality a critical ingredient of meditation? Comparing the effects of spiritual meditation, secular meditation, and relaxation on spiritual, psychological, cardiac, and pain outcomes. J Behav Med. 2005;28(4):369–84. pmid:16049627.
- 39. Wachholtz AB, Pargament KI. Migraines and meditation: does spirituality matter? J Behav Med. 2008;31(4):351–66. pmid:18551362.
- 40. McCauley J, Haaz S, Tarpley MJ, Koenig HG, Bartlett SJ. A randomized controlled trial to assess effectiveness of a spiritually-based intervention to help chronically ill adults. Int J Psychiatry Med. 2011;41(1):91–105. pmid:21495524.
- 41. Bormann JE, Aschbacher K, Wetherell JL, Roesch S, Redwine L. Effects of faith/assurance on cortisol levels are enhanced by a spiritual mantram intervention in adults with HIV: a randomized trial. J Psychosom Res. 2009;66(2):161–71. pmid:19154859; PubMed Central PMCID: PMCPMC2760973.
- 42. Guilherme C, Ribeiro GR, Caldeira S, Zamarioli CM, Oliveira-Kumakura ARdS, Almeida AM, Carvalho EM. Effect of the “Spiritual Support” Intervention on Spirituality and the Clinical Parameters of Women Who Have Undergone Mastectomy: A Pilot Study Religions. 2016. 7(26):1–11.
- 43. Arriola K, Robinson DH, Thompson NJ, Perryman JP. Project ACTS: an intervention to increase organ and tissue donation intentions among African Americans. Health Educ Behav. 2010;37(2):264–74. pmid:19858313; PubMed Central PMCID: PMCPMC3489024.
- 44. Margolin A, Beitel M, Schuman-Olivier Z, Avants SK. A controlled study of a spirituality-focused intervention for increasing motivation for HIV prevention among drug users. AIDS Educ Prev. 2006;18(4):311–22. pmid:16961448.
- 45. Wingood GM, Robinson LR, Braxton ND, Er DL, Conner AC, Renfro TL, et al. Comparative effectiveness of a faith-based HIV intervention for African American women: importance of enhancing religious social capital. Am J Public Health. 2013;103(12):2226–33. pmid:24134367; PubMed Central PMCID: PMCPMC3828974.
- 46. Oman D, Richards TA, Hedberg J, Thoresen CE. Passage meditation improves caregiving self-efficacy among health professionals: a randomized trial and qualitative assessment. J Health Psychol. 2008;13(8):1119–35. pmid:18987085.
- 47. Rosmarin D, Pargament K, Pirutinsky S, Mahoney A. A randomized controlled evaluation of a spiritually integrated treatment for subclinical anxiety in the Jewish community, delivered via the Internet. Journal of Anxiety Disorders. 2010;24(7):799–808. WOS:000281325600021. pmid:20591614
- 48. Bormann JE, Thorp S, Wetherell JL, Golshan S. A spiritually based group intervention for combat veterans with posttraumatic stress disorder: feasibility study. J Holist Nurs. 2008;26(2):109–16. pmid:18356284; PubMed Central PMCID: PMCPMC4083747.
- 49. Koenig HG, Pearce MJ, Nelson B, Shaw SF, Robins CJ, Daher NS, et al. Religious vs. conventional cognitive behavioral therapy for major depression in persons with chronic medical illness: a pilot randomized trial. J Nerv Ment Dis. 2015;203(4):243–51. pmid:25816046.
- 50. Binaei N, Moeini M, Sadeghi M, Najafi M, Mohagheghian Z. Effects of hope promoting interventions based on religious beliefs on quality of life of patients with congestive heart failure and their families. Iran J Nurs Midwifery Res. 2016;21(1):77–83. pmid:26985226; PubMed Central PMCID: PMCPMC4776564.
- 51. Morita T, Murata H, Kishi E, Miyashita M, Yamaguchi T, Uchitomi Y, et al. Meaninglessness in terminally ill cancer patients: a randomized controlled study. J Pain Symptom Manage. 2009;37(4):649–58. pmid:18834700.
- 52. Burkhart L, Schmidt W. Measuring effectiveness of a spiritual care pedagogy in nursing education. J Prof Nurs. 2012;28(5):315–21. pmid:23006654.
- 53. Duru OK, Sarkisian CA, Leng M, Mangione CM. Sisters in motion: a randomized controlled trial of a faith-based physical activity intervention. J Am Geriatr Soc. 2010;58(10):1863–9. pmid:20929464; PubMed Central PMCID: PMCPMC2953732.
- 54. Elias AC, Ricci MD, Rodriguez LH, Pinto SD, Giglio JS, Baracat EC. The biopsychosocial spiritual model applied to the treatment of women with breast cancer, through RIME intervention (relaxation, mental images, spirituality). Complement Ther Clin Pract. 2015;21(1):1–6. pmid:25682524.
- 55. Ernst E. Prevalence of use of complementary/alternative medicine: a systematic review. Bull World Health Organ. 2000;78(2):252–7. pmid:10743298; PubMed Central PMCID: PMCPMC2560678.
- 56. Murthy V, Sibbritt DW, Adams J. An integrative review of complementary and alternative medicine use for back pain: a focus on prevalence, reasons for use, influential factors, self-perceived effectiveness, and communication. Spine J. 2015;15(8):1870–83. pmid:25962340.
- 57. Adams M, Jewell AP. The use of Complementary and Alternative Medicine by cancer patients. Int Semin Surg Oncol. 2007;4:10. pmid:17470282; PubMed Central PMCID: PMCPMC1872026.
- 58. Wootton JC, Sparber A. Surveys of complementary and alternative medicine: part IV. Use of alternative and complementary therapies for rheumatologic and other diseases. J Altern Complement Med. 2001;7(6):715–21. pmid:11822620.
- 59. Barnes P, Powell-Griner E, McFann K, Nahin R. Complementary and alternative medicine use among adults: United States, 2002. Seminars in Integrative Medicine. 2004;2(2):54–71.
- 60. McCullough M. Research on religion-accommodative counseling: Review and meta-analysis. Journal of Counseling Psychology. 1999;46(1):92–8. WOS:000078463900011.
- 61. Smith T, Bartz J, Richards P. Outcomes of religious and spiritual adaptations to psychotherapy: A meta-analytic review. Psychotherapy Research. 2007;17(6):643–55. WOS:000251645600002.
- 62. Oh P, Kim Y. Meta-Analysis of Spiritual Intervention Studies on Biological, Psychological, and Spiritual Outcomes. Journal of Korean Academy of Nursing. 2012;42(6):833–42. WOS:000314621800007. pmid:23364038
- 63. Kruizinga R, Hartog ID, Jacobs M, Daams JG, Scherer-Rath M, Schilderman JB, et al. The effect of spiritual interventions addressing existential themes using a narrative approach on quality of life of cancer patients: a systematic review and meta-analysis. Psychooncology. 2016;25(3):253–65. pmid:26257308.
- 64. Higgins J, Green S. Cochrane Handbook for Systematic Reviews of Interventions. The Cochrane Collaboration.2011. Available from: www.handbook.cochrane.org.
- 65. Hulett JM, Armer JM. A Systematic Review of Spiritually Based Interventions and Psychoneuroimmunological Outcomes in Breast Cancer Survivorship. Integr Cancer Ther. 2016. pmid:27151592.
- 66. Schünemann HJ, Oxman AD, Vist GE, Higgins JPT, Deeks JJ, Glasziou P, et al. Chapter 12: Interpreting results and drawing conclusions. Available from www.handbook.cochrane.org: The Cochrane Collaboration, 2011.
- 67. Stein EM, Kolidas E, Moadel A. Do spiritual patients want spiritual interventions?: A qualitative exploration of underserved cancer patients' perspectives on religion and spirituality. Palliat Support Care. 2015;13(1):19–25. pmid:23916058.
- 68. Sloan RP, Bagiella E, Powell T. Religion, spirituality, and medicine. Lancet. 1999;353(9153):664–7. pmid:10030348.
- 69. Awaad R, Ali S, Salvador M, Bandstra B. A Process-Oriented Approach to Teaching Religion and Spirituality in Psychiatry Residency Training. Acad Psychiatry. 2015;39(6):654–60. pmid:25510222.
- 70. Huguelet P, Mohr S, Betrisey C, Borras L, Gillieron C, Marie AM, et al. A randomized trial of spiritual assessment of outpatients with schizophrenia: patients' and clinicians' experience. Psychiatr Serv. 2011;62(1):79–86. pmid:21209304.
- 71. Menegatti-Chequini MC, Gonçalves JP, Leão FC, Peres MF, Vallada H. A preliminary survey on the religious profile of Brazilian psychiatrists and their approach to patients' religiosity in clinical practice. BJPsych Open. 2016;2(6):346–52. Epub 2016/11/03. pmid:27847592; PubMed Central PMCID: PMCPMC5099984.
- 72. Neely D, Minford EJ. Current status of teaching on spirituality in UK medical schools. Med Educ. 2008;42(2):176–82. pmid:18230090.
- 73. Lucchetti G, Lucchetti AL, Puchalski CM. Spirituality in medical education: global reality? J Relig Health. 2012;51(1):3–19. pmid:22130583.
- 74. Pargament KI, Koenig HG, Tarakeshwar N, Hahn J. Religious struggle as a predictor of mortality among medically ill elderly patients: a 2-year longitudinal study. Arch Intern Med. 2001;161(15):1881–5. pmid:11493130.
- 75. Davidson JR, Connor KM, Lee LC. Beliefs in karma and reincarnation among survivors of violent trauma—a community survey. Soc Psychiatry Psychiatr Epidemiol. 2005;40(2):120–5. pmid:15685403.
- 76. Stratta P, Capanna C, Riccardi I, Carmassi C, Piccinni A, Dell'Osso L, et al. Suicidal intention and negative spiritual coping one year after the earthquake of L'Aquila (Italy). J Affect Disord. 2012;136(3):1227–31. pmid:22100127.
- 77. Boutron I, Moher D, Altman DG, Schulz KF, Ravaud P, Group C. Extending the CONSORT statement to randomized trials of nonpharmacologic treatment: explanation and elaboration. Ann Intern Med. 2008;148(4):295–309. pmid:18283207.