Figures
Abstract
Background
Placebo or sham controls are the standard against which the benefits and harms of many active interventions are measured. Whilst the components and the method of their delivery have been shown to affect study outcomes, placebo and sham controls are rarely reported and often not matched to those of the active comparator. This can influence how beneficial or harmful the active intervention appears to be. Without adequate descriptions of placebo or sham controls, it is difficult to interpret results about the benefits and harms of active interventions within placebo-controlled trials. To overcome this problem, we developed a checklist and guide for reporting placebo or sham interventions.
Methods and findings
We developed an initial list of items for the checklist by surveying experts in placebo research (n = 14). Because of the diverse contexts in which placebo or sham treatments are used in clinical research, we consulted experts in trials of drugs, surgery, physiotherapy, acupuncture, and psychological interventions. We then used a multistage online Delphi process with 53 participants to determine which items were deemed to be essential. We next convened a group of experts and stakeholders (n = 16). Our main output was a modification of the existing Template for Intervention Description and Replication (TIDieR) checklist; this allows the key features of both active interventions and placebo or sham controls to be concisely summarised by researchers. The main differences between TIDieR-Placebo and the original TIDieR are the explicit requirement to describe the setting (i.e., features of the physical environment that go beyond geographic location), the need to report whether blinding was successful (when this was measured), and the need to present the description of placebo components alongside those of the active comparator.
Citation: Howick J, Webster RK, Rees JL, Turner R, Macdonald H, Price A, et al. (2020) TIDieR-Placebo: A guide and checklist for reporting placebo and sham controls. PLoS Med 17(9): e1003294. https://doi.org/10.1371/journal.pmed.1003294
Published: September 21, 2020
Copyright: © 2020 Howick et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: JH and RKW were supported by the University of Oxford Humanities Division Research Excellence Framework Support Fund-provided funding for part of this project. AWME was funded by a Vici grant from the Netherlands Organization for Scientific Research (NWO) (Number: 45316004) and a European Research Council Consolidator Grant (ERC‐2013‐CoG‐617700). VN was supported by the National Institutes of Health, National Center for Complementary and Integrative Health (R01‐AT007550, R61/R33‐AT009306, P01-AT009965), and the National Institute of Arthritis and Musculoskeletal and Skin Diseases (R01‐AR064367). GSC was supported by the National Institutes for Health Research Biomedical Research Centre, Oxford and Cancer Research United Kingdom (grant C49297/A27294). TH is supported by a National Health and Medical Research Council of Australia Senior Research Fellowship. None of the funders played any role in the study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: (1) TH is an author of the main TIDieR statement; (2) RT is an editor at PLOS Medicine. The other authors have declared that no other competing interests exist.
Abbreviations: BI, blinding index; CONSORT, Consolidated Standards of Reporting Trials; EQUATOR, Enhancing the QUAlity and Transparency Of health Research; SIPS, Society for Interdisciplinary Placebo Studies; TIDieR, Template for Intervention Description and Replication
Background
Placebo or sham controls are the standard against which the effectiveness of many active interventions are compared [1]. To appraise whether an active intervention is effective therefore requires that the placebo or sham intervention be described. However, a decade of research shows that placebo or sham interventions in trials are rarely reported in adequate detail. A 2010 systematic review found that between 8.2% (pharmacological) and 26.7% (nonpharmacological) trials adequately described placebo or sham interventions [2]. Ten years later, things have barely improved [3]. Hence, the need to look more closely at what placebo or sham comparators are is becoming more widely recognised [4].
A possible reason for the failure to describe placebo or sham components is the misconception that they are inactive or inert [5]. There would be little point in describing inert things. In fact, placebos and sham interventions are a heterogeneous group of interventions that can cause benefits and harms. Even simple lactose pills are active for diabetics or people with lactose intolerance. The size, shape, and colour of drugs can influence the effects that are measured or perceived [6, 7]. In certain cultural contexts [8], for example, red tablets can produce a larger stimulating effect than blue ones [9], expensive tablets may have greater analgesic effects than generic cheap ones [10], and two placebos can be more effective than one [11]. More invasive placebo or sham interventions have greater effects [6, 7, 11]. Brand-name, expensive interventions (or those believed to be expensive and have a brand name) have been shown in some studies to have greater effects [12, 13]. In one study, cellulose acetate phthalate (typically used to coat pills) was reported to have activity against several sexually transmitted diseases, including herpes, in mice [14]. See S1 Text for additional examples.
Placebo interventions can also cause adverse events. For instance, some placebo pills deliberately contain ingredients to mimic a drug side effect to improve blinding [15]. For instance, in some trials of oseltamivir, the placebo contained dehydrocholic acid and dibasic calcium phosphate dihydrate. This was presumably done to mimic the bitter taste of the active intervention (oseltamivir powder) and maintain blinding. However, dehydrocholic acid can cause gastrointestinal symptoms [16]. This may have led to underestimating the gastrointestinal adverse events of oseltamivir, which was determined by comparing rates of gastrointestinal adverse events in drug with placebo groups. The term ‘active’ is used to qualify ‘placebo’ when the placebo contains an ingredient that mimics the side effect of the drug. To reduce conceptual ambiguity, we preserve the term ‘active’ to refer to nonplacebo interventions.
If placebo or sham interventions were always matched with their active comparator interventions, the problem with failure to describe placebo or sham interventions would not be as serious. This is because a trial comparing the suitably matched placebo or sham with an active intervention would reveal the incremental benefit and harm (if any) of the relevant components of the active intervention. However, a 2016 study found that 44% of control treatments were inadequately matched [17]. Worse, since placebo components are not well reported, we cannot determine precisely how common unmatching is. Without clear reporting, researchers and clinical decision-makers will not know what the effects of the placebo or sham comparator are and could subsequently overestimate or underestimate the benefits or harms of the active intervention they are testing.
The Consolidated Standards of Reporting Trials (CONSORT) statement recommends that trial interventions be adequately described. However, little detail is provided, and subsequent researchers have found that intervention reporting was poor [18]. To address intervention reporting, the Template for Intervention Description and Replication (TIDieR) checklist was developed to aid reporting of interventions and can be used in conjunction with CONSORT. However, neither CONSORT nor TIDieR explicitly mention placebo or sham controls, and our background research revealed that they require some modification to guide adequate reporting of these interventions [3].
To address this gap, a team of researchers, editors, and patient representatives developed TIDieR-Placebo. It modifies the original TIDieR so that it is directly applicable to placebo and sham interventions and is designed to be used alongside the original TIDieR. Some of these individuals were also involved in developing the original TIDieR.
Methodology
We followed Enhancing the QUAlity and Transparency Of health Research (EQUATOR) Network guidance for developing this reporting guideline. The development of TIDieR-Placebo consisted of 5 main phases: (1) background research, (2) panel selection, (3) generation of initial checklist, (4) optimisation of the checklist, and (5) approval of the final checklist.
Preliminary research
JH, TH, and RKW conducted preliminary research exploring the need to describe placebo and sham components adequately [2, 3, 19]. JH drafted and registered the protocol [20].
Panel selection
To advise on the development of the checklist, we invited panel members who were identified based on a review of key authors in the field, as well as membership in the Society for Interdisciplinary Placebo Studies (SIPS). We ensured that researchers with the relevant expertise in different types of placebo or sham controls (physiotherapy, surgery acupuncture, drug), or reporting guidelines were invited. One of the panel members (AP) obtained ongoing feedback from 5 patient representatives throughout the guideline development process (see S1 Data for details).
Generation of the initial checklist
The panel generated the initial list of items, including illustrative vignettes, through brainstorming and discussion and taking into account existing TIDieR items [21].
Optimisation of the checklist
S2 Text has full details of the optimisation process.
Delphi survey.
Members of the SIPS, together with an additional 24 people with expertise in placebo/sham controls or research reporting, were invited to take part in a multistage Delphi survey process. They were asked to rate items on the long list from 1 (omit) to 4 (essential) and were given the opportunity to provide full-text comments and recommend additional items. For subsequent rounds, participants were asked to rate the items generated in the long list and again had the opportunity to provide free-text comments. We planned on having 2 or 3 rounds depending on the level of agreement reached.
Consensus meeting and approval of final checklist.
The results of the Delphi survey were reported at a 2-day consensus meeting with the panel members (supplemented by additional guideline reporting experts) on 10–11 September 2019, in Oxford, UK. Meeting attendees discussed the results of the Delphi survey and agreed on the final list of items.
To reduce the burden of ‘guideline fatigue’, the panel agreed to be conservative in choices to deviate from existing related checklists (especially TIDieR and CONSORT). For similar reasons, we decided that the extension should be concise and machine-readable. We also agreed that items that were highly ranked by Delphi survey respondents should be kept. Disagreements were resolved by discussion.
Deviations from protocol
In the protocol, we anticipated having 12 members of the panel [20], and the final number was 14.
Results
TIDieR-Placebo panel
Fifteen individuals were invited to be part of the TIDieR-Placebo panel, and 14 agreed. Nine were female, and 5 were male; 9 were based in the United Kingdom, 2 in the United States, 2 in Continental Europe, and 1 in Australia.
Generation of initial checklist
This resulted in a long list of 45 placebo or sham components for potential inclusion. There were 14 generic items (which included all the original TIDieR items) and other items useful only for specific types of sham interventions (such as ‘participant access to operation note detailing sham surgery’).
Optimisation of the checklist
Delphi survey.
For the first round of our web-based survey, we invited 172 participants, and 31% (n = 53) responded (see Table 1 for characteristics). Of the 45 items, 31 were ranked as essential or desirable by at least 85% of respondents, 14 were moderately ranked as essential or desirable by at least 65% of respondents, and 4 additional items were suggested in the free-text comments (S2 Text presents full details). For round 2, only those who responded to round 1 (n = 53) were invited to take part. Sixty-six percent (35 of 53) responded. After 2 rounds, 36 items were included in the draft checklist.
Consensus meeting.
Following the Delphi survey respondents, the placebo expert panel agreed that the original TIDieR items should be kept but that TIDieR-Placebo required 2 additions and several elaborations in order to be applicable to placebo or sham controls.
The 2 items most consistently ranked as ‘essential’ by >80% of Delphi respondents were reporting how placebo/sham components compared to those of the active intervention and measuring the success of blinding. To achieve the former, we recommend that descriptions of placebo or sham interventions are presented in a table alongside the active intervention’s description. S1 Table is a checklist that can be used to guide reporting of placebo and active interventions, and S2 Table contains descriptions of active and placebo/sham drug, surgery, psychology, acupuncture, and physiotherapy interventions.
The group discussed measuring the success of blinding extensively. Earlier versions of the CONSORT Statements recommended it [22], and later editions did not [23]. Whilst there are many cases in which lack of success of blinding does not indicate lower quality (for example, in medication cessation trials and most exercise trials), measuring the success of blinding often indicates whether the placebo or sham functioned as intended [24]. Hence, knowing whether blinding was successful can be useful. Methods for measuring the success of blinding have been developed and are currently in use. They include Bang’s ‘blinding index’ (BI) [25] and James’ BI [26]. Both ask patients to state whether they believed they received the experimental active intervention. In light of these considerations and to remain faithful to the Delphi survey responses, we agreed to add measuring the success of blinding as a TIDieR-Placebo item. We added a caveat that a measure of the success of blinding (or indeed any of the other items) is not to condemn researchers that have not done so but to encourage those who have measured the fidelity of blinding to report it. We plan to provide an outline of the case for and against measuring the success of blinding in a separate publication; see S3 Text for additional discussion of this point.
The additional explanations required to describe placebo or sham controls are all below and in S2 Table. There was an extensive discussion around whether to use the term ‘setting’ (which was recommended in the free-text comments by Delphi respondents but not used by the original TIDieR). In the meeting, it was agreed by most attendees that setting as well as location for item 7 (Where) can influence outcomes. Location is typically understood as geographic location, whereas setting can also include potentially important features of the location, such as lighting and noise. Birth setting trials were the most markedly affected, with between 68% and 85% of eligible women declining to be in trials because of preference for a particular healthcare setting [27]. In some trials, less specialised and less costly home settings are as effective as hospital settings, independently of geographic location [28, 29]. Studies have also found that factors such as noise, daylight deprivation, and light intensity may increase stress and pain level, as well as affect length of hospital stay [30–32]. Also, surgical patients might be recruited from outpatient clinics, preadmission clinics, or research clinics. Each of these settings comes with a different potential anxiety that affect the type of patient recruited as well as preoperative scores, which in turn can affect surgical outcomes. None of them are primarily related to geographic location [33].
An issue that arose at the consensus meeting, but not the Delphi survey, surrounded the ambiguity around whether certain control interventions are shams or placebos. For example, in one trial measuring methods to reduce stress amongst researchers of violence, researchers allocated participants to either group debriefings or 3 leisure sessions consisting of uplifting film viewings [34]. The film viewings were not described as sham interventions, and it is not clear whether they functioned as placebo/sham controls because taking ‘time out’ to watch a light-hearted film could, and indeed has been known to, change physiology [35]. Hence, in these cases, we recommend reporting the control according to TIDieR-Placebo. The same applies if the control is usual care or waiting list [36].
After the meeting, the report and checklist were distributed to the participants to ensure it reflected all decisions made, and this explanatory document was generated. It was then tested for face validity with 20 researchers who were conducting placebo or sham-controlled trials of different types. As a result, minor modifications were made.
Final TIDieR-Placebo checklist
We have elaborated on items only when they require explanation over and above that already provided in the original TIDieR statement (see Table 2; downloadable version: S1 Table).
1. Brief name: Provide the name or a phrase that describes the placebo/sham intervention. Brand-name, expensive interventions have been shown in some studies to have greater effects (see above). The name also enables easy identification of the placebo or sham intervention in the report. Abbreviations or acronyms should be explained in full or short descriptive statements provided. Examples:
- ‘0.9% normal saline [37]’.
- ‘…the enhanced group’s active treatment was referred to as Singulair [38]’.
2. Why: Describe any rationale, theory, or goal of the elements essential to the placebo/sham intervention. The rationale for the placebo or sham chosen will usually (but not always) be to control for certain components of the active intervention. These components should be specified so that readers can appraise the extent to which this aim was achieved. Examples:
- ‘Because brand names are associated with increased perceived potency [38]’.
- ‘To control for therapist contact and support, expectations, homework tasks, etc, RT [Relaxation Techniques] participants were taught a series of relaxation techniques… [39]’.
3. What (materials): Describe any physical or informational materials used in the placebo/sham intervention, including those provided to participants or used in intervention delivery or in training of intervention providers. Provide information on where the materials can be accessed (such as an online appendix, URL). Examples:
- ‘We used transcutaneous electrical nerve stimulation (TENS) equipment…For sham, instead of DD [Dense Disperse], a 40Hz adjustable (ADJ) wave was used [40]’.
- ‘…placebo (consisting of calcium phosphate, starch, cellulose, and magnesium stearate)…the placebo tablets were the same size and shape as the penicillin tablets, the tablets were not identical owing to the cost implications of overencapsulation (the placebo tablets were unmarked, and the penicillin tablets were marked) [41]’.
4. What (procedures): Describe each of the procedures, activities, and/or processes used in the placebo/sham intervention, including any enabling or support activities. Beyond describing standard procedures, reporting of more subtle procedures (such as nonverbal cues) [42, 43] and context [44] can influence outcomes. Examples:
- ‘Participants were encouraged to discuss their health anxiety and helpful ways of coping with it and to provide support to others randomised to the control group. The discussion forum was monitored by a clinical psychologist on a daily basis to ensure that discussions were conducted in a respectful manner [45]’.
- ‘The placebo group received a sham Kinesio Tape application, consisting of a single I-strip of the same tape applied transversely immediately above the point of maximum lumbar pain [46]’.
5. Who provided: For each category of placebo/sham intervention provider (such as psychologist, nursing assistant), describe their expertise, background, and any specific training given. [47] Examples:
- ‘4 physical therapists, all with a minimum of 5 years of clinical experience in outpatient orthopaedic settings [48]’.
- ‘Six acupuncturists trained in traditional Chinese medicine, licensed by the Texas State Board of Medical Examiners, were recruited through the American College of Acupuncture & Oriental Medicine (ACAOM). To ensure uniformity, all were Chinese, male, and had at least two years of clinical experience [40]’.
6. How: Describe the modes of delivery (such as face to face or by some other mechanism, such as internet or telephone) of the placebo/sham intervention and whether it was provided individually or in a group. Examples:
- ‘Three of the sessions were face-to-face, where the patient came into the hospital to meet with the therapist. The other five sessions were completed by telephone to increase the likelihood of attendance and reduce the stress of travel for participants [39]’.
- ‘Intervention was delivered over the phone [49]’.
7. Where: Describe the type(s) of locations(s) and settings where the placebo/sham intervention occurred, including any necessary infrastructure or relevant features. Both geographic location and features of the location (setting) can be important. Examples:
- ‘32 hospital sites in the UK [50]’.
- ‘Cadet Physical Therapy Clinic at the United States Military Academy or Keller Army Community Hospital at West Point, NY [48]’.
8. When and how much: Describe the number of times the placebo/sham intervention was delivered and over what period of time, including the number of sessions, their schedule, and their duration, intensity, or dose. If relevant, include the duration of the pre- and postrandomisation consultations. Reporting the pre- and postintervention consultation details is especially important in cases in which practitioners are not blinded after randomisation (as is often the case in sham surgery trials). In the prerandomisation consultation, equal time and the same ‘quality of care’ [51] might be spent describing the placebo compared with the experimental active intervention. One of our surgical trial experts (JLR) highlighted his experience of the ease with which postsurgical consultations or clinical contact with other treating health professionals can advertently or inadvertently unblind the patient and subsequently affect some clinical outcomes. For example, a recovery nurse might read an operation note (and learn which group the patient was in) and, not knowing the patient was in a trial, reveal to the patient which intervention they received. Examples:
- ‘…a loading dose of 1 g of tranexamic acid infused over 10 min, followed by intravenous infusion of …matching placebo (0·9% saline)…over 8 h [52]’.
- ‘For sham, instead of dense disperse wave, a 40Hz adjustable wave was used. Voltage was increased until the patient could feel it and then immediately turned off. Patients rested for 20’ with the needles retained, but without TENS stimulation [40]’.
9. Tailoring: If the placebo/sham intervention was planned to be personalised, titrated, or adapted, then describe what, why, when, and how. Examples:
- ‘Participants were asked if the tape was limiting lumbar movement and, if so, the tape was reapplied so that they had unrestricted range of motion [53]’.
- ‘Patients were allowed to receive placebo beyond radiographic progression as long as they continued to have clinical benefit [54]’.
10. Modifications: If the placebo/sham intervention was modified during the course of the study, describe the changes (what, why, when, and how). Examples:
- ‘In some cases, the face-to-face were replaced with phone sessions if needed [55]’.
- ‘…the protocol was amended to require a time-out before the beginning of surgery [sham neurosurgery] on each side of the brain, with the coordinates confirmed by the surgeon and documented in writing by a study coordinator or other surgical team member before penetration of the brain [56]’.
11. How well (planned): If placebo/sham intervention adherence or fidelity was assessed, describe how and by whom, and if any strategies were used to maintain or improve fidelity, describe them. Planning to measure adherence to active as well as placebo/sham intervention could help detect whether an adverse event or unblinding may have contributed to change in adherence. Examples:
- ‘We also requested that patients complete a diary card on which the number of pills [placebo and active intervention] taken every day was recorded [57]’.
- ‘[Sham exercise] Sessions were recorded in a logbook to ensure compliance [58]’.
12. How well (actual): If placebo/sham intervention adherence or fidelity was assessed, describe the extent to which the intervention was delivered as planned. Examples:
- ‘Four patients did not receive the allocated injection (1 in the placebo group and 3 in the corticosteroid group) due to nonattendance (n = 2; 1%) or alternative medical advice (n = 2; 1%) [59]’.
- ‘…the proportion of patients who reported taking at least 75% of the tablets was similar in the two groups (79% in the penicillin group and 78% in the placebo group) [41]’.
13. Measuring the success of blinding: Was blinding measured, and if so, how, and what were the results of such measurement? Failure to demonstrate the success of blinding does not imply that the trial is invalid or lower quality. However, it can be useful to know whether blinding was successful in cases where it was measured. Examples:
- ‘As the James’ blinding indices were >0.5 and Bang’s blinding indices did not approach 1 or −1, participants were considered to have been blinded successfully on average [60]’.
- ‘Treatment allocation was correctly guessed by the outcome assessor in 53% (20/38) of cases receiving the placebo injection only, 39% (16/41) of cases receiving the placebo injection plus physiotherapy, 44% (18/41) of cases receiving the corticosteroid injection only, and 39% (15/38) of cases receiving the corticosteroid injection plus physiotherapy [59]’.
Discussion
Summary
To facilitate critical appraisal of the benefits and harms of the active interventions with which they are compared, placebo or sham controls need to be reported with the same rigour as experimental active interventions. Some features of placebo or sham controls require emphasis for complete reporting, such as nonverbal cues, setting, and success of blinding. Here, we report the development of TIDieR-Placebo, a reporting guideline intended to encourage the concise and accurate reporting of the nature and implementation of placebo or sham controls so as to aid in the interpretation and use of clinical research findings.
Strengths and limitations
We followed the methodology recommended by the EQUATOR Network and believe this is the first guideline to explicitly incorporate patient perspectives. A limitation is that our survey for eliciting potential TIDieR-Placebo items asked readers to consider drug, surgery, psychological, and acupuncture, but not some other intervention subtypes such as physiotherapy, psychological, or behavioural interventions. To mitigate this, some members of the team are behavioural trial (CM) and physiotherapy trial (SL) experts. Also, our sample of survey respondents, whilst experts in placebo/sham interventions, may have been unrepresentative. Because our background research showed that placebo components are often ignored, we believed it was necessary to focus on researchers who were familiar with placebo and sham interventions. To mitigate this, we sent the manuscript to 20 trialists who user tested the manuscript and took their feedback into account.
Conclusion and recommendations
TIDieR-Placebo is a user-friendly guide for reporting placebo and sham control interventions that can be used alongside other checklists. Its use will enhance the understanding and ability to implement and appraise placebo- and sham-controlled trials. We would encourage that it be recommended by journal editors, included by the EQUATOR Network, and used alongside other checklists, particularly CONSORT. Core members of the panel will work with EQUATOR, CONSORT, and TIDieR working groups to review and develop the guideline in the future.
Supporting information
S1 Table. TIDieR-Placebo checklist (to be used alongside TIDieR-Placebo guide).
TIDieR, Template for Intervention Description and Replication.
https://doi.org/10.1371/journal.pmed.1003294.s001
(DOCX)
S2 Table. Examples of TIDieR-Placebo with illustrations of pharmacological, surgical, psychological, acupuncture, behavioural*, and physiotherapy placebo/shams and active interventions.
TIDieR, Template for Intervention Description and Replication.
https://doi.org/10.1371/journal.pmed.1003294.s002
(DOCX)
S1 Data. Results of public and patient involvement.
https://doi.org/10.1371/journal.pmed.1003294.s003
(DOCX)
S1 Text. Additional examples in which choice of placebo/sham influenced benefits or harms of active intervention.
https://doi.org/10.1371/journal.pmed.1003294.s004
(DOCX)
S2 Text. Supporting information: Full report of Delphi consensus survey.
https://doi.org/10.1371/journal.pmed.1003294.s005
(DOCX)
Acknowledgments
We acknowledge the insightful contributions of our non-placebo–expert participants, Michael Mittelman, Lenny Vasanthan, Deborah Carter, PhD, and Madhava Sai Viva Sivapuram, MD. We also appreciate and acknowledge the useful contributions of the placebo experts who participated in the Delphi survey and who agreed to be identified: Professor John Kelley, Professor Karin Meissner, Dr. Kaya Peerdeman, Professor Mirta Fiorio, Dr. Marco Testa, Professor Marco Annoni, Dr. Antonio Capafons, Professor Hugh Macpherson, Professor Dave Newell, Dr. Liesbeth van Vliet, Professor Klaus Linde, Dr. Opher Caspi, Dr. Johannes Laferton, Dr. Glacomo Rossettini, Professor Fabrizio Benedetti, and Dr. Daniel Moerman.
References
- 1. Ellenberg SS, Temple R. Placebo-controlled trials and active-control trials in the evaluation of new treatments. Part 2: practical issues and specific cases. Ann Intern Med. 2000;133(6):464–70. pmid:10975965.
- 2. Golomb BA, Erickson LC, Koperski S, Sack D, Enkin M, Howick J. What’s in placebos: who knows? Analysis of randomized, controlled trials. Annals of internal medicine. 2010;153(8):532–5.
- 3. Webster RK, Howick J, Hoffmann T, Macdonald H, Collins GS, Rees JL, et al. Inadequate description of placebo and sham controls in a systematic review of recent trials. Eur J Clin Invest. 2019;49(11):e13169. pmid:31519047.
- 4. Beard DJ, Campbell MK, Blazeby JM, Carr AJ, Weijer C, Cuthbertson BH, et al. Considerations and methods for placebo controls in surgical trials. The Lancet. 2020;395(10226):828–38.
- 5. Howick J. The relativity of placebos: defending a modified version of Grünbaum’s scheme. Synthese. 2017;194(4):1363–96.
- 6. de Craen AJ, Tijssen JG, de Gans J, Kleijnen J. Placebo effect in the acute treatment of migraine: subcutaneous placebos are better than oral placebos. J Neurol. 2000;247(3):183–8. pmid:10787112.
- 7. Zhang W, Robertson J, Jones AC, Dieppe PA, Doherty M. The placebo effect and its determinants in osteoarthritis: meta-analysis of randomised controlled trials. Ann Rheum Dis. 2008;67(12):1716–23. pmid:18541604.
- 8.
Moerman DE. Meaning, medicine, and the "placebo effect". Cambridge: Cambridge University Press; 2002.
- 9. de Craen AJ, Roos PJ, Leonard de Vries A, Kleijnen J. Effect of colour of drugs: systematic review of perceived effect of drugs and of their effectiveness. BMJ. 1996;313(7072):1624–6. pmid:8991013.
- 10. Waber RL, Shiv B, Carmon Z, Ariely D. Commercial features of placebo and therapeutic efficacy. JAMA. 2008;299(9):1016–7. pmid:18319411.
- 11. de Craen AJ, Moerman DE, Heisterkamp SH, Tytgat GN, Tijssen JG, Kleijnen J. Placebo effect in the treatment of duodenal ulcer. Br J Clin Pharmacol. 1999;48(6):853–60. pmid:10594490.
- 12. Branthwaite A, Cooper P. Analgesic effects of branding in treatment of headaches. Br Med J (Clin Res Ed). 1981;282(6276):1576–8. pmid:6786566.
- 13. Faasse K, Cundy T, Gamble G, Petrie KJ. The effect of an apparent change to a branded or generic medication on drug effectiveness and side effects. Psychosom Med. 2013;75(1):90–6. pmid:23115341.
- 14. Gyotoku T, Aurelian L, Neurath AR. Cellulose acetate phthalate (CAP): an ‘inactive’ pharmaceutical excipient with antiviral activity in the mouse model of genital herpesvirus infection. Antivir Chem Chemother. 1999;10(6):327–32. pmid:10628808.
- 15. Moncrieff J, Wessely S, Hardy R. Active placebos versus antidepressants for depression. Cochrane Database Syst Rev. 2004;(1):CD003012. pmid:14974002.
- 16. Jefferson T, Jones M, Doshi P, Spencer EA, Onakpoya I, Heneghan CJ. Oseltamivir for influenza in adults and children: systematic review of clinical study reports and summary of regulatory comments. BMJ. 2014;348:g2545. pmid:24811411.
- 17. Bello S, Wei M, Hilden J, Hrobjartsson A. The matching quality of experimental and control interventions in blinded pharmacological randomised clinical trials: a methodological systematic review. BMC Med Res Methodol. 2016;16:18. pmid:26873063.
- 18. Hoffmann TC, Erueti C, Glasziou PP. Poor description of non-pharmacological interventions: analysis of consecutive sample of randomised trials. BMJ. 2013;347:f3755. pmid:24021722.
- 19. Howick J, Hoffmann T. How placebo characteristics can influence estimates of intervention effects in trials. CMAJ. 2018;190(30):E908–E11. pmid:30061325.
- 20.
Howick J, Bishop F, Collins G, Evers A, Hoffmann T, Lamb S, et al. TIDieR—Placebo checklist explanation and elaboration: protocol 2019. 2019 [cited 2020 Jan 1]. https://www.equator-network.org/wp-content/uploads/2019/05/TIDieR-Placebo-Protocol-v11.pdf.
- 21. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. pmid:24609605.
- 22. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, et al. Improving the quality of reporting of randomized controlled trials. The CONSORT statement. JAMA. 1996;276(8):637–9. pmid:8773637.
- 23. Schulz KF, Altman DG, Moher D. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoS Med. 2010;7(3):e1000251. pmid:20352064.
- 24.
Howick J. The Philosophy of Evidence-Based Medicine. Oxford: Wiley-Blackwell; 2011.
- 25. Bang H, Ni L, Davis CE. Assessment of blinding in clinical trials. Control Clin Trials. 2004;25(2):143–56. pmid:15020033.
- 26. James KE, Bloch DA, Lee KK, Kraemer HC, Fuller RK. An index for assessing blindness in a multi-centre clinical trial: disulfiram for alcohol cessation—a VA cooperative study. Stat Med. 1996;15(13):1421–34.
- 27. Corbett MS, Watson J, Eastwood A. Randomised trials comparing different healthcare settings: an exploratory review of the impact of pre-trial preferences on participation, and discussion of other methodological challenges. BMC Health Serv Res. 2016;16(1):589. pmid:27756285.
- 28. Jolly K, Taylor R, Lip GY, Greenfield S, Raftery J, Mant J, et al. The Birmingham Rehabilitation Uptake Maximisation Study (BRUM). Home-based compared with hospital-based cardiac rehabilitation in a multi-ethnic population: cost-effectiveness and patient adherence. Health Technol Assess. 2007;11(35):1–118. pmid:17767899.
- 29. Dalal HM, Evans PH, Campbell JL, Taylor RS, Watt A, Read KL, et al. Home-based versus hospital-based rehabilitation after myocardial infarction: A randomized trial with preference arms—Cornwall Heart Attack Rehabilitation Management Study (CHARMS). Int J Cardiol. 2007;119(2):202–11.
- 30. Walch JM, Rabin BS, Day R, Williams JN, Choi K, Kang JD. The effect of sunlight on postoperative analgesic medication use: a prospective study of patients undergoing spinal surgery. Psychosom Med. 2005;67(1):156–63. pmid:15673638.
- 31. Malenbaum S, Keefe FJ, Williams AC, Ulrich R, Somers TJ. Pain in its environmental context: implications for designing environments to enhance pain control. Pain. 2008;134(3):241–4. pmid:18178010.
- 32. Ulrich N, Baum N. Going green in the medical office is more than wearing green. J Med Pract Manage. 2010;26(2):109–12. pmid:21090207.
- 33. Singleton N, Poutawera V. Does preoperative mental health affect length of hospital stay and functional outcomes following arthroplasty surgery? A registry-based cohort study. J Orthop Surg (Hong Kong). 2017;25(2):2309499017718902. pmid:28673198.
- 34. Grundlingh H, Knight L, Naker D, Devries K. Secondary distress in violence researchers: a randomised trial of the effectiveness of group debriefings. BMC Psychiatry. 2017;17(1):204. pmid:28578682.
- 35. McClelland LE, Vogus TJ. Compassion practices and HCAHPS: does rewarding and supporting workplace compassion influence patient perceptions? Health Serv Res. 2014;49(5):1670–83. pmid:24837713.
- 36. Erlen JA, Tamres LK, Reynolds N, Golin CE, Rosen MI, Remien RH, et al. Assessing usual care in clinical trials. West J Nurs Res. 2015;37(3):288–98. Epub 2014 Mar 12. pmid:24622154.
- 37. Gallagher TQ, Hill C, Ojha S, Ference E, Keamy DG, Williams M, et al. Perioperative dexamethasone administration and risk of bleeding following tonsillectomy in children: a randomized controlled trial. JAMA. 2012;308(12):1221–6. pmid:23011712.
- 38. Wise RA, Bartlett SJ, Brown ED, Castro M, Cohen R, Holbrook JT, et al. Randomized trial of the effect of drug presentation on asthma outcomes: the American Lung Association Asthma Clinical Research Centers. The Journal of allergy and clinical immunology. 2009;124(3):436–44, 44e1–8. pmid:19632710.
- 39. van Kessel K, Moss-Morris R, Willoughby E, Chalder T, Johnson MH, Robinson E. A randomized controlled trial of cognitive behavior therapy for multiple sclerosis fatigue. Psychosom Med. 2008;70(2):205–13. pmid:18256342.
- 40. Suarez-Almazor ME, Looney C, Liu Y, Cox V, Pietz K, Marcus DM, et al. A randomized controlled trial of acupuncture for osteoarthritis of the knee: effects of patient-provider communication. Arthritis Care Res (Hoboken). 2010;62(9):1229–36. pmid:20506122.
- 41. Thomas KS, Crook AM, Nunn AJ, Foster KA, Mason JM, Chalmers JR, et al. Penicillin to prevent recurrent leg cellulitis. N Engl J Med. 2013;368(18):1695–703. pmid:23635049.
- 42. Stewart MA. Effective physician-patient communication and health outcomes: a review. CMAJ. 1995;152(9):1423–33. pmid:7728691.
- 43. Ruben MA, Blanch-Hartigan D, Hall JA. Nonverbal Communication as a Pain Reliever: The Impact of Physician Supportive Nonverbal Behavior on Experimentally Induced Pain. Health Commun. 2017;32(8):970–6. Epub 2016 Jul 27. pmid:27463408.
- 44. Ulrich RS, Cordoza M, Gardiner SK, Manulik BJ, Fitzpatrick PS, Hazen TM, et al. ICU Patient Family Stress Recovery During Breaks in a Hospital Garden and Indoor Environments. HERD. 2020;13(2): 83–102. Epub 2019 Aug 7. pmid:31390887.
- 45. Hedman E, Andersson G, Andersson E, Ljotsson B, Ruck C, Asmundson GJ, et al. Internet-based cognitive-behavioural therapy for severe health anxiety: randomised controlled trial. Br J Psychiatry. 2011;198(3):230–6. pmid:21357882.
- 46. Castro-Sanchez AM, Lara-Palomo IC, Mataran-Penarrocha GA, Fernandez-Sanchez M, Sanchez-Labraca N, Arroyo-Morales M. Kinesio Taping reduces disability and pain slightly in chronic non-specific low back pain: a randomised trial. J Physiother. 2012;58(2):89–95. pmid:22613238.
- 47. Howe LC, Goyer JP, Crum AJ. Harnessing the placebo effect: Exploring the influence of physician characteristics on placebo response. Health Psychology. 2017;36:1074–82.
- 48. Gonzalez-Iglesias J, Fernandez-de-Las-Penas C, Cleland JA, Huijbregts P, Del Rosario Gutierrez-Vega M. Short-term effects of cervical kinesio taping on pain and cervical range of motion in patients with acute whiplash injury: a randomized clinical trial. J Orthop Sports Phys Ther. 2009;39(7):515–21. pmid:19574662.
- 49. Madigan CD, Jolly K, Roalfe A, Lewis AL, Webber L, Aveyard P, et al. Study protocol: the effectiveness and cost effectiveness of a brief behavioural intervention to promote regular self-weighing to prevent weight regain after weight loss: randomised controlled trial (The LIMIT Study). BMC Public Health. 2015;15:530. pmid:26041653.
- 50. Beard DJ, Rees JL, Cook JA, Rombach I, Cooper C, Merritt N, et al. Arthroscopic subacromial decompression for subacromial shoulder pain (CSAW): a multicentre, pragmatic, parallel group, placebo-controlled, three-group, randomised surgical trial. Lancet. 2018;391(10118):329–38. Epub 2017 Nov 20. pmid:29169668.
- 51. Kaptchuk TJ, Kelley JM, Conboy LA, Davis RB, Kerr CE, Jacobson EE, et al. Components of placebo effect: randomised controlled trial in patients with irritable bowel syndrome. BMJ. 2008;336(7651):999–1003. pmid:18390493.
- 52. collaborators C-t, Shakur H, Roberts I, Bautista R, Caballero J, Coats T, et al. Effects of tranexamic acid on death, vascular occlusive events, and blood transfusion in trauma patients with significant haemorrhage (CRASH-2): a randomised, placebo-controlled trial. Lancet. 2010;376(9734):23–32. pmid:20554319.
- 53. Parreira PdCS, Costa LdCM, Takahashi R, Junior LCH, Junior MAdL, Silva TMd, et al. Kinesio Taping to generate skin convolutions is not better than sham taping for people with chronic non-specific low back pain: a randomised trial. Journal of Physiotherapy. 2014;60:90–6. http://dx.doi.org/10.1016/j.jphys.2014.05.003.
- 54. Abou-Alfa GK, Meyer T, Cheng AL, El-Khoueiry AB, Rimassa L, Ryoo BY, et al. Cabozantinib in Patients with Advanced and Progressing Hepatocellular Carcinoma. N Engl J Med. 2018;379(1):54–63. pmid:29972759.
- 55. Heine M, Verschuren O, Hoogervorst EL, van Munster E, Hacking HG, Visser-Meily A, et al. Does aerobic training alleviate fatigue and improve societal participation in patients with multiple sclerosis? A randomized controlled trial. Mult Scler. 2017;23(11):1517–26. pmid:28528566.
- 56. LeWitt PA, Rezai AR, Leehey MA, Ojemann SG, Flaherty AW, Eskandar EN, et al. AAV2-GAD gene therapy for advanced Parkinson’s disease: a double-blind, sham-surgery controlled, randomised trial. Lancet Neurol. 2011;10(4):309–19. pmid:21419704.
- 57. Adams R, Brown E, Brown L, Butler R, Falk S, Fisher D, et al. Inhibition of EGFR, HER2, and HER3 signalling in patients with colorectal cancer wild-type for BRAF, PIK3CA, KRAS, and NRAS (FOCUS4-D): a phase 2–3 randomised trial. Lancet Gastroenterol Hepatol. 2018;3(3):162–71. Epub 2017 Dec 16.
- 58. Keating SE, Hackett DA, Parker HM, O’Connor HT, Gerofi JA, Sainsbury A, et al. Effect of aerobic exercise training dose on liver fat and visceral adiposity. J Hepatol. 2015;63(1):174–82. pmid:25863524.
- 59. Coombes BK, Bisset L, Brooks P, Khan A, Vicenzino B. Effect of corticosteroid injection, physiotherapy, or both on clinical outcomes in patients with unilateral lateral epicondylalgia: a randomized controlled trial. JAMA. 2013;309(5):461–9. pmid:23385272.
- 60. Choy O, Raine A, Hamilton RH. Stimulation of the Prefrontal Cortex Reduces Intentions to Commit Aggression: A Randomized, Double-Blind, Placebo-Controlled, Stratified, Parallel-Group Trial. J Neurosci. 2018;38(29):6505–12. pmid:29967006.