Peer Review History
| Original SubmissionJune 3, 2020 |
|---|
|
PONE-D-20-16802 Explaining placebo effects for clinical practice: Does ‘Pavlov’ ring a bell? PLOS ONE Dear Dr. Smits, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Thank you for your submission. Based on my own reading of the manuscript, as well as the esteemed reviewers' suggestions, I would like to invite you to submit a revised version of this manuscript for reconsideration. In particular, I hope that this revision would allow you the opportunity to defend your manuscript, and address not only the methodological and statistical queries, but also the concerns that the manuscript may be overstating its importance and findings. While I believe that there is value in the contribution of this manuscript to the existing literature, I would strongly suggest that the conceptual grounding for this study, especially given the conceptual topic and framing re: placebo be better elucidated not only in the introduction but also discussion; furthermore I would suggest that the conclusions in relation to the results of this descriptive study be more tempered and realistic. Please submit your revised manuscript by Oct 25 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Haikel A. Lim, MD, MSc Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. You indicated that you had ethical approval for your study. In your Methods section, please ensure you have also stated whether you obtained consent from parents or guardians of the minors included in the study or whether the research ethics committee or IRB specifically waived the need for their consent. 3. Please include additional information regarding the survey or questionnaire used in the study and ensure that you have provided sufficient details that others could replicate the analyses. For instance, if you developed a questionnaire as part of this study and it is not under a copyright more restrictive than CC-BY, please include a copy, in both the original language and English, as Supporting Information. If the survey instruments were translated, please indicate how the translation was carried out and validated. 4. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. 5. Your ethics statement must appear in the Methods section of your manuscript. If your ethics statement is written in any section besides the Methods, please move it to the Methods section and delete it from any other section. Please also ensure that your ethics statement is included in your manuscript, as the ethics section of your online submission will not be published alongside your manuscript. 6. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: No Reviewer #2: Yes Reviewer #3: Partly Reviewer #4: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: I Don't Know Reviewer #4: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No Reviewer #3: No Reviewer #4: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes Reviewer #4: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This is a study about the knowledge of and attitudes towards placebo effects in the general population. Technically it is well done but the problems are elsewhere. First, there are conceptual issues and second, the conclusions go to far and are not based on the results. A) Conceptual issues: 1. Line 45. "Their potential use for clinical practice"? 2. Line 47. Use of placebos in clinical practice is completely different from harnessing placebo effects in care. 3. Line 60. "administering placebos". What does this actually refer to? Giving placebo pills, prescribing placebo pills (which is not possible in most countries), prescribing something that the physician does not believe to be pharmacologically active, prescribing something that the physician believes to be active but which is not, just being kind, etc. etc. are all very different situations. 4. Line 63. It is not clear what these results would mean for clinical practice. 5. Line 74-76. This is a very narrow understanding about placebo effects. They could also be seen as an essential component of any (positive) therapeutic relationship ("context and meaning effects"). 6. Line 121-122. Research on open-label placebos is flourishing but it is not at all obvious that anything clinically useful would follow from that research. It will certainly increase our understanding of the phenomena but it is far too early to refer to their use in clinical practice. 7. Line 294 and page 16. I find three claims in the PlaceboQuitz conceptually problematic: "A placebo can reduce symptoms such as pain", "Placebos can induce a physical reaction", "Placebos can also cause side effects". This is common terminology, but, as the authors well know, placebos AS SUCH do not cause anything. This conceptual issue should at least be mentioned in the commenting text. 8. Line 432-433. Again, "optimize the potential use for clinical practice"??? 9. Line 452-453. ""to examine the extent of placebos integrated in treatment" ??? 10. Line 489. Again, "clinical implementation" meaning what? B) The conclusions go too far. 11. Line 492. The normative conclusion that is drawn ("served best") does not follow from the descriptive results. 12. Line 493-494. The normative conclusion that is drawn ("encourages clinical implementation") does not follow from the descriptive results. In sum, the study as such is technically done carefully. The authors should pay attention to the conceptual issues described above and write they conclusion in a far more modest way. This is a descriptive study and as such it is ok, but deriving conclusions about the justification of the use of placebos in clinical practice is a totally different issue. Reviewer #2: The paper was able to achieve it's three main aims (1) it assessed the current knowledge of the general population about placebo/nocebo knowledge (2) assessed the different types of placebo explanations based on 3 outcomes and their association with different predictors and (3) assessed the acceptability of placebos in different clinical scenarios through a cross-section survey of the general population. It found areas where knowledge was lacking, found explanations that were favoured, and found opinions on when placebo use would be appropriate. Relevant recommendations were also given from the conclusions and would be useful knowledge to share with the scientific community. This paper was an interesting read that investigated questions relating to how the placebo can be characterised to help provide information on how it can be translated into clinical therapies. Through its study design, this paper synthesised the different placebo explanations used and identified the heterogeneity in clinical placebo research currently. It also identified the different clinical scenarios it could be applied to, making the aims of the study clinically relevant and applicable. Major comments: (1) the study methods did not include a sample size calculation. (2) there was little explanation or background given on why neuroticism, anxiety and optimism were used as predictors, or how they relate to the various placebo explanations. Hypotheses could have been generated regarding these relationships. (3) the study population was the general population rather than a specific disease group, with the justification that this population has not been influenced by prior clinical experiences. However, the proposed use of placebos has been in diseased groups where traditional therapies have been ineffective, which would not be relevant to the general population that has not received prior clinical exposure. In addition, while medication use the study population was measured, comorbidities were not measured and controlled for. Minor comments: (1) in Table 2, row 1 of results, there is inconsistent reporting between the correct answer and the percentage answering with the correct answer. (2) the axes in figures 2, 3, 4, 7 and 8 are difficult to identify. (3) the conclusion that "attitudes and acceptability for placebos in treatment were mostly dependent on the type of the condition (i.e. more acceptant for psychological complaints)" in paragraph 1 of the discussion does not seem to be consistent with the results presented in figures 5 and 6. Reviewer #3: Thank you for the opportunity to review this manuscript. This was a cross-sectional, survey-based study from Smits and colleagues at Leiden University in the Netherlands. The overall purpose was to characterize preference for various placebo information strategies for optimization in clinical practice. Specifically, the authors aimed to (1) examine current knowledge about placebo effects, (2) rate different types of explanations about placebo effects and their mechanisms based on preference, perceived efficacy, and willingness participate in a treatment based on a given placebo explanation, (3) extend prior work examining attitudes and acceptability towards placebos in treatment settings, (4) examine the underlying factor structure of their placebo explanations scale, and (5) examine the extent to which factors associated with placebo effects explained variance in explanation preferences. Out of 444 total participants, 377 completed the survey. The primary findings are as follows: (1) Placebo knowledge: Mean correct score of 81.1% on the placebo knowledge quiz with the lowest score observed for an item concerning whether deception is required in order to induce placebo effects (22.5 % correct) (2) Placebo knowledge: 13.6% of variance in placebo knowledge was explained in the model. Education was the only significant predictor. (3) Differences in placebo explanations Preference: Participants differed in terms of preference for explanations with those based on brain mechanisms and expectations showing higher preference than others. The neutral explanation had significantly lower preference than the others. Perceived efficacy: No differences Willingness to participate: No differences (4) Predictors of placebo explanations Preference: Age, education, optimism, trait anxiety, and placebo knowledge Perceived efficacy: optimism, trait anxiety, placebo knowledge and education Willingness to participate: trait anxiety and general attitudes towards medication (5) Factor structure Preference: 1 factor explaining 36.24% of the variance Perceived efficacy: 2 factors, 1 explaining 19.68% of the variance and 2 explaining 15.41% of the variance Willingness to participate: 2 factors, 1 explaining 22.74% of the variance and 2 explaining 15.81% of the variance (6) Placebo attitudes and acceptability: Overall, I thought the study design was interesting and believe that this manuscript would add a unique perspective to the broader literature on placebo effects. However, the statistical analysis, results, and discussion sections in particular could benefit from more development. Thus, I would like to see your detailed response to my below comments before giving this manuscript any further consideration for publication. Introduction- 123-139 – Consider making the order of your aims and results consistent for the reader. For instance, the aim to explore attitudes appears third in the list of aims whereas these data are presented last in the results section. 134-136 – Can you provide a stronger rationale for exploring the factor structure of your preference, perceived efficacy, and willingness to participate scales? How would this information benefit clinicians who want to use placebos in practice? As of now, I am having trouble understanding what this information adds to the overall manuscript and it seems more appropriate for a separate study of psychometric properties of their instrument (e.g., factorial validity) Methods – 166-168 -You designed your study to control for order effects when collecting data on placebo explanations. Can you describe this a bit more? How many possible orders were available to a given participant? Did you confirm whether or not order had an effect on your results (e.g., does entering order as a covariate in your model affect the results)? 213-239- The investigators have used several standardized scales to help characterize the participant sample (i.e., Life Orientation Test-Revised, Revised NEO Personality Inventory, Spielberger State Trait Anxiety Inventory, General Attitudes towards Medication Survey). If available, please consider providing norms for each of these scales to help the reader contextualize whether the study sample is above or below average on each of these scales. 240- Can the authors comment on the statistical power of their study? Was an a priori power analysis conducted for any of the aims? 248-260- It is unclear to me why a repeated-measures model is being used here. Wouldn’t a one-way ANOVA/ANCOVA be sufficient since the overall design of the study did not involve multiple timepoints? Results - 301-307 – Please provide the results for the overall regression model. Was the overall model significant? This is critical for interpreting the rest of your findings. In other words, if the overall model was not significant, observing individual predictors that were significant (e.g., education) does not really matter. 328-381- The authors describe results of three different regression models presumably examining predictors of preference, perceived efficacy, and willingness to participate, but these models are not described in the statistical analysis section. What kind of regression model was used? How was the dependent variable score treated? For each model, was the score a sum total from the various items used to characterize preference, perceived efficacy, and willingness to participate? This will definitely need more detail. 329-338- Please provide the results for the overall regression model in addition to your summary of individual predictors. Was the overall model significant? 351-362- Please provide the results for the overall regression model in addition to your summary of individual predictors. Was the overall model significant? 372-381- Please provide the results for the overall regression model in addition to your summary of individual predictors. Was the overall model significant? Discussion- 444-446- The investigator appears to interpret “Placebos can also cause side effects” as knowledge about nocebo effects. Indeed, information about nocebo effect knowledge is very important, but I am not entirely convinced that is what they measured with this item and would urge the authors to exercise some caution with referring to it as such. How do we know the respondents are assigning a negative connotation to the term “side effects”? It is unfortunate that this was not spelled out more clearly for study participants (e.g., Placebos can also cause negative or harmful effects). 444-447 – There’s hardly any discussion of the regression model that explored predictors of placebo quiz performance and found 13.6% variance explained. Was the amount of variance explained lower or higher than the authors expected? What other factors could account for the large amount of variance that was not explained by the model? 456-474 – I found the exploration and discussion of the underlying factor structure to be rather distracting and I am not sure this adds much value to the paper. In your revisions, please either make this more apparent to the reader or consider removing altogether. 479-480 – “Although the sample was rather large (377 completers)…”. Relative to which specific studies? 486-489 – Despite listing this as one of their aims, there’s also very little discussion of how exactly their results have extended prior work examining attitudes and acceptability towards placebos in treatment settings. I think this could be a separate paragraph rather than squeezed in as an afterthought in it’s present place in the manuscript. Limitations/Future directions section – The discussion of the study limitations is pretty thin. Please add a paragraph or two on the potential shortcomings of this study to help the reader contextualize the findings. A few things that come to mind are: (1) The cross-sectional nature of the study (e.g., what if attitudes change over time as new experiences occur (e.g., clinical trial participation, patient-provider interactions?). This is especially relevant considering how young your sample is. (2) How might various populations with chronic mental or physical health conditions benefit from this information? Is the present data sufficient for these groups or is more data directly collected from patient populations needed? (3) Is there anything to be learned from applying this research question/approach to nocebo effects and more thoroughly characterizing knowledge of nocebo effects than what was done here? (4) Just because a participant prefers a given strategy does not necessarily mean this translates to the largest placebo effects. This of course is an empirical question that could be tested in an experimental design and merits some thought/discussion about how such a study could be conducted. To be clear, these are just some potential ideas worth considering and I’m not saying that each of these needs to be added as limitations. Rather, I would like to see you give some thoughtful consideration to what you think are the primary limitations and discuss them accordingly. Reviewer #4: The authors conducted an online survey to examine knowledge and attitudes of the general population towards placebos, placebo effects, and placebo mechanisms. Results indicate that knowledge about placebo effects is generally high, with better knowledge in well-educated participants. Furthermore, the participants preferred explanations of placebo effects based on brain mechanisms and expectations, and preferences varied with age, education level, optimism, trait anxiety, and placebo knowledge. Perceived efficacy of the 8 proposed explanations showed comparable associations, while the willingness to participate varied with trait anxiety and attitudes towards medication. PCA revealed a two-dimensional structure for perceived efficacy and willingness to participate, separating between more positively stated mechanisms (such as expectations/mind-body/trust/brain mechanisms), and more negatively stated ones (such as transparency/neutral explanation). The use of placebos in clinical pratice was widely accepted. The study is well designed and reported, the statistical analysis is sound and the results support the conclusions. The findings are important as they provide various approaches for implementing placebo effects in clinical practice. The following issues should be addressed before publication: - The sample comprises mainly young well-educated people. This is a major limitation of the results, since older and less-educated people may have different knowledge and attitudes about placebos and placebo effects. The authors discuss this issue very shortly. The implications are important and far-reaching and need to be addressed much more carefully by the authors. Furthermore, details of recruitment need to be explained in more detail (e.g., to whom the emails were sent, which social media platforms were used, etc.), and a rationale should be provided why the authors did not chose a more representative sample. - The title is very vague. It should include the type of study as well as the restriction to younger adults. - In Table 2, the entries for the first items should be double-checked; numbers appear to be reversed. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Pekka Louhiala Reviewer #2: No Reviewer #3: Yes: Jacob B. Lindheimer Reviewer #4: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.
|
| Revision 1 |
|
Explaining placebo effects in an online survey study: Does ‘Pavlov’ ring a bell? PONE-D-20-16802R1 Dear Dr. Smits, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Jenny Wilkinson, PhD Academic Editor PLOS ONE Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #3: All comments have been addressed Reviewer #4: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: (No Response) Reviewer #3: Thank you for your thoughtful responses to my concerns. I appreciate the attention to detail and have no further comments. Reviewer #4: (No Response) ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Pekka Louhiala Reviewer #3: No Reviewer #4: No |
| Formally Accepted |
|
PONE-D-20-16802R1 Explaining placebo effects in an online survey study: Does ‘Pavlov’ ring a bell? Dear Dr. Smits: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr Jenny Wilkinson Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .