Peer Review History
| Original SubmissionFebruary 21, 2020 |
|---|
|
PONE-D-20-05285 Development of a knowledge translation platform for ataxia: Impact on readers and volunteer contributors PLOS ONE Dear Prof. Truant, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. We would appreciate receiving your revised manuscript by Jun 11 2020 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Keith M. Harris, PhD Academic Editor PLOS ONE Additional Editor Comments (if provided): Dear Dr Truant, Please closely read the comments by the reviewers. They offer helpful suggestions on improving this submission. In particular, further information on your project, details of collecting information, and activities by your group. would help enlighten this work for potential research consumers. After addressing these issues, we look forward to reviewing your updated manuscript. Best wishes, Keith Journal requirements: When submitting your revision, we need you to address these additional requirements: 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.plosone.org/attachments/PLOSOne_formatting_sample_main_body.pdf and http://www.plosone.org/attachments/PLOSOne_formatting_sample_title_authors_affiliations.pdf 2. Please note an error on lines 144-145 as 6/19=32% and not 26%. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly Reviewer #3: No ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: N/A ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The authors have developed a website called SCAsource to provide patients and their families with up-to-date health research information translated into lay terms. SCA stands for Spinocerebellar ataxia, which is a rare, fatal neurodegenerative disease. The online site also gives researchers the opportunity to develop skills in communicating their research to the public. The website was started in 2018 by a small group using their own funds. This article is a first attempt to evaluate the success of SCAsource. Figure 1 shows the distribution of 26,9000 views of SCAsource worldwide, indicating the website is being used. Surveys were sent to contributors and readers of SCAsource online with multiple choice quantitative questions and open-ended qualitative questions. A small sample size responded: 19 contributors (58% of those requested) and 36 users (63% of those requested). The authors are aware of the limitations of the small sample size, and including the qualitative responses was very informative. The authors summarize their results. Generally the contributors and respondents found value in the website. The contributors valued learning to communicate with the public. The readers valued access to research that is understandable and current. The authors suggest this is a good model for developing knowledge translation efforts for other rare diseases. Overall the development of knowledge translation websites is a very valuable for scientists and for the people suffering from a disease. This effort will not only benefit the individuals involved, it will encourage support for research among the public. This is an important article to publish. As a graduate student I worked in the area of inhibitor design for HIV and volunteered at an AIDS hotline. I learned a lot from working with the hotline and it provided me with an emotional connection for the value of my research. I have no major criticisms of the paper. I have a few comments that occurred to me while reading the article. To the extent that the authors wish to promote other groups to emulate their successes, it would be helpful to provide a little more background about SCAsource and how it got started. - line 68 states that the authors were inspired by discussions with their own patient group. Was SCAsource started by doctors who treat SCA patients? Is that a good model for starting a knowledge translation effort? I imagine the founders must have had some relationship with patients suffering from the disorder. - What are the combination of skills needed to develop a website for other diseases? Did you need a computer scientist, a web designer, a survey of patients with SCA, contacts with the National Ataxia Foundation, … Questions about the SCAsource knowledge-translation model: - To what extent is this model filling a need to serve rare disease communities versus bridging researchers and patients of any disease community? Is this niche already being filled for more common disorders, eg cancer or diabetes? - How many countries have an organization like the National Ataxia Foundation? Are you at all duplicating information that they have available? Does it make sense to be disseminating SCAsource through them instead of maintaining an independent website? Questions about contributors: - How do contributors find out about SCAsource? Is there a main SCA meeting that is attended by many researchers in the field? Is this an international meeting? Is there a journal that is read by many practitioners in the field? - Where are your contributors from? Mostly Canada and the US, or other places in the world? Do they match the distribution of your readers (Figure 1b)? - To what extent are the contributors in basic research vs clinical research? Have you been able to bridge the gap between those communities? - How do contributors learn if their content is accessible to readers? Training seems to be through 6 pages of written documents for new volunteers. Questions about readers: - How big is the patient community with SCA? What percent of that community is using the website? - Line 153 – you don’t specify what % of your readers responded to your survey (36/57 ~ 63%), though you say the % of your contributors that responded (line 143 - 58%). Questions about content: - Lines 236-9: The authors mention there was some increased interest among the readers to participate in clinical trials. Perhaps people interested in clinical trials are more likely to read research articles. To what extent is participation in clinical trials promoted in the content? - I know that many people suffering from incurable diseases look to non-medical treatments, to mitigate suffering or even for cures. Does SCAsource address those concerns of readers? I don’t know if there is research in those areas. - I like the idea of adding laboratory profiles as an article type. That will personalize the research for the SCA readers, which seems valuable. Figure 1a. Do the colors mean anything in the bar graph? If not, the colors are confusing because they are the same as in the key in part b. - It’s interesting that the number of views go up and down, somewhat seasonally. Is there a reason for that? Reviewer #2: Thank you for the opportunity to review this paper which describes the development of a KT platform for ataxia. This platform - SCAsource is an online platform where peer reviewed research papers are translated into lay summaries. The goal was to make research more accessible and understandable to patients and families. A secondary goal was to provide opportunities for ataxia researchers to develop and hone their translational skills (to write lay summaries). It is unclear if patients and families were part of the decision to develop this platform (which would be important) - or if they were passive recipients of the platform. Two online surveys - developed for this study- were distributed (19 volunteers; 36 respondents). Descriptive statistics were conducted and grounded theory thematic analysis were conducted on the textual survey responses. My main concerns are on the small sample of both volunteers and readers of the platform. This is a small number of participants to make the claims in the manuscript (eg the readers overwhelmingly appreciated the easy to understand content). I would encourage the writers to temper these claims in light of the sample size. I would challenge the authors that they did not actually conduct grounded theory thematic analysis - rather, what they describe is more aligned with Qualitative Description. There was no mention of steps to address rigor in their qualitative analysis. I would suggest that the Discussion section needs to be revised. There are many different initiatives that could be used to situate these findings against (e.g., Cochrane Collaboration has been doing lay summaries for quite some time). The discussion needs to be enhanced. Reviewer #3: The manuscript describes an online platform that was launched in September 2018, with the goal of making ataxia research more accessible and understandable to patients and families. A secondary goal was to provide opportunities for ataxia researchers to develop and hone their knowledge translation skills, which would then improve the quality of patient communication in the ataxia community. The study (unfunded) measured the impact of SCAsource on its readers and volunteer contributors after one year of activity. Background Pg 4 - The notion of a snapshot presented here sounds like a summary of a summary. I would argue that summaries are bound by the parameters of the research study; they summarize the study in simpler terms for the lay reader. Snapshots, however, should do more than summarize; they must offer new information in the context of the informational needs of the reader. Snapshots should convey why the aim of the study and its’ findings are important to the reader; what are the implications and potential benefits of the study for the reader? In this way, the scientific work is tailored to the needs of the reader and are key to ensuring lay readers benefit from the deliverable. Pg 5 - It appears the expectation was that contributors would improve their lay writing skills simply by being given the opportunity to do so? Yet, plain language writing is a teachable skill; how did you intervene to teach them? There is mention that resources were shared with contributors, but these are not critically appraised for quality, nor are they shared in the manuscript. It also seems rather naïve to assume that written documentation can suffice to train writing skills in the absence of trial /feedback, and experience. Pg 5, line 97-98 – this sentence belongs in the conclusion. Overall, linkage with the KT literature is fairly weak in this paper and contributes to the impression that the project is atheoretical and not guided by the knowledge base in dissemination. Methods 1. It seems curious to me that this work was waived by REB; on what grounds? You are collecting human data and publishing. Please describe. 2. There were not additional data files attached to the submission, i.e., survey protocols, teaching materials and examples provided to the contributors. 3. The survey methodology could be improved upon based on current methods of this kind published in the literature. For instance, methods that allow for the invitation of content feedback linked directly on the webpage; see the work of Pierre Pluye and McGill University on the Information Assessment Method. 4. Pg 7 – Web analytics were reportedly collected but don’t figure at all in the results or discussion. 5. Pg 7-8 –It's hard to ascribe any meaning to the contributor characteristics without further information about how they are recruited, supported, trained, remunerated, etc. 6. p9 – The use of survey format with open-ended options demonstrates a lack of patient-centeredness. Presumably and in fact, intentionally, the limitations of the respondents with respect to response options should have been anticipated and another modality of feedback provided; phone, for instance, or multiple choice rather than open ended questions, or open-ended questions that could be voice recorded. 7. P9 - There is no information about reader demographics - age, sex, patient status, etc - and thus their responses are not contextualized. Without this information, it's hard to understand why they may have said /rated how they did so. This is another example of who the project doesn't seem all that well thought out in terms of user-perspective, KT training and quality of dissemination products. 8. P16 - How are summaries/snapshots vetted prior to publication? What are the standards of quality and how are they assessed? They may like doing it but are they any good at it? The latter seems to be the more important question, in addition to whether readers benefit from them, and how. 9. Since your sample numbers are small, the use of percentages has the effect of overamplifying. Please convey the n as well as the % so as not to over emphasize the findings. 10. All of the survey questions were very researcher oriented; focused on how the readership can support research rather than how the research, when simply communicated, can benefit the reader/patient. This seems rather self-serving and not at all in the spirit of KT. 11. How were the content formats decided upon? by whom? how do you know this is what readers want? 12. P 19, line 248/9 - Again, as mentioned above, the researchers place importance on how clearly a scientific concept or finding can be communicated to a lay reader. What about focusing on whether the summary can inform and benefit the reader? This would seem to be more laudable and purposeful goal of effective dissemination. 13. P 23, line 276 - this is really curious because most lay people have no or little interest in research papers, not only because they are behind pay-walls and filled with jargon, but more importantly because they do not address the meaning of the research from the readers perspective. This resource does nothing to address this. 14. There is no linkage to the literature on what other laypersons seek from research summaries; what type of information and format they prefer. The paper would be strengthened by a much tighter connection to the literature. Discussion 15. p 24, line 302 - Depends how you interpret highly positive; they don't seem to report many benefits, so this statement would seem to be unsubstantiated. 16. Dissemination of health information on the web isn't a model; it's a dissemination strategy. Models simplify a process of translating evidence into practice. Models provide the key steps to plan for and undertake when operationalizing a D&I initiative. You don't have a model; you have a platform for dissemination. 17. It is odd for contributors to practice something for which they have received little instruction or that is not informed by an evidence-informed framework. There are published snapshot frameworks and frameworks for effect dissemination, but this paper does not use them to inform the work, rendering the exercise atheoretical and yielding little of value to KT science or the readership. I recognize the aim of this website is to make research accessible to knowledge users, and this is important. That said, there is little depth with respect of KT evidence or methodological approach or capacity building/training of contributors/academic faculty, and thus the manuscript does not provide novel information that moves the field forward. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: Yes: Melanie Barwick [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Development of a knowledge translation platform for ataxia: Impact on readers and volunteer contributors PONE-D-20-05285R1 Dear Dr. Truant, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Keith M. Harris, PhD Academic Editor PLOS ONE Additional Editor Comments (optional): Dear Authors. Congratulations on your work and this positive outcome. Both reviewers were appreciative of your work, including your revisions. They also both suggested a few additional minor edits. I encourage you to finalize those few edits before we move forward and publish your work. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: (No Response) Reviewer #3: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #3: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: N/A Reviewer #3: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #3: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #3: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The paper is much improved, and I believe should be published. The authors addressed all of my questions – in the article and through their detailed responses to my questions. I think the paper clearly indicates the limits of the current study, particularly the small sample size and whether their sample is representative of the community as a whole. But the responses to their survey provide an important first look at the value of their website. The authors are also clear that their initial evaluation will allow them to expand their effort by gaining support and funding from the ataxia community. I have read the responses of the other reviewers to the first draft of the article. I am a scientist not versed in the literature of assessment. While I think it is valuable to criticize the methodology of the current study, it is important that it does not detract from the success and efforts represented by this project. The one question I still had when I read the paper was how big the SCA research and affected communities are. The authors addressed the uncertainty of the affected community size in their author response (estimated 150,000 with SCA in the US). I think it is worth providing some idea of the community size in the paper because it justifies the need to expand their efforts. It also may be important for comparison by other groups interested in emulating this effort. SCAsource is a valuable project that will have general interest. First, the scientific community needs to foster communication between scientists and the public. This is clear from the skepticism by the public to medical advice and vaccines to Covid-19. Greater communication is important for scientists to understand how their work affects the community, but also for the community to develop trust in science. I think this project has benefits beyond developing communication skills for scientists. Many scientists value the contribution that their work makes to society. As a researcher I have found that engaging with the community is rewarding and motivating. I think this is especially true for graduate students and postdocs. This point is addressed in the paper. There is also a clear desire by people with SCA, and any disorder, to understand the symptoms, cause and possible treatments. This is an important trend in the internet age. Providing accurate information to the public is important since there is so much misinformation on the internet. Grammatical corrections: Line 48: the word “cation” needs to be corrected Line 103-104: modify the sentence “New volunteers are giving….” I think they are given a training guide and document guidelines for the two different document types. You mention the editing feedback in a later sentence. Line 187: change “vias” to “bias” Line 316: change “ewer” to “fewer” Reviewer #3: Thank you for the opportunity to read this revision. The paper describes a novel effort to improve access to empirical work in Ataxia while building capacity for KT among researchers - both are needed. There is a good model for knowledge sharing in other disease areas. Overall, I think the authors did a thorough job of responding to the reviewer comments. In reading the revision, I found a few more required revisions. • Page 3. Type/part of sentence is missing. “Knowledge-to-Action, outlines both cycles of knowledge creation and knowledge application [5,6]cation cycle involves adapting knowledge to the local context of users, as well as identifying barriers to using and accessing this knowledge [5]. • Page 4 –typo - New volunteers are giving a training guide on how to write effective lay summaries… • Page 5 – perhaps you could say something about this method, otherwise the reader has to go to the Salita paper: “Summaries follow the inverted pyramid structure and best lay summary practices described by Salita [15].” • Page 8; change the verb ‘was’ to ‘were’; data is plural. “Once data was collected, survey response data was formatted • Page 21 – type. “ewer readers rated Snapshots” • I still maintain that the term ‘writer’ is clearer that the term ‘volunteers’. I understand the writers are volunteers, but their role on the site is as writers, and it flows better to distinguish between readers and writers. • Page 27 – suggest ‘of’ instead of ‘by’ in this sentence, “Another assumption by knowledge translation models. Moreover, I would say that another assumption is that the knowledge being translated has immediate benefits for the reader rather than specifying clinical or instrumental benefits. Such benefits might include increased awareness, knowledge, or support in decision-making. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #3: Yes: Melanie Barwick |
| Formally Accepted |
|
PONE-D-20-05285R1 Development of a knowledge translation platform for ataxia: Impact on readers and volunteer contributors Dear Dr. Truant: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Keith M. Harris Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .