Peer Review History
| Original SubmissionNovember 21, 2022 |
|---|
|
PONE-D-22-32110Assessment of potential transthyretin amyloid cardiomyopathy cases in the Brazilian public health system using a Machine Learning ModelPLOS ONE Dear Dr. Silva Julian, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Sep 08 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Giuseppe Limongelli Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Thank you for stating the following financial disclosure: "This study was funded by Pfizer Brazil" Please state what role the funders took in the study. If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." If this statement is not correct you must amend it as needed. Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf. 3. Thank you for stating the following in the Competing Interests section: "IZL, RVF and AJLA are full-time employees at IQVIA Brazil. CCH, CLBS and GSJ are full-time employees at Pfizer Brazil." We note that one or more of the authors are employed by a commercial company: IQVIA Brazil, Pfizer Brazil (1) Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form. Please also include the following statement within your amended Funding Statement. “The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.” If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement. (2) Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: ""This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf. 4. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability. Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized. Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access. We will update your Data Availability statement to reflect the information you provide in your cover letter. 5. Please ensure that you refer to Figure 1 in your text as, if accepted, production will need this reference to link the reader to the figure. 6. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: No ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The authors use machine learning models to identify and classify ATTR-CM, an amyloid fibril that can cause cardiac arrest by preventing the ventricles from pumping blood effectively to the rest of the body. The study was conducted using patient data collected between 2015 and 2021 in order to assist the Brazilian health care system in enhancing patient health guidelines. -In the introduction I suggest to authors to read and refer to this article which explains in general what amyloid fibrils are: Auriemma Citarella, Alessia, et al. "ENTAIL: yEt aNoTher amyloid fIbrils cLassifier." BMC bioinformatics 23.1 (2022): 1-15. -In the introduction I suggest putting a short introduction to cardiovascular disease in general and referring to these papers: De Marco, Fabiola, et al. "Classification of QRS complexes to detect Premature Ventricular Contraction using machine learning techniques." Plos one 17.8 (2022): e0268555. De Marco, Fabiola, Dewar Finlay, and Raymond R. Bond. "Classification of Premature Ventricular Contraction Using Deep Learning." 2020 Computing in Cardiology. IEEE, 2020. -At the end of the introduction, I suggest inserting a brief description of the objective of the paper, the dataset used and a very brief description of the results achieved. - In the introduction, add structure to the paper to make it easier to read. -Check the references in the method section. -What are the fields of the dataset? How many people are involved in the study? Clarify and include a better description of the dataset. -A misunderstanding exists between dataset parameters and model input parameters. Are they identical? Are only some selected? Then why? -Why are so many more samples taken from people over 50? Does this occur more frequently in people over 50? Explain this point. -Insert a diagram or table to explain the structure of the dataset well, explaining what they are for each field and category in order to favor the reader. -What percentage are training, validation and testing chosen? -Why wasn't the AUC metric used? please if it is possible to insert it. -The description part of the dataset in the results section should be moved to the dataset subsection. -It is unclear what descriptions images and tables refer to in the results section. Need to double check and fix. In this way I cannot say that they are clear and adequate -The conclusion needs improvement. In this way, they cannot be accepted. The authors should provide a summary of their work, report a portion of the findings, and explain how their work has improved the domain. Reviewer #2: Thank you for the opportunity to review this paper from Laper et colleagues. I really appreciate the effort to estimate the prevalence of cardiac amyloidosis in a wide national population and I think that machine learning models represent the future of screening for cardiomyopathies and the subject is of great interest, however I have to report my concern about the accuracy of the data presented. Major revisions: Labelling data as “reference ATTR-CM” and “not ATTR-CM” was defined by the investigators, potentially introducing a bias, specifically I do not agree with the definitions of “ATTR-CM-like”. From my understanding, in methods you stated that for diagnosis of “ATTR-CM-like” you need 1 cardiac related ICD-10 AND 1 secondary procedure AND 1 mandatory procedure. let me give you an example fulfilling your criteria: patient with a cardiac related ICD 10 AND heart magnetic resonance (mandatory) AND troponin dosage… this example for me it is not suggestive of ATTR-CM unless CMR presents features consistent with amyloid cardiomyopathy, but this is not specified in the text or at least for me it is unclear. I can provide you plenty of combinations that you labelled as “ATTR-CM-like” but they are hardly acceptable. Similarly with the second possible definition of “ATTR-CM-like” e.g. ICD 10-related wtATTR (organ limited amyloidosis) AND secondary procedure (ECG), it is difficult to accept that this combination is suggestive of “ATTR-CM-like”. For what we know it could be amyloidosis in the carpal tunnel or just in the lung tissue or many other different alternatives but not necessarily “ATTR-CM-like”, isn’t it? My concern is similar for “hATTR-CM -like”, I provide you another example fulfilling your criteria for “hATTR-CM -like”: Neuropathic heredofamilial amyloidosis (ICD10 criteria) AND skin biopsy (secondary criteria), for me it does not represent a “hATTR-CM-like” but it could simply be a neuropathic amyloidosis with skin biopsy performed and no cardiac involvement. Secondary procedures criteria may often be just screening procedure? The fact that a patient performed a cardiological screening does not mean that it resulted positive to it. What I'm trying to prove is that the criteria you have chosen are non specific for amyloid cardiac involvement, or at least are questionable. I think that we have internationally shared specific criteria for ATTR cardiac involvement, I can accept the fact that in such a large population, referring to ATTR related IC10 can be a valid option however ATTR related ICD-10 are non specific for cardiac involvement and the association with “cardiac related ICD 10” can somehow increase the specificity but the overall result might be unprecise either in “ATTR-CM- like” or in “ATTR-CM-reference” (e.g. neuropathic heredofamilial amyloidosis + aortic valve stenosis fulfill you “ATTR-CM-reference” criteria but for me it can just be a neuropathic amyloidosis with a degree of aortic stenosis in an old patient without amyloidosis proven cardiac involvement) In conclusion I appreciate the effort but I have to express my concern on most of the definitions you provided and consequently to all the analysis derived from them. You excluded patients with “blood cancer” to avoid overlap with AL however, all patients with a positive serum or urinary immunofixation rise the suspect of possible AL ( independently from the presence of a blood cancer) and only biopsy proven ATTR should be included, I don’t think this has been done in your study , rising additional biases Minor revisions: Is it normal that in the manuscript I repeatedly found “(Supplementary Error! Reference source not found.)”? Maybe there is something wrong in my downloaded manuscript, but it is difficult to understand the refences in the text. For me it is unclear how you tested the accuracy, sensitivity and specificity of the ML model, from what I understood you classified wtATTR-CM and hATTR-CM based on ICD-10 with criteria not accepted internationally for the diagnosis of cardiac amyloidosis. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Fabiola De Marco Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.
|
| Revision 1 |
|
PONE-D-22-32110R1Assessment of potential transthyretin amyloid cardiomyopathy cases in the Brazilian public health system using a Machine Learning ModelPLOS ONE Dear Dr. Silva Julian, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Dec 24 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Giuseppe Limongelli Academic Editor PLOS ONE Journal Requirements: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. Additional Editor Comments: Dear author Thank you for re-submitting your manuscript and for addressing the points raised by the reviewers. We would suggest a few minor changes: - review punctuation (spaces after brakets) - review the reference in line 309 - add a figure to help understand the composition of the dataset visually looking forward to receive the manuscript [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: This work present a retrospective study aimed to identify potential transthyretin cardiac amyloidosis (ATTR-CM) cases in the Brazilian public health system using predictive machine learning to improve diagnosis and treatment. All the comments have been addressed. Minor comments: - - Please, pay attention to spaces in some part of the text and before some brackets; - Line 309: there is an error for the reference source; - Some figures could be improved. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Assessment of potential transthyretin amyloid cardiomyopathy cases in the Brazilian public health system using a Machine Learning Model PONE-D-22-32110R2 Dear Dr. Silva Julian, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Giuseppe Limongelli Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-22-32110R2 Assessment of potential transthyretin amyloid cardiomyopathy cases in the Brazilian public health system using a Machine Learning Model Dear Dr. Silva Julian: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Giuseppe Limongelli Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .