Peer Review History
| Original SubmissionApril 16, 2025 |
|---|
|
Dear Dr. tu, plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Habtamu Setegn Ngusie Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please ensure that you refer to Figure 1 and 2 in your text as, if accepted, production will need this reference to link the reader to the figure. Additional Editor Comments: As the editor, I would like to offer the following general comments: Introduction: Please ensure that your introduction is scientifically sound. Start with a general overview and then narrow down to specific details. Incorporate existing solutions to the problem, highlight the research gap, and reference previous studies. Language Editing: I recommend enhancing the overall quality of the English language in your manuscript. Please check all grammatical issues from the introduction to the end, as this is vital for your and the journal's reputation. Abstract: Please revise your abstract to make it more compelling and ensure it meets the journal's standards. It should serve as a concise summary of the key sections of your manuscript. Specific Comments: Please provide a clear workflow diagram. Please employ a hyperparameter tuning technique in your study and show the ROC curve before and after tuning/optimization. You can use only one technique, for example, grid search tuning or Bayesian optimization. You state that you used the Boruta algorithm for risk factor identification; I believe you meant feature selection, as this algorithm is used for that purpose. Please correct your statement in all sections that mention the Boruta algorithm accordingly. If you obtain new results regarding the best-performing algorithm after employing the hyperparameter tuning technique, please rewrite the results, discussion, and other sections to reflect these new findings. In your conclusion, you state your findings. Refer to the following quoted sentence from your abstract, conclusion subsection: "These models outperform traditional statistical methods and offer valuable insights for risk stratification." Do you mean compared to other machine learning algorithms or compared to traditional statistical methods? Please clarify and ensure your conclusion aligns with your findings. In your Boruta algorithm graph (Figure 2), the yellow represents tentative attributes, but you seem to have removed those variables as you did for non-important variables. Should tentative variables be removed automatically like non-important variables? If not, please clearly state what you did in your feature selection technique. It would be better to incorporate a workflow diagram for your machine learning activities, or if you don't prefer this kind of diagram, please state the details within the methods section. The performance of each machine learning algorithm, such as the ROC curve value before and after various data balancing techniques, should be highlighted. Please experiment with various data balancing techniques, or if you only employed one, provide the reasoning with references. Please also highlight headings and subheadings clearly, ensuring the first letter of each heading and subheading is capitalized. Did you employ SHAP analysis after selecting the most important variables using the top-performing machine learning algorithm, or separately? If it was separately, what was the purpose of employing the machine learning algorithm? If you used both the machine learning algorithm and SHAP analysis for identifying the top predictors, please state the details regarding the method of ensembling. Lastly, the author may benefit from citing the following article for some of their methodological arguments, as it clearly articulates the aspects we should follow in machine learning, especially in predictive modeling: https://link.springer.com/article/10.1186/s12889-024-19566-8. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? Reviewer #1: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: I Don't Know ********** 3. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes ********** Reviewer #1: 1.Unclear inclusion and exclusion criteria can impact sample size and outcomes. Therefore, it is crucial to clarify key factors such as MIMIC database version, age, and diabetes classification to ensure accurate sample size and consistent research baseline. 2.The exclusion criteria only mention CHD patients admitted to the ICU. How should data from CHD patients with multiple ICU admissions be handled? Additionally, how does a change in sample size affect the selection of key variables in the machine learning model? 3.The MIMIC database includes clinical data such as vital signs, laboratory results, clinical scores, complications, medication usage, interventions, and outcomes. The exclusion criteria mentioned in the text only state "lack of key clinical data (e.g., vital signs or laboratory results at admission)" without providing original data to verify potential bias in the exclusion criteria. This lack of transparency may affect the sample size included. 4.Can you provide sufficient evidence that the application of 16 predictive models in clinical prediction research is meaningful, both statistically and clinically? 5.The study mentions the predictive significance of comparing 16 machine learning models. It also examines whether the predictions are consistent with traditional clinical scores such as SOFA, APACHE-II, and OASIS. 6.In our study, age, blood urea nitrogen (BUN), and pH were identified as the three most important prognostic variables. How does this differ from the machine learning model predicting coronary heart disease (CHD) in type 2 diabetes published in Acta Diabetologica on 2025 Apr 1? Ji Y, Shang H, Yi J, Zang W, Cao W. Machine learning-based models to predict type 2 diabetes combined with coronary heart disease and feature analysis-based on interpretable SHAP. Acta Diabetol. 2025 Apr 1. doi: 10.1007/s00592-025-02496-1. Epub ahead of print. PMID: 40167635. 7.Recently, many studies on CHD outcome prediction models can be found on PUBMED. What do you consider to be the advantages or innovations of this study? For example: 1、Yadegar A, Mohammadi F, Seifouri K, Mokhtarpour K, Yadegar S, Bahrami Hazaveh E, Seyedi SA, Rabizadeh S, Esteghamati A, Nakhjavani M. Surrogate markers of insulin resistance and coronary artery disease in type 2 diabetes: U-shaped TyG association and insights from machine learning integration. Lipids Health Dis. 2025 Mar 15;24(1):96. doi: 10.1186/s12944-025-02526-5. PMID: 40089748; PMCID: PMC11910848. 2、Rehman MU, Naseem S, Butt AUR, Mahmood T, Khan AR, Khan I, Khan J, Jung Y. Predicting coronary heart disease with advanced machine learning classifiers for improved cardiovascular risk assessment. Sci Rep. 2025 Apr 17;15(1):13361. doi: 10.1038/s41598-025-96437-1. PMID: 40247042; PMCID: PMC12006408. 3、Soleimani H, Najdaghi S, Davani DN, Dastjerdi P, Samimisedeh P, Shayesteh H, Sattartabar B, Masoudkabir F, Ashraf H, Mehrani M, Jenab Y, Hosseini K. Predicting In-Hospital Mortality in Patients With Acute Myocardial Infarction: A Comparison of Machine Learning Approaches. Clin Cardiol. 2025 Apr;48(4):e70124. doi: 10.1002/clc.70124. PMID: 40143742; PMCID: PMC11947610. 4.Tao H, Wang C, Qi H, Li H, Li Y, Xie R, Dai Y, Sun Q, Zhang Y, Yu X, Shen T. A Real-Time Computer-Aided Diagnosis System for Coronary Heart Disease Prediction Using Clinical Information. Rev Cardiovasc Med. 2025 Mar 17;26(3):26204. doi: 10.31083/RCM26204. PMID: 40160568; PMCID: PMC11951285. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Dear Dr. tu, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Sep 12 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Kwang-Sig Lee Academic Editor PLOS ONE Journal Requirements: 1. If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. Additional Editor Comments: I am really grateful to review this manuscript. In my opinion, this manuscript can be published once some revision is done successfully. I made two suggestions and I would like to ask your kind understanding. Firstly, it can be noted that experts use impurity/permutation importance for testing the strength of association between the dependent variable and its major predictor then they employ the SHAP summary/dependence plot for evaluating the direction of the association. In this context, I would like to ask the authors to derive impurity/permutation importance as well. Secondly, it can be noted that boosting and the random forest often register similar performance outcomes (84%-85%) but bring different results in permutation importance and SHAP plots. Boosting focuses on the final decision of the strongest tree with minimal bias whereas the random forest focuses on the majority vote of all trees with minimal variance. Both models have their own strengths and weaknesses, hence which model performs and explains better depends on various conditions. In this vein, I would like to ask the authors to (1) compare their strengths and weaknesses and (2) compare their permutation importance and SHAP plots in a comprehensive manner. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author Reviewer #1: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions??> Reviewer #1: Partly ********** 3. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: I Don't Know ********** 4. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: No ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: (No Response) ********** Reviewer #1: We do not deny the authenticity of the data provided by the MIMIC.舄However, the phenomenon mentioned in the May 2025 Science article �O'Grady C. Low-quality papers surge thanks to public data and AI. Science. 2025 May 22;388(6749):807-808. doi: 10.1126/science.adz1715. Epub 2025 May 22. PMID: 40403045. �is “authors limited their analysis to certain years, or certain ages of people in the survey. That suggests the authors were on the hunt for statistically significant results to generate easy publications, Spick says. But fishing for results in such a huge data set is bound to come up with many false positive findings. When the team took a closer look at the 28 NHANES studies that had explored depression, they found that only 13 of the results survived a statistical adjustment that corrects for the risk of finding false positives.” So we hope the author can provide the initial data of 4366 cases extracted from the MIMCI database, so that other researchers can verify whether there is selection bias or false positive issues in repeating this study without specific data screening. Perhaps with initial data, I can provide a good explanation and validation for the 1-3 questions I raised during my first review. 1.Unclear inclusion and exclusion criteria can impact sample size and outcomes. Therefore, it is crucial to clarify key factors such as MIMIC database version, age, and diabetes classification to ensure accurate sample size and consistent research baseline. 2.The exclusion criteria only mention CHD patients admitted to the ICU. How should data from CHD patients with multiple ICU admissions be handled? Additionally, how does a change in sample size affect the selection of key variables in the machine learning model? 3.The MIMIC database includes clinical data such as vital signs, laboratory results, clinical scores, complications, medication usage, interventions, and outcomes. The exclusion criteria mentioned in the text only state "lack of key clinical data (e.g., vital signs or laboratory results at admission)" without providing original data to verify potential bias in the exclusion criteria. This lack of transparency may affect the sample size included ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Predicting In-Hospital Mortality in ICU Patients with Coronary Heart Disease and Diabetes Mellitus Using Machine Learning Models PONE-D-25-20524R2 Dear Dr. tu, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support . If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Kwang-Sig Lee Academic Editor PLOS ONE |
| Formally Accepted |
|
PONE-D-25-20524R2 PLOS ONE Dear Dr. tu, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Professor Kwang-Sig Lee Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .