Peer Review History
| Original SubmissionMarch 15, 2021 |
|---|
|
PONE-D-21-08513 Investigation of Potential Genetic Biomarkers and Molecular Mechanism of Smoking-related Postmenopausal Osteoporosis by Using WGCNA and Machine Learning PLOS ONE Dear Dr. Wang, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Both reviewers raised substantial technical concerns. All of these need to be suitably addressed in a revised manuscript. Please submit your revised manuscript by Jul 08 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jishnu Das, Ph.D. Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables should be uploaded as separate "supporting information" files. 3. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. Please see the following video for instructions on linking an ORCID iD to your Editorial Manager account: https://www.youtube.com/watch?v=_xcclfuvtxQ [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: No Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: No Reviewer #2: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Review of "Investigation of Potential Genetic Biomarkers and Molecular Mechanism of Smoking-related Postmenopausal Osteoporosis by Using WGCNA and Machine Learning" by J. Wang. The author has presented a bioniformatic pipeline to identify genetic biomarkers for smoking related postmenopausal osteoporosis. The are a few questions I have that I would like the authors to address. 1. The author seems to have mixed analytical methods with subjective heuristics, which is concerning. For example, based on correlation analysis the author identifies the yellow module as showing a significant correlation between both smoking and osteoporosis. However, this identification seems subjective as the black module also seems to be significant. Futhermore, since this data is not RNAseq data but microarray data, which generaly profiles targeted transcripts, it is quite possible that the black module will also identify some relevant biomarkers. The author, therefore, needs to carefully, methodically and quantitatively justify the selection of the relevant module. 2. Following the above point the author should clarify how the correlation between smoking/osteoporosis phenotype and eigengene of the different modules is computed and how the significance is computed. Additionally, in the Results section the author mentions correlation between eigenvalue (instead of eigengene) and the phenotype. The authors should clarify this confusion. 3. The author uses a recursive feature elimination approach. In the context of statistical regression, such stepwise approaches have been shown to be suboptimal. Why does the author think that this approach is a good option, especially given that many of the microarray genes might already be pre-selected and correlated. Clarification would be quite helpful. 4. What type of SVM did the author use: linear/non-linear, soft/hard margin, nu/C parameterization and why? 5. The author should clarify their validation approach: what was the training set, what was the testing set, and how did the control set relate to them. 6. It remains unclear to me as to why the author has generated ROCs and related AUC only for individual gene expressions. The performance is quite poor, and if one looks at the shape of the ROC, the sensitivity and specificity are not good either. It might be better to generate ROC curves for gene expression combinations. 7. In the abstract the author has mentioned the "yellow module" as the clinically significant module. This seems to be a highly unusual way to present ones results. Nobody reading the abstract will understand what a yellow module is. The author needs to provide a better description. 8. The writing needs to be improved. For example, 'According to recently scientific discoveries, ...', 'With the rapid development of high-throughput microarray technologies, identification of meaningful genomic variations and investigating biological mechanisms have contributed great effort ....', etc. Reviewer #2: The overall analytical pipeline (WGCNA+ML) seems promising to help identify potential genetic biomarkers of SRPO, but the validity and robustness of the results presented in this paper need further examination. Major 1. Identification of significant modules and analysis of module-trait relationship – It was not clear whether proper multiple-testing correction has been applied. This appeared to be critical as the significance of the two modules nominated in the Module-Osteoporosis analysis is marginal (Yellow p=0.03, Green p=0.02). And the significance of the Yellow in Module-Smoking relationship will also become marginal if Bonferroni is applied to correct 11 tests. 2. Construction of PPI network – The network and sub-network built in this paper seemed to be very dense. This was likely resulted from the authors including all sorts of protein linkages. Restricting to only “experimentally determined interactions” may better clarify the biological meaning of the network and the subsequent results. In particular, the inclusion of “gene neighborhood interactions”, “text-mining interactions”, and “gene co-occurrence interactions” lacks biological context. 3. Function and pathway enrichment analysis – 1) Statistical significance again was not properly defined here. While gene set enrichment tools usually provide adjusted p-values (or q-values), the authors stated that “The p-value < 0.05 was considered to indicate a significant difference for GO terms and KEGG pathways”. 2) Statistical significance (Adjusted P-value or Odds) would be preferred in the figure, instead of “gene number”. 3) It is of little use to list all the enriched terms in the main text, instead, the authors should investigate further and explain the biological meaning of these terms and more importantly, how they are relevant to the phenotype SRPO. This is essential and is part of be the meat of this paper, as the authors claimed that this work could provide novel insights into the molecular mechanism of SRPO. 4. Identification of feature genes using machine learning method – It was not sufficiently justified why the specific two ML methods were chosen. Also, how the recursive feature elimination analysis was performed and how it can benefit the model was not clearly explained. Plus, while prioritizing the genes by their overlaps seems justifiable, more detailed comparison of the two sets of genes is desired to give a more comprehensive view of the results (e.g., Are those non-overlapping genes also functionally relevant? Does one gene set appear to be more relevant than the other? Why RF gave many more genes than SVM – is it more powerful or less accurate? Would it be reasonable to use the union instead of intersection to implicate more genes?). 5. Data validation – 1) The selection of control group: “10 samples of postmenopausal non-smoking females with high BMD” was used, while alternatively, the other group “10 samples of postmenopausal non-smoking females with low BMD” can be used to better dissect the relationship between the implicated genes and “smoking-related” postmenopausal osteoporosis (rather than the general postmenopausal osteoporosis). 2) Multiple-testing correction is expected for the gene expression analysis; if Bonferroni, genes ATP5G1 and RPL26L1 will not surpass the threshold. 3) Description and discussion about the functional significance of the implicated genes are expected to follow the results here. The authors had lengthy paragraphs on this in the Discussion section, which should be moved up, expanded in depth, while rephrased more concisely. Minor 1. Accurate references need to be cited when linking the implicated genes/pathways to SRPO if the relevant conclusions are not drawn by this paper (e.g., “It has been suggested that aging and increasing in reactive oxygen species (ROS) may be the proximal culprits for osteoporosis”, “ROS can influence the generation and survival of osteoclasts and osteoblasts” …). 2. Grammar needs to be revised (small errors like "Osteoporosis is one of the most common systemic skeletal disorder" occurs occasionally). 3. Language needs to be polished into a more scientific fashion (for example, in “… performed a heatmap and bar graph of ...” and “…scatterplots of GS vs. MM of module yellow of the two phenotypes were performed …”, specific analyses/statistical tests should be described rather than the types of graphs). 4. Data availability – key results should be complied as supplementary files for others to use (e.g., module information, PPI network, pathways, and relevant statistical results, etc.). ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-21-08513R1 Analysis of potential genetic biomarkers and molecular mechanism of smoking-related postmenopausal osteoporosis using weighted gene co-expression network analysis and machine learning PLOS ONE Dear Dr. Wang, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. ============================== ACADEMIC EDITOR: The revised manuscript is significantly improved. Reviewer 2's final comments regarding structure/organization should be addressed. The current version of the manuscript presents a highly fragmented narrative, and would benefit from stylistic edits (as suggested by Reviewer 2) to make it more readable. ============================== Please submit your revised manuscript by Oct 07 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jishnu Das, Ph.D. Academic Editor PLOS ONE Journal Requirements: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. Additional Editor Comments (if provided): [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: All comments have been addressed Reviewer #2: (No Response) ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: No ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: The authors have adequately addressed my comments. In particular, I was glad to see that in their Discussion the authors have moderated the significance of their results with the limitations inherent in this initial study. Reviewer #2: The manuscript has been considerably improved. The authors addressed all technical comments well; the results are now scientifically sound and worth to be published. One last improvement needed is the writing / organization of the paper. The results section reads too thin to deliver the message fully. The major issue appears to be lacking of relevant discussion/interpretation following specific results. For example, result #2 "Construction of the PPI network" appears insufficient to be an independent section (it's more like a paragraph of Method). An easy fix could be combining it with result #3. Similarly, #5 "Diagnostic efficiency of feature genes" is also too thin - further interpretation is expected, possibly merge with result #4. On the other hand, the authors did a decent amount of work on explaining the specific nominated genes in the Discussion section. I'd suggest move these discussions to the Result section to alleviate the scarcity and better deliver the scientific implication of the analyses. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Analysis of potential genetic biomarkers and molecular mechanism of smoking-related postmenopausal osteoporosis using weighted gene co-expression network analysis and machine learning PONE-D-21-08513R2 Dear Dr. Wang, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Jishnu Das, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-21-08513R2 Analysis of potential genetic biomarkers and molecular mechanism of smoking-related postmenopausal osteoporosis using weighted gene co-expression network analysis and machine learning Dear Dr. Wang: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Jishnu Das Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .