Peer Review History
| Original SubmissionSeptember 16, 2024 |
|---|
|
PONE-D-24-39233Quantitative profiling of liver fat in non-enhanced abdominal CT: Comparative performance of two-dimensional and three-dimensional radiomic analysis and deep LearningPLOS ONE Dear Dr. Yang, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Thank you for the opportunity to review your manuscript titled "Quantitative profiling of liver fat in non-enhanced abdominal CT: Comparative performance of two-dimensional and three-dimensional radiomic analysis and deep Learning." The study presents valuable findings; however, several aspects need to be addressed to enhance the overall quality and clarity of the paper. Please submit your revised manuscript by Dec 05 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Yuki Arita, M.D., Ph.D Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. PLOS requires an ORCID iD for the corresponding author in Editorial Manager on papers submitted after December 6th, 2016. Please ensure that you have an ORCID iD and that it is validated in Editorial Manager. To do this, go to ‘Update my Information’ (in the upper left-hand corner of the main menu), and click on the Fetch/Validate link next to the ORCID field. This will take you to the ORCID site and allow you to create a new iD or authenticate a pre-existing iD in Editorial Manager. 3. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, we expect all author-generated code to be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse. 4. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: No Reviewer #2: Partly Reviewer #3: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: No Reviewer #3: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: 1- The title should be improved. 2- The objectives and the rationale of the study are recommended to be clearly stated. 3- The concluding remarks of the abstract are not well-written. It's merely the repetition of the objectives and title of the manuscript. Please add method limitations and justification to the abstract. 4- The innovation of using this study is not very clear. I do not see a clear reason that this study can perform better than others. Why did the authors choose the method for this study? 5- The necessity & novelty of the manuscript should be presented and stressed in the "Introduction" section. 6- The application/theory/method/study reported is not in sufficient detail to allow for its replicability and/or reproducibility. Therefore, it is suggested to make it clear to show all steps to build the model. 7- The problem statement and gap study are not clear. 8- The method is not clear. Therefore, it must be shown and clarified to show all steps. 9- The interpretation of results and study conclusions are not supported by providing the reasons behind why they show that. Therefore, it is recommended to deepen the discussion. 10- It is recommended to emphasize the strengths of the study clearly. 11- The limitations of the study should be stated. 12- The manuscript structure, flow, or writing needs some improvements. 13- The manuscript is benefit from language editing. The English of the paper is readable; however, I would suggest the authors to have it checked preferably by a native English-speaking person to avoid any mistakes. 14- I noticed that the conclusion section tends to repeat the abstract and results. The conclusion paragraph should be short, impactful, and direct the reader to this research's next steps and opportunities. 15- It will be nice to add some new references to show that your study is updated. Reviewer #2: The study aims to compare the diagnostic performance of three-dimensional (3D) and two-dimensional (2D) radiomic features extracted from liver images obtained through non-enhanced abdominal CT scans. These features will be classified into four categories using 12 different classifiers. However, the writing style lacks coherence and clarity, particularly in the methodology section, which makes it difficult to follow. Therefore, I will mention some issues in the paper that need to be addressed in order to improve its quality: 1- The manuscript contains numerous grammatical errors that need thorough revision to enhance coherence and readability. 2- The term “NAFLD” should be defined upon its first occurrence to ensure clarity for all readers. Additionally, terms like “VB-Net” need proper definitions. 3- The related work section is brief and merged with the introduction. A more comprehensive review of relevant literature would be beneficial to provide context for the study. 4- The paper states that volumetric segmentation of the liver was performed using an algorithm based on VB-Net. This algorithm needs to be clearly defined, particularly regarding how it identifies vascular structures in the images. 5- Some figure captions, especially for Figures 1 and 2, lack clarity. These should be articulated more clearly to enhance understanding. 6- In Figure 2, the use of two fully connected layers (FCs) should be justified. A single FC layer may suffice and could mitigate the risk of overfitting and reduce computational costs. 7- The manuscript should specify which version of the ResNet architecture is being used, as different versions can have varying impacts on performance. For example, ResNet has ResNet18, ResNet34, ResNet50. ResNet101 and ResNet152 variants. 8- In lines 134 and 135, the authors mention that the “3D model feeds the segmentation and labeling data from the VB-Net into the ResNet network for analysis.”. However, Figure 2 does not provide clarity on the shape or structure of the data from VB-Net. 9- A summary table detailing the final dataset used, including the total number of features and their corresponding labels, should be included for clarity. 10- The data augmentation strategies are not sufficiently detailed. The authors should discuss their impact on the overall performance deeply. 11- Data augmentation strategies are mentioned in multiple places. It would be beneficial to consolidate this information into a dedicated subsection. 12- The normalization process is discussed in multiple sections (lines 177, 185); it should be consolidated into a single, clear explanation. 13- The choice of a 64x64 or 64x64x64 patch size should be justified, as other sizes may also be appropriate for this analysis. 14- In 186-187, the authors mentioned “Subsequently, the 3D liver images, along with their respective labels, are fed into the DCNN.”. This leads to confusion about whether the models are trained with both images and radiomic features. This should be clarified. 15- In 189-190, the authors mentioned only one fully connected layer in the text, leading to conflict with Figure 2, which depicts two. This inconsistency should be resolved. 16- In 197-198, the authors mentioned “models is evaluated by analyzing the ROC curve and calculating the AUC, which includes key metrics like accuracy, sensitivity, and specificity”. The authors state that models are evaluated using the ROC curve and AUC. It is important to clarify that AUC measures the model's ability to distinguish classes, while accuracy reflects overall prediction correctness. The authors should explain how accuracy is derived from AUC values. 17- In 202-211 lines, the “Participant Characteristics” section should be moved to a more appropriate place within the dataset description in the methodology. 18- The pre-processing steps should be organized into a dedicated subsection for clarity. 19- It’s not clear how the authors incorporate CNN layers, ResNet, and VB-Net for 2D/3D features, as shown in Figure 2, for use in classifiers such as SVM, RF, and others. 20- The terms “2DDLS” and “3DDLS” in Table 4 require definitions, as they are introduced without prior explanation. 21- There is inconsistency in labeling (e.g., -, +, ++, +++ in Figure 2 vs. 0-3 in Figure 3). A standardized labeling system should be adopted throughout the manuscript, including in the confusion matrices. Furthermore, the confusion matrices in Figure 3 have different labels in different orders. 22- The authors are encouraged to utilize cross-validation techniques to enhance the robustness of their findings. 23- The manuscript lacks details regarding the percentage of data used for training and testing. This information is crucial for replicability. 24- The authors may consider developing two scenarios: one that incorporates images in both training and testing and another that focuses solely on radiomic features. This approach could strengthen the overall findings. Reviewer #3: You have presented an interesting paper within a relevant and impactful area of research. However, before it is acceptable for publication I believe there are a number of issues that first need to be addressed, and therefore I am suggesting that this paper be accepted with major revisions, or if necessary rejected. Please see my comments below 1. I have concerns regarding the overall relevance of this work as it seems similar to work that has previously been published by other authors such as 10.3346/jkms.2022.37.e339. However the inclusion of extra models may warrant the article for publication and therefore it may be a good idea to reference earlier work such as this and compare why your work is superior. 2. Repeatedly throughout this work you have used acronyms. Please ensure your usage of acronyms is consistent, with the acronym defined at first usage and then used consistently in the same format throughout. Additionally, please ensure you always place a space betwee the full term and the parentheses. 3. On line 32, do not start a sentence with "Assess". Instead use a term such as "we assess" 4. Online 34 you say accuracy was confirmed through comparison with "manual assessments". Please state here what assessments these are. 5. On line 66-68, you make a very straong statement regarding the superiority of MRI and CT, there should be a relevant citation here to support this argument. 6. On lines 91-93, you start the sentence as if you are going to define both inclusion and exclusion criteria, but then only define exclusion criteria. Were no specific inclusion criteira used? 7. The sentence on lines 99-101 seems very out of place compared to the current text and may be better placed elsewhere or removed. 8. On lines 108-109, you state that participants were categorised. What categories were they categorised into? 9. On lines 173-175, these two sentences present the same information but with a slight difference in wording. Therefore they are not both needed. 10. In the "deep learning model development..." section, you say that data is fed to the DCNN but do not give any descriptions regarding the architecture. You should discuss the architecture here first (perhaps by moving the text from lines 188-192) before going on to say more. Instead, you simply discuss the "ResNet" layer on with no context. 11. On lines 188-192, you first state that cross entropy loss was used and then that focal loss was used. Is there a reason for this specification of two different loss types. If both were used it would be best to provide the context as to why. 12. You provide discussions of results but do not provide any description as to any particular processes that were used to validate the results that you have provided except for the use of the test set. For instance, did you use techniques such as K-Fold validation or repeated experiments? 13. There are a number of textual issues with this manuscript that need to be significantly addressed before it can be published. PLease check for English spelling, grammar and textual formatting errors, as there are multiple occurences of issues such as sentences ending and a new one starting with no space between and no spaces between the end of text and beginning of citations. 14. Additionally, there are a number of instances of textual discussions that do not match with the sections that they are discussing or provide information later on in a discussion when it should have been earlier (comment 7 + 10). I would suggest conducting a thorough re-evaluation of the article structure and ensuring that all text flows adequately and in the correct locations. 15. The captions you have provided for figures are increasingly long. I would suggest removing some of the text entirely or relocating it to the main body of text. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Diagnostic of fatty liver using radiomics and deep learning models on non-contrast abdominal CT PONE-D-24-39233R1 Dear Dr. Yang, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Yuki Arita, M.D., Ph.D Academic Editor PLOS ONE Additional Editor Comments (optional): This second version of the paper is a great improvement, the authors are to be commended. The manuscript has been much improved and is in a nice condition now. Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: (No Response) Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: (No Response) Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: (No Response) Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: (No Response) Reviewer #2: No ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: (No Response) Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: all comments were addressed. all comments were addressed. all comments were addressed. all comments were addressed. Reviewer #2: I am generally supportive of accepting the manuscript for publication in PLoS ONE, contingent upon the authors addressing the following points: 1. The manuscript currently includes two separate figures labeled as "Figure 3.", “Fig3. Diagnostic performance.” and “Fig 3. Feature weighting”. To ensure clarity, please renumber them as Figure 3 and Figure 4, respectively. 2. In lines 131-132, the reference to "The network structure is visible in S1 Fig." is incomplete. Similarly, the reference in line 166 to "Full details can be found in the S4 Table" lacks the full citation. Both should be updated to include the appropriate figure/table captions or details. 3. The images labeled C and D from Figure 3 were removed, yet these are critical as they illustrate the 3D DL model. I suggest reinstating these images and presenting them as subfigures A and B within Figure 3. Please ensure the labeling style and numbering are consistent with the rest of the figure. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** |
| Formally Accepted |
|
PONE-D-24-39233R1 PLOS ONE Dear Dr. Yang, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Yuki Arita Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .