Peer Review History

Original SubmissionDecember 13, 2023
Decision Letter - Yan Chai Hum, Editor

PONE-D-23-42003An image quality assessment index based on image features and keypoints for X-ray CT imagesPLOS ONE

Dear Dr. Maruyama,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

The review report requires substantial revisions to improve clarity and coherence. In the introduction, it is necessary to clearly present the aim/objective and hypothesis before detailing the methods, while eliminating redundant sections such as the outline. The methods section lacks a description of the statistical analysis employed. Moving to the discussion, there is a need to explore the method's applicability in patient settings, considering variations in normal anatomy, and addressing how parameters like kVp-settings and collimation might affect results. Additionally, the discussion should clarify how the method's results correlate with image quality across different clinical questions and highlight its advantages over existing standard methods. Overall, the report would benefit from thorough language editing to rectify numerous typos and grammatical errors, enhancing its readability and comprehension.

Please submit your revised manuscript by Mar 15 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Yan Chai Hum

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, all author-generated code must be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

3. We note that your Data Availability Statement is currently as follows: [All relevant data are within the manuscript and its Supporting Information files.]

Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition).

For example, authors should submit the following data:

- The values behind the means, standard deviations and other measures reported;

- The values used to build graphs;

- The points extracted from images for analysis.

Authors do not need to submit their entire data set if only a portion of the data was used in the reported study.

If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories.

If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access.

Additional Editor Comments:

Please revise according to reviewer's comments.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Introduction:

- There is a need to present a clear aim/objective and the hypothesis before stating the methods.

- Lines 52-63, is this method description?

- Lines 64-66 are hard to follow. Is this a conclusion?

- The outline in lines 66-69 is not needed

Methods:

- Statistical analysis description is missing.

Discussion:

- There is a need to discuss the use in patients and how differences in normal anatomy might affect the use of this method.

- Could different kVp-settings, collimation, slice thickness, pitch, etc., have changed the results?

- Diagnostic image quality is dependent on the clinical question. How are the results of these tests an index for image quality in different clinical questions? Are there some clinical questions where it is more useful than others?

- What does this method add to image quality assessment compared to today's standard methods?

General:

- The text is hard to follow, and there are some typos and grammatical errors. Thus, there is a need for language editing.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Elin Kjelle

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Reviewer #1

Introduction:

- There is a need to present a clear aim/objective and the hypothesis before stating the methods.

Thank you for your feedback and the suggestion.

We have extensively revised the final paragraph of the Introduction section, providing a comprehensive overview of the proposed methodology’s objectives and novelty. These modifications aim to enhance the clarity and accessibility of the research introduction.

We have reflected this comment by lines 46–57.

- Lines 52-63, is this method description?

We appreciate your observation and pointing out.

The description in the “Objective” sentence indeed resembled methodological details, causing confusion in the structure. We have removed the mentioned portion and restructured it so that specific methodology details are now explained solely in the subsequent Methods section.

- Lines 64-66 are hard to follow. Is this a conclusion?

Thank you for your specific feedback. We have removed unnecessary paragraphs and added new sentences to clarify the main contributions of this study.

We have reflected this comment by lines 55–57.

- The outline in lines 66-69 is not needed

Thank you for your advice.

We have removed the paragraph outlining the structure of the paper. Additionally, we have streamlined the Introduction by eliminating redundant explanations and definitions. These revisions were made with a focus on enhancing readability.

We have reflected this throughout the Introduction section.

Methods:

- Statistical analysis description is missing.

We appreciate the feedback.

We have included a description sentence of the statistical analysis in the Methods section. Please review to ensure that it provides the necessary information for the satisfaction of the reviewers.

We have reflected this sentence by lines 147–149.

Discussion:

- There is a need to discuss the use in patients and how differences in normal anatomy might affect the use of this method.

Thank you for your insightful and valuable comments, which broadens our perspective.

We have added our argument into the existing text. While acknowledging the need for some validations of how differences in normal anatomy might affect its use, we have considered that it would be difficult to further discuss the regarding additional influence or applications based on the insights obtained in this study. Therefore, we have opted to address the importance of preparing for clinical application and highlight it as a topic for future validation. We appreciate your review of these revisions.

We have incorporated reviewer’s comments by lines 298–302.

- Could different kVp-settings, collimation, slice thickness, pitch, etc., have changed the results?

Thank you for providing specific question. Although this aspect was previously commented in the discussion section, we have now provided more specific explanation.

If image quality is changed by adjusting the parameters of imaging condition, the results obtained by the proposed method will change. This can be explained based on our results, which examine the effects of dose and blurring in our validations; features of any keypoints may change as the image quality changes. However, to ensure a clearer understanding of the points raised, we have added more detailed explanations to clarify this aspect further.

We have incorporated your comments by lines 288–294.

- Diagnostic image quality is dependent on the clinical question. How are the results of these tests an index for image quality in different clinical questions? Are there some clinical questions where it is more useful than others?

Thank you for your insightful perspective and important feedback. We agree with the reviewer's comments.

Based on the suggestion provided by the reviewer, we have added a new paragraph to discuss this aspect. Considering the relevance to the observer's reading process and decision-making, further investigation is necessary to determine whether the proposed approach can seamlessly apply to various clinical questions or tasks. We have provided examples and outlined future prospects to address this concern.

We have incorporated your comments by lines 275–285.

- What does this method add to image quality assessment compared to today's standard methods?

Thank you for your feedback. We have perceived this as a crucial comment to emphasize the significance of our approach.

One of the clear distinctions between our method and conventional techniques is the ability to visualize keypoints (or local area) where changes in image quality occur; we believe this aspect encourages a better understanding in medical image analysis. To facilitate this understanding, we have added several sentences and modified one paragraph in the discussion section.

We have incorporated your comments by lines 265–270.

General:

- The text is hard to follow, and there are some typos and grammatical errors. Thus, there is a need for language editing.

Thank you for your helpful comments. The submitted manuscript had corrected by a professional editing service; however, we sincerely apologized for any insufficiencies. After revising the points raised by the reviewers, we have resubmitted the manuscript for further proofreading by the service. (We had also attached the reviewer's comments regarding the language in the manuscript.)

Please review to ensure that the revised manuscript meets the standards of clarity and readability required for publication.

We have reflected this comment the manuscript (minor changes have been made the throughout text).

Decision Letter - Yan Chai Hum, Editor

PONE-D-23-42003R1Image quality assessment index based on image features and keypoints for X-ray CT imagesPLOS ONE

Dear Dr. Maruyama,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please revise according to reviewer's comments. 

Please submit your revised manuscript by Jun 03 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Yan Chai Hum

Academic Editor

PLOS ONE

Additional Editor Comments:

Please revise according to reviewers' comment.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

Reviewer #3: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: No

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Explain how the present manuscript differs from and improves upon these established previous works. Include a study with your survey papers and be sure to highlight any knowledge gaps that have come up recently.

Discuss some major sections in the article like the real time/ practical application of the paper, future perspectives, major contribution in the paper, significance of this study.

In the introduction section, include some other research applications on medical imaging as literature. Some suggestions are: Multi-modal medical image fusion framework using co-occurrence filter and local extrema in NSST domain; An end-to-end content-aware generative adversarial network based method for multimodal medical image fusion; TSJNet: A Multi-modality Target and Semantic Awareness Joint-driven Image Fusion Network; Clustering based Multi-modality Medical Image Fusion; Directive clustering contrast-based multi-modality medical image fusion for smart healthcare system

The authors should test their model with their dataset (not only from the public dataset). The complexity comparison should be made. Cross-Validation is lacking in this paper.

For the validation and best performance of result, use graphical analysis like histogram or intensity profile analysis.

Rewrite conclusion. Add concluding, contribution points in it briefly. Abstract needs to rewritten with better summary of paper.

Reviewer #3: This paper presents a simple quality assessment index for CT images. The Hamming distance between the features extracted by the feature extraction algorithm and the corresponding feature points of the reference image is used as the quality assessment result for the image. However, the manuscript is rather confusing in its structural arrangement, the logical expression is not very clear, and it also has the following problems that need to be revised:

The introduction does not make clear what the application context requires of the method. The reason why evaluation indicators such as SSIM cannot be used and new indicators need to be proposed is not well reflected in the introduction.

The design of the experimental section is problematic. The comparison of algorithms in the experimental section does not reflect well the superiority of the proposed quality evaluation method. At the same time, the algorithm lacks data on time complexity.

Insufficient arguments for the conclusions drawn from the experimental results. The conclusion in line 254 that the scores obtained by the algorithmic metrics proposed after the images have undergone affine transformations are not sufficiently correlated with SSIM to indicate that the algorithms are robust is not very convincing. Consideration could be given to validating this point based on the correlation between the results of the algorithm after the affine transformation and the results of algorithms such as CW-SSIM and the like (correlation algorithms that can still efficiently detect unstructured distortions).

There is a lack of explanation about the reason for choosing the feature extraction algorithm. Whether the specific characteristics of CT images were taken into account or whether there were other considerations.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

The detailed responses to the reviewers are provided in the attached response letter.

Please refer to the attached file.

Thank you very much for your consideration.

Attachments
Attachment
Submitted filename: Response letter_PONE-D-23-42003_R2.docx
Decision Letter - Yan Chai Hum, Editor

Image quality assessment index based on image features and keypoints for X-ray CT images

PONE-D-23-42003R2

Dear Dr. Maruyama,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Yan Chai Hum

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Formally Accepted
Acceptance Letter - Yan Chai Hum, Editor

PONE-D-23-42003R2

PLOS ONE

Dear Dr. Maruyama,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Yan Chai Hum

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .