Peer Review History

Original SubmissionMay 31, 2019
Decision Letter - Li Zeng, Editor

PONE-D-19-15441

Development of a novel denoising convolutional neural network-based algorithm for metal artifact reduction in digital tomosynthesis for arthroplasty: A phantom study

PLOS ONE

Dear Prof Gomi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

We would appreciate receiving your revised manuscript by Sep 09 2019 11:59PM. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter.

To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). This letter should be uploaded as separate file and labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. This file should be uploaded as separate file and labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. This file should be uploaded as separate file and labeled 'Manuscript'.

Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

We look forward to receiving your revised manuscript.

Kind regards,

Li Zeng

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please ensure that you have fully discussed how the present study advances on your previous work in this area. Please ensure that you discuss how your work relates to, and advances upon, the following publication:

"Development of a novel algorithm for metal artifact reduction in digital tomosynthesis using projection-based dual-energy material decomposition for arthroplasty: A phantom study"

https://www.physicamedica.com/article/S1120-1797(18)31136-0/fulltext"

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors are developing a novel denoising convolutional neural network metal artifact reduction hybrid

reconstruction (DnCNN-MARHR) algorithm for decreasing metal objects in digital tomosynthesis (DT) for

arthroplasty employing projection data. The DnCNN-MARHR algorithm based on a training network

(mini-batch stochastic gradient descent algorithm with momentum) to estimate residual reference and object

images using projection data and subtract the estimated residual images from the object images, involving hybrid

and subjectively reconstructed image usage (back projection and maximum likelihood expectation maximization.

However, the proposed methodology is not new. The paper simply combines several preexisting and widely available techniques, such as, convolutional neural network, residual learning, mini-batch stochastic gradient descent algorithm, back projection maximum likelihood expectation maximization. In this context, what are the methodological and algorithmic contributions of the work to the research community?

#Comments

1. Over all the paper, I'm not sure the purpose of this paper is denoising or metal artifacts reduction.

2. The structure of the article is very confusing. For instance, the equation of the evaluation criteria (artifact index) is in the

Optimization parameters section and the other two evaluation criterias are in the Evaluation section.

3. The methods section is badly written. Many important aspects in the methodology are left unexplained in the article. The authors state to use low-energy projection image (PL) as input image and VM X-ray image as reference image for training workflow (Page 8, Line 159-160). There is no information on how many total data sets and how may data sets were allocated each to training, validation and testing.

4. It is very confusing in how to generate the reference projection images VM X-ray image? What is the meaning of the Ft, Fw and Ff in equation (5), how to determine the value of Ft, Fw and Ff? And why VM X-ray image can be the reference projection images for traning the DnCNN, there's still artifacts in this image in my opinion.

5. In fig 2, I cannot find the difference between the original image (PL) and artifact reduced projection image (Cor_img) from the DnCNN step. I suggest that the authors can directly use the original image (PL) and the equation (11) to obtain the final MAR image and make a comparison between this MAR image and DnCNN-MARHR image, I think the difference in the image quality between this MAR image and DnCNN-MARHR image is small.

Reviewer #2: The authors proposed a novel denoising convolutional neural network metal artifact reduction hybrid reconstruction (DnCNN-MARHR) algorithm to reduce the metal artifacts in digital tomosynthesis. The proposed method is based on a training network to estimate residual reference and the object images using projection. And then subtract the estimated residual images from the object images to get the artifact reduced projection. At last, the hybrid reconstruction algorithm was used to obtain the reconstructed tomosynthesis image with metal artifact reduction. And the authors executed a phantom study to compare the performance with different methods. Overall, the paper includes extensive work and the comparison studies are very clear. However, there are few limitations and the authors are encouraged to address the following concerns:

1. As far as I know, the material decomposition algorithm using dual-energy imaging technique needs a known material phantom to build the relationship between the projection (attenuation) and the material property in the calibration process. For the testing process, the projection of the unknown object with low and high energy was converted to the basis images with known materials in the projection domain. The virtual monochromatic images (VMIs) are generated by using the basis image and the attenuation coefficient according to the linear relation of the attenuation coefficient combination. Do you use the calibration phantom? Please provide more information on the content.

2. The DnCNN-MARHR algorithm is the major development of the study. And the Eq.(7) is the core to calculate the residual projection image. Please add more explanations or references.

3. The specification of the computing environment? How long does it take for training and testing process? Iteration number of different image reconstruction? The differences in the calculation time cost for DnCNN-MARHR algorithm and other methods.

4. What is the image size of the projection? Does it have any image pre-processing on the projections?

5. DEMDRA has the lowest AI value. Why not use DEMDRA image to be the reference image of the training network?

6. In generally, the metal artifacts could be reduced by increasing tube voltage for 3D X-ray imaging. (M.-J.Lee et al., “Overcoming artifacts from metallic orthopedic implants at high-field-strength MR imaging and multi-detector CT,” Radiographics, vol. 27, no. 3, pp. 791–803, 2007.) Why do you choose the projection with lower tube voltage to be the input image for DnCNN-MARHR algorithm?

7. Do you use any additional filters in the low and high tube voltage? Could you provide the energy spectrum of the low and high tube voltage setting?

8. How do you perform the data acquisition of the dual-energy tomosynthesis imaging? Is the imaging with different image parameters in the sequential process?

9. What is the total slice number of the reconstructed tomosynthesis image? What is the start height of the reconstruction from the detector surface? Where is the focal point during tomosynthesis imaging?

10. Line 313-315 Could you provide 2D AI surface plot with epochs and weighting coefficients when mini-batch size is 544?

11. Line 334-335 In Fig.2, the image of MLEM_DnCNN is the same as the polychromatic MLEM-MAR [70 kV]? And the image of BP_DnCNN is also the same as the polychromatic filtered back projection [FBP] MAR [70 kV]? Why do you combine the image of MLEM_DnCNN and BP_DnCNN? Is it empirical knowledge?

12. Could you provide the schematic diagram to illustrate the relationship of the in-focus plane and the out-of-plane in the Z-axis direction?

13. The execute time of DnCNN-MARHR algorithm (not include the training network)?

14. Line 447-448 the imaging parameters case by case? For the object in the different region or the various kind of object (e.g.: materials,…), the proposed algorithm could deal with it?

Minor corrections:

1. Line 137-138 Please normalize the expression of units. –mm μm

2. Line 175-176 Please double check the formula correctness of Eq.(2) and Eq.(3). Does it miss the exponential mark?

3. Line 238 “Equation (6)”

4. Line 245 “Equation (7)”

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Chia-Hao Chang

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Inserted into the revised manuscript (PDF).

Attachments
Attachment
Submitted filename: rebuttal_letter.pdf
Decision Letter - Li Zeng, Editor

[EXSCINDED]

Development of a denoising convolutional neural network-based algorithm for metal artifact reduction in digital tomosynthesis for arthroplasty: A phantom study

PONE-D-19-15441R1

Dear Dr. Gomi,

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements.

Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication.

Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

With kind regards,

Li Zeng

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thank you for all your efforts to include new figures and add more explanations in the manuscript. The current version is much clearer and well supported with the further information provided. However, I suggest adding some definition of the material fractions(F_t, F_w, F_f), XDTS_EL, XDTS_EH in Equation (5). That would help readers to understand the physical meanings of this equation.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Formally Accepted
Acceptance Letter - Li Zeng, Editor

PONE-D-19-15441R1

Development of a denoising convolutional neural network-based algorithm for metal artifact reduction in digital tomosynthesis for arthroplasty: A phantom study

Dear Dr. Gomi:

I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

For any other questions or concerns, please email plosone@plos.org.

Thank you for submitting your work to PLOS ONE.

With kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Li Zeng

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .