Peer Review History
| Original SubmissionDecember 21, 2020 |
|---|
|
PONE-D-20-40081 A novel approach for adjustment of to dry weight in adjustments for dialysis patients using machine learning. PLOS ONE Dear Dr. Choi, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.This is an interesting study as your team has tried a newer approach of dry weight in adjustments for dialysis patients using machine learning .After reviewing this paper and also the reviewer comments several issues needs to be addressed before this study can be considered for publication.Please address the comments and concerns by the reviewers and after that your paper will be reviewed again before being considered for publication. Please submit your revised manuscript by Mar 27 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols We look forward to receiving your revised manuscript. Kind regards, Bhagwan Dass, MD Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. To comply with PLOS ONE submission guidelines, in your Methods section, please provide additional information regarding the methodological and statistical analyses performed for the computational tests. For more information on PLOS ONE's expectations for statistical reporting, please see https://journals.plos.org/plosone/s/submission-guidelines.#loc-statistical-reporting. 3. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. 4. Please amend either the title on the online submission form (via Edit Submission) or the title in the manuscript so that they are identical. 5.Thank you for stating the following in the Acknowledgments Section of your manuscript: "This research was also supported by National Institute for Mathematical Sciences (NIMS) grant funded by the Korea government, 2020 (No. NIMS-2020B900000). This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2017R1D1AB03035061)." We note that you have provided funding information that is not currently declared in your Funding Statement. However, funding information should not appear in the Acknowledgments section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript and let us know how you would like to update your Funding Statement. Currently, your Funding Statement reads as follows: "he funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." Please include your amended statements within your cover letter; we will change the online submission form on your behalf. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Partly Reviewer #3: No ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: No Reviewer #3: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: No Reviewer #3: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: No Reviewer #3: No ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Choi and coworkers are submitting a novel approach for adjusting dry weight in hemodialysis patients using machine learning support. For this purpose, they developed a retrospective study using a data set of 1672 hemodialysis (HD) patients in which they compared dry weight defined clinically (clinical proper) to dry weight predicted or estimated from bioimpedance spectroscopy device (BIS). They estimated the gap between these two methods and they clustered such difference in three categories (<1; 1-2;>2 liters). With machine learning support, they identified and weighted factors (clinical data, lab test, body composition from BIS) being associated with each of these groups. They concluded that machine learning support, may help to improve dry weight clinical estimate using BIS and additional factors (clinical data, lab values, body composition) particularly in the lowest fluid overload patient categories. In addition, malnutrition related factors may explain most of gap discrepancy in dry weight estimate. This novel approach relying on machine learning and artificial intelligence is interesting, and seems appealing as support tool for guiding physicians in managing more precisely dialysis patients. This approach may be used as an example of featuring future of medicine. Now the study raises several concerns that should be addressed: 1. Use of such machine learning and intelligence artificial tool to identify factors that may influence bad estimate of dry weight such malnutrition is not sufficient to validate this approach. 2. It is not clear from reading, how the authors defined the ideal dry weight of patients? Was it the fluid overload estimated from the BIS device that was chosen as target to set suitable or ideal dry weight or the clinical judgement or a combination? That should be defined clearly since it is confusing along the manuscript. 3. If the ideal or suitable dry weight was established on the clinical and/or biologic assessment, therefore the authors should define which criteria and threshold values were used to define the three categories of gap discrepancies. 4. If the target dry weight was established from BIS measurement then it is easier to understand but still clinical criteria used to define fluid status needs to be listed with their threshold values. 5. From a methodological point of view, it would be also interesting to validate the algorithm that was developed in the assessment of fluid overload within an external cohort of patients. 6. Clinical outcomes of these three categories of patients would require further analyses. This is important to value the support of machine learning in reducing intradialytic morbidity (ie, incidence of intradialytic hypotension) and/or improving medium- or long-term morbidity (ie, hospitalization for pulmonary edema) and mortality (all cause or cardiovascular mortality). 7. What will be the clinical implication in the future of using this tool? How the authors envisage to develop and use such tool? Are they planning to perform a prospective interventional study with which aims? Reviewer #2: It is a research paper that has been hard work with a large number of patients, but it requires extensive revision in order for the general reader to understand. I have several questions. I think you defined DWcp as usual meaning, but what is the ‘prediction of DWcp’ using machine learning? You said OHcp is the gap between DWcp and the body weight (pre-dialysis?), but what does OHcp mean by machine learning? You said that you derived a more clinically accurate DW using machine learning, but where is the data? What new data is included in Group Two? DWgap Group 2 has mixed definitions. Be sure to indicate. More detail explanation is needed for the general readers to understand machine learning. What does the number next to diabetes or HTN on the figure 2? Please indicate the statistical values. I do not understand what correlation figure 2 represents. The graph showing the correlation seems to be missing. For the title ‘The factors influencing GapDW’, these factors do not affect GapDW, but are values that depend on the GapDW group. Maybe larger gap group tend to be in high overhydration status, so that they have large ECW and lower concentrations of materials. Reviewer #3: Kim et al. have gathered an impressive dataset: BIS-measurements from as many as 1672 hemodialysis patients, undergoing hemodialysis at a single center. The authors stated they would “predict the clinical dry weight, by using machine learning for volume status derived from BIS and clinical information”. Major comments: 1) I do not understand the definition of the “DW gap”. The authors state that this is “the absolute value of the body weight minus DWBIS from DWCP in units of kg”, but I find this definition unclear. For example, if an 80 kg person has a DWBIS of 77 kg and a DWCP of 78 kg. I am assuming the gap is 1 kg. What happens if an 80 kg person had a DWBIS of 78 kg and a DWCP of 77 – is the gap still 1 kg? 2) The authors state that “in general, dry weight (DW) is defined as the lowest weight a patient on chronic hemodialysis can tolerate [4].” (1) The reference is a 1980 publication by Henderson and clinically outdated. A more appropriate definition is given by Agarwal: (2) (also not the newest paper available, but much more modern than Henderon’s). 3) The authors state that “In this study, the concept of clinically proper DW (DWCP) was used to distinguish it from DWBIS. DWCP was defined as the post-dialysis weight in which the patient had a clinically stable water state (no hypotension during dialysis or edema after dialysis).” Sounds very good, but what was done to ensure this condition in 1672 hemodialysis patients? 4) The authors state: “Additionally, by correcting these influential factors, we attempted to correct the difference between the DWBIS and the clinically appropriately adjusted DW to ultimately predict the correct DW.” A confusing sentence, but even I take it seriously, may I ask how this was done in a retrospective study? 5) The authors state: “A total of 1,672 patients were included in the study.” […] “The study was conducted […] between January 2010 and September 2015.” […] “There are some limitations to this study. First, the DW measurements using the BIS device were performed by a single person [36]” � The reference (REF 36) does not fit here. Can the authors please explain, using a patient flow chart, how exactly that one person was able to perform BIS in all 1,672 patients? Did one person measure 1-2 consecutive patients per day, thus between 300 and 600 a year? How did the authors deal with the effect of time? Did the dry weight protocol change from beginning to end of the retrospective study period? 6) The authors state that “in patients with a GapDW value of more than 2 kg, the proportion of women was high, the age was high, and there were many patients with diabetes (Table 1).” Related to my comment (1), I do not understand how the dry weight gap was defined. Was the clinical dry weight “off target” (too high, if BIS was considered the gold standard) in older women with diabetes? 7) The authors state that “There were 672 (40%) men.” This percentage is very low for a usual hemodialysis center, as the majority of dialysis patients worldwide are men, not women. Can the authors please report the country statistics for Korea, and how their center fits in within their country’s data? 8) The authors state: “It is obvious from this result that, when data with large GapDW are included and as GapDW increases, it is increasingly difficult to predict the target property (OHCP) as a BIS measurement property.” I have no clue what this sentence means. 9) The authors state: “Box plots were used to reveal the distributions of the BIS-based data and the clinical data according to the gap differences based on GapDW. In the box plots, the mean value of ECW showed a tendency to decrease as GapDW increased. Conversely, the overall distribution of hemoglobin, serum total protein, serum albumin, serum creatinine, phosphorus, and serum potassium had lower values as GapDW increased. The ECW value reflects overhydration. As GapDW increases, ECW tends to increase.” � Can the authors please clarify what they mean? In my understanding, the two sentences that I underlined (“In the box plots, the mean value of ECW showed a tendency to decrease as GapDW increased.” versus “As GapDW increases, ECW tends to increase.”) say exactly the opposite of one another. Overall judgement: Many of my points raised here above are so major that they unfortunately jeopardize the entire study itself. However, I see an even more fundamental problem with this analysis: If I understand correctly, the authors are using BIS dry weight data to predict clinical dry weight, and the machine learning algorithm is a fancy way of trying to relate one thing (BIS technology) with another (clinical dry weight assessment and management). In my opinion, this undertaking is unfortunately useless, clinically. Many studies from the early years of the BCM have shown that dialysis patients are “not on target”, meaning the clinical dry weight differs from the BIS-derived dry weight. The fact that it is difficult to perform clinical dry weight management is the very reason that BIS is informative, on top of clinical judgement, in the first place. A machine learning algorithm should not be used to identify factors that predict the clinical dry weight, deviating from the BIS-derived dry weight. Instead, the authors can take the classical approach: establish a hypothesis regarding the factors that they feel are important (malnutrition, BMI, sex/gender, malnutrition, inflammation, frailty) and check whether these factors differ between patients who are “on” or “off” the BIS-derived dry weight target. Unfortunately, this analysis will not be new. But in my opinion, the novel machine learning algorithm presented here causes more confusion than it helps the clinician. Minor: 10) The authors state: “ECW, ICW, and TBW were calculated using a fluid model [23].” The BCM result is actually obtained that way, but this sentence sounds as if the authors had done the calculation by themselves. References 1. Henderson LW: Symptomatic hypotension during hemodialysis. Kidney Int 1980;17:571-576 2. Agarwal R, Weir MR: Dry-weight: a concept revisited in an effort to avoid medication-directed approaches for blood pressure control in hemodialysis patients. Clin J Am Soc Nephrol 2010;5:1255-1260 ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No Reviewer #3: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
A novel approach to dry weight adjustments for dialysis patients using machine learning PONE-D-20-40081R1 Dear Dr. Choi, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Bhagwan Dass, MD Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-20-40081R1 A novel approach to dry weight adjustments for dialysis patients using machine learning Dear Dr. Choi: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Bhagwan Dass Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .