Peer Review History

Original SubmissionFebruary 11, 2021
Decision Letter - Rajendra Bhimma, Editor

PONE-D-21-04747

Population-based identification and temporal trend of children with primary nephrotic syndrome: The Kaiser Permanente Nephrotic Syndrome Study

PLOS ONE

Dear Dr. Alan S Go

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by 12 April 2021. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Rajendra Bhimma, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In the ethics statement in the manuscript and in the online submission form, please provide additional information about the patient records/samples used in your retrospective study, including: a) whether all data were fully anonymized before you accessed them; b) the date range (month and year) during which patients' medical records/samples were accessed.

3. Thank you for stating the following in the Competing Interests section:

"I have read the journal's policy and the authors of this manuscript have the following disclosures: ASG declares funding from the Brin Wojcicki Foundation. GMC declares grants from NIDDK, and Amgen, and fees from Ardelyx, AstraZeneca, Baxter, Cricket, DiaMedica, Gilead, Reata, Sanifit, Vertex, Satellite Healthcare, Angion, Bayer, ReCor and other disclosures from CloudCath, Durect, and Outset. All other authors have nothing to disclose."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

Additional Editor Comments:

See comments by reviewers

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The authors estimate and characterize the population incidence of pediatric primary NS in a large, integrated healthcare delivery system through structured review of available data within electronic health records (EHR) and associated health system data sources. They conclude that this population-based identification of children with primary NS leveraging electronic health records can provide a unique approach and platform for describing the natural history of NS and identifying determinants of outcomes in children with primary NS.

The study is interesting, however, there are some concerns.

Concerns:

1) The supporting literature for the definition of NS in this study should be clearly stated in the text.

2) The indications for renal biopsy in NS in the population in this study should be presented. The indications for renal biopsy may have a significant impact on the data presented in this study.

3) Many pediatric NS patients have MCD, and a significant proportion of these patients do not have renal biopsy. According to the method used by the authors in this study, it should be possible to identify patients with NS who have not undergone renal biopsy. In pediatric patients, the population without renal biopsy is also important and should be included in the analysis.

4) In pediatric NS, the term "idiopathic" is often used. The authors use the term "primary" instead of "idiopathic". This is correct if the disease is confirmed as "primary" by renal biopsy.

On the other hand, the rate of renal biopsy among 179 primary NS is shown to be 40.2%. This statement is strange. How can they distinguish between MCD, FSGS, and MN when no renal biopsy was performed? Does this mean that re-biopsy data was collected in some cases? The authors should clearly explain this point and improve the manuscript to avoid misleading the readers. There is a significant problem with this database if they are diagnosing FSGS and MN without performing renal biopsy.

5) There were 67 cases (37.4%) with missing data for renal function. A total of 67 cases (37.4%) with missing data for renal function is a serious limitation of this study. Why is this the case? Do many attending physicians not measure renal function in NS patients? The same is fact for serum albumin. The authors mention that we additionally performed targeted manual chart review by board-certified nephrologists for evidence of a clinical presentation consistent with NS which enhanced our specificity and reduced misclassification compared with reliance only on administrative diagnosis codes. Also, the authors described that all primary NS cases were manually confirmed through targeted manual medical records review by nephrologists, which is considered the gold standard for retrospective case identification and also demonstrated the suboptimal performance of diagnosis codes alone to identify children with NS. If so, I would guess that kidney function and serum albumin could be easily checked. The high incidence of missing data for renal function and serum albumin in NS studies is fatal. Appropriate improvements in the manuscript are desirable. If this is not possible, then the data extraction itself may be inappropriate, and the credibility of the data presented may be affected.

6) The numbering of the figures is wrong. They do not match the text.

7) In Table 2, the number of kidney biopsies performed is not correct. MCD (30), FSGS (36), and MN (6) add up to only 72, while the total is 74.

Reviewer #2: The authors describe Population-based identification and temporal trend of children with primary nephrotic

syndrome:

1. The study was funded by Brin Wojcicki, so why say ‘Grant Not Applicable’. Please give url of Funder

2. Line 308: What is the percentage of insured versus uninsured population?

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachments
Attachment
Submitted filename: Review PLOS ONE.docx
Revision 1

Please see uploaded Response to Reviewers document

Attachments
Attachment
Submitted filename: Parikh_Pediatric_NS_PLOS_Response_09Apr2021.docx
Decision Letter - Rajendra Bhimma, Editor

PONE-D-21-04747R1

Population-based identification and temporal trend of children with primary nephrotic syndrome: The Kaiser Permanente Nephrotic Syndrome Study

PLOS ONE

Dear Dr. Alan S. Go

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please see comments by the reviewers that need to be addressed. 

Please submit your revised manuscript by 31 July 2021. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Rajendra Bhimma, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (if provided):

Please see comments from reviewers

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #3: All comments have been addressed

Reviewer #4: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #3: This is an interesting and well thought out manuscript that uses the electronic health record to assess the incidence of nephrotic syndrome in pediatric patients in a well characterized and excellent health care system.

The following are some suggestions that might improve the manuscript

1. The number of patients is unclear. Table 1 is a bit confusing and it is unclear whether the number of patients is 365 or 179. I think a CONSORT diagram documenting the steps to reach the analytic sample would be helpful

2. The definition of nephrotic syndrome is more appropriate for adults and not pediatric patients where the proteinuria threshold is >2 mg/mg creatinine

3. The impact of race is not clearly presented.

4. The authors might comment on the minor change in the incidence of nephrotic syndrome over time

5. The authors might want to compare their findings to those in adults published in AJKD that was based on the same health care system.

Reviewer #4: To be accepted for publication in PLOS ONE, research articles must satisfy the following criteria:

1. The study presents the results of original research.

Nephrotic syndrome (NS) is a clinical diagnosis with proteinuria, hypoalbuminemia and odema. Although primary NS is relatively uncommon, it accounts for mortality and considerable morbidity in young children. The prognosis of NS in children correlates with the spectrum of responsiveness to steroid therapy, from steroid-sensitive NS (SSNS) to steroid-resistant NS (SRNS). SRNS is the most common acquired cause of end-stage renal disease (ESRD) in children.

Kaiser Permanente (KP) in the Northern California region, provides an integrated healthcare delivery system caring for >750,000 children. Primary NS in the region is relatively uncommon, and no prior population-based research in the region has been carried out to study the incidence of primary NS in children. The incidence being unknown, both based on the clinical patterns and ethnic distribution despite the data being available in the EMRs and laboratory databases of the KP systems.

The aim of this study was to estimate the incidence of primary NS in the region based on a retrospective laboratory and EMR data with a multicenter collaboration within the KP systems.

Such data would help in improving population-level quality of care and thereby clinical outcomes. Additionally, would contribute to the development and implementation of system-wide efforts to improve complex delivery care systems for the illness. This research data despite its limitations of being retrospective and only 40% of the children having a renal biopsy, will facilitate infrastructure and processes that support the ability to accelerate large-scale change internally, as well as externally through successful multi-institutional collaborations within the Kaiser Permanente as seen in the paper. In conclusion the study does present results of original research work done in the region of northern California cared for by the Kaiser Permanente integrated healthcare delivery system and agree with the authors that the study can provide a unique approach and platform for describing the natural history of NS and identifying determinants of outcomes in children with primary NS.

2. Results reported have not been published elsewhere.

The results reported have not been published elsewhere as far as my search for the same has revealed. This data although retrospective does provide a comphrensive input into the incidence of pediatric nephrotic syndrome in the region split by clinical presentation and ethnic breakup.

3. Experiments, statistics, and other analyses are performed to a high technical standard and are described in sufficient detail.

The analysis is preformed to the needed technical standard and done in sufficent detail for the data that is available. All data are made fully available without restriction and the authors have made available a file of the minimal de-identified data set necessary to replicate the analyses in this manuscript.

4. Conclusions are presented in an appropriate fashion and are supported by the data.

The data is retrospective and collected from the EMRs as well as laboratory databases, from across the KP organization. There could be changes in the etiology and the racial presentation presented, since only 40% have biopsy data and there is no long-term follow-up reported after the initial diagnosis. Especially, that in 60% of the patients the diagnosis was entirely clinical and not supported with renal histology. Although ethnic differences in clinical presentations are shown, it would have been useful to have follow-up data on outcomes among these children with nephrotic syndrome which are unknown. Despite the higher incidence of NS among ethnics, outcomes may be significantly less complicated when compared between various clinical presentations. Within the above limitations the presentation is appropriately supported.

5. The article is presented in an intelligible fashion and is written in standard English.

Yes, the article is presented in an intelligible fashion and written in standard English with no flaws observed within the article.

6. The research meets all applicable standards for the ethics of experimentation and research integrity.

The research does meet with all the applicable standards for the ethics of experimentation and research integrity. The study was approved by the KPNC institutional review board, and waiver of informed consent was obtained due to the nature of this retrospective data-only study, with the use of de-identified data sets as reported.

The authors have also made the relevant disclosures which do not conflict with the results of the study: ASG declares funding from the Brin Wojcicki Foundation. GMC declares grants from NIDDK, and Amgen, and fees from Ardelyx, AstraZeneca, Baxter, Cricket, DiaMedica, Gilead, Reata, Sanifit, Vertex, Satellite Healthcare, Angion, Bayer, ReCor and other disclosures from CloudCath, Durect, and Outset. All other authors have nothing to disclose.

7. The article adheres to appropriate reporting guidelines and community standards for data availability.

The manuscript does provide a clear and complete account of the research done. The reporting does clearly allow editors, peer reviewers and readers to understand what was done and how. The data can be clearly understood by a reader, replicated by a researcher, and used to make a clinical decision and included in a systematic reveiw with its limitations.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #3: Yes: Howard Trachtman

Reviewer #4: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

We thank the Editors and Reviewers for providing comments on the manuscript, and have provided a point-by-point response to comments in the attached file.

Attachments
Attachment
Submitted filename: Parikh_Pediatric_NS_PLOS_Response_23Jun2021.docx
Decision Letter - Rajendra Bhimma, Editor

Population-based identification and temporal trend of children with primary nephrotic syndrome: The Kaiser Permanente Nephrotic Syndrome Study

PONE-D-21-04747R2

Dear Dr. Alan S. Go

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Rajendra Bhimma, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Dear Dr Go

Thank you for your submission. I apologies for the delay but now that i have received the reviewers comments, I am happy to forward this to to the Editor in Chief for a final decision on the manuscript.

Reviewers' comments:

Formally Accepted
Acceptance Letter - Rajendra Bhimma, Editor

PONE-D-21-04747R2

Population-based identification and temporal trend of children with primary nephrotic syndrome: The Kaiser Permanente Nephrotic Syndrome Study

Dear Dr. Go:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Rajendra Bhimma

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .