Peer Review History

Original SubmissionJune 11, 2020
Decision Letter - Richard Turner, Editor

Dear Dr Rentsch,

Thank you for submitting your manuscript entitled "Covid-19 by Race and Ethnicity: A National Cohort Study of 6 Million United States Veterans" for consideration by PLOS Medicine.

Your manuscript has now been evaluated by the PLOS Medicine editorial staff and I am writing to let you know that we would like to send your submission out for external assessment.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Please re-submit your manuscript within two working days, i.e. by .

Login to Editorial Manager here: https://www.editorialmanager.com/pmedicine

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review.

Feel free to email us at plosmedicine@plos.org if you have any queries relating to your submission.

Kind regards,

Richard Turner, PhD

Senior editor, PLOS Medicine

rturner@plos.org

Revision 1
Decision Letter - Richard Turner, Editor

Dear Dr. Rentsch,

Thank you very much for submitting your manuscript "Covid-19 by Race and Ethnicity: A National Cohort Study of 6 Million United States Veterans" (PMEDICINE-D-20-02701R1) for consideration at PLOS Medicine.

Your paper was discussed among the editorial team and and sent to independent reviewers, including a statistical reviewer. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to invite you to submit a revised version that fully addresses the reviewers' and editors' comments. You will appreciate that we cannot make a decision about publication until we have seen the revised manuscript and your response, and we expect to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We hope to receive your revised manuscript by Aug 03 2020 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see http://journals.plos.org/plosmedicine/s/submission-guidelines#loc-methods.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

Please let me know if you have any questions. Otherwise, we look forward to receiving your revised manuscript soon.

Sincerely,

Richard Turner, PhD

Senior Editor, PLOS Medicine

rturner@plos.org

-----------------------------------------------------------

Requests from the editors:

In your data statement, please explain briefly the reasons for non-availability of study data, e.g., ethics criteria.

Please revisit your title, so that it is a better match with journal style. We suggest "Patterns of COVID-19 testing and mortality by race and ethnicity in United States veterans: a national cohort study".

Please add a new final sentence to the "methods and findings" subsection of your abstract, beginning "Study limitations include ...", or similar, and quoting 2-3 of the study's main limitations.

At line 72, please begin the sentence "In this study, we found that ..." or similar.

After the abstract, please add a new and accessible "author summary" section in non-identical prose. You may find it helpful to consult one or two recent research papers published in PLOS Medicine to get a sense of the preferred style.

Early in the methods section of your main text, please state whether the study had a protocol or prespecified analysis plan, and if so attach the document as a supplementary file (referred to in the text). Please highlight analyses that were not prespecified.

Please remove the "role of the funding source" statement from the main text. Funding and competing interest information will appear in the article metadata in the event of publication, via information provided in the submission form.

Where available, please add p values along with odds ratios and 95% CI.

Please avoid claims of "the first" or "largest", e.g., at line 251, and where these cannot be avoided add "to our knowledge" or similar.

Again, please remove information on data sharing, funding and competing interests from the end of the main text, as this belongs in the metadata.

We suggest using initial capitals for "white" and "black" throughout your text.

Please add full access details to items in your reference list where needed, e.g. to reference 30.

Where you cite preprints, such as reference 2, please add "[preprint]".

Please add a completed checklist for the most appropriate reporting guideline - which may be STROBE or RECORD - as a supplementary document, referred to early in your methods section. In the checklist, please refer to individual items by section (e.g., "Methods") and paragraph number rather than by page or line numbers, as the latter generally change in the event of publication,

Comments from the reviewers:

*** Reviewer #1:

"Covid-19 by Race and Ethnicity: A National Cohort Study of 6 Million United States Veterans" describes the results of a detailed multivariate analysis using data from the largest integrated healthcare system in the U.S., the Department of Veterans Affairs (VA). The primary conclusions were that minority (i.e. Black & Hispanic) individuals experienced an excess burden of Covid-19 infection, as indicated by significantly higher adjusted OR of testing positive for Covid-19, compared to whites.

As emphasized in the manuscript, a key strength of this study is the scale and completeness of the data used, which covers over 5.8 million individuals from a single healthcare system. The main statistical analysis applied on Covid-19 positive individuals (summarized in Table 3) also appears to be with relatively standard logistic regression models.

However, a major limitation would be the relatively small number of non-medical input variables available (age, race/ethnicity, sex, residence urban/rural). As such, it is not possible to quantify whether the difference in burden might be explained to some extent by socioeconomic factors, which seems not improbable (e.g. access to private testing). Nevertheless, the unprecedented scope of this study as regards the distribution of Covid-19 burden by race/ethnicity should make it an important addition to the literature, especially if the limitations pertaining to available factors are clearly acknowledged upfront.

Nevertheless, there remain some possible points for consideration:

1. The adjustments made for various confounders (e.g. comorbidities, stations) in the various statistical analyses as reported in Table 3/Table S2 are not fully described. The authors might consider releasing the code used, and/or detail the adjustment procedure in the supplementary material (particularly for the various individual comorbidities), although this is not expected to change the conclusions materially.

2. The tests per 1000 individuals metric (as seen in Line 161/Table 2) might be clarified. Does it refer to raw number of tests (i.e. an individual might have multiple tests applied, as mentioned in Line 128), or does it instead refer to the number of tested individuals per 1000 individuals? In either case, the prevalence of multiple tests per individual (also broken down by race/ethnicity if possible) might be briefly described.

3. From Lines 110/130, it appears that data may be available as to the location of testing (i.e. hospitalization); the authors might consider reporting distribution of broad location types (e.g. primary care, urgent care, emergency department, inpatient, from [8]) and as a possible confounder, if appropriate.

4. From Table 3, the number of cases/events decreases as additional confounders are considered. It is assumed that this is due to missing data for these additional confounders (as suggested for smoking/alcohol consumption in Line 156); the authors might consider explicitly stating this, if true.

5. From Table 3, The large difference in OR for Black individuals, between the Multivariable model and the Conditional OR model (2.73 vs. 1.96), might merit a brief comment on its possible significance.

*** Reviewer #2:

This paper is a strong analysis overall of a large and important dataset. I have a few specific questions that I think should be addressed before the paper is acceptable for publication. The inclusion of data on who did and did not get tested is of particular value, as most studies of this nature have focused only on positive test results.

1. The authors claim that the finding that there is no racial disparity in mortality among individuals in the VA system after adjustment for comorbidities is not supported by the data if the authors intend for it to be interpreted as a population-level finding. It may be true that these disparities are minimized in a population with access to quality care, but the discussion makes it appear as if these findings are generalizable to the total population, which they are not.

2. More information on regional or site-specific variation in these effects would strengthen the results. Because the pandemic is a non-stationary event, the different VA centers included may have been in different phases of pandemic response within the individual time-slices analyzed here. At the very least, presenting results regionally would allow the reader to see to what extent these results vary by location. Because the dataset is so large, there is no reason that the analysis cannot just be repeated on region-specific subsets of the data.

3. The 30-day mortality analyzed by the authors is essentially the same as estimating the case-fatality rate. Although 30-day mortality is a standard term/measure, the authors should at least explain the relationship of this metric to the CFR to ensure that the analysis is accessible to a wide audience.

*** Reviewer #3:

This study provides a simple but geographically expansive approach to evaluating underlying COVID-19 testing patterns and race/ethnic disparities. This is an important and convincing study overall, but I do have a number of comments and concerns:

Line 87—suggest providing an example of incidence disparities to motivate this prioritization statement

Line 135—please clarify if you looked at 30-day mortality from all-causes or from COVID-19 only. If the former, this requires additional clarification in terms of the leading causes of death and COVID-19 role. If the latter, how did you deal with competing risks? On what basis was 30 days chosen?

Line 148—please clarify how comorbidities of interest were selected (which evidence base). Also, were these all modeled individually? There are many covariates and these models risk overadjustment, particularly given that some (e.g. asthma) are only tenuously linked to more severe COVID-19 outcomes.

Line 220—there was not an 'increased likelihood' (a measure of probability) of testing positive, but instead increased odds. Please check manuscript throughout for similar errors.

Line 224—site of care is not properly defined previously

Lines 226-229—this is an erroneous interpretation and runs into Table 2 fallacy issues—the analytic hypothesis examines race and testing, and thus cannot inform a conclusion regarding gender and urban status in the multivariate analyses (descriptive interpretations only are appropriate). Displaying the adjustment variable parameter estimates (and interpreting them) is inappropriate because they may be confounded by additional variables that were not included. See e.g. https://pubmed.ncbi.nlm.nih.gov/23371353/?from_term=table+2+fallacy&from_pos=1

Lines 237-238: The sentence "There was some suggestion of an association between male sex (OR 1.44, 95% CI 0.75-2.76) or urban residence (OR 1.57, 95% CI 0.96-2.57) and 30-day mortality, but confidence intervals were wide" can be removed. There is no suggestion of an association given these wide confidence intervals. The results just as likely imply a lack of an association (especially for male sex) as they do an association.

Discussion section: The authors make no attempt at interpreting the change in trends of time for racial group testing results. Without additional clarification, it is unclear what these results might mean.

Policy implications: What about household-level interventions to contain spread, or interventions at the local/state level to enforce quarantine measures etc.?

***

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 2
Decision Letter - Richard Turner, Editor

Dear Dr. Rentsch,

Thank you very much for re-submitting your manuscript "Patterns of Covid-19 testing and mortality by race and ethnicity among United States Veterans: a national cohort study" (PMEDICINE-D-20-02701R2) for consideration at PLOS Medicine.

I have discussed the paper with editorial colleagues and it was also seen again by one reviewer. I am pleased to tell you that, provided the remaining editorial and production issues are dealt with, we expect to be able to accept the paper for publication in the journal.

The remaining issues that need to be addressed are listed at the end of this email. Any accompanying reviewer attachments can be seen via the link below. Please take these into account before resubmitting your manuscript:

[LINK]

Our publications team (plosmedicine@plos.org) will be in touch shortly about the production requirements for your paper, and the link and deadline for resubmission. DO NOT RESUBMIT BEFORE YOU'VE RECEIVED THE PRODUCTION REQUIREMENTS.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

In revising the manuscript for further consideration here, please ensure you address the specific points made by each reviewer and the editors. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments and the changes you have made in the manuscript. Please submit a clean version of the paper as the main article file. A version with changes marked must also be uploaded as a marked up manuscript file.

Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. If you haven't already, we ask that you provide a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract.

We hope to receive your revised manuscript within 1 week. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

We ask every co-author listed on the manuscript to fill in a contributing author statement. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

Please let me know if you have any questions. Otherwise, we look forward to receiving the revised manuscript soon.

Sincerely,

Richard Turner, PhD

Senior Editor, PLOS Medicine

rturner@plos.org

------------------------------------------------------------

Requests from Editors:

According to PLOS' data policy, https://journals.plos.org/plosmedicine/s/data-availability, we will need to ask you to include a non-author or institutional contact for readers interested in inquiring about access to study data.

Please substitute "nationwide" for "national" in the title and where this occurs elsewhere in the article.

Please make that "COVID-19" throughout the ms.

At line 76, we suggest amending the text to "... under-representation of women and a lack of detailed information on social determinants ...".

At line 91, please make that "... has yet investigated".

At line 318, do you mean "The absence of ethnic/racial disparity in mortality ..."? Alternatively, perhaps you wish to refer to the apparent disparity in unadjusted data, suggesting populations' differing age structures as a possible explanation for perceived disparities.

Where "p<0.0001" is quoted, in the abstract and elsewhere, please substitute exact p values or "p<0.001".

Please avoid "p<0.000", e.g., in table 3.

Please add "[preprint]" to reference 16.

Comments from Reviewers:

*** Reviewer #1:

We thank the authors for largely addressing the previously-raised concerns in the revised and expanded manuscript. In particular, additional details on the adjustments have been added to the text and in supplementary material (Table S2, which also explores the incremental effect of various confounders on OR), the tests per 1000 individuals metric has been clarified as testing rate, and no exclusions have now been implemented for Table 3.

***

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 3
Decision Letter - Richard Turner, Editor

Dear Dr. Rentsch,

On behalf of my colleagues and the academic editor, Dr. Jonathan Zelner, I am delighted to inform you that your manuscript entitled "Patterns of COVID-19 testing and mortality by race and ethnicity among United States Veterans: a nationwide cohort study" (PMEDICINE-D-20-02701R3) has been accepted for publication in PLOS Medicine.

PRODUCTION PROCESS

Before publication you will see the copyedited word document (in around 1-2 weeks from now) and a PDF galley proof shortly after that. The copyeditor will be in touch shortly before sending you the copyedited Word document. We will make some revisions at the copyediting stage to conform to our general style, and for clarification. When you receive this version you should check and revise it very carefully, including figures, tables, references, and supporting information, because corrections at the next stage (proofs) will be strictly limited to (1) errors in author names or affiliations, (2) errors of scientific fact that would cause misunderstandings to readers, and (3) printer's (introduced) errors.

If you are likely to be away when either this document or the proof is sent, please ensure we have contact information of a second person, as we will need you to respond quickly at each point.

PRESS

A selection of our articles each week are press released by the journal. You will be contacted nearer the time if we are press releasing your article in order to approve the content and check the contact information for journalists is correct. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact.

PROFILE INFORMATION

Now that your manuscript has been accepted, please log into EM and update your profile. Go to https://www.editorialmanager.com/pmedicine, log in, and click on the "Update My Information" link at the top of the page. Please update your user information to ensure an efficient production and billing process.

Thank you again for submitting the manuscript to PLOS Medicine. We look forward to publishing it.

Best wishes,

Richard Turner, PhD

Senior Editor

PLOS Medicine

plosmedicine.org

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .