Peer Review History
| Original SubmissionFebruary 12, 2024 |
|---|
|
PONE-D-23-44051Impact of COVID-19 on Emergency Medical Services Utilization and Severity in the U.S. Upper MidwestPLOS ONE Dear Dr. Boggust, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by May 17 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jobst Augustin, Associate Professor/Senior lecturer Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information. If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information. 3. Thank you for stating the following financial disclosure: "This effort was funded by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) of the National Institute of Health (NIH) National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) grant number R03DK127010." Please state what role the funders took in the study. If the funders had no role, please state: ""The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."" If this statement is not correct you must amend it as needed. Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf. 4. We note that your Data Availability Statement is currently as follows: All relevant data are within the manuscript and its Supporting Information files. Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition). For example, authors should submit the following data: - The values behind the means, standard deviations and other measures reported; - The values used to build graphs; - The points extracted from images for analysis. Authors do not need to submit their entire data set if only a portion of the data was used in the reported study. If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories. If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access. 5. Please include your full ethics statement in the ‘Methods’ section of your manuscript file. In your statement, please include the full name of the IRB or ethics committee who approved or waived your study, as well as whether or not you obtained informed written or verbal consent. If consent was waived for your study, please include this information in your statement as well. 6. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information. Additional Editor Comments: The manuscript deals with an important and current topic with interesting results. However, the manuscript needs to be substantially revised before it can be accepted. Please read the reviewers' comments carefully and implement them accordingly. Another point: the maps (Figure 2) show absolute values. Absolute values should only be used in choropleth maps in justified exceptional cases. Accordingly, relative values (e.g. per 1000 inhabitants) should normally be used. Please check this again. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: I Don't Know Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Reviewer #1: The authors provide valuable insights into the first phase of the COVID-19 pandemic by analyzing 911 calls made to Mayo Clinic ambulance services. They use appropriate descriptive methods to describe utilization in 2020 and to compare it to previous years and the modeled number of expected calls in 2020. They find that utilization declines, especially during the first months when the pandemic hits the US (March-June). The sub-analysis of calls due to motor vehicle collisions follows this underlying trend, whereas calls because of overdose/intoxication increase, and results for the category “behavioral” are mixed. Declines were more pronounced in urban areas. There is also an increased use of lights and sirens, as well as an increase in calls with transport and with death prior to arrival, however, these differences are rather small. The manuscript is well-written and it is easy to follow the structure. The authors followed the STROBE reporting guidelines. However, there are a few concerns that I believe should be addressed. This applies in particular to the analysis and presentation in the tables as well as the graphical representation and the definition of the "pandemic period.” My detailed comments are as follows: Major Issues Line 113: Please clarify what “14 locations” refers to. Are these distinct geographic areas or communities? Or hospitals as the main destination of transport? Can you indicate how many other operators cover the same area as Mayo Clinic Ambulance? This would make it easier to set this into context for readers that are not familiar with the US ambulance system. I am no statistical expert, so perhaps I am not correctly assessing the authors' approach to the analysis. However, I'm confused about why, when comparing distributions, there are multiple Chi-Square test p-values reported for variables that have more than two categories and add up to 100%. This is seen in Table 1 for “patient age” and Table 2 for “call outcome.” This is not the case for categories “Gender” and “Rurality” in Table 1, where the authors only report one p-value. I know that by convention, a p-value higher than 0.05 is often used to determine “significance” (i.e., statistical significance). However, classifying results as “significant” or not based on a p-value cutoff is arbitrary, and results might still be inconclusive (for further explanation see e.g.: Cochrane Handbook for Systematic Reviews of Interventions. Chapter 15: Interpreting results and drawing conclusions. 15.3.2 P values and statistical significance). Many of the observed “statistically significant” differences are also quite small (e.g., in Table 1: 93.99% vs 94.96% (p>0.001) transport vs no transport Q1). Therefore, I recommend not using this wording and removing the sentence. Can the authors also explain why Bonferroni correction is necessary? I am also not sure whether Bonferroni correction was actually applied, as Footnote 4 of Table 2 says that “p-values are as reported”, and that the results were only compared to Bonferroni corrected values. Which p-value is reported, and what were the results of the comparison? In line 156, the authors describe that missing values are presented as a separate category (unknown). Does that mean that, in Table 2, there was only one variable (Location of call) with missing values (0.17% pre-COVID, 0.29% post-COVID), and all other variables did not? Footnote 3 of Table 2: Does the sentence “was not taken into consideration” imply complete case analysis? Could the authors please specify? Why did the authors choose to display calls from 2019-2020 only? Data are available from 2015. Displaying these data would be helpful to further separate random variations in the number of calls from variation caused by COVID. If this is because the presentation of all years would take up too much space, I suggest basing the “comparison” not only on 2019 but on the average of previous years, as was done in the tables (pre-COVID). In line 189, the authors describe percentage changes (6.8% / 0.05%) and refer to Figure 1. However, I am unable to derive percentage changes from the figure. I recommend reporting the absolute number that can be derived from the graph and adding the percentage change in brackets. I think it is useful to compare the actual number of calls to the projected number of calls. However, the model used to project call volume is very simple and likely does not represent reality (e.g., does not take into consideration seasonality, demographics, events, etc.). I suggest mentioning in the limitations that the model is also only a guess of what the actual number of calls would have been without COVID. In Figure 1, labels for the left and right axes are missing. The legend is difficult to understand. Please specify the axes and the variable names. The result for the variable “yearmon” seems to be a straight line on the x-axis. This is probably a mistake, which also shifts the label of axis ticks on the x-axis and makes it hard to understand which data point belongs to which month. In general, it is hard to evaluate the graphs as long as important information about interpretation (axes labeling) is missing and axis ticks of the left and right axes are not aligned. Labels of the left and right axes also need to be added to Figure 3, as well as the legend of the first part of Figure 3. I agree with the conclusion that the severity of calls, based on the use of lights and sirens and calls with fatal outcomes, increased. However, the difference is quite small and this is already observed in Q1 (see Table 2), where the upcoming pandemic likely did not impact people's decisions to call an ambulance. This should be mentioned early in the discussion. In general, defining the year 2020 as the “COVID-19 Period” might be misleading. Even though the pandemic began in late 2019, it can be assumed that it still had little impact on people in the USA in the first quarter of 2020. To avoid any misunderstanding, I suggest changing the column header of Table 1 to “2015-2019” or “pre-2020” and “2020”, as is the case in Table 2. I would also recommend rephrasing this wording in the abstract and the rest of the manuscript, wherever the authors refer to results that are derived from data of the whole year of 2020. Alternatively, the analyses could be adjusted so that the pandemic period only covers Q2-Q4. I would appreciate it if the authors added a short paragraph where they describe the differences between the different pandemic stages in 2020 in a bit more detail. There are notable differences between different quarters and months of the year. Line 270: How do the authors explain that others found lower rates of transport (e.g., Lane et al (DOI: https://doi.org/10.9778/cmajo.20200313, Dicker et al: https://doi.org/10.1136/bmjopen-2020-044726, Hegenberg et al doi: 10.1186/s13049-019-0607-5) whereas the amount of transported patients was increasing in their study? Is this explained by different EMS systems? Minor issues: • Abstract: please specify which region the figure (1 million lives) refers to. • Line 85: this sentence might be there due to a longer submission process, yet I would say that, gladly, the COVID-19 pandemic is over. It is still important to learn from these events, please adapt the sentence. • Line 130: There is a word missing (of) after “combination.” • Table 2: When reporting “Need for CPR”: for better readability, I would suggest formatting this variable so that it can be quickly recognized that rural vs urban is a stratification. The same applies to the variable “reason for call.” • Line 324: the historic comparison is not exactly the same as adjustment. If there are changes in population numbers, the population is not the same. I assume that this is not the case to a large extent, however, this should be added to the limitations. • The data availability statement says that all data are available without restriction. I am not sure whether the respective method of retrieving these data (repository etc.) needs to be included. • The resolution of the map could be better; it is a bit difficult to read. This will probably be changed during the publication process. Reviewer #2: This manuscript compares EMS call volumes in the five years prior to the COVID-19 pandemic (2015-1019) with the year of the pandemic (2020). In addition to the number of calls, the demographics, type and severity of the emergency call are compared and an urban-rural comparison is made. Overall, a decrease in the number of calls was observed, although the severity increased. During the pandemic, older people and people in rural areas were more likely to call 911. The manuscript is well written overall, but there are still a few details to get a better understanding of the methodology and interpretation. It is not clear to me where the expected values for 2020 have been used. Do they only refer to the figures? I also wondered, if the data is available on a monthly basis, why 2020 is summarized as the "pandemic year" and not the actual start of the pandemic. For the comparisons, 95% confidence intervals would be useful instead of the many p-values or additionally. The p-value depends on the number of cases, which is very large here. Confidence intervals therefore make sense in order to better capture the differences. The figures as a whole should be revised again. I have the following questions and comments: - Fig. 1: A more detailed description of the figures would help to better understand the graph. Is it possible that the x-axis has slipped? A better labeling would also be useful here, it seems as if the variable names have not been adjusted (e.g.: yearmon) - Fig. 2: The legend describes that the 2018 population is mapped. However, the number of calls can be seen here. What is meant by "Population data are mapped by ZIP code"? How were the 5 years of the Prior-2020 period summarized? - Fig. 3: Labeling of the upper graph is missing - l. 174: The goodness of fit parameters belong in the results section rather than the methods section - l. 186-188: The monthly average number over the entire period is considered and a rate of change is determined from this, but here the average monthly rate before the pandemic should be compared with the year during the pandemic. - l. 163 How were the 5 years combined? - I. 165 "number of calls" - this cannot be the absolute number of the 5 years, is it an averaged value? - l. 178: Were the expected values used from here on or the observed values? - l. 194 and Table 1: Why was age used here as a continuous variable and then age groups were compared again in Table 1? Have the p-values been adjusted for age? Overall, too much was tested here. Especially for Table 1, 95% confidence intervals would be useful. - Table 2: Are these observed or expected values? Strictly speaking, Q1 2020 also belongs to the "pre-2020" period. Significant differences can also be observed here. Can this therefore indicate a difference at all that relates to the pandemic? Here, too, 95% confidence intervals would be helpful. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-23-44051R1Impact of COVID-19 on Emergency Medical Services Utilization and Severity in the U.S. Upper MidwestPLOS ONE Dear Dr. McCoy, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please revise the figures as they are at least partially confusing. This applies in particular to figures 2 and 5. Solid lines can also be shown in combination with dashed lines. Also make sure that the colours are clearly distinguishable in the printed format and that readers with colour vision problems (e.g. red/green) can read the figure. Please submit your revised manuscript by Sep 27 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Jobst Augustin, Associate Professor/Senior lecturer Academic Editor PLOS ONE Journal Requirements: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Impact of COVID-19 on Emergency Medical Services Utilization and Severity in the U.S. Upper Midwest PONE-D-23-44051R2 Dear Dr. McCoy, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Jobst Augustin, Associate Professor/Senior lecturer Academic Editor PLOS ONE |
| Formally Accepted |
|
PONE-D-23-44051R2 PLOS ONE Dear Dr. McCoy, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Jobst Augustin Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .