Peer Review History
| Original SubmissionJanuary 22, 2025 |
|---|
|
Dear Dr. Berke, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Jul 04 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Zhifeng Gao Academic Editor PLOS ONE Journal Requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information . [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? Reviewer #1: Yes Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: No Reviewer #2: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: Yes Reviewer #2: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: The paper examines the impact of online shopping platforms on consumers’ purchasing behavior and how this impact was influenced by the COVID-19 pandemic. It leverages a unique crowdsourced Amazon purchase dataset, which includes detailed information on consumers’ purchasing activities and demographic characteristics. Overall, I find the paper to be well written and the topic is interesting. However, I have several concerns regarding the empirical strategies employed in the study, which I outline below: 1. In Equation (3), you estimate the impact of the COVID-19 pandemic on the number of purchase days. I am curious about the rationale behind focusing solely on purchase days. Have you considered exploring other outcome variables such as the number of distinct products purchased or average spending? It would be helpful to know whether the pandemic had similar effects on these measures. 2. Also in Equation (3), have you considered controlling for geographic variation by including consumers’ state of residence in the regression? Online purchasing behavior could vary significantly across states due to differing policies, infrastructure, or local conditions during the pandemic. 3. In Equation (4), you analyze the relationship between consumer demographics and purchase frequency. The empirical strategy appears to rely on the assumption that “the 2018 and 2022 results are meant to be comparable” (line 205). Could you provide justification to support this assumption? 4. In the analysis of the relationship between online purchases and offline retail employment prior to the pandemic, you restricted the sample to states with at least 50 users making online purchases. What is the rationale for this cutoff? Could this restriction potentially bias the results by overestimating the impact of online purchases on offline retail employment? 5. In the same analysis, you estimate the relationship by calculating the correlation coefficient between online purchases and the change in employment within a sector, measured as (employees in 2019 – employees in 2018) / employees in 2018. However, employment changes could be driven by other factors, such as population shifts or dynamics in other sectors. Have you considered using a regression-based approach that controls for these potential confounding factors? 6. In analyzing the impact of online grocery purchases on in-store shopping during COVID-19, the analysis focuses only on the top three states with the highest average monthly number of Amazon users (CA, TX, and NY). I am concerned about the external validity of these results. States in the Midwest or other regions may have very different food environments and demographic characteristics, which could lead to different online and offline grocery shopping dynamics. Reviewer #2: General Comments: Thank you for the opportunity to review this paper titled “Evaluating Amazon effects and the limited impact of COVID-19 with purchases crowdsourced from US consumers”. This paper presents a large amount of information on changes in consumer shopping behavior during the COVID-19 pandemic using crowdsourced Amazon data. While the dataset and research topic are unique and compelling, the manuscript currently lacks a coherent narrative, making it difficult to follow the presentation of findings. The introduction should clearly set the direction of the study. However, as currently written, the discussion of research gaps and contributions is scattered across several paragraphs (e.g., the first, fourth, and fifth). A more structured approach is recommended—such as beginning with general background, clearly stating key research gaps, and explaining how this study addresses those gaps. Currently, the literature review, gap identification, and contribution statements are mixed together throughout the section, making it hard for readers to form a clear understanding of the study's purpose. Additionally, the authors should include a statement of the overall study objective, followed by specific objectives. In the Materials and Methods and Results sections, the authors should focus on a few core research questions rather than trying to cover all analyses. Key findings should be presented in the main manuscript—currently, some are placed in the Supplementary Information (SI), making it difficult for the reader to find the results. The use of numbered subsections could improve clarity, especially since multiple aspects of consumer behavior are being examined. Also, methodological reporting is inconsistent; some sections include model specifications and corresponding results, while others do not. These should be harmonized for clarity. Finally, the Results section should discuss the findings in more detail, especially explaining the magnitude of effects, not only directional effects. Specific comments: Materials and Methods User demographics: For Table S2, please clarify which Census data (year and dataset) was used. Preprocessing and panel data: It’s unclear whether users were required to have made purchases in both 2018 and 2022. Does the panel require continuous activity, or are gaps (e.g., months with zero spending) allowed? Event study evaluating trends in purchasing behavior and the impact of COVID-19 Equation 1 should be accompanied by a results table—not just a figure—to help interpret the results. Table S11, the results include an intercept term, but it's unclear whether individual fixed effects were applied. Equation 3 has a_i (fixed effects for each user), but this isn't reflected in the results. Please clarify. When interpreting postCOVID variable, in addition to directionality, please interpret the magnitude of the coefficient. For example, what does a coefficient of 0.5578 imply in practical terms? Analyzing relationships between consumer demographics and purchasing Why not use Equation 1 instead of a separate model for this analysis? Also, since multiple behavioral outcomes are analyzed for the same individual, Seemingly Unrelated Regressions (SUR) would be more appropriate to account for correlated errors. Analyzing online purchases versus retail employment prior to COVID The use of both (a), (b) and (1), (2) for itemizing points is confusing, especially since references are numbered as well. Consider using one consistent formatting style. What is the meaning of correlation coefficients? Please explain their interpretation. Results If the magnitude of coefficients is being discussed in the text, the corresponding tables should be in the main manuscript rather than in the SI. Indicate which model or equation each result refers to for clarity. Provide more detailed interpretation of coefficients. Many results describe only the direction (positive or negative) without addressing effect size. The sentence “On average, 1 additional purchase day corresponds to approximately 2 additional products purchased each month” is a strong example of clear interpretation. Similar explanations should be included throughout the results section. Overall, the results section needs better organization. Consider streamlining it according to the study’s main objectives to improve clarity and readability. ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Dear Dr. Berke, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by Nov 29 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols . We look forward to receiving your revised manuscript. Kind regards, Zhifeng Gao Academic Editor PLOS ONE Journal Requirements: If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author Reviewer #1: All comments have been addressed Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions??> Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? -->?> Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available??> The PLOS Data policy Reviewer #1: Yes Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English??> Reviewer #1: Yes Reviewer #2: Yes ********** Reviewer #1: Thank you for addressing my previous comments. I only have a few minor editing suggestions: 1. The abstract is somewhat lengthy. Please consider condensing it to improve readability. 2. In Table 1, please revise the footnote to read: “Standard errors are reported in parentheses. ***, **, and * indicate statistical significance at the 1%, 5%, and 10% levels, respectively.” Reviewer #2: (No Response) ********** what does this mean? ). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy Reviewer #1: No Reviewer #2: No ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org |
| Revision 2 |
|
Evaluating Amazon effects and the limited impact of COVID-19 with purchases crowdsourced from US consumers PONE-D-25-03722R2 Dear Dr. Berke, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. I noticed that some of the equations are not displayed appropriately in the PDF file, please make sure you correct the problem in your final submission. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. For questions related to billing, please contact billing support . If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Zhifeng Gao Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-25-03722R2 PLOS ONE Dear Dr. Berke, I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team. At this stage, our production department will prepare your paper for publication. This includes ensuring the following: * All references, tables, and figures are properly cited * All relevant supporting information is included in the manuscript submission, * There are no issues that prevent the paper from being properly typeset You will receive further instructions from the production team, including instructions on how to review your proof when it is ready. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few days to review your paper and let you know the next and final steps. Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. You will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. If we can help with anything else, please email us at customercare@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Zhifeng Gao Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .