Peer Review History
Original SubmissionSeptember 19, 2022 |
---|
Transfer Alert
This paper was transferred from another journal. As a result, its full editorial history (including decision letters, peer reviews and author responses) may not be present.
PONE-D-22-25993Evaluation of the introduction of a healthy food and drink policy in 13 community recreation centres on the healthiness and nutrient content of customer purchases and business outcomes an observational study.PLOS ONE Dear Dr. Naughton, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. The authors are advised to carefully address each of the reviewers' concerns and recommendations in a revised version of the manuscript and response to reviewers, with particular attention paid to the requested details regarding the data, methods, and policies, and with care regarding causal inference. Additionally, more detail regarding the statistical modelling would be of benefit in a revised version. Please submit your revised manuscript by Mar 18 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Blake Byron Walker, Ph.D. Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf 2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information. If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information. 3. During the internal evaluation of the study, we have noted that the ethics approval number suggests that ethics approval for the study was obtained in 2016. As such of the data used for retrospective analysis was obtained in 2018, it is in our understanding that ethics approval should be obtained following this period. Please could you clarify whether the IRB approved for use of data prospective to the date of approval. 4. Thank you for stating in your Funding Statement: “This research was in part funded (to AP) by the National Health and Medical Research Council (NHMRC) as a Centre of Research Excellence in Food Retail Environments for Health (RE-FRESH) (APP1152968)https://www.nhmrc.gov.au” Please provide an amended statement that declares *all* the funding or sources of support (whether external or internal to your organization) received during this study, as detailed online in our guide for authors at http://journals.plos.org/plosone/s/submit-now. Please also include the statement “There was no additional external funding received for this study.” in your updated Funding Statement. Please include your amended Funding Statement within your cover letter. We will change the online submission form on your behalf. 5. Thank you for stating the following in the Competing Interests section: “SN, HR, AP, LO, and TBR are researchers within the NHMRC-funded Centre of Research Excellence in Food Retail Environments for Health (RE-FRESH) (APP1152968). SN is funded, and HR part funded, by RE-FRESH. AP is funded through an NHMRC Investigator Grant (APP1194630). AJ is funded through a Cotutelle Doctoral Studentship from Deakin University and Coventry University. TBR is funded through a Deakin University Postdoctoral Fellowship. All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: Anna Peeters receives funding from the NHMRC and is a board member of both Obesity Australia and the Victorian Health Promotion Foundation. Alexandra Chung receives funding from the Medical Research Future Fund Preventive Health Research Initiative (1199826). Liliana Orellana has receiving consulting fees from Western Health and the World Health Organisation- Fiji through payments made to Deakin University. Alethea Jerebine was an employee of YMCA Victoria 2014-2021. Shaan Naughton, Helena Romaniuk, and Tara Boelsen-Robinson report no other funding; All authors disclose no other relationships or activities that could appear to have influenced the submitted work.” Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: ""This does not alter our adherence to PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests). If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared. Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf. 6. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability. Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized. Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access. We will update your Data Availability statement to reflect the information you provide in your cover letter. 7. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. In your revised cover letter, please address the following prompts: a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. We will update your Data Availability statement on your behalf to reflect the information you provide. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: No Reviewer #2: Yes Reviewer #3: Partly Reviewer #4: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: No Reviewer #2: Yes Reviewer #3: Yes Reviewer #4: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: No Reviewer #3: Yes Reviewer #4: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes Reviewer #4: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: I appreciate the opportunity to review this article. The study compares sales of a three period public policy. The analysis needs to build a counterfactual to compare actual and expected sales. There are many possible alternatives to build this counterfactuals (depending on the data availability), such as, demand systems, time series models, panel data models. Another possibility, it is to have recreational community center without policy intervention (I am not sure whether it is is possible). Also, estimation needs to have robustness checks. Finally, the background and discussion sections needs to show the prolific evidence on food labelling (particularly, front of packaging). I do believe that the topic is interesting, however, the analysis needs to be taken further. Regards Reviewer #2: I hope the following fairly minor thoughts are helpful: Line 168 why not just say something like expressed as a “percentage difference” Line 169 add x100%. And why not say the “difference” rather than “absolute mean difference” https://en.wikipedia.org/wiki/Absolute_difference Such alterations would need to also be made in other places. Line 232 delete “a reduction of” Line 235 95% CI does not include 37.1% Line 231 6 superscript should be [6]? Line 393 “healthiness” not health I wonder if Fig S2 should be in the main manuscript. I wonder if Figures 1-3 should instead be supplementary, and a table with the overall results added to the main manuscript. (Table S1 could become part of this table.) Describing outcome levels pre-implementation in the main manuscript (perhaps in a table) could help the reader appreciate the importance of changes of X.XX without having to look at suppl material. This comment is most relevant for: energy density, %vol sugar. Perhaps also for total fat, sat fat and sodium values. use the word implementation consistently, not intervention nor initiative inter-rater reliability was 93% … does this mean kappa =0.93? meta-analysis better done with ratios rather than percent differences* … this might make a little difference to Figure 1a, I would expect -3.2 to get smaller *unless use Tim Cole’s definition of a “symmetric percentage difference” (Stat Med 2000) in which case the two are equivalent. This paper might lead you to natural log-transform sales before then following your analysis approach. how were SEs found for percent differences for an outcome for a centre? Using pre and post means and SEs somehow… percent differences for total food and drink sales can be rounded to nearest integer Reviewer #3: This paper studies how the introduction of a food labelling policy at 13 recreation centres in Victoria, Australia was associated with the sales of foods at these centres. The findings point to a shift to healthier food purchases over the study period. The study represents original research and therefore fits well within the scope of the journal. I have some concerns and suggestions which I detail in the comments below. Comments 1. Causal identification The key shortcoming of the study is that there is no credible control group for the policy intervention: basically, food sales before the implementation are compared to food sales after the implementation. For this difference to be interpretable as causal, any secular trends need to be absent. It is possible that there are general trends away from unhealthy foods and towards more healthful foods, and so food sales in 2018 can be different from those in 2013 for a variety of reasons unrelated to the specific food policy the paper considers. For instance, the timing of the food policy in the paper largely coincides with other government food initiatives aimed at increasing the healthfulness of food, such as the roll-out of the Health Star Rating in supermarkets, which had an effect on the composition of the foods (e.g, Bablani et al. 2020, PLOS Medicine, 17(11): e1003427) and the purchases of consumers (e.g., Bablani et al. 2022, BMJ Nutrition, Prevention & Health, 5(2): 227–234). Therefore, changes in food sales in recreation centres might have been partly influenced by changes in patron’s preferences/diets over this period that were due to other policies such as the Health Star Rating, or simply because of other trends in the demands for foods over the study period. I have two suggestions in this regard: 1) The paper should discuss some of these other broader food policies happening concurrently in Australia, such as the mentioned Health Star Rating, as they represent a salient potential confounding mechanism. 2) The paper needs to either (i) rewrite all text parts that make causal claims to reflect that the estimates represent associations rather than causal effects or (ii) find an alternative empirical strategy that makes it possible to control for common trends. Clearly, option (ii) is significantly more involved than option (i). A possibility for option (ii) might be to exploit the fact that centres differed in the timing of the adoption of the policy, as mentioned in the text and quite strikingly visible in figures S2. This setting fits a staggered differences-in-differences approach, where centres which are not (yet) treated can serve as control observations for centres which are already treated. 2. Policy description The policy is described in the Introduction and in the subsection “Study Design And Policy Description”. I was not clear on how the classification “red/amber/green” was displayed (e.g., on the products themselves or on the menus?). I also did not understand if during the “phased implementation” which allowed “stock of ‘red’ items to be sold, rather than immediately removed from sale” (p.4) the red/amber/green classification was displayed. 3. Analysis It would make the analysis easier to understand if the paper could include an equation for the linear models estimated to obtain the centre-level estimates and an equation to show the random effects meta-analysis. The latter would be particularly helpful as the term ‘random effects’ is used slightly differently in different disciplines, so a more precise mathematical statement would open the article to a broader readership. It would also make any statistical assumptions behind the aggregation of the centre-level results more readily assessable. It was not clear to me why the linear models included calendar months as a control variable. Perhaps I am missing something, but calendar months are not correlated with the key variables of interest (the three study periods) since each study period contains all calendar months by design. Finally, the modelling approach for some outcomes requires the estimation of predicted means in levels and then the subsequent transformation of these absolute means (in levels) into relative means (in percentages). Conducting statistical inference on such ratios of estimated quantities is not entirely trivial, as their distribution is not normal. An alternative approach which the paper should conduct as a sensitivity analysis is to specify the outcome variable in logarithms. In that way, the estimated coefficients of the linear model directly have the (approximate) desired percentage-change interpretation and inference is standard as it is based on a single estimated coefficient. Reviewer #4: This manuscript is a generally well-written report of a study that analyses 6 years of sales data comparing before and after a policy to reduce unhealthy food and drink availability in recreation centres was implemented. The study is interesting and is a useful addition to the literature. However, I do have some comments that I hope will help to improve the manuscript. • Is this policy aiming to address childhood obesity? The introduction gives statistics on childhood obesity but not adults. If the policy is not specifically targeted, could you add some information on adults too? • Does your analysis take secular trends into account? E.g. Were there price increases over the 6-year study period? Could this account for food sales not changing? Were sales expected to increase over the study period? In which case, no change in sales could be seen as a decrease in sales compared to what was expected. • As I was reading the Methods, I was wondering if the included centres were typical of YMCA centres. I would include information on included centres (lines 201-205; lines 208-211) earlier on, in the Methods. • You noted that 1012 products were sold over 6 years. I would be interested to know if the amount of choice varied across centres. • What is monthly attendance? The number of people visiting each month? • What did you define as ‘no’, ‘limited’ and ‘full’ food preparation facilities? • Could you clarify why 2017-18 is considered post-intervention? Did centres reverse the policy? Or did it take 2016-17 for all centres to fully implement the policy? • Why is time lag of 3 assumed and not tested? • Why were 13 months of data excluded? And how did you decide that 5 other months of data were invalid? • Were products classified with brand-specific nutrient information? It looks like it might not have been, and some products vary hugely in their composition. • The diamond markers in your figures may be too big, as some centres end up not having 95% CIs visible and some values not crossing 0 look like they do (e.g. centre 11 in Fig 2a). • It would be good to know how much this policy changed the foods and drinks that were available. What was the baseline offering in terms of % red, green and amber? What was it post-intervention? Did centres comply with the policy? • Were any other initiatives (either at these centres or in Victoria in general) considered to have potentially impacted sales over the 4 years after the policy was implemented? ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: Mark D Chatfield Reviewer #3: No Reviewer #4: Yes: Amy Yau ********** [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
Revision 1 |
Evaluation of the introduction of a healthy food and drink policy in 13 community recreation centres on the healthiness and nutrient content of customer purchases and business outcomes: an observational study. PONE-D-22-25993R1 Dear Dr. Naughton, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Blake Byron Walker, Ph.D. Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #2: All comments have been addressed Reviewer #3: All comments have been addressed Reviewer #4: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #2: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #2: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #2: (No Response) Reviewer #3: Yes Reviewer #4: No ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #2: (No Response) Reviewer #3: Yes Reviewer #4: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #2: (No Response) Reviewer #3: (No Response) Reviewer #4: I thank the authors for thoroughly addressing my comments. I have no further comments and recommend this manuscript for publication. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #2: No Reviewer #3: No Reviewer #4: No ********** |
Formally Accepted |
PONE-D-22-25993R1 Evaluation of the introduction of a healthy food and drink policy in 13 community recreation centres on the healthiness and nutrient content of customer purchases and business outcomes: an observational study. Dear Dr. Naughton: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Prof. Dr. Blake Byron Walker Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .