Peer Review History

Original SubmissionAugust 3, 2022
Decision Letter - Callam Davidson, Editor

Dear Dr Barlow,

Thank you for submitting your manuscript entitled "US and EU Free Trade Agreements and implementation of policies to control tobacco, alcohol, and unhealthy food and drink: a quasi-experimental analysis" for consideration by PLOS Medicine.

Your manuscript has now been evaluated by the PLOS Medicine editorial staff and I am writing to let you know that we would like to send your submission out for external peer review.

However, before we can send your manuscript to reviewers, we need you to complete your submission by providing the metadata that is required for full assessment. To this end, please login to Editorial Manager where you will find the paper in the 'Submissions Needing Revisions' folder on your homepage. Please click 'Revise Submission' from the Action Links and complete all additional questions in the submission questionnaire.

Please re-submit your manuscript within two working days, i.e. by Aug 08 2022 11:59PM.

Login to Editorial Manager here: https://www.editorialmanager.com/pmedicine

Once your full submission is complete, your paper will undergo a series of checks in preparation for peer review. Once your manuscript has passed all checks it will be sent out for review.

Feel free to email us at plosmedicine@plos.org if you have any queries relating to your submission.

Kind regards,

Callam Davidson

Associate Editor

PLOS Medicine

Revision 1
Decision Letter - Callam Davidson, Editor

Dear Dr. Barlow,

Thank you very much for submitting your manuscript "US and EU Free Trade Agreements and implementation of policies to control tobacco, alcohol, and unhealthy food and drink: a quasi-experimental analysis" (PMEDICINE-D-22-02643R1) for consideration at PLOS Medicine.

Your paper was evaluated by an associate editor and discussed among all the editors here. It was also discussed with an academic editor with relevant expertise, and sent to independent reviewers, including a statistical reviewer. The reviews are appended at the bottom of this email and any accompanying reviewer attachments can be seen via the link below:

[LINK]

In light of these reviews, I am afraid that we will not be able to accept the manuscript for publication in the journal in its current form, but we would like to consider a revised version that addresses the reviewers' and editors' comments. Obviously we cannot make any decision about publication until we have seen the revised manuscript and your response, and we plan to seek re-review by one or more of the reviewers.

In revising the manuscript for further consideration, your revisions should address the specific points made by each reviewer and the editors. Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments, the changes you have made in the manuscript, and include either an excerpt of the revised text or the location (eg: page and line number) where each change can be found. Please submit a clean version of the paper as the main article file; a version with changes marked should be uploaded as a marked up manuscript.

In addition, we request that you upload any figures associated with your paper as individual TIF or EPS files with 300dpi resolution at resubmission; please read our figure guidelines for more information on our requirements: http://journals.plos.org/plosmedicine/s/figures. While revising your submission, please upload your figure files to the PACE digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at PLOSMedicine@plos.org.

We hope to receive your revised manuscript by Oct 19 2022 11:59PM. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

We ask every co-author listed on the manuscript to fill in a contributing author statement, making sure to declare all competing interests. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. If new competing interests are declared later in the revision process, this may also hold up the submission. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT. You can see our competing interests policy here: http://journals.plos.org/plosmedicine/s/competing-interests.

Please use the following link to submit the revised manuscript:

https://www.editorialmanager.com/pmedicine/

Your article can be found in the "Submissions Needing Revision" folder.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

We look forward to receiving your revised manuscript.

Sincerely,

Callam Davidson,

PLOS Medicine

plosmedicine.org

-----------------------------------------------------------

Comments from the Academic Editor:

My main comment was that out of 10 policies and 4 contexts (40 different tests), only 7 were significant in the direction that the paper focuses on (one significant in opposite direction, all others null). Whilst the authors note in the discussion that "a need to investigate why impacts may vary across regulatory domains and country-partners", I'd like to see a bit more evidence/theory-informed speculation here. Why might it be that FTAs impeded child food marketing restrictions, but not tobacco ad bans or alcohol ad and sales restrictions (ie why does the impact on essentially the same policies differ between commodity)? Similarly, why might FTAs impede smoke free places, but not tobacco ad bans/taxes (ie why do they impact on some but not all tobacco control efforts)? I suspect this is something to do with both how different commodities are 'valued' in society (ie tobacco universally considered 'bad', alcohol less so); and the co-effects of different policies (ie taxes are revenue raising, not JUST health promoting).

Requests from the editors:

Please structure your abstract using the PLOS Medicine headings (Background, Methods and Findings, Conclusions).

Please avoid assertions of primacy (“We conducted the first…”) in your Abstract Background. Instead, the final sentence should clearly state the study question.

Assertions of primacy are also present in the Discussion and should be tempered accordingly (e.g., “to our knowledge”, or similar).

In the Abstract Methods and Findings, please include the study design and main outcome measures.

In the last sentence of the Abstract Methods and Findings section, please describe the main limitation(s) of the study's methodology.

Please remove the Funding section from your Abstract.

Please include continuous line numbering throughout your manuscript to facilitate further review.

At this stage, we ask that you include a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract. Please see our author guidelines for more information: https://journals.plos.org/plosmedicine/s/revising-your-manuscript#loc-author-summary

Please place citations within square brackets and preceding punctuation (e.g., [1]). This also applies to your appendices.

Please organise and cite your appendices as outlined here: https://journals.plos.org/plosmedicine/s/supporting-information

The footnotes in Appendix 4 appear to be labelled incorrectly.

Please ensure that the study is reported according to the STROBE guideline, and include the completed STROBE checklist as Supporting Information. Please add the following statement, or similar, to the Methods: "This study is reported as per the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline (S1 Checklist)."

The STROBE guideline can be found here: http://www.equator-network.org/reporting-guidelines/strobe/

When completing the checklist, please use section and paragraph numbers, rather than page numbers.

Table 1: Please define Free Trade Agreement (FTA) in the legend.

Figure 4: Please define the 95% confidence interval bars in the legend.

Reference 26 (your protocol) is a preprint: please add [preprint] to the reference to identify it as such. Further details can be found here: https://journals.plos.org/plosmedicine/s/submission-guidelines#loc-references

Comments from the reviewers:

Reviewer #1: Thanks for the opportunity to review your manuscript. My role is as a statistical reviewer, so my review concentrates on the study design, data, and analysis that are presented. I have put general questions first, followed by queries relevant to a specific section of the manuscript (with a page/paragraph reference).

This manuscript examines whether participation in a free-trade agreement is associated with the implementation of policies that target tobacco/alcohol/unhealthy food and drinks. Data is at the country level from three time points (2014, 2016, 2019), policy implementation data comes from WHO country surveys (based on WHO recommended policies) and information on free trade agreements is from collaborative database. A range of additional covariates is available for secondary analysis of heterogeneity of the TIA effect. The WHO specific recommended policies includes tobacco and alcohol taxes and restrictions, graphic warnings on tobacco packing, legislation on breast-milk substitutes and policies that target sodium, sat and trans fats, and food marketing to children. In the main analyses, the outcomes are assessed as unimplemented or fully implemented (and with alternative coding considered in sensitivity analyses). The 'exposure' variable for the main analysis is binary (part of TIA/not part of TIA). In the main analysis a matching process (based on Manholobis distance of the matching variables) to limit confounding is used. Where balance wasn't achieved, the covariate was included in the main logistic regression model. The protocol is very detailed (and well explained), there are some deviations from this (detailed in app 5), these are quite reasonable and reflect changes required once features of the final dataset were apparent (e.g. not enough variation to get sufficient sub-groups for some secondary analyses). Limitations of the study design are well articulated in the discussion.

How is Mahalanobis distance calculated for differences in the region each country belongs to? I am more familiar with Mahalanobis distance calculated for continuous variables and I wasn't sure how it was done here.

With the Mahalanobis matching approach, is there a straightforward way to assess common support, i.e. that there is sufficient overlap between the FTA groups in the covariates or are the countries with FTAs fundamentally different from those without?

My usual area of expertise is far away from free-trade agreements - so the following question is probably more for my own understanding than any issue with the manuscript. Are the FTAs similar enough to be that we can represent them as a universal, binary covariate? I ask because it seems that mainstream media reporting around FTAs always seems to emphasise differences between FTAs (for my country at least the reporting is always that 'we were ripped off compared to country XX') and I am curious if perhaps FTAs are broadly similar and I have a distorted impression of reality.

P6, Paragraph 2. What criteria were used to decide between purely regression adjustment and matching (once it was clear first order models weren't appropriate)?

P7, Paragraph 3. This could be my reading of it but it seems like the part:

"FTAit is one of two FTA indicators in country i with coefficient B1: i) US FTA participation, or ii) EU FTA participation, lagged by 1 year (t-1) to allow for a delayed effect; we estimate separate models for US FTAs and EU FTAs."

is contradictory, if there is an indicator variable for EU or US participation woudn't that make the variable unvarying if separate models for US/EU are run?

With this model each country will contribute multiple 'rows' of data regression model, i.e. there are repeated measurements (of different times) of the same countries. Is this correlation accounted for by the block bootstrap procedure? Also - is this the 'simple' version of block/cluster bootstrapping where an entire block/country is selected in the sampling, or is this the more complex procedure where there is second level of sampling of years within the selected blocks?

Also to confirm, is country the 'block' for the block bootstrapping?

P19. Table 1. I would consider removing the p-values here, the rest of the table provides everything necessary to understand the differences.

Should the title of the table include "EU FTAs"?

Under the EU FTAs there is a typo - "differesnce" should be difference.

P18. What was the minimum number per category you considered to be appropriate allow for sufficient statistical power?

Reviewer #2: This is an excellent and informative paper. Well done. Before publishing there are some exceedingly minor changes to make:

p. 5 'first quant study' is a bold claim that needs nuance. A google search shows there have been lots of (non-peer reviewed?) 'studies', impact assessments and so forth in this space. Also next section suggests a few of these studies. Suggest paring back this claim or adding nuance.

Typo p. 10 'All results are consistent in sign for all models'. 'Significance?'

P. 12 'window of opportunity' is vague. What is the window and why has this come about?

Reviewer #3: This paper uses natural experiment methods to assess the association of US or EU Free Trade Agreement participation with the implementation of various health policies. The paper thoroughly assembles what data is available for countries as the unit of analysis, and uses a matching procedure to try and approximate an unconfounded comparison. Unfortunately, not many matched country-pairs make it through to the final analytical sample - a necessary cost of trying to remove confounding, and increase internal validity.

There are 48 'tests' of whether FTA participation effects health policies: 12 policies, by 4 combinations of EU/US FTA and Full or partial/Full classifications. Figure 4 shows these 48 'tests' as a forest plot, correctly portraying the mixed findings and lack of an overwhelming pattern. That said, there is a pattern - 9 of the 48 'tests' (19%) have 95% CI excluding the null AND a finding of worse health policy implementation if the country is a participant of a FTA, whereas only 1 'test' shows better health policy. Averaged across all 48 tests, the average percentage difference was -4.4%.

The study is clearly worthy of publication. And it will generate substantial discussion and debate - rightly so. This is the first paper to quantitatively test this hypothesis in a comprehensive manner - testing a hypothesis long suspected.

I have only a few recommendations for the authors in revision.

1. It is not clear on reading the abstract that 48 tests were run, than many were null, etc. An indication of the PATTERN of 19% of tests showing a statistically significant decreases, compared to only one (2%) an increase, would help. Moreover, as a more thorough sense of the whole pattern, giving the average effect (-4.4%) with a 95% CI would be useful (which may require some careful math to allow for correlations of the partial / partial or full classification).

2. Perhaps point out in the paper that pulling out the 9 'positive' tests for profiling is a bit risky. To many this falls foul of a statistical testing approach. Hence my suggestions above to give the average effect size. Or alternatively, the percentage of 'tests' with the effect size stronger than -20%, between --20% to -10%, etc - to convey a focus on magnitude of the associations.

3. The matching in Table 1 does not look as good as the text of the paper implies, or the absolute standardized means in Fig 3. For example, the absolute standardized mean differences in GDP in Fig 3 nicely moves almost to nil after matching - but not in Table 1. (Actually in Table 1, the differences in GDP remain, just flipped in sign.) Either I have misunderstood Table 1, or there is perhaps an error in the data in Table 1?

4. Box 2's title implies this is a WHO categorization - but it is actually the categorization used for analysis in this paper. Perhaps make this clearer.

Congratulations to the authors on an important paper.

Reviewer #4: This paper shines a light on an important issue and methodologically speaking, is executed superbly. The authors write in an accessible and clear way about a highly complex and technical public health issue. My one, very minor, comment is that the authors might consider including the UK-CPTPP deal as an important US led agreement under negotation ( bottom of pg. 4 )

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 2

Attachments
Attachment
Submitted filename: plos_med_rr_v2.docx
Decision Letter - Callam Davidson, Editor

Dear Dr. Barlow,

Thank you very much for re-submitting your manuscript "US and EU Free Trade Agreements and implementation of policies to control tobacco, alcohol, and unhealthy food and drink: a quasi-experimental analysis" (PMEDICINE-D-22-02643R2) for review by PLOS Medicine.

I have discussed the paper with my colleagues and the academic editor and it was also seen again by two reviewers. I am pleased to say that provided the remaining editorial and production issues are dealt with we are planning to accept the paper for publication in the journal.

The remaining issues that need to be addressed are listed at the end of this email. Any accompanying reviewer attachments can be seen via the link below. Please take these into account before resubmitting your manuscript:

[LINK]

***Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.***

In revising the manuscript for further consideration here, please ensure you address the specific points made by each reviewer and the editors. In your rebuttal letter you should indicate your response to the reviewers' and editors' comments and the changes you have made in the manuscript. Please submit a clean version of the paper as the main article file. A version with changes marked must also be uploaded as a marked up manuscript file.

Please also check the guidelines for revised papers at http://journals.plos.org/plosmedicine/s/revising-your-manuscript for any that apply to your paper. If you haven't already, we ask that you provide a short, non-technical Author Summary of your research to make findings accessible to a wide audience that includes both scientists and non-scientists. The Author Summary should immediately follow the Abstract in your revised manuscript. This text is subject to editorial change and should be distinct from the scientific abstract.

We hope to receive your revised manuscript within 1 week. Please email us (plosmedicine@plos.org) if you have any questions or concerns.

We ask every co-author listed on the manuscript to fill in a contributing author statement. If any of the co-authors have not filled in the statement, we will remind them to do so when the paper is revised. If all statements are not completed in a timely fashion this could hold up the re-review process. Should there be a problem getting one of your co-authors to fill in a statement we will be in contact. YOU MUST NOT ADD OR REMOVE AUTHORS UNLESS YOU HAVE ALERTED THE EDITOR HANDLING THE MANUSCRIPT TO THE CHANGE AND THEY SPECIFICALLY HAVE AGREED TO IT.

Please ensure that the paper adheres to the PLOS Data Availability Policy (see http://journals.plos.org/plosmedicine/s/data-availability), which requires that all data underlying the study's findings be provided in a repository or as Supporting Information. For data residing with a third party, authors are required to provide instructions with contact information for obtaining the data. PLOS journals do not allow statements supported by "data not shown" or "unpublished results." For such statements, authors must provide supporting data or cite public sources that include it.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript.

Please note, when your manuscript is accepted, an uncorrected proof of your manuscript will be published online ahead of the final version, unless you've already opted out via the online submission form. If, for any reason, you do not want an earlier version of your manuscript published online or are unsure if you have already indicated as such, please let the journal staff know immediately at plosmedicine@plos.org.

If you have any questions in the meantime, please contact me or the journal staff on plosmedicine@plos.org.  

We look forward to receiving the revised manuscript by Nov 11 2022 11:59PM.   

Sincerely,

Callam Davidson,

Associate Editor 

PLOS Medicine

plosmedicine.org

------------------------------------------------------------

Requests from Editors:

The URL in your Data Availability Statement leads to an error page - please correct or confirm this link will be made active upon publication.

Please update your Author Summary to use 2-3 single sentence bullet points per question (please see here for further guidelines: https://journals.plos.org/plosmedicine/s/revising-your-manuscript).

Please check the formatting of your References (including Supplementary) is consistent (e.g., list first six authors before use of et al.) and follows our guidelines (https://journals.plos.org/plosmedicine/s/submission-guidelines#loc-references).

Comments from Reviewers:

Reviewer #1: Thanks for the revised manuscript and responses to my review. The updates to the manuscript resolve all my original queries. A great piece of work.

Only one very small change - 'per-protocol' and 'protocol deviations' both have specific meaning to in clinical trials which are different to how they are used here. It might make S2 Appendix clearer to describe these as 'changes from pre-registered protocol' or 'according to pre-registered protocol'.

Reviewer #3: My comments have been satisfactorily addressed

Any attachments provided with reviews can be seen via the following link:

[LINK]

Revision 3
Decision Letter - Callam Davidson, Editor

Dear Dr Barlow, 

On behalf of my colleagues and the Academic Editor, Professor Jean Adams, I am pleased to inform you that we have agreed to publish your manuscript "US and EU Free Trade Agreements and implementation of policies to control tobacco, alcohol, and unhealthy food and drink: a quasi-experimental analysis" (PMEDICINE-D-22-02643R3) in PLOS Medicine.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. Please be aware that it may take several days for you to receive this email; during this time no action is required by you. Once you have received these formatting requests, please note that your manuscript will not be scheduled for publication until you have made the required changes.

In the meantime, please log into Editorial Manager at http://www.editorialmanager.com/pmedicine/, click the "Update My Information" link at the top of the page, and update your user information to ensure an efficient production process. 

PRESS

We frequently collaborate with press offices. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximise its impact. If the press office is planning to promote your findings, we would be grateful if they could coordinate with medicinepress@plos.org. If you have not yet opted out of the early version process, we ask that you notify us immediately of any press plans so that we may do so on your behalf.

We also ask that you take this opportunity to read our Embargo Policy regarding the discussion, promotion and media coverage of work that is yet to be published by PLOS. As your manuscript is not yet published, it is bound by the conditions of our Embargo Policy. Please be aware that this policy is in place both to ensure that any press coverage of your article is fully substantiated and to provide a direct link between such coverage and the published work. For full details of our Embargo Policy, please visit http://www.plos.org/about/media-inquiries/embargo-policy/.

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

Thank you again for submitting to PLOS Medicine. We look forward to publishing your paper. 

Sincerely, 

Callam Davidson 

Associate Editor 

PLOS Medicine

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .