Peer Review History

Original SubmissionJuly 3, 2020
Decision Letter - Christophe Leroyer, Editor

PONE-D-20-19557

A cluster feasibility trial to explore the uptake and use of e-cigarettes versus usual care offered to smokers attending homeless centres in Great Britain

PLOS ONE

Dear Dr. Dawkins,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process and you will find below.

Please submit your revised manuscript by October first. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Christophe Leroyer

Academic Editor

PLOS ONE

Journal requirements;

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for inncluding your competing interests statement;"I have read the journal's policy and the authors of this manuscript have the following competing interests:

PH received research funding from and provided consultancy to manufacturers of stop-smoking medications.

LD has provided consultancy for the pharmaceutical industry relating to the development of smoking cessation products.

SC, LB, AF, DR, SP, CB, AT, JL, IU, SP have no competing interests."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

Please know it is PLOS ONE policy for corresponding authors to declare, on behalf of all authors, all potential competing interests for the purposes of transparency. PLOS defines a competing interest as anything that interferes with, or could reasonably be perceived as interfering with, the full and objective presentation, peer review, editorial decision-making, or publication of research or non-research articles submitted to one of the journals. Competing interests can be financial or non-financial, professional, or personal. Competing interests can arise in relationship to an organization or another person. Please follow this link to our website for more details on competing interests: http://journals.plos.org/plosone/s/competing-interests

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: PONE-D-20-19557

Review of the paper A cluster feasibility trial to explore the uptake and use of e-cigarettes versus usual care offered to smokers attending homeless centers in UK

Global assessment

The proposed article is quite long and presents only a prospective limited randomized by cluster feasibility study which does not in itself allow definitive conclusions. On the principle it is the publisher's choice whether or not to accept this type of publication.

But this publication if of interest. This randomized trial concern:

1- tobacco dependence, the leading cause of preventable death. Tobacco related disease and mortality particularly affects vulnerable populations.

2- place of e-cigarette use for tobacco cessation is the object of strong discussions because of the lack of good data’s.

3- an innovative approach in precarious homeless people to quitting smoking through e-cigarettes is welcome

4- numerous very practical point for the conception of a large randomized trial are assessed in this paper.

This important article opens a door to the evaluation of e-cigarettes for nicotine replacement smoked in poor people who are heavy smokers and opens the door to improving health and reducing inequalities. The paper does not provide a definitive result but offers interesting results to launch a large essay that may provide the answer. This article provides an unprecedented series of information to understand the place of e-cigarettes for smokers in great social precariousness.

This paper is informative and clear and criticism are mainly of detail.

In detail

Length of introduction

The introduction (as the paper) is long and could be shortened.

Randomization page 8

The randomization process and result is not clear and had to be clarified.

It is clear that the randomization concern center and that all smokers in a same center received the same treatment.

• It seem that day centers and 24 h centers are associated in the random process.

• It appear than a center was changed after randomization.

• It appear than the smokers of a center had information of the result of the randomization in the center before inclusion.

• It seem than a center was designed to offer e-cigarette because of the proximity of the study center

I understand that the treatment was allocated by center, but the mode of distribution of treatment by center was not clearly identified (this is not a severe problem for a pilot study and lesson of this trial could be useful for a full size trial), but there is a need to better explain with coherence the allocation of treatment.

Page 9 recruitment of patients

It would be interesting to clarify what is said to smokers? Is the agreement for a smoking cessation need to be included? Is smoking reduction and option?

Is it clear to the patient that the trial is randomized?

Page 11 baseline(and follow-up) measure

The number of questionnaires included in the protocol addressed to homeless subjects is very high. Did the subjects complete the questionnaires on their own, were they completed with the help of a caregiver or by a signatory

NHS Treatement

Please precise what is an NHS treatment (Patch + oral nicotine) varenicline ?

Page 17 number of subjects in each arm

is there such a difference in the number of subjects in each arm (1/3 more subjects in the e-cigarette group than in the usual treatment group)?

Table 5 right column 1 to 6

I do not understand that in the right column we have frequencies at zero and percentages which are not zero for the first 6 lines. Please explain more or correct

Page 21 retention

I understand than at Week 4 only 25% of patients had reach SSS (no information on treatment) then in the EC arm 75% or 95% of patients use e-cigarette. But there is no or few data of the nicotine received daily in the two groups. Such information on daily dose and duration of nicotine received is important to assess in a complete trial the efficacy of treatment.

Page 29 cost of intervention

The duration of the visits seems short. The questionnaire completion time is often long in these homeless patients. 5 to 8 minutes for the follow-up visits seems very short, if not impossible, if this time includes the time for completing the questionnaire. If it is the health professional's time indicated: please specify the nature of these times

The cost needs to obtain one smoking cessation could be pertinent to be calculated in e-cig group. Not in UC group because no a single success.

Reviewer #2: Important note: This review pertains only to ‘statistical aspects’ of the study and so ‘clinical aspects’ [like medical importance, relevance of the study, ‘clinical significance and implication(s)’ of the whole study, etc.] are to be evaluated [should be assessed] separately/independently. Further please note that any ‘statistical review’ is generally done under the assumption that (such) study specific methodological [as well as execution] issues are perfectly taken care of by the investigator(s). This review is not an exception to that and so does not cover clinical aspects {however, seldom comments are made only if those issues are intimately / scientifically related & intermingle with ‘statistical aspects’ of the study}. Agreed that ‘statistical methods’ are used as just tools here, however, they are vital part of methodology [and so should be given due importance].

COMMENTS: Since this is a ‘feasibility trial’, sample size is not a big issue anyway. However, the objectives (given later on page-6) are not limited to (feasibility) use of e-cigarettes but comparison with usual care [offered to smokers attending homeless centres in Great Britain] is included. On page 15 [in Sample size section] it is said that “As this is a feasibility study, a formal power calculation based on detecting evidence for efficacy was not conducted”.

Objective three is “3. Assess the potential efficacy of supplying free e-cigarette starter kits to determine the required sample size for a main trial”. Intra class correlation coefficient (ICC) found in this trial will help to estimate the required sample size for a possible future definitive cluster RCT is understandable [however, need to mention this clearly]. But (because further you also said so) ‘how can the aim of the feasibility study was to calculate the required sample size?’ (please correct the sentence there).

Just a clarification – you said in ‘Methods section of Abstract’ that: “In this feasibility cluster trial, four homeless centres in Great Britain were pragmatically allocated to either a Usual Care (UC) or E-Cigarette (EC) arm” means the allocation was ‘non-random’ (in simple words). Is not that so? [dictionary meaning of ‘pragmatically’ is practically or rationally (therefore, what you said is perfectly alright) but we often describe allocation in terms of ‘random/non-random’]. Therefore, it is desirable to describe/classify allocation procedure in those terms.

Please note [for most data in this article through-out] that though measures/tools used are appropriate, most of them yield data in [at the most] ‘ordinal’ level of measurement [and not in ratio level of measurement as the score two times higher does not indicate presence of that parameter/phenomenon as double (for example, a Visual Analogue Scales {VAS} score or say ‘depression’ score)]. Then application of suitable non-parametric test(s) is/are indicated/advisable [even if distribution may be ‘Gaussian’ (i.e. normal)]. Note also that:

For ‘ordinal’ categorical data [as usual Chi-square test which otherwise is very versatile, the ‘ordering’ in categories is not recognized (example: instead of taking VAS scores are groups as No, Mild, Moderate, Severe, even if you take group sequence as Moderate, No, Mild, Severe, Chi-square value will be same), one variation called ‘Chi-square trend’ test is oftentimes recommended but] most recommended is RIDIT analysis [Bross IDJ. ‘How to use RIDIT analysis’. Biometrics, 1958; 14:18-38. There are many recent references, but they are on application results. This is (an original, old classic and) gives details on ‘how to use’ the technique].

In {last paragraph of} ‘Data analysis’ section, since it is stated that “For assessment of the relationship between other variables and outcomes, cases with missing data were excluded from the analysis“ I would like to know ‘how many cases were available?’. I doubt if ‘what is reported in Table 2’ [table titled as: Unintended consequences of E-cigarette use at 4, 12 and 24 weeks] are ‘consequences of E-cigarette use’. Findings of Table 4 [table titled as: Mental health and substance use at baseline and each follow up time point for the e-cigarette (EC) and usual care (UC) arms] are not properly interpreted, in my opinion {and displaying figures for ‘total’ is relevant, I guess}.

Note that when reported ICC, it is desirable to give the interpretation of ‘intraclass correlation coefficient’s point estimate is 0.0157?’ [though this Fleiss-Cuzick method is little known]. Nevertheless, there are few appreciable points, for example, inclusion of ‘Main RCT sample size calculation’ and discussion on ‘limitations’ [page 35].

Reviewer #3: This preliminary work provides important indications for a larger study to explore the feasibility of supplying free EC starter kits, targeting a vulnerable population, particularly at risk of smoking but also difficult to study rigorously in a clinical trial.

The questions are relevant and treated from a pragmatic angle.

For example, in practice, certain material challenges will have to be anticipated as best as possible such as, for example, the breakage of E-cigarettes...

The relatively encouraging results give an indication of the strengths and weaknesses of future studies, in particular the high proportion of those lost to follow-up during the study.

More generally, we must welcome the interest of a pragmatic approach that does not make guilt or infantilize towards a precarious and sensitive population.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Pr Bertrand Dautzenberg

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Attachments
Attachment
Submitted filename: renamed_af8f6.docx
Revision 1

1. We have reviewed the PLOS ONE style templates and changed our manuscript style in accordance with these templates.

2. We have updated our competing interests statement to include the required additional statement and this is included in our cover letter.

Attachments
Attachment
Submitted filename: responses to reviewers.docx
Decision Letter - Christophe Leroyer, Editor

A cluster feasibility trial to explore the uptake and use of e-cigarettes versus usual care offered to smokers attending homeless centres in Great Britain

PONE-D-20-19557R1

Dear Dr. Dawkins,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Christophe Leroyer

Academic Editor

PLOS ONE

Formally Accepted
Acceptance Letter - Christophe Leroyer, Editor

PONE-D-20-19557R1

A cluster feasibility trial to explore the uptake and use of e-cigarettes versus usual care offered to smokers attending homeless centres in Great Britain

Dear Dr. Dawkins:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Christophe Leroyer

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .