Peer Review History

Original SubmissionOctober 31, 2023
Decision Letter - Henri Tilga, Editor

PONE-D-23-22195Fostering active choice to empower behavioral change to reduce cardiovascular risk: a web-based randomized controlled trialPLOS ONE

Dear Dr. Timmermans,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 29 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Henri Tilga, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that funding information should not appear in any section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript.

3. We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match. 

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

4. Thank you for stating the following financial disclosure: 

   "Funded by Amsterdam University Medical Center" 

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript." 

If this statement is not correct you must amend it as needed. 

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

5. In the online submission form, you indicated that "The dataset used and analyzed during the current study is available from the corresponding author on reasonable request. Additional file 1 presents the code used for the statistical analyses."

All PLOS journals now require all data underlying the findings described in their manuscript to be freely available to other researchers, either 1. In a public repository, 2. Within the manuscript itself, or 3. Uploaded as supplementary information.

This policy applies to all data except where public deposition would breach compliance with the protocol approved by your research ethics board. If your data cannot be made publicly available for ethical or legal reasons (e.g., public availability would compromise patient privacy), please explain your reasons on resubmission and your exemption request will be escalated for approval. 

6. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files

Additional Editor Comments:

The Reviewer has provided several useful comments to increase the quality of this manuscript. Please carefully follow all the comments made by the Reviewer and revise the manuscript accordingly.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: PLOS One Review Comments to Author:

The paper presents the results of an experiment conducted with an online panel to examine the impact of active versus passive choice in decisions about cardiovascular disease prevention. The authors present a detailed background for the study and have strong theoretical grounding for the intervention and outcomes. The active choice intervention used a heart age risk presentation that had been previously shown to heighten risk perception. The findings point to the superiority of the active choice intervention over the passive choice condition. The paper is well written, yet there are a few areas that may benefit from clarification, mainly around the outcome measures and the results.

1. The primary outcome measure ‘active choice scale’ appears to be developed de novo for the study, as such, a bit more information about the development process would be helpful.

a. Please add more description regarding the constructs or components included, theoretical framework, and development process (e.g. cognitive testing of items, any validity testing/psychometric evaluation of the scale in addition to the Cronback alpha that is reported).

b. The authors report that they incorporated 5-items from an existing, well validated scale (Decisional Conflict Scale), why not just use that as its own measure as it has established benchmarks and strong psychometrics? Please comment on rationale for using subset of the Decisional Conflict Scale rather than the actual scale itself.

c. On a quick scan, the authors appear to have used active choice measures in other studies, e.g. Landais, L.L., Damman, O.C., Jelsma, J.G.M. et al. Promoting an active choice among physically inactive adults: a randomised web-based four-arm experiment. Int J Behav Nutr Phys Act 19, 49 (2022). https://doi.org/10.1186/s12966-022-01288-y . How is the 11-item measure used in this study similar to/different than the active choice measure employed in that study? Again, generally more information on this scale and development would be important to include as it is the primary outcome.

2. In Table 1, for all scales (e.g. active choice, knowledge, commitment) please provide the potential range for the total scores and then provide mean/SD/range for all of the outcomes measured.

3. Please clarify rationale for why self-efficacy and intention strength were measured with two items, yet only the highest score was used (which would seem to then exacerbate ceiling effects).

4. For commitment, two of three items were used to create a composite score. Again, the rationale is not clear as to why this was done, and why this was handled differently than self-efficacy and intention. Please provide rationale for the scoring of these and any psychometrics that are available for these items.

5. Study power – please comment on how the magnitude of active choice difference to power the study was selected and what that represents (is that clinically meaningful?) to help readers who are unfamiliar with this scale. It would also be helpful to report what that corresponds to in terms of standard deviation for the scale (e.g. 0.5 SD).

6. Table 3 – for cognitive risk perception, active choice and commitment, the differences appear quite small (though given comment #2, it is hard to know what the range of scores are for the variables). Are these differences meaningful?

7. After reading this a few times, it is still unclear how the ORs for the intentions variable are being calculated—is it within the arm or comparing across arms? While there does seem to be difference between arms in intention to pursue lifestyle changes (60% vs 67%), it is unclear how that translates to OR 2.86.

8. Discussion would benefit from reflection on the active choice measure (and possibly noting lack of validity or evidence of psychometric properties in the limitations).

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

We added the data file as a supplementary file.

We added funding information

Response to reviewer:

Point-by-point response to the reviewer

PONE-D-23-22195

We thank the editor and reviewer for carefully considering our manuscript. The comments and valuable suggestions of the reviewer helped us improve the manuscript. Below, we provide a point-by-point response to the comments.

Reviewer:

“The paper presents the results of an experiment conducted with an online panel to examine the impact of active versus passive choice in decisions about cardiovascular disease prevention. The authors present a detailed background for the study and have strong theoretical grounding for the intervention and outcomes. The active choice intervention used a heart age risk presentation that had been previously shown to heighten risk perception. The findings point to the superiority of the active choice intervention over the passive choice condition. The paper is well written, yet a few areas may benefit from clarification, mainly around the outcome measures and the results.”

1. The primary outcome measure ‘active choice scale’ appears to be developed de novo for the study, as such, a bit more information about the development process would be helpful.

a. Please add more description regarding the constructs or components included, theoretical framework, and development process (e.g. cognitive testing of items, any validity testing/psychometric evaluation of the scale in addition to the Cronback alpha that is reported).

Response: We agree with the reviewer that this requires further explanation. We developed the active choice scale to measure the degree of active choice. We did evaluate the suitability of existing instruments beforehand, including the Multi-dimensional measure of informed choice (Michie et al., 2002), However, it was discussed with the research team that these instruments were not sufficiently suitable for measuring the degree of active choice. Some questions from the Decisional Conflict Scale (specifically the 'Informed subscale' and 'Values clarity subscale') were deemed suitable for the active choice scale.

As there is no measure for active choice, we first defined the concept based on relevant literature (see introduction). We used this definition to develop our measure, as a solid theoretical foundation is essential for these kind of measures (see De Vet et al 2011). This scale was largely comparable to an active choice scale that we developed for a previous study (62). In accordance with the previous study, the first items of our active choice scale were adapted from the 'Informed subscale' and 'Values clarity subscale' of the validated Decisional Conflict Scale (63). The other subscales of the Decisional Conflict Scale were not included as they measured different constructs. Based on that study, the scale yields a reasonably normal data distribution. In the current study, we pre-tested the intervention and the questionnaire before data collection. One of the researchers (LL) used the 'think-aloud method': six adults went through the intervention and the questionnaire while reading everything aloud and verbalizing their thoughts aloud. This pre-test made some adjustments to the active choice scale, including clarifying the wording of some items. Our current active choice scale differs from the previous active choice scale regarding the wording of items: we adjusted the items to the current decision situation. Moreover, we added two items to the current scale to measure the extent to which participants had considered the consequences of (1) adopting a healthy lifestyle and (2) using medication for their risk of cardiovascular disease. Our active choice scale showed good internal consistency (α = 0.83).

b. The authors report that they incorporated 5-items from an existing, well validated scale (Decisional Conflict Scale), why not just use that as its own measure as it has established benchmarks and strong psychometrics? Please comment on rationale for using subset of the Decisional Conflict Scale rather than the actual scale itself.

Response: We did not include the questions from the subscales 'support', 'uncertainty', and 'effective decision' of the Decisional Conflict Scale because they did not align with our construct of 'active choice'. We based our measure on a solid theoretical definition of active choice. The DCS is not a measure of active choice.

c. On a quick scan, the authors appear to have used active choice measures in other studies, e.g. Landais, L.L., Damman, O.C., Jelsma, J.G.M. et al. Promoting an active choice among physically inactive adults: a randomised web-based four-arm experiment. Int J Behav Nutr Phys Act 19, 49 (2022). https://doi.org/10.1186/s12966-022-01288-y . How is the 11-item measure used in this study similar to/different than the active choice measure employed in that study? Again, generally more information on this scale and development would be important to include as it is the primary outcome.

Response: The active choice scale in our current study is comparable to the active choice scale used in our previous study. However, we adjusted the wording for the new decision situation since our current study was no longer about 'increasing physical activity' versus 'not increasing physical activity' but about adopting a healthier lifestyle or 'using medication'. Our previous active choice scale consisted of 9 items. To the current active choice scale, we added 2 items to measure the extent to which participants had considered the consequences of (1) adopting a healthy lifestyle and (2) using medication for their risk of cardiovascular disease.

Based on comments 1a-c, we made the following changes to the manuscript:

Lines 207-209: Before data collection, the questionnaire was also pre-tested among the six adults before data collection. Based on the pre-test, we made several adaptations to the questionnaires to increase comprehensibility.

Lines 227-243: To measure these outcomes, we used self-constructed items. These items were thoroughly evaluated with participants during the pretest and subsequently adjusted based on their experiences and feedback. The reported degree of active choice was measured using 11 self-constructed items (5-point scale). As there is no measure for active choice, we first defined the concept based on relevant literature (see introduction). We used this definition to develop our measure, as a solid theoretical foundation is essential for these kind of measures (see 62). This scale was largely comparable to an active choice scale that we developed for a previous study (63). In accordance with the previous study, the first items of our active choice scale were adapted from the 'Informed subscale' and 'Values clarity subscale' of the validated Decisional Conflict Scale (64). The other subscales of the Decisional Conflict Scale were not included as they measured different constructs. Based on that study, the scale yields a reasonably normal data distribution. In the current study, we pre-tested the intervention and the questionnaire before data collection. One of the researchers (LL) used the 'think-aloud method': six adults went through the intervention and the questionnaire while reading everything aloud and verbalizing their thoughts aloud. This pre-test made some adjustments to the active choice scale, including clarifying the wording of some items. Our current active choice scale differs from the previous active choice scale regarding the wording of items: we adjusted the items to the current decision situation. Moreover, we added two items to the current scale to measure the extent to which participants had considered the consequences of (1) adopting a healthy lifestyle and (2) using medication for their risk of cardiovascular disease. Our active choice scale showed good internal consistency (α = 0.83).

2. In Table 1, for all scales (e.g. active choice, knowledge, commitment) please provide the potential range for the total scores and then provide mean/SD/range for all of the outcomes measured.

Response: We followed the reviewer's suggestion by adding this information to Table 1.

3. Please clarify rationale for why self-efficacy and intention strength were measured with two items, yet only the highest score was used (which would seem to then exacerbate ceiling effects).

Response: Initially, we planned to take the average of both scores on the items. However, we discovered this was not a logical starting point during the pre-test. For instance, if someone has a strong intention to make lifestyle changes (e.g., score 9) but a much weaker intention to use medication (e.g., score 2), then based on the average of those responses, one might wrongly conclude that the person does not have a strong intention to change behaviour. In contrast, they do, but only for one of the behaviours. Since we were interested in the choice option participants were most inclined to pursue, we only considered the highest score in the analyses of these variables. We explained this in the manuscript as follows.

Lines 224-225: This was done because we were interested in participants' confidence regarding the choice option they were most inclined to pursue.

Lines 249-250: In the analyses, we used the highest scores on these items since we were interested in the intention strength and commitment regarding the choice option participants were most inclined to pursue.

4. For commitment, two of three items were used to create a composite score. Again, the rationale is not clear as to why this was done, and why this was handled differently than self-efficacy and intention. Please provide rationale for the scoring of these and any psychometrics that are available for these items.

Response: We acknowledge that this was unclear. For commitment, we asked one question about the willingness to invest time, effort and energy into the chosen behaviour. In addition, we asked two questions about maintaining health behaviour: one about lifestyle and one about medication. For these last two questions, we again used the highest score (due to the reason above). Because we also had that first question about commitment, we calculated a composite score of this construct by taking the average of that first question and the highest score on those last two questions. Besides Cronbach's alpha value, we do not have any other psychometric information about this construct to report. In the manuscript, we added.

Lines 247-252: Concerning commitment to adopt risk-reducing behaviour, two items measured individuals’ commitment to maintaining behavioural changes on a 10-point scale: one about lifestyle change and one about medication use. In the analyses, we used the highest scores on these items since we were interested in the intention, strength and commitment regarding the choice option participants were most inclined to pursue. For commitment, a composite score was calculated by averaging the highest score on the two aforementioned items with the score on an additional item about the willingness to invest time, effort and energy into the chosen behaviour.

5. Study power – please comment on how the magnitude of active choice difference to power the study was selected and what that represents (is that clinically meaningful?) to help readers who are unfamiliar with this scale. It would also be helpful to report what that corresponds to in terms of standard deviation for the scale (e.g. 0.5 SD).

Response: We assumed an alpha of .05, a power of .80. We assumed a delta of 0.145 for active choice (because this lies exactly between 0.13 and 0.16; these were the significant differences found in an earlier study). We powered on active choice (based on only one group of the previous study: the control group) and then calculated the difference we can demonstrate with that calculated sample size on the measures intention strength and commitment. Since we found effect modification on several variables in the earlier study, e.g. intention strength and commitment, we powered by gender; that allows stratified analyzes for gender.

We added this information to the text:

Lines 276-277: “Since a previous study using an active choice intervention in a different setting (62) found that gender modified the effect on multiple outcomes, we stratified the current study by gender. We used SD=0.478 for men and SD=0.490 for women for the power calculation on ‘Active choice’ (62). We used a statistical power of 80%, an alpha level of 0.05, and a clinically relevant difference of 0.145 points on ‘Active choice’, meaning that 173 men and 182 women were needed per group. We assumed a delta of 0.145 for active choice because this lies exactly between 0.13 and 0.16; these were the significant differences found in an earlier study (62). Consequently, we could detect 0.74 points difference for men and 0.64 points difference for women on ‘Intention strength’, and 0.45 points difference for both men and women on ‘Commitment’.”

6. Table 3 – for cognitive risk perception, active choice and commitment, the differences appear quite small (though given comment #2, it is hard to know what the range of scores are for the variables). Are these differences meaningful?

Response: We agree that the differences are quite small. However, our study is a proof-of-concept study. We made this more clear in the current version of the paper. If our experiment shows an effect of an active choice intervention in an experiment however small, only then further studies are relevant how this could be tested in practice.

Lines 120-123: This proof of concept study aimed to test the preliminary efficacy of fostering an active choice of participants at increased cardiovascular risk for preventive action as well as to better understand the mediating psychological processes using hypothetical scenarios. If our study shows positive results, the intervention could be tested in a real-life trial.

End discussion line 429-430: “Our proof of concept study shows that fostering active choice among people at increased risk for cardiovascular disease may positively impact their intention and commitment for preventive action.

7. After reading this a few times, it is still unclear how the ORs for the intentions variable are being calculated—is it within the arm or comparing across arms? While there does seem to be difference between arms in intention to pursue lifestyle changes (60% vs 67%), it is unclear how that translates to OR 2.86.

Response: This intentions variable was analysed both within and across arms. That means that within each arm, the proportion of participants intending to pursue lifestyle changes was compared to those who intended to ‘change nothing’; these proportions were subsequently compared across the active choice and passive choice arms. This resulted in an odds ratio of 2.86.

We added the following line to the manuscript to make this clearer:

Lines 330-331: For intention regarding coping with CVD risk, the results were compared both within and between study arms.

8. Discussion would benefit from reflection on the active choice measure (and possibly noting lack of validity or evidence of psychometric properties in the limitations).

Response: Our measure indeed lacks some psychometric testing. On the other hand, our measure has a solid theoretical base. Some concepts are based on items of the DCS which was shown to have good psychometric properties. We added a remark in the limitations section of the discussion.

Lines 443-446: It should be acknowledged that many items in the study were self-constructed, including part of the items to measure the degree of active choice, intentions, and commitment. Although we based this measure on a theoretically solid definition, pre-tested these items before data collection and calculated Cronbach’s alpha values, the items and scales lack validity and evidence of psychometric properties.

Line 395 : The finding that cognitive risk perception and negative affect sequentially mediated the relationship between experimental condition and active choice corresponds to the literature, which describes that cognitive risk perceptions can influence affect and, subsequently, behavi

Attachments
Attachment
Submitted filename: Response to reviewers_resubmission Landais et al 19 04 2024.docx
Decision Letter - Henri Tilga, Editor

Fostering active choice to empower behavioral change to reduce cardiovascular risk: a web-based randomized controlled trial

PONE-D-23-22195R1

Dear Dr. Timmermans,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager® and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Henri Tilga, PhD

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Authors have done well job on revising their manuscript.

Reviewers' comments:

Formally Accepted
Acceptance Letter - Henri Tilga, Editor

PONE-D-23-22195R1

PLOS ONE

Dear Dr. Timmermans,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Henri Tilga

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .