Peer Review History

Original SubmissionNovember 5, 2022
Decision Letter - Francesca Baratta, Editor

PONE-D-22-30497Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item Advance Care Planning Engagement questionnairePLOS ONE

Dear Dr. Giordano,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 18 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Francesca Baratta, PharmD, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Thank you for stating the following financial disclosure:

"This research was funded by Fondazione Italiana Sclerosi Multipla (FISM; aism.fism.it), grant no. 2020/R-Multi/024 to A.S, and partially supported by the Italian Ministry of Health (RRC). R.L.S. is funded in part by the National Institute on Aging, National Institutes of Health (K24AG054415)."             

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

If this statement is not correct you must amend it as needed.

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

3. Thank you for stating the following in the Competing Interests section:

"A.S. reports grants from the Italian Multiple Sclerosis Foundation (FISM) and the European Academy of Neurology, during the conduct of the study; she serves as board member for Merck Serono, and received personal fees from Almirall and Merck Serono, outside the submitted work."

Please confirm that this does not alter your adherence to all PLOS ONE policies on sharing data and materials, by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests).  If there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include your updated Competing Interests statement in your cover letter; we will change the online submission form on your behalf.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: At the end of your introduction, state the objective of your research instead of what is written in the last paragraph “ For each questionnaire, the linguistic validation encompasses two main actions: translation97 adaptation of the QOC and ACP-E inventories into Italian; psychometric validation. Here we report the results of the first action”.

The main aspect of the paper that can improve is the presentation of the cross-cultural adaptation (Results from page 9-12). Is it possible to create Tables to explain: what items were modified, why and how?

The conclusion should summarise your main results. Avoid citing references in your conclusion.

Reviewer #2: The authors translated and cross-culturally validated the Italian the Quality of Communication (QOC) and the 4-item ACP Engagement (4-item ACP-E). Their results in 14 subjects showed satisfactory semantic, conceptual and normative equivalence. Below my comments.

The authors report that “For each questionnaire, the linguistic validation encompasses two main actions: translation adaptation of the QOC and ACP-E inventories into Italian; psychometric validation”. But they claim to report only the first part (i.e. Translation and adaptation). Why did the authors decide not to report the results of the psychometric properties? Even if the questionnaire has been transculturally translated, if we do not know the psychometric properties (such as reliability and validity) we cannot use it with our patients and therefore the repercussions in clinical practice are very low. I highly recommend reporting the psychometric results as well. Furthermore, I have hardly read of papers reporting only the assessment of cross-cultural validity; these results are usually reported together with the validity and reliability results, to improve the application of the results in clinical practice.

The authors report that “the ACP-E is available in shorter versions (55-item, 34-item, 9-item, 4-item) … Specifically, we were interested in the 4-item version”. What are the reasons that led the authors to prefer the 4-item version? Why didn't they consider translating the entire completed questionnaire?

Information on the structure of the questionnaire is missing. For example, there is no information about the scores for each item and the calculation of the total score

The authors included only 14 patients in the cognitive de briefing. Typically, guidelines for cross-cultural validation suggest including 30 patients. Why did the authors only include 14 of them?

Reviewer #3: Peer-Review PONE-D-22-30497

Dear authors,

Thank you for submitting your manuscript to the journal PLOS ONE. This is a well-prepared and thorough investigation of the content validity of the Italian translations of two questionnaire relevant for supporting Advance Care Planning. I only have very minor comments below.

Clinical relevance of the questionnaires

In the introduction, you explain about ACP - what it is, its elements etc. You also specify that the two questionnaires be used for clinical and research purposes (page 4, line 82/83). I would recommend being a bit more specific regarding the use cases you envisage. Are you translating the questionnaires for evaluation purposes of ACP interventions? Or are you planning to bring them into clinical practice? If yes, in which setting? How is shared decision making going to happen with the aid of these questionnaires?

You can also specify this in the discussion section, not in the background section if you felt it would sit better there.

Methods

You are very comprehensive when it comes to explaining your methods. Although you specify the methods for cognitive interviewing and you also specify the analysis methods, I was missing the framework of Tourangeau being applied to the data. From the results and how they are reported, I would expect you probably used Tourangeau. It might be worth mentioning him and his framework.

Discussion/article

Your aim is the cross-cultural adaptation of the two ACP questionnaires. You do a very thorough translation process. However, although cultural issues are implicitly mentioned in the results, the discussion section then does not make them explicit. You present a lot of evidence in the background on the Italian's readiness to endorse ACP. You also describe the health care system's lack in responding to this need. You describe the "emotionally taxing" nature of some of the items. I was wondering whether it would be possible to explicitly discuss cultural issues and how they reflect on the construct ACP the questionnaire want to measure. After all, achieving translations that are faithful to the original definition and measurement of the construct is one of the aims of a cross-cultural adaptation. The other might be to learn more about once culture and, in reflection, about the construct under investigation. Results from cross-cultural adaptations of questionnaires can feed back into further develop the content validity of the questionnaires. I was missing a section in the discussion to do just that - a bit of reflection on the general content validity of the two questionnaires.

Minor comment

In the introduction section, you often speak of "his/her own personal values" or "his/her health". It is common to do a gender-neutral pronoun in plural in English in these situations (at least in publications, not in the actual questionnaires). Page 4, line 66 could better read as "ACP helps the patient to identify their own personal values and goals, understand their health..."

Otherwise, this was an engaging, clearly structured and methodologically thoroughly prepared study. What a pleasure to read!

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Leonardo Pellicciari

Reviewer #3: Yes: Christina Ramsenthaler

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Reviewer #1:

At the end of your introduction, state the objective of your research instead of what is written in the last paragraph “For each questionnaire, the linguistic validation encompasses two main actions: translation adaptation of the QOC and ACP-E inventories into Italian; psychometric validation. Here we report the results of the first action”.

R: We have revised the last sentence of the introduction as suggested.

The main aspect of the paper that can improve is the presentation of the cross-cultural adaptation (Results from page 9-12). Is it possible to create Tables to explain: what items were modified, why and how?

R: We have added two tables to summarize the changes made in the QOC (Table 1) and 4-item ACP-E (Table 2).

The conclusion should summarise your main results. Avoid citing references in your conclusion.

R: We have revised the conclusion as suggested.

Reviewer #2:

The authors report that “For each questionnaire, the linguistic validation encompasses two main actions: translation adaptation of the QOC and ACP-E inventories into Italian; psychometric validation”. But they claim to report only the first part (i.e. Translation and adaptation). Why did the authors decide not to report the results of the psychometric properties?

R: We purposely focused on a research phase that is usually poorly documented: translation and cultural adaptation (and cognitive debriefing). We have aired this in the discussion section.

Even if the questionnaire has been transculturally translated, if we do not know the psychometric properties (such as reliability and validity) we cannot use it with our patients and therefore the repercussions in clinical practice are very low. I highly recommend reporting the psychometric results as well. Furthermore, I have hardly read of papers reporting only the assessment of cross-cultural validity; these results are usually reported together with the validity and reliability results, to improve the application of the results in clinical practice.

R: The psychometric testing phase is currently ongoing and will be reported in a separate manuscript.

The authors report that “the ACP-E is available in shorter versions (55-item, 34-item, 9-item, 4-item) … Specifically, we were interested in the 4-item version”. What are the reasons that led the authors to prefer the 4-item version? Why didn't they consider translating the entire completed questionnaire?

R: We were interested in the 4-item version of the 4-item ACP-E as: (a) it had good sensitivity to change compared to longer versions in a large trial involving US English- and Spanish-speaking old adults (PREPARE study, ref. 12); (b) it assesses the readiness behavior change construct within the ACP ‘process’ domain (ref. 11); (c) administration burden is limited. We have described this in the materials and methods section.

Information on the structure of the questionnaire is missing. For example, there is no information about the scores for each item and the calculation of the total score

R: Following reviewer’s advice, we have added (methods section) the scoring rules for the two scales.

The authors included only 14 patients in the cognitive de briefing. Typically, guidelines for cross-cultural validation suggest including 30 patients. Why did the authors only include 14 of them?

R: As from the ISPOR Task Force, we applied cognitive debriefing, which involves a small group of 5-6 subjects. We guess that the reviewer refers to pilot testing instead, which requires 30–40 subjects.

Reviewer #3: Peer-Review PONE-D-22-30497

Clinical relevance of the questionnaires

In the introduction, you explain about ACP - what it is, its elements etc. You also specify that the two questionnaires be used for clinical and research purposes (page 4, line 82/83). I would recommend being a bit more specific regarding the use cases you envisage. Are you translating the questionnaires for evaluation purposes of ACP interventions? Or are you planning to bring them into clinical practice? If yes, in which setting? How is shared decision making going to happen with the aid of these questionnaires?

You can also specify this in the discussion section, not in the background section if you felt it would sit better there.

R: We have described (introduction section) that we are using the QOC and the 4-item ACP-E for evaluation purposes of an ACP intervention (ConCure-SM). Following reviewer’s advice, we have expanded the description of the ConCure-SM intervention and feasibility trial to clarify the context in which the two instruments are being used.

Methods

You are very comprehensive when it comes to explaining your methods. Although you specify the methods for cognitive interviewing and you also specify the analysis methods, I was missing the framework of Tourangeau being applied to the data. From the results and how they are reported, I would expect you probably used Tourangeau. It might be worth mentioning him and his framework.

R: We thank the reviewer for her comment. We do confirm that we pre-planned the interviews according to Willis' indications [14], and the modified Tourangeau model of cognitive aspects [15]. We have now slightly changed the text, accordingly.

Discussion/article

Your aim is the cross-cultural adaptation of the two ACP questionnaires. You do a very thorough translation process. However, although cultural issues are implicitly mentioned in the results, the discussion section then does not make them explicit. You present a lot of evidence in the background on the Italian's readiness to endorse ACP. You also describe the health care system's lack in responding to this need. You describe the "emotionally taxing" nature of some of the items. I was wondering whether it would be possible to explicitly discuss cultural issues and how they reflect on the construct ACP the questionnaire want to measure. After all, achieving translations that are faithful to the original definition and measurement of the construct is one of the aims of a cross-cultural adaptation. The other might be to learn more about once culture and, in reflection, about the construct under investigation. Results from cross-cultural adaptations of questionnaires can feed back into further develop the content validity of the questionnaires. I was missing a section in the discussion to do just that - a bit of reflection on the general content validity of the two questionnaires.

R: In the discussion section, we have now made explicit the main cultural issues that emerged during the cross-cultural adaptation process: “We also acknowledge that cultural issues arose during the study. These include a lack of knowledge of the Italian ACP legislation, revealed by the fact that some respondents were unaware of the term 'fiduciario'. Another problem is the difficulty of talking about EOL in the Italian clinical context: although all enrolled patients suffered from progressive conditions, they expected their doctors to talk about possible treatments and care pathways, not about EOL. Death being a taboo topic, along with the superstitious belief that talking about something can evoke it, may contribute to this difficulty.”

Minor comment

In the introduction section, you often speak of "his/her own personal values" or "his/her health". It is common to do a gender-neutral pronoun in plural in English in these situations (at least in publications, not in the actual questionnaires). Page 4, line 66 could better read as "ACP helps the patient to identify their own personal values and goals, understand their health..."

R: We have changed the sentence as suggested.

Otherwise, this was an engaging, clearly structured and methodologically thoroughly prepared study. What a pleasure to read!

R: We thank the reviewer for her appreciation of the study.

Attachments
Attachment
Submitted filename: Response to Reviewers.docx
Decision Letter - Francesca Baratta, Editor

Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item Advance Care Planning Engagement questionnaire

PONE-D-22-30497R1

Dear Dr. Giordano,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Francesca Baratta, PharmD, PhD

Academic Editor

PLOS ONE

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

Reviewer #3: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

Reviewer #3: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: I thank the authors for their efforts to answer my questions. I agree that the purpose of the paper is to describe the cross-cultural validation process. Unfortunately, in this form the results of this study have limited application in clinical practice. Having the validity and reliability data available allows clinicians to be able to use this tool. I hope these results will be available soon.

Reviewer #3: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Leonardo Pellicciari

Reviewer #3: Yes: Christina Ramsenthaler

**********

Formally Accepted
Acceptance Letter - Francesca Baratta, Editor

PONE-D-22-30497R1

Italian cross-cultural adaptation of the Quality of Communication questionnaire and the 4-item Advance Care Planning Engagement questionnaire

Dear Dr. Giordano:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Francesca Baratta

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .