Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Supporting health and social care professionals in serious illness conversations: Development, validation, and preliminary evaluation of an educational booklet

  • Silvia Gonella ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    silvia.gonella@unito.it (SG); federica.rivarovedda@unito.it (FRR)

    Affiliation City of Health and Science University Hospital Turin, Turin, Italy

  • Paola Di Giulio,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Department of Public Health and Pediatrics, University of Torino, Turin, Italy

  • Federica Riva-Rovedda ,

    Roles Conceptualization, Investigation, Methodology, Writing – review & editing

    silvia.gonella@unito.it (SG); federica.rivarovedda@unito.it (FRR)

    Affiliation Department of Public Health and Pediatrics, University of Torino, Turin, Italy

  • Luigi Stella,

    Roles Resources, Writing – review & editing

    Affiliation Fondazione Assistenza e Ricerca Oncologica (F.A.R.O.), Turin, Italy

  • Maria Marcella Rivolta,

    Roles Resources, Writing – review & editing

    Affiliation Local Health Authority of the City of Turin, Turin, Italy

  • Eugenia Malinverni,

    Roles Resources, Writing – review & editing

    Affiliation Fondazione Luce per la Vita Onlus, Rivoli, Turin, Italy

  • Mario Paleologo,

    Roles Resources, Writing – review & editing

    Affiliation City of Health and Science University Hospital Turin, Turin, Italy

  • Giancarlo Di Vella,

    Roles Resources, Writing – review & editing

    Affiliation Department of Public Health and Pediatrics, University of Torino, Turin, Italy

  • Valerio Dimonte

    Roles Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliations City of Health and Science University Hospital Turin, Turin, Italy, Department of Public Health and Pediatrics, University of Torino, Turin, Italy

Abstract

Serious illness conversations aim to align the care process with the goals and preferences of adult patients suffering from any advanced disease. They represent a challenge for healthcare professionals and require specific skills. Conversation guides consistent with task-centered instructional strategies may be particularly helpful to improve the quality of communication. This study aims to develop, validate, and preliminarily evaluate an educational booklet to support Italian social and healthcare professionals in serious illness conversations. A three-step approach, including development, validation, and evaluation, was followed. A co-creation process with meaningful stakeholders led to the development of the booklet, validated by 15 experts on clarity, completeness, coherence, and relevance. It underwent testing on readability (Gulpease index, 0 = lowest-100 = maximum) and design (Baker Able Leaflet Design criteria, 0 = worst to 32 = best). Twenty-two professionals with different scope of practice and care settings evaluated acceptability (acceptable if score ≥30), usefulness, feasibility to use (1 = not at all to 10 = extremely), and perceived acquired knowledge (1 = not at all to 5 = extremely). After four rounds of adjustments, the booklet scored 97% for relevance, 60 for readability, and 25/32 for design. In all, 18 (81.8%), 19 (86.4%) and 17 (77.3%) professionals deemed the booklet acceptable, moderate to highly useful, and feasible to use, respectively; 18/22 perceived gain in knowledge and all would recommend it to colleagues. The booklet has good readability, excellent design, high content validity, and a high degree of perceived usefulness and acquired knowledge. The booklet is tailored to users’ priorities, mirrors their most frequent daily practice challenges, and offers 1-minute, 2-minute and 5-minute solutions for each scenario. The co-creation process ensured the development of an educational resource that could be useful regardless of the scope of practice and the care setting to support professionals in serious illness conversations.

Introduction

Serious illness conversations represent a wide range of discussions engaging healthcare professionals, patients and/or their informal caregivers when a health condition with a high risk of mortality and a negative impact on quality of life occurs or excessively strains the caregivers [1]. Serious illness conversations need a complex skillset that has been conceptualized as both a skill and as a way of being in relation to the other [2]. Indeed, such conversations occur in a context of uncertainty and turbulent emotions, and involve communication skills as well as relational skills of empathy, flexibility, and self-reflection [3]. According to their goal, serious illness conversations require competencies in delivering news, eliciting hopes and worries, sharing or clarifying the prognosis, promoting illness understanding, exploring what is important for the patient and their goals and wishes for care, making recommendations, but also in responding to emotions and offering support and reassurance [4, 5].

Although there is consensus that effective communication plays a key role in the establishment of therapeutic alliance and partnership based on mutual trust [6] and contributes to know the patients’ valued priorities and align care with their preferences [7], communication skills training is generally not part of traditional education for healthcare professionals in Italy, especially for clinicians. As a consequence, the novices who enter the profession often feel underprepared and unequipped for difficult conversations [8], and tend to postpone them as much as possible [9]. However, there is increasing awareness that communication skills are both innate and teachable [6, 10] and communication skills training is a growing component of formal professional training for healthcare professionals in other healthcare systems such as the UK, US, Canada and Australia, where programs to promote high quality communication have been introduced in the education of healthcare students and also represent a consolidated component of continuing education for professionals [1114].

Several institutions are recognizing the worthy contribution of effective communication in avoiding aggressive, non-beneficial treatments and delivering high-quality care [15], with increasing investments in communication skills training [16, 17]. At least at a basic level, all members of the team should be confident and capable of engaging in serious illness conversations [18].

Experts in the field of communication skills recognize that didactic material can support experiential learning [10]. Printed educational resources are among the most common approaches to translate research into clinical practice tips [19]. They may facilitate clearer communication by providing a mental model of common clinical scenarios (i.e., context, goals, challenges to overcome, strategies to be used, etc.) [6, 18]. A written conversation guide offers structure for the conversation and facilitates timely, effective conversations [17, 20], while maintaining an active role of professionals [4]. Compared to other formats such as video or audio guides, written guides are more quickly accessible in clinical contexts, make it easier to revisit a particular section, and their computerized version allows one to search for keywords that make them more discoverable [19]. When conversation guides were used, professionals perceived that they had a framework for difficult conversations [17] and their satisfaction with their role increased [20].

Written conversation guides have been introduced in different clinical contexts, such as emergency departments, intensive care units, primary care, oncology, and long-term care to provide high-quality patient-centered care [12, 21, 22]. In these experiences, the original conversation guides were adapted to the care environment and the scope of practice of the healthcare professionals who would use the guide [23].

Conversation guides that are consistent with task-centered instructional strategies may be particularly helpful to improve the flow and speed of conversation [17]. The education theory of task-centered instructional strategies assumes that optimal learning occurs with focused tasks that learners are likely to encounter in their daily practice, associated with readily accessible procedural information [24]. The former makes it clear what the learner should do, while the latter provides the learner with the information they need to perform the task and decreases their cognitive load [24].

Although it is acknowledged that there is no “magic bullet” to change professional practice [25] and that the context influences the effectiveness of strategies [26], twelve key theoretical constructs have been identified to explain healthcare professionals’ behavior change [27]. In order to promote behavior change, interventions should enhance (1) knowledge and (2) skills, (3) be consistent with social/professional role and identity, (4) serve as persuasive strategies which influence beliefs about capabilities and (5) lead to changes in beliefs about consequences, (6) stimulate reflection on motivation and goals, (7) influence memory, attention, and decision processes, (8) create a facilitative environmental context that triggers behaviors, evoke (9) emotions and (10) behaviours while providing regulation, and (11) propose desirable behaviours and (12) social norms.

In the effort to maximize the benefit of an innovative communication skills training program for different health and social care professionals [28], as an integral part of the intervention, we developed an educational booklet aimed at providing professionals with guidance in challenging communication scenarios with frail or terminally-ill patients and/or their families. Unlike previous conversation guides [29, 30] that provide a talking map with a series of signposts to cover the conversation flow with no reference to clinical cases, this booklet is built on complex communication scenarios (e.g., unawareness of disease trajectory or prognosis, ambivalent care preferences) based on realistic cases. This is likely to improve learners’ memory of content because they immediately perceive support for real-case scenarios. Moreover, previous guides employ only one communication strategy; instead, having more solutions could maximize the chance for learners to find the communication strategy that best fits their learning style (e.g., short tips, infographics, or illustrative statements). Therefore, the booklet adopts several communication strategies and covers the most common and challenging communication scenarios that professionals can experience in clinical practice to help them acquire knowledge of their real-word tasks and form mental models for how integrating the skills into their performance. In fact, relevance is a pivotal component of motivation for behavioural change [31].

The primary aim of this study was to describe the development and validation of the educational booklet. The secondary aim was to assess its acceptability, usefulness, and feasibility to use in daily practice and the acquired knowledge on communication techniques perceived by professionals.

Material and methods

This study was carried out according to a three-step approach [32] and adhered to the guidelines outlined in the Standards for QUality Improvement Reporting Excellence in EDUcation (SQUIRE-EDU) [33] (S1 Table).

The methodology included the creation of the resource, validation, and evaluation. The first step entailed a literature review, qualitative interviews, and a co-creation process to develop the booklet. The second step involved the booklet’s validation (i.e., relevance) through health and social care professionals; moreover, completeness, clarity, realism of clinical scenarios, readability, and design were assessed. The third step concerned the preliminary evaluation of the booklet by health and social care professionals working in different clinical settings. The professionals rated the acceptability, usefulness, and feasibility of using the booklet in daily practice as well as their acquired knowledge on communication techniques and protocols after reading the booklet. These steps ensured the methodological validity and reproducibility of this study (Fig 1).

thumbnail
Fig 1. Development, validation, and preliminary evaluation of the educational booklet: A three-step approach.

BALD, Baker Able Leaflet Design; CVI, Content Validity Index.

https://doi.org/10.1371/journal.pone.0304180.g001

Participants involved in the development of the booklet provided verbal consent that was audio and video recorded, while those involved in the validation and preliminarily evaluation steps provided written consent. The study was approved by the Ethics Committee of the University of Torino (n. 0598416/2021).

First step: Development of the booklet

A first draft of the booklet covering the most common and difficult communication scenarios was created according to a review of the literature [8, 34] and interviews with health and social care professionals with varying scopes of practice (findings published elsewhere) [35]. The first draft covered nine difficult communication scenarios against four clinical cases in different contexts of care where difficult conversations are frequent: 1. Carlo, 77 years, with advanced dementia in nursing home; 2. Giovanni, 80 years, with lung cancer in intensive care unit; 3. Ottavio, 47 years, with acute lymphoblastic leukemia in hematology; 4. Anna, 85 years, transferred to long-term services after in-hospital stay for heart failure. Communication scenarios included unawareness of disease trajectory or prognosis, turbulent emotions and prolonged silences, preferences for aggressive care, ambivalent care preferences, family carers with different care preferences, choosing care treatments when the person’s preferences are unknown, unrealistic expectations, balancing hope and realism, and remote communication. Each scenario is accompanied by i) practical hints to deal with serious illness conversations; ii) infographics summarizing the main evidence-based indications; and iii) good examples of communication scripts based on the most known communication protocols (i.e., CONNECT, SPIKES) and methods (i.e., ADAPT, NURSE, PREPARED, REMAP, TUVERI). All these protocols and methods share core components such as paying attention to the context, exploring patient/family perceptions and preferences and providing information tailored on their needs, and addressing emotions with empathic responses. Each protocol/method also has a specific focus: ADAPT and PREPARED were designed to provide a talking map in discussing prognosis; the NURSE method illustrates communicative strategies for responding to emotions; the REMAP tool may be useful to address goals of care; the CONNECT protocol was designed to organize key aspects of remote communication; finally, SPIKES and TUVERI provide guidance in disclosing unfavorable information. A detailed review of the principles or content of the main communication protocols and methods is shown in S2 Table.

An introductory text, a section on basic communication skills, and additional resources complete the booklet.

Secondly, 12 health and social care professionals and three representatives of patients associations, family carers, and volunteers in the field of dementia or palliative care were recruited between 5 September 2022 to 26 October 2022 and participated in three focus group discussions (5 participants for each focus group). The research team reached the reference person of each association that then identified their representative. Characteristics of the participants to focus groups are shown in S3 Table.

Seven to ten days prior to the focus group, each participant received the booklet by email and was asked to read it for sharing ideas on the content during the group discussion. The focus groups were conducted digitally to facilitate participation from different geographical areas [36] and had a mean duration of 78 minutes (range 68–85). A member of the research team moderated the discussion using a pre-defined set of questions and solved conflicts of opinion by seeking common ground and areas of agreement to compromise. The questions guiding the focus groups explored the completeness, acceptability, clarity, feasibility to use, and graphics of the booklet, that the literature recognizes as key features for written resources [19]. Another team member took any field notes on paraverbal and body language. Focus group discussions were audio-recorded, transcribed verbatim and transcripts checked for accuracy. Then, two researchers used an inductive thematic analysis to analyse the transcripts and identify the areas of improvement [37]. Thirdly, this analysis guided the changes of the second iteration of the booklet, which was then distributed back for a second evaluation with the request to complete a brief open-ended questionnaire assessing its content and design. Fourthly, the booklet was further adjusted according to the emerging comments.

The research team initially took the decision not to involve a design agency and to deal on their own with design issues that could have arisen. However, the team later realized that it was not possible to address satisfactorily criticalities about font, colors, and layout as they recurred on the unfolding versions of the booklet despite the efforts to solve the problems; therefore, a graphic designer was involved after the feedback from the external review board.

Second step: Validation

Content validity index.

An external review board of 12 health and social care professionals who work in the community, long-term, hospital, and education settings and three representatives of two stakeholder societies reviewed the booklet and answered an online, 10-minute questionnaire from 17 January 2023 to 17 February 2023. Characteristics of the board are shown in the S4 Table.

The professionals received the booklet by email and were invited to rate each section according to its clarity, coherence, and relevance. Moreover, the booklet was explored for completeness and missing information. Clarity, coherence, and relevance of each section were assessed using a 4-point Likert scale (from 1 = not at all to 4 = much). The completeness was based on a dichotomous answer (yes/no) with the opportunity to list missing information. Free comments were also invited.

Regarding the relevance of the booklet, the content validity index (CVI) was computed for individual sections (I-CVI) and for the overall booklet (S-CVI/averaging calculation method (Ave) and S-CVI/Universal Agreement (UA)) [38].

The I-CVI was calculated for each section as the number of professionals giving a rating of either 3 or 4 (thus relevant), divided by the total number of professionals. With more than 10 validators, the I-CVI should be >0.70 [38]. Only sections scoring higher than this threshold were maintained [38].

The S-CVI/Ave was computed as the average of the I-CVIs for all sections on the booklet. A S-CVI/Ave of 0.90 or higher is recommended. The S-CVI/UA was computed as the proportion of sections of the booklet that achieved a relevance rating of 3 or 4 by all the validators. A S-CVI/UA of 0.80 or higher is recommended [38].

The clarity and coherence of each section and for the overall booklet were computed as mean with standard deviation (SD). The completeness of the booklet was computed as the number of validators who rated the booklet as complete on the total.

When a section was marked as ‘not at all’ = 1 or ‘little’ = 2 for relevance, clarity, or realism of clinical scenarios by at least two validators, the text was adjusted according to their comments.

Product testing.

The readability, layout, and design of the final booklet were evaluated. The Gulpease Index was used to assess the readability [39]. The Gulpease index considers two linguistic variables, the length of the word and the number of letters of the sentence, as shown in the following formula: [39]. Accounting for the length of a word in characters rather than in syllables, it is proved to be more reliable in assessing the readability of Italian texts. The index ranges from 0 (lowest readability) to 100 (maximum readability). Scores below 80, 60 and 40 identify texts that are difficult to read for a 5th grade level (primary school level, 6 to 10 years), 8th grade level (junior secondary school level, 11 to 13 years), and 13th grade level (secondary school level, 14 to 18 years) [40]. Each section of the booklet was tested at the following address: https://farfalla-project.org/readability_static/.

The Baker Able Leaflet Design (BALD) criteria were used to assess the layout and design characteristics of the booklet [41]. The BALD score covers 16 attributes and ranges from 0 (worst layout and design) to 32 (best layout and design).

Third step: Preliminary evaluation

Recruitment of health and social care professionals.

Health and social care professionals were recruited at a 800-bed acute care hospital and its community services and at two nursing homes in the North-west of Italy from 10 May 2023 to 15 May 2023. Professionals of any profile engaged in serious illness conversations with patients or their families were eligible.

Questionnaire.

The professionals were asked to complete a questionnaire that explored their perception on the acceptability, usefulness, and feasibility of using the booklet in daily practice. Moreover, they were asked to rate their acquired knowledge on communication techniques and protocols and could suggest changes. Finally, professionals were asked whether they would recommend the booklet to colleagues (yes/not) and to motivate it.

Acceptability is referred to by O’Connor and Cranney as ‘‘ratings regarding the comprehensibility of components of a decision aid, its length, amount of information, balance in presentation of information about options, and overall suitability for decision making” [42]. Our measure of ‘acceptability’ refers more specifically to acceptability to use, understand, read, and inform patients and their families. It also includes the themes of communication with patients/families, relationships with patients/families, and intention to use the booklet in practice. For this, we developed a 10-item scale summing rating of agreement with statements selected from the acceptability instrument by O’Connor and Cranney [42] and from a comparative evaluation of three decision aids [43]. Item scores were 1 (strongly disagree) to 5 (strongly agree) [42]. Higher total scores represent better acceptability. We regarded scores of 30 and higher as “acceptable” and 40 and higher as “highly acceptable” (mean item scores 3 and 4, respectively).

Usefulness and feasibility to use were rated on a scale from 1 (not at all useful/feasible to use) to 10 (extremely useful/feasible to use). The mean usefulness and feasibility scores were calculated; a score between 6 and 7 indicated moderate usefulness/feasibility, while a score >8 a high degree of usefulness/feasibility. Acquired knowledge was rated on a 5-point Likert scale from 1 (not at all) to 5 (extremely).

Statistical analyses

Frequencies, percentages, and means with range or standard deviation (SD) were computed. IBM SPSS Statistics for Window Version 27.0 was employed. The sample size for the evaluation step was based on the concept of content validity and was calculated using the formula: , where ‘P’ is the expected proportion of health and social care professionals who indicated the relevance of each section of the booklet and ‘e’ represents the acceptable proportional difference compared to what would be expected [44]. An expected proportion of professionals of 85% was established with a difference of 15% and a confidence level of 95%. This results in a minimum of 22 professionals being needed [44]. This analysis is based on the methodology for the evaluation of decision aids. Decision aids and educational booklets share several similarities, including the multidisciplinary approach, evidence-based soundness, and attention to both content and design. However, some differences also occur: decision aids explicitly state the decision that needs to be considered and appear as active tools to guide the decision-making process by providing detailed focus on options and outcomes and helping people to arrive at decisions that reflect their personal values and preferences. Instead, educational booklets represent a source of information but are not focused on decision points due to their broader perspective [45].

Results

First step: Development of the booklet

The inductive thematic analysis of focus group transcripts identified eight areas for improvement: 1) Make clearer that the booklet is part of a communication skills training program; 2) Strengthen the relational component of communication; 3) Enhance the realism of clinical scenarios; 4) Draw attention to the legal issues; 5) Insert missing critical situations; 6) Employ a person-centered dialogical approach; 7) Enhance actionability; and 8) Improve graphics.

Further refinements came after re-evaluation by focus group participants and external reviewers, but without major changes.

Table 1 shows the main adjustments of the booklet during its development.

thumbnail
Table 1. Adjustments of the booklet during the process of development.

https://doi.org/10.1371/journal.pone.0304180.t001

The final version of the booklet is freely available online and is downloadable from the website of the Italian Society of Palliative Care at https://www.sicp.it/aggiornamento/linee-guida-bp-procedures/2023/09/guida-alla-comunicazione-in-situazioni-complesse/

Second step: Validation

Content validity index.

All external reviewers deemed the booklet complete with an overall mean (SD) clarity and coherence of 3.7 (0.5) and 3.9 (0.3), respectively. The final booklet resulted into 17 sub-sections and none was removed based on I-CVI always above 0.9. No differences emerged between professional raters and association representatives. The S-CVI/Ave was 0.97 and the S-CVI/UA was 0.53. The S5 Table shows the details for each sub-section.

Product testing.

The mean Gulpease index of all sub-sections was 60. This represents a language fairly easy to read and understand at a junior secondary school level. The ‘Introduction’ sub-section scored the lowest with 44. The ‘Actionable resources’ subsection scored the highest with 71, followed by ‘Basic communication skills’ with 70 (S5 Table).

The BALD score for the final version of the booklet was 25/32. The S6 Table shows the detailed design characteristics of the booklet.

Third step: Preliminary evaluation

Participants.

Twenty-two professionals were contacted and all answered the evaluation questionnaire. The majority were females and the over 35 to under 35 years ratio was roughly equal. More than two thirds (n = 15) had more than 10 years of working experience with only three professionals with less than one year in the current service. Most were nurses, however, the profiles of physician, social worker, occupational therapist, and physiotherapist were also represented. The professionals worked in varying settings of care, including emergency, nursing home, medicine, surgery, primary care, and hospice. Only three professionals undertook specific education in clinical communication or counselling (Table 2).

thumbnail
Table 2. Characteristics of professionals evaluating the educational booklet (n = 22).

https://doi.org/10.1371/journal.pone.0304180.t002

Questionnaire.

The evaluations for acceptability, usefulness, feasibility to use, and perceived acquired knowledge are presented in Table 3. In all, 18 (81.8%), 19 (86.4%) and 17 (77.3%) professionals deemed the booklet acceptable, moderate to highly useful, and moderate to highly feasible to use, respectively. Over 80% (n = 18) of the professionals perceived gain in knowledge after reading the booklet.

thumbnail
Table 3. Acceptability, usefulness, feasibility to use and perceived acquired knowledge.

https://doi.org/10.1371/journal.pone.0304180.t003

Table 4 shows the acceptability score at the item level: particularly, professionals perceived the booklet as consistent with their professional identity and standard by agreeing that it aligns with the way they think things should be done (15/22) and complements their usual approach to communication (14/22). All but three professionals perceived a high probability that using this booklet may result in more benefit than harm, and half believed that the booklet would improve communication and relationships between professionals and families. Around 60% (13/22) reported that they would continue to use the resource after the end of the project.

thumbnail
Table 4. Acceptability of the booklet: Scoring at the item level by the 22 evaluating professionals.

https://doi.org/10.1371/journal.pone.0304180.t004

All professionals would recommend the booklet to colleagues and 11 reported reasons: “provides practical and easily applicable advice” (n = 6), “provides a mental model and guidance in real-case scenarios” (n = 3), “helps start conversations” (n = 1), and “promotes reflection on professional competence and learning needs” (n = 1). Only one professional suggested enriching the bibliography to improve scientific soundness.

Discussion

This study describes the development, validation, and preliminarily evaluation of an educational booklet aimed at supporting Italian professionals in serious illness conversations. The co-creation process led to an acceptable resource with valid content, high degree of perceived usefulness, feasibility to use, and acquired knowledge.

The co-creation process for developing the booklet relied on focus groups involving a purposive sample of stakeholders. Focus groups represent a person-centered research method that provides the opportunity to discuss own perspective in a collaborative, participatory setting and could be helpful in obtaining viewpoints that are representative of the majority [46]. To develop the educational booklet, the academics strictly worked with stakeholders from other sectors, including professionals with varying scope of practice, representatives of volunteering associations, and associations of patients and family carers with life-limiting illnesses. The iterative, user-centric approach with several rounds of revisions promoted the creation of a person-centered resource tailored on day-to-day practice challenges that is responsive to real life scenarios [35]. For example, in Carlo’s case to promote reflection on care choices, the original, professionals-centric sentence “we have given you a lot of information” was changed into the person-centric statement “you have received a lot of information”. Moreover, the user-centric approach allowed to improve realism by replacing didactic sentences with real-life expressions. Although several communication protocols suggest closing the encounter by making patients/family carers summarize the main key points discussed, all participants in our focus groups agreed that this is usually performed by the professionals to avoid further pressure. Therefore, the original sentence “could you try repeating []” was changed into “we would like to summarize […]”.

As suggested by previous literature on participatory research [47, 48], the co-creation process ensured that the booklet was relevant to the users’ priorities and needs and resulted in all professionals recommending the resource to colleagues for its practicality and support in real-case scenarios. The involvement of meaningful stakeholders in quality improvement initiatives is recommended to develop innovative clinical resources aimed at improving practice [49, 50]. An active engagement of potential users in the design of the resources can affect their behavior change more positively, favour the integration of resources in daily practice and is finally more likely to improve health-related outcomes and public health [51].

The I-CVI always above 0.9 and the S-CVI/Ave of 0.97 indicate the high degree of content information validity. The target of a S-CVI/UA above 0.80 was not reached [38]; this was somewhat expected due to the large number of external validators. However, the involvement of 15 external validators despite the fact that more than ten are probably unnecessary [52] was justified by the need to include professionals with different scope of practice who work in a wide array of clinical settings. This approach wants to sustain the core message that serious illness conversations are ubiquitous across several care settings and require a multidisciplinary team [5355]. Additionally, only two experts deemed some sections not relevant (one 6/17 and one 2/17) (S5 Table).

The booklet performed well in the product testing of readability and design that employed internationally accepted methods -Gulpease index and BALD criteria, respectively-. In general, an increase in readability leads to a shorter reading time, better memory of the content, and greater text comprehension [56]. Our booklet showed good readability (Gulpease index of 60), was perceived easy to read by over 80% (18/22) of the professionals and 15 (68%) agreed on high understandability. Gray and Leary identified four basic elements that influence the ease of reading: content, style, structure, and design [57]. Design should not be overlooked since sound design principles can help users to understand and use information [58, 59]. Consultation workshops arranged for the development of a resource to support person-centered conversations strongly recommend avoiding an arbitrary design that would reduce the usefulness and uptake among professionals [60]. Multiple adjustments were made to the design and layout of the booklet and a design agency was engaged to improve the production of quick-reading and visual-friendly solutions.

An ever-present barrier to serious illness conversations is the lack of time [34, 54, 61, 62] and professionals need to quickly identify information that answers specific communication challenges. A resource designed to support clinical practice must address this obstacle. In our booklet, each communication scenario is accompanied by practical hints, an infographic, and an example of good interaction. This reflects a time-based approach on conversations templates of 1, 2, and 5 minutes, respectively, according to the amount of time professionals have.

Most professionals perceived the booklet as useful (19/22) and gain in knowledge on how engaging in serious illness conversations (18/22), despite the generally long working experience. This suggests that though experience may be a valid aid in sustaining challenging conversations, it is not enough. An international study involving professionals who work in long-term settings across six European countries found that Italy scored the worst in self-efficacy regarding end-of-life communication [63]. These conversations are emotional and professionals need training and resources to acquire confidence; our booklet is the first resource in Italian language that offers professionals support.

The booklet strives for behaviour change and supports professionals overcoming individual-related barriers and timely initiating these conversations. Our resource is well-placed to promote changes in professional practice as suggested by addressing all the 12 domains identified to explain behavior change [27]. The booklet enhances knowledge to engage successfully in serious illness conversations, provides guidance for real-life difficult communication scenarios while ensuring readability and appealing design the positively influence the memory of the content, is consistent with professional identity and standard, and influences beliefs about capabilities and outcomes with most professionals reporting they would continue to use the resource and perceiving benefits in communication and relationships with families. Additionally, the booklet may stimulate reflection on professional competence and learning needs, enhance sensitivity on the topic of quality and timely communication, which triggers change in behavior, evoke emotions and behaviors related to previous communication experience while providing functional tools for their management, and propose desirable behaviors or instigate a process of social influence.

The booklet supports professionals to sustain serious illness conversations that mirror their most frequent challenges in daily practice and for each scenario offers 1-minute, 2-minute and 5-minute solutions. Communication scenarios are relevant to the professionals’ learning needs and priorities to prompt efforts in memorizing information and applying learning that is perceived relevant. Moreover, the opportunity to choose the template that best fits own routine increases the use of the booklet. The easily readable information and the user-friendly design promote the understandability of the booklet content. This helps professionals become more knowledgeable about how engaging in serious illness conversations and supports behavior change to improve practice and patient care [19]. The resource stimulates reflection on professional competence, learning needs, and motivation to enhance skills with reference to the professional standard. The high content information validity while employing communication scenarios set in multiple care settings (i.e., nursing home, oncology, and intensive care unit), as well as the involvement of professionals with different scope of practice and who work in different contexts across the development, validation, and evaluation of the booklet, suggests that the resource may be potentially useful irrespective of the professional profile and the setting of care. Finally, the collaboration between researchers, professionals, and lay stakeholders and the testing of the booklet using validated tools ensured the development of a resource of increased quality and utility.

The booklet presents a limited number of advanced chronic or terminal illnesses, but addresses the most frequent communication scenarios across different clinical settings and offers practical tips and examples of communication protocols that can be tailored to different chronic conditions. Moreover, issues related to communication with adults about an infant or child’s illness are not addressed. Parents are often scared, feel guilty, and may have difficulties retaining and processing information. When communicating to parents, professionals have to listen authentically, avoid judgement and act empathically to capture their history, values, perspectives and peculiarities that make one family different from another. Parents need to be supported and accompanied in the experience of their child’s illness, beyond receiving information that should be tailored with regard to content and modalities. Therefore, a specific resource to support communication in this setting is warranted. Secondly, the involvement of the design agency occurred late in the development process. Its integration from the outset of the project could have eased addressing the feedbacks and translating them into solutions. However, the design agency had received information on the objectives of the booklet and the main critiques emerged during its development, and the research team provided ongoing supervision. Thirdly, the evaluation of the booklet was mainly quantitative in nature, with professionals reporting ratings on acceptability, usefulness, feasibility of use, and acquire knowledge; despite professionals had the opportunity to report open comments and suggest changes, qualitative work could have contributed more deeply to identify nuances that benefit from improvements.

Conclusions

The booklet developed helps address the lack of support tools on serious illness conversations for Italian professionals and could potentially improve the quality of serious illness conversations.

The co-creation process yielded an acceptable resource with good readability and excellent design, high content validity, and a high degree of perceived usefulness and acquired knowledge. Also, the time-based solutions favor the use of the resource in daily practice. All these features make the booklet ideally positioned to encourage changes in professional practice and a valid resource to enhance shared decision-making and care planning. In addition, the booklet has good potential for a wider distribution, as it is available on the website of a high-profile Italian society of palliative care and can be downloaded for free. Finally, translation to English and social media campaigns beyond congress presentations are planned to promote dissemination.

Supporting information

S1 Table. Standards for Quality Improvement Reporting Excellence for Education (SQUIRE-EDU).

https://doi.org/10.1371/journal.pone.0304180.s001

(PDF)

S2 Table. Review of the principles or content of the main communication protocols and methods.

https://doi.org/10.1371/journal.pone.0304180.s002

(PDF)

S3 Table. Characteristics of the participants to the focus groups (n = 15).

https://doi.org/10.1371/journal.pone.0304180.s003

(PDF)

S4 Table. Characteristics of the external review board (n = 15).

https://doi.org/10.1371/journal.pone.0304180.s004

(PDF)

S5 Table. Clarity, coherence, relevance, and readability for each sub-section of the booklet.

https://doi.org/10.1371/journal.pone.0304180.s005

(PDF)

S6 Table. Layout and design characteristics of the booklet based on the Baker Able Leaflet Design (BALD) criteria.

https://doi.org/10.1371/journal.pone.0304180.s006

(PDF)

Acknowledgments

We would like to express our gratitude to all professionals and associations engaged in the development, validation, and evaluation of the booklet for their cooperation. We thank Ylenia Arnone and Alessio Turrini for their contribution in developing the booklet content, Alexandra Antal and Valentino Bissacca for their help in validating the resource, and Luisa Goglio for revising its design. Finally, we thank Dr. Nicola Cornally for her methodological guidance across the development and validation processes.

References

  1. 1. Kelley AS, Bollens-Lund E. Identifying the Population with Serious Illness: The "Denominator" Challenge. J Palliat Med. 2018;21(S2):S7–s16. pmid:29125784
  2. 2. Zoppi K, Epstein RM. Is communication a skill? Communication behaviors and being in relation. Fam Med. 2002;34(5):319–24. pmid:12038712
  3. 3. Browning DM, Meyer EC, Truog RD, Solomon MZ. Difficult conversations in health care: cultivating relational learning to address the hidden curriculum. Acad Med. 2007;82(9):905–13. pmid:17726405
  4. 4. Daubman BR, Bernacki R, Stoltenberg M, Wilson E, Jacobsen J. Best practices for teaching clinicians to use a serious illness conversation guide. Palliat Med Rep. 2020;1(1):135–42. pmid:34223467
  5. 5. Geerse OP, Lamas DJ, Sanders JJ, Paladino J, Kavanagh J, Henrich NJ, et al. A Qualitative Study of Serious Illness Conversations in Patients with Advanced Cancer. J Palliat Med. 2019;22(7):773–81. pmid:30724693
  6. 6. Prineas S, Mosier K, Mirko C, Guicciardi S. Non-technical Skills in Healthcare. In: Donaldson L, Ricciardi W, Sheridan S, Tartaglia R, editors. Textbook of Patient Safety and Clinical Risk Management. Cham: Springer International Publishing; 2021. p. 413–34.
  7. 7. Curtis JR, Downey L, Back AL, Nielsen EL, Paul S, Lahdya AZ, et al. Effect of a patient and clinician communication-priming intervention on patient-reported goals-of-care discussions between patients with serious illness and clinicians: a randomized clinical trial. JAMA Intern Med. 2018;178(7):930–40. pmid:29802770
  8. 8. Travers A, Taylor V. What are the barriers to initiating end-of-life conversations with patients in the last year of life? Int J Palliat Nurs. 2016;22(9):454–62. pmid:27666307
  9. 9. Gonella S, Basso I, Clari M, Dimonte V, Di Giulio P. A qualitative study of nurses’ perspective about the impact of end-of-life communication on the goal of end-of-life care in nursing home. Scand J Caring Sci. 2021;35(2):502–11. pmid:32343871
  10. 10. Stiefel F, Kiss A, Salmon P, Peters S, Razavi D, Cervantes A, et al. Training in communication of oncology clinicians: a position paper based on the third consensus meeting among European experts in 2018. Ann Oncol. 2018;29(10):2033–6. pmid:30412225
  11. 11. Beddard-Huber E, Fyles G, Tayler C, Barwich D, Hassan E, Ma SD. Implementation of the serious illness conversation program–lessons learned from a canadian provincial health system. 2020. Available from: https://www.bc-cpc.ca/wp-content/uploads/2021/05/BCCPC-Implementation-of-the-Serious-Illness-Conversation-Program.pdf
  12. 12. Bernacki R, Paladino J, Neville BA, Hutchings M, Kavanagh J, Geerse OP, et al. Effect of the serious illness care program in outpatient oncology: a cluster randomized clinical trial. JAMA internal medicine. 2019;179(6):751–9. pmid:30870563
  13. 13. McGlinchey T, Mason S, Coackley A, Roberts A, Maguire M, Sanders J, et al. Serious illness care Programme UK: assessing the ‘face validity’, applicability and relevance of the serious illness conversation guide for use within the UK health care setting. BMC Health Services Research. 2019;19:1–9. pmid:31196072
  14. 14. White SJ, Condon B, Ditton-Phare P, Dodd N, Gilroy J, Hersh D, et al. Enhancing effective healthcare communication in Australia and Aotearoa New Zealand: Considerations for research, teaching, policy, and practice. PEC Innov. 2023;3:100221. pmid:37822775
  15. 15. Gonella S, Basso I, Dimonte V, Martin B, Berchialla P, Campagna S, et al. Association between end-of-life conversations in nursing homes and end-of-life care outcomes: a systematic review and meta-analysis. J Am Med Dir Assoc. 2019;20(3):249–61. pmid:30470575
  16. 16. Borghi L, Meyer EC, Vegni E, Oteri R, Almagioni P, Lamiani G. Twelve Years of the Italian Program to Enhance Relational and Communication Skills (PERCS). Int J Environ Res Public Health. 2021;18(2). pmid:33429873
  17. 17. Paladino J, Kilpatrick L, O’Connor N, Prabhakar R, Kennedy A, Neal BJ, et al. Training clinicians in serious illness communication using a structured guide: evaluation of a training program in three health systems. J Palliat Med. 2020;23(3):337–45. pmid:31503520
  18. 18. Shi S, Keeney T, Ritchie C. Advancing Communication and Decision-making for Older Adults Discharged to Skilled Nursing Facilities-Not Where but Why? JAMA Intern Med. 2022;182(11):1115–6. pmid:36121670
  19. 19. Giguère A, Zomahoun HTV, Carmichael PH, Uwizeye CB, Légaré F, Grimshaw JM, et al. Printed educational materials: effects on professional practice and healthcare outcomes. Cochrane Database Syst Rev. 2020;8(8):Cd004398. pmid:32748975
  20. 20. Paladino J, Koritsanszky L, Nisotel L, Neville BA, Miller K, Sanders J, et al. Patient and clinician experience of a serious illness conversation guide in oncology: a descriptive analysis. Cancer medicine. 2020;9(13):4550–60. pmid:32363775
  21. 21. Lakin JR, Koritsanszky LA, Cunningham R, Maloney FL, Neal BJ, Paladino J, et al. A systematic intervention to improve serious illness communication in primary care. Health Aff (Millwood). 2017;36(7):1258–64. pmid:28679813
  22. 22. Lamas DJ, Owens RL, Nace RN, Massaro AF, Pertsch NJ, Moore ST, et al. Conversations about goals and values are feasible and acceptable in long-term acute care hospitals: a pilot study. J Palliat Med. 2017;20(7):710–5. pmid:28437209
  23. 23. Aaronson EL, Greenwald JL, Krenzel LR, Rogers AM, LaPointe L, Jacobsen JC. Adapting the serious illness conversation guide for use in the emergency department by social workers. Palliat Support Care. 2021;19(6):681–5. pmid:34140064
  24. 24. Merrill MD. A task-centered instructional strategy. Journal of research on Technology in education. 2007;40(1):5–22.
  25. 25. Oxman AD, Thomson MA, Davis DA, Haynes RB. No magic bullets: a systematic review of 102 trials of interventions to improve professional practice. Cmaj. 1995;153(10):1423–31. pmid:7585368
  26. 26. Wensing M, van der Weijden T, Grol R. Implementing guidelines and innovations in general practice: which interventions are effective? Br J Gen Pract. 1998;48(427):991–7. pmid:9624774
  27. 27. Michie S, Johnston M, Abraham C, Lawton R, Parker D, Walker A. Making psychological theory useful for implementing evidence based practice: a consensus approach. Qual Saf Health Care. 2005;14(1):26–33. pmid:15692000
  28. 28. Gonella S, Di Giulio P, Berchialla P, Bo M, Cotogni P, Macchi G, et al. The Impact of Health and Social Care Professionals’ Education on the Quality of Serious Illness Conversations in Nursing Homes: Study Protocol of a Quality Improvement Project. Int J Environ Res Public Health. 2022;20(1). pmid:36613049
  29. 29. Ariadne Labs: A Joint Center for Health Systems Innovation and Dana-Farber Cancer Institute. Serious Illness Conversation Guide. 2015, upadate May 2023. Available at https://www.ariadnelabs.org/wp-content/uploads/2023/05/Serious-Illness-Conversation-Guide.2023-05-18.pdf
  30. 30. Tinetti M, Naik A, Dindo L. Conversation guide and manual for identifying patients’ health priorities. 2018. Available at https://patientprioritiescare.org/wp-content/uploads/2018/11/Conversation-Guide-and-Manual-for-Identifying-Patients27-Health-Priorities.pdf
  31. 31. Keller JM, Litchfield BC. Motivation and performance. Trends and issues in instructional design and technology. 2002;2:89–92.
  32. 32. Giannopoulos P, Mertens YJ, Secomandi LE, Olsder L, van Leeuwen BL. Development, validation and evaluation of a patient information booklet for rectal cancer survivors with a stoma: A three-step approach. Patient Educ Couns. 2021;104:2275–85. pmid:33685763
  33. 33. Ogrinc G, Armstrong GE, Dolansky MA, Singh MK, Davies L. SQUIRE-EDU (Standards for QUality Improvement Reporting Excellence in Education): publication guidelines for educational improvement. Acad Med. 2019;94(10):1461–70. pmid:30998575
  34. 34. De Vleminck A, Pardon K, Beernaert K, Deschepper R, Houttekier D, Van Audenhove C, et al. Barriers to advance care planning in cancer, heart failure and dementia patients: a focus group study on general practitioners’ views and experiences. PLoS One. 2014;9(1):e84905. pmid:24465450
  35. 35. Gonella S, Di Giulio P, Antal A, Cornally N, Martin P, Campagna S, et al. Challenges experienced by italian nursing home staff in end-of-life conversations with family caregivers during covid-19 pandemic: a qualitative descriptive study. Int J Environ Res Public Health. 2022;19(5). pmid:35270195
  36. 36. Flynn R, Albrecht L, Scott SD. Two approaches to focus group data collection for qualitative health research: maximizing resources and data quality. Int J Qual Methods. 2018;17(1):1609406917750781.
  37. 37. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative research in psychology. 2006;3(2):77–101.
  38. 38. Polit DF, Beck CT. The content validity index: are you sure you know what’s being reported? Critique and recommendations. Res Nurs Health. 2006;29(5):489–97. pmid:16977646
  39. 39. Lucisano P, Piemontese ME. GULPEASE: una formula per la predizione della difficoltà dei testi in lingua italiana. Scuola e città. 1988;3(31):110–24.
  40. 40. Tonelli S, Mahn KT, Pianta E. Making readability indices readable. In: Williams S, Siddharthan A, Nenkova A, editors. Proceedings of the first workshop on predicting and improving text readability for target reader populations. Canada: Association for computational linguistics; 2012, p. 40–8.
  41. 41. Baker SJ. Who can read consumer product information? The Australian Journal of Hospital Pharmacy. 1997;27(2):126–31.
  42. 42. O’Connor AM, Cranney A: Patient decision aids–Evaluation measures. User manual for acceptability. Ottawa, Canada: University of Ottawa, Ottawa Hospital Research Institute, 2002. https://decisionaid.ohri.ca/docs/develop/user_manuals/um_acceptability.pdf (Last accessed September 30, 2022).
  43. 43. Graham ID, Logan J, Bennett CL, Presseau J, O’Connor AM, Mitchell SL, et al. Physicians’ intentions and use of three patient decision aids. BMC Med Inform Decis Mak. 2007;7:20. pmid:17617908
  44. 44. Lopes MV, Silva VM, Araujo TL. Methods for establishing the accuracy of clinical indicators in predicting nursing diagnoses. Int J Nurs Knowl. 2012;23(3):134–9. pmid:23043652
  45. 45. Stacey D, Lewis KB, Smith M, Carley M, Volk R, Douglas EE, et al. Decision aids for people facing health treatment or screening decisions. Cochrane Database Syst Rev. 2024;1(1):Cd001431.
  46. 46. Prior SJ, Mather C, Ford K, Bywaters D, Campbell S. Person-centred data collection methods to embed the authentic voice of people who experience health challenges. BMJ Open Qual. 2020;9(3). pmid:32699082
  47. 47. Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving Research Impact Through Co-creation in Community-Based Health Services: Literature Review and Case Study. Milbank Q. 2016;94(2):392–429. pmid:27265562
  48. 48. Jagosh J, Macaulay AC, Pluye P, Salsberg J, Bush PL, Henderson J, et al. Uncovering the benefits of participatory research: implications of a realist review for health research and practice. Milbank Q. 2012;90(2):311–46. pmid:22709390
  49. 49. Price A, Clarke M, Staniszewska S, Chu L, Tembo D, Kirkpatrick M, et al. Patient and Public Involvement in research: A journey to co-production. Patient Educ Couns. 2022;105(4):1041–7. pmid:34334264
  50. 50. van Deventer C, McInerney P, Cooke R. Patients’ involvement in improvement initiatives: a qualitative systematic review. JBI Database System Rev Implement Rep. 2015;13(10):232–90. pmid:26571293
  51. 51. Halvorsrud K, Kucharska J, Adlington K, Rüdell K, Brown Hajdukova E, Nazroo J, et al. Identifying evidence of effectiveness in the co-creation of research: a systematic review and meta-analysis of the international healthcare literature. J Public Health (Oxf). 2021;43(1):197–208. pmid:31608396
  52. 52. Lynn MR. Determination and quantification of content validity. Nurs Res. 1986;35(6):382–5. pmid:3640358
  53. 53. Anderson RJ, Bloch S, Armstrong M, Stone PC, Low JT. Communication between healthcare professionals and relatives of patients approaching the end-of-life: a systematic review of qualitative evidence. Palliat Med. 2019;33(8):926–41. pmid:31184529
  54. 54. Gonella S, Conti A, Albanesi B, Antal A, Dimonte V, Di Giulio P. Lived experiences of end-of-life communication among nursing home staff: An interpretive phenomenological study. J Adv Nurs. 2023;79(2):698–710. pmid:36447384
  55. 55. Towsley GL, Hirschman KB, Madden C. Conversations about End of Life: Perspectives of Nursing Home Residents, Family, and Staff. J Palliat Med. 2015;18(5):421–8. pmid:25658608
  56. 56. DuBay WH. The principles of readability. Impact Information, Costa Mesa;2004.
  57. 57. Gray WS, Leary BE. What makes a book readable. University of Chicago Press;1935.
  58. 58. Ancker JS, Kaufman D. Rethinking health numeracy: a multidisciplinary literature review. Journal of the American Medical Informatics Association. 2007;14(6):713–21. pmid:17712082
  59. 59. Baxter M, Lonsdale MdS, Westland S. Utilising design principles to improve the perception and effectiveness of public health infographics. Information Design Journal. 2021;26(2):124–56.
  60. 60. Reid H, Caterson J, Smith R, Baldock J, Jones N, Copeland R. What dohealthcare professionalswant from a resource to supportperson-centred conversations onphysical activity? A mixed-methods, user-centric approach to developing educational resources. BMJ Open Sport Exerc Med. 2022;8(2):e001280. pmid:35813130
  61. 61. Evenblij K, Ten Koppel M, Smets T, Widdershoven GA, Onwuteaka-Philipsen BD, Pasman HRW. Are care staff equipped for end-of-life communication? A cross-sectional study in long-term care facilities to identify determinants of self-efficacy. BMC palliative care. 2019;18:1. pmid:30621703
  62. 62. Saretta M, Doñate-Martínez A, Alhambra-Borrás T. Barriers and facilitators for an effective palliative care communication with older people: A systematic review. Patient Educ Couns. 2022;105(8):2671–82. pmid:35459530
  63. 63. Ten Koppel M, Onwuteaka-Philipsen BD, van der Steen JT, Kylänen M, Van den Block L, Smets T, et al. Care staff’s self-efficacy regarding end-of-life communication in the long-term care setting: Results of the PACE cross-sectional study in six European countries. Int J Nurs Stud. 2019;92:135–43. pmid:30822706