There is a need for structure to achieve functional patient engagement within mental healthcare organizations, and for clarification on how to proceed on a strategic level. The aim of this paper is to shed light on the implementation of a strategic organizational structure for patient engagement in mental health by examining why and how to implement a structure, the organizational and environmental factors that facilitate or limit the process, and the perceived consequences of the implementation.
This paper evaluates the implementation of a strategic committee for patient engagement in a mental healthcare organization in Montreal (Quebec, Canada). The research was designed as a qualitative single case study using a deductive approach by means of a conceptual framework. Data sources consisted in ten semi-structured interviews, three focus groups, and organizational documents.
The strategic committee for patient engagement was implemented as a means to formalize patient partner participation, following the introduction of a vision of full citizenship. Important aspects of its implementation included its composition and role, the elaboration of a framework for patient partner participation, and finally, ongoing application and evaluation of the framework. Several facilitating factors were identified, including executive management support, leadership, and a vision behind the participation. Limiting factors mainly consisted of resistance towards patient participation and the existence of stigma. Consequences included increased and improved patient engagement, as well as reduced stigma within the organization.
This study shows that the implementation of a strategic organizational structure for patient engagement is comprehensive. It further shows the importance of a vision and an articulate leadership involving several actors. Further research is needed regarding the impact of this type of strategic structure on a clinical level.
Citation: Ewalds Mulliez A-P, Pomey M-P, Bordeleau J, Desbiens F, Pelletier J-F (2018) A voice for the patients: Evaluation of the implementation of a strategic organizational committee for patient engagement in mental health. PLoS ONE 13(10): e0205173. https://doi.org/10.1371/journal.pone.0205173
Editor: Marianne Storm, Universitetet i Stavanger, NORWAY
Received: January 15, 2018; Accepted: August 31, 2018; Published: October 24, 2018
Copyright: © 2018 Ewalds Mulliez et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information file.
Funding: This paper is part of a research project funded by the Canadian Institutes of Health Research. Grant number: 201311PHE-318871-PHE-CFCA-119899. Website: http://cihr-irsc.gc.ca/e/193.html. MPP received the funding. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
In recent years, the patient engagement approach has been studied frequently within various areas of the healthcare system. There is a consensus in the literature on the importance of engaging patients in different ways within the healthcare system to improve quality of care and positively affect other elements at both the individual and organizational levels [1, 2]. As has been frequently noted, involving patients in decision-making has to go beyond merely symbolic participation without an actual role for the patients [3, 4]. There is a need for further clarification regarding patient engagement and for a context-sensitive approach, involving several interconnected elements [5, 6].
Patient engagement within mental health
Reviewing the literature on patient engagement, specifically within mental health, reveals additional considerations. Patient engagement is often discussed in connection with challenges linked to traditional perceptions of mental illness and the limitations that they impose on patients; for example, in terms of inequality within power-relations  and stigmatization . When it comes to stigma, these perceptions can be expressed through negative paternalistic attitudes towards the capacity of the mentally ill to take part in decision-making . Progress has been made on these fronts by incorporating patient engagement as a fundamental part of notions such as recovery and citizenship , two approaches aiming to promote full community inclusion and participation despite or beyond enduring negative perceptions of mental illness . Recovery involves retrieving important aspects of everyday life that were lost through mental illness, even as the illness persists , while citizenship takes a larger perspective, encouraging patients to function as regular citizens within society, but still with due respect to the diversity they may represent collectively [13, 14]. Similarly, the “citizen psychiatry” approach, developed in France, involves active social inclusion of mental health service users . In the context of Quebec, the most recent Mental Health Action Plan (MHAP) incorporates patient engagement under its goal for all to be considered citizens . While the importance of patient engagement within mental health is clear, the question of how to proceed in practice needs further clarification [16–18]. There are several different models or methods for involving patients in mental health organizations, both at the individual level and at a broader level [19, 20]. This paper focuses on the latter.
How to implement patient engagement
The literature indicates that patient engagement requires a certain support or structure in order to work well within mental health organizations, which means explicit actions need to be taken in this direction [2, 16, 21, 22]. Elements of successful patient participation that are frequently cited include actor preparation, support mechanisms, and resource allocation [20, 23]. These positive ingredients must be successfully combined, while overcoming the negative influences prevailing both within the organization and in society at large . The literature provides examples of various patient engagement initiatives in mental health settings where local participatory structures have been created within organizations, such as councils and committees including patients [24, 25]. However, it is also necessary to zoom out from individual participation initiatives to adopt a larger vision of functioning patient engagement . There is less evidence in the literature on establishing patient engagement structures on a strategic level to improve patient engagement across an entire organization. This knowledge gap has also been identified by Rise, Solbjør, and Steinsbekk , who investigated the implementation of an organization-wide strategy for patient engagement. A few studies have taken a wider organizational perspective, focusing on the establishment of a structure for the benefit of patient engagement [23, 26–29]. These studies, however, are not explicit regarding the theoretical foundations on which they rest, a key element when studying the implementation of interventions within healthcare organizations .
The aim of this paper is to shed light on patient engagement in mental health, more specifically, the implementation of a structure for patient engagement on a strategic organizational level. To this end, a case study was carried out. The paper will address the following research questions:
- Why and how to implement a strategic structure for patient engagement within a mental healthcare organization?
- What organizational and environmental factors facilitate or limit the implementation?
- What are the perceived consequences of the implementation?
A conceptual framework was used to study the implementation process of a strategic structure for patient engagement, the influential organizational and environmental factors, as well as the consequences of implementation (Fig 1). Although there are a range of frameworks illustrating different aspects of implementation of innovation and change within healthcare , the body of knowledge specific to the process of implementation within mental healthcare organizations needs further development . For this reason, the model by Rogers , which depicts the innovation process in a general way and leaves the content of each stage to be discovered, seems appropriate. Rogers describes the model as being composed of two parts: one addressing the rationale for the innovation constituting its initiation, and the other covering the actual implementation where the innovation is operationalized. In the conceptual framework of this study, the term “operationalization” is used instead of “implementation” as in the model by Rogers. This adaption has been done in order to illustrate that the implementation process consists of both initiation and operationalization. The first part of Rogers’ model includes agenda-setting and matching: identifying the need for innovation, as well as planning and designing the innovation in accordance with this need. Hence, deciding whether to continue with the subsequent stages or not occurs in the first part. The second part of the model consists of the stages of redefining/restructuring, clarifying, and routinizing: mutually adjusting the innovation and organization to each other, further structuring the innovation, and finally integrating it with the organization. It should be noted that the implementation process in healthcare is non-linear [31, 34].
The inner sphere illustrates the organization where the implementation process of the structure takes place, while the outer sphere refers to the environment of the organization. Both spheres contain factors influencing the process. The stages of the implementation process belong to initiation (I) or operationalization (O) of the structure. The consequences of the implementation are situated to the right. (Adapted from Rogers , Pomey et al. , Brooks et al.  and Mendel et al. ).
Factors that influence the implementation process can be either internal/organizational or external/environmental [35, 37–40]. A host of organizational factors are identified in the literature. Pomey et al.  categorized these factors under the four groupings of culture, governance, tools, and resources. It is also important to consider the specific context of this field and to look beyond the organization when studying the implementation of innovations within mental health [32, 36]. Environmental influences on the process of implementation include factors such as mental health policy, different social aspects of mental health (e.g., norms, attitudes, stigmatization, social exclusion) [32, 36], and various actors operating in connection with an organization .
This paper evaluates an initiative through which a strategic committee was implemented to structure patient engagement within a large public mental healthcare organization in a metropolitan area of Montreal, in the province of Quebec, Canada. The organization provides both inpatient and outpatient services, and comprises different administrative and clinical departments. Healthcare is provided through specific clinical programs in psychiatry, as well as certain general healthcare services. The organization also conducts research and teaching activities. A strategic committee was established as a formal structure to support the participation of patient partners in different activities within the organization. The committee includes representatives from several of the administrative and clinical departments, as well as user and patient representatives. A single-case study was conducted, and various means of data collection were used to explore the implementation process of the strategic committee within the organization [41, 42]. The study was retrospective in nature, studying events that have taken place between 2008 and 2015. A qualitative approach was used to obtain multiple perspectives on the implementation process, and a deductive analysis was carried out with the conceptual framework as a base . Other elements of patient engagement, such as recovery mentors , exist within the studied organization, but are outside the scope of this paper.
The data was collected through interviews, focus groups, and an analysis of organizational documents. Data collection took place between December 2015 and August 2016. A total of 27 individuals participated in the study. The participant categories were (several participants belonged to more than one category): patient partners (n = 7), a member of the users committee (n = 1), recovery mentors (n = 3), members of executive management (n = 2), researchers (n = 2), a clinician (n = 1), senior managers in departments (n = 5), middle managers in departments (n = 4), project managers (n = 2), and clinical administrative managers in clinical programs (n = 3). Ten semi-structured interviews , lasting approximately 60 minutes, were conducted with participants who had been involved in implementing the committee (members of executive management, managers, patient partners, researchers, one clinician, and one member of the users committee), several of whom were members of the committee. Two of the interviews involved two participants at the same time for logistical reasons. Three focus groups of 120 minutes each were also conducted as part of data collection: the first with nine actors (mainly managers, but also recovery mentors) taking part in patient engagement in different ways within the organization, the second with four patient partners, and the third with nine different actors (patient partners, managers, and recovery mentors) involved in patient engagement and, in most cases, in implementing the committee. An objective of the first focus group was to narrow down the scope of the research project, while the last group also served to validate the research team’s understanding of the previously collected data. Guides for the interviews and focus groups were developed, then validated during meetings of the research team. The interview guide was modified as deemed appropriate after the first interviews carried out in December 2015 . All guides were based on the same themes from the conceptual framework (stages of implementation, factors, and consequences), allowing for the process to be examined through various perspectives. Finally, an analysis was conducted of relevant organizational documents (annual reports of the organization, organizational charts, newsletters, various publications, annual reports of committees, an evaluation report concerning patient partner participation, meeting minutes, presentations, and working documents). The collection of diversified data allowed for triangulation [41, 43].
Participants were recruited with the help of the research team’s main contacts at the organization. An initial list was assembled, containing participants who could provide information on the studied events. As data collection proceeded, further participants were recruited through the “snowball” method as long as they were vetted as being able to provide significant contributions . Participants were contacted via telephone or e-mail by a member of the research team, except for the participants of two of the focus groups, who were invited by contacts at the organization.
The interviews and focus groups were recorded and transcribed, and all data were analyzed following the iterative process of Miles and Huberman for qualitative studies , using the qualitative data analysis software package QDA Miner 4.0  (see Table 1). The first author coded and compiled the data, while the second and fourth authors also coded two interviews and one focus group to validate the attribution of codes. All authors verified the results emerging from the analysis.
Ethical approval was obtained from the University of Montreal Health Sciences Research Ethics Committee (14-127-CÉRES-D), and from the ethics committee of the Centre hospitalier de l'Université de Montréal (MP-02-2015-5710—CE.14.232), which handled the multi-site certification of the research project. Written informed consent was obtained from all participants of the study.
The conceptual framework is used as a foundation to present the results, starting with the five-stage implementation process of the strategic committee, followed by organizational and environmental factors of influence, and finally, the consequences of implementation.
Implementation process of the committee
The first two stages of the implementation process (agenda-setting and matching) contain two overlapping chains of events leading to the creation of the strategic committee, while the following three (redefining/restructuring, clarifying and routinizing) cover the establishment and activity of the committee.
The first stage of implementation involved launching patient partner participation within the organization (the term patient partner is used for patients participating in various activities). This included identifying the need for a formal structure and opportunities for realizing it.
This stage saw the beginning of two overlapping chains of events. First, following the inclusion of the notion of recovery in the Quebec MHAP for 2005–2010 , which entails patient participation at an organizational level, the management of one clinical department took the initiative of involving patients in the design and the organization of services. A reflection regarding recovery and how to go about involving patients was undertaken within this department, together with actors from the research department. The process was described as “action-research”, as the ongoing reflection was complemented by initial experiences of patient involvement. Many questions were raised:
“[…] ‘who do I invite? Why do I invite them? Should they be paid? How will the others react?’ So, we were stuck with all these questions, but we really did it sort of as ‘action-research’. We told ourselves: ‘Well, we’ll figure it out, we’ll start integrating them.’” (Interview 75, non-patient)
Actors in the above-described reflection wanted the participation of patient partners to work well, in addition to capturing and leveraging their experience as patients when involving them. The initiating department organized training for personnel and patient partners, in collaboration with a provincial mental health association with expertise in involving patients. Furthermore, a partly independent self-help group run by patients was formed to discuss recovery and help develop the participation of patient partners. This self-help group also constituted the pool of patient partners at the time, which implied them participating in different activities within the organization.
Thus, a structure for participation began to take shape, which included developing a policy and arranging for patient partners to be compensated for their time. However, it was recognized that the process would have to be further formalized, including evaluation, to function well, as ethical concerns were raised. Indeed, with regards to the psychological safety, getting engaged as a mental health patient in discussions on patients’ experience could sometimes rekindle painful memories. While assuming leadership and responsibility, the involved actors were aware that the engagement procedure should not and could not be improvised given the identified psychological risks.
“There were already patients that were integrated within patient-partnership activities, within committees. They felt a need to formalize all of that…” (Interview 73, patient partner)
The second chain of events concerned actions at a strategic level that took place starting in 2010. Key actors in the organization created an opportunity to set up a formal structure for participation, making it an institutional priority. A member of the research department–already involved in discussing patient participation–introduced a new angle to recovery by combining it with another approach: citizen psychiatry. This inspired a member of executive management (the deputy CEO, who became CEO later in the process), who had already identified a need for an overall organizational change, to push for a transition away from traditional functioning towards becoming a university institute. Observing that the recovery approach alone did not work in the context of Quebec, an effort was led to develop a concept combining elements of both citizen psychiatry and recovery.
“Recovery, which is an American movement to which the francophone milieu did not at all adhere, zero…” (Interview 72, non-patient)
Indeed, although there was an openness to the underlying values and principles of the English-American concept of recovery, one of the core priorities of the MHAP, there was a need to adapt it to eventually apply it in a French-speaking area in Montreal.
This stage involved exploration concerning recovery and citizen psychiatry, leading to the creation of the strategic committee for patient engagement. Several key actors from previous discussions (from the initiating department, the research department, and executive management) worked together on how to develop the notions of recovery and citizen psychiatry within the organization. This investigative work involved deliberation, observation, and conceptualization presented subsequently in the three following paragraphs.
These key actors organized a civic forum to discuss recovery and citizen psychiatry. The forum consisted of presentations and discussions involving different participants: patients (some of whom were also presenting), executive management and other employees, community organizations, patient organizations, and international actors. It led to a deeper exploration of the subject and increased collaboration both inside and outside the organization.
After the forum, field research visits were organized to observe examples of recovery and citizen psychiatry. To see how services could be dispersed throughout the city instead of being confined to specialized settings, a trip to France was organized, with a wide range of participants. This trip figured prominently in the collected data. Patients (n = 3), researchers (n = 2), managers, including executive (n = 4), clinicians (n = 2), project managers (n = 3), and family members (n = 2) spent one week studying the French implementation of citizen psychiatry. While the first stop of the trip involved observing the approach within an organizational setting, the second stop provided an inspirational look at the integration of patients within the community. However, much of the significance of this trip derived from the experience of travelling together. The equality between all participants was described as eye-opening, considering how far from equal the relationship between patients, health professionals, and other personnel was in the everyday functioning of their own organization.
“. it was completely transformative…, we lived for a week together, all of us. […] For a week, we ate all our meals together, we slept at the same place, we spent our days together, we waited for the train together. It really changes the relationship with… even with the professionals, the physicians, all of that.” (Interview 71, non-patient)
Following this experience, the previously mentioned key actors conceived an approach adapted to their organization. A new clinical vision centered on full citizenship  was formally included in the organization’s strategic plan to promote full community inclusion and participation, in decision-making and planning processes of the institution as well as in collaboration with the surrounding community and other partners through civic forums. The vision was full citizenship for all, founded on the participation of patients at various levels.
“…the thing about recovery centred on the individual, and the more public citizen approach, is that we can support individuals in having an influence on social determinants and public action. That is how we combine them.” (Interview 70, non-patient)
With the introduction of this vision, initiatives to involve patient partners in different activities increased across the organization. The same member of the research department was given a mandate from executive management, along with funding, to realize the participation of patients according to the new vision of full citizenship.
At this point, the two chains of events converged, i.e., the identified need for a formal and safer structure for the participation of patient partners within the organization, and the opportunity to create it (see the agenda-setting stage). The mandate for realization of patient engagement took concrete form through the creation of an organizational committee to frame participation in line with the new vision.
“We involved patients, but at the same time… we had a bunch of questions for which we did not have answers. So, at one point, there was a need for a space to reflect on this properly, and since it had worked well in the beginning, we told ourselves: ‘If we want it to last, we need to create an official committee’. To have a budget, for it to not go off in all kinds of directions, for people to feel good about participating, and also… so that we weren’t doing patient partners just because it’s good for institutional appearances.” (Interview 75, non-patient)
This stage involved establishing the strategic committee for patient engagement and determining its role. It should be noted that the events and actions of the two last stages of implementation (clarifying and routinizing) also took place during the same time period as the current stage, 2011–2015.
The committee was described as developed “in action”. The collaboration between two key actors continued (from the initiating department and the research department), as they took on leadership roles as co-chairs of the committee in the beginning. The composition of the committee gradually evolved as other representatives were invited, to finally comprise eight members. The committee’s representativeness was discussed; there was a desire to have a wide range of perspectives from within the organization to better promote the participation of patient partners. To this end, the committee included members from several different departments (research, support for social integration, teaching, clinical services) and from the organization’s users committee, while a patient partner was assigned to the role of coordinator. This patient partner was also co-director of a user-led private non-profit organization created in parallel with the committee, where patient partners promote and transact their experiential knowledge through, among others, participatory research. Eventually, another patient partner was recruited, who was also a member of the previously created semi-independent self-help group (this person subsequently also joined the board of directors of the non-profit organization).
“We had decided that ideally we should have two patient partners on the committee, so that people would not feel intimidated, would feel that there is a peer that can understand them.” (Interview 73, patient partner)
Among the members from different departments were two clinical psychologists by training as representatives of clinicians, however, at the time, they were assigned to clinical-administrative work rather than clinical work per se. A few members changed over time, and a fresh perspective was ensured by regularly rotating the committee chair.
“This committee changed chairperson every two years to ensure that the concept spread out in all the departments.” (Interview 81, non-patient)
The committee was linked to and reported to executive management.
“We deemed, within the committee, that it was necessary to have a direct link to executive management. For the committee to be transversal within the institute, not dependent on one particular program.” (Interview 73, patient partner)
The first meeting of the committee took place in the Fall of 2011. Meetings were held six times per year on average. In the beginning, the committee focused on formulating its mandate. Its aims were to promote, document, and evaluate the participation of patient partners, and to establish a policy for participation. This included serving in an advisory capacity to executive management. The committee had a broad role, described as both supervisory and consultative, functioning both as a “watch dog” and a “guide”, aiming to support patient partner participation within the organization. The role was amended as the work of the committee progressed.
Each year, upon request from the committee, executive management allocated a budget for the compensation of patients participating within the organization (ranging from CAD$5,000 in 2011/2012 to $15,000 in 2014/2015). The hospital’s foundation provided additional funding, covering costs beyond the actual participation of patient partners such as transport to activities taking place outside the organization.
Using the previous, more informal structure for the participation of patient partners as a starting point, the committee proceeded to articulate how it should be framed in the light of full citizenship. This stage involved two main tasks: the creation of functioning conditions for the participation of patient partners, and communication and promotion.
The committee developed a centralized system as a framework for participation activities by establishing: 1) A formal policy, including practical functional procedures for participation, which were illustrated in a chart (a document detailing the different steps and the roles of the actors involved). The policy had already been elaborated before the formalization of the committee, but was revised and adjusted at this point. 2) Standard forms for requesting the participation of a patient partner and for compensation. These were made available through the intranet, to be used by different actors within the organization wishing to involve a patient partner in an activity. 3) A tracking document for closer monitoring of participation activities and related compensation, which was created as part of budget management.
The committee’s work was characterized by ongoing reflection and discussion. Clarifications were made along the way, for example, regarding aspects of the procedures, the terminology used (patient instead of user, indemnity instead of payment), and the budget (compensation amounts, attribution guidelines, and fiscal considerations). The committee also sought to understand the functioning of patient partner participation, through internal research and collaboration with research projects within the organization. There was a desire for participation to function well, and for patients to not just go through the motions and receive a cash indemnity.
“Of course, for us to approve a patient-partnership activity, it had to promote the full citizenship of the users involved […] and take advantage of their experiential knowledge.” (Interview 73, patient partner)
“Although included in the accreditation, putting a patient on a committee doesn’t mean anything. […] There has always been a preoccupation, we’ve always done a follow-up, with the patients, and with the manager or clinician initiating the committee…” (Focus group, non-patient)
Different challenges emerged along the way, leading to the committee reflecting on ethics. This concerned, for example, the timing of the indemnity (direct or delayed) so that the motivation to participate was not linked to satisfying primary needs, and how to act when a patient partner seemed to be in difficulty when participating.
“And what we saw is that at times when people, users, spoke in public, they were stressed, since some people are nervous. Sometimes to the point that they seemed lost, they no longer made sense. At that point, we, in the committee, asked ourselves: ‘What do we do in these types of situations? Do we take away the microphone, something we would not do with a psychiatrist […]?’ So, the committee would think about these challenges.” (Interview 70, non-patient)
More functional aspects were also dealt with, for example patient representativeness, an issue that arose when the same patients were assigned repeatedly. This was a concern raised by several interviewees.
“We need to switch patient partners, because otherwise we will always come back to the same viewpoint […]. That’s what worried me a little more, since it’s like with professionals, we have our professional views. If it’s always this same user on all the committees, well, it’s their experience, but it’s not representative of others…” (Interview 74, non-patient)
In line with the vision of full citizenship, the committee wanted to make the role of the patients more equal to those of other actors within the organization. It brought attention to physical places and activities where patients were not allowed. One example, pointed out by a patient partner on the committee, was lack of access to the documentation centre. This struck the committee as paradoxical, since the patients that participated in various activities also needed documentation resources. The experience also highlighted the important role of the patients.
“Because we don’t see it anymore. It takes patients to denounce it or to bring attention to things like that.” (Interview 70, non-patient)
The committee members informed the rest of the organization about their role, sharing policies and procedures. Annual reports were produced to summarize their activities and accomplishments, as well as the various participation activities taking place within the organization. They also promoted both their own work and the participation of patient partners, for example through presentations at conferences, orientation days for new employees, and promotional banners. These types of activities also aimed to “destigmatize” mentally ill persons. Promotion took place both inside the organization and, increasingly, on the outside, extending even to exchanges with international actors. Patient partners, both members of the strategic committee and others, were involved in all of these activities.
During this stage, the procedures for patient partner participation were applied on an ongoing basis, an evaluation mechanism was created, and participation continued to increase.
The participation activities within the organization passed through the committee and followed the procedures they had established. At this point, the procedures for participation, which had been developed and gradually improved by the committee, were described as well- functioning.
“It was integrated into the whole system. Whether it was a public conference, a management committee on the organization of services, the welcoming of employees, in many areas. It was logical, it was natural to say that a patient partner was integrated […] ‘did you pass by the patient partner kiosk?’ It was a reflex.” (Focus group, non-patient)
The framework for participation activities relied on the ongoing administrative work of a few members of the committee, including the coordinator, and consisted in handling the procedures for participation: 1) When a health professional or manager within the organization wished to involve a patient in an activity, a request form was filled out on the intranet and automatically transferred to the committee. 2) The request was processed (approved or refused), and 3) for approved cases, a patient partner, either chosen by the committee or identified by the person making the request, was assigned. Many patient partners came from the self-help group and the user-led private non-profit organization, but health professionals and managers also referred patients. 4) Preparation for participation (e.g., reading material) was handled by the person requesting the participation, with the committee available for support. 5) After the participation, the committee received satisfaction surveys filled out by both the patient partner and health professional or manager, for follow-up. These surveys provided insight to the committee on the participation and how it could be improved so that patients could truly take part in the activities. Patient partner compensation and the administration of satisfaction surveys were handled by executive management in the beginning, but were eventually taken over by the committee coordinator, who also was a certified recovery mentor paying particular attention to the comfort of patient partners in their engagement.
Based on these procedures, including the satisfaction surveys, an evaluation mechanism was developed. The committee formed a sub-committee (which included both patient partner members) responsible for evaluating the satisfaction of health professionals, managers, and patient partners involved in participation activities. In addition to the satisfaction surveys, focus groups were carried out. This provided feedback regarding different aspects of the procedures and the participation itself. For example, a need was identified for better preparation prior to participation activities.
Although policy and procedures were developed, certain aspects remained informal, for example, the criteria for recruitment of patient partners.
The participation activities, which took place both inside and outside the organization, touched many different areas: organization of services, research, teaching, evaluation, and others (see Table 2).
The level of patient participation within the organization facilitated through these procedures doubled from 2011 to 2014. Both the number of activities and the number of patient partners increased (27 activities and 30 patient partners in 2011/2012 versus 60 activities and 67 patient partners in 2013/2014). The activities often involved several patient partners at the same time, and could be punctual or take place over several occasions. More and more actors within the organization requested patients for participation, and resistance towards the practice lessened, as reported by several interviewees. However, patient partners also expressed a wish for more participation.
This positive trend ended with the arrival of a reform of the Quebec healthcare system in 2015 , leading to the organization merging with others. Before the reform came into force, a decrease in the number of participation activities was observed, and a discussion began on how to ensure continued activity of the committee and how to spread this strategic patient engagement practice over a larger scale within the new organizational structure.
Facilitating and limiting factors
Several organizational and environmental facilitating and limiting factors were identified, as described below (see Table 3).
A key facilitating organizational factor was continual support from executive management throughout the initial development of patient partner participation, the elaboration of the full citizenship vision, and the establishment of the committee. This support was realized effectively by keeping the committee connected to executive management and allocating a budget for their activity. Management support within the initiating department was also determinant for the start of patient partner participation.
“… we were supported by executive management, by our managers […] also by his own boss the CEO at the time. You cannot sustain something that complex, overcoming resistance, if it is not endorsed by executive management.” (Focus group, non-patient)
“The whole board of directors of the hospital was inspired by these new ways of doing things.” (Interview 71, non-patient)
Strong leadership and dedication from the key actors in executive management and the research department were essential in elaborating the vision of full citizenship. There was also a shared leadership and understanding (“common philosophy”) among the initial members (the co-chairs) of the committee, which facilitated its creation through a collaboration of management and research.
“…So, we joined forces to be able to create this unity to sustain the process.” (Focus group, non-patient)
Furthermore, the vision of full citizenship enabled a cultural change within the organization, which helped the establishment of the committee and its work.
“… what is important, is what made it work. We were supported by executive management, it was implemented in the organizational culture, we talked about full citizenship, there was a clinical vision accompanying these activities…” (Focus group, non-patient)
The committee’s work was also facilitated by individuals who became “standard-bearers” of the vision of full citizenship within the organization (many of them having participated in the eye-opening trip to France), for example psychiatrists who referred patients to be patient partners, as well as key actors within the committee. Finally, financial resources made it possible to start the committee and for it to continue functioning over the years.
Limiting organizational factors included resistance from certain actors within the organization, mainly managers and health professionals, particularly at the beginning of the participation of patient partners.
“There was also a little bit of insecurity in integrating the patients, because some people–not all, but some–thought that we were there to slow down their work.” (Focus group, patient partner)
A final factor was the difficulty in sharing with the rest of the organization the vision of full citizenship that had been conceptualized by a few key actors.
“…the less you communicate, the more people in the field will say: ‘It’s management style.’ The more frequent the communication, the clearer it is, that will help. And to explain what full citizenship meant, because we did not understand it in the beginning. ‘What does it mean?’” (Interview 74, non-patient)
In order for employees to align with the vision, the importance of ensuring that they understand its implications was pointed out.
In terms of facilitating environmental factors, mental health policy (MHAP 2005–2010) instigated the process of involving patient partners within the organization. There was also influence from international actors in recovery and citizen psychiatry, both regarding the full citizenship vision and means for involving patient partners.
“We came back home inspired by all these values and, for a long time, we would invite patients to be part of our committees […] where the experiential knowledge is important, because the patients were sometimes bored when it did not concern them, I think.” (Interview 71, non-patient)
The self-help group was an important collaborator and provided support throughout the implementation of the committee, from the first steps in patient partner participation. Similarly, the supportive network for patient participation both inside and outside the organization (e.g., user-led private non-profit organization, self-help group, community organizations where patient partners were active), contributed to the committee’s work. Additionally, the aim of becoming a university institute, which entailed evolving towards a structure of research and innovative practices, certainly influenced the process.
Limiting environmental factors mainly consisted in the existence of stigma, which was expressed within the organization through resistance towards the participation of patient partners and the existence of discriminatory organizational structures. The enactment of the 2015 healthcare system reform in Quebec also affected the committee’s activity.
The consequences of the implementation of the strategic committee
According to interviewees, implementation of the committee for patient engagement made ongoing patient partner participation possible, by creating a formal structure for it within the organization, including a budget for participation and the production of annual reports. The evaluation mechanism that was instituted enabled the committee to obtain feedback and improve the procedures for participation, for example by strengthening support for actors involved in participation activities.
The increased participation of patient partners was due not only to the vision of full citizenship, but also to the existence of the committee, which promoted and supported participation in a systematic way. This generated a change in culture within the organization, which reduced resistance to patient participation. By including members from various departments and actively advocating broader participation, the committee also contributed to increasing the scope of participation within the organization.
“The involvement of [name], then the research, as well as the teaching department to spread the practice, helped make it [patient engagement] sustainable.” (Focus group, non-patient)
Several discriminatory structures within the organization were removed through the observations and actions taken by the committee. With the committee’s work and increased participation activities, patients were given a formal and more significant presence within the organization, which contributed to destigmatize mentally ill persons.
Limitations of the study
As data collection was carried out retrospectively, no observational data on the implementation process was included in this paper, which is an important part of case studies . Many years had passed since several of the studied events, and due to the 2015 reform of the Quebec healthcare system, which involved structural organizational changes, including the reorganization and elimination of various managers positions , not all concerned informants could be included in the study. Additionally, at times, the embeddedness and parallelism of different events in the committee implementation process led to difficulties with regards to knowing when an aspect was dependent on the committee itself or on the vision of full citizenship. Finally, the perspective of health professionals could have been included in this study in greater depth.
The results show how a structure for patient engagement, in the form of an organizational committee on a strategic level, can be put in place. The committee was implemented to formalize the already-existing participation of patient partners, as a new vision of full citizenship was introduced, which implied changes in the organization. Implementation of the committee progressed through stages, from its initial formation and structure, to elaborating a framework for patient partner participation within the organization, and finally to the ongoing operation and evaluation of the framework. Several facilitating factors were identified, including executive management support, strong leadership, international influence, and guiding vision for participation. Limiting factors consisted mainly of resistance towards participation and the existence of stigma. The implementation of the committee led to increased and improved patient partner participation. It also helped reduce stigma within the organization, by contributing to a more formal and widespread presence of patient partners. The results of this study confirm that implementation of a strategic committee for patient engagement is a multidimensional, complex process and raises several considerations. A few of these are discussed below.
The committee as a model for improving patient engagement
Despite the lack of literature on the subject, both in mental health specifically and in other healthcare domains, the need for strategies at the organizational level to spread the practice of patient engagement has been emphasized [23, 26, 51]. In the present study, successful realization of such a strategy was made effective by ensuring representation from various departments on the strategic committee, and by advocating more extensive participation of patient partners. This suggests that the committee could serve as a model for others interested in implementing a similar structure. Also observed was the kind of active and deliberate leadership to improve patient engagement that has been identified as a requirement in the literature. This leadership includes promotion of the approach and support for its realization, both in practical terms and from an ideological standpoint, relating to the values of the parties involved [21, 52]. This underlines the need for the explicit creation of a structure for patient engagement that is both practical and democratic . The present findings agree with previous studies examining efforts to take patients’ experiential knowledge into account [21, 25, 53] and to reduce visible discriminatory elements . However, a change in culture is required , as we discuss further down. The visible and influential role of coordinator of the strategic committee held by a patient partner could be considered as a concrete manifestation of democratization and inclusion of experiential knowledge. It can also be seen as an expression of recovery and greater participation within the healthcare system and society–as has been promoted in the Quebec context for many years through mental health policy [15, 48]. As such, it exemplifies the many facets of individuals, ranging from patients to citizens .
Based on the literature, two limitations of the model for patient engagement presented in this study can be identified. The first is the non-inclusion on the strategic committee of healthcare professionals doing clinical work. A literature review on patient engagement in change management pointed to a lack of focus on healthcare professionals as leaders of the approach . The second limitation concerns the lesser importance granted to preparation for participation. The importance of training to work together and take part in new initiatives, on a scale greater than that of an individual participation activity, has been expressed .
A vision behind patient engagement, and articulate leadership
The vision of full citizenship in this study gives conceptual meaning to the participation of patient partners , responding to calls for conceptual clarification regarding patient engagement . It has been argued that, for successful transmission, it is necessary to have not only a conceptual vision to act as a vehicle for change, but also a manifestation of this mental content by actors within the organization . Thus, having a vision supporting the participation is not enough on its own. In this case, there was an initial lack of comprehension lower down in the organization, before organizational culture change occurred. Leadership is an important element of organizational culture change , which requires leaders who can grasp the essence of an innovative vision and translate it into action, especially within organizations in fields such as mental health . Building on this, the present study agrees with previous research recommending that patient engagement should be given a formal place within the overall organizational culture of mental health organizations .
Characteristics of the implementation process
The results also confirm the non-linearity of the implementation process in healthcare  as well as of patient engagement , as illustrated by the changing composition of the committee for example, or the successive modifications to the procedures for participation. Non-linearity was further expressed in each of the last three stages of implementation of the committee, which ran in parallel and overlapped. Findings like these confirm that implementation within healthcare is an open-ended process, continuing throughout the innovation’s existence . Furthermore, the committee’s implementation process was characterized by collective action involving a variety of different actors, a suitable approach for tackling various complex subjects arising along the way . Patients participated in each implementation stage of the committee, which is a key element when it comes to changes in mental healthcare organizations [55, 64] and challenges the perception that mental health patients may not have the capacity to participate in decision-making within organizations . Finally, this study supports and illustrates the importance of constant management support, as brought up in the literature on both implementation  and patient engagement .
Using a conceptual framework helped highlight several aspects of the implementation process of a structure for patient engagement in a mental health context. Drawing on Rogers , the framework of this study distinguishes between initiation and operationalization, allowing for exploration of the preparatory actions leading to the implementation of the committee. The large role played in this case by the vision of full citizenship, which was developed in the initial stages, confirms the importance of these first steps as mentioned in the literature . To further develop the conceptual framework based on the results of the present study, the consequences of implementation could be categorized in terms of quality, range, and volume of participation, as well as organizational culture.
Continuing implementation process
As the results indicate, the routinizing stage of the implementation process was affected by the reform of the Quebec healthcare system, spurring reflection on how to pursue the committee’s activity within the new larger organization. Executive management support for patient engagement within the larger organizational entity, as well as the continuing participation of key individuals from the implementation of the original structure, have been raised as key elements in another case described by Pomey et al.  concerning the successful propagation of a similar structure for patient engagement following the Quebec healthcare system reform.
This paper examines the implementation of a committee for patient engagement across an entire organization. It shows that such a structure’s success in increasing and improving patient engagement depends on many factors and that multiple dimensions must be considered. For patient engagement to operate well, broadly, and in democratic conditions within mental health organizations, the implemented structure must be guided by a strong vision combined with articulate leadership provided by diverse actors. Given the above, some recommendations for decision-makers interested in implementing this type of structure are to include multiple actors in the process, to have a clear vision behind the change, to appoint leaders, and finally to assign adequate resources so that all aspects of patient engagement within the organization can be monitored.
The usefulness of a conceptual framework is brought forward in this paper by confirming that existing theory can be used to explain our case study. Theoretical insights are also provided through the development of categories regarding the consequences of implementation. Finally, a better understanding of the implementation process is provided through concrete presentation of the events at each stage and the factors with influence.
The reform in the healthcare system of Quebec, which took effect in 2015, has raised several questions. What do these types of changes entail for organizational structures for patient engagement such as the committee in this study? What are the conditions for successfully propagating a structure for patient engagement in a larger organization? These are worthwhile topics for additional research. Moreover, this kind of strategic organizational structure for patient engagement requires further research to explore its impact on quality of care and services on a more clinical level.
The authors would like to acknowledge and thank the patient partners and all participants at the mental healthcare organization for making this study possible. The authors would also like to thank Patrick Riley and Yannick Gayama for their thorough editing and re-reading of the article.
- 1. Carman KL, Dardess P, Maurer M, Sofaer S, Adams K, Bechtel C, et al. Patient and family engagement: a framework for understanding the elements and developing interventions and policies. Health Aff (Millwood). 2013 Feb;32(2):223–31. pmid:23381514
- 2. Simpson EL, House AO. User and carer involvement in mental health services: from rhetoric to science. Br J Psychiatry. 2003 Aug;183(2):89–91.
- 3. Omeni E, Barnes M, MacDonald D, Crawford M, Rose D. Service user involvement: impact and participation: a survey of service user and staff perspectives. BMC Health Serv Res. 2014 Oct 25;14(1):491. pmid:25344210
- 4. Rose D, Fleischmann P, Schofield P. Perceptions of user involvement: a user-led study. Int J Soc Psychiatry. 2010 Jul;56(4):389–401. pmid:19628557
- 5. Barello S, Graffigna G, Vegni E. Patient engagement as an emerging challenge for healthcare services: mapping the literature. Nurs Res Pract. 2012 Oct 31;2012:1–7. pmid:23213497
- 6. Tritter JQ, McCallum A. The snakes and ladders of user involvement: moving beyond Arnstein. Health Policy. 2006 Apr;76(2):156–68. pmid:16006004
- 7. Borg M, Karlsson B, Kim HS. User involvement in community mental health services–principles and practices. J Psychiatr Ment Health Nurs. 2009 Apr;16(3):285–92. pmid:19291158
- 8. Bee P, Brooks H, Fraser C, Lovell K. Professional perspectives on service user and carer involvement in mental health care planning: a qualitative study. Int J Nurs Stud. 2015 Dec;52(12):1834–45. pmid:26253574
- 9. Happell B. Polarisation and political correctness: subtle barriers to consumer participation in mental health services. AeJAMH. 2008;7(3):150–156.
- 10. Pelletier J-F, Davidson L, Roelandt J-L. Citizenship and recovery for everyone: a global model of public mental health. Int J Ment Health Promot. 2009 Nov;11(4):45–53.
- 11. Pelletier J-F, Corbière M, Lecomte T, Briand C, Corrigan P, Davidson L, et al. Citizenship and recovery: two intertwined concepts for civic-recovery. BMC Psychiatry. 2015 Mar 4;15:37. pmid:25885779
- 12. Anthony WA. Recovery from mental illness: The guiding vision of the mental health service system in the 1990s. Psychosocial Rehabilitation Journal. 1993 Apr;16(4):11–23.
- 13. Barnes M. Users as citizens: collective action and the local governance of welfare. Soc Policy Adm. 1999 Mar;33(1):73–90.
- 14. Rowe M, Clayton A, Benedict P, Bellamy C, Antunes K, Miller R, et al. Going to the source: creating a citizenship outcome measure by community-based participatory research methods. Psychiatr Serv. 2012 May;63(5):445–50. pmid:22549531
- 15. Ministère de la Santé et des Services sociaux du Québec. Plan d'action en santé mentale 2015–2020: faire ensemble et autrement [internet]. Québec, QC: Gouvernement du Québec; 2015 [cited 2016 Nov 17]. Available from: http://publications.msss.gouv.qc.ca/msss/fichiers/2015/15-914-04W.pdf
- 16. Munro K, Killoran Ross M, Reid M. User involvement in mental health: time to face up to the challenges of meaningful involvement? Int J Ment Health Promot. 2006 May;8(2):37–44.
- 17. Rutter D, Manley C, Weaver T, Crawford MJ, Fulop N. Patients or partners? Case studies of user involvement in the planning and delivery of adult mental health services in London. Soc Sci Med. 2004 May;58(10):1973–84. pmid:15020013
- 18. Storm M, Knudsen K, Davidson L, Hausken K, Johannessen JO. “Service user involvement in practice”: the evaluation of an intervention program for service providers and inpatients in Norwegian community mental health centers. Psychosis. 2011 Feb;3(1):29–40.
- 19. Storm M, Edwards A. Models of user involvement in the mental health context: intentions and implementation challenges. Psychiatr Q. 2013 Sep;84(3):313–27. pmid:23076765
- 20. Tambuyzer E, Pieters G, Van Audenhove C. Patient involvement in mental health care: one size does not fit all. Health Expect. 2014 Feb;17(1):138–50. pmid:22070468
- 21. Lammers J, Happell B. Consumer participation in mental health services: looking from a consumer perspective. J Psychiatr Ment Health Nurs. 2003 Aug;10(4):385–92. pmid:12887629
- 22. Truman C, Raine P. Experience and meaning of user involvement: some explorations from a community mental health project. Health Soc Care Community. 2002 May;10(3):136–43. pmid:12121249
- 23. Pomey M-P, Morin E, Neault C, Biron V, Houle L, Lavigueur L, et al. Patient advisors: how to implement a process for involvement at all levels of governance in a healthcare organization. Patient Exp J. 2016;3(2):99–112.
- 24. Linhorst DM, Eckert A, Hamilton G. Promoting participation in organizational decision-making by clients with severe mental illness. Soc Work. 2005 Jan;50(1):21–30. pmid:15688677
- 25. McDaid S. An equality of condition framework for user involvement in mental health policy and planning: evidence from participatory action research. Disabil Soc. 2009 Jun;24(4):461–74.
- 26. Rise Solbjor M, Steinsbekk A. Experiences from the implementation of a comprehensive development plan for user involvement in a mental health hospital: a qualitative case study. Int J Soc Psychiatry. 2014 Jun;60(4):387–95. pmid:23812411
- 27. Brooks F. Nursing and public participation in health: an ethnographic study of a patient council. Int J Nurs Stud. 2008 Jan;45(1):3–13. pmid:17046769
- 28. Kendell C, Urquhart R, Petrella J, MacDonald S, McCallum M. Evaluation of an advisory committee as a model for patient engagement. Patient Exp J. 2014;1(2):62–70.
- 29. Perreault M, Renaud J, Bourassa F, Beauchesne L, Mpiana A, Bernier S, et al. Implementation of a panel of service users for the evaluation of mental health outpatient services. Eval Health Prof. 2010 Dec;33(4):480–96. pmid:20876086
- 30. Grol RPTM, Bosch MC, Hulscher MEJL, Eccles MP, Wensing M. Planning and studying improvement in patient care: the use of theoretical perspectives. Milbank Q. 2007;85(1):93–138. pmid:17319808
- 31. Moullin JC, Sabater-Hernández D, Fernandez-Llimos F, Benrimoj SI. A systematic review of implementation frameworks of innovations in healthcare and resulting generic implementation framework. Health Res Policy Syst. 2015 Mar 14;13(1):16. pmid:25885055
- 32. Brooks H, Pilgrim D, Rogers A. Innovation in mental health services: what are the key components of success? Implement Sci. 2011 Oct 26;6(1):120. pmid:22029930
- 33. Rogers EM. Diffusion of innovations. 5th ed. New York: The Free Press; 2003.
- 34. Fixsen DL, Blase KA, Naoom SF, Wallace F. Core implementation components. Res Soc Work Pract. 2009 Sep;19(5):531–40.
- 35. Pomey M-P, Forest P-G, Sanmartin C, De Coster C, Drew M. Wait time management strategies for scheduled care: what makes them succeed? Healthc Policy. 2010 Feb;5(3):66–81. pmid:21286269
- 36. Mendel P, Meredith LS, Schoenbaum M, Sherbourne CD, Wells KB. Interventions in organizational and community context: a framework for building evidence on dissemination and implementation in health services research. Adm Policy Ment Health. 2008 Mar;35(1):21–37. pmid:17990095
- 37. Aarons GA, Hurlburt M, Horwitz SM. Advancing a conceptual model of evidence-based practice implementation in public service sectors. Adm Policy Ment Health. 2011 Jan;38(1):4–23. pmid:21197565
- 38. Damschroder LJ, Aron DC, Keith RE, Kirsh SR, Alexander JA, Lowery JC. Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science. Implement Sci. 2009 Aug 7;4:50. pmid:19664226
- 39. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008 Jun;41(3–4):327–50. pmid:18322790
- 40. Greenhalgh T, Robert G, Macfarlane F, Bate P, Kyriakidou O. Diffusion of innovations in service organizations: systematic review and recommendations. Milbank Q. 2004;82(4):581–629. pmid:15595944
- 41. Yin RK. Case study research: design and methods. 4th ed. Thousand Oaks, CA: Sage Publications; 2009. https://doi.org/10.1016/j.ymeth.2008.10.015
- 42. Baker GR. The contribution of case study research to knowledge of how to improve quality of care. BMJ Qual Saf. 2011 Apr;20(Suppl 1):i30–i5. pmid:21450767
- 43. Patton MQ. Qualitative research & evaluation methods. 3rd ed. Thousand Oaks, CA: Sage Publications; 2002.
- 44. Guide d’admission et des programmes d’études [internet]. Montreal, QC: Université de Montréal; 2017. Module de formation de mentorat pour pair-aidants en santé mentale. [cited 2017 Nov 24]; [about 1 screen]. Available from https://admission.umontreal.ca/programmes/module-de-formation-de-mentorat-pour-pairs-aidants-en-sante-mentale/presentation/
- 45. Kvale S. Doing interviews. London, GB: Sage Publications; 2007.
- 46. Miles MB, Huberman M. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks, CA: Sage Publications; 1994.
- 47. QDA Miner: Qualitative text analysis software. Version 4.0 [software]. Provalis Research. 2011 [cited 2017 Dec 08]. Available from: https://provalisresearch.com/products/qualitative-data-analysis-software/
- 48. Ministère de la Santé et des Services sociaux du Québec. Plan d’action en santé mentale 2005–2010—La force des liens [internet]. Québec, QC: Gouvernement du Québec; 2005 [cited 2016 Jun 10]. Available from: http://publications.msss.gouv.qc.ca/msss/fichiers/2005/05-914-01.pdf
- 49. Fortin D, Fortier L, Pelletier J-F, Saulnier B. Une vision clinique centrée sur la pleine citoyenneté: axe de transformation d’un institut de santé mentale montréalais. Paper presented at: XVIe Colloque de l’Association québécoise pour la réadaptation psychosociale—rétablissement et pleine citoyenneté: du discours à l’action; 2012 Oct 31- Nov 2; Québec, QC. French.
- 50. Bill 10: An act to modify the organization and governance of the health and social services network, in particular by abolishing the regional agencies. L.Q. 2015, c. 1
- 51. Rise MB, Steinsbekk A. Long term effect on professionals’ knowledge, practice and attitudes towards user involvement four years after implementing an organisational development plan: a controlled study. PLoS One. 2016 Mar 14;11(3):e0150742. pmid:26974971
- 52. Restall G, Strutt C. Participation in planning and evaluating mental health services: building capacity. Psychiatr Rehabil J. 2008;31(3):234–8. pmid:18194951
- 53. Elstad TA, Eide AH. User participation in community mental health services: exploring the experiences of users and professionals. Scand J Caring Sci. 2009 Dec;23(4):674–81. pmid:19804372
- 54. Pelletier J-F. Let the patient-user-citizen revolution continue. Sante Ment au Que. 2015;40(1):11–7.
- 55. Rose D, Fleischmann P, <au Tonkiss F, Campbell P, Wykes T. User and carer involvement in change management in a mental health context: Review of the literature. Report to the National Co-ordinating Centre for NHS Service Delivery and Organisation R&D (NCCSDO) [internet]. London, GB: NCCSDO; 2003 [cited 2016 Nov 20]. Available from: http://www.netscc.ac.uk/hsdr/files/project/SDO_FR_08-1201-017_V01.pdf
- 56. Bowl R. Involving service users in mental health services: Social Services Departments and the National Health Service and Community Care Act 1990. J Ment Health. 1996;5(3):287–304.
- 57. Pelletier J-F, Fortin D, Laporta M, Pomey M-P, Roelandt J-L, Guézennec P, et al. The global model of public mental Health through the WHO QualityRights project. J Public Ment Health. 2013;12(4):212–23.
- 58. Hickey G, Kipping C. Exploring the concept of user involvement in mental health through a participation continuum. J Clin Nurs. 1998 Jan;7(1):83–8. pmid:9510712
- 59. Kotter JP. Leading change: why transformation efforts fail. Harv Bus Rev. 1995;73(2):59–67.
- 60. Schein EH. Organizational culture and leadership. 1st ed. San Franciso, CA: Jossey-Bass Publishers; 1985.
- 61. Valiant Cook J. Innovation and leadership in a mental health facility. Am J Occup Ther. 1995 Jul-Aug;9(7):596–606.
- 62. Meyers DC, Durlak JA, Wandersman A. The quality implementation framework: a synthesis of critical steps in the implementation process. Am J Community Psychol. 2012 Dec;50(3–4):462–80. pmid:22644083
- 63. Jewell C, Davidson L, Rowe M. The paradox of engagement: How political, organizational, and evaluative demands can hinder innovation in community mental health services. Soc Serv Rev. 2006 Mar;80(1):3–26.
- 64. Lord J, Ochocka J, Czarny W, MacGillivary H. Analysis of change within a mental health organization: a participatory process. Psychiatr Rehabil J. 1998;21(4):327–9.
- 65. Länsisalmi H, Kivimäki M, Aalto P, Rouranen R. Innovation in healthcare: a systematic review of recent research. Nurs Sci Q. 2006 Jan;19(1):66–72. pmid:16407603
- 66. Pomey M-P, Morin E, Neault C, Clavel N, D'Amour M, Beaumont M. Engager les patients à tous les niveaux de gouvernance d’un établissement de santé et de services sociaux: le cas du CIUSSS de la Mauricie-et-du-Centre-du-Québec. Le Point en santé et services sociaux. 2017;12(4):12–7.