Figures
Abstract
Background
Occupational therapy (OT) is an effective evidence-based intervention that positively influences stroke patients’independence recovery, leading to new opportunities for better quality of life outcomes.
Objectives
To explore the effectiveness of an early OT intervention program (EOTIPS) in the process of hospital to home discharge after stroke in Spain.
Material and methods
We conducted a prospective, randomized controlled clinical trial that included 60 adults who suffered a stroke and were discharged home. Participants assigned to the experimental group (n = 30) were included in EOTIPS and compared with a control group (n = 30). Evaluations assessed quality of life (Stroke and Aphasia Quality of Life Scale [SAQOL-39]), functional independence (Modified Rankin Scale [mRS], Barthel Index [BI] and Stroke Impact Scale-16 [SIS-16]), perceptual-cognitive skills (Montreal Cognitive Assessment [MoCA]), upper limb function (Fugl Meyer Assessment [FMA]), mobility (Berg Balance Scale [BBS] and Timed Up & Go [TUG]), communication skills (Communicative Activity Log [CAL]) and mood disorders (Beck Depression Inventory–II [BDI-II] and Hamilton Anxiety Scale [HAM-A]); they were completed within two weeks post-stroke and after three months follow-up. Statistical analysis included intent-to-treat analysis, considering all participants (dropouts as failures), and efficacy analysis, considering only end-of-treatment participants.
Results
Participants in the intervention group showed a significant better evolution in the main outcome measure of quality of life (SAQOL-39 p = .029), as well as for independence (mRSp = .004), perceptual-cognitive skills (MoCA p = .012)and symptoms of depression (BDI-II p = .011) compared to the control group.
Conclusions
EOTIPS was effective in improving quality of life, as well as enhancing perceptual-cognitive skills, independence and reducing levels of depression for patients who suffered a stroke in a Spanish cohort and could be considered as an applicable non-pharmacologic therapeutic tool that can lead to patients’ positive outcomes after stroke.
This study was registered on ClinicalTrials.gov with the identifier NCT04835363.
Citation: García-Pérez P, Rodríguez-Martínez MC, Gallardo-Tur A, Blanco-Reina E, de la Cruz-Cosme C, Lara JP (2024) Early Occupational Therapy Intervention post-stroke (EOTIPS): A randomized controlled trial. PLoS ONE 19(8): e0308800. https://doi.org/10.1371/journal.pone.0308800
Editor: Nadinne Alexandra Roman, Transilvania University of Brasov: Universitatea Transilvania din Brasov, ROMANIA
Received: February 15, 2024; Accepted: July 29, 2024; Published: August 19, 2024
Copyright: © 2024 García-Pérez et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Figshare(URL: https://doi.org/10.6084/m9.figshare.25665207.v1).
Funding: Regarding financial disclosure, all the authors would like the following to be included in the article: Funding: The APC has been funded by IBIMA Plataforma BIONAND and University of Málaga (Spain).
Competing interests: The authors have declared that no competing interests exist.
Introduction
Stroke is a significant health, social, and economic problem that represents the first cause of adult disability in Europe. However, advances in stroke prevention and treatment suppose that more people survive and live with its long-term consequences [1]. In addition, the number of younger persons suffering a stroke is increasing, resulting in a long-term health problem, affecting social, community, work and leisure activities. The presence of depressive symptoms, cognitive impairment, functioning, mobility and daily life activities limitations are most frequently and consistently associated with poor participation outcomes and a lower quality of life [2].
Initially, a systematic review was carried out in order to study interventions within the scope of Occupational Therapy (OT) to support discharge from an acute care hospital to home. According to the results, an early OT intervention can be effective in terms of functional recovery and can lead to caregiver’s self-efficacy. OT practitioners working with adults who suffered a stroke must understand the implications of their clients’ limitations on occupational performance and choose individualized interventions based on clinical reasoning and scientific evidence. The included studies agreed that individual planning and rehabilitation should start before discharge and patients with both social and physical needs could benefit from multidisciplinary services [3–5], which could lead to a more rapid independence recovery [6].
After stroke, patients may experience impaired motor and cognitive impairment, difficulties performing activities, and reduced health-related quality of life, which can place a burden on caregivers and society [7]. Early mobilization and home-based rehabilitation reduce disability and increases quality of life and it has been shown to be more cost-effective when compared to standard care [4, 8]. Patients should be informed and aware of the importance of discharge transition and carefully plan this moment together with professionals and caregivers, since the impact of this situation can affect quality of life and functionality [9]. OT plays an important role in a multidisciplinary approach to the treatment of cognitive and motor impairment, helping patients achieve their maximum level of functional autonomy and fulfill desired and required life roles after stroke [10]. Although an early OT intervention after stroke and discharge planning is considered an evidence-based intervention in many European countries [11–13], replication studies are needed to provide an evidence base in other countries and cultures. Thus, we examined the effectiveness of early OT intervention in a cohort of adults who suffered a stroke in a region of Spain with an extensive protocol evaluation with the final intention of introducing a novel intervention for the mentioned sanitary context.
Consequently, the primary objective of the present trial was to evaluate the effect of an Early Occupational Therapy Intervention Post-Stroke (EOTIPS) in the process of hospital discharge post-stroke on the patient quality of life within the Spanish public healthcare system, compared to a control group that received conventional rehabilitation and care. Secondary objectives were to assess improvements in functional independence, sensory–motor skills, perceptual–cognitive skills, communication skills and levels of depression and anxiety.
Materials and methods
Study design
EOTIPS was a prospective, longitudinal, randomized and controlled clinical trial, which protocol was previously defined and approved by the Malaga Research Ethics Committee (CEI) on 25th February 2021 (see S1 and S2 Files). Patients’ evaluations within the EOTIPS research took place between May 2021 to November 2022. This study was registered on ClinicalTrials.gov with the identifier NCT04835363 and fully anonymous dataset was published [14]. Results are reported in accordance to CONSORT guidelines (see S3 File) [15].
Participants and recruitment procedures
Recruitment started the 25th May 2021 and finished the 30thAugust 2022. Patients assigned to the experimental group were included in EOTIPS, a program in which they received early occupational therapy intervention, and compared with a control group. Both groups received the usual care and rehabilitation provided by other health professionals within the public healthcare system. The rehabilitation and neurology departments were responsible for selecting and referring suitable patients to the occupational therapist to participate in the research. Only those who signed a written informed consent form were included in this study.
Participants were individuals that suffered a stroke and were admitted to the neurology ward of Virgen de la Victoria University Hospital (Malaga, Spain). The inclusion criteria were as follows: (1) diagnostic confirmation of stroke with single or multiple vascular lesions that have occurred in the same time period, demonstrated by neuroimaging tests (CT or MRI); (2) age > 18 years old; (3) >2 to <26 points on the National Institute of Health (NIHSS) scale; (4) 30–100 points on the Barthel Index (BI) on the second day after the stroke (with BI 100, the patient could be included if the Montreal Cognitive Assessment was<26); (5) going home on discharge, hence not going to a nursing home or rehabilitation unit. Inclusion in the study occurred prior to hospital discharge, and EOTIPS intervention started as soon as patients were medically fit for it and initial assessment was completed, in all cases within two weeks after the stroke. Therefore, this research took place exclusively with early sub-acute post-stroke patients.
Exclusion criteria were: (1) NIHSS> 26; (2) life expectancy <1 year; (3) having suffered a previous stroke, dementia or other types of illnesses associated with major neurocognitive disorders and other concomitants neurological, psychiatric or medical illnesses (for example, severe epilepsy, head trauma, schizophrenia, chronic obstructive pulmonary disease, severe or unstable heart disease or sleep apnea) that could alter cognitive function; (4) presence of moderate-severe aphasia and (5) people who do not understand Spanish or English.
Masked medical staff assessed participants inclusion and exclusion criteria and referred them to the evaluators for inclusion in the study. Eligible patients were randomly assigned to EOTIPS or the control group according to a computer pre-stablished designation in blocks of six patients, developed by the principal investigator of the study with the online free tool Sealed Envelope, v1.23.0 [16]. Regarding to the blinding process, evaluators and participants were masked to group allocation during the whole process. To minimize bias, participants were explained that they would enter an occupational therapy related study within which they would receive specialized monitoring of their stroke evolution. Only the occupational therapist leading the interventions was unblinded and explained every participant the intervention they were being provided, not revealing their group allocation. The statistical analysis was carried out by a blinded biostatistics expert and supervised by the principal investigator.
Sociodemographic and clinical variables were taken into account: age, sex, education, marital status, nationality, native language, employment status, stroke type, vascular territory of the lesion and Oxfordshire classification (see Table 1). Neurological impairments related to stroke were also contemplated and classified according to a recent classification system that divides the body impairments in four types: consciousness, cognition (includes disorientation, aphasia and inattention), motor (includes facial palsy, ataxia, dysarthria and dysphagia) and sensory impairments (includes eye movement and visual field impairments) [17]. This classification defines impairments using the National Institute of Health Stroke Scale (NIHSS) and their identification was done through the neurologist usual clinical practice examination who evaluates the patient systematically (see Table 3).
During data collection, the anonymity of users was guaranteed. Participants were informed of the intervention and were asked to sign a written informed consent, since the participation was voluntary, allowing the user to leave whenever they wished. The principles of the Declaration of Helsinki were followed [18].
Interventions
EOTIPS main objective was to improve patients’ quality of life facilitating the transition from hospital to home. The intervention group received EOTIPS delivered by a single expert occupational therapist, who had advanced training in neurology. It took place both in the hospital and the patient’s home. Before beginning rehabilitation, the occupational therapist and their family explored the needs and wishes of the patient and set individual goals for the intervention period [19].
The intervention had a person-centered approach, which is inherent to occupational therapy, that was based on the patient’s context and history, their individual strengths and weaknesses and social support network. Therefore, individualized objectives were established, taking into account their abilities and limitations. EOTIPS included an initial evaluation, a first session in hospital, a post-discharge home visit, a home visit one month later, and a final evaluation three months after discharge. Although all patients received advice to continue rehabilitation at home following the occupational therapist guidance, frequency and intensity of practice they performed at home depended on their willingness to improve and adherence to treatment. The occupational therapistmaintained communication with patients and caregivers via home visits and phone calls to offer information and support during the transition from hospital to home. The overall aim was to educate patients with information and knowledge about the importance of postural care, cognitive/motor/perceptual/sensitive stimulation and basic neuro-rehabilitation to promote involvement in the intervention and, consequently, enhancing the participation and engagement in therapeutic activities. This intervention was carried out in parallel to the standard of care provided by the public healthcare system when the trial took place (see Fig 1). During the study, patients were evaluated by the rehabilitator doctor and referred to physiotherapy or OT depending on their needs and abilities. Nevertheless, in the hospital where the intervention and during the time the study took place, OT was not provided in the ward or at the patient´ home, being only provided in the OT department for outpatients who were previously referred by the rehabilitator doctor.
Outcomes
After determining potential participants’ eligibility, evaluators facilitated a research information document and proceeded with initial evaluations. Evaluators were OT practitioners previously trained to carry out the assessments and who were blinded to group assignment. Initial assessments were performed in hospital while final assessments took place at patients’ homes. All measures used in the research were standardized and validated for stroke population and adapted to Spanish language [20–39].
Clinical and social data were obtained for all participants at each evaluation:
The primary outcome was quality of life, assessed by the Stroke and Aphasia Quality of Life Scale (SAQOL-39) [20–22]. In this scale, the 39 items are scored from one to five (higher score means better performance). Items scores are added and divided by 39, obtaining a result between zero and five where higher final score indicates better quality of life.
Level of functional independence was measured by Barthel Index (BI), Modified Rankin Scale (mRS) and Stroke Impact Scale-16 (SIS-16). BI measures the extent to which someone can function independently during basic ADL. Each performance item is rated on this scale with a given number of points assigned to each level. The modified version with 0–100 was used in this study, where a lower score indicates higher dependence [23]. mRS is used to describe disability in general. The scale ranges from 0 (perfect health) to 6 (death) [24]. SIS-16 is a reduced version of the Stroke Impact Scale version 3.0. Items are scored on 5-grade ordinal scale, 1 meaning the activity could not be completed and 5 meaning it was completed with no difficulties. The scale ranges from 16 (dependent) to 80 (independent) [25–27].
Sensory-motor skills were assessed by Fugl Meyer Assessment (FMA), Berg Balance Scale (BBS) and Timed Up & Go (TUG). We used the Spanish version of the FMA to evaluate the motor and sensory progress of the affected upper limb, therefore, we did not include the lower limb section of the scale (maximum score of 126). FMA is a scale created to measure motor recovery after stroke. Items are scored on a 3-grade ordinal scale, with 0 as the minimum and 2 as the maximum [28–30]. BBS assesses functional balance. Performance on this test is rated from 0 (cannot perform) to 4 (normal performance) on 14 different tasks. The maximum score is 56 and higher score indicates better balance skills [31]. TUG assesses basic mobility, counting the time required for a person to get up from a standardized chair, walk a distance of three meters, turn, return to the chair, and sit down again. A shorter time indicates better performance [32].
Perceptual-cognitive skills were assessed by Montreal Cognitive Assessment (MoCA). MoCA is a brief screening instrument with good predictive value for the development of cognitive impairment after stroke. The assessment scores from 0 to 30, being 30 the highest score that means absence of cognitive impairment [33–36].
Communication skills were assessed by Communicative Activity Log (CAL). CAL scale allows obtaining information on communication skills in activities of daily life referring to comprehensive and expressive aspects of language. It is made up of 36 items that assess both the quality and the quantity of the patient’s communication. The performance is obtained through the sum of the scores in each item [37].
Mood disorders (levels of anxiety and depression), were assessed by Beck Depression Inventory–II (BDI-II)and Hamilton Anxiety Scale (HAM-A). BDI-II is a self-administered questionnaire that consists of 21 multiple-choice questions. It is one of the most commonly used instruments to measure the severity of depression. The maximum score is 63 (higher score, higher level of depression) [38]. HAM-A assesses the severity of anxiety globally in patients who meet criteria for anxiety or depression. It is made up of 14 items, 13 of which refer to anxious signs and symptoms and the last one that assesses the patient’s behavior during the interview [39].
Statistical analysis
The sample size ″n″ was intended to represent the total population of patients who suffer a stroke admitted to a second level hospital in Málaga (Spain) and who maintain sequelae susceptible to rehabilitation. It was calculated based on the primary outcome SAQOL-39 [20–22] with the sample size determination formula for two independent groups, assuming a mean of 2.50, standard deviation of 0.75, significance level of 5%, a power of 80% and a critical difference of 0.54, obtaining a sample of 30 participants per group, and a total of 60 participants. Therefore, two groups were formed: an intervention group of 30 patients who received the Early Occupational Therapy program (EOTIPS) in addition to conventional rehabilitation and care, and a control group of 30 patients who received conventional rehabilitation and care.
The power was finally recalculated with the G*Power tool [40] assuming SAQOL-39 as the primary outcome, an effect size of 0.3, a sample size of 30, a calculated measurement coefficient of 0.654, two repeated measures and two groups, obtaining a final power in the study of 96%.
Sociodemographic and clinical variables were reported using the mean and standard deviation in case of quantitative variables; and number and percentage for qualitative variables. Baseline differences between the two treatment groups were assessed by Student’s T-test or non-parametric Mann-Whitney U test according to normality deviation tests when variables were quantitative, and Pearson’s Chi-squared test or Fisher’s exact test as appropriate when variables were qualitative.
In order to compare changes between the control and the experimental group a repeated measures ANOVA was performed considering one within-factor (Time) and one between-factor (Group). Where ANOVA factors were significant, post-hoc pairwise comparisons were performed to identify comparisons driving the differences. As the variable “Type of stroke” was almost significant, it was considered as a possible confusion factor. For all tests, a P value of < .05 was considered statistically significant. For the statistical analysis of ordinal variables, non-parametric tests were used. For the other variables, the conditions of normality and homoscedasticity (equality of variances) were contrasted. The software used for data analysis was JAMOVI, version 2.3.26 [41].
Results
Recruitment and participant characteristics
We screened 74 potential participants, of whom 65 were eligible to participate in the trial; three patients declined to sign the written informed consent. Therefore, 62 participants were randomly assigned to the intervention and control groups (31 per group): 1 intervention participant and 1 control participant deceased, not concluding the study. An overview of the flow of participants through the study is provided in Fig 2.
Recruitment ended after 15 months, once the sample size was accomplished. The final sample thus included 60 participants. The intervention and control group did not present significant differences on the sociodemographic characteristics and clinical data at baseline, being the average age 67.5 (±SD 10.60) and male/female ratio of 1.4 (see Table 1). Length of hospitalization varied between 3 and 30 days, being the mean 10 days and standard deviation 6.31. Therefore, all participants were in the early sub-acute phase of their first stroke (see Table 2).
In regards to race, 100% of the study were Caucasian. Although the major ethnicity that entered the study was Spanish (93.3%), other ethnicities entered in the sample, such as Latin-American (6.66%), Portuguese (1.7%), Arabs (3.33%) and White British (3.33%).
The most common type of stroke within the participants was ischemic in opposition to hemorrhagic (χ2 = 5.45, p = 0.052), not showing statistically significant difference between damaged hemispheres (χ2 = 1.83, p = 0.400). There were not significant differences between groups in any of the baseline evaluations.
Regarding the participants neurological impairments related to stroke, no significant differences were found for any of the categories: consciousness (p = 1.000), cognitive (p = 0.771), motor (p = 1.000) and sensory impairments (p = 0.792)(see Table 3).
Summary of participants individual goals
Before the start of EOTIPS intervention, the occupational therapist explored the needs and wishes of the patient and together decided on individual goals for the intervention period (examples of chosen goals, both general and specific, are shown in Table 4).Most of the chosen general objectives were related to basic and instrumental ADL. However, they were also related to social participation and significant activities which is, in turn, their sense of self and occupational identity [42, 43].
Outcome analysis
Table 5 shows the results of a repeated measures ANOVA which was conducted to examine the change of the variables from baseline to final evaluation on the evaluations scores. In 4 of the variables analyzed there was a significant interaction between the time of evaluation (within-subject factor) and group (between-subjects factor), therefore their results of the Tukey post-hoc Test have been added in the last column, revealing statistically significant differences for three of them. The means and standard deviations in the initial and final evaluations for each group have been included, as well as the analysis results to verify significant differences between both groups, including p values, F values and degrees of freedom (gl). The mean percentage of change (%) has also been indicated to better understand the magnitude of the improvement or worsening in relation to the baseline evaluation (see Table 5). In addition, Fig 3 shows the evolution of those variables in which the interaction factor (Time*Group) has been significant (see Fig 3).
Repeated measures ANOVA results indicated that mean change in the pre-post evaluation for four of the evaluation scores were significantly different between groups, being those evaluations SAQOL-39 (F = 5.02, p = 0.029), mRS (F = 8.97, p = 0.004), MOCA (F = 6.80, p = 0.012) and BDI-II (F = 6.93, p = 0.011). Post-hoc pairwise comparisons revealed that evaluations scores were not significantly different between the control and the experimental group for the baseline evaluation (T1), but were for the final evaluation (T2)ofthe scalesSAQOL-39 (T1, p = 0.843; T2, p = 0.036), MOCA (T1, p = 0.720; T2, p = 0.047) and BDI-II (T1, p = 0.767; T2, p = 0.037); but was not for mRS (T1, p = 0.998; T2, p = 0.076). Modified Rankin Scale (mRS) scores significantly improved for both groups (p = < .001), as shown by the statistical analysis of Wilcoxon signed-rank test (see Table 6). Therefore, evaluations related to functional independence, quality of life, cognition skills and level of depression showed better recovery for the experimental group (see Figs 3 and 4).
It is noteworthy that both groups, having participated or not in the EOTIPS program in addition to conventional rehabilitation, greatly improved scores on all evaluations comparing T1 and T2 scores. Mean change scores for the secondary scaled goals were greater for the intervention group compared with the control group in most variables, although not achieving significant differences (see Table 5): independence, as scored by Barthel Index (F = 0.46, p = 0.496); general independence after stroke, as scored by SIS-16 (F = 1.40, p = 0.241); upper limb function, as scored by FMA (F = 2.15, p = 0.148); level of anxiety, as scored by HAM-A (F = 3.79, p = 0.055) and communication skills, as scored by CAL (F = 3.23, p = 0.078).Nevertheless, mean change scores for functional balance, as shown BBS, were higher for the control group than the experimental group (F = 0.85, p = 0.358). Due to the inability of some participants to stand up during the initial evaluation (43.3%), TUG test could not be completed. Therefore, only participants that completed both initial and final evaluation could be included in the statistical analysis (n = 34). However, it must be highlighted that 21 patients of the experimental group against 13 of the control group succeeded in completing the TUG test. Finally, it is worth to mention no harms or unintended negative effects were generated or reported during the trial.
Discussion
This study presents the development of a RCT based on an early OT intervention during the hospital discharge post-stroke. To our knowledge, it is the first prospective, randomized clinical trial to investigate the effect of adding an early OT discharge planning intervention that involves home visits and goal setting in the Spanish public healthcare system. The trial had random allocation, blinded assessments and intention-to-treat analysis. This research has relevance as it provides evidence supporting an intervention that addresses challenges found at home after discharge and emphasizes the importance of a personal-centered approach [44–46].
Studies with an evaluation protocol as extensive and complete are not common [47]. Likewise, no similar studies have been found assessing quality of life as the main efficacy variable. However, there are articles that have included it as a secondary variable and have shown significant improvements after the intervention [4]. Furthermore, this research exposed cohesion with other published articles significant results: improvements in functional independence [48–50], cognition skills [51] and symptoms of depression [5]. Most participants met their chosen goals at the end of EOTIPS due to regained ability for doing the activity and/or to activities/tools adaptation to perform the task safely, which resulted in higher participants satisfaction and quality of life. Nevertheless, according to other studies the effectiveness of the potential benefits of OT interventions remains unclear [52], being the need of further research the main motivation for the current study.
There are not many studies on the effectivity of a multidisciplinary intervention in the process of hospital discharge after stroke that includes the figure of the occupational therapist, with the majority being carried out in northern Europe [3, 4, 53–55], UK [56], China [12, 57] and Australia [47]. Some studies include the occupational therapist as part of the multidisciplinary services facilitated by an Early Supported Discharge (ESD) or a Very Early Supported Discharge (VESD) model, which has been proven to reduce long-term dependency and admission to institutional care [3, 56]. Although most of related researches incorporate caregivers as a potentiality in the patient rehabilitation [6], only 68.3% of participants were married or living with their partner who accepted to be deeply involved in their care.
In the current study, inclusion and exclusion criteria used were those usually described in previous researches but with an improved evaluation protocol that included valid and reliable clinical tools [47]. Decision on evaluations and intervention duration was made after reviewing recent and similar published papers, as showing main changes between groups 3 months after discharge [3, 4, 49, 53, 58] and being Barthel Index and the mRS the most widely used evaluations [3, 4, 53, 59]. Cognitive skills were also assessed as more than 40% of stroke survivors experience cognitive impairment (mild post-stroke cognitive impairment—MCI) soon after the event [57].
As expected, the participants had stroke severity at the mild end of the NIHSS scale, previously shown to be the target population of ESD intervention [56]. According to the Oxfordshire Community Stroke Project classification [60], the most common type of stroke within the RCT was lacunar syndrome (LACS), followed by partial anterior circulation stroke (PACS) and posterior circulation syndrome (POCS). However, only 3 patients with total anterior circulation stroke (TACS) were included in the study (being the 3% of the control group and the 7% of the experimental group). On the other hand, it seems important to highlight that there was a significant difference in stroke type, which may have influenced the final results as it has been generally believed that hemorrhagic strokes are generally more severe as within the first 3 months after stroke. Moreover, hemorrhagic strokes are associated with a considerable increase of mortality [61], although that did not show in our study, being mortality rate identical between groups. Nevertheless, despite hemorrhagic stroke patients usually presenting with worse functional and clinical status compared to ischemic stroke, there are studies that support the same or even better functional prognosis in stroke survivors with hemorrhagic stroke, with age and initial stroke severity as the main prognostic factors [62, 63]. Other studies consider that, although the pathophysiology of these types of strokes is different, both ultimately result in similar injuries, possibly accounting for lack of findings of functional levels differences between groups after rehabilitation [64].
The neurological impairments related to stroke were also contemplated and classified according to a new classification system [17], which shows most of them had motor impairments (98.33%) followed by sensory impairments (46.66%), cognitive impairments (26.66%) and consciousness related impairments (6.66%), not showing significant differences between groups. In general terms, there were no differences between groups at baseline. On the time of the study, in-patient rehabilitation consisted on nine beds and the decision was made by the rehabilitator doctor based on different reasons, such as severity of the stroke, rehabilitation potential, age, social support and bed availability. As this service is part of the public healthcare system, admission to rehabilitation unit happened at no economical cost. However, patients must have had relatives or friends to support them in the unit. Therefore, a strong support net was crucial for admission. Thus, people with severe stroke, strong social net and young age were more likely to be sent to rehabilitation as an inpatient. Nevertheless, patients going home on discharge must also have had social support or be independent enough to manage at home despite any limitation. Only 5 participants in total (2 in the experimental group and 3 in the control group) had not a caregiver to support them on discharge, fact that may also be related to Spanish culture [65]. Regarding to other sociodemographic characteristics, as can be seen in Table 1, the sample was very homogeneous, not showing statistical differences between groups on sex, age, education or marital status, not either in the clinical patients’ data at baseline (stroke type, damaged hemisphere, Oxfordshire Classification and baseline evaluations) which means the participants selected were similar in terms of sequelae left after the stroke, being particularly a group of people who found difficulties in their ADLs but could manage going home (with or without support from family). Regarding the socio-economic status, as can be seen in Table 1, 60% of the participants were retired, therefore, living on retirement pension, 8.3% were househusbands or housewives, 5% were unemployed and only 25% were actively working when the stroke took place, therefore since then being temporarily unfit to work (8 persons in control group and 7 in experimental group). Consequently, it shows there were not significant differences between groups.
Overall, literature addressing OT interventions for stroke survivors going home on discharge shows that, although most of them are effective in terms of patients’ functional recovery, as well as caregivers’ improvements in self-efficacy and fatigue reduction, the heterogeneity of the interventions precludes to draw specific conclusions [11–13]. Stroke discharges and rehabilitation plans are usually carried out in a multidisciplinary manner, making it difficult to evaluate the extent OT contributes to the patients’ recovery [3–5, 54]. Consequently, EOTIPS program was designed and carried out in order to evaluate early OT intervention in the process of hospital discharge and study its influence on the person with stroke quality of life and independence.
As revealed in the Results section, evaluations related to functional independence (mRS), quality of life (SAQOL-39), cognition skills (MOCA) and level of depression (BDI-II) showed better recovery for the experimental group. Quality of life has been shown to be a strong predictor of survival, and this prognostic ability suggests that there is a need for routine assessment of quality of life in clinical trials [66]. Quality of life is a complex concept that is interpreted and defined in a number of ways within and between various disciplines. As a consequence, SAQOL-39 was used in this research due to its validity and reliability within the stroke population [20]. BI may be a useful outcome in stroke rehabilitation RCTs with sufficient sample sizes to support accurate interpretation of statistical significance levels; however, the mRS seems to lack sensitivity to detect change and thus may be unsuitable as a primary outcome [67]. Moreover, while the mRS has a plateau effect in measuring recovery for this patient population between 3 and 6 months, the BI may be a more sensitive measure for assessing recovery up to 12 months [68]. Despite results on mRS scores were positive, Barthel Index did not obtain significant results, therefore, it would be needed a bigger sample size to determine how positive the intervention was on the patient’s independence recovery.
As previously explained, EOTIPS was carried out in parallel to the usual care provided by the healthcare system, in which only a very small number of patients get to see the occupational therapist within the first three months after the stroke due to long waiting lists and reduced number of professionals. In the present RCT, patients with stroke who received EOTIPS showed greater gains in quality of life, independence, perceptual-cognitive skills and levels of depression compared with patients in the usual-care group. The experimental group have shown a 33% higher percentage of change on SAQOL-39 compering to the control group, being consistent with quality-of-life improvements from a previously published study [4]. Nevertheless, Rasmussen et al. [4] intervention group was treated by a multidisciplinary, intersectoral and interventional team, whereas this research only includes the occupational therapist along the conventional care, which includes generally physiotherapy.
Regarding independence, statistically significant results were obtained for mRS but not for BI, although both groups greatly improved its results. Yamakawa et al. [50], referred an active OT intervention on patients with acute stroke was effective in improving the limitations in performing ADLs and reducing the length of hospitalization. They also indicated that it was more effective in patients with severe limitations in performing ADLs and cognitive impairment, such as neglect. Comparing to our study, it is noteworthy the greater improvement of the experimental group on the chosen scale to assess cognition skills, which almost doubled scores. A reason for this result may be the stimulation added by the occupational therapist and caregiver, as well as the better adherence to treatment and compliance of recommended exercises to improve perceptual-cognitive skills [53].
In regards to symptoms of depression, they reduced significantly after intervention in a 69% compared to the control group, being this data cohesive with a previously published study by Feng et al. [5], although they also found a significant decline on levels of anxiety that was not reflected in our research. Nevertheless, different evaluation tools were utilized. No similar studies that include communication skills as a variable have been found.
Strengths and limitations
This study has several limitations. First of all, one of the limitations may be the selected randomization method which was chosen to simply control balance across groups over time for a sample size of 60 participants. As published data suggest, the 6-block randomization method may not be optimal for randomization, as blocks are best used in smaller increments due to easier balance control. Therefore, the 4-block randomization method could have been a more optimal technique to use for this study [69]. On the other hand, although balance in sample size may be achieved with this method, groups may be generated that are rarely comparable in terms of certain covariates, which could introduce bias in the statistical analysis and reduce the power of the study. Consequently, sample size and covariates should had been balanced in this clinical research [70]. Secondly, although the evaluators were blinded to group assignment, the occupational therapist leading the intervention and who also participated in statistical analysis was not, therefore potential bias may have influenced final outcomes. It should be noted that they had no conflicts of interest. Thirdly, our study included patients with mild-moderate stroke sequelae and our results may not be valid for patients with moderate-severe sequelae. Fourthly, rehabilitation sessions that participants received varied due to many reasons. At the time, the public hospital area where the research took place, provided physiotherapy on ward (see Fig 1), but the number of sessions every patient received depended on the physiotherapist caseload, although it was intended every patient that was referred to physiotherapy by the rehabilitator doctor received at least one session a day. On the other hand, OT was not provided in the ward. In regards to the outpatient rehabilitation, patients could be referred to physiotherapy or OT, but start of intervention varied due to a waiting list, which was especially long for OT, and which meant some participants had not yet been called to start their outpatient’s intervention in the 3 months of research follow-up or were not even referred in the first place. Moreover, data regarding private treatment was inaccessible or not reliable, therefore it has not been included in the results comparisons. Fifthly, not all participants had a main caregiver that could help with their rehabilitation at home, which could also lead to differences on their skills improvements. Frequency and intensity of practice they performed at home also depended on their willingness to improve and adherence to treatment, it being therefore a limitation itself. Finally, participants with moderate-severe aphasia were not included in the investigation.
A previously published RCT by Mudzi et al. [53], concludes reminding the need to devise new ways of providing rehabilitation to patients post discharge enhancing the importance of domiciliary visits, as well as prompts that caregivers require more support to enable them to positively influence patient outcomes post stroke. Similarly, the current research shows a new possibility for the Spanish public healthcare system to include the occupational therapist as an active health professional to maximize safety on discharge and improve stroke patients’ quality of life. An important strength to mention is that, although sample sizes for each group had been previously calculated to prove statistical significance, the results have been shown to be also clinically relevant, revealing better outcomes on quality of life, cognition and depression. Moreover, EOTIPS provides information about the benefits of home assessments and post-discharge support for stroke survivors returning home and their families. Findings can lead to evidence-based clinical practice guideline recommendations, and therefore improvements for patients’ outcomes and greater cost-efficiency in hospitals.
Conclusions
This study has important implications for Occupational Therapy practice. First, it showed that early OT intervention after stroke can be provided successfully in the Spanish public healthcare system. Secondly, an early OT intervention during the process of discharge can help support participation in daily tasks and activities for patients diagnosed with a stroke, enhancing quality of life and leading to better outcomes on cognition.
This research provides additional support for OT as an evidence-based intervention to improve quality of life, perceptual-cognitive skills, independence and reduce depression in adults with stroke. Further replication studies with larger sample size are needed to validate this intervention.
Supporting information
S3 File. Approval by the research ethics committee.
https://doi.org/10.1371/journal.pone.0308800.s003
(PDF)
Acknowledgments
We acknowledge Francisca Rius Díaz, biostatistics expert, for her valuable assistance in this manuscript.
References
- 1. Díaz-Guzmán J, Egido JA, Gabriel-Sánchez R, Barberá-Comes G, Fuentes-Gimeno B, Fernández-Pérez C, et al. Stroke and transient ischemic attack incidence rate in Spain: the IBERICTUS study. Cerebrovasc Dis. 2012:34(4):272–81. pmid:23095851
- 2. Ezekiel L, Collett J, Mayo NE, Pang L, Field L, Dawes H. Factors Associated With Participation in Life Situations for Adults With Stroke: A Systematic Review. Arch Phys Med Rehabil. 2019 May;100(5):945–55. pmid:29981316
- 3. Rafsten L, Danielsson A, Nordin A, Björkdahl A, Lundgren-Nilsson A, Larsson MEH, et al. Gothenburg Very Early Supported Discharge study (GOTVED): a randomised controlled trial investigating anxiety and overall disability in the first year after stroke. BMC Neurol. 2019;19(1):277. pmid:31706292
- 4. Rasmussen RS, Østergaard A, Kjær P, Skerris A, Skou C, Christoffersen J, et al. Stroke rehabilitation at home before and after discharge reduced disability and improved quality of life: a randomised controlled trial. Clin Rehabil. 2016;30(3):225–36. pmid:25758941
- 5. Feng W, Yu H, Wang J, Xia J. Applicationeffectofthe hospital-community integrated service model in home rehabilitation of stroke in disabled elderly: a randomised trial. Ann Palliat Med. 2021;10(4):4670–7. pmid:33966415
- 6. García-Pérez P, Lara JP, Rodríguez-Martínez MC, de la Cruz-Cosme C. Interventions within the Scope of Occupational Therapy in the Hospital Discharge Process Post-Stroke: A Systematic Review. Healthcare. 2022;29:10(9):1645. pmid:36141257
- 7. Stolwyk RJ, Mihaljcic T, Wong DK, Chapman JE, Rogers JM. Poststroke Cognitive Impairment Negatively Impacts Activity and ParticipationOutcomes: A Systematic Review and Meta-Analysis. Stroke. 2021;52(2):748–60. pmid:33493048
- 8. Li Z, Zhang X, Wang K, Wen J. Effects of Early Mobilization after Acute Stroke: A Meta-Analysis of Randomized Control Trials. J Stroke Cerebrovasc Dis. 2018;27(5):1326–37. pmid:29373228
- 9. Nunes HJM, Queirós PJP. Patient with stroke: hospital discharge planning, functionality and quality of life. Rev Bras Enferm. 2017;70(2):415–23. pmid:28403308
- 10. Legg LA, Drummond AE, Langhorne P. Occupational therapy for patients with problems in activities of daily living after stroke. Cochrane Database Syst Rev. 2006;18:2006(4):CD003585. pmid:17054178
- 11. Mayo NE, Wood-Dauphinee S, Côté R, Gayton D, Carlton J, Buttery J, et al. There’s no place like home: an evaluation of early supported discharge for stroke. Stroke. 2000;31(5):1016–23. pmid:10797160
- 12. Fjærtoft H, Rohweder G, Indredavik B. Stroke unit care combined with early supported discharge improves 5-year outcome: a randomized controlled trial. Stroke. 2011;42(6):1707–11. pmid:21474806
- 13. Thomas M, Watson J. Caregivers of Stroke Survivors’ Perspectives on Stressful Caregiver Activities. The American Journal of Occupational Therapy. 2020;1:74(4_Supplement_1):7411510270p1.
- 14. García-Pérez Patricia; de la Cruz Cosme Carlos; Martínez Maria del Carmen Rodríguez; Lara Jose Pablo; Gallardo Tur Alejandro; Blanco-Reina Encarnación(2024). EOTIPS DATA.xlsx. figshare. Dataset. https://doi.org/10.6084/m9.figshare.25665207.v1.
- 15. Schulz KF, Altman DG, Moher D, CONSORT Group. CONSORT 2010 statement: updated guidelines for reporting parallel group randomised trials. PLoSMed. 2010 Mar 24;7(3):e1000251. pmid:20352064
- 16.
Simple randomisation service | Sealed Envelope [Internet]. [cited 2024 Apr 10]. Available from: https://www.sealedenvelope.com/simple-randomiser/v1/
- 17. Gittins M, Lugo-Palacios D, Vail A, Bowen A, Paley L, Bray B, et al. Stroke impairment categories: A new waytoclassifytheeffectsofstrokebasedonstroke-relatedimpairments. Clin Rehabil. 2021 Mar;35(3):446–58. pmid:33131321
- 18.
WMA–The World Medical Association-WMA Declaration of Helsinki–Ethical Principles for Medical Research Involving Human Subjects [Internet]. [cited 2022 Nov 10]. Available from: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/
- 19. Occupational Therapy Practice Framework: Domain and Process-Fourth Edition. AJOT. 2020;31:74(Supplement_2):7412410010p1–87. pmid:34780625
- 20. Ahmadi A, Tohidast SA, Mansuri B, Kamali M, Krishnan G. Acceptability, reliability, and validity of the Stroke and Aphasia Quality of Life Scale-39 (SAQOL-39) across languages: a systematic review. Clin Rehabil. 2017 Sep;31(9):1201–14. pmid:28125905
- 21. Lata-Caneda MC, Piñeiro-Temprano M, García-Fraga I, García-Armesto I, Barrueco-Egido JR, Meijide-Failde R. Spanish adaptation of the Stroke and Aphasia Quality of Life Scale-39 (SAQOL-39). Eur J Phys Rehabil Med. 2009 Sep;45(3):379–84. Epub 2009 Jan 21. pmid:19156021.
- 22. Hilari K, Lamping DL, Smith SC, Northcott S, Lamb A, Marshall J. Psychometric properties of the Stroke and Aphasia Quality of Life Scale (SAQOL-39) in a generic stroke population. Clin Rehabil. 2009 Jun 1;23(6):544–57. pmid:19447841
- 23. Baztán JJ, Pérez del Molino J, Alarcón T, San Cristóbal E, Izquierdo G, Manzarbeitia J. Índice de Barthel: Instrumento válido para la valoración funcional de pacientes con enfermedad cerebrovascular. Rev Esp Geriatr Gerontol 1993; 28: 32–40.
- 24. van Swieten JC, Koudstaal PJ, Visser MC, Schouten HJA, van Gijn J. Inter observer agreement for the assessment of handicap in stroke patients. Stroke. 1988;19(5):604–7. pmid:3363593
- 25. Duncan PW, Lai SM, Bode RK, Perera S, DeRosa J. Stroke Impact Scale-16: A brief assessment of physical function. Neurology. 2003;28:60(2):291–6. pmid:12552047
- 26. Reeves M, Lisabeth L, Williams L, Katzan I, Kapral M, Deutsch A, et al. Patient-Reported Outcome Measures (PROMs) for Acute Stroke: Rationale, Methods and Future Directions. Stroke. 2018 Jun;49(6):1549–56. pmid:29789396
- 27. Carod-Artal F. Escalas específicas de evaluación de calidad de vida en el ictus. 2004;39(11):1052–62.
- 28. Fugl-Meyer AR, Jääskö L, Leyman I, Olsson S, Steglind S. The post-stroke hemiplegic patient. 1. a method fo revaluation of physical performance. Scand J Rehabil Med. 1975;7(1):13–31. pmid:1135616
- 29. Gor-García-Fogeda MD, Molina-Rueda F, Cuesta-Gómez A, Carratalá-Tejada M, Alguacil-Diego IM, Miangolarra-Page JC. Scales to assess gross motor function in stroke patients: a systematic review. Arch Phys Med Rehabil. 2014 Jun;95(6):1174–83. pmid:24582618
- 30. Ferrer González BM. Adaptación y validación al español de la escala Fugl-Meyer en el manejo de la rehabilitación de pacientes con ictus. 2016 Feb 8 [cited 2023 Jun 20]; Available from: https://idus.us.es/handle/11441/40335.
- 31. Kudlac M, Sabol J, Kaiser K, Kane C, Phillips RS. Reliability and Validity of the Berg Balance Scale in the Stroke Population: A Systematic Review. Phys Occup Ther Geriatr. 2019;3:37(3):196–221.
- 32. Hafsteinsdóttir TB, Rensink M, Schuurmans M. Clinimetric properties of the Timed Up and Go Test for patients with stroke: a systematic review. Top Stroke Rehabil. 2014;21(3):197–210. pmid:24985387
- 33. Shi D, Chen X, Li Z. Diagnostic test accuracy of the Montreal Cognitive Assessment in the detection of post-stroke cognitive impairment under different stages and cutoffs: a systematic review and meta-analysis. Neurol Sci. 2018;39(4):705–16. pmid:29427168
- 34. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: A Brief Screening Tool For Mild Cognitive Impairment. Journal of the American Geriatrics Society. 2005;53(4):695–9. pmid:15817019
- 35. Chiti G, Pantoni L. Use of Montreal Cognitive Assessment in Patients With Stroke. Stroke. 2014 Oct;45(10):3135–40. pmid:25116881
- 36. Delgado C, Araneda A, Behrens MI. Validación del Montreal Cognitive Assessment (MoCA): test de cribado para el deterioro cognitivo leve. Datos preliminares. Neurología. 2019;34(6):376–385. pmid:28364958
- 37. Pulvermüller F, Berthier ML. Aphasiatherapyon a neuroscience basis. Aphasiology. 2008 Jun;22(6):563–99. pmid:18923644
- 38. Beck AT, Steer RA, Ball R, Ranieri W. Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients. J Pers Assess. 1996;67(3):588–97. pmid:8991972
- 39. Lobo A, Chamorro L, Luque A, Dal-Ré R, Badia X, Baró E, et al. Validation of the Spanish versions of the Montgomery-Asberg depression and Hamilton anxiety rating scales. Med Clin (Barc). 2002;13:118(13):493–9. pmid:11975886
- 40. Faul F, Buchner E, Lang AG. Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behavior Research Methods. 2009;(41):1149–60. pmid:19897823
- 41. Jamovi. The jamovi project (2022) [Internet]. 2022. Available from: https://www.jamovi.org.
- 42. Hutton L, Ownsworth T. A qualitative investigation of sense of self and continuity in younger adults with stroke. Neuropsychol Rehabil. 2019;29(2):273–88. pmid:28274180
- 43. Hansson SO, Björklund Carlstedt A, Morville AL. Occupational identity in occupational therapy: A concept analysis. Scand J Occup Ther. 2022;29(3):198–209. pmid:34260864
- 44. Barnden R, Cadilhac DA, Lannin NA, Kneebone I, Hersh D, Godecke E, et al. Development and field testing of a standardised goal setting package for person-centred discharge care planning in stroke. PEC Innov. 2022;1:100008. pmid:37364011
- 45. Rafsten L, Sunnerhagen KS. Patient-centered goal setting in very early supported discharge with continued rehabilitation after stroke. Disabil Rehabil. 2022;8:1–6. pmid:36346073
- 46. Lloyd A, Bannigan K, Sugavanam T, Freeman J. Experiences of stroke survivors, their families and unpaid carers in goal setting within stroke rehabilitation: a systematic review of qualitative evidence. JBI Database System Rev Implement Rep. 2018;16(6):1418–53. pmid:29894410
- 47. Lannin NA, Clemson L, Drummond A, Stanley M, Churilov L, Laver K, et al. Effect of occupational therapy home visit discharge planning on participation after stroke: protocol for the HOME Rehab trial. BMJ Open. 2021;5:11(7):e044573. pmid:34226214
- 48. Cogan AM, Weaver JA, Davidson LF, Cole KR, Mallinson T. Association of Cognitive Impairment With Rate of Functional Gain Among Older Adults With Stroke. J Am Med Dir Assoc. 2022;23(12):1963.e1–1963.e6. pmid:36058296
- 49. Chen S, Lv C, Wu J, Zhou C, Shui X, Wang Y. Effectiveness of a home-based exercise program among patients with lower limb spasticity post-stroke: A randomized controlled trial. Asian Nurs Res (Korean Soc Nurs Sci). 2021;15(1):1–7. pmid:32890770
- 50. Yamakawa S, Nagayama H, Tomori K, Ikeda K, Niimi A. Effectiveness of active occupational therapy in patients with acute stroke: A propensity score-weighted retrospective study. Front Rehabil Sci. 2022;3:1045231. pmid:36684684
- 51. Gibson E, Koh CL, Eames S, Bennett S, Scott AM, Hoffmann TC. Occupational therapy for cognitive impairment in stroke patients. Cochrane Database Syst Rev. 2022;29:3(3):CD006430. pmid:35349186
- 52. Schnell-Inderst P, Conrads-Frank A, Stojkov I, Krenn C, Kofler LM, Siebert U. Occupational therapy for persons with cognitive impairments. Ger Med Sci. 2023;21:Doc02. pmid:37260919
- 53. Mudzi W, Stewart A, Musenge E. Effect of carer education on functional abilities of patients with stroke | International Journal of Therapy and Rehabilitation. 2012;19:7, 380–385.
- 54. Taule T, Strand LI, Assmus J, Skouen JS. Ability in daily activities after early supported discharge models of stroke rehabilitation. Scand J Occup Ther. 2015;22(5):355–65. pmid:26005768
- 55. Saal S, Becker C, Lorenz S, Schubert M, Kuss O, Stang A, et al. Effect of a stroke support service in Germany: a randomized trial. Topics in Stroke Rehabilitation. 2015;18:22(6):429–36. pmid:25920942
- 56. Fisher RJ, Gaynor C, Kerr M, Langhorne P, Anderson C, Bautz-Holter E, et al. A consensus on stroke: early supported discharge. Stroke. 2011;42(5):1392–7. pmid:21441151
- 57. Wu Z, Xu J, Yue C, Li Y, Liang Y. Collaborative Care Model Based Telerehabilitation Exercise Training Program for Acute StrokePatients in China: A Randomized Controlled Trial. J Stroke Cerebrovasc Dis. 2020;29(12):105328. pmid:33002792
- 58. Zhou B, Zhang J, Zhao Y, Li X, Anderson CS, Xie B, et al. Caregiver-Delivered Stroke Rehabilitation in Rural China. Stroke. 2019;50(7):1825–30. pmid:31177978
- 59. Popović IM, Šerić V, Demarin V. Mild cognitive impairment in symptomatic and asymptomatic cerebrovascular disease. Journal of the Neurological Sciences. 2007;257:185–93. pmid:17328916
- 60. Bamford J, Sandercock P, Dennis M, Burn J, Warlow C. Classification and natural history of clinically identifiable sub types of cerebral infarction. Lancet. 1991;22:337(8756):1521–6. pmid:1675378
- 61. Andersen KK, Olsen TS, Dehlendorff C, Kammersgaard LP. Hemorrhagic and ischemic strokes compared: stroke severity, mortality, and risk factors. Stroke. 2009;40(6):2068–72. pmid:19359645
- 62. Paolucci S, Antonucci G, Grasso MG, Bragoni M, Coiro P, De Angelis D, et al. Functional out come of ischemic and hemorrhagic stroke patients after inpatient rehabilitation: a matched comparison. Stroke. 2003;34(12):2861–5. pmid:14615613
- 63. Salvadori E, Papi G, Insalata G, Rinnoci V, Donnini I, Martini M, et al. Comparison between Ischemic and Hemorrhagic Strokes in Functional Outcome at Discharge froman Intensive Rehabilitation Hospital. Diagnostics. 2020;28:11(1):38. pmid:33379391
- 64. Perna R, Temple J. Rehabilitation Outcomes: Ischemic versus Hemorrhagic Strokes. Behav Neurol. 2015;2015:891651. pmid:26246694
- 65. Savage B, Foli KJ, Edwards NE, Abrahamson K. Familism and Health Care Provision to Hispanic Older Adults. J Gerontol Nurs. 2016 Jan;42(1):21–9; quiz 30–1. pmid:26651861
- 66. Haraldstad K, Wahl A, Andenæs R, Andersen JR, Andersen MH, Beisl and E, et al. A systematic review of quality of life research in medicine and health sciences. Qual Life Res. 2019;28(10):2641–50. pmid:31187410
- 67. McGill K, Sackley C, Godwin J, Gavaghan D, Ali M, Ballester BR, et al. Using the Barthel Index and modified Rankin Scale as Outcome Measures for Stroke Rehabilitation Trials; A Comparison of Minimum Sample Size Requirements. Journal of Stroke and Cerebrovascular Diseases. 2022;1:31(2):106229. pmid:34871903
- 68. Sreekrishnan A, Leasure A, Zhou S, Greer D, Sheth K. Differences between the modified rank in scale and Barthel index in measuring intracerebral hemorrhage recovery at 12 months. (P5.051). Neurology. 2017;18;88(16 Supplement):P5.051.
- 69. Kang M, Ragan BG, Park JH. Issues in outcomes research: an overview of randomization techniques for clinical trials. J Athl Train. 2008 Apr-Jun;43(2):215–21. pmid:18345348
- 70. Pocock SJ, Simon R. Sequential treatment assignment with balancing for prognostic factors in the controlled clinical trial. Biometrics. 1975 Mar;31(1):103–15. pmid:1100130.