Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Robot-assisted gait training in patients with various neurological diseases: A mixed methods feasibility study

  • Isabella Hotz,

    Roles Investigation, Project administration, Writing – original draft

    Affiliation Department of Rehabilitation Science, Clinic for Rehabilitation Münster, Münster, Austria

  • Sarah Mildner,

    Roles Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Rehabilitation Science, Clinic for Rehabilitation Münster, Münster, Austria

  • Michaela Stampfer-Kountchev,

    Roles Conceptualization, Investigation, Supervision, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Bianca Slamik,

    Roles Formal analysis, Investigation, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Christoph Blättner,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Elisabeth Türtscher,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Franziska Kübler,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Rehabilitation Science, Clinic for Rehabilitation Münster, Münster, Austria

  • Clemens Höfer,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Johanna Panzl,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Michael Rücker,

    Roles Investigation, Writing – review & editing

    Affiliation Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria

  • Christian Brenneis,

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – review & editing

    Affiliations Department of Neurology, Clinic for Rehabilitation Münster, Münster, Austria, Karl Landsteiner Institute of Interdisciplinary Rehabilitation Research, Münster, Austria

  • Barbara Seebacher

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    barbara.seebacher@reha-muenster.at

    Affiliations Department of Rehabilitation Science, Clinic for Rehabilitation Münster, Münster, Austria, Karl Landsteiner Institute of Interdisciplinary Rehabilitation Research, Münster, Austria, Clinical Department of Neurology, Medical University of Innsbruck, Innsbruck, Austria

Abstract

Background

Walking impairment represents a relevant symptom in patients with neurological diseases often compromising social participation. Currently, mixed methods studies on robot-assisted gait training (RAGT) in patients with rare neurological diseases are lacking. This study aimed to explore the feasibility, acceptability, goal attainment and preliminary effects of RAGT in patients with common and rare neurological diseases and understand the intervention context and process.

Methods

A mixed-methods feasibility study was conducted at an Austrian rehabilitation centre. Twenty-eight inpatients after stroke in the subacute and chronic phases, with multiple sclerosis, Parkinson’s disease, spinal cord injury, spinocerebellar ataxia, acute/chronic inflammatory demyelinating polyneuropathy and motor neuron disease were included. Patients received RAGT for 45 minutes, 4x/week, for 4 weeks. Baseline and post-intervention assessments included gait parameters, walking and balance, and questionnaires. Semi-structured observations were conducted twice during the intervention period and analysed using thematic analysis. Descriptive statistics within the respective disease groups and calculation of effect sizes for the total sample were performed. Triangulation was employed to develop a deeper understanding of the research topic.

Results

Data from 26 patients (mean age 61.6 years [standard deviation 13.2]) were analysed. RAGT was highly accepted by patients and feasible, indicated by recruitment, retention, and adherence rates of 84.8% (95% confidence interval, CI 0.7–0.9), 92.2% (95% CI 0.7–1.0) and 94.0% (95% CI 91.4–96.2), respectively. Goal attainment was high, and only mild adverse events occurred. Improvements in walking speed (10-Metre Walk Test, effect size r = 0.876), walking distance (6-Minute Walk Test, r = 0.877), functional mobility (Timed Up and Go, r = 0.875), gait distance (r = 0.829) and number of steps (r = 0.834) were observed. Four themes were identified: familiarising with RAGT; enjoyment and acceptance through a trusting therapeutic relationship; actively interacting; and minimising dissatisfaction.

Discussion

Sufficiently powered randomised controlled trials are needed to validate our results.

Trial registration

German Clinical Trials Register, DRKS00027887.

Background

Walking disorders represent a relevant symptom in patients with neurological diseases. In multiple sclerosis (MS), symptoms such as weakness and spasticity, loss of proprioception, balance and coordination, cognitive and visual dysfunction, fatigue and pain can contribute to walking impairment [1]. In patients with Parkinson’s disease (PD), mobility may be affected by rigidity, hypo- and bradykinesia, flexion posture and postural instability [2]. After stroke, hemiparetic spastic walking impairment is a common symptom in about 75% of patients [3]. Hereditary ataxias are primarily characterised by progressive motor and speech coordination deficits and unsteady walking with an increased step width [4]. In patients with spastic paraplegia or tetraplegia due to spinal cord injury (SCI), polyneuropathies, and motor neuron disease, walking dysfunction is also a major aspect of patients’ disability leading to limitations in their daily lives [5]. Numerous studies have found that walking disability contributes to depression and anxiety and severely impairs social participation and health-related quality of life (HRQoL) [1, 6]. In addition, relevant studies have highlighted the relationship between walking disability and unemployment in patients with neurological diseases [7, 8].

Walking and balance disorders can be treated through intensive and repetitive task-oriented training [9, 10]. Applying the principles of massed (focused), high-dose, task- specific training with individualized progressive adjustment of difficulty considering patient’s performance, implicit and explicit feedback, robot-assisted gait training (RAGT) is used to address walking impairment [1113]. Systematic reviews have shown that RAGT benefits gait in patients with PD and MS [1416] and improves walking ability, walking speed and distance in patients after stroke [17]. However, to the best of our knowledge, no study has investigated the feasibility and acceptability of RAGT in patients with common and rare neurological disorders using a mixed methods approach. Aims of this study were therefore to investigate the feasibility, acceptability, goal attainment and preliminary effects of RAGT in patients after stroke, with MS, PD, spastic paraplegia or tetraplegia, hereditary ataxia, inflammatory demyelinating polyneuropathies and motor neuron disease. Further aims were to explore the intervention context and process.

Materials and methods

Study design

This study was a prospective convergent mixed methods feasibility study [18] based on the paradigm of pragmatism to investigate the research question with a plurality of views and methods [19]. Triangulation was used to gain a deeper understanding of the research topic [20]. The Good Reporting of a Mixed Methods Study (GRAMMS) framework [21] was used (S1 Table).

Participants

Sample size.

Based on the study design and primary outcome, no formal sample size calculation was carried out (see S1 File for the study protocol). Instead, the decision regarding the number of patients included in the study was influenced by the varying prevalence rates of the investigated diseases, resulting in a total sample size of 28.

Inclusion criteria.

Using maximum variation sampling, 28 patients were enrolled from 1.2.2022 to 18.10.2022 at the Clinic for Rehabilitation Münster, Austria. Inclusion criteria were: adults aged 18–99 years; any sex; any ethnicity; diagnosis of ischaemic or haemorrhagic stroke confirmed using the German Society of Neurology (2017) Guideline [22]; MS according the revised McDonald criteria valid at the time of diagnosis [23, 24]; PD using the UK Brain Bank criteria [25]; spastic para- or tetraplegia caused by any type of spinal cord lesion (SCI) according to the German Society of Neurology (DGN 2021) Guideline [26] or current NICE Guideline (2016) [27]; mild to moderate hereditary (spinocerebellar) ataxia (SCA) using the Ataxia Medical Guidelines 2016 or earlier versions, developed by Ataxia UK, London [28]; acute or chronic inflammatory demyelinating polyneuropathy (PNP) e.g., due to Guillain-Barré syndrome or chronic inflammatory demyelinating polyneuropathy following the corresponding European Federation of Neurological Societies/Peripheral Nerve Society Guideline [29]; motor neuron disease (MND) e.g., amyotrophic lateral sclerosis (ALS) using the revised World Federation of Neurology El Escorial Criteria [30, 31]; at a clinically stable phase of the disease; ability to participate in this study; walking impairment (Functional Ambulation Categories (FAC) [32] score 0–4); intact cognitive function (Mini Mental State Examination (MMSE) [33] score of ≥24/30 points); German speaking verbally and written language.

Exclusion criteria.

Patients were excluded if they met any of the following criteria: concomitant disease such as malignant disease, other severe neurological, orthopaedic or psychiatric disorders; acute, pronounced pain; joint contracture or arthrodesis; severe spasticity in or consolidated fractures of the lower extremity; body weight exceeding 180 kg; body height <100 cm or >200 cm; increased risk of bone fracture; osseous or joint instability; cardiac contraindications; high-grade ataxia or apraxia; skin lesions in areas which come in contact with the device or harness system; inadequately treated epilepsy; or pregnancy.

Recruitment.

Patients who met the eligibility criteria were informed verbally and in writing about the study by the principal investigator, along with an invitation to participate in the study. Upon acquiring informed written consent, screening for cognitive impairment was carried out. Patients who passed the screening were subsequently enrolled in the study.

Intervention

All patients received RAGT using a mechatronic end-effector robotic device with body weight support (LEXO® robotic gait trainer, Tyromotion, Graz, Austria). RAGT was performed as part of multidisciplinary inpatient rehabilitation for 45 minutes, 4x/week, for 4 weeks and supervised 1:1 by a trained physiotherapist. Patients could choose between a harness system or a saddle to ensure the required body-weight support (S1 Fig). Throughout the training session, augmented performance feedback was delivered via a computer screen positioned in front of the patient. This feedback was generated from the robot’s gait parameter measurements. A standard RAGT protocol was used to record configurations, results, breaks and other important information (S2 File). The training was adapted according to the individual performance level of the patient. The first step was to reduce the body-weight support as tolerated by the patient, then gradually increase the cadence and step length. During the 45 min training session, patients could rest at any time. Physical support at the ankle or knee joint was provided by the physiotherapist as needed, to assist muscle activation and enhance a physiological gait pattern. Adverse events and safety issues related to the training were monitored.

Data collection

At baseline, age, sex, years of education, and type and date of diagnosis were extracted from patients’ medical charts. Disease specific information were collected as follows: Impairment caused by stroke was assessed using the National Institutes of Health Stroke Scale (NIHSS) [34]; MS-related disability with the Expanded Disability Status Scale (EDSS) [35]; disability and impairment in PD utilising the Unified Parkinson’s Disease Rating Scale (UPDRS) [36] and Hoehn & Yahr Scale (H&Y) [37]; classification of the acquired impairment in SCI according to the American Spinal Injury Association (ASIA) Impairment Scale (AIS) [38] and neurological level of injury; impairment caused by SCA by means of the Scale for the Assessment and Rating of Ataxia (SARA) [39, 40]; disability caused by Guillain-Barré syndrome utilising the Guillain-Barré syndrome disability scale (GBSDS) [41]; peripheral neuropathy using the Overall Neuropathy Limitations Scale (ONLS) [42]; and functional status in patients with ALS using the Amyotrophic Lateral Sclerosis Functional Rating Scale, revised version (ALS-FRS-R) [43].

Primary outcome.

The feasibility of the methods and the potential for conducting a larger trial was explored using predetermined criteria. This involved monitoring monthly recruitment, retention, and adherence rates in relation to the RAGT intervention. Using a structured log, adherence to the RAGT was documented, capturing instances of non-adherence and reasons for discontinuation (e.g., lack of interest). Instances of participants not being retained in the study were also documented, with the reason e.g., withdrawal of consent. Any adverse events and side effects were systematically recorded and evaluated using a formal log including the date, type of adverse event, severity classified into serious/non-serious, causality differentiated into related/non-related with the interventions, and actions to restore or improve the patient’s wellbeing and outcome.

Acceptability of the intervention was assessed using a 5-point Smiley Likert Scale asking 4 predefined questions on the acceptance of the intervention, with lower numbers representing higher acceptance/satisfaction: “How did you like the training?”(1); “How well did you feel during the training?”(2); “How satisfied were you with your performance?”(3); “How satisfied were you with your results?”(4).

The predetermined criteria for feasibility success were:

  1. a target recruitment rate of 3 patients per month or 80%,
  2. a target retention rate of 85%,
  3. a target minimum adherence rate of 75% to the RAGT interventions (12 sessions out of a maximum of 16),
  4. high safety of the intervention, no severe adverse events related with the study intervention,
  5. high acceptability of the intervention.

Secondary outcomes.

Secondary outcomes were walking speed as assessed by the 10-Metre Walk Test (10MWT) [44]; walking distance measured by the 6-Minute Walk Test (6MWT) [45]; functional mobility using the Timed Up and Go (TUG) [46]; dynamic balance measured by the Four-Square Step Test (FSST) [47]; fall rate assessed by the number (percentage) of fallers/non-fallers; walking ability using the functional ambulation categories (FAC) [32]; and dynamic balance assessed by the Functional Gait Assessment (FGA) [48]. In non-ambulatory patients, trunk movement was assessed using the Trunk Control Test (TCT) [49] and the limits of stability regarding trunk movements utilising the Modified Functional Reach Test (MFRT) [50]. Additionally, concerns about falling were measured using the Falls Efficacy Scale-International (FES-I) [51]; fatigue employing the Fatigue Severity Scale (FSS) [52]; depression assessed using the Beck Depression Inventory, second edition (BDI-II) [53]; and HRQoL utilising the 5-level EQ-5D version (EQ-5D-5L) [54]. The amount of individual and predefined goal achievement was evaluated using Goal Attainment Scaling (GAS) [55]. Details on the administration and psychometric properties of standardised assessments are provided in S3 File. Gait parameters (gait speed, gait distance, number of steps and step length) during the RAGT intervention were recorded by the LEXO® robotic gait trainer. Outcome data were collected by trained neurologists, psychologists, and physiotherapists at baseline and post-intervention.

In addition, semi-structured observations of RAGT were performed by trained physiotherapist-researchers in weeks 1 and 4 to understand the intervention context and process.

Observations of the RAGT intervention

Two observations of the RAGT intervention were conducted to understand the intervention context and process, recognise patterns, and move beyond selected outcome measures (S2 Table). This was considered of clinical relevance because high acceptability may help increase motivation and adherence in patients. Using a combined structured and unstructured observation protocol and taking notes, in weeks 1 and 4 RAGT sessions were observed by trained and experienced physiotherapist-researchers holding a Master’s or PhD degree to investigate the RAGT process and acceptance [56]. The observer introduced herself to the study patients at the beginning of the RAGT session but stayed in the background as a silent observer for the remainder of the session.

The observation forms underwent a pilot phase involving 4 separate researchers across 5 sessions to evaluate congruence, practicability and to identify and correct any sources of error [57]. Following the pilot, an additional section for unstructured observations and two categories for setup and closure were incorporated. This expansion was intended to gather more comprehensive insights into the process.

Reflexive statement.

To enhance trustworthiness and credibility, and acknowledge and reduce researcher bias, all researchers discussed their position, beliefs and prior experiences [58]. The researchers used a peer scrutiny and debriefing throughout the process of semi-structured and unstructured observations and qualitative data analysis to disclose personal biases. Qualitative data collection and analysis was described in detail to enrich dependability. Both observations and the participants’ and therapists’ verbatim expressions were included in the final report. A summary of the researchers’ backgrounds involved in the qualitative strand of the study is presented in S3 Table.

Ethics, governance, and study registration

This study was approved by the research ethics committee of the Medical University of Innsbruck, Austria (ref. 1403/2021; 21.01.2022). All patients signed the informed consent form prior to enrolment. Data collected in the context of this study were treated confidential and personal data pseudonymised. This clinical investigation followed the World Medical Association Declaration of Helsinki (2013) [59], Guidelines of the International Organization for Standardization (ISO), ICH E6 Guideline for good clinical practice (2016) and Guideline for Clinical investigation of medical devices for human subjects—Good clinical practice (ISO/DIS 14155:2018). This study was prospectively registered with the German Clinical Trials Register on 26.01.2022 (DRKS-ID: DRKS00027887).

Data analyses

Statistical data analyses.

IBM SPSS Software, release 27.0 (IBM Corporation, Armonk, NY, USA) and GraphPad Prism 9, San Diego, California, were used for the data analysis. Statistical significance was defined as a two-tailed p-value 0.05. Descriptive statistics were used for the baseline demographic variables, primary and secondary outcome measures. Continuous data were checked for normal distribution using the Shapiro Wilk Test and visualised using Q-Q plots and histograms. Frequencies (percentage) were presented for count data. Medians (minimum—maximum) were reported for ordinal data or continuous data showing a non-normal distribution, and the mean (standard deviation [SD]) was used for continuous data. The number (percentage) of patients, who reached a clinically significant improvement in walking speed of at least 0.14 m/s on the 10MWT [60] was estimated, likewise, the number (percentage) of patients was calculated, who showed a clinically significant improvement in walking distance of at least 34.4 metres on the 6MWT [6,1]. Spearman’s rank correlation coefficients were estimated between gait parameters and mobility tests (i.e., timed walking, mobility, and dynamic balance tests) and presented using a heatmap. Effect sizes were determined using the rank-biserial correlation coefficient (r) derived from the Wilcoxon signed-rank test. This coefficient offers insights into the strength and direction of association between paired samples, specifically the baseline and post-intervention measures in this study [62]: (1) where Z was the the Wilcoxon signed rank test Z-score and n was the total number of observations on which Z was based [61]. According to Cohen (1988), a correlation coefficient of 0.10 was considered a weak correlation; 0.30 a medium correlation, and 0.50 or higher a strong correlation [63].

With respect to the primary outcome of feasibility, the recruitment rate (%) was estimated by dividing the number of patients who consented by the N of eligible patients, multiplied by 100. The retention rate (%) was determined by dividing the N of patients who completed the study by the N of the total sample, times 100. The adherence rate (%) was calculated by dividing the N of RAGT sessions performed by the patients, divided by the N of the scheduled RAGT training sessions over the 4 week study period (16x), times 100 [64]. The recruitment, retention, and adherence rates were calculated with their 95% confidence interval (CI) according to the Wilson ‘score’ method cited by Newcombe [65]; when the proportion was close to 0 or 1, a Poisson approximation as described by Brown and colleagues was used [66].

Qualitative data analysis.

Inductive reflexive thematic analysis (TA) according to Braun and Clarke [66] was used to analyse the observation data. Thematic analysis is distinguished by its inherent structure, and we adhered to the six analysis phases outlined by Braun & Clarke [67, 68]. Phase 1 involved familiarising ourselves with the dataset through thorough and critical reading. In phase 2, using f4analyse (Dr. Dresing & Pehl GmbH, Marburg, Germany) qualitative analysis software, two independent researchers worked systematically through the data set, identifying initial codes that held relevance or significance to the research question. These codes were discussed among the two coders and two additional researchers until a consensus was reached. Codes underwent multiple revisions and were cross-checked against the entire dataset. Moving into the third phase, two researchers independently began drafting preliminary themes, designed to encapsulate clusters of codes sharing common meanings. Advancing to the fourth phase, these themes were then discussed among the four researchers, refined, and subjected to testing. The subsequent stage (phase 5) focused on enhancing, naming, and defining the themes. At the conclusion of this process, the themes were established and presented in written form alongside pertinent data excerpts, enriching overall understanding. The process was not strictly linear; instead, it was marked by iterative cycles involving multiple rounds of revisions, refinements, deletions, and the emergence of new codes and themes. Throughout this iterative journey, the codes and themes were consistently evaluated through peer scrutiny and debriefing, solidifying the trustworthiness and credibility of our findings [69], involving colleagues in the research process to offer feedback, insights, and critical evaluation. To ensure consensus, the evolved themes and descriptions underwent extensive discussion among four female researchers. The themes and descriptions were crafted from the researchers’ perspective, informed by their backgrounds in neurology and physiotherapy.

Results

Participants’ characteristics

Twenty-eight patients were enrolled, thereof 26 completed the study (10 women, 16 men). See Fig 1 for a flow chart. The patients’ mean age was 61.6 (SD 13.2) years. At baseline, 23 patients were ambulatory and 5 were non-ambulatory, 5 patients were fallers (19.2%) and 21 were non-fallers (80.8%). Detailed demographic and disease related data are presented in Table 1.

Primary outcome

The recruitment rate was 87.88% (95% CI 70.86–96.04; or 3–4 patients recruited per month), the retention rate 92.86% (95% CI 0.75–0.99) and the adherence rate 94.23% (95% CI 91.42–96.19). For RAGT, none of the patients chose the saddle for body-weight support, they felt more comfortable using the harness system. Only anticipated mild and transient adverse events were reported including muscle fatigue (n = 19), musculoskeletal pain (n = 5), sensory symptoms (n = 3), and a fall (n = 1).

Median (range) pleasure rating on the 5-point Smiley Likert Scale during the RAGT was 1 (1–2). Feeling well during RAGT was rated median 1 (1–3), satisfaction with one’s performance 2 (1–3) and satisfaction with one’s results 1 (1–4), with lower scores indicating higher pleasure, wellbeing, and satisfaction respectively. These numbers indicated that the predetermined feasibility criteria were met.

Secondary outcomes

From baseline to post-intervention, there was an improvement in walking speed, walking distance, functional mobility, and dynamic balance in all patients (Fig 2 and S2 Fig and S4 Table). Sixteen out of 28 patients (57.1%) reached a clinically significant improvement in walking speed of ≥20% and 12 patients (42.9%) showed a clinically significant improvement in walking distance exceeding 20%. Compared to baseline, with 5 patients reporting a fall, at post-intervention only one patient remained a faller (3.8%) and 25 were non-fallers (96.2%). Overall, walking abilities according to the FAC improved by median (range) 1 (0–3) points. Patients diagnosed with MND, SCI, and SCA demonstrated the smallest improvements in their walking capabilities, with gains of only 0.5 points.

thumbnail
Fig 2. Secondary outcomes.

The before-after graphs represent individual patients’ walking performance at baseline (blue dots) and post-intervention (red or orange dots) on the (A) 10MWT, (B) 6MWT, (C) TUG, and (D) FGA. With the 10MWT, 6MWT and FGA, an increase in scores represents improvement. With the TUG, decrease in duration indicates improvement. 10MWT, 10-Metre Walk Test; 6MWT, 6-Minute Walk Test; BL, baseline; FGA, Functional Gait Assessment; MND, motor neuron disease; MS, multiple sclerosis; PD, Parkinson’s disease; PI, post-intervention; PNP, acute or chronic inflammatory demyelinating polyneuropathy; SCA, spinocerebellar ataxia; SCI, spinal cord injury (spastic para- or tetraplegia); TUG, Timed Up and Go.

https://doi.org/10.1371/journal.pone.0307434.g002

In non-ambulatory patients, improvements in the limits of stability regarding trunk movements (MFRT) were observed, with large effect sizes for all subcategories (reaching forward, r = 0.663; reaching right, r = 0.905 and reaching left, r = 0.921). There were however no changes in aspects of trunk movement as assessed by the TCT. Improvements in concerns about falling were seen in most patients, with a large effect size of r = 0.772. Furthermore, improvements in fatigue (r = 0.544), depression (r = 0.647) and HRQoL (r = 0.579, 0.404) were found, although some patients reported a worsening in fatigue, depression, or their overall health condition (Fig 3 and S4 Table). Patients were able to achieve individual and predefined goals “somewhat more than expected” as shown by a median (minimum—maximum) score difference on the GAS of 1 (-2 to 2).

thumbnail
Fig 3. Results from secondary outcomes of questionnaires.

The before-after graphs represent individual patient’s scorings at baseline (blue squares) and post-intervention (lilac or pink squares) on the (A) FFS, (B) BDI-II, (C) FES-I, (D) EQ-5D-5L VAS and (E) EQ-5D-5L Index. With the EQ-5D-5L VAS and EQ-5D-5L Index, an increase in scores represents improvement. With the FSS, BDI-II and FES-I, decrease indicates improvement.

https://doi.org/10.1371/journal.pone.0307434.g003

A, ambulatory patients; BDI-II, Beck Depression Inventory second edition; BL, baseline; EQ-5D-5L Index, 5-level EQ-5D version Index; EQ-5D-5L VAS, 5-level EQ-5D version visual analogue scale; FES-I, Falls Efficacy Scale-International; FSS, Fatigue Severity Scale; MND, motor neuron disease; MS, multiple sclerosis; NA, non-ambulatory patients; PD, Parkinson’s disease; PI, post-intervention; PNP, acute or chronic inflammatory demyelinating polyneuropathy; SCA, spinocerebellar ataxia; SCI, spinal cord injury (spastic para- or tetraplegia).

Overall, the gait parameters of gait distance, number of steps, average step length, RAGT time, and maximum gait speed improved in all disease groups (S5 Table). For the relationship between the RAGT gait parameters and the timed walking tests, mobility, and dynamic balance tests, weak to moderate correlations were found (Fig 4). Fig 5 presents changes of the gait distance, number of steps, average step length, RAGT time and maximum speed from baseline to post-intervention in the total sample.

thumbnail
Fig 4. Correlations of gait parameters with walking, mobility, and dynamic balance.

The heatmap presents Spearman’s rank correlation coefficients (ranging from-1 to +1) of gait parameter measures and walking assessments, where greater numbers (Spearman’s rho correlation coefficients), and darker blue and black fields signify stronger positive or negative correlations. 10MWT, 10-Metre Walk Test; 6MWT, 6-Minute Walk Test; FAC, Functional Ambulation Categories; FGA, Functional Gait Assessment; FSST, Four Square Step Test; RAGT, robot-assisted gait training; TUG, Timed Up and Go.

https://doi.org/10.1371/journal.pone.0307434.g004

thumbnail
Fig 5. Changes in gait parameters.

Violin plots present the changes in gait parameters of the study cohort. Medians are represented by bold vertical lines in the centre of the violins, 25. and 75. percentiles by thin vertical lines and ranges by the violin borders. Improvement is signified by a positive change (percentage) from baseline and worsening by a negative change (percentage), with a dashed red line indicating zero change. RAGT, robot-assisted gait training.

https://doi.org/10.1371/journal.pone.0307434.g005

Observations of the RAGT intervention

Throughout the intervention period, 51 observations of RAGT were carried out on 26 patients. Among them, 23 patients underwent two observations each. The field notes taken were converted into digital Word files for subsequent data analysis. From the material 56 codes were developed, which brought the key points into focus [70] (S6 Table). Finally, four themes were identified from the codes, as shown in Table 2, along with their corresponding quotations. The themes were not prioritised; their order reflects the sequence in which they were found.

Integration of findings

Integration of quantitative and qualitative data was performed by two researchers (IH and BS), showing that RAGT is feasible and highly accepted among patients with neurological disorders. Fig 6 visualises the individual positive and negative aspects of the RAGT and how they interacted. Due to the high adaptability of the device, the training parameters could be adjusted to fit the patients’ needs. Moreover, quantitative data showed that walking ability, walking speed, mobility, dynamic balance, gait distance, RAGT time, average step length and maximum gait speed improved over the 4-week intervention period. Furthermore, improvements in concerns about falling, fatigue, mood, and HRQoL were reported. The therapeutic relationship between patients and therapists was observed to be a core component of a satisfying and self-determined training for the patients, where they were able to unleash their full potential.

thumbnail
Fig 6. Integration of qualitative and quantitative findings.

The concept-map illustrates the individual aspects, with plus signs denoting positive influences and minus signs negative influences on satisfactory RAGT.

https://doi.org/10.1371/journal.pone.0307434.g006

Discussion

This study investigated the feasibility, acceptance, and preliminary effects of RAGT among people with different neurological diseases. Results showed that a 4-week intervention embedded into routine care was feasible and highly accepted by the patients. In our study, high recruitment, adherence, and retention rates of 87.9%, 94.2% and 92.3% respectively, were observed. Given the lack of evidence on recruitment, adherence, and retention rates in RAGT studies, we compared our results with other rehabilitation studies. With a home-based physical activity programme in older adults at risk of Alzheimer’s disease, adherence and retention rates were 91.7% and 97.2% respectively [71]. An 80% retention rate was seen with a 6-week rhythmic-auditory cued gait and balance programme in people after stroke [72]. A review that investigated recruitment and retention of participants in 151 randomised controlled trials (RCT) funded and published by the United Kingdom Health Technology Assessment Programme showed a median retention rate of 89.0% [73], comparable the present study. We suggest that several factors could have influenced adherence and retention in our and other studies. First, individual characteristics, such as motivation, perceived benefits, and expectations, supervision, integration into daily life, communication and feedback, self-efficacy and competence and patient’s active role and goal setting may have impacted adherence and retention [74], particularly in those with more severe walking impairment. Patients with higher motivation levels, a positive attitude towards training, and a clear understanding of the potential benefits of RAGT are likely more inclined to actively participate in and adhere to a RAGT programme, ensuring continued engagement [74]. Second, the design of the RAGT intervention itself could have influenced adherence and retention. Patient engagement and adherence may have been influenced by various factors, including the duration and frequency of sessions, customisation tailored to individual needs, the level of challenge and gradual progression in the training programme, as well as the availability of progress information and monitoring [74, 75]. Overall, in our study, only mild, short-lived adverse events were observed. These adverse events were of an expected nature and encompassed muscle fatigue, musculoskeletal pain, and sensory symptoms. Additionally, typical signs of exertion, such as heavy breathing, sweating, and skin reddening, were observed. Another end-effector study investigated in the feasibility of RAGT in patients with various neurological disorders and reasons for attrition [76]. Except saddle discomfort, main reasons for discontinuation comprised poor cooperation, pain, limitations in motion or need for excessive body-weight support [76]. This could be explained by the use of a saddle with the end-effector device in the cited study [76]. In contrast, participants in our study had the option to choose between a harness or a saddle, and they unanimously preferred the use of a harness. In general, technology-based interventions seem to be associated with higher adherence rates as compared to conventional therapies [77]. Third, adequate support and guidance from the therapists in our study could have played a crucial role in promoting adherence and retention. Provision of clear instructions, ongoing feedback, encouragement, and addressing of concerns or barriers could have helped patients feel supported and motivated to continue with the RAGT [78, 79]. This was reflected by the findings from our qualitative analysis described below.

Our quantitative results showed improvements in all walking, balance, and functional mobility related outcomes, as well as in concerns about falling, fatigue, depression and HRQoL across groups. We found large effect sizes related to changes in walking speed and distance, functional mobility, dynamic balance, gait distance, number of steps, RAGT time and concerns about falling in patients. Significant albeit weak to moderate correlations between RAGT parameters and mobility related outcome measures were seen. This suggests that RAGT is useful even within underexplored neurological populations, including patients with motor neuron disease and SCA.

In an RCT that compared RAGT with different amounts of weight support to conventional gait training in patients after stroke, improvements in walking speed and mobility were found [80]. Results aligned with those from a single-blind pilot RCT [81] on the effects of RAGT with virtual reality on motor and cognitive function in people with MS. A significant improvement in walking distance and HRQoL was observed, again, similar to the present study. We speculate that the end-effector-based gait training type used in our study helped to address pelvic obliquity in patients, by providing targeted assistance and guidance to promote proper alignment and symmetry [82]. The robotic device may have contributed to adjusting movement trajectories, enhancing the level of voluntary muscle engagement during the stance phase and applying forces to the body to encourage correct pelvic alignment [83, 84]. These suggestions align with findings from RCTs that investigated the differences between end-effector RAGT and treadmill training or conventional gait training in people with PD [8588]. Results showed greater improvements in pelvic obliquity and the hip abduction-adduction in the RAGT group than in the treadmill group [86] and additionally, RAGT was superior to conventional gait training [85, 86]. However, no statistical superiority of RAGT over treadmill training in balance or walking speed was found [87]. This might be attributed to a lack of statistical power, resulting from 20–25 patients in each group.

Studies investigating the effects of RAGT in patients with SCA are still lacking. Our preliminary results indicated that patients with SCA may benefit from RAGT. These results are in line with two single case studies showing improvement in balance and walking in a 56-year-old male patient with hereditary ataxia of unknown type [89] and a 23-year-old woman with SCA [90]. Findings suggest that individuals with ataxia may benefit from the assistance, guidance, and feedback provided by the RAGT technology. As RAGT devices provide a more stable and controlled environment, the risk of falls is reduced. Consequently, patients can focus on their gait patterns responding to the real-time feedback on gait parameters from the robotic device, enabling them to make necessary adjustments and enhance their motor control and coordination during walking [91, 92]. This may refer particularly to patients with intact cognition as included in our study, who are able to understand and generate a physical response to visual feedback [92]. Agreeing with this proposition, an RCT including 19 patients after stroke or meningoencephalitis with ataxia demonstrated significantly greater improvements in walking ability and walking speed after end-effector type RAGT as compared to conventional physiotherapy [93]. Similarly, another small RCT has found statistically significant improvements in balance, functional independence in activities of daily living and general ataxia symptoms, but no differences between the RAGT and therapist-assisted gait training groups in patients with post-stroke ataxia [94].

Our descriptive results indicated that RAGT leads to improvements in walking, balance, mobility, and other outcomes in people with spastic paraplegia due to SCI. Relatedly, a meta-analysis showed that RAGT was superior to body-weight-supported overground or treadmill walking in improving walking speed in people with SCI [95]. In line with this, another prospective multi-centre study has shown significant improvements in walking speed following an end-effector-based gait training in people with SCI [96].

In our study, we observed an improvement in walking, balance, mobility, and further outcomes in people with MND following 4-week RAGT. As MND includes a group of progressive neurological disorders leading to spasticity, cramps, muscle weakness and wasting, we carefully adjusted the RAGT to the patients’ functional status. This was based on meagre evidence showing that endurance or exercise training of moderate intensity can improve motor function in people with ALS [97, 98]. One study investigated the effects of ≥4-week RAGT on walking speed and distance and activities of daily living using a wearable exoskeleton in five patients with ALS [99]. Improvements in walking were found. Another small pilot study (n = 9; 3 drop-outs) explored the feasibility, tolerability, safety, and preliminary effects of an 8-week repetitive rhythmic exercise and body-weight supported treadmill gait training in patients with ALS [100]. Improvements in walking and fatigue were seen and the intervention was considered safe and tolerable while the feasibility of a larger study was not clear [100]. Except for fatigue, our results confirmed those of the two studies. The small sample sizes do however need to be considered.

Our qualitative analysis indicated that strong therapeutic connection played a central role in fostering high levels of acceptance and satisfaction with the RAGT (theme 2). This relationship should be built on mutual appreciation, open communication, provision of clear information about the device and the training, including instructions and therapeutic tasks, and offering tactile support. Our findings echoed a study from Miciak who identified a set of four key conditions for establishing a therapeutic relationship: being present, receptive, genuine, and committed as a therapist [101]. Furthermore, our results were in line with a retrospective observational study nested within an RCT showing that treatment outcomes of patients with lower back pain were consistently influenced by the quality of the therapeutic alliance [102]. A systematic review including 13 prospective RCTs, controlled clinical trials, and cohort studies has reported that a trustful therapeutic alliance was associated with increased treatment adherence and satisfaction and improved depressive symptoms and physical function [103]. These results imply that except involving highly repetitive task-oriented training, RAGT therapists should also be encouraged to strengthen the therapeutic alliance. Another longitudinal study investigated the turning points in the therapeutic relationship development in occupational and physical therapy [104]. From the perspective of each partner in a dyadic relationship, turning points are the pivotal moments in a relationship that have the most significant impact on its trajectory [105]. Findings from their study showed that progressing towards a goal, positive feedback, and a strong interpersonal affective bonding with the therapist can be relevant turning points generating positive emotions and favourable perceptions of relationship quality [104].

Further themes identified through thematic analysis were familiarising with RAGT (1), actively interacting (3) and minimising dissatisfaction (4). Familiarising with RAGT included the first session(s) and the accompanying feelings of unfamiliarity, curiosity, and a certain nervousness with RAGT. This process, as well as active interaction have previously been identified as key points in a qualitative analysis of patients’ and therapists’ experiences and perceptions of exoskeleton-based physiotherapy in stroke rehabilitation [106]. The intimidating reception of a device of this size was also described in a mixed-methods study in 10 individuals after stroke [107]. Nevertheless, patients’ perception of receiving an effective and useful therapy overweighed any initial insecurities [106, 107]. Notably, several studies examining RAGT reported the presence of discomfort or dissatisfaction [76, 106, 107] as it was also observed in our study. This needs to be considered before allocating patients to RAGT, for this might lead to intensifying pre-existing symptoms (theme 4) or even discontinuation [76]. Our results indicate that therapists should therefore address patients’ insecurities about effectiveness and dissatisfaction as best as possible by adjusting hardware and software parameters like body-weight support, but also give clear information on a basis of a trusted therapeutic relationship.

Strengths and limitations

Through a mixed methods design, we were able to gather information on both the feasibility and preliminary effectiveness of RAGT and insight into the patients’ experience in real-life RAGT. Nevertheless, there were limitations. Primarily, it is worth noting that during the 4-week intervention period, the patients did not receive RAGT as the sole intervention. This approach aligns with other studies conducted in an inpatient rehabilitation setting. Hence, it was not possible to attribute the effects solely to RAGT as the patients underwent a complex multimodal rehabilitation programme. Additionally, there was no follow-up testing to assess the sustainability of the results.

Another limitation was the absence of patient interviews at the conclusion of the intervention period, results of which may have been valuable and insightful. Nonetheless, the observations facilitated a deeper understanding of the patients’ and therapists’ behaviour and provided an opportunity to capture details during RAGT that the people themselves might have overlooked. This allowed the research team to draw conclusions on critical factors to be considered in RAGT and derive recommendations for tailoring RAGT to meet the individual needs of the patients.

Conclusions

To our knowledge, there is a gap in the literature regarding the exploration of quantitative RAGT effects alongside patient acceptance and satisfaction using qualitative methods across various neurological conditions. Our study aims to fill this gap by offering valuable insights into understanding patients’ needs and identifying necessary adjustments to ensure that RAGT is both enjoyable and maximally effective for patients.

The outcomes of our study imply the feasibility of utilising the LEXO® gait trainer for RAGT among patients with various neurological conditions. This is evidenced by robust recruitment, retention, and adherence rates. Furthermore, the findings underscore the safety of this approach, as indicated by the occurrence of anticipated mild and transient adverse events, alongside its initial effectiveness in enhancing RAGT outcomes among patients with diverse neurological conditions. Moreover, the majority of patients experienced the training positively and expressed satisfaction with their performance and outcomes. While our findings are promising, it is essential to conduct subsequent adequately powered RCTs to validate our results regarding the safety and efficacy of end-effector-based RAGT in patients with MND and SCA. Additionally, further mixed-methods studies are warranted to provide more nuanced insights into patients’ perceptions of RAGT with end-effector devices and the influence of the therapeutic relationship on RAGT outcomes.

Supporting information

S1 Fig. LEXO training.

The figure shows the LEXO® gait trainer with harness system (A) and with the saddle (B and C). Reprinted from device training material under a CC BY license, with permission from Tyromotion GmbH, Graz, Austria, original copyright 2023. Written consent for publication was obtained from the person depicted in the pictures.

https://doi.org/10.1371/journal.pone.0307434.s002

(TIF)

S2 Fig. Results FSST and FAC.

The before-after graphs represent individual patients’ walking and balance performance at baseline (blue dots) and post-intervention (yellow/green dots) on the (A) FSST and (B) FAC. A larger dot size indicates a higher number of patients achieving the same score. With the FAC, an increase in scores represents improvement. With the FSST, a decrease in duration indicates improvement. A, ambulatory patients; BL, baseline; FAC, Functional Ambulation Categories; FSST, Four Square Step Test; MND, motor neuron disease; MS, multiple sclerosis; NA, non-ambulatory patients; PD, Parkinson’s disease; PI, post-intervention; PNP, acute or chronic inflammatory demyelinating polyneuropathy; SCA, spinocerebellar ataxia; SCI, spinal cord injury (spastic para- or tetraplegia).

https://doi.org/10.1371/journal.pone.0307434.s003

(TIF)

S3 File. Description and psychometric properties of assessments.

https://doi.org/10.1371/journal.pone.0307434.s006

(DOCX)

Acknowledgments

We extend our heartfelt gratitude to all the patients who participated in this study. Additionally, we express our appreciation to the therapists at the Clinic for Rehabilitation Münster, Bianca Slamik, Markus Rendl, Stefan Klinger, and Katharina Lukasser, as well as the head and deputy head of the therapy department, Andreas Mühlbacher and Barbara Linert. We would also like to acknowledge the exceptional efforts of the therapy scheduling team around Sylvia Radinger.

References

  1. 1. Pearson OR, Busse ME, van Deursen RWM, Wiles CM. Quantification of walking mobility in neurological disorders. QJM: An International Journal of Medicine. 2004;97(8):463–75. pmid:15256604
  2. 2. Cheng Y-Y, Hsieh W-L, Kao C-L, Chan R-C. Principles of rehabilitation for common chronic neurologic diseases in the elderly. Journal of Clinical Gerontology and Geriatrics. 2012;3(1):5–13.
  3. 3. Rose DK, Nadeau SE, Wu SS, Tilson JK, Dobkin BH, Pei Q, et al. Locomotor Training and Strength and Balance Exercises for Walking Recovery After Stroke: Response to Number of Training Sessions. Phys Ther. 2017;97(11):1066–74. Epub 2017/10/28. pmid:29077960; PubMed Central PMCID: PMC6075074.
  4. 4. Bird TD. Hereditary Ataxia Overview. In: Adam MP, Ardinger HH, Pagon RA, Wallace SE, Bean LJH, Mirzaa G, et al., editors. GeneReviews. Seattle (WA): University of Washington, Seattle; 1993.
  5. 5. Jarvis HL, Brown SJ, Price M, Butterworth C, Groenevelt R, Jackson K, et al. Return to Employment After Stroke in Young Adults: How Important Is the Speed and Energy Cost of Walking? Stroke. 2019;50(11):3198–204. Epub 20190926. pmid:31554503; PubMed Central PMCID: PMC6824505.
  6. 6. Ochoa-Morales A, Hernández-Mojica T, Paz-Rodríguez F, Jara-Prado A, Trujillo-De Los Santos Z, Sánchez-Guzmán MA, et al. Quality of life in patients with multiple sclerosis and its association with depressive symptoms and physical disability. Mult Scler Relat Disord. 2019;36:101386. Epub 2019/09/15. pmid:31520986.
  7. 7. Raggi A, Covelli V, Schiavolin S, Scaratti C, Leonardi M, Willems M. Work-related problems in multiple sclerosis: a literature review on its associates and determinants. Disabil Rehabil. 2016;38(10):936–44. Epub 2015/07/28. pmid:26213244.
  8. 8. Jarvis HL, Brown SJ, Price M, Butterworth C, Groenevelt R, Jackson K, et al. Return to Employment After Stroke in Young Adults. Stroke. 2019;50(11):3198–204. pmid:31554503
  9. 9. Van Peppen RP, Kwakkel G, Wood-Dauphinee S, Hendriks HJ, Van der Wees PJ, Dekker J. The impact of physical therapy on functional outcomes after stroke: what’s the evidence? Clin Rehabil. 2004;18(8):833–62. Epub 2004/12/22. pmid:15609840.
  10. 10. Nilsson L, Carlsson J, Danielsson A, Fugl-Meyer A, Hellström K, Kristensen L, et al. Walking training of patients with hemiparesis at an early stage after stroke: a comparison of walking training on a treadmill with body weight support and walking training on the ground. Clin Rehabil. 2001;15(5):515–27. Epub 2001/10/12. pmid:11594641.
  11. 11. Bruni MF, Melegari C, De Cola MC, Bramanti A, Bramanti P, Calabrò RS. What does best evidence tell us about robotic gait rehabilitation in stroke patients: A systematic review and meta-analysis. J Clin Neurosci. 2018;48:11–7. Epub 2017/12/07. pmid:29208476.
  12. 12. Calabrò RS, Naro A, Russo M, Bramanti P, Carioti L, Balletta T, et al. Shaping neuroplasticity by using powered exoskeletons in patients with stroke: a randomized clinical trial. J Neuroeng Rehabil. 2018;15(1):35. Epub 2018/04/27. pmid:29695280; PubMed Central PMCID: PMC5918557.
  13. 13. Portaro S, Naro A, Chillura A, Billeri L, Bramanti A, Bramanti P, et al. Toward a more personalized motor function rehabilitation in Myotonic dystrophy type 1: The role of neuroplasticity. PloS one. 2017;12(5):e0178470. Epub 2017/05/26. pmid:28542314; PubMed Central PMCID: PMC5444819.
  14. 14. Carmignano SM, Fundarò C, Bonaiuti D, Calabrò RS, Cassio A, Mazzoli D, et al. Robot-assisted gait training in patients with Parkinson’s disease: Implications for clinical practice. A systematic review. NeuroRehabilitation. 2022;51(4):649–63. pmid:35570502.
  15. 15. Xue X, Yang X, Deng Z. Efficacy of rehabilitation robot-assisted gait training on lower extremity dyskinesia in patients with Parkinson’s disease: A systematic review and meta-analysis. Ageing Res Rev. 2023;85:101837. Epub 20230109. pmid:36634871.
  16. 16. Pérez-de la Cruz S. Use of Robotic Devices for Gait Training in Patients Diagnosed with Multiple Sclerosis: Current State of the Art. Sensors (Basel). 2022;22(7). Epub 20220328. pmid:35408195; PubMed Central PMCID: PMC9002809.
  17. 17. Maranesi E, Riccardi GR, Di Donna V, Di Rosa M, Fabbietti P, Luzi R, et al. Effectiveness of Intervention Based on End-effector Gait Trainer in Older Patients With Stroke: A Systematic Review. J Am Med Dir Assoc. 2020;21(8):1036–44. Epub 20191129. pmid:31787581.
  18. 18. Orsmond GI, Cohn ES. The Distinctive Features of a Feasibility Study: Objectives and Guiding Questions. OTJR (Thorofare N J). 2015;35(3):169–77. pmid:26594739.
  19. 19. Creswell JW, Clark VLP. Designing and Conducting Mixed Methods Research: SAGE Publications; 2010.
  20. 20. Flick U. Gütekriterien qualitativer Forschung. In: Mey G, Mruck K, editors. Handbuch Qualitative Forschung in der Psychologie. Wiesbaden: VS Verlag für Sozialwissenschaften; 2010. p. 395–407.
  21. 21. O’Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy. 2008;13(2):92–8. Epub 2008/04/18. pmid:18416914.
  22. 22. Hennerici MG, Kern Rea S1-Leitlinie Diagnostik akuter zerebrovaskulärer Erkrankungen: Deutsche Gesellschaft für Neurologie 2017 [cited 2019 13.02.]. Available from: www.dgn.org/leitlinien.
  23. 23. Thompson AJ, Banwell BL, Barkhof F, Carroll WM, Coetzee T, Comi G, et al. Diagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria. The Lancet Neurology. 2018;17(2):162–73. pmid:29275977
  24. 24. Polman CH, Reingold SC, Banwell B, Clanet M, Cohen JA, Filippi M, et al. Diagnostic criteria for multiple sclerosis: 2010 revisions to the McDonald criteria. Annals of Neurology. 2011;69(2):292–302. Epub 2011/03/10. pmid:21387374; PubMed Central PMCID: PMC3084507.
  25. 25. Hughes AJ, Daniel SE, Kilford L, Lees AJ. Accuracy of clinical diagnosis of idiopathic Parkinson’s disease: a clinico-pathological study of 100 cases. J Neurol Neurosurg Psychiatry. 1992;55(3):181–4. Epub 1992/03/01. pmid:1564476; PubMed Central PMCID: PMC1014720.
  26. 26. Ringleb PA, Köhrmann M, Jansen O, Hametner C, Frank B, Berlis A, et al. Akuttherapie des ischämischen Schlaganfalls, S2e-Leitlinie, Version 1.1. 2021.
  27. 27. Spinal injury: assessment and initial management. Spinal injury assessment: assessment and imaging for spinal injury. NICE Guideline NG41 London, UK: NICE, National Institute for Health and Care Excellence; 2016 [cited 2018 21.12.]. Available from: https://www.nice.org.uk/guidance/ng41/evidence/full-guideline-2358425776.
  28. 28. de Silva R, Greenfield J, Cook A, Bonney H, Vallortigara J, Hunt B, et al. Guidelines on the diagnosis and management of the progressive ataxias. Orphanet J Rare Dis. 2019;14(1):51–. pmid:30786918.
  29. 29. European Federation of Neurological Societies/Peripheral Nerve Society Guideline on management of chronic inflammatory demyelinating polyradiculoneuropathy: report of a joint task force of the European Federation of Neurological Societies and the Peripheral Nerve Society—First Revision. J Peripher Nerv Syst. 2010;15(1):1–9. Epub 2010/05/04. pmid:20433600.
  30. 30. Brooks BR, Miller RG, Swash M, Munsat TL. El Escorial revisited: revised criteria for the diagnosis of amyotrophic lateral sclerosis. Amyotroph Lateral Scler Other Motor Neuron Disord. 2000;1(5):293–9. Epub 2001/07/24. pmid:11464847.
  31. 31. de Carvalho M, Dengler R, Eisen A, England JD, Kaji R, Kimura J, et al. Electrodiagnostic criteria for diagnosis of ALS. Clin Neurophysiol. 2008;119(3):497–503. Epub 2008/01/01. pmid:18164242.
  32. 32. Wade DT. Measurement in neurological rehabilitation. Oxford: Oxford Medical Publications; 1992.
  33. 33. Folstein MF, Folstein SE, McHugh PR. "Mini-mental state". A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1975;12(3):189–98. pmid:1202204.
  34. 34. Brott T, Adams HP, Jr., Olinger CP, Marler JRBarsan WG, Biller J et al. Measurements of acute cerebral infarction: a clinical examination scale. Stroke. 1989;20(7):864–70. Epub 1989/07/01. pmid:2749846.
  35. 35. Kurtzke JF. Rating neurologic impairment in multiple sclerosis: an Expanded Disability Status Scale (EDSS). Neurology. 1983;33(11):1444–52. Epub 1983/11/01. pmid:6685237.
  36. 36. Fahn S, Elton RL. Unified Parkinson’s disease rating scale. In: Fahn S, M. G, D. M, D.B. C, editors. Recent de-velopments in Parkinson’s disease. II. New Jersey: Mac-Millan; 1987. p. 153–63.
  37. 37. Hoehn MM, Yahr MD. Parkinsonism: onset, progression and mortality. Neurology. 1967;17(5):427–42. Epub 1967/05/01. pmid:6067254.
  38. 38. Kirshblum SC, Burns SP, Biering-Sorensen F, Donovan W, Graves DE, Jha A, et al. International standards for neurological classification of spinal cord injury (revised 2011). J Spinal Cord Med. 2011;34(6):535–46. Epub 2012/02/15. pmid:22330108; PubMed Central PMCID: PMC3232636.
  39. 39. Schmitz-Hübsch T, du Montcel ST, Baliko L, Berciano J, Boesch S, Depondt C, et al. Scale for the assessment and rating of ataxia: development of a new clinical scale. Neurology. 2006;66(11):1717–20. Epub 2006/06/14. pmid:16769946.
  40. 40. Weyer A, Abele M, Schmitz-Hübsch T, Schoch B, Frings M, Timmann D, et al. Reliability and validity of the scale for the assessment and rating of ataxia: a study in 64 ataxia patients. Movement disorders: official journal of the Movement Disorder Society. 2007;22(11):1633–7. Epub 2007/05/23. pmid:17516493.
  41. 41. van Koningsveld R, Steyerberg EW, Hughes RAC, Swan AV, van Doorn PA, Jacobs BC. A clinical prognostic scoring system for Guillain-Barré syndrome. The Lancet Neurology. 2007;6(7):589–94. 8.
  42. 42. Graham RC, Hughes RA. A modified peripheral neuropathy scale: the Overall Neuropathy Limitations Scale. J Neurol Neurosurg Psychiatry. 2006;77(8):973–6. Epub 2006/04/01. pmid:16574730; PubMed Central PMCID: PMC2077620.
  43. 43. Cedarbaum JM, Stambler N, Malta E, Fuller C, Hilt D, Thurmond B, et al. The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. BDNF ALS Study Group (Phase III). J Neurol Sci. 1999;169(1–2):13–21. Epub 1999/12/14. pmid:10540002.
  44. 44. Bohannon RW. Comfortable and maximum walking speed of adults aged 20–79 years: reference values and determinants. Age Ageing. 1997;26(1):15–9. pmid:9143432.
  45. 45. Potter K, Cohen ET, Allen DD, Bennett SE, Brandfass KG, Widener GL, et al. Outcome measures for individuals with multiple sclerosis: recommendations from the American Physical Therapy Association neurology section task force. Physical Therapy. 2014;94(5):593–608. pmid:24363338.
  46. 46. Podsiadlo D, Richardson S. The timed "Up & Go": a test of basic functional mobility for frail elderly persons. J Am Geriatr Soc. 1991;39(2):142–8. pmid:1991946.
  47. 47. Dite W, Temple VA. Development of a Clinical Measure of Turning for Older Adults. American Journal of Physical Medicine and Rehabilitation. 2002;81:857–66. pmid:12394998
  48. 48. Wrisley DM, Marchetti GF, Kuharsky DK, Whitney SL. Reliability, internal consistency, and validity of data obtained with the functional gait assessment. Phys Ther. 2004;84(10):906–18. Epub 2004/09/29. pmid:15449976.
  49. 49. Franchignoni FP, Tesio L, Ricupero C, Martino MT. Trunk control test as an early predictor of stroke rehabilitation outcome. Stroke. 1997;28(7):1382–5. Epub 1997/07/01. pmid:9227687.
  50. 50. Duncan PW, Weiner DK, Chandler J, Studenski S. Functional reach: a new clinical measure of balance. J Gerontol. 1990;45(6):M192–7. Epub 1990/11/01. pmid:2229941.
  51. 51. Yardley L, Beyer N, Hauer K, Kempen G, Piot-Ziegler C, Todd C. Falls Efficacy Scale–-International (FES-I) Age and Ageing. 2005;34(6):614–9. https://doi.org/10.1037/t01443-000.
  52. 52. Krupp LB, LaRocca NG, Muir-Nash J, Steinberg AD. The Fatigue Severity Scale: Application to Patients With Multiple Sclerosis and Systemic Lupus Erythematosus. Archives of neurology. 1989;46(10):1121–3. pmid:2803071
  53. 53. Beck AT, Epstein N, Brown G, Steer RA. An inventory for measuring clinical anxiety: psychometric properties. J Consult Clin Psychol. 1988;56(6):893–7. pmid:3204199.
  54. 54. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2011;20(10):1727–36. pmid:21479777; PubMed Central PMCID: PMC3220807.
  55. 55. Kiresuk TJ, Sherman RE. Goal attainment scaling: A general method for evaluating comprehensive community mental health programs. Community Mental Health Journal. 1968;4(6):443–53. pmid:24185570
  56. 56. Ritchie J, Lewis J, Nicholls CM, Ormston R, editors. Qualitative Research Practice: A Guide for Social Science Students and Researchers 2013.
  57. 57. Döring N, Bortz J. Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler. 4 ed. Springer Berlin, Heidelberg 2016.
  58. 58. Hadi MA, José Closs S. Ensuring rigour and trustworthiness of qualitative research in clinical pharmacy. Int J Clin Pharm. 2016;38(3):641–6. Epub 20151214. pmid:26666909.
  59. 59. WMA. Declaration of Helsinki—Ethical Principles for Medical Research involving human subjects: World Medical Association; 2013. Available from: https://www.wma.net/policies-post/wma-declaration-of-helsinki-ethical-principles-for-medical-research-involving-human-subjects/.
  60. 60. Perera S, Mody SH, Woodman RC, Studenski SA. Meaningful Change and Responsiveness in Common Physical Performance Measures in Older Adults. Journal of the American Geriatrics Society. 2006;54(5):743–9. pmid:16696738
  61. 61. Tang A, Eng JJ, Rand D. Relationship between perceived and measured changes in walking after stroke. J Neurol Phys Ther. 2012;36(3):115–21. Epub 2012/08/02. pmid:22850336; PubMed Central PMCID: PMC3501529.
  62. 62. Tomczak M, Tomczak E. The need to report effect size estimates revisited. An overview of some recommended measures of effect size TRENDS in Sport Sciences. 2014;1(21):19–55.
  63. 63. Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed ed. Hillsdale: Lawrence Erlbaum Associates; 1988.
  64. 64. Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353(5):487–97. pmid:16079372.
  65. 65. Newcombe RG. Two-sided confidence intervals for the single proportion: comparison of seven methods. Statistics in Medicine. 1998;17(8):857–72. pmid:9595616.
  66. 66. Brown L, Cai T, DasGupta A. Interval estimation for a binomial proportion. Statistical Science. 2001;16(2):101–33.
  67. 67. Braun V, Clarke V. Using thematic analysis in psychology. Qualitative Research in Psychology. 2006;3(2):77–101.
  68. 68. Braun V, Clarke V. Thematic Analysis: A Practical Guide. London, Thousand Oaks, New Delhi, Singapore: SAGE Publications Ltd; 2021.
  69. 69. Spall S. Peer Debriefing in Qualitative Research: Emerging Operational Models. Qualitative Inquiry. 1998;4(2):280–92.
  70. 70. Braun V, Clarke V. Thematic analysis. APA handbook of research methods in psychology, Vol 2: Research designs: Quantitative, qualitative, neuropsychological, and biological. APA handbooks in psychology®. Washington, DC, US: American Psychological Association; 2012. p. 57–71.
  71. 71. Cox KL, Cyarto EV, Ellis KA, Ames D, Desmond P, Phal P, et al. A Randomized Controlled Trial of Adherence to a 24-Month Home-Based Physical Activity Program and the Health Benefits for Older Adults at Risk of Alzheimer’s Disease: The AIBL Active-Study. J Alzheimers Dis. 2019;70(s1):S187–s205. Epub 2018/10/30. pmid:30372680; PubMed Central PMCID: PMC6700652.
  72. 72. Shaw L, McCue P, Brown P, Buckley C, Del Din S, Francis R, et al. Auditory rhythmical cueing to improve gait in community-dwelling stroke survivors (ACTIVATE): a pilot randomised controlled trial. Pilot Feasibility Stud. 2022;8(1):239. Epub 2022/11/13. pmid:36371213; PubMed Central PMCID: PMC9652598.
  73. 73. Walters SJ, Bonacho Dos Anjos Henriques-Cadby I, Bortolami O, Flight L, Hind D, Jacques RM, et al. Recruitment and retention of participants in randomised controlled trials: a review of trials funded and published by the United Kingdom Health Technology Assessment Programme. BMJ Open. 2017;7(3):e015276. Epub 20170320. pmid:28320800; PubMed Central PMCID: PMC5372123.
  74. 74. Collado-Mateo D, Lavín-Pérez AM, Peñacoba C, Del Coso J, Leyton-Román M, Luque-Casado A, et al. Key Factors Associated with Adherence to Physical Exercise in Patients with Chronic Diseases and Older Adults: An Umbrella Review. Int J Environ Res Public Health. 2021;18(4). Epub 2021/03/07. pmid:33669679; PubMed Central PMCID: PMC7922504.
  75. 75. Teo JL, Zheng Z, Bird SR. Identifying the factors affecting ’patient engagement’ in exercise rehabilitation. BMC Sports Sci Med Rehabil. 2022;14(1):18. Epub 2022/02/09. pmid:35130940; PubMed Central PMCID: PMC8819209.
  76. 76. Choi S, Kim SW, Jeon HR, Lee JS, Kim DY, Lee JW. Feasibility of Robot-Assisted Gait Training with an End-Effector Type Device for Various Neurologic Disorders. Brain Neurorehabil. 2020;13(1):e6. Epub 20191115. pmid:36744272; PubMed Central PMCID: PMC9879527.
  77. 77. Valenzuela T, Okubo Y, Woodbury A, Lord SR, Delbaere K. Adherence to Technology-Based Exercise Programs in Older Adults: A Systematic Review. J Geriatr Phys Ther. 2018;41(1):49–61. Epub 2016/07/01. pmid:27362526.
  78. 78. Jack K, McLean SM, Moffett JK, Gardiner E. Barriers to treatment adherence in physiotherapy outpatient clinics: a systematic review. Man Ther. 2010;15(3):220–8. Epub 2010/02/19. pmid:20163979; PubMed Central PMCID: PMC2923776.
  79. 79. Yoshida T, Otaka Y, Osu R, Kumagai M, Kitamura S, Yaeda J. Motivation for Rehabilitation in Patients With Subacute Stroke: A Qualitative Study. Front Rehabil Sci. 2021;2:664758. Epub 2021/06/07. pmid:36188821; PubMed Central PMCID: PMC9397769.
  80. 80. Choi W. Effects of Robot-Assisted Gait Training with Body Weight Support on Gait and Balance in Stroke Patients. Int J Environ Res Public Health. 2022;19(10). Epub 20220510. pmid:35627346; PubMed Central PMCID: PMC9141724.
  81. 81. Munari D, Fonte C, Varalta V, Battistuzzi E, Cassini S, Montagnoli AP, et al. Effects of robot-assisted gait training combined with virtual reality on motor and cognitive functions in patients with multiple sclerosis: A pilot, single-blind, randomized controlled trial. Restor Neurol Neurosci. 2020;38(2):151–64. pmid:32333564.
  82. 82. Alingh JF, Weerdesteyn V, Nienhuis B, van Asseldonk EHF, Geurts ACH, Groen BE. Immediate after-effects of robot-assisted gait with pelvic support or pelvic constraint on overground walking in healthy subjects. Journal of NeuroEngineering and Rehabilitation. 2019;16(1):40. pmid:30876445
  83. 83. Son C, Lee A, Lee J, Kim D, Kim SJ, Chun MH, et al. The effect of pelvic movements of a gait training system for stroke patients: a single blind, randomized, parallel study. J Neuroeng Rehabil. 2021;18(1):185. Epub 2021/12/29. pmid:34961541; PubMed Central PMCID: PMC8714451.
  84. 84. Ji J, Guo S, Xi FJ. Force Analysis and Evaluation of a Pelvic Support Walking Robot with Joint Compliance. J Healthc Eng. 2018;2018:9235023. Epub 2019/01/10. pmid:30622691; PubMed Central PMCID: PMC6304213.
  85. 85. Picelli A, Melotti C, Origano F, Waldner A, Fiaschi A, Santilli V, et al. Robot-assisted gait training in patients with Parkinson disease: a randomized controlled trial. Neurorehabil Neural Repair. 2012;26(4):353–61. Epub 20120118. pmid:22258155.
  86. 86. Picelli A, Melotti C, Origano F, Neri R, Waldner A, Smania N. Robot-assisted gait training versus equal intensity treadmill training in patients with mild to moderate Parkinson’s disease: a randomized controlled trial. Parkinsonism Relat Disord. 2013;19(6):605–10. Epub 20130313. pmid:23490463.
  87. 87. Galli M, Cimolin V, De Pandis MF, Le Pera D, Sova I, Albertini G, et al. Robot-assisted gait training versus treadmill training in patients with Parkinson’s disease: a kinematic evaluation with gait profile score. Funct Neurol. 2016;31(3):163–70. pmid:27678210; PubMed Central PMCID: PMC5115231.
  88. 88. Capecci M, Pournajaf S, Galafate D, Sale P, Le Pera D, Goffredo M, et al. Clinical effects of robot-assisted gait training and treadmill training for Parkinson’s disease. A randomized controlled trial. Ann Phys Rehabil Med. 2019;62(5):303–12. Epub 20190801. pmid:31377382.
  89. 89. Lamberti G, Sesenna G, Marina M, Ricci E, Ciardi G. Robot Assisted Gait Training in a Patient with Ataxia. Neurol Int. 2022;14(3):561–73. Epub 20220622. pmid:35893280; PubMed Central PMCID: PMC9326713.
  90. 90. Kim SH, Han JY, Song MK, Choi IS, Park HK. Effectiveness of Robotic Exoskeleton-Assisted Gait Training in Spinocerebellar Ataxia: A Case Report. Sensors. 2021;21(14). Epub 2021/07/25. pmid:34300613; PubMed Central PMCID: PMC8309925.
  91. 91. Banz R, Bolliger M, Colombo G, Dietz V, Lünenburger L. Computerized Visual Feedback: An Adjunct to Robotic-Assisted Gait Training. Physical Therapy. 2008;88(10):1135–45. pmid:18772279
  92. 92. Koenig A, Omlin X, Bergmann J, Zimmerli L, Bolliger M, Müller F, et al. Controlling patient participation during robot-assisted gait training. Journal of NeuroEngineering and Rehabilitation. 2011;8(1):14. pmid:21429200
  93. 93. Jung C, Kim DY, Kwon S, Chun MH, Kim J, Kim SH. Morning Walk(®)-Assisted Gait Training Improves Walking Ability and Balance in Patients with Ataxia: a Randomized Controlled Trial. Brain Neurorehabil. 2020;13(3):e23. Epub 20201120. pmid:36741796; PubMed Central PMCID: PMC9879369.
  94. 94. Belas Dos Santos M, Barros de Oliveira C, Dos Santos A, Garabello Pires C, Dylewski V, Arida RM. A Comparative Study of Conventional Physiotherapy versus Robot-Assisted Gait Training Associated to Physiotherapy in Individuals with Ataxia after Stroke. Behavioural neurology. 2018;2018:2892065. Epub 2018/04/21. pmid:29675114; PubMed Central PMCID: PMC5838477.
  95. 95. Yang FA, Chen SC, Chiu JF, Shih YC, Liou TH, Escorpizo R, et al. Body weight-supported gait training for patients with spinal cord injury: a network meta-analysis of randomised controlled trials. Sci Rep. 2022;12(1):19262. Epub 20221110. pmid:36357483; PubMed Central PMCID: PMC9649733.
  96. 96. Shin JC, Jeon HR, Kim D, Cho SI, Min WK, Lee JS, et al. Effects on the Motor Function, Proprioception, Balance, and Gait Ability of the End-Effector Robot-Assisted Gait Training for Spinal Cord Injury Patients. Brain Sci. 2021;11(10). Epub 20210928. pmid:34679346; PubMed Central PMCID: PMC8534051.
  97. 97. Dal Bello-Haas V, Florence JM. Therapeutic exercise for people with amyotrophic lateral sclerosis or motor neuron disease. Cochrane Database Syst Rev. 2013;2013(5):Cd005229. Epub 2013/06/04. pmid:23728653; PubMed Central PMCID: PMC6769061 received a grant from the Amyotrophic Lateral Sclerosis Association to conduct the study. JMF has an interest in the design & implementation of outcome measures for clinical trials in neuromuscular disorders. She has been involved in this arena through her appointment in the Department of Neurology at Washington University School of Medicine in St. Louis and in the position of a consultant for several biotech, biomedical & pharmaceutical companies.
  98. 98. Ashworth NL, Satkunam LE, Deforge D. Treatment for spasticity in amyotrophic lateral sclerosis/motor neuron disease. Cochrane Database Syst Rev. 2012;(2):Cd004156. Epub 2012/02/18. pmid:22336799.
  99. 99. Morioka H, Hirayama T, Sugisawa T, Murata K, Shibukawa M, Ebina J, et al. Robot-assisted training using hybrid assistive limb ameliorates gait ability in patients with amyotrophic lateral sclerosis. J Clin Neurosci. 2022;99:158–63. Epub 2022/03/14. pmid:35279589.
  100. 100. Sanjak M, Bravver E, Bockenek WL, Norton HJ, Brooks BR. Supported Treadmill Ambulation for Amyotrophic Lateral Sclerosis: A Pilot Study. Archives of Physical Medicine and Rehabilitation. 2010;91(12):1920–9. pmid:21112435
  101. 101. Miciak M, Mayan M, Brown C, Joyce AS, Gross DP. The necessary conditions of engagement for the therapeutic relationship in physiotherapy: an interpretive description study. Arch Physiother. 2018;8:3. Epub 2018/02/23. pmid:29468089; PubMed Central PMCID: PMC5816533.
  102. 102. Ferreira PH, Ferreira ML, Maher CG, Refshauge KM, Latimer J, Adams RD. The therapeutic alliance between clinicians and patients predicts outcome in chronic low back pain. Phys Ther. 2013;93(4):470–8. Epub 2012/11/10. pmid:23139428.
  103. 103. Hall AM, Ferreira PH, Maher CG, Latimer J, Ferreira ML. The influence of the therapist-patient relationship on treatment outcome in physical rehabilitation: a systematic review. Phys Ther. 2010;90(8):1099–110. Epub 20100624. pmid:20576715.
  104. 104. Horton A, Hebson G, Holman D. A longitudinal study of the turning points and trajectories of therapeutic relationship development in occupational and physical therapy. BMC Health Serv Res. 2021;21(1):97. Epub 20210128. pmid:33509181; PubMed Central PMCID: PMC7845106.
  105. 105. Baxter LA, Bullis CA. TURNING POINTS IN DEVELOPING ROMANTIC RELATIONSHIPS. Human Communication Research. 1986;12:469–93.
  106. 106. Louie DR, Mortenson WB, Lui M, Durocher M, Teasell R, Yao J, et al. Patients’ and therapists’ experience and perception of exoskeleton-based physiotherapy during subacute stroke rehabilitation: a qualitative analysis. Disabil Rehabil. 2022;44(24):7390–8. Epub 20211025. pmid:34694189.
  107. 107. McDonald C, Fingleton C, Murphy S, Lennon O. Stroke survivor perceptions of using an exoskeleton during acute gait rehabilitation. Sci Rep. 2022;12(1):14185. Epub 20220819. pmid:35986162; PubMed Central PMCID: PMC9391354.