Digitally enabled rehabilitation may lead to better outcomes but has not been tested in large pragmatic trials. We aimed to evaluate a tailored prescription of affordable digital devices in addition to usual care for people with mobility limitations admitted to aged care and neurological rehabilitation.
Methods and findings
We conducted a pragmatic, outcome-assessor-blinded, parallel-group randomised trial in 3 Australian hospitals in Sydney and Adelaide recruiting adults 18 to 101 years old with mobility limitations undertaking aged care and neurological inpatient rehabilitation. Both the intervention and control groups received usual multidisciplinary inpatient and post-hospital rehabilitation care as determined by the treating rehabilitation clinicians. In addition to usual care, the intervention group used devices to target mobility and physical activity problems, individually prescribed by a physiotherapist according to an intervention protocol, including virtual reality video games, activity monitors, and handheld computer devices for 6 months in hospital and at home. Co-primary outcomes were mobility (performance-based Short Physical Performance Battery [SPPB]; continuous version; range 0 to 3; higher score indicates better mobility) and upright time as a proxy measure of physical activity (proportion of the day upright measured with activPAL) at 6 months. The dataset was analysed using intention-to-treat principles. The trial was prospectively registered with the Australian New Zealand Clinical Trials Registry (ACTRN12614000936628). Between 22 September 2014 and 10 November 2016, 300 patients (mean age 74 years, SD 14; 50% female; 54% neurological condition causing activity limitation) were randomly assigned to intervention (n = 149) or control (n = 151) using a secure online database (REDCap) to achieve allocation concealment. Six-month assessments were completed by 258 participants (129 intervention, 129 control). Intervention participants received on average 12 (SD 11) supervised inpatient sessions using 4 (SD 1) different devices and 15 (SD 5) physiotherapy contacts supporting device use after hospital discharge. Changes in mobility scores were higher in the intervention group compared to the control group from baseline (SPPB [continuous, 0–3] mean [SD]: intervention group, 1.5 [0.7]; control group, 1.5 [0.8]) to 6 months (SPPB [continuous, 0–3] mean [SD]: intervention group, 2.3 [0.6]; control group, 2.1 [0.8]; mean between-group difference 0.2 points, 95% CI 0.1 to 0.3; p = 0.006). However, there was no evidence of a difference between groups for upright time at 6 months (mean [SD] proportion of the day spent upright at 6 months: intervention group, 18.2 [9.8]; control group, 18.4 [10.2]; mean between-group difference −0.2, 95% CI −2.7 to 2.3; p = 0.87). Scores were higher in the intervention group compared to the control group across most secondary mobility outcomes, but there was no evidence of a difference between groups for most other secondary outcomes including self-reported balance confidence and quality of life. No adverse events were reported in the intervention group. Thirteen participants died while in the trial (intervention group: 9; control group: 4) due to unrelated causes, and there was no evidence of a difference between groups in fall rates (unadjusted incidence rate ratio 1.19, 95% CI 0.78 to 1.83; p = 0.43). Study limitations include 15%–19% loss to follow-up at 6 months on the co-primary outcomes, as anticipated; the number of secondary outcome measures in our trial, which may increase the risk of a type I error; and potential low statistical power to demonstrate significant between-group differences on important secondary patient-reported outcomes.
In this study, we observed improved mobility in people with a wide range of health conditions making use of digitally enabled rehabilitation, whereas time spent upright was not impacted.
The trial was prospectively registered with the Australian New Zealand Clinical Trials Register; ACTRN12614000936628
Why was this study done?
- A higher dose of therapy in physical rehabilitation is associated with better outcomes; however, current rehabilitation models deliver low therapy doses.
- Use of digital devices such as virtual reality video games, activity monitors, and handheld computer devices can be enjoyable, provide feedback on performance, and may enable a greater dose of task-specific therapy to improve outcomes.
- Current evidence is yet to confidently confirm the effects of rehabilitation using digital devices in addition to usual rehabilitation care on mobility tasks such as walking and other important outcomes such as quality of life.
What did the researchers do and find?
- In a pragmatic, outcome-assessor-blinded randomised controlled trial, 300 people with walking difficulties (age 72 ± 16 years, 50% female) received usual multidisciplinary inpatient and post-hospital aged care and neurological rehabilitation alone, or in addition used a range of affordable devices such as virtual reality video games, activity monitors, and handheld devices to target mobility and physical activity, as individually prescribed by a physiotherapist for 6 months.
- On average participants in the intervention group used 4 ± 1 devices in the inpatient setting and 2 ± 1 devices in the post-hospital setting. This approach was feasible and enjoyed, and demonstrated it could be provided across care settings including the post-hospital setting with mostly remote support.
- Clinically important improvement was seen in mobility at 3 weeks and 6 months after baseline, but this was not accompanied by greater time spent upright.
- No adverse events were reported by participants whilst undertaking rehabilitation using digital devices, and there was no difference in the rate of falls between groups.
What do these findings mean?
- Digitally enabled rehabilitation using a range of devices prescribed by a physiotherapist to target a range of mobility limitations across care settings for adults with mixed health conditions can improve mobility but not time spent upright.
- These results need to be interpreted in light of study limitations including a 15%–19% loss to follow-up at 6 months on the co-primary outcomes.
- Future models of rehabilitation should investigate incorporating digital devices to enhance inpatient and post-hospital rehabilitation, but prescription should ensure quality and quantity of practice.
Citation: Hassett L, van den Berg M, Lindley RI, Crotty M, McCluskey A, van der Ploeg HP, et al. (2020) Digitally enabled aged care and neurological rehabilitation to enhance outcomes with Activity and MObility UsiNg Technology (AMOUNT) in Australia: A randomised controlled trial. PLoS Med 17(2): e1003029. https://doi.org/10.1371/journal.pmed.1003029
Academic Editor: Christelle Nguyen, Univ. Paris Descartes, PRES Sorbonne Paris Cité, Hôpital Cochin, Assistance Publique - Hôpitaux de Paris, FRANCE
Received: June 9, 2019; Accepted: January 22, 2020; Published: February 18, 2020
Copyright: © 2020 Hassett et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying the results presented in the study are available from the University of Sydney's open access institutional repository, Sydney eScholarship repository: https://ses.library.usyd.edu.au/handle/2123/21698.
Funding: This work was supported by an Australian National Health and Medical Research Council Project Grant (APP1063751). CS receives salary funding from an Australian National Health and Medical Research Council Fellowship. No funding bodies had any role in the study design, data collection and analysis, decision to publish, or preparation of this manuscript.
Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: MH is in receipt of a National Health and Medical Research Council of Australia Career Development Fellowship Level 2, APP1141328.
Abbreviations: AMOUNT, Activity and MObility UsiNg Technology; IPEQ, Incidental and Planned Exercise Questionnaire; SPPB, Short Physical Performance Battery
Over 20% of the world population will be >60 years of age by 2050 . Many will need accessible and affordable rehabilitation to reduce costly limitations in function from neurological and musculoskeletal health conditions  as well as decline from aging and inactivity . Physical rehabilitation should contain intensive, repetitive task-specific exercises to improve outcomes [4–7]. Virtual reality video games, activity monitors, and handheld computer devices are accessible, affordable, and enjoyable , and together can provide a digitally enabled rehabilitation environment by providing more opportunity and greater motivation to increase task-specific practice in hospital  and in the home setting . However, evidence of their impact on outcomes is limited and focused on stroke rehabilitation [11,12]. A systematic review of virtual reality interventions in people after stroke (72 studies) demonstrated a moderate effect on balance, but no effect on walking speed or global motor function when delivered as an adjunct to usual rehabilitation . However, the quality of evidence was rated as low for nearly all outcomes, and all but 1 study tested a single virtual reality system. A feasibility trial conducted by our team in people undertaking inpatient aged care and neurological rehabilitation (n = 58) provided an additional dose of rehabilitation for 2 weeks using a range of low-cost video games and activity monitors . The intervention was feasible, safe, and enjoyable, and enabled a higher dose of exercise and improved balance but not overall mobility. This promising intervention, after refinement, required rigorous evaluation.
The primary aim of the Activity and MObility UsiNg Technology (AMOUNT) trial was to test the effectiveness of tailored prescription of affordable devices to improve mobility and physical activity in people with mobility limitations undertaking aged care and neurological rehabilitation. The devices were prescribed in addition to usual care and compared to usual care alone.
AMOUNT was a pragmatic, assessor-blinded, multicentre superiority randomised controlled trial with 2 parallel groups and included a nested economic analysis (presented separately) and a qualitative study .
Sites, staff, and participants
There were 3 trial sites across Australia. Two were in metropolitan hospitals in Sydney in New South Wales (Site 1: 20-bed stroke and 20-bed aged care rehabilitation wards; Site 2: 16-bed brain injury rehabilitation unit), and 1 was in Adelaide in South Australia (Site 3: 30-bed geriatric evaluation and management ward and 40- and 20-bed general rehabilitation wards). Research physiotherapists recruited participants, conducted baseline assessments, randomised participants, and delivered the intervention; all were experienced physiotherapists and received training in trial processes, as well as in the digital intervention to be delivered.
Consecutive patients admitted to the units who met the following criteria were invited to participate: ≥18 years old; reduced mobility (Short Physical Performance Battery [SPPB] score < 12)  with clinician-assessed capacity for improvement (based on the usual care physiotherapists’ clinical experience and their assessment and treatment experience with the patient); life expectancy > 12 months; anticipated length of stay ≥ 10 days from randomisation; and able to maintain a standing position (with assistance of 1 person if necessary). Patients were excluded if they had any of the following: cognitive impairment likely to interfere with device use; insufficient English language skills with no available interpreter; inadequate vision to use devices; medical condition(s) precluding exercise; no interest in using devices; anticipated discharge to high care residential facility (nursing home); or discharge location too distant for follow-up.
A staff member external to the trial prepared the randomisation schedule using randomly permuted block sizes of 2, 4, and 6 and incorporating stratification for study site and health condition (whether or not the person had a neurological health condition affecting mobility). Following written informed consent and baseline assessment, research staff completed web-based randomisation (allocation concealment) to determine group allocation.
Both the intervention and control groups received usual rehabilitation care, which was determined by the treating clinicians and included assessment and prescription of a series of repetitive exercises by the physiotherapist, tailored management by the multidisciplinary team, and a fall prevention brochure  (see Table 1). In addition, the intervention group was prescribed 30 to 60 minutes of digitally enabled rehabilitation 5 days per week in hospital and post-discharge, defined as rehabilitation using digital devices (e.g., virtual reality, wearables, and tablet and smartphone applications), with remote monitoring and communication post-discharge. The intervention group was prescribed exercises using virtual reality video games, activity monitors, and handheld computer devices to enhance mobility and physical activity. The exercises and devices were individually prescribed by a trial physiotherapist according to an intervention protocol that matched different task-specific exercises on different devices to common mobility limitations. The physiotherapist also considered participant impairments (e.g., upper limb weakness, hemianopia) and contextual factors such as participant goals, device preferences, and the home environment. Included devices were purchased by the research team or constructed for less than US$3,700 each. Participants could use any number of devices as guided by the physiotherapist. Devices were loaned to participants to use at home and were progressed or changed as required. For further details of usual care and the additional intervention using digital devices, see Table 1 and S1 Text, and the published protocol .
Face-to-face outcome assessments were conducted at 3 weeks and 6 months after randomisation and by mail or telephone at 12 weeks after randomisation. Outcome assessors were registered health professionals trained in conducting the outcome assessments, external to the clinical sites, and blinded to group allocation. The face-to-face assessments were conducted in the hospital if the participant was still an inpatient, or at the post-hospital-discharge destination (e.g., home, transitional living unit). Prior to the outcome assessor completing the 6-month assessment, the intervention devices were removed from participant homes and participants were reminded not to discuss their trial involvement with the assessor.
The co-primary outcomes were mobility and physical activity (upright time) 6 months after randomisation. Mobility is a broad term that is defined as the ability to move around and change positions, such as to stand up from sitting and to walk. Mobility was assessed with the performance-based SPPB (continuous version), also known as the lower extremity continuous summary performance score, which uses actual time taken to complete mobility tasks . Scores range from 0 (worst performance) to 3 (best performance) and are based on timed gait speed over 4 metres; standing balance with feet positioned parallel, semi-tandem, and tandem; and standing up from a chair 5 times. The SPPB has high levels of validity, reliability, and responsiveness in measuring mobility in older people living in the community, is increasingly used in trials involving older adults , and can predict falls risk, disability, and death . The 12-point version of the SPPB is most commonly used, and 0.5- to 1-point changes have been suggested to be clinically meaningful. We used the continuous version as it has been suggested as more likely to be able to detect change .
Physical activity was assessed over a 7-day period at the end of the 6-month intervention period using the activPAL activity monitor (PAL Technologies, UK) . The measure of physical activity was ‘upright time’, defined as the average proportion of the day spent standing and stepping, measured in 10-second minimum periods. Upright time was chosen as our primary physical activity measure, rather than steps per day, as not all trial participants were expected to be able to walk independently, and we sought to use a measure that could be used at all study time points.
Secondary outcomes were performance-based measures assessed at 3 weeks and 6 months after randomisation and participant-reported measures assessed at 3 and 12 weeks and 6 months after randomisation. Performance-based measures of mobility included SPPB (continuous) at 3 weeks; SPPB total score (0 to 12 based on categorisation of performance times; higher score indicates better mobility; clinically important difference 0.5 points) [15,20] and subscale scores (0 to 4) ; de Morton Mobility Index (0 to 100; higher score indicates better mobility; clinically important difference 7 to 8 points) [22–24]; single leg stance (0 to 10 seconds; greater time indicates better mobility); maximal balance range test (millimetres; greater distance indicates better mobility) ; and step test (number of steps; greater number of steps indicates better mobility) . Performance-based measures of physical activity included proportion of the day spent upright at 3 weeks, average time spent standing and stepping, number of steps per day, and number of sit to stand transitions per day measured using the activPAL . Performance-based measures of cognition included Trail Making Test A, B, and B − A (seconds; quicker time indicates improved cognition) [27,28].
Participant-reported measures included Incidental and Planned Exercise Questionnaire (IPEQ) total score and home exercise and walking activity subscale scores (hours/week) ; Modified Computer Self Efficacy Scale (10 to 100; higher score indicates improved device self-efficacy) ; Activities-specific Balance Confidence Scale (0 to 100; higher score indicates improved confidence) ; WHO Disability Assessment Schedule 2.0 (12 to 60; lower score indicates improved activity performance and participation) [32,33]; Short Form 6 dimensions questionnaire subscale scores and health utility score (0 to 1; higher score indicates better quality of life; mean minimal important difference 0.041) [34,35]; and European Quality of Life–5 dimensions subscale scores, visual analogue scale score (0 to 100), and health utility score (−0.68 to 1; higher score indicates better quality of life; minimal important difference 0.074) [35,36]. In addition, falls and health and community service usage were assessed over the 6-month period. Adverse events in the intervention group and deaths in both groups were monitored and documented throughout the trial. Adverse events were defined as an unwanted and usually harmful outcome (e.g., fall, seizure, cardiac event) that may or may not be related to the intervention, but occurred while the participant was undertaking mobility or physical activities using intervention digital devices. Self-reported measures of device usability (System Usability Scale; 0 to 100; score above 70 indicates above average usability) [37,38] and enjoyment (Physical Activity Enjoyment Scale; 18 to 126; higher score indicates more enjoyment)  were obtained from the intervention group at 3 and 12 weeks and 6 months after randomisation.
We estimated that a sample size of 300 participants (150 per group) would provide 90% power to detect a 15% between-group difference in the co-primary outcome measures, allowing for a 20% dropout rate and an alpha of 5%. This sample size was also estimated to be sufficient to detect between-group differences of 10%–15% in most secondary outcomes and was considered by the authors to be of meaningful size on the basis of our collective clinical experience with the measures.
A statistical analysis plan was approved by the study statistician (SH) and chief investigator (CS) before data analysis, and no changes were made after this time (see S3 Text). Analysis was conducted by 2 investigators (CS, LH) blinded to group allocation for the co-primary outcomes using dummy codes for group allocation, created by a person external to the trial. The dataset analysed consisted of all randomised participants irrespective of intervention adherence (intention-to-treat). Missing values were not imputed for the primary analyses. Between-group comparisons for continuously scored outcomes were made using linear models with baseline scores entered as covariates. The distribution of continuous variables was evaluated to inform whether change scores were used for analysis. Fall rates between groups were compared using negative binomial regression. Two pre-specified sensitivity analyses were conducted for the co-primary outcomes; (i) not adjusting for baseline scores and (ii) adjusting for stratification variables. p-Values were not adjusted for multiplicity as we pre-specified that a significant effect must be observed on both primary outcomes to declare the intervention effective.
We undertook 6 pre-specified subgroup analyses based on neurological versus non-neurological health conditions limiting mobility, sex, age, baseline mobility (SPPB total score), device use before hospitalisation, and state (New South Wales versus South Australia). The main analysis for each subgroup analysis was an interaction test in the regression models to determine whether the effect of treatment differed significantly across categories for that variable. Analyses were performed using Stata software, version 14 (StataCorp).
Two human research ethics committees (HRECs) approved the trial (Southern Adelaide Clinical HREC and South Western Sydney Local Health District HREC). Six minor protocol amendments were approved by the ethics committees, 4 prior to the trial commencing (see S2 Text). We prospectively registered the trial with the Australian New Zealand Clinical Trials Registry (ACTRN12614000936628).
Between September 2014 and November 2016, 5,039 patients were screened, 715 patients were assessed as eligible, and 300 patients provided written informed consent and were randomised: 149 to the intervention group and 151 to the control group (Fig 1). Six-month assessments were completed by 258 participants (control group: 129/151, 85%; intervention group: 129/149, 87%). For the co-primary outcomes, there was an 85% (254/300) follow-up rate for mobility (data unavailable for 4 additional participants who refused to complete 1 or more test components) and an 80% (239/300) follow-up rate for upright time (data missing or excluded for 19 additional participants due to <4 days wear time for activPAL device, n = 3; refusal/unable to wear device, n = 5; device initialisation/fault, n = 3; device lost, n = 4; missing data, n = 4).
*Number included in intention-to-treat analysis. LOS, length of stay.
Baseline characteristics are presented in Tables 2 and S1. On average, participants spent 13 days in the ward before randomisation (SD 16; median 8). Participants had a mean age of 74 (SD 14) years, 50% were female, and 54% had neurological health conditions causing activity limitation. At baseline, participants had significant mobility limitation (mean [SD] SPPB total score 4.2 [2.6]) and spent little time standing or stepping (mean [SD] upright time 112  minutes) (Table 3). Prior to hospital admission, 87% of participants could walk independently in the community and all but 1 could walk indoors. Thirty-nine percent of participants reported never using a computer, tablet, smartphone, gaming device, or activity monitor in the month prior to hospitalisation.
Intervention fidelity, acceptability, enjoyment, and adherence
Over the 6-month trial period, participants spent on average 19 days (SD 20; median 12) in an inpatient setting and 161 days (SD 18) in a post-hospital setting, typically at home. The total cost of the intervention (staff training, equipment, intervention preparation, and delivery) per participant was AU$1,892 (S2 Table). Intervention data are presented in Table 4. Intervention participants rated the usability of prescribed devices above average, and enjoyment as high at all time points (Table 3).
Participants in both groups received a similar number of usual care physiotherapy sessions in the post-hospital setting (mean [SD]: intervention group, 10 ; control group, 10  sessions). Few control participants reported using devices for mobility or physical activity (inpatient setting: computer, n = 1; tablet, n = 2; activity monitor, n = 3; post-hospital setting: smartphone, n = 1; gaming device, n = 2; activity monitor, n = 9 participants).
Effect of intervention
Change in mobility scores were higher in the intervention group compared to the control group from baseline (SPPB [continuous, 0–3] mean [SD]: intervention group, 1.5 [0.7]; control group, 1.5 [0.8]) to 6 months (mean between-group difference 0.2 points, 95% CI 0.1 to 0.3; p = 0.006); however, there was no evidence of a difference between groups for upright time at 6 months (mean [SD] proportion of the day spent upright at 6 months: intervention group, 18.2 [9.8]; control group, 18.4 [10.2]; mean between-group difference −0.2, 95% CI −2.7 to 2.3; p = 0.87), with similar results in sensitivity analyses (S3 Table) and at week 3 (Table 5).
There were between-group differences in favour of the intervention group across most secondary mobility outcomes (Table 5), for change in self-reported time spent walking from 3 weeks to 6 months (IPEQ walking activity subscale, hours/week: 1.8, 95% CI 0.6 to 3.0, n = 254; p = 0.004), and for change on 1 measure of cognition from baseline to 3 weeks (Trail Making Test A: −5.1 seconds, 95% CI −9.3 to −0.8, n = 283; p = 0.02). There was no evidence of a difference between groups in the number of steps taken per day from baseline to 6 months (mean between-group difference 646 steps per day, 95% CI −109 to 1,402, n = 239; p = 0.09) or on any other secondary outcomes (Tables 5 and 6 and S4). Thirteen participants died while in the trial (intervention group: 9; control group: 4) due to causes unrelated to the trial. The same number of participants reported falling 1 or more times in both groups (n = 53), and there was no difference between groups in fall rate (S5 Table). No adverse events, defined as incidents that occurred while participating in the intervention, were reported.
Interaction analysis for primary outcomes indicated a greater effect of the intervention on mobility among those with poorer mobility at baseline (Tables 5 and S6). Exploratory analyses for secondary outcomes revealed consistently greater intervention impact in younger participants (Tables 5 and 6 and S7).
We conducted a pragmatic, assessor-blinded, parallel-group randomised trial in people with mobility limitations undertaking aged care and neurological rehabilitation recruited from 3 Australian hospitals to investigate whether tailored prescription of affordable digital devices (including virtual reality video games, activity monitors, and handheld computer devices) in addition to usual care could improve mobility and physical activity when compared with people undertaking usual care alone. There was no evidence of effectiveness of the intervention in accordance with our pre-specified definition that both primary outcomes needed to show statistically significant between-group differences. However, significant and clinically relevant improvements in mobility were observed in participants receiving the AMOUNT intervention. The greatest improvements in mobility were seen at 3 weeks during hospital-supervised therapy. Between-group differences were still evident at 6 months despite the lower intensity physiotherapy support in the post-hospital period. All available devices were used, supporting our premise of a multi-device intervention over using a single device as in previous studies. Six of the devices were used across both inpatient and post-hospital care settings, and usability and enjoyment were rated highly. Taken altogether, these findings suggest that digitally enabled rehabilitation, supported by physiotherapists, is feasible and acceptable and can improve mobility outcomes.
The mean between-group difference on our primary mobility measure at 6 months (0.2 points) may be considered of clinical importance. A change of 0.54 on the 12-point version of the SPPB, i.e., 4.5% of the maximum value, has been suggested to be a small meaningful change . The between-group difference at 6 months in the present study represents 6.7% of the maximum value for the 3-point version; therefore, it may represent meaningful change.
In the inpatient setting, participants received on average 41 minutes daily of additional rehabilitation using devices (Table 4). Approximately 60% of participants used the rehabilitation video games (Fysiogaming and the Humac Balance System), which enable the greatest customisation of task-specific mobility training. Our findings of improved mobility are consistent with previous systematic reviews demonstrating improved activity when a greater amount of task-specific practice is provided [4,5]. In contrast, our findings of improved mobility are different than those of the Cochrane systematic review of virtual reality interventions in people after stroke for the effect of additional virtual reality intervention on global motor function . This is likely due to our multi-device intervention and detailed intervention protocol, enabling additional task-specific practice of a range of mobility tasks, compared to the lower limb trials in the review using 1 device, typically targeting balance. The range of health conditions and inclusion of younger participants in our trial may also explain the different findings; however, participants with neurological health conditions and participants with worse mobility at baseline had the greatest improvements in mobility (SPPB total score), particularly at 3 weeks. It is difficult to tease out the contributing role of both amount and type of practice; however, our results suggest that attention to quality and quantity of rehabilitation practice is important.
Although the physical capacity of participants in the intervention group to move around improved, this did not translate to increased time spent upright. Yet there was an indication of more steps taken by intervention participants (p = 0.09; particularly younger participants, <76 years, p = 0.05), greater self-reported walking, and more time spent stepping and less time spent standing compared to control participants. This finding matches the way the intervention was delivered, with a focus on increasing the number of steps per day using a Fitbit tracker, rather than on standing activities. Further exploration of trial activPAL data is underway to better understand our findings and to help determine how best to prescribe physical activity in this population.
The success of the intervention in improving mobility is likely due to the personalisation of the intervention, which targeted each person’s mobility limitations. The included devices were piloted previously , tested by consumer and clinician investigators, and prescribed according to a detailed protocol developed by the investigator team using motor learning principles . The right level of challenge, variety, enjoyment, and support to use the devices appears key to successful participant engagement [14,41].
Study limitations include 15%–19% loss to follow-up at 6 months on co-primary outcomes, as anticipated in this age group of hospitalised patients. Multiplicity is also a consideration due to the number of outcomes measured. Additionally, there was no statistically significant difference in the important participant-reported outcome of health-related quality of life; however, the measures of this outcome were in the direction favouring the intervention group, which may reflect low statistical power to demonstrate significance for this outcome. There was greater time spent with therapists in the intervention group, which could account for the difference between groups. However, as this was a pragmatic trial, we consider our choice of usual care and an enhanced program to be the correct comparison, and our trial found additional benefits of the enhanced program. Contamination was of concern prior to commencing the study; however, only a small number of control participants reported using devices for mobility or physical activity. Although the range of devices was a strength, accurate documentation of dosage was difficult because of differences in the types of output data (e.g., game time, repetitions), particularly at home. Development and testing of efficient solutions such as clinical dashboards that enable data from diverse sources to be integrated into a common platform  may facilitate tailored use and monitoring of multiple devices in rehabilitation.
Further research should investigate whether future models of rehabilitation care can incorporate digital devices to enhance inpatient and post-hospital rehabilitation with a higher dose of practice whilst conserving quality. Hybrid type II effectiveness–implementation study designs  could be used to simultaneously test the effectiveness of the clinical intervention (digitally enabled rehabilitation) on patient outcomes and the effectiveness of implementation strategies (e.g., education and training) to support clinicians to include digital devices into practice.
In summary, we observed improved mobility in participants with a wide range of health conditions in a digitally enabled rehabilitation environment, but no between-group differences in upright time. To enhance generalisability, we focussed on devices likely to be affordable for most rehabilitation services, with elements that could transfer into the community when the patient is discharged. Nevertheless, this was a complex intervention, with specialised equipment and expert staff, so further analyses including economic analysis will be important in understanding its acceptability to purchasers and providers of healthcare.
S1 Table. Participant primary diagnosis at rehabilitation admission.
S2 Table. Costs for digitally enabled rehabilitation intervention.
S3 Table. Sensitivity analyses for primary outcomes.
S4 Table. Primary and secondary outcomes (additional analysis).
S5 Table. Fall outcomes at 26 weeks.
S6 Table. Interaction p-values for co-primary outcomes and mean between-group difference (95% CI) for significant (p ≤ 0.05) interaction terms.
S7 Table. Interaction p-values for secondary outcomes and mean-between group difference (95% CI) for significant interaction terms.
S1 Text. Intervention protocol.
S2 Text. AMOUNT rehabilitation trial: Study protocol and intervention protocol amendments.
S3 Text. Statistical analysis plan.
The authors are grateful to Mr. Ross Pearson for consumer advice and testing different devices. We are also grateful to the study participants, hospital staff, study staff, and students, particularly Ashley Rabie, Elizabeth Lynch, Catherine Kirkham, Areti Dakopoulos, Melani Boyce, Frances Moran, Janine Prestes Vargas, Linda Roylance, Tarcisio Campos Folly, Hannah Kastrappi, Heather Paull, Caroline Hafner, Janette Hall, Anna Miles, Abby Schmidt, and Caitlin Hamilton.
- 1. Chatterji S, Byles J, Cutler D, Seeman T, Verdes E. Health, functioning and disability in older adults—current status and future implications. Lancet. 2015;385(9967):563–75. pmid:25468158
- 2. Ma VY, Chan L, Carruthers KJ. Incidence, prevalence, costs, and impact on disability of common conditions requiring rehabilitation in the United States: stroke, spinal cord injury, traumatic brain injury, multiple sclerosis, osteoarthritis, rheumatoid arthritis, limb loss, and back pain. Arch Phys Med Rehabil. 2014;95(5):986–95.e1.
- 3. Chodzko-Zajko WJ, Proctor DN, Fiatarone Singh MA, Minson CT, Nigg CR, Salem GJ, et al. American College of Sports Medicine position stand. Exercise and physical activity for older adults. Med Sci Sports Exerc. 2009;41(7):1510–30. pmid:19516148
- 4. Schneider EJ, Lannin NA, Ada L, Schmidt J. Increasing the amount of usual rehabilitation improves activity after stroke: a systematic review. J Physiother. 2016;62(4):182–7. pmid:27637769
- 5. Veerbeek JM, van Wegen E, van Peppen R, van der Wees PJ, Hendriks E, Rietberg M, et al. What is the evidence for physical therapy poststroke? A systematic review and meta-analysis. PLoS ONE. 2014;9(2):e87987. pmid:24505342
- 6. Sherrington C, Michaleff ZA, Fairhall N, Paul SS, Tiedemann A, Whitney J, et al. Exercise to prevent falls in older adults: an updated systematic review and meta-analysis. Br J Sports Med. 2017;51(24):1750–8. pmid:27707740
- 7. Olivetti L, Schurr K, Sherrington C, Wallbank G, Pamphlett P, Kwan MM, et al. A novel weight-bearing strengthening program during rehabilitation of older people is feasible and improves standing up more than a non-weight-bearing strengthening program: a randomised trial. J Physiother. 2007;53(3):147–53.
- 8. Lewis GN, Rosie JA. Virtual reality games for movement rehabilitation in neurological conditions: how do we meet the needs and expectations of the users? Disabil Rehabil. 2012;34(22):1880–6. pmid:22480353
- 9. Betker AL, Desai A, Nett C, Kapadia N, Szturm T. Game-based exercises for dynamic short-sitting balance rehabilitation of people with chronic spinal cord and traumatic brain injuries. Phys Ther. 2007;87(10):1389–98. pmid:17712036
- 10. Allen NE, Song J, Paul SS, Smith S, O’Duffy J, Schmidt M, et al. An interactive videogame for arm and hand exercise in people with Parkinson’s disease: a randomized controlled trial. Parkinsonism Relat Disord. 2017;41:66–72. pmid:28528804
- 11. Laver KE, Lange B, George S, Deutsch JE, Saposnik G, Crotty M. Virtual reality for stroke rehabilitation. Cochrane Database Syst Rev. 2017;11:CD008349. pmid:29156493
- 12. Lynch EA, Jones TM, Simpson DB, Fini NA, Kuys SS, Borschmann K, et al. Activity monitors for increasing physical activity in adult stroke survivors. Cochrane Database Syst Rev. 2018;7:CD012543. pmid:30051462
- 13. van den Berg M, Sherrington C, Killington M, Smith S, Bongers B, Hassett L, et al. Video and computer-based interactive exercises are safe and improve task-specific balance in geriatric and neurological rehabilitation: a randomised trial. J Physiother. 2016;62:20–8. pmid:26701163
- 14. Hamilton C, McCluskey A, Hassett L, Killington M, Lovarini M. Patient and therapist experiences of using affordable feedback-based technology in rehabilitation: a qualitative study nested in a randomised controlled trial. Clin Rehabil. 2018;32(9):1258–70. pmid:29696990
- 15. Guralnik JM, Simonsick EM, Ferrucci L, Glynn RJ, Berkman LF, Blazer DG, et al. A short physical performance battery assessing lower extremity function: association with self-reported disability and prediction of mortality and nursing home admission. J Gerontol. 1994;49(2):M85–94. pmid:8126356
New South Wales Health Clinical Excellence Commission. Falls prevention—in public places. Version 1. SHPN (CEC) 120266. Sydney: New South Wales Health Clinical Excellence Commission; 2012.
- 17. Hassett L, van den Berg M, Lindley RI, Crotty M, McCluskey A, van der Ploeg HP, et al. Effect of affordable technology on physical activity levels and mobility outcomes in rehabilitation: a protocol for the Activity and MObility UsiNg Technology (AMOUNT) rehabilitation trial. BMJ Open. 2016;6(6):e012074. pmid:27266776
- 18. Onder G, Penninx BW, Lapuerta P, Fried LP, Ostir GV, Guralnik JM, et al. Change in physical performance over time in older women: the Women’s Health and Aging Study. J Gerontol. 2002;57(5):M289–93.
- 19. Balachandran A, Signorile JF. How to improve reporting of the Short Physical Performance Battery scores. J Gerontol A Biol Sci Med Sci. 2015;70(12):1595–6. pmid:26392404
- 20. Treacy D, Hassett L. The Short Physical Performance Battery (Clinimetrics). J Physiother. 2018;64(1):61. pmid:28645532
- 21. Grant PM, Ryan CG, Tigbe WW, Granat MH. The validation of a novel activity monitor in the measurement of posture and motion during everyday activities. Br J Sports Med. 2006;40(12):992–7. pmid:16980531
- 22. de Morton NA, Brusco NK, Wood L, Lawler K, Taylor NF. The de Morton Mobility Index (DEMMI) provides a valid method for measuring and monitoring the mobility of patients making the transition from hospital to the community: an observational study. J Physiother. 2011;57(2):109–16. pmid:21684492
- 23. de Morton NA, Lane K. Validity and reliability of the de Morton Mobility Index in the subacute hospital setting in a geriatric evaluation and management population. J Rehabil Med. 2010;42(10):956–61. pmid:21031293
- 24. Davenport SJ, de Morton NA. Clinimetric properties of the de Morton Mobility Index in healthy, community-dwelling older adults. Arch Phys Med Rehabil. 2011;92(1):51–8. pmid:21187205
- 25. Lord SR, Ward JA, Williams P. Exercise effect on dynamic stability in older women: a randomized controlled trial. Arch Phys Med Rehabil. 1996;77(3):232–6. pmid:8600863
- 26. Hill K. A new test of dynamic standing balance for stroke patients. Physiother Can. 1996;Fall:257–62.
War Department Adjutant General’s Office. Army Individual Test Battery. Manual of directions and scoring. Washington (DC): War Department Adjutant General’s Office; 1944.
- 28. Tombaugh TN. Trail Making Test A and B: normative data stratified by age and education. Arch Clin Neuropsychol. 2004;19(2):203–14. pmid:15010086
- 29. Delbaere K, Hauer K, Lord SR. Evaluation of the incidental and planned activity questionnaire (IPEQ) for older people. Br J Sports Med. 2010;44(14):1029–34. pmid:19474003
- 30. Laver K, George S, Ratcliffe J, Crotty M. Measuring technology self efficacy: reliability and construct validity of a modified computer self efficacy scale in a clinical rehabilitation setting. Disabil Rehabil. 2012;34(3):220–7. pmid:21958357
- 31. Powell LE, Myers AM. The Activities-specific Balance Confidence (ABC) Scale. J Gerontol. 1995;50A(1):M28–34.
- 32. Rehm J, Ustun TB, Saxena S, Nelson CB, Chatterji S, Ivis F, et al. On the development and psychometric testing of the WHO screening instrument to assess disablement in the general population. Int J Methods Psychiatr Res. 1999;8(2):110–22.
- 33. Andrews G, Kemp A, Sunderland M, Von Korff M, Ustun TB. Normative data for the 12 item WHO Disability Assessment Schedule 2.0. PLoS ONE. 2009;4(12):e8343. pmid:20020047
- 34. Brazier J, Roberts J, Deverill M. The estimation of a preference-based measure of health from the SF-36. J Health Econ. 2002;21(2):271–92. pmid:11939242
- 35. Walters SJ, Brazier JE. Comparison of the minimally important difference for two health state utility measures: EQ-5D and SF-6D. Qual Life Res. 2005;14(6):1523–32. pmid:16110932
- 36. Herdman M, Gudex C, Lloyd A, Janssen M, Kind P, Parkin D, et al. Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Qual Life Res. 2011;20(10):1727–36. pmid:21479777
Brooke J. SUS: a “quick and dirty” usability scale. In: Jordan PW, Thomas B, Weerdmeester BA, McClelland IL, editors. Usability evaluation in industry. London: Taylor & Francis; 1996. pp. 189–94.
- 38. Bangor A, Kortum PT, Miller JT. An empirical evaluation of the system usability scale. Int J Hum Comput Interact. 2008;24(6):574–94.
- 39. Kendzierski D, DeCarlo K. Physical activity enjoyment scale: two validation studies. J Sport Exercise Psy. 1991;13:50–64.
Magill RA. Motor learning and control: concepts and applications. 10th edition. New York: McGraw-Hill Education; 2014.
- 41. Hamilton C, Lovarini M, McCluskey A, Folly de Campos T, Hassett L. Experiences of therapists using feedback-based technology to improve physical function in rehabilitation settings: a qualitative systematic review. Disabil Rehabil. 2019;41(15):1739–50. pmid:29513052
- 42. Badgeley MA, Shameer K, Glicksberg BS, Tomlinson MS, Levin MA, McCormick PJ, et al. EHDViz: clinical dashboard development using open-source technologies. BMJ Open. 2016;6(3):e010579. pmid:27013597
- 43. Curran GM, Bauer M, Mittman B, Pyne JM, Stetler C. Effectiveness-implementation hybrid designs: combining elements of clinical effectiveness and implementation research to enhance public health impact. Med Care. 2012;50(3):217–26. pmid:22310560