Figures
Abstract
Importance/Background
Movement-controlled video games have potential to promote home-based practice of therapy activities. The success of therapy gaming interventions depends on the quality of the technology used and the presence of effective support structures.
Aim
This study assesses the feasibility of a novel intervention that combines a co-created gaming technology integrating evidence-based biofeedback and solution-focused coaching (SFC) strategies to support therapy engagement and efficacy at home.
Methods
Following feasibility and single-case reporting standards (CONSORT and SCRIBE), this was a non-blind, randomized, multiple-baseline, AB, design. Nineteen (19) young people with cerebral palsy (8–18 years old) completed the 4-week home-based intervention in France and Canada.
Participant motivations, personalized practice goals, and relevance of the intervention to daily activities were discussed in a Solution Focused Coaching-style conversation pre-, post-intervention and during weekly check-ins. Participants controlled a video game by completing therapeutic gestures (wrist extension, pinching) detected via electromyography and inertial sensors on the forearm (Myo Armband and custom software).
Process feasibility success criteria for recruitment response, completion and adherence rates, and frequency of technical issues were established a priori. Scientific feasibility, effect size estimates and variance were determined for Body Function outcome measures: active wrist extension, grip strength and Box and Blocks Test; and for Activities and Participation measures: Assisting Hand Assessment (AHA), Canadian Occupational Performance Measure (COPM) and Self-Reported Experiences of Activity Settings (SEAS).
Results
Recruitment response (31%) and assessment completion (84%) rates were good and 74% of participants reached self-identified practice goals. As 17% of technical issues required external support to resolve, the intervention was graded as feasible with modifications. No adverse events were reported.
Moderate effects were observed in Body Function measures (active wrist extension: SMD = 1.82, 95%CI = 0.85–2.78; Grip Strength: SMD = 0.63, 95%CI = 0.65–1.91; Box and Blocks: Hedge’s g = 0.58, 95%CI = -0.11–1.27) and small-moderate effects in Activities and Participation measures (AHA: Hedge’s g = 0.29, 95%CI = -0.39–0.97, COPM: r = 0.60, 95%CI = 0.13–0.82, SEAS: r = 0.24, 95%CI = -0.25–0.61).
Citation: MacIntosh A, Desailly E, Vignais N, Vigneron V, Biddiss E (2020) A biofeedback-enhanced therapeutic exercise video game intervention for young people with cerebral palsy: A randomized single-case experimental design feasibility study. PLoS ONE 15(6): e0234767. https://doi.org/10.1371/journal.pone.0234767
Editor: Andrea Martinuzzi, IRCCS E. Medea, ITALY
Received: August 12, 2019; Accepted: June 1, 2020; Published: June 22, 2020
Copyright: © 2020 MacIntosh et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by the Canadian Institutes of Health Research [funding reference number RN304779 - 379428, Author AM], the Campus France Eiffel Excellence Scholarship [895191H, Author AM], and the Mitacs GobaLink program [IT10648, Author AM]. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Interactive computer play (ICP) is “any kind of computer game or virtual reality technology where the individual can interact and play with virtual objects in a computer-generated environment” [1]. It is an attractive way to augment traditional therapy and align with children’s interest. Eight of 10 young people with Cerebral Palsy (CP) enjoy playing video games recreationally [2]. Cerebral Palsy (CP) is neuromuscular disability impacting approximately 2.11 per 1,000 live births in high-resource settings [3]. CP presents with positive and negative motor signs including: spasticity, weakness, impaired selective motor control and sensory deficits [4]. ICP has been used to improve balance [5], gait symmetry [6], upper limb strength [7] and other functional abilities in people with CP. Perhaps the largest study to date in this field is the ‘Move it to improve it’ (MITII) randomized controlled trial that used web-based therapy at home to improve occupational performance and visual perception in children with unilateral CP [8]. These types of studies have shown moderate evidence towards improving balance and overall motor skill but weak evidence towards improving upper extremity skills, joint control, gait and strength [9]. In part, the success of ICP-based therapies in the home has been thwarted by the challenge of (i) delivering high quality feedback that informs individuals with CP on any progress towards therapy goals as a therapist would in a clinic setting [10]; and (ii) sustaining engagement in the intervention over an extended period. Children with CP and their families have expressed a desire for more accurate feedback within ICP [8] and reported the challenge of sustaining intrinsic interest in ICP therapies in the home.
High quality feedback
Improving feedback quality in ICP can increase practice engagement and efficiency at home [11]. Biofeedback, where a people receives information about their body state (e.g. heart rate, foot speed, muscle activity) [1], can help increase awareness and control by informing them how their body is functioning [11]. Echoing families’ remarks, a recent systematic review found that most interventions using biofeedback do so in a way that positions the people in a passive role in their practice and builds dependency, hindering motor learning progress [10].
Working with young people with CP and clinicians, we recently co-created an evidence-based biofeedback strategy (S1 File). The implementation improves biofeedback use (efficiency, effectiveness, engagement) by offering autonomy, varying feedback presentation (e.g. visual, audio), and being proportionate to the person’s ability [10]. These mechanisms serve to improve the effectiveness of ICP therapies. They help direct the person to higher-quality movements at home where practice is completed without therapist supervision and provide a stronger cognitive link between game-focused (e.g. scoring points) and therapy-focused (e.g. decreased compensatory movements) goals (S1 File).
Sustaining engagement
Low adherence is a primary concern in home-based interventions, historically ranging from 34–67% [12,13]. A recent review consistently found engagement and adherence difficult to maintain [14]. To improve adherence and engagement, an intervention must closely align with participants values and sustain their intrinsic motivation [14]. Intrinsic motivation is influenced by both the ICP technology (feedback, activity personalization), and the intervention design (therapist interaction, social support). Solution-focused coaching in pediatric rehabilitation (SFC-Peds) is a model of coaching recommended for youth with disabilities [15]. SFC-Peds builds intrinsic motivation to generate personal interest in health behaviour changes [16,17]. In SFC-Peds, coaches collaborate with children to help them envision their “preferred future” [15]. Through this process, children develop therapy goals and a supporting plan that aligns with their priorities.
Aim
The success of an ICP intervention is influenced both by the technology used and the supports provided. In this project, we investigate the combination of a novel ICP technology integrating evidence-based biofeedback and Solution Focused Coaching strategies to promote home-based practice of hand/arm exercises. The ICP is a video game where participants complete therapeutic hand gestures to control game actions on-screen. The approach aims to provide a motivational, goal-based environment to address muscle weakness and selective motor control. This paper addresses intervention feasibility as articulated by Thabane et al (2010) [18]. This framework highlights that the aim of feasibility testing can be related to one or more of the following four classifications: process, resources, management and scientific. The objective here is to support development towards future randomized controlled trials and not to define statistical or clinical effectiveness of the intervention [18]. In this study, we concentrate on two of the four feasibility classifications:
First, we assess process feasibility of the biofeedback-enhanced therapy video game intervention protocol for young people with CP. The objective here is to determine the ability to enroll participants, enable home-based practice, and retain their activity during a 1-month intervention. To this purpose, a priori success criteria were established for the recruitment and response rates, adherence, and frequency of technical difficulties impeding home practice [18].
Second, we assess the scientific feasibility of the intervention by estimating the effect size and variance for six person-centred outcome measures for the hand and wrist. The measures are aligned to the Body Functions and Activities and Participation chapters of the ICF (international classification of functioning disability and health) [19,20].
Methods
Design
A randomized, multiple-baseline, single-case experimental design (SCED) with two phases was applied. SCED designs can provide strong evidence wherein participants serve as their own controls for the purpose of within-subject comparison [21]. SCED research typically involves collecting a representative baseline phase through repeated measurements of an outcome of interest (Phase 1) that is then compared with the intervention phase (Phase 2). In a randomized SCED design, the time lapse between Phase 1 and Phase 2 is randomly allocated for each participant to further mitigate threats to internal validity [22]. SCED designs are increasingly used in clinical intervention research, particularly when sample size is limited, SCEDs can provide a rigorous approach to generate higher quality evidence [23]. In this feasibility study, the Single-Case Reporting Guideline in Behavioural Interventions (SCRIBE) [21] and the Consolidated Standards of Reporting Trials (CONSORT) methodologies were used (see S2 File and S3 File) [24]. Participants, researchers and assessing therapists were not blind to treatment phase. One methodological change occurred during the first week of enrollment. Inclusion criteria was expanded to include those with mixed tone and mild dystonia since it was found that they could control the game effectively and the potential therapeutic value was confirmed by clinicians. Procedural fidelity was maintained by following a standard operating protocol outlining the activities and resources for each phase (S4 File). Ethical approval was obtained by Holland Bloorview’s Research Ethics Board (approved July 27, 2018, amended November 23, 2018, to include participants with mixed tone and mild dystonia) and the French national Comité de protection des personnes (CPP) (approved July 6, 2018). The authors confirm that all ongoing and related trials for this intervention are registered.
Participants
From September to October 2018, ten participants were recruited from a regional rehabilitation hospital at a metropolitan city in Canada. From November 2018 to January 2019, ten participants were recruited from a rural regional rehabilitation hospital in France.
Inclusion criteria:
- Cerebral Palsy diagnosis.
- 8–18 years old.
- Manual Abilities Classification System levels I-III [25].
- Having a goal relating to improving hand/wrist function.
- Dominantly spastic presentation. This original criterion was expanded to included mixed tone and mild dystonia.
- Normal or corrected-to-normal vision and hearing.
- Able to co-operate, understand, and follow simple instructions for game play.
- Having passive wrist extension at least 10° greater than active wrist extension.
Exclusion criteria:
- Receiving active therapy of the hand/wrist.
- History of unmanaged epilepsy.
- Having received a Botulinum Toxin treatment within 3 months or constraint-based movement therapy within 6 months before study enrollment.
- Visual, cognitive or auditory disability that would interfere with play.
- Unable to commit an estimated minimum of 5-hours to training plan over four weeks.
Sample size rationale.
The sample size of twenty was determined based on recommended samples of a future definitive RCT with a small (0.2)–medium (0.5) effect, 90% power and two-sided 5% significance. Based on estimates of previous interventions on active wrist extension in the literature [26–29] a pre/post change of 10° with an expected standard deviation of 4–12° would require between 8–22 participants [30].
Recruitment.
Occupational therapists and developmental pediatricians identified participants who met inclusion criteria from their existing or previous caseload. In Canada, eligible participants were also identified through the hospital’s centralized recruitment database, connect2research. In Canada the researcher telephoned potential participants after sending an invitation letter by mail. Then, the researcher screened interested participants and obtained written informed consent. Recruitment in Canada took place from September-November 2018. In France, the developmental pediatricians invited eligible individuals to participate. Developmental pediatricians obtained written informed consent from interested participants. Recruitment in France took place from November 2018—January 2019. Caregivers gave consent and were consulted to ensure the child could provide consent or assent. If capable, the child gave consent/assent [31].
Protocol
The description follows the Template for Intervention Description and Replication (TIDieR guidelines), see S5 File [32]. S6 File.
Baseline (phase A).
Participants met once with the researcher and Occupational Therapist (60 minutes) in clinic. In a Solution-focused Coaching style [15,17] conversation, they discussed: motivations for participating, personalized scheduling and practice goals, how the intervention connects to daily activities. By the end of this conversation, participants established Canadian Occupational Performance Measure (COPM) goals [33]. Caregivers were present if desired. The dialogue was intended to improve cognitive engagement and consequently, home-play adherence [16]. Therapists and researchers guiding these conversations received one day of formal training and practiced scenarios with a certified SFC coach. Fidelity to the coaching style was maintained by following a conversation checklist developed with the certified SFC coach (S4 File).
Following the coaching conversation, a therapist assessed bimanual performance (Assisting Hand Assessment (AHA)) and gross manual dexterity (Box and Blocks (B&B)). The researcher visited each participant’s home for multiple baseline testing of wrist extension and grip strength (3–6 visits, 30-minutes sessions). The number of baseline sessions was ‘data-driven’ to establish stability in the primary measure of effectiveness: active wrist extension–open fingers (AWEO). Stability was defined as 80% of phase 1 data within interquartile range [34]. After baseline, participants waited a computer-generated randomized number of days (between 1–10 days) to begin the intervention.
Activity description.
During 1–2 baseline sessions the researcher habituated the participant to ICP activity system controls. Participants learned to control the video game using a therapeutic gesture, one of: wrist extension- open fingers, wrist extension- closed fingers, finger-thumb pinch, supination. In the SFC-Peds style conversation, therapists helped participants identify which gesture to practice based on the daily activities that were established to be important to them. All but two participants practiced wrist extension. In the game, participants are rewarded by making the gesture at the correct time with high quality (i.e. high forearm extensor activity and isolated hand movement).
Intervention (phase B).
After the randomized waiting period, the researcher gave participants the system to practice at home. The system includes hardware: laptop, electromyography (EMG) and inertial sensor (Myo Armband) and software: adapted commercial video game (Dashy Square) and custom software to interpret movements and control the game (MATLAB 2017b). Participants practiced at home alone for 4-weeks according to their self-defined practice schedule established during the initial conversation. Once per week, the researcher visited each participant. During the 60-minute visit they:
- Recorded gameplay with a video camera and electro-goniometer
- Measured wrist extension and grip strength
- Had a ‘check-in’ conversation to re-evaluate the self-defined practice goals
The check-in followed the SFC conversation guideline, EARS (elicit, amplify, reinforce, start again) [35] and served to gauge: satisfaction with progress, motivation, and modify practice goals and game difficulty if necessary. At the first and last weekly visit, participants completed Self-Reported Experiences of Activity Settings (SEAS) questionnaire to measure interaction, engagement, and sense of control while playing at home [36].
Post-intervention
Within 2-weeks following the final visit, participants returned to clinic for a 60-minute assessment with the researcher and occupational therapist. The therapist re-evaluated: bimanual performance (AHA), gross manual dexterity (B&B), and COPM goals. The researcher conducted a semi-structured interview to gain participant’s subjective evaluations of the intervention [37] (S4 File). Finally, a separate member of the research team (other than who completed the home visits) made a (5–10 minute) telephone call with participant’s caregiver. The researcher asked questions and noted responses related to system use and integration into home-life (S4 File).
Outcomes
To address process feasibility, a priori success criteria were compared to observed outcomes. Success criteria were based on previous recruitment, adherence and technical performance results of a home-based exercise intervention in a similar population [38,39]:
Process feasibility, a priori success criteria:
- ≥10% response rate from all eligible participants [38]
- ≥80% of the participants successfully complete the study. (i.e. completed at least 3 repeated measures during phase A and B, and complete assessments at baseline and post-intervention)
- Participants meet their self-identified practice goal. (within ≥66% of the identified frequency and duration)
- Participants were not prohibited from practicing due to technical constraints (e.g. After instruction, participants could start and play the game, technical challenges were overcome with the provided aid, and participants were not forced to cancel a practice session due to technical limitations). Participants may report multiple issues during the 1-month intervention.
The study is then given one of the following recommendations: Not feasible, Feasible with minor modifications, Feasible with close monitoring, Feasible as is according to criteria set by [18].
Towards assessing scientific feasibility, the size and variance of the effect of the intervention on participant-centred outcome measures are evaluated. As no single measure covers all aspects of function and experience during home-based interventions, complementary measures are used to capture changes across two ICF chapters [19,20].
- Measures for ICF chapter: Body Function, changes in:
- active wrist extension–open fingers (AWEO)
- grip strength (GRIP)
- gross manual dexterity (B&B)
First, to evaluate the capacity with which participants can open their hand, a manual goniometric measurement of active wrist extension [40] with open and closed fingers was made. Participants start with the elbow in 90 degrees of flexion, the forearm pronated to the extent possible and the upper arm alongside the trunk. With the forearm fixed by the assessor, the child performs three wrist extensions per side [41]. Positive values indicate extension above neutral wrist position and values are recorded to the nearest five degrees, the minimal detectable difference [42]. In the relevant population passive movement tests show very good test–retest reliability (Intraclass correlation coefficients (ICC): 0.81–0.94) and moderate inter-rater reliability (correlation coefficients between 0.48–0.73 [43]). Second, grip strength was measured using a modified sphygmomanometer to evaluate relative changes in grip capacity [44]. The child sits with the arm adducted, the elbow flexed at 90 degrees and the forearm and wrist in neutral position (if possible). Participants maximally squeeze the device three times per side. The test is completed on both sides and the relative strength of the non-dominant hand to the dominant is reported. While normative data for children’s grip strength using the modified sphygmomanometer are not available, [44] found excellent test-retest reliability (Pearson correlation coefficient of 0.97) and [45] reported high intra-rater reliability (ICC = 0.92). Third, the Box and Blocks Test (B&B) measured gross manual dexterity. The number of blocks a participant can move over a center divider in one minute is counted for both hands [46]. The B&B test shows high inter-rater reliability (ICCs >0.95) and test-retest reliability (ICCs >0.95) in children 6–19 years [47] and in adults with hemiplegia [48].
- 2. Measures for ICF Chapter: Activities and Participation, changes in:
- functional bimanual performance (AHA)
- perceived functional performance in a self-identified goal (COPM)
- perception of meaningful participation experiences (SEAS)
Three measures address ICF chapter, Activities and Participation. First, the Assisting Hand Assessment (AHA) quantifies spontaneous functional bimanual performance. Progressing through a board game guided by a trained occupational therapist, participants complete bimanual tasks such as opening a box or shuffling cards [49]. There are twenty tasks, scored on a 4-point scale. The smallest detectable change for the AHA is 5 logit units (scaled from 0–100). In adolescents with unilateral CP up to age 18, AHA shows good construct validity and excellent inter-rater (ICCs 0.94–0.98) and test-retest reliability (ICCs 0.98–0.99) [49,50]. Second, Canadian Occupational Performance Measure (COPM) evaluates perceived changes in satisfaction and performance of self-identified goal areas [33]. In conversation with a trained Therapist, participants rated a primary, and secondary if desired, goal area(s) from 1–10 in terms of importance, performance and satisfaction. Goal areas were re-evaluated post-intervention [33]. The primary goal’s perceived change in performance and satisfaction are evaluated here [51]. 2-points is the minimal clinically meaningful change [52]. COPM has been reported as valid, reliable, and responsive [53]. Third, the Self-Reported Experiences of Activity Settings (SEAS) questionnaire evaluates experience with an activity in four domains: personal growth, psychological engagement, meaningful interactions, choice and control [36]. It is a 22-item questionnaire completed independently or with parental/researcher assistance. Scores are interpreted on a 7-point Likert scale (from +3- -3). The questionnaire has good internal consistency and test-retest reliability (Cronbach’s alpha from 0.71 to 0.88, mean scale ICC = 0.68) [54].
Analyses
For process feasibility, participant recruitment and demographic characteristics are presented as per CONSORT recommendations [24]. Success criteria are reported descriptively and narratively. Technical issues and resources required for resolution were documented and reported. Recommendations for the design of a future clinical trial is based on the number of and extent to which success criteria were met.
For scientific feasibility related to Body Function measures size and variance of the intervention effect on active wrist extension and grip strength are calculated for baseline and intervention phases. SCRIBE recommends a combined visual and statistical approach for SCED data [55]. The statistical approaches improve the estimate of the effect and can help account for serial dependence, variability and trends in the time-series data [23,56]. As the objective of the study is to inform a definitive RCT, the analysis focuses on estimating treatment effect size and variance. Statistical significance tests are not recommended to report due to insignificant power [21,57,58]. Level- and slope-change differences between phases, percentage of all non-overlapping data (PAND), and standardized mean difference (SMD, d-statistic with 95% confidence interval (CI)) show the effect size and variance [23,34,56]. Changes in Box and Blocks performance are described at individual and group levels with Hedge’s G effect size and 95% CI.
For scientific feasibility related to Activities and Participation measures, the effect size (Hedge’s g) and 95% CI are reported for changes in functional bimanual performance (AHA, Assisting Hand Assessment). Effect size for non-parametric data (COPM and SEAS) are reported using matched-pairs rank-biserial correlation (r) with 95% CI by bootstrapping [59]. These data analyses were completed in R (v. 3.7) employing packages: SingleCaseES [60] and RcmdrPlugin [23].
Results
Participant and recruitment characteristics
Fig 1 shows the CONSORT recruitment flow chart. Participant enrolment started September 2018 and completed January 2019. The target number of participants was reached. Table 1 shows baseline demographic and clinical characteristics. System usage varied across individuals but averaged 4±1 days/week (8–24 days total), 17±9 minutes/day (37–333 minutes total), and 163±59 gesture repetitions/day (997–5698 total). No adverse events were reported. Two participants reported mild forearm muscle soreness during a weekly check-in. The soreness lasted for one day and resolved naturally without intervention.
Standardized recruitment flowchart depicting the number of screened, enrolled, allocated and assess participants. Clinical assessment completed before and after intervention with occupational therapist: Box and Blocks, Assisting Hand Assessment and COPM Goals. As in single-case design, all participants allocated to same intervention.
Process feasibility success criteria
Table 2 summarizes the a priori success criteria evaluation. As most (i.e. recruitment rate, completion), but not all criteria (i.e. frequency of technical issues) were met, the recommendation is ‘feasible with minor modifications’.
Scientific feasibility
Table 3 shows individual system utilization (dose) and scores for the six person-centred outcome measures.
Participants system usage in total days played (Days), average daily repetitions (Reps.), average time spent actively playing in the system (Minutes Active), average time using the system (Minutes in System). Body Function and Activities and Participation measures are presented. Starting (S) scores are: the median values at baseline for AWEO (Active wrist extension–open fingers, positive values indicate extension above neutral) and Grip (non-dominant grip strength relative to dominant), therapist assessed baseline values for B&B (Box and Blocks Test) and AHA (Assisting Hand Assessment- Logit score/100), COPM-P (primary goal’s performance score), COPM-S (primary goal’s satisfaction score), and SEAS (overall score on 7-point Likert scale) assessed at first week of play. Finishing (F) score are median score during final week of the intervention for AWEO and Grip, therapist assessment within 2-weeks of the end of intervention for B&B, AHA and COPM, and SEAS after the final day of practice. Insufficient/ not collected data denoted by -.
Body function.
Active wrist extension (AWEO) increased 12±12°. There was a moderate to large effect for AWEO (SMD = 1.82, 95%CI = 0.85–2.78). Grip strength also increased (17±18%) and there was a small to moderate effect (SMD = 0.63, 95%CI = 0.65–1.91). Fig 2 shows the number of participants with small, moderate and large effects through Slope and Level change, and PAND analysis. A positive increase in at least one Body Function measure was seen in 14/19 participants (see S7 File, for slope and level changes for each participant).
Number of participants showing changes between baseline and intervention phases (total N = 17). Active wrist extension–open fingers (AWEO, dark) and grip strength (light). (a) Slope changes, increasing indicates intervention phase slope is greater than baseline slope. (b) Level changes determined by split-middle method, small—Intervention phase < 5° (AWEO) or <5% (Grip Strength) from Baseline, moderate—Intervention phase 5–15° (AWEO) or 5–15% (Grip Strength) from Baseline, and large—Intervention phase >15° (AWEO) or >15% (Grip Strength) from Baseline. (c) Percent of all non-overlapping data, 50–80% of all non-overlapping data between phases indicates moderate separation between baseline and intervention and >80% of all non-overlapping data between phases indicates large separation between baseline and intervention.
Change score for non-dominant Box & Blocks performance showed a moderate effect (Hedge’s g = 0.58, 95%CI = -0.11–1.27). Box & Blocks scores were between 5–32 at pre-test and 3–41 at post with a median change of +2.5 blocks (Table 3).
Activities and participation.
Fig 3 summarizes pre-post changes, ordered by practice time (minutes in system). Post-hoc analyses showed small to no relationship between practice time and functional change scores (B&B, r = 0.19; AHA, r = 0.20; COPM, r = 0.30; SEAS, r = 0.08). Four weeks of the intervention showed a small effect in AHA score (Hedge’s g = 0.29, 95%CI = -0.39–0.97). AHA scores ranged between 32–77 at pre-test and 40–79 at post with a median change of +1.5 logit units. There was a moderate effect for COPM Performance scores (r = 0.60, 95%CI = 0.13–0.82). Median COPM change was +1 post intervention ranging from -2–5. See S1 Table for COPM Goals. The SEAS questionnaire showed participants felt positively about the activity (median = +2, IQR = 1.25) at the beginning and end of the intervention. SEAS score did not change (Median change = 0, range = -1–1, IQR = 0.75, small effect r = 0.24, 95%CI = —.25–0.61). See S2 Table for SEAS subscale scores.
Differences in score before and after intervention for each measure, positive values indicate higher post-intervention score. (a) Assisting Hand Assessment (AHA) logit units, b) Box and Blocks (Blocks / minute), c) Canadian Occupational Performance Measure (COPM) P-performance, S-satisfaction (1–10 scale), and d) Self-Reported Experiences of Activity Settings (SEAS) overall score (+3- -3, 7-point Likert scale). Solid horizontal line indicates clinically meaningful change. Red, horizontal lines indicate clinically meaningful difference where available. Participants arranged left to right by total practice time (minutes) as indicated by dotted line, showing little correlation (r = 0.8–0.3) between practice time and change score for each measure.
Discussion
This study assesses the feasibility of novel intervention combining Solution Focused Coaching strategies with biofeedback-enhanced movement-controlled gaming. Most but not all a priori success criteria were met, as such the intervention approach is feasible with modifications, most notably in the refinement of the technology to mitigate technical issues. Clinical outcomes of the intervention were promising with moderate effects in Body Function measures and small-moderate effects in Activities and Participation measures.
Recruitment and adherence
This study shows comparable recruitment and retention rates to similar interventions. When reported, previous home-based ICP interventions have shown 37–46% recruitment of eligible participants and 66–90% retention through the intervention [38,61–63]. Adherence was relatively high compared to other studies which have shown participants complete 53–78% of practice goals during intervention periods 4–20 weeks long [38,61–63]. Few studies transparently report relevant metrics of the practice (timing, duration intensity) which makes it difficult to quantify and compare the therapy dose between studies. Standardized reporting in this area would facilitate meta-analyses needed to strengthen the evidence for home-based gaming interventions. At the observed effect size, 0.29, in bimanual performance (AHA change score), 127 participants would be required for the definitive RCT assuming alpha significance set to 0.05 and a desired power = 0.9. AHA change score was chosen to estimate the sample size instead of active wrist extension capacity since it measures functional bimanual performance and has a more direct relationship with ability to perform activities of daily living.
Implementation
It is important to note that this is the first investigation of the novel home-based gaming intervention and accordingly focused on process and scientific feasibility. Specifically, the study focuses on determining the extent to which the intervention could be used at home and estimating the effect size and variance it might have. Towards conducting a complete RCT, more studies and development would be needed to ascertain real-world feasibility, addressing resources and management. This includes a proper health economics analysis and evaluation of the logistic organization with respect to an institute’s existing therapeutic practices. It should also be noted that participants in Canada and France were off treatment blocks but visited their care provider for regularly scheduled check-ups, either annually or quarterly. Two participants, B and F, took additional weekly therapy sessions outside of the rehabilitation centre and one participant, J, attended the school at the rehabilitation centre and would see the occupational therapist as needed.
Motivation
We expect that the coaching and biofeedback strategies helped maintain participants’ engagement in the intervention. Biofeedback was linked to a variety of short- and long-term goals in the game. Participants’ motivations were linked to game biofeedback. Participants regularly chose to review their progress and adapted their movements in response to game feedback (S1 File). The Solution Focused Coaching strategy helped to maintain cognitive engagement in the intervention, reiterating how the game addressed functional goals. The positive, self-directed rhetoric was more effective with participants who believed that the game addressed their functional goals. Five of 19 participants did not reach their practice goals. These participants showed a novelty effect, with little interest after 1–2 weeks with the new game. These participants commented that they felt the activity did not align with their functional goals (e.g. Spread thumb easier to use joystick when playing video games) indicating a lack of cognitive engagement. Participants who were less convinced of the relevance of the task found it more difficult to participate in the coaching conversations and verbalize how their success in the game could translate to daily activities. In such cases, we explored alternative motivation strategies (e.g. parent-identified rewards for adhering to practice goals, or leader boards playing to a competitive nature). The SFC strategy required flexibility in the conversation and training structure. We would recommend it as a tool to engage participants but would not rely solely on SFC. Overall our learning in this study defends the importance of ensuring that home-based ICP therapy activities align with individual motivations and goals to support cognitive, affective and behavioural engagement in the intervention [14].
Body function
Active wrist extension is moderately to highly related to manual abilities [43,64]. In the current study, 12 of 17 participants increased active wrist extension by at least 5 degrees. These findings are consistent with other home-based supplemental therapy activities. Comparatively, [28] found 6±3 degrees improvement in wrist extension across 30 young children with CP after 24 weeks at 3 * 60 minutes/week and [27] saw 18±12 degrees change with four participants after 30 minutes * 5 sessions of EMG-based neurotherapy. Note, the wide range in practice time and different nature of the interventions may contribute to the inconsistency between studies.
Wrist extension capacity is also directly related to grip strength [65]. Accordingly, we saw 18% average improvement in non-dominant grip strength relative to the dominant side across participants. However, normative data for children’s grip strength, as compared to the dominant side using the modified sphygmomanometer are not available. For comparison, [66] reported an average 15% grip strength improvement after 12-weeks hand function training in 15 children with CP. [67] observed a median 25% change from 5 participants pre-test values after 8-weeks of single joint resistance training combined with Botulinum toxin A injections.
Post-hoc analyses showed differences in Body Function effect based on CP severity. Participants with more severe involvement (MACS level II) had greater gains in active wrist extension (8±10°) and smaller gains in grip strength (-8±7%) compared to participants at MACS level I. Statistical confirmation is not advised based on sample size and variance. More severely affected participants, those at MACS II had below neutral maximum wrist extension. Therefore, there was more opportunity for amplitude improvement, but without being in an extended posture, it is difficult to optimize grip strength.
[68] established through path analysis from records of 136 children with CP that grip strength indirectly contributes to manual ability (Abilhand-Kids) [69] via its influence on gross manual dexterity (B&B) [68]. Consequently, active wrist extension and grip strength may indicate changes in manual ability relevant to daily activities. Despite this, we recognize the increased focus and relevance towards Activity and Participation measures [70]. Accordingly, the Activity and Participation measures were included in this early-stage feasibility study.
Activities and participation
There were small effects in Activities and Participation related measures (AHA, COPM). A minority of participants met or exceeded clinically meaningful thresholds (3/19 for AHA and 8/19 for COPM), while the majority showed non-clinically significant positive changes. The small effect is most likely due to low dosage and the nature of the activity. Further considering this relatively small dose across all participants, it is not surprising to see small correlations between practice time and functional change scores. The biofeedback video game practices specific functional movements but it is not an activity-based intervention (e.g. Constraint Induced Movement Therapy) [41]. Since practical manual ability is not the simple summation of skill and structure it would be unreasonable to expect gross transfer to daily tasks. However, considering the need for diverse and engaging rehabilitation strategies and the relative low risk of harm of this ICP intervention it may be a useful supplement to activity-based interventions. It may help accelerate Body Function changes (e.g. active wrist extension, grip strength) to facilitate manual ability improvements. This question could be addressed in future clinical trials.
The SEAS questionnaire showed that participants experience was consistent during the 4-weeks. This corresponds with observations during the weekly check-in conversations. Only in the five participants who experienced a novelty effect, as described above, did we observe a decrease in the sub-scale score, Psychological Engagement (S2 Table).
Limitations
Due to resource limitations, a single game was built which may not have optimally appealed to the wide range in ages (8–18 years) and interests of the participants. General interest in video games or this game was not an inclusion criterion. Considering the impact personal motivation has on adherence and the vast differences in personal preferences, it is essential to match participants to activities that interest them. Greater choice and game variety, while challenging to implement in rehabilitation protocols, would help maintain novelty and interest in the activity. Collaboration with independent game developers can improve feasibility by offering content with relatively quick and flexible modification abilities, as was the case in the current study with the adapted commercial video game (Dashy Square) [71].
Methodologically, there was risk of bias in assessment scoring as clinicians and researchers were not blinded to the participant phase. Bias in goal setting is also possible as parents, clinicians and researchers were present when the participants set their practice and COPM goals. Further, COPM responses are subjective and can be influenced by mood and environment. For instance, one participant successfully completed her goal for the first time at the post-intervention assessment but scored the performance lower than at baseline. For these reasons we use multiple measures to capture Activities and Participation experiences. Next, level-change groupings (small, moderate, and large) for active wrist extension were based on a minimal detectible difference of five degrees [42]. However, similar level-change groupings in grip strength were undeterminable since minimal detectible differences for grip strength, as compared to the dominant hand, do not yet exist for young people with CP. Scores are reported as a percent of the dominant side since improved capacity for bimanual activities is a primary goal for many young people with CP. For context, raw score increases in the affected hand's grip strength averaged 17 mmHg and all but two participants saw an improvement of greater than 10 mmHg. A minimal detectible difference of seven mmHg and a within-subject Standard Error of Measurement of three mmHg has recently been reported in individuals with Parkinson's Disease using a similar modified sphygmomanometer test [72]. These visual analyses summaries are not provided as a definitive evaluation but to aid the reader in their interpretation of the effect size in this single-case design intervention [23]. Further, while AB designs are useful for evaluating feasibility, return-to-baseline, or withdrawal designs would improve the strength of evidence of treatment effects [23]. The SEAS questionnaire was a practical tool to implement in the home to gauge self-reported experience. For a comprehensive evaluation, future work should consider qualitative interviews and content analysis [73]. The Solution Focused Coaching approach is designed to encourage collaborative development, led by the participant but does acknowledge the potential for external influence [16]. Here we kept fidelity of the SFC approach by referring to a checklist, but this could be improved by video review and completing a fidelity questionnaire [16].
Logistically, the protocol may benefit from increased clinician involvement. Occupational Therapists remarked that that they could have helped guide home-based training by observing participants playing at weekly visits or by video. Finally, this study used the AHA as an outcome measure focusing on the non-dominant hand’s involvement in bimanual activities. Other measures of manual performance (i.e. Melbourne Assessment of Unilateral Upper Limb Function) [46] have been proposed and used more widely. Changing this metric could facilitate cross-study comparison.
Supporting information
S2 File. The Single-Case Reporting Guideline In BEhavioural interventions (SCRIBE) 2016 checklist.
https://doi.org/10.1371/journal.pone.0234767.s002
(PDF)
S3 File. The Consolidated Standards of Reporting Trials (CONSORT) checklist.
https://doi.org/10.1371/journal.pone.0234767.s003
(PDF)
S5 File. Template for Intervention Description and Replication (TIDieR) checklist.
https://doi.org/10.1371/journal.pone.0234767.s005
(PDF)
Acknowledgments
We are greatly appreciative of the time and input of the participants and families who helped us build and test this system. The authors wish to acknowledge the occupational therapists and research administration staff who supported this project. Special thanks to the head of the DISI, and to the head of the UFR ST, of University of Evry for lending computers. And to the developer of the game, KasSanity Inc. The authors also wish to acknowledge the data processing and administrative assistance of the Research Manager.
References
- 1. Sandlund M, McDonough S, Hager-Ross C. Interactive computer play in rehabilitation of children with sensorimotor disorders: a systematic review. Dev Med Child Neurol. 2009;51: 173–179. pmid:19191834
- 2. Shikako-Thomas K, Shevell M, Lach L, Law M, Schmitz N, Poulin C, et al. Are you doing what you want to do? Leisure preferences of adolescents with cerebral palsy. Dev Neurorehabilitation. 2015;18: 234–240. pmid:23869565
- 3. Oskoui M, Gazzellone MJ, Thiruvahindrapuram B, Zarrei M, Andersen J, Wei J, et al. Clinically relevant copy number variations detected in cerebral palsy. Nat Commun. 2015;6: 7949. pmid:26236009
- 4. Sanger TD, Chen D, Delgado MR, Gaebler-Spira D, Hallett M, Mink JW, et al. Definition and classification of negative motor signs in childhood. Pediatrics. 2006;118: 2159–2167. pmid:17079590
- 5. Jelsma J, Pronk M, Ferguson G, Jelsma-Smit D. The effect of the Nintendo Wii Fit on balance control and gross motor function of children with spastic hemiplegic cerebral palsy. Dev Neurorehabilitation. 2013;16: 27–37. pmid:23030836
- 6. Levin I, Lewek MD, Feasel J, Thorpe DE. Gait training with visual feedback and proprioceptive input to reduce gait asymmetry in adults with cerebral palsy: a case series. Pediatr Phys Ther. 2017;29: 138–145. pmid:28350769
- 7. Keller JW, van Hedel HJA. Weight-supported training of the upper extremity in children with cerebral palsy: a motor learning study. J NeuroEngineering Rehabil. 2017;14. pmid:28854939
- 8. James S, Ziviani J, King G, Boyd RN. Understanding Engagement in Home-Based Interactive Computer Play: Perspectives of Children With Unilateral Cerebral Palsy and Their Caregivers. Phys Occup Ther Pediatr. 2016;36: 343–358. pmid:26606419
- 9. Ravi DK, Kumar N, Singhi P. Effectiveness of virtual reality rehabilitation for children and adolescents with cerebral palsy: an updated evidence-based systematic review. Physiotherapy. 2017;103: 245–258. pmid:28109566
- 10. MacIntosh A, Lam E, Vigneron V, Vignais N, Biddiss E. Biofeedback interventions for individuals with cerebral palsy: a systematic review. Disabil Rehabil. 2019;41: 2369–2391. pmid:29756481
- 11. Van Dijk H, Jannink M, Hermens H. Effect of augmented feedback on motor function of the affected upper extremity in rehabilitation patients: a systematic review of randomized controlled trials. J Rehabil Med. 2005;37: 202–211. pmid:16024475
- 12. Rone-Adams SA, Stern DF, Walker V. Stress and compliance with a home exercise program among caregivers of children with disabilities. Pediatr Phys Ther. 2004;16: 140–148. pmid:17057541
- 13. Stergiou N, Harbourne RT, Cavanaugh JT. Optimal Movement Variability: A New Theoretical Perspective for Neurologic Physical Therapy. J Neurol Phys Ther. 2006;30: 120. pmid:17029655
- 14. Biddiss E, Chan-Viquez D, Cheung ST, King G. Engaging children with cerebral palsy in interactive computer play-based motor therapies: theoretical perspectives. Disabil Rehabil. 2019;1.: 1. pmid:31104517
- 15. Baldwin P, King G, Evans J, McDougall S, Tucker MA, Servais M. Solution-Focused Coaching in Pediatric Rehabilitation: An Integrated Model for Practice. Phys Occup Ther Pediatr. 2013;33: 467–483. pmid:23611310
- 16. McPherson AC, McAdam L, Keenan S, Schwellnus H, Biddiss E, DeFinney A, et al. A feasibility study using solution-focused coaching for health promotion in children and young people with Duchenne muscular dystrophy. Dev Neurorehabilitation. 2018;21: 121–130. pmid:28272972
- 17. Abraham C, Kelly MP, West R, Michie S. The UK National Institute for Health and Clinical Excellence public health guidance on behaviour change: a brief introduction. Psychol Health Med. 2009;14: 1–8. pmid:19085307
- 18. Thabane L, Ma J, Chu R, Cheng J, Ismaila A, Rios LP, et al. A tutorial on pilot studies: the what, why and how. BMC Med Res Methodol. 2010;10: 1. pmid:20053272
- 19. Schiariti V, Mâsse LC. Identifying relevant areas of functioning in children and youth with Cerebral Palsy using the ICF-CY coding system: From whose perspective? Eur J Paediatr Neurol. 2014;18: 609–617. pmid:24813657
- 20. Cieza A, Geyh S, Chatterji S, Kostanjsek NFI, Ustün BT, Stucki G. ICF linking rules: an update based on lessons learned. J Rehabil Med. 2005;37: 212–218. pmid:16024476
- 21. Tate RL, Perdices M, Rosenkoetter U, McDonald S, Togher L, Shadish W, et al. The Single-Case Reporting Guideline In BEhavioural Interventions (SCRIBE) 2016: Explanation and elaboration. Arch Sci Psychol. 2016;4: 10.
- 22. Kratochwill TR, Hitchcock J, Horner R, Levin JR, Odom S, Rindskopf D, et al. Single-case designs technical documentation. What Works Clgh. 2010.
- 23. Manolov R, Gast DL, Perdices M, Evans JJ. Single-case experimental designs: Reflections on conduct and analysis. Neuropsychol Rehabil. 2014;24: 634–660. pmid:24779416
- 24. Eldridge SM, Chan CL, Campbell MJ, Bond CM, Hopewell S, Thabane L, et al. CONSORT 2010 statement: extension to randomised pilot and feasibility trials. Pilot Feasibility Stud. 2016;2: 64. pmid:27965879
- 25. Eliasson A-C, Krumlinde-Sundholm L, Rösblad B, Beckung E, Arner M, Öhrvall A-M, et al. The Manual Ability Classification System (MACS) for children with cerebral palsy: scale development and evidence of validity and reliability. Dev Med Child Neurol. 2006;48: 549–554. pmid:16780622
- 26. Wood KC, Lathan CE, Kaufman KR. Feasibility of Gestural Feedback Treatment for Upper Extremity Movement in Children With Cerebral Palsy. IEEE Trans Neural Syst Rehabil Eng. 2013;21: 300–305. pmid:23193461
- 27. Rios DC, Gilbertson T, McCoy SW, Price R, Gutman K, Miller KEF, et al. NeuroGame Therapy to improve wrist control in children with cerebral palsy: a case series. Dev Neurorehabilitation. 2013;16: 398–409. pmid:23617243
- 28. Olama K, Hegazy F, Thabt N. Combined effects of myofeedback and isokinetic training on hand function in spastic hemiplegic children. Egypt J Med Hum Genet. 2012;13: 183.
- 29. Sevick M, Eklund E, Mensch A, Foreman M, Standeven J, Engsberg J. Using Free Internet Videogames in Upper Extremity Motor Training for Children with Cerebral Palsy. Behav Sci. 2016;6: 10. pmid:27338485
- 30. Faul F, Erdfelder E, Lang A-G, Buchner A. G*Power 3: a flexible statistical power analysis program for the social, behavioral, and biomedical sciences. Behav Res Methods. 2007;39: 175–91. pmid:17695343
- 31.
Research Ethics Board—Forms. [cited 6 Aug 2019]. Available: http://research.hollandbloorview.ca/researchethicsboard/forms
- 32. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better Reporting of Interventions: Template for Intervention Description and Replication (TIDieR) Checklist and Guide. Gesundheitswesen. 2016;78: 175–188. pmid:26824401
- 33. Law M, Baptiste S, McColl M, Opzoomer A, Polatajko H, Pollock N. The Canadian occupational performance measure: an outcome measure for occupational therapy. Can J Occup Ther Rev Can Ergother. 1990;57: 82–87.
- 34. Solanas A, Manolov R, Onghena P. Estimating slope and level change in N = 1 designs. Behav Modif. 2010;34: 195–218. pmid:20234005
- 35.
Jong PD, Berg IK. Interviewing for Solutions. Nelson Education; 2012.
- 36. King G, Batorowicz B, Rigby P, McMain-Klein M, Thompson L, Pinto M. Development of a Measure to Assess Youth Self-reported Experiences of Activity Settings (SEAS). Int J Disabil Dev Educ. 2014;61: 44–66.
- 37.
Ratner H, George E, Iveson C. Solution focused brief therapy: 100 key points and techniques. New York, NY, US: Routledge/Taylor & Francis Group; 2012.
- 38. James S, Ziviani J, Ware RS, Boyd RN. Randomized controlled trial of web-based multimodal therapy for unilateral cerebral palsy to improve occupational performance. Dev Med Child Neurol. 2015;57: 530–538. pmid:25955443
- 39. Bilde PE, Kliim-Due M, Rasmussen B, Petersen LZ, Petersen TH, Nielsen JB. Individualized, home-based interactive training of cerebral palsy children delivered through the Internet. BMC Neurol. 2011;11: 32. pmid:21392370
- 40. Howcroft J, Klejman S, Fehlings D, Wright V, Zabjek K, Andrysek J, et al. Active Video Game Play in Children With Cerebral Palsy: Potential for Physical Activity Promotion and Rehabilitation Therapies. Arch Phys Med Rehabil. 2012;93: 1448–1456. pmid:22571917
- 41. Aarts PB, Jongerius PH, Geerdink YA, van Limbeek J, Geurts AC. Modified Constraint-Induced Movement Therapy combined with Bimanual Training (mCIMT–BiT) in children with unilateral spastic cerebral palsy: How are improvements in arm-hand use established? Res Dev Disabil. 2011;32: 271–279. pmid:21051191
- 42. Mutlu A, Livanelioglu A, Gunel MK. Reliability of goniometric measurements in children with spastic cerebral palsy. Med Sci Monit. 2007;13: CR323–CR329. pmid:17599027
- 43. Klingels K, Cock PDE, Molenaers G, Desloovere K, Huenaerts C, De Cock P, et al. Upper limb motor and sensory impairments in children with hemiplegic cerebral palsy. Can they be measured reliably? Disabil Rehabil. 2010;32: 409–416. pmid:20095955
- 44. Glazier J, Fehlings D, Steele C. Test-retest reliability of upper extremity goniometric measurements of passive range of motion and of sphygmomanometer measurement of grip strength in children with cerebral palsy and upper extremity spasticity. Dev Med Child Neurol. 1997;39: 33–34.
- 45. Xu K, Wang L, Mai J, He L. Efficacy of constraint-induced movement therapy and electrical stimulation on hand function of children with hemiplegic cerebral palsy: a controlled clinical trial. Disabil Rehabil. 2012;34: 337–346. pmid:21961441
- 46. Wagner L V., Davids JR. Assessment Tools and Classification Systems Used For the Upper Extremity in Children With Cerebral Palsy. Clin Orthop Relat Res. 2012;470: 1257–1271. pmid:21932104
- 47. Mathiowetz V, Volland G, Kashman N, Weber K. Adult Norms for the Box and Block Test of Manual Dexterity. Am J Occup Ther. 1985;39: 386–391. pmid:3160243
- 48. Platz T, Pinkowski C, van Wijck F, Kim I-H, di Bella P, Johnson G. Reliability and validity of arm function assessment with standardized guidelines for the Fugl-Meyer Test, Action Research Arm Test and Box and Block Test: a multicentre study. Clin Rehabil. 2005;19: 404–411. pmid:15929509
- 49. Louwers A, Beelen A, Holmefur M, Krumlinde-Sundholm L. Development of the Assisting Hand Assessment for adolescents (Ad-AHA) and validation of the AHA from 18 months to 18 years. Dev Med Child Neurol. 2016;58: 1303–1309. pmid:27291981
- 50. Louwers A, Krumlinde-Sundholm L, Boeschoten K, Beelen A. Reliability of the Assisting Hand Assessment in adolescents. Dev Med Child Neurol. 2017;59: 926–932. pmid:28555755
- 51. Garzon LC, Switzer L, Musselman KE, Fehlings D. The use of functional electrical stimulation to improve upper limb function in children with hemiplegic cerebral palsy: A feasibility study. J Rehabil Assist Technol Eng. 2018;5: 2055668318768402. pmid:31191936
- 52. McColl MA, Law M, Baptiste S, Pollock N, Carswell A, Polatajko HJ. Targeted Applications of the Canadian Occupational Performance Measure. Can J Occup Ther. 2005;72: 298–300. pmid:16435590
- 53. Cup EHC, Scholte op Reimer WJM, Thijssen MCE, van Kuyk-Minis MAH. Reliability and validity of the Canadian Occupational Performance Measure in stroke patients. Clin Rehabil. 2003;17: 402–409. pmid:12785249
- 54. King G, Kingsnorth S, McPherson A, Jones-Galley K, Pinto M, Fellin M, et al. Residential immersive life skills programs for youth with physical disabilities: A pilot study of program opportunities, intervention strategies, and youth experiences. Res Dev Disabil. 2016;55: 242–255. pmid:27153504
- 55. Bulté I, Onghena P. When the truth hits you between the eyes: A software tool for the visual analysis of single-case experimental data. Methodol Eur J Res Methods Behav Soc Sci. 2012;8: 104–114.
- 56. Shadish WR, Hedges LV, Pustejovsky JE. Analysis and meta-analysis of single-case designs with a standardized mean difference statistic: A primer and applications. J Sch Psychol. 2014;52: 123–147. pmid:24606972
- 57. Kratochwill TR, Hitchcock J, Horner RH, Levin JR, Odom SL, Rindskopf DM, et al. What Works Clearinghouse Single-case design technical documentation. 2010.
- 58. Faraone SV. Interpreting Estimates of Treatment Effects. Pharm Ther. 2008;33: 700–711.
- 59.
R Handbook: Confidence Intervals. [cited 6 Aug 2019]. Available: http://rcompanion.org/handbook/C_03.html
- 60. Pustejovsky J, Swan D. Singlecasees: A calculator for single-case effect size indices, R package version 0.3. Comput Softw Man Retrieved Httpsgithub ComjepustoSingleCaseES. 2017.
- 61. Chen C-L, Hong W-H, Cheng H-YK, Liaw M-Y, Chung C-Y, Chen C-Y. Muscle strength enhancement following home-based virtual cycling training in ambulatory children with cerebral palsy. Res Dev Disabil. 2012;33: 1087–1094. pmid:22502833
- 62. Ramstrand N, Lygnegard F. Can balance in children with cerebral palsy improve through use of an activity promoting computer game? Technol Health Care Off J Eur Soc Eng Med. 2012;20: 501–510. pmid:23187015
- 63. Chiu H-C, Ada L, Lee H-M. Upper limb training using Wii Sports ResortTM for children with hemiplegic cerebral palsy: a randomized, single-blind trial. Clin Rehabil. 2014;28: 1015–1024. pmid:24849793
- 64. Park ES, Rha DW, Park JH, Park DH, Sim EG. Relation among the Gross Motor Function, Manual Performance and Upper Limb Functional Measures in Children with Spastic Cerebral Palsy. Yonsei Med J. 2013;54: 516–522. pmid:23364990
- 65. O’Driscoll SW, Horii E, Ness R, Cahalan TD, Richards RR, An K-N. The relationship between wrist position, grasp size, and grip strength. J Hand Surg. 1992;17: 169–177.
- 66. Azzam A M. Effect of Hand Function Training on Improvement of Hand Grip Strength in Hemiplegic Cerebral Palsy in Children. J Nov Physiother. 2012;02.
- 67. Elvrum A-KG, Brændvik SM, Sæther R, Lamvik T, Vereijken B, Roeleveld K. Effectiveness of resistance training in combination with botulinum toxin-A on hand and arm use in children with cerebral palsy: a pre-post intervention study. BMC Pediatr. 2012;12: 91. pmid:22747635
- 68. Arnould C, Bleyenheuft Y, Thonnard J-L. Hand Functioning in Children with Cerebral Palsy. Front Neurol. 2014;5. pmid:24782821
- 69. Arnould C, Penta M, Renders A, Thonnard J-L. ABILHAND-Kids: a measure of manual ability in children with cerebral palsy. Neurology. 2004;63: 1045–1052. pmid:15452296
- 70. Rosenbaum P, Stewart D. The world health organization international classification of functioning, disability, and health: a model to guide clinical thinking, practice and research in the field of cerebral palsy. Semin Pediatr Neurol. 2004;11: 5–10. pmid:15132248
- 71. MacIntosh A, Vignais N, Vigneron V, Fay L, Musielak A, Desailly E, et al. The design and evaluation of electromyography and inertial biofeedback in hand motor therapy gaming. Assistive Technology. 2020 Apr 17:1–9.
- 72. Silva SM, Corrêa FI, Silva PFC, Silva DFT, Lucareli PRG, Corrêa JCF, et al. Validation and reliability of a modified sphygmomanometer for the assessment of handgrip strength in Parkinson´s disease. Braz J Phys Ther. 2015;19: 137–145. pmid:25993627
- 73.
Flick U, Kardoff E von, Steinke I. A Companion to Qualitative Research. SAGE; 2004.