Background and Objectives
To provide proof-of-concept for the validity of the Wii Balance Board (WBB) measures to predict the type of walking aids required by inpatients with a recent (≤4days) total knee arthroplasty (TKA).
A cross-sectional sample of 89 inpatients (mean age, 67.0±8years) with TKA was analyzed. A multivariable proportional odds prediction model was constructed using 8 pre-specified predictors – namely, age, sex, body mass index, knee pain, knee range-of-motion, active knee lag, and WBB-derived standing balance. The type of walking aids prescribed on day 4 post-surgery was the outcome of interest – an ordinal variable with 4 categories (walking stick, narrow- and broad-base quadstick, and walking frame).
Women, increasing body mass index, and poorer standing balance were independently associated with greater odds for requiring walking aids with a larger base-of-support. The concordance-index of the prediction model was 0.74. The model comprising only WBB-derived standing balance had nearly half (44%) the explanatory power of the full model. Adding WBB-derived standing balance to conventional demographic and knee variables resulted in a continuous net reclassification index of 0.60 (95%CI,0.19-1.01), predominantly due to better identification of patients who required walking aids with a large base-of-support (sensitivity gain).
The WBB was able to provide quantitative measures of standing balance which could assist healthcare professionals in prescribing the appropriate type of walking aids for patients. Further investigation is needed to assess whether using the WBB could lead to meaningful changes in clinical outcomes such as falls.
Citation: Pua Y-H, Clark RA, Ong P-H (2015) Evaluation of the Wii Balance Board for Walking Aids Prediction: Proof-of-Concept Study in Total Knee Arthroplasty. PLoS ONE 10(1): e0117124. https://doi.org/10.1371/journal.pone.0117124
Academic Editor: Maciej Buchowski, Vanderbilt University, UNITED STATES
Received: August 18, 2014; Accepted: December 12, 2014; Published: January 23, 2015
Copyright: © 2015 Pua et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was supported by Singhealth Foundation Grant (SHF/FG444S/2009). The study sponsors had no involvement in study design, collection, analysis and interpretation of the data, writing of the manuscript and in the decision to submit the manuscript for publication.
Competing interests: The authors have declared that no competing interests exist.
Walking aids such as sticks and frames are recommended for and commonly used by older adults with mobility limitations to promote independent functioning and improve balance.[1,2] Prescribing the appropriate type of walking aids is crucial: inappropriate prescription is by itself a risk factor for falls with often severe consequences.[3,4] Appropriate prescription of the type of walking aids relies, inter alia, on an accurate assessment of postural balance. Although the laboratory force-plate is the gold-standard equipment to assess postural balance, healthcare professionals who prescribe walking aids often do not have access to these high-precision but high-cost and non-portable devices. Furthermore, no formal algorithm exists to guide healthcare professionals in the selection of a walking aid.
Recently, we have repurposed the Nintendo Wii Balance Board (WBB) as a portable (3.5kg) balance assessment tool. Whilst we have established the reliability of the WBB-derived center-of-pressure (CoP) measures and their concurrent validity with laboratory force plate measures in healthy and clinical populations,[6,7] it remains untested whether the WBB could have clinical applications such as assisting in the prescription of walking aids.
Therefore, this study sought to provide proof-of-concept for the validity of WBB-measures to predict the type of walking aids required by patients. Noteworthy, we examined inpatients with a recent (≤ 4days) total knee arthroplasty (TKA) – a clinical population with a high risk of injurious falls,[8,9] in which an increase in predictive accuracy would be most clinically important. Furthermore, an acute ward setting was chosen because healthcare professionals have typically no access to a laboratory force-plate in the wards.
Patients and Methods
Our study sample comprised patients aged 50 and older undergoing unilateral TKA for primary knee osteoarthritis at one hospital from June 2010 to January 2011. Patients were recruited within a month before the surgery as part of a randomized trial investigating the effects of postoperative electrical muscle stimulation (ACTRN12610000601033). Patients were excluded if they had previous lower extremity surgery in the past year or were unable to walk 10 meters independently. A total of 104 eligible patients participated in our original clinical study but the present study is concerned with data collected on post operation day (POD) 4 (or earlier on the discharge day). We excluded 15 patients from the final analysis due to the following reasons: (i) underwent unicompartmental knee arthroplasty instead of TKA (n = 2); (ii) found to be unfit for the operation (n = 6); (iii) declined to continue participation (n = 5); and (iv) developed postoperative medical complications that adversely affected the outcomes (n = 2). Thus, the final sample comprised the remaining 89 patients. The Singhealth Centralised Institutional Review Board approved this study and all patients provided signed, written, informed consent.
Candidate independent (predictor) variables
Following a TKA, all patients were managed using a coordinated clinical pathway to ensure standardized medical, pharmacological, and rehabilitation care. Patients included in this study received standard physiotherapy interventions daily from POD1. They also underwent quadriceps muscle stimulation or active quadriceps exercises (control treatment), as per study protocol. For our analysis, beside standing balance (assessed using the WBB), we focused on age, sex, body mass index (BMI), and knee impairments – variables that are routinely or easily obtained in a hospital ward setting and have been correlated elsewhere with activity limitations.[10,11] All data were collected on POD4 by 3 physiotherapists who followed a standardized protocol.
Knee Pain Intensity. An 11-point visual numeric pain scale was used to measure knee pain intensity, with 0 indicating ‘no pain’ and 10 indicating ‘worst pain ever experienced’. Two pain ratings – at rest and during leg movement in the past 24 hours – were obtained and a composite average was calculated. The visual numeric pain scale has been shown to be a reliable and valid measure of pain in patients with osteoarthritis.
Knee Range-of-Motion (ROM). A Lafayette Gollehon extendable goniometer was used to measure passive knee flexion and extension ROM. Knee flexion ROM was measured with the patients in supine position. With the assistance of a belt, patients were asked to slide their heels toward the buttocks and to flex their knees maximally. Knee extension ROM was measured with the patients in supine position with the heel elevated on a firm wedge. Two sets of flexion and extension ROM measurements were taken, and the higher ROM measurement was recorded. For the knee ROM measurements, one previous study in patients with knee osteoarthritis has demonstrated good test–retest reliability (intraclass correlation coefficients, 0.95 and 0.85 for flexion and extension ROM, respectively).
Active Knee Lag. A Lafayette Gollehon extendable goniometer was used to measure active knee (quadriceps) lag with the patients in supine position with the heel elevated on a firm wedge. Patients were asked perform a straight-leg-raise maneuver which consisted in straightening the operated knee ‘as far as possible’ and lifting the heel ~10cm off the wedge. In this position, knee extension ROM was measured and subtracted by the passive knee extension ROM to represent active knee lag. All patients performed 2 straight-leg-raise maneuvers with a 30-second rest interval, and the smaller active knee lag measurement was recorded.
Standing Balance. Standing balance was assessed using the WBB and testing was conducted in the ward gymnasium or in the patient’s cubicle. To perform the test, patients stood unsupported and barefooted on the WBB in their usual comfortable stance and they were instructed to stand quietly. All patients performed two 30-second trials with a one-minute rest interval, and the mean of 2 trials was taken. The WBB was interfaced with a laptop computer using custom-written software (Labview 8.5 National Instruments), and CoP coordinates were recorded at 40 Hz and low-pass filtered at 6.25Hz. Given the myriad of CoP measures that can be extracted from a standing balance test, to avoid spurious (Type I) errors and model overfitting, we a priori focused on one measure – the variability or standard deviation (SD) of the CoP around its mean position in the mediolateral axis (ML-SD). Conventionally, higher CoP ML-SD values indicate greater postural sway and hence, poorer balance control. We chose the ML-SD measure primarily because biomechanical studies in older adults showed that walking aids increased ML base-of-support and contributed significantly to frontal (ML) plane standing balance.[14,15]. Furthermore, a recent study in patients with knee osteoarthritis has demonstrated good absolute reliability (standard error of measurement, 9%) and moderate relative (test-retest) reliability (intraclass correlation coefficient, 0.60) for the ML-SD measures .
In our study, the outcome measure was the type of walking aids prescribed by one of two principal physiotherapists with a combined experience of over 20 years in orthopedic and sports physiotherapy. Specifically, the type of walking aids was an ordinal variable with 4 categories – namely, walking stick, narrow- and broad-base quadstick, and walking frame (in ascending order of base-of-support provided by the device). To mimic clinical practice, the two physiotherapists were permitted to perform any clinical tests; however, they were masked to the WBB results.
We used descriptive statistics to characterize the study sample: we used means with SDs for continuous variables and frequencies with percentages for categorical variables. We used the transcan function developed by Harrell[17,18] to singly impute missing predictor values in our sample (<3%).
To develop the prediction model for the type of walking aids prescribed – an ordinal outcome with 4 categories – we used a proportional odds regression model which comprised 8 a priori predictors listed in Table 1. We confirmed the proportional odds assumption graphically and by logistic regression. As we based our variable selection on prior data/studies, all variables were included in the model without variable selection but we performed a redundancy analysis on the predictors to identify collinear variables. To avoid assuming linearity, continuous measures were modeled as restricted cubic splines unless there was weak evidence against linearity (P-value>0.20). Because we used data from a treatment study, treatment assignment variable and its interaction with the predictors were also included in the model. As the Wald joint test for treatment and its interaction terms gave non-significant results, we removed these terms from the final model. Because our sample size was modest, to account for model overfitting, we estimated the odds ratios (ORs) in the multivariable model using penalized maximum likelihood methods. Given that our predictors were measured on different scales, we calculated IQR-ORs to allow valid comparisons between predictors. Specifically, IQR-ORs compared the odds of requiring walking aids with a larger base-of-support between the 75th and 25th percentile levels of the predictors. To facilitate results interpretation, we developed an Excel spreadsheet which gave predicted probabilities for each type of walking aid (S1 Spreadsheet).
We assessed model performance in 2 ways. First, model discrimination was measured by the concordance index (c-index), where a value of 1 represents perfect discrimination and 0.5 represents no discrimination (‘coin flip’). Because a prediction model is expected to perform better (optimistically) in the original derivation sample than in new but similar samples, we used a bootstrap internal validation technique to correct (shrink) the c-index for “optimism”. Second, model calibration was assessed using a loess-smoothed calibration plot.
We quantified the predictive performance of CoP ML-SD using the model likelihood ratio χ2 statistic and we expressed this value as a fraction of the total likelihood ratio χ2 the full model: the larger this fraction, the more contribution from ML-SD to the prognostic information of the full model . To statistically assess the amount of incremental prognostic information contributed by CoP ML-SD, we compared nested models with and without CoP ML-SD using a likelihood ratio test. To further provide a clinical view of its incremental predictive value, we separated patients who were prescribed a walking stick or narrow-base quadstick from those who were prescribed a broad-base quadstick or walking frame, and we calculated the continuous net reclassification improvement (NRI>0) statistic.[21,22] All statistical analyses were done with R, version 3.0.1, using the rms package.
Table 1 shows patients’ characteristics. The patients were predominantly female (82%) and were on average moderately overweight. Amongst our 89 patients, 52 (58%) were evaluated as requiring a walking stick; 17 (20%), narrow-base quadstick; 19 (22%), broad-base quadstick; and 19 (22%), walking frame. Table 2 shows the results of multivariable proportional odds model based on 8 a priori specified predictors. No redundant variables were identified. Three of 8 predictors were statistically significant: women (P = 0.04), those with higher BMI (P<0.01) and greater CoP ML-SD (P<0.001) were more likely to require a larger walking aid. Knee ROM and active knee lag measures nearly met nominal levels of statistical significance (P-values, 0.06 to 0.11).
Fig. 1 shows the screenshot of a spreadsheet (provided as S1 Spreadsheet) which allows the user to calculate for individual patients, the predicted probabilities for each type of walking aid. The optimism-corrected c-index of the prediction model was 0.74, indicating moderately good discrimination. Fig. 2 shows the calibration plot, with the light dotted and solid lines representing the calibration accuracy of the original and (optimism-corrected) bootstrap models, respectively. The 2 lines were relatively close to the dashed line of unity, indicating moderately good calibration.
Perfect calibration accuracy is represented by the “ideal” line of unity. Locally weighted scatterplot smoothing is used to model the relationship between observed and predicted probabilities. The distribution of the predicted probabilities is shown as small vertical lines at the top of the graph.
Fig. 3 shows the predictive value of models comprising CoP ML-SD or conventional measures (demographic and knee variables), or both. The model comprising only ML-SD had nearly half (44%) the explanatory power of the full model. Put otherwise, 44% of the prognostic information of the full model (comprising demographic, knee, and ML-SD variables) may be attributed to ML-SD. Using the likelihood ratio χ2 test for nested models, ML-SD added statistically significant incremental predictive value (P<0.001) to a model comprising conventional demographic and knee variables. The NRI>0 associated with the addition of the ML-SD measure was 0.60 (95%CI, 0.19 to 1.01) – a large effect size with a net gain of 38%(12/32; 95%CI, 5 to 70%) in patients who required walking aids with a large base-of-support (broad-base quadstick or walking frame) and 22%(13/57; 95%CI, −2 to 48%) net gain in patients who required walking aids with a small base-of-support (narrow-base quadstick or walking stick).
The predictive value is represented by the likelihood ratio χ2 statistic. The model comprising CoP ML-SD alone had 44% of the explanatory power of the full model. Put otherwise, nearly half the prognostic information of the full model (comprising conventional and ML-SD variables) may be attributed to ML-SD. Furthermore, ML-SD added statistically significant predictive information (P<0.001) to a model that comprised only conventional measures.
In our sample of 89 patients with a recent TKA, we developed a model to predict the type of walking aids prescribed for these patients. We found 3 significant predictors: BMI, sex, and standing balance, indexed by CoP ML-SD (Table 2). We also demonstrated that the incremental predictive value of ML-SD beyond conventional predictors was clinically important.
Reviewing the literature, Van der Esch et al reported on 187 older adults with lower limb osteoarthritis and found that functional disability was strongly associated with the possession of walking aids in these patients. Another cross-sectional study by Watson et al on 31 low-care residential older adults showed that the Berg Balance Test – a clinical balance test – was associated with the type of walking aids used. Given that significant or nearly-significant predictors in our prediction model – namely, standing balance, BMI, sex, knee range-of-motion, and knee strength – were correlates of activity limitations in people with TKA,[10,11] our findings corroborated prior studies and provided some confidence for the applicability of the prediction model.
In our prediction model CoP ML-SD was a stronger predictor than conventional knee impairment variables and it had nearly half (44%) the explanatory power of the full model. Importantly, ML-SD more accurately classified patients who required larger base-of-support walking aid to a higher risk group (38% sensitivity gain). Our findings that balance performance was a crucial consideration when prescribing walking aids agree with those by Watson et al. However, their study was based on the Berg Balance Test whereas ours used the WBB. Just 3 or 4 days after a TKA, patients may be unable or unwilling to complete the full battery of 14 Berg Balance Test items and this limitation could potentially create a floor effect. In contrast, all our patients completed two 30-second standing trials on the WBB with no falls or other safety issues, thereby supporting the time-efficiency and feasibility of WBB testing in patients with substantial mobility limitations.
Cost-effectiveness and practicality are additional aspects of the evaluation of new devices. Although the WBB is substantially cheaper than a laboratory force plate, it is not cost-free. Also, healthcare professionals who are facile with movement analysis may feel confident prescribing walking aids without needing information from a WBB. To take a broader perspective, however, the literature identifies a range of healthcare professionals who are involved in prescribing walking aids for older adults, in whom expertise in balance assessment may vary considerably.[26–28] Thus, future studies should evaluate the financial and clinical costs of performing versus not performing WBB testing across different health settings and healthcare professionals. Also of interest, future inter-disciplinary studies could evaluate whether the pedagogical use of the WBB deepens one’s understanding of balance and fall risk assessment.
Our study has limitations. First, our sample size was small which limited our ability to externally validate our model. Accordingly, our prediction model should be viewed as preliminary and requiring further validation and perhaps refinement. Second, although our model showed moderately-good discrimination (c-index was 0.74), we acknowledge that a prediction model that incorporates additional variables – for example, fear of falling, home environmental factors, and patients’ preferences – may yield even greater discriminative ability. Third, our findings may not be easily generalizable because we studied only patients with TKA. Future testing is needed to evaluate the added value of WBB information when prescribing walking aids for other high-risk clinical populations. Fourth, we allowed the patients to self-select their stance width, and this may have influenced the results of our study due to the known associations between stance width and CoP variables . However, we specifically chose to test patients in comfortable stance for a number of reasons including ensuring that the position was pain free, easing the implementation and interpretation of the test and enhancing the ecological validity of the findings of the study by replicating a normal activity of daily living.
In conclusion, we provide proof-of-concept that it is possible to obtain objective quantitative measures of standing balance in an inpatient ward setting. More important, our findings suggest that postural sway information from the WBB may help healthcare professionals to more accurately determine standing balance which, in turn, assist in walking aids selection and ultimately prevent falls and related injuries. At a time when existing falls prediction tools have less-than-ideal predictive accuracy in the inpatient setting, our study potentially has important implications for accurate balance assessment in hospitals which contributes to more appropriate prescription of walking aids and prevention of falls.
We thank Amanda Lee, Jia-Jie Tan, Wei-Xiang Er, Jia-Ying Ho, and Felicia Seet for their research assistance. We acknowledge the support from Bee-Yee Tan and the orthopaedic surgeons, Singapore General Hospital. Finally, we thank Dr. Maarten J.G. Leening for his helpful comments on this manuscript.
Conceived and designed the experiments: YHP RC PHO. Performed the experiments: YHP PHO. Analyzed the data: YHP RC. Contributed reagents/materials/analysis tools: RC. Wrote the paper: YHP RC PHO.
- 1. Hochberg MC, Altman RD, April KT, Benkhalti M, Guyatt G, et al. (2012) American College of Rheumatology 2012 recommendations for the use of nonpharmacologic and pharmacologic therapies in osteoarthritis of the hand, hip, and knee. Arthritis Care Res (Hoboken) 64: 465–474. pmid:22563589
- 2. Kaye HS, Kang T, LaPlante MP (2000) Mobility device use in the United States: National Institute on Disability and Rehabilitation Research, US Department of Education. pmid:25506959
- 3. Charron PM, Kirby RL, MacLeod DA (1995) Epidemiology of walker-related injuries and deaths in the United States. Am J Phys Med Rehabil 74: 237–239. pmid:7779337
- 4. Stevens JA, Thomas K, Teh L, Greenspan AI (2009) Unintentional fall injuries associated with walkers and canes in older adults treated in U.S. emergency departments. J Am Geriatr Soc 57: 1464–1469. pmid:19555423
- 5. Bradley SM, Hernandez CR (2011) Geriatric assistive devices. Am Fam Physician 84: 405–411. pmid:21842786
- 6. Clark RA, Bryant AL, Pua YH, McCrory P, Bennell K, et al. (2010) Validity and reliability of the Nintendo Wii Balance Board for assessment of standing balance. Gait & Posture 31: 307–310. pmid:25571600
- 7. Holmes JD, Jenkins ME, Johnson AM, Hunt MA, Clark RA (2013) Validity of the Nintendo Wii(R) balance board for the assessment of standing balance in Parkinson’s disease. Clinical Rehabilitation 27: 361–366. pmid:22960241
- 8. Prieto-Alhambra D, Javaid MK, Maskell J, Judge A, Nevitt M, et al. (2011) Changes in hip fracture rate before and after total knee replacement due to osteoarthritis: a population-based cohort study. Annals of the Rheumatic Diseases 70: 134–138. pmid:20980287
- 9. Kearns RJ, O’Connor DP, Brinker MR (2008) Management of falls after total knee arthroplasty. Orthopedics 31: 225. pmid:19292250
- 10. Pua YH, Ong PH, Chong HC, Yeo W, Tan CI, et al. (2013) Associations of self-report physical function with knee strength and knee range-of-motion in total knee arthroplasty: Possible nonlinear and threshold effects. J Arthroplasty 28: 1521–1527. pmid:23523481
- 11. Fitzgerald JD, Orav EJ, Lee TH, Marcantonio ER, Poss R, et al. (2004) Patient quality of life during the 12 months following joint replacement surgery. Arthritis Rheum 51: 100–109. pmid:14872462
- 12. Ritter PL, Gonzalez VM, Laurent DD, Lorig KR (2006) Measurement of pain using the visual numeric scale. J Rheumatol 33: 574–580. pmid:16511926
- 13. Cibere J, Bellamy N, Thorne A, Esdaile JM, McGorm KJ, et al. (2004) Reliability of the knee examination in osteoarthritis: effect of standardization. Arthritis Rheum 50: 458–468. pmid:14872488
- 14. Bateni H, Maki BE (2005) Assistive devices for balance and mobility: benefits, demands, and adverse consequences. Arch Phys Med Rehabil 86: 134–145. pmid:15641004
- 15. Tung JY, Gage WH, Zabjek KF, Maki BE, McIlroy WE (2011) Frontal plane standing balance with an ambulation aid: Upper limb biomechanics. J Biomech 44: 1466–1470. pmid:21458816
- 16. Takacs J, Carpenter MG, Garland SJ, Hunt MA (2014) Test re-test reliability of centre of pressure measures during standing balance in individuals with knee osteoarthritis. Gait Posture 40: 270–273. pmid:24746407
- 17. Harrell FE Jr (2001) Regression modeling strategies: with applications to linear models, logistic regression, and survival analysis. New York: Springer. pmid:25506954
- 18. Harrell FE Jr (2013) rms: Regression Modeling Strategies. R package version 4.0-0. http://CRAN.R-project.org/package=rms.
- 19. Harrell FE Jr, Lee KL, Mark DB (1996) Multivariable prognostic models: issues in developing models, evaluating assumptions and adequacy, and measuring and reducing errors. Stat Med 15: 361–387. pmid:8668867
- 20. Moons KGM, Donders AR, Steyerberg EW, Harrell FE (2004) Penalized maximum likelihood estimation to directly adjust diagnostic and prognostic prediction models for overoptimism: a clinical example. Journal of Clinical Epidemiology 57: 1262–1270. pmid:15617952
- 21. Pencina MJ, D’Agostino RB Sr, Steyerberg EW (2011) Extensions of net reclassification improvement calculations to measure usefulness of new biomarkers. Stat Med 30: 11–21. pmid:21204120
- 22. Leening MJG, Vedder MM, Witteman JCM, Pencina MJ, Steyerberg EW (2014) Net reclassification improvement: computation, interpretation, and controversies: A literature review and clinician’s guide. Ann Intern Med 160: 122–131. pmid:24592497
- 23. Pencina MJ, D’Agostino RB, Pencina KM, Janssens AC, Greenland P (2012) Interpreting incremental value of markers added to risk prediction models. Am J Epidemiol 176: 473–481. pmid:22875755
- 24. Van der Esch M, Heijmans M, Dekker J (2003) Factors contributing to possession and use of walking aids among persons with rheumatoid arthritis and osteoarthritis. Arthritis Rheum 49: 838–842. pmid:14673971
- 25. Watson SC, Chipchase LS, Mackintosh S (2004) Balance, fear of falling, pain and gait aid use by low care older people: pilot study. Australasian Journal on Ageing 23: 77–81.
- 26. O’Hare MP, Pryde SJ, Gracey JH (2013) A systematic review of the evidence for the provision of walking frames for older people. Physical Therapy Reviews 18: 11–23.
- 27. Simpson C, Pirrie L (1991) Walking aids: a survey of suitability and supply. Physiotherapy 77: 231–234.
- 28. Brooks LL, Wertsch JJ, Duthie EH Jr (1994) Use of devices for mobility by the elderly. Wisconsin Medical Journal 93: 16. pmid:8160480
- 29. Chiari L, Rocchi L, Cappello A (2002) Stabilometric parameters are affected by anthropometry and foot placement. Clinical Biomechanics 17: 666–677. pmid:12446163
- 30. Oliver D (2008) Falls risk-prediction tools for hospital inpatients. Time to put them to bed? Age and Ageing 37: 248–250. pmid:18456789