Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Feasibility, reliability and validity of self-measurement of knee range-of-motion using an accelerometer-based smartphone application by patients with total knee arthroplasty

  • Eleanor Shuxian Chew ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    eleanor.chew.s.x@sgh.com.sg

    Affiliation Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore

  • Ee-Lin Woon,

    Roles Data curation, Investigation, Methodology, Project administration, Supervision, Validation, Writing – review & editing

    Affiliation Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore

  • Juanita Krysten Miao-Shi Low,

    Roles Investigation, Methodology, Project administration, Writing – original draft

    Affiliation Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore

  • Luke Jonathan Haseler,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation School of Allied Health Care, Curtin University, Perth, Australia

  • Ismahfaris Ismail,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation School of Computing, National University of Singapore, Singapore, Singapore

  • Muhammad Bukhari Alif,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation School of Computing, National University of Singapore, Singapore, Singapore

  • Yu-Heng Kwan,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Programme in Health Services and System Research, Duke-NUS Medical School, Singapore, Singapore

  • John Wei-Ming Tan,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore

  • Samantha Shi-Man Koh,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore

  • Hee-Nee Pang,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Orthopedic Surgery, Singapore General Hospital, Singapore, Singapore

  • Jerry Delphi Yongqiang Chen,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Orthopedic Surgery, Singapore General Hospital, Singapore, Singapore

  • Seng-Jin Yeo,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Orthopedic Surgery, Singapore General Hospital, Singapore, Singapore

  • Shi-Ying Lim,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation School of Computing, National University of Singapore, Singapore, Singapore

  • Celia Ia-Choo Tan,

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – review & editing

    Affiliations Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore, School of Allied Health Care, Curtin University, Perth, Australia

  • Yong-Hao Pua

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Supervision, Validation, Writing – review & editing

    Affiliations Department of Physiotherapy, Singapore General Hospital, Singapore, Singapore, Medicine Academic Programme, Duke-NUS Graduate Medical School, Singapore, Singapore

Abstract

Aims

Limited knee range-of-motion (ROM) is common following total knee arthroplasty (TKA). It is associated with functional limitations and patient dissatisfaction. Regular knee ROM assessment is important but accurate testing traditionally requires timely access to trained healthcare professionals. Although accelerometer-based smartphone goniometry has shown to provide reliable and valid joint angles, current evidence of its use still positions healthcare providers as end users instead of patients themselves. Therefore, to maximize the impact of smartphone goniometry on post-TKA care, our study aimed to examine the feasibility, reliability, and validity of patients’ self-measurement of knee ROM using an accelerometer-based smartphone goniometry application.

Methods

Patients were given standard instructions with a practice trial before the actual measurements. Passive knee flexion and extension ROM was measured on 2 sessions in 30 patients with TKA using 4 block-randomized methods: (i) smartphone self-assessment, (ii) long-arm goniometry by physiotherapist, (iii) smartphone assessment by physiotherapist, and (iv) extendable-arm goniometry by physiotherapist with placement adjudication. Feasibility was assessed by the number of participants who could independently perform the self-measurement. To assess intra- and inter-session reliability, we computed intraclass correlation coefficients (ICCs) from random-effects models. To assess intra- and inter-session agreement, we computed mean absolute differences (MADs) and minimum detectable change (MDC). To assess concurrent validity, we designated extendable-arm goniometry as the "gold standard" and compared other methods against it using ICCs and MADs.

Results

All patients were able to comprehend and execute the assessment. 87% (n = 26) found the application easy to administer. Smartphone goniometry by patients showed excellent intra- and inter-session reliability (ICCs>0.97) and minimum variability (MAD = 0.9°-3.9°; MDC95 = 3.1°–9.0°). Smartphone or long-arm goniometry by physiotherapists did not outperform patients’ self-assessment (ICC = 0.96–0.99, MAD = 0.7°-3.1°; MDC95 = 2.2°-8.0°). Compared against extendable-arm goniometry, smartphone goniometry by patients measured knee flexion and extension ROM with a MAD of 4.5° (ICC, 0.97) and 2.2° (ICC = 0.98), respectively.

Conclusion

Our study demonstrates that smartphone goniometry is feasible, reliable and accurate, and can be used with confidence in the self-assessment of knee ROM post-TKA. Future studies should further explore its utility in telemonitored rehabilitation, and its possible integration into mobile health applications to enhance accessibility to care following TKA.

Introduction

Total knee arthroplasty (TKA) is a cost-effective surgical intervention for painful knee osteoarthritis in adults aged 65 years and over [1, 2]. However, limited knee range-of-motion (ROM) is common following a TKA. This is associated with functional limitations [35] and patient dissatisfaction [4, 5]. Accurate and regular knee ROM assessment is therefore important to inform recovery progress, identify at-risk patients [6], and guide rehabilitation decisions post-TKA.

Knee ROM is traditionally measured by trained professionals using the universal long-arm goniometer. Although the long-arm goniometer has demonstrated reasonable levels of reliability and validity in numerous studies to quantify knee ROM [7, 8], it requires a trained assessor to perform the measurement. This is manpower exhaustive. Furthermore, the demand for TKAs has been rapidly rising globally [911], and this is projected to increase by 673% from 2005 to 2030 in the United States [12]. This translates to an increased need for timely post-operative and rehabilitative care, further straining health systems. As such, there is an urgent need for a cost-effective and accurate assessment of knee ROM to reduce the dependence on healthcare resources without compromising on post-operative care and recovery following TKA.

Currently, developments in smartphone technology and software have provided smartphones the ability to measure joint ROM reliably [13]. Reliable and valid joint angles can be derived from the smartphone’s in-built accelerometer and trigonometric function [8, 1317]. This may circumvent the difficulties of manually identifying anatomical landmarks for knee ROM measurement with a long-arm goniometer, thus removing the need for a trained assessor. Despite these proposed benefits of smartphone goniometry for self-assessment of joint ROM, current evidence of its use still positions healthcare providers as end users [8, 1317]. No studies have evaluated the feasibility, reliability and validity as an assessor-free method, nor in patients more than 2 weeks post-TKA [13] where regular measurements are required [18].

Therefore, to maximize the impact of smartphone goniometry on post-TKA care, our study aimed to examine the feasibility, reliability and validity of patients’ self-measured knee ROM post-TKA using an accelerometer-based smartphone goniometry application.

Methods

Participants

A sample of 30 individuals aged 45 years or older who have had primary unilateral TKA in Singapore General Hospital within the last 16 weeks were consecutively recruited during their outpatient physiotherapy visit. Patients included in this study had to be able to provide informed consent and demonstrate the ability to hold and tap on the screen of a smartphone. Patients were excluded if they had cognitive dysfunction, communicable disease(s), or post-TKA complications. This study was approved by the SingHealth Centralised Institutional Review Board (CIRB) (CIRB Ref No: 2021/2479, Singapore) and patients provided written informed consent.

Instrumentation

Smartphone application.

The smartphone self-assessment utilises an accelerometer-based application that was developed in-house based on trigonometric functions that converts shank angle to knee joint angle. This technique, first described by Ockendon & Gilbert [15] can be created and applied to any smartphone device containing accelerometers. The application was installed on a Samsung Galaxy S10 android smartphone (Samsung; Seoul, South Korea). We included older-adults friendly features on the user interface such as larger buttons and fonts, text labelled icons to ensure ease of self-measurement for the user (Fig 1A1).

thumbnail
Fig 1. Standard instruments were used to compare the measurement of knee ROM.

Efforts to ensure blinding of the primary assessor to the ROM angle include (A) feature on the smartphone application to hide and unhide, (B) opaque sheet covering one side of the long-arm goniometer and (C) flipping of the extendable-arm goniometer.

https://doi.org/10.1371/journal.pone.0307219.g001

Long-arm goniometer.

We used a single plastic Baseline 12–1000 goniometer (Baseline Evaluation Instruments; New York, USA) with an 18inch movable arm and a 360° face for this study (Fig 1B1).

Extendable-arm goniometer.

For our reference method, a Lafayette Gollehon extendable-arm goniometer model 01135 (Lafayette Instrument; Indiana, USA) with chromium-plated brass arms of 20-70cm that allowed for 360° arm rotation was used (Fig 1C1).

Procedure

Four methods were evaluated: (i) smartphone self-assessment, (ii) long-arm goniometry by physiotherapist, (iii) smartphone assessment by physiotherapist, and (iv) extendable-arm goniometry by physiotherapist with placement adjudication (reference criterion).

For all patients, passive knee flexion ROM was measured before passive knee extension ROM (knee “position”). For knee flexion ROM, in long-seating, patients were asked to bring their leg to maximal knee flexion with their arms. For knee extension ROM, in long-seating, a patient’s leg was propped with a towel roll placed under the heel to ensure the soft tissues of the thigh and calf were clear off the plinth and the knee was fully extended. To ensure that patient’s hamstring would not limit patient’s ability to reach forward for self-measurement, the opposite leg was allowed to bent off the side of the plinth.

For each knee ROM position (flexion or extension ROM), method (i) was always done first to assess the patient’s ability to perform the test independently without reminder. Methods (ii) and (iii) were block randomized to remove any potential order effects. Method (iv) was done last. For each method and knee ROM position, 2 measurements were obtained. Following the collection of one round ("session") of flexion and extension ROM assessment, each patient performed another round ("session") of ROM assessment. Pain levels were monitored throughout the entire session to ensure they remain fairly constant.

Two physiotherapists who are familiar with the management of TKA were involved in the data collection as assessors: the primary assessor performed measurements for all patients and the secondary assessor performed data scribing. To minimize bias, efforts to ensure that assessors were blinded for each method are described in subsequent sections.

Method (i)—Smartphone self-assessment.

Patients were given standard instructions on how to perform the self-assessment using the smartphone application and then asked to repeat once under the supervision and guidance of a physiotherapist before the actual measurement. In maximal knee flexion and extension, the edge of the smartphone was placed against the patient’s skin parallel to and over the middle aspect of the tibia before tapping on the button on the screen to capture the angle (Fig 2). To ensure blinding of the patient, the smartphone application was modified for this study so that the angles do not appear during the ROM measurement (Fig 1A2). The secondary assessor would reveal the recorded measurement for data collection by selecting the ‘unhide’ option.

Feasibility was assessed in two ways: (a) by the number of patients who could independently perform the self-measurement and (b) by the patients’ self-ratings of perceived difficulty with independent home use on a simple 11-point Likert scale. A score of 0 means no “no difficulties”, and 10 means “extremely difficult”. Patients were invited to provide additional comments if they found the self-assessment difficult.

Method (ii)—Long-arm goniometry by physiotherapist.

The axis of the goniometer was centred on the lateral femoral epicondyle, with the proximal arm aligned with the greater trochanter and the distal arm aligned with the lateral malleolus [19]. To ensure blinding of the primary assessor, the side of the goniometer facing the assessor was covered with an opaque sheet (Fig 1B2). The secondary assessor recorded the reading taken from the other side of the goniometer.

Method (iii)—Smartphone assessment by physiotherapist.

The edge of the smartphone was placed against the patient’s skin, parallel to and over the middle aspect of the tibia by the physiotherapist, before the button on the screen was tapped to capture the knee ROM. The same blinding process described in method (i) was performed to obtain knee ROM measures (Fig 1A2).

Method (iv)—Extendable-arm goniometry by physiotherapist with placement adjudication.

Knee ROM was assessed using an extendable-arm goniometer with 2 trained assessors agreeing on the placement as ‘gold standard’. Landmarks for the long-arm and extendable-arm goniometer were as follows: fixed arm pointing to or over the greater trochanter of the femur axis at the lateral epicondyle of the femur and moving arm pointing toward or over the lateral malleolus of the fibula [19]. To ensure blinding of the 2 assessors, the extendable-arm goniometer was flipped such that the side of the goniometer with the measurement faced away during the assessment (Fig 1C2). After each measurement, the goniometer was passed to the secondary assessor who logged the measurement.

Sample size calculation

Using the ‘ICC.Sample.Size’ R package [20, 21], a minimum sample size of 26 participants was calculated to be required to test whether an anticipated reliability of 0.90 [7, 2224] for inter-session goniometry exceed a minimum acceptable reliability of 0.75, at 0.05 alpha level (1-tailed) and 80% power. To ensure adequate power, we recruited 30 participants.

Statistical analysis

Feasibility.

To assess the feasibility of smartphone goniometry, we calculated descriptive statistics for the number of patients who were unable to complete the test and their self-reported ratings.

Reliability and validity.

Intraclass correlation (ICC) for intra-rater (intra-rater reliability), inter-session (test-retest reliability) and inter-method (validity) agreement was calculated from 2-way random-effects models. Specifically, for intra-rater agreement, ICC was based on a random-effects model for single measurement. For inter-session and inter-method agreement, ICC [2,2] was based on a mean-rating, random-effects model of absolute agreement. Intra-rater, inter-session and inter-method variability was measured in 2 ways. First, we computed the mean absolute differences (MADs) [25] between (i) any 2 measurements (measured for each patient) obtained within the same session (intra-rater variability) (ii) any 2 measurements obtained on different (test and retest) sessions (inter-session variability) and (iii) any 2 (session-averaged) measurements obtained from different methods (inter-method variability). For all MADs, 95%CIs were estimated using a bootstrapping procedure with 1000 iterations. Second, we used the root means square error (rMSE) from the fitted random-effects models to compute the minimum detectable change (MDC95) by multiplying rMSE and 2.77 (MDC95 = 2.77 x rMSE). Specifically, the MDC95 represents the magnitude of the maximum expected variability (difference) between repeated observations expected in 95% of pairs observations that are obtained (i) within each session (intra-rater variability), (ii) between sessions (inter-session variability), and (iii) between methods (inter-method variability).

All analyses were done in R (http://www.r-project.org) using the psych [26] and lme4 [27] packages.

Results

A total of 30 TKA patients were studied, and their demographic and clinical characteristics are described in Table 1. All patients were able to ambulate without (human) assistance.

thumbnail
Table 1. Participant demographics and clinical characteristics.

https://doi.org/10.1371/journal.pone.0307219.t001

Feasibility

All patients were able to understand the instructions and self-administer the assessment independently. 87% (n = 26) indicated that it would be easy to use (8 or more) with none indicating that they would face difficulty to use (4 or less) smartphone goniometry at home.

Reliability

Smartphone goniometry by patients showed excellent intra-rater and inter-session reliability (ICCs>0.97) and minimum variability (MAD = 0.9°-3.9°; MDC95 = 3.1°–9.0°) (Table 2).

thumbnail
Table 2. Intra-rater, inter-session, and inter-method agreement.

https://doi.org/10.1371/journal.pone.0307219.t002

Validity

Physiotherapist assessment using smartphone or long-arm goniometry (inter-method agreement), did not outperform patient self-assessment (ICC = 0.96–0.99, MAD = 0.7°-3.1°; MDC95 = 2.2°-8.0°) (Table 2). Compared against extendable-arm goniometry, smartphone goniometry by patients measured knee flexion and extension ROM with a MAD of 4.5° (ICC, 0.97) and 2.2° (ICC = 0.98), respectively.

Discussion

Self-assessment of knee ROM using smartphone goniometry was feasible in patients post-TKA. Our study demonstrated excellent intra-rater reliability, inter-session reliability with acceptable validity when compared to extendable-arm goniometry with placement adjudication as ‘gold standard’. To our knowledge, this study represents the first effort to explore the utility of smartphone goniometry for patient self-assessment of knee ROM after TKA.

Feasibility

All patients were able to comprehend and execute the smartphone goniometry measurement according to the instructions provided.

Reliability

Our findings were similar to previous literature [8, 28] for intra-rater reliability (ICC = 0.97–0.98) of goniometer measurements for knee ROM of surgical orthopaedic patients. In our study, self-assessment using smartphone goniometry showed similar intra-rater reliability to measurements obtained by physiotherapists using smartphone goniometry, long-arm goniometer or an extendable-arm goniometer.

The smartphone application in our study utilised the most common method, first described by Ockendon & Gilbert [15]. Previously known as Knee Goniometer, studies that applied similar methods of smartphone goniometry as our study reported superior and excellent intra-rater reliability in healthy adults (ICC = 0.90–0.99) [1416]. Further exploring the intra-rater reliability of smartphone goniometry compared to standard goniometry in a clinical population, Pereira et al. [14] evaluated the application on patients immediately after unicompartmental knee arthroplasty and TKA. Similar to our study, intra-rater reliability was found to be good-to-excellent for passive knee flexion (ICC = 0.87) and extension (ICC = 0.87) ROM, despite reported limitations from compressive bandages that could potentially limit accurate measurement of postoperative knee ROM with either testing instrument [14]. However, authors in this study had only explored intra-rater reliability of application use within clinicians. Our study thus adds to the evidence that patients’ self-measurement of knee ROM post-TKA is possible with an accelerometer-based smartphone application.

Validity

Our findings for assessment done using a smartphone accelerometer-based application evaluating knee ROM by clinicians and therapists were consistent with previous studies [1317]. As expected, MAD and MDC95 were highest for self-measurement using smartphone goniometry, but the difference is unlikely to be clinically important, and therefore still adequately valid. Therefore, our findings extend previous study results to measurements performed by laypeople and to patients beyond the first 2 weeks after TKA surgery.

Limitations

Our study has limitations. Getting a gold standard is always a challenge. While radiographs are used as the reference standard in some studies, exposure of subjects to radiation for the purpose of assessing goniometry devices would be excessive. There are also issues associated with interpreting results measuring joint angles from a radiograph due to the angle of the camera relative to the subject [29]. All the previous studies done to evaluate knee smartphone goniometry have therefore used long-arm goniometers as the reference standard for validation of different goniometers [13]. We have therefore devised an alternative referenced measure and would be the first to compare smartphone goniometry against extendable-arm goniometry with placement adjudication by a second assessor as gold standard. We have also included blinding to ensure rigour in our analysis to ensure confidence in our criterion instrument and our validation study. Second, extreme ROM measures of knee flexion (maximum of 145°) and extension (maximum of 0°) [15] was not possible on a smartphone. However, as patients in our study were examined in the early stages of recovery post-TKA, it was unlikely that knee ROM would breach the defined measurement limits. Third, results cannot be generalized to smartphone goniometry of the knee in non-clinical environments as only one smartphone model was used in our study. As previous studies have shown that accelerometer-based goniometry across different makes of smartphones were unlikely to affect testing accuracy [1316], the limitation in testing environment can be overcome with the provision of clear instructions to replicate the assessment procedure. Lastly, inter-session reliability was obtained with measurement sessions performed on the same visit, differing from conventional test-retest reliability methods. As our study population was expected to present with different knee ROM measurements on separate visits [18], it was not feasible for the sessional ROM measurements to be obtained this way, especially when the study’s focus was on the patients’ ability to repeat the self-measurement.

Clinical implication

Our study carries significant implications for clinical practice. By demonstrating the interchangeability of smartphone goniometry between clinicians and patients, our findings suggest that patients can more frequently self-measure their knee ROM post-TKA. This capability not only empowers patients to actively engage in their recovery process but also provides clinicians with valuable data to monitor progress remotely [30].

Beyond providing feedback to patients about their post-surgical progress, regular ROM assessment potentially fosters motivation [31] during rehabilitation. Moreover, with the integration of tele-rehabilitation or video consultations facilitated by technological advancements, remote monitoring becomes feasible. Accurate measurement of knee ROM becomes paramount in supporting such innovative models of care, as changes in ROM can signify complications such as stiffness, joint contractures, or implant malposition. Early detection of these issues enables timely interventions [30], thereby optimizing clinical outcomes.

Conclusion

In conclusion, our study demonstrates that smartphone goniometry is feasible, reliable and accurate, and can be used with confidence in the self-assessment of knee ROM post-TKA. Future studies should further explore its utility in telemonitored rehabilitation, and its possible integration into existing mobile health applications to enhance accessibility to care following TKA.

Acknowledgments

We acknowledge the support from Jennifer Liaw, the head of the Department of Physiotherapy, Singapore General Hospital.

References

  1. 1. Kahlenberg CA, Nwachukwu BU, McLawhorn AS, Cross MB, Cornell CN, Padgett DE. Patient Satisfaction After Total Knee Replacement: A Systematic Review. HSS Journal. 2018;14(2):192–201. pmid:29983663
  2. 2. Neogi T. The Epidemiology and Impact of Pain in Osteoarthritis. Osteoarthritis Cartilage. 2014;21(9):1145–53.
  3. 3. Pua YH, Seah FJT, Clark RA, Lian-Li Poon C, Tan JWM, Chong HC. Factors associated with gait speed recovery after total knee arthroplasty: A longitudinal study. Semin Arthritis Rheum. 2017;46(5):544–51. pmid:27894727
  4. 4. Devers BN, Conditt MA, Jamieson ML, Driscoll MD, Noble PC, Parsley BS. Does Greater Knee Flexion Increase Patient Function and Satisfaction After Total Knee Arthroplasty? Journal of Arthroplasty. 2011;26(2):178–86. pmid:20413247
  5. 5. Ha CW, Park YB, Song YS, Kim JH, Park YG. Increased Range of Motion Is Important for Functional Outcome and Satisfaction After Total Knee Arthroplasty in Asian Patients. Journal of Arthroplasty. 2016;31(6):1199–203. pmid:26777578
  6. 6. Gandhi R, De Beer J, Leone J, Petruccelli D, Winemaker M, Adili A. Predictive risk factors for stiff knees in total knee arthroplasty. Journal of Arthroplasty. 2006;21(1):46–52. pmid:16446184
  7. 7. Brosseau L, Balmer S, Tousignant M, O’Sullivan JP, Goudreault C, Goudreault M, et al. Intra- and intertester reliability and criterion validity of the parallelogram and universal goniometers for measuring maximum active knee flexion and extension of patients with knee restrictions. Arch Phys Med Rehabil. 2001;82(3):396–402. pmid:11245764
  8. 8. Hancock GE, Hepworth T, Wembridge K. Accuracy and reliability of knee goniometry methods. J Exp Orthop. 2018;5(1). pmid:30341552
  9. 9. Lin FH, Chen HC, Lin C, Chiu YL, Lee HS, Chang H, et al. The increase in total knee replacement surgery in Taiwan A 15-year retrospective study. Medicine (United States). 2018;97(31). pmid:30075592
  10. 10. Hitzl W, Heisinger S, Hobusch GM, Frank K, Cotofana S. Projected numbers of primary total knee replacement in Austria from 2015–2075. Orthopade. 2019;48(2):144–9.
  11. 11. Ackerman IN, Bohensky MA, Zomer E, Tacey M, Gorelik A, Brand CA, et al. The projected burden of primary total knee and hip replacement for osteoarthritis in Australia to the year 2030. BMC Musculoskelet Disord. 2019;20(1):1–10.
  12. 12. Kurtz S, Ong K, Lau E, Mowat F, Halpern M. Projections of primary and revision hip and knee arthroplasty in the United States from 2005 to 2030. Journal of Bone and Joint Surgery—Series A. 2007;89(4):780–5. pmid:17403800
  13. 13. Keogh JWL, Cox A, Anderson S, Liew B, Olsen A, Schram B, et al. Reliability and validity of clinically accessible smartphone applications to measure joint range of motion: A systematic review. PLoS One. 2019;14(5):1–24. pmid:31067247
  14. 14. Pereira LC, Rwakabayiza S, Lécureux E, Jolles BM. Reliability of the Knee Smartphone-Application Goniometer in the Acute Orthopedic Setting. Journal of Knee Surgery. 2017;30(3):223–30. pmid:27218479
  15. 15. Ockendon M, Gilbert RE. Validation of a novel smartphone accelerometer-based knee goniometer. J Knee Surg. 2012;25(4):341–5. pmid:23150162
  16. 16. Milanese S, Gordon S, Buettner P, Flavell C, Ruston S, Coe D, et al. Reliability and concurrent validity of knee angle measurement: Smart phone app versus universal goniometer used by experienced and novice clinicians. Man Ther. 2014;19(6):569–74. pmid:24942491
  17. 17. Hambly K. Level of agreement between a novel smartphone application and a long arm goniometer for the assessment of maximum active knee flexion by an inexperienced tester Physical activity for people with antiphospholipid syndrome View project Translating Research. 2012;(January 2012).
  18. 18. Pua YH, Seah FJT, Poon CLL, Tan JWM, Clark RA, Liaw JSC, et al. Age- and sex-based recovery curves to track functional outcomes in older adults with total knee arthroplasty. Age Ageing. 2018;47(1):144–8. pmid:28985252
  19. 19. Norkin CC, White DJ. Measurement Of Joint Motion: A Guide To Goniometry. Fifth Edit. Davis F.A.; 2016. 591 p.
  20. 20. Rathbone A, Shaw S, Kumbhare D (2015). ICC.Sample.Size: Calculation of Sample Size and Power for ICC. R package version 1.0, <https://CRAN.R-project.org/package=ICC.Sample.Size>.
  21. 21. Zou GY. Sample size formulas for estimating intraclass correlation coefficients with precision and assurance. Stat Med. 2012;31(29):3972–81. pmid:22764084
  22. 22. Lenssen AF, Van Dam EM, Crijns YHF, Verhey M, Geesink RJT, Van Den Brandt PA, et al. Reproducibility of goniometric measurement of the knee in the in-hospital phase following total knee arthroplasty. BMC Musculoskelet Disord. 2007;8:1–7.
  23. 23. Rothstein JM, Miller PJ, Roettger RF. Goniometric reliability in a clinical setting. Elbow and knee measurements. Phys Ther. 1983;63(10):1611–5. pmid:6622536
  24. 24. Medina-Mirapeix F, Vivo-Fernández I, López-Cañizares J, García-Vidal JA, Benítez-Martínez JC, del Baño-Aledo ME. Five times sit-to-stand test in subjects with total knee replacement: Reliability and relationship with functional mobility tests. Gait Posture. 2018;59:258–60. pmid:29102855
  25. 25. Harrell FEJr. Regression Modeling Strategies: With Applications to Linear Models, Logistic and Ordinal Regression, and Survival Analysis. Springer; 2015.
  26. 26. William R. psych: Procedures for Personality and Psychological Research, Northwestern University, Evanston, Illinois, USA, https://CRAN.R-project.org/package=psychVersion=2.2.5. 2022;
  27. 27. Bates D, Mächler M, Bolker BM, Walker SC. Fitting linear mixed-effects models using lme4. J Stat Softw. 2015;67(1).
  28. 28. Youdas JW, Bogard CL, Suman VJ. Reliability of goniometric measurements and visual estimates of ankle joint active range of motion obtained in a clinical setting. Arch Phys Med Rehabil. 1993;74(10):1113–8. pmid:8215866
  29. 29. Gajdosik RL, Bohannon RW. Clinical Measurement of Range of Motion. Phys Ther. 1987;67(12):1867–72.
  30. 30. Oka T, Wada O, Asai T, Maruno H, Mizuno K. Importance of knee flexion range of motion during the acute phase after total knee arthroplasty. Phys Ther Res. 2020 Dec 20;23(2):143–8. pmid:33489651
  31. 31. Kuiken TA, Amir H, Scheidt RA. Computerized biofeedback knee goniometer: Acceptance and effect on exercise behavior in post-total knee arthroplasty rehabilitation. Arch Phys Med Rehabil. 2004;85(6):1026–30. pmid:15179662