Figures
Abstract
Background
Low back pain (LBP) is a highly prevalent condition that substantially impairs individuals’ physical functioning. This highlights the need for effective management strategies to improve patient outcomes. It is, therefore, crucial to have knowledge of physical functioning prognostic factors that can predict outcomes to facilitate the development of targeted treatment plans aiming to achieve better patient outcomes. There is no synthesis of evidence for physical functioning measures as prognostic factors in the LBP population. The objective of this systematic review is to synthesize evidence for physical measures of physical functioning as prognostic factors to predict outcomes in LBP.
Methods
The protocol is registered in the International Prospective Register of Systematic Reviews and reported in line with the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P). Prospective longitudinal observational studies investigating potential physical prognostic factors in LBP and/or low back-related leg pain population will be included, with no restriction on outcome. Searches will be performed in MEDLINE, EMBASE, Scopus, CINAHL databases, grey literature search using Open Grey System and ProQuest Dissertations and Theses, hand-searching journals, and reference lists of included studies. Two independent reviewers will evaluate the eligibility of studies, extract data, assess risk of bias and quality of evidence. Risk of bias will be assessed using the Quality in Prognostic Studies (QUIPS) tool. Adequacy of clinical, methodological, and statistical homogeneity among included studies will decide quantitative (meta-analysis) or qualitative analysis (narrative synthesis) focused on prognostic factors and strength of association with outcomes. Quality of cumulative evidence will be evaluated using a modified Grading of Recommendations Assessment, Development, and Evaluation (GRADE).
Citation: Rashed R, Kowalski K, Walton D, Niazigharemakhe A, Rushton A (2023) Physical measures of physical functioning as prognostic factors to predict outcomes in low back pain: Protocol for a systematic review. PLoS ONE 18(12): e0295761. https://doi.org/10.1371/journal.pone.0295761
Editor: Shabnam ShahAli, Iran University of Medical Sciences, ISLAMIC REPUBLIC OF IRAN
Received: July 28, 2023; Accepted: November 24, 2023; Published: December 11, 2023
Copyright: © 2023 Rashed et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data will be published in the paper.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Low back pain (LBP) has been a prevalent and persistent global health issue for the past three decades [1]. It continues to rank among the highest causes of Years Lived with Disability, contributing to a decline in functionality throughout the lifespan and imposing a substantial economic burden [1, 2]. Prognostic research enables early identification of people at risk for poor outcomes, facilitating informed decision-making for timely and targeted treatment interventions that aim to improve outcomes and reduce disability burden [3]. A prognostic factor refers to a measurement or characteristic that can predict subsequent health outcomes in the context of a particular health condition, aiding in understanding and anticipating the natural course of the condition [4]. It is, therefore, crucial to have knowledge of prognostic factors that can predict outcomes in LBP for effective management.
The Core Outcome Measures in Effectiveness Trials Initiative (COMET) defines physical functioning as the impact of a disease or condition on physical activities of daily living, such as walking, self-care, performance status and disability index [5]. Physical functioning is a multifaceted construct that encompasses various interconnected dimensions. These dimensions include body structure and function, performance of physical activities, social and role functioning [6]. These dimensions interact and influence each other, forming a comprehensive picture of a person’s physical functioning. Limitations in one dimension may impact another, resulting in an increased risk of disability and decreased quality of life [7, 8].
Assessment of physical functioning can be categorized based on recommendations from the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT), evaluating structure or function of a specific body part or system (e.g., muscle endurance, range of motion) [9], evaluating performance on a defined task in a standardized environment (e.g., 6 min walk test) [10], and evaluating activity in an individual’s natural environment (e.g., accelerometery) [9, 10]. Measures of physical functioning offer valuable insight into the broader impact of adverse health conditions on a person’s quality of life, which is a significant concern for the affected individuals [7, 11]. The core outcome set to measure the effectiveness of interventions for LBP also recommends physical functioning as an outcome domain that should be reported in all clinical trials [7]. Physical functioning has been assessed using both patient-reported outcome measures (PROMs) [9] and physical outcome measures [12] such as performance-based outcome measures [13] or clinician-administered outcome measures [14] which offer complementary yet distinct information [15]. PROMs offer insights into patients’ perceived functional well-being [16], their usefulness can be limited by susceptibility to biases arising from patients’ beliefs about their performance or abilities [14], as well as contextual and psychosocial factors such as pain and emotional state [17]. Physical outcome measures can provide more detailed information about specific aspects of physical functioning, such as walking speed and muscle strength [18]. Owing to the emergence of physical functioning assessment as a key component of multidimensional evaluation during the last two decades [19], several physical measures of physical functioning as prognostic factors have been identified, and are increasingly being adopted in clinical and research settings [20].
Previous systematic reviews examining prognostic factors in LBP have considered a range of factors, encompassing personal, modifiable, unmodifiable, physical (such as X-ray findings), psychological, and work-related factors [15, 16]. However, a notable gap in the existing literature is the investigation of physical measures of physical functioning as prognostic factors for LBP outcomes. Two systematic reviews to date have included physical measures of physical functioning as prognostic factors in LBP. Hartvigsen et al focused on clinical tests as prognostic factors and reported inconsistent evidence [21]. However, this review was limited to low-tech clinical tests only. The level of confidence in the results of this review was not high due to lack of reporting clarity and methodological shortcomings in several included papers. Consequently, the overall assessment score indicated low-quality based on AMSTAR-2 criteria. Verkerk et al. explored several prognostic factors; however, they inadequately addressed and did not comprehensively cover physical measures of physical functioning. This review focused solely on muscle endurance, strength, and aerobic capacity within the category of physical functioning [22]. The review possesses methodological shortcomings (lacking sufficient details on selection criteria, exhibiting low methodological quality of included studies, and lacking to report on the strength of associations between prognostic factors and outcomes) with a low-quality assessment score (AMSTAR-2 criteria).
This limited investigation of physical measures of physical functioning represents a significant gap in understanding their role as prognostic factors in LBP. Therefore, further research is warranted to comprehensively evaluate physical measures of physical functioning predicting outcomes in LBP. This is of particular importance considering the growing field of prognostic research [23] and increasing significance of using physical measures for physical functioning [24].
Material and methods
Design
This protocol for a systematic review is designed using the Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 statement [25] and Cochrane handbook [26]. The protocol is registered in PROSPERO (Registration No. CRD42023406796) on 12 April 2023 and any amendments will be reported.
Eligibility criteria
Inclusion criteria.
Population. Participants aged 18 years and above with LBP and / or low back-related leg pain.
Potential physical prognostic factors. All physical measures of physical functioning that have been investigated as predictors of outcomes, and are practically feasible in terms of time, space, training, safety and cost to perform in hospital or community- based clinic (e.g., Timed up and go, 6 min walk test, accelerometery) will be included. Physical measures of physical functioning will be categorized as the following:
- Impairment based physical measures, evaluating structure or function of a specific body part or system (e.g., range of motion) [9].
- Performance-based measures, evaluating performance on a defined task in standardized environment (e.g., 6 min walk test) [10].
- Physical measures of activity in natural environment/real-world, evaluating activity in natural environment (e.g., accelerometery) [10].
Outcomes. Any outcome predicted by physical measures of physical functioning (intentional broad definition of outcome following scoping search that identified a limited number of studies).
Timing and setting. Any time point for outcome assessment.
Study design. Prospective longitudinal observational studies, as they are considered the gold standard for prognostic research enabling optimal measurement of outcomes [27].
Exclusion criteria.
Any study that includes LBP related to malignancy, fracture, infection, cauda equina, rheumatoid arthritis, and ankylosing spondylitis will be excluded. Studies published in any language except English will be excluded. Physical measures such as imaging, electrophysiological measures (EMG), and motion capture gait analysis utilizing force plates and three-dimensional video analysis will not be included.
Information sources
A comprehensive search will be performed in electronic databases from inception to June 30, 2023 on MEDLINE, EMBASE, CINAHL, and Scopus. The grey literature will be searched using Open Grey System and ProQuest Dissertations and Theses. Hand searches of key journals (Spine, European Spine Journal, The Spine Journal) and screening reference list of included studies will also be performed.
Search strategy
The search strategy was developed in collaboration with a research librarian around the constructs of LBP, physical measures of physical functioning and prognostic factors. Search terms were informed by the National Institute for Health and Care Excellence guidelines for LBP and sciatica in over 16s [28], previous systematic reviews focused to physical measures of physical functioning [29] and a search filter developed by the Delphi panel for Ovid MEDLINE to identify prognostic factor studies [30]. The search was developed in MEDLINE and will be adapted for use in other databases. The MEDLINE search strategy is provided in S1 File.
Data management
The citations retrieved from searches will be imported and archived into Covidence, a web-based software platform designed for the purposes of conducting systematic reviews. The software will automatically detect any duplicate records and remove them accordingly. Following the initial screening of titles and abstracts, the full texts of relevant citations will be uploaded and securely stored within the Covidence platform. Eligibility screening, both at the title and abstract stage, as well as at the full-text stage, will be performed using the Covidence platform.
Study selection process
Two independent reviewers will perform eligibility assessments for the citations retrieved. During the initial screening phase, titles and abstracts will be evaluated based on predefined eligibility criteria. Full-texts of articles will be obtained for citations that meet the criteria agreed upon by both reviewers or for articles that lack sufficient information in the title and abstract to determine eligibility. In the subsequent phase, full-texts will be screened independently by the reviewers in duplicate to determine whether the articles meet the eligibility criteria. To ensure consistency in the assessment process, disagreements between the two reviewers will be resolved through discussions. If consensus cannot be reached, a third reviewer will be consulted to resolve the disagreement. The level of agreement between reviewers will be assessed using the Cohen’s kappa [31] in Covidence. A PRISMA flowchart will illustrate the selection of included and excluded studies and the reasons for exclusion as shown in the Fig 1 [32].
This diagram reflects the study selection process.
Data extraction process
Data will be extracted using a standardized data extraction form by Checklist for Critical Appraisal and Data Extraction for systematic review of prognostic factor studies (CHARMS-PF) [33]. This form for prognostic factors studies has been developed [34], by additions and modifications of the CHARMS checklist for primary studies of prediction models [35]. To ensure the reliability and feasibility of this modified form pilot testing will be performed. Two reviewers will independently extract data from selected studies and ambiguities or challenges in the form will be assessed. Any necessary modifications to the form will be made accordingly. Authors of included studies will be contacted a maximum three times via email in case of any missing data.
Data items
Data items will be extracted based on modified CHARMS-PF checklist [34]. Table 1. shows the items to be extracted from the included studies.
Outcomes and prioritization
As the scoping search identified limited studies and given the broad spectrum of outcome measures used with the LBP population, all outcome measures will be included. The measures can be either PROMs (e.g., ODI) or physical outcome measures (e.g., SLR). Based on the scoping search, a pre-defined outcome of interest and the use of one-time point is not possible owing to variability in the literature. Due to variability in follow-up assessment time points, outcomes will be categorized as short-term (<3 months), medium-term (>3 months, < 12 months), and long-term (>12 months).
Risk of bias in individual studies
To evaluate the risk of bias (RoB) in the studies included in the review, two independent reviewers will use the QUIPS tool [36], which is recommended by Cochrane for assessing the RoB in prognostic studies. The inter-rater reliability of QUIPS has been demonstrated to be good to acceptable, and previous studies have used QUIPS successfully in prognostic reviews [37, 38]. It consists of multiple prompting items categorized into six domains: study participation, study attrition, prognostic factor measurement, outcome measurement, study confounding, statistical analysis and reporting. Each domain is graded as low, moderate, or high risk of bias. An overall RoB score will be decided for each study based on the scores of all domains. If all six domains are rated as low RoB, or no more than one is rated as moderate ROB, the study will be categorized as low RoB. If one or more domains are rated as high RoB, or ≥ 3 domains are rated as moderate ROB, the study will be assessed as high RoB. All studies in between will be classified as having moderate ROB [39]. Any difference of opinion between the two reviewers will be discussed. If no consensus can be achieved, an impartial third reviewer will be consulted for their decision. Using Cohen’s kappa coefficient, the level of agreement between the two reviewers at each step will be evaluated [40].
Data synthesis
Data synthesis for each prognostic factor will be performed by pooling data quantitively (meta-analysis) or summarizing results qualitatively (narrative synthesis). Selection of data synthesis method will depend on heterogeneity across included studies. Determination of heterogeneity will be based on clinical, methodological and statistical heterogeneity [41]. Clinical heterogeneity will be assessed by variation in study population characteristics, coexisting conditions, outcomes, outcome measures, follow-up duration, and prognostic factors. Methodological heterogeneity will be based on RoB in included studies and statistical inconsistency will be determined by effect sizes and direction of effect by Cochrane test (significance level of 0.05) supplemented by the I2 statistic [30]. Absence of heterogeneity will be considered if I2 < 5% and/or Cochrane Q test is non-significant while I2 value less than 25% will be interpreted as low heterogeneity, between 25% and 50% as moderate and exceeding 50% as high heterogeneity [42].
Meta-analysis will be conducted in case of sufficiently homogeneous studies. As we are anticipating widely different methodologies, outcomes, prognostic factors, and unexplained heterogeneity across studies, a random effect approach will be used. This approach will provide a summary estimate of the average prognostic effect of index factor and the variability in effect across studies. The statistical data reported by the original sources will be extracted and evaluated in relation to established thresholds for statistical or clinical significance [43]. Considering the study design being included in this review, the extracted statistics are expected to include odd ratios, relative risks, hazard ratios, beta coefficients, or likelihood ratios, however any other relevant statistics will be extracted per the source author. In case of high heterogeneity (clinical, methodological and statistical heterogeneity) across studies a narrative synthesis will be conducted [38].
Results across studies will be presented in tabular form to compare different groups, including potential prognostic factors (impairment based, performance based and activity in natural environment), strength of association with different outcomes in relation to follow up time duration (short, medium or long term).
Meta-bias(es)
If protocols are identified within our searches, reporting bias will be evaluated through consistency of study protocols and published results.
Confidence in cumulative evidence
GRADE (Grading of Recommendations Assessment, Development, and Evaluation) will be used by two reviewers independently, to rate the quality of evidence (level of confidence) in overall findings, and further elaborating strength of effect across all findings for each prognostic factor per outcome. As advised for prognostic factor research a modified GRADE approach proposed by Huguet et al [44] will be used. The modified GRADE consists of six domains (phase of investigation, study limitations, inconsistency, indirectness, imprecision, publication bias) that determine quality of evidence. Quality can be rated as high, moderate, low, or very low depending on these domains.
All studies included in this review are prospective observational studies, hence the evidence will be of moderate quality as a starting point [38]. The quality of evidence in this review may be downgraded based on several factors. First, methodological limitations in individual studies assessed using the QUIPS tool will result in evidence being rated as having no serious limitation, serious limitation, or very serious limitation (Risk of Bias). Second, unexplained variability in results across studies (inconsistency), and third, evidence that does not directly apply to the population, setting, and outcome of interest (indirectness) will decrease the quality of evidence. Fourth, small sample sizes and wide confidence intervals around estimated effect sizes (imprecision) will downgrade evidence quality. Finally, selective reporting or publication bias will also decrease evidence quality [44]. Two factors that can increase the quality of evidence are a moderate or large effect size and an exposure-response gradient. A moderate effect size would be based on a standardized mean difference of around 0.5, while a large effect size would be around 0.8 or greater [44]. An exposure-response gradient would be demonstrated if higher levels of the prognostic factor led to a larger effect size. In these cases, the confidence in the quality of evidence will be upgraded. Furthermore, strength of effect determined by magnitude of effect estimates will suggest small, medium, large or inconsistent associations between prognostic factor and outcome across all studies. Summary of evidence will include level of confidence on cumulative evidence (high, moderate, low or very low) in strength of association (small, medium, large or inconsistent) of prognostic factors and outcomes across studies [44].
Patient and public involvement
Patient involvement has informed this protocol through discussion of the planned systematic review with the spinal pain research Patient Partner Advisory Group at the School of Physical Therapy, Western University. Further discussion will inform interpretation of results from the patients’ perceptive and stimulate future research initiatives.
Discussion
This will be a comprehensive and low RoB systematic review providing a summary of evidence for physical measures of physical functioning as prognostic factors for outcomes in the LBP population. This review will address important gaps in the literature, since there are several physical measures of physical functioning that are used in clinical practice in LBP management [45], but knowledge of their association with outcomes is lacking. Aligned with the importance of physical outcome measures in recently updated physical therapy clinical practice guideline for LBP management [46], this review will identify the prognostic value of using these factors in clinical practice for prediction. Knowledge of prognostic factors will benefit the healthcare practitioners, providing valuable insight for decision-making towards patient care and prioritizing appropriate treatment strategies [47]. Healthcare practitioners can use a risk stratification approach to identify and categorize subgroups of patients with low back pain based on their likelihood of experiencing poor or good outcomes. This approach allows for early intervention, targeted allocation of healthcare resources and support to those at higher risk of poor outcomes, ultimately improving patient outcomes and reducing the burden on the healthcare system. Moreover, providing evidence-based information to patients about the probability of developing various outcomes can positively impact the patients’ quality of life by managing their expectations for recovery [48]. Further research of physical prognostic factors of physical functioning may involve other regions of spine (e.g., neck and thoracic region).
Supporting information
S1 Checklist. PRISMA-P (Preferred Reporting Items for Systematic review and Meta-Analysis Protocols) 2015 checklist: Recommended items to address in a systematic review protocol*.
https://doi.org/10.1371/journal.pone.0295761.s001
(DOC)
S1 File. Search strategy.
This file shows MEDLINE search strategy.
https://doi.org/10.1371/journal.pone.0295761.s002
(PDF)
References
- 1. Wu A, March L, Zheng X, Huang J, Wang X, Zhao J, et al. Global low back pain prevalence and years lived with disability from 1990 to 2017: estimates from the Global Burden of Disease Study 2017. Annals of translational medicine. 2020;8(6). pmid:32355743
- 2. Cieza A, Causey K, Kamenov K, Hanson SW, Chatterji S, Vos T. Global estimates of the need for rehabilitation based on the Global Burden of Disease study 2019: a systematic analysis for the Global Burden of Disease Study 2019. The Lancet. 2020;396(10267):2006–17. pmid:33275908
- 3. Geurts JW, Willems PC, Kallewaard J-W, van Kleef M, Dirksen C. The impact of chronic discogenic low back pain: costs and patients’ burden. Pain research & management. 2018;2018. pmid:30364097
- 4. Riley RD, Hayden JA, Steyerberg EW, Moons KG, Abrams K, Kyzas PA, et al. Prognosis Research Strategy (PROGRESS) 2: prognostic factor research. PLoS medicine. 2013;10(2):e1001380. pmid:23393429
- 5. Dodd S, Clarke M, Becker L, Mavergames C, Fish R, Williamson PR. A taxonomy has been developed for outcomes in medical research to help improve knowledge discovery. Journal of clinical epidemiology. 2018;96:84–92. pmid:29288712
- 6. Jette AM. Toward a common language for function, disability, and health. Physical therapy. 2006;86(5):726–34. pmid:16649895
- 7. Chiarotto A, Deyo RA, Terwee CB, Boers M, Buchbinder R, Corbin TP, et al. Core outcome domains for clinical trials in non-specific low back pain. European Spine Journal. 2015;24:1127–42. pmid:25841358
- 8. Tomey KM, Sowers MR. Assessment of physical functioning: a conceptual model encompassing environmental factors and individual compensation strategies. Physical therapy. 2009;89(7):705–14. pmid:19443558
- 9. Reiman MP, Manske RC. The assessment of function: How is it measured? A clinical perspective. Journal of Manual & Manipulative Therapy. 2011;19(2):91–9.
- 10. Taylor AM, Phillips K, Patel KV, Turk DC, Dworkin RH, Beaton D, et al. Assessment of physical function and participation in chronic pain clinical trials: IMMPACT/OMERACT recommendations. Pain. 2016;157(9):1836. pmid:27058676
- 11. Turk DC, Dworkin RH, Revicki D, Harding G, Burke LB, Cella D, et al. Identifying important outcome domains for chronic pain clinical trials: an IMMPACT survey of people with pain. Pain®. 2008;137(2):276–85. pmid:17937976
- 12. Alamrani S, Rushton A, Gardner A, Falla D, Heneghan NR. Outcome measures evaluating physical functioning and their measurement properties in adolescent idiopathic scoliosis: a protocol for a systematic review. BMJ open. 2020;10(4):e034286. pmid:32241788
- 13. Alnattah M. Assessing Physical Function in Low Back Pain 2021.
- 14. Lee CE, Simmonds MJ, Novy DM, Jones S. Self-reports and clinician-measured physical function among patients with low back pain: a comparison. Archives of physical medicine and rehabilitation. 2001;82(2):227–31. pmid:11239315
- 15. Cook CE, Learman KE, O’halloran BJ, Showalter CR, Kabbaz VJ, Goode AP, et al. Which prognostic factors for low back pain are generic predictors of outcome across a range of recovery domains? Physical therapy. 2013;93(1):32–40. pmid:22879443
- 16. Boissoneault J, Mundt J, Robinson M, George SZ. Predicting low back pain outcomes: suggestions for future directions. journal of orthopaedic & sports physical therapy. 2017;47(9):588–92. pmid:28859589
- 17. Organization WH. Towards a common language for functioning, disability, and health: ICF. The international classification of functioning, disability and health. 2002.
- 18. Middleton A, Fritz SL, Lusardi M. Walking speed: the functional vital sign. Journal of aging and physical activity. 2015;23(2):314–22. pmid:24812254
- 19. Haskell WL, Blair SN, Hill JO. Physical activity: health outcomes and importance for public health policy. Preventive medicine. 2009;49(4):280–2. pmid:19463850
- 20. Fusco O, Ferrini A, Santoro M, Lo Monaco MR, Gambassi G, Cesari M. Physical function and perceived quality of life in older persons. Aging Clinical and Experimental Research. 2012;24:68–73. pmid:22643307
- 21. Hartvigsen L, Kongsted A, Hestbaek L. Clinical examination findings as prognostic factors in low back pain: a systematic review of the literature. Chiropractic & manual therapies. 2015;23(1):1–22. pmid:25802737
- 22. Verkerk K, Luijsterburg PA, Miedema HS, Pool-Goudzwaard A, Koes BW. Prognostic factors for recovery in chronic nonspecific low back pain: a systematic review. Physical therapy. 2012;92(9):1093–108. pmid:22595238
- 23. Steyerberg EW, Moons KG, van der Windt DA, Hayden JA, Perel P, Schroter S, et al. Prognosis Research Strategy (PROGRESS) 3: prognostic model research. PLoS medicine. 2013;10(2):e1001381. pmid:23393430
- 24. Stienen MN, Ho AL, Staartjes VE, Maldaner N, Veeravagu A, Desai A, et al. Objective measures of functional impairment for degenerative diseases of the lumbar spine: a systematic review of the literature. The Spine Journal. 2019;19(7):1276–93. pmid:30831316
- 25. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Systematic reviews. 2015;4(1):1–9. pmid:25554246
- 26. Reeves B. Cochrane handbook for systematic reviews of interventions. http://wwwcochrane-handbookorg. 2011.
- 27. Moons KG, Royston P, Vergouwe Y, Grobbee DE, Altman DG. Prognosis and prognostic research: what, why, and how? Bmj. 2009;338.
- 28. UK NGC. Low back pain and sciatica in over 16s: assessment and management. 2016.
- 29. Kowalski KL, Lukacs MJ, Mistry J, Goodman M, Rushton AB. Physical functioning outcome measures in the lumbar spinal surgery population and measurement properties of the physical outcome measures: protocol for a systematic review. BMJ open. 2022;12(6):e060950. pmid:35667717
- 30. Stallings E, Gaetano-Gil A, Alvarez-Diaz N, Solà I, López-Alcalde J, Molano D, et al. Development and evaluation of a search filter to identify prognostic factor studies in Ovid MEDLINE. BMC Medical Research Methodology. 2022;22(1):107. pmid:35399050
- 31. Cohen J. A coefficient of agreement for nominal scales. Educational and psychological measurement. 1960;20(1):37–46.
- 32. Page M, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. (2021). The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. Bmj. 2021;372(71):1–9.
- 33. Moons KG, de Groot JA, Bouwmeester W, Vergouwe Y, Mallett S, Altman DG, et al. Critical appraisal and data extraction for systematic reviews of prediction modelling studies: the CHARMS checklist. PLoS medicine. 2014;11(10):e1001744. pmid:25314315
- 34. Riley RD, Moons KG, Snell KI, Ensor J, Hooft L, Altman DG, et al. A guide to systematic review and meta-analysis of prognostic factor studies. bmj. 2019;364. pmid:30700442
- 35. Debray TP, Damen JA, Snell KI, Ensor J, Hooft L, Reitsma JB, et al. A guide to systematic review and meta-analysis of prediction model performance. bmj. 2017;356. pmid:28057641
- 36. Hayden JA, Côté P, Bombardier C. Evaluation of the quality of prognosis studies in systematic reviews. Annals of internal medicine. 2006;144(6):427–37. pmid:16549855
- 37. Middlebrook A, Middlebrook N, Bekker S, Rushton A. Physical prognostic factors predicting outcome following anterior cruciate ligament reconstruction: A systematic review and narrative synthesis. Physical Therapy in Sport. 2022;53:115–42. pmid:34896673
- 38. Rushton A, Zoulas K, Powell A, Staal J. Physical prognostic factors predicting outcome following lumbar discectomy surgery: systematic review and narrative synthesis. Physiotherapy. 2019;105:e52–e3.
- 39. Grooten WJA, Tseli E, Äng BO, Boersma K, Stålnacke B-M, Gerdle B, et al. Elaborating on the assessment of the risk of bias in prognostic studies in pain rehabilitation using QUIPS—aspects of interrater agreement. Diagnostic and prognostic research. 2019;3:1–11.
- 40. Landis JR, Koch GG. The measurement of observer agreement for categorical data. biometrics. 1977:159–74. pmid:843571
- 41. Fletcher J. What is heterogeneity and is it important? Bmj. 2007;334(7584):94–6. pmid:17218716
- 42. Melsen W, Bootsma M, Rovers M, Bonten M. The effects of clinical and statistical heterogeneity on the predictive values of results from meta-analyses. Clinical microbiology and infection. 2014;20(2):123–9. pmid:24320992
- 43. Roberts MR, Ashrafzadeh S, Asgari MM. Research techniques made simple: interpreting measures of association in clinical research. Journal of Investigative Dermatology. 2019;139(3):502–11. e1.
- 44. Huguet A, Hayden JA, Stinson J, McGrath PJ, Chambers CT, Tougas ME, et al. Judging the quality of evidence in reviews of prognostic factor research: adapting the GRADE framework. Systematic reviews. 2013;2:1–12.
- 45. Denteneer L, Van Daele U, Truijen S, De Hertogh W, Meirte J, Stassijns G. Reliability of physical functioning tests in patients with low back pain: a systematic review. The Spine Journal. 2018;18(1):190–207. pmid:28882521
- 46. George SZ, Fritz JM, Silfies SP, Schneider MJ, Beneciuk JM, Lentz TA, et al. Interventions for the management of acute and chronic low back pain: revision 2021: clinical practice guidelines linked to the international classification of functioning, disability and health from the academy of orthopaedic physical therapy of the American Physical Therapy Association. Journal of Orthopaedic & Sports Physical Therapy. 2021;51(11):CPG1–CPG60.
- 47. Kent P, Cancelliere C, Boyle E, Cassidy JD, Kongsted A. A conceptual framework for prognostic research. BMC Medical Research Methodology. 2020;20:1–13. pmid:32600262
- 48. Ketiš ZK. Predictors of health-related quality of life and disability in patients with chronic nonspecific low back pain. Slovenian Medical Journal. 2011;80(5).