Figures
Abstract
Background
Brain tumours affect 7 per 100,000 people in the UK, glioma being most prevalent, with only 12% five-year survival rates and devastating impacts. Primary care triage tools could facilitate earlier detection of glioma. One option for triage is cognitive function testing. The aim of this systematic review was to determine if cognitive function tests can discriminate between patients with glioma and healthy controls, and their potential suitability for primary care use.
Methods
Studies were included that conducted cognitive function tests with adult patients with glioma, prior to treatment, compared to healthy controls. Two independent researchers performed screening and data extraction. The primary outcome explored test discrimination between people with glioma and healthy controls.
Results
Seventeen studies were identified. Findings indicated multiple cognitive function and language function have potential discriminatory capacity between patients with glioma and healthy controls. Over half of cognitive function tests measuring multiple cognitive functions (59%, n = 17) and language function (54%, n = 30) found significant differences between patients with glioma and healthy controls with medium or large effect size. The Montreal Cognitive Assessment has short test duration, high feasibility and acceptability, suggesting potential primary care suitability. Further acceptability and feasibility studies are needed for other potential tests.
Conclusions
Acknowledging high heterogeneity of included studies, this review suggests tests of multiple cognitive functions or language could support primary care practitioners with decision-making for urgent neuroimaging referral. However, interpretations should be treated with caution and the applicability to primary care requires further exploration.
Prospero registration number: CRD42023408671
Citation: Standen L, Aslam A, Curran R, Derksen C, Yerrakalva D, McInnerney D, et al. (2025) Can cognitive function tests discriminate between patients with glioma and healthy controls prior to treatment? A systematic review. PLoS One 20(8): e0329663. https://doi.org/10.1371/journal.pone.0329663
Editor: Zypher Jude G. Regencia, National Institutes of Health, University of the Philippines Manila / De La Salle University, PHILIPPINES
Received: November 18, 2024; Accepted: July 18, 2025; Published: August 6, 2025
Copyright: © 2025 Standen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files, and Open Science Framework (DOI 10.17605/OSF.IO/C7SRE)
Funding: This systematic review was funded by Barts Charity (G-001520; MRC&U0036).
Competing interests: The authors have declared that no competing interests exist.
Introduction
Background
Brain tumours are experienced by approximately 7 per 100,000 in the UK population [1], have twelve-month survival rates of approximately 40% and five-year survival of only 12% [2]. Many patients (62%) are diagnosed through emergency services [3], which is associated with the poorest survival outcomes [4]. Even in patients who are referred through primary care, referral often only occurs after multiple visits to primary care, which adds to diagnostic delay. Over 40% of patients visit a GP more than three times before referral [5], which could be due to a lack of clear referral guidelines and diagnostic support tools [6]. This is also likely influenced by patients under-reporting their symptoms [7]. Research on detecting early symptoms is high priority for early detection of brain tumours [8], and is supported by the National Institute for Health and Care Excellence [9], the National Institute for Health and Care Research [10], the Cancer Research UK [11] research strategy, and the Tessa Jowell Brain Cancer Mission [12].
Only 1% of patients with brain tumours are referred via the urgent suspected cancer referral pathway [13], intended to expedite cancer diagnosis and reduce patient stress and anxiety [14]. Furthermore, GPs report that there are likely avoidable delays in the patient journey to diagnosis, especially in patients suffering from headaches without other symptoms [15]. Prompt diagnosis could facilitate treatment and survival outcomes with fewer treatment-associated deficits and reduced clinical deterioration [16,17]. Patient experience could also be improved by causing less patient stress and anxiety [18].
Identifying the wide spectrum of early symptoms is extremely challenging [4]. Most patients for whom imaging reveals a glioma present initially with seizures or neurological symptoms [19], including headache, cognitive changes, and non-specific symptoms [15,20]. The strongest positive predictive values for combined symptoms are headache with cognitive symptoms (7.2%) and cognitive symptoms alongside weakness (9.6%) [21]. Yet identifying which patients to refer for urgent neuroimaging is challenging [14], as headaches can signify more common conditions such as migraine [22], fatigue, muscular tension, anxiety and others, including no medical condition [23]. As brain tumours occur much less commonly than other conditions, GPs may first investigate other more common causes [4], which can add delays to the diagnostic pathway. It is also likely that patients do not interpret all cognitive changes as symptoms or disclose them to healthcare professionals [7]. Referring everyone with a headache would add unnecessary patient stress, overwhelm the already over-burdened neuroimaging service, and increase healthcare costs [13,24–26]. Identifying cognitive symptoms could help triage patients in primary care [27], alerting the potential need for prompt referral to neuroimaging [21,26]. A primary care triage support tool for cognitive symptoms could be a crucial innovation to both avoid over-referral and improve early detection rates [21]. However, tools are needed to identify cognitive deficits to assist GP referral decision-making [21].
Cognitive function tests identify neurological deficits through a series of tasks measured against validated cut-off scores [28]. In secondary care, cognitive function tests are used to monitor brain tumour progression, rehabilitation, and recurrence [29,30]. However, no gold-standard cognitive function test exists for patients with brain tumours [31]. Furthermore, testing for rehabilitation or surgical eligibility can be long and arduous (1–8 hours) for patients, thereby reducing clinical acceptability and feasibility [31], particularly within primary care. Evidence of the validity of short cognitive function tests for these patients is conflicting [30]. Therefore, it is crucial to identify whether individual cognitive function tests can identify cognitive impairments in patients with a brain tumour, while being acceptable and feasible in primary care considering resource, timing, and administration needs.
This systematic review aimed to determine if cognitive function tests can discriminate between patients with and without glioma prior to treatment. We chose to focus on glioma given that glioma has the highest incidence of all primary brain tumours [32] and rising prevalence [33]. Glioma represents over 80% of all malignant brain tumours [34]. Secondary aims were to determine details of what each test entails, how it was carried out, and any adverse effects experienced by participants to assess potential suitability for primary care.
Methods
Study design
This systematic review was carried out according to the Preferred Reporting Items for Systematic Review (PRISMA) guidelines [35]. The protocol was registered with the International Prospective Register of Systematic Reviews (PROSPERO) (CRD42023408671). The protocol included studies with patients with all brain tumour types; the results for glioma are presented here.
Information sources
A search strategy (S1 Table) was conducted on 3rd July 2024 to identify studies from the following electronic databases: Medline (via PubMed), CENTRAL, and Embase; citation searching of included studies; trials registers; and conference abstracts.
The full search strategy can be seen in the supplementary file (S1 Table). As an example, the following search strategy was used within the PubMed database: ((Brain tumour*[Title/Abstract]) OR (brain cancer*[Title/Abstract]) OR (brain neoplasms[MeSH Terms])) AND ((Cognit* function* test*[Title/Abstract]) OR (cognit* function* assessment*[Title/Abstract]) OR (cognitive function* exam*[Title/Abstract]) OR (executive function* test*[Title/Abstract]) OR (executive function* assessment*[Title/Abstract]) OR (executive function* exam*[Title/Abstract]) OR (neuropsycholog* assessment*[Title/Abstract]) OR (neuro-psycholog* assessment*[Title/Abstract]) OR (neuropsycholog* exam*[Title/Abstract]) OR (neuro-psycholog* exam*[Title/Abstract]) OR (cognit* test*[Title/Abstract]) OR (cognit* assessment*[Title/Abstract]) OR (cognit* exam*[Title/Abstract]) OR (cognit* abilit* test*[Title/Abstract]) OR (clock-drawing test[Title/Abstract]) OR (Montreal cognitive test[Title/Abstract]) OR (mini-mental state exam[Title/Abstract]) OR (abbreviated mental test[Title/Abstract]) OR (memory impairment screen[Title/Abstract]) OR (mental status questionnaire[Title/Abstract]) OR (short portable mental status questionnaire[Title/Abstract]) OR (neuropsychiatric inventory questionnaire[Title/Abstract]) OR (mini examen cognoscitivo[Title/Abstract]) OR (Eurotest[Title/Abstract]) OR (Fototest[Title/Abstract]) OR (memory alteration test[Title/Abstract]) OR (verbal fluency[Title/Abstract]) OR (memory[Title/Abstract]) OR (mental capacity[Title/Abstract]) OR (Neuropsychological tests[MeSH Terms])).
Eligibility criteria
Studies were included that used an objective cognitive function test with adult patients with primary glioma from any gender, ethnicity, or socioeconomic background and a control group that was either healthy or with any condition other than brain tumour. All study designs with a control group were included. Studies were included in all languages, timeframes, and publication statuses.
Studies were excluded if participants completed cognitive testing after treatment or biopsy as this could impact cognitive function [36]. Studies were excluded if patients had a metastatic tumour diagnosis, or if there was no control group. Case studies with <5 patients or controls were also excluded. One study [37] that included a control group with hippocampal sclerosis was excluded from the review as it was not comparable to the other studies in which control groups were without neurological conditions. This study also had a high risk of bias.
Study selection
Two researchers (LS, and a member of the reviewer team (RC, AA, SB, TM, DY, DM, JL, CD, PA, SA)) independently screened all abstracts and full texts to assess their eligibility for the review. Any disagreements were taken to a third researcher for decision.
Data extraction and management
Data were extracted independently by two researchers (LS and either SS, RC, RE or CD), including participant demographics; recruitment methods; tumour type, stage, and location; cognitive function tests and administration; study design and methods; study completion rates, outcomes and results; and author conflicts of interest, where relevant. Details of cognitive function test administration (i.e. duration, timepoint, setting, mode of delivery, and administered by whom) were used to consider suitability for use in primary care.
Where data was missing, incomplete, or unclear, authors were contacted for clarification where possible. Missing data were reported as no data reported (n.d.). Quality assessment conducted during data extraction was based on GRADE and QUADAS-2 for diagnostic accuracy studies [38], assessing patient selection, testing, flow and timing, selective outcome reporting, and measurement of outcomes. A study was assessed as having overall low risk of bias if all categories were deemed to be low risk. A study was assessed as having overall moderate risk of bias if one or more (but not all) categories were found to have moderate risk. A study was assessed as having a high risk of bias if at least one category was high risk or all categories were moderate risk [39]. As a meta-analysis was not carried out, other factors contributing to GRADE certainty of evidence were assessed narratively. Inconsistency was assessed using effect sizes and imprecision was assessed using sample sizes, compared across studies were relevant and appropriate. Indirectness was assessed using the relevance of the studies to the review research questions, and publication bias was assessed using selective reporting and declared funding sources.
During the data extraction process, it became apparent that there was variation in the claimed cognitive functions being assessed by each cognitive test, and inconsistencies in definitions of cognitive functions between studies. In particular, executive function has been previously defined to include inhibition and interference control, working memory, and cognitive flexibility [40], and as a wider concept encompassing multiple cognitive functions [41]. To guide synthesis and interpretation in this review, each cognitive test was categorised as measuring one of seven cognitive functions (language, memory, information processing, executive function, decision-making, attention, and visuospatial function) or multiple cognitive functions. All cognitive function tests used across all included studies were listed alongside the cognitive function(s) each test was measuring, as reported by each study. This was compared across all included studies to ensure consistency. Existing literature using the same tests was consulted where there was uncertainty or conflicts. Where there was conflict in the claimed measured cognitive function, the majority consensus was adopted and validated using existing literature. (S2 File).
Effect sizes for test findings were calculated using Hedges’ g, with small effect 0.2, medium effect 0.5, and large effect 0.8 [42]. Subgroup analysis of frontal and temporal lobe tumours was included as this tumour location is most likely to cause cognitive symptoms.
Results
A total of 11,605 records were identified by the search. After duplicate removal, 9,585 abstracts were screened, and 803 full texts were assessed for inclusion. One full text [43] was not able to be retrieved. Eighteen records met the inclusion criteria and were included in this review: two reported the same longitudinal study [44,45]. See Fig 1 for the PRISMA flow diagram.
Study characteristics
Table 1 presents summary data for all included studies (n = 17) [44–61]. Further study characteristics are presented in S3 Table, S4 Table, and S5 Table.
Nearly all studies (n = 16) [44,45,47–61] reported tumour location. Studies were typically carried out in mainland Europe (n = 10) [44–49,51,52,55,59,60] or China (n = 5) [50,53,57,58,61]. Three studies [46,51,55] reported study design as case-control. Other study designs were reported as prospective [47,48,52,61], observational [44,45,61], exploratory [55,56], or longitudinal [44,45]. Three-quarters of studies (n = 13) [47,49–55,57–61] were single-centre. Study aims explored cognitive function status (n = 10) [44–47,49,50,52,55,58,60,61]; anatomical / topological mapping (n = 7) [48,51,53,54,57,58,60]; treatment-associated cognitive impairment (n = 5) [44–46,52,53,61]; and test validation (n = 2) [49,56]. Only two studies [46,51] specifically aimed to explore cognitive discrimination between patients with and without glioma.
Patients were recruited from medical settings (n = 14) [46,47,49–53,55–61], often as in-patients for neurosurgery (n = 8) [47,49–51,55,57,58,60]. Control groups were healthy participants (n = 17) [44–61], typically volunteers (n = 6) [46,47,51,55,57,61], patients’ family members [51] or research / hospital staff [53]. Most studies (n = 10) [44,45,48–50,52,54,56,58–60] did not report the method of recruitment of controls.
Most studies (n = 15) [44–46,48–50,52–61] reported inclusion and exclusion criteria for patients. Fewer studies (n = 9) [44,45,48,49,55–60] reported these for controls. Many studies excluded participants with severe cognitive deficits [44–46,48,50,52,54–57,60], comorbidities [44,45,48,50,52–61] or psychiatric illness [44,45,48,50,54,56–60], drug, alcohol, or substance abuse [44,45,48,56–59], or medication affecting cognitive function [46,56,59]. Some studies included only patients eligible for surgery [48,50,52,56,59]. Some studies excluded older age patients [44,45,50,57,60].
The average number of patients in each study was n = 30 (range 10–90). The average number of controls was n = 31 (range 10–80). Studies excluded patients from data analysis for medical complications (n = 3) [52,55,59], incompatible histological diagnosis (n = 3) [47,55,61], fatigue or cognitive impairment (n = 2) [52,60], or organisational reasons (n = 1) [52]. In three studies [46,58,59] there was missing test data without reason.
Participant average ages ranged from 31.8 to 60.6 years old. Thirteen studies [44,45,48–53,55–57,59–61] reported patient education levels. No studies reported ethnicity or socioeconomic status. Many studies matched controls for age (n = 14) [44–47,49–53,55,56,58–61], education (n = 12) [44–50,52,53,55,56,59,60], and sex (n = 10) [46,47,50–53,56,58,60,61]. Some studies reported whether patients (n = 7) [46,47,50,52,54,55,61] or controls [61] had any symptoms or signs such as seizures [46,47,50,52,54,55], headache [47,50,52], or neurological deficits [52], and medication influencing cognitive function [46,47,50,52]. Some studies tested handedness (n = 12) [44–46,50,51,53–60] (matched to controls [44–46,50,51,53,57,58,60]), functional impairment [46,47,57,61], intelligence (matched to controls [50]), or anxiety and depression (matched to controls and controlled for as covariates [50]). Most studies did not report controlling for these factors when making comparisons.
The average number of cognitive function tests administered was 6 (range 1–14). Test duration was reported in seven studies [46,47,50,51,55,56,59], and ranged from 15–180 minutes. There was wide variation in test duration: one study [59] reported 15-minute duration for a total of six cognitive tests, and another [56] reported ≤20-minute duration for one language assessment. Six studies [44,45,47,50,55,56,59] reported the physical test location (typically a quiet environment with breaks between tests), while six studies [44,45,49,51,55,56,60] reported the mode (e.g. computerised). In ten studies [46,48,51,53,55–59,61] expert professionals administered testing, while seven studies [44,45,47,49,50,52,54,60] did not specify the administrator. Only four studies stated whether test order was counterbalanced [51,56], randomised [59] or fixed [46]. All studies performed cognitive function testing prior to treatment, including any tumour-directed therapy, biopsy, or peri-operative steroid use; however, four studies [54,57,58,60] did not specify precisely how long before treatment the cognitive function tests were administered. The specific timepoints reported for testing ranged from 1 day to 1 month before surgery; however, other less specific timepoints were also reported (e.g. “before surgery” [56]). Only two studies reported the timepoint of testing for controls, being the same time as patients [50] or from a previous study [54].
Quality and risk of bias
In all studies [44–61] there was risk of bias. All studies, except one [47], had moderate risk of bias over patient selection, typically excluding patients with severe cognitive deficits. Five studies [44,45,50,52,57,60] had moderate risk of bias for testing, typically not specifying blinding or test administration [43–45,47–49,55]. Eleven studies [47,51–55,57–61] had moderate risk of bias for flow and timing, typically not specifying test procedure [47–49,52,53,56,57,59,60]. Half of studies (n = 8) [44–47,51,52,55,56,59] had moderate risk of bias for selective outcome reporting, typically for not reporting non-significant values [45,50–52,58–60]. Ten studies [44,45,47–50,54–58] had moderate risk of bias for outcome measurement, typically due to wide confidence intervals. (Fig 2).
Findings
Tables 1 and 2 summarise the findings of the included studies.
Multiple cognitive functions.
Nine studies [46,50–53,58–61] explored tests measuring multiple cognitive functions, reporting twenty-nine test results. Seventeen test findings across eight studies [50–53,58–61] found patients to have significantly worse cognitive function than healthy controls, reporting mostly medium and large effect sizes (using Digit Span Test (DST), Dual-Attention Task Visual, Letter Digit Modalities Test, Stroop, Montreal Cognitive Assessment (MoCA), Digit Symbol Substitution Test (DSST), Arithmetic, Trail-Making Test (TMT), and Symbol Digit Modalities Test). Effect size was not calculable for six findings [52,59,60] as patient and control scores were not reported. Twelve test findings across five studies [46,51,58–60] found no significant differences in cognitive function between patients and healthy controls (using Letter Digit Modalities Test, Stroop, Dual Attention Task Auditory, DST, and TMT). Six non-significant findings [51,60] showed a small or medium effect. One non-significant finding [58] showed a large negative effect, where patients performed worse than healthy controls.
Sub-group analysis of tumour location showed three studies [50,53,58] explored tests measuring multiple cognitive functions in patients with only frontal or temporal lobe glioma, reporting seven test findings. Six of the seven test findings [50,53,58] demonstrated patients performed significantly worse than healthy controls. In the remaining test finding [58] cognitive function did not differ between patients and controls.
Language.
Eleven studies [44–46,48,54–61] explored language as a cognitive function, reporting fifty-six test results. Thirty test findings across ten studies [44,45,48,54–61] found patients to have significantly worse language than healthy controls, nearly all with medium or large effect (using Aachener Aphasie Test, Aphasia Battery for Chinese Speakers, Aphasia Quotient, Boston Naming Test, Picture-Sentence Matching Task, Spontaneous Speech, TeleLanguage Test, Token Test, Verbal Fluency Test, and Wechsler Adult Intelligence Scale Similarities). Effect size was not calculable for nine findings [44,45,54,56,59]. One test finding in one study [55] found healthy controls to have significantly worse language than patients with glioma with medium effect (using Bedomning av subtila sprakstorningar Metaphors). Nineteen test findings across six studies [44–46,54,55,59,60] found no significant differences in language between patients and healthy controls (using Bedomning av subtila sprakstorningar, Picture-Sentence Matching Task, Spontaneous Speech, and Verbal Fluency Test). Fourteen non-significant findings [44,45,55,60] showed a small or medium effect. Six test findings in one study [54] reported no significance testing with five subtests of Picture-Sentence Matching Task showing higher scores in patients with glioma than controls, and one subtest showing similar scores.
Sub-group analysis of tumour location showed three studies [48,54,58] explored language in patients with only frontal or temporal lobe glioma, reporting nineteen test findings. Twelve of the nineteen test findings [48,54,58] demonstrated patients performed significantly worse than healthy controls. For the remaining seven test results [54], one showed that language did not differ between patients and controls, and six reported no significance testing but showed higher patient scores than control group scores.
Memory.
Seven studies [46,47,50,52,58,60,61] explored memory as a cognitive function, reporting twenty test results. Five test findings across three studies [52,60,61] found patients to have significantly worse memory than healthy controls, reporting medium and large effect sizes (using Auditory Verbal Learning Test, Memory with Interference (30s), Story Recall Immediate and Delayed, and Visual Verbal Learning Test). Effect size was not calculable for one finding [52] as patient and control scores were not reported. Fifteen test findings across five studies [46,47,50,58,60] found no significant differences in memory between patients and healthy controls (using Corsi, Memory Test, Munich Verbal Memory Test [Münchner Verbaler Gedächtnistest], Tapping Test, Visual Verbal Learning Test, and Wechsler Adult Intelligence Scale Working Memory). Ten non-significant findings [47,50,60] showed a small or medium effect. Three non-significant findings in two studies [50,58] showed a large negative effect, where patients performed worse than healthy controls.
Regarding tumour location, two studies [50,58] explored memory in patients with only frontal or temporal lobe glioma, reporting four test findings, none of which differed between patients and controls.
Information processing.
Two studies [51,59] explored information processing as a cognitive function, reporting sixteen test results. Four test findings across both studies [51,59] found patients to have significantly worse information processing than healthy controls, some with medium or large effect sizes (using Matching Tasks: Auditory, Picture Naming Task, and Sentence Judgement Test). Effect size was not calculable for one finding [59]. Nine test findings across two studies [51,59] found no significant differences in information processing between patients and healthy controls (using Learning-Meaningful and Non-Meaningful Tasks, Matching Tasks, and Sentence Judgement Test Time). Eight non-significant findings [51] showed a small or medium effect. Three test findings in one study [59] reported no significance testing and did not report scores for the control group (using Sentence-Judgement Test).
Executive function.
Five studies [46,50,52,57,61] explored executive function as a cognitive function, reporting eleven test results. Four test findings across four studies [50,52,57,61] found patients to have significantly worse executive function than healthy controls, some with medium or large effect (using Concept Shifting, Mini Mental State Examination, and Modified Card Sorting Test). Effect size was not calculable for two findings [52,57]. Seven test findings across two studies [46,50] found no significant differences in executive function between patients and healthy controls (using Concept Shifting, and subtests of Modified Card Sorting Test). Five non-significant findings [50] showed a small or medium effect, and one non-significant finding in the same study showed a large effect (using Modified Card Sorting Test: Preservative Error).
Decision-making.
One study [49] (which included patients with only frontal or temporal lobe glioma) explored decision-making in patients, reporting five test results. Four test findings found patients to have significantly worse decision-making than healthy controls, and had large effect sizes (using subtests of Gambling Task). In the remaining test, there was no significant difference in decision-making between patients and healthy controls showing a small effect (using subtest of Gambling Task).
Attention.
One study [60] explored attention as a cognitive function, reporting four test results. Two test findings found patients to have significantly worse attention than healthy controls, and two test findings found no significant differences in attention between patients and healthy controls (using subtests of Conner’s Continuous Performance Test). Effect size was not calculable.
Visuospatial function.
One study [58] (which included patients with only frontal or temporal lobe glioma) explored visuospatial function as a cognitive function, reporting two test results; both found patients to have significantly worse visuospatial function than healthy controls with large effect sizes (using Mapping, and Visuospatial tests).
Studies using the same cognitive function test.
The DST Total was used by two studies [50,58], and DST Forwards and Backwards each by two studies [50,60] and reported mixed results. The Boston Naming Test (BNT) was used by two studies [55,59]; both found patients with glioma performed significantly worse than healthy controls. The TMT A was used by three studies [59–61], and reported mixed results and selective outcome reporting; the TMT B was used by two studies [59,60] with mixed results and selective outcome reporting. Furthermore, Stroop tests were administered in four studies [46,52,60,61]; however, it was not clear which version was used across the four studies. Outcomes were not fully reported across all studies, resulting in an inability to combine findings across multiple studies. As a result of selective outcome reporting and heterogeneity in the methods used in the studies, a meta-analysis was not deemed appropriate.
Discussion
This review assessed the literature exploring cognitive function in patients with glioma compared to healthy controls. Over the 17 studies analysed, the number of cognitive function tests (n = 143) and their findings, and the testing procedure and approach, were highly varied. This is a common finding in other literature exploring cognitive function in patients with glioma [62]. This heterogeneity made it challenging to draw firm conclusions. However, our review suggests that tests measuring multiple cognitive functions, and language in particular, have some potential to identify differences in the cognitive performance of patients with glioma and healthy controls, while acknowledging that cognitive function deficits are also highly prevalent in many neurological diseases.
The MoCA, Mapping, Dual-Attention Task Visual, Arithmetic, and DSST tests showed the largest effect sizes between patients with glioma and healthy controls. The Mapping and Arithmetic tests were not described in detail; therefore, it is not possible to determine accurately which specific measures were administered during the study [58]. The Dual-Attention Task Visual and DSST were administered by neuropsychologists. The Dual-Attention Task Visual was carried out on computer and preceded by a training phase. Individual tests, such as the DSST, generally require <5 minutes duration. No further specific information on time duration, setting, or administration was reported to assess the acceptability and feasibility of these tests for primary care application. These tests would need further investigation into required time, cost and administration resources. The BNT was administered across two studies [55,57] with large numbers of participants, showing medium to large effect size, suggesting this test has potential to identify cognitive deficits associated with glioma; however, within the context of this review, the BNT is likely to be too long (30–45 minutes) to administer within primary care [63].
The MoCA, which assesses multiple cognitive domains, is possibly one of the most suitable tests for primary care, with short test duration, and existing clinical application within primary care for other neurological conditions, such as dementia [64]. It also has the most promising findings in this review with the largest effect size of all included measures. Furthermore, the established cut-off score for the MoCA is < 26, and the patients in the included study scored a mean of 20.2 compared to a mean of 27.9 for the control group. While the established cut-off score appeared suitable for this sample, it is important to acknowledge the risk of false positives and potentially varying scores for other samples. The MoCA is mentioned as a commonly used clinical test in European Association of Neuro-Oncology (EANO) guidelines for diagnosis of glioma [65]. A recent systematic review [62] questioned the sensitivity of the MoCA for patients with glioma as it was not developed to detect subtle cognitive changes associated with brain tumours. Our current findings suggest that the MoCA might have potential to be capable of identifying cognitive differences in patients with glioma. The MoCA also has low time and cost demands, and high patient readability, consent, completion rates, and acceptability, and needs no specialist administration [62], suggesting it is a highly acceptable and feasible test for primary care. However, in this review, it must be acknowledged that the MoCA was used in a single study with a small sample size; this lack of a large body of evidence supporting the MoCA used in this context highlights the need for caution.
Certain cognitive function tests might be capable of discriminating between patients with glioma and healthy controls. Cognitive tests could provide support for GP decision-making around which patients would benefit from onward referral and investigation, either via an urgent suspected cancer pathway or a GP direct access to neuroimaging pathway. However, further exploration is required around feasibility and implementation of cognitive testing in the current brain tumour diagnostic pathway in primary care. Similarly, it is important to consider how these tests are administered and the clinical implications within primary care. For instance, the length of testing, mode of delivery, administration, eligibility, and required resources and workload [62]. Lengthy tests and specialised administrators are not feasible in primary care settings [66], given impact on resources and workload [67]. Practical challenges of time constraints, GP training, and clinical workflow considerations must be further explored. Tests that showed discriminatory utility, such as the Mapping, Dual-Attention Task Visual, Arithmetic, and DSST, need further investigation into time and cost resources and administration requirements for application in primary care. The MoCA, as an established and validated test used within primary care for other conditions, is potentially suitable for future implementation research to determine how the administration in primary care would impact on resources, workload, and outcomes from healthcare professional, patient and public perspectives [67]. External validation of cognitive tests would also be required, particularly in a primary care setting with relevant patient populations.
It is important to acknowledge that there is a disproportionate representation of patients with left hemisphere gliomas in the included studies. However, the MoCA, DSST, and Dual-Attention Task Visual were all tested in a mixed group of patients with equal representation of left- and right-hemisphere gliomas. Similarly, it might be presumed that cognitive function tests would be more likely to detect cognitive deficits in patients with high-grade glioma, as a more intrusive tumour, compared to low-grade glioma. However, the MoCA [53] was administered only to patients with low-grade glioma, and the Dual-Attention Task Visual [51] was tested equally in patients with low- and high-grade glioma. The grade of the tumour was not reported for patients who performed the DSST [58].
The results of this systematic review suggest cognitive function tests measuring multiple cognitive functions and language could have clinical utility for identifying a difference in cognitive function between patients with glioma and healthy control groups. This suggests language impairment is objectively detectable in patients with glioma, in line with previous research [7]. Indeed, there has been recent interest in language testing to support detection of glioma [66]. Verbal fluency testing was identified as predominantly measuring language function by most of the included studies in this review [44,45,48,55,56,60,61], though it could be argued that it measures other cognitive functions in conjunction with language function [66]. However, it is important to acknowledge the disproportionate number of cognitive function tests measuring language in the review, and the findings should be interpreted within this context. Tumour location might further influence multiple cognitive function or language impairment, given the high ratio of tests reporting significant differences in these domains for patients with frontal or temporal lobe tumours compared to controls. However, these findings should be interpreted with caution due to small sample sizes.
Memory deficits are often cited as a cognitive symptom associated with glioma [20,21]. However, most cognitive function tests in this review found no difference in memory performance between patients with glioma and healthy participants. These findings indicate memory function tests might not have clinical utility within this context. It also could be argued that different forms of memory should be studied, such as working memory and long-term memory. For other cognitive functions such as information processing, executive function, decision making, attention, and visuospatial function, the results were mixed or few in number. This limits conclusions about their utility. Cognitive function tests measuring executive function might be clinically useful; however, the mixed findings might reflect a lack of established consensus for defining executive function, which can be used as an umbrella term that includes attention, memory, and cognitive flexibility [40]. The definition of executive function as accepted in this review is that of general neurological function that is separate from more specialised cognitive functions, such as memory or cognitive flexibility.
Some non-significant findings showed a large effect whereby patients scored worse on the cognitive function tests than the healthy control group. In particular, the DST (measuring multiple cognitive functions), Tapping Test (measuring memory), and Modified Card Sorting Test (measuring executive function). These non-significant findings might be due to the small sample sizes and demonstrate the need for further robust exploration to draw any further conclusions about their utility.
Overall, the same cognitive function test was rarely used across multiple studies making comparisons difficult and limiting options to perform a meta-analysis. Consistency in choice of cognitive function test with patients with glioma is crucial to understand whether these tests have the capability of detecting differences in cognitive function. Replication studies are required to further this evidence base. The most promising areas are impairments in multiple cognitive function or language, and these could be the initial focus.
The strengths of this review include systematic searching of three databases, and the use of quality assessment methods. Searching these three databases is recommended by Cochrane [68] as providing comprehensive coverage of the relevant literature, though further databases could have been included to further the potential to identify eligible studies. Furthermore, no meta-analysis was carried out, so there is a strong need for caution when interpreting any conclusions. The results of the review are limited in that all control groups were healthy participants. In contrast, patients presenting to primary care are likely to be symptomatic, which might affect the applicability of these findings to primary care. Research is therefore needed to compare discrimination of cognitive function results in a population presenting to primary care with symptoms potentially associated with glioma, such as headache or weakness. Furthermore, this review did not include studies that compared data of patients with glioma to normative data, and only included case-control studies; this may have resulted in missing some studies that could contribute relevant findings. In addition, there is no clear agreement on the definition of different types of cognitive function. For instance, there is ongoing debate whether emotion recognition is included as a cognitive function. Studies testing emotion recognition were not included in this review but could offer additional insight into identification of cognitive differences between patients with glioma and healthy controls [69]. Furthermore, the secondary aim of this review to determine any adverse effects experienced by participants was not fulfilled as no data was provided by the included studies on this outcome.
Limitations of the included papers further limit the conclusions of this systematic review. The wide heterogeneity of the included studies, with regards methodology, sample sizes and demographics, and types of cognitive tests used, makes direct comparisons of findings challenging. For example, different cognitive tests might assess different cognitive domains and have varying levels of accuracy. Different patient samples could have varying socio-demographics as well as varying tumour histology and location, which could influence comparison across study findings. Furthermore, study design could vary in patient and control recruitment methods and cognitive test administration procedures. The heterogenous factors have been reported transparently in this review as this is likely to impact on the reliability of these conclusions [70]. Most studies were single-centre, with small sample sizes, potentially reducing representativeness and statistical power of the findings. Often, cognitive function tests were administered as part of standard clinical care, making it more difficult to extrapolate to uniform delivery within populations of patients with glioma, and between patients and controls. As such, it was also not always reported which specific test or which version of a test was being used. Furthermore, some studies did not report significance testing, which makes it difficult to determine the impact on the findings of this review. Some studies assessing memory, language, information processing, and executive function were lacking this data, though the reasons for this are unknown and require further investigation. Similarly, effect sizes were not calculable for all findings due to the lack of reported data. Over half the studies excluded patients with severe cognitive deficits, possibly resulting in underestimating differences in cognitive function. The selection and matching of control groups are not consistently reported. Without proper matching for age, education, and other factors, observed cognitive differences may be due to confounding rather than the presence of glioma. Furthermore, no studies reported ethnicity or socioeconomic status of participants, and as such, it is challenging to understand the representativeness of the samples, potentially reducing the generalisability of the findings. Future research should be widely applicable, using representative samples, specifically including patients with poorer prognoses, including those ineligible for surgical intervention, and with severe cognitive deficits, who are largely underrepresented in these samples. Similarly, further exploration, validation and diagnostic accuracy studies would be needed in a representative sample of the population with brain tumours, or indeed in a population of patients presenting to primary care with symptoms that might prompt a referral for neuroimaging. Future validation studies of cognitive function testing in primary care settings are also needed. Robust research would benefit from reporting full demographic data, including ethnicity and socioeconomic status for both patients and controls to improve representativeness and investigate health inequalities.
Conclusions
In conclusion, this systematic review has emphasised the high variability with which cognitive function is assessed in studies with patients with glioma. Cognitive function tests might have utility to be used alongside guidelines for referral [71] to raise suspicion of glioma by identifying early change in cognitive function, in particular, within an overall multiple cognitive function domain or language function. However, high heterogeneity and the presence of risk of bias in existing studies means any interpretations and the reliability of the conclusions should be treated with caution. The applicability to primary care requires further exploration, in particular testing feasibility and acceptability of the cognitive function tests within the workflow and capacity of primary care.
Supporting information
S2 File. Cognitive function measured by each cognitive function test: process.
https://doi.org/10.1371/journal.pone.0329663.s002
(DOCX)
S3 Table. Numbered table of eligible studies and data extraction process.
https://doi.org/10.1371/journal.pone.0329663.s003
(DOCX)
S4 Table. Supplementary summary of study aims and participant characteristics in systematic review.
https://doi.org/10.1371/journal.pone.0329663.s004
(DOCX)
S5 Table. Supplementary summary of participant characteristics and study administration.
https://doi.org/10.1371/journal.pone.0329663.s005
(DOCX)
S6 Table. Summary of studies that include patients with frontal or temporal location of glioma in systematic review.
https://doi.org/10.1371/journal.pone.0329663.s006
(DOCX)
S7 Table. Matrix showing which cognitive function was tested in which studies with only frontal or temporal lobe glioma and whether a significant difference was found between patients and control groups.
https://doi.org/10.1371/journal.pone.0329663.s007
(DOCX)
Acknowledgments
The authors wish to thank Professor Ruth Dobson and Mr Edward McKintosh for support and guidance. The authors also wish to thank Dr Ruth Evans for data extraction, and Stefanie Bonfield, Teffanie Maramba, Joy Li, Panos Alexandris, and Sanjula Arora for abstract screening.
References
- 1.
McNamara S, Fawcett TN, McQueen A. Facing the challenges of primary malignant brain tumours. In: Perspectives on Cancer Care [Internet]. Hoboken, United Kingdom: John Wiley & Sons, Incorporated; 2011. Available from: http://ebookcentral.proquest.com/lib/gmul-ebooks/detail.action?docID=624722
- 2.
Office for National Statistics. Cancer survival in England adult, stage at diagnosis and childhood - patients followed up to 2018. 2018; Available from: https://www.ons.gov.uk/peoplepopulationandcommunity/healthandsocialcare/conditionsanddiseases/bulletins/cancersurvivalinengland/stageatdiagnosisandchildhoodpatientsfollowedupto2018
- 3. Fraulob I, Davies EA. How do patients with malignant brain tumors experience general practice care and support? Qualitative analysis of English Cancer Patient Experience Survey (CPES) data. Neurooncol Pract. 2020;7(3):313–9. pmid:32528712
- 4. Penfold C, Joannides AJ, Bell J, Walter FM. Diagnosing adult primary brain tumours: can we do better?. Br J Gen Pract. 2017;67(659):278–9.
- 5. Sage W, Fernández-Méndez R, Crofton A, Gifford MJ, Bannykh A, Chrysaphinis C, et al. Defining unmet clinical need across the pathway of brain tumor care: a patient and carer perspective. CMAR. 2019;11:2189–202.
- 6. Ceronie B, Hart T, Belete D, Ramani L, Bahra A. Isolated headache is not a reliable indicator for brain cancer: the 2-week wait pathway for suspected CNS malignancies. Clin Med (Lond). 2021;21(6):e648–55. pmid:34862227
- 7. Scott SE, Penfold C, Saji S, Curtis S, Watts C, Hamilton W, et al. It was nothing that you would think was anything”: Qualitative analysis of appraisal and help seeking preceding brain cancer diagnosis. PLoS One. 2019;14(3):e0213599. pmid:30901334
- 8. Hamilton AC, Donnelly DW, Fitzpatrick D, Coleman HG. Early-Onset cancers in adults: a review of epidemiology, supportive care needs and future research priorities. Cancers (Basel). 2022;14(16):4021. pmid:36011014
- 9.
NICE. NICE guideline: Brain tumours (primary) and brain metastases in over 16s. 2021. p. 69. Available from: https://www.nice.org.uk/guidance/ng99
- 10.
NIHR. Highlight Notice: Brain Tumours. 2019; Available from: https://www.nihr.ac.uk/documents/highlight-notice-brain-tumours/11656
- 11.
Cancer Research UK. Our Research Strategy [Internet]. 2022. Available from: https://www.cancerresearchuk.org/sites/default/files/cancer_research_uk-our_research_strategy.pdf
- 12.
Mission TJBC. Tessa Jowell Brain Cancer Mission (TJBCM) | Calling for action to improve brain tumour treatment, research and survival. 2019; Available from: https://www.tessajowellbraincancermission.org/.
- 13. Walter FM, Penfold C, Joannides A, Saji S, Johnson M, Watts C. Missed opportunities for diagnosing brain tumours in primary care: a qualitative study of patient experiences. Br J Gen Pract. 2019;69(681):e224-35.
- 14. Salander P, Bergenheim AT, Hamberg K, Henriksson R. Pathways from symptoms to medical care: a descriptive study of symptom development and obstacles to early diagnosis in brain tumour patients. Fam Pract. 1999;16(2):143–8. pmid:10381020
- 15. Ozawa M, Brennan PM, Zienius K, Kurian KM, Hollingworth W, Weller D, et al. Symptoms in primary care with time to diagnosis of brain tumours. Fam Pract. 2018;35(5):551–8. pmid:29420713
- 16. Grant R, Dowswell T, Tomlinson E, Brennan PM, Walter FM, Ben-Shlomo Y, et al. Interventions to reduce the time to diagnosis of brain tumours. Cochrane Database Syst Rev. 2020;9(9):CD013564. pmid:32901926
- 17. Khalil A, Rahimi A, Luthfi A, Azizan MM, Satapathy SC, Hasikin K, et al. Brain tumour temporal monitoring of interval change using digital image subtraction technique. Front Public Health. 2021;9:752509. pmid:34621723
- 18. Christensen HM, Huniche L. Patient perspectives and experience on the diagnostic pathway of lung cancer: a qualitative study. SAGE Open Med. 2020;8:2050312120918996. pmid:32435485
- 19.
Kracht LW, Heiss WD. Metabolic Imaging. Neuro-oncology: The essentials. 2014.
- 20. Perkins A, Liu G. Primary brain tumors in adults: diagnosis and treatment. Am Fam Physician. 2016;93(3):211–7. pmid:26926614
- 21. Ozawa M, Brennan PM, Zienius K, Kurian KM, Hollingworth W, Weller D. The usefulness of symptoms alone or combined for general practitioners in considering the diagnosis of a brain tumour: a case-control study using the clinical practice research database (CPRD) (2000-2014). BMJ Open. 2019;9(8):e029686.
- 22. Vuralli D, Ayata C, Bolay H. Cognitive dysfunction and migraine. J Headache Pain. 2018;19(1):109.
- 23. Smith R. In search of “non-disease.”. BMJ. 2002;324(7342):883–5.
- 24. Kostopoulou O, Nurek M, Cantarella S, Okoli G, Fiorentino F, Delaney BC. Referral decision making of general practitioners: a signal detection study. Med Decis Making. 2019;39(1):21–31. pmid:30799690
- 25. Mohammad HR, Boardman J, Howell L, Mills RJ, Emsley HCA. Urgent referral for suspected CNS cancer: which clinical features are associated with a positive predictive value of 3% or more? BMC Neurol. 2016;16(1):152.
- 26. Zienius K, Chak-Lam I, Park J, Ozawa M, Hamilton W, Weller D, et al. Direct access CT for suspicion of brain tumour: an analysis of referral pathways in a population-based patient group. BMC Fam Pract. 2019;20(1):118. pmid:31431191
- 27. Jones OT, Calanzani N, Saji S, Duffy SW, Emery J, Hamilton W, et al. Artificial intelligence techniques that may be applied to primary care data to facilitate earlier diagnosis of cancer: systematic review. J Med Internet Res. 2021;23(3):e23483. pmid:33656443
- 28. Ciesielska N, Sokołowski R, Mazur E, Podhorecka M, Polak-Szabela A, Kędziora-Kornatowska K. Is the Montreal Cognitive Assessment (MoCA) test better suited than the Mini-Mental State Examination (MMSE) in mild cognitive impairment (MCI) detection among people aged over 60? Meta-analysis. Psychiatr Pol. 2016;50(5):1039–52.
- 29. Becker J, Steinmann E, Könemann M, Gabske S, Mehdorn HM, Synowitz M, et al. Cognitive screening in patients with intracranial tumors: validation of the BCSE. J Neurooncol. 2016;127(3):559–67. pmid:26830092
- 30. Robinson GA, Biggs V, Walker DG. Cognitive screening in brain tumors: short but sensitive enough? Front Oncol [Internet]. 2015;5((Robinson G.A., g.robinson@psy.uq.edu.au) Neuropsychology Research Unit, School of Psychology, The University of Queensland, Brisbane, QLD, Australia):60. https://www.embase.com/search/results?subaction=viewrecord&id=L636415268&from=export
- 31. Renovanz M, Reitzug L, Messing L, Scheurich A, Grüninger S, Ringel F, et al. Patient reported feasibility and acceptance of Montreal Cognitive Assessment (MoCA) screening pre- and postoperatively in brain tumour patients. J Clin Neurosci. 2018;53:79–84. pmid:29685411
- 32. Wanis HA, Møller H, Ashkan K, Davies EA. The incidence of major subtypes of primary brain tumours in adults in England 1995-2017. Neuro-Oncol. 2021;23(8):noab076.
- 33. Vocht F d e. Inferring the 1985–2014 impact of mobile phone use on selected brain cancer subtypes using Bayesian structural time series and synthetic controls. Environ International. 2016;97:100–7.
- 34. Ostrom QT, Bauchet L, Davis FG, Deltour I, Fisher JL, Langer CE, et al. The epidemiology of glioma in adults: a “state of the science” review. Neuro Oncol. 2014;16(7):896–913. pmid:24842956
- 35. Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4(1):1. pmid:25554246
- 36. Coomans MB, van der Linden SD, Gehring K, Taphoorn MJB. Treatment of cognitive deficits in brain tumour patients: current status and future directions. Curr Opin Oncol. 2019;31(6):540–7. pmid:31483326
- 37. Baxendale S, Donnachie E, Thompson P, Sander JW. Dysembryoplastic neuroepithelial tumors: a model for examining the effects of pathology versus seizures on cognitive dysfunction in epilepsy. Epilepsia. 2013;54(12):2214–8. pmid:24304439
- 38. Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36. pmid:22007046
- 39.
QUADAS-2 background document - background-doc.pdf [Internet]. [cited 2024 June 21]. Available from: https://www.bristol.ac.uk/media-library/sites/quadas/migrated/documents/background-doc.pdf
- 40. Diamond A. Executive functions. Annu Rev Psychol. 2013;64(1):135–68.
- 41. Arevalo-Rodriguez I, Smailagic N, Roqué I Figuls M, Ciapponi A, Sanchez-Perez E, Giannakou A, et al. Mini-Mental State Examination (MMSE) for the detection of Alzheimer’s disease and other dementias in people with mild cognitive impairment (MCI). Cochrane Database Syst Rev. 2015;2015(3):CD010783. pmid:25740785
- 42. Lakens D. Calculating and reporting effect sizes to facilitate cumulative science: a practical primer for t-tests and ANOVAs. Front Psychol. 2013;4:863. pmid:24324449
- 43. Atsuchi M, Takeuchi K. Psychiatric manifestations of brain tumors--from the viewpoint of neurosurgery. Nihon Rinsho. 1969;27(9):2225–8. pmid:5389206
- 44. Satoer D, Vincent A, Smits M, Dirven C, Visch-Brink E. Spontaneous speech of patients with gliomas in eloquent areas before and early after surgery. Acta Neurochir (Wien). 2013;155(4):685–92. pmid:23440372
- 45. Satoer D, Vincent A, Ruhaak L, Smits M, Dirven C, Visch-Brink E. Spontaneous speech in patients with gliomas in eloquent areas: Evaluation until 1 year after surgery. Clin Neurol Neurosurg. 2018;167:112–6. pmid:29475027
- 46. Reijneveld JC, Sitskoorn MM, Klein M, Nuyen J, Taphoorn MJ. Cognitive status and quality of life in patients with suspected versus proven low-grade gliomas. Neurology. 2001;56(5):618–23.
- 47. Ruge MI, Ilmberger J, Tonn J-C, Kreth F-W. Health-related quality of life and cognitive functioning in adult patients with supratentorial WHO grade II glioma: status prior to therapy. J Neurooncol. 2011;103(1):129–36. pmid:20820874
- 48. Bizzi A, Nava S, Ferrè F, Castelli G, Aquino D, Ciaraffa F, et al. Aphasia induced by gliomas growing in the ventrolateral frontal region: assessment with diffusion MR tractography, functional MR imaging and neuropsychology. Cortex. 2012;48(2):255–72. pmid:22236887
- 49. Mattavelli G, Casarotti A, Forgiarini M, Riva M, Bello L, Papagno C. Decision-making abilities in patients with frontal low-grade glioma. J Neurooncol. 2012;110(1):59–67. pmid:22798208
- 50. Mu Y-G, Huang L-J, Li S-Y, Ke C, Chen Y, Jin Y, et al. Working memory and the identification of facial expression in patients with left frontal glioma. Neuro Oncol. 2012;14 Suppl 4(Suppl 4):iv81-9. pmid:23095835
- 51. Plaza M, Capelle L, Maigret G, Chaby L. Strengths and weaknesses of multimodal processing in a group of adults with gliomas. Neurocase. 2013;19(3):302–12. pmid:22554225
- 52. Habets EJJ, Kloet A, Walchenbach R, Vecht CJ, Klein M, Taphoorn MJB. Tumour and surgery effects on cognitive functioning in high-grade glioma patients. Acta Neurochir (Wien). 2014;156(8):1451–9. pmid:24879620
- 53. Huang Q, Zhang R, Hu X, Ding S, Qian J, Lei T, et al. Disturbed small-world networks and neurocognitive function in frontal lobe low-grade glioma patients. PLoS ONE. 2014;9(4).
- 54. Kinno R, Ohta S, Muragaki Y, Maruyama T, Sakai KL. Differential reorganization of three syntax-related networks induced by a left frontal glioma. Brain. 2014;137(Pt 4):1193–212. pmid:24519977
- 55. Antonsson M, Longoni F, Jakola A, Tisell M, Thordstein M, Hartelius L. Pre-operative language ability in patients with presumed low-grade glioma. J Neurooncol. 2018;137(1):93–102. pmid:29196925
- 56. De Witte E, Piai V, Kurteff G, Cai R, Mariën P, Dronkers N, et al. A valid alternative for in-person language assessments in brain tumor patients: feasibility and validity measures of the new TeleLanguage test. Neurooncol Pract. 2019;6(2):93–102. pmid:31386040
- 57. Zhang N, Xia M, Qiu T, Wang X, Lin C-P, Guo Q, et al. Reorganization of cerebro-cerebellar circuit in patients with left hemispheric gliomas involving language network: A combined structural and resting-state functional MRI study. Hum Brain Mapp. 2018;39(12):4802–19. pmid:30052314
- 58. Hu G, Hu X, Yang K, Liu D, Xue C, Liu Y, et al. Restructuring of contralateral gray matter volume associated with cognition in patients with unilateral temporal lobe glioma before and after surgery. Hum Brain Mapp. 2020;41(7):1786–96. pmid:31883293
- 59. Mooijman S, Bos LS, Witte ED, Vincent A, Visch-Brink E, Satoer D. Language processing in glioma patients: speed or accuracy as a sensitive measure?. Aphasiology. 2022;36(12):1467–91.
- 60. Tarantino V, Visalli A, Facchini S, Rossato C, Bertoldo A, Silvestri E, et al. Impaired cognitive control in patients with brain tumors. Neuropsychologia. 2022;169:108187. pmid:35218790
- 61. Wang L, Fang S, Peng Y. A research of preoperative neurocognitive functioning and contributing factors in patients with supratentorial gliomas. Neurosci Lett. 2022;775:136527. pmid:35167943
- 62. Carlson MA, Fradgley EA, Yates D, Morris S, Tait J, Paul CL. Acceptability and feasibility of cognitive assessments with adults with primary brain cancer and brain metastasis: A systematic review. Neurooncol Pract. 2022;10(3):219–37. pmid:37188159
- 63.
Boston Naming Test Second Edition - Product Information [Internet]. [cited 2024 June 7]. Available from: https://www.annarbor.co.uk/index.php?main_page=index&cPath=690_249_493
- 64. Nasreddine ZS, Phillips NA, Bédirian V, Charbonneau S, Whitehead V, Collin I, et al. The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc. 2005;53(4):695–9. pmid:15817019
- 65. Weller M, van den Bent M, Preusser M, Le Rhun E, Tonn JC, Minniti G, et al. EANO guidelines on the diagnosis and treatment of diffuse gliomas of adulthood. Nat Rev Clin Oncol. 2021;18(3):170–86. pmid:33293629
- 66. Zienius K, Ozawa M, Hamilton W, Hollingworth W, Weller D, Porteous L, et al. Verbal fluency as a quick and simple tool to help in deciding when to refer patients with a possible brain tumour. BMC Neurol. 2022;22(1):127. pmid:35379182
- 67.
Saunders RP. Implementation monitoring and process evaluation. SAGE Publications, Inc; 2016.
- 68.
Chapter 4: Searching for and selecting studies | Cochrane Training [Internet]. [cited 2025 June 5]. Available from: https://training.cochrane.org/handbook/current/chapter-04
- 69. Buunk AM, Gerritsen MJJ, Jeltema H-R, Wagemakers M, Metzemaekers JDM, Groen RJM, et al. Emotion recognition in patients with low-grade glioma before and after surgery. Brain Sci. 2022;12(9):1259. pmid:36138995
- 70. Chess LE, Gagnier JJ. Applicable or non-applicable: investigations of clinical heterogeneity in systematic reviews. BMC Méd Res Methodol. 2016;16(1):19.
- 71.
Suspected neurological conditions: recognition and referral - suspected-neurological-conditions-recognition-and-referral-pdf-66141663923653 [Internet]. [cited 2024 June 21]. Available from: https://www.nice.org.uk/guidance/ng127/resources/suspected-neurological-conditions-recognition-and-referral-pdf-66141663923653