Correction
1 Oct 2013: de Paula JJ, Bertola L, Ávila RT, Moreira L, Coutinho G, et al. (2013) Correction: Clinical Applicability and Cutoff Values for an Unstructured Neuropsychological Assessment Protocol for Older Adults with Low Formal Education. PLOS ONE 8(10): 10.1371/annotation/2a374fe8-6d25-45cb-b97b-a5ca1529aa14. https://doi.org/10.1371/annotation/2a374fe8-6d25-45cb-b97b-a5ca1529aa14 View correction
Figures
Abstract
Background and Objectives
The neuropsychological exam plays a central role in the assessment of elderly patients with cognitive complaints. It is particularly relevant to differentiate patients with mild dementia from those subjects with mild cognitive impairment. Formal education is a critical factor in neuropsychological performance; however, there are few studies that evaluated the psychometric properties, especially criterion related validity, neuropsychological tests for patients with low formal education. The present study aims to investigate the validity of an unstructured neuropsychological assessment protocol for this population and develop cutoff values for clinical use.
Methods and Results
A protocol composed by the Rey-Auditory Verbal Learning Test, Frontal Assessment Battery, Category and Letter Fluency, Stick Design Test, Clock Drawing Test, Digit Span, Token Test and TN-LIN was administered to 274 older adults (96 normal aging, 85 mild cognitive impairment and 93 mild Alzheimer`s disease) with predominantly low formal education. Factor analysis showed a four factor structure related to Executive Functions, Language/Semantic Memory, Episodic Memory and Visuospatial Abilities, accounting for 65% of explained variance. Most of the tests showed a good sensitivity and specificity to differentiate the diagnostic groups. The neuropsychological protocol showed a significant ecological validity as 3 of the cognitive factors explained 31% of the variance on Instrumental Activities of Daily Living.
Citation: de Paula JJ, Bertola L, Ávila RT, Moreira L, Coutinho G, de Moraes EN, et al. (2013) Clinical Applicability and Cutoff Values for an Unstructured Neuropsychological Assessment Protocol for Older Adults with Low Formal Education. PLoS ONE 8(9): e73167. https://doi.org/10.1371/journal.pone.0073167
Editor: Karl Herholz, University of Manchester, United Kingdom
Received: March 31, 2013; Accepted: July 17, 2013; Published: September 16, 2013
Copyright: © 2013 de Paula et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by the following grants: CBB-APQ-00075-09 from FAPEMIG, 573646/2008-2 from CNPq, and APQ-01972/12-10, APQ-02755-10 from FAPEMIG. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The neuropsychological evaluation plays an important role in the differential diagnostic between normal and pathological aging cognitive processes [1]. It is of particular relevance to differentiate subjects with mild cognitive impairment (MCI) from those in the early stages of dementia, e.g. mild Alzheimer's disease (AD), when cognitive screening tests are not sensitive for the differential diagnosis [2]. The neuropsychological evaluation usually presents similar or greater sensitivity and specificity for the identification of AD versus MCI when compared to other diagnostic procedures. For instance, in a recent study the neuropsychological assessment showed higher accuracy (84%) to differentiate MCI from AD patients, followed by structural Magnetic Resonance Imaging (82%), PET-FDG (76%), and cerebrospinal fluid biomarkers (73%) [3]. The combinations of different procedures increase the diagnosis accuracy, although the estimated additional gain in effect sizes were small.
Formal education has a major impact in the performance on cognitive tests and can bias the interpretation of test results. Educational level influences the performance on cognitive screening test, such as the Mini-Mental State Examination and the Category Fluency Test, and cut-off scores for dementia diagnosis based on the educational level have been widely used [4], [5]. The performance on structured cognitive assessment batteries for diagnosis of dementia, such as the Mattis Dementia Rating Scale [6], the CERAD Battery [7], and the CAMCOG [8] is also influenced by educational level. Educational attainment can also affect the performance on neuropsychological tests that evaluate specific cognitive domains. Previous studies showed that the performance on several neuropsychological tests designed to assess language, episodic memory, and executive function is significantly biased by education [1], [9]–[13]. In developing countries, this is a very important issue, given the high proportion of older adults with no or few years of formal education [14]. It is, therefore, of utmost importance to develop and adapt neuropsychological batteries taking into account the effect of formal education to reduce the risk of bias and misclassification of subjects.
In clinical neuropsychology the use of an unstructured assessment protocol allows the clinician to carefully choose the neuropsychological tests according to a cognitive model and his clinical hypothesis, mapping different cognitive domains in a comprehensive way [1]. However, there few studies evaluating the psychometric properties of neuropsychological instruments for older adults with low formal education. The present study aims to investigate the psychometric properties of a neuropsychological assessment protocol designed for the evaluation of older adults with low educational level. We assessed its factor structure, criterion-related validity and ecological validity. In addition, we proposed cut-off scores to discriminate the diagnostic groups (AD, MCI and normal aging).
Materials and Methods
Participant's recruitment and assessment
In the present study 274 consecutive older adults were assessed. Participants were enrolled in an ongoing work evaluating the relationship of depression and dementia in the elderly. The participants or caregivers who did not show interest in joining the study were referred and treated normally by the patient service center, not suffering any burden with the non-participation. This study was approved by the local Ethics Committee (registry 334/06) and carried out in accordance with the Helsinki declaration. All the participants (and caregivers for patients with suspected dementia) gave written consent for the participation. Participants with less than 60 years, previous history of neurological or psychiatric disorders (except for depression), use of typical and atypical antipsychotics, evidence of major vascular events on brain computed tomography scans, severe sensorial or motor impairments or other clinical conditions which may influence the neuropsychological performance (such as hypothyroidism or B12 vitamin depletion), history of alcohol or other substance abuse and patients which a close caregiver was not present on the assessment were excluded from the present study.
All subjects underwent a comprehensive gerontological evaluation which included the cognitive assessment with the administration of the Mattis Dementia Rating Scale [6], the Mini-Mental State Examination [4], the Verbal Learning test of the CERAD Neuropsychological Battery [7], the Clinical Dementia Rating [15]. Depressive symptoms were assessed by the Short-Version of the Geriatric Depression Scale (GDS-15) [16]. Formal education assessed in the initial clinical interview was reported in years, discounting repetitions. Participants with less than one year and unable to read or write simple sentences were considerate illiterates. Participants which, do not have formal schooling, but were able to read and write were classified with one year of formal education.
The performance on neuropsychological tests used for diagnosis was interpreted based on cut-off values for the Mini-Mental State Examination (18 points for illiterate, 23 points for participants with 1 to 7 years of formal education and 26 for participants with 8 years or more). For the Mattis Dementia Rating total score and Subscales the “-2 Standard-Deviations” guideline (based on normative values stratified by education) was used. For the CERAD Neuropsychological Battery, we adopted as cut-off the first quartile stratified by education, following Nitrini and colleagues [7] recommendations. The procedure stratifies formal education in Illiterate, Low Educated Literate (less than 4 years of formal education) or Standard Educated Literate (4 or more years of formal education). The lower quartile has the following values: Immediate recall (Illiterate = 3, Low Educated Literate = 4, Standard Educated Literate = 5), Delayed Recall (Illiterate = 3, Low Educated Literate = 4, Standard Educated Literate = 4).
Neurocognitive status was adjudicated at expert multidisciplinary meetings, taking into account all clinical, cognitive assessment, laboratorial, and neuroimaging data when available. Functional status was investigated based on caregiver's reports about activities of daily living and by the functional components of the Clinical Dementia Rating [15]. The performance on cognitive tests was adjusted for age and educational status, based on Brazilian norms for each test. Alzheimer's disease was diagnosed according to the NINCDS-ADRDA [17] guidelines. The diagnosis of MCI was made according to Mayo Clinic criteria [18] as follows: 1) subjective cognitive complaint, preferably corroborated by an informant; 2) objective impairment in the performance on cognitive tests of the CERAD Neuropsychological Battery and on the Mattis Dementia Rating Scale, but not severe enough to reach dementia diagnosis; 3) preserved global cognitive function (Mini-Mental State Examination scores above the cutoff for dementia based on formal education); 4) preserved or minimal impairments in activities of daily living 5) not demented.
A total of 85 subjects were identified as MCI and 93 with AD. Ninety-six subjects with no evidence of cognitive impairment were included as a comparison group (“normal cognitive aging – NA” group). Normal aging and MCI participants had MMSE scores above the cutoff for dementia according to formal education [4]. Considering the cutoff 5/6 (case/non case) on the Geriatric Depression Scale, 35% of the NA, 26% of MCI and 29% of AD participants has significant depressive symptoms.
Neuropsychological Assessment
The protocol used in the present study was designed to assess episodic memory, attention, executive functions, visuospatial abilities and language. It was designed to be fully administered in one session of 90 minutes, increasing its usefulness in the clinical contexts where the time and human resources for the neuropsychological assessment are scarce. The tests were selected based on Brazilian studies which investigated their psychometric properties on older adults with low formal education. Two neuropsychologists (LFM-D and JJP) searched the Brazilian and international literature for neuropsychological tests which: 1) may be suitable for older adults with low formal education (e.g.: avoiding reading or calculation, complex drawing and fine motor coordination); 2) have previous studies reporting, at least partially, validity for this population, 3) could be all applied on a 90 minutes assessment section, 4) tests did not have copyright agreements, with stimuli and application procedures freely available. The following tests were selected:
Rey Auditory Verbal Learning Test (RAVLT): a measure of episodic memory containing five learning trials of a 15 word list followed by a distractor, an immediate recall (RAVLT IR), a 25-minutes delayed recall (RAVLT DR) and a recognition Trial (RAVLT Rec). The Brazilian version of the test proposed by Malloy-Diniz and colleagues [9] and validated for older adults [11] was chosen for the present study. The RAVLT has good criterion validity for the diagnosis of neurocognitive disorders in older adults, such as AD, MCI and major depression, according to a recent review [19].
Frontal Assessment Battery: designed as a bedside screening test for frontal-executive impairment [20], this test is a brief and well validated screening test for older adults, assessing different executive components by six subtests (similarities, fluency, motor planning, selective attention, inhibitory control and environmental autonomy). One of the Brazilian versions was used and the total score adopted as variable, since it was previously validated and had adequate normative values [21]. The test performance is usually compromised in clinical conditions related to frontostriatal dysfunction, such as Frontotemporal dementia, Progressive Supranuclear Palsy and Parkinson's disease [20]. The battery shows moderate correlations with classical executive-functions tests [20]–[23].
Short version of the Token Test: this language comprehension test designed for the detection of aphasia involves verbal orders of increasing difficulty (input) and motor sequences on colored tokens (output). The short version (36 items) is adapted [24], validated [10] and has adequate normative data [13] for this population. The test was divided in two components for this study, based on the factor structure proposed on a previous report [10]: Token Test – Attention (items 1 to 15) and Token Test – Comprehension (items 16 to 36).
Category Fluency and Letter Fluency: The verbal fluency tests are classical screening tests for cognitive impairment, usually associated with the executive functions. Two categories and one letter were chosen for the protocol, based on the normative and validity studies for the Brazilian population: Animals [5], Fruits [12] and “S” [25] generated in one minute. The test is very sensitive for cognitive impairment in different clinical conditions [2], [10], [12].
Digit Span: a classical measure of verbal working memory, a cognitive process related to storage and manipulation of verbal information. Kessels, van den Berg, Ruis and Brands [26] suggest the use of a product score between the maximum span and the number of correct trials (2 per span) as a more general measure of working memory efficiency. A previous report validated this method for older adults with low formal education [22]. In AD, the phonological loop of the working memory (assessed by the Digit Span Forward) is usually preserved, while the executive components (assessed by Digit Span Backward) are slightly impaired [27].
Clock Drawing Test: A classical drawing task designed for the assessment of cognitive impairment in older adults and a widely used test for cognitive screening. The Shulman's [28] (0 to 5 points, higher scores represent better performance, pre-drawn circle). This version was chosen for the present study, since it's one of the most sensitive for neurocognitive disorders in the elderly [29].
Stick Design Test: a test used for the assessment of visuospatial abilities consisted of four bi-dimensional models where the subject must reproduce them using four matches [30]. The models differ in global configuration (open and closed models), alignments, angles and orientation of match heads. The test is a good alternative to drawing tasks, since for very low educated or illiterate individuals the more traditional constructional praxis tests may cause negative emotional reactions and very low scores [31]. The Stick Design Test shows good criterion validity for dementia, even superior to drawing tests in patients with very low formal education [32].
The Neuropsychological Investigations Laboratory Naming Test (TN-LIN): developed as a measure of naming abilities in children and older adults with low formal education [33]. Based on classical naming paradigms, the TN-LIN uses 65 black-white line drawings divided into nouns (40), verbs (10) and professions (15). The nouns are divided in objects (15), animals (10), food (5), transports (4), and clothes (5). The nouns (TN-LIN Nouns), verbs (TN-LIN Verbs) and professions (TN-LIN Professions) were used for further analysis.
Activities of Daily Living: we used the Basic Daily Life Activities Index and the Instrumental Daily Life Activities Index, based on the Katz [34] and Lawton [35] indexes respectively, to assess functional performance. Each activity of daily living was scored, based on information provided by a close caretaker, as “2” (no functional impairment), “1” (partial dependence of human help in performing the daily life activity) and “0” (complete dependence of human help on performing the daily life activity). Scores for basic activities range from 0–12 and instrumental activities from 0–16. The general score (0–28 points) was used in this study. Lower scores indicated greater impairment.
Statistical procedures
Performance on neuropsychological assessment tests and socio-demographic characteristics were assessed by one-way ANOVA, and the Sidak's post hoc test was used to assess pairwise group differences. Effect sizes for this analysis were computed by the eta-squared. Keeping in mind the hierarchical structure of the cognitive system [36], which leads to significant associations among neuropsychological measures, a principal axis factoring and an oblique (direct oblimin [37]) rotation were adopted, allowing the encountered factors to correlate. The criteria used for components formation include eigenvalues greater than 1 and convergent scree-plot analysis by two independent judges. The Keiser-Meyer-Olkim (KMO) test of sampling adequacy and the Bartlett's test of sphericity were used to assess the viability of the factor extraction. Cronbach's alpha of each factor was computed for the assessment of reliability. These procedures aims to assess if the proposed battery keeps its construct validity for the assessment of Executive Functions, Language, Memory and Visuospatial Abilities on the studied population, assuring it's clinical applicability. Another advantage of factor analysis is the reduction of the amount of test variables, reducing the probability of a Type 1 error on further analysis.
The ecological validity of the neuropsychological assessment was investigated by linear regression models, containing the ADL measures as dependent variables and the components of the factor analysis (extracted by the regression method and standardized based on the non-depressed normal aging participants scores) as predictors. We adopted stepwise procedures to reduce multicollinearity.
We carried out Receiver Operator Characteristic (ROC) curve analyses to compare the performance of each neuropsychological test to differentiate the diagnostic groups. Cutoffs for clinical use considering the best ration between sensitivity and specificity were calculated. Finally, we performed a multinomial logistic regression analysis, with diagnosis as dependent variable and the neuropsychological tests as independent variables; to evaluate which neuropsychological tests best differentiate the diagnostic groups. To reduce multicollinearity, we adopted a stepwise procedure (forward entry, entering criteria: 0.05 and exclusion criteria 0.10).
For the criterion related validity procedures, only participants with GDS-15 scores below 6 were selected. The Mini-Mental State Examination total score was included in the models, since the neuropsychological measures should have an addictive power with this screening measure for the patient's diagnosis. All the statistical procedures were performed on SPSS 19.0 (Chicago, IL) and statistical significance was set at α<5%.
Results
The three groups did not differ in clinical and socio-demographic and clinical characteristics. As expected, we found significant differences in the scores of all neuropsychological tests among diagnostic groups, with effect sizes ranging from small to large (Table 1).
The Neuropsychological battery formed four related factors (Table 2). The first factor was composed by tests related to verbal fluency, working memory and the Frontal Assessment Battery (Executive Functions Factor). The second component contained the three TN-LIN variables, a test designed to assess the naming skills (Language/Semantic Memory Factor). The third component contained the RAVLT items (Episodic Memory Factor). The last component contained tests designed to assess visuospatial abilities, visual search (Visuospatial Abilities Factor). Unexpectedly, a verbal comprehension test was also present in this fourth factor. These four factors explained 65% of the total variance. The internal consistency of the individual factors and the protocol as a whole was 0.83 satisfactory.
The ecological validity of the neuropsychological assessment was assessed by a stepwise linear regression model. The model was significant (F = 40.65, p<0.001, R2 = 31%) and contained three steps. The final model (third step) consisted of Executive Functions (β = 0.27, p<0.001), Episodic Memory (β = 0.20, p = 0.002) and Language/Semantic Memory (β = 0.23, p = 0.006), but not Visuospatial abilities (β = −0.11, p = 0.116). Figure 1 shows the relationship between the standardized predictors and the functional measure.
Legend: the four components extracted on the factor analysis (Episodic Memory, Executive Functions, Language/Semantic Memory and Visuospatial Abilities) were used as independent predictors of older adults performance on Activities of Daily Living. Three of the four components (excluding Visuospatial Abilities) explained about 30% of functional performance variance.
Table 3 shows the cut-off values for differentiating the diagnostic groups. All neuropsychological tests showed good sensitivity and specificity values to discriminate between NA and AD participants. Nonetheless, we observed that the sensitivity and specificity of the neuropsychological tests for discriminating NA vs. MCI, and MCI vs. AD were lower than those found for NA vs. AD.
The multinomial logistic regression model, which seeks to correctly classify the participants (considering the Normal Aging group as reference), was significant (−2 Log Likelihood = 198.10, χ2 = 221.43, p<0.001, R2 = 78%). Six steps were performed by the model starting with RAVLT-DR (χ2 = 114.43, p<0.001), then adding, Mini-Mental State Examination (χ2 = 44.02, p<0.001), Category Fluency Animals (χ2 = 30.76, p<0.001), RAVLT-Rec (χ2 = 13.33, p<0.001), TN-LIN-Nouns (χ2 = 12.05, p = 0.002) and the Frontal Assessment Battery (χ2 = 6.83, p = 0.033). The participant's classification, considering chance, the final regression model and error are shown in Figure 2.
Legend: increase on the classification rate of the participants by the use of different neuropsychological tests. The final model contains tests of general cognitive function (Mini-Mental State Examination), Episodic Memory (Delayed Recall and Recognition from the Rey Auditory-Verbal Learning Test), Executive Functions (Category Fluency Test “Animals” and the Frontal Assessment Battery) and Language/Semantic Memory (Laboratory of Neuropsychological Investigations Naming Test “Nouns”). Considering its general accuracy the protocol improves the classification rate of the participant's in 47%, starting at chance (33%). Its accuracy is greater for the identification of normal Aging (54%) followed by AD (47%) and MCI (42%), which reflect the intermediate condition of this last group.
Discussion
Our results suggest that this neuropsychological protocol has appropriate psychometric properties and can be used in the assessment older adults with low educational level. The factor analysis indicated a four component model related to Executive Functions, Language/Semantic Memory, Episodic Memory and Visuospatial Abilities, suggesting that the selected neuropsychological tests retain its construct validity for the assessment of older adults with low formal education. The structure is very similar to our a priori hypothesis, differing slightly on two neuropsychological measures. The neuropsychological tests performed well to differentiate healthy adults from MCI and AD patients and the performance on these tests were correlated to functional performance. These results indicate a good criterion related and ecologic validity of this neuropsychological battery.
The factor analysis showed a four factor structure for the neuropsychological battery (Executive Function, Language/Semantic memory, Episodic memory, and Visoespacial abilities). This is in accordance with the expected protocol structure given the tests chosen included in the neuropsychological protocol. Therefore, our results show that this protocol has good construct validity and is appropriate for administration in older adults with low educational level. This is particularly important as most of these tests were developed in countries with population with higher educational attainment level.
Three of the four cognitive components of our study correlated with functional performance and only visuospatial abilities were not correlated with functional performance. Previous studies, nonetheless, reported significant associations between visuospatial tests and functional measures [38], [39]. We delineate three hypotheses for the lack of significance. First, this factor has shown relatively low variance, since more pronounced visuospatial impairment is unlikely in normal aging, MCI and AD. The tests related to this factor are heterogeneous, and in all of them, there was a tendency for ceiling effects reducing the variance of this cognitive component. Finally, the IADLs assessed in this study are poorly related to spatial orientation, navigating, perception and spatial processing, with only one demanding a greater loading of spatial abilities (go out alone to distant locations using transport) [35]. These factors might have contributed to the lack of significant association between visoespacial abilities and functional performance. The analysis of the protocol ecological validity contributes for a topic usually neglected on the study of more traditional neuropsychological measures and might be useful from a prospective view, estimating environmental needs of the patients and guiding rehabilitation routines [22].
This neuropsychological protocol showed good criterion related validity, and the cutoff values found on this study could be used on clinical setting for discriminating AD, MCI and healthy older subjects. The best sensitivity and specificity values were observed for AD vs. healthy controls. The sensitivity and specificity for AD vs. MCI and MCI vs. NA was lower than those observed for AD vs. NA, but still at an acceptable range to be used in clinical practice. Our results are in accordance with other studies, with minor differences in the proposed cut-off value, and differences might be explained by sample particularities [2], [5], [10], [12]. Interestingly, our results are similar to those found in another Brazilian study which examined an elderly population with higher educational level and used a different neuropsychological protocol [2]. In this study, the authors also report that the best sensitivity and specificity values were observed for differentiating AD from healthy controls. The sensitivity and specificity for discriminating AD from MCI, and MCI from NA were lower. These results suggest that the identification of MCI and its differentiation from healthy older adults and early AD subjects are major challenges in clinical practice. The development of novel neuropsychological tests and protocols as well as the evaluation of combined tools and methods specifically designed for the diagnosis of MCI is necessary to improve our ability to make an accurate and early identification of these subjects.
The neuropsychological assessment protocol proposed by this study significantly improved the classification of the three groups. A multinomial regression model included tests of delayed and recognition memory (RAVLT), global cognitive functioning (Mini-Mental State Examination), executive functions (Category Fluency Animals and FAB) and language/semantic processing (TN-LIN Nouns). These results support the hypothesis that adding cognitive tests of different cognitive domains increase diagnostic power [40]. The accuracy, however, was lower than in other studies, such as Schmand and colleague [3]. Our analysis involves three different groups hypothetically defined as a continuum (NA – MCI – AD) and the cognitive boundaries of each one are largely superimposed. In a previous study, we found large effect sizes when AD patients and normal controls were compared using Token Test raw scores, however, when scaled scores based on population norms were adopted the effect sizes were only moderate [10]. We believe the proposed cutoff scores of our study might improve the clinical applicability of these measures on participants with low formal education.
Our study was performed with a very particular and vulnerable population, and the proposed cutoff scores might improve the clinical use of the neuropsychological testes for patients with similar characteristics. In this sense, the study is clinically relevant, with different cutoffs for several neuropsychological tests for three different comparisons, and could be used along with other methods to the diagnosis of AD and MCI, as well for the differentiation of these two conditions. However the cutoffs must be used cautiously, since the accuracy of each test independently is usually moderate, especially on the MCI x AD differentiation.
Limitations
The present results should be viewed in light of study limitations. This is a cross-sectional study and the MCI patients were not followed-up to assess the progression to dementia. Previous studies suggest that there are significant baseline differences in cognitive performance between MCI converters and non-converters what may significantly influence the definition of cut-off scores to differentiate MCI from normal aging and dementia subjects [40], [41], [42]. The participants were recruited from a geriatric outpatient clinic and the present results may not be generalized to the general population. Additional studies with independent and community-based samples are necessary to evaluate and validate the psychometric properties and the proposed cut-off scores for the neuropsychological protocol.
Conclusion
The present study shows strong evidence of the validity of a neuropsychological protocol designed for the cognitive assessment of older adults with low educational level. The measures are valid for the assessment of executive functions, language, memory and visuospatial abilities. It has good accuracy for the diagnosis of AD and MCI patients. Future studies are necessary to replicate these finding, to verify its applicability under other clinical conditions and to develop population-based norms for this protocol.
Acknowledgments
We would like to thank the geriatricians, gerontologists and neuropsychologists from the Instituto Jenny Faria de Atenção à Saúde do Idoso for the patient's assessment and Care Planning.
Author Contributions
Conceived and designed the experiments: JJP LB RTA LM GC ENM MACB RN BSD LFMD. Performed the experiments: JJP LB RTA LM GC ENM MACB RN BSD LFMD. Analyzed the data: JJP LFMD. Contributed reagents/materials/analysis tools: JJP LB RTA LM GC ENM MACB RN BSD LFMD. Wrote the paper: JJP LB RTA LM GC ENM MACB RN BSD LFMD.
References
- 1. Salmon DP, Bondi MW (2009) Neuropsychological Assessment of Dementia. Annu Rev Psychol 60: 257–282.
- 2. Diniz BS, Yassuda MS, Pereira FS, Flaks MK, Viola LF, et al. (2008) Mild cognitive impairment: cognitive screening or neuropsychological assessment? Rev Bras Psiquiatr 30(4): 316–321.
- 3. Schmand B, Eikelenboom P, van Gool WA, Alzheimer's Disease Neuroimaging Initiative (2011) Value of neuropsychological tests, neuroimaging, and biomarkers for diagnosing Alzheimer's disease in younger and older age cohorts. J Am Geriatr Soc 59(9): 1705–1710.
- 4. Brucki SM, Nitrini R, Caramelli P, Bertolucci PHF, Okamoto IH (2003) Sugestões para o Uso do Mini-Exame do Estado Mental no Brasil. Arq Neuropsiquiatr 61(3B): 777–781.
- 5. Brucki SMD, Malheiros SMF, Okamoto IH, Bertolucci PHF (1997) Dados normativos para o teste de fluência verbal categoria animais em nosso meio. Arq Neuropsiquiatr 55(1): 56–61.
- 6. Porto CS, Fichman GC, Caramelli P, Bahia VS, Nitrini R (2003) Brazilian version of the Mattis Dementia Rating Scale: Diagnosis of mild dementia in Alzheimer's disease. Arq Neuropsiquiatr 61(2B): 339–345.
- 7. Nitrini R, Caramelli P, Herrera E Jr, Porto CS, Charchat-Fichman H, et al. (2004) Performance of illiterate and literate nondemented elderly subjects in two tests of long term memory. J Int Neuropsychol Soc 10: 634–638.
- 8. Aprahamian I, Diniz BS, Izbicki R, Radanovic M, Nunes PV, et al. (2011) Optimizing the CAMCOG test in the screening for mild cognitive impairment and incipient dementia: saving time with relevant domains. Int J Geriatr Psychiatry 26(4): 403–408.
- 9. Malloy-Diniz LF, Lasmar VAP, Gazinelli LSR, Fuentes D, Salgado JV (2007a) The Rey Auditory-Verbal Learning Test: applicability for the Brazilian elderly population. Rev Bras Psiquiatr 29(4): 324–329.
- 10. de Paula JJ, Bertola L, Nicolato R, Moraes EN, Malloy-Diniz LF (2012a) Evaluating Language Comprehension in Alzheimer's disease: the use of the Token Test. Arq Neuropsiquiatr 70(6): 435–440.
- 11. de Paula JJ, Cunha LMP, Nicolato R, Moraes EN, Bicalho MA, et al. (2012b) Reliability and construct validity of the Rey-Auditory Verbal Learning Test in Brazilian elders. Rev Psiquiatr Clín 39(1): 19–23.
- 12. de Paula JJ, Schlottfeldt CG, Moreira L, Cotta M, Bicalho MA, et al. (2010) Psychometric properties a brief neuropsychological protocol for use in geriatric populations. Rev Psiquiatr Clín 37(6): 251–255.
- 13. Moreira L, Schlottfeldt CG, de Paula JJ, Daniel MT, Paiva A, et al. (2011) Normative study of the Token Test (short version): preliminary data for a sample of Brazilian seniors. Rev Psiquiatr Clín 38(3): 97–101.
- 14.
Ministério do Planejamento, Orçamento e Gestão. (Instituto Brasileiro de Geografia e Estatística IBGE). Contagem Populacional. Available: Http://www.censo2010.ibge.gov.br/resultados_do_censo2010.php/. Accessed: 20 Jun 2013.
- 15. Morris JC (1993) The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology 43(11): 2412–2414.
- 16. Sheik J, Yesavage J (1986) Geriatric Depression Scale (GDS): recent evidence and development of a shorter version. Clin Gerontol 5: 165–172.
- 17. McKhann G, Drachman D, Folstein M, Katzman R, Price D, et al. (1984) Clinical diagnosis of Alzheimer's disease: report of the NINCDS-ADRDA work group under the auspices of department of health and human services task force on Alzheimer's disease. Neurology 34(7): 939–944.
- 18. Petersen RC, Doody R, Kurz A, Mohs RC, Morris JC, et al. (2001) Current concepts in mild cognitive impairment. Arch Neurol 58(12): 1985–1992.
- 19. Cotta MF, Malloy-Diniz LF, Nicolato R, Moraes EN, Rocha FL, et al. (2012) The Rey Auditory-Verbal Learning Test (RAVLT) on the differential diagnosis of normal and pathological aging. Contextos Clínicos 5(1): 10–25.
- 20. Dubois B, Slachevsky A, Litvan I, Pillon B (2000) The FAB: A frontal assessment battery at bedside. Neurology 55: 1621–1626.
- 21. de Paula JJ, Moura SM, Bocardi MB, Moraes EN, Malloy-Diniz LF, et al. (2013) Screening for executive dysfunction with the Frontal Assessment Battery: psychometric properties analysis and representative normative data for Brazilian older adults. Psicologia em Pesquisa 7(1): 89–98.
- 22. de Paula JJ, Malloy-Diniz LF (2013) Executive functions as predictors of functional performance in mild Alzheimer's dementia and mild cognitive impairment elderly. Estud psicol 18(1): 117–124.
- 23. de Paula JJ, Moreira L, Nicolato R, de Marco LA, Correa H, et al. (2012c) The Tower of London Test: Different Scoring Criteria for Diagnosing Alzheimer's disease and Mild Cognitive Impairment. Psychol Rep 110(2): 477–488.
- 24. Fontanari J (1989) O Token Test: elegância e concisão na avaliação da compreensão do afásico. Validação da versão de De Renzi para o Português. Neurobiologia 52(3): 167–176.
- 25. Senhorini MC, Amaro Júnior E, de Mello Ayres A, de Simone A, Busatto GF (2006) Phonemic fluency in Portuguese-speaking subjects in Brazil: ranking of letters. J Clin Exp Neuropsychol 28(7): 1191–1200.
- 26. Kessels RPC, van den Berg E, Ruis C, Brands AMA (2008) The Backward Span of the Corsi Block-Tapping Task and Its Association with the WAIS-III Digit Span. Assessment 15(4): 426–434.
- 27. Huntley JD, Howard RJ (2010) Working memory in early Alzheimer's disease: a neuropsychological review. Int J Geriatr Psychiatry 25(2): 121–132.
- 28.
Shulman KI (2000) Clock-drawing: Is it the ideal cognitive screening test? Int J Geriatr Psychiatry, 15(6), 548–561.
- 29. Tuokko H, Hadjistavropoulos T, Rae S, O'Rourke N (2000) A comparison of alternative approaches to the scoring of clock drawing. Arch Clin Neuropsychol 15: 137–148.
- 30. Baiyewu O, Unverzagt FW, Lane KA, Gureje O, Ogunniyi A, et al. (2005) The Stick Design test: A new measure of visuoconstructional ability. J Int Neuropsychol Soc 11(5): 598–605.
- 31. Unverzagt FW, Morgan OS, Thesiger CH, Eldemire DA, Luseko J, et al. (1999) Clinical utility of CERAD neuropsychological battery in elderly Jamaicans. J Int Neuropsychol Soc 5: 255–259.
- 32.
de Paula JJ, Costa MV, Bocardi MB, Cortezzi MC, Moraes EN, et al.. (2013) The Stick Design Test on the Assessment of older adults with low formal Education: evidences of construct, criterion-related and ecological validity. Int Psychogeriatr epub ahead of print.
- 33. Malloy-Diniz LF, Bentes RC, Figueiredo PM, Brandão-Bretas D, Costa-Abranches S, et al. (2007) Normalización de una batería de tests para evaluar las habilidades de comprensión del lenguaje, fluidez verbal y denominación en niños brasileños de 7 a 10 años: resultados preliminares. Rev Neurol 44(5): 275–280.
- 34. Katz S, Ford AB, Moskowitz RW, Jackson BA, Jaffe MW (1963) Studies of illness in the aged. The index of ADL: a standardized measure of biological and psychosocial function. JAMA 185(12): 914–919.
- 35. Lawton MP, Brody EM (1969) Assessment of older people: Self-Maintaining and Instrumental Activities of Daily Living. Gerontologist 9: 179–185.
- 36. Salthouse TA (2003) Localizing age-related individual differences in a hierarchical structure. Intelligence 32: 541–561.
- 37.
IBM Corp Released 2010. IBM SPSS Statistics for Windows, Version 19.0. Armonk, NY: IBM Corp.
- 38. Farley KL, Higginson CI, Sherman MF, MacDougall E (2011) The ecological validity of clinical tests of visuospatial function in community-dwelling older adults. Arch Clin Neuropsychol 26(8): 728–738.
- 39. Davies SR, Field AR, Andersen T, Pestell C (2011) The ecological validity of the Rey-Osterrieth Complex Figure: predicting everyday problems in children with neuropsychological disorders. J Clin Exp Neuropsychol 33(7): 820–31.
- 40. Forlenza OV, Diniz BS, Talib LL, Radanovic M, Yassuda MS, et al. (2010) Clinical and biological predictors of Alzheimer's disease in patients with amnestic mild cognitive impairment. Rev Bras Psiquiatr. 32(3): 216–22.
- 41. Cui Y, Liu B, Zhen X, Fan M, Liu T, et al. (2011) Identification of Conversion from Mild Cognitive Impairment to Alzheimer's Disease Using Multivariate Predictors. PLoS One 6(7): e21896.
- 42. Zhang D, Shen D, the Alzheimer's Disease Neuroimaging Initiative (2011) Predicting future clinical changes in MCI patients using longitudinal and multimodal biomarkers. PLoS One 7(3): e33182.