It is difficult to longitudinally characterize cognitive impairment in amyotrophic lateral sclerosis (ALS) due to motor deficits, and existing instruments aren’t comparable with assessments in other dementias.
The ALS Brief Cognitive Assessment (ALS-BCA) was validated in 70 subjects (37 with ALS) who also underwent detailed neuropsychological analysis. Cognitive predictors for poor survival were then analyzed in a longitudinal cohort of 171 ALS patients.
The ALS-BCA was highly sensitive (90%) and specific (85%) for ALS-dementia (ALS-D). ALS-D patients had shorter overall survival, primarily due to the poor survival among ALS-D patients with disinhibited or apathetic behaviors after adjusting for demographic variables, ALS site of onset, medications, and supportive measures. ALS-D without behavioral changes was not a predictor of poor survival.
Citation: Hu WT, Shelnutt M, Wilson A, Yarab N, Kelly C, Grossman M, et al. (2013) Behavior Matters—Cognitive Predictors of Survival in Amyotrophic Lateral Sclerosis. PLoS ONE 8(2): e57584. https://doi.org/10.1371/journal.pone.0057584
Editor: Weidong Le, Baylor College of Medicine, Jiao Tong University School of Medicine, United States of America
Received: October 5, 2012; Accepted: January 23, 2013; Published: February 27, 2013
Copyright: © 2013 Hu et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by the Viretta Brady Discovery Fund at Emory University School of Medicine, and NIH AG025688. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Amyotrohpic lateral scleorsis (ALS) is a progressive neurodegenerative disorder that affects motor and extra-motor systems, and shares the pathologic hallmark of neuronal inclusions immunoreactive to TAR-DNA binding protein of ∼43 kD (TDP-43) with many cases of frontotemporal degeneration (FTD). ,  About 15% of ALS patients may develop dementia (ALS-D) that resembles FTD, ,  and FTD in ALS is associated with poor survival.– While detailed neuropsychological analysis can identify cognitive impairment in ALS in the research setting, such evaluation on a routine clinical basis is challenging because of the length of evaluation, patient fatigue, and motor-dependent tasks during testing. An abbreviated protocol that rapidly identifies ALS-D patients, tracks the severity of cognitive impairment over time, and has comparable performance in other dementias would significantly advance the understanding of ALS-D.
ALS patients can also develop mild cognitive impairment (ALS-CI) detectable on detailed neuropsychological analysis. Studies on ALS-CI and survival have generated conflicting findings, ,  and the clinical utility of identifying ALS-CI remains unknown due to poor diagnostic sensitivity by available instruments.  We previously developed the Philadelphia Brief Assessment of Cognition that accurately detects and tracks cognitive deficits in FTD,  and PBAC is also used in the clinical diagnosis of mild cognitive impairment (MCI) and Alzheimer’s disease (AD). We have modified the PBAC into a 5-item ALS Brief Cognitive Assessment (ALS-BCA) by combining tests sensitive for executive and memory dysfunctions with a validated behavioral screen (Frontal Behavioral Inventory, FBI).  The ALS-BCA can be administered to ALS patients with variable dysarthria and limb weakness, and here we validated this instrument in 70 subjects (with and without ALS) who also underwent detailed neuropsychological analysis and diagnostic formulation through a consensus mechanism. We then applied the validated ALS-BCA to a large cohort of consecutive ALS patients to assess their executive function, language, memory, and behavior, and determined the differential effect of ALS-D, ALS-CI, and cognitive impairment subtype on survival in ALS.
Two cohorts of subjects were included in the current study, and all were diagnosed with possible, probable, or definite ALS.  This study was approved by the Emory University Institutional Review Board. The validation cohort included 37 ALS patients evaluated and longitudinally followed at the Emory ALS Center, and 43 healthy subjects longitudinally followed at the Emory Alzheimer’s Disease Research Center with normal cognition and behavior. All subjects independently underwent cognitive evaluation using the ALS-BCA and, on a separate day within 3 months, an in-depth neuro-cognitive evaluation consisting of structured neuropsychological analysis, language evaluation, and diagnostic formulation through a consensus mechanism. Written informed consents were obtained from all subjects or their legal representatives in the validation cohort. The longitudinal cohort consisted of 171 ALS patients serially followed at the Emory ALS Center on a regular interval (every 3–4 months), including 20 subjects from the validation cohort. There was no significant (p>.05) difference in age, disease duration, and cognitive performance between subjects from the validation cohort who were or were not part of the longitudinal analysis (data not shown). The ALS-BCA was administered as part of their clinical evaluation, and their ALS-BCA performance was retrospectively reviewed (WH, MS, and AW). As part of their initial clinical evaluation, all patients from the longitudinal cohort underwent structured interview for demographic information (including time and site of onset, family history of ALS/FTD), neurological examination, functional assessment using the revised ALS Functional Rating Scale (ALSFRS-R),  breathing assessment for forced expiratory volume (FEV) as a percentage of predictive value, electromyography to determine denervation, and blood tests and MRI to exclude other causes of progressive motor symptoms. All subsequent visits were reviewed (WH) to determine whether a patient was started on ALS therapies, including riluzole, non-invasive positive pressure ventilation (NPPV), and percutaneous endoscopic gastrostomy (PEG). Death information was obtained from clinical records for 59 patients and from local obituaries for 2 patients.
2. Cognitive Evaluation
The ALS-BCA is a 5-item assessment that evaluates a subject’s executive functions (working memory, set-shifting), frontally-mediated language function, delayed verbal recall, and behaviors common in FTD (Figure 1). Four items were derived from the PBAC for their association with FTD: ,  for executive function, working memory and the capacity for effective mental manipulation was assessed with the Reverse Digit Span subtest where subjects are given trials consisting of 2 to 7 numbers and the Oral Trail Making Test  where subjects are asked to verbally alternate between numbers and letters (i.e., 1-A-2-B, etc.); for frontally-mediated language function, subjects are asked to generate as many words as possible that begin with “F” within one minute; for delayed free recall, subjects are asked to repeat a list of six words for three separate trials, and then recall all words after a brief delay. For anarthric patients, a modified protocol omitting oral trails is performed (Figure 1). Performance of healthy subjects from the validation cohort was used to establish a norm for the ALS-BCA, with −1.5 standard deviation below the mean as the cut-off for abnormal scores. ALS subjects had abnormal performance if they had the following: delayed recall at 40% or less of Trial 3 learning, reverse digit span at 3 or below, letter-guided fluency of 8 words or less in one minute, and oral trails performance of 42 or less. Lastly, for all subjects, a behavioral questionnaire (FBI)  is administered to the caregiver to assess behavioral and personality changes from baseline (with permission from Dr. A. Kertesz). The FBI is a 24-item caregiver questionnaire that rates the severity of behavioral symptoms common in FTD, including 12 items addressing disinhibited behaviors and 12 items addressing negative behaviors. Each item is rated from 0 to 3 according to severity (0 = never, 1 = mild or occasional, 2 = moderate, 3 = severe or very frequent), and previous work has shown that FTD patients have greater total scores than patients with AD, depression, or vascular dementia. .
For patients who have mild to moderate dysarthria, they are instructed to proceed with word list learning, reverse digit span, word list recall, letter fluency, and oral trails (see Methods). For patients who have severe dysarthria or anarthria, a modified ALS-BCA is administered as follows: for learning and recall, subjects write or type the first letter of each word during learning, and write down the whole words during delayed free recall; for reverse digit span, subjects write down the numbers in reverse order; for letter-guided fluency, subjects write as many F-words as possible until they give up or until 16 words have been generated. Oral trails is omitted for these patients.
Subjects in the validation cohort underwent detailed neuropsychological analysis according to the procedures of the Alzheimer Disease Centers Uniform Data Set,  including tests of attention and executive functions (forward and reverse digit span,  Trail Making Test A & B,  similarities ), verbal encoding and retrieval, language (category fluency,  and the 30-item Boston Naming Test for confrontation naming ). Tests for letter-guided fluency,  visual encoding and retrieval (Brief Visuospatial Memory Test-Revised),  and visual spatial relations (judgment of line orientation test)  were also performed according to standard protocols. The raw score for each patient was converted to age-, gender-, and education-adjusted Z-scores, and a Z-score at or below −1.5 was considered abnormal. Findings from the clinical history, neurological examination (including degree of dysarthria and limb weakness), and neuropsychological analysis were then used to derive a consensus diagnosis of normal cognition, ALS-CI, or ALS-D. Specifically, neurologists and one neuropsychologist will assess the history, number of abnormal cognitive tests and domains for each subject, determine the relationship between the motor-dependent aspects of each test and individual patients’ motor deficits, functional deficits from motor weakness, and overall functional deficits to derive the diagnosis. ALS-CI was diagnosed when there were objective cognitive deficits but the deficits were not severe enough to cause functional deficits independent of the motor deficits, and ALS-D was diagnosed when there were sufficient cognitive deficits independent of motor findings to result in a functional decline from baseline. In the validation phase, we did not include patients who were completely mute or unable to write as they could not participate fully in traditional neuropsychological protocols.
3. Statistical Analysis
All statistical analysis using de-identified data was performed in SPSS 20.0 (Chicago, IL). Baseline comparisons between subjects with normal cognition, ALS-CI, and ALS-D were performed by Chi-squared tests for categorical variables and analysis of variance for continuous variables. Sensitivity and specificity of ALS-BCA for ALS-CI and ALS-D were determined by receiver-operating characteristics (ROC) curve analysis. Survival analysis was performed first by Kaplan-Meier analysis for the effect of ALS-CI or ALS-D, with p<0.01 as a threshold for significance at the ALS-BCA subtest level to adjust for multiple comparisons. Tests linked to poor survival were then analyzed in a Cox proportional hazards analysis to adjust for contribution from other factors, with age, gender, disease duration, and bulbar- vs. limb-onset were entered as fixed variables in the first step, and abnormal ALS-BCA test, FEV, rilutek use, NPPV use, PEG use, and family history entered in a forward likelihood ratio fashion.
1. Validation Cohort
In the validation cohort (n = 70, Table 1), ALS-D subjects were older and were more cognitive impaired than other ALS subjects. When all subjects were administered ALS-BCA, 2 or more abnormal subtest scores was associated with 90% sensitivity and 85.2% specificity for the prediction of ALS-D (area under the curve of 0.946, Figure 2), compared to 70% sensitivity and 55.6% specificity for a MMSE score below 26 (area under the curve of 0.746). The one ALS-D subject with fewer than 2 abnormal ALS-BCA subtests was a 40-year-old man with definite ALS, a FBI score of 38, and impaired confrontation naming (Z-score −1.60). He was given the consensus diagnosis behavioral variant FTD based on behavior changes without a psychiatric or medical explanation. For any clinically significant cognitive impairment (ALS-CI or ALS-D), 1 or more abnormal subtest scores on ALS-BCA had modest sensitivity (79.2%; 100% for ALS-D and 64% for ALS-CI) and specificity (69.2%) compared to MMSE score below 27 (sensitivity 62.5%, specificity 69.2%).
Areas under the curve are 0.946 for ALS-BCA and 0.746 for MMSE.
2. Longitudinal Cohort
The longitudinal cohort for survival analysis contained 171 consecutive ALS patients with a median follow-up of 9 months. At baseline, 25% of the ALS patients had impaired performance on two or more subtests (ALS-D), and 27% of the ALS patients had impaired performance on only one subtest (ALS-CI, Table 2). Impairments in letter-guided fluency (67% in ALS-D and 47% in ALS-CI) and reverse digit span (70% in ALS-D, 19% in ALS-CI) were common, with impairments on Oral Trails more common in ALS-D (70%) than ALS-CI (8%). Abnormal behavior was uncommon in both ALS-D (19%) and ALS-CI (11%). As a group, ALS-D patients were older at baseline, but otherwise were similar to the two other ALS groups according to gender, disease duration, site of onset, clinical ALS diagnosis,  family history, ALS-FRS, FEV, and use supportive measures (riluzole, NPPV, PEG).
61 ALS patients (36%) died during a median follow-up of 9 months. ALS-D patients had worse overall survival than non-demented ALS patients (p = 0.03, Figure 3), but ALS-CI was not associated with poorer survival compared to ALS patients with normal cognition (p = 0.463). 15 patients underwent neuropathologic evaluation after death, including 6 with normal cognition, 2 with ALS-CI, and 7 with ALS-D. Among these, 9/15 had diffuse cortical FTLD-TDP pathology, and 8/15 had some form of neuritic plaque and neurofibrillary tangle pathology (1 with probable AD, 5 with possible AD, and 2 with isolated tau pathology). There was no significant difference in cortical FTLD-TDP pathology and AD-related pathology according to cognitive or behavioral abnormalities. Classification of ALS-CI patients into dysexecutive (abnormal performance in reverse digit span, letter-guided fluency, or oral trails), amnestic (abnormal retrieval of encoded verbal information), and behavioral (abnormal FBI) subtypes did not reveal any subtype to be associated with worse survival (p = 0.482).
Top: ALS-dementia (ALS-D) patients have poorer survival than non-demented ALS patients (p = 0.03). Bottom: ALS-D patients with abnormal behavior had significantly worse survival than ALS-D patients with normal behavior and non-demented ALS patients (p<0.001).
To explore if one ALS-BCA subtest was the strongest predictor of poor survival, we performed Kaplan-Meier analysis on the longitudinal cohort according to normal or impaired performance in one of the five subtests (free verbal recall, reverse digit span, letter-guided fluency, oral trails, behavior). Abnormal behavior (FBI score of 23 or more) was strongly associated with poor survival (p<0.001), but survival was not influenced by impaired performance in delayed free recall (p = 0.130), reverse digit span (p = 0.08), letter-guided fluency (0.185), or oral trails (p = 0.123). When only ALS-D patients were analyzed, patients with abnormal FBI scores had significantly worse survival than patients with normal behaviors. After this dichotomization, ALS-D with normal behavior was no longer associated with poor survival (Figure 3). This was confirmed in a multi-variate Cox proportional hazards analysis (Statistical Analysis; Table 3), and entering additional variables such as the Clinical ALS diagnosis (definite, probable with laboratory support, probable, possible) resulted similar outcomes. ALS-D patients with abnormal behaviors (n = 8) scored higher on both the disinhibition and negative behavioral scores than ALS-D patients with normal behaviors (n = 35; mean score 10.1 vs. 2.69 for disinihibition, 21.5 vs. 6.89 for negative behavior, p<0.001 for each case). Further analysis revealed that compared to ALS-D patients with normal FBI scores, ALS-D patients with abnormal FBI scores additionally had shorter disease duration prior to cognitive assessment (1.94 yr vs. 3.38 yr, p = 0.02), but were otherwise similar in age, gender, site of onset, family history, ALS-FRS, riluzole use, NPPV use, and PEG use. Dividing the ALS-D patients with normal behaviors into dysexecutive, amnestic, and language subtypes did not reveal any impact of the main deficit type on survival.
A number of tools have been proposed for the diagnosis of ALS-D and ALS-CI given the overlap between ALS-D and FTD, but they serve primarily as screening instruments and are not in regular use in cognitive research. Here we modified a previously validated tool for FTD to derive the ALS-BCA, and demonstrated its high sensitivity and specificity for ALS-D in a large validation cohort. The applicability of ALS-BCA and the broader PBAC will enable the comparative analysis of cognitive decline between ALS and other motor-sparing disorders including FTD and AD. Furthermore, we prospectively used ALS-BCA in a larger longitudinal cohort to show ALS-D to be quite common, and the poor survival associated with ALS-D is primarily due to patients with abnormal behaviors while dementia without behavioral abnormalities did not significantly influence overall survival in ALS.
Cognitive impairment in ALS has recently become a focus of detailed clinical and neuropsychological research. , ,  Consensus criteria have been proposed for frontotemporal dysfunctions in ALS,  but the significance of making the diagnosis of ALS-CI or ALS-D in a disorder with high morbidity and mortality is unknown. Complicating matters further in the syndromic characterization of ALS patients with cognitive impairment are the evolving definition of behavioral variant FTD – and feature overlaps between behavioral and motor deficits (e.g., inertia due to behavior vs. weakness). While detailed neuropsychological evaluation in ALS centers with local neuropsychological expertise is possible, , ,  such practice is often not practical in most ALS clinics. Among traditional screening tools, the MMSE is poorly sensitive for ALS-D and ALS-CI, ,  and the sensitivity of Montreal Cognitive Assessment  and Addenbrooke’s Cognitive Examination  for ALS-D and ALS-CI are unknown. Behaviorally, the Cambridge Behavioral Inventory,  the FBI, and the Frontal Assessment Battery ,  have all been used in ALS populations, but the small proportion of ALS-D patients in our study with highly abnormal behaviors suggests that behavioral-only screening is insensitive for ALS-D and ALS-CI. Similar to the ALS-CBS™,  ALS-BCA sought to determine behavioral and non-behavioral cognitive changes in ALS patients. Unlike ALS-CBS™, ALS-BCA has the unique property of using number of abnormal subtests instead of overall additive score as a threshold for ALS-CI or ALS-D, which resulted in improved sensitivity for ALS-CI (64%) compared to ALS-CBS™ (25%).  This approach is no different from the formulation of MCI-AD subtypes (single domain vs. multi-domain), and retains information on the number and type of abnormal subtests. Furthermore, the public domain ALS-BCA can be used to track longitudinal outcome according to absolute Z-scores or categorical diagnoses (progression, stability, reversion), and the increasing use of public domain PBAC in dementia clinics for MCI, AD, and FTD makes ALS-BCA the ideal clinical and research tool for comparative studies. .
The phenotypic information derived from the ALS-BCA also enabled us to conclude that ALS-D patients with abnormal behaviors, but not ALS-D patients with normal behaviors, have the poorest survival. This differs qualitatively from prior studies which mostly found FTD to be associated with poor survival in ALS. For example, one such study  showed that ALS patients with sufficient executive and behavioral changes for the diagnosis of behavioral variant FTD by Neary criteria  had poorer survival than other ALS patients,  and Neary criteria for behavioral variant FTD were used to detect demented ALS subjects in two subsequent studies. ,  However, Neary criteria have limited sensitivity in early FTD  and its sensitivity in ALS-FTD or ALS-D is unknown. This limitation may have led to the identification of only ALS patients with prominent behavioral changes as ALS-D subjects in prior studies while underestimating the overall prevalence of ALS-D. In other words, ALS-FTD patients in previous studies are likely equivalent to ALS-D patients in our current study with abnormal behaviors, while ALS-D patients with normal behaviors were not considered FTD-like. Therefore, it may be difficult to directly compare the prevalence of ALS-D reported in the current survival study (25%) with other survival studies that employed the Neary criteria, but the reported prevalence here is similar to that reported in a study using detailed neuropsychological criteria.  Our finding that behavior is a more important predictor of survival than the diagnosis of ALS-D or ALS-CI is crucial, as behavioral changes can be reliably reported by caregivers independent of the patients’ abilities to undergo cognitive testing. At the same time, it is not immediately apparent why ALS-D with normal behavior is not associated with poor survival. One possibility is that ALS-D patients with abnormal behaviors have more severe neuropathology, and work is ongoing to determine whether the distribution and severity of TDP-43 pathology is associated with behavioral abnormalities. Another possible explanation may be impairment in other higher cortical functions not routinely tested even in detailed neuropscyhological analysis such as theory of mind.  Impairments in theory of mind are thought to underlie some of the behavioral abnormalities in FTD, – and abnormal behaviors in ALS-D may indicate yet more severe neurodegeneration or network abnormalities  associated with poorer survival. If this is the case, the neuronal neuropathology and measures of cortical function may not significantly differ between ALS-D patients with and without behavioral changes, but the glial neuropathology and large-scale brain network impairment may be more prominent in ALS-D patients with abnormal behaviors. Future studies in living patients using diffusion tensor imaging or functional MRI may be useful to detect network dysfunction in ALS-D.
The phenotypic and quantitative nature of ALS-BCA additionally allowed us to study the impact of ALS-CI on survival. In the longitudinal cohort, executive dysfunction accounted for approximately 75% of all ALS-CI. Similar to two prior studies, ,  we did not find ALS-CI to be a predictor of poor survival, although the sensitivity of ALS-BCA for ALS-CI only (64%) is still under 80% despite the relative improvement from ALS-Cognitive Behavioral Screen (ALS-CBS)™ (25%). At the same time, ALS-BCA It also remains unclear if ALS-CI as a diagnosis or a particular ALS-CI syndrome may be sufficient to interfere with activities of daily living and use of adaptive equipments (PEG, NPPV). This raises the question of whether ALS-CI carries the same clinical significance as MCI due to AD. There were too few conversions (from ALS-CI to ALS-D) in the current study to determine whether ALS-CI is a prodromal phase to ALS-D, and ALS-CI may represent a heterogeneous group of disorders with cognitive impairment stemming from extra-motor ALS pathology, hypoxia, or nutritional factors. As we continue to gather longitudinal cognitive and clinical data on this and other cohorts, the etiology and outcome associated with ALS-CI as a diagnostic entity can be more directly addressed.
While the ALS-BCA has high diagnostic accuracy for ALS-D, this study has a number of limitations. The ALS-BCA is geared towards common deficits in FTD and AD, but does not contain subtests that evaluate parietal functions. While visual-spatial dysfunction is more common in FTD cases associated with tau pathology,  confrontation naming is often impaired in semantic variant of primary progressive aphasia which shares TDP-43 pathology with ALS (albeit with different TDP-43 subtypes).  ALS-BCA in the current study was administered as patients were initially evaluated at the ALS Clinic, but it was difficult to determine retrospectively whether abnormal cognition had been present since disease onset even though we adjusted for disease duration in our multi-variate model. The current cohort may not be sufficiently powered to detect the effects of ALS-D with normal behavior and ALS-CI on survival, and the ALS-D with abnormal behavior cohort was limited in size to determine the effect of specific behaviors (e.g., ritualistic behavior vs. apathy) on survival. Lastly, only a proportion of ALS subjects had neuropathologic evaluation, and there were too few cases for detailed examination on the pathologic differences between ALS-CI, ALS-D with normal behavior, and ALS-D with abnormal behaviors. Prospective studies examining the severity and distribution of TDP-43 pathology are on-going to address the possible connection between pathologic burden, executive functions, and behavior. Nevertheless, ALS-BCA can rapidly and accurately identify cognitive dysfunction in a busy multi-disciplinary ALS clinic, and can be used to longitudinally study the significance of isolated cognitive impairment on ALS patients and caregivers.
Conceived and designed the experiments: WH MG DL JG. Performed the experiments: WH MS AW NY CK JK JL AL JG. Analyzed the data: WH MS CK JG. Contributed reagents/materials/analysis tools: WH MG DL JG. Wrote the paper: WH JG.
- 1. Neumann M, Kwong LK, Lee EB, Kremmer E, Flatley A, et al. (2009) Phosphorylation of S409/410 of TDP-43 is a consistent feature in all sporadic and familial forms of TDP-43 proteinopathies. Acta Neuropathol 117: 137–149.
- 2. Mackenzie IR, Neumann M, Bigio EH, Cairns NJ, Alafuzoff I, et al. (2009) Nomenclature for neuropathologic subtypes of frontotemporal lobar degeneration: consensus recommendations. Acta Neuropathol 117: 15–18.
- 3. Strong MJ, Grace GM, Orange JB, Leeper HA, Menon RS, et al. (1999) A prospective study of cognitive impairment in ALS. Neurology 53: 1665–1670.
- 4. Elamin M, Phukan J, Bede P, Jordan N, Byrne S, et al. (2011) Executive dysfunction is a negative prognostic indicator in patients with ALS without dementia. Neurology 76: 1263–1269.
- 5. Olney RK, Murphy J, Forshew D, Garwood E, Miller BL, et al. (2005) The effects of executive and behavioral dysfunction on the course of ALS. Neurology 65: 1774–1777.
- 6. Hu WT, Seelaar H, Josephs KA, Knopman DS, Boeve BF, et al. (2009) Survival profiles of patients with frontotemporal dementia and motor neuron disease. Arch Neurol 66: 1359–1364.
- 7. Gordon PH, Goetz RR, Rabkin JG, Dalton K, McElhiney M, et al. (2010) A prospective cohort study of neuropsychological test performance in ALS. Amyotroph Lateral Scler 11: 312–320.
- 8. Woolley SC, York MK, Moore DH, Strutt AM, Murphy J, et al. (2010) Detecting frontotemporal dysfunction in ALS: utility of the ALS Cognitive Behavioral Screen (ALS-CBS). Amyotroph Lateral Scler 11: 303–311.
- 9. Libon DJ, Massimo L, Moore P, Coslett HB, Chatterjee A, et al. (2007) Screening for frontotemporal dementias and Alzheimer’s disease with the Philadelphia Brief Assessment of Cognition: a preliminary analysis. Dement Geriatr Cogn Disord 24: 441–447.
- 10. Kertesz A, Davidson W, Fox H (1997) Frontal behavioral inventory: diagnostic criteria for frontal lobe dementia. Can J Neurol Sci 24: 29–36.
- 11. Brooks BR, Miller RG, Swash M, Munsat TL (2000) World Federation of Neurology Research Group on Motor Neuron D (2000) El Escorial revisited: revised criteria for the diagnosis of amyotrophic lateral sclerosis. Amyotroph Lateral Scler Other Motor Neuron Disord 1: 293–299.
- 12. Cedarbaum JM, Stambler N, Malta E, Fuller C, Hilt D, et al. (1999) The ALSFRS-R: a revised ALS functional rating scale that incorporates assessments of respiratory function. BDNF ALS Study Group (Phase III). J Neurol Sci 169: 13–21.
- 13. Libon DJ, Rascovsky K, Gross RG, White MT, Xie SX, et al. (2011) The Philadelphia Brief Assessment of Cognition (PBAC): a validated screening measure for dementia. Clin Neuropsychol 25: 1314–1330.
- 14. Ricker JH, Axelrod BN (1994) Analysis of an Oral Paradigm for the Trail Making Test. Assessment 1: 47–52.
- 15. Kertesz A, Nadkarni N, Davidson W, Thomas AW (2000) The Frontal Behavioral Inventory in the differential diagnosis of frontotemporal dementia. J Int Neuropsychol Soc 6: 460–468.
- 16. Morris JC, Weintraub S, Chui HC, Cummings J, Decarli C, et al. (2006) The Uniform Data Set (UDS): clinical and cognitive variables and descriptive data from Alzheimer Disease Centers. Alzheimer Dis Assoc Disord 20: 210–216.
- 17. Wechsler D, Stone C (1973) Manual: Wechsler Memory Scale. New York: Psychological Corporation.
- 18. Armitage S (1946) An analysis of certain psychological tests used in the evaluation of brain injury. Psych Mono 60: 1–48.
- 19. Wechsler D (1955) Manual: Wechsler Adult Intelligence Scale. New York: Psychological Corporation.
- 20. Morris JC, Heyman A, Mohs RC, Hughes JP, van Belle G, et al. (1989) The Consortium to Establish a Registry for Alzheimer’s Disease (CERAD). Part I. Clinical and neuropsychological assessment of Alzheimer’s disease. Neurology 39: 1159–1165.
- 21. Goodglass H, Kaplan E (1983) The assessment of aphasia and related disorders. Philadelphia: Lee & Ferbiger.
- 22. Spreen O, Struss E (1990) A compendium of neuropychological tests. New York: Oxford University Press.
- 23. Benedict R (1997) Brief Visuospatial Memory Test-Revised. Odessa, FL: Psychological Assessment Resources, Inc.
- 24. Benton A, Hamsher K, Varney N, Spreen O (1983) Contributions to neuropsychological assessment. New York: Oxford University Press.
- 25. Geser F, Brandmeir NJ, Kwong LK, Martinez-Lage M, Elman L, et al. (2008) Evidence of multisystem disorder in whole-brain map of pathological TDP-43 in amyotrophic lateral sclerosis. Arch Neurol 65: 636–641.
- 26. Josephs KA, Petersen RC, Knopman DS, Boeve BF, Whitwell JL, et al. (2006) Clinicopathologic analysis of frontotemporal and corticobasal degenerations and PSP. Neurology 66: 41–48.
- 27. Strong MJ, Grace GM, Freedman M, Lomen-Hoerth C, Woolley S, et al. (2009) Consensus criteria for the diagnosis of frontotemporal cognitive and behavioural syndromes in amyotrophic lateral sclerosis. Amyotroph Lateral Scler 10: 131–146.
- 28. Neary D, Snowden JS, Gustafson L, Passant U, Stuss D, et al. (1998) Frontotemporal lobar degeneration: a consensus on clinical diagnostic criteria. Neurology 51: 1546–1554.
- 29. McKhann GM, Albert MS, Grossman M, Miller B, Dickson D, et al. (2001) Clinical and pathological diagnosis of frontotemporal dementia: report of the Work Group on Frontotemporal Dementia and Pick’s Disease. Arch Neurol 58: 1803–1809.
- 30. Rascovsky K, Hodges JR, Kipps CM, Johnson JK, Seeley WW, et al. (2007) Diagnostic criteria for the behavioral variant of frontotemporal dementia (bvFTD): current limitations and future directions. Alzheimer Dis Assoc Disord 21: S14–18.
- 31. Rascovsky K, Hodges JR, Knopman D, Mendez MF, Kramer JH, et al. (2011) Sensitivity of revised diagnostic criteria for the behavioural variant of frontotemporal dementia. Brain 134: 2456–2477.
- 32. Rippon GA, Scarmeas N, Gordon PH, Murphy PL, Albert SM, et al. (2006) An observational study of cognitive impairment in amyotrophic lateral sclerosis. Arch Neurol 63: 345–352.
- 33. Ahn SW, Kim SH, Kim JE, Kim SM, Sung JJ, et al. (2011) Frontal assessment battery to evaluate frontal lobe dysfunction in ALS patients. Can J Neurol Sci 38: 242–246.
- 34. Oskarsson B, Quan D, Rollins YD, Neville HE, Ringel SP, et al. (2010) Using the Frontal Assessment Battery to identify executive function impairments in amyotrophic lateral sclerosis: A preliminary experience. Amyotroph Lateral Scler 11: 244–247.
- 35. Nasreddine ZS, Phillips NA, Bedirian V, Charbonneau S, Whitehead V, et al. (2005) The Montreal Cognitive Assessment, MoCA: a brief screening tool for mild cognitive impairment. J Am Geriatr Soc 53: 695–699.
- 36. Mathuranath PS, Nestor PJ, Berrios GE, Rakowicz W, Hodges JR (2000) A brief cognitive test battery to differentiate Alzheimer’s disease and frontotemporal dementia. Neurology 55: 1613–1620.
- 37. Lillo P, Mioshi E, Zoing MC, Kiernan MC, Hodges JR (2011) How common are behavioural changes in amyotrophic lateral sclerosis? Amyotroph Lateral Scler 12: 45–51.
- 38. Gordon PH, Wang Y, Doorish C, Lewis M, Battista V, et al. (2007) A screening assessment of cognitive impairment in patients with ALS. Amyotroph Lateral Scler 8: 362–365.
- 39. Cavallo M, Adenzato M, Macpherson SE, Karwig G, Enrici I, et al. (2011) Evidence of social understanding impairment in patients with amyotrophic lateral sclerosis. PLoS One 6: e25948.
- 40. Fernandez-Duque D, Hodges SD, Baird JA, Black SE (2010) Empathy in frontotemporal dementia and Alzheimer’s disease. J Clin Exp Neuropsychol 32: 289–298.
- 41. Adenzato M, Cavallo M, Enrici I (2010) Theory of mind ability in the behavioural variant of frontotemporal dementia: an analysis of the neural, cognitive, and social levels. Neuropsychologia 48: 2–12.
- 42. Lough S, Gregory C, Hodges JR (2001) Dissociation of social cognition and executive function in frontal variant frontotemporal dementia. Neurocase 7: 123–130.
- 43. Eslinger PJ, Moore P, Troiani V, Antani S, Cross K, et al. (2007) Oops! Resolving social dilemmas in frontotemporal dementia. J Neurol Neurosurg Psychiatry 78: 457–460.
- 44. Rusina R, Ridzon P, Kulist’ak P, Keller O, Bartos A, et al. (2010) Relationship between ALS and the degree of cognitive impairment, markers of neurodegeneration and predictors for poor outcome. A prospective study. Eur J Neurol 17: 23–30.
- 45. Grossman M, Xie SX, Libon DJ, Wang X, Massimo L, et al. (2008) Longitudinal decline in autopsy-defined frontotemporal lobar degeneration. Neurology 70: 2036–2045.
- 46. Snowden J, Neary D, Mann D (2007) Frontotemporal lobar degeneration: clinical and pathological relationships. Acta Neuropathol 114: 31–38.