The main focus of this study is to illustrate the applicability of latent class analysis in the assessment of cognitive performance profiles during ageing. Principal component analysis (PCA) was used to detect main cognitive dimensions (based on the neurocognitive test variables) and Bayesian latent class analysis (LCA) models (without constraints) were used to explore patterns of cognitive performance among community-dwelling older individuals. Gender, age and number of school years were explored as variables. Three cognitive dimensions were identified: general cognition (MMSE), memory (MEM) and executive (EXEC) function. Based on these, three latent classes of cognitive performance profiles (LC1 to LC3) were identified among the older adults. These classes corresponded to stronger to weaker performance patterns (LC1>LC2>LC3) across all dimensions; each latent class denoted the same hierarchy in the proportion of males, age and number of school years. Bayesian LCA provided a powerful tool to explore cognitive typologies among healthy cognitive agers.
Citation: Costa PS, Santos NC, Cunha P, Palha JA, Sousa N (2013) The Use of Bayesian Latent Class Cluster Models to Classify Patterns of Cognitive Performance in Healthy Ageing. PLoS ONE8(8): e71940. https://doi.org/10.1371/journal.pone.0071940
Editor: Oscar Arias-Carrion, Hospital General Dr. Manuel Gea González, Mexico
Received: March 15, 2013; Accepted: July 5, 2013; Published: August 20, 2013
Copyright: © 2013 Costa et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The study is integrated in the “Maintaining health in old age through homeostasis (SWITCHBOX)” collaborative project funded by the European Commission FP7 initiative (grant HEALTH-F2-2010-259772). NS and JAP are main team members of the European consortium SWITCHBOX (http://www.switchbox-online.eu/). NCS is supported by a SwitchBox post-doctoral fellowship. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Normal ageing is associated with cognitive decline in various memory and executive function abilities, the course of which varies between individuals and in the same individual over the lifespan –. The identification of cognitive patterns in the ageing population is a fundamental step in studies assessing the effect of intrinsic and extrinsic factors on cognitive performance. Although it is impossible to apply all neuropsychological/cognitive assessment parameters in a given population sample, different neurocognitive test variables have similar patterns and relation with age (see for review ). The use of composite scores and cluster analysis methods to identify test variable groupings and to provide insights into distinct groups of cognitive patterns can be particularly powerful in studying cognitive trajectories in population studies. On this, latent class analysis (LCA) cluster modeling may be especially relevant in that i) it does not conform to model assumptions (for example, normal distribution and homogeneity), ii) it can include variables of mixed scale types in the same analysis, and iii) the relationship between the latent classes and covariates can be assessed simultaneously –. Furthermore, the mixture model-based approach allows to estimate membership probabilities (to classify cases into the appropriate cluster) and to explore hidden clusters represented by each latent class –.
The present work from the Switchbox Consortium (http://www.switchbox-online.eu/) is based on findings in older community-dwelling individuals (residing in Minho, Northern Portugal) that were cognitively characterized via a battery of neurocognitive tests . Here, based on the neurocognitive measures, the study aim was two-fold: first, to identify neurocognitive variables’ grouping(s); second, determine the value of Bayesian LCA on modeling patterns of cognitive performance among older individuals.
Materials and Methods
Participants (n = 506) were randomly selected from the Guimarães and Vizela local area health authority registries (health care centers). All participants still lived in the community (community-dwellers), with equal distribution between urban and rural areas. The majority of individuals (70.4%, females 51.9%) were in the medium socio-economic stratum (Class III, Graffar measure ) and retired (n = 344, females 48.3%). The cohort was representative of the general Portuguese population with respect to gender (females, n = 264 or 52.2%), age [range: 50–89 years; M = 65.7, SD = 8.98; age categories: [50–60[, 30.2% (females, 55.6%); [60–70[, 33.2% (females, 54.8%); [70+[, 36.6% (females, 47.0%)], and education (median years of schooling = 4; 1.2, 5.9, 73.9, 7.7, 9.1, and 2.2% of the cohort attended school for 0, 1–2, 3–4, 5–8, 9–12, and 13+ years, respectively; literacy rate 99.4%, able to read and write).
The study was conducted in accordance with the Declaration of Helsinki (59th Amendment) and was approved by the national ethical committee (Comissão Nacional de Protecção de Dados) and by the local ethics review boards (Hospital Escola Braga, Braga; Centro Hospitalar do Alto Ave, Guimarães; and Unidade Local de Saúde do Alto Minho, Viana-do-Castelo/Ponte-de-Lima). Potential participants were explained the study goals and the neurocognitive assessments. All volunteers provided written informed consent. The primary exclusion criteria included inability to understand informed consent, participant choice to withdraw from the study, incapacity and/or inability to attend the neuropsychological assessment session(s), and/or diagnosed dementia or neuropsychiatric disorder. Further exclusion/inclusion selection criteria are described elsewhere , .
Tests were selected to provide cognitive profiles (general cognition, executive and memory functions), as previously reported , . The following parameters were assessed: global cognitive status with the mini-mental state examination (MMSE) ; short-term verbal memory with the digit span forward test (subtest of the Wechsler adult intelligence test WAIS III, 1997) , verbal working memory with the digit span backward test (subtest of the Wechsler adult intelligence test WAIS III, 1997)  and multiple trial verbal learning and memory with the selective reminding test [SRT, parameters: consistent long term retrieval (CLTR), long term storage (LTS), delayed recall and intrusions] ; response inhibition/cognitive flexibility with the Stroop color and word test (Stroop, parameters: words, colors and words/colors)  and verbal fluency with the controlled oral word association test F-A-S (COWAT-FAS, parameters: admissible and non-admissible) . A team of trained psychologists conducted the assessments.
Data analysis followed previously reported strategies  and was structured as follows:
- Conversion of all test scores into z scores to express all variables in the same scale;
- Exclusion of participants that met the previously established MMSE criteria for cognitive impairment: total MMSE score <17 if individual with less than 4 years of formal school education and/or ≥72 years of age (excluded n = 1 individual), or total MMSE score <23 if individual with more than 4 years of formal school education and/or ≤71 years of age (excluded n = 2 individuals) , ;
- Principal component analysis (PCA) for allocation of multiple test parameters into single or composite cognitive dimensions, allowing to reduce information of multiple parameters into a minimal number of components (dimensions) and the identification of the “weight” of each component (ultimately also allowing to calculate the performance score of each individual in each dimension);
- Bayesian latent class analysis (LCA) cluster modeling for determination of cognitive performance patterns;
- ANOVA, MANOVAS, t-tests and chi-squared tests to detect differences between the subjects in the distinct latent classes for relevant variables.
Principal Component Analysis
The following measures (neurocognitive tests’ total or parameter scores) were considered: MMSE, Stroop, SRT, COWAT F-A-S and digits. The analysis (extraction method: principal component analysis; rotation method: Varimax with Kaiser Normalization) included all individuals that met the previously established MMSE threshold ,  and had no missing values in any of the considered neurocognitive measures (n = 503). Here PCA was used so to maintain the largest possible total explained variance as opposed to common variance.
Bayesian Latent Class Analysis
Bayesian LCA cluster modeling with Markov chain Monte Carlo (MCMC) simulation technique was used to identify latent classes (LC) that grouped together individuals similar in cognitive performance (in respect to the identified PCA cognitive dimensions). The components (cognitive dimensions) were stipulated as uncorrelated and no pre-established group coding was defined regarding cognitive performance (to account for the possibility of label switching , trace plots were run for the individual parameters). Latent structure analysis is a variation of mixture modeling in which the measured variables are required to be modeled as independent within each group. As such, an essential assumption of LCA is that of “conditional independence”, where, when the measured variables are multivariate normal, they are required to be modeled as uncorrelated . Finally, Bayesian LCA allows for a more sophisticated group division (proportion estimates) than, for example, a quantile approach, by not forcing similar group sample sizes across divisions.
Four separate Bayesian LCA solutions were tested (consisting of 2 to 5 clusters, respectively; seed used in all solutions = 2,992,372; default burn-in period = 500) and all solutions satisfied the Gelman et al.  default convergence criteria of <1.10 (the AMOS default criterion of 1.002 is considered conservative). Cluster model solutions were stopped at a number of samples of approximately 55,500, yielding for each a overall convergence statistic (CS, as it approaches 1.000 there is no much more precision to be gained) of: 2-cluster, CS = 1.0003; 3-cluster, CS = 1.0003; 4-cluster, CS = 1.0248; 5-cluster, CS = 1.0257 [this solution was not further considered as it yielded two latent classes that contained a proportion estimate of 0.038 and 0.092, respectively, and CS was not reached for three of the latent classes, for the number of samples considered]. For each model (cluster solution), the probabilities of membership in each latent class group were inputted into the dataset based on the highest probability value. In addition to the CS value, a frequency polygon of the distribution of the proportion was also used to check convergence of the Bayesian MCMC method (in frequency polygons, when the distributions of the first and last thirds of the analysis samples are virtually identical/overlap then the posterior distribution has converged; in addition, the center of the distribution represents the mean value of the parameter and the standard deviation can also be visualized) (Fig. S1).
Scatterplot Matrix and 3D Scatterplots
R and R Commander were used to perform a scatterplot matrix by LC (representing the least-squares lines, smooth lines and spread; density plots on diagonal) for the three cognitive dimensions explored and a 3D scatterplot with the cognitive dimension zMMSE as response variable, and the dimensions zMEM and zEXEC as explanatory variables (options: show axis scales; show surface grid lines; smooth regression; plot 50% concentration ellipsoid, plot by LC and parallel regression surfaces).
Cognitive Performance Dimensions
From the PCA analysis three dimensions were identified: one single (termed “MMSE”) and two composites (termed “EXEC” and “MEM”) (sampling adequacy, KMO = 0.838; Bartlett’s sphericity, χ2(66) = 2145.6, p<0.001, revealing significant correlation between the variables) (Table 1). The parameter MMSE, a general cognition measure, was considered a single dimension (MMSE) because it loaded in 2 components with similar weights (loadings less than 0.5, and the difference between the two components’ weights was of less than 0.1). The composite dimensions were formed as follows: executive function (EXEC, Cronbach’s alpha 0.780) comprising Stroop measures (parameters: words, colors and words/colors), COWAT F-A-S (parameter: admissible) and digits (parameters: forward and backward spans); and, memory function (MEM, Cronbach’s alpha 0.894) composed of the SRT test variables (parameters: CLTR, LTS and delayed recall). The dimensional composite consisting of the parameters SRT intrusions and FAS non-admissible (which would reflect test “errors”) was not considered viable due to the very low Cronbach’s alpha (0.000). Results were confirmed using oblimin rotation, meaning that the factorial structural remained the same independently of the rotation method.
Latent Classes of Cognitive Performance
Based on the PCA dimensions multiple Bayesian LCA clustering solutions were tested (2-, 3- and 4-cluster) (Table 2 and Fig. S1). The general effect size η2 was derived by dividing the sum of all between- groups sum of squares by the sum of the total sum of groups; for the 2-, 3-, 4-cluster solutions, η2 was 0.386, 0.506 and 0.478, respectively. The latent classes in each of the Bayesian LCA clustering solutions represented distinct cognitive typologies (Fig. 1); cross-tabulation analysis allowed to determine about the membership interrelation of the cluster solutions and to determine how subjects were divided as the number of cluster solutions increased (Fig. 2). For the 2-cluster solution two separate latent classes were identified: LC1 and LC2, grouping, respectively, stronger (+) and weaker (-) performers. In the next tested solution (3-cluster), the identified latent classes subdivided the cohort into “stronger” (+, LC1), “average” (+/−, LC2) and “weaker” (−, LC3) performers. Cross tabulation analysis showed that the “average” latent class resulted both from subjects from the “stronger” and “weaker” latent classes identified in the 2-cluster model. Finally, the 4-cluster solution further subdivided the sample into different cognitive performance patterns, from “stronger” (+/+, LC1), to “average high” (+/−, LC2), “average low” (−/+, LC3) and “weaker” (−/−, LC4). The first two classes (LC1 and LC2) resulted from differentiation among the LC1 and LC2 3-cluster latent classes, while the latter two (LC3 and LC4) from the LC2 and LC3 3-cluster latent classes. In all cluster solutions, subjects within each latent class performed similarly across the cognitive dimensions (that is, a performance pattern in a particular dimension corresponded to a similar “stronger”, “high/low average” or “weaker” performance in the other dimensions) (Fig. 1).
a 2-cluster (latent classes, LC1 to LC2), b 3-cluster (LC1 to LC3), c 4-cluster (LC1 to LC4).
Frequency counts and percentages of subjects are reported for each latent class in each cluster solution.
To explore basic participant socio-demographic characteristics and how these might underlie cognitive performance, the variables gender, age and school years were used to describe and compare between subjects in the latent classes of each Bayesian LCA solution (Table 3). Among others, these factors were identified as relevant in previous studies , . As expected, with exception of gender in the 2- and 4-cluster models, all factors were significant in explaining latent class membership; females, older subjects and those with less school years belonged to latent classes denoting weaker cognitive performance across the studied cognitive dimensions.
The 3-cluster Bayesian LCA solution was considered the strongest: i) had the highest general eta-squared effect, ii) explained ≥5% of the dependent variables compared to the previous applied solution, iii) had a greater variance than that of the previous solution and iv) subjects were evenly distributed among the latent classes. Specifically, the latent classes LC1-LC3 characterized distinct patterns of cognitive performance; 3 in 10 subjects were “strong” performers (LC1), 6 in 10 subjects “average” (LC2), and 1 in 10 “weak” cognitive performers (LC3) for the considered cognitive dimensions (general cognition and executive and memory functions). Scatter plot visualization showed that positive correlations existed between the MMSE, MEM and EXEC dimensions (Fig. 3a). Furthermore, following the cognitive performance pattern (LC1>LC2>LC3, visually represented in the 3D plot Fig. 3b) each latent class overall denoted the same hierarchy in the proportion of males, youth and number of school years across the MMSE, MEM and EXEC dimensions (Fig. 3c–k). MANOVAS were performed in order to detect gender, age and school years main effects in the three considered dimensions split by latent class. Based on Pillai’s Trace gender showed a significant effect on LC1 [F(3,144) = 4.11, p = 0.008, η2p = 0.068, π = 0.981; significant differences detected on EXEC] and LC2 [F(3,295) = 7.13, p<0.001, η2p = 0.079, π = 0.840; significant differences detected on MMSE and MEM] and not on LC3 [F(3,52)<1, p = 0.555, η2p = 0.039, π = 0.189]. Significant main effects of age were detected on LC2 [F(6,590) = 4.67, p<0.001, η2p = 0.05, π = 0.989; significant differences detected on MEM and EXEC] and on LC3 [F(6,104) = 3.20, p<0.001, η2p = 0.16, π = 0.912; significant differences detected on EXEC] and not on LC1 [F(6,288)<1, p = 0.857, η2p = 0.01, π = 0.178]. Regarding school years significant main effects of were found on LC1 [F(3,295) = 5.86, p = 0.001, η2p = 0.06, π = 0.952; significant differences detected on EXEC] and LC2 [F(3,144) = 5.54, p = .001, η2p = 0.10, π = 0.937; significant differences detected on MMSE and EXEC]; this analysis was not performed for LC3 because all participants had 0–4 school years.
Latent class analysis is a powerful method for analyzing the relationships among manifest data when some variables are unobserved; variables can represent nominal, ordinal, continuous and count data –, . Conceptually, LCA follows other clustering approaches: the original dataset is divided into a number of exclusive and exhaustive subsets (in LCA termed latent classes); however, it uses statistical (rather than mathematical) methodology to construct the results. That is, as opposed to more traditional approaches (e.g. hierarchical or K-means cluster analysis, which we have previously used in our ageing studies , ), LCA is a model-based approach that offers a probability-based classification through a posterior probability of membership (meaning: cases are not absolutely assigned to classes, but have a probability of membership for each latent class) , , . Furthermore, LCA models add in some key methodological elements: i) the use of starting values to ensure that the best solution has been found (particularly relevant in complex models with large numbers of classes); ii) does not rely on traditional modeling assumptions (e.g. linear relationship, normal distribution, homogeneity) and is therefore less prone to biases; and iii) the relationship between the latent classes and external variables (covariates) can be assessed simultaneously . In LCA the Expectation Maximization algorithm can be used to obtain the parameters of latent class models; where, in a Bayesian approach, the parameters are usually estimated by Markov Chain Monte Carlo methods. Classic and Bayesian statistical approaches are applied in as multiple and diverse areas as diagnostic testing (for example, ) and whole-genome association analyses (for example, ), to the modeling of performance typologies (for example, ) and clinical studies (for example, –). Particularly, the sociology and psychology fields offer valuable methodological developments regarding LCA models . On ageing research, the approach has been mainly used in longitudinal studies because LCA captures trajectories over long periods of time and can model timing, onset, decline and recovery efficiently in one model.
Herein we used a combined approach of PCA and Bayesian LCA modeling to a cross-sectional analysis in order to identify main cognitive dimensions and to explore patterns of cognitive performance among community-dwelling older individuals. Based on neurocognitive test variables, three main cognitive dimensions were identified that represented general (MMSE), memory (MEM) and executive (EXEC) functions. While the first dimension was a single-variable category, the latter two were composites of multiple test variables; altogether, dimensions were positively correlated. Even noting that the dimensions that were the result of neurocognitive variables groupings (MEM and EXEC) may be more reliable and/or suitable measures than a cognitive dimension comprised of a single test variable (MMSE), here MMSE remained in the analysis as a indicator of general ability. The MMSE is still the most commonly used instrument for screening general cognitive function , presenting good reliability indexes, and being an adequate and comparable measure within studies. Nonetheless, some of its limitations have been identified, namely, in detecting for subtle memory losses, particularly in well-educated participants , since it is a measure vulnerable to culture and education. In this way, it is possible for a participant to score poorly in the absence of cognitive impairment (for example due to low educational background) or, that higher-educated individuals score well despite having cognitive impairment , . In the present study, since the majority of participants had 4 years of school education and were culturally similar, these vulnerabilities most likely did not affect the results or contributed to a possible “ceiling effect.”
From the obtained dimensions, Bayesian LCA was conducted to identify clusters of distinct cognitive performers in the cohort. Three latent classes were identified – LC1 to LC3– which corresponded to stronger to weaker performance across all dimensions (LC1>LC2>LC3). Overall, each latent class denoted the same performance hierarchy in the proportion of males, younger individuals and higher number of school years. Gender, age and school years had the greater impact on LC2 membership; although, it should be noted LC3 membership was only individuals with ≤4 school years. Across each cognitive dimension, gender, age and school years also had an effect on latent class distribution: executive function appeared the most affected by gender (LC1), age (LC2 and LC3) and school years (LC1 and LC2), followed equally by MEM (gender and age, LC2) and MMSE (gender and school years, LC2).
In accordance with our results, two main cognitive domains emerge across studies showing age-related decline: memory and executive function . From a neurocognitive standpoint each of these include a myriad of cognitive processes, where the line between these can be at times difficult to distinguish, particularly as measured by neuropsychological batteries. For instance, memory, while broadly defined as the ability to store and retrieve information (short- and long-term), it can also encompass, for instance, working memory. This capacity implies the ability to transform, re-organize and/or use new information based on previously acquired one. As such, for example, the neurocognitive measure digit-span backward is still debated in the field regarding if it is a measure of short-term or working memory, with some authors indicating that the set of mechanisms used (short-term vs. working) may differ depending on the age group considered . In fact, studies on executive function reveal an even larger group of cognitive processes, ranging from ability to retrieve, maintain and manipulate information, to inhibition, goal switching and formation of new strategies to complete a certain task. Still, in common, memory and executive order function processes show a degree of age-related decline, even if non-uniform inter- or intra-individually throughout ageing , . Further interesting, it is thought that some components of both domains can actually be protected from ageing, by “leaning in” on other mechanisms or by process of (repeated) learning . Here, the cross-sectional design does not allow for fine-discrimination among more stable and less stable measures, but it is nonetheless of note that memory and executive function appeared the most affected by age in the weaker classes (LC2 and LC3), possibly indicating that higher performers may rely on a more complex cognitive network.
On this, education plays a major role. In fact, in our previous studies the number of school years was one of the most significant discriminatory parameters in explaining cognitive performance , , following other similar findings , . Here, executive function appeared the most affected by school years particularly in the first two classes (LC1 and LC2). One of the most well-established proxy measures of reserve capacity in older individuals is education, which is thought to promote more efficient cognitive processing and use of brain networks, possibly due to an increase in neural connections made while learning , . This means that learning may increase the cognitive reserve, possibly resulting into smaller age-related decline  and in relying less on memory strategies to solve problems. Still, interpretation of the results should be taken with care: individuals in the lower educational group are already in a lower cognitive class (“flooring effect”). As such, they have “less to loose,” which may translate into higher educated individuals appearing more “sensitive” to the effects of ageing, albeit this may occur later on .
On gender, although differences in cognition have been well documented (for example, women perform better in verbal tasks and men in spatial tasks ), differences in ageing effect have not been clearly established across the lifespan. Here, executive function appeared the most affected by gender in the stronger class and memory in the middle class; where, in both cases, males were the stronger performers. While some authors indicate that overall age-decline begins earlier in women than men , others defend the opposite . According to Schmand and colleagues, the question may reside on cultural aspects . Older women with a more limited formal education may have poorer cognitive performance compared with men, not because of gender itself, but because of their educational background (which relates to the brain reserve capacity theory). However, this is a matter of debate, particularly for the oldest old. For instance, van Exel and colleagues showed in their cohort study that despite women presenting lower formal education they performed cognitively better than men in the same age class . The authors concluded that formal educational by itself does not explain differences in cognitive performance between genders and, consequently, that the brain reserve theory alone does not explain the gender differences in cognitive performance. Instead, the authors indicated that a later onset of age-associated pathologies, such as cardiovascular disease, could be at the root of the better cognitive functioning of older women compared with men. On this, neurophysiologic and brain structural aspects should also be taken into consideration. Pre-clinical evidence indicates that estrogens have salutary neurophysiologic effects; particularly, in that a drop in estrogen may be detrimental to cognition . So, when considering the mechanisms by which estrogens might impact cognitive function, it is important to consider both indirect (menopausal symptoms such as mood, sleep disturbance, and “hot flashes”) and direct effects (effects on neural systems subserving cognitive functions of hormonal changes on the brain systems) . Another important consideration is that the hippocampus and prefrontal cortex, which serve episodic and working memory, are rich in estrogen receptors , which may possibly also underlie gender-specific findings. Altogether, although the findings appear contradictory, it may simply mean that different factors are of different relevance depending on the life stage. Ultimately, if considering that age-associated cognitive performance may rely on compensatory mechanisms , poorer performance may relate with a continued reliance on strategies (perhaps verbal in women ) that may prove ineffective “leaning-ins” to compensate for the observed age-related decline in more executive and memory-related dimensions.
Some methodological considerations should be taken into account when reporting on the results from the LCA methodology: first, it did not result in the same number of clusters compared to the more traditional procedures (hierarchical and K-means clustering) that we used in our similar datasets (although these with not as many variables and with a smaller sample size without missing values, , ). Whereas the previous non-latent class analysis strategies yielded 4-clusters, here, LCA yielded a 3-cluster solution; this observation indicates differences in cluster membership between the methods, which is in accordance to the results from Eshghi et al  when directly comparing clustering methods using a same database. The apparent inconsistency may be difficult to interpret (particularly when in cases where there are no predefined clusters) and although it may indicate that classical solutions yield more homogeneous clusters, herein the analysis showed that further divisions yielded new classes whose membership performance did not agree with its preceding class. Altogether, although a deeper understanding of different cluster methodologies and their applicability in ageing (cross-sectional) studies is warranted, Bayesian LCA proved to be a powerful technique to inform on cognitive typologies. As complementary tools, logistic regressions or discriminant analysis may prove valuable so that, based on the identified cluster solutions, new subjects are assigned class membership. Finally, strategies of data imputation for missing values (on neurocognitive test variables) may be pertinent as often studies are constrained by these with a considerable impact on sample size and therefore on the use of more powerful statistical techniques.
Frequency polygon of the distribution of the proportion across the 55,500 samples for each Bayesian LCA solution. a, b 1-cluster (latent classes, LC1 and LC2, respectively), c–e 2-cluster (LC1 to LC3, respectively), f–i 4-cluster (LC1 to LC4, respectively).
We are thankful to all study participants. The authors would like to acknowledge all colleagues who assisted with participant recruitment and evaluation.
Conceived and designed the experiments: NS JAP. Performed the experiments: NCS PC. Analyzed the data: PSC NCS. Contributed reagents/materials/analysis tools: PSC. Wrote the paper: PSC NCS NS. Participated in data interpretation and contributed substantially to the scientific process leading up to the writing of the submitted manuscript and have approved of its final version: PSC NCS PC JAP NS.
- 1. Hilborn JV, Strauss E, Hultsch DF, Hunter MA (2009) Intraindividual variability across cognitive domains: investigation of dispersion levels and performance profiles in older adults. J Clin Exp Neuropsychol 31: 412–424.
- 2. Salthouse TA (2010a) Does the meaning of neurocognitive change change with age? Neuropsychology 24: 273–278.
- 3. Salthouse TA (2010b) Selective review of cognitive aging. J Int Neuropsychol Soc 16: 754–760.
- 4. Gelman A, Carlin JB, Stern HS, Rubin DB (eds) (2004) Bayesian Data Analysis. 2nd ed. Boca Raton: Chapman and Hall/CRC.
- 5. Magidson J, Vermunt JK (2005) A nontechnical introduction to latent class models. DMA Research Council Journal. Available: www.statisticalinnovations.com/articles/lcmodels2.pdf. Accessed: 2013 Jul 15.
- 6. Vermunt JK, Magidson J (2002) Latent Class Cluster Analysis. In: Hagenaars JA, McCutcheon, AL (eds) Advances in Latent Class Analysis. Cambridge: Cambridge University Press.
- 7. Santos NC, Costa PS, Cunha P, Cotter J, Sampaio A et al. (2012) Mood is a key determinant of cognitive performance in community-dwelling older adults: a cross-sectional analysis. Age (Dordr). In press.
- 8. Graffar M (1956) Une methode de classification sociale d’echantillon des populations. Courrier 6: 455–459.
- 9. Paulo AC, Sampaio A, Santos NC, Costa PS, Cunha P, et al. (2011) Patterns of cognitive performance in healthy ageing in northern Portugal: a cross-sectional analysis. PLoS One 6: e24553.
- 10. Folstein MF, Folstein SE, McHugh PR (1975) Mini-mental state. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12: 189–198.
- 11. Wechsler D (ed) (1997) Wechsler adult intelligence scale (WAIS-III). San Antonio: Harcourt Assessment.
- 12. Buschke H, Sliwinski M, Kuslansky G, Lipton RB (1995) Aging, encoding specificity, and memory change in the double memory test. J Int Neuropsychol Soc 1: 483–493.
- 13. Strauss E, Sherman EMS, Spreen O (eds) (2006) A compendium of neuropsychological tests: administration, norms and commentary. New York: Oxford University Press.
- 14. Lezak M, Howieson D, Loring D (eds) (2004) Neuropsychological assessment. New York: Oxford University Press.
- 15. Arbuckle JL (ed) (2009) Amos 18 user’s guide. Crawfordville: Amos Development Corporation.
- 16. Fox J (2005) The R Commander: a basic statistics graphical user interface to R. J Stat Softw. 14: 1–42.
- 17. R Core Team (2012) R: A language and environment for statistical computing [updated 2012 Oct 26]. Vienna: R Foundation for Statistical Computing, ISBN 3-900051-07-0. Available from: http://www.R-project.org/. Accessed 2012 Dec 12.
- 18. Chung H, Loken E, Schafer JL (2004) Difficulties in drawing inferences with finite mixture models: a simple example with a simple solution. Am Stat 58: 152–158.
- 19. Haughton D, Legrand P, Woolford S (2009) Review of three latent class cluster analysis packages: latent GOLD, poLCA, and MCLUST. Am Stat 63: 81–91.
- 20. Kaplan D (ed) (2004) The sage handbook of quantitative methodology for the social sciences. Thousand Oaks: Sage Publications.
- 21. Gonçalves L, Subtil A, de Oliveira MR, do Rosário V, Lee PW, et al. (2012) Bayesian Latent Class Models in malaria diagnosis. PLoS One 7: e40633.
- 22. Schumacher FR, Kraft PA (2007) Bayesian latent class analysis for whole-genome association analyses: an illustration using the GAW15 simulated rheumatoid arthritis dense scan data. BMC Proc (Suppl 1): S112.
- 23. Lambe P, Bristow D (2011) Predicting medical student performance from attributes at entry: a latent class analysis. Med Educ 45: 308–316.
- 24. Breslau N, Reboussin BA, Anthony JC, Storr CL (2005) The structure of posttraumatic stress disorder: latent class analysis in 2 community samples. Arch Gen Psychiatry 62: 1343–1351.
- 25. Hybels CF, Blazer DG, Pieper CF, Landerman LR, Steffens DC (2009) Profiles of depressive symptoms in older adults diagnosed with major depression: latent cluster analysis. Am J Geriatr Psychiatry 17: 387–396.
- 26. Yang FM, Marcantonio ER, Inouye SK, Kiely DK, Rudolph JL, et al. (2009) Phenomenological subtypes of delirium in older persons: patterns, prevalence, and prognosis. Psychosomatics 50: 248–254.
- 27. Formann A (2003) Latent class model diagnosis from a frequentist point of view. Biometrics 58: 189–196.
- 28. Molloy DW, Standish TIM (1997) Mental Status and Neuropsychological Assessment: a guide to the standardized mini-mental state examination. Int Psychogeriatr 9: 87–94.
- 29. Small GW (2002) What we need to know about age related memory loss. BMJ 324: 1502–1505.
- 30. Tombaugh TN, McIntyre NJ (1992) The mini-mental state examination: a comprehensive review. J Am Geriatr Soc 40: 922–935.
- 31. Brayne C, Calloway P (1990) The association of education and socioeconomic status with the Mini Mental State Examination and the clinical diagnosis of dementia in elderly people. Age Ageing 19: 91–96.
- 32. St Clair-Thompsona HL (2010) Backwards digit recall: a measure of short-term memory or working memory? Eur J Cogn Psychol 22: 286–296.
- 33. Goh JO, An Y, Resnick SM (2012) Differential trajectories of age-related changes in components of executive and memory processes. Psychol Aging 27: 707–719.
- 34. Ardila A, Ostrosky-Solis F, Rosselli M, Gómez C (2000) Age-related cognitive decline during normal aging: the complex effect of education. Arch Clin Neuropsychol 15: 495–513.
- 35. Wilson RS, Hebert LE, Scherr PA, Barnes LL, Mendes de Leon CF, et al. (2009) Educational attainment and cognitive decline in old age. Neurology 72: 460–465.
- 36. Vance DE, Webb NM, Marceaux JC, Viamonte SM, Foote AW, et al. (2008) Mental stimulation, neural plasticity and aging: directions for nursing research and practice. J Neurosci Nurs 40: 241–249.
- 37. Steffener J, Stern Y (2012) Exploring the neural basis of cognitive reserve in aging. Biochim Biophys Acta 1822: 467–473.
- 38. Stern Y (2009) Cognitive reserve. Neuropsychologia 47: 2015–2028.
- 39. Gur RE, Gur RC (2002) Gender differences in aging: cognition, emotions, and neuroimaging studies. Dialogues Clin Neurosci 4: 197–210.
- 40. van Exel E, Gussekloo J, de Craen AJM, Bootsma-van der Wiel A, Houx P, et al. (2001) Cognitive function in the oldest old: women perform better than men. J Neurol Neurosurg Psychiatry 71: 29–32.
- 41. Schmand B, Smit JH, Geerlings MI, Lindeboom J (1997) The effects of intelligence and education on the development of dementia. A test of the brain reserve hypothesis. Psychol Med 27: 1337–1344.
- 42. Greendale AG, Derby CA, Maki PM (2011) Perimenopause and cognition. Obstet Gynecol Clin North Am 38: 519–535.
- 43. Baltes PB, Baltes MM (1990) Psychological perspectives on successful aging: the model of selective optimization with compensation. In Baltes PB, Baltes MM (eds.), Successful aging: perspectives from the behavioral sciences. New York: Cambridge University Press; 1pp.
- 44. Eshghi A, Haughton D, Legrand P, Skaletsky M, Woolford S (2011) Identifying groups: a comparison of methodologies. J Data Sci 9: 271–91.