Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Prospective memory, retrospective memory, and individual differences in cognitive abilities, personality, and psychopathology

  • Bob Uttl ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    uttlbob@gmail.com

    Affiliation Psychology Department, Mount Royal University, Calgary, Alberta, Canada

  • Carmela A. White,

    Roles Data curation, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Current address: Department of Psychology, University of British Columbia Okanagan, Kelowna, British Columbia, Canada

    Affiliation Psychology Department, Mount Royal University, Calgary, Alberta, Canada

  • Kelsey Cnudde,

    Roles Data curation, Investigation, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Psychology Department, Mount Royal University, Calgary, Alberta, Canada

  • Laura M. Grant

    Roles Data curation, Investigation, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Psychology Department, Mount Royal University, Calgary, Alberta, Canada

Abstract

Although individual differences in processing speed, working memory, intelligence, and other cognitive functions were found to explain individual differences in retrospective memory (RetM), much less is known about their relationship with prospective memory (ProM). Moreover, the studies that investigated the relationship between ProM and cognitive functions arrived to contradictory conclusions. The relationship between ProM, personality, and psychopathology is similarly unsettled. Meta-analytic reviews of the relationships of ProM with aging and personality suggest that the contradictory findings may be due to widespread methodological problems plaguing ProM research including the prevalent use of inefficient, unreliable binary measures; widespread ceiling effects; failure to distinguish between various ProM subdomains (e.g., episodic ProM versus vigilance/monitoring); various confounds; and, importantly, small sample sizes, resulting in insufficient statistical power. Accordingly, in a large scale study with nearly 1,200 participants, we investigated the relationship between episodic event-cued ProM, episodic RetM, and fundamental cognitive functions including intelligence, personality, and psychopathology, using reliable continuous measures of episodic event-cued ProM. Our findings show that (a) continuous measures of episodic event-cued ProM were much more reliable than binary measures, (b) episodic event-cued ProM was associated with measures of processing speed, working memory, crystallized and fluid intelligence, as well as RetM, and that such associations were similar for ProM and RetM, (c) personality factors did not improve prediction of neither ProM nor RetM beyond the variance predicted by cognitive ability, (d) symptoms of psychopathology did not improve the prediction of ProM although they slightly improved the prediction of RetM, and (e) participants' sex was not associated with ProM but showed small correlations with RetM. In addition to advancing our theoretical understanding of ProM, our findings highlight the need to avoid common pitfalls plaguing ProM research.

Introduction

Prospective memory (ProM) allows us to make plans, retain them, and bring them back to one's consciousness at the right time and place [13]. ProM is used for a variety of everyday tasks including remembering to buy groceries en route home, picking up a child from daycare, keeping appointments, watching a bathtub so it does not overflow, taking medication at bedtime, and paying bills by the deadline. ProM is divided into several subdomains [1,2]: episodic ProM or ProM proper, vigilance/monitoring, and habitual ProM. Episodic ProM brings back to consciousness a previously formed plan at the right time or place, in response to appropriate cues (e.g., remembering to buy groceries en route home when seeing the grocery store sign). In contrast, vigilance/monitoring maintains the plan in consciousness from the formation of the plan until the right time or place for its performance (e.g., watching a bathtub so that it does not overflow). Habitual ProM is similar to episodic ProM, but the time and place for performing the plan repeats regularly with enough time between repetitions for the plan to leave consciousness (e.g., taking medication everyday at bedtime). Moreover, ProM may be cued by events (event-cued or event-based) or by time (time-cued or time-based). In this study, we focus on episodic event-cued ProM.

Although individual differences in processing speed, working memory, intelligence, and other cognitive functions were found to explain individual differences in retrospective memory (RetM), much less is known about their relationship with ProM. Moreover, the studies that have investigated the relationship between ProM, intelligence, and other cognitive functions have arrived to opposite conclusions. For example, Maylor [46] reported no significant correlations between ProM measures and verbal intelligence tests including the Mill Hill Vocabulary Test [7] and the vocabulary subtest of the Wechsler Adult Intelligence Scale–Revised [8]. Others have similarly found no relationships between ProM measures and verbal intelligence measures [913]. In contrast, other studies found small to moderate correlations between ProM and verbal intelligence [1418]. Similarly, inconsistent findings have been reported for fluid intelligence, working memory, processing speed, and RetM measures, even within these same studies.

Conflicting findings have also been reported for the relationships between ProM measures and measures of personality. Although Searleman noted that “people vary tremendously in their ability to successfully carry out many types of prospective memory tasks–some are astonishingly proficient at such tasks, whereas others are absolutely terrible at them,” [19] his and subsequent research found only weak and inconsistent relationships between ProM and personality factors [17,19]. Our meta-analysis of the relationship between personality and ProM found only weak correlations (.09 to .10) between ProM and three personality factors: openness, conscientiousness, and agreeableness [17]. However, the meta-analysis was based on a mix of episodic ProM and vigilance/monitoring studies, and because of the insufficient number of studies, we could not determine if the relationship between ProM and personality varied by ProM subdomain. Our subsequent large scale experimental study showed that episodic ProM was not related to any of the Big Five personality factors, whereas vigilance/monitoring was correlated with extroversion and openness [17]. Nevertheless, even our relatively large sample study (n = 283 for episodic ProM) did not have sufficient statistical power to detect correlations of .10 as suggested by the meta-analysis.

What may be the reasons for the inconsistent findings among the relationships between ProM and other cognitive functions and personality? We have previously examined similarly contradictory findings about age-related differences in ProM [2,17,20]. While some researchers concluded that there were no age related declines in ProM others found large age declines. In our reviews, we found a number of reasons for these inconsistent findings. First, ProM was typically assessed using binary success/failure measures. One natural consequence of such measurement is that ProM measures are imprecise, inefficient, and not reliable. In turn, binary measures substantially underestimate the true population correlation between ProM and aging. Further, such underestimation was more severe as the proportion of success to failures became more extreme. Second, a large proportion of ProM studies suffered from severe ceiling effects, with a large proportion of participants in such studies obtaining perfect or nearly perfect scores. In turn, the ceiling effects artificially reduced the observed correlations between ProM and aging. In fact, the strongest reported and independently replicated relationship involving ProM to date is r = .67 between the magnitude of age related decline in ProM and the degree to which the ProM performance was limited by ceiling effects [2,16,21,22]. Third, although many studies acknowledge the distinction between episodic ProM and vigilance/monitoring, it is rarely made explicit and readers must carefully read through method sections of various studies to determine whether a study examined episodic ProM or vigilance/monitoring. Importantly, we previously found that both age declines and personality correlations vary depending on ProM subdomain. Fourth, many previous studies confounded a variable of interest–age–with other variables, for example, intelligence. Finally, and equally important, most of the studies on ProM are based on small samples and do not have sufficient statistical power to detect even moderate correlations. We suspect the same methodological issues may be responsible for inconsistent findings among correlations between event-cued ProM, cognitive abilities, and personality.

Recently, there has also been an interest in the relationship between ProM, depression [23], anxiety [23], and other symptoms of psychopathology such as obsessive compulsive disorder (OCD) [2426]. Depression as well as anxiety are presumed to limit the amount of processing resources, and thus, reduce ProM performance. However, research findings are conflicting, with some studies finding negative correlations between ProM and depression and anxiety [9,23,27] and other studies finding no such relationships [23,28]. In contrast, theories about the relationship between ProM and OCD suggest that symptoms of OCD may cause ProM failures but also be caused by ProM failures. For example, symptoms of OCD combined with the awareness of past ProM failures may trigger increases in OCD symptoms such as compulsive checking [29]. But OCD associated with deficits in working memory and executive functions, may also cause ProM failures. Not surprisingly, some studies found a relationship between ProM and OCD, whereas other studies found no such relationships [29]. When reviewing the literature on ProM and compulsive checking, Cuttler and Graf pointed to several possible explanations including small sample sizes, failures to distinguish between episodic ProM and vigilance/monitoring, and a number of confounds when OCD groups were compared to healthy controls [29].

Finally, it has been suggested that non-cognitive factors (i.e., personality, lifestyle, etc.) are more influential than cognitive factors (i.e., processing speed, intelligence) in determining prospective memory performance [30]. In contrast, cognitive factors were found to be far more influential than personality factors in determining retrospective memory performance. However, to our knowledge, only one previous study examined relative importance of personality and lifestyle variables vs. cognitive variables on prospective memory performance but its results were different for different episodic prospective memory tasks and ultimately inconclusive [30]. Possible reasons for inconsistent findings were use of unreliable binary measures of prospective memory and prevalent ceiling effects on some but not other prospective memory tasks. Moreover, the authors noted that their study design did not allow any direct comparison of predictive power of personality and lifestyle vs. cognitive factors on episodic prospective vs. episodic retrospective memory [30].

Accordingly, the main objective of our study was to investigate the relationship between episodic event-cued ProM versus episodic RetM and fundamental cognitive functions, personality, and symptoms of psychopathology, using reliable continuous measures of ProM and a large sample of participants to ensure sufficient statistical power to detect even small (r = .10) relationships suggested by our meta-analysis of the relationships between ProM and personality [17]. The power analyses indicated that to detect r = .10, with power of .80 and two-tailed alpha of .05, the required sample size is N = 783 participants; to detect the same effect with power of .90 the required sample size is N = 1,047 participants; and to detect the same effect with power of .95, the required sample size is N = 1,294 participants. We aimed for statistical power of at least .90 to detect r = .10

There were five specific aims of the current study. The first aim was to examine the distribution, intercorrelations, and the composite reliability of two continuous measures of event-cued ProM. The second aim was to examine the relationships between event-cued ProM versus RetM and a variety of cognitive abilities including crystallized intelligence, fluid intelligence, processing speed, and working memory. The third aim was to examine the relationship between event-cued ProM versus RetM and personality. The fourth aim was to examine the relationship between even cued ProM versus RetM and depression, anxiety, and other symptoms of psychopathology. The fifth aim was to examine whether these relationships differ depending on participants' sex. And the final, sixth aim, was to examine relative contribution of personality vs. cognitive factors to performance on episodic prospective vs. episodic retrospective memory measures.

Method

Participants

Participants were 1170 undergraduate student volunteers, 79.9% women and 20.1% men, (age M = 21.43 years, SD = 5.24 years). The majority of participants spoke English as their first language (80.0%). The study was approved by Mount Royal University Human Research Ethics Board and all participants gave written consent to participate in the study. The study took approximately 2 hours and each participant received two course participation credits.

Measurement instruments

As part of a larger study, participants were administered several objective tests of ProM and RetM, measures of crystallized and fluid intelligence, working memory, processing speed, and personality. Table 1 shows the sequence of all questionnaires and tasks completed by the participants. Other questionnaires including the inner speech questionnaires and a course interest survey were included to insert a delay between ProM instructions and the start of the ongoing tasks as well as for other unrelated reasons that are not analyzed in this paper.

thumbnail
Table 1. Sequence of all instruments and tasks completed by participants, with the approximate time required to complete each task.

https://doi.org/10.1371/journal.pone.0193806.t001

Continuous measures of event-cued ProM (ProM/C).

The continuous measures of event-cued ProM developed for this study were patterned after continuous measures previously used by Uttl and his colleagues [15,16,31]. Participants' ProM was assessed on two occasions within the session to allow assessment of test-retest reliability. For each assessment, participants were instructed to circle any and all occurrences of the ProM cue–the word “content” (first assessment) and the word “close” (second assessment)–as they worked through the session. The specific instructions for the first assessment were:

We want to examine your ability to do something in the future. Thus, if you encounter the word content at any point during this experiment, please circle it. You will not be reminded again but it is important that you circle any and all occurrences of the word content. Please copy the following sentence below in your hand writing so that we are sure you did not miss these instructions: “I am to circle all occurrences of the word content.”

The instructions for the second assessment were identical except that the word content was replaced with the word close. Following these instructions, participants worked through the tasks.

For the first assessment, eight ProM cues were embedded within a word knowledge multiple choice test–Words/A40 (see below)–extended with 18 fillers and eight items that included ProM cues. Each page included six multiple choice items and one ProM cue appeared on each page starting with page four until the last page, page 11. Critically, the ProM cue became progressively larger and more intrusive on each successive page. The smallest cue was 12 points (identical to the surrounding text font size) and the largest cue was 28 points. If an examinee detected the very first cue, he or she obtained a score of eight. If the examinee detected the last cue, he or she obtained score of 1, and if the examinee did not detect any cues, he or she obtained score of 0. Thus, each participant's test score was determined solely by the first cue to which the participant responded.

For the second assessment, eight ProM cues were embedded within a personality inventory designed to measure the Big Five–IPIP 100 (see below)–extended with 33 fillers and eight items that included ProM cues. Both fillers and items containing ProM cues were drawn from the IPIP database. Thus, on each assessment, participants encountered the cues within an 11 page personality inventory. The first page contained the standard instructions for the personality inventory and each of the subsequent 10 pages had 15 personality items on it except the last page that had only six items. One ProM cue appeared on each page starting with page five. The ProM cues increased in size and the test was scored the same way as on the first assessment.

Binary measure of event-cued ProM (ProM/B).

To compare performance on binary vs. continuous measures, for each ProM assessment above, we also calculated a binary success/failure ProM measure based solely on participants' performance on the first shown ProM cue. If a participant responded to the very first cue, he or she obtained a score of 1. If the participant did not respond to the first cue, he or she received a score of 0.

Words/A40.

The Words/A40 is a 40-item multiple choice test designed to assess examinees' verbal knowledge [15]. Each item consists of a target word and four other words out of which one word is similar in meaning. Each item is scored as correct (1 point), incorrect (0 points), or not answered (0.25 points to correct for a failure to guess). The test score is the average across all items or the proportion of items correctly answered corrected for failure to guess.

International personality Item Pool NEO (IPIP 100).

The IPIP 100 [32] is a 100-item self-report personality inventory designed to measure the Big Five using items from the International Personality Item Pool (IPIP). Examinees rate how accurately each statement describes them using the following response scale: 1 = Very inaccurate, 2 = Moderately inaccurate, 3 = Neither inaccurate nor accurate, 4 = Moderately accurate, and 5 = Very accurate. Similarly to NEO PI-R, we calculated each participant's personality dimension scores as an average across the relevant items.

Shippley's Institute for Living Scale Reasoning test (SILS/R).

The SILS/R [33] is a 20-item test designed to assess examinees' reasoning skills. Examinees are asked to complete various sequences with the next item in the sequence, for example, if they are given the sequence of 2 4 16 __ they are expected to fill in 144 (2x2 = 4, 4x4 = 16, 16x16 = 144). The score is the proportion of the number of sequences correctly completed out of 20.

Verbal Learning Test Categorized 20 (VLT/C20).

The VLT/C20 [15] is a measure of explicit episodic RetM patterned after the Rey Auditory Verbal Learning Test [34] but five items are selected from each of the four categories: animals, clothing, vegetables, and kitchen items. The test consists of a series of three study-test trials on one set of 20 words selected from the four categories. On each trial, an examinee listened to a list of 20 words read by an experimenter and were required to write down as many words as they could remember, in any order, after the experimenter had completed reading the list. For each trial, participants were given 90 seconds for recall. The scores on each trial as well as the average of the three trials could range from 0 to 20.

Wechsler IV Digit Symbol Coding (DS Coding).

The DS Coding [35] is primarily a measure of processing and motor speed. Examinees are presented with a two row digit-symbol translation table with numbers from one to nine in the top row and the symbols corresponding to each number in the bottom row. Below the table, examinees are presented with rows of numbers and their task is to draw the corresponding symbols below each of the numbers, working as fast as they can, for 120 seconds. The DS Coding score is the number of correctly placed symbols with a maximum score of 135.

Wechsler IV Digit Span Backward (DS Backward).

The DS Backward [35] measures working memory. Examinees are read sequences of numbers and their task is to repeat back each sequence backwards. For example, if an examinee hears 3–5–4, he or she needs to repeat back 4–5–3. The DS Backward score is the length of the largest sequence that the examinee repeats back successfully.

Symptoms Checklist 90 Revised (SCL90R).

The SCL90R [36] is a 90-item questionnaire assessing psychological problems and symptoms of psychopathy. It includes nine primary dimensions: Somatization (SOMA), Obsessive-Compulsive (O-C), Interpersonal Sensitivity (I-S), Depression (DEP), Anxiety (ANX), Hostility (HOS), Phobic Anxiety (PHOB), Paranoid Ideation (PAR), Psychoticism (PSY). It also provides three global indexes: Global Severity Index (GSI) measures overall psychological distress; Positive Symptom Distress Index (PSDI) measures intensity of symptoms; and Positive Symptom Total (PST) is the total number of self-reported symptoms.

Course interest survey.

The Course Interest Survey [37] consisted of 44 titles and descriptions of all psychology courses offered in the 2012–2013 Mount Royal University calendar except the two introductory psychology first year courses that participants were registered in. The participants rated their interest in taking each course using a 5-point scale ranging from 1 = Not at all interested to 5 = Very interested.

Self Talk Scale (STS).

The STS [38] is a 22-item questionnaire measuring the frequency of both inner and private speech. Examinees indicate the frequency with which they engage in various self-talk using the 5-point scale: 1 = Never, 2 = Seldom, 3 = Sometimes, 4 = Often, and 5 = Very often.

Inner speech report.

The Inner Speech Report required participants to think about what they talk to themselves about. They were asked to write down as many things as they talk to themselves about as they could recall. The responses were coded for the number of inner speech instances produced and also classified into specific categories by content and function.

Varieties of Inner Speech Questionnaire (VISQ).

The VISQ [39] is an 18-item questionnaire designed to measure the phenomenological properties of inner speech including dialogic inner speech, condensed inner speech, other people in the inner speech, and evaluative/motivational inner speech. Examinees responded to each statement using a 6-point scale: 6 = Certainly applies to me, 5 = Possibly applies to me, 4 = If anything, applies to me slightly, 3 = If anything, slightly does not apply to me, 2 = Possibly does not apply to me, and 1 = Certainly does not apply to me.

Self Regulation Questionnaire (SRQ).

The SRQ [40] is a 63-item questionnaire designed to measure ability to develop, implement, and maintain planned behavior to achieve one’s goals. Examinees respond to each item using the 5-point Likert scale: 1 = Strongly disagree, 2 = Disagree, 3 = Uncertain or Unsure, 4 = Agree, 5 = Strongly Agree.

Self Control Scale (SCS).

The SCS [41] is a 36-item questionnaire designed to measure self-control, that is, the self-control over thoughts, emotional control, impulse control, performance regulation, and habit breaking. Examinees rated each statement on a 5-point scale ranging from 1 = Not at all like me to 5 = Very much like me.

Procedure

Participants were tested in small groups of 1 to 10 participants, seated widely separated in a small classroom, in a single session lasting approximately 2 hours, by one of eight trained research assistants. Table 1 indicates the order of the tasks and the approximate time required for completing each task. First, participants provided written informed consent and basic demographic information (age, gender, whether their first language was English, handedness, major). Second, they completed a set of timed tasks (DS Backward, DS Coding). Lastly, they completed the remaining tasks at their own pace, placing each completed page on the desk next to them (this prevented them from going back and circling cues they may not have responded to at the right time).

Results

Data screening

Following the recommendations for outlier detection [42,43], the data were screened for univariate outliers, defined as scores falling more than 3.5 MADe distances from the median (MAD = Median Absolute Deviation and MADe = 0.6745*MAD). A fewer than 0.1% of all values on any of the variables were identified as outliers. The influence of outliers was reduced by replacing them with corresponding outlier caps (i.e., a value 3.5*MADe from a median, either below or above, as appropriate).

Continuous versus binary measures of ProM

Table 2 shows the means, standard deviations, and reliabilities for individual ProM assessments as well as for the composite ProM measures (i.e., averages of the two assessments). The data are shown separately for men, women, and for all participants combined. As expected, the correlation between the two binary measures of ProM was small, r = .11. In contrast, the correlation between the two continuous measures of ProM was much larger, r = .50. In turn, the Cronbach’s α of the binary composite was much smaller than that of the continuous composite, .19 versus .64. In comparison, the Cronbach’s α of the RetM tests–VLT/C20, calculated over three study-test trials, was .87. Our results confirm a well-known mathematical fact that binary measures are unable to measure individual differences in abilities with any degree of precision, are unreliable, and inefficient.

Accordingly, the binary measures of ProM are reported for comparison purposes only and to highlight their inferior psychometric properties. The continuous measures of ProM are used for all substantive analyses to address objectives of this study.

Fig 1 shows the distribution of the ProM/C, a continuous measure of ProM. The distribution is relatively close to normal, with a negative skew (-1.72), and with a relatively small number of participants scoring either at the ceiling (6.0%) or at the floor (3.7%).

thumbnail
Fig 1. Distribution of ProM/C (continuous measure of ProM).

The distribution of ProM/C was relatively normal with a negative skew. Only a small number of participants scored at the floor or at the ceiling.

https://doi.org/10.1371/journal.pone.0193806.g001

ProM, RetM, intelligence, working memory, and processing speed

Table 2 also shows the means, standard deviations, and reliabilities for all other measures. Table 3 shows a partial correlation matrix showing correlations among ProM, RetM, intelligence, working memory, and processing speed measures.

Fig 2 contrasts the correlations between ProM versus RetM and Words/A40, SILS/Reasoning, DS Backward and DS Coding. First, for intelligence measures, SILS/R and Words/A40, the correlations with ProM and RetM were comparable (Words/A40: z = 1.434, p = .076; SILS/R: z = 0, p = .500). Second, for both processing speed and working memory measures, the correlations were stronger with RetM than with ProM (DS Coding: z = 2.531, p = .006; DS Backwards: z = 3.071, p = .001).

thumbnail
Fig 2. Correlations between ProM and RetM with intelligence, processing speed, and working memory.

ProM versus RetM correlations with crystallized and fluid intelligence were comparable. In contrast, correlations with processing speed and working memory were smaller for ProM versus RetM.

https://doi.org/10.1371/journal.pone.0193806.g002

ProM, RetM, personality and symptoms of psychopathology

Table 3 also shows correlations between ProM versus RetM and personality and symptoms of psychopathology. Fig 3 highlights that out of the Big Five, as measured by IPIP100, only Intellect/Imagination (Openness) correlated with ProM with a correlation of, r = .09. Fig 3 also highlights the same pattern of correlations between the Big Five and ProM for RetM.

thumbnail
Fig 3. Correlations between ProM and personality.

Both ProM and RetM correlated only with Openness and the two correlations were comparable. The dashed lines indicate p = .05 criterion.

https://doi.org/10.1371/journal.pone.0193806.g003

Fig 4 shows that, in general, symptoms of psychopathology were negatively correlated with ProM but that such correlations were weak, < .10, and only Hostility and Paranoia reached .10. Similar weak correlations were found between symptoms of psychopathology and RetM.

thumbnail
Fig 4. Correlations between ProM and symptoms of psychopathology.

In general, both ProM and RetM showed very small negative correlations with symptoms of psychopathology. The dashed lines indicate p = .05 criterion.

https://doi.org/10.1371/journal.pone.0193806.g004

Sex differences in ProM

Table 3 includes correlations between sex and measures of ProM as well as between sex and all other measures. The correlation between sex and ProM was near zero, r = .03, and not statistically significant even though there was a small significant correlation between sex and RetM, r = .15.

Given the large sample, Table 4 and Table 5 show the partial correlation matrix among ProM, RetM, and other measures for men and women, respectively. The correlations between ProM and other measures were similar for men and women.

Regression analyses

We conducted several hierarchical regression analyses to predict performance on ProM versus RetM measures using cognitive ability, personality, and symptoms of psychopathology. In the first set of analyses, the cognitive variables measuring processing speed, working memory and crystalized and fluid intelligence were entered first, and personality and symptoms of psychopathology measures were added on subsequent steps. These analyses allows us to see how much additional variance personality and psychopathology measures explain above and beyond cognitive measures. In the second set of analyses, suggested by the reviewers, the personality and symptoms of psychopathology measures were entered first and cognitive measures on subsequent steps. This second set of analyses allows us to see how much additional variance cognitive measures explain above and beyond personality and symptoms of psychopathology measures.

Table 6 shows the results of the first set of the hierarchical regression analyses. On the first step, we entered DS Coding, a measure of processing speed. On the second step, we added DS Backward, a measure of working memory. On the third step, we added the two measures of intelligence, Words/A40 and SILS/R. On the fourth step, for predicting ProM only, we added VLT/C20, a measure of RetM. On the fifth step, we added personality measures, and, on the fifth alternative step, we added measures of symptoms of psychopathology. When predicting ProM, on each of the first four steps, the added variables significantly improved prediction but, when intelligence measures were added into the model, DS Coding and DS Backward coefficients were no longer statistically significant. In total, cognitive ability variables explained 14.9% of variability in ProM. On the fifth step, neither personality nor symptoms of psychopathology measures improved prediction beyond cognitive ability.

thumbnail
Table 6. Summary of hierarchical regression analyses predicting ProM versus RetM from cognitive ability, personality, and symptoms of psychopathology.

https://doi.org/10.1371/journal.pone.0193806.t006

When predicting RetM, on each of the first three steps, the added variables significantly improved prediction, with DS Coding and DS Backward's contributions being stronger than for ProM. Moreover, when intelligence measures were added into the model, DS Coding and DS Backward coefficients remained statistically significant. In total, cognitive ability variables also explained 14.9% of variability in RetM. Similar to ProM, personality did not improve the prediction of RetM beyond cognitive ability. However, symptoms of psychopathology improved the prediction of RetM slightly, (1.7% increase in R2).

Table 7 shows the results of the second set of the hierarchical regression analyses. On the first step, we entered personality variables. On the second step, we added symptoms of psychopathology. On the third step, we added DS Coding, a measure of processing speed. On the fourth step, we added DS Bakward, a measure of working memory. On the fifth step, we added two measures of intelligence, Words/A40 and SILS/R. And on the sixth, final step, we added VLT/C20, a measure of RetM.

thumbnail
Table 7. Summary of hierarchical regression analyses predicting ProM versus RetM from personality, symptoms of psychopathology, and cognitive ability.

https://doi.org/10.1371/journal.pone.0193806.t007

When predicting ProM, the added variables significantly improved prediction at each step. The personality and symptoms of psychopathology explained only 3.3% of variance. In contrast, cognitive variables explained additional 12.6% of variance above and beyond the personality and symptoms of psychopathology variables. Similarly, when predicting RetM, the added variables significantly improved prediction at each step. The personality and symptoms of psychopathology explained 4.8% of variance in RetM. The cognitive variables explained additional 13.2% of variance above and beyond the personality and symptoms of psychopathology variables.

Discussion

The current study resulted in the following key findings. First, continuous measures of episodic event-cued ProM were more reliable than binary measures derived from the same ProM task. The reliability of a composite continuous measure of ProM was respectable, .64. Accordingly, as expected [2,44], the composite of two continuous versus binary measures of ProM showed larger correlations with other measures, including measures of cognitive ability, personality, and symptoms of psychopathology. Second, episodic event-cued ProM was associated with measures of processing speed, working memory, crystallized and fluid intelligence, as well as RetM. Moreover, processing speed, working memory, and intelligence explained comparable proportions of variance in ProM and RetM. Third, personality factors–Big Five measured by IPIP100 –did not improve the prediction of neither ProM nor RetM beyond variance predicted by cognitive ability. Fourth, symptoms of psychopathology did not improve the prediction of ProM although they slightly improved the prediction of RetM. When personality and symptoms of psychopathology were entered first in the hierarchical regression analyses, they explained only 3.3% and 4.8% variance in ProM and RetM, respectively. Cognitive measures explained additional 12.6% and 15.2% of variance in ProM and RetM, respectively, above and beyond the variance explained by personality and symptoms of psychopathology. Finally, participants' sex was not associated with ProM but showed small correlations with RetM.

The use of unreliable binary measures in the investigations of ProM has two direct, undesirable consequences. First, because unreliable measures measure primarily error variation rather than ability of interest, researchers must use large sample sizes to increase statistical power and to compensate for the low reliability of binary measures. As a corollary, studies with small samples are unlikely to find any statistically significant correlations between binary ProM measures and other abilities and constructs. Since most of the previous studies investigating relationships between ProM and other individual differences used binary measures of ProM and small samples, it is not surprising that they often reported no correlations between ProM and intelligence, personality, and symptoms of psychopathology.

Second, the use of unreliable binary measures of ProM makes it nearly impossible to compare magnitudes of correlations between ProM and other constructs and variables because of large differences in reliability of the measures. For example, for theoretical reasons [45], researchers have been interested in determining whether ProM versus RetM show larger age-related declines across the adult life span. However, when there are large differences in the reliabilities of ProM and RetM measures used in a particular study, researchers are more likely to find that age declines on ProM measures are smaller than age declines on RetM measures simply because of the differences in the reliabilities of the two measures rather than the differences in the size of the true age declines themselves [2].

We found substantial correlations between episodic event-cued ProM and cognitive ability measures. Both crystallized/verbal intelligence and fluid/performance intelligence measures correlated with episodic ProM and these correlations were as large as with RetM. Processing speed and working memory correlated somewhat weaker with ProM than with RetM. This latter finding is consistent with the views that processing speed and working memory are more important for both encoding and retrieval in RetM, less important for encoding of the ProM cue and plan, and even less important for retrieval in ProM. For example, in our study, participants only had a limited time to encode 20 to-be-remembered words for the RetM test, whereas they had unlimited time to encode only one ProM cue. However, although cognitive abilities explained a similar proportion of variance in ProM and RetM measures in our study, it is possible and even likely that cognitive abilities would explain a larger proportion of variability in ProM than in RetM if reliabilities of ProM and RetM measures were equal.

Our examination of the relationships between episodic ProM and personality showed that out of the Big Five, only the Openness (measured by IPIP Intellect) was correlated with episodic ProM, and that this correlation was very small, r = .08. This finding is consistent with both (a) our meta-analysis of previously published studies suggesting that any correlations between personality and ProM were small (r ~ .10) and (b) our large sample study (N = 283) showing no statistically significant correlations between episodic ProM and the Big Five (measured by two different personality inventories) even though episodic ProM correlated .09 with NEO Openness and .04 with IPIP Openness [17]. Although it may seem surprising that, for example, Conscientiousness was not correlated with episodic ProM, Conscientiousness may not influence performance in controlled laboratory conditions [17,30]. Personality factors such as Conscientiousness may be more influential if episodic ProM was assessed in natural conditions and/or when completion of an episodic ProM task is of greater social importance to participants. Personality factors may be more influential if ProM was assessed in natural conditions, the ProM cue was time rather than an event, and the ProM task was socially important [17,46]. In our earlier study, we [17] found that personality factors affect subdomains of ProM (i.e., episodic ProM versus vigilance/monitoring) differently and it would not be surprising if the relationship between personality factors and various ProM subdomains also differed depending on whether ProM is assessed in laboratory versus natural settings.

We also found that correlations between episodic ProM versus RetM and personality factors were comparable. Only Openness correlated significantly with RetM and the correlation was also very small, r = .09. Correlations between personality and RetM have been reported previously but they were generally small and found in some studies but not in others. Consistent with our findings, previous studies often reported that RetM correlates positively with Openness and negatively with Agreeableness, although such correlations tend to be small and often not significant even in large sample studies [17].

With respect to symptoms of psychopathology, we generally found very small negative correlations between both episodic ProM and RetM. Specifically, episodic ProM was weakly negatively correlated with Obsessive-Compulsive symptoms, Depression, Anxiety, Hostility, Phobic Anxiety, Paranoid Ideation, and Psychoticism. These correlations were similar to those found for RetM. These findings suggest that the negative effects of psychopathology symptoms are general rather than specific to only some of the symptoms. Nevertheless, however, they are not inconsistent with a suggestion that ProM correlations with symptoms of psychopathology may be very specific. For example, larger effects for checkers but smaller effects for non-checkers, within obsessive-compulsive subclinical and clinical disorders [29].

We also examined the correlations between episodic ProM and participants' sex. Although we observed a small correlation between participants' sex and RetM favoring women (r = .15), the correlation between participants' sex and episodic ProM was nearly zero and not significant. Moreover, we found no appreciable differences between correlations for men and women, for measures of ProM, RetM, cognitive abilities, personality, and symptoms of psychopathology.

Despite our large sample size and use of reliable continuous measures of ProM, our findings are limited to episodic even-cued ProM, assessed in laboratory settings, and to undergraduate students–a common limitations of many previous studies on relationships between personality, psychopathology and ProM and RetM. They may or may not generalize to other prospective memory subdomains, naturalistic settings, or other populations. Future studies will need to examine generalizability our out findings to other ProM subdomains, other settings and other populations.

Conclusions

Our investigation was motivated by contradictory findings about the relationship between ProM and fundamental cognitive functions, personality, and symptoms of psychopathology. We examined these correlations in a large sample study, used reliable continuous measures of episodic ProM, and compared them to the correlations with RetM. Contrary to numerous prior findings, episodic ProM correlated with fundamental cognitive functions including processing speed, working memory, crystallized intelligence, fluid intelligence, and RetM. Although the pattern of the correlations was partially different for ProM versus RetM, overall these cognitive functions explained a similar proportion of variance in both ProM and RetM. Consistent with our prior meta-analysis and prior studies, we found that episodic ProM is largely unrelated to the Big Five personality factors and that ProM and RetM are similarly related to the Big Five. Only Openness was significantly correlated with both ProM and RetM. Similarly, the symptoms of psychopathology were weakly negatively correlated with ProM and RetM. In summary, our results show that cognitive factors were far more influential than non-cognitive personality and psychopathology factors in explaining both ProM and RetM performance. Importantly, our results suggest that the previous studies failed to find these relationships because of methodological issues including the use of inefficient, unreliable, binary measures of ProM; ceiling effects; and small sample sizes resulting in lack of statistical power.

Our findings are specific to episodic event-cued ProM assessed in laboratory settings. They may or may not generalize to other ProM subdomains or to a natural setting. Our previous research shows that it would be hazardous to assume that ProM correlations with cognitive functions, personality, and symptoms of psychopathology are invariant across ProM subdomains and assessment settings. For example, we found that age declines in episodic event-cued ProM are much larger than age declines in event-cued vigilance/monitoring [2]. Similarly, we found that ProM relationships with personality varied by ProM subdomain [17]. Moreover, as discussed above, personality factors may be far more influential in natural settings as well as for personally important ProM tasks [17,46].

Acknowledgments

This research was supported by Natural Science and Engineering Research Council of Canada Discovery Grant to Bob Uttl. We thank Amy L. Siegenthaler for careful reading and comments on the manuscript.

References

  1. 1. Graf P, Uttl B. Prospective memory: a new focus for research. Conscious Cogn. 2001;10: 437–450. pmid:11790035
  2. 2. Uttl B. Transparent meta-analysis of prospective memory and aging. PloS One. 2008;3: e1568. pmid:18286167
  3. 3. Brandimonte MA, Einstein GO, McDaniel MA, editors. Prospective Memory: Theory and Applications. Mahwah, N.J: Psychology Press; 1995.
  4. 4. Maylor EA. Age and prospective memory. Q J Exp Psychol Sect A. 1990;42: 471–493.
  5. 5. Maylor EA. Aging and forgetting in prospective and retrospective memory tasks. Psychol Aging. 1993;8: 420–428. pmid:8216962
  6. 6. Maylor EA. Changes in Event-Based Prospective Memory Across Adulthood. Aging Neuropsychol Cogn. 1998;5: 107–128.
  7. 7. Raven JC. Guide to using the Mill Hill vocabulary test with progressive matrices. Lond UK HK Lewis. 1965;
  8. 8. Wechsler D. Wechler adult intelligence scale-revised (WAIS-R). Psychological Corporation; 1981.
  9. 9. Altgassen M, Vetter NC, Phillips LH, Akgün C, Kliegel M. Journal of Experimental Child Psychology. J Exp Child Psychol. 2014;127: 163–175. pmid:24933705
  10. 10. Ford RM, Driscoll T, Shum D, Macaulay CE. Executive and theory-of-mind contributions to event-based prospective memory in children: Exploring the self-projection hypothesis. J Exp Child Psychol. 2012;111: 468–489. pmid:22169353
  11. 11. Hertzog C, Park DC, Morrell RW, Martin M. Ask and ye shall receive: Behavioural specificity in the accuracy of subjective memory complaints. Appl Cogn Psychol. 2000;14: 257–275.
  12. 12. Kidder DP, Park DC, Hertzog C, Morrell RW. Prospective memory and aging: The effects of working memory and prospective memory task load. Aging Neuropsychol Cogn. 1997;4: 93–112.
  13. 13. Alfaraj AMAI, Spada MM, Nikčević AV, Puffett A, Meer S. Positive beliefs about rumination in depressed and non-depressed pregnant women: A preliminary investigation. J Reprod Infant Psychol. 2009;27: 54–60.
  14. 14. Tam JW, Schmitter-Edgecombe M. Event-based prospective memory and everyday forgetting in healthy older adults and individuals with mild cognitive impairment. J Clin Exp Neuropsychol. 2013;35: 279–290. pmid:23419059
  15. 15. Uttl B. Age-related changes in event-cued visual and auditory prospective memory proper. Aging Neuropsychol Cogn. 2006;13: 141–172.
  16. 16. Uttl B, Kibreab M. Self-report measures of prospective memory are reliable but not valid. Can J Exp Psychol Can Psychol Expérimentale. 2011;65: 57.
  17. 17. Uttl B, White CA, Wong Gonzalez D, McDouall J, Leonard CA. Prospective memory, personality, and individual differences. Front Psychol. 2013;4. Available: http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3605513/
  18. 18. Wang Y, Chan RC, Hong X, Ma Z, Yang T, Guo L, et al. Prospective memory in schizophrenia: further clarification of nature of impairment. Schizophr Res. 2008;105: 114–124. pmid:18707848
  19. 19. Searleman A. Personality variables and prospective memory performance. Basic Appl Mem Res Pract Appl. 1996;2: 111–119.
  20. 20. Uttl B. Transparent meta-analysis: does aging spare prospective memory with focal vs. non-focal cues? PloS One. 2011;6: e16618. pmid:21304905
  21. 21. Uttl B. Age-related changes in event-cued prospective memory proper. Dynamic cognitive processes. Springer; 2005. pp. 273–303. Available: http://link.springer.com/chapter/10.1007/4-431-27431-6_12
  22. 22. McDaniel MA, Einstein GO. Prospective Memory: An Overview and Synthesis of an Emerging Field. 1 edition. SAGE Publications, Inc; 2007.
  23. 23. Arnold NR, Bayen UJ, Böhm MF. Is prospective memory related to depression and anxiety? A hierarchical MPT modelling approach. Memory. 2015;23: 1215–1228. pmid:25337864
  24. 24. Cuttler C, Graf P. Sub-clinical compulsive checkers’ prospective memory is impaired. J Anxiety Disord. 2007;21: 338–352. pmid:16860532
  25. 25. Cuttler C, Graf P. Sub-clinical checking compulsions are related to impaired prospective memory independently of depression, anxiety and distractibility. J Anxiety Disord. 2008;22: 642–654. pmid:17656066
  26. 26. Cuttler C, Graf P. Sub-clinical compulsive checkers show impaired performance on habitual, event-and time-cued episodic prospective memory tasks. J Anxiety Disord. 2009;23: 813–823. pmid:19394193
  27. 27. Harris LM, Cumming SR. An Examination of the Relationship Between Anxiety and Performance on Prospective and Retrospective Memory Tasks. Aust J Psychol. 2003;55: 51–55.
  28. 28. Livner A, Berger A-K, Karlsson S, Backman L. Differential effects of depressive symptoms on prospective and retrospective memory in old age. J Clin Exp Neuropsychol. 2008;30: 272–279. pmid:17852610
  29. 29. Cuttler C, Graf P. Checking-in on the memory deficit and meta-memory deficit theories of compulsive checking. Clin Psychol Rev. 2009;29: 393–409. pmid:19442426
  30. 30. Cuttler C, Graf P. Personality predicts prospective memory task performance: an adult lifespan study. Scand J Psychol. 2007;48: 215–231. pmid:17518914
  31. 31. Graf P, Uttl B, Dixon R. Prospective and retrospective memory in adulthood. Lifesp Dev Hum Mem. 2002; 257–282.
  32. 32. Goldberg LR. The development of markers for the Big-Five factor structure. Psychol Assess. 1992;4: 26–42.
  33. 33. Shipley WC. A self-administering scale for measuring intellectual impairment and deterioration. 1940;9: 371–377.
  34. 34. Strauss E, Sherman E, Spreen O. Rey Auditory Verbal Learning Test. Compend Neuropsychol Tests 3rd Ed Oxf Univ Press. 2006; 776–807.
  35. 35. Wechsler D, Coalson DL, Raiford SE. WAIS-IV: Wechsler adult intelligence scale. Pearson San Antonio, TX; 2008.
  36. 36. Derogatis LR. Symptom Checklist-90-Revised (SCL-90-R). San Antonio, TX, USA: Pearson; 1994.
  37. 37. Uttl B, White CA, Morin A. The numbers tell it all: students don’t like numbers! Plos One. 2013;8: e83443–e83443. pmid:24358284
  38. 38. Brinthaupt TM, Hein MB, Kramer TE. The self-talk scale: Development, factor analysis, and validation. J Pers Assess. 2009;91: 82–92. pmid:19085287
  39. 39. McCarthy-Jones S, Fernyhough C. The varieties of inner speech: links between quality of inner speech and psychopathological variables in a sample of young adults. Conscious Cogn. 2011;20: 1586–1593. pmid:21880511
  40. 40. Brown JM, Miller WR, Lawendowski LA. The self-regulation questionnaire. 1999; Available: http://psycnet.apa.org/psycinfo/1999-02283-018
  41. 41. Tangney JP, Baumeister RF, Boone AL. High self-control predicts good adjustment, less pathology, better grades, and interpersonal success. J Pers. 2004;72: 271–324. pmid:15016066
  42. 42. Iglewicz B, Hoaglin DC. How to Detect and Handle Outliers. ASQC Quality Press; 1993.
  43. 43. Seo S. A review and comparison of methods for detecting outliers in univariate data sets. Master’s Thesis, University of Pittsburgh. 2002.
  44. 44. Glass GV, Hopkins KD. Statistical Methods in Education and Psychology. 3 edition. Boston: Pearson; 2008.
  45. 45. Craik . A functional account of age differences in memory. Klix F & Hagendorf H(Eds) Human memory and cognitive capabilities. Elsevier Science Bv; 1986.
  46. 46. Graf P. Prospective Memory: Faulty Brain, Flaky Person. Can Psychol. 2012;53: 7.