Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The utility of simple questions to evaluate cognitive impairment

  • Yugaku Daté,

    Roles Data curation, Formal analysis, Writing – original draft

    Affiliation Departments of Neurology, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Daisuke Sugiyama,

    Roles Formal analysis

    Affiliation Faculty of Nursing and Medical Care Graduate School of Health Management, Keio University, Kanagawa, Japan

  • Hajime Tabuchi,

    Roles Data curation, Formal analysis

    Affiliation Departments of Neuropsychiatry, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Naho Saito,

    Roles Formal analysis

    Affiliation Departments of Neuropsychiatry, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Mika Konishi,

    Roles Formal analysis

    Affiliation Departments of Neuropsychiatry, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Yoko Eguchi,

    Roles Formal analysis

    Affiliation Departments of Neuropsychiatry, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Yuki Momota,

    Roles Formal analysis

    Affiliation Departments of Neuropsychiatry, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Takahito Yoshizaki,

    Roles Formal analysis

    Affiliation Departments of Neurology, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Kyoko Mashima,

    Roles Formal analysis

    Affiliation Departments of Neurology, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Masaru Mimura,

    Roles Writing – review & editing

    Affiliation Departments of Neuropsychiatry, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Jin Nakahara,

    Roles Writing – review & editing

    Affiliation Departments of Neurology, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

  • Daisuke Ito

    Roles Conceptualization, Data curation, Writing – original draft, Writing – review & editing

    d-ito@jk9.so-net.ne.jp

    Affiliation Departments of Neurology, Keio University School of Medicine, Shinjuku-ku, Tokyo, Japan

Abstract

Objectives

As the population of patients with cognitive decline grows, physicians and caregivers need brief screening tools. Comprehensive neurocognitive batteries require special training and time for evaluation. We focused on accessibility and compared the diagnostic power of several easy questions.

Design

“Attended With” (AW) and “Head-Turning Sign” (HTS) factors and participants’ replies to following questions were recorded: “Do you feel that you have more difficulties in your daily life than you used to?”, [no consciousness (C-) or consciousness+ (C+)], “Could you tell me about your daily pleasures or pastimes?” [no pleasure (P-) or pleasure + (P+)], “What are notable current/recent news/topics?” [no news (N-) or news+ (N+)].

Setting

This took place in our Memory Clinic between May 2016 and July 2019.

Participants

We enrolled 162 consecutive cases (44 cognitive normal (CN), 55 amnestic mild cognitive impairment (aMCI), and 48 Alzheimer’s disease (AD)).

Measurements

The sensitivity and specificity of each battery were calculated, and on account of those numbers, the population attributable risk percent % (PAR%) of (AW and HTS+), (C- and P-), (C- and N-), (P- and N-) as analysis of combination of questions, respectively, were calculated.

Results

AW had high sensitivity, 87.4, 95.8% (CN vs aMCI + AD, CN + aMCI vs AD) but the sensitivity of HTS was only 46.4, 57.7%, and HTS showed high specificity, 100.0, 71.8%. C- had high sensitivity, 80.6, 87.5%, whereas P- and N- had high specificity, both 83.9% in CN vs aMCI + AD, 88.1% and 75.9% in CN + aMCI vs AD, respectively. In combination analysis, the PAR% of (C- and N-) were as high as (AW and HTS+).

Conclusions

The combination of (C- and N-) is as powerful as (AW and HTS+) in screening AD. Our findings provide novel insights for screening utility of brief questions “Consciousness of Impairment” and “Recent News.”

Introduction

The rate of memory loss is 41% among people aged 55–64 years and 52% among those aged 70–85 years [1]. As the worldwide population grows older at an unprecedented rate, complaints of memory loss and cognitive disorder will be more and more common [25]. In order to diagnose dementia accurately, a thorough medical history, physical and neurological examination, and neurocognitive assessment are needed [6]. Neurocognitive function should be assessed by means of comprehensive set of batteries [7], but these batteries require special training and much time for assessment that many clinicians are unable to spare. The Mini Mental State Examination (MMSE) is a brief examination to detect dementia, but it requires as long as ten minutes per patient and is reported to have low sensitivity, that is, a high rate of false negatives [8].

As more and more people develop cognitive dysfunction and most of them are not conscious of the fact that they are developing an illness [9, 10], prompt access to suitable medical care relies on primary physicians or caregivers who consult neurologists or psychiatrists, and more time-saving and easy assessment screening batteries are necessary. “Attended With (AW)” and “Head-Turning Sign (HTS)” have been reported to be the most effective set of screening batteries [11]. A patient with negative AW, which means he or she visits the clinic alone, is likely to have an absence of cognitive decline [12]. HTS, which is a patient's behavior of looking back to his or her accompanying person for help when asked something by the examiner, is reported to be a strong marker of dementia [13]. Soysal P. et al. reported the effectiveness of AW and HTS as a marker of cognitive decline, especially focusing on older populations who are most likely to develop dementia [14].

But there are some limitations to these batteries. AW has high sensitivity to detect cognitive decline in older adults [14] but cannot evaluate the cognitive function of hospitalized patients. To identify HTS, at least one accompanying person is necessary, so is not always suitable for hospitalized patients or those who live alone. In cases where a professional caregiver wants to evaluate a client’s cognitive function in the client’s home, neither AW nor HTS is an effective tool. Further, both are affected by cultural settings and regional/national characteristics. In searching for easy screening questions for cognitive impairment, we focused on briefness, effectiveness (sensitivity and specificity), and accessibility to all older adults.

Materials and methods

Participants

Between May 2016 and July 2019, 162 consecutive participants, aged 60 to 89 years at the first medical examination, were recruited from the memory clinic of Keio University Hospital as a retrospective clinical cohort. The study design and protocol were approved by the Ethics Committee for Human Research of the Keio University School of Medicine (#20170315). Informed consent was obtained in the form of opt-out on the web-site (https://www.neurology.med.keio.ac.jp/newslist/). Those who rejected were excluded.

Assessment

All subjects underwent thorough medical history, neurological examination, and serum examination. After that they underwent at least two types of imaging studies, including head magnetic resonance imaging (MRI) and cerebral fluid single photon emission computed tomography (SPECT), and if needed, myocardial 123I-Metaiodobenzylguanidine (MIBG) scintigraphy and / or dopamine transporter scan. They were also examined with conclusive neurocognitive batteries including the MMSE, Logical Memory subtest of Wechsler Memory Scale revised (LM), Rey-Osterrieth Complex Figure Test (ROCFT), Ray Auditory Verbal Learning Test (RAVLT), Trail Making Test (TMT), Verbal Fluency Test (initial letter and category), Neuropsychiatric Inventory—Questionnaire (NPI-Q), Zarit Burden Interview, GDS and Geriatric Depression Scale15 (GDS15) for diagnosis, as previously described [7]. For RAVLT, the five learning trials on category A list (trials 1–5) were followed by an interference category B list, followed by two post-list B interference recall trials, an immediate and delayed, then a recognition trial with distractor words [15].

Diagnoses of dementia were assigned after several visits by dementia specialists according to reference criteria [1619].

Brief questions

On a participant’s first visit to our memory clinic, AW and HTS were recorded. AW was based on whether the patient first visited the clinic accompanied by someone else, such as a family, friend, or caretaker. The accompanying person was instructed to sit next to or behind the patient at an angle of 45°, and if the patient turned his or her head at least one time seeking for help during the medical interview, he or she was recorded as “HTS+” [14].

We asked every patient three questions: “Do you feel that you have more difficulties in your daily life than you used to?”; “Could you tell me about your daily pleasures or pastimes?”; and “What are notable current/recent news/topics?” In this study, all subjects were patients visiting our hospital, not a community-based population; the majority of patients visiting alone had some memory or cognitive-related complaints. Thus if a patient answered, “Yes, I have difficulties in my daily life,” they were classified as self-aware [“Consciousness + (C+)”]; if they answered, “No, I do not have difficulties”, they were classified as having “unconsciousness, anosognosia, (C-)” in the recorded results. Only when a patient provided a specific and concrete answer like “I enjoy feeding our dog and going for a walk to a nearby park with him” was the patient recorded as engaging in “Pleasure or pastime+ (P+)”. When the patient answered nothing, or the answer was subtle or abstract (like “Generally I enjoy everything”), the patient was recorded as “(P-)”. When a patient provided an example of concrete, adequate, recent news (within half a year), he or she was recorded as aware of “news+ (N+)”, but if the patient answered nothing, or gave an abstract answer like “There have been a number of recent events”, or provided news more than half a year old, he or she was recorded as “no news (N-)”.

Data analysis

For these five types of batteries, AW, HTS, Consciousness, Pleasure or Pastime, and Recent News, the number of patients diagnosed as Alzheimer’s disease (AD), amnestic mild cognitive impairment (aMCI), and as cognitively normal were counted. In this step, the diagnosis of dementia only included dementia caused by AD spectrum (AD, mixed dementia (AD and VD, AD and DLB, aMCI). Other forms of dementia were excluded. The sensitivity and specificity to distinguish cognitive normal (CN) + aMCI vs dementia, and CN vs aMCI + dementia, were calculated respectively for these five batteries. To clarify which combination of questions is the most impact for diagnosis, we estimated the attributable risk percentage (PAR%), [1− (1/odd ratio)]*100%, of (AW and HTS+), (C- and P-), (C- and N-), and (P- and N-), each for CN + aMCI vs AD, and CN vs aMCI + AD, respectively. Significant differences among groups for each neuropsychiatric battery were examined by the Student’s t test.

Results

Participants

The characteristics of 162 patients who visited the Memory Clinic in Keio University Hospital and their final diagnoses are demonstrated in Table 1. In terms of educational history, 45.7% (74 out of 162) patients had 16 years of education or more, much higher than the 19.9% average percentage of university graduates in the Japanese population[20].

MMSE was recorded in 154 patients with an average score of 24.45±4.30. One hundred fifty-one out of 162 patients underwent GDS15, and the average score was 4.00±3.74. Out of 162 patients, 48 patients were diagnosed as AD, all 55 MCI were diagnosed as aMCI, and 44 were CN, including subjective cognitive impairment. Fifteen residual patients were diagnosed either as dementia with DLB, FTLD, epilepsy after encephalitis, chronic alcohol addiction, or iNPH. We focused on 44 CN and 103 patients with cognitive impairment due to AD spectrum [AD including mixed dementia (AD and VD, DLB and AD), aMCI.].

Sensitivity and specificity of each clinical sign/question

The number of patients who were classified as CN, aMCI, or AD in each clinical sign are shown in Table 2. Notably, 42 patients were visiting alone (AA), of whom only two were AD. No CN was HTS positive and only 10 subjects with CN and aMCI showed P-.

thumbnail
Table 2. Numbers of patients classified as NC, aMCI or AD in each clinical sign.

https://doi.org/10.1371/journal.pone.0233225.t002

Table 3 shows the sensitivity and specificity of each sign to assess cognitive function. Both AW+ and C- show high sensitivity, more than 80%, in both CN vs aMCI + AD and CN + aMCI vs AD. The sensitivity of AW was higher than that of C- in both CN vs aMCI + AD and CN + aMCI vs AD. Both P- and N- had 83.9% specificity to distinguish the CN and aMCI + AD, and the specificity of P-, 88.1%, was the highest in distinguishing CN + aMCI vs AD. The highest specificity in distinguishing CN vs aMCI + AD was shown by HTS+, but in distinguishing CN + aMCI vs AD, the specificity of HTS+ was lower than P- or N-.

thumbnail
Table 3. Sensitivity and specificity of each sign in assessing cognitive function.

https://doi.org/10.1371/journal.pone.0233225.t003

Analysis of combination of questions

The specificity of P- in CN + aMCI vs AD is higher than that of N-, but the absolute number of AD patients in P- group is smaller than that in C- or N- group, so the diagnostic power of C-, P-, and N- is not simply compared only by the sensitivity and specificity. To clarify which combination of questions is most effective for diagnosis, we analyzed population attributable risk % (PAR%), which is widely used to evaluate the estimated potential impact of clinical sings and/or risk factors, as shown in Table 4. To distinguish aMCI + AD from CN, the PAR% of each combination of signs group is 29.9% (AA and HTS+), 7.45% (C- and P-), 22.8% (C- and N-), 2.04% (P- and N-) respectively. To distinguish AD from CN or aMCI, the PAR% is 56.6% (AA and HTS+), 23.1% (C- and P-), 57.6% (C- and N-), and 17.6% (P- and N-), respectively. Collectively, the cognitive sign set, (AW and HTS+) and (C- and N-), most distinguish aMCI + AD from CN, and AD patients from the CN+aMCI, respectively.

thumbnail
Table 4. Population attributable risk % of each sign to assess cognitive function.

https://doi.org/10.1371/journal.pone.0233225.t004

Each question and neuropsychiatric batteries

In Table 5, the mean value and standard deviation of a set of neuropsychiatric batteries in each question (C+, C-, P+, P-, N+, N-), and the P-value of Student’s t-test comparing the positive group and negative group in each sign are shown. N- has a consistent correlation with the memory batteries (RALVLT1, ROCFT3min, LMI) and executive function tests (TMTA, verbal fluency), but otherwise, even with NPI, Zarit, or GDS, no consistent correlation was observed. it was shown that C- and P- are independent parameters of neuropsychiatric batteries.

thumbnail
Table 5. Comparison among three signs (C-, P-, N-) and points in each neuropsychiatric battery.

https://doi.org/10.1371/journal.pone.0233225.t005

Discussion

We found AW and C- had high sensitivity, and P- and N- had high specificity for evaluating cognitive impairments. To evaluate the impact of question sets, PAR% of (C- and N-) were higher than that of (C- and P-) and that of (P- and N-), so (C- and N-) was considered to be the suitable tool to detect the AD without the presence of a family member or caregiver. Previous reports [11, 14] demonstrated that AW and HTS were practical, time-saving, and sensitive tools to detect patients’ cognitive impairments, but these tools could be applied only in cases where a patient has family or a caregiver. The cognitive function of a patient who has no family members or who is hospitalized for a physical disorder other than dementia and is suspected to have some cognitive disorder cannot be assessed with these tools. In this study we measured the power of several alternative tools to detect cognitive impairment of older adults.

In a previous report from Turkey [14], the sensitivity of HTS was 80.95% and the specificity 64.76%, which is remarkably higher than those in our study. The age distribution was 75.67±8.29 years in that study and is not significantly different compared our study, but the education years (7.43±4.72) were shorter than those in our study. The low sensitivity and high specificity of HTS in our study may have been caused by the high education level of the patients, which caused a feeling of self-respect and independence, or by cultural background, such as social status, relationships with spouse and children, family structure, and national character. Future studies should assess how differences in educational background affect the diagnostic utility of the tests used.

When interpreting the results of the present study, several limitations should be kept in mind. First, FTLD, VD and DLB patients were excluded from this study, so further investigation is needed to evaluate use of tests assessing frontal lobar functions to differentiate FTLD, VD, DLB and AD. Second, the CN group was basically composed of “cognitively preserved” normal persons, but this group included those with so-called “subjective cognitive impairment” [21]. As expected, C- is high prevalence, 31.8% in CN. We thought that it was practical to compare performance on our neuropsychological tests among the AD, aMCI, and CN groups in the outpatient clinic, but a future study should investigate a larger number of truly “normal” individuals. Third, patients with severe dementia were not included in the present study, presumably because they have difficulty in visiting a university hospital, and the significant difference in age and the educational history between CN, aMCI, and AD groups cannot be excluded. Fourth, subjects on the AD spectrum in this study were not evaluated by biomarkers of amyloid β burden, such as amyloid positron emission tomography and cerebrospinal fluid AD assessment. The selection and/or subdivision of participants by AD biomarkers will be fruitful for the interpretation of results in future studies. Fifth, the mean age and disease duration of our subjects were limited. Finally, our study may be subject to biases, including selection bias and information bias as a result of the retrospective study.

All our subjects were Japanese people living in an urban area under a generous welfare system, places where elderly people can live alone, even with dementia; therefore, further longitudinal studies of subjects of different races and ethnicities from various areas are necessary. Accessibility to clinics or hospitals and health insurance systems will also need to be considered in the interpretation of this study. Additionally, long-term follow-up of the cognitive function and assessment of clinical signs will also be helpful in determining the diagnostic significance of these clinical signs and questions; however, our findings provide novel insights for simple diagnostic tools.

Conclusion

Our study suggests the combination of C- and N- are as powerful screening signs as AW and HTS. But on the other hand, our data suggest that the reactivity to these kinds of signs can differ based on cultural or educational background. Further worldwide data accumulation is needed for a comprehensive assessment of what kind of tools are most effective in assessing the cognitive function of patients.

Acknowledgments

We are grateful to the following individuals for clinical assistance and comments: Dr. Bun Yamagata, Dr. Toshie Kitao, Dr. Kei Funaki, and Dr. Ryo Shikimoto, Department of Neuropsychiatry/Memory Center, Keio University School of Medicine, Japan. The authors have no financial support and no financial interest related to this manuscript.

References

  1. 1. Ponds RW, Commissaris KJ and Jolles J (1997) Prevalence and covariates of subjective forgetfulness in a normal population in The Netherlands. The International Journal of Aging and Human Development 45: 207–221. pmid:9438876
  2. 2. Wortmann M (2012) Dementia: a global health priority—highlights from an ADI and World Health Organization report. Alzheimers Res Ther 4: 40. pmid:22995353
  3. 3. Ohara T, Hata J, Yoshida D, Mukai N, Nagata M, et al. (2017) Trends in dementia prevalence, incidence, and survival rate in a Japanese community. Neurology 88: 1925–1932. pmid:28424272
  4. 4. Nichols E, Szoeke CEI, Vollset SE, Abbasi N, Abd-Allah F, et al. (2019) Global, regional, and national burden of Alzheimer's disease and other dementias, 1990–2016: a systematic analysis for the Global Burden of Disease Study 2016. The Lancet Neurology 18: 88–106. pmid:30497964
  5. 5. Livingston G, Sommerlad A, Orgeta V, Costafreda SG, Huntley J, et al. (2017) Dementia prevention, intervention, and care. The Lancet 390: 2673–2734.
  6. 6. Annoni J, Chouiter L and Démonet J (2016) Age-related cognitive impairment: conceptual changes and diagnostic strategies. Revue medicale suisse 12: 774–779. pmid:27276719
  7. 7. Yagi T, Ito I, Sugiyama D, Iwasawa S, Tabuchi H, et al. (2016) Diagnostic accuracy of neuropsychological tests for classification of dementia. Neurology Asia 21: 47–54.
  8. 8. Iverson GL (1998) Interpretation of Mini‐Mental State Examination scores in community‐dwelling elderly and geriatric neuropsychiatry patients. International journal of geriatric psychiatry 13: 661–666. pmid:9818300
  9. 9. Zamboni G and Wilcock G (2011) Lack of awareness of symptoms in people with dementia: the structural and functional basis. International journal of geriatric psychiatry 26: 783–792. pmid:21744382
  10. 10. Hanseeuw BJ, Scott MR, Sikkes SAM, Properzi M, Gatchel JR, et al. (2020) Evolution of anosognosia in alzheimer's disease and its relationship to amyloid. Ann Neurol 87: 267–280. pmid:31750553
  11. 11. Larner AJ (2012) Head turning sign: pragmatic utility in clinical diagnosis of cognitive impairment. J Neurol Neurosurg Psychiatry 83: 852–853. pmid:22338027
  12. 12. Larner A (2005) “Who came with you?” A diagnostic observation in patients with memory problems? Journal of Neurology, Neurosurgery & Psychiatry 76: 1739–1739.
  13. 13. Fukui T, Yamazaki T and Kinno R (2011) Can the 'head-turning sign' be a clinical marker of Alzheimer's disease? Dement Geriatr Cogn Dis Extra 1: 310–317. pmid:22203823
  14. 14. Soysal P, Usarel C, Ispirli G and Isik AT (2017) Attended With and Head-Turning Sign can be clinical markers of cognitive impairment in older adults. International psychogeriatrics / IPA 29: 1763–1769.
  15. 15. Rey G and Benton A (1991) Examen De Afasia Multilingüe. Iowa: AJA Associates Inc.
  16. 16. McKeith IG, Boeve BF, Dickson DW, Halliday G, Taylor JP, et al. (2017) Diagnosis and management of dementia with Lewy bodies: Fourth consensus report of the DLB Consortium. Neurology 89: 88–100. pmid:28592453
  17. 17. Roman GC, Tatemichi TK, Erkinjuntti T, Cummings JL, Masdeu JC, et al. (1993) Vascular dementia: diagnostic criteria for research studies. Report of the NINDS-AIREN International Workshop. Neurology 43: 250–260. pmid:8094895
  18. 18. McKhann GM, Knopman DS, Chertkow H, Hyman BT, Jack CR Jr., et al. (2011) The diagnosis of dementia due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimers Dement 7: 263–269. pmid:21514250
  19. 19. Albert MS, DeKosky ST, Dickson D, Dubois B, Feldman HH, et al. (2011) The diagnosis of mild cognitive impairment due to Alzheimer's disease: recommendations from the National Institute on Aging-Alzheimer's Association workgroups on diagnostic guidelines for Alzheimer's disease. Alzheimer's & dementia: the journal of the Alzheimer's Association 7: 270–279.
  20. 20. National Census Japan (2010) Population Census https://www.e-stat.go.jp/en/stat-search/files?page=1&query=Type%20of%20last%20completed%20educational%20level&layout=dataset&stat_infid=000025518697&metadata=1&data=1.
  21. 21. Stewart R (2012) Subjective cognitive impairment. Curr Opin Psychiatry 25: 445–450. pmid:23037961