Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Content-Specificity in Verbal Recall: A Randomized Controlled Study

Content-Specificity in Verbal Recall: A Randomized Controlled Study

  • Jan Zirk-Sadowski, 
  • Denes Szucs, 
  • Joni Holmes
PLOS
x

Abstract

In this controlled experiment we examined whether there are content effects in verbal short-term memory and working memory for verbal stimuli. Thirty-seven participants completed forward and backward digit and letter recall tasks, which were constructed to control for distance effects between stimuli. A maximum-likelihood mixed-effects logistic regression revealed main effects of direction of recall (forward vs backward) and content (digits vs letters). There was an interaction between type of recall and content, in which the recall of digits was superior to the recall of letters in verbal short-term memory but not in verbal working memory. These results demonstrate that the recall of information from verbal short-term memory is content-specific, whilst the recall of information from verbal working memory is content-general.

Introduction

Working memory is the cognitive system responsible for the temporary maintenance and processing of information during complex cognitive activities. It is important for many everyday activities that require the online storage and processing of different types of information. These include reading comprehension, mental arithmetic, following directions, and reasoning [14]. In this experiment, we explore whether different types of verbal information (e.g. numbers and letters) are handled differently within different aspects of the verbal memory system.

There are several theoretical models of working memory which differ in their views of the nature, structure, and function of the system (see 5,6 for reviews). The primary distinction between these models is whether working memory is conceived of as a discrete entity (e.g., [7,8]) or a limited capacity process of controlled attention (e.g. [911]).

One account, which is provided by the enduring model of Baddeley and Hitch [7,8] suggests working memory is comprised of four components. The central executive is responsible for monitoring and processing information across domains and for the retrieval of information from long-term memory and attentional control. Two storage systems, the phonological loop and the visuo-spatial sketchpad, provide temporary maintenance of verbal and visuo-spatial information. The fourth component, the episodic buffer, binds information across domains into integrated chunks [8].

Other accounts suggest that working memory capacity is limited by controlled attention that acts to activate existing representations in long-term memory in the face of distraction or interference [10,11]. In a latent factor analysis, Engle and colleagues [12] distinguished between verbal STM tasks and verbal working memory tasks, and herein lays the commonality across different models of working memory. Both accounts distinguish between the storage-only capacity of a verbal STM system and a central component that co-ordinates the ongoing processing of information with the storage of information in STM (see for example 7,12). This latter component, referred to as working memory, is more closely associated with measures of general intelligence, other higher order cognitive control functions and reading and mathematics ([9,10,1315]).

Verbal STM is a well-defined system, which is domain-specific and dedicated solely to storing verbal / phonological information. It is less clear whether working memory is domain-general (i.e. capable of manipulating and keeping active both verbal and visuo-spatial information) or whether there are separate subsystems for handling verbal and non-verbal information. Domain-general accounts of working memory capacity have been advanced by many leading theorists [10,16], and are supported by factor analytic studies in which tasks designed to measure the ability to process and store verbal and visuo-spatial information load on to a common factor (e.g. [17,18]). An alternative account is that working memory capacity is supported by two separate pools of domain-specific resources for verbal and visuospatial information ([19], see also 20). According to this account, each domain is independently capable of manipulating and keeping information active. Research on adult participants and on older children supports this distinction ([2123]).

Based on studies that have explored the contribution of short-term and working memory performance to other higher-level abilities such as reading and maths (e.g. [24]), our view is that working memory has a multi-component structure that includes a domain-general processing component (akin to Baddeley’s central executive) and domain-specific storage components (verbal STM/phonological loop and visuo-spatial sketchpad), and that working memory can be assessed by either verbal or non-verbal tasks that involve both the storage and manipulation of information. In this study, we use a verbal working memory task to facilitate a comparison of the handling of phonological information in verbal STM and verbal working memory, but we believe that verbal and visuo-spatial working memory may have a common central executive component.

Although the distinction between verbal STM and working memory is relatively well understood, less is known about how different types of auditory/verbal material (e.g. digits or letters) are processed within the two systems. If working memory for verbal stimuli operates in a less specific way than verbal STM, we might expect differences in the way in which different forms of verbal material are handled across the two systems. If, as we suspect, working memory for verbal stimuli is more content-general than verbal short-term memory, there will be no differences in the recall of different forms of verbal information in verbal working memory but there will be in verbal STM. Thus, if there is an interactive effect of stimuli type and verbal memory component, we will establish further evidence for a distinction between verbal STM and verbal working memory by demonstrating differences in the way they handle different types of phonological information.

Thus, the principal aim of the current experiment was to investigate whether there are content-specific effects within verbal STM and verbal working memory using carefully designed digit and letter stimuli. Although a small number of studies have previously compared memory for different verbal materials within STM or working memory ([25,26]), no single study has directly compared recall for different phonological materials across the different systems. Working memory is typically measured by tasks that involve the concurrent storage of information whilst processing additional, sometimes unconnected, information. STM tasks do not involve processing, and therefore typically require the immediate serial recall of information 2 tasks that are widely used in the literature to distinguish short-term and working memory, and which are used in the current study, are forward and backward span (e.g. [12,17]). Here we compare participants’ verbal recall in forward and reverse serial order using verbal stimuli that control for the potential confound of the mental representation of numerical and non-numerical ordinal sequences: the distance effect.

The numerical distance effect describes how the ability to discriminate between two numbers improves as the numerical distance between them increases (e.g. [2729]). So, for example, it is easier and faster to discriminate between ‘5’ and ‘9’ compared to ‘5’ and ‘6’. The same psychophysical distance effect has also been observed for letters ([3033]). Based on these observed distance effects, it may be reasonable to assume that estimates of span, and importantly differences in performance with different modalities (e.g. digits or letters), could be confounded by distance effects if strings of letters or digits are presented with varying distances between stimuli (e.g. “8, 1” in a digit recall task might be more difficult to process than “A, M” in a letter span task where the distance is larger). In the current study, we use digit and letter span tasks that are matched for inter-stimuli distances across modalities to exclude this potential confound.

We predict a main effect of content, but our hypothesis is not directional. We consider both possibilities: i) performance on digits may be significantly better compared to letters (e.g. daily life circumstances require remembering digit strings such as telephone numbers, dates, postcodes, etc; also digits have a semantic sense while letters in isolation have no semantic loading; people easier remember meaningful stimuli); ii) performance on letters may be significantly better compared to digits (e.g. people practice recalling letter strings when learning the alphabet, the spelling of new words or when applying ordinal labels to objects: e.g. a, b, c, etc;). We also predict superior recall for forward span tasks based on the additional processing load associated with recalling information in reverse order in the backward span tasks ([34,35]). No a priori predictions are made about the interaction between content (letters and digits) and verbal memory type (forward recall, STM and backward recall, working memory).

Materials and Methods

Ethics Statement

This study received ethical approval from the University of Cambridge Psychology Research Ethics Committee. All participants gave informed written consent prior to participating. The full dataset is available upon request.

Participants

Thirty-seven postgraduate students from the University of Cambridge participated in the experiment (24 females, age: 25.19 years (SD=2.55; Range = [20.59, 30.72]). All participants were native English speakers. Participants were paid for their time.

Measures

Participants completed the forward (FD) and backward (BD) Digit Span subtests of the Wechsler Adult Intelligence Scale, 3rd Edition (WAIS-III, [36]) to measure verbal STM and working memory respectively. In both tasks, sequences of digits were presented auditorially for immediate verbal recall in either forward serial order (FD) or reverse order (BD). Each task began with two trials at a sequence length of two items. Sequences increased by one digit every two trials, up to a sequence (span length) of 9 items. In total, there were eight blocks of trials, with two trials in each block (totalling 16 trials per task). Both tasks were administered according to the instructions of the WAIS-III manual ([36]). The experimenter read the sequences of letters/digits to the participant at a rate of 1 item per second. Each trial was scored as correct (1) or incorrect (0), as per the test manual.

Parallel forward (FL) and backward (BL) letter span tasks were constructed by matching letters to each of the digits in the FD and BD tasks (e.g. 1 corresponded to A, 2 to B, 3 to C and so on). The distance between the letters was matched to the distance between the numbers in each of the trials in the Digit Span tasks. For example, if the first trial in FD was “1,3”, the corresponding FL trial was constructed as “A,C”. Task administration was identical to that of the Digit Span tasks.

The same researcher administered all tasks to all participants. The tasks were administered in a fully randomized order, thus the study had a randomized controlled within-subjects design.

Results

Descriptive statistics summarising performance in each of the conditions are shown in Table 1.

MeanSDMin.Max.
Digits forward12.861.84916
Letters forward10.781.58813
Digits backward9.952.66314
Letters backward8.842.57414
Average digit recall (forward and backward recall)11.411.91814.5
Average letter recall (forward and backward recall)9.811.78713.5
Average backward recall (letters and digits)9.392.273.514
Average forward recall (letters and digits)11.821.48914.5

Table 1. Trial correct across the verbal memory tasks.

CSV
Download CSV

Table 2 shows the correlations between the tasks. There were significant associations between the two forward recall tasks (p=.002) and the two backward recall tasks (p=.001), consistent with measures of STM and working memory. The two letter recall tasks were significantly related to one another (p=.005), but there was not a significant association between the letter span forward and digit span backward tasks (p=.358).

Digits forwardLetters forwardDigits backwardLetters backward
Digits forward0.49**0.43**0.45**
Letters forward0.160.45**
Digits backward0.52**

Table 2. Pearson correlations between measures.

CSV
Download CSV

A maximum-likelihood mixed-effects logistic regression [3739] was conducted to test whether content (digit vs. letter) and memory component (STM, forwards vs. working memory, backwards) predict performance. This analytic approach for repeated measures data is more powerful than ANOVA [40]. The dependent variable entered into the regression model was memory performance, with memory type (STM or working memory, coded as 0 and 1 respectively) and content (digit, 0; letter, 1) entered as independent variables. Both were significant (content: digit vs. letter, β=-.461, p<.001, and memory type: forwards vs. backwards, β=-697, p<.001). The odds of correct performance were greater for digits than letters (odds ratio: OR=.498) and greater for forward than backward recall (OR=.631), indicating main effects of both content and memory type.

The interaction term (content × memory) was entered into the model to test whether content effects were specific to one of the components of working memory. The 2 main effects remained significant (content, β=-.686, p<.001 and memory type, β=-.915, p<.001; with odds ratios of OR=.504 and OR=.400, respectively). The interaction between content and memory-type predicted performance, β=.399, p=.003 (odds ratio =1.491), with markedly better recall of digits compared to letters in forward recall (STM) (see Figure 1).

thumbnail
Figure 1. Content effects in forward (STM) and backward recall tasks (working memory).

Error bars are standard errors of the mean.

https://doi.org/10.1371/journal.pone.0079528.g001

Discussion

The purpose of the present study was to investigate whether different types of information (digits and letters) are handled differently in verbal STM and verbal working memory. The results replicate the well-established distinction between STM and working memory and provide novel data demonstrating that the recall of information from verbal STM is content-specific, whilst the processing of information in working memory for verbal stimuli is content-general.

By comparing performance on forward and backward digit recall tasks, we have demonstrated that participants are better able to recall information in forward than reverse order. Finding a main effect of recall (forward or backward) supports a distinction between STM and working memory (e.g. [10,11,4143]), here probed in the context of phonological domain. It also provides further validation for the use of backward recall tasks as measures of verbal working memory (e.g. [44]), rather than STM (e.g. [10]).

The second main effect, that the recall of digits is superior to the recall of letters, is as predicted and lends support to the notion that the extensive practice of remembering digits in everyday life (e.g. dates and telephone numbers) may facilitate performance over remembering arbitrary strings of letters. However, the superior recall for digits over letters was specific to only one aspect of the verbal memory system. Content-specific effects do provide a comprehensive account of the data in the short-term memory. This may be related to the lower activity of the central executive module in this context. Alternatively, numerical semantics may be processed more centrally in the forward recall. Semantic characteristics may be processed only peripherally in the working memory context: participants’ cognitive resources or attention may be more intensively spent on information retrieval rather than semantic processing in the backward recall tasks. The forward recall may facilitate semantic processing; hence larger difference between digits and letters.

A significant interaction was observed between content-type and memory, indicating that the verbal recall of different types of information differs between verbal STM and verbal working memory. Whilst participants were better able to recall digits than letters in forward order, this effect was not observed for backward order. This suggests that verbal STM is content-specific and (verbal) working memory is content-general. In terms of the theoretical structure of working memory, this is consistent with the view that the storage aspects of the system are more highly specialized and defined than the domain-general central executive system (e.g. [7]). According to multiple models there are distinct components associated with the storage of verbal and visual material (e.g. the phonological loop / verbal short-term memory and the visuo-spatial sketchpad, [7,11,17,24]). The current data go one step further to imply there may be separate systems, or at least distinct processes, associated with the storage of different forms of information within each of these storage-only systems. In terms of the working memory, or central executive system, the absence of a content effect provides further support for the notion of a domain-free processing ability that deals with all types of information, whether it is verbal or visuo-spatial (e.g. [24]), numerical or letter-based. Of course, further research is needed to investigate this, which could be achieved through investigating whether other types of phonological information (e.g. words and nonwords) interactively predict verbal STM and verbal working memory capacity, or whether there are similar content-specific effects in visuo-spatial STM using visuo-spatial working memory tasks.

The current findings are important for the assessment of verbal STM skills. Because the content of to-be-remembered information influences performance, it is important that assessors give careful consideration to the type of material / stimuli presented to avoid over- or under-estimating ability. This is particularly important when assessing for potential deficits in disorders such as dyslexia where the immediate recall of phonological information is used as a marker of impairment. To ensure a fair estimate of performance is obtained, it would be advisable to consider using multiple assessments that cross different content-types.

In summary, the findings from the current study indicate that forward and backward span tasks assess different aspects of the verbal memory system and that verbal STM recall is content-specific whilst working memory related verbal recall is content-general.

Author Contributions

Conceived and designed the experiments: JZ DS. Performed the experiments: JZ. Analyzed the data: JZ. Contributed reagents/materials/analysis tools: JZ. Wrote the manuscript: JZ DS JH.

References

  1. 1. Adams JW, Hitch GJ (1997) Working memory and children’s mental addition. J Exp Child Psychol 67: 21–38. Available: http://eprints.whiterose.ac.uk/60914/. doi:https://doi.org/10.1006/jecp.1997.2397. PubMed: 9344485.
  2. 2. Cain K, Oakhill J, Bryant P (2004) Children’s reading comprehension ability: Concurrent prediction by working memory, verbal ability, and component skills. J Educ Psychol 96: 31. doi:https://doi.org/10.1037/0022-0663.96.1.31.
  3. 3. Gathercole SE, Durling E, Evans M, Jeffcock S, Stone S (2008) Working memory abilities and children’s performance in laboratory analogues of classroom activities. Appl Cogn Psychol 22: 1019–1037. doi:https://doi.org/10.1002/acp.1407.
  4. 4. Oberauer K, Süß H-M, Wilhelm O, Wittman WW (2003) The multiple faces of working memory: Storage, processing, supervision, and coordination. Intelligence 31: 167–193. doi:https://doi.org/10.1016/S0160-2896(02)00115-0.
  5. 5. Conway ARA, Jarrold CE, Kane MJ, Miyake A, Towse JN (2007) Variation in working memory. Oxford University Press.
  6. 6. Miyake A, Shah P (1999) Models of working memory: Mechanisms of active maintenance and executive control. Cambridge University Press.
  7. 7. Baddeley A (2000) The episodic buffer: a new component of working memory? Trends Cogn Sci 4: 417–423. doi:https://doi.org/10.1016/S1364-6613(00)01538-2. PubMed: 11058819.
  8. 8. Baddeley A, Hitch G (1974) Working memory. Psychol Learn Motiv 8: 47-89. doi:https://doi.org/10.1016/S0079-7421(08)60452-1.
  9. 9. Cowan N (1995) Attention and memory. Oxford University Press.
  10. 10. Engle RW, Kane MJ, Tuholski SW (1999) Individual differences in working memory capacity and what they tell us about controlled attention, general fluid intelligence, and functions of the prefrontal cortex. Models Works Mem Mech Act Maint Exec Control: 102–134.
  11. 11. Kane MJ, Hambrick DZ, Tuholski SW, Wilhelm O, Payne TW et al. (2004) The generality of working memory capacity: a latent-variable approach to verbal and visuospatial memory span and reasoning. J Exp Psychol Gen 133: 189–217. doi:https://doi.org/10.1037/0096-3445.133.2.189. PubMed: 15149250.
  12. 12. Engle RW, Tuholski SW, Laughlin JE, Conway AR (1999) Working memory, short-term memory, and general fluid intelligence: a latent-variable approach. J Exp Psychol Gen 128: 309–331. doi:https://doi.org/10.1037/0096-3445.128.3.309. PubMed: 10513398.
  13. 13. Duncan J, Owen AM (2000) Common regions of the human frontal lobe recruited by diverse cognitive demands. Trends Neurosci 23: 475–483. doi:https://doi.org/10.1016/S0166-2236(00)01633-7. PubMed: 11006464.
  14. 14. Kane MJ, Bleckley MK, Conway ARA, Engle RW (2001) A controlled-attention view of working-memory capacity. J Exp Psychol Gen 130: 169–183. doi:https://doi.org/10.1037/0096-3445.130.2.169. PubMed: 11409097.
  15. 15. Pennington BF, Ozonoff S (1996) Executive functions and developmental psychopathology. J Child Psychol Psychiatry 37: 51–87. doi:https://doi.org/10.1111/j.1469-7610.1996.tb01380.x. PubMed: 8655658.
  16. 16. Baddeley A (1986) Working memory (vol. 11). Oxford: Clarendon Press.
  17. 17. Alloway TP, Gathercole SE, Pickering SJ (2006) Verbal and visuospatial short-term and working memory in children: are they separable? Child Dev 77: 1698–1716. Available: http://www.ncbi.nlm.nih.gov/pubmed/17107455. doi:https://doi.org/10.1111/j.1467-8624.2006.00968.x. PubMed: 17107455.
  18. 18. St Clair-Thompson HL, Gathercole SE (2006) Executive functions and achievements in school: Shifting, updating, inhibition, and working memory. Q J Exp Psychol 59: 745–759. doi:https://doi.org/10.1080/17470210500162854. PubMed: 16707360.
  19. 19. Shah P, Miyake A (1996) The separability of working memory resources for spatial thinking and language processing: an individual differences approach. J Exp Psychol Gen 125: 4–27. doi:https://doi.org/10.1037/0096-3445.125.1.4. PubMed: 8851737.
  20. 20. Daneman M, Tardif T (1987) Working memory and reading skill re-examined. In: M. Coltheart. Attention and performance: The psychology of reading. pp. 491-508.
  21. 21. Friedman NP, Miyake A (2000) Differential roles for visuospatial and verbal working memory in situation model construction. J Exp Psychol Gen 129: 61–83. doi:https://doi.org/10.1037/0096-3445.129.1.61. PubMed: 10756487.
  22. 22. Jarvis HL, Gathercole SE (2003) Verbal and non-verbal working memory and achievements on National Curriculum tests at 11 and 14 years of age. Educ Child Psychol 20: 123-140.
  23. 23. Miyake A, Friedman NP, Rettinger DA, Shah P, Hegarty M (2001) How are visuospatial working memory, executive functioning, and spatial abilities related? A latent-variable analysis. J Exp Psychol Gen 130: 621–640. doi:https://doi.org/10.1037/0096-3445.130.4.621. PubMed: 11757872.
  24. 24. Bayliss DM, Jarrold C, Gunn DM, Baddeley AD (2003) The complexities of complex span: Explaining individual differences in working memory in children and adults. J Exp Psychol Gen 132: 71–92. doi:https://doi.org/10.1037/0096-3445.132.1.71. PubMed: 12656298.
  25. 25. Bedard A-C, Jain U, Johnson SH, Tannock R (2007) Effects of methylphenidate on working memory components: influence of measurement. J Child Psychol Psychiatry 48: 872–880. doi:https://doi.org/10.1111/j.1469-7610.2007.01760.x. PubMed: 17714372.
  26. 26. Hale S, Rose NS, Myerson J, Strube MJ, Sommers M et al. (2011) The structure of working memory abilities across the adult life span. Psychol Aging 26: 92–110. doi:https://doi.org/10.1037/a0021483. PubMed: 21299306.
  27. 27. Moyer RS, Landauer TK (1967) Time required for judgements of numerical inequality. Nature 215: 1519–1520. doi:https://doi.org/10.1038/2151519a0. PubMed: 6052760.
  28. 28. Dehaene S, Dupoux E, Mehler J (1990) Is numerical comparison digital? Analogical and symbolic effects in two-digit number comparison. J Exp Psychol Hum Percept Perform 16: 626–641. doi:https://doi.org/10.1037/0096-1523.16.3.626. PubMed: 2144576.
  29. 29. Holloway ID, Ansari D (2009) Mapping numerical magnitudes onto symbols: The numerical distance effect and individual differences in children’s mathematics achievement. J Exp Child Psychol 103: 17–29. doi:https://doi.org/10.1016/j.jecp.2008.04.001. PubMed: 18513738.
  30. 30. Fulbright RK, Manson SC, Skudlarski P, Lacadie CM, Gore JC (2003) Quantity determination and the distance effect with letters, numbers, and shapes: a functional MR imaging study of number processing. AJNR Am J Neuroradiol 24: 193–200. PubMed: 12591633.
  31. 31. Gevers W, Reynvoet B, Fias W (2003) The mental representation of ordinal sequences is spatially organized. Cognition 87: 87–95. doi:https://doi.org/10.1016/S0010-0277(02)00234-2. PubMed: 12684205.
  32. 32. Troup GA, Bradshaw JL, Nettleton NC (1983) The lateralization of arithmetic and number processing: A review. Int J Neurosci 19: 231–241. doi:https://doi.org/10.3109/00207458309148659. PubMed: 6874256.
  33. 33. Van Opstal F, Gevers W, De Moor W, Verguts T (2008) Dissecting the symbolic distance effect: Comparison and priming effects in numerical and nonnumerical orders. Psychon Bull Rev 15: 419–425. doi:https://doi.org/10.3758/PBR.15.2.419. PubMed: 18488662.
  34. 34. Bopp KL, Verhaeghen P (2005) Aging and verbal memory span: A meta-analysis. J Gerontol B Psychol Sci Soc Sci 60: 223. doi:https://doi.org/10.1093/geronb/60.5.P223. PubMed: 16131616.
  35. 35. Hale JB, Hoeppner J-AB, Fiorello CA (2002) Analyzing digit span components for assessment of attention processes. J Psychoeduc Assess 20: 128–143. doi:https://doi.org/10.1177/073428290202000202.
  36. 36. Wechsler D (2001) Wechsler Adult Intelligence Scale-Third Edition. Canadian technical manual. Canada: Harcourt Publishing House.
  37. 37. Lindstrom MJ, Bates DM (1990) Nonlinear mixed effects models for repeated measures data. Biometrics 46: 673–687. doi:https://doi.org/10.2307/2532087. PubMed: 2242409.
  38. 38. Thomas R, Have T, Kunselman AR, Pulkstenis EP, Landis JR (1998) Mixed effects logistic regression models for longitudinal binary response data with informative drop-out. Biometrics 54: 367–383. doi:https://doi.org/10.2307/2534023. PubMed: 9544529.
  39. 39. Pinheiro JC, Bates DM (2000) Linear mixed-effects models: basic concepts and examples. Springer Verlag.
  40. 40. Quené H, den Bergh H (2004) On multi-level modeling of data from repeated measures designs: A tutorial. Speech Commun 43: 103–121. doi:https://doi.org/10.1016/j.specom.2004.02.004.
  41. 41. Archibald LMD, Gathercole SE (2006) Short-term and working memory in specific language impairment. Int J Lang Commun Disord R Coll Speech Lang Ther 41. pp. 675–693. Available: http://www.ncbi.nlm.nih.gov/pubmed/17079222.
  42. 42. Jacquemot C, Scott SK (2006) What is the relationship between phonological short-term memory and speech processing? Trends Cogn Sci 10: 480–486. doi:https://doi.org/10.1016/j.tics.2006.09.002. PubMed: 16997610.
  43. 43. Gathercole SE, Tiffany C, Briscoe J, Thorn A (2005) Developmental consequences of poor phonological short-term memory function in childhood: a longitudinal study. J Child Psychol Psychiatry 46: 598–611. doi:https://doi.org/10.1111/j.1469-7610.2004.00379.x. PubMed: 15877766.
  44. 44. Gathercole SE, Pickering SJ, Ambridge B, Wearing H (2004) The structure of working memory from 4 to 15 years of age. Dev Psychol 40: 177–190. doi:https://doi.org/10.1037/0012-1649.40.2.177. PubMed: 14979759.