Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Pitch contour impairment in congenital amusia: New insights from the Self-paced Audio-visual Contour Task (SACT)

  • Xuejing Lu ,

    luxj@psych.ac.cn

    Affiliations CAS Key Laboratory of Mental Health, Institute of Psychology, Beijing, China, Department of Psychology, University of Chinese Academy of Sciences, Beijing, China, Department of Psychology, Macquarie University, Sydney, New South Wales, Australia, ARC Centre of Excellence in Cognition and its Disorders, Sydney, New South Wales, Australia

    ORCID http://orcid.org/0000-0001-7586-5576

  • Yanan Sun,

    Affiliations Department of Psychology, Macquarie University, Sydney, New South Wales, Australia, ARC Centre of Excellence in Cognition and its Disorders, Sydney, New South Wales, Australia

  • Hao Tam Ho,

    Affiliations Department of Translational Research on New Technologies in Medicine and Surgery, University of Pisa, Pisa, Pisa, Italy, School of Psychology, University of Sydney, Sydney, New South Wales, Australia

  • William Forde Thompson

    Affiliations Department of Psychology, Macquarie University, Sydney, New South Wales, Australia, ARC Centre of Excellence in Cognition and its Disorders, Sydney, New South Wales, Australia

Pitch contour impairment in congenital amusia: New insights from the Self-paced Audio-visual Contour Task (SACT)

  • Xuejing Lu, 
  • Yanan Sun, 
  • Hao Tam Ho, 
  • William Forde Thompson
PLOS
x

Abstract

Individuals with congenital amusia usually exhibit impairments in melodic contour processing when asked to compare pairs of melodies that may or may not be identical to one another. However, it is unclear whether the impairment observed in contour processing is caused by an impairment of pitch discrimination, or is a consequence of poor pitch memory. To help resolve this ambiguity, we designed a novel Self-paced Audio-visual Contour Task (SACT) that evaluates sensitivity to contour while placing minimal burden on memory. In this task, participants control the pace of an auditory contour that is simultaneously accompanied by a visual contour, and they are asked to judge whether the two contours are congruent or incongruent. In Experiment 1, melodic contours varying in pitch were presented with a series of dots that varied in spatial height. Amusics exhibited reduced sensitivity to audio-visual congruency in comparison to control participants. To exclude the possibility that the impairment arises from a general deficit in cross-modal mapping, Experiment 2 examined sensitivity to cross-modal mapping for two other auditory dimensions: timbral brightness and loudness. Amusics and controls were significantly more sensitive to large than small contour changes, and to changes in loudness than changes in timbre. However, there were no group differences in cross-modal mapping, suggesting that individuals with congenital amusia can comprehend spatial representations of acoustic information. Taken together, the findings indicate that pitch contour processing in congenital amusia remains impaired even when pitch memory is relatively unburdened.

Introduction

Congenital amusia is a disorder of music perception that has been the subject of considerable research and theory [1, 2]. Although much remains to be understood about this rare disorder, it is generally agreed that amusic individuals exhibit difficulties in fine-grained pitch perception [3], as revealed by elevated pitch thresholds at a group level compared with non-amusic listeners [47]. Despite this difficulty, people with amusia can still name and recognise voices and environmental sounds, and have little difficulty interpreting speech intonation that involves large changes in pitch [1, 8]. In addition, despite evidence that individuals with amusia have poor memory for pitch, there is no evidence they have a general impairment of memory, in that digit spans are comparable in amusics and matched controls [9]. These and other findings led to the hypothesis that the core deficit of congenital amusia is a low-level impairment in fine-grained pitch processing [10].

Subtle impairments beyond music processing have been reported, however. For example, when amusics are presented with the prosodic aspect of spoken sentences in the absence of linguistic content (i.e., spoken stimuli that are filtered so as to remove linguistic information while preserving pitch contour), they are significantly worse than control participants at discriminating speech prosody [1]. Given that these stimuli preserved the intonation patterns from spoken sentences, this dissociation challenged the hypothesis that the core deficit of congenital amusia is restricted to fine-grained pitch processing. Thus, Patel et al. (2005) [8] proposed the “Melodic Contour Deafness Hypothesis”, which suggests that the principle deficit of congenital amusia lies at a higher level of processing and does not arise from a low-level impairment in pitch processing. Indeed, individuals with congenital amusia exhibit difficulties in melodic contour processing [4, 11], although the source of this difficulty is under debate. Melodic contour refers to the rising and falling pattern of intervals within a melody, and whether adjacent notes are higher or lower than one another [12]. The contour of a melody does not consider the precise size of successive pitch intervals, but represents the direction of pitch changes that occur throughout a sequence [13]. The psychological significance of contour has been underscored by findings that infants are sensitive to pitch contour but not other details of melodies [14], and that adults who hear a novel melody tend to remember its contour but not absolute pitches or precise pitch intervals [1519]. Thus, successful contour processing depends on the ability to identify the direction of individual pitch changes, and on the ability to retain a succession of pitch changes in memory [1821].

There are two plausible explanations for the impaired melodic contour processing observed in congenital amusia. One possibility is that amusic individuals have a reduced sensitivity to the direction of pitch change [22]. This reduced sensitivity, in turn, leads to an unstable mental representation of musical pitch [23]. Alternatively, amusic individuals may have difficulty retaining pitch information in memory [6, 2426] (but see [7]). Tests of contour processing, such as the contour subtest of the Montreal Battery of Evaluation of Amusia (MBEA) [27], typically involve asking listeners to compare two consecutive pitch sequences, which may differ in pitch contour. Thus, performance on the task requires both sensitivity to the direction of pitch changes, and the ability to retain the first sequence in short-term memory until the second sequence is presented for comparison.

To evaluate these two explanations, we developed a Self-paced Audio-visual Contour Task (SACT). The SACT was designed to minimize reliance on short-term memory during the evaluation of melodic contour, and to direct attention to pitch contour in each sequence. As will be described in the Method section of Experiment 1, memory load was reduced by presenting a visual contour simultaneously with a melodic contour, with the occurrence of sequential tones self-paced by participants. Melodic contours were displayed as a sequence of large dots varying in spatial height and connected to each other by lines. Thus, instead of holding a melodic sequence in short-term memory and comparing it to a subsequent melodic sequence, participants judged whether concurrent melodic and visual contours were congruent with one another (i.e., online matching). This comparison process also functioned to slow down and enhance the temporal dynamics of contour perception. In short, the task diminished reliance on short-term pitch memory while emphasizing and enhancing the perceptual processing of contour.

The task bears some resemblance to a sight-reading task. However, in standard sight-reading tasks, visual stimuli (notation) are presented in a form that depicts entire musical sequences, which are either presented acoustically for comparison (passive task), or performed by participants (active task). Thus, sight-reading involves encoding visual symbols and either comparing this representation to a delayed auditory stimulus, or mapping the representation to a motor output [28, 29]. In contrast, the SACT allows participants to make “online” comparisons between simultaneously presented auditory and visual contours.

The decision to combine melodic and visual contours was motivated by two lines of evidence that visual representations of melodic contour are natural. One line of evidence comes from cross-modal dimensional interactions at the psychophysical level. For instance, sounds with high frequency (i.e., pitch) or intensity (i.e., loudness) are associated with a higher spatial location (i.e., height) and bright lights or colors (i.e., visual brightness), whereas those with low frequency or intensity are associated with a lower spatial location and dim lights or colors [3038]. Comparable to non-amusics, amusic individuals are able to represent pitch spatially [23], although this mapping is somewhat less efficient among amusics. Another line of evidence comes from the evidence that untrained listeners can activate visual representations of melodic contour [39] and generate drawings of melodic contours that depict the pattern of ascending and descending pitch changes with considerable accuracy [40]. These findings indicate that there is a strong intermodal association between melodic and visual contours [41].

During the SACT, participants must determine whether each pitch is higher or lower than the immediately preceding pitch, and determine whether this relationship is congruent with the concurrent visual contour. If impaired pitch memory were responsible for poor contour processing in congenital amusia, then participants should perform relatively well on this online matching task, given that the SACT places minimal burden on pitch memory. On the other hand, if amusic individuals are genuinely impaired at processing pitch contour, then they should have difficulty detecting incongruence between melodic and visual contours.

Experiment 1

Method

Participants.

MBEA has been widely used for diagnosing amusia over the past decade. As we were specifically interested in individuals with deficits in pitch processing, we administered the three melodic subtests (Scale, Contour, and Interval) of the MBEA (see also [22]). For each subtest, listeners were presented with pairs of melodies and asked to judge whether they were the same or different. Participants in the pitch-impaired (henceforth “amusic”) group were 14 individuals with composite scores on the three subtests at or below 65 out of 90 (72% correct). Another 14 participants with composite scores above the cut-off score comprised the control group. All participants reported normal hearing and normal or corrected-to-normal vision. None reported any auditory, neurological, or psychiatric disorder. As shown in Table 1, although amusics performed significantly worse than controls in all three melodic tests (all p < .001), the two groups were matched in age, gender, years of education, years of musical training, and hours of music listening (all p > .10). Written informed consent for participation was obtained from all participants prior to the study. This experimental protocol was approved by Macquarie University Ethics Committee (Ref: 5201200890).

thumbnail
Table 1. Participants’ characteristics, mean ± SD correct rates on the melodic subtests of the MBEA, and independent-sample t-test results between two groups in Experiment 1.

https://doi.org/10.1371/journal.pone.0179252.t001

Stimuli.

As illustrated in Fig 1, auditory stimuli were seven-note tone sequences. Each auditory stimulus was accompanied by a visual presentation of a sequence of dots—one for each note of the auditory sequence. The fourth, fifth or sixth tone of each auditory sequence served as a target tone, in which an audio-visual incongruence could occur. The probability of an incongruence occurrence was held constant at each position. Tones in other positions were not selected as targets, because they were used to established a strong sense of tonality. As expected, the target position affected neither amusic and control participants’ task performance (see Figure A in S1 File). The size of the interval separating the preceding and target tones was systematically varied between 1–12 semitones. There were six trials for each interval size condition—half with upward changes and the rest with downward changes. All sequences were constructed using tones from the C major scale, as tonality can boost pitch-related short-term memory in amusics [42, 43]. The strength of tonality of each tone sequence was measured using the “key-finding algorithm” [44] implemented in the MATLAB MIDI toolbox [45], whereby the maximum positive correlation may be taken as the most strongly established key. As expected, the maximum correlation for each tone sequence was with the C major key, r (10) = 0.76 (range from 0.45–0.92), all t > 3.75, all p < .05.

thumbnail
Fig 1. Illustration of the (A) auditory and (B) visual stimuli.

* indicates the note that is either congruent (left panel) or incongruent (right panel) with the visual representation. In the incongruent condition, the change in the vertical position of dots is inconsistent with the change in direction of pitches in the accompanying melody.

https://doi.org/10.1371/journal.pone.0179252.g001

Seventy-two tone sequences were constructed. To ensure that interval size was not confounded with the tonal stability of notes, we monitored the degree of fit (i.e., stability value) of target notes and notes immediately preceding the target notes with respect to the key context (C major in this case). Stimuli were created such that there were no systematic differences across interval sizes in the average tonal stability of tones (all p > .05). To ensure results could be generalized beyond a C major key context, a third of the sequences were shifted up by four semitones, and a third of the sequences were shifted down by four semitones. All tones were generated by using the computer software GarageBand (Version 6.0.4; Apple Inc., USA) with flute timbre, and a duration of 500 ms.

Visual stimuli consisted of seven white dots (50-pixel diameter; screen resolution: 1980 × 1024 pixels) that varied in both vertical and horizontal spatial location and that were displayed on a black background and connected by short lines. Each dot corresponded to a single note in the tonal sequence, with pitch height represented as a location on the vertical dimension (a length of 50 pixels in the screen represents a semitone difference), and temporal position represented as a spatial location on the horizontal dimension. The first dot was fixed on the left vertical centre of the display, and the rest were presented successively from left to right simultaneously with the presentation of each tone in the auditory sequence. Two visual stimulus sets were constructed such that melodic and visual contours were either congruent or incongruent with one another.

Procedure.

Participants were tested in a quiet and dimly lit room. Each trial started with a fixation on the left vertical centre of the screen for 500 ms, at which time the first tone and dot were presented concurrently. Participants were required to push the spacebar on a computer keyboard at a comfortable pace to trigger the following tones and dots, one after another. After the presentation of the whole sequence, participants were asked to make a non-speeded judgment on whether the melodic and visual contours were congruent with one another (“yes” or “no”) by pressing one of two response keys. Assignment of the two response keys for congruent and incongruent trials was counterbalanced across participants. For congruent trials, melodic and visual contours always matched; for incongruent trials, there was a single occurrence within the sequence in which the dot in the visual contour moved in the opposite direction to the direction implied by the pitch change. Twelve practice trials were presented prior to the experimental trials. Feedback was provided during the practice trials but not during the experimental trials. Instead, participants were asked to rate their confidence level for their judgment on a five-point scale (1 = not at all confident; 5 = complete confidence). The congruent and incongruent trials were scrambled independently for each participant, and assigned to six blocks. Participants were encouraged to take a short break after each block to minimize fatigue effects. Auditory stimuli were delivered via noise-cancelling headphones (Sennheiser PXC 350) at a comfortable hearing level of 65 dB SLP. The experiment was programmed and presented in SuperLab 4.5 (Cedrus Corporation, San Pedro, USA).

Results

For analysis purposes, we classified the interval sizes into three categories: small (1–4 semitones), medium (5–8 semitones) and large (9–12 semitones). This procedure allowed us to reveal broad effects of interval size on the detection of audio-visual incongruence.

The audio-visual judgments were evaluated using d-prime (d′) [46]. A response of “no” on an incongruent trial was defined as a hit whereas a response of “no” on a congruent trial was defined as a false-alarm. A repeated-measures analysis of variance (ANOVA) was conducted with the between-subject factor of Group (amusics and controls) and the within-subject factor of Interval size (small, medium, and large). Greenhouse-Geisser adjustments were used in light of violations of sphericity, and the Bonferroni correction was used in post-hoc analyses, where appropriate.

As shown in Fig 2, amusic individuals performed worse than control participants in all interval size conditions, as revealed by a significant main effect of Group, F(1, 26) = 11.73, p < .01, ηp2 = .31, with no significant interaction with Interval size, F(1.59, 41.22) = 0.86, p = .41, ηp2 = .03. A main effect of Interval size was also found, F(1.59, 41.22) = 72.20, p < .001, ηp2 = .70, with increased performance associated with larger interval sizes. It should be noted that the analysis of all 12 interval sizes also yielded significant main effects of Group and Interval size, F(1, 30) = 12.05, p < .005, ηp2 = .32, and F(1, 30) = 29.16, p < .001, ηp2 = .53, respectively.

thumbnail
Fig 2. Task performance in Experiment 1 evaluated by d′ on each interval size condition for amusic (black bars) and control (grey bars) groups.

Error bars represent +1 SE. **: p < .01.

https://doi.org/10.1371/journal.pone.0179252.g002

A repeated-measures ANOVA was conducted on the confidence ratings for trials with a correct response, with the factors of Group, Interval size, and Congruence. There was a significant main effect of Interval size, F(2, 52) = 44.71, p < .001, ηp2 = .63. A post-hoc test indicated that participants’ confidence level increased with the size of the pitch interval leading to the target note (small: M = 3.75, SE = 0.12; medium: M = 3.98, SE = 0.11; large: M = 4.18, SE = 0.10; all p < .001). There was also a significant main effect of Group, F(1, 26) = 5.03, p = .03, ηp2 = .16. Across interval sizes, mean ratings of confidence were lower for individuals with congenital amusia (M = 3.78; SD = 0.58) than for control participants (M = 4.23; SD = 0.54). There was no significant interaction involving Group (all p > .05). That is, confidence was lower for amusic participants than for control participants regardless of the size of the pitch interval leading to the target note.

Discussion

These results confirm that amusic participants were less sensitive to audio-visual contour congruence, regardless of the interval size between consecutive tones. Indeed, amusics participants reported low confidence ratings when compared with control listeners for all interval sizes, even when they responded correctly. This deficit is unlikely to be caused by a high threshold for pitch discrimination, because the impairment was observed for small, medium, and large pitch intervals. Pitch memory problems are also unlikely to be the source of the impairment, given that memory requirements in our task were low.

Two possibilities remain. First, the difficulties in detecting incongruence of audio-visual contours may indicate that amusic participants had an unstable spatial representation of pitch. Second, their difficulties may reflect a general impairment in all forms of cross-modal mapping, given that cross-modal mapping is needed to compare stimuli from two sensory modalities. To test the latter possibility and examine whether the impaired contour processing extends beyond the pitch dimension, a follow-up experiment was conducted by employing the same paradigm used in Experiment 1 (i.e., SACT) to investigate contour processing in auditory dimensions other than pitch: either timbral brightness or loudness. Although it has been suggested that temporal, spectral, and intensity perception is intact in the amusic auditory system [47, 48], no study has tested whether individuals with congenital amusia show impairments in contour processing for attributes of sound other than pitch.

Experiment 2

Although the concept of contour has traditionally been applied to melodies consisting of a sequence of tones that vary in pitch, the contour of acoustic attributes other than pitch also have psychological significance [49, 50], including timbral brightness and loudness. Brightness is one of the most salient dimensions of timbre [51], and reflects the spectral profile of the sound. The perception of brightness correlates with the centre of mass of the frequency spectrum. Sounds with more energy in the high-frequency range of the spectrum are perceived as brighter, whereas sounds with more energy in the low-frequency range are perceived as duller, even when they have the same fundamental frequency (F0). In other words, brightness can be varied independently of the F0 (i.e., pitch height). Loudness, on the other hand, is a non-spectral dimension, and correlates with the intensity of a sound.

If individuals with congenital amusia have contour processing impairments specific to the pitch dimension, then they should be able to discriminate patterns of change in other dimensions. However, if individuals with congenital amusia have a more general impairment in cross-modal mapping, then they should exhibit impaired processing of contours in brightness and loudness.

Method

Participants.

Sixteen individuals with congenital amusia (four were recruited from Experiment 1) and 16 matched controls took part in Experiment 2. Table 2 summarizes the participants’ characteristics and results of the MBEA for each group. Because the participant pool and recruitment procedures were identical in Experiments 1 and 2, it is reasonable to assume that the two groups of amusics are representative of the same parent population.

thumbnail
Table 2. Participants’ characteristics, mean ± SD correct rates on the subtests of the MBEA, and independent-sample t-test results between two groups in Experiment 2.

https://doi.org/10.1371/journal.pone.0179252.t002

Stimuli.

Auditory stimuli were constructed to vary in either timbral brightness or in intensity, but not in pitch. Brightness-varying stimuli were digitally synthesized and manipulated by shifting the spectral centroid while keeping the F0 fixed using MATLAB, following the strategy described by Russo and Thompson (2005) [52] and Warrier and Zatorre (2002) [53]. The energy in the dull timbre was weighted in lower partials, and the energy in the bright timbre was weighted in the higher partials. In the present experiment, F3 (174.62 Hz), G3 (196 Hz), A3 (220 Hz) or B3 (246.94 Hz) was selected to serve as the F0.

As illustrated in Fig 3, five levels of timbral brightness (very dull, somewhat dull, intermediate, somewhat bright, and very bright) were generated for each frequency by varying the intensities of ten partial harmonics while keeping F0 at a fixed intensity level that was always higher than that of any other partial. This strategy ensured that tones differed only in brightness but not on the intensity of the F0. The spectral centroid changes from the intermediate timbre to the very dull, somewhat dull, somewhat bright, and very bright timbre were approximately 330, 114, 107, and 278 cents, respectively. To be comparable to the pitch-varying sequence used in Experiment 1, timbral brightness-varying sequences consisted of seven notes, and the target note occurred at the fourth, fifth or sixth position at an equal rate. There were 24 timbral brightness-varying sequences in total and the notes in each sequence shared the same F0 but varied in spectral centroid. The degree of change in brightness between the preceding and target note was manipulated experimentally: for half of the trials, small changes in timbre were introduced (a change by one or two levels) and the rest were large changes (a change by three or four levels). Every sequence started with the tone in the intermediate timbre and was presented binaurally at 65 dB SPL through headphones.

thumbnail
Fig 3. Spectra of five levels of brightness used in Experiment 2.

The x-axis refers to the harmonic components.

https://doi.org/10.1371/journal.pone.0179252.g003

The loudness-varying stimuli were generated using the intermediate timbre tones from the timbral brightness-varying stimuli, and manipulated by altering the amplitude to increase or reduce intensity by 5 or 10 dB. Loudness-varying sequences were then created following similar procedures with timbral brightness-varying ones, where the degree of change in loudness between the preceding and target note was either small or large. Thus, loudness-varying sequences varied in intensity, but not in pitch or timbral brightness.

Two types of visual stimuli were employed—height-varying and visual brightness-varying contours. The former stimuli were similar to those used in Experiment 1 and the latter stimuli were created by varying visual brightness while maintaining the vertical spatial location of the dots. In congruent trials, the audio and visual information were congruent; that is, the sound went brighter or louder aurally as the dot moved up or went brighter visually, or the sound went duller or softer aurally as the dot moved down or went dimmer visually. Incongruent trials were characterized by the reversed mapping.

Procedure.

The paradigm and procedure were the same as that described for Experiment 1. Experiment 2 consisted of four audio-visual combinations: spatial height and timbral brightness; spatial height and loudness; visual brightness and timbral brightness; and visual brightness and loudness. Within each condition there were three blocks of 16 trials, yielding 48 trials per condition. Assignment of the two response keys to the congruent and incongruent responses and the orders of four conditions were counterbalanced across participants.

Results

A repeated-measures ANOVA on d′ was conducted with the factors of Group, Audio change (timbral brightness and loudness), Visual change (height and visual brightness), and Change size (small and large). As shown in Fig 4, the mean performance in the amusic group (M = 2.06, SE = 0.16) was slightly lower than the mean performance in the control group (M = 2.39, SE = 0.16); however, the difference between the two groups was not statistically significant, F(1, 30) = 2.11, p = .16, ηp2 = .07. All participants did better on loudness-varying conditions (visual height: M = 2.52, SE = 0.12; visual brightness: M = 2.49, SE = 0.13) in comparison to brightness-varying conditions (visual height: M = 2.03, SE = 0.15; visual brightness: M = 1.85, SE = 0.14), as revealed by the main effect of Audio change, F(1, 30) = 34.79, p < .001, ηp2 = .54. Similar to the finding in Experiment 1, individuals both with and without congenital amusia showed better performance on trials with large changes (M = 2.48, SE = 0.12) than on trials with small changes (M = 1.97, SE = 0.12), F(1, 30) = 36.20, p < .001, ηp2 = .55.

thumbnail
Fig 4. Mean d′ value in Experiment 2 for amusic and control groups.

Error bars represent +1 SE. ***: p < .001.

https://doi.org/10.1371/journal.pone.0179252.g004

Similarly, a repeated-measures ANOVA was conducted on confidence ratings. No group difference in self-reported confidence level was found (Amusic: M = 4.11, SE = 0.13; Control: M = 3.88, SE = 0.13), F(1, 30) = 1.47, p = .24, ηp2 = .05. Furthermore, participants reported higher confidence levels on loudness-varying conditions (M = 4.15, SE = 0.10) when compared with brightness-varying conditions (M = 3.83, SE = 0.11), F(1, 30) = 16.68, p < .001, ηp2 = .36, in line with their task performance reflected by d′ value.

Discussion

These findings suggest that individuals with congenital amusia, who are impaired on tests of melodic contour, have no significant impairment in contour processing for auditory dimensions other than pitch (timbral brightness or loudness in this case). Furthermore, individuals with congenital amusia exhibit no performance deficit for tasks that require cross-modal matching, as long as that task does not rely on sensitivity to pitch contour.

General discussion

Sensitivity to melodic contour is fundamental to music perception, and impaired contour processing is one of the defining characteristics of congenital amusia. Previous investigations of melodic contour have relied on a discrimination paradigm, in which participants were presented with pairs of melodies and were then required to judge whether they are the same or different (e.g., [4, 11, 25, 27]). However, such an experimental design cannot exclude potential influences from the limited capacity of auditory memory [6, 9, 24]. In this investigation, we developed and employed an online Self-paced Audio-visual Contour Task (SACT) that placed minimal load on auditory memory. The novel task allows us to determine whether the impaired contour processing characteristics of individuals with congenital amusia arises as a secondary consequence of a core deficit in either pitch discrimination or pitch memory. In addition, the self-paced paradigm allows participants sufficient time to encode acoustic information at early stages of the auditory processing, which should optimize pitch processing [43, 54]. Thus, poor performance on the SACT indicates a significant impairment of contour perception that cannot be explained as a consequence of impaired pitch memory.

In Experiment 1, amusic participants exhibited reduced sensitivity to pitch contour, even for pitch interval sizes that exceeded the threshold of pitch discrimination. Given the low memory load in the SACT, this impairment in contour processing cannot be solely explained by deficits in storing and retaining pitch information [6, 24, 42]. In addition, even when amusic participants made correct judgments about pitch contour, they still reported low confidence relative to control, suggesting amusic participants have a cautious attitude towards pitch-related tasks.

The results of Experiment 2 suggest that impaired contour processing is restricted to pitch sequences, and does not extend to acoustic attributes other than pitch. Nor does the impairment reflect a general deficit in cross-modal mapping. Indeed, confidence levels for judgments of timbral brightness and loudness did not differ between participants with and without congenital amusia. That is, amusics can make judgments of auditory input with normal levels of confidence, as long as those judgments are not about pitch [5557].

What is the underlying mechanism of contour processing in congenital amusia? Our investigation makes three advances to the understanding of impaired contour perception among individuals with congenital amusia. First, given that the SACT exerts very low burden on pitch memory, we can infer that congenital amusia is associated with impaired contour processing, and this deficit is unlikely to be a secondary consequence of an underlying pitch memory problem. Specifically, our results indicate that deficits in contour processing exist independently of potential deficits in short-term memory. Of course, as we did not attempt to isolate later stages of auditory processing (e.g., auditory short-term memory), it is also possible that amusia is independently associated with short-term pitch memory impairments (see [58] for a recent review). Second, given that performance was significantly worse for amusic participants than control participants even when pitch interval sizes exceeded their threshold of pitch discrimination, we can infer that impaired contour processing is unlikely to be a consequence of an inability to discriminate successive pitches in melodies. Third, given that amusic and control participants performed equally well on contour matching for acoustic attributes other than pitch, our results suggest that impaired contour processing in congenital amusia is specific to the domain of pitch.

Taken together, these insights suggest that impaired contour processing in congenital amusia is not a consequence of poor pitch memory or elevated pitch discrimination thresholds. Two possibilities remain. First, the impairment may reflect unstable coding of pitch direction at relatively early stages of processing. This stage of processing would be subsequent to the earliest stage of pitch processing at which individual pitches are encoded. This type of impairment would mean that individuals with amusia can perceive individual pitches, but they have difficulty perceiving relationships between pitches [22]. However, a recent study employing Event-related potential (ERP) methodologies casts doubt on this possibility. Lu et al. (2016) [59] reported that amusic and control individuals exhibited comparable ERP components in response to pitch change directions, suggesting that pitch direction is registered by the amusic brain.

A second possibility is that impaired contour processing in congenital amusia reflects of disorder of pitch awareness. Reduced pitch awareness may arise from an abnormality in the pathways that connect pitch perception to high-level regions associated with conscious awareness [6062]. This so-called “disconnection hypothesis” predicts that amusic individuals successfully represent pitch change direction at an early stage of processing, but this representation is not reliably transmitted to higher levels associated with conscious awareness, thereby resulting in reduced performance in tasks that entail explicit judgments of pitch [55, 60, 6365]. A reduction in pitch awareness would also explain why amusic participants were not confident with their pitch judgments, even when those judgments were correct, but they were confident of the judgments that they made for acoustic attributes other than pitch.

Supporting information

S1 File. The results of additional analyses.

https://doi.org/10.1371/journal.pone.0179252.s002

(RAR)

Author Contributions

  1. Conceptualization: XL HTH WFT.
  2. Data curation: XL.
  3. Formal analysis: XL.
  4. Funding acquisition: WFT.
  5. Investigation: XL YS.
  6. Methodology: XL HTH WFT.
  7. Project administration: XL YS.
  8. Resources: XL.
  9. Software: XL.
  10. Supervision: WFT.
  11. Validation: XL.
  12. Visualization: XL.
  13. Writing – original draft: XL.
  14. Writing – review & editing: XL YS HTH WFT.

References

  1. 1. Ayotte J, Peretz I, Hyde K. Congenital amusia: A group study of adults afflicted with a music-specific disorder. Brain. 2002;125(2):238–51. pmid:11844725.
  2. 2. Peretz I. The biological foundations of music: Insights from congenital amusia. In: Deustch D, editor. The psychology of music. Third Edition ed. San Diego: Academic Press; 2013. p. 551–64.
  3. 3. Vuvan DT, Nunes-Silva M, Peretz I. Meta-analytic evidence for the non-modularity of pitch processing in congenital amusia. Cortex. 2015;69:186–200. pmid:26079675.
  4. 4. Foxton JM, Dean JL, Gee R, Peretz I, Griffiths TD. Characterization of deficits in pitch perception underlying 'tone deafness'. Brain. 2004;127:801–10. pmid:14985262.
  5. 5. Hyde KL, Peretz I. Brains that are out of tune but in time. Psychological Science. 2004;15(5):356–60. Epub 2004/04/23. pmid:15102148.
  6. 6. Tillmann B, Schulze K, Foxton J. Congenital amusia: A short-term memory deficit for non-verbal, but not verbal sounds. Brain and Cognition. 2009;71(3):259–64. pmid:19762140.
  7. 7. Jiang C, Lim VK, Wang H, Hamm JP. Difficulties with Pitch Discrimination Influences Pitch Memory Performance: Evidence from Congenital Amusia. PLoS ONE. 2013;8(10):e79216. pmid:24205375.
  8. 8. Patel AD, Foxton JM, Griffiths TD. Musically tone-deaf individuals have difficulty discriminating intonation contours extracted from speech. Brain and Cognition. 2005;59(3):310–3. pmid:16337871.
  9. 9. Williamson VJ, Stewart L. Memory for pitch in congenital amusia: Beyond a fine-grained pitch discrimination problem. Memory. 2010;18(6):657–69. pmid:20706954.
  10. 10. Peretz I, Hyde KL. What is specific to music processing? Insights from congenital amusia. Trends in Cognitive Sciences. 2003;7(8):362–7. pmid:12907232.
  11. 11. Jiang C, Hamm JP, Lim VK, Kirk IJ, Yang Y. Processing melodic contour and speech intonation in congenital amusics with Mandarin Chinese. Neuropsychologia. 2010;48(9):2630–9. pmid:20471406.
  12. 12. Jones MR. Levels of structure in the reconstruction of temporal and spatial serial patterns. Journal of Experimental Psychology. 1976;2(4):475–88.
  13. 13. Prince JB, Schmuckler MA, Thompson WF. The effect of task and pitch structure on pitch-time interactions in music. Memory and Cognition. 2009;37(3):368–81. pmid:19246351.
  14. 14. Trehub SE, Trainor L. Singing to infants: Lullabies and play songs. Advances in infancy research. 1998;12:43–78.
  15. 15. Hébert S, Peretz I. Recognition of music in long-term memory: Are melodic and temporal patterns equal partners? Memory and Cognition. 1997;25(4):518–33. pmid:9259629.
  16. 16. Edworthy J. Interval and contour in melody processing. Music Perception. 1985;2(3):375–88.
  17. 17. Attneave F, Olson RK. Pitch as a medium: A new approach to psychophysical scaling. The American Journal of Psychology. 1971;84(2):147–66. pmid:5566581.
  18. 18. Dowling WJ. Scale and contour: Two components of a theory of memory for melodies. Psychological Review. 1978;85(4):341–54.
  19. 19. Dowling WJ, Fujitani DS. Contour, interval, and pitch recognition in memory for melodies. The Journal of the Acoustical Society of America. 1971;49(2):524–31. pmid:5541747.
  20. 20. Mikumo M. Encoding strategies for tonal and atonal melodies. Music Perception. 1992;10(1):73–81.
  21. 21. Trehub SE, Bull D, Thorpe LA. Infants' perception of melodies: The role of melodic contour. Child Development. 1984;55(3):821–30. pmid:6734320.
  22. 22. Liu F, Patel AD, Fourcin A, Stewart L. Intonation processing in congenital amusia: Discrimination, identification and imitation. Brain. 2010;133(6):1682–93. pmid:20418275.
  23. 23. Lu X, Sun Y, Thompson WF. An investigation of spatial representation of pitch in individuals with congenital amusia. The Quarterly Journal of Experimental Psychology. 2017;70(9):1867–77. pmid:27426027.
  24. 24. Gosselin N, Jolicoeur P, Peretz I. Impaired memory for pitch in congenital amusia. Annuals of the New York Academy of Sciences. 2009;1169:270–2. pmid:19673791.
  25. 25. Albouy P, Mattout J, Bouet R, Maby E, Sanchez G, Aguera PE, et al. Impaired pitch perception and memory in congenital amusia: the deficit starts in the auditory cortex. Brain. 2013;136(Pt 5):1639–61. pmid:23616587.
  26. 26. Williamson VJ, McDonald C, Deutsch D, Griffiths TD, Stewart L. Faster decline of pitch memory over time in congenital amusia. Advances in Cognitive Psychology. 2010;6(1):15–22. pmid:20689638.
  27. 27. Peretz I, Champod AS, Hyde KL. Varieties of musical disorders: The Montreal Battery of Evaluation of Amusia. Annuals of the New York Academy of Sciences. 2003;999(1):58–75. pmid:14681118.
  28. 28. Brodsky W, Kessler Y, Rubinstein BS, Ginsborg J, Henik A. The mental representation of music notation: notational audiation. Journal of Experimental Psychology: Human Perception and Performance. 2008;34(2):427–45. pmid:18377180.
  29. 29. Simoens VL, Tervaniemi M. Auditory short-term memory activation during score reading. PLoS ONE. 2013;8(1):e53691. pmid:23326487
  30. 30. Melara RD. Dimensional interaction between color and pitch. Journal of Experimental Psychology: Human Perception and Performance. 1989;15(1):69–79. pmid:2522534.
  31. 31. Marks LE. On cross-modal similarity: Auditory-visual interactions in speeded discrimination. Journal of Experimental Psychology. 1987;13(3):384–94. pmid:2958587.
  32. 32. Marks LE. Bright sneezes and dark coughs, loud sunlight and soft moonlight. Journal of Experimental Psychology. 1982;8(2):177–93. pmid:6461716.
  33. 33. Marks LE. On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness. Journal of Experimental Psychology. 1989;15(3):586–602. pmid:2527964.
  34. 34. Marks LE, Hammeal RJ, Bornstein MH. Perceiving similarity and comprehending metaphor. Monographs of the Society for Research in Child Development. 1987;52(1):i–100. pmid:3431563.
  35. 35. Eitan Z, Schupak A, Marks LE, editors. Louder is higher: Cross-modal interaction of loudness change and vertical motion in speeded classification. Proceedings of the 10th international conference on music perception and cognition; 2008; Adelaide, Australia: Causal Productions.
  36. 36. Lewkowicz DJ, Turkewitz G. Cross-modal equivalence in early infancy: Auditory–visual intensity matching. Developmental psychology. 1980;16(6):597–607.
  37. 37. Lidji P, Kolinsky R, Lochy A, Morais J. Spatial associations for musical stimuli: A piano in the head? Journal of Experimental Psychology: Human Perception and Performance. 2007;33(5):1189–207. pmid:17924817.
  38. 38. Rusconi E, Kwan B, Giordano B, Umilta C, Butterworth B. Spatial representation of pitch height: the SMARC effect. Cognition. 2006;99(2):113–29. pmid:15925355.
  39. 39. Prince JB, Schmuckler MA, Thompson WF. Cross-model melodic contour similarity. Canadian Acoustics. 2009;37(1):35–49.
  40. 40. Davies ADM, Roberts E. Poor pitch singing: A survey of is incidence in school children. Psychology of Music. 1975;3(2):24–36.
  41. 41. Mikumo M. Multi-encoding for pitch infornation of tone sequences. Japanese Psychological Research. 1997;39(4):300–11.
  42. 42. Albouy P, Schulze K, Caclin A, Tillmann B. Does tonality boost short-term memory in congenital amusia? Brain Research. 2013;1537(2013):224–32. pmid:24041778.
  43. 43. Tillmann B, Lalitte P, Albouy P, Caclin A, Bigand E. Discrimination of tonal and atonal music in congenital amusia: The advantage of implicit tasks. Neuropsychologia. 2016;85:10–8. pmid:26944873.
  44. 44. Krumhansl CL. Cognitive Foundations of Musical Pitch. Oxford, UK: Oxford University Press; 1990.
  45. 45. Eerola T, Toiviainen P. MIDI Toolbox: MATLAB Tools for Music Research University of Jyväskylä: Kopijyvä, Jyväskylä, Finland2004. http://www.jyu.fi/hum/laitokset/musiikki/en/research/coe/materials/miditoolbox/.
  46. 46. Macmillan NA, Creelman CD. Detection Theory: A User's Guide. Second ed. Mahwah, NJ: Erlbaum; 2005.
  47. 47. Cousineau M, Oxenham AJ, Peretz I. Congenital amusia: A cognitive disorder limited to resolved harmonics and with no peripheral basis. Neuropsychologia. 2014. pmid:25433224.
  48. 48. Cousineau M, Oxenham AJ, Peretz I. The role of peripheral spectro-temporal coding in congenital amusia. The Jouranl of the Acoustical Society of America. 2013;133(5):3381.
  49. 49. McDermott JH, Lehr AJ, Oxenham AJ. Is relative pitch specific to pitch? Psychological Science 2008;19(12):1263–71. pmid:19121136
  50. 50. Graves JE, Micheyl C, Oxenham AJ. Expectations for Melodic Contours Transcend Pitch. Journal of Experimental Psychology: Human Perception and Performance. 2014;40(3):2338–47. pmid:25365571.
  51. 51. McAdams S, Winsberg S, Donnadieu S, De Soete G, Krimphoff J. Perceptual scaling of synthesized musical timbres: Common dimensions, specificities, and latent subject classes. Psychological Research. 1995;58(3):177–92. pmid:8570786.
  52. 52. Russo FA, Thompson WF. The subjective size of melodic intervals over a two-octave range. Psychonomic Bulletin & Review. 2005;12(6):1068–75. pmid:16615330.
  53. 53. Warrier CM, Zatorre RJ. Influence of tonal context and timbral variation on perception of pitch. Perception & Psychophysics. 2002;64(2):198–207. pmid:12013375.
  54. 54. Albouy P, Cousineau M, Caclin A, Tillmann B, Peretz I. Impaired encoding of rapid pitch information underlies perception and memory deficits in congenital amusia. Scientific Reports. 2016;6:18861. pmid:26732511.
  55. 55. Loui P, Guenther FH, Mathys C, Schlaug G. Action-perception mismatch in tone-deafness. Current Biology. 2008;18(8):R331–2. Epub 2008/04/24. pmid:18430629.
  56. 56. Loui P, Kroog K, Zuk J, Winner E, Schlaug G. Relating pitch awareness to phonemic awareness in children: implications for tone-deafness and dyslexia. Frontiers in Psychology. 2011;2:111. pmid:21687467.
  57. 57. Hutchins S, Gosselin N, Peretz I. Identification of changes along a continuum of speech intonation is impaired in congenital amusia. Frontiers in Psychology. 2010;1:236. pmid:21833290.
  58. 58. Tillmann B, Leveque Y, Fornoni L, Albouy P, Caclin A. Impaired short-term memory for pitch in congenital amusia. Brain Research. 2016;1640(Part B):251–63. pmid:26505915.
  59. 59. Lu X, Ho HT, Sun Y, Johnson BW, Thompson WF. The influence of visual information on auditory processing in individuals with congenital amusia: An ERP study. NeuroImage. 2016;135:142–51. pmid:27132045.
  60. 60. Peretz I, Brattico E, Jarvenpaa M, Tervaniemi M. The amusic brain: in tune, out of key, and unaware. Brain. 2009;132(5):1277–86. pmid:19336462.
  61. 61. Hyde KL, Zatorre RJ, Peretz I. Functional MRI evidence of an abnormal neural network for pitch processing in congenital amusia. Cerebral Cortex. 2011;21(2):292–9. pmid:20494966.
  62. 62. Tillmann B, Albouy P, Caclin A, Bigand E. Musical familiarity in congenital amusia: evidence from a gating paradigm. Cortex. 2014;59:84–94. pmid:25151640.
  63. 63. Zendel BR, Lagrois ME, Robitaille N, Peretz I. Attending to pitch information inhibits processing of pitch information: the curious case of amusia. Journal of Neuroscience. 2015;35(9):3815–24. pmid:25740512.
  64. 64. Lu X, Ho HT, Liu F, Wu D, Thompson WF. Intonation processing deficits of emotional words among Mandarin Chinese speakers with congenital amusia: an ERP study. Frontiers in Psychology. 2015;6:385. pmid:25914659.
  65. 65. Loui P, Alsop D, Schlaug G. Tone deafness: A new disconnection syndrome? Journal of Neuroscience. 2009;29(33):10215–20. pmid:19692596.