Figures
Abstract
Research on infant vocal development has provided notable insights into vocal interaction with caregivers, elucidating growth in foundations for language through parental elicitation and reaction to vocalizations. A role for infant vocalizations produced endogenously, potentially providing raw material for interaction and a basis for growth in the vocal capacity itself, has received less attention. We report that in laboratory recordings of infants and their parents, the bulk of infant speech-like vocalizations, or “protophones”, were directed toward no one and instead appeared to be generated endogenously, mostly in exploration of vocal abilities. The tendency to predominantly produce protophones without directing them to others occurred both during periods when parents were instructed to interact with their infants and during periods when parents were occupied with an interviewer, with the infants in the room. The results emphasize the infant as an agent in vocal learning, even when not interacting socially and suggest an enhanced perspective on foundations for vocal language.
Citation: Long HL, Bowman DD, Yoo H, Burkhardt-Reed MM, Bene ER, Oller DK (2020) Social and endogenous infant vocalizations. PLoS ONE 15(8): e0224956. https://doi.org/10.1371/journal.pone.0224956
Editor: Iris Nomikou, University of Portsmouth, UNITED KINGDOM
Received: October 22, 2019; Accepted: July 20, 2020; Published: August 5, 2020
Copyright: © 2020 Long et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data required to replicate the study's findings are contained in the manuscript, its files, and openly available in Open Science Framework at https://osf.io/hb834/. Due to the nature of this research, participants of this study did not agree for audio/video recordings to be shared publicly, so raw recording data is not available, nor required to replicate the study.
Funding: The research for this manuscript was funded to DKO by the National Institutes of Health grants R01 DC006099, DC011027, and DC015108 from the National Institute on Deafness and Other Communication Disorders (https://www.nidcd.nih.gov/) and by the Plough Foundation (http://plough.org/) which supports DKO's Chair of Excellence. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Overview
The relative frequencies of human infant vocalizations that can be categorized as social vs. endogenous have not been a major focus of research. We seek to quantify the extent to which infants vocalize socially and endogenously in naturalistic settings. The effort has led to a shift in our perspective, where the contribution of endogenous vocalization and exploratory vocal play has assumed increasing importance in our speculations about the emergence of the speech capacity both in development and evolution.
The new perspective is informed by evolutionary developmental biology, evo-devo [1–4], a paradigm of thought that emphasizes natural selection as targeting developmental processes, allowing the evolution of foundational structures and capabilities upon which subsequent developments can self-organize and be further exploited in subsequent development and evolution. This approach does not diminish the importance of social interaction in the origin of the speech capacity, but instead is hoped to help account for foundational requirements of functionally flexible vocal interaction. In essence, the line of reasoning emphasizes the origin of flexible vocalization, without which significant growth in flexible vocal interaction and, through further development, vocal language may have been impossible.
Social interaction and vocal development
The effect of social interaction on infant vocal development has long been a topic of interest in child psychology and the emergence of language [5–13]. The study of infant intrinsic motivation for social engagement has highlighted an apparently innate drive to engage in face-to-face dyadic interaction with caregivers from birth [14, 15] and has been interpreted as contributing to the development of temporal sensitivity, vocal coordination, and social contingency [16–20]. The long tradition of research in infant attachment and bonding [21–24] has included a distinct emphasis on the parent-infant dyad as the fundamental unit of human social and emotional development. Even in the first 3 months of life parent-infant vocal interaction has been described in detail [25–27]. Experimental studies in the still-face paradigm [28] have shown that by 5–6 months of age, infants increase their rate of speech-like vocalizations when the parent disengages from an ongoing vocal interaction [29, 30], suggesting infants by that age seek to repair broken interactions with increased vocalization. A social feedback loop has been posited to exist in infant and child vocalization, and that loop has been thought to promote contingent infant vocalizations with respect to caregiver vocalizations [6, 31–33]. Winnicott [34] went so far as to say that “there is no such thing as an infant,” highlighting the idea that without a mother, an infant cannot exist. But this idea has been taken too far, we think, if it is interpreted to imply that research on human infancy should emphasize the dyad to the near exclusion of interest in the independent infant as an agent in its development.
There can be no doubt that social interaction plays a critical role in infant vocal learning and language acquisition; social learning allows us for example to acquire language-specific syllables, phonemic elements, and the largely arbitrary pairings of words with meanings in languages. But even deaf infants produce the same kinds of prelinguistic speech-like sounds, or “protophones” [30], as hearing infants in the first year of life [35]. Thus the importance of hearing speech sounds from the social environment does not appear to drive the initial development of protophones. In this paper, we seek to highlight the quantity of infant endogenous, non-cry vocal activity to further illuminate the role protophones play in supplying a basis for social learning.
Several studies have shown that dyadic vocal interaction increases the rate of protophone production (volubility), and the proportion of advanced vocal forms including canonical babbling appears to be particularly high during dyadic vocal interaction [5, 6, 8, 10, 27]. Yet surprisingly, the proportion of infant protophones that are social in nature has, to our knowledge, never been previously quantified, so the extent to which infant protophone production may be primarily social rather than endogenous is unknown.
Intrinsic motivation to support vocal development
Intrinsic infant motivation for action and exploration has long been recognized. For example, Piaget’s sensorimotor stage in the first two years of life is portrayed as a period wherein infants’ self-generated gestures are produced without social intent, but rather for the pure enjoyment of experiencing sensorimotor activity [36, 37]. In anecdotal reports [38–42], the interpretation of this stage focused on the circular reactions of manual gestures, but Piaget did not emphasize circular reactions in the vocal domain [43].
The low level of focus on the infant as an independent agent of vocalization in prior research on development (see Appendix A of S1 Data) might be in part an unintended consequence of the radical behaviorist tradition that for many decades treated behaviors as responses rather than actions [44, 45]. Panksepp and his colleagues have argued that we have not overcome the legacy of that radical behaviorism, and that even modern cognitive psychology continues to underplay the endogenous, emotion-driven actions of both humans and non-humans [46–49].
Breaking with the dominant tradition of infant development research, a role for intrinsic motivation as a primary mechanism to support vocal development has recently received increased attention [50–52]. In the Supplementary Material to a published article based on recordings made in our own laboratory [53], it was reported that infants across the first year of life produced the majority of their protophones when gaze was not directed toward another person. In a small-scale study from another laboratory with just 16 minutes of recording per infant at 6–8 months, infants produced more vocalizations when playing alone with toys than when engaged socially [54]. Another recent observational study found no significant difference in protophone volubility between a recording circumstance where parents talked to infants compared to circumstances where parents were in the same room and silent or not present in the room at all, suggesting that infants had an “independent inclination to vocalize spontaneously” in the absence of social interaction (p. 481) [7]. Importantly, the rate of protophone production has been reported to be very high, >4 protophones per minute during all-day audio recordings, across the entire first year, and even when infants were judged to be alone in a room, the rate was >3 per minute [55].
These findings suggest vocalizations are commonly produced endogenously. In other words, infants in these prior studies appear to have been intrinsically motivated to explore or practice sounds, in essence to play with sensorimotor aspects of sound production, although the evidence has been somewhat indirect. We propose that this vocal exploration may have a deeply significant role in vocal development, alongside the importance of caregiver-infant interaction and ambient language exposure. In spite of the possible importance of endogenous, exploratory vocalizations in language development, to our knowledge there is no published evidence specifically targeting the communicative function of infant protophones or the lack of it. Only with such work will it be possible to reliably quantify proportions of endogenous infant protophones and socially-directed ones. (see Appendix B of S1 Data, for information suggesting that both parents and non-parents tend to view infant vocalizations as being predominantly social rather than endogenous or exploratory).
We deem it important that such quantification be established in contexts with and without parent engagement across the first year of life. Prior studies suggest the proportions of endogenously-produced sounds may be high, but appropriate research requires direct comparison in different circumstances of potential interaction, especially when caregivers are attempting to interact with infants and when not. Providing such quantification may highlight the importance of endogenously generated vocalization and self-organization in prelinguistic vocal development [50, 52] and may help establish perspective about relative roles of endogenous and interactive factors in vocal development.
Specific aims and hypothesis
Our primary goal is to determine the extent to which infants produce social and endogenous vocalizations at three ages and in two laboratory circumstances: An Engaged circumstance, where the parent attempts to interact with the infant, and an Independent circumstance, where the infant is present in a room, but the parent is interacting with another adult. This quantification is hoped to provide a standard against which we may be able to recognize the relative importance of infant protophones both as social and as endogenous. We hypothesize that infants will produce predominantly socially-directed vocalizations in circumstances where parents are trying to interact with infants (Engaged) and predominantly endogenous vocalizations when parents are interacting with another adult while the baby is in the room (Independent).
Materials and methods
Approval for the longitudinal research that produced data for this study was obtained from the IRB of the University of Memphis. Families were recruited from child-birth education classes and by word of mouth to parents or prospective parents of newborn infants. Interested families completed a detailed informed consent indicating their interest and willingness to participate in a longitudinal study on infant sounds and parent-child interaction.
We selected six parent-infant dyads (3 male, 3 female infants) from the University of Memphis Origin of Language Laboratory’s (OLL) archives of audiovisual recordings. The dyads had been recorded while engaged in naturalistic interactions and play. The three female infants were initially selected for coding in an earlier study on imitation [56] which had utilized a coding methodology for judging illocutionary force similar to the one used in the present study. Three males were thereafter selected from the archives in order to balance the sample for gender. The selection was unbiased with regard to social vs. endogenous vocalization. All families lived in and around Memphis, Tennessee, and all but one infant were exposed to an English-only speaking environment (Infant 6 was exposed to English and Ukrainian at home). Parents were asked to speak English and no other language during the laboratory recordings. Criteria for inclusion of infant participants included a lack of impairments of hearing, vision, language, or other developmental disorders. Demographics and recording ages for each infant at each recording session are provided in Table 1.
Laboratory recordings
Two laboratory recordings were selected from each of the 6 infants at approximately 3, 6, and 10 months, for a total of 36 sessions. The average session length was 19 minutes (range: 12–22 minutes). During recordings, the parent-infant pairs occupied a studio designed as a child playroom with toys and books. Laboratory staff operated four or eight pan-tilt video cameras located in the corners of the recording studio from an adjacent control room—there were three such recording laboratories at varying stages of the research. In all the laboratories, two channels of video were selected at each moment in time with the goal of recording: 1) a full view of the interaction or potential interaction, including the infant and any potential interactors (i.e., parent or laboratory staff) with one camera and 2) a close view of the infant’s face with the other camera. Both the parent and the infant wore high fidelity wireless microphones, with the infant microphone <10 cm from the infant’s mouth. Detailed descriptive information regarding the recording equipment can be found in previous studies from this laboratory [57, 58].
In roughly counterbalanced orders across ages, parents were either instructed to interact with the infant (the expected Engaged circumstance) or with another adult while the baby was in the room (the expected Independent circumstance). Later at the same age (usually on the same day), the dyad was recorded in the other circumstance. Parents were asked to interact with the infant and/or laboratory staff in a naturalistic manner. During the expected Engaged circumstance, parents were encouraged to engage in face-to-face interaction with the infant but were not restricted from interaction with others if someone came into the room (e.g., to adjust cameras, to answer parent questions, etc.). Similarly, in the expected Independent circumstance, parents were encouraged to keep their attention and interactive focus on the laboratory interviewer but were not restricted from engaging with the infants if they appeared uncomfortable or if the infants were repeatedly bidding for attention. The freedom allowed in these naturalistic recordings resulted in variation in the actual circumstance with respect to the expected circumstance. Our analysis took account of social directivity of infant utterances in the actual circumstances only.
Coding for Engaged and Independent circumstances
As indicated above, the recordings had been intended to be differentiated neatly as primarily corresponding to Engaged or Independent circumstances, but the infants often sought attention from the parents during sessions intended by protocol to be Independent, or adults would engage in conversation with a staff member during sessions intended to be Engaged. For this reason, we re-categorized segments of time within each session in terms of whether they were actually Engaged or Independent. Pic 1 exemplifies this re-categorization.
An example of one 20-minute recording (Infant 5 at 3 months) with the expected circumstance according to the protocol on line 1 of the coding field (below the spectrogram) and the re-categorization of actual circumstances on line 2. In this recording session, the parent was instructed to engage with the interviewer in accord with the Independent circumstance, but there were two substantial periods of time where the parent was actually directly engaged with the infant, and so those segments were re-coded as Engaged.
These re-categorized segments were used in the analysis of the role of circumstance in the infant utterances. Table 2 shows the re-categorized, actual circumstance durations for each infant and infant age. (Appendix C of S1 Data) provides a more detailed breakdown of expected and actual circumstance durations for each infant and infant age.
The amount of time pertaining to the actual circumstances that occurred during the recordings varied substantially, including two periods of time that included so few utterances (< 5) we did not include them in the analyses, as indicated in the total protophone counts of Table 3. This substantial variation in circumstance duration, along with the variability of actual ages provided motivation for a statistical modeling approach that was robust and conservative with regard to such variations (see below).
Coding of the function of infant protophones
Coding for circumstance, illocutionary function, and gaze direction was completed within the Action Analysis Coding and Training software (AACT) [59]. This coding software has been used and discussed extensively in previous research from this laboratory [25, 58, 60]. The software affords frame-accurate coordination of video and audio, which is displayed in a special version of the TF32 software [61]. TF32 includes both flexible waveform and spectrographic displays. Coders can view and listen with a scrolling audio display where a cursor indicates the location of the audio at each moment of playback. The utterances to be coded in the present work were labeled for vocal type and bounded in time for onsets and offsets in AACT in prior studies [53]. The AACT software allowed the coder to advance to each bounded utterance in turn for playback and coding in illocutionary force and gaze direction for the present study. The AACT software also allows users to export data that indicate whether an utterance occurred within an Engaged or Independent circumstance.
All infant protophones that had been previously bounded were also labeled for the present work in terms of illocutionary force [62–64] to indicate potentially communicative functions. Illocutionary force was originally defined by Austin as the social intention of a speech act, but has been extended in work in child development and animal communication to also encompass vocal acts produced with little or no social intention [53]. In this extended usage, vocal play, for example, is treated as an illocutionary force. Another example: a fussy protophone, not directed toward anyone, can be treated as having the illocutionary force of complaint.
Pre-linguistic infants express varying illocutionary forces and varying emotional content (i.e., positive, neutral, and negative) in early protophones beginning at birth [53, 65] (see Appendix D of S1 Data). This fact indicates that infants have the capacity to produce a single protophone type with different illocutionary forces on different occasions, indicating they possess a vocal capability that is, of course, required of all words and sentences in mature language. Put another way, infant protophones can be used with varying communicative intentions, for example, to gain attention, to continue vocal interaction when engaged with a caregiver, or to make a request. The same vocalization types can also be produced for the infant’s own purposes when not engaged in social interaction at all, e.g., when vocalizing toward an object or when simply exploring sound for its own sake.
The determination of whether a vocalization is social or endogenous requires considering a variety of factors. One is gaze direction during infant vocalization, but another is the extent to which infants may bid for attention vocally even when they are not in the same room with caregivers. Judging directivity of infant vocalizations also requires taking into account the relative timing of infant and caregiver utterances as well as the content of utterances of adults who are present at the time of the recording, especially caregivers who presumably know a good deal about the capabilities of a particular infant. We make the assumption for this work that judgments about vocal directivity need to be made moment by moment, utterance by utterance, to account for the possibility that infants may engage and disengage in protoconversation. The judgments of the social or endogenous nature of infant protophones need to be made taking account of the broad context of events prior to and subsequent to each infant utterance, and factors such as timing, eye contact, perceived imitativeness, and meaningful responsivity must be allowed to yield intuitive judgments by the observer, where a balance among the factors provides the basis for the coding.
A coding scheme was created for making judgments on the illocutionary function of individual infant vocalizations in consideration of all of the above listed factors. Social protophones were labeled as such when, for example, the infant used them to initiate conversation, continue an ongoing interaction, imitate another person, or to complain or exult in a way that was directed to an adult as indicated by gaze, gestures, or other contextual factors. Endogenous protophones were identified as utterances infants produced for their own purposes; such events included vocal play, object-directed sounds, complaints and exultations not directed to others, or protophones with no clear illocutionary force. Brief descriptions of each code used for judgments of illocutionary function are provided in Table 4.
Our coding is founded on the assumption that human observers are naturally able to judge the extent to which vocalizations at any age are intended as communicative acts—otherwise how would humans know when to respond or participate in vocal engagement? If some parents are poor at making such judgments, they are surely at a disadvantage in child rearing, because they don’t know when their infants are communicating or not. It makes sense that natural selection has produced parents (and potential parents) that are capable of recognizing when infants are communicating intentionally and when not. Consequently, the coding process takes advantage of natural capabilities of human observers and gauges the extent of their reliability by comparing agreement among observers.
During illocutionary coding, both the primary coder and an independent reliability coder took a broad view of each utterance and its context of production. The coding was conducted by watching the entire recording session. Then the coder started at the beginning of each session and observed everything that happened up to the point of each infant utterance, and then coded with repeat observation. That is, each time a protophone was located, the judgment of illocution was made based on the entire preceding context and the cursors could also be stretched so that, during repeated playbacks before coding for illocutionary force, the coder could, if necessary, see and hear the utterance plus a several-second context both before and after it repeatedly. If there was ambiguity about how to judge the possible social directivity of the utterance, the boundaries could be stretched further until the coder felt confident that no further stretching would improve the coding decision.
Coding for gaze direction of infant protophones
Gaze direction coding was conducted independently of the illocutionary coding for all protophones and was based on gaze direction only. For this coding, sound was turned off, and the coder determined whether at any time during each utterance, the infant looked toward another person. The time frame of playback for the period during which the protophones occurred was expanded through a special setting in AACT by 50 ms before and 50 ms after the actual utterance boundaries as indicated based on the original protophone coding. This expansion of time frame for viewing was deemed important because of the low frame rate of video recording (~30 ms per frame) and ensured that the entire period of the vocalization was available for visual judgment. Utterances could be played repeatedly this way. They were judged as “directed to a person” (during any portion of the utterance plus or minus 50 ms) or “not directed to a person” (during the same period). For utterances that included no good camera view of the infant (the infant sometimes turned away from the selected cameras and vocalized before new cameras could be selected) or for utterances where the infant’s eyes were closed, the coder indicated “can’t see” or “eyes closed,” respectively. The gaze direction analysis excluded all such utterances. A brief description of each code used for judgments of gaze direction is provided in Table 5.
Coder training and coder agreement
For the coding in the present study, both the primary coder and the agreement coder were trained in infant vocalizations and illocutionary coding by the last two authors in a training sequence that has been described in several prior publications [25, 51, 53]. In brief, the training included 1) a series of 5 lectures on vocal development and coding of early vocalization and interaction, 2) an interleaved set of corresponding coding exercises using recorded data like that to be encountered in the current research; 3) comparisons of the outcomes of those coding exercises with regard to outcomes for other coders, with special reference to coder agreement and agreement with gold standard coding by the last author, who has been engaged in vocal development research for more than 40 years [66]; and 4) a certification process that resulted from reviews ensuring that coding results correlated highly with group coding and the gold standard coding and did not diverge from gold standard coding by more than 10% of mean values.
All the data of the present study were coded for illocutionary force (from which socially- and endogenous categories could be derived) by the first author, and approximately 30% of the total data set was coded independently for illocutionary force by the agreement coder. An original coding of gaze direction had been done on three of the six infants by a previous team of coders for the paper previously cited [53]. This completely independent prior coding on half of the data for the present study was available to offer an agreement check on the gaze coding done for the present paper.
Results
Protophone usage judged in terms of illocutionary functions
A total of 6,657 infant protophones were labeled across all 36 recordings (6 infants x 3 ages x 2 sessions). The data account for all infant utterances that were judged to be non-vegetative (burp, hiccough) and not fixed signals (cry, laugh) across the 36 laboratory recording sessions. Utterances where either gaze or illocution could not be judged were eliminated. Two segments were eliminated from analysis because of a very low number of protophones for that infant at that age in that condition (specifically, Infant 1, Independent at 3 months and Infant 6, Engaged at 6 months, see Table 3 in Methods). Only 8 protophones occurred in these 2 segments. We also limited the analysis to include utterances that could be judged based on audio and video both for illocutionary force and for gaze direction. The final set included 6,388 protophones.
To determine if the usage of endogenous protophones exceeded that of social protophones, we used t-tests comparing percentages of endogenous protophones against 50%. To test for effects of Age (3 levels) and recording Circumstance (Engaged vs. Independent), a different approach was required. We selected a logistic regression model based on Generalized Estimating Equations (GEE). GEE analyses are a non-parametric alternative to generalized linear mixed models that accounts for within-subject covariance when estimating population-averaged model parameters [67]. GEE is particularly appropriate for the data in question because of the unequal amounts of data in the two circumstances and the lack of precise age matching across infants. GEE provides a conservative but robust method for such cases.
Fig 1 displays the overall percentages of protophones produced by the six infants across the two broad illocutionary groupings of endogenous and social. Infants used significantly more endogenous protophones across the three ages than social ones, with about 75% of all protophones being endogenous. By t-tests of the percentage of endogenous protophones, it was found they significantly (p < .001) exceeded 50% at all three ages. We found no notable change in the predominance of the endogenous protophones across Age, and indeed the GEE revealed no significant difference in the percentage of social protophones across Age (p = 0.48). A subsequent GEE analysis was conducted with Age as a continuous variable and produced the same pattern, with more endogenous protophones than social ones (p < .0001) and no Age effect (p = .69).
Percentage of infant protophones that were judged to be endogenous (produced for the infants’ own purposes) and social (overtly communicative) across all observations. Overall, infants primarily produced endogenous vocalizations (~75%), suggesting that the great majority of infant sounds are produced independent of social engagement in the first year. Furthermore, a non-significant main effect of Age is consistent with an interpretation of stable use of both social and endogenous protophones across the three ages.
Similarly, t-tests of the proportion of endogenous protophones in the two circumstances (Engaged vs. Independent) showed that endogenous protophones significantly exceeded 50% in both circumstances (p < .001). Based on the GEE for data presented in Fig 2, infants used significantly more endogenous protophones in the Independent circumstance than the Engaged circumstance (p < .03). A separate GEE analysis in which only main effects were considered revealed a stronger Circumstance effect (p < .0001). The fact that endogenous protophones outnumbered social ones in the Engaged circumstance contradicted our hypothesis and highlighted the predominance of endogenous infant vocalization. A separate GEE analysis of the data treating Age as a continuous variable yielded similar results. Specifically, significant differences were seen for overall proportions of protophones between circumstances (p < .001) and non-significant differences across Ages (p = .982).
Percentages of social and endogenous infant protophones across Engaged (parent and infant interacting) and Independent (parent and interviewer conversing while infant present in room) circumstances. Endogenous protophones predominated in both conditions.
The pattern of results revealed by the illocutionary coding was similar for both the primary coder and the reliability coder, with 79% point-to-point inter-rater agreement on 30% of the recordings that were coded independently by the two observers. For both coders, endogenous protophones predominated, and the reliability coder—who had no knowledge of the hypotheses for this study—identified a slightly higher proportion of endogenous protophones (79.2%) than the primary coder (78.5%).
Protophone usage based on gaze-direction judgments
As a check on the illocutionary coding, we considered an alternate, simpler way of gauging the function of infant protophones. The first author coded gaze direction during protophone production as being directed or not directed toward a person. Gaze judgments were made with sound off (video only) for all six infants.
Even though the function of protophones as determined by gaze-direction was not always the same as the function based on illocutionary judgments, the overall percentages of social protophones as determined by the two methods was very similar. That is, the great majority of infant protophones were judged to be produced with gaze directed somewhere other than towards any person in the room, just as the illocutionary judgments indicated the great majority of infant protophones to be endogenous. 72% of the infant protophones were deemed not to include person-directed gaze, while 75% were deemed endogenous by illocutionary coding.
In the earlier study mentioned above [53], 50% of the current sample had been coded for gaze direction, allowing for a robust analysis of independent inter-rater agreement. Inter-rater agreement on a point-to-point basis was 87% (of 3347 utterances). The results showed a strong predominance of protophones not being associated with gaze directed toward another person for both the earlier coders and the present one. Based on the same sample of utterances, the primary coder in this study found 64% of the utterances not to include person-directed gaze, while the previous (reliability) coder found 61% not to include person-directed gaze. These percentages represent only half the total sample (three of the six infants) and consisted heavily of samples from the Engaged circumstance; consequently, the percentages (64 and 61%) are lower than the 72% of utterances deemed not to include person-directed gaze for the whole sample as reported above.
Let us expand on why the gaze-direction and illocutionary coding methods do not yield exactly the same outcomes on the function of infant protophones. In the coding of illocutionary force, momentary gaze direction by the infant toward a person was sometimes not deemed to indicate the function of the vocalization. For example, a momentary glance directed to the parent occasionally occurred even though the infant appeared to be engaged in vocal play. There were also a number of cases where the coder deemed a protophone to be social in illocutionary coding, even though gaze direction toward a person was deemed absent. Such cases often corresponded to interactional sequences where the relative timing of utterances suggested the infant was engaged and directing the protophone to the parent, even though the infant was looking away.
Discussion
Overall, infants used about three times as many endogenous protophones as social ones. This predominance remained stable across the three ages. Even in the Engaged circumstance, where parents were trying to engage with their infants, endogenous protophones predominated, with twice as many judged to be endogenous as social. In the Independent circumstance, where parents were engaged in conversation with laboratory staff, the endogenous protophones predominated to a substantially greater extent, with four times as many endogenous as social.
The low rate of socially-directed vocalizations of infants in the first 10 months as reported here has required us to reorient our thinking about the functions of infant protophones. It seems important to draw attention to the fact that for all the sessions of recording reported on here the caregivers and infants were in the same room, and caregivers were aware that they were being recorded. The caregivers also knew the study was about vocal development, and it was assumed they would endeavor to elicit infant vocalization and thus interact as much as possible. They often attended to infant vocalizations even in the designated Independent circumstances, sometimes responding to infant protophones with infant-directed speech (IDS), a pattern of caregiver responsivity that required some restructuring of our analysis to assign segments within sessions appropriately to the actual Engaged and Independent circumstances. Consequently, we presume parents tried to maximize their infants’ socially-directed vocalization—and yet the rate was low.
Partly because the Independent circumstance resulted in a considerably larger predominance of the endogenous protophones than the Engaged circumstance, we presume that even more naturalistic recordings might produce an even greater predominance of endogenous protophones. That is, we suspect that the percentage of infant protophones that are socially directed in the natural environment of the home could be considerably lower than the values estimated here. This suspicion is supported by recent results where we compared the amount of IDS occurring in laboratory recordings for 12 infants (three of whom are among those represented in the present work) to the amount of IDS occurring in all-day LENA recordings [68] conducted in the home with the very same infants at approximately the same ages across the first year of life [51]. IDS was six times more frequent in the laboratory recordings than in randomly-selected five-minute samples from the all-day recordings when infants were awake. Thus, we reason that the percentage of endogenous protophones at home could be considerably higher than we have seen in the present work, since IDS is considerably lower. We plan to explore the rate of endogenous vocalization in all-day recordings in subsequent efforts. We also aim to study a larger sample of infants and to consider more differentiated circumstances of recording.
Our results contradict expectations that have often been apparent in the field of child development, where infant vocalizations are generally treated as responses to adult utterances or as attempts to engage adults in social interaction or to seek help from adults. Why has there been relatively low emphasis on exploratory or endogenous vocalization? It seems likely that the answer lies in the amount of attention given by caregivers to infant vocalizations that are directed toward them as opposed to those that are not. We assume parents and other caregivers notice and remember vocalizations that appear to be social in nature to a greater extent than endogenous ones, and perhaps developmental researchers are similarly influenced by the salience of infant sounds that are embedded in protoconversation. Furthermore, parents may attend to any unique type of spontaneously produced protophone—irrespective of the communicative intent—and adapt their behavior to promote continued production of that particular sound, creating the appearance of, or perhaps initiating engagement with the infant. Indeed, we have reported evidence suggesting caregivers pay greatest attention to salient vocal signals such as those occurring in imitation, even though vocal imitation is surprisingly rare in the first year [69]. Caregivers, and thus people in general, may be inclined to overestimate the proportion of salient vocal signals such as imitation or immediate responses in protoconversation since it seems likely these are the sounds to which parents attend the most. So when they render estimates, they tend to overstate the frequency of occurrence of the social ones. It is only with systematic counting of every vocalization occurring in recorded samples, as has been done in the present work, that it becomes possible to determine that the great majority of infant protophones are in fact directed to nobody.
The results strongly suggest, then, that babies vocalize predominantly for their own endogenous purposes, hundreds or even thousands of times daily—4–5 times per minute of wakeful time based on randomly-sampled segments from all-day recordings at home [51]. There is considerable evidence that not just in vocalization, but in other realms as well, babies are not passive learners and in fact regularly influence their own experiences [70]. A fundamental question that requires answering based on the present work is: If protophones are not directed to caregivers, what is their purpose from a developmental or an evolutionary standpoint? What advantage could be associated with producing vocal sounds that are largely affectively neutral, produced most commonly in apparent comfort, but without social directivity [53, 65]?
One possibility is that infants may be learning the range of capabilities of their vocal system through sensorimotor exploration. We see evidence of this possibility when infants produce squeals for extended periods, repeatedly make small whisper sounds or raspberries, or babble the same syllables repeatedly to a toy. Of course it seems likely that endogenous and social vocalization both contribute to the development of the speech system [37, 43]. But importantly, the sounds infants use in endogenous vocal activity provide the raw vocal material that parents are able to use in engaging their infant in protoconversation.
Members of our research group and John L. Locke have argued elsewhere [63, 71–73] from an evolutionary-developmental (evo-devo) perspective [2, 4, 74, 75] that high rates of endogenous infant vocalization and vocal play may constitute fitness signals. The idea is based on the fact that the human infant is altricial (born relatively helpless) and has a long road ahead of requiring caregiver assistance for survival—the need for such caregiving lasts literally twice as long as in our closest ape relatives [76]. Consequently, we have argued that the human infant experiences selection pressure on the provision of fitness signals that could have the effect of eliciting long-term investment from caregivers, whose evolutionary goal can be portrayed as perpetuation of their own genes through grandchildren. From this point of view, caregivers should invest more in infants who seem healthy and tend to neglect infants who seem less healthy. We operate under the assumption that the production of comfortable vocalization can signal well-being and good health. This pattern of fitness signaling is hypothesized to have applied to the ancient hominin infant, who has been presumed in accord with the hominin “obstetrical dilemma” [77], to have been more altricial than other apes as soon as humans were bipedal. In accord with the reasoning about bipedality—which proves surprisingly difficult to confirm in the fossil record [78, 79]—bipedality had narrowed the human pelvis and required the hominin infant to be born with a smaller head and brain and thus to be more altricial than other apes. While the roots of human vocal flexibility appear to lie in their value as fitness signals in a distant hominin past, modern human infants are not less altricial than their distant forebears, and consequently we reason that endogenous protophones continue to be under selection pressure as fitness signals in human infancy.
One might ask, if fitness signaling is the primary advantage of protophones, why do infants not endeavor to direct their protophones primarily toward potential caregivers? Of course, some of the time they do, as indicated by our data. When they do not, the protophones may still be heard and noticed, if only semi-consciously by potential caregivers. A parent may hear comfortable infant protophones and draw the unspoken conclusion that the infant is well and needs no immediate attention. Regular events of noticing the infant’s well-being may reinforce a caregiver’s commitment to long-term investment precisely because it suggests that particular infant is healthy and thus likely to be a good investment for survival and reproduction. So it may pay for the human infant to produce protophones at prodigious rates in case someone might be listening.
The production of protophones in infancy at the beginning of the communicative split between ancient hominins and their ape relatives, perhaps millions of years ago, seems likely to have laid a foundation for a more extensive use of vocalization as a fitness signal later in life, for example, in mating or in alliance formation [72]. And as the amount of protophone-like vocalization became more well-established in the hominin line, it surely provided a foundation for more elaborate uses of vocalization, ratcheting from simple fitness signaling toward more and more language-like uses [63].
Play is widely recognized as a theater for practice of the behaviors young mammals will need as they proceed through life [80, 81]. But it is important to note that playful behavior can serve not only as practice, but also as a fitness signal for the altricial young of many species. Our suggestion is that protophones can be seen (in the substantial majority of cases) as playful indicators of well-being, but they would seem to contribute at the same time to a sort of preparation for the future in mating, in alliance formation, and ultimately (nowadays) in the development of language.
Acknowledgments
We wish to thank the families in Memphis whose infants participated in this research, the graduate student reliability coders, and the survey participants (Appendix B of S1 Data Opinion Study).
References
- 1. Bertossa RC. Theme issue: Evolutionary developmental biology (evo-devo) and behaviour: Papers of a Theme issue compiled and edited by Rinaldo C. Bertossa. Philos Trans R Soc B Biol Sci. 2011;366:2055–180.
- 2.
Carroll SB. Endless forms most beautiful: The new science of evo devo and the making of the animal kingdom. W. W. Norton & Co; 2005.
- 3. Newman SA. Physico-genetic determinants in the evolution of development. Science. 2012;338:217–9. pmid:23066074
- 4.
Müller GB, Newman SA. Origination of organismal form: Beyond the gene in developmental and evolutionary biology. Cambridge, MA: MIT Press; 2003.
- 5. Lee C-C, Jhang Y, Relyea G, Chen L-M, Oller DK. Babbling development as seen in canonical babbling ratios: A naturalistic evaluation of all-day recordings. Infant Behav Dev. 2018;50:140–53. pmid:29289753
- 6. Gros‐Louis J, West MJ, King AP. Maternal responsiveness and the development of directed vocalizing in social interactions. Infancy. 2014;19(4):385–408.
- 7. Iyer SN, Denson H, Lazar N, Oller DK. Volubility of the human infant: Effects of parental interaction (or lack of it). Clin Linguist Phonetics. 2016;30(6):470–788.
- 8. Goldstein MH, Schwade JA. Social feedback to infants’ babbling facilitates rapid phonological learning. Psychol Sci. 2008 May 1;19(5):515–23. pmid:18466414
- 9. Bloom K, Russell A, Wassenberg K. Turn taking affects the quality of infant vocalizations. J Child Lang. 1987;14(2):211–27. pmid:3611239
- 10. Hsu HC, Fogel A. Infant vocal development in a dynamic mother-infant communication system. Infancy. 2001;2(1):87–109.
- 11. Goldstein MH, Schwade JA, Bornstein MH. The value of vocalizing: Five-month-old infants associate their own noncry vocalizations with responses from caregivers. Child Dev. 2009;80(3):636–44. pmid:19489893
- 12. Gratier M, Devouche E, Guellai B, Infanti R, Yilmaz E, Parlato-Oliveira E. Early development of turn-taking in vocal interaction between mothers and infants. Front Psychol. 2015;6(September):1–10.
- 13. Bloom K, Esposito A. Social conditioning and its proper control procedures. J Exp Child Psychol. 1975;19(2):209–22. pmid:1151281
- 14.
Trevarthen C. Communication and cooperation in early infancy: A description of primary intersubjectivity. In: Bullowa M, editor. Before speech: The beginning of interpersonal communication. London, UK: Cambridge University; 1979. p. 321–47.
- 15.
Trevarthen C. The concept and foundations of infant intersubjectivity. In: Bråten S, editor. Intersubjective Communication and Emotion in Early Ontogeny. Cambridge University; 1998. p. 15–46.
- 16. Crown CL, Feldstein S, Jasnow MD, Beebe B, Jaffe J. The cross-modal coordination of interpersonal timing: Six-week-olds infants’ gaze with adults’ vocal behavior. J Psycholinguist Res. 2002;31(1):1–23. pmid:11924837
- 17. Jaffe J, Beebe B, Feldstein S, Crown CL, Jasnow MD. Rhythms of dialogue in infancy: coordinated timing in development. Monogr Soc Res Child Dev. 2001;66(2):i–viii, 1–132. pmid:11428150
- 18. Roseberry S, Hirsh-Pasek K, Golinkoff RM. Skype me! Socially contingent interactions help toddlers learn language. Child Dev. 2014;85(3):956–70. pmid:24112079
- 19. Golinkoff RM, Can DD, Soderstrom M, Hirsh-Pasek K. (Baby) Talk to me: The social context of infant-directed speech and its effects on early language acquisition. Curr Dir Psychol Sci. 2015;24(5):339–44.
- 20. Ramírez-Esparza N, García-Sierra A, Kuhl PK. Look who’s talking: speech style and social context in language input to infants are linked to concurrent and future speech development. Dev Sci. 2014 Nov 1;17(6):880–91. pmid:24702819
- 21. Ainsworth MD. Object relations, dependency, and attachment: A theoretical review of the infant-mother relationship. Child Dev. 1969;969–1025. pmid:5360395
- 22.
Bowlby J. Attachment and loss. Vol. 1. New York, NY: Basic Books; 1969.
- 23. Pipp S, Harmon RJ. Attachment as regulation: A commentary. Child Dev. 1987;58(3):648–52.
- 24. Schore AN. Effects of a secure attachment relationship on right brain development, affect regulation, and infant mental health. Infant Ment Health J. 2001;22(1–2):7–66.
- 25. Yoo H, Bowman DD, Oller DK. The origin of protoconversation: An examination of caregiver responses to cry and speech-like vocalizations. Front Psychol. 2018 Aug 24;9:1510. pmid:30197615
- 26. Dominguez S, Devouche E, Apter G, Gratier M. The roots of turn-taking in the neonatal period. Infant Child Dev. 2016;25(3):240–55.
- 27. Gratier M, Devouche E. Imitation and Repetition of Prosodic Contour in Vocal Interaction at 3 Months. Dev Psychol. 2011;47(1):67–76. pmid:21244150
- 28. Tronick EZ, Als H, Adamson LB, Wise S, Brazelton TB. The infant’s response to entrapment between contradictory messages in face-to-face interaction. J Am Acad Child Psychiatry. 1978;17(1):1–13. pmid:632477
- 29. Goldstein MH, King AP, West MJ. Social interaction shapes babbling: Testing parallels between birdsong and speech. Proc Natl Acad Sci USA. 2003 Jun;100(13):8030–5. pmid:12808137
- 30. Franklin B, Warlaumont AS, Messinger D, Bene E, Nathani Iyer S, Lee C-C, et al. Effects of parental interaction on infant vocalization rate, variability and vocal type. Lang Learn Dev. 2013;10(3):279–96.
- 31. Abney DH, Warlaumont AS, Oller DK, Wallot S, Kello CT. Multiple coordination patterns in infant and adult vocalization. Infancy. 2017;22(4):514–39. pmid:29375276
- 32. Hsu HC, Fogel A. Social regulatory effects of infant nondistress vocalization on maternal behavior. Dev Psychol. 2003;39(6):976. pmid:14584979
- 33. Warlaumont AS, Richards JA, Gilkerson J, Oller DK. A social feedback loop for speech development and its reduction in autism. Psychol Sci. 2014;25:1314–24. pmid:24840717
- 34. Winnicott DW. The theory of the parent-infant relationship. Int J Psychoanal. 1960;41:585–95. pmid:13785877
- 35. Oller DK, Eilers RE. The role of audition in infant babbling. Child Dev. 1988;59(2):441–9. pmid:3359864
- 36.
Piaget J. Play, dreams and imitation in childhood. W. W. Norton & Co; 1952.
- 37.
Piaget J. The second stage: The first acquired adaptations and the primary circular reaction. In: Piaget J, Cook M, editors. The origins of intelligence in children. W. W. Norton & Co; 1952. p. 47–143.
- 38. Grossberg S, Vladusich T. How do children learn to follow gaze, share joint attention, imitate their teachers, and use tools during social interactions? Neural Networks. 2010 Oct;23(8–9):940–65. pmid:20817477
- 39. Vauclair J, Bard KA. Development of manipulations with objects in ape and human infants. J Hum Evol. 1983;12(7):631–45.
- 40.
Caligiore D, Ferrauto T, Parisi D, Accornero N, Capozza M, Baldassarre G. Using motor babbling and Hebb rules for modeling the development of reaching with obstacles and grasping. In: International Conference on Cognitive Systems. 2008. p. E1-8.
- 41.
Sheya A, Smith LB. Development through Sensorimotor Coordination. In: Stewart J, Gapenne O, Di Paolo EA, editors. Enaction: Toward a new paradigm for cognitive science. MIT Press; 2013. p. 123–43.
- 42. Pedersen FA, Rubenstein JL, Yarrow LJ. Infant development in father-absent families. J Genet Psychol. 1979;135(1):51–61.
- 43. Stark RE. Infant vocalization: A comprehensive view. Infant Ment Health J. 1981;2(2):118–28.
- 44.
Skinner BF. Verbal behavior. New York, NY: Appleton-Century-Crofts, Inc.; 1957.
- 45. Watson JB. Psychology as the behaviorist views it. Psychol Rev. 1913;20(2):158–77.
- 46.
Davis K, Panksepp J. The emotional foundations of personality: A neurobiological and evolutionary approach. W.W. Norton & Company; 2018.
- 47. Panksepp J. Toward a general psychobiological theory of emotions. Behav Brain Sci. 1982 Sep 4;5(3):407–22.
- 48. Panksepp J. Toward a cross-species neuroscientific understanding of the affective mind: Do animals have emotional feelings? Vol. 73, American Journal of Primatology. 2011. p. 545–61. pmid:21319205
- 49.
Panksepp J, Biven L. The archaeology of mind: Neuroevolutionary origins of human emotions. W.V. Norton & Company; 2012.
- 50. Moulin-Frier C, Nguyen SM, Oudeyer PY. Self-organization of early vocal development in infants and machines: The role of intrinsic motivation. Front Psychol. 2014;4:1006. pmid:24474941
- 51. Oller DK, Griebel U, Iyer SN, Jhang Y, Warlaumont AS, Dale R, et al. Language origins viewed in spontaneous and interactive vocal rates of human and bonobo infants. Front Psychol. 2019;10:729. pmid:31001176
- 52.
Moulin-Frier C, Oudeyer PY. The role of intrinsic motivations in learning sensorimotor vocal mappings: A developmental robotics study. In: INTERSPEECH, ISCA. Lyon, France; 2013.
- 53. Oller DK, Buder EH, Ramsdell HL, Warlaumont AS, Chorna LB, Bakeman R. Functional flexibility of infant vocalization and the emergence of language. Proc Natl Acad Sci. 2013;110(16):6318–23. pmid:23550164
- 54. Harold MP, Barlow SM. Effects of environmental stimulation on infant vocalizations and orofacial dynamics at the onset of canonical babbling. Infant Behav Dev. 2013;36(1):84–93. pmid:23261792
- 55. Oller DK, Caskey M, Yoo H, Bene ER, Jhang Y, Lee C-C, et al. Preterm and full term infant vocalization and the origin of language. Sci Rep. 2019;9:14734. pmid:31611607
- 56. Long HL, Oller DK, Ramsdell-Hudock HL, Bene E. Imitative and vocally adaptive behaviors in infants through twelve months. Annu Meet Am Speech-Language Hear Assoc. 2016;
- 57.
Buder E, Warlaumont AS, Oller DK, Chorna LB. Dynamic indicators of mother-infant prosodic and illocutionary coordination. In: Speech Prosody 2010-Fifth International Conference. 2010. p. 6–9.
- 58. Warlaumont AS, Oller DK, Dale R, Richards JA, Gilkerson J, Xu D. Vocal interaction dynamics of children with and without autism. In: Proceedings of the Annual Meeting of the Cognitive Science Society. 2010. p. 121–6.
- 59.
Delgado RE, Buder EH, Oller DK. AACT (Action Analysis Coding and Training). Miami, FL: Intelligent Hearing Systems; 2010.
- 60. Jhang Y, Franklin B, Ramsdell-Hudock HL, Oller DK. Differing roles of the face and voice in early human communication: Roots of language in multimodal expression. Front Commun. 2017/09/15. 2017;2(10):10.
- 61.
Milenkovic P. TF32 [Computer software]. Madison, WI: University of Wisconsin- Madison; 2001.
- 62.
Austin JL. How to do things with words. Oxford, UK: Oxford University Press; 1962.
- 63. Oller DK, Griebel U, Warlaumont AS. Vocal development as a guide to modeling the evolution of language. Gray W, Oller DK, Dale R, Griebel U, editors. Top Cogn Sci. 2016;8(2):382–92. pmid:26932662
- 64.
Searle JR. Speech acts: An essay in the philosophy of language. Vol. 626. Cambridge University; 1969.
- 65. Jhang Y, Oller DK. Emergence of functional flexibility in infant vocalizations of the first 3 months. Front Psychol. 2017;8.
- 66. Oller DK, Wieman LA, Doyle J, Ross C. Infant babbling and speech. J Child Lang. 1976;3:1–11.
- 67. Liang K-Y, Zeger SL. Longitudinal data analysis using generalized linear models. Biometrika. 1986;73(1):13–22.
- 68. Zimmerman FJ, Gilkerson J, Richards JA, Christakis DA, Xu D, Gray S, et al. Teaching by listening: The importance of adult-child conversations to language development. Pediatrics. 2009;124:342–9. pmid:19564318
- 69. Long HL, Oller DK, Bowman DD. Reliability of listener judgments of infant vocal imitation. Front Psychol. 2019 Jun 11;10:1340. pmid:31244735
- 70.
Bornstein MH. Infant into conversant: Language and nonlanguage processes in developing early communication. In: Budwig N, Užgiris IČ, Wertsch J V., editors. Communication: An Arena of Development. Santa Barbara, CA: Greenwood Publishing Group; 2000. p. 109–29.
- 71. Locke JL. Parental selection of vocal behavior: Crying, cooing, babbling, and the evolution of language. Hum Nat. 2006;17:155–68. pmid:26181412
- 72. Locke JL. Evolutionary developmental linguistics: Naturalization of the faculty of language. Lang Sci. 2009;31:33–59.
- 73.
Oller DK, Griebel U. Contextual freedom in human infant vocalization and the evolution of language. In: Burgess RL, MacDonald K, editors. Evolutionary Perspectives on Human Development. Thousand Oaks, CA: SAGE Publications; 2005. p. 135–66.
- 74. Gottlieb G. Developmental-behavioral initiation of evolutionary change. Psychol Rev. 2002;109(2):211. pmid:11990317
- 75.
Kirschner M, Gerhart J. The plausibility of life: Resolving Darwin’s dilemma. Yale University; 2006.
- 76. Locke JL, Bogin B. Language and life history: A new perspective on the development and evolution of human language. Behav Brain Sci. 2006;29:259–325. pmid:17214017
- 77. Washburn SL. Tools and human evolution. Sci Am. 1960;203(3):62–75.
- 78. Gruss LT, Schmitt D. The evolution of the human pelvis: Changing adaptations to bipedalism, obstetrics and thermoregulation. Philos Trans R Soc B Biol Sci. 2015;370(1663):20140063.
- 79. Wells JCK, DeSilva JM, Stock JT. The obstetric dilemma: An ancient game of Russian roulette, or a variable dilemma sensitive to ecology? Am J Phys Anthropol. 2012;149:40–71. pmid:23138755
- 80.
Bekoff M, Byers J. Animal play: Evolutionary, comparative, and ecological perspectives. Vol. 36. Cambridge University; 1998.
- 81. Lafreniere P. Evolutionary functions of social play: Life histories, sex differences, and emotion regulation. Am J Play. 2011;3(4):464–88.