There is increasing evidence that variation in the promoter region of the serotonin transporter gene SLC6A4 (i.e., the 5-HTTLPR polymorphism) moderates the impact of environmental stressors on child psychopathology. Emotional reactivity −the intensity of an individual’s response to other’s emotions− has been put forward as a possible mechanism underlying these gene-by-environment interactions (i.e., G×E). Compared to children homozygous for the L-allele (LL-genotypes), children carrying an S-allele (SS/SL-genotypes), specifically when they have been frequently exposed to negative emotions in the family environment, might be more emotionally reactive and therefore more susceptible to affective environmental stressors. However, the association between 5-HTTLPR and emotional reactivity in children has not yet been empirically tested. Therefore, the goal of this study was to test this association in a large-scale experiment.
Children (N = 521, 52.5% boys, Mage = 9.72 years) were genotyped and randomly assigned to happy, angry or neutral dynamic facial expressions and vocalizations. Motor and affective emotional reactivity were assessed through children’s self-reported negative and positive affect (n = 460) and facial electromyography activity (i.e., fEMG: the zygomaticus or “smile” muscle and the corrugator or “frown” muscle, n = 403). Parents reported on their negative and positive parenting behaviors.
Children mimicked and experienced the emotion they were exposed to. However, neither motor reactivity nor affective reactivity to these emotions depended on children’s 5-HTTLPR genotype: SS/SL-genotypes did not manifest any stronger response to emotional stimuli than LL-genotypes. This finding remained the same when taking the broader family environment into account, controlling for kinship, age, gender and genetic ancestry, and when including a tri-allelic factor.
We found no evidence for an association between the 5-HTTLPR polymorphism and children’s emotional reactivity. This finding is important, in discounting one potential underlying endophenotype of G×E between the 5-HTTLPR and affective environmental stressors.
Citation: Weeland J, Slagt M, Brummelman E, Matthys W, de Castro BO, Overbeek G (2015) 5-HTTLPR Expression Outside the Skin: An Experimental Test of the Emotional Reactivity Hypothesis in Children. PLoS ONE 10(11): e0141474. doi:10.1371/journal.pone.0141474
Editor: Robert M. Lafrenie, Sudbury Regional Hospital, CANADA
Received: June 7, 2015; Accepted: October 7, 2015; Published: November 11, 2015
Copyright: © 2015 Weeland et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by VIDI grant 452-10-005 of the Netherlands Organization for Scientific Research (http://www.nwo.nl/) (to GO), and the Department of Psychology committee of appliances, Utrecht University (JW). This study was hosted by Science Centre NEMO in Amsterdam (http://www.sciencelive.nl/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
When faced with adversity, some children seem particularly vulnerable to develop psychopathology, whereas others seem resilient and show more favorable developmental outcomes. Variability in the promoter region of the serotonin transporter gene SLC6A4 or 5-HTT (i.e., 5-HTTLPR polymorphism) has been shown to influence the strength of the relationship between environmental adversity and child internalizing and externalizing psychopathology (for an overview see Van IJzendoorn, Belsky, & Bakermans-Kranenburg ). However, findings on these gene-by-environment interactions (i.e., G×E) have been mixed. It has been difficult to reliably replicate earlier findings [2–5], and we know little about how these interactions work (i.e., the underlying mechanisms or “how genes get outside the skin”). Emotional reactivity has been put forward as a possible explaining mechanism of the interplay between, specifically, affective environmental risk factors (e.g., angry, harsh parenting, parental martial conflict) and the 5-HTTLPR [6, 7]. However, the association between 5-HTTLPR and emotional reactivity has not been empirically tested in children. Moreover, what we know mostly stems from correlational studies, which have their limitations. In a large scale experiment we therefore tested the association between 5-HTTLPR and children’s motor (i.e., facial electromyography) and affective (i.e., child self-report) emotional reactivity.
The emotional reactivity hypothesis
Emotional reactivity refers to the form and intensity of an individual’s motor, affective, and sensory response to emotions , or in other words, how (strongly) people react to other’s emotions. Emotions are key elements of children’s environment, specifically of parenting, and in turn predictors of their development [9, 10]. Compared to less reactive children, highly reactive children are more likely to respond intensely to an angry or irritated parent [11, 12]: They may more strongly mimic the shown facial expressions (i.e., motor reaction) and experience anger or irritability (i.e., affective reaction). Heightened emotional reactivity (i.e., angry reactivity and irritability) is an important symptom of both Oppositional Defiant Disorder and Child Depression , suggesting that it might be an endophenotype underlying both childhood externalizing and internalizing psychopathology. Indeed, individual differences in reactivity to emotional stimuli have been related to both internalizing and externalizing psychopathology [14, 15]. Hence, highly reactive children might be at increased risk for developing psychopathology, when exposed to highly negative emotions.
Individual differences in the processing of emotional stimuli have been associated with variation in availability of the neurotransmitter serotonin, an important modulator of neural circuitry controlling mood . The 5-HTTLPR polymorphism is a key regulator of this availability . Compared to the high expressing long allele (i.e., L-allele), the low expressing short allele (i.e., S-allele) of this polymorphism has been associated with significantly lower 5-HTT mRNA and protein, lower uptake, and consequently higher and less stable concentrations of serotonin in the synaptic cleft [18, 19] (but see Naylor et al. ). Such high and unstable serotonin concentrations might contribute to higher neural reactivity and more intense and prolonged arousal, when people are exposed to emotions . This is illustrated by findings showing that, compared to people homozygous for the L-allele (i.e., LL-genotypes) people carrying at least one S-allele (i.e., SS/SL-genotypes) show heightened amygdala activity in response to emotional stimuli, presumably indicating higher arousal during emotion processing [22, 23]. The 5-HTTLPR S-allele might thus predispose people to heightened emotional reactivity.
Although we know little about how such neurological arousal is related to the actual experience of emotions and how it eventually “translates” into behavior, previous studies on adults do suggest that S-allele carriers show heightened motor, physiological and affective reactivity after being exposed to an emotional film , maternal expressed emotions , or unsupportive parenting . One possibility therefore is that the neurological arousal after being exposed to other’s emotions indirectly affects behavior via changes in individual’s emotion expression and mood (or affective state) [26–28]. Indeed, previous research indicates that neural and motor reactivity to emotional stimuli are related, and that in turn these reactivity measures might indicate “emotional contagion” [26–28]. Thus, S-allele carriers might be at increased risk for developing psychopathology when exposed to affective environmental stressors because they show heightened reactivity to these stressors. One pioneering study indeed found the joined effect of the 5-HTTLPR and family adversity on externalizing symptoms to be mediated by children’s angry reactivity . However, this study examined angry reactivity in particular rather than emotional reactivity in general. As of yet, there has been no previous research on the association between 5-HTTLPR variability and differences in how strongly children react to other’s emotional expressions with their own emotions.
Underlying endophenotypes such as emotional reactivity are not explained by genetic variation alone. They most likely take the form of entrained bio-psychosocial traits: Partly heritable traits that are shaped by countless interactions with the environment during early development . In turn, these traits can directly contribute to the development of psychopathology, as well as indirectly through the way children react to the environment. In case of emotional reactivity, it seems likely that the 5-HTTLPR interacts with affective environmental stressors, such as family conflict and highly negative or low-supportive parenting, in eventually predicting individual differences. Children’s observations of marital conflict, for example, have been shown to contribute to an increased sensitivity to anger cues . Repeated exposure to such affective environmental stressors (e.g., low supportive or harsh parenting) possibly alters neurophysiological arousal to such emotional stimuli, in some children more than others [31, 32]. Specifically for SS/SL-genotypes, affective environmental stressors might form a cumulative risk factor for heightened reactivity to negative emotions. Thus, SS/SL-genotypes might be especially emotionally reactive when they have experienced highly negative and low-positive parenting in the past. It has been shown that amygdala and hippocampus activation in rest correlates positively with life stress in SS/SL-genotypes, but negatively in LL-genotypes . Thus, for LL-genotypes (but not SS/SL genotypes) such stressors might form a cumulative risk factor for decreased reactivity to negative emotions (i.e., hypo-arousal, ). As a result, LL-genotypes might be especially emotionally unreactive when they have experienced highly negative and low-positive parenting in the past.
In sum, emotional reactivity has been put forward as a possible explaining mechanism of the interplay between, specifically, the 5-HTTLPR and affective environmental risk factors (e.g., angry, harsh parenting, and parental martial conflict) in predicting child psychopathology. By clarifying the underlying mechanisms of G×E we might increase the empirical and clinical value of our knowledge: It may enable us to form specific a priori hypothesis, and specify our research strategies accordingly. Eventually, this might help us to better tailor interventions and increase their effectiveness . However, the association between 5-HTTLPR and emotional reactivity has not been tested empirically in children. Moreover, existing studies on emotional reactivity have been correlational, which do not permit causal inferences. Here, we report a large scale experiment testing the emotional reactivity hypothesis. In addition to enabling causal inferences, experiments have several important advantages over correlational studies. First, by randomizing participants across experimental conditions, they rule out alternative explanations for G×E . For example, genetic factors and environmental factors, such as parenting, might be correlated because children with a specific genetic make-up evoke specific parenting behaviors or emotions (i.e., gene-environment correlation, or rGE). By randomly assigning individuals to conditions, the manipulated variable cannot be related to children’s genetics. Second, experiments prevent the usually highly skewed distributions of environmental risk by manipulating the environmental risk factor (in our case negative emotions). Third, manipulation of the environment creates a standardized, specific and clear environmental stimulus, representing the targeted environmental stressor, and will therefore decrease “noise” in the assessment of G×E and will increase power to detect interactions if present.
The present experiment tested whether SS/SL-genotypes were more emotionally reactive than LL-genotypes, specifically SS/SL-genotypes who were frequently exposed to highly aversive or low supportive emotions in the family environment. Standardized video clips of dynamic facial expressions were used to simulate exposure to other’s emotions. Such emotional stimuli have been successfully used in previous studies to evoke an emotional response and enabling measurement of emotional reactivity [36, 37]. Although previous studies on the 5-HTTLPR have mostly focused on the negative consequences of environmental risk, heightened emotional reactivity may work both ways, as heightened reactivity to both negative (aversive) as well as to positive (supportive) emotions (i.e., for better and for worse ). To be able to test for both dual risk (i.e., for worse) as well as differential susceptibility interactions (i.e., for better and for worse), our experiment contained positive as well as negative emotional stimuli, and assessments of positive as well as negative reactivity . To avoid “carry-over” effects of the different emotions, a between-subjects design was selected. Furthermore, because emotional reactivity is a multi-faceted construct it was measured using a multi-method approach. First, by using, a motor reactivity measure consisting of activity measures of the corrugator supercilii muscle -which frowns the brows- and the zygomaticus major muscle -which pulls up the corners of the mouth- (i.e., facial electromyography activity, or fEMG). Second, by using an affective reactivity measure consisting of child self-reported happiness, anger, sadness, and fear. Both self-report and fEMG have been shown to be valid measures of emotional reactivity in school aged children [39, 40]. However, although part of the same process, such motor and affective reactivity each may play a unique role in the translation of emotional arousal to behavior and are therefore not, or only weakly, related to each other [41, 42].
We expected a main effect of condition (i.e., neutral, happy or anger) on both motor and affective reactivity. Specifically, we expected children exposed to happy emotional expressions and vocalizations to show higher zygomaticus activity (i.e., smile) and report higher positive affect, compared to the anger or neutral condition. Similarly, we expected children exposed to angry facial expressions and vocalization show higher corrugator activity (i.e., frown) and report higher negative affect, compared to the happy or neutral condition. Most importantly, we expected 5-HTTLPR genotype to moderate the condition-effect, with SS/SL-genotypes showing higher motor and affective reactivity than LL-genotypes. In addition, we expected a three-way interaction of condition-×-5-HTTLPR genotype-×-parenting interaction. Here, we expected the condition-effect to be especially strong for SS/SL-genotypes who were exposed to highly negative or low positive parenting in their home situation.
Methods and Materials
Participants were 521 children (52.5% boys) aged 6 to 13 years (M = 9.72; SD = 1.51) and their parents (61.1% mothers; Mage = 42.45; SD = 4.68), recruited in Science Centre NEMO Amsterdam (The Netherlands), as part of Science Live, an innovative research program that enables scientists to carry out research using NEMO visitors as volunteers. Most children (90.0%) were from Dutch ancestry (i.e., parents were born in The Netherlands) and were living with both parents (84.8%). Over half of parents (63.5%) were higher educated (i.e., completed university or higher vocational training), around a third (30.7%) completed lower vocational training and 5.6% completed primary or high school. Overall, parents reported relatively high positive parenting and low negative parenting (see APQ scores beneath).
Procedure and instruments
All children received active informed written parental consent. Only children accompanied by their parent(s) or legal guardian(s) were allowed to participate in the study. Children aged 12 and older also signed an active informed consent form. Based on their ID number children were randomly assigned to one of three experimental conditions (i.e., happy, angry or neutral). To avoid “carry-over” effects of emotions, children were exposed to one of the three emotions only. To put children at ease and to let them get familiar with the computer children first answered some simple questions about age and gender. While children were involved in their assessment parents completed a digital questionnaire on parenting behavior in a separate room. We collected a buccal swab for the purpose of genotyping children. This study and the procedures were approved by the Medical Ethical Board of the Utrecht Medical Center (protocol number 12-634/K).
Children watched four standardized clips −each lasting approximately 400 ms− displaying either happy, angry or neutral facial expressions (Amsterdam Dynamic Facial Expression Set ). The clips showed two Dutch male and two Dutch female models starting with neutral facial expressions, after which they gradually start to express the target emotion while turning towards the viewer. Viewers in previous studies have indicated feeling more involved with this version compared to the face-forward version . The clips were synchronized with nonlinguistic vocalizations of the target emotion that were intense yet natural: Laughing in the happy condition, growling in the angry condition, or clicking of the tongue in the neutral condition.
Motor reactivity: fEMG measure.
During exposure to the stimulus material, bipolar EMG recordings were made from children’s left zygomaticus major and left corrugator supercilii muscles (guidelines by Fridlund and Cacioppo ), using five 2 mm surface Ag/AgCl electrodes filled with conductive paste. Raw EMG recordings were made with a portable digital recorder for preprocessing and storage of physiological data (Vitaport III, TEMEC Instruments B.V., Kerkrade, The Netherlands). Signals were antialiasing filtered using a 512 Hz lowpass filter and were digitized at 1024 Hz.
Affective reactivity: child self-report.
Both before and after exposure to the stimulus material (i.e., baseline and response) children answered questions about their affective state (i.e., mood) using a visualized five-point Likert scale (1 = not at all to 5 = totally, adapted from Reijntjes and colleagues ). All 12 items were formulated the same way (e.g., ‘At this moment I feel angry’) and together formed four scales capturing the basic emotions of anger, fear, sadness, and happiness. Responses were averaged per emotion. Reliability was satisfactory for all emotions (Cronbach α’s between .76 and .85) and did not vary by children’s age. Because of high correlations (r = .61 - .71, see Table 1) between the three negative emotions anger, fear, and sadness, for further analyses, we grouped these emotions together to form a negative affect scale (vs. happiness as positive affect scale). Reliability of the negative affect scale was good (Cronbach α = .89 at baseline and .91 at response).
The Alabama Parenting Questionnaire (APQ ) was used to measure the broader affective family environment (i.e., aversive and supportive parenting). The questionnaire consists of 35 items which make up the scales Involvement (10 items, e.g., ‘You have a friendly talk with your child’), Poor monitoring (10 items, e.g., ‘Your child is out with friends you do not know’), Positive parenting (6 items, e.g., ‘You praise your child if he/she behaves well’), Corporal punishment (3 items, e.g., ‘You slap your child if he/she has done something wrong’), Inconsequent discipline (6 items, e.g., ‘The punishment you give your child depends on your mood’) and Other. Parents filled out how often they use the described practices using a 5-point Likert-scale (1 = never to 5 = always). It has been shown that negative parenting behavior, such as authoritarian and harsh parenting, is related to negative parental affect and expressed emotions, but that sensitive and encouraging parenting is related to positive parental affect and expressed emotions [47–49]. Therefore, to create scales that measure such parenting behavior we combined the scales involvement and positive parenting to create a positive parenting scale and the scales corporal punishment, poor monitoring and inconsequent discipline to create a negative parenting scale (cf. Prevatt ). The APQ ‘other’ scale was not used because of its lack of specificity. Reliability of both scales was good (Cronbach α for positive parenting was .81 and for negative parenting was .76). Overall, parents reported relatively high positive parenting (between 2.63 and 4.88; M = 3.99; SD = .36) and low negative parenting (between 1.06 and 3.00; M = 1.77; SD = .32).
Differential fEMG signals were filtered offline (high-pas 20 Hz, 48dB/octave) and rectified using Brain Vision Analyzer Software (Brain Products GmbH, Munich). Raw fEMG data were segmented into 100 ms epochs. For each clip a baseline (i.e., neutral expression at start) and reaction epoch (i.e., onset of dynamic expression) was selected (cf. Deschamps and colleagues ), resulting in four baseline and four reaction epochs per child. Since we applied this very strict fEMG baseline measure consisting of a baseline epoch of all four clips, conditions did differ on baseline scores of both muscles (ps < .01). These differences can be explained by “carry-over” effects of muscle response to a clip, to the baseline measure of the next clip: Muscle reaction to clip one onto baseline epoch of clip two (etc.). Absolute scores of 3SD above the mean were considered extreme outliers and were removed. Due to technical problems and measurement errors (e.g., equipment failure, “noise” from another room, or children wishing to discontinue the fEMG procedure), fEMG data were missing for 47 children. Children without fEMG data did not differ from children with fEMG data on age, gender, genetic ancestry, 5-HTTLPR genotype, or on parent-reported parenting behavior (ps > .11).
Buccal swabs from children were collected in lysisbuffer (100 mM NaCl, 10 mM EDTA, 10 mM Tris pH 8, 0.1 mg/ml proteinase K and 0.5% w/v SDS) until further processing. Genomic DNA was isolated from the samples using the Chemagic buccal swab kit on a Chemagen Module I workstation (Chemagen Biopolymer-Technologie AG, Baesweiler, Germany). The region of interest from the 5-HTT gene was amplified by PCR using the following primers: a FAM-labelled primer 5’-TCCTCCGCTTTGGCGCCTCTTCC-3’, and a reverse primer 5’-TGGGGGTTGCAGGGGAGATCCTG-3’. Typical PCR reactions contained between 10 and 100 ng genomic DNA templates, 10 pmol of forward and reverse primer. PCR was carried out in the presence of 5% DMSO, 5x buffer supplied with the enzyme and with 1.25U of LongAmp Taq DNA Polymerase (NEB) in a total volume of 30 μl using the following cycling conditions: initial denaturation step of 10 min at 95°C, followed by 26 cycles of 30 sec 95°C, 30 sec 69°C, 60 sec 65°C and a final extension step of 10 min 65°C. After PCR 10 μl of the sample is subjected to restriction digestion with the enzyme HpaII in a total volume of 20 μl. Restriction is incubated for 2 hours at 37°C and inactivated by incubating for 20 min. at 80°C. One microliter of PCR product before and after restriction was mixed separately with 0.3 μl LIZ-500 size standard (Applied Biosystems) and 11.7 μl formamide (Applied Biosystems) and run on an AB 3730 genetic analyser set up for fragment analyses with 50 cm capillaries. Results were analysed using GeneMarker software (Softgenetics).
Saliva of 513 children (36.8% LL-genotypes; 47.4% SL-genotypes; 15.8% SS-genotypes) was successfully genotyped. Hardy-Weinberg equilibrium (HWE) proportions were estimated , and no deviations from these proportions were found (χ2 = 0.04; df = 2; p = .89). For analyses, assuming the S-allele is dominant , the 5-HTTLPR was dummy coded (i.e., SS and SL vs. LL). Possible associations between genotype and mood and possible Gene-Environment correlations (i.e., rGE) were checked. No significant correlations between genotype and parenting or child mood (i.e., pre-test scores) were found (see Table 1).
Chi square and ANOVA tests showed no differences between conditions on children’s age, gender, 5-HTTLPR genotype, genetic ancestry, and child reported emotions at baseline or on parent-reported parenting (ps > .21), indicating successful randomization.
Overall effects of condition stimuli
We examined the effect of experimental condition using MANOVA’s with condition as predictor, controlling for baseline fEMG activity and self-reported affect scores. To control for skewed distributions we used a bootstrapping procedure. As reported by previous studies [41, 42], motor and affective reactivity were not systematically related (small significant correlations were only found between corrugator and anger response (r = .11, p < .05), between zygomaticus and fear response (r = .11, p < .05), and between zygomaticus and anger response (r = .14, p < .01)). Therefore, separate analyses were conducted for motor and affective emotional reactivity. Analyses showed that the condition stimuli has a small but significant effect on both motor (N = 449; Wilks’Lambda = .90, F(4, 886) = 12.55, p < .001, partial η² = .05) and affective reactivity (N = 518; Wilks’Lambda = .93 F(4, 1024) = 9.43, p < .001 partial η² = .04) (see Table 2 for mean differences). As expected, children in the happy condition showed highest zygomaticus activity response (i.e., strongest smile) and highest response score for positive affect (i.e., happiness), but lowest for negative affect (i.e., anger, sadness and fear) of all conditions. Children in the angry condition showed highest corrugator activity response (i.e., strongest frown) and lowest response score for positive affect, but highest for negative affect of all conditions. Overall, these findings showed children’s tendency to mimic and experience the emotion they were exposed to, indicating successful manipulation of emotions. Consistent with previous research , the manipulation evoked stronger motor (but not affective) reactivity in girls (Partial η² = .11), compared to boys (Partial η² = .04) (see under auxiliary analyses and Tables A and B in S1 Table).
Moderation effects of genotype and parenting
We examined the effect of genotype and parenting using MANOVA’s, again controlling for baseline and skewed distributions. To avoid multicollinearity in the interaction analyses, mean-centered scores were computed for positive and negative parenting scales. See the results in Tables 3 and 4. Crucially, the two-way condition×genotype interaction was not significant, indicating there is no direct relation between the 5-HTTLPR and emotional reactivity. Thus, contrary to our hypotheses, the strength of children’s motor and affective reactions to the emotion they were exposed to did not depend on genotype. The three-way condition×genotype×parenting interactions were also not significant, indicating that 5-HTTLPR did not moderate emotional reactivity, regardless of children’s broader affective family environment (i.e., positive and negative parenting).
To address factors possibly confounding the results, we performed four auxiliary analyses. First, to control for possible effects of family-relations between participants (i.e., control for kinship), we randomly included one parent-child dyad per family. Second, to control for possible systematic differences in allele frequencies within subgroups from different genetic ancestry (i.e., population stratification ) we excluded children of whom one or both parents were not born in Europe. Third, assessing genetic variation using a single polymorphism has been criticized. Multiple polymorphisms within a gene might alter gene expression. Specifically, the 5-HTTLR L-allele has an embedded single nucleotide substitution (SNP rs25531) (A>G), which seems to inhibit transcription, creating an allele functionally equivalent to the S-allele . To control for possible effects of this SNP on 5-HTTLPR expression we repeated our analyses using a tri-allelic genetic factor (cf. Braithwaite and colleagues ): low expression: SS, SLG, LGLG (16.40%); medium expression: SLA, LGLA (54.40%); and high expression: LALA (29.20%). Weinberg equilibrium (HWE) proportions were estimated (87.9% AA genotype) , and no deviations from these proportions were found (χ2 = .50; df = 2; p = .78). Fourth, in adults opposing effects have been found regarding the 5-HTTLPR for males and females in the development of internalizing psychopathology. For females, childhood stressors predicted higher depression in S-allele carriers, whereas for males this was in LL-genotypes . It might therefore be that different mechanisms underlie G×E including the 5-HTTLPR in males and females. There are indeed indications that there are gender differences in serotonergic functioning, specifically in central nervous system (CNS) serotonin turnover [56–58]. Also, it might be that there are sensitive periods (i.e., effects of G×E might be stronger in some developmental periods than in others), or even critical periods (i.e., effects of G×E might be only present in certain developmental periods) for specific G×E . To control for possible confounding effects of child gender and age we repeated the analyses including condition×genotype×age and condition×genotype×gender interactions.
In all abovementioned analyses, the condition×genotype and the condition×genotype×parenting interactions remained non-significant, regardless of kinship, genetic ancestry, possible tri-allelic effects, age and gender (Tables A and B in S1 Table). Thus, these analyses too showed that the strength of children’s motor and affective reactivity to the emotion they were exposed to did not depend on their genotype–regardless of whether children’s broader affective family environment (i.e., parenting) was taken into account.
Emotional reactivity has been put forward as a possible mechanism underlying interactions between the 5-HTTLPR polymorphism and affective environmental risk (e.g., angry, harsh parenting) in predicting child psychopathology. If emotional reactivity indeed functions as an explanatory mechanism, it should be directly associated with the 5-HTTLPR polymorphism, specifically in interaction with the broader environment children grow up in. Knowledge on such mechanisms underlying G×E is important to increase the empirical and clinical value of the discoveries made so far [60, 61]. In a large-scale experiment we tested whether children’s motor and affective reactivity to dynamic facial expressions and vocalizations was dependent on their 5-HTTLPR genotype. Results showed that this is not the case: Although children reacted to the happy, angry and neutral stimuli in an emotionally congruent manner, this emotional reactivity was not associated with the 5-HTTLPR polymorphism, regardless of children’s broader affective environment (i.e., positive and negative parenting). This finding did not change controlling for kinship, genetic ancestry, age, gender or including a tri-allelic genetic factor. Together, these findings challenge the hypothesis that emotional reactivity underlies interactions between the 5-HTTLPR polymorphism and affective environmental stressors in predicting child psychopathology.
How do our findings relate to previous research? Although previous studies found S-allele carriers to show heightened neural response to emotional stimuli [23, 24], we did not find these genetic differences to translate to heightened motor or affective reactions in children. Consequently, our findings do not confirm that emotional reactivity, as has been theorized, is indeed an underlying mechanism of previous found G×E including the 5-HTTLPR polymorphism [6, 7]. This contradicts earlier findings, showing that children’s angry reactivity mediated the interaction between 5-HTTLPR and maternal unresponsiveness . One possibility is that emotional reactivity −as we measured it− is simply not a mechanism underlying G×E including the 5-HTTLPR. The 5-HTTLPR has been related to other affective, cognitive and behavioural endophenotypes, besides emotional reactivity, as well [6, 62]. G×E including the 5-HTTLPR might therefore result, not from differences in emotional reactivity, but rather from differences in the ability to regulate emotions evoked by others (e.g., how children reframe or suppress these emotions). Indeed, a recent study found that emotion regulation (i.e., using cognitive reappraisal) served as a buffer in the association between 5-HTTLPR, environmental stressors, and psychopathology . Because the distinction between emotional reactivity, regulation and processing (e.g., cognitive processes) is a difficult one [64, 65], it might be conducive for future research efforts to take into account different emotional processes that are possibly involved in individual differences in psychopathology.
It is important to interpret our present results in light of specific limitations. First, being hosted by a Research Centre −an educative attraction− caused an oversampling of relatively highly educated and well-adjusted families. The range of reported parenting behavior was therefore limited to scores reflecting (sub)optimal behavior. Our results might not be generalizable to the general population. Future research should therefore test these hypotheses in more heterogeneous samples and also in at risk samples. Additionally, to avoid “carry-over” effects from one emotion to another a between subject design was selected. This means our study does not actually measure whether the same children genetically differ in emotional reactivity to both positive and negative emotions (i.e., for better and for worse), but only whether children differ in reactivity to either negative or positive emotions. Furthermore, the emotional reactivity hypothesis is based on differences in serotonin availability, which is influenced by multiple genes but which was measured in this study by 5-HTTLPR variability alone. Including more genetic factors possibly influencing serotonin availability could be an important next step. For example, a serotonergic genetic pathway (i.e., also including genes coding for serotonin synthesis and reuptake, such as TPH1, HTR1A, and HTR2C) could be used as moderator.
Nevertheless, our study design has some important strengths. First of all, our study is part of the growing body of experimental research on G×E (for an overview see Bakermans-Kranenburg and Van IJzendoorn ) providing more robust measures of G×E compared to correlational designs (e.g., ruling out alternative explanations for such an interaction). Second, our large scale genetically informed experiment shows it is possible to manipulate emotions in school-aged children and to measure their emotional reactions through both self-report and fEMG. We used a multi-method multi-informant approach, using both observed motor and self-reported affective reactivity measures. Replicating previous research [26, 67], we found stronger motor (but not affective) reactivity in girls than boys, which might indicate gender differences in emotion processing. Third, our study assessed children’s reactivity to standardized and precise measures of both negative (i.e., anger) and positive (i.e., happiness) affective environmental factors (i.e., for better and for worse). We tested whether children genetically differ in their general emotional reactivity by exposing them to standardized emotional facial expressions, which were directed toward the child, in a controlled laboratory setting rather than in “real life” situations. However, this approach might explain why our findings differ from those of Davies and Cicchetti  (who exposed children to a simulated angry phone conversation between the mother and her intimate partner) and Gyurak and colleagues  (who exposed adults to a clip about the Darfur crisis). These previous studies did not include standardized emotion expressions addressing the child.
Studies on G×E in psychopathology form a fast growing field of research, yielding exciting results on the interplay between genes and environment. However, we have little understanding of how such interactions work. In order for these interactions to have empirical and clinical implications, we need to understand the underlying psycho-biological mechanisms. Our findings showed that one important hypothesis on why children might be more susceptible to environmental stressors did not hold true: Contrary to the emotional reactivity hypothesis, children carrying a SS/SL-genotypes of the 5-HTTLPR were not more emotionally reactive than LL-genotypes. Our findings might indicate that previously found differences between SS/SL- and LL-genotypes in emotion processing do not translate into differences in motor and affective reactivity. Future research should explore whether such processes rather translate into other psycho-biological processes such as emotion regulation or processing. Unravelling mechanisms underlying G×E demands that we report both findings that confirm and findings that falsify our theories or assumptions about specific G×E. Only such transparency can help us gain insight into the validity and specificity of these mechanisms (see also Heininga et al., 2015 on ambivalent G×E findings including the 5-HTTLPR ). However, we must keep in mind that the absence of evidence is not necessarily the evidence of absence. In this regard, it is pivotal to acknowledge that research on the interplay between genetics and the environment is making important (technological) progress. Future studies using epigenetics, haplotypes and the whole genome (i.e., GWAS) might yield more solid results [67–69]. Such strategies might also prove to be powerful designs to further explore the mechanisms of G×E.
To summarize, we conclude that how strongly children react to other’s emotions, with their facial expression and own affect, is neither directly explained by variation in the 5-HTTLPR, nor by a combination of 5-HTTLPR variability and previous interactions with the environment. These findings challenge the emotional reactivity hypothesis.
S1 Dataset. Dataset 5-HTTLR and emotional reactivity.
S1 File. Codebook dataset.
S1 Table. Auxiliary analyses Table A and B.
We thank Prof. Susan Branje, Jolien van der Graaff, Ph.D., and Dennis Schutter, Ph.D. for their help with the collection and processing of the fEMG data. We thank science center NEMO Amsterdam (Science Live) for hosting our study.
Conceived and designed the experiments: JW EB MS WM BO GO. Performed the experiments: JW MS. Analyzed the data: JW. Contributed reagents/materials/analysis tools: JW MS EB. Wrote the paper: JW MS EB WM BO GO.
- 1. Van IJzendoorn M, Belsky J, Bakermans-Kranenburg M. Serotonin transporter genotype 5-HTTLPR as a marker of differential susceptibility: A meta-analyses of child and adolescent gene-by-environment studies. Transl Psychiatry. 2012;2: e147. doi: 10.1038/tp.2012.73. pmid:22872162
- 2. Agnafors S, Comasco E, Bladh M, Sydsjo G, DeKeyser L, Oreland L. et al. Effect of gene, environment and maternal depressive symptoms on pre-adolescence behavior problems-a longitudinal study. Child Adolesc Psychiatry Ment Health. 2013;10: e7. doi: 10.1186/1753-2000-7-10
- 3. Braithwaite EC, Ramchandani PG, O'Connor TG, Van IJzendoorn MH, Bakermans-Kranenburg MJ, Glover V, et al. No moderating effect of 5-HTTLPR on associations between antenatal anxiety and infant behavior. J Am Acad Child Adolesc Psychiatry. 2013;52: 519–526. doi: 10.1016/j.jaac.2013.02.010. pmid:23622853
- 4. Richards JS, Hartman CA, Franke B, Hoekstra PJ, Heslenfeld DJ, Oosterlaan J. Differential susceptibility to maternal expressed emotion in children with ADHD and their siblings? Investigating plasticity genes, prosocial and antisocial behaviour. Eur Child Adolesc Psychiatry. 2015;24: 209–217. doi: 10.1007/s00787-014-0567-2. pmid:24929324
- 5. Heininga VE, Oldehinkel AJ, Veenstra R, Nederhof E. I just ran a thousand analyses: benefits of multiple testing in understanding equivocal evidence on gene-environment interactions.PLoS One. 2015;10(5): e0125383. doi: 10.1371/journal.pone.0125383. pmid:26016887
- 6. Van Goozen SHM, Fairchild G, Snoek H, Harold G. The evidence for a neurobiological model of childhood antisocial behavior. Psychol Bull. 2007;133: 149–182. pmid:17201574 doi: 10.1037/0033-2909.133.1.149
- 7. Davies PT, Cicchetti D. How and why does the 5-HTTLPR gene moderate associations between maternal unresponsiveness and children's disruptive problems? Child Dev. 2014; 85: 484–500. doi: 10.1111/cdev.12148. pmid:24033129
- 8. Rothbart MK, Derryberry D. Development of individual differences in temperament. Adv Dev Psychol. 1981;1: 37–86.
- 9. Teti DM, Cole PM. Parenting at risk: New perspectives, new approaches. J Fam Psychol. 2011;25: 625–634. doi: 10.1037/a0025287. pmid:21875200
- 10. Denham SA, Workman E, Cole PM, Weissbrod C, Kendziora KT, Zahn–Waxler C. Prediction of externalizing behavior problems from early to middle childhood: The role of parental socialization and emotion expression. Dev Psychopathol. 2000;12: 23–45. pmid:10774594 doi: 10.1017/s0954579400001024
- 11. Sonuga‐Barke EJ, Oades RD, Psychogiou L, Chen W, Franke B, Buitelaar J, et al. Dopamine and serotonin transporter genotypes moderate sensitivity to maternal expressed emotion: The case of conduct and emotional problems in attention deficit/hyperactivity disorder. J Child Psychol Psychiatry. 2009;50: 1052–1063. doi: 10.1111/j.1469-7610.2009.02095.x. pmid:19490304
- 12. El-Sheikh M. Parental drinking problems and children's adjustment: Vagal regulation and emotional reactivity as pathways and moderators of risk. J AbPsychol. 2001;110: 499–515. doi: 10.1037//0021-843x.110.4.499
- 13. Stringaris A, Zavos H, Leibenluft E, Maughan B, Eley T. Adolescent irritability: Phenotypic associations and genetic links with depressed mood. Am J Psychiatry. 2012;169: 47–54. doi: 10.1176/appi.ajp.2011.10101549. pmid:22193524
- 14. De Wied M, Van Boxtel A, Zaalberg R, Goudena PP, Matthys W. Facial EMG responses to dynamic emotional facial expressions in boys with disruptive behavior disorders. J Psychiatr Res. 2006;40: 112–121. pmid:16176819 doi: 10.1016/j.jpsychires.2005.08.003
- 15. Sloan DM, Bradley MM, Dimoulas E, Lang PJ. Looking at facial expressions: Dysphoria and facial EMG. Bio Psychol. 2002;60: 79–90. doi: 10.1016/s0301-0511(02)00044-3
- 16. Hariri AR., Drabant EM, Weinberger DR. Imaging genetics: perspectives from studies of genetically driven variation in serotonin function and corticolimbic affective processing. Biol Psychiatry. 2006;59: 888–897. pmid:16442081 doi: 10.1016/j.biopsych.2005.11.005
- 17. Pezawas L, Meyer-Lindenberg A, Drabant M, Verchinski BA, Munoz K E, Kolachana BS, et al. 5-HTTLPR polymorphism impacts human cingulate-amygdala interactions: A genetic susceptibility mechanism for depression. Nat Neurosci. 2005;8: 828–834. pmid:15880108 doi: 10.1038/nn1463
- 18. Lesch K, Bengel D, Heils A, Sabol SZ, Greenberg BD, Petri S et al. Association of anxiety-related traits with a polymorphism in the serotonin transporter gene regulatory region. Science. 1996:274; 1527–1531. pmid:8929413 doi: 10.1126/science.274.5292.1527
- 19. Greenberg BD, Tolliver TJ, Huang SJ, Li Q, Bengel D, Murphy DL. Genetic variation in the serotonin transporter promoter region affects serotonin uptake in human blood platelets. Am J Med Gen. 1999;88: 83–87. doi: 10.1002/(sici)1096-8628(19990205)88:1<83::aid-ajmg15>3.0.co;2-0
- 20. Naylor L, Dean B, Pereira A, Mackinnon A, Kouzmenko A, Copolov D. No association between the serotonin transporter-linked promoter region polymorphism and either schizophrenia or density of the serotonin transporter in human hippocampus. Mol Med. 1998;4: 671–674. pmid:9848084
- 21. Glenn AL. The other allele: Exploring the long allele of the serotonin transporter gene as a potential risk factor for psychopathy: A review of the parallels in findings. Neurosci Biobehav Rev. 2011;35:612–620. doi: 10.1016/j.neubiorev.2010.07.005. pmid:20674598
- 22. Munafò MR, Brown SM, Hariri AR. Serotonin transporter (5-HTTLPR) genotype and amygdala activation: A meta-analysis. Biol Psychiatry. 2008;63: 852–857. pmid:17949693 doi: 10.1016/j.biopsych.2007.08.016
- 23. Murphy SE, Norbury R, Godlewska BR, Cowen PJ, Mannie ZM, Harmer CJ et al. The effect of the serotonin transporter polymorphism (5-HTTLPR) on amygdala function: a meta-analysis. Mol Psychiatry. 2013;18: 512–520. doi: 10.1038/mp.2012.19. pmid:22488255
- 24. Gyurak A, Haase CM, Sze J, Goodkind MS, Coppola G, Lane J, et al. The effect of the serotonin transporter polymorphism (5-HTTLPR) on empathic and self-conscious emotional reactivity. Emotion. 2013;13: 25–35. doi: 10.1037/a0029616. pmid:22906085
- 25. Hankin B, Nederhof E, Oppenheimer C, Jenness J, Young J, Abela J. Differential susceptibility in youth: Evidence that 5-HTTLPR x positive parenting is associated with positive affect ‘for better and worse’. Transl Psychiatr. 2011;1: e44. doi: 10.1038/tp.2011.44
- 26. Wild B, Erb M, Bartels M. Are emotions contagious? Evoked emotions while viewing emotionally expressive faces: quality, quantity, time course and gender differences. Psychiatry Res. 2001;102: 109–124. pmid:11408051 doi: 10.1016/s0165-1781(01)00225-6
- 27. Hess U, Blairy S. Facial mimicry and emotional contagion to dynamic emotional facial expressions and their influence on decoding accuracy. Int J Psychophysiol. 2001;40: 129–141. pmid:11165351 doi: 10.1016/s0167-8760(00)00161-6
- 28. Likowski KU, Mühlberger A, Gerdes AB, Wieser MJ, Pauli P, Weyers P. Facial mimicry and the mirror neuron system: simultaneous acquisition of facial electromyography and functional magnetic resonance imaging. Front Hum Neurosci. 2002;6: e214. doi: 10.3389/fnhum.2012.00214
- 29. Dishion TJ, Patterson GR. Developmental psychopathology. 2nd ed. Cicchetti DD, Cohen DJ, editors. Hoboken, NJ: Wiley; 2006.
- 30. El-Sheikh M, Cummings EM, Reiter S. Preschoolers' responses to ongoing interadult conflict: The role of prior exposure to resolved versus unresolved arguments. J Abnorm Child Psychol. 1996;24: 665–679. pmid:8956090 doi: 10.1007/bf01670106
- 31. Walsh ND, Dalgleish T, Dunn VJ, Abbott R, St Clair MC, Owens M, et al. 5-HTTLPR-environment interplay and its effects on neural reactivity in adolescents. Neuroimage. 2012;24: 665–680. doi: 10.1016/j.neuroimage.2012.07.067
- 32. Wilson KR, Hansen DJ, Li M. The traumatic stress response in child maltreatment and resultant neuropsychological effects. Aggress Violent Behav. 2011;16: 87–97. doi: 10.1016/j.avb.2010.12.007
- 33. Canli T, Lesch KP. Long story short: the serotonin transporter in emotion regulation and social cognition. Nat Neurosci. 2007;10: 1103–1109. pmid:17726476 doi: 10.1038/nn1964
- 34. Matthys W, Vanderschuren LJ, Schutter DJ, Lochman JE. Impaired neurocognitive functions affect social learning processes in oppositional defiant disorder and conduct disorder: Implications for interventions. Clin Child Fam Psychol Rev. 2012;15: 234–246. doi: 10.1007/s10567-012-0118-7. pmid:22790712
- 35. Jaffee SR, Price TS. The implications of genotype–environment correlation for establishing causal processes in psychopathology. Dev Psychopathol. 2012;24: 1253–1264. doi: 10.1017/S0954579412000685. pmid:23062295
- 36. Van Der Schalk J, Hawk ST, Fischer AH, Doosje B. Moving faces, looking places: Validation of the Amsterdam dynamic facial expression set (ADFES). Emotion. 2011;11: 907–920. doi: 10.1037/a0023853. pmid:21859206
- 37. Sato W, Kochiyama T, Yoshikawa S, Naito E, Matsumura M. Enhanced neural activity in response to dynamic facial expressions of emotion: an fMRI study. Cog Brain Res. 2004:20; 81–91. doi: 10.1016/j.cogbrainres.2004.01.008
- 38. Belsky J. Theory testing, effect‐size evaluation, and differential susceptibility to rearing influence: The case of mothering and attachment. Child Dev. 1997;68: 598–600. pmid:9306638 doi: 10.2307/1132110
- 39. Deschamps P, Schutte I, Kenemans J, Matthys W, Schutter D. Electromyographic responses to emotional facial expressions in 6–7year olds: A feasibility study. Int J Psychophysiol. 2012;85: 195–199. doi: 10.1016/j.ijpsycho.2012.05.004. pmid:22634269
- 40. Durbin CE. Validity of young children's self-reports of their emotion in response to structured laboratory tasks. Emotion. 2010;10: 519–535. doi: 10.1037/a0019008. pmid:20677869
- 41. Hubbard JA, Smithmyer CM, Ramsden SR, Parker EH, Flanagan KD, Dearing KF et al. Observational, physiological, and self–report measures of children’s anger: Relations to reactive versus proactive aggression. Child Dev. 2002;73: 1101–1018. pmid:12146736 doi: 10.1111/1467-8624.00460
- 42. Reisenzein R, Studtmann M, Horstmann G. Coherence between emotion and facial expression: Evidence from laboratory experiments. Emotion Rev. 2013:5; 16–23. doi: 10.1177/1754073912457228
- 43. Hawk ST, Fischer AH, Van Kleef GA. Face the noise: Embodied responses to nonverbal vocalizations of discrete emotions. J Pers Soc Psychol. 2012;102: 796–814. doi: 10.1037/a0026234. pmid:22059840
- 44. Fridlund AJ, Cacioppo JT. Guidelines for human electromyographic research. Psychophysiol. 1986;23: 567–589. doi: 10.1111/j.1469-8986.1986.tb00676.x
- 45. Reijntjes A, Thomaes S, Kamphuis JH, Bushman BJ, de Castro BO, Telch MJ. Explaining the paradoxical rejection-aggression link: The mediating effects of hostile intent attributions, anger, and decreases in state self-esteem on peer rejection-induced aggression in youth. Pers Soc Psychol Bull. 2011;37: 955–963. doi: 10.1177/0146167211410247. pmid:21632967
- 46. Shelton KK, Frick PJ, Wootton J. Assessment of parenting practices in families of elementary school-age children. J Clin Child Psychol. 1996;25: 317–329. doi: 10.1207/s15374424jccp2503_8
- 47. Crandall A, Deater-Deckard K, Riley AW. Maternal Emotion and Cognitive Control Capacities and Parenting: A conceptual framework. Dev Rev. 2015;36: 105–126. pmid:26028796 doi: 10.1016/j.dr.2015.01.004
- 48. Dix T. The affective organization of parenting: Adaptive and maladaptative processes. Psychol Bull. 1991;110: 3–25. pmid:1891517 doi: 10.1037//0033-2909.110.1.3
- 49. Duncombe ME, Havighurst SS, Holland KA, Frankling E.J. The contribution of parenting practices and parent emotion factors in children at risk for disruptive behavior disorders. Child Psychiat Hum Dev. 2012;43: 715–733. doi: 10.1007/s10578-012-0290-5
- 50. Prevatt FF. The contribution of parenting practices in a risk and resiliency model of children's adjustment. Br J Dev Psychol. 2003;21: 469–480. doi: 10.1348/026151003322535174
- 51. Rodriguez S, Gaunt TR, Day IN. Hardy-weinberg equilibrium testing of biological ascertainment for mendelian randomization studies. Am J Epidemiol. 2009;69: 505–514. doi: 10.1093/aje/kwn359
- 52. Grossman M, Wood W. Sex differences in intensity of emotional experience: a social role interpretation. J Pers Soc Psychol. 1993:65; 1010–1022. pmid:8246109 doi: 10.1037//0022-3518.104.22.1680
- 53. Manica A, Prugnolle F, Balloux F. Geography is a better determinant of human genetic differentiation than ethnicity. Hum Genet. 2005;118: 366–371. pmid:16189711 doi: 10.1007/s00439-005-0039-3
- 54. Hu X, Lipsky RH, Zhu G, Akhtar LA, Taubman J, Greenberg BD, et al. Serotonin transporter promoter gain-of-function genotypes are linked to obsessive-compulsive disorder. Am J Hum Genet. 2006;78: 815–826. pmid:16642437 doi: 10.1086/503850
- 55. Brummett BH, Boyle SH, Siegler IC, Kuhn C, Ashley-Koch A, Jonassaint CR et al. Effects of environmental stress and gender on associations among symptoms of depression and the serotonin transporter gene linked polymorphic region (5-HTTLPR). Behav Genet. 2008;38: 34–43. pmid:17955359 doi: 10.1007/s10519-007-9172-1
- 56. Williams RB, Marchuk DA, Gadde K, Barefoot JC, Grichnik K, Helms MJ et al. Serotonin-related gene polymorphisms and central nervous system serotonin function. Neuropsychopharmacology. 2003;28: 533–541. pmid:12629534 doi: 10.1038/sj.npp.1300054
- 57. Brummett BH, Muller CL, Collins AL, Boyle SH, Kuhn CM, Siegler IC et al. 5-HTTLPR and gender moderate changes in negative affect responses to tryptophan infusion. Behav Genet. 2008;38: 476–483. doi: 10.1007/s10519-008-9219-y. pmid:18661222
- 58. Cerasa A, Quattrone A, Piras F, Mangone G, Magariello A, Fagioli S et al. 5-HTTLPR, anxiety, and gender interaction moderates right amygdala volume in healthy subjects. Soc Cogn Affect Neurosci. 2013;9: 1537–1545. doi: 10.1093/scan/nst144. pmid:23986266
- 59. Reiss D, Leve LD, Neiderhiser JM. How genes and the social environment moderate each other. A J Pub Health. 2013;103(S1): 111–121. doi: 10.2105/ajph.2013.301408
- 60. Reiss D, Leve LD. Generic expression outside the skin: Clues to mechanisms of genotype×environment interaction. Dev Psychopathol. 2007;19: 1005–1027. pmid:17931431 doi: 10.1017/s0954579407000508
- 61. Dodge KA. Mechanisms of gene-environment interaction effects in the development of conduct disorder. Persp Psychol Sci. 2009;4: 408–414. doi: 10.1111/j.1745-6924.2009.01147.x
- 62. Spoont M. R. Modulatory role of serotonin in neural information processing: implications for human psychopathology. Psychol Bull. 1992;112: 330–350. pmid:1454898 doi: 10.1037//0033-2909.112.2.330
- 63. Ford BQ, Mauss IB, Troy AS, Smolen A, Hankin B. Emotion regulation moderates the risk associated with the 5-HTT gene and stress in children. Emotion. 2014;14: 930–939. doi: 10.1037/a0036835. pmid:24866526
- 64. Gross JJ, Barrett LF. Emotion generation and emotion regulation: One or two depends on your point of view. Emot Rev. 2011;3: 8–16. pmid:21479078 doi: 10.1177/1754073910380974
- 65. Stollstorff M, Munakata Y, Jensen AP, Guild RM, Smolker HR, Devaney JM et al. Individual differences in emotion-cognition interactions: emotional valence interacts with serotonin transporter genotype to influence brain systems involved in emotional reactivity and cognitive control. Front Hum Neurosci. 2013;4: e327. doi: 10.3389/fnhum.2013.00327
- 66. Bakermans-Kranenburg MJ, Van IJzendoorn MH. The hidden efficacy of interventions: Gene× environment experiments from a differential susceptibility perspective. An Rev Psychol. 2015;66: 381–409. doi: 10.1146/annurev-psych-010814-015407
- 67. Beach SR, Brody GH, Todorov AA, Gunter TD, Philibert RA. Methylation at 5HTT mediates the impact of child sex abuse on women's antisocial behavior: an examination of the Iowa adoptee sample. Psychosoc Med. 2011;73: 83–87. doi: 10.1097/psy.0b013e3181fdd074
- 68. Sulik M J, Eisenberg N, Lemery-Chalfant K, Spinrad TL, Silva KM, Eggum ND et al. Interactions between serotonin transporter gene haplotypes and quality of mothers' parenting predict the development of children's noncompliance. Dev Psychol. 2012;48: 740–745. doi: 10.1037/a0025938. pmid:22059451
- 69. Salvatore JE, Aliev F, Bucholz K, Agrawal A, Hesselbrock V, Hesselbrock M et al. Polygenic Risk for Externalizing Disorders Gene-by-Development and Gene-by-Environment Effects in Adolescents and Young Adults. Clin Psychol Sci. 2015;3: 189–201. pmid:25821660 doi: 10.1177/2167702614534211