Approach or avoidance behaviors are accompanied by perceptual vigilance for, affective reactivity to and behavioral predisposition towards rewarding or punitive stimuli, respectively. We detected three subpopulations of C57BL/6J mice that responded with avoiding, balancing or approaching behaviors not induced by any experimental manipulation but spontaneously displayed in an approach/avoidance conflict task. Although the detailed neuronal mechanisms underlying the balancing between approach and avoidance are not fully clarified, there is growing evidence that endocannabinoid system (ECS) plays a critical role in the control of these balancing actions. The sensitivity of dorsal striatal synapses to the activation of cannabinoid CB1 receptors was investigated in the subpopulations of spontaneously avoiding, balancing or approaching mice. Avoiding animals displayed decreased control of CB1 receptors on GABAergic striatal transmission and in parallel increase of behavioral inhibition. Conversely, approaching animals exhibited increased control of CB1 receptors and in parallel increase of explorative behavior. Balancing animals reacted with balanced responses between approach and avoidance patterns. Treating avoiding animals with URB597 (fatty acid amide hydrolase inhibitor) or approaching animals with AM251 (CB1 receptor inverse agonist) reverted their respective behavioral and electrophysiological patterns. Therefore, enhanced or reduced CB1-mediated control on dorsal striatal transmission represents the synaptic hallmark of the approach or avoidance behavior, respectively. Thus, the opposite spontaneous responses to conflicting stimuli are modulated by a different involvement of endocannabinoid signaling of dorsal striatal neurons in the range of temperamental traits related to individual differences.
Citation: Laricchiuta D, Rossi S, Musella A, De Chiara V, Cutuli D, Centonze D, et al. (2012) Differences in Spontaneously Avoiding or Approaching Mice Reflect Differences in CB1-Mediated Signaling of Dorsal Striatal Transmission. PLoS ONE 7(3): e33260. doi:10.1371/journal.pone.0033260
Editor: Marianna Mazza, Catholic University of Sacred Heart of Rome, Italy
Received: December 27, 2011; Accepted: February 6, 2012; Published: March 8, 2012
Copyright: © 2012 Laricchiuta et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This investigation was supported by MIUR (Ministero dell'Istruzione, dell'Università e della Ricerca) grants to LP and DC (www.miur.it). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The super-ordinate division of emotions is distributed along a bipolar dimension of affective valence, from approaching to avoiding stimuli , . In particular, approach and avoidance motivation are defined as the energization of behavior by, or the direction of behavior towards or away from, positive or negative stimuli (objects, events, possibilities), respectively , . Approach and avoidance temperaments are both accompanied by neurobiological sensitivity to, perceptual vigilance for, affective reactivity to stimuli, so that a stimulus positively or negatively evaluated produces motivation and effort to approach or avoid it. Given approach/avoidance discrimination is the primary and most elemental reaction to environmental inputs, all organisms produce constitutionally ingrained approach-avoidance responses , . Approaching or avoiding new situations, objects or foods as well as counterbalancing each other to maintain reactions to unfamiliar stimuli within adaptive boundaries are integral to successful adaptation , . Excessive approaching or avoiding behavior can lead to psychopathological disorders, including depression, anxiety and addiction –.
There is growing evidence that endocannabinoid system (ECS) plays an important role in the balancing control between approach and avoidance both in humans ,  and rodents , , but its detailed action mechanism is not fully clarified. ECS is involved in tuning behaviors mediated by the reward central networks – and in particular in the rewarding properties of palatable foods , . ECS is formed by cannabinoid receptors, their endogenous lipid ligands (endocannabinoids) and the machinery for synthesis and degradation of endocannabinoids . Most central ECS functions are mediated by cannabinoid type-1 receptors (CB1) , , , densely expressed in numerous brain regions, as neocortex, basal ganglia, amygdala, hippocampus, hypothalamus and cerebellum –. CB1 receptors presynaptically inhibit both glutamatergic and GABAergic neurotransmission , , . Such an inhibitory control on different neuronal subtypes would determine the bimodal effects of endocannabinoids on food intake, effects dependent also on their concentration .
In rodents, cocaine-induced conditioned place preference as well as running wheel spontaneous activity or sucrose consumption (manipulations with strong rewarding and reinforcing properties) are associated with hypersensitivity of striatal GABAergic synapses to CB1 receptors stimulation , . These findings raise the intriguing possibility that even spontaneous forms of reward-based behaviors may rely on the sensitization of CB1 receptor-mediated GABAergic transmission in the striatum. The present research was aimed at studying approach/avoidance behaviors related to seeking for a novel palatable food and their electrophysiological neuronal substrates. Given we were searching for individual differences in a spontaneous behavior not induced by any experimental manipulation, the behavior of adolescent mice in a conflict task able to reveal temperamental traits of approach or avoidance was analyzed. Adolescent subjects have been retained the most appropriate sample because they are reported to be statistically over-represented, when compared to adults, in the group showing prominent vulnerability to conflicting situations –. Notably, the individual behavioral differences emergent in adolescence are persistent traits maintained across the life-span, although modulated by environmental experiences , .
In the present study, the spontaneous behavior of mice submitted to an approach/avoidance conflict task and the CB1-mediated transmission in spiny neurons of the dorso-medial striatum, structure crucially involved in motivated and goal-directed behaviors –, were analyzed.
In both S1 and S2, the choices of 206 animals fitted the normal distribution fairly well. When both arms were rewarded with the same standard food (S1), most entries the animals made were in the reassuring black arm (1360 black choices versus 700 white choices out of 2060 total entries). Interestingly, when the aversive white arm was rewarded with the palatable food (S2), the distribution curve shifted towards the white choices (921 white choices out of 2060 total entries) (Fig. 1A). The frequencies of white choices in S1 and S2 showed a highly significant difference between sessions (χ2 = 272.23, P<0.00001).
(A) Curves of distribution of the white and black choices of 206 animals during the sessions. (B) Curve of distribution of the A/A conflict index, considered as the difference (Δ) in the number of white choices between sessions. Entry latencies in the white and black arms of the entire sample of animals (C) and of the avoiding, balancing and approaching animals (D) during sessions, as well as latencies in the ten trials of S1 (E) in the three categories of animals are depicted. Abbreviations: W: white arm; B: black arm; S1: first session; S2: second session; AV: avoiding animals; BA: balancing animals; AP: approaching animals. In C, D, E and in the following figures, data are presented as means ± SEM. Asterisks indicate the significance level of the post hoc comparisons: in (D) AP vs. AV or BA groups: ** P<0.01; in (E) AV vs. AP groups: * P<0.05, *** P<0.0005; AV vs. BA groups: # P<0.05.
Even the A/A conflict index was normally distributed (Fig. 1B) and its bell-shaped curve indicated that in S2 the palatable food, even if placed in the aversive white environment, was salient enough to increase white choices number (mean = Δ+1, SD = ±1.67). Thus, in the presence of conflicting inputs, we identified animals belonging to three behavioral categories, avoiding (AV), balancing (BA) and approaching (AP) animals. BA animals (24% of the sample) reacted with balancing responses between approach and avoidance and their values corresponded to the mean. The two opposite curve tails represented the few subjects exhibiting responses unbalanced towards one of the conflicting inputs: AV animals (5%) whose values were minus two SD of the mean, exhibited avoidance responses to the conflicting stimuli, while AP animals (8%) whose values were plus two SD of the mean, displayed approach responses to the conflicting stimuli. Differences in body weight did not influence the behavioral category animals belonged to (Two-way ANOVA on body weight: category: F2,21 = 0.01, P = 0.98; session: F1,21 = 2.81, P = 0.11; interaction: F2,21 = 1.92, P = 0.17), strongly indicating that the runts of the litter were not the more likely avoiding mice and “king-size” pups were not the more likely approaching animals.
A two-way ANOVA (arm×session) on the entry latencies of the 206 animals failed to indicate significant arm (F1,205 = 0.54, P = 0.46) and session (F1,205 = 3.39, P = 0.07) effects. Also interaction was not significant (F1,205 = 1.75, P = 0.19) (Fig. 1C). When entry latencies were analyzed in relation to the categories the animals belonged to, faceted results were found (Fig. 1D). A three-way ANOVA (category×arm×session) revealed a significant category effect (F2, 21 = 9.18, P = 0.001), while arm (F1,21 = 0.07, P = 0.799) and session (F1, 21 = 1.5, P = 0.23) effects were not significant. First- and second-order interactions were not significant. Post hoc comparisons on category effect revealed significant differences between AP and BA (P = 0.005) or AV (P = 0.002) animals and no difference between AV and BA animals (P = 0.9).
By analyzing the entry latencies regardless arm color or reward in the ten trials of the two sessions, in S1 the three categories of animals started with very similar values, increased throughout the session in AV and BA groups, but not in AP group and reached significant differences in AV animals in the last two trials (Fig. 1E) (Two-way ANOVA: category: F2,21 = 5.73, P = 0.01; trial: F9,189 = 5.5, P<0.00001; interaction: F18,189 = 2.42, P = 0.001). No differences in latency values were found in S2 (Two-way ANOVA: category: F2,21 = 1.85, P = 0.2; trial: F9,189 = 2.93, P = 0.003; interaction: F18,189 = 0.7, P = 0.8).
In the OF, AP animals were more active, rapid and explorative in moving into the environment than BA and AV animals, as revealed by two-way ANOVAs (category×session) on OF explorative parameters (total distance: category: F2,21 = 15.47, P = 0.0001; session: F1,21 = 4.84, P = 0.04; interaction: F2,21 = 9.25, P = 0.0013; peripheral distance: category (F2,21 = 4.97, P = 0.02; session (F1,21 = 398.76, P<0.00001; interaction (F2,21 = 4.90, P = 0.02). Furthermore, the AP animals were more active than BA and AV animals in contacting the object, as revealed by one-way ANOVA on contact time (F2,21 = 19.99, P = 0.00001). One-way ANOVA on contact latency did not reveal significant differences among animals (F2,21 = 1.77, P = 0.2). Post hoc comparisons are reported in Fig. 2A–D.
In S1, AP animals exhibited longer total distances (A) than AV and BA animals. In S2, AP mice spent more time in contacting the object (D), reduced total (A) and peripheral (B) distances. AV and BA animals displayed similar response patterns in almost all OF parameters (A–D). Abbreviations: S1: first session; S2: second session. Asterisks indicate the significance level of the post hoc comparisons between groups: * P<0.05; ** P<0.005; *** P<0.0005.
A positive significant correlation between frequency of white choices in the A/A Y-Maze and contact time of object in the OF was found (r = 0.8, P = 0.001) (Fig. 3).
A positive significant correlation has showed in the scatter plot. Abbreviations: AV: avoiding animals; BA: balancing animals; AP: approaching animals.
Striatal neurons recorded from AV, BA and AP animals displayed remarkably different responses to the stimulation of CB1 receptors (Fig. 4). In fact, bath application of the CB1 receptor agonist HU210 (10 min) caused a significant inhibition of sIPSCs frequency only in neurons from the BA animals (paired Student's t-test: P<0.05, n = 18, compared with pre-HU210 values) and AP animals (paired Student's t-test: P<0.05, n = 11, compared with pre-HU210 values), while it did not cause any effect in neurons from the AV group (paired Student's t-test: P>0.05, n = 12, compared with pre-HU210 values). The effect of HU210 in the three categories of animals was analyzed by one-way ANOVA (F2,38 = 21.5, P<0.0001). Post hoc comparisons showed that HU210 responses of AV animals were significantly different from that showed by AP (P<0.01) and BA animals (P<0.01). Notably, HU210 responses were enhanced in AP when compared to BA animals (P<0.01).
The graph shows that the sIPSC frequency reduction induced by cannabinoid CB1 receptor agonist HU210 in the BA was potentiated in the AP and abolished in neurons from the AV animals. The electrophysiological traces on the bottom are examples of voltage-clamp recordings before and during the application of HU210 in AV, BA, and AP animals.
Furthermore, blockade of CB1 receptors with AM251 bath application (10 min) failed to enhance sIPSC frequency in neurons from the three experimental groups (paired Student's t-test: P>0.05, n = 6, compared to pre-AM251 values for AV, BA, and AP mice), ruling out that a different endocannabinoid tone may account for their different sensitivity to HU210 in these mice.
CB1 receptors also control glutamate transmission in the striatum by a presynaptic mechanism , , . HU210 inhibited glutamate-mediated sEPSC frequency to a similar extent (Fig. 5) (paired Student's t-test: P>0.05 compared with pre-HU210 values) in slices from AV (n = 5), BA (n = 9), and AP (n = 6) animals, indicating that only the sensitivity of CB1 receptors regulating GABA synapses is different in the three experimental groups.
The graph shows that the sEPSC frequency reduction induced by cannabinoid CB1 receptor agonist HU210 was analogous in the AV, BA, and AP animals.
These results, therefore, indicate that enhanced or reduced CB1 receptor control on GABAergic transmission represents the synaptic hallmarks of the approach or avoidance behavior, respectively.
Behavioral effects of drugs acting on ECS
To further analyze ECS functioning in the animals belonging to the extreme AV and AP categories, we tested them under the action of URB597 or AM251 respectively, in the A/A Y-maze and OF tasks. The results obtained from AV animals treated with URB597 or VHL in the re-test session of A/A Y-maze were compared with those they had displayed in the previous S2. AV+URB animals significantly increased the number of white choices, at odds with AV+VHL animals that maintained their avoiding behavior (Fig. 6 A1). Two-way ANOVA (drug×session) on white choices revealed significant drug (F1,8 = 8.89, P = 0.017) and session (F1,8 = 70.53, P = 0.00003) effects. Also the interaction was significant (F1,8 = 16.13, P = 0.003). Notably, this behavior was accompanied by decreased entry latencies, mainly in entering the black arm. A three-way ANOVA (drug×arm×session) on entry latencies revealed not significant main effects (drug: F1,8 = 0.16, P = 0.69; arm: F1,8 = 3.85, P = 0.08; session: F1,8 = 0.15, P = 0.70). The only significant interaction was the first-order interaction drug×arm (F1,8 = 15.12, P = 0.004) (Fig. 6 A2). Even in the OF, the AV+URB animals were more active than AV+VHL animals in exploring the environment and contacting the object (Two-way ANOVAs (drug×session): total distance: drug: F1,8 = 1.28, P = 0.29; session: F1,8 = 22.03, P = 0.0016; interaction: F1,8 = 29.8, P = 0.0006; peripheral distance: drug: F1,8 = 7.24, P = 0.02; session: F1,8 = 121.04, P<0.00001; interaction: F1,8 = 5.49, P = 0.04; One-way ANOVAs: contact latency: drug: F1,8 = 6.07, P = 0.039; contact time: drug: F1,8 = 29.83, P = 0.0006). Post hoc comparisons are reported in Fig. 6, C1–C4.
On the left side, the responses of AV animals treated with URB597 (URB) or vehicle (VHL) in A/A Y-Maze (A1, A2) and OF (C1–C4). AV+URB animals displayed enhancement of white choices and decrease of entry latencies mainly in entering the black arm, while they were more active in exploring the environment and contacting the object in the OF than AV+VHL animals. On the right side, the responses of AP animals treated with AM251 (AM) or vehicle (VHL) in A/A Y-Maze (B1, B2) and OF (D1–D4). AP+AM did not change the number of white choices, decreased entry latencies in the white arm in A/A Y-Maze, while they were less active in exploring the environment and contacting the object in the OF than AP+VHL animals. Abbreviations: W: white arm; B: black arm; S1: first session; S2: second session. Asterisks indicate the significance level of the post hoc comparisons between groups: * P<0.05; ** P<0.005; *** P<0.0005.
Accordingly, the data of AP animals tested under the action of AM251 or VHL in the re-test session of A/A Y-maze were compared with those they had displayed in the previous S2. AP+AM animals did not change their number of white choices (Fig. 6 B1) likely the AP+VHL animals, as revealed by a two-way ANOVA (drug: F1,8 = 0.2, P = 0.66; session: F1,8 = 0.00, P = 1; interaction: F1,8 = 0.57, P = 0.47). This behavior was accompanied by a significant decrease of entry latencies in the white arm (Three-way ANOVA: drug: F1,8 = 0.80, P = 0.39; arm: F1,8 = 14.70, P = 0.004; session: F1,8 = 20.49, P = 0.001; the only significant interaction was arm×session F1,8 = 21.53, P = 0.001) (Fig. 6 B2). In the OF, AP+AM animals were less active than AP+VHL animals in exploring the environment and contacting the object (Two-way ANOVAs (drug×session): total distance: drug: F1,8 = 24.54, P = 0.001; session: F1,8 = 6.48, P = 0.034; interaction: F1,8 = 16.66, P = 0.003; peripheral distance: drug: F1,8 = 9.70, P = 0.01; session: F1,8 = 146.35, P<0.00001; interaction: F1,8 = 5.92, P = 0.04; One-way ANOVAs: contact latency: drug: F1,8 = 0.09, P = 0.77; contact time: drug: F1,8 = 11.07, P = 0.01). Post hoc comparisons are reported in Fig. 6, D1–D4.
As further verification of these effects, we counterbalanced the pharmacological manipulations between categories, by analyzing URB597 effects in five different AP animals as well as AM251 effects in five different AV animals, in A/A Y-maze and OF tasks.
The results obtained from AV animals treated with AM251 or VHL in the re-test session of A/A Y-maze were compared with those they had displayed in the previous S2. AV+AM animals maintained their number of white choices, as AV+VHL animals did (Fig. 7A). This behavior was accompanied by unmodified entry latencies, in entering both arms (Two-way ANOVA (drug×session) on white choices: drug: F1,8 = 0.02, P = 0.88; session: F1,8 = 0.20, P = 0.66; interaction: F1,8 = 1.89, P = 0.20; Three-way ANOVA (drug×arm×session) on entry latencies: drug: F1,8 = 0.12, P = 0.73; arm: F1,8 = 1.39, P = 0.27; session: F1,8 = 0.35, P = 0.56; first- or second-order interactions were all not significant).
On the left side, the responses of AV animals treated with AM251 (AM) or vehicle (VHL) in A/A Y-Maze (A) and OF test (B). In A/A Y-Maze, AV+AM animals maintained the number of white choices and in the OF test they explored the environment and contacted the object not differently than AV+VHL animals. On the right side, the responses of AP animals treated with URB597 (URB) or vehicle (VHL) in A/A Y-Maze (C) and OF test (D). In A/A Y-Maze, AP+URB animals did not change the number of white choices and in the OF test they were active as AP+VHL animals in exploring the environment and contacting the object. Abbreviations: S2: second session; retest: retest session.
In the OF test, AV+AM animals explored the environment not differently from AV+VHL animals and did not modify the contact with the new object (Fig. 7B) (ANOVAs (drug×session): total distance: drug: F1,8 = 0.71, P = 0.42; session: F1,8 = 2.05, P = 0.19; interaction: F1,8 = 0.95, P = 0.36; peripheral distance: drug: F1,8 = 1.17, P = 0.31; session: F1,8 = 210.79, P = 0.00001; interaction: F1,8 = 0.004, P = 0.95; One-way ANOVAs: contact latency: drug: F1,8 = 5.05, P = 0.06; Contact time: drug: F1,8 = 2.28, P = 0.16).
Analogously, the data of AP animals tested under the action of URB597 or VHL in the re-test session of A/A Y-maze were compared with those they had displayed in the previous S2. As AP+VHL animals, AP+URB animals did not significantly change their number of white choices (Two-way ANOVA: drug: F1,8 = 1.66, P = 0.23; session: F1,8 = 0.84, P = 0.38; interaction: F1,8 = 0.84, P = 0.38) (Fig. 7C) and did not modify entry latencies in entering both arms (Three-way ANOVA: drug: F1,8 = 1.01, P = 0.34; arm: F1,8 = 1.77, P = 0.21; session: F1,8 = 0.003, P = 0.95; first- or second-order interactions were not significant).
In the OF test, AP+URB animals were active as AP+VHL animals in exploring the environment and contacting the new object (Fig. 7D) (ANOVAs (drug×session): total distance: drug: F1,8 = 0.15, P = 0.70; session: F1,8 = 36.03, P = 0.0003; interaction: F1,8 = 3.11, P = 0.11; peripheral distance: drug: F1,8 = 0.23, P = 0.64; session: F1,8 = 200.20, P = 0.00001; interaction: F1,8 = 2.08, P = 0.18; One-way ANOVAs: contact latency: drug: F1,8 = 2.49, P = 0.15; contact time: drug: F1,8 = 0.0009, P = 0.97).
Electrophysiological effects of drugs acting on ECS
In line with the behavioral data and with previous findings , the treatment of AV animals with URB597 was able to rescue the sensitivity of striatal GABAergic synapses to HU210 (paired Student's t-test: P<0.05, n = 6 compared with pre-HU210 values). On the other hand, blockade of CB1 receptors with AM251 fully abolished HU210 responses in AP mice (paired Student's t-test: P>0.05, n = 8 compared with pre-HU210 values).
As a further verification of the described effects, we counterbalanced the pharmacological manipulations between categories, by analyzing the effects of URB597 in five different AP animals as well as the effect of AM251 in five different AV animals. Blockade of CB1 receptors with AM251 did not modify HU210 responses of GABAergic striatal neurons in AV mice (paired Student's t-test: P>0.05, n = 5 compared with pre-HU210 values), while the treatment of AP animals with URB597 maintained the high sensitivity of striatal GABAergic synapses to HU210 (paired Student's t-test: P<0.05, n = 6 compared with pre-HU210 values) (Fig. 8).
(A) The graph shows that treatment with URB597 was able to rescue the effect of the CB1 receptor agonist HU210 on sIPSC frequency in neurons from the AV animals. The HU210-induced inhibition of sIPSC frequency in AV+URB animals was comparable to that seen in BA animals. The treatment with the CB1 receptor antagonist AM251 fully abolished HU210 responses in AP mice. (B) The counterbalanced pharmacological manipulations between categories showed that in AV mice blockade of CB1 receptors with AM251 did not modify HU210 responses of GABAergic striatal neurons, while the treatment of AP animals with URB maintained the high sensitivity of striatal GABAergic synapses to HU210. Asterisks indicate the significance level of the comparisons between AV+URB vs. AV+VHL animals and AP+AM vs. AP+VHL animals: * P<0.05.
Anxiety level evaluation
To address whether anxiety might contribute to avoidance and approach patterns, the behaviors exhibited by AP, BA and AV animals (8/category) were evaluated considering parameters more directly linked to anxiety. The OF parameters linked to anxiety were measured in S1 and revealed no difference among categories (Fig. 9A–D) (One-way ANOVAs: central crossings: F2,21 = 0.18, P = 0.83; freezing: F2,21 = 1.97, P = 0.16; defecation boluses: F2,21 = 0.5, P = 0.61). Anyway, the already noted differences among AV, BA and AP animals in parameters related to exploration were again found. In fact, AP animals explored the environment significantly more than the remaining AV and BA animals (One-way ANOVA on total distance: F2,21 = 12.86, P = 0.0002).
Central crossings (A), freezing (B), defecation boluses (C), total distance (D) are depicted. Asterisk indicates the significance level of the post hoc comparisons between groups: ** P<0.01.
In the EPM (Fig. 10), all animals regardless the category they belonged to spent more time in the close arms, exhibiting thus the normal open arm avoidance (Two-way ANOVA: category: F2,21 = 0.73, P = 0.48; arm: F1,21 = 449.22, P<0.00001; interaction: F2,21 = 2.35, P = 0.11). Furthermore, no significant difference in defecation boluses was found among groups (ANOVA: category: F2,21 = 0.28, P = 0.75; arm: F1,21 = 33.71, P<0.00001; interaction: F2,21 = 0.28, P = 0.75).
The present study demonstrates a different control of striatal CB1 receptors on GABAergic neurotransmission in relation to individual differences in the spontaneous response of approach or avoidance to conflicting stimuli and advances a framework for explaining behaviors of approach and avoidance involving the ECS at striatal level.
Approach system is a motivational system activating reward-seeking behavior associated with impulsivity/exploration, while avoidance system is an attentional system promoting inhibition of appetitive responses , . Excessive reactivity of these systems has been related to psychopathological disorders, as attention-deficit/hyperactivity disorders (ADHD) or depression on one hand and anxiety on the other hand , , , . The innovative use of experimental protocols made in the current research allowed analyzing spontaneous motivational components that guide behavioral responses ranging from approaching to avoiding stimuli. In the presence of the same conflicting stimuli, while BA animals reacted with balanced responses between approach and avoidance, AV or AP animals respectively exhibited inhibitory or approach responses towards one of the conflicting inputs.
The behavioral differences observed in AV or AP animals were not linked to different levels of anxiety. Conversely, the behaviors linked to exploration and approach were significantly influenced by the category the mice belonged to. Namely, AP mice in A/A Y-Maze displayed the lowest entry latencies and in the OF traveled the longest distances in the arena, contacted longer the object, demonstrating they were indeed approaching and explorative. Furthermore, in S1 ten trials of A/A Y-Maze test, all animals exhibited similar anxiety levels in the very first trials (the latencies of all animals started with very similar values), AP animals were the only subjects maintaining high reactivity when the trials went by (entry latencies progressively increased only in AV and BA groups), at the end of the task AV animals made evident a behavioral inhibition (in the last two trials their latencies reached values significantly higher).
The relation between reward-seeking behavioral activation and exploration/impulsivity has been also found in previous studies reporting that impulsivity and extraversion , , as well as risk aversion and low motivation ,  are related to each other.
Intriguingly, the individual differences in temperamental traits were reflected in the differences in the CB1-mediated activity of the dorsal striatal network. In fact, CB1-mediated presynaptic control on GABAergic transmission in the dorsal striatal medium spiny neurons was almost absent in AV animals and conversely increased in AP animals. ECS plays a central role in the balancing control between approach and avoidance in both humans ,  and rodents ,  and modulates GABAergic inhibition controlling fine-tuned behaviors . Notably, reward-associated environmental manipulations sensitize CB1-mediated striatal transmission , , while chronic psycho-emotional stress causes marked down-regulation of CB1-controlled GABAergic striatal transmission . Recent neuroimaging findings in healthy human subjects indicate striatal and prefrontal functional differences in reward processing related to differences in approach/avoidance personality traits , . Individual differences on expectation and receipt of reward have been found also in clinical populations, demonstrating abnormal reward processing in psychopathological disorders, as bipolar mania , substance dependence , schizophrenia , , ADHD  and depression . The present experimental findings fully fit with these functional studies.
In the AV animals the enhancement of the endogenous tone of anandamide (AEA) with URB597 increased number of white choices and decreased entry latencies in the A/A Y-maze as well as enhanced explorative behavior and contact times in the OF test. These behavioral responses were consistently paralleled by the rescue of CB1 receptor sensitivity to HU210, indicating that indeed striatal CB1 receptors modulate spontaneous reward-related processes. The intriguing observation that URB597 reinstates “sensitivity” to HU210 in AV mice deserves further discussion. AV mice fail to respond to HU210, suggesting silencing of CB1 receptors. How may the increase in endocannabinoid signaling by blocking AEA degradation reinstate CB1 control on GABAergic transmission? Notably, in the striatum the enhancement of AEA tone with URB597 inhibits sEPSC but not sIPSC frequency  because CB1 receptors controlling glutamate release are the target of AEA, while the other endocannabinoid 2-AG is the preferential endogenous agonist of CB1 receptors controlling GABAergic transmission. In fact, stimulation of 2-AG synthesis with DHPG ,  or following acetylcholine M1 receptor activation  reduces GABAergic but not glutamatergic synaptic events. Thus, in AV animals the AEA increase, caused by URB597, reinstates the control of CB1 receptors on sIPSC frequency to HU210, indicating a complex interaction between the two main endocannabinoids and their receptors.
In AP animals the blockade of CB1 receptors with AM251 reduced contact times and explorative behavior in OF test, although it failed to affect white choice number in A/A Y-maze. Electrophysiological recordings in the same treated animals indicated a fully blocked CB1 receptor activity. Thus, AV or AP animals treated with ECS agonists or antagonists tended to fade away their behavioral features, rendering them less inhibited or less “triggered”, respectively. These findings are fully supported by counterbalancing the pharmacological manipulations in AV or AP animals. In fact, AV mice that had a reduced CB1 control on GABAergic neurotransmission when further inhibited by AM251 did not display any behavioral or electrophysiological modification. In parallel, AP animals that had an enhanced CB1 control on GABAergic neurotransmission when further potentiated by URB597 did not display any behavioral or electrophysiological modification.
ECS functional features and the pharmacological properties of the drugs acting on it provide a possible explanation for the different pharmacological efficacy found in the present research. In fact, endocannabinoids are synthesized and released “on demand” after neuronal depolarization , . Indeed, by presynaptically reducing both excitatory and inhibitory neurotransmission, the ultimate effect of endocannabinoids depends on nature and amount of neurotransmitters being controlled , , , –, . The inhibition of endocannabinoid degradation by URB597 prolongs the neuronal signaling in active synapses only, preserving the spatio-temporal specificity of endocannabinoid activity . Conversely, systemic CB1 receptor blockade by AM251 suppresses both excitatory and inhibitory ECS effects on multiple neuronal populations, explaining thus the different behavioral responses exhibited in the drug presence. Thus, the treatment with URB597 of the “behaviorally inhibited” AV animals enhanced the endocannabinoid tonic control over striatal GABAergic synapses and unhinged the behavioral inhibition featuring these animals. On the converse, the treatment with AM251 of the “explorative/impulsive” AP animals blocked the endocannabinoid tonic control over striatal synapses and prevented the triggered behavior featuring these animals. These findings are fully consistent with the decrease of anxious behaviors, the reduction of isolation-induced ultrasonic vocalizations in pups and the decrease of stress-induced corticosterone release provoked by URB597 injections –. Furthermore, they fit with the increase of the preference for palatable substances produced by administration of exogenous cannabinoids or endocannabinoids –, and with the decrease in palatable food intake produced by treatment with AM251 , , .
The present research demonstrates that in responding to the same conflicting stimuli adolescent inbred mice exhibit variance of spontaneous behavior ranging from avoiding to approaching traits and that this behavioral variance is accompanied by a different CB1-mediated control on striatal neurotransmission. Human and rodent adolescents show a prominent motivation towards reward-responsivity, novelty seeking and impulsivity as well as increased vulnerability to affective illness and addiction , –, –. Moreover, adolescent rats find repeated cannabinoid exposure less aversive than adult rats but exhibit memory deficits and changes in hippocampal protein expression more lasting . Age-dependent differences in the brain levels of endocannabinoids as well as in CB1-mediated effects on synaptic transmission have been described –. However, the features linked to individual behavioral differences present in adolescence appear to be persistent traits maintained across the life-span , .
Interestingly, the individual predisposition to approach or avoidance demonstrated by the present data extends recent findings reporting differences in impulsivity associated with differences in striatum and nucleus accumbens monoamines  in inbred rodents. Phenotypic differences in susceptibility to stress associated with differences in responses to natural and drug rewards were also reported . Because all same-sex members of inbred strains are genetically identical, when animals belonging to same strain are tested under controlled conditions, individual differences among animals have to reflect allelic and functional differences probably modulated by prenatal and postnatal environmental factors or early dominance hierarchies –. Although environmental influences determining the phenotypic variability in inbred subjects are difficult to control and measure, inbred mice raised in rigorously defined environments may show variability in some traits unrelated to genetic and environmental influences . Future studies are needed to delineate the contribution of genetic, epigenetic and environmental variables that may together develop and modulate individual differences.
The behavioral responses to conflicting stimuli mirrored CB1-mediated control on dorsal striatal neuronal transmission. We are aware that the different CB1-mediated control on GABAergic transmission observed in the three behaviorally-characterized groups of animals could be linked to a different sensitivity of the CB1 receptor as an entity, or to differences in the distribution of CB1 receptors or to differences in the amount of CB1 receptors. Distinguishing among the three alternatives requires aimed studies with specific methodological approaches that are in progress. However, this drawback does not weaken the present data since the current findings do evidence that endocannabinoids acting on dorsal striatal neurons influence the spontaneous response to conflicting stimuli and support the involvement of endocannabinoid transmission in approach and avoidance behaviors that often feature not only full-blown psychiatric disorders but also the individual differences in non-pathological temperamental traits.
Materials and Methods
Seven hundred eighty male adolescent (32±2 pnd) C57BL/6JOlaHsd mice (Harlan, Italy) were used. Description of subjects, experimental procedures and global timing of the experimental design are summarized in Fig. S1 and detailed in Materials and Methods S1.
All efforts were made to minimize animal suffering and to reduce their number, in accordance with the European Community Council Directive of 24 November 1986 (86/609/EEC) and approved by the Ethical Committee on animal experiments of Santa Lucia Foundation.
Behavioral Testing: Approach/Avoidance Y-Maze (A/A Y-Maze)
A Plexiglas Y-maze had a starting gray arm from which two arms (8×30×15 cm) stemmed, arranged at an angle of 90° to each other. A T-guillotine door was placed at the end of the starting arm to prevent the animal to be back. An arm entry was defined as four legs entering one of the arms. One of the two arms had black and opaque floor and walls and no light inside, while the other one had white floor and walls and was lighted by a 16-W neon lamp. The colored “furniture” as well as the neon lamp were exchangeable between arms to alternate the spatial position of the white and black arms. The apparatus was placed in a slightly lit room by a red light (40 W) and it was always cleaned thoroughly with 70% ethanol and dried after each trial to remove scent cues. At the end of each arm of choice there was a blue food tray (3 cm in diameter, 1 cm deep). The depth of the tray prevented mice from seeing the reward at a distance but allowed for an easy reward, i.e., eating as well as the appreciation of reward scent, not reducing the olfactory cues.
Since the appetites for palatable foods have to be learned , , a week before behavioral testing the animals were exposed to a novel palatable food (Fonzies, KP Snack Foods, Munchen, Germany) in their home cages for three consecutive days . Fonzies (8% protein, 33% fat and 53% carbohydrate, for a caloric value of 541 kcal/100 gm) consisted of corn flour, hydrogenate vegetable fat, cheese powder and salt.
At the beginning of behavioral testing, mice were subjected to 1-day habituation phase in which all Y-Maze arms were opened to encourage maze exploration. During habituation, no food was present in the apparatus. To increase the motivation to search for the reward, 12 h before exposure to the experimental set-up, the animals were slightly food deprived by limiting the food access to 12 hours/day. Such a regimen resulted in no significant body weight loss. Mean values of weight ranged from 17.63±0.50 to 18.28±0.58 g. Testing phase consisted of two 10-trial sessions with 1 min-inter-trial interval. In the Session 1 (S1), the animal was placed in the
starting arm and could choose to enter one of the two arms, both containing the same standard food reward. At the end of each trial the reward was always replaced. The spatial position of each arm (black and dark or white and lighted) was side balanced during the whole test, to exclude any side preference.
During the Session 2 (S2) starting 24 h after S1, the white arm was rewarded with the highly palatable food (Fonzies), while the black arm was rewarded with the standard food pellet. Notably, this approach/avoidance test required to choose between two conflicting drives, reaching a palatable reward placed in an aversive (white and lighted) environment or reaching a standard food placed in a reassuring (black and dark) environment.
Parameters considered were: white choices, the frequency of entry into the white arm in S1 and S2; A/A conflict index, the difference (Δ) in the number of white choices between S1 and S2; entry latencies exhibited in white and black arms, separately or regardless arm color or reward in each trial of both S1 and S2.
Behavioral Testing: Open Field Test With Novel Object (OF)
To eliminate the “food” and “palatability” dimensions and maintain the conflicting drives given by an appealing new object placed in an anxiogenic central location of a wide arena, OF test was used. The apparatus placed in a dimly lighted (red light 40 W) and soundproof cubicle room consisted of a circular arena (diameter 60 cm) delimited by a pale gray wall 20 cm high. In S1, a single animal was allowed to explore the empty open field and its baseline level of activity was measured. In S2, an object (a gray plastic cone: 10×6 cm; base diameter = 9.5 cm) was put in the arena center. Sessions lasted 10 min and inter-session interval was 5 min. The apparatus and the object were always cleaned thoroughly with 70% ethanol and dried after each session to remove scent cues. The whole testing was recorded by a video camera. The resulting video signal was relayed to a monitor and processed through an image analyzer (Ethovision, Noldus, Wageningen, The Netherlands).
The parameters considered were: total distance (in cm) traveled in the arena; peripheral distance, the percentage of total distance traveled in a 6-cm peripheral annulus; central crossings, number of entries into the 24-cm radius central area; duration of freezing, absence of all movements, (aside from those required for respiration); number of defecation boluses; contact latency with the object; contact time with the object. The contact with object was considered to take place when the mouse's snout actually touched the object, or when it sniffed the object for at least 1 sec.
Behavioral Testing: Elevated Plus Maze (EPM)
EPM that exploits the natural aversion of rodents to heights and unprotected spaces consisted in a maze raised 90 cm above the ground formed by a wooden structure in the shape of a cross with four 30×5 cm arms extending from a central (5×5 cm) region. North and south arms were open, east and west arms were enclosed by 15 cm high walls. EPM behavioral indicators were: time spent in the open and closed arms; number of defecation boluses in the open and closed arms.
Whole-cell patch clamp recordings from single striatal neurons in cortico-striatal coronal slices (200 µm) were performed according to previous studies , , , . To detect spontaneous GABAA-mediated inhibitory postsynaptic currents (sIPSCs), intraelectrode solution had the following composition (mM): CsCl (110), K+-gluconate (30), ethylene glycol-bis (ß-aminoethyl ether)-N,N,N′,N′-tetra-acetic acid (EGTA; 1.1), HEPES (10), CaCl2 (0.1), Mg-ATP (4), Na-GTP (0.3). MK-801 (30 µM) and CNQX (10 µM) were added to the external solution to block, respectively, NMDA and nonNMDA glutamate receptors.
To study spontaneous glutamate-mediated excitatory postsynaptic currents (sEPSCs), the recording pipettes were filled with internal solution of the following composition: (mM) K+-gluconate (125), NaCl (10), CaCl2, (1.0), MgCl2 (2.0), 1,2-bis (2-aminophenoxy) ethane-N,N,N,N-tetraacetic acid (BAPTA; 0.5), N-(2-hydroxyethyl)-piperazine-N-s-ethanesulfonic acid (HEPES; 19), guanosine triphosphate (GTP; 0.3), Mg-adenosine triphosphate (Mg-ATP; 1.0), adjusted to pH 7.3 with KOH. Bicuculline (10 µM) was added to the perfusing solution to block GABAA-mediated transmission. sIPSCs or sEPSCs were stored by using P-CLAMP 9 (Molecular Devices, Foster City, CA, USA) and analyzed off line on a personal computer with Mini Analysis 5.1 (Synaptosoft, Leonia, NJ, USA) software. Offline analysis was carried out on sIPSCs or sEPSCs recorded during fixed times (5–10 samplings of 2–3 min duration each, recorded every 2–3 min). Only cells showing stable frequencies (<20% changes during the control samplings) were taken into account.
HU210 drug used in slices was first dissolved in DMSO, then in the bathing ACSF to the desired final concentration. DMSO alone was used in control experiments. The concentrations (µM) of the various drugs were as follows: AM251 (10), CNQX (10), HU210 (1), MK-801 (30) (Tocris, Bristol, UK), Bicuculline (10) (Sigma-RBI, St Louis, MO, USA).
For electrophysiological data, ‘n’ refers to the number of cells. One to six neurons per animal were recorded. Any electrophysiological measure was obtained by pooling data from at least five animals of each group.
In some cases, animals were intraperitoneally (i.p.) injected with the CB1 receptor antagonist AM251 (6 mg/kg) (AM, Tocris, UK) or with the fatty acid amide hydrolase inhibitor URB597 (0.3 mg/kg) (URB, Alexis, USA). Both drugs were dissolved in a vehicle (VHL), composed by saline with 10% of DMSO and 5% of Tween 80 and administered in an injection volume of 5 ml/kg. Animals used as controls received i.p. the same amount of vehicle. According to their pharmacokinetic properties, drugs were administered 30 min before the behavioral testing , . Drugs were administered at dosages reported in literature , .
Data presented as mean ± SEM (or ± SD) were tested for normality (Will-Shapiro's test) and homoscedasticity (Levene's test). While frequencies of white choices in S1 and S2 were compared by means of χ2 test, the remaining behavioral and electrophysiological data were compared by using analyses of variance (ANOVAs), followed by Tukey's HSD test or paired Student's t-test. Pearson's correlation was run to determine the relationship between white choices in the S2 in A/A Y-Maze and time of contact with the object in OF. The differences were considered significant at the P<0.05 level.
Description of subjects, experimental procedures and global timing of the experimental design are summarized.
Flow diagram of the experimental design. Procedures and global timing are indicated. Out of the 780 adolescent C57BL/6J mice tested in the A/A Y-Maze, 206 animals were used to build the distribution curve of their behavior in response to conflicting stimuli in A/A Y-Maze, while the remaining 574 mice were analyzed for their responses to A/A Y-Maze, Open Field (OF) test and Elevated Plus Maze (EPM). At the end of behavioral testing, Electrophysiological Recordings (ER) were performed from spiny striatal neurons. The behavioral (A/A Y-Maze, OF) and electrophysiological effects of drugs (URB597, URB; AM251, AM) or vehicle (VHL) acting on endocannabinoid system were also analyzed.
The authors wish to thank Prof. Fabio Ferlazzo for his kind and expert support in statistical analyses and Mr. Massimo Tolu for his technical assistance.
Conceived and designed the experiments: DL LP D. Centonze. Performed the experiments: DL AM VDC D. Cutuli. Analyzed the data: DL SR AM VDC. Contributed reagents/materials/analysis tools: DL SR AM VDC D. Cutuli D. Centonze LP. Wrote the paper: DL LP D. Centonze.
- 1. Elliot AJ (2008) Approach and Avoidance Motivation. In: Elliot AJ, editor. Handbook of Approach and Avoidance Motivation. New York: Taylor & Francis Group Psychology Press. pp. 3–14.
- 2. Elliot AJ, Thrash TM (2002) Approach-avoidance motivation in personality: approach and avoidance temperaments and goals. J Pers Soc Psychol 82: 804–818.
- 3. Zajonc RB (1998) Emotion. In: Gilbert D, Fiske S, Lindzey G, editors. The handbook of social psychology. New York: McGraw-Hill. pp. 591–632.
- 4. Tooby J, Cosmides L (1990) The past explains the present: emotional adaptions and the structure of ancestral environments. Ethology and sociobiology 11: 375–424.
- 5. Lafenêtre P, Chaouloff F, Marsicano G (2009) Bidirectional regulation of novelty-induced behavioral inhibition by the endocannabinoid system. Neuropharmacology 57: 715–721.
- 6. Hariri AR (2009) The neurobiology of individual differences in complex behavioral traits. Annu Rev Neurosci 32: 225–247.
- 7. Meyer B, Johnson SL, Carver CS (1999) Exploring behavioral activation and inhibition sensitivities among college students at risk for bipolar spectrum symptomatology. J Psychopathol Behav Assess 21: 275–292.
- 8. Mitchell JT, Nelson-Gray RO (2006) Attention-deficit/hyperactivity disorder symptoms in adults: relationship to Gray's behavioral approach system. Pers Individ Differ 40: 749–760.
- 9. McDonald J, Schleifer L, Richards JB, de Wit H (2003) Effects of THC on behavioral measures of impulsivity in humans. Neuropsychopharmacology 28: 1356–1365.
- 10. Van Laere K, Goffin K, Bormans G, Casteels C, Mortelmans L, et al. (2009) Relationship of type 1 cannabinoid receptor availability in the human brain to novelty-seeking temperament. Arch Gen Psychiatry 66: 196–204.
- 11. Pattij T, Janssen MC, Schepers I, Gonzalez-Cuevas G, De Vries TJ, et al. (2007) Effects of the cannabinoid CB1 receptor antagonist rimonabant on distinct measures of impulsive behavior in rats. Psychopharmacology (Berl) 193: 85–96.
- 12. Kano M, Ohno-Shosaku T, Hashimotodani Y, Uchigashima M, Watanabe M (2009) Endocannabinoid-mediated control of synaptic transmission. Physiol Rev 89: 309–380.
- 13. Maldonado R, Valverde O, Berrendero F (2006) Involvement of the endocannabinoid system in drug addiction. Trends Neurosci 29: 225–232.
- 14. Marsicano G, Lutz B (2006) Neuromodulatory functions of the endocannabinoid system. J Endocrinol Invest 29: 27–46.
- 15. Cota D, Marsicano G, Lutz B, Vicennati V, Stalla GK, et al. (2003) Endogenous cannabinoid system as a modulator of food intake. Int J Obes Relat Metab Disord 27: 289–301.
- 16. Mahler SV, Smith KS, Berridge KC (2007) Endocannabinoid hedonic hotspot for sensory pleasure: anandamide in nucleus accumbens shell enhances ‘liking’ of a sweet reward. Neuropsychopharmacology 32: 2267–2278.
- 17. Piomelli D (2003) The molecular logic of endocannabinoid signalling. Nat Rev Neurosci 4: 873–884.
- 18. Freund TF, Katona I, Piomelli D (2003) Role of endogenous cannabinoids in synaptic signaling. Physiol Rev 83: 1017–1066.
- 19. Herkenham M, Lynn AB, Little MD, Johnson MR, Melvin LS, et al. (1990) Cannabinoid receptor localization in brain. Proc Natl Acad Sci U S A 87: 1932–1936.
- 20. Katona I, Sperlagh B, Sik A, Kafalvi A, Vizi ES, et al. (1999) Presynaptically located CB1 cannabinoid receptors regulate GABA release from axon terminals of specific hippocampal interneurons. J Neurosci 19: 4544–4558.
- 21. Marsicano G, Lutz B (1999) Expression of the cannabinoid receptor CB1 in distinct neuronal subpopulations in the adult mouse forebrain. Eur J Neurosci 11: 4213–4225.
- 22. Matias I, Di Marzo V (2007) Endocannabinoids and the control of energy balance. Trends Endocrinol Metab 18: 27–37.
- 23. Pagotto U, Marsicano G, Cota D, Lutz B, Pasquali R (2006) The emerging role of the endocannabinoid system in endocrine regulation and energy balance. Endocr Rev 27: 73–100.
- 24. Bellocchio L, Lafenêtre P, Cannich A, Cota D, Puente N, et al. (2010) Bimodal control of stimulated food intake by the endocannabinoid system. Nat Neurosci 13: 281–283.
- 25. Centonze D, Rossi S, De Chiara V, Prosperetti C, Battista N, et al. (2007) Chronic cocaine sensitizes striatal GABAergic synapses to the stimulation of cannabinoid CB1 receptors. Eur J Neurosci 25: 1631–1640.
- 26. De Chiara V, Errico F, Musella A, Rossi S, Mataluni G, et al. (2010) Voluntary exercise and sucrose consumption enhance cannabinoid CB1 receptor sensitivity in the striatum. Neuropsychopharmacology 35: 374–387.
- 27. Adriani W, Laviola G (2004) Windows of vulnerability to psychopathology and therapeutic strategy in the adolescent rodent model. Behav Pharmacol 15: 341–352.
- 28. Good RL, Radcliffe RA (2011) Methamphetamine-induced locomotor changes are dependent on age, dose and genotype. Pharmacol Biochem Behav 98: 101–111.
- 29. Hefner K, Holmes A (2007) Ontogeny of fear-, anxiety- and depression-related behavior across adolescence in C57BL/6J mice. Behav Brain Res 176: 210–215.
- 30. Arnett JJ (1999) Adolescent storm and stress, reconsidered. Am Psychol 54: 317–326.
- 31. Spear LP (2002) The adolescent brain and the college drinker: biological basis of propensity to use and misuse alcohol. J Stud Alcohol Suppl 71–81.
- 32. Krishnan V, Han MH, Graham DL, Berton O, Renthal W, et al. (2007) Molecular adaptations underlying susceptibility and resistance to social defeat in brain reward regions. Cell 131: 391–404.
- 33. Roberts BW, Mroczek D (2001) Personality Trait Change in Adulthood. Curr Dir Psychol Sci 17: 31–35.
- 34. Ito R, Dalley JW, Robbins TW, Everitt BJ (2002) Dopamine release in the dorsal striatum during cocaine-seeking behavior under the control of a drug-associated cue. J Neurosci 22: 6247–6253.
- 35. Koob GF, Volkow ND (2010) Neurocircuitry of addiction. Neuropsychopharmacology 35: 217–238.
- 36. Palmiter RD (2008) Dopamine signaling in the dorsal striatum is essential for motivated behaviors: lessons from dopamine-deficient mice. Ann N Y Acad Sci 1129: 35–46.
- 37. Yin HH, Ostlund SB, Knowlton BJ, Balleine BW (2005) The role of the dorsomedial striatum in instrumental conditioning. Eur J Neurosci 22: 513–523.
- 38. Rossi S, De Chiara V, Musella A, Kusayanagi H, Mataluni G, et al. (2008) Chronic psychoemotional stress impairs cannabinoid-receptor-mediated control of GABA transmission in the striatum. J Neurosci 28: 7284–7292.
- 39. Rossi S, De Chiara V, Musella A, Sacchetti L, Cantarella C, et al. (2010) Preservation of striatal cannabinoid CB1 receptor function correlates with the antianxiety effects of fatty acid amide hydrolase inhibition. Mol Pharmacol 78: 260–268.
- 40. McNaughton N, Gray JA (2000) Anxiolytic action on the behavioural inhibition system implies multiple types of arousal contribute to anxiety. J Affect Disord 61: 161–176.
- 41. Pickering AD, Gray JA (2001) Dopamine, appetitive reinforcement, and the neuropsychology of human learning: an individual differences approach. In: Angleitner A, editor. Advances in Individual Differences Research. Lengerich, Germany: PABST Science Publishers. pp. 113–149.
- 42. Kasch KL, Rottenberg J, Arnow BA, Gotlib IH (2002) Behavioral activation and inhibition systems and the severity and course of depression. J Abnorm Psychol 111: 589–597.
- 43. Muris P, Merckelbach H, Schmidt H, Gadet BB, Bogie N (2001) Anxiety and depression as correlates of self-reported behavioural inhibition in normal adolescents. Behav Res Ther 39: 1051–1061.
- 44. Cohen MX, Young J, Baek JM, Kessler C, Ranganath C (2005) Individual differences in extraversion and dopamine genetics predict neural reward responses. Brain Res Cogn Brain Res 25: 851–861.
- 45. Martin LE, Potts GF (2004) Reward sensitivity in impulsivity. Neuroreport 15: 1519–1522.
- 46. Mizuno K, Tanaka M, Ishii A, Tanabe HC, Onoe H, et al. (2008) The neural basis of academic achievement motivation. Neuroimage 42: 369–378.
- 47. Tobler PN, O'Doherty JP, Dolan RJ, Schultz W (2007) Reward value coding distinct from risk attitude-related uncertainty coding in human reward systems. J Neurophysiol 97: 1621–1632.
- 48. Maccarrone M, Finazzi-Agrò A (2002) Endocannabinoids and their actions. Vitam Horm 65: 225–255.
- 49. O'Gorman RL, Kumari V, Williams SC, Zelaya FO, Connor SE, et al. (2006) Personality factors correlate with regional cerebral perfusion. Neuroimage 31: 489–495.
- 50. Simon JJ, Walther S, Fiebach CJ, Friederich HC, Stippich C, et al. (2010) Neural reward processing is modulated by approach- and avoidance-related personality traits. Neuroimage 49: 1868–1874.
- 51. Abler B, Greenhouse I, Ongur D, Walter H, Heckers S (2008) Abnormal reward system activation in mania. Neuropsychopharmacology 33: 2217–2227.
- 52. Bjork JM, Smith AR, Hommer DW (2008) Striatal sensitivity to reward deliveries and omissions in substance dependent patients. Neuroimage 42: 1609–1621.
- 53. Juckel G, Schlagenhauf F, Koslowski M, Wustenberg T, Villringer A, et al. (2006) Dysfunction of ventral striatal reward prediction in schizophrenia. Neuroimage 29: 409–416.
- 54. Ströhle A, Stoy M, Wrase J, Schwarzer S, Schlagenhauf F, et al. (2008) Reward anticipation and outcomes in adult males with attention-deficit/hyperactivity disorder. Neuroimage 39: 966–972.
- 55. Steele JD, Kumar P, Ebmeier KP (2007) Blunted response to feedback information in depressive illness. Brain 130: 2367–2374.
- 56. Maccarrone M, Rossi S, Bari M, De Chiara V, Fezza F, et al. (2008) Anandamide inhibits metabolism and physiological actions of 2-arachidonoylglycerol in the striatum. Nat Neurosci 11: 152–159.
- 57. Maccarrone M, De Chiara V, Gasperi V, Viscomi MT, Rossi S, et al. (2009) Lipid rafts regulate 2-arachidonoylglycerol metabolism and physiological activity in the striatum. J Neurochem 109: 371–381.
- 58. Musella A, De Chiara V, Rossi S, Cavasinni F, Castelli M, et al. (2010) Transient receptor potential vanilloid 1 channels control acetylcholine/2-arachidonoylglicerol coupling in the striatum. Neuroscience 167: 864–87.
- 59. Campolongo P, Roozendaal B, Trezza V, Hauer D, Schelling G, et al. (2009) Endocannabinoids in the rat basolateral amygdala enhance memory consolidation and enable glucocorticoid modulation of memory. Proc Natl Acad Sci U S A 106: 4888–4893.
- 60. Pacher P, Batkai S, Kunos G (2006) The endocannabinoid system as an emerging target of pharmacotherapy. Pharmacol Rev 58: 389–462.
- 61. Dubreucq S, Koehl M, Abrous DN, Marsicano G, Chaouloff F (2010) CB1 receptor deficiency decreases wheel-running activity: consequences on emotional behaviours and hippocampal neurogenesis. Exp Neurol 224: 106–113.
- 62. Trezza V, Baarendse PJ, Vanderschuren LJ (2010) The pleasures of play: pharmacological insights into social reward mechanisms. Trends Pharmacol Sci 31: 463–469.
- 63. Kathuria S, Gaetani S, Fegley D, Valino F, Duranti A, et al. (2003) Modulation of anxiety through blockade of anandamide hydrolysis. Nat Med 9: 76–81.
- 64. Patel S, Roelke CT, Rademacher DJ, Cullinan WE, Hillard CJ (2004) Endocannabinoid signaling negatively modulates stress-induced activation of the hypothalamic-pituitary-adrenal axis. Endocrinology 145: 5431–5438.
- 65. Patel S, Hillard CJ (2006) Pharmacological evaluation of cannabinoid receptor ligands in a mouse model of anxiety: further evidence for an anxiolytic role for endogenous cannabinoid signaling. J Pharmacol Exp Ther 318: 304–311.
- 66. Higgs S, Williams CM, Kirkham TC (2003) Cannabinoid influences on palatability: microstructural analysis of sucrose drinking after delta(9)-tetrahydrocannabinol, anandamide, 2-arachidonoyl glycerol and SR141716. Psychopharmacology (Berl) 165: 370–377.
- 67. Jarrett MM, Limebeer CL, Parker LA (2005) Effect of Delta9-tetrahydrocannabinol on sucrose palatability as measured by the taste reactivity test. Physiol Behav 86: 475–479.
- 68. Yoshida R, Ohkuri T, Jyotaki M, Yasuo T, Horio N, et al. (2010) Endocannabinoids selectively enhance sweet taste. Proc Natl Acad Sci U S A 107: 935–939.
- 69. Di Marzo V, Matias I (2005) Endocannabinoid control of food intake and energy balance. Nat Neurosci 8: 585–589.
- 70. Chambers RA, Potenza MN (2003) Neurodevelopment, impulsivity, and adolescent gambling. J Gambl Stud 19: 53–84.
- 71. Slawecki CJ (2005) Comparison of anxiety-like behavior in adolescent and adult Sprague-Dawley rats. Behav Neurosci 119: 1477–1483.
- 72. Teicher MH, Andersen SL, Polcari A, Anderson CM, Navalta CP, et al. (2003) The neurobiological consequences of early stress and childhood maltreatment. Neurosci Biobehav Rev 27: 33–44.
- 73. Wallace JM Jr, Bachman JG, O'Malley PM, Schulenberg JE, Cooper SM, et al. (2003) Gender and ethnic differences in smoking, drinking and illicit drug use among American 8th, 10th and 12th grade students, 1976–2000. Addiction 98: 225–234.
- 74. Quinn HR, Matsumoto I, Callaghan PD, Long LE, Arnold JC, et al. (2008) Adolescent rats find repeated Δ9-THC less aversive than adult rats but display greater residual cognitive deficits and changes in hippocampal protein expression following exposure. Neuropsychopharmacology 33: 1113–1126.
- 75. Al-Hayani A, Davies SN (2000) Cannabinoid receptor mediated inhibition of excitatory synaptic transmission in the rat hippocampal slice is developmentally regulated. Br J Pharmacol 131: 663–665.
- 76. Berrendero F, Sepe N, Ramos JA, Di Marzo V, Fernandez-Ruiz JJ (1999) Analysis of cannabinoid receptor binding and mRNA expression and endogenous cannabinoid contents in the developing rat brain during late gestation and early postnatal period. Synapse 33: 181–191.
- 77. Moesgaard B, Petersen G, Jaroszewski JW, Hansen HS (2000) Age dependent accumulation of N-acyl-ethanolamine phospholipids in ischemic rat brain. A (31)P NMR and enzyme activity study. J Lipid Res 41: 985–990.
- 78. Moreno M, Cardona D, Gómez MJ, Sánchez-Santed F, Tobeña A, et al. (2010) Impulsivity characterization in the Roman high- and low-avoidance rat strains: behavioral and neurochemical differences. Neuropsychopharmacology 35: 1198–208.
- 79. Kliethermes CL, Crabbe JC (2006) Genetic independence of mouse measures of some aspects of novelty seeking. Proc Natl Acad Sci U S A 103: 5018–5023.
- 80. Peaston AE, Whitelaw E (2006) Epigenetics and phenotypic variation in mammals. Mamm Genome 17: 365–374.
- 81. Wong AH, Gottesman II, Petronis A (2005) Phenotypic differences in genetically identical organisms: the epigenetic perspective. Hum Mol Genet 14: R11–R18.
- 82. Gartner K (1990) A third component causing random variability beside environment and genotype. A reason for the limited success of a 30 year long effort to standardize laboratory animals? Lab Anim 24: 71–77.
- 83. Wise RA (2006) Role of brain dopamine in food reward and reinforcement. Philos Trans R Soc Lond B Biol Sci 361: 1149–1158.
- 84. Bassareo V, De Luca MA, Di Chiara G (2002) Differential Expression of Motivational Stimulus Properties by Dopamine in Nucleus Accumbens Shell versus Core and Prefrontal Cortex. J Neurosci 22: 4709–4719.
- 85. Centonze D, Rossi S, Prosperetti C, Gasperi V, De Chiara V, et al. (2007) Endocannabinoids limit metabotropic glutamate 5 receptor-mediated synaptic inhibition of striatal principal neurons. Mol Cell Neurosci 35: 302–310.