With advances of research on fetal behavioural development, the question of whether we can identify fetal facial expressions and determine their developmental progression, takes on greater importance. In this study we investigate longitudinally the increasing complexity of combinations of facial movements from 24 to 36 weeks gestation in a sample of healthy fetuses using frame-by-frame coding of 4-D ultrasound scans. The primary aim was to examine whether these complex facial movements coalesce into a recognisable facial expression of pain/distress.
Fifteen fetuses (8 girls, 7 boys) were observed four times in the second and third trimester of pregnancy. Fetuses showed significant progress towards more complex facial expressions as gestational age increased. Statistical analysis of the facial movements making up a specific facial configuration namely “pain/distress” also demonstrates that this facial expression becomes significantly more complete as the fetus matures.
The study shows that one can determine the normal progression of fetal facial movements. Furthermore, our results suggest that healthy fetuses progress towards an increasingly complete pain/distress expression as they mature. We argue that this is an adaptive process which is beneficial to the fetus postnatally and has the potential to identify normal versus abnormal developmental pathways.
Citation: Reissland N, Francis B, Mason J (2013) Can Healthy Fetuses Show Facial Expressions of “Pain” or “Distress”? PLoS ONE 8(6): e65530. https://doi.org/10.1371/journal.pone.0065530
Editor: Junming Yue, The University of Tennessee Health Science Center, United States of America
Received: February 6, 2013; Accepted: April 30, 2013; Published: June 5, 2013
Copyright: © 2013 Reissland et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Funding was provided by Durham University (http://www.dur.ac.uk). The analysis of the data was supported by ESRC grant RES-576-25-0019 (http://www.esrc.ac.uk/). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
With advances in prenatal medicine allowing treatment in utero, the question of whether we can identify facial expressions in general and, specifically, facial expressions of “pain” or “distress” in the fetus takes on greater importance. Although the experience of pain and distress is subjective  entailing a psychological component  anatomical and functional development is necessarily related to perception of stimuli (e.g. ; ). Regardless of whether or not the emotional content of “pain” or “distress” is learned through experience, the nature of physical “distress” or more specifically “pain” presupposes the presence of functional thalamocortical circuitry required for conscious perception (e.g. , ). Given that infant’s pain and distress responses cannot be distinguished  we use these two terms interchangeable in this paper.
Most research on neonatal pain so far has been on preterm babies. Oberlander, Grunau, Fitzgerald & Whitfield  suggest that pain responses in infants below 32 weeks gestation, are largely sub-cortical which arguably would lead to different facial expressions at specific gestational ages. Supporting this claim, Waxman  found no difference in facial activity during heel lancing of infants with and without significant cortical injury, suggesting that facial activity even around 32 weeks may not be cortically controlled. In premature infants, Lee et al.  found a distinct set of neonatal facial movements present during invasive but absent during non-invasive procedures. These facial movements, ,  were evident in infants at 28–30 weeks post-conceptual-age but not at 25–27 weeks. In contrast, other studies , , have found that cortical areas of preterm infants are activated by painful stimuli and differed when comparing responses to tactile and painful stimulation. In addition, somatosensory cortical activity in response to tactile stimulation was correlated with the Premature-Infant-Pain-Profile (PIPP) score, measuring pain behaviours including facial expressions . Notably, somatosensory cortical activities were closely correlated with scores of the facial expression component of the PIPP. Although, one study , determined that minimal necessary neural pathways for pain are in place by 24 weeks gestation suggesting that pain is potentially experienced by a fetus in utero, it is not known whether fetuses are capable of the necessary coordination of muscle movements to produce the expressions of “distress” or ”pain”.
Facial “distress” movements are essential components of the development of mature pain expression. In one study , the Neonatal Facial Coding System  was used to provide detailed descriptions of facial activity in preterm infants during painful procedures. Measures containing facial movements include deepening of the naso-labial furrow, open lips, horizontal and vertically stretched mouth, which are incorporated in the coding scheme of fetal facial expressions from 24–36 weeks gestation .
Pain experience and pain and distress response are not necessarily the same. In the fetus, although the response to a painful stimulus might be regulated in the spinal cord and brainstem, this does neither prove nor disprove that the stimulus reaches the neonatal cortex. Before it is possible to determine whether facial expressions are meaningful proxies of pain or distress, we need a greater understanding of the development of fetal facial expressions. Without this basic research, facial expressions cannot reliably be correlated with other stimuli.
A previous study  of female fetuses demonstrated that fetal facial movements become more complex between 24–35 weeks gestation. There are some research findings suggesting that female fetuses show more mouth movements ; specifically, more jaw and lip movements, as well as more sucking movements  than males. However, other research does not indicate any gender differences . Hence we tested whether gender affected the complexity of facial movements as well as the development of a specific gestalt namely the “pain-face” gestalt.
In the present study, we hypothesise that fetal motor development affects not only general motor and specific oral-motor function as previously reported in neonates  but also the complexity of their facial expressions. We suggest that healthy fetuses, as they mature from 24 to 36 weeks gestation, are increasingly capable of complex facial movements, and that in healthy fetuses we are able to observe facial expressions which resemble a “pain” face. This conjecture is supported by research showing that mere review of fetal scans without fine grained coding allows the observer to label expressions such as scowling or grimacing , , .
Materials and Methods
Ethical permission for the study was granted by the County Durham and Tees Valley 2 Research Ethics Committee (REC Ref: 08/H0908/31), the Research and Development department of James Cook University Hospital and Durham University. All mothers gave informed written consent covering publication under a Creative Commons Licence.
The principal aim was to investigate the increasing complexity of facial movements from 24 to 36 weeks gestation in a sample of 15 healthy fetuses of first time mothers. We focus on the “pain/distress” facial gestalt, which in a previous study  found significant results. Coded findings are used to explore the hypothesis that facial movements associated with increasingly complex facial expressions develop from the second to third trimester of pregnancy.
Fifteen healthy fetuses, 8 girls and 7 boys, were scanned. The fetuses were observed four times in the mornings in the radiography department of the James Cook University Hospital where mothers underwent their 12 and 20 week scans. Observation took place in a darkened room with the mothers on their back or on their side, depending on the position of the fetus and how comfortable mothers were. The first scan was performed at a mean 24.20 weeks gestational age (range 23.9–24.5 weeks); the second at 28 weeks gestational age (range 27.8–28.2 weeks); the third at 32.1 weeks gestational age (range 31.8–32.4 weeks); the fourth at 36.1 weeks gestational age (range 36.0–36.4 weeks). All participants were first time mothers with mean age 27 years (range 19–40 years), specifically recruited through the midwives of the antenatal unit of the James Cook University Hospital, Middlesbrough, UK and following ethical procedures. All fetuses were confirmed to be healthy, after case review and the assessment by a paediatrician with mean weight of 3283 grams at birth (standard deviation 489 grams). Apgar scores measured at 1 and 5 minutes ranged from 9–10.
Following ethical approval, mothers were approached after they had completed their 20 week anomaly scans, showing a healthy fetus and were given written information of the study. Mothers had to opt into the study by phoning for an appointment. Mothers were then asked to sign a consent form in order to participate in the study. All participating mothers received four additional scans in which fetuses were observed while active for approximately 20 minutes. During consent and before each procedure mothers were made aware that these additional scans were for research purposes and not routine medical scans. All scans were performed by an experienced, trained radiographer (Kendra Exley) and one of the researchers (N.R.) was present at all scans. Mothers were provided with a DVD copy of their scans. The fetal face and upper torso were visualized by means of 4D full frontal or facial profile ultrasound recordings, and recorded for off line analysis with a GE Voluson 730 Expert Ultrasound System using a GE RAB4–8L Macro 4D Convex Array Transducer. Three coders, trained in coding infant and fetal facial movements, coded the data. Because at times the fetal scan did not show the full face or profile we accumulated 600 seconds of scan for each observation period, starting from the first moment the face was codable. If the face was not visible for a time the coding was stopped and started as soon as the face became visible. No stimulation was applied in these observation periods. The first scan of one fetus could not be coded because the fetal face was not visible during the scan. Hence the data are based on 59 rather than 60 scans.
Method of Coding
Using a method previously published ,  we identified 19 facial movements derived from the Facial Action Coding System  (see Table 1 column 1), which could be observed in fetuses and reliably coded from fetal 4 D scans.
We identified 6 facial movements, which have been shown to have a significant relationship with “pain” or “distress” in previous research ,  and have been used in order to identify aspects of pain and distress in various populations. A number of studies have identified: Lowering the brows –; Nose wrinkle , ; Upper lip raiser , –; deepening of the Nasiolabial furrow ; Lips parting , and Mouth stretch . We then defined combinations of these movements as a specific “gestalt” by identifying facial configurations which are classified as “pain/distress” expressions (see our previous publication for details ). We use the term “gestalt” to emphasise the fact that we do not associate these expressions with fetal feeling, emotion or cognition. The “pain gestalt” can be thought of as a pattern of co-ordinated movements which would be viewed by an observer as a “pain” and or “distress” face, but does not imply that the fetus is in distress or pain. This view is supported by the research on facial expression and emotion. Based on their review of the literature, Fernandez-Dois came to the conclusion that… “facial expressions cannot be defined as crisp… signals of emotion but are… nevertheless … adaptive…” [33, p. 27]. Furthermore, although the Neonatal Facial Coding System, when used to measure pain in infants,  includes ten facial movements, the authors assign a maximum score of 10 for premature infants and of 9 for full term infants if these infants show all actions. This, however, does not imply that fewer facial movements represent an absence of pain in this and other coding systems identifying pain. Rather infants are said to experience relatively less pain if they score on fewer items. Although in our coding system the maximum of 6 co-occurring facial movements was rarely observed, facial configurations consisting of 3 or 4 co-occurring movements still gave the visual impression of a pain facial gestalt (see Fig. 1).
(a) Showing an example of neutral face, and (b) a “pain/distress” facial expression with complex combinations of facial movements.
Table 1 identifies all 19 facial movements coded which were tested in terms of complexity of facial movements observed over four gestational ages as well as showing the specific facial movements making up the “pain/distress” gestalt. We assessed reliability of the coding by independently re-coding 32% of recordings. Using Cohen’s Kappa, reliability was established for these scans, which were coded independently by a new coder trained in the coding system. This resulted in reliability estimates for facial movements making up the “pain” gestalt (mean = 0.96, range. 77–1.00), as well as overall reliability for all 19 facial movements coded (overall mean = .91, overall mean range. 79–1.00).
Co-occurring facial movements were those within one second of one another. We analysed the co-occurrence of all 19 facial movements coded. Additionally, specific facial movements were assigned to one gestalt, namely the “pain/distress” facial expression (see Table 1 column 2). Events were coded according to the number of facial movements occurring at the same time and were classified as single, double, triple events and so on, and were then aggregated for each observation period to produce a set of counts identifying the number of single, double, triple etc events.
We fit a random effects proportional odds ordinal regression model to the data , . Ordinal regression is used as the categories “one facial movement occurring by itself”, “two facial movements occurring at the same time”, “three facial movements occurring at the same time” etc. may not be equally spaced - it might be more difficult for a fetus to develop from a double to a triple compared to development from a single to a double. We allow for variation in the development of each fetus by using a random effects model. The random effect allows for between-fetus variability and allows for the repeated longitudinal design of the study, controlling for the fact that some fetuses may be early developers and some late developers.
Formally, the model can be written as:where gives the probability that a movement event for fetus i at time t has j or fewer concurrent facial movements, and represents the gestational age of fetus i at time t. The give the cutpoints in the model, and the are fetal random effects and are assumed to be normally distributed with mean zero and variance . The β1 parameter can be interpreted as a value that gives an indication of speed of progression from one category to the next as gestational age increases. The higher the value of β1, the faster is the developmental process towards increasing complexity. In a similar way, the β2 parameter measures the increase in complexity for males over females (the baseline category) controlling for gestational age. The model is fitted by maximum likelihood on the individual category probabilities assuming a multinomial distribution. Unlike mixed effects models for continuous data which will estimate residual within-subject variability and which is assumed to be normally distributed, the standard assumption of the multinomial distribution in this model has no residual scale parameter to estimate. Within-fetus variability in this model is thus assumed to be constant and cannot be estimated .
The model was fitted using the clmm function (i.e. cumulative link mixed models) in the ordinal package in the statistical language R . The significance of the β parameters was assessed by likelihood-ratio tests (LRT), which compared the likelihood of nested models, one comparing the age and gender model with age, and the second comparing age with a no-covariate model.
Results indicate that as fetuses mature, they show increasingly complex facial movements using up to 7 of the 19 facial movements occurring at the same time. Table 2 reports for each gestational age the observed total number of co-occurring facial events for the 15 fetuses.
Table 3 reports similarly for each age the subset of co-occurring events making up the pain/distress gestalt.
The number of co-occurring movements making up the pain facial gestalt increased with fetal age. We were able to observe events with up to seven facial movements co-occurring, although the number of times seven facial movements occurred was small. The subsequent ordinal regression for all facial movements therefore used a six-category ordinal variable as response (single, double, triple, quadruple, quintuple and sextuple or more facial movements observed at the same time). For the pain/distress gestalt we used a five-category ordinal variable as response.
Figure 1 depicts typical fetal faces at 32 weeks showing (a) a neutral face and (b) an example of a fetus showing a complex combination of facial movements which make up the pain/distress gestalt.
Random effects ordinal regression showed that linear age (on the cumulative log-odds scale) was a significant predictor of increasing complexity with gestational age. Table 4 gives the β estimate for the “pain” gestalt. Also presented is the analysis for increasing facial movement complexity ignoring gestalt assignment. Analyses of the facial gestalts of “pain” could be observed to develop in complexity by gestational age from 24–36 weeks gestational age with the estimate of β1 given as 0.197 (LRT = 342.4 on 1 df; p<0.001). Ignoring the assignment of individual facial movements to gestalts, the analysis of all 19 facial movements also demonstrated increasing complexity, with a β1 estimate of 0.228 (LRT = 804.9 on 1 df, p<0.001).
Sex differences were assessed by examining the significance of β2. For all analyses, the effect of sex was not significant (Pain: LRT = 0.55 on 1 df - p = 0.46; All facial movements: LRT = 0.73 on 1 df- p = 0.39), and there was thus no evidence that boys and girls differed in the developmental complexity of facial gestalts.
Figure 2 shows the fitted random effects model by age (excluding the non-significant gender effect) for the pain gestalt of a “typical fetus” (i.e. with a random effect of zero). The plot identifies that the probability of a single facial movement declines to around 0.20 by 36 weeks; the probability for two facial movements happening at the same time increases and reaches a peak at around 35 weeks before declining, and the probability for three facial movements happening at the same time continues to increase over the study period. The chance of observing a four movements happening at the same time for an average fetus is zero at 24 weeks but also rises to about 2%.
Discussion and Conclusion
This study adds to and extends earlier work on development of fetal movements –. Advances in ultrasound technology giving high-resolution 4-D scans  combined with a standard coding scheme has allowed us to focus on fetal facial features, their development over gestational age , and coordination of movements to form recognisable facial gestalts .
The specific work in this paper concerns the “pain/distress” gestalt with a focus on the question of whether fetuses show “pain/distress” expressions. According to Kostovic & Judas , due to the functional immaturity of thalamocortical connections, there is no cortical processing and no feeling of pain before 25 weeks of gestation. Nevertheless, this study demonstrates that it is possible for fetuses to show facial expressions which can be interpreted as a “pain/distress” expression.
We were able to demonstrate that as the fetus matures we can see spontaneously more of these facial configurations. Specifically, the combination of six of these movements contributing to the “pain/distress” gestalt increases as the fetus matures. However, in our sample and in accord with other research  there was no evidence that gender plays a role in the developmental process. Having observed that the complexity of fetal facial movements in a group of 15 healthy fetuses increases significantly from 24 to 36 weeks gestation, we found additionally that it is possible to recognize “pain/distress” facial expressions in utero akin to facial expressions seen after birth. In this paper we give a developmental account in which we observe spontaneous facial movements as they are produced by fetuses from 24 to 36 weeks gestation. If instead we adopt a threshold approach, and define an identifiable pain face as needing 3 or more co-occurring facial movements, then at 24 weeks the pain/distress gestalt would be only very rarely observed with only 5% of facial events showing 3 relevant facial movements and 0.3% having 4 relevant facial movements making up the pain/distress gestalt. In contrast, at 36 weeks gestation, healthy fetuses did show higher frequencies of more complex facial pain expressions, with 21.2% of facial events having 3 facial movements making up the pain gestalt, and 2.8% of observations including 4 out of the 6 simultaneously occurring facial movements making up the pain/distress face gestalt.
What is the importance of these movements? There are two possible explanations. Firstly, given that pathways mediating the pain perception appear to be functional between 29 and 30 weeks of gestation , and hence that fetuses from around 28–30 weeks gestational age are capable of feeling pain , , then a proxy for pain experiences might be the facial expression of pain , .
An alternative view is that movements such as pain expressions might only relate to maturation of fetal facial movements and is therefore adaptive, preparing the fetus for postnatal life, and the need to alert carers to pain “experiences” by the infant. The reason for this is twofold. First, based on our observations, healthy fetuses not subjected to stimulation show spontaneously complex facial expressions. These facial movements coalesce at 36 weeks, making up a “pain/distress” gestalt. Second, Mellor, Diesch, Gunn & Bennet  analysed fetal movements in utero and claimed that the fetus is never “awake” in utero. They suggest that the fetus is kept “unconscious” by a variety of inhibitory factors. Regarding frequency of movements, Mellor et al suggest that the fetus who shows more movements is healthier compared to the fetus showing fewer movements (: 460). Specifically, a noxious stimulus such as hypoxia, which induces arousal to waking states postnatally, suppresses arousal prenatally, thereby promoting survival of the fetus in adverse conditions. In agreement with a number of researchers [e.g. 22–24, 46] we argue that increasingly complex fetal facial expressions are a sign of healthy maturation. We speculate that there is potential in using this method of analysis to test associations of complex fetal facial movements with certain stimuli.
It is unclear whether infants might have a “memory” for the movements they produced in utero. However, given that other researchers have found that fetal prenatal experiences - for example sounds and language – are remembered postnatally, it is possible that the infant also remembers prenatal movement patterns. If infants remember movement patterns it would be interesting to identify whether fetuses undergoing painful procedures would show more “pain/distress” facial expressions, even without “feeling” pain.
We suggest that our findings demonstrate that fetal facial movements become more complex during healthy development. Previous research on selected facial movements indicates that the frequency of facial movements declines with gestational age (e.g., ). This result might represent maturation of fetal facial movements in terms of the time a movement can be held, with younger fetuses making fleeting movements and older fetuses holding movements for longer.
In summary, our research demonstrates that refined methods of coding fetal facial movement allow us to identify the progression of increasingly complex facial movements in utero as well as the formation of the fetal facial “pain/distress” gestalt. Future studies need to test whether this facial gestalt is delayed in fetuses who are either subjected to unhealthy in utero conditions (e.g. experiencing effects of smoking or alcohol), show conditions such as cerebral palsy , or whether fetal facial movements are different in fetuses undergoing invasive procedures versus fetuses developing in healthy environments .
We thank all radiographers and especially Kendra Exley of James Cook University Hospital for their help in recruiting participants and performing ultrasound scans, the coders of the ultrasound scans and the mothers who kindly agreed to participate in this study. We thank Karen Lincoln and Kumar Kumarendran for their support. We also thank Harriet Oster, Marco Dondi and Luc Marlier for a discussion of facial movements derived from FACS.
Conceived and designed the experiments: NR. Performed the experiments: NR. Analyzed the data: BF. Wrote the paper: NR BF JM.
- 1. Smith RP, Giteau R, Glover V, Fisk NM (2000) Pain and stress in the human fetus. Eur J Obstet Gynecol Reprod Biol 92: 161–165.
- 2. Lee SJ, Ralston HJP, Drey EA, Partridge JC, Rosen MA (2005) Fetal pain: A systematic multidisciplinary review of the evidence. JAMA 294: 947–95.
- 3. Anand KJS, Hickey PR (1987) Pain and its effects in the human neonate and fetus. New Engl J Med 317: 1321–1329.
- 4. Benatar D, Benatar M (2001) A pain in the fetus: towards ending confusion about fetal pain. Bioethics 15: 57–76.
- 5. Kostovic I, Judas M (2010) The development of the subplate and thalamocortical connections in the human foetal brain. Acta Paediatr 99: 1119–1127.
- 6. Mathews PJ, Mathews LJ (2003) Assessment and management of pain in infants. Postgrad Med J 79: 438–443.
- 7. Oberlander TF, Grunau RE, Fitzgerald C, Whitfield MF (2002) Does parenchymal brain injury affect biobehavioral pain responses in very low birth weight infants at 32 weeks’ postconceptional age? Pediatrics 110: 570–576.
- 8. Waxman SG (1996) Clinical observations on the emotional motor system. Prog Brain Res 107: 595–604.
Craig KD, Prkachin KM, Grunau RE (2001) Facial expression of pain. In: Turk DC, Melzack R, editors. Handbook of Pain Assessment. 2nd ed. New York, NY: Guilford Press. pp 153–169.
- 10. Craig KD, Hadjistavropoulos HD, Grunau RV, Whitfield MF (1994) A comparison of two measures of facial activity during pain in the newborn child. J Pediatr Psychol 19: 305–318.
- 11. Bartocci M, Bergqvist LL, Lagercrantz H, Anand KJS (2006) Pain activates cortical areas in the preterm newborn brain. Pain 122: 109–17.
- 12. Slater R, Cantarella A, Gallella S, Worley A, Meek J, et al. (2006) Cortical pain responses in human infants. J. Neurosci 26: 3662–3666.
- 13. Slater R, Cantarella A, Franck L, Meek J, Fitzgerald M (2008) How well do clinical pain assessment tools reflect pain in infants? PLoS Medicine 5: e129.
- 14. Derbyshire SWG (2010) Foetal pain? Best Pract Res Cl Ga 24: 647–655.
- 15. Craig KD, Whitfield MF, Grunau RVE, Linton J, Hadjistavropoulos HD (1993) Pain in the preterm neonate: behavioural and physiological indices. Pain 52: 287–299.
- 16. Grunau RVE, Johnston CC, Craig KD (1990) Neonatal facial and cry responses to invasive and non-invasive procedures. Pain 42: 295–305.
- 17. Reissland N, Francis B, Mason J, Lincoln K (2011) Do Facial Expressions Develop before Birth? PLoS ONE 6(8): e24081
- 18. Hepper PG, Shannon EA, Dornan JC (1997) Sex differences in fetal mouth movements. Lancet 350: 1820.
- 19. Miller JL, Macedonia C, Sonies BC (2006) Sex differences in prenatal oral-motor function and development. Dev Med Child Neurol 48: 465–470.
- 20. Hepper PG, Dornan JC, Lynch C (2012) Sex differences in fetal habituation. Dev Sci 15: 373–383.
Humprey T (1967) Reflex activity in the oral and facial area of the human fetus. In Bosma JF, editor. Second symposium on oral sensation and perception Springfield IL. Charles C. Thomas. 195–255.
- 22. Azumendi G, Kurjak A (2003) Three-dimensional and four-dimensional sonography in the study of the fetal face. Ultrasound Obst Gyn 3: 160–169.
- 23. Yan F, Dai SY, Akther N, Kuno A, Yanagihara T, et al. (2006) Four-dimensional sonographic assessment of fetal facial expression early in the third trimester. Int J Gynaecol Obstet 94: 108–113.
Piontelli A (2010) Development of normal fetal movements. Springer Verlag, Italia.
Ekman P, Friesen WV (1978) Manual for the Facial Action Coding System. Paolo Alto, CA: Consultant Psychologists Press.
- 26. Reissland N, Francis B, Mason J (2012) Development of Fetal Yawn Compared with Non-Yawn Mouth Openings from 24–36 Weeks Gestation. PLoS ONE 7(11): e50569
Craig KD, Grunau RVE (1991) Developmental issues: Infants and toddlers. In Bush JP, Harkins SW, editors. Pain in children: Clinical and research issues from a developmental perspective. New York: Springer-Verlag. 171–193.
Prkachin KM (2005) the consistency of facial expressions of pain: a comparison across modalities. In Ekman P, Rosenberg EL, editors.What the face reveals, CUP. 181–197.
- 29. LeResche L (1982) Facial expression in pain: A study of candid photographs. J Nonverbal Behav 7: 46–56.
- 30. LeResche L, Dworkin SF (1988) Facial expressions of pain and emotions in chronic TMD patients. Pain 35: 71–78.
- 31. Patrick CJ, Craig KD, Prkachin KM (1986) Observer judgements of acute pain: Facial action determinants. J Pers Soc Psychol 50: 1291–98.
- 32. Craig KD, Patrick CJ (1985) Facial expression during induced pain. J Pers Soc Psychol 48: 1080–1091.
- 33. Fernadez-Dols JM, Crivelli C (2013) Emotion and Expression : Naturalistic Studies. Emotion Review 5: 24–29.
Agresti A (2010) Analysis of Ordinal Categorical Data (2nd Edition). New York: Wiley.
- 35. Tutz G, Hennevogl W (1996) Random effects in ordinal regression models. Comput Stat Data An 22: 537–557.
- 36. Hartzel J, Agresti A, Caffo B (2001) Multinomial logit random effects models. Stat Model 1: 81–102.
Christensen RHB (2011) Analysis of ordinal data with cumulative link models - estimation with the R-package ordinal. 2011. Available: http://cran.r-project.org/web/packages/ordinal/vignettes/clm_intro.pdf. Accessed 2011 Dec 15.
- 38. De Vries JIP, Visser GH, Prechtl H (1982) The emergence of fetal behaviour. I. Qualitative aspects. Early Hum Dev 7: 301–322.
- 39. Roodenburg PJ, Wladimiroff JW, van Es A, Prechtl HF (1991) Classification and quantitative aspects of fetal movements during the second half of normal pregnancy. Early Hum Dev 25: 19–35.
- 40. Kurjak A, Vecek N, Hafner T, Bozek T, Funduk-Kurjak B, et al. (2002) Prenatal diagnosis: What does four-dimensional ultrasound add? J Perinat Med 30: 57–62.
- 41. Kurjak A, Azumedi G (2003) Fetal hand movement and facial expressions in normal pregnancy studies by four dimensional sonography. J Perinat Med 31: 496–508.
- 42. Kurjak A, Stanojevic M, Azumendi G, Carrera JM (2005) The potential of four-dimensional (4D) ultrasonography in the assessment of fetal awareness. J Perinat Med 33: 46–53.
- 43. Kurjak A, Andonotopo W, Hafner T, Salihagic Kadic A, Stanojevic M, et al. (2006) Normal standards for fetal neurobehavioral developments –longitudinal quantification by four-dimensional sonography. J Perinat Med 34: 56–65.
- 44. Kurjak A, Tikvica A, Sanojevic M, Miskovic B, Ahmed B, et al. (2008) The assessment of fetal neurobehavior by three-dimensional and four-dimensional ultrasound. J Matern Fetal Neonatal Med 21: 675–684.
Hata T, Dai S-Y, Marumo G (2010) Ultrasound for Evaluation of Fetal Neurobehavioural Development: from 2-D to 4-D Ultrasound. Infant Child Dev 19: Special Issue, 99–118.
- 46. Mellor DJ, Diesch TJ, Gunn AJ, Bennet L (2005) The importance of “awareness” to understand fetal pain. Brain Res Rev 49: 455–471.
- 47. Kawai N (2010) Towards a New Study on Associative Learning in Human Fetuses: Fetal Associative Learning in Primates. Infant Child Dev 19: 55–59.
- 48. Kisilevsky BS, Hains SMJ, Lee K, Xie X, Huang H, et al. (2003) Effects of experience on fetal voice recognition. Psych Sci 14: 220–224.
- 49. Kisilevsky BS, Hains SMJ (2010) Exploring the Relationship between Fetal Heart Rate and Cognition. Infant Child Dev 19: 60–75.
- 50. Kurjak A, Abo-Yaqoub S, Stanojevic M, Yigiter AB, Vasilj O, et al. (2010) The potential of 4D sonography in the assessment of fetal neurobehavior – multicentric study in high-risk pregnancies J Perinat Med. 38: 77–82.
- 51. Giannakoulopoulos X, Sepulveda W, Kourtis P, Glover V, Fisk NM (1994) Fetal plasma cortisol and beta-endorphin response to intrauterine needling. Lancet 344: 77–81.