The training to become a dentist can create psychological distress. The present study evaluates the structure of the ‘Perceived Stress Questionnaire’ (PSQ), its internal consistency model and interrelatedness with burnout, anxiety, depression and resilience among dental students.
The study employed a cross-sectional design. A sample of Spanish dental students (n = 314) completed the PSQ, the ‘Goldberg Anxiety and Depression Scale’ (GADS), ‘Connor-Davidson Resilience Scale’ (10-item CD-RISC) and ‘Maslach Burnout Inventory-Student Survey’ (MBI-SS). The structure was estimated using Parallel Analysis from polychoric correlations. Unweighted Least Squares was the method for factor extraction, using the Item Response Theory to evaluate the discriminative power of items. Internal consistency was assessed by squaring the correlation between the latent true variable and the observed variable. The relationships between the PSQ and the other constructs were analysed using Spearman’s coefficient.
The results showed a PSQ structure through two sub-factors (‘frustration’ and ‘tenseness’) with regard to one general factor (‘perceived stress’). Items that did not satisfy discriminative capacity were rejected. The model fit were acceptable (GFI = 0.98; RSMR = 0.06; AGFI = 0.98; NFI = 0.98; RFI = 0.98). All the factors showed adequate internal consistency as measured by the congeneric model (≥0.91). High and significant associations were observed between perceived stress and burnout, anxiety, depression and resilience.
The PSQ showed a hierarchical bi-factor structure among Spanish dental students. Using the questionnaire as a uni-dimensional scale may be useful in perceived stress level discrimination, while the sub-factors could help us to refine perceived stress analysis and improve therapeutic processes.
Citation: Montero-Marin J, Piva Demarzo MM, Pereira JP, Olea M, García-Campayo J (2014) Reassessment of the Psychometric Characteristics and Factor Structure of the ‘Perceived Stress Questionnaire’ (PSQ): Analysis in a Sample of Dental Students. PLoS ONE 9(1): e87071. https://doi.org/10.1371/journal.pone.0087071
Editor: Marianna Mazza, Catholic University of Sacred Heart of Rome, Italy
Received: October 4, 2013; Accepted: December 23, 2013; Published: January 23, 2014
Copyright: © 2014 Montero-Marin et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by the Research Network on Preventative Activities and Health Promotion (RD06/0018/0017), Aragon Health Sciences Institute, Faculty of Health and Sports (University of Zaragoza)and Faculty of Medicine and Dentistry (University of Santiago de Compostela). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The training to become a health professional can create psychological distress and symptoms of burnout, which may have adverse consequences for one’s personal and professional life –. Dentists experience high levels of work-related stress, which begins during professional training . Furthermore, the prevalence of burnout among dentistry students is high, with a significant relation found between the syndrome and a student’s academic performance, use of medication and thoughts of dropping out of the course . Dental students complain of exhaustion resulting from the high levels of anxiety generated by exams, limited free time available for relaxation and the stress associated with having to adapt to the requirements of clinical practice –. As a result, some new dentistry graduates exhibit alarmingly high levels of burnout .
‘Stress’ occurs when environmental demands overwhelm individuals’ resources and threaten their personal well-being. It has been defined as the result of a relationship with the environment that individuals appraise as significant for their well-being and in which the demands exceed the available coping resources . ‘Burnout’ is a response to the failure to cope adequately with chronic occupational stress and is an attempt to adapt to or to protect oneself from it . This syndrome has classically been characterized by a state of exhaustion, cynicism and inefficacy . ‘Exhaustion’ is the feeling of not being able to offer any more of oneself; ‘cynicism’ represents a distant attitude towards work, those served by it and other colleagues; and ‘inefficacy’ is the feeling of not performing tasks adequately or being incompetent.
On the other hand, ‘resilience’ has been characterized as a dynamic and flexible process of adaptation to life changes that could serve as a protective factor against psychological distress and mental disorders , . It is the amount of personal strength, energy and motivation that enables an individual to cope with and recover from stress and to flourish when faced with adversity. Most of the proposed models to improve well-being in students and health professionals aim to enhance strategies for coping with stress using educational and environmental support as well as cognitive exercises that strengthen resilience skills , .
From the early stages of their university studies, dental students show concern for the stress produced by their experiences with clinical practice. They develop intense and long-term interactions with clients and patients, which is characteristic of careers with high levels of psychological distress and burnout . Experiencing burnout over a prolonged period is associated with adverse emotional consequences, such as anxiety and depression, and it can also negatively affect the quality of patient care –. As a result, being able to measure the stress process in dental students seems to be essential if we want to evaluate their well-being along with their period of professional training.
The ‘Perceived Stress Questionnaire’ (PSQ) is a 30-item instrument that was developed by clinicians to quantify perceived stress . It is one of the most used instruments that measure the stress process in psychosomatic research and has been associated with somatic complaints. In addition, it has demonstrated good predictive values in stress-related diseases –. The PSQ permits the subjective experience of perceived stressful situations and stress reactions to be assessed, emphasizing cognitive perceptions more than emotional states or specific life events. The general form of the instruction asks questions related to ‘the last two years’ and the recent form asks about situations taking place ‘during the last month’, potentially addressing chronic and acute relationships with stressful events and activities. It contains both positively and negatively formulated items in order to reduce acquiescent bias. Each item is answered using a four-point Likert-type scale, ranging from 1 (‘almost never’) to 4 (‘almost always’). Higher scores indicate more severe perceived stress. Originally designed in English, this instrument has been translated to Italian, German and Spanish, and validated in populations of psychiatric inpatients and outpatients, nursing students, health workers, psychosomatic patients and health adults , , .
One key element of this questionnaire is that it includes different groups of stressful experiences, such as harassment, overload, irritability, lack of joy, fatigue, worries and tension, which were proposed in its original version. However, this structure was not replicated. The study by Sanz-Carrillo  revealed the dimensions of social acceptance, load, irritability, energy, fear and self-realization; while the Fliege’s study  observed worries, tension, lack of joy and demands, differentiating the first three as internal stress reactions, while demands was classified as external stressors. So far, contemplating a general factor seems to be the most reasonable solution for its use. The original author proposed a linear algorithm ranging from 0 to 1 .
The previous inconsistencies may be due to differences among the samples that were used, which is in line with the idea that validating instruments in a specific population of interest is the most advisable option . Nevertheless, the principal component analysis used as factor extraction method from r correlation matrices, along with the Kaiser role for the number of factors to retain, do not seem to be the best option to estimate factorial models using psychological variables as mentioned, and they are too often used out of force of habit .
Therefore, the goals of the present study were to evaluate the factor structure of the PSQ with dental students, together with its internal consistency model and its interrelatedness with the constructs of burnout, anxiety, depression and resilience. As a hypothesis, we expected high and significant correlations between all constructs.
We used a cross-sectional design by means of the application of a self-assessment survey.
Setting, Sample and Ethics Statement
The population consisted of Spanish dental students enrolled in Huesca (NH = 136) and Santiago de Compostela (NS = 242), during the 2010–11 academic year. An 83.1% response rate (RR) to the surveys, which were sent to all prospective participants, resulted in a sample of n = 314 participants. The students did not receive any financial or credit compensation for participating in the study. No differences were found in RR based on sex (males = 81.4% vs. females = 83.8%; p = 0.576), campus (Huesca = 87.5% vs. Santiago de Compostela = 80.6%; p = 0.085) or age (participants Mn = 22.05; SD = 3.57 vs. non-participants Mn = 22.34; SD = 3.83; p = 0.551).
A clinical psychologist trained two research assistants to administer the questionnaires as a battery in a paper-and-pencil format. The first page of the protocol identified the objectives of the study, participants, potential benefits and risks and the confidentiality of the data treatment. Each participant provided written informed consent before the commencement of the survey. The research assistants administered the survey in May 2011, two weeks before the period of final exams. After completion, the questionnaires were collected and kept in a sealed envelope to ensure the participants’ anonymity. The Ethical Review Board of Aragon, Spain, approved the study protocol. This study followed Helsinki Convention norms and later modifications, the Declaration of Madrid of the World Psychiatric Association and the Uniform Requirements for manuscripts submitted to Bio-medical journals.
Data were collected on age, gender, stable relationship (‘yes’, ‘no’), children (‘yes’, ‘no’), campus (‘Huesca’, ‘Santiago’), distance from family home (km), residence (‘with parents’, ‘dormitory’, ‘shared flat’, ‘private flat’), scholarship (‘yes’, ‘no’), parental support perceived (‘insufficient’, ‘good’, ‘very good’), weekly study hours, failed subjects over the previous period (‘none’, ‘one’, ‘two or more’), job (‘yes’, ‘no’) and year of study (‘first’, ‘second’, ‘third’, ‘fourth’, ‘fifth’).
Perceived Stress Questionnaire (PSQ).
Goldberg Anxiety and Depression Scale (GADS).
The participants completed the Spanish version of the GADS , , which consists of a 9-item subscale that assesses symptoms of anxiety and a 9-item subscale that assesses symptoms of depression. The participants respond with either ‘yes’ or ‘no’, with one point scored for each positive response. A greater number of positive responses is associated with a greater likelihood of suffering from anxiety or depression. Each subscale provides a measure of the associated mental disorder. The convergence validity of the GADS has demonstrated adequate values of sensitivity and specificity –. We used this short and friendly scale because it is recommended for the screening of anxiety and depression in large sample studies in the general population –.
Connor-Davidson Resilience Scale (10-item CD-RISC).
The participants also completed the Spanish version of the 10-item CD-RISC –. This scale is a self-report instrument that measures resilience on a 5-point Likert scale with responses that range from 0 (‘not at all’) to 4 (‘almost always’). The final scores are obtained by summing the response to each of the items, with higher values indicating higher levels of resilience. The validity and internal consistency of the scale were adequate and positively related to variables such as sleep quality and mental health , .
Maslach Burnout Inventory-Student Survey (MBI-SS).
Subjects were given the MBI-SS in its validated Spanish version for students , . This questionnaire is the ‘golden rule’ for the evaluation of burnout, and this adaptation consists of 15 items grouped into the three dimensions: five items corresponded to exhaustion, four to cynicism and six to efficacy. Responses are arranged in a 7-point Likert scale, scored from 0 (‘never’) to 6 (‘always’). The scores of each dimension are obtained by adding up the responses to the corresponding items, with higher values indicating higher levels of each one. The questionnaire dimensions present an adequate structure and internal consistency .
SPSS v19.0, FACTOR v9.02 and AMOS v7.0 statistical packages were used to conduct the analysis.
Means, standard deviations, skewness, kurtosis and Mardia’s coefficients  were calculated to evaluate the performance of the PSQ items.
Polychoric correlation is advised for factorial analysis (FA) when the distributions of ordinal items are asymmetric, with excess of kurtosis or with high item-rest coefficients . Thus, a polychoric correlation matrix was estimated with regard to the PSQ items. We used parallel analysis (PA)  to identify the number of factors to include in the factorial solution, by replacing the raw data method  with optimal implementation based on minimum rank factor analysis , generating 500 random correlation matrices from permutation of the raw data. With this analysis, a factor is considered significant if the associated eigen-value is greater than that corresponding to 95th percentile of the distribution of eigen-values derived from a random dataset. PA is considered the best available solution to decide the number-of-factors-to-retain , . We had previously verified the adequacy of the matrix, assessing the determinant, the KMO index and Barlett’s test of sphericity .
Unweighted Least Squares (ULS) was the method used for factor extraction . The ULS procedure does not provide inferential estimations for assessing model data fit based on the χ2 distribution, but it has important advantages: it does not require any distributional assumptions; it is quite robust and usually converges because of its efficiency in terms of computation; and it tends to provide less biased estimates of the true parameter values . Additionally, ULS is an appropriate choice for the case of not excessively large samples and shows good performance when working with polychoric matrices. In fact, ULS is consistent with the underlying variables approach from the Item Response Theory (IRT); it tends to supply accurate estimates even when models are large; and it provides better estimates than far more complex procedures –. The rotation method used was Promax, with a parameter of k = 4.00, given the correlated solution expected and using Raw Varimax as clever rotation start. We used Bentler’s simplicity index (S) and the loading simplicity index (LS) to evaluate factorial simplicity , .
Although we used unrestricted item factor analysis at this stage, we actually propose a second order factor solution, as a perceived stress general factor (G), by hierarchical factor solution . This specification, which is multidimensional but is able to reflect the essential uni-dimensionality of the data, prescribes a factor which reflects what is common to all of the items, working as a multidimensional semi-confirmatory factorial analysis . The factor weights (w) and the % of variance explained in each item by means of communality values (h2) were calculated. IRT parameterization by multidimensional normal-ogive graded response model (derived from the assumption of normally distributed measurement error), showed us the pattern of item discriminations in each dimension . The belonging factor was determined by means of the IRT discrimination (an), with those items with poor values being dismissed. Specifically, those items with an values <0.65 were discarded, as well as those with an values >0.65 in all of the latent dimensions at the same time .
We examined the fit of the proposed PSQ model by CFA, applying ULS from a polychoric matrix, for the reasons stated above. From a general perspective, we used the goodness-of-fit index (GFI), the adjusted goodness-of-fit index (AGFI), the root mean square of the standardized residuals (RMSR), the normed-fit-index (NFI) and Bollen’s relative-fit-index (RFI). GFI and AGFI refer to explained variance and values >0.90 are considered acceptable . SRMR is the standardized difference between the observed and the predicted covariance, indicating a good fit for values <0.08 . NFI measures the proportional reduction in the adjustment function when going from null to the proposed model and is considered acceptable when >0.90 . RFI takes into account the discrepancy for the model evaluated and for the baseline model, and it is very good close to 1 . All of them are perfectly valid for the ULS procedure. Taken together, they provide a reliable evaluation of the solution and additional information regarding absolute and incremental model fit. From an analytical perspective, standardized factor saturations and the explained variance were also considered.
We examined the internal consistency of the scales and sub-escales using congeneric, tau-equivalent and parallel models . The congeneric model is the least restrictive and assumes that each individual item measures the same latent variable, with possibly different scales, degrees of precision and magnitude of error. The tau-equivalent model implies that individual items measure the same latent variable on the same scale and with the same degree of precision, but with possibly different degrees of error. The parallel model is the most restrictive measurement model; it assumes that all items must measure the same latent variable on the same scale, with the same degree of precision and with the same amount of error. We finally chose the model that fitted better with the data, applying the ULS method and establishing comparisons. The reliability value was estimated by squaring the implied correlation between the composite latent true variable and the composite observed variable, to arrive at the percentage of the total observed variance that was accounted for by the true variable . Mean inter-item polychoric correlations, item-rest and mean item-rest correlations were also used, as well as the mean Spearman’s R coefficients between the items over the belonging factor, calculated according to the Bayes ‘Expected A Posteriori’ (EAP) .
In order to adhere to standards for data availability, the authors state that all materials used to produce the results in this paper will be made available upon request. This includes : 1.- The list of documents and data files that are needed in order for replication to be possible, 2.- A detailed list of what will be provided by the authors, and 3.- What steps, and in what sequence, the interested researchers need to take in order for this data to be made available. In addition, authors will post these materials on the group’s website .
Table 1 displays the general characteristics of participants. They comprised adults of European ethnicity between the ages of 18 and 41 (Mn = 22.05; SD = 3.57), 70.70% of whom were women. Compared to students in Santiago de Compostela, students in Huesca lived further away from the family home (χ2 = 72.53; df = 2; p<0.001), were more likely to live in shared flats (χ2 = 14.79; df = 3; p = 0.002), were less likely to have received a scholarship (χ2 = 6.66; df = 1; p = 0.010) and failed a higher percentage of subjects over the previous exam period (χ2 = 7.33; df = 2; p = 0.026). Students in both Santiago and Huesca were similar with regard to the rest of the socio-demographic and occupational variables.
Descriptive statistics for all the PSQ items can be seen in Table 2. Some items presented skewness values >1.00, such as ‘you feel lonely or isolated’ (item n° 5) and ‘you find yourself in situations of conflict’ (n° 6). Otherwise, some items showed kurtosis values <−1.00, as ‘you feel calm’ (n° 10 reversed), ‘you are under pressure from other people’ (n° 19), ‘you are afraid for the future’ (n° 22) and ‘you feel under pressure from deadlines’ (item n° 30). Mardia’s multivariate skewness and kurtosis coefficients were 132.70 (p = 1.00) and 1,040.71 (p<0.001), respectively.
The polychoric matrix of the PSQ items revealed that 78.6% of coefficients out of the diagonal were ≥0.30. The determinant was <0.001. KMO test had a value of 0.95 and Bartlett’s statistic was 4,780.50 (df = 435; p<0.001). The PA identified a two-factor structure, explaining 54.9% of the variance [(λ1 = 12.23; 46.7% variance of the real data; 7.5% variance explained over the P95 of the random samples); (λ2 = 2.39; 8.2% variance of the real data; 6.9% variance explained over the P95 of the random samples)]. The hierarchical solution by two first order factors (F1 and F2) and one second-order factor (G) exhibited good simplicity indices, such as S = 0.98 (P99) and LS = 0.45 (P99).
Table 2 shows the weights over G, the rotated loading matrix over F1 and F2 and the h2 values. All the items loaded ≥0.40 in G, except ‘you feel you are doing things you really like’ (n° 7 reversed; wg = 0.27). F1 presented topics related to ‘frustration’, such as ‘you are light-hearted’ (n° 25 reversed; w1 = 0.94), ‘you feel discouraged’ (n° 20; w1 = 0.82) or ‘you feel frustrated’ (n° 12; w1 = 0.72). F2 exhibited themes associated with ‘tenseness’, such as ‘you have too many things to do’ (n° 4; w2 = 0.95), ‘you feel that too many demands are being made on you’ (n° 2; w2 = 0.83), or ‘you feel you are in a hurry’ (n° 16; w2 = 0.82). In general, h2 values were high, with an average of 0.49. Table 2 shows the PSQ items in terms of IRT discrimination. Some items did not present sufficient values, such as ‘you feel rested’ (n° 1 reversed; a1 = 0.11; a2 = 0.58), ‘you are irritable or grouchy’ (n° 3; a1 = 0.52; a2 = 0.56), and also items n° 6 (a1 = 0.50; a2 = 0.08), n° 19 (a1 = 0.52; a2 = 0.50) and n° 22 (a1 = 0.43; a2 = 0.11), already mentioned. Additionally, ‘your problems seem to be piling up’ (n° 15; a1 = 0.73; a2 = 0.79) presented high values in both factors, so it was also dismissed.
Figure 1 shows the PSQ hierarchical bi-factor structure using CFA from an analytical and standardized point of view. The two first order factors turned out to be highly influenced by G, with loadings over F1 = 0.96 and F2 = 0.82. The item loadings with regard to their respective latent factor were high (F1 and F2 ranges = 0.42 to 0.81 and = 0.38 to 0.85, respectively). In a general sense, the PSQ hierarchical bi-factor structure presented adequate fit indices without using correlations between the error terms (GFI = 0.98; RSMR = 0.06; AGFI = 0.98; NFI = 0.98; RFI = 0.98).
The circles represent latent constructs and the rectangles are observable variables. The factor weightings are over the one-way arrows and the percentage of explained variance for each observable variable over the boxes (standardized estimates).
Table 3 shows the reliability models tested for the PSQ hierarchical bi-factor structure. The indices fitted best with the congeneric model in all of the latent factors. Based on the congeneric model, the estimates of reliability obtained for G were 0.95; with 0.91 for F1 and 0.93 for F2. The mean inter-item polychoric correlation for the twenty-four selected PSQ items was 0.42. Item-rest values were positive and high, with an average of 0.59. All the items were highly and positively correlated to the belonging factor calculated by EAP, with an average of 0.65 over F1 and 0.70 over F2.
Table 4 shows the convergence values for the PSQ hierarchical bi-factor structure scores calculated by EAP. F1 and F2 presented a correlation of r = 0.62 and both had high associations with regard to anxiety, depression and exhaustion. However, F1 presented higher values with cynicism, positively, and with resilience and efficacy, negatively.
Despite the fact that perceived stress has been evaluated among dental students , as far as we are aware, this is the first factorial study of the PSQ among dental students. It is also the first study to examine its internal consistency model as well as possible interrelatedness with burnout, anxiety, depression and resilience. Other studies have evaluated its structure in other samples , , but the methods used did not respect the true ordinal nature of the variables, as we have. Our results provide evidence of a clear two-factor structure of the PSQ in dental students (‘frustration’ and ‘tenseness’), while it was also possible to use a single general factor (‘perceived stress’). Overall, the questionnaire had good psychometric properties, with adequate reliability and good convergence values, although it was advisable to discard some non-discriminative items. We found that the congeneric model was the optimal model to measure its internal consistency. Interestingly, the results revealed different relationship patterns between the perceived stress factors and the other constructs.
The main strength of the present study is that generalizability was enhanced because it was conducted using an high-stress-risk sample , –, from two different universities in two Spanish regions, and these groups exhibited similar response rate. It is interesting to highlight the fact that the study was carried out during the period of final exams, a well-known source of distress, which may make the results more relevant . The response rate was high and the participants did not differ significantly from non-participants with regard to age, gender or years of study. Moreover, an independent researcher supervised the data transcription process to control for errors, and the analysis method respected the true nature of the variables used. The main limitation of the study was the use of a cross-sectional design because it did not permit the analysis of causal hypotheses. Another limitation could proceed from the instruments used, because they are not the only questionnaires used to measure such constructs. The use of other questionnaires might have produced slightly different results.
The participants in the study were young adults. Most of the individuals were women who did not have children. The majority of students also did not receive financial assistance and were not employed. On average, the responses of the participants were not extreme, although the values for tenseness and anxiety were moderately high. Comparatively, the scores for frustration, burnout and depression were slightly lower. This findings can be understood by considering the pressure that the students experienced owing to the proximity of final exams.
One of the most salient findings of this study is the clear hierarchical bi-factor structure shown by the PSQ among Spanish dental students. In this population, high correlations were observed between one second-order factor and two first-order factors. The second order factor (G) refers to ‘perceived stress’ as a general factor, as used in the original proposal ,  and in other studies , . The first of the first-order factors (F1), which we referred to as ‘frustration’, mainly included items from the original ‘lack of joy’ and ‘worries’. The second of the first-order factors (F2), named ‘tenseness’, mainly included items from the original ‘tension’ and ‘overload’ . In other words, F1 consisted of the stress perceived as lack of joy and worries, and F2 consisted of the external stressor of demands and the stress reaction of tension .
In general terms, the behaviour of the items was adequate, with high and positive item-rest values, although their distributions suggest a non-linear analysis, as was expected. All the items weighted strongly and positively in G factor. However, the IRT discrimination values advised us to reject some items because they were unable to differentiate adequately between F1 and F2. For these reasons, the 24 selected items were strong and positively weighted in the belonging factor and the model fit was very good. These items correlated highly with one another and internal consistency values were high, for G as well as for F1 and F2. Each item seemed to be measuring the corresponding latent variables, with possibly different degrees of precision and different amounts of error.
We found that G was significantly related to all the considered constructs, and therefore this finding supports the hypothesis that burnout syndrome could mediate the link between perceived stress and the occurrence of emotional disorders , , although it is well known that there are many others sources of stress, different from those related to work or workers in training. In other words, occupational stress could be an important risk factor for the development of anxious and depressive symptoms in dental students through burnout syndrome –. Thus, dealing with stress problems at an early stage of training may help to promote resilience and reduce burnout and mental health problems in the longer term . Nevertheless, in order to reach a full understanding of the process, it will be necessary to continue with research until the hypothetical relationships put forward can be fully brought to light. It will be necessary to make use of designs that allow possible causal relationships to be explained, particularly if we are interested in developing effective lines of intervention, given the lack of these in a setting that is so in need of them.
In addition, the pattern of relationships observed between the PSQ first-order factors and the other constructs suggests that while both F1 and F2 seems to be strongly associated with exhaustion, anxiety and depression, F1 could be more positively related than F2 to cynicism, and more negatively related to efficacy and resilience. In general, resilience increases the feelings of satisfaction and commitment that promote the empowerment of and beneficial outcomes for students and even workers –. In accordance with the demands-resources model , people who suffer from burnout experience a progressive decline in commitment to their studies over time . This is perhaps why resilience constitutes a coping reservoir that influences the long term functioning of university students [17,72). However, our results suggest that interventions focused on promoting resilience may be of benefit in overcoming frustration more than tenseness, while tenseness seems to be more important in this population. Combining resilience interventions with relaxation interventions could possibly be the best choice for dental students.
The PSQ showed a hierarchical bi-factor structure among Spanish dental students. Using the questionnaire as a unidimensional scale may be useful for discerning perceived stress levels, while the two sub-factors could help us to refine the perceived stress analysis and improve therapeutic processes. On the other hand, certain important psychometric aspects of the PSQ with regard to dental students remain unknown and should be examined in the future: first, whether the PSQ hierarchical bi-factor structure varies across male and female students; and second, whether differences in translations of the PSQ to other languages may have introduces variations as regards its factor structure and item loadings. Therefore, the PSQ hierarchical bi-factor structure model should be replicated in a large and multi-national sample of dental students.
Conceived and designed the experiments: JMM JGC. Performed the experiments: JMM JPP MO. Analyzed the data: JMM. Contributed reagents/materials/analysis tools: JMM. Wrote the paper: JMM MMPD.
- 1. Tisdelle DA, Hansen DJ, St Lawrence JS, Brown JC (1984) Stress management training for dental students. J Dent Educ 48(4): 196–202.
- 2. Dyrbye LN, Thomas MR, Shanafelt TD (2006) Systematic review of depression, anxiety and other indicators of psychological distress among U.S. and Canadian medical students. Acad Med 81(4): 354–373.
- 3. Watson R, Deary I, Thompson D, Li G (2008) A study of stress and burnout in nursing students in Hong Kong: a questionnaire survey. Int J Nurs Stud 45(10): 1534–1542.
- 4. Abu-Ghazaleh SB, Rajab LD, Sonbol HN (2011) Psychological stress among dental students at the University of Jordan. J Dent Educ 75(8): 1107–1114.
- 5. Mazurkiewicz R, Korenstein D, Fallar R, Ripp J (2012) The prevalence and correlations of medical student burnout in the pre-clinical years: a cross-sectional. Psychol Health Med 17(2): 188–195.
- 6. Campos JA, Jordani PC, Zucoloto ML, Bonafé FS, Maroco J (2012) Burnout syndrome among dental students. Rev Bras Epidemiol 15(1): 155–165.
- 7. Rajab LD (2001) Perceived sources of stress among dental students at the University of Jordan. J Dent Educ 65(3): 232–341.
- 8. Pöhlmann K, Jonas I, Ruf S, Harzer W (2005) Stress, burnout and health in the clinical period of dental education. Eur J Dent Educ 9(2): 78–84.
- 9. Alzahem AM, van der Molen HT, Alaujan AH, Schmidt HG, Zamakhshary MH (2011) Stress amongst dental students: a systematic review. Eur J Dent Educ 15(1): 8–18.
- 10. Gorter RC, Storm MK, te Brake JH, Kersten HW, Eijkman MA (2007) Outcome of career expectancies and early professional burnout among newly qualified dentists. Int Dent J 57(4): 279–285.
- 11. Lazarus R, Folkman S (1984) Stress, appraisal and coping. Barcelona: Martínez Roca. 46 p.
- 12. Maslach C, Schaufeli WB, Leiter MP (2001) Job burnout. Annu Rev Psychol 52: 397–422.
- 13. Maslach C, Jackson SE, Leiter MP (1996) Maslach Burnout Inventory. Palo Alto, CA: Consulting Psychologist Press.
- 14. Rutter M (1985) Resilience in the face of adversity: protective factors and resistance to psychiatric disorders. Br J Psych 147: 598–611.
- 15. Norris FH, Stevens SP, Pfefferbaum B, Wyche KF, Pfefferbaum RL (2008) Community resilience as a metaphor, theory, set of capacities and strategy for disaster readiness. Am J Community Psychol 41: 127–150.
- 16. Grafton E, Gillespie B, Henderson S (2010) Resilience: the power within. Oncol Nurs Forum 37(6): 698–705.
- 17. Dunn LB, Iglewicz A, Moutier C (2008) A conceptual model of medical student well-being: promoting resilience and preventing burnout. Acad Psychiatry 32(1): 44–53.
- 18. Gil-Monte PR, Moreno-Jiménez B (2007) The Burnout Syndrome: Professional Groups at Risk. Madrid: Pirámide Psicología.
- 19. Humphris G (1998) A review of burnout in dentists. Dent Update 25(9): 392–396.
- 20. Schaufeli W, Enzmann D (1998) The burnout companion to study and practice: A critical analysis. London: Taylor & Francis.
- 21. Rada RE, Jonson-Leong C (2004) Stress, burnout, anxiety and depression among dentists. J Am Dent Assoc 135(6): 788–794.
- 22. Mathias S, Koerber A, Fadavi S, Punwani I (2005) Speciality and sex as predictors of depression in dentists. J Am Dent Assoc 136(10): 1388–1395.
- 23. Toker S, Shirom A, Shapira I, Berliner S, Melamed S (2005) The association between burnout, depression, anxiety and inflammation biomarkers: C-reactive protein and fibrinogen in men and women. J Occup Health Psychol 10(4): 344–362.
- 24. Oliveira GS Jr, Chang R, Fitzgerald PC, Almeida MD, Castro-Alves LS, et al. (2013) The prevalence of burnout and depression and their association with adherence to safety and practice standards: a survey of United States anesthesiology trainees. Anesth Analg 117(1): 182–193.
- 25. Levenstein S, Prantera V, Varvo V, Scribano ML, Berto E, et al. (1993) Development of the Perceived Stress Questionnaire: a new tool for psychosomatic research. J Psychosom Res 37: 19–32.
- 26. Levenstein S, Prantera V, Varvo V, Scribano ML, Andreoli A, et al. (2000) Stress and exacerbation in ulcerative colitis: a prospective study of patients enrolled in remission. Am J Gastroenterol 95: 1213–1220.
- 27. Sanz-Carrillo C, García-Campayo J, Rubio A, Santed MA, Montoro M (2002) Validation of the Spanish version of the Perceived Stress Questionnaire. J Psychosom Res 52: 167–172.
- 28. Fliege H, Rose M, Arck P, Walter OB, Kocalevent RD, et al. (2005) The Perceived Stress Questionnaire (PSQ) reconsidered: validation and reference values from different clinical and healthy adult samples. Psychosom Med 67(1): 78–88.
- 29. Araya R, Montero-Marín J, Barroilhet S, Fritsch R, Montgomery A (2013) Detecting depression among adolescent in Santiago, Chile: sex differences. BMC Psychiatry 13: 122.
- 30. Ferrando PJ, Anguiano-Carrasco C (2010) El Análisis Factorial como técnica de investigación en Psicología. Papeles del Psicólogo 31: 18–33.
- 31. Goldberg D, Bridges K, Duncan-Jones P, Grayson D (1988) Detecting anxiety and depression in general medical settings. Br Med J 97: 897–899.
- 32. Montón C, Pérez-Echevarría MJ, Campos R, García-Campayo J, Lobo A (1993) Anxiety scales and Goldberg’s depression: an efficient interview guide for the detection of psychological distress. Aten Primaria 12(6): 345–349.
- 33. Barreto P, Corral ME, Muñoz MP, Boncompte R, Sebastián R, et al. (1998) Perception of psychological distress by the doctor in a basic health area. Aten Primaria 22: 491–496.
- 34. Martínez R, Baylín A, Ortiz MF (1999) Can we detect mental disorders in primary healthcare? Usefulness and concordance of two diagnostic instruments. Aten Primaria 23: 285–288.
- 35. Notario-Pacheco B, Solera-Martínez M, Serrano-Parra M, Bartolomé-Gutiérrez R, Carcía-Campayo J, et al. (2011) Reliability and validity of the Spanish version of the 10-item Connor-Davidson Resilience Scale (10-item CD-RISC) in young adults. Health Qual Life Outcomes 9: 63.
- 36. Campbell-Sills L, Stein MB (2007) Psychometric analysis and refinement of the Connor-Davidson Resilience Scale (CD-RISC): validation of a 10-item measure of resilience. J Trauma Stress 20: 1019–1028.
- 37. Schaufeli W, Martinez IM, Marques-Pinto A, Salanova M, Bakker A (2002) Burnout and engagement in university students: A cross-national study. J Cross Cult Psychol 33(5): 464–481.
- 38. Mardia K (1974) Applications of some measures of multivariate skewness and kurtosis in testing normality and robustness studies. Sankhya 36: 115–128.
- 39. Muthén B, Kaplan D (1992) A comparison of some methodologies for the factor analysis of non-normal Likert variables: A note on the size of the model. Br J Math Stat Psychol 45: 19–30.
- 40. Horn JL (1965) A rationale and test for the number of factors in factor analysis. Psychometrika 30: 179–185.
- 41. Buja A, Eyuboglu N (1992) Remarks on parallel analysis. Multivar Behav Res 27(4): 509–540.
- 42. Timmerman ME, Lorenzo-Seva U (2011) Dimensionality Assessment of Ordered Polytomous Items with Parallel Analysis. Psychol Methods 16: 209–220.
- 43. Hayton JC, Allen DG, Scarpello V (2004) Factor Retention Decisions in Exploratory Factor Analysis: a Tutorial on Parallel Analysis. Organ Res Methods 7: 191–205.
- 44. Ledesma RD, Valero-Mora P (2007) Determining the number of factors to retain in EFA: an easy-to-use computer program for carrying out Parallel Analysis. Practical Assessment, Research & Evaluation 12: 2.
- 45. García E, Gil J, Rodríguez G (2000) Análisis Factorial. Madrid: La Muralla.
- 46. Jöreskog KG (1977) Factor analysis by least-squares and maximum-likelihood methods. In Enslein K, Ralston A, Wilf HS, Editors. Statistical methods for digital computers. New York: Wiley. 125–153 pp.
- 47. Briggs NE, MacCallum RC (2003) Recovery of weak common factors by maximum likelihood and ordinary least squares estimation. Multivariate Behav Res 38: 25–56.
- 48. Lee Ch, Zhang G, Edwards MC (2012) Ordinary least squares estimation of parameters in exploratory factor analysis with ordinal data. Multivariate Behav Res 47: 314–339.
- 49. Knol DL, Berger MPF (1991) Empirical comparisons between factor analysis and multidimensional item response models. Multivariate Behav Res 26: 457–477.
- 50. Parry CDH, McArdle JJ (1991) An applied comparison of methods for least-squares factor analysis of dichotomous variables. Appl Psychol Meas 15: 35–46.
- 51. Bentler PM (1977) Factor simplicity index and transformations. Psychometrika 59: 567–579.
- 52. Lorenzo-Seva U (2003) A factor simplicity index. Psychometrika 68: 49–60.
- 53. Schmid J, Leiman JN (1957) The development of hierarchical factor solutions. Psychometrika 22: 53–61.
- 54. Reise SP, Moore TM, Haviland MG (2010) Bifactor models and rotations: Exploring the extent to which multidimensional data yield univocal scale scores. J Pers Assess 92: 544–559.
- 55. Reckase MD (1985) The difficulty of test items that measure more than one ability. App Psychol Meas 9: 401–412.
- 56. Múñiz J, Fidalgo AM (2005) Análisis de los ítems. Madrid: La Muralla. 88 p.
- 57. Byrne BM (2001) Structural equation modeling with Amos: Basic concepts, applications and programming. Mahwah, NJ: Erlbaum.
- 58. Hu LT, Bentler PM (1999) Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria vs. new alternatives. Struct Equ Modeling 6: 1–55.
- 59. Lévy JP, Martín MT, Román MV (2006) Optimización según estructuras de covarianzas. In Lévy JP, Varela J, editors. Modelización con Estructuras de Covarianzas en Ciencias Sociales. A Coruña: Netbiblo. 21–22 pp.
- 60. Bollen KA (1986) Sample size and Bentler and Bonett’s non-normed fit index. Psychometrika 51: 375–377.
- 61. Raykov T (1997) Estimation of composite reliability for congeneric measures. App Psychol Meas 2: 173–184.
- 62. Graham JM (2006) Congeneric and (essentially) tau-equivalent estimates of score reliability: What they are and how to use them. Educ Psychol Meas 66: 930–944.
- 63. Muraki E (1990) Fitting a polytomous item response model to Likert-type data. App Psychol Meas 14: 59–71.
- 64. King G (2003) The future of the replication movement. International Studies Perspectives 4(1): 100–105.
- 65. Russett B (2003) ‘The Journal of Conflict Resolution’s policy on replication’. International Studies Perspectives 4(1): 88–89.
- 66. Shah M, Hasan S, Malik S, Sreeramareddy CT (2010) Perceived Stress, sources and severity of stress among medical undergraduates in a Pakistani Medical School. BMC Med Educ 10: 2.
- 67. Ahola K, Honkonen T, Kivimäki M, Virtanen M, Isometsä E, et al. (2006) Contribution of burnout to the association between job strain and depression: the health 2000 study. J Occup Environ Med 48(10): 1023–1030.
- 68. Zhong J, You J, Gan Y, Zhang Y, Lu C, et al. (2009) Job stress, burnout, depression symptoms and physical health among Chinese university teachers. Psychol Rep 105(3 Pt 2): 1248–1254.
- 69. Tsukamoto K, Igata M, Hayashi T, Suzuki T (1995) The relationship between work factors and psychiatric symptoms: a comparison between anxiety and depression. Sangyo Eiseigaku Zasshi 37(5): 329–336.
- 70. Dragano N, He Y, Moebus S, Jöckel KH, Erbel R, et al. (2008) Two models of job stress and depressive symptoms. Results from a population-based study. Soc Psychiatry Psychiatr Epidemiol 43(1): 72–78.
- 71. Park SG, Min KB, Chang SJ, Kim HC, Min JY (2009) Job stress and depressive symptoms among Korean employees: the effects of culture on work. Int Arch Occup Environ Health 82(3): 397–405.
- 72. Fertleman C, Carroll W (2013) Protecting students and promoting resilience. BMJ 347: f5266.
- 73. Menezes de Lucena VA, Fernández B, Hernández L, Ramos F, Contador I (2006) Resilience and the burnout-engagement model in formal caregivers of the elderly. Psicothema 18(4): 791–796.
- 74. Everly GS, Smith KJ, Welzant V (2008) Cognitive-affective resilience indices as predictors of burnout and job-related outcome. Int J Emerg Ment Health 10(3): 185–189.
- 75. Larrabee JH, Wu Y, Persily CA, Simoni PS, Johnson PA, et al. (2010) Influence of stress resiliency on RN job satisfaction and intent to stay. West J Nurs Res 32(1): 81–102.
- 76. Pines EW, Rauschuber ML, Norgan GH, Cook JD, Canchola L, et al. (2012) Stress, resiliency, psychological empowerment and conflict management styles among baccalaureate nursing students. J Adv Nurs 68(7): 1482–1493.
- 77. Mealer M, Jones J, Newman J, McFann KK, Rothbaum B, et al. (2012) The presence of resilience is associated with a healthier psychological profile in intensive care unit (ICU) nurses: results of a national survey. Int J Nurs Stud 49(3): 292–299.
- 78. Schaufeli WB, Bakker AB (2004) Job demands, job resources and their relationship with burnout and engagement: a multi-sample study. J Organ Behav 25(3): 293–315.
- 79. Dahlin M, Nilsson C, Stotzer E, Runeson B (2011) Mental distress, alcohol use and help-seeking among medical and business students: a cross sectional comparative study. BMC Med Educ 11: 92.