http://orcid.org/0000-0003-4662-1999
Figures
Abstract
There is scarce research on stress in Spanish police officers and on the use of instruments to assess this construct in this professional group. In Spain, the DECORE questionnaire has been one of the most used. Nevertheless, it had not been previously applied to police officers. The aim of this study was to analyze both the construct validity and the reliability of the original model of 44 items. A cross-sectional design and a non-probabilistic quota sampling were used. A total of 223 Spanish police officers participated. 202 police personnel were men (90.6%) and 21 were women (9.4%). The average age was 41 years old (SD = 7.52). These police officers answered the DECORE questionnaire. Confirmatory Factor Analysis was carried out. The results showed an unsatisfactory adjustment using the original model of 44 items. A final solution of 21 items and four factors was formulated with both suitable validity and reliability indexes. In this model, 23 items that did not weigh highly in any of the four factors were removed. The DECORE-21 questionnaire is recommended to assess work-related stress in police officers.
Citation: Talavera-Velasco B, Luceño-Moreno L, Martín García J, Vázquez-Estévez D (2018) DECORE-21: Assessment of occupational stress in police. Confirmatory factor analysis of the original model. PLoS ONE 13(10): e0205028. https://doi.org/10.1371/journal.pone.0205028
Editor: Antonio Palazón-Bru, Universidad Miguel Hernandez de Elche, SPAIN
Received: April 30, 2018; Accepted: September 17, 2018; Published: October 4, 2018
Copyright: © 2018 Talavera-Velasco et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: These data have been collected from a study conducted and promoted in the Laboratory of Organizational Psychology and Safety Studies from Complutense University of Madrid, Spain. The favorable report of Deontology Commission of the Faculty of Psychology of the Complutense University of Madrid was obtained to carry out this research. Requests for data may be sent to the Laboratory of Organizational Psychology and Safety Studies at the following address: Campus de Somosaguas s/n, 28223 Pozuelo de Alarcón, Madrid, Spain; Tel: 913943174; lab.psitrabajo@ucm.es. We confirm that interested researchers would be able to access these data in the same manner as the authors. The authors did not have any special access privileges that others would not have.
Funding: This study has not received funding.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The number of research articles focusing on psychosocial risk factors at work has increased in the last fifteen years, due to the relationship with occupational stress [1]. The European Commission defines the term occupational stress as the “set of emotional, cognitive, physiological and behavioral reactions to harmful aspects of the content, organization or context of the work. It is a condition that is characterized by high levels of excitation, distress and the feeling of not being able to do anything” [2]. Psychosocial risk factors at work can negatively affect the health of the worker, producing stress [3]. They are defined as “those conditions that are present in a labor situation and that are directly related to the organization, the content of the work and the accomplishment of the task, and that have aptitude to concern so much the well-being or the health (physical, psychological or social) of the worker as the development of the work” [4]. Examples of psychosocial risk factors at work are the lack of control during tasks, unforeseeable work schedules, social isolation, labor uncertainty or the perception of high job demands. Specifically, the perception of: lack of control of work, interpersonal conflicts, perception of high job demands (like the increase of both work hours and workload), or the perception of low organizational support are some of the psychosocial risk factors at work related to cardiovascular problems [5], anxiety, depression [6] or musculoskeletal disorders [7].
There are different instruments that assess the psychosocial risk factors at work such as questionnaires, inventories or scales, check-lists, administrative information, interviews, discussion groups (or focus-group) and the information contained in the job description. Questionnaires have been widely used because of: their anonymous character, easiness to fill in, standardized characteristics and the fact that they allow us to obtain an important quantity of information in little time, making them very practical tools [3].
The questionnaires most used for the assessment of the stress at work that appear in the scientific bibliography are the following ones: a) Job Content Questionnaire-JCQ [8]; b) Effort-Reward Imbalance Questionnaire-ERI-Q [9]; and, c) Job Stress Survey-JSS [10]. In Spain, the DECORE questionnaire to assess the psychosocial risks has shown evidences of validity and reliability [11]. However, it is necessary to apply the questionnaire in other job positions, different from the ones used in the original adaptation of the questionnaire. In addition, it is advisable to examine the psychometric properties of the instruments of evaluation in different samples throughout the time [12]. The DECORE questionnaire has been applied in military personnel but not in other security forces such as the police.
In general, the police profession is characterized for being a job position of high risk for the development of occupational stress. Police officers must assist citizens and carry out monotonous tasks. Usually they feel stressed out and they feel that they are overloaded in their work [13]. Most of the stressors perceived by police officers come from both the organization and their tasks [14], so there is a high probability that these workers suffer from work-related stress and health problems [15]. Some tasks, such as, mediating in conflicts between citizens, directing traffic, reporting infractions, enforcing the law, attending to citizens or pursuing organized crime, produce high levels of stress in police officers [16, 17].
Organizational support has been one of the factors that have best explained stress in police officers. For these workers, the support received from colleagues and supervisors is essential [18]. Other factors such as the perception of low control over labor demands in different situations make the work of the police highly stressful [19], and consequently they have a greater probability of suffering from cardiovascular diseases [20] and poor mental health [21].
Only one study has been found that treats the differences in stress between local police officers according to gender, seniority or type of work-shift in Spain [22]. Therefore, it is necessary to carry out studies on the assessment of stress in this profession. Nevertheless, it is true that both the access to this type of sample and the assessment of the psychosocial risk factors are difficult, due to the reticence of some members of the organization [23]. For this reason, it becomes necessary to perform more precise evaluations, reduce their duration and develop specific instruments for assessment in this profession.
Therefore, the aim of this research was to validate the DECORE questionnaire in a sample of police officers, with the intention of assuring that its psychometric properties are adequate, and its application is useful for this professional group.
Materials and methods
Participants
For this research, a cross-sectional design and a non-probabilistic quota sampling was used. This type of sampling means that, despite all the police officers who participated did so voluntarily, it was necessary that they meet several requirements. Those officers who had at one year seniority at least in the work place at and the same police station were selected. The total sample consisted of 223 police officers from Madrid, Spain. Of the total number of participants, 202 were men (90.6%) and 21 women (9.4%). The average age was 41 years old (SD = 7.52). The average of job seniority was 14 years (SD = 13.90). The average work hours per week was 38 hours (SD = 8.87). Regarding the type or shift, 36.8% of the total number worked in the morning shift; 27.4% had the afternoon shift; 23.8% worked in the night shift; finally, 12% had a rotating shift. All the participants were local police officers.
Instrument
To assess the perception of the psychosocial risk factors at work, the DECORE Questionnaire for the Psychosocial Risk Assessment [11] was applied. This questionnaire assesses the perception that the workers have on the following psychosocial risk factors: excess (or shortage) of cognitive demands, lack of control, little organizational support and lack of rewards. The questionnaire consists of 44 items and the following scales: a) Cognitive demands (12 items): it refers to the requirements that workers must meet, which are related to the perception of the quantitative workload that the worker carries out. Examples of items of this scale are: "I feel a lot of time pressure to do my job" or "I work more hours than necessary"; b) Control (9 items): the items of this scale assess the possibilities that the worker has so that he can determine both the methods of organization of work and the decisions related to the organization of work activities. Examples of items: "I can interrupt my work if necessary" or "I have little freedom to decide the way of doing the work"; c) Organizational support (12 items): it assesses the perception of the workers about the relationships that they have with colleagues and supervisors. Examples of items of this scale would be: "Relations with my coworkers are good" or "In my work I have easy access to colleagues and superiors"; and, finally, d) Rewards (11 items): The items of this scale assess the benefits that the worker perceives due to the performance of his/her tasks (specially, it assesses the perception of salary and job safety). Examples of items would be: "I think that the pay policy of my company is adequate" or "The future prospects of an increase in salary are good". Apart from the scoring on every scale, it is possible to calculate the Global Risk Index (IGR). This index offers an overall scoring of the perception of psychosocial risk, considering the average of the scores of the four dimensions. All the items are answered on a five-point Likert scale, ranging from 1 (strongly disagree) to 5 (strongly agree). A high score indicates a very adverse situation from the point of view of the psychosocial risk (the worker perceives excessive cognitive demands, lack of control, scarce organizational support and few rewards in his/her work). The range of scores for each of the scales, as well as for the global scale, ranges between 100 and 500. A high score indicates that the worker perceives the psychosocial risk factors adversely. The validity of the questionnaire was analyzed by factor analysis, resulting in a structure made up of four factors. The coefficients Cronbach’s alpha are ranged between .81 and. 84, so the questionnaire is considered as an instrument that presents suitable evidence of validity and reliability [22, 24]. Nevertheless, though the psychometric properties of the questionnaire are robust in other samples, it has not been applied previously in police officers.
Procedure
This study was approved by the Ethics Committee of the Faculty of Psychology of the Complutense University of Madrid, obtaining a favorable report on February 2017 (Ref. 2016/17-012). Representatives of workers and local police departments were informed of the nature of this research and its voluntary and anonymous nature. A collaborative agreement was signed between the police corps and the Complutense University of Madrid. In this agreement, special attention was paid to the preservation of anonymity and the objective of using the data with a purely scientific and investigative purpose was specified, without prejudice to the participating police officers or to the organization. The policemen completed the questionnaire and signed an informed consent. The questionnaires were administered in paper form and gathered in closed envelope for each participant. 225 questionnaires were completed, but two police officers had to be eliminated from the sample because they answered less than 50% of the items.
Data analysis
The data analyses were carried out with the Lavaan package [25] of the programming environment R [26], using the R Studio interface [27] and the statistical package SPSS for Windows 21.0 [28]. The psychometric properties of the original model of 44 items of the DECORE questionnaire were analyzed. Construct validity and reliability analyses were carried out. A Confirmatory Factor Analysis (CFA) was conducted, since the theoretical model was already specified [29]. The criterion of Brown (2006) was used to assess the results [30]. This criterion recommends using CFI (Comparative Fit Index), TLI (Tucker-Lewis Index), RMSEA (Root Mean Square Error of Approximation) and SRMR (Standardized Root Mean Square Residual) indices to calculate both the satisfactory global functioning and model adjustment. Different indices of reliability were calculated: Cronbach’s alpha and McDonald’s Omega [31, 32].
Results
Construct validity
Regarding this type of validity, the indices CFI, TLI, RMSEA and SRMR were analyzed to assess the adjustment of the original model of 44 items in this sample (Table 1).
Since it can be observed in Table 1, the fit indices CFI, TLI and SRMR for the original model of 44 items grouped in four factors (cognitive demands, control, organizational support and rewards) were below acceptable values (.82, .80, and .12, respectively). Only RMSEA remained adequate (.08).
At this point, the original model of DECORE was examined deeply. In this study, we detected items that did not seem to work the same way as on the original structural model, since they did not weigh highly in any of four factors. Therefore, we checked the factorial load of all the items of the model of 44 items. The obtained results can be observed in the Table 2. A conservative criterion was used, and items whose weight was lower than .60 were eliminated (Table 2). Items were eliminated depending on: the factorial loads, indices of modification, distribution analysis, reliability analysis as long as the content validity were not harmed.
In total, 23 items were eliminated: 8 items of the Cognitive Demands factor; 5 items of the Control factor; 6 items of the Organizational Support factor; and, finally, 4 items of the Rewards dimension. After the elimination of the previous items, another CFA was carried out using the same fit indices. An adequate adjustment was found with the model of four factors and 21 items in the sample of this study (Table 3).
As it can be observed in Table 3, by eliminating 23 items, a suitable adjustment of the model is obtained keeping its four dimensions. The Cognitive demands scale is now made up of 4 items, the same as the Control scale; the Organizational support scale consists of 6 items and the Rewards scale consists of 7 items.
The correlations, averages and standard deviations for each factor (cognitive demands, control, organizational support and rewards) are shown in Table 4.
Table 4 shows the correlations between the different factors. A lowest value of .16 is obtained (p < .05) between cognitive demands and organizational support dimensions. The maximum value of .53 (p < .01) is reached between the control and organizational support factors. The averages in the different dimensions reveal values closer to 500 in all factors, the ones obtained in the cognitive demands (396.86) and rewards (342.99) dimensions being the highest averages.
Reliability
The indices of reliability were calculated in both versions of the questionnaire (44 and 21 items) (Table 5).
As we can see in Table 5, using the Cronbach’s alpha index, the levels of reliability are between .73 and .85 for all the scales of DECORE-44. The values of the omega index are similar to those of Cronbach’s alpha, with values between .76 and .88 in the scales of DECORE-44. With the new model of 21 items, the reliability indices are similar to the original model of 44 items. Only the Cognitive demands scale shows a value of .60 using alpha, although it comes closer to .70, using the omega index.
As a final result, the items of DECORE-21 questionnaire can be viewed in the Table 6.
Discussion
The aim of this study was to assess the psychometric properties of the original version of 44 items of the DECORE questionnaire in a sample of Spanish police officers. The CFA showed an unsuitable fit. The analyses carried out indicated that some items presented low factorial weights. A conservative criterion was adopted, since it was considered necessary to eliminate the greater number of items that did not show adequate factorial weights, in order to shorten the time of application of the questionnaire in a sample of difficult access.
It is important to mention that, of the total number of 23 eliminated items, three of them presented values closer to .60: "I can decide the order in which I do my work", "I do not have any flexibility in organizing my work schedules" and "My work is demanding from an emotional point of view, due, for example, to contact with patients, clients, students, etc.". Specifically, the factorial loads of these items were: .596, .593 and .595, respectively. These three items should be analyzed in other studies to assess if they have a more satisfactory functioning in other samples. In this research, it was decided not to work with these three items because with 21 items the adjustment was satisfactory. Also, a minimum of four items were obtained by factor or dimension. Therefore, suitable psychometric properties are maintained with 21 items, and the use of this questionnaire is recommended in the police group. In addition, two indices of reliability were calculated. Commonly, Cronbach’s alpha index is used, though this index can underestimate the reliability in some cases. The omega index complements the information and can be considered useful, although its use is recommended with wide samples (N > 700).
This instrument could be used along other tools for measurement of burnout and symptoms associated with job stress in police officers. In Spain, the Burnout Granada’s Questionnaire was developed specifically for national police officers [33]. This questionnaire is composed by 26 items that assess the three factors for burnout. This one has been the only questionnaire that specializes in Spanish police officers. In comparison with the latter questionnaire, the DECORE-21 questionnaire presents a less number of items, evaluating the psychosocial risk factors (not the burnout construct), which facilitates the detection of variables related to stress that are susceptible to being manipulated by the organization in order to avoid development of chronic stress.
A greater number of studies on stress in police officers are necessary because of the difficulty of accessing these types of samples in the Public Administration [23]. Only ten studies with samples from police officers have been published in Spain in the last four years, although some of these studies investigated the transformational leadership in police, not stress [34]. Thus, it is necessary to consider that the psychosocial risk factors precede the appearance of chronic occupational stress and interventions can be designed to reduce the perceived stress. The Demand-Control model has been applied in samples of police officers in relation to the burnout syndrome, concluding that the perception of high job demands and scarce control over work environments are associated with emotional exhaustion, low perception of professional auto-efficacy and high levels of depersonalization [35, 36].
One of the principal contributions of this work is the validation of the DECORE-21 questionnaire for the assessment of the psychosocial risk factors at work in policemen. This version shortens the time for completing all the items, considering that the psychometric properties are improved. Comparing both versions of DECORE, the time for filling out the model of 21 items is reduced to approximately 25 minutes.
In other countries that are different than Spain, occupational stress has been evaluated specifically in police officers with the Police Stress Questionnaire [37]. This instrument consists of two scales (each of 20 items) designed to assess operational (PSQ-Op) and organizational (PSQ-Org) stress. The PSQ-Op measures different stressors, for example, fatigue and health problems related to work. The PSQ-Org measures stressors such as difficulties related to with lack of resources, red tape and staff shortages. The questionnaire is composed by 40 items [38]. In this regard, DECORE-21 shortens the time to fill it in and it includes the principal psychosocial risk factors that turn out to be more related to stress and disease in the bibliography. DECORE-21 measures the main factors that appear separately in other famous questionnaires: Job Content Questionnaire and Effort-Reward Imbalance Questionnaire (both mentioned in the Introduction section). Definitively, this tool allows detecting the factors that precede chronic stress in a profession such as the police, in which personnel are capable of suffering risk situations that generate stress and produce psychological exhaustion [39, 40].
Despite of the strengths of DECORE-21 questionnaire, it would be interesting in future studies to examine other types of validity, discriminating validity for example, as well as to extend the sample and to compare different results with the ones obtained in other countries. All these studies can improve the assessment of occupational stress in police officers.
References
- 1.
Houdmont J, Leka S. Contemporary occupational health psychology. Oxford: Wiley-Blackwell; 2010.
- 2.
European Commission. Work-related stress guide. The “spice of life” or the “kiss of death”? Luxembourg: Official Publications of the European Communities; 2010.
- 3.
Moreno-Jiménez B, Báez C. Psychosocial risk factors: forms, consequences, measures and best practice. Madrid: NISH; 2010.
- 4.
National Institute of Health and Safety, NIHS. II National Survey of Work Conditions. Barcelona: NIHS; 1997.
- 5. Kivimäki M, Nyberg ST, Fransson EI, Heikkilä K, Alfredsson L, Casini A, et al. Associations of job strain and lifestyle risk factors with risk of coronary artery disease: A meta-analysis of individual participant data. CMAJ. 2013; 185(9):763–9. https://doi.org/10.1503/cmaj.121735 pmid:23670152
- 6. Nieuwenhuijsen K, Bruinvels D, Frings-Dresen M. Psychosocial work environment and stress-related disorders, a systematic review. Occup Med. 2010; 60(4):277–86. https://doi.org/10.1093/occmed/kqq081 pmid:20511268
- 7. Lang J, Ochsmann E, Kraus T, Lang JW. Psychosocial work stressors as antecedents of musculoskeletal problems: A systematic review and meta-analysis of stability-adjusted longitudinal studies. Soc Sci Med. 2012; 75(7):1163–74. https://doi.org/10.1016/j.socscimed.2012.04.015 pmid:22682663
- 8.
Karasek RA. Job Content Questionnaire and user’s guide. Lowell: University of Massachusetts Lowell, Department of Work Environment; 1985.
- 9.
Siegrist J. Adverse health effects of Effort-Reward Imbalance at work: Theory, empirical support and implications for prevention. In: Cooper CL, editor. Theories of Organizational Stress. Oxford: Oxford University Press; 1998. pp. 190–204.
- 10. Vagg PR, Spielberger CD. The Job Stress Survey: Assessing perceived severity and frequency of occurrence of generic sources of stress in the workplace. J Occup Health Psychol. 1999; 4(3):288–92. http://dx.doi.org/10.1037/1076-8998.4.3.288 pmid:10431288
- 11.
Luceño-Moreno L, Martín-Garcia J. DECORE. Questionnaire for the psychosocial risk assessment. Madrid: TEA Editions; 2008.
- 12.
American Educational Research Association, American Psychological Association, National Council on Measurement in Education. The standards for educational and psychological testing. Washington, DC: AERA Publications Sales; 2014.
- 13. Gu G, Yu S, Wu H, Zhou W. The effect of occupational stress on depression symptoms among 244 policemen in a city. Zhonghua Yu Fang Yi Xue Za Zhi. 2015; 49(10):924–9. https://doi.org/10.3760/cma.j.issn.0253-9624.2015.10.017 pmid:26813728
- 14. Garbarino S, Cuomo G, Chiorri C, Magnavita N. Association of work-related stress with mental health problems in a special police force unit. BMJ Open. 2013; 3:1–12. https://doi.org/10.1136/bmjopen-2013-002791 pmid:23872288
- 15. Van der Velden PG, Rademaker AR, Vermetten E, Portengen MA, Yzemans JC, Grievink L. Police officers: A high-risk group for the development of mental health disturbances? A cohort study. BMJ Open. 2013; 3:1–9. http://dx.doi.org/10.1136/bmjopen-2012-001720 pmid:23355659
- 16. Korre M, Farioli A, Varvarigou V, Sato S, Kales SN. A survey of stress levels and time spent across law enforcement duties: Police chief and officer agreement. Policing. 2014; 8(2):109–22. https://doi.org/10.1093/police/pau001
- 17. Patil RR, Chetlapally SK, Bagavandas M. Global review of studies on traffic police with special focus on environmental health effects. Int J Occup Med Environ Health. 2014; 27(4):523–35. https://doi.org/10.2478/s13382-014-0285-5 pmid:25034905
- 18. Page K, Jacobs S. Surviving the shift: Rural police stress and counseling services. Psychol Serv. 2011; 8(1):12–22. http://dx.doi.org/10.1037/a0021796
- 19. Violanti JM. Introduction to special issue: Stress and health in law enforcement. Int J Emerg Ment Health. 2011; 13(4):209–10. pmid:22900454
- 20. Duxbury L, Higgins C, Halinski M. Identifying the antecedents of work-role overload in police organizations. Crim Justice Behav. 2015; 42(4):361–81. https://doi.org/10.1177%2F0093854814551017
- 21. Gerber M, Kellmann M, Elliott C, Hartmann T, Brand S, Holsboer-Trachsler E. et al. Perceived fitness protects against stress-based mental health impairments among police officers who report good sleep. J Occup Health. 2014; 55(5):376–84. https://doi.org/10.1539/joh.13-0030-OA pmid:23892642
- 22. García-Albuerne Y, Pérez-Nieto MA, Luceño-Moreno L. Shiftwork and psychosocial stress in the local police officers of Madrid. Anxiety & Stress. 2015; 21(1):57–70.
- 23. Sánchez-Teruel D, Robles MA. Personality and resilience in a special corps of the National Police in Spain. J Work Organ Psychol. 2014; 30(2):75–81. http://dx.doi.org/10.1016/j.rpto.2014.06.003
- 24. Luceño-Moreno L, Martín-García J, Rubio S, Díaz E. Confirmatory factor analysis of the DECORE questionnaire. Anxiety & Stress. 2010; 16(2–3):237–48.
- 25. Rosseel Y. Lavaan: An R package for structural equation modeling. Journal of Statistical Software. 2012; 48(2):1–36. http://dx.doi.org/10.18637/jss.v048.i02
- 26.
R Development Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing: Vienna; 2011.
- 27. Racine JS. R Studio: A platform-independent ide for R and sweave. J Appl Econ. 2012; 27(1):167–72. https://doi.org/10.1002/jae.1278
- 28.
IBM Corp. Released. IBM SPSS Statistics for Windows, version 21.0. Armonk, NY: IBM Corp; 2012.
- 29. Lloret S, Ferreres A, Hernández-Baeza A, Tomás I. Exploratory item factor analysis: A practical guide revised and updated. Ann Psychol. 2014; 30(3):1151–69. http://dx.doi.org/10.6018/analesps.30.3.199361
- 30.
Brown TA. Confirmatory factor analysis for applied research. New York: Guilford Press; 2006.
- 31.
McDonald RP. Test theory. A unified treatment. Mahwah, NJ: Lawrence Erlbaum Associates; 1999.
- 32. Revelle W, Zinbarg RE. Coefficients alpha, beta, omega and the glb: Comments on Sijtsma. Psychometrika. 2009; 74:145–54. https://doi.org/10.1007/s11336-008-9102-z
- 33. De la Fuente EI, Lozano LM, García-Cueto E, San Luis C, Vargas C, Cañadas GR, et al. Development and validation of the Granada Burnout Questionnaire in Spanish police. Int J Clin Health Psychol. 2013; 13(3):216–25. https://doi.org/10.1016/S1697-2600(13)70026-7
- 34. Álvarez O, Lila M, Tomás I, Castillo I. Transformational leadership in the local police in Spain: A leader-follower distance approach. Span J Psychol. 2014; 17:1–9. https://doi.org/10.1017/sjp.2014.44
- 35. Park HI, Jacob AC, Wagner SH, Baiden M. Job control and burnout: A meta-analytic test of the Conservation of Resources model. Appl Psychol. 2014; 63(4):607–42. http://dx.doi.org/10.1111/apps.12008
- 36. Taris TW, Kompier MA, Geurts SA, Houtman IL, van den Heuvel FF. Professional efficacy, exhaustion and work characteristics among police officers: A longitudinal test of the learning-related predictions of the Demand-Control model. J Occup Organ Psychol. 2010; 83(2):455–74. https://doi.org/10.1348/096317909X424583
- 37. Acquadro D, Varetto A, Zedda M, Ieraci V. Occupational stress, anxiety and coping strategies in police officers. Occup Med. 2015; 65(6):466–73. https://doi.org/10.1093/occmed/kqv060 26048331
- 38. McCreary DR, Thompson MM. Development of two reliable and valid measures of stressors in policing: The operational and organizational police stress questionnaires. Int J Stress Manag. 2006; 13(4):494–518. http://dx.doi.org/10.1037/1072-5245.13.4.494
- 39.
Fernández CJ, Yñiguez A. Strategic management of the Police: Organization of the efficiency in the police work. Sevilla: Punto Rojo; 2014.
- 40. Vilardell J, Martí G, Solé i Sanosa MA. Assessment of psychological conditions for the use of firearms in law enforcement. Med Clin. 2014; 142(2):30–6. https://doi.org/10.1016/S0025-7753(14)70069-7 pmid:24913751