Figures
Abstract
Introduction
Pregnancy and perinatal periods are significant risk factors of intimate partner violence (IPV), a major public health problem that could begin or intensify during these periods. Perinatal care providers have a major role in the identification and the management of IPV. This study aimed to cross-culturally adapt into French the Physician Readiness to Manage Intimate Partner Violence Survey (PREMIS) tool, a reliable instrument to assess the knowledge, attitudes and preparedness to address IPV, and to evaluate its psychometric properties.
Methods
The PREMIS was cross-culturally adapted by conducting forward and backward translations, following international guidelines. An online cross-sectional study was conducted to assess the psychometric properties of the PREMIS-French in perinatal care providers: data completeness, factor analysis, score distribution, floor and ceiling effects, internal consistency, item-total correlations, inter-subscale correlations and test-retest reliability.
Results
The PREMIS was successfully translated and cross-culturally adapted to the context of metropolitan France. The results obtained from 360 perinatal care providers showed good acceptability. Exploratory factor analysis of the “Opinions” items resulted in a six-factor solution with six of the eight subscales of the original structure identified. Good internal consistency (Cronbach’s alpha ranging from 0.54 to 0.97) and good test-retest reliability (intraclass correlation coefficients ranging from 0.46 to 0.92) for the “Background” and “Opinions” subscales were found.
Discussion
This study provides evidence of the good psychometric properties of the PREMIS-French. This valid instrument will help to understand perinatal care providers’ barriers to IPV screening and management and will help to focus on specific lacks of knowledge for developing IPV education programs.
Citation: Guiguet-Auclair C, Debost-Legrand A, Lémery D, Barasinski C, Mulin B, Vendittelli F (2021) Measuring the readiness to screen and manage intimate partner violence: Cross-cultural adaptation and psychometric evaluation of the PREMIS tool for perinatal care providers. PLoS ONE 16(11): e0258943. https://doi.org/10.1371/journal.pone.0258943
Editor: Stefano Federici, University of Perugia: Universita degli Studi di Perugia, ITALY
Received: June 14, 2021; Accepted: October 9, 2021; Published: November 4, 2021
Copyright: © 2021 Guiguet-Auclair et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data underlying this study have been uploaded to: Guiguet-Auclair, Candy; Debost-Legrand, Anne; Lémery, Didier; Barasinski, Chloé; Mulin, Blandine; Vendittelli, Françoise (2021), “Measuring the readiness to screen and manage intimate partner violence: cross-cultural adaptation and psychometric evaluation of the PREMIS tool for perinatal care providers”, Mendeley Data, V2, doi: 10.17632/7x989dtpk7.2.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Intimate partner violence (IPV) is well recognized as a major public health problem [1]. IPV prevalence in Europe is estimated to exceed 20% in women aged 15 years and older and is higher in women of reproductive age [2]. Pregnancy and perinatal periods are significant risk factors of IPV that could begin or intensify during these periods. In 2013, a meta-analysis reported a mean IPV prevalence rate among pregnant women of 19.8% for 23 countries; the mean reported prevalence of abuse was 28.4% for emotional abuse, 13.8% for physical abuse and 8.0% for sexual abuse [3]. Acts of violence during pregnancy affects directly and indirectly the mortality and the morbidity of the child and the mother. IPV is associated to unwanted pregnancies, termination of pregnancy [4] and adverse maternal and neonatal outcomes [5–7]. Moreover, the prevalence of maternal death by homicide was estimated between 13 and 24%, considering all causes of deaths during pregnancy [8].
Given these serious health consequences, healthcare professionals specializing in the perinatal period (perinatal care providers), have a major role in the identification and the management of abused women. The French National Health Authority recommended in 2019 that perinatal care providers screen all women for IPV during the first prenatal visit and continue at least once per trimester and during postpartum visits [9], in accordance with international guidelines [10]. Pregnancy is recognized as a privileged moment to detect past or current violence suffered by a woman. Indeed, the frequency of prenatal consultations and the bond of trust that is established between the care provider and the women offer the opportunity to disclose IPV.
However, several studies shown that IPV screening was not always done by healthcare professionals, often in reason of insufficient preparedness [11–13]. In 2014, the French inter-ministerial mission for the protection of women victims of violence and the fight against human trafficking conducted a national study to evaluate the midwives’ IPV knowledge and their ability to screen IPV with a non-validated questionnaire [14]. They reported insufficient education on IPV and limited knowledge. Almost one third had never assessed their patients’ exposure to IPV and in case of IPV, 81% felt insufficiently prepared. Nonetheless, 90% considered that midwives had a role to play in the disclosure and management of IPV. The reasons given for not screening were the lack of training, the absence of clear referral procedures and the ignorance of appropriate response or local specialist IPV services. Similar results were found among Italian midwives [15]. An American study identified in 2015 that 31.2% of obstetricians-gynecologists screen all pregnant patients at specific times of their pregnancy and 36.8% report insufficient training to assist their patients in addressing IPV [16].
Thus, the creation of specific IPV education and training programs for perinatal care providers, teaching how to recognize and respond to IPV is primordial [17,18], as well as assessing the effectiveness of these educational interventions with reliable outcomes. Among them, the PREMIS (Physician Readiness to Manage Intimate Partner Violence Survey), developed by Short et al. in 2006, is a valid and reliable self-reported instrument designed to measure the knowledge, attitudes and preparedness of physician to manage IPV [19]. They demonstrated evidence for its construct validity, internal consistency (with Cronbach’s alpha higher than 0.65 for reliable subscales), predictive validity, external validity (correlations between self-reported practices and observed clinical behaviors) and temporal stability over 12 months in the absence of IPV education or intervention. The developers shown that the PREMIS could discriminate between trained and untrained physicians [20].
This instrument has been adapted and widely used in multiple populations, cultures and languages [16,21–33]. It was also used to measure the effectiveness of IPV training programs proposed to physicians [20], practicing general practitioners and residents of general practice [34], nurses [35], and healthcare providers working in fracture clinics [36].
To our knowledge, no study in France assessed with a valid and reliable tool neither IPV knowledge of perinatal care providers nor their ability to identify and address IPV victims. Thus, we performed a study to cross-culturally adapt and evaluate the psychometric properties of a French version of the PREMIS tool.
Methods
Study design and participants
This cross-sectional online study was conducted from May 2017 to December 2019 in two phases: first, the original PREMIS was cross-culturally adapted from English to French; then psychometric properties of the French version of PREMIS were assessed.
The study was approved by the French regional ethics committee “Comité d’Ethique des Centres d’Investigation Clinique de l’inter-région Rhône-Alpes-Auvergne, CE-CIC Grenoble” (n° IRB 0005921, 03 October 2016). The aims and procedures were explained to participants, who gave their written informed consents.
An online link was created and data were collected using REDCap electronic data capture tools hosted at Clermont-Ferrand University Hospital. The French Federation of Perinatal Heath Network (‘Fédération Française des Réseaux de Santé en Périnatalité’) invited by email its care providers’ memberships (except healthcare students) to take part in the study and spread the internet link to complete the questionnaire. A reminder was done one time during the period of the study.
To assess test-retest reliability of the PREMIS, the internet link to complete the questionnaire a first time was sent by email to a subsample of memberships of two regional perinatal networks who were identified by their email address. They completed a second time the same questionnaire online between fifteen days and one month after the first assessment. Respondents who reported having a training course about IPV between test and retest were excluded for this reliability analysis.
The sample size of the study was determined according to quality criteria established by COSMIN [37] and Terwee et al. [38] that recommend a minimum number of 100 subjects to ensure satisfactory factor analysis and internal consistency evaluation and a sample size of at least 50 subjects in order to guarantee an acceptable assessment for reliability.
The PREMIS tool
The PREMIS self-administrated questionnaire contains 67 items comprising five sections: “Respondent profile”, “Background”, “Actual IPV Knowledge”, “Opinions” and “Practice issues”.
From the “Background” section, two subscales scores are obtained by calculating the mean of the individual scores of the items listed in the subscale. The ‘Perceived preparation’ subscale includes 12 items asking respondents how prepared they feel to assist IPV victims and rated on a 7-point Likert scale from 1 (not prepared) to 7 (quite well prepared). The ‘Perceived knowledge’ subscale includes 16 items asking respondents how much respondents feel they know about IPV and rated on a 7-point Likert scale from 1 (nothing) to 7 (very much).
In the “Actual IPV Knowledge” section, a combination of 7 multiple choice items and 11 true/false items (on IPV risk, manifestations, victim’s behavior and physician’s professional practice) form the ‘Actual knowledge’ subscale, scored by the number of correct items.
The “Opinions” section includes 36 items, rated on a 7-point Likert scale from 1 (strongly disagree) to 7 (strongly agree) and evaluating attitudes, beliefs and physician’s role in IPV management, on which 31 items forms six reliable subscales in the original version of PREMIS: ‘Preparation’, ‘Legal requirements’, ‘Workplace issues’, ‘Self-efficacy’, ‘Alcohol/drugs’ and ‘Victim understanding’. Two other subscales, ‘Constraints’ and ‘Victim autonomy’, needed future testing for validity and reliability.
Scores are obtained by calculating the mean of the individual scores of the items listed in the subscale (provided that answers are given to at least half of the items), with reversed scores for negatively worded opinion items.
The 13 items of the “Practice issues” section evaluated self-reported behaviors and personal IPV experience of the respondent, with various responding options.
Translation and cross-cultural adaptation of the French version of PREMIS
The PREMIS questionnaire was translated from English into French and cross-culturally adapted to be relevant to the French context, following international guidelines for the adaptation of self-administered instruments [39].
Forward translations were independently made by two bilingual translators fluent in English, with French as mother tongue, and naïves to the outcome measure. A multidisciplinary expert committee (composed of an obstetrician-gynecologist practicing forensic assessments, an obstetrician-gynecologist supervising a perinatal network, a referent midwife for IPV, and methodologists) reviewed the two translations and edited a first consensus French version. Cultural adaptations and linguistic equivalence with the original English version of PREMIS were discussed.
Then a native English translator fluent in French, blinded to the original English version then made a backward translation. The expert committee compared source and target versions, and resolved discrepancies. Item translation, semantic, idiomatic, cultural, experiential, and conceptual equivalents were discussed. The consensus French version was pre-tested on a sample of ten health care providers (general practitioners, obstetrician-gynecologists, and midwives) in order to evaluate the comprehensibility of instructions and items. Their responses and comments were reviewed.
The evaluation of psychometric properties (given in details below) was then conducted.
Statistical analysis
Statistical analysis were performed with SAS software (version 9.4, SAS Institute, Cary, NC, 2002–2012) and conducted at a two-sided alpha = 0.05 significance level.
Sociodemographic and professional characteristics of participants were described.
The psychometric properties evaluation of the PREMIS-French consisted in data completeness, factor analysis, descriptive statistics and score distributions, internal consistency, item-total correlations, inter-subscale correlations and reliability.
Data completeness.
The respondent acceptability was assessed by looking at the frequency of missing values. Data quality was considered satisfactory if less than 15% of the item data were missing.
Factor analysis.
Factor analysis with an oblique promax rotation, allowing the factors to correlate, were performed to study the multidimensionality and distribution of the items of the “Opinions” section in subscales [40]. As attitudes and clinical practice in IPV management could vary from culture to culture, there was no guarantee that the French version reproduced the subscales of the original PREMIS questionnaire. Hence, we chose an exploratory analysis of the structure of the items [39,41–43]. The Kaiser-Meyer-Olkin (KMO) statistic and Bartlett’s test of sphericity were used to check the appropriateness of running the factor analysis. KMO values higher than 0.50 are acceptable [44]. Bartlett’s test requires to yield significant result (p<0.05). Eigenvalues higher than 1 (Kaiser criterion) and Cattell’s scree plot [45] were used for factor retention. The solution giving the most adequate factor structure (item loadings greater than 0.32, no or few item cross loadings, i.e. no or few items with loadings at 0.32 or higher on two or more factors) was retained [40].
Descriptive statistics and score distributions.
The PREMIS-French subscales scores’ distribution were described by mean, standard deviation, median and range. The variability of the PREMIS-French scores was investigated for each subscale with the floor and ceiling effects. These effects were considered to be present if more than 15% of the subjects obtained the lowest or highest possible score [46].
Internal consistency.
Cronbach’s α coefficient was used to evaluate the internal consistency of each subscale of the “Background” and “Opinions” sections [47]. The minimum required for the coefficient was 0.70, according to the standard used for group comparisons [48]. Internal consistency was not evaluated for the ‘Actual knowledge’ subscale as it is a criterion-referenced subscale [19,49].
Item-total correlations.
Item-total consistency was used to evaluate the extent of the linear relationship between an item and its subscale for the “Background” and “Opinions” sections, corrected for overlap (the item which is to be correlated with the scale was omitted from the subscale total) [43]. A minimum correlation coefficient of 0.40 was considered indicative of good item-total consistency [50].
Inter-subscale correlations.
Spearman’s coefficients were used to evaluate inter-subscale correlations of the “Opinions” section subscales. Correlations were considered very small for coefficients lower than 0.30, small for coefficients between 0.30 and 0.50, moderate from 0.50 to 0.70 and strong if higher than 0.70 [51].
Convergent validity.
Spearman’s coefficients were used to evaluate correlations between (1) the number of hours of previous IPV training, ‘Perceived knowledge’, ‘Perceived preparation’, and ‘Actual knowledge’ subscales, (2) the subscales from the “Opinions” section and the number of hours of previous IPV training, ‘Perceived knowledge’, ‘Perceived preparation’, ‘Actual knowledge’ subscales. Positive correlations were expected.
Reliability.
Stability over time was assessed by the test-retest method. Reliability of the subscales from the “Background”, “Actual IPV knowledge” and “Opinions” sections was estimated by intraclass correlation coefficient (ICC), based on the two-way mixed effect model. The following categories were selected to interpret the agreement levels: 0–0.2 small, 0.21–0.40 fair, 0.41–0.60 moderate, 0.61–0.80 substantial and 0.81–1 almost perfect [52].
Results
Translation and cross-cultural adaptation
Cultural adaptations were made during the forward translations. In “Respondent profile” section, an item was added: ‘Including you, how many midwives practice at your work site?’. In “Actual IPV Knowledge” section, ‘Child Protective Services’ was adapted to the French context using ‘Cellule de Recueil des Informations Préoccupantes (CRIP)’. In “Opinions” section, item 17 (‘I comply with the Joint Commission standards that require assessment for IPV’) was adapted to the French context, as the Joint Commission did not exist in France. In “Practice issues” section, one item was not culturally relevant in the French context and was removed (item 8: ‘Do you practice in a state where it is legally mandated to report IPV cases involving competent (non-vulnerable) adults?’). Moreover, local DV/IPV hotline and Child Protective Services were omitted from the list of referral resources in item 4, as these support services are not available in France.
In pre-testing the French version, none of the ten health care providers reported any understanding difficulty or completion’s problem. Consequently, the expert committee adopted this version as the pre-final cross-cultural adaptation (S1 File). We named this version the PREMIS-French.
Psychometric evaluation of the PREMIS-French
Participants.
The online survey was answered by 360 perinatal care providers. The characteristics of these respondents are described in Table 1 and S1 Table. They were predominantly women with a mean age of 43.3 years (SD 10.7) and practicing for 17.9 years (SD 10.8) mainly in gynecology and obstetrics. Less than 4% had no actual clinical activity. About one quarter of the care providers never had training about IPV issues. The mean amount of previous IPV training was 15.0 hours (SD 19.3) and the more frequent type of training was to attend a lecture or talk. In the last 6 months, 63.7% made at least one new diagnose of IPV (picked up an acute case, uncovered ongoing abuse, or had a patient disclose a past history).
Data completeness.
In the “Respondent profile” section, the percentage of missing values per item varied between 0 and 16.1% (for the item on the number of practitioners that have participated in an IPV training course in the past 6 months at the work site). In the “Background” section, the percentage of missing values was 11.4% for the item on the amount of previous IPV training and ranged from 0 to 1.7% for items of the ‘Perceived preparation’ subscale and from 0.6 to 2.2% for items of the ‘Perceived knowledge’ subscale. The percentage of missing values ranged from 0.3 to 2.8% for items of the “Actual IPV knowledge” section and from 1.9 to 7.8% for items of the “Opinion” section. In the “Practice issues” section, with items on the screening and management of IPV victims in the last 6 months, the percentage of missing values per item were higher and ranged between 4.2 and 16.4%.
Factor analysis.
Factor analysis with an oblique promax rotation were performed to study the distribution of the 36 items of the “Opinions” section in subscales. The significance value of Bartlett’s test of sphericity was <0.0001 (χ2 = 3606.5, df = 630) and KMO measures of sampling adequacy was 0.846, indicating that the data were suitable for factor analysis. An initial Maximum Likelihood Factor (MLF) analysis identified a 11-factor solution that was statistically sound (χ2 = 323.7, df = 289, p = 0.0783). However, four factors contained only two items, ten items cross-loaded on two or more factors, indicating a complex solution that lacked a good theoretical basis. Thus, new factor analysis were performed after discarding items with loadings lower than 0.32, with loadings greater than 0.32 on two or more factors or items that significantly lowered internal consistency. The final factor analysis identified six factors with eigenvalues greater than one and accounting for 59.1% of the total variance (Table 2). All items loaded higher than 0.40 on its subscale. The first factor comprised five items and was named ‘Preparation’. It had four items in common with the original ‘Preparation’ subscale (items 6, 10a, 10b and 10c) and one item from the original ‘Self-efficacy’ subscale (item 9). The second factor named ‘Workplace issues’ comprised six items, four items were in common with the original subscale (items 3, 4, 19, 25), item 2 was from the original ‘Self-efficacy’ subscale and item 18 was from the original ‘Victim understanding’ subscale. The third factor comprised the four items of the original ‘Legal requirements’ subscale (items 12a, 12b, 12c, 17) and was labeled identically. Item 17 loaded higher than 0.32 on two factors: 0.55 on its factor and 0.38 on factor 2. The fourth factor comprised four items (items 5, 14, 26, 32) and was labeled ‘Self-efficacy’. It had three items in common with the original subscale (items 5, 14, 32) and one item from the original ‘Workplace issues’ subscale (item 26). The fifth factor comprised the three items of the original ‘Alcohol/drugs’ subscale (items 7, 21, 31) and was named identically. The sixth factor comprised three items of the original ‘Victim understanding’ subscales (items 11, 15, 16) and was labeled identically. Item 15 loaded higher than 0.32 on two factors: 0.71 on its factor and 0.33 on factor 4.
Two original “Opinions” subscales were not found in the current model. The items of ‘Victim autonomy’ (items 8, 22, 30) and ‘Constraints’ (items 13 and 23) subscales were discarded during the selection process of the most adequate factor structure.
Descriptive statistics, score distribution, floor and ceiling effects.
The descriptive statistics and score distributions of the PREMIS-French subscales are presented in Table 3. The percentage of missing values were less than 7%, except for the ‘Actual knowledge’ subscale with 25% of missing values. Neither floor nor ceiling effects were found for the “Background”, “Actual IPV knowledge” and “Opinions” subscales.
Internal consistency and item-total correlations.
The “Background” subscales showed good internal consistency, with Cronbach’s α equal to 0.95 and 0.97 for ‘Perceived preparation’ and ‘Perceived knowledge’ subscales respectively. All corrected item-total correlations were higher than the required 0.40, ranging from 0.54 to 0.87 for ‘Perceived preparation’ subscale and from 0.50 to 0.90 for ‘Perceived knowledge’ subscale.
For “Opinions” subscales, Cronbach’s α ranged from 0.54 to 0.88 (Table 4), showing good internal consistency for four subscales, and moderate internal consistency for the ‘Alcohol/drugs’ and ‘Victim understanding’ subscales, which did not obtain the minimum required coefficient of 0.70. All corrected item-total correlations were higher than the required 0.40, ranging from 0.40 to 0.85, except for item 21 from ‘Alcohol/drugs’ subscale with a value of 0.38, and for items 11 and 15 from ‘Victim understanding’ subscale with values of 0.32 and 0.34 (S2 Table).
In addition, each item of the “Opinions” section correlated better with its parent subscale (corrected for overlap) than with the other subscales, except for two items of the ‘Self-efficacy’ subscale (S2 Table). For item 14 (Able to gather the necessary information to identify IPV as the underlying cause of patient illnesses), the item-total correlation with its subscale was 0.57 and the correlation with the ‘Preparation’ subscale was also 0.57. For item 26 (Able to gather the necessary information to identify IPV as the underlying cause of patient injuries), the item-total correlation with its subscale was 0.54 and the correlation with the ‘Workplace issues’ subscale was 0.57.
Inter-subscale correlations.
Correlations between PREMIS-French “Opinions” subscales ranged from -0.003 to 0.54 (Table 4). The ‘Preparation’ subscale had a significant moderate correlation with the ‘Workplace issues’ subscale (r = 0.54). The ‘Legal requirements’ subscale had significant small correlations with ‘Preparation’ (r = 0.44), ‘Workplace issues’ (r = 0.45) and ‘Self-efficacy’ (r = 0.45) subscales. The ‘Self-efficacy’ subscale had significant moderate correlations with ‘Preparation’ (r = 0.53) and ‘Workplace issues’ (r = 0.50) subscales. The ‘Alcohol/drugs’ subscales had significant very small correlations with ‘Workplace issues’ (r = 0.14) and ‘Self-efficacy’ (r = 0.17) subscales, and no significant correlation with the others. The ‘Victim understanding’ subscale had only significant very small correlations with ‘Preparation’ (r = 0.21) and ‘Workplace issues’ (r = 0.13) subscales.
Convergent validity.
Correlations between the amount of previous IPV training, the “Background” subscales, the ‘Actual knowledge’ subscale and the “Opinions” subscales are shown in Table 5.
The amount of previous IPV training was moderately correlated to ‘Perceived preparation’ and ‘Perceived knowledge’ subscales (r = 0.66 and r = 0.67, respectively) and very weakly to ‘Actual knowledge’ subscale (r = 0.28). The ‘Perceived knowledge’ and ‘Perceived preparation’ subscales were strongly correlated (r = 0.91). Correlations between the ‘Actual knowledge’ subscale and the “Background” subscales were significant but very small: r = 0.22 with ‘Perceived preparation’ and r = 0.27 with ‘Perceived knowledge’.
Hours of IPV training showed moderate correlations with ‘Preparation’ (r = 0.52) and ‘Workplace issues’ (r = 0.52) subscales, almost moderate correlations with ‘Legal requirements’ (r = 0.45) and ‘Self-efficacy’ (r = 0.46) subscales, and no significant correlation with the two other “Opinions” subscales. All “Opinions” subscales except for the ‘Alcohol/drugs’ one were significantly correlated to the ‘Perceived preparation’ and ‘Perceived knowledge’ subscales. Correlations were strong with the ‘Preparation’ subscale (r = 0.70 and 0.74, respectively), moderate with ‘Workplace issues’, ‘Legal requirements’ and ‘Self-efficacy’ subscales (ranging from 0.52 to 0.62 and from 0.54 to 0.64, respectively) and very small for the ‘Victim understanding’ subscale (r = 0.15 and 0.18, respectively). Correlations between “Opinions” subscales and the ‘Actual knowledge’ subscale were significant but very small, ranging from 0.14 to 0.23, except for the ‘Victim understanding’ subscale with a higher correlation of 0.33.
Reliability.
Of the fifty perinatal care providers randomly selected for the test-retest, 40 (80.0%) completed the test questionnaire. Among them, 24 (60.0%) completed the retest questionnaire. No one reported having a training course about IPV between test and retest. The characteristics of the test-retest participants are described in S1 Table. They were predominantly women (83.3%), with a mean age of 44.2 years (SD 11.6). Twenty of them practiced in gynecology and obstetrics, two in mother and child protection services, one in pediatrics and one in psychology.
Test-retest reliability was almost perfect for the “Background” subscales, with ICCs equal to 0.92 for ‘Perceived preparation’ and 0.88 for ‘Perceived knowledge’ (Table 6). Agreement was substantial for ‘Actual knowledge’ subscale with an ICC of 0.69. Reliability was also substantial for “Opinions” subscales, with ICCs ranging from 0.65 to 0.83, except for ‘Alcohol/drugs’ subscale with a moderate ICC of 0.46.
Discussion
The present study describes the cross-cultural adaptation and the evaluation of the psychometric properties of the French version of the PREMIS, named the PREMIS-French, in a national sample of perinatal care providers.
The PREMIS was successfully translated and cross-culturally adapted from English to French. The PREMIS-French had good acceptability with low percentages of missing values per item, except for some items from the “Practice issues” section, evaluating practices or workplace specificities that could be not relevant for some participants. It also had good response distribution, neither floor nor ceiling effect were found for the subscales, indicating that the instrument was adapted to the studied population.
The six-factor structure of the PREMIS-French “Opinions” section differs slightly from the eight-factor structure of the original version of the PREMIS [19]. Only the two original ‘Victim autonomy’ and ‘Constraints’ subscales were not found in our validation. However, in the original PREMIS, this subscales were not sufficiently reliable and only kept for future testing.
The ‘Preparation’ subscale groups together four items from the original ‘Preparation’ subscale and one item from the original ‘Self-efficacy’ subscale. This item (Feel comfortable discussing IPV with patients) was more related to the feeling of being prepared in the French context. The PREMIS-French ‘Workplace issues’ subscale comprised items from the original subscale, and two items related to the systematic abuse screening of patients from the original ‘Self-efficacy’ and ‘Victim understanding’ subscales. IPV screening in France depends on the institutions’ policies where health care providers work and not all encourage IPV identification unfortunately. The ‘Self-efficacy’ subscale comprised one item from the original ‘Workplace issues’ subscale. Being able to gather the necessary information to identify IPV as the underlying cause of patient injuries is more related to self-efficacy than to work site. The ‘Victim understanding’ subscale comprised three items on the seven items of the original subscale. Lastly, ‘Legal requirements’ and ‘Alcohol/drugs’ subscales were identical in the French and the original versions [19].
The other PREMIS versions also presented factor structures that were somewhat different from the original version. Two subscales were identified in all other studies, ‘Preparation’ and ‘Alcohol/drugs’ subscales. The Greek physicians’ version [23] identified a 2-item ‘IPV screening’ subscale. The ‘Legal requirements’ subscale was not found in this version where the items were excluded during the adaptation of the PREMIS [23], as the ‘Victim autonomy’ subscale. The Spanish version for physicians and nurses identified a ‘Barriers’ subscale [24]. The American pharmacists’ version identified one single subscale for self-efficacy and workplace-efficacy [22]. The American health care students’ version identified a 2-item ‘IPV screening’ subscale [21]. The ‘Workplace issues’ and the ‘Constraints’ subscales were not identified, as it was not appropriate for students [21]. The Australian paramedic and nursing students’ version did not find the ‘Workplace issues’ and ‘Constraints’ subscales [25]. The ‘Legal requirements’ subscale was not found in this version as the items were excluded during the adaptation of the PREMIS [25].
Internal consistency of the “Background” subscales was high and comparable to those of the original subscales with Cronbach’s α superior to 0.90 [19]. Same results were found for the physicians’ Greek and Spanish versions [23,24], the American and Australian healthcare students’ versions [21,25] and the American pharmacists’ version [22]. For “Opinions” section, ‘Preparation’, ‘Workplace issues’, ‘Legal requirements’ and ‘Self-efficacy’ subscales demonstrated good internal consistency (α = 0.88, α = 0.77, α = 0.76, and α = 0.72), comparable to those reported in the original version (α = 0.85, α = 0.82, α = 0.79, and α = 0.69 respectively) [19]. ‘Alcohol/drugs’ and ‘Victim understanding’ subscales displayed moderate internal consistency (α = 0.59 and α = 0.54), lower than those reported in the original version (α = 0.70 and α = 0.69 respectively) [19]. This moderate internal consistency was also found in the Greek physicians’ version (α<0.50 and α = 0.63 respectively) [23], in the American healthcare students’ version (α = 0.48 and α = 0.46 respectively) [21], and in the Australian paramedic and nursing students’ version (α = 0.57 for the ‘Alcohol/drugs’ subscale) [25]. The Spanish physicians and the American pharmacists’ versions reported higher internal consistency for the ‘Alcohol/drugs’ subscale (α = 0.66 and α = 0.80 respectively) [22,24].
The very small to moderate correlations between the “Opinions” subscales imply that they measures related but relatively different constructs. ‘Alcohol/drugs’ subscale displayed the lowest correlations with the other subscales, results found in the original development of the PREMIS [19] and in the other studies [21–25].
Convergent validity was explored by assessing the inter-subscales correlations. The majority of the correlations replicated findings of previous studies. Only the Spanish validation did not explore these correlations [24]. ‘Perceived preparation’ and ‘Perceived knowledge’ subscales were strongly correlated (r = 0.91). In the previous studies, correlations ranged from 0.74 to 0.89 [19,21–25]. These subscales were not significantly correlated to ‘Alcohol/drugs’ subscale, as found in the original version [19], the Greek physicians’ version [23] and the Australian healthcare students’ version [25]. Correlations between the amount of previous IPV training and the “Background” subscales were moderate and higher than those found in all previous studies [19,21–25]. ‘Actual knowledge’ subscale had small correlations with the amount of previous training, the “Background” and “Opinions” subscales. The higher correlation was found with the ‘Victim understanding’ subscale, which was the only significant correlation in the Greek physicians [23] and American healthcare students’ versions [21]. Short et al in the original version found significant but small correlations between ‘Actual knowledge’ and ‘Perceived knowledge’, and between ‘Actual knowledge’ and “Opinions” subscales, except ‘Preparation’ and ‘Legal requirements’ subscales [19]. In the American pharmacists’ version, ‘Actual knowledge’ was only significantly correlated to ‘Legal requirements’ subscale [22].
Test-retest reliability, which is an essential property [53], showed substantial to almost perfect ICCs, except for the ‘Alcohol/drugs’ opinions subscale, with moderate reliability. Only the Greek physicians validation reported ICCs for test-retest reliability over a 3- to 4-week period [23]. In our study, ICCs for the ‘Perceived preparation’, ‘Perceived knowledge’, ‘Actual knowledge’ and ‘Self-efficacy’ subscales were higher (0.92, 0.88, 0.69, and 0.83 versus 0.84, 0.78, 0.68, and.078 respectively). For the other similar “Opinions” subscales, our ICCs were lower: 0.65 versus 0.83 for ‘Preparation’ subscale, 0.78 versus 0.93 for ‘Workplace issues’, 0.74 versus 0.81 for ‘Victim understanding’, 0.46 versus 0.79 for ‘Alcohol/drugs’.
Our study has some limitations. First, participants were mainly women. This could be explained by the fact that midwives are widely represented in perinatal care occupations. In France in 2017, only 2.6% of midwives were men. As women, these participants certainly felt more concerned about this topic and this could have affected their responses. Almost one quarter of the participants reported no previous IPV training. In the other cross-cultural validations, this proportion varied from 45.7% [21] to 95% [23]. Nevertheless, Short et al reported that 13.5% of their first sample and 31.3% of their second sample used to validate the original PREMIS reported no previous training, which was closer to our results [19]. Besides, it was not possible to distinguish between town and clinic caregivers and those who are regular employees of the hospitals or health care institutions. Practice variations could be explained by the work site, in particular by the presence of protocol for dealing with abused women, IPV referral resources or institutional policies. For the reliability test, 24 respondents completed the retest, a number lower than the 50 subjects recommended by Terwee et al. [38], but higher than in the other validation studies:10 subjects for the Spanish version [24], 18 subjects for the Australian version [25] and 20 subjects for the Greek version [23].
Further studies are needed on sample with more men to confirm the psychometric properties of the questionnaire, and in other settings, like in primary health care physicians. The responsiveness to change, that is the ability of the PREMIS-French to detect changes after IPV training, had to be evaluated, as well as convergent validity, as no validated instruments was validated in French to serve for comparison.
Conclusion
This study provides evidence of the good psychometric properties of the PREMIS-French when delivered to perinatal care providers to assess their readiness to manage IPV. As the original and the other versions of the PREMIS, the PREMIS-French could be used in several ways: to assess knowledge, attitudes, beliefs, behaviors and skills in order to assess needs that could be addressed during IPV education program; as a pre and post-test to measure the changes over time (spontaneous evolution of practices) or after IPV trainings or interventions; to compare perinatal care providers who had received training and those who did not have it. This is a valid and easy instrument to use which will help to understand perinatal care providers’ barriers to IPV screening and management and will help to focus on specific lacks of knowledge for developing IPV education programs. This measure of educational outcome would also allow the evaluation of IPV training courses that will be developed in the near future, in accordance with the recent recommendations of the French National Health Authority.
Supporting information
S1 Table. Sociodemographic and professional characteristics of participants.
https://doi.org/10.1371/journal.pone.0258943.s001
(DOCX)
S2 Table. Corrected item-total correlations for the PREMIS-French “Opinions” subscales.
https://doi.org/10.1371/journal.pone.0258943.s002
(DOCX)
References
- 1.
García-Moreno C, Pallitto C, Devries K, Stöckl H, Watts C, Abrahams N. Global and regional estimates of violence against women: prevalence and health effects of intimate partner violence and non-partner sexual violence. Geneva, Switzerland: World Health Organization; 2013.
- 2.
European Union Agency for Fundamental Rights. Violence against women: an EU-wide survey Main results. European Union Agency for Fundamental Rights; 2015. https://fra.europa.eu/sites/default/files/fra_uploads/fra-2014-vaw-survey-main-results-apr14_en.pdf.
- 3. James L, Brody D, Hamilton Z. Risk factors for domestic violence during pregnancy: a meta-analytic review. Violence Vict. 2013;28: 359–380. pmid:23862304
- 4. Hall M, Chappell LC, Parnell BL, Seed PT, Bewley S. Associations between intimate partner violence and termination of pregnancy: a systematic review and meta-analysis. PLoS Med. 2014;11: e1001581. pmid:24409101
- 5. Alhusen JL, Ray E, Sharps P, Bullock L. Intimate partner violence during pregnancy: maternal and neonatal outcomes. J Womens Health (Larchmt). 2015;24: 100–106. pmid:25265285
- 6. Silverman JG, Decker MR, Reed E, Raj A. Intimate partner violence victimization prior to and during pregnancy among women residing in 26 U.S. states: associations with maternal and neonatal health. Am J Obstet Gynecol. 2006;195: 140–148. pmid:16813751
- 7. Donovan BM, Spracklen CN, Schweizer ML, Ryckman KK, Saftlas AF. Intimate partner violence during pregnancy and the risk for adverse infant outcomes: a systematic review and meta-analysis. BJOG. 2016;123: 1289–1299. pmid:26956568
- 8. Plichta SB. Intimate partner violence and physical health consequences: policy and practice implications. J Interpers Violence. 2004;19: 1296–1323. pmid:15534333
- 9.
Haute Autorité de Santé. Repérage des femmes victimes de violences au sein du couple. Recommandations pour la pratique clinique. 2019. https://www.has-sante.fr/upload/docs/application/pdf/2019-09/170919_reperage_des_femmes_victimes_de_violences_au_sein_du_couple_texte_recommandations.pdf.
- 10. Chisholm CA, Bullock L, Ferguson JEJ. Intimate partner violence and pregnancy: screening and intervention. Am J Obstet Gynecol. 2017;217: 145–149. pmid:28551447
- 11. Roelens K, Verstraelen H, Van Egmond K, Temmerman M. A knowledge, attitudes, and practice survey among obstetrician-gynaecologists on intimate partner violence in Flanders, Belgium. BMC Public Health. 2006;6: 238. pmid:17002786
- 12. Gutmanis I, Beynon C, Tutty L, Wathen CN, MacMillan HL. Factors influencing identification of and response to intimate partner violence: a survey of physicians and nurses. BMC Public Health. 2007;7: 12. pmid:17250771
- 13. Long AJ, Golfar A, Olson DM. Screening in the Prenatal Period for Intimate Partner Violence and History of Abuse: A Survey of Edmonton Obstetrician/Gynaecologists. J Obstet Gynaecol Can. 2019;41: 38–45. pmid:30585166
- 14.
MIPROF. Résultats de l’enquête nationale auprès des sages-femmes en activité sur les violences faites aux femmes. Mission interministérielle pour la protection des femmes contre les violences et la lutte contre la traite des êtres humains; 2015. http://unssf.org/wp/wp-content/uploads/2018/08/Enqu%C3%AAte-nationale-aupr%C3%A8s-des-sages-femmes-en-activit%C3%A9-MIPROF-2015.pdf.
- 15. Mauri EM, Nespoli A, Persico G, Zobbi VF. Domestic violence during pregnancy: Midwives׳ experiences. Midwifery. 2015;31: 498–504. pmid:25726007
- 16. Jones K, Taouk L, Castleberry N, Carter M, Schulkin J. IPV Screening and Readiness to Respond to IPV in Ob-Gyn Settings: A Patient-Physician Study. Adv Public Health. 2018;2018:1–8.
- 17. Feder G, Davies RA, Baird K, Dunne D, Eldridge S, Griffiths C, et al. Identification and Referral to Improve Safety (IRIS) of women experiencing domestic violence with a primary care training and support programme: a cluster randomised controlled trial. Lancet. 2011;378: 1788–1795. pmid:22000683
- 18.
World Health Organization. Responding to Intimate Partner Violence and Sexual Violence Against Women: WHO Clinical and Policy Guidelines. Geneva: World Health Organization; 2013. https://www.ncbi.nlm.nih.gov/books/NBK174250/pdf/Bookshelf_NBK174250.pdf.
- 19. Short LM, Alpert E, Harris JM, Surprenant ZJ. A tool for measuring physician readiness to manage intimate partner violence. Am J Prev Med. 2006;30: 173–180. pmid:16459217
- 20. Short LM, Surprenant ZJ, Harris JM. A community-based trial of an online intimate partner violence CME program. Am J Prev Med. 2006;30: 181–185. pmid:16459218
- 21. Connor PD, Nouer SS, Mackey STN, Tipton NG, Lloyd AK. Psychometric properties of an intimate partner violence tool for health care students. J Interpers Violence. 2011;26: 1012–1035. pmid:20587479
- 22. Barnard M, West-Strum D, Yang Y, Holmes E. Evaluation of a Tool to Measure Pharmacists’ Readiness to Manage Intimate Partner Violence. Pharmacy (Basel). 2018;6: 66. pmid:30002273
- 23. Papadakaki M, Prokopiadou D, Petridou E, Kogevinas M, Lionis C. Defining physicians’ readiness to screen and manage intimate partner violence in Greek primary care settings. Eval Health Prof. 2012;35: 199–220. pmid:22158688
- 24. Vives Cases C, Torrubiano Domínguez J, Carrasco Portiño M, Espinar-Ruiz E, Gil-González D, Goicolea I. [Validation of the Spanish Version of Physician Readiness to Manage Intimate Partner Violence Survey (PREMIS)]. Rev Esp Salud Publica. 2015;89: 173–190. pmid:26121627
- 25. Sawyer S, Coles J, Williams A, Williams B. The psychometric properties of an intimate partner violence education outcome measure. Nurse Educ Today. 2019;76: 148–153. pmid:30784843
- 26. Ramsay J, Rutterford C, Gregory A, Dunne D, Eldridge S, Sharp D, et al. Domestic violence: knowledge, attitudes, and clinical practice of selected UK primary healthcare clinicians. Br J Gen Pract. 2012;62: e647–655. pmid:22947586
- 27. Zaher E, Mason R. Saudi Family-Medicine Residents’ Readiness to Manage Intimate Partner Violence: A Needs Assessment Study. World Family Medicine Journal: Incorporating the Middle East Journal of Family Medicine. 2014;99:1–6.
- 28. Baird KM, Saito AS, Eustace J, Creedy DK. Effectiveness of training to promote routine enquiry for domestic violence by midwives and nurses: A pre-post evaluation study. Women Birth. 2018;31: 285–291. pmid:29102526
- 29. Harris CM, Boyd L, Rainchuso L, Rothman AT. Oral Health Care Providers’ Knowledge and Attitudes About Intimate Partner Violence. J Dent Hyg. 2016;90: 283–296.
- 30. Jones KM, Carter MM, Bianchi AL, Zeglin RJ, Schulkin J. Obstetrician-gynecologist and patient factors associated with intimate partner violence screening in a clinical setting. Women Health. 2020;60: 1000–1013. pmid:32615063
- 31. Forsdike K, O’Connor M, Castle D, Hegarty K. Exploring Australian psychiatrists’ and psychiatric trainees’ knowledge, attitudes and preparedness in responding to adults experiencing domestic violence. Australas Psychiatry. 2019;27: 64–68. pmid:30047793
- 32. Nyame S, Howard LM, Feder G, Trevillion K. A survey of mental health professionals’ knowledge, attitudes and preparedness to respond to domestic violence. J Ment Health. 2013;22: 536–543. pmid:24279406
- 33. Ambikile JS, Leshabari S, Ohnishi M. Knowledge, attitude, and preparedness toward IPV care provision among nurses and midwives in Tanzania. Hum Resour Health. 2020;18: 56. pmid:32746849
- 34. Papadakaki M, Petridou E, Kogevinas M, Lionis C. Measuring the effectiveness of an intensive IPV training program offered to Greek general practitioners and residents of general practice. BMC Med Educ. 2013;13: 46. pmid:23537186
- 35. Alhalal E. The effects of an intimate partner violence educational intervention on nurses: A quasi-experimental study. Nurse Educ Pract. 2020;47: 102854. pmid:32858301
- 36. Investigators EDUCATE. Assessing readiness to manage intimate partner violence 12 months after completion of an educational program in fracture clinics: a pretest-posttest study. CMAJ Open. 2020;8: E731–E736. pmid:33199506
- 37.
COSMIN. COSMIN—Improving the selection of outcome measurement instruments. 2020. https://www.cosmin.nl/.
- 38. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, Dekker J, et al. Quality criteria were proposed for measurement properties of health status questionnaires. J Clin Epidemiol. 2007;60: 34–42. pmid:17161752
- 39. Beaton DE, Bombardier C, Guillemin F, Ferraz MB. Guidelines for the process of cross-cultural adaptation of self-report measures. Spine. 2000;25: 3186–3191. pmid:11124735
- 40. Costello AB, Osborne JW. Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Pract Assess Res Eval. 2005;10: 1–9.
- 41. Bullinger M, Alonso J, Apolone G, Leplège A, Sullivan M, Wood-Dauphinee S, et al. Translating health status questionnaires and evaluating their quality: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51: 913–923. pmid:9817108
- 42. Ware JE, Gandek B. Methods for testing data quality, scaling assumptions, and reliability: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51: 945–952. pmid:9817111
- 43. Gandek B, Ware JE. Methods for validating and norming translations of health status questionnaires: the IQOLA Project approach. International Quality of Life Assessment. J Clin Epidemiol. 1998;51: 953–959. pmid:9817112
- 44. Kaiser H, Rice J. Educational and Psychological Measurement. 1974;34: 111–117.
- 45. Cattell RB. The Scree Test For The Number Of Factors. Multivariate Behav Res. 1966;1: 245–276. pmid:26828106
- 46. McHorney CA. Methodological inquiries in health status assessment. Med Care. 1998;36: 445–448. pmid:9544585
- 47. Cronbach L. Coefficient alpha and the internal structure of tests. Psychometrika. 1951;16: 297–334.
- 48.
Nunnally J, Bernstein I. Psychometric Theory (3rd ed.). McGraw-Hill. New York; 1994.
- 49. Brown J. The Cronbach alpha reliability estimate. Shiken JALT Test Eval SIG Newsl. 2002;6: 16–18.
- 50.
Ware J, Brook R, Williams K, Stewart A, Davies-Avery A. Conceptualisation and Measurement of Health for Adults in the Health Insurance Study. In: Model of Health and Methodology. Santa Monica, USA: RAND corporation; 1980.
- 51.
Hinkle D, Wiersma W, Jurs S. Applied statistics for the behavioral sciences. 5th ed. London: Boston, Mass.: Houghton Mifflin; 2003.
- 52. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33: 159–174. pmid:843571
- 53. Fitzpatrick R, Davey C, Buxton MJ, Jones DR. Evaluating patient-based outcome measures for use in clinical trials. Health Technol Assess. 1998;2: i–iv, 1–74. pmid:9812244