Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation of the Arabic version of the Mental Health Literacy Scale (MHLS) in three Arab samples

  • Fareeda Abo-Rass ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft

    Abo-Rass@hsph.harvard.edu

    Affiliations Takemi Program in International Health, Harvard T.H. Chan School of Public Health, Boston, Massachusetts, United States of America, Department of Social Work, Ben-Gurion University of the Negev, Beer-Sheva, Israel

  • Ora Nakash,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation School for Social Work, Smith College, Northampton, Massachusetts, United States of America

  • Sarah Abu-Kaf,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Conflict Management and Resolution Program, Ben-Gurion University of the Negev, Beer-Sheva, Israel

  • Bizu Gelaye,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Department of Epidemiology, Harvard T. H. Chan School of Public Health, Boston, Massachusetts, United States of America, Department of Psychiatry, Harvard Medical School, Boston, Massachusetts, United States of America, Epidemiology Branch, Division of Intramural Population Health Research, Division of Intramural Research, Eunice Kennedy Shriver National Institute of Child Health and Human Development, Bethesda, Maryland, United States of America

  • Hanan AboJabel,

    Roles Formal analysis, Methodology, Writing – review & editing

    Affiliation The Paul Baerwald School of Social Work and Social Welfare, The Hebrew University of Jerusalem, Jerusalem, Israel

  • Anwar Khatib

    Roles Conceptualization, Data curation, Project administration, Writing – review & editing

    Affiliations Department of Social Work, Zefat Academic College, Zefat, Israel, Department of Community Mental Health, University of Haifa, Haifa, Israel

Abstract

Mental Health Literacy (MHL) is pivotal for understanding and addressing mental disorders, often assessed using the comprehensive Mental Health Literacy Scale (MHLS) across six dimensions and 35 items. However, research on MHL within Arab populations is not just scarce, but alarmingly so, indicating a significant gap in knowledge regarding MHL in this demographic. This study aimed to fill this gap by adapting the MHLS into Arabic and evaluating its psychometric properties among three distinct Arabic-speaking groups: adolescents, students, and the general public. Data were collected using the translated MHLS, the General Health Questionnaire, and sociodemographic measures, employing a cross-sectional design. Validation procedures were conducted, including exploratory factor analysis, reliability testing, and face validity assessment. Construct validity was assessed using Pearson correlation analysis and t-tests. The validation process yielded three modified versions of the MHLS in Arabic: MHLS-Arabic-Adolescents (31 items, 5 factors), MHLS-Arabic-Students (30 items, 6 factors), and MHLS-Arabic-General Public (33 items, 5 factors). These tools demonstrated robust construct validity and high-reliability coefficients and stood as a testament to their adaptability and potential for use in diverse Arabic-speaking populations. This study suggests the nuanced nature of MHL and points to the importance of micro-context-specific validation. Providing three reliable MHLS Arabic versions could facilitate research on MHL among Arabic-speaking populations worldwide, potentially leading to tailored intervention initiatives that aim to enhance mental health outcomes and ensure equitable access to services within Arab communities globally.

Introduction

Mental Health Literacy (MHL) was originally introduced by Jorm et al. [1] as the “knowledge and beliefs about mental disorders that facilitate their recognition, management, or prevention” (p. 182). It was conceived as an extension of health literacy, defined by the World Health Organization [2] as the attainment of knowledge, personal skills, and confidence necessary to improve personal and community health by modifying individual lifestyles and living conditions. Notably, Jorm [3] highlighted that health literacy traditionally focused on physical rather than mental health issues. Jorm’s MHL conceptual framework (2000) defines MHL as a multidimensional concept encompassing six dimensions:(1) Mental disorder recognition; (2) Risk factor knowledge; (3) Available professional help; (4) Information seeking knowledge; (5) Self-treatment knowledge; and (6) Attitudes that promote recognition or appropriate help-seeking behavior.

MHL has been recognized for its crucial role in enhancing mental health outcomes [36]. Research consistently highlights the association between MHL and mental health behaviors, such as intentions to seek help, actual help-seeking behaviors, engagement in health-promoting activities, and utilization of mental health services [79]. Consequently, MHL has become an important resource for promoting mental health, facilitating help-seeking, and addressing mental disorders [10].

While the concept of MHL has continuously evolved, Jorm’s [11] definition retains its prominence in the field, and the Mental Health Literacy Scale (MHLS) by O’Connor and Casey [12] stands out as the predominant tool for MHL assessment. The MHLS consists of 35 items that measure mental health knowledge, attitudes, and behaviors through the six dimensions of Jorm’s MHL framework [12]. The MHLS is pivotal in advancing MHL research, as evidenced by comparative analyses with alternative measurement tools highlighting its efficacy in assessing MHL and emphasizing its robustness and reliability [13]. Studies employing this scale have investigated MHL levels across diverse groups, including university students, Health care providers, individuals undergoing therapy, and the general public, showcasing its versatility across various populations [10,1416].

Moreover, the scale has been translated and validated in multiple languages, such as French and Urdu, facilitating its application in different cultural contexts [17,18]. Recognizing that cultural nuances influence MHL [3,19], the scale’s translation and validation aim to ensure its appropriateness in diverse cultural settings. Despite these efforts, a notable gap exists in understanding MHL in non-Western and low-middle-income countries, where most studies using the MHLS have predominantly focused on Western samples [20].

One of the populations where insufficient attention has been devoted to MHL research is the Arab population. In a recent scoping review that relied on Jorm’s theoretical framework [3] and his definition of MHL, only nine studies were identified among Arabs. Seven of these studies employed a quantitative cross-sectional design, two utilizing the MHLS and five opting for an adapted version of the MHLS [10]. Moreover, it is widely recognized that there is a notable scarcity of local research in the mental health field in the Arab region, hindering the culturally appropriate development of diverse services in mental health care among Arabs [21]. Nonetheless, two recent studies have validated the MHLS tool [22,23]. While these studies hold significant relevance in the field, it’s worth noting that both were conducted within the specific context of Saudi Arabia, with the first study exclusively targeting female students. Furthermore, the absence of the Arabic version of the MHLS tool in these articles and elsewhere limits its potential contribution to advancing research on MHL within Arabs.

The absence of comprehensive mental health studies, particularly in the domain of MHL, is somewhat surprising given the substantial global Arab population of approximately 436 million. Although mental health data on Arabs is limited, the prevalence of mental disorders in the region is notably high [24]. For instance, recent meta-analyses indicate that the range of depression in Arabic countries spans from 3% to 50%, anxiety from 2% to 19%, and post-traumatic stress disorder from 2% to 36% [24]. Notably, Arabs tend to be less inclined to seek formal help. They are more prone to seek assistance for mental health issues from informal sources, such as religious counselors, friends, or family members, often relying on God as their primary path to healing [25,26]. A recent systematic review documented that mental health stigma served as a significant obstacle to seeking professional mental health assistance among Arabs [27]. The review underscores a common tendency among Arabs to attribute mental symptoms to supernatural causes, such as magic and the evil eye, rather than considering physiological or social factors. Mental health challenges are often perceived as a divine punishment or test [28,29]. Additionally, Arabs frequently hold highly negative perceptions of individuals facing mental health issues [25,27]. However, recent social and cultural changes among Arabs in the last few decades suggest a shift in knowledge and a transformation of stigmatizing beliefs about mental health [27,30].

The current study

Due to the distinctive background of Arabs and their significant global presence, and considering that MHL is rooted in the individual’s context [3], this study endeavors to adapt the MHLS [12] into Arabic. The primary objective of the current study is to assess and validate the psychometric properties of the Arabic version of the MHLS among three Arabic-speaking groups within three different contexts: adolescents, emerging adults in academic settings (students), and individuals in the general public. Analyzing diverse groups within the same ethnic and cultural context stems from recognizing that MHL is linked to a more specific and concentrated context influenced by culture or language [10]. Evaluating the validity of questionnaires in Arabic across various samples ensures their accessibility and will contribute to advancing research in the realm of MHL among Arabs worldwide.

Methods

Research design

This cross-sectional study was part of three large research projects assessing MHL and mental health help-seeking among three different groups within the Arabic-speaking Palestinian citizens in Israel.

Measures

Mental Health Literacy.

The Mental Health Literacy Scale (MHLS) [12] was used to evaluate participants’ MHL. Comprising 35 items, the self-report measure includes six dimensions:

  1. Ability to recognize disorders (e.g., ‘To what extent do you think it is likely that Personality Disorders are a category of mental illness’).
  2. Knowledge of risk factors and causes (e.g., ‘To what extent do you think it is likely that in general in Israel, men are MORE likely to experience an anxiety disorder compared to women’).
  3. Knowledge of self-treatment (e.g., ‘To what extent do you think it would be helpful for someone to avoid all activities or situations that made them feel anxious if they were having difficulties managing their emotions’).
  4. Knowledge of professional help available (e.g., ‘To what extent do you think it is likely that Cognitive Behaviour Therapy (CBT) is a therapy based on challenging negative thoughts and increasing helpful behaviors’).
  5. Knowledge of where to seek information (e.g., ‘I am confident that I know where to seek information about mental illness’).
  6. Attitudes that promote recognition or appropriate help-seeking behavior (e.g., ‘Seeing a mental health professional means you are not strong enough to manage your own difficulties’).

Items in dimensions (1), (2), and (4) were rated on a four-point Likert scale, ranging from 1 (very unlikely) to 4 (very likely). Items in dimension (3) were rated on a 4-point Likert scale, from 1 (very unhelpful) to 4 (very helpful). Lastly, items in dimensions (5) and (6) were rated on a 5-point Likert scale, from 1 (strongly disagree) to 5 (strongly agree). Twelve items were reverse-scored: items 10, 12, 15, and 20–28. Scores within each dimension were summed, with higher scores indicating a greater level of that particular aspect of MHL.

Psychological distress.

The General Health Questionnaire (GHQ-12) [31] was employed to evaluate psychological distress. Comprising 12 items, the questionnaire utilizes a 4-point Likert scale, which includes less than usual, no more than usual, more than usual, and much more than usual. For seven of these items, the scores were reversed. The questions prompt respondents to report recent feelings related to various variables. Examples include “Have you recently been thinking of yourself as worthless?”. A score of 0 is given for the first two choices and 1 for the next two. The scores of all items were aggregated to compute the overall index using the original scoring method, where a score of 0 is given for the first two choices and 1 for the next two. Scores on this scale range from 0 to 12, with higher values indicating elevated levels of psychological distress. The questionnaire was previously validated in Arabic [32].

Sociodemographic and clinical characteristics.

The sociodemographic questionnaire included questions about age, gender, subjective financial status (above average, average—indicative of the financial situation typical for most people in Israel, or below average; the adolescents and the students were asked to rate their families’ financial status), and self-reported history or current mental illness (Yes/No).

Samples and procedure

This study involves three samples (adolescents, emerging adults in high academic settings- Students and adults from the general public) who met the specific criteria of being Arabic-speaking Palestinian citizens of Israel.

The Adolescents sample comprised 172 adolescents aged 14–18. Data was collected between March and July 2023. Research assistants utilized social media parent groups to recruit participants, sharing study details and contact information. Interested parents reached out to the principal researcher (first author). Those consenting to their children’s participation received a link containing study information and the questionnaire. Parents provided written consent, and adolescents completed the questionnaire independently. The comprehensive recruitment procedure is detailed in [33]. The Ethics Committee of Zefat Academic College approved this sample recruitment protocol.

The Student sample comprises 109 students enrolled at one of the higher education institutions in Israel (Universities and colleges affiliated with the Council for Higher Education in Israel). Data collection for this study occurred between March and July 2021. Two authors personally sent an internet link to potential participants, who were then asked to forward the link to other eligible participants using a snowball technique to enhance recruitment. The link led to a structured survey containing a study description and the researchers’ contact information. Before participation, all participants completed informed consent. The research protocol received approval from the Ethics Committee of Zefat Academic College. A detailed recruitment procedure is available in [34].

The General Public sample comprises 206 adults aged 18 and above. Data collection occurred between July and October 2021, with the recruitment protocol approved by the Human Subjects Ethics Committee of of Zefat Academic College. The first author conducted face-to-face interviews with potential participants and shared the survey form online with additional relevant individuals using the snowball technique. Both recruitment approaches included a study description, an informed consent form, and the authors’ contact details. Participation was contingent upon signing the form or indicating agreement. A detailed recruitment procedure is available in [10]

A convenience sample was employed in all three samples, meaning participants were recruited based on their availability and willingness to participate rather than through probability-based met. Participants completed a survey that included the MHLS, the GHQ-12, and the Sociodemographic and Clinical Characteristics questionnaire. All participants provided informed consent before undertaking the survey, which took approximately 20 minutes.

Translation of the MHLS

The original Mental Health Literacy Scale (MHLS) was translated into Arabic and back-translated into English by two bilingual independent experts, following the recommendations of Sousa and Rojjanasrirat [35]. We performed this translation using Modern Standard Arabic, which is universally understood across the diverse accents and subcultures among Arabs in general. This approach ensures that the scale is applicable and accessible to Arabic-speaking populations globally.

Similar to the original scale, the translated version initially comprised 35 items, and no questions were omitted at this stage. The MHLS was pretested with 15 participants in each sample to ensure clarity and minor revisions were implemented based on their feedback. Importantly, no differences in wording were observed between the three groups, so the translated version remained consistent across all samples. The final version underwent review and approval by a panel of three Arab Palestinian mental health professionals, achieving face validation through consensus agreement on the translated Arabic version.

Statistical analyses

All data were coded and analyzed using SPSS-25. (a) Descriptive analyses were used to summarize the characteristics of the participants and the scale, including means, standard deviations, and percentages. In addition, the assumptions of normal distribution for the MHLS items were tested, and the variables were found to fall within an acceptable range for normality among all samples (skewness: −1.38 to 0.23; kurtosis: −1.56 to 0.46). (b) Construct validity was assessed using exploratory factor analysis (EFA) with varimax rotation. Items with a rotated factor loading < 0.35 or exhibiting false loading inconsistent with theoretical understanding were eliminated. The EFA with varimax rotation was chosen to validate the tool in this study as it identifies the underlying factor structure of observed variables and simplifies the factors by maximizing the variance of squared loadings, ensuring they reflect the theoretical constructs being measured, as demonstrated in previous research validating the MHLS [22]. Spearman’s correlation coefficient was utilized to assess the association between variables within each obtained factor. (c) Cronbach’s alpha coefficients were calculated to determine the internal consistency of each factor. Values ranging from 0.70 to 0.80 were deemed good, those falling between 0.80 and 0.90 were categorized as very good, and scores exceeding 0.90 were regarded as excellent [36]. Also, corrected item-total correlations were computed to assess the strength of the relationship between each item and the overall score of the factor. Items with correlations below 0.20 were deemed non-contributory to the factor [37]. An analysis of floor and ceiling effects was conducted to assess the distribution of scores for each factor across different samples. No significant floor or ceiling effects were observed, as they did not exceed 15%, indicating that the scale factors were well-calibrated. (d) To evaluate Construct validity, Pearson correlation analysis, t-tests, or ANOVA were employed to investigate the relationship between the total score of each factor and participants’ characteristics in each sample, including age, gender, financial status, mental illness, and psychological distress. Homogeneity of variances for all variables was tested, and the results indicated that this assumption was satisfied. All p-values were two-tailed, and statistical significance was defined as p < 0.05. (e) Finally, following the completion of all analysis stages and the restructuring of the scale in each sample, which involved the removal of specific questions, a panel of five Palestinian Arab experts specializing in diverse populations relevant to the study reassessed the questionnaire as part of the face validity assessment. This expert team included researchers and mental health care providers from different professions and genders, all with considerable experience. To address missing data, we applied mean substitution, replacing missing values with the mean of each specific item calculated across all responses in the sample. The number of missing values was minimal, and there were no cases where more than 50% of the items for any respondent were unanswered.

Results

Description of the sample

Table 1 displays the characteristics of participants in each group sample. Most participants across groups were female, constituting 64% in the adolescents’ sample, 67.9% in the students’ sample, and 68.4% in the general public sample. The mean age was 16.25 years for the adolescent sample (range 14–18), 36.56 for the general public sample (range 18–72), and 25.13 for the student sample (range 19–40). In the sample of adolescents, 54.1% reported an above-average socioeconomic status, compared to 11.9% in the student sample and 24.8% in the general public sample. Furthermore, the majority of participants in all three samples reported no history or current diagnosis of mental illness, and the mean scores for psychological distress were low across all three groups.

thumbnail
Table 1. Sociodemographic and Clinical Characteristics of Participants in Each Group Sample.

https://doi.org/10.1371/journal.pone.0335126.t001

Exploratory factor analysis

Tables 2, 3, and 4 present EFA results for adolescents, student samples, and adults from the general public community, respectively. These tables illustrate the final solution, including variables, factor loadings, corrected item-total correlations, alpha values with item deletion, and the Cronbach’s alpha of the subscale.

thumbnail
Table 2. Results of exploratory factor analysis and reliability tests of Mental Health Literacy Scale in the adolescents’ sample (N = 172); MHLS-Arabic-Adolescents.

https://doi.org/10.1371/journal.pone.0335126.t002

thumbnail
Table 3. Results of exploratory factor analysis and reliability tests of Mental Health Literacy Scale in the students sample (N = 109); MHLS-Arabic-Students.

https://doi.org/10.1371/journal.pone.0335126.t003

thumbnail
Table 4. Results of exploratory factor analysis and reliability tests of Mental Health Literacy Scale in the general public sample (N = 206); MHLS-Arabic-General Public.

https://doi.org/10.1371/journal.pone.0335126.t004

The Adolescents’ sample.

In the adolescent sample, four items from the original MHLS were excluded (items 10, 12, 15, and 20) due to either false loading inconsistent with theoretical understanding or a low factor loading of less than 0.35. The final model comprised 31 items and was divided into five factors instead of six in the original MHLS. As depicted in Table 2, Factor 1, “Recognition of Anxiety and Depression Disorders,” demonstrated a Cronbach’s alpha of 0.72 with individual corrected item-total correlations ranging between 0.48 and 0.62. The Spearman correlation between the three items of Factor 1 was significant (p < 0.001) and ranged between r = 0.32 and r = 0.57. Factor 2, “Mental Health Knowledge,” had a Cronbach’s alpha of 0.84 with individual corrected item-total correlations between 0.45 and 0.62. The Spearman correlations between the nine items of Factor 2 were significant (p < 0.05) and ranged between r = 0.17 and r = 0.56. Factor 3, “Knowledge of where to seek information,” remained consistent with the original MHLS, comprising the same four items and demonstrating a Cronbach’s alpha of 0.80. Individual corrected item-total correlations ranged between 0.67 and 0.85, with a significant Spearman correlation between the items (p < 0.001) ranging between r = 0.67 and r = 0.85. The last dimension in the original MHLS, “Attitudes that promote recognition or appropriate help-seeking behavior,” was divided into two factors in the adolescent sample. Factor 4, “Attitude toward mental illness,” displayed a Cronbach’s alpha of 0.77 with individual corrected item-total correlations ranging between 0.38 and 0.63. The Spearman correlation between the six items of this factor was significant (p < 0.001) and ranged between r = 0.16 and r = 0.57. In parallel, Factor 5, “Attitudes towards people with a mental health problem,” had a Cronbach’s alpha of 0.87 with individual corrected item-total correlations between 0.36 and 0.77. The Spearman correlation between the nine items of this factor was significant (p < 0.01) and ranged between r = 0.22 and r = 0.73.

The student sample.

In the student sample, five items were excluded (items 3, 10, 12, 15, and 20). The final model comprised 30 items and was divided into six factors. As illustrated in Table 3 Factor 1, ‘Ability to Recognize Disorders,’ remained similar to dimension 1 in the original MHLS, excluding item 3. This factor exhibited a Cronbach’s alpha of 0.87, with individual corrected item-total correlations ranging between 0.49 and 0.72. The Spearman correlation among the three items of Factor 1 was significant (p < 0.001) and ranged between r = 0.42 and r = 0.63. Factor 2, “Mental Health Knowledge,” was reduced to four items compared to the same factor in the previous samples. It combines items from the dimensions ‘Knowledge of Risk Factors and Causes,’ ‘Knowledge of Professional Help Available,’ and ‘Knowledge of Self-Treatment’ in the original MHLS. This factor had a Cronbach’s alpha of 0.75, with individual corrected item-total correlations between 0.51 and 0.60. The Spearman correlation among the nine items of Factor 2 was significant (p < 0.001) and ranged between r = 0.35 and r = 0.64. Factor 3, “Knowledge of Where to Seek Information,” remained consistent with the original MHLS and factor 3 in the adolescent and general public samples, including the same four items. It demonstrated a Cronbach’s alpha of 0.79, with individual corrected item-total correlations ranging between 0.57 and 0.63. The Spearman correlation among the items was significant (p < 0.001), ranging between r = 0.40 and r = 0.65. The last dimension in the original MHLS, “Attitudes that Promote Recognition or Appropriate Help-Seeking Behavior,” was divided into three factors in the student sample. Factor 4, “Attitude toward mental illness” displayed a Cronbach’s alpha of 0.83, with individual corrected item-total correlations ranging between 0.55 and 0.75. The Spearman correlation among the four items of this factor was significant (p < 0.001) and ranged between r = 0.46 and r = 0.74. Factor 5, “Attitudes about Mental health treatment,” had a Cronbach’s alpha of 0.84, with individual corrected item-total correlations between 0.60 and 0.74. The Spearman correlation among the four items of this factor was significant (p < 0.001) and ranged between r = 0.45 and r = 0.66. Lastly, Factor 6, “Attitudes Towards People with a Mental Health Problem,” had a Cronbach’s alpha of 0.90, with individual corrected item-total correlations between 0.60 and 0.79. The Spearman correlation among the seven items of this factor was significant (p < 0.001) and ranged between r = 0.32 and r = 0.87.

The general public sample.

In the general population sample, two items (items 15 and 20) were excluded for reasons consistent with those in the previous sample. The final model comprised 33 items and was organized into five factors, a departure from the original six factors in the MHLS.

As depicted in Table 4, Factor 1, “Mental Health Knowledge,” exhibited a robust Cronbach’s alpha of 0.92, with individual corrected item-total correlations ranging between 0.51 and 0.78. The Spearman correlation among the 12 items of Factor 1 was significant (p < 0.001), ranging between r = 0.24 and r = 0.74. This factor amalgamated the three dimensions of ‘Ability to recognize disorders,’ ‘Knowledge of risk factors and causes,’ and ‘Knowledge of professional help available’ from the original MHLS. Factor 2, ‘Knowledge of Self-Treatment,’ retained its structure from the original MHLS but with two items instead of three. The Spearman correlation between the items was significant, r = 0.53 (p < 0.001). The other three factors mirrored those in the adolescent sample, maintaining the same items and division. Factor 3, “Knowledge of Where to Seek Information,” remained consistent with the original MHLS, boasting a Cronbach’s alpha of 0.91. Individual corrected item-total correlations ranged between 0.73 and 0.85, with a significant Spearman correlation between the items (p < 0.001) ranging between r = 0.59 and r = 0.81. Factor 4, “Attitude Toward Mental Illness,” demonstrated a Cronbach’s alpha of 0.82, with individual corrected item-total correlations ranging between 0.51 and 0.70. The Spearman correlation between the six items of this factor was significant (p < 0.001), ranging between r = 0.28 and r = 0.63. Factor 5, “Attitudes Towards People with a Mental Health Problem,” displayed a Cronbach’s alpha of 0.91, with individual corrected item-total correlations between 0.52 and 0.82. The Spearman correlation among the nine items of this factor was significant (p < 0.001), ranging between r = 0.30 and r = 0.82 (Table 4).

Concurrent validity

Table 5 presents the new MHL factors’ means, standard deviations, and correlations among the adolescents, student samples, and adults from the general public. It is evident that moderate to high levels of MHL are observed in all factors among the three distinct samples.

thumbnail
Table 5. Means, Standard Deviations, and correlates for MHL factors by group samples.

https://doi.org/10.1371/journal.pone.0335126.t005

Concerning the correlations, as depicted in Table 5, different factors exhibit varying associations with participant characteristics in the three samples. Among adolescents, we found significant differences in Recognition of Anxiety and Depression Disorders among participants with different levels of socioeconomic status. Individuals with an average and above socioeconomic status demonstrate higher MHL in Recognizing Anxiety and Depression Disorders compared to those below average. Moreover, individuals with a current or history of mental illness exhibit more positiveAttitudes towards people with mental health problems. While a positive significant correlation exists between psychological distress and Recognition of Anxiety and Depression Disorders, negative significant correlations are found between psychological distress and Knowledge of where to seek information, as well as Attitude toward mental illness.

Among the student sample, female students report significantly higher MHL in all factors except Attitudes toward people with mental health problems. Those with an average and above socioeconomic status demonstrate significantly higher MHL only in the factor Attitudes about Mental health treatment. Psychological distress is positively and significantly correlated only with the MHL factor Mental Health Knowledge.

Finally, among adults from the general public sample, age is positively and significantly related to all MHL factors except Knowledge of where to seek information. At the same time, women significantly display higher MHL in all aspects. Those with an average and above socioeconomic status demonstrate significantly higher MHL in Mental Health Knowledge, Knowledge of where to seek information and Attitude toward mental illness. Similar to the adolescent sample, individuals with a history of mental illness exhibit more positive attitudes towards people with mental health problems. Positive significant correlations are found between psychological distress and Attitude toward mental illness, as well as Attitudes toward people with a mental health problem.

Face validity

The questionnaire underwent a rigorous evaluation process by experts, as detailed in the statistical analysis subsection, where each factor and its assigned items were thoroughly assessed through the EFA. An exceptional level of agreement was achieved, with experts expressing high agreement rates ranging from 80% to 100% in all items and in each sample. This significant level of inter-expert agreement is a strong indicator of face validity.

Table 6 consolidates the findings, displaying items in English and Arabic and the association of each item with its corresponding factor as determined by the analysis within each research sample.

thumbnail
Table 6. English and Arabic Items and Their Division into Factors Across Samples.

https://doi.org/10.1371/journal.pone.0335126.t006

Discussion

This study aimed to evaluate the reliability and validity of the MHLS [12] in Arabic among three distinct groups: adolescents, emerging adults in academic settings (students), and individuals in the general public. The evaluation of the original MHLS among these groups (MHLS-Arabic-Adolescents, MHLS-Arabic-General Public, and MHLS-Arabic-Students) demonstrated strong construct validity and higher reliability coefficients compared to other published studies, both in general and particularly those conducted among Arab participants [9,17,18,22,23].

However, our analyses raise several significant and intriguing points for discussion. First, our empirical findings not only corroborate the multidimensional concept of MHL [3], but also hint at the possibility that MHL is influenced by more nuanced contexts beyond mere cultural and linguistic factors. This suggests a more profound, more complex interplay that warrants further exploration. This observation is underscored by the different divisions of the MHLS dimensions among three groups originating from the same cultural and societal background and sharing the same language and dialect. Our findings underscore the significance of incorporating micro-contexts into the validation of the MHLS. Validation measures for MHL tools must be tailored to the specific nuanced to adequately address the complexities of mental health understanding and management across diverse settings. This understanding allows for ongoing research to explore aspects requiring deeper comprehension, thereby facilitating the development of more focused intervention programs grounded in these studies.

Second, it was interesting to observe that items 15, “A mental health professional can break confidentiality if your problem is not life-threatening and they want to assist others to better support you,” and 20, “People with a mental illness could snap out of it if they wanted,” received low loading factors across all three samples and as a result were excluded. This finding is consistent with previous research that included various MHL versions. These two items were omitted in Saudi Arabic, French, Chinese, and Slovenian versions [16,17,22,23,36,38]. It is plausible that item I-15 lacks clarity, as typically, involving family members in shared decision-making regarding the treatment and management of mental disorders is an important aspect of mental health care [39,40]. Regarding the unclarity of item I-20, Wang et al. [16] argue that the statement appears overly absolute. They suggest that mental illness could be self-cured in certain instances, such as through self-practiced mindfulness practices [41]. These findings highlight the necessity for continual refinement and validation of assessment tools to ensure accurate measurement of MHL across diverse populations.

Thirdly, within the MHLS, the original dimension, “Attitudes that promote recognition or appropriate help-seeking behavior,” underwent differentiation into two factors among adolescents and the general public: “Attitude toward mental illness” and “Attitudes towards people with a mental health problem.” However, among the student sample, it further subdivided into three factors: “ Attitude toward mental illness”, “Attitudes about Mental health treatment,” and “Attitudes towards people with a mental health problem.” These findings echo previous studies, which also observed the division of this dimension into multiple attitudes [17,18,42]. The differentiation of the original dimension in the MHLS into distinct factors among different populations underscores the intricate nature of attitudes toward mental health and help-seeking behaviors. Our research underscores the importance of differentiating attitudes toward mental illness, which span a broader spectrum encompassing risk factors, treatments, and additional factors, as opposed to attitudes solely targeting individuals with mental disorders.

Lastly, to our knowledge, this study is the first to examine the validity of the MHLS tool among adolescents. This is notable due to the existing research gap in MHL studies focusing on this population [43,44], compounded by a scarcity of instruments tailored for assessing MHL within this age group [45]. The findings of the study, particularly the identification of a unique factor related to recognizing depression and anxiety disorders, highlight the importance of conceptualizing and measuring MHL with adjustments tailored to adolescent populations. The inclusion of a factor associated with depression and anxiety recognition is unsurprising, considering the World Health Organization’s assertation that these conditions are the primary contributors to disability among adolescents [46]. This underscores the urgency for intervention programs to prioritize MHL efforts focused on the prevention of depression and anxiety among adolescents in this vulnerable group.

Limitations and future research

Two limitations of the study should be noted. First, the study was specifically conducted among the Arabic-speaking Palestinian citizens of Israel. Given the diversity among Arab populations worldwide, concentrating on this specific subgroup could potentially affect the generalizability of the MHLS validation. While the use of modern standard literary Arabic, widely accepted and employed among Arabs universally, may help mitigate the potential impact of this limitation, language alone may not capture the full range of cultural and contextual factors that shape MHL. Variables such as national health systems, religious norms, conflict exposure, and migration histories may all influence how individuals understand and respond to MHLS items, even when the language is standardized. These factors could affect the interpretation, relevance, and validity of certain items across diverse Arab contexts.

We recommend that future studies examine our adapted version among other Arab populations worldwide to assess its applicability and effectiveness in varying contexts. This broader examination will enhance the generalizability of our findings and provide valuable insights into the nuances of MHL within different Arab communities.

Second, data collection relied on self-reports, potentially introducing inaccuracies in participant responses and potentially amplifying social desirability bias. Additionally, in our factor analysis, Factor 2 within the general public sample consists of only two items, which may not offer sufficient robustness and may reflect a sample-specific pattern or item-level variation rather than a stable construct. While we followed previous studies validating the MHLS in our statistical analysis to ensure that the factors reflect the theoretical constructs of mental health literacy [22], we also drew on literature suggesting that EFA is sufficient for the cross-cultural adaptation of health-related scales [47,48]. However, some aspects of validity and reliability were not assessed, such as confirmatory factor analysis and test-retest reliability, as the study was conducted at a single point in time. Importantly, convergent and discriminant validity were not tested using external measures, which limits the strength of our psychometric conclusions’ strength. Future studies should employ diverse data collection methods to triangulate information and enhance the reliability of MHL tools validation, but also incorporate external validation tools, and investigate the factor structure further, particularly in the general public version of the scale, to refine the instrument and enhance its cross-contextual utility. Integrating our quantitative findings with qualitative studies can offer a more comprehensive understanding of the MHLS and help mitigate the impact of potential inaccuracies and social desirability bias.

Conclusion and implications

In conclusion, this study presents three modified MHLS Arabic versions—MHLS-Arabic-Adolescents, MHLS-Arabic-General Public, and MHLS-Arabic-Students—as suitable instruments for assessing MHL among Arab-speaking populations globally. Our findings potentially contribute to the existing body of knowledge on MHL measurement by highlighting its inherent complexity and suggesting the importance of adopting micro-context-specific approaches for assessing MHL. This underscores the imperative to refine the MHLS to capture MHL’s nuances across diverse populations. Moreover, this study makes a notable contribution to the literature by providing three reliable modified versions of the MHLS in Arabic. This is particularly significant as it enables the study of MHL among the 436 million Arabic-speaking individuals worldwide who suffer from a high prevalence of mental health problems and disorders. Understanding MHL across different Arab demographic groups can facilitate the development of tailored intervention initiatives that aim to promote mental health service use, enhance mental health outcomes, and ensure equitable access to high-quality treatments. Finally, this research has an indirect yet equally important implication: the need for foundational exploration of MHL among Arabs. Understanding how MHL manifests within these communities is essential for developing new questionnaires, not just ones modified from existing ones but specifically tailored to assess MHL across diverse Arab groups.

Acknowledgments

This study was conducted as part of the Takemi Program in International Health at Harvard University and was supported by the program. The contributions of Dr. Gelaye were made as part of his official duties as a National Institutes of Health (NIH) federal employee, are in compliance with agency policy requirements, and are considered Works of the United States Government. However, the findings and conclusions presented in this paper are those of the author(s) and do not necessarily reflect the views of the NIH or the U.S. Department of Health and Human Services.

References

  1. 1. Jorm AF, Korten AE, Jacomb PA, Christensen H, Rodgers B, Pollitt P. “Mental health literacy”: a survey of the public’s ability to recognise mental disorders and their beliefs about the effectiveness of treatment. Med J Aust. 1997;166(4):182–6. pmid:9066546
  2. 2. World Health Organization. Health promotion [Internet]. Geneva: World Health Organization; 2003. https://www.who.int/healthpromotion/health-literacy/en/
  3. 3. Jorm AF. Mental health literacy: empowering the community to take action for better mental health. Am Psychol. 2012;67(3):231–43. pmid:22040221
  4. 4. Bjørnsen HN, Espnes GA, Eilertsen M-EB, Ringdal R, Moksnes UK. The Relationship Between Positive Mental Health Literacy and Mental Well-Being Among Adolescents: Implications for School Health Services. J Sch Nurs. 2019;35(2):107–16. pmid:28950750
  5. 5. Jafari A, Nejatian M, Momeniyan V, Barsalani FR, Tehrani H. Mental health literacy and quality of life in Iran: a cross-sectional study. BMC Psychiatry. 2021;21(1):499. pmid:34641793
  6. 6. Kutcher S, Wei Y, Coniglio C. Mental Health Literacy: Past, Present, and Future. Can J Psychiatry. 2016;61(3):154–8. pmid:27254090
  7. 7. Cheng H, Wang C, McDermott RC, Kridel M, Rislin JL. Self‐Stigma, Mental Health Literacy, and Attitudes Toward Seeking Psychological Help. Jour of Counseling & Develop. 2018;96(1):64–74.
  8. 8. Gorczynski P, Sims-schouten W, Hill D, Wilson JC. Examining mental health literacy, help seeking behaviours, and mental health outcomes in UK university students. JMHTEP. 2017;12(2):111–20.
  9. 9. Noroozi A, Khademolhosseini F, Lari H, Tahmasebi R. The Mediator Role of Mental Health Literacy in the Relationship Between Demographic Variables and Health-Promoting Behaviours. Iran J Psychiatry Behav Sci. 2018;12(2).
  10. 10. Abo-Rass F, Abu-Kaf S. Mental Health Literacy among the Palestinian‐Arab Minority in Israel and Its Correlates with Mental Health Service Use. Perspectives in Psychiatric Care. 2023;2023(1).
  11. 11. Jorm AF. Mental health literacy. Public knowledge and beliefs about mental disorders. Br J Psychiatry. 2000;177:396–401. pmid:11059991
  12. 12. O’Connor M, Casey L. The Mental Health Literacy Scale (MHLS): A new scale-based measure of mental health literacy. Psychiatry Res. 2015;229(1–2):511–6. pmid:26228163
  13. 13. Wei Y, McGrath PJ, Hayden J, Kutcher S. Measurement properties of tools measuring mental health knowledge: a systematic review. BMC Psychiatry. 2016;16(1):297. pmid:27553955
  14. 14. Kim EJ, Yu JH, Kim EY. Pathways linking mental health literacy to professional help-seeking intentions in Korean college students. J Psychiatr Ment Health Nurs. 2020;27(4):393–405. pmid:31954091
  15. 15. Laufer A, Khatib A, Finkelstein M. The association between mental health literacy and resilience among individuals who received therapy and those who did not. JMHTEP. 2023;19(1):36–48.
  16. 16. Wang A, Jia S, Shi Z, Sun X, Zhu Y, Shen M. Validation and Psychometric Testing of the Chinese Version of the Mental Health Literacy Scale Among Nurses. Front Psychol. 2022;12:791883. pmid:35153915
  17. 17. Montagni I, González Caballero JL. Validation of the Mental Health Literacy Scale in French University Students. Behav Sci (Basel). 2022;12(8):259. pmid:36004830
  18. 18. Akhtar IN. Mental Health Literacy Scale: Translation and Validation in Pakistani Context. PSSR. 2020;4(II):722–35.
  19. 19. Furnham A, Swami V. Mental health literacy: A review of what it is and why it matters. Int Perspect. 2018;7(4):240–57.
  20. 20. Furnham A, Hamid A. Mental health literacy in non-western countries: a review of the recent literature. Mental Health Review Journal. 2014;19(2):84–98.
  21. 21. Okasha A, Karam E, Okasha T. Mental health services in the Arab world. World Psychiatry. 2012;11(1):52–4. pmid:22295010
  22. 22. Alshehri E, Alosaimi D, Rufaidi E, Alsomali N, Tumala R. Mental Health Literacy Scale Arabic Version: A Validation Study Among Saudi University Students. Front Psychiatry. 2021;12:741146. pmid:34646177
  23. 23. BinDhim NF, Althumiri NA, Ad-Dab’bagh Y, Alqahtani MMJ, Alshayea AK, Al-Luhaidan SM, et al. Validation and psychometric testing of the Arabic version of the mental health literacy scale among the Saudi Arabian general population. Int J Ment Health Syst. 2023;17(1):42. pmid:38053169
  24. 24. Zuberi A, Waqas A, Naveed S, Hossain MM, Rahman A, Saeed K, et al. Prevalence of Mental Disorders in the WHO Eastern Mediterranean Region: A Systematic Review and Meta-Analysis. Front Psychiatry. 2021;12:665019. pmid:34335323
  25. 25. Al-Krenawi A. Attitudes, beliefs, and stigma toward mental health issues among Palestinian citizens in Israel. Mental health and Palestinian citizens in Israel. Indiana: University Press. 2019. p. 165–76.
  26. 26. Hamid A, Furnham A. Factors affecting attitude towards seeking professional help for mental illness: a UK Arab perspective. Mental Health, Religion & Culture. 2013;16(7):741–58.
  27. 27. Zolezzi M, Alamri M, Shaar S, Rainkie D. Stigma associated with mental illness and its treatment in the Arab culture: A systematic review. Int J Soc Psychiatry. 2018;64(6):597–609. pmid:30019976
  28. 28. Ciftci A, Jones N, Corrigan PW. Mental Health Stigma in the Muslim Community. Journal of Muslim Mental Health. 2013;7(1).
  29. 29. Koenig HG, Al Zaben F, Sehlo MG, Khalifa DA, Al Ahwal MS, Qureshi NA, et al. Mental Health Care in Saudi Arabia: Past, Present and Future. OJPsych. 2014;04(02):113–30.
  30. 30. Abo-Rass F, Shinan-Altman S, Werner P. Depression Illness Representations Among Arabs in Israel: a Qualitative Study Comparing Younger and Older Adults. J Cross Cult Gerontol. 2020;35(4):353–66. pmid:32949318
  31. 31. Goldberg DP. The detection of psychiatric illness by questionnaire. 1972.
  32. 32. Daradkeh TK, Ghubash R, el-Rufaie OE. Reliability, validity, and factor structure of the Arabic version of the 12-item General Health Questionnaire. Psychol Rep. 2001;89(1):85–94. pmid:11729557
  33. 33. Abo-Rass F, Nakash O, Gelaye B, Khatib A, AboJabel H. Determinants of intentions to seek formal mental health help among Palestinian adolescents in Israel. Int J Soc Psychiatry. 2024;70(4):720–9. pmid:38312061
  34. 34. Abo-Rass F, Khatib A, Abu-Kaf S, Nakash O. Association between mental health literacy and formal help-seeking behaviors among students from the Palestinian-Arab minority in Israel. Arch Psychiatr Nurs. 2024;53:158–64. pmid:39615929
  35. 35. Sousa VD, Rojjanasrirat W. Translation, adaptation and validation of instruments or scales for use in cross-cultural health care research: a clear and user-friendly guideline. J Eval Clin Pract. 2011;17(2):268–74. pmid:20874835
  36. 36. Tavakol M, Dennick R. Making sense of Cronbach’s alpha. Int J Med Educ. 2011;2:53–5. pmid:28029643
  37. 37. Field AP. Discovering statistics using SPSS. 2nd ed. Sage Publications; 2005.
  38. 38. Krohne N, Gomboc V, Lavrič M, Podlogar T, Poštuvan V, Šedivy NZ, et al. Slovenian Validation of the Mental Health Literacy Scale (S-MHLS) on the General Population: A Four-Factor Model. Inquiry. 2022;59:469580211047193. pmid:35135367
  39. 39. Butler AM. Shared decision-making, stigma, and child mental health functioning among families referred for primary care-located mental health services. Fam Syst Health. 2014;32(1):116–21. pmid:24447150
  40. 40. Huang C, Plummer V, Lam L, Cross W. Perceptions of shared decision-making in severe mental illness: An integrative review. J Psychiatr Ment Health Nurs. 2020;27(2):103–27. pmid:31444919
  41. 41. Parsons CE, Crane C, Parsons LJ, Fjorback LO, Kuyken W. Home practice in Mindfulness-Based Cognitive Therapy and Mindfulness-Based Stress Reduction: A systematic review and meta-analysis of participants’ mindfulness practice and its association with outcomes. Behav Res Ther. 2017;95:29–41. pmid:28527330
  42. 42. Ikeyama M, Imamura K, Kawakami N. Reliability and validity of the Japanese version of the Mental Health Literacy Scale (MHLS) among undergraduate and graduate students in the medical field. Cold Spring Harbor Laboratory. 2022.
  43. 43. Mansfield R, Patalay P, Humphrey N. A systematic literature review of existing conceptualisation and measurement of mental health literacy in adolescent research: current challenges and inconsistencies. BMC Public Health. 2020;20(1):607. pmid:32357881
  44. 44. Sodi T, Quarshie EN-B, Oppong Asante K, Radzilani-Makatu M, Makgahlela M, Nkoana S, et al. Mental health literacy of school-going adolescents in sub-Saharan Africa: a regional systematic review protocol. BMJ Open. 2022;12(9):e063687. pmid:36127093
  45. 45. Kågström A, Pešout O, Kučera M, Juríková L, Winkler P. Development and validation of a universal mental health literacy scale for adolescents (UMHL-A). Psychiatry Res. 2023;320:115031. pmid:36608527
  46. 46. World Health Organization. Mental health of Adolescents. https://www.who.int/news-room
  47. 47. Acar S, Savci S, Keskinoğlu P, Akdeniz B, Özpelit E, Özcan Kahraman B, et al. Tampa Scale of Kinesiophobia for Heart Turkish Version Study: cross-cultural adaptation, exploratory factor analysis, and reliability. J Pain Res. 2016;9:445–51. pmid:27382331
  48. 48. Balqis-Ali NZ, Saw PS, Jailani AS, Fun WH, Mohd Saleh N, Tengku Bahanuddin TPZ, et al. Cross-cultural adaptation and exploratory factor analysis of the Person-centred Practice Inventory - Staff (PCPI-S) questionnaire among Malaysian primary healthcare providers. BMC Health Serv Res. 2021;21(1):32. pmid:33413325