Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Health Literacy Measure for Adolescents (HELMA): Development and Psychometric Properties

Health Literacy Measure for Adolescents (HELMA): Development and Psychometric Properties

  • Shahla Ghanbari, 
  • Ali Ramezankhani, 
  • Ali Montazeri, 
  • Yadollah Mehrabi
PLOS
x

Abstract

Background

Health literacy refers to personal competencies for the access to, understanding of, appraisal of and application of health information in order to make sound decisions in everyday life. The aim of this study was to develop and evaluate the psychometric properties of an instrument for the measurement of health literacy among adolescents (the Health Literacy Measure for Adolescents-HELMA).

Methods

This study was made up of two phases, qualitative and quantitative, which were carried out in 2012–2014 in Tehran, Iran. In the qualitative part of the study, in-depth interviews with 67 adolescents aged 15–18 were carried out in 4 high schools to generate the initial item pool for the survey. The content validity of the items was then assessed by an expert panel review (n = 13) and face validity was assessed by interviewing adolescents (n = 16). In the quantitative part of the study, in order to describe the psychometric properties of the scale, validity, reliability (internal consistency and test-retest) and factor analysis were assessed.

Results

An item pool made up of 104 items was generated at the qualitative stage. After content validity was considered, this decreased to 47 items. In the quantitative stage, 582 adolescents aged 15–18 participated in the study with a mean age of 16.2 years. 51.2% of participants were females. In principal component factor analysis, 8 factors were loaded, which accounted for 53.37% of the variance observed. Reliability has been approved by α = 0.93 and the test-retest of the scale at two-week intervals indicated an appropriate stability for the scale (ICC = 0.93). The final questionnaire was approved with 44 items split into eight sections. The sections were titled: gain access to, reading, understanding, appraise, use, communication, self-efficacy and numeracy.

Conclusion

The Health Literacy Measure for Adolescents (HELMA) is a valid and reliable tool for the measurement of the health literacy of adolescents aged 15–18 and can be used to evaluate different levels of functional, interactive, and critical health literacy in adolescents.

Introduction

Health literacy was introduced around 40 years ago [1,2] and since then has become an issue considered to be important in the public’s health and in recent years, it has received substantial attention [3,4].

Health literacy was defined from different perspectives and thus various definitions have been given to it [1,5,6]. Recently, the European Consortium on Health Literacy Score (HLS) gave a more comprehensive definition of health literacy. They suggested four key factors for health literacy: the ability to access, understand, appraise, and apply health information in order to make decisions in everyday life in the three main areas of disease prevention, healthcare, and health promotion [2,4,6]. Most studies on health literacy took place in medical settings and showed that lower health literacy was associated with poorer health outcomes, health disparities, and increased healthcare expenditure [710].

Health literacy is widely recognized as the most important social determinant of health and outcome of health education endeavors [6,11,12]. Furthermore, it includes competencies such as interactive and critical skills that are necessary to better control one's health [13]. In public health, health literacy is assumed to be an asset that can reduce health disparities [14] and improve social capital [12]. It brings together the fields of education and health and creates the framework to enhance individuals' abilities to achieve good health throughout their life [15,16].

Adolescence is an important period of life, with specific regard to independent decision-making. It is therefore a crucial time to arm adolescents with accurate and reliable health information so they can develop lifelong healthy behavior [17], as well as to enable them to take control of the condition of their own health [18].

Broad access to information via the Internet has given rise to great concerns about adolescent health literacy and the validity of the information they obtain. Limited search abilities, or low literacy skills, make it difficult for adolescents to find and understand good quality information. There is not a school health curriculum, meaning adolescents may not achieve optimal health literacy, which in turn may lead to poorer health outcomes and health disparity [17,19].

Most researchers agreed that health literacy is related to the context, so different settings may require different assessment tools. Despite there being many studies on the development and assessment of instruments used for measuring health literacy in clinical settings [20], few studies have addressed the health literacy of adolescents [21], particularly within schools [22]. This is mainly due to the lack of a comprehensive definition of health literacy and lack of proper assessment tools [3]. As suggested by Nutbeam, a good questionnaire for measuring health literacy should be able to assess a person’s ability to gain access to information from different sources, understand health information, and appropriately apply health information to achieve personal benefit [14].

The Rapid Estimate of Adult Literacy in Medicine (REALM) and the Test of Functional Health Literacy in Adults (TOFHLA) are popular health literacy measurement tools, which were primarily designed and used in clinical settings [13] and subsequently used in studies of adolescent health literacy [23,24]. These measures are currently criticized for their limited focus as they merely assess reading and numeracy skills and do not capture further elements of health literacy such as self-efficacy, communication, and critical thinking [13,25,26]. However, some specific instruments for measuring health literacy among adolescents were found. Wu et al. developed a detailed questionnaire which consisted of 47 items for assessing students’ health literacy in high schools [3]. Their instrument was criticized for being time-consuming, difficult to complete, less applicable to public health surveys, and limited on its outcomes surrounding abilities such as the understanding and evaluation of health information.

Abel et al. designed a short multidimensional tool for measuring health literacy in young adults in the context of everyday life [20]. This was found to be very broad and general, despite considering different dimensions of health literacy.

Massey et al., in a study that contextualized the concept of health literacy among insured adolescents in health centers [27], developed a questionnaire made up of 24 items split into 6 sections for measuring the health literacy of adolescents [13]. The instrument focused on the limited aspects of health literacy among specific sub-groups of adolescents in a healthcare setting, thus making its application very limited. We therefore thought that it is time to develop a more general instrument for measuring health literacy in adolescents in order to facilitate future studies on the topic with a broader application. In particular, the presented study aimed to develop a specific multidimensional measure of health literacy for adolescents aged 15–18 and then provide an evaluation of its psychometric properties. We defined and operationalized health literacy as indicated by adolescents and included the following areas in the survey: gain access to, reading, understanding, appraisal, use, communication and numeracy.

Materials and Methods

This study had two phases, one of which was qualitative, while the other was quantitative. Descriptions of these are provided as follows:

Phase 1

i) Item generation.

Using a qualitative approach, 67 in-depth interviews were conducted with high school students aged 15–18 from November 2012 to February 2013. Interviews were carried out in 4 schools in Tehran, Iran. Participants were selected using purposeful sampling.

During the interviews the adolescents’ were asked about literacy, health, health literacy, awareness of health information resources, their previous experiences in relation to searching for health information, and their use of health information and services.

Sampling continued until no further new data emerged, indicating that the data saturation point was reached. The duration of each interview varied from 25 to 40 minutes. All interviews were digitally recorded having obtained the permission of the participants. After completing each interview, it was listened to carefully several times and transcribed word for word. The data was explored using content analysis and an initial pool of 104 items was generated based on this analysis. After a careful review of the items by the research team, the number of items was reduced to 81. The questionnaire was then scrutinized for its content validity and its face validity.

ii) Content validity.

The content validity of the questionnaire was carried out using qualitative and quantitative approaches. First, 10 specialists in health education and health promotion, public health, epidemiology, educational planning, and management reviewed the questionnaire to check its grammar, wording, item allocation, and scaling. During the quantitative stage, in order to calculate the Content Validity Ratio (CVR), 13 other specialists were asked to assess each item on a 3-point Likert scale (where 1 = essential, 2 = useful but not essential, 3 = not essential). Then, based on Lawshe’s table [28], items that scored greater than or equal to 0.54 were kept in the scale. Throughout this phase, 27 items were removed. In order to calculate the Content Validity Index (CVI), 10 additional expert panelists were asked to determine the relevance, clarity, and simplicity of each item using a 4-point Likert scale. Usually a same group of experts rate the CVR and the CVI. For more precision we used two separate groups of experts. However, in accordance with Waltz and Baussel [29], items with CVI value greater than or equal to 0.79 were accepted and 7 items that did not meet this criterion were deleted. 47 items had a CVI value of greater than or equal to 0.79.

iii) Face validity.

The face validity of the scale was determined in two stages. In the qualitative stage, 16 adolescents aged 15–18 (8 boys and 8 girls) were recruited using convenience sampling to determine the ambiguity, relevance and difficulty of each item. At this stage, none of the items were removed but 3 items were changed as a result of the adolescents’ suggestions.

During the quantitative stage, the impact score of each item was calculated (impact score = frequency (%) × importance). For this purpose, another sample of 26 adolescents was asked to score the importance of each item on a 5-point Likert scale. The items with impact scores of 1.5 or above were considered to be satisfactory [30]. Following the content validity and face validity checks, the pre-final version of the instrument (the Health Literacy Measure for Adolescents-HELMA) had 47 items and was ready for the quantitative phase.

Phase 2

i) Design and data collection.

Psychometric analysis of the HELMA was performed by way of a cross sectional study with a sample of adolescents aged 15–18 who were studying in high school in Tehran. Participants were recruited using a multi stage sampling method. For sampling, Tehran was divided into to 5 regions: north, south, west, east and center. In each region, a district was selected randomly. In the next stage, two high schools from each district (one boys’ school and one girls’ school) were identified. Then, based on the population of each class, 3 to 4 classes were assigned randomly.

As was recommended, we estimated that a sample of 470 students would be enough for this study (10 individuals per item of the questionnaire) [31]. However, 717 students of 31 classes participated in the study.

The study objectives were explained to the students, and after obtaining informed consent, participants completed the HELMA. Of 717 returned questionnaires, 65 were removed as the respondents’ ages were outside of the age range 15–18 years. 60 of the returned questionnaires were excluded as they had data missing. Statistical analysis was carried out using the remaining complete data. Demographic characteristics of the study participants, such as age, gender, grade, parents’ jobs and education, first source of health information, and overall health status, were also recorded.

ii) Statistical analysis.

The psychometric properties of HELMA were examined with several statistical analyses as follows:

  1. Construct validity: To investigate the construct validity, exploratory factor analysis with varimax rotation was used. To determine the number of required factors, the analysis was carried out multiple times using a different number of factors. To determine the number of potential underlying factors, eigenvalues above 1 and a scree plot were used [32]. Factor loadings greater than or equal to 0.40 were considered appropriate. To assess the appropriateness of the sample for the factor analysis, The Kaiser-Meyer-Olkin (KMO) and Bartlett’s Test of Sphericity were used [32,33].
  2. Reliability: Internal consistency and test-retest analyses were used in order to determine the reliability of the HELMA. To determine the internal consistency, the Cronbach’s (alpha) coefficient was measured for each dimension as well as for the entire scale. A Cronbach’s (alpha) coefficient of 0.70 or above indicates that the instrument has acceptable reliability [34]. To examine the instrument’s stability, test-retest was used. Two samples of adolescents (22 boys and 22 girls) completed the HELMA twice with a two-week interval [31,35], and the Intraclass Correlation Coefficients (ICC) were calculated where a value of 0.4 or above was considered to be acceptable [35]. All of the statistical analyses were performed using SPSS, version 17.0.

Ethics statement

The ethics committee of the Shahid Beheshti University of Medical Sciences approved the study. In addition to this, we obtained permission from authorities in the Ministry of Education. We also obtained verbal informed consent from all of the study’s participants. The consent was obtained verbally as we thought students may otherwise feel uneasy. In doing so, the main investigator (SHGH) introduced herself and the study’s objectives. The participants were then either interviewed (Phase 1) or given the questionnaire to complete (Phase 2) in private. They were ensured that their name and information would be kept confidential and they were told that they were free to leave the interview or not complete the study questionnaire if they did not wish to do so. This is considered to be an acceptable consent procedure by the ethics committees both at institutional level (Shahid Beheshti University of Medical Sciences) and at national level (Ministry of Health) for exceptional situations, and was confirmed for this study in particular.

Results

The sample characteristics

In all, 582 adolescents aged 15–18 participated in the study. The mean age of respondents was 16.2 years, 51.2% were females, 44.2% were interested or very interested in health issues, and 75.7% rated their overall health status as “good” or “very good”. 44.2% of respondents said that their parents were their first source of health information and a much lower percentage of 29.4%, claimed that the Internet was their first source of health information (Table 1).

thumbnail
Table 1. Demographic characteristics of adolescents participated in study (n = 582).

http://dx.doi.org/10.1371/journal.pone.0149202.t001

Factor structure

After confirming the adequacy of the sampling based on the KMO and Bartlett’s Test of Sphericity (KMO = 0.917 and χ2 = 11239.38, p< 0.0001), 11 factors emerged with eigenvalues of greater than 1, which accounted for 60.50% of the variance observed. Factor loading patterns of the 6 areas of reading, understanding, appraisal, communication and numeracy were consistent with the initial assumed item set. Due to the low loading of some factors, and in accordance with the dimensions of health literacy, the number of factors was limited to 8, with minimum factor loading of 0.45. Finally, 44 items were loaded in 8 factors that explained 53.37% of the variance, representing the following dimensions: access (5 items), reading (5 items), understanding (10 items), appraisal (5 items), use (4 items), communication (8 items), self-efficacy (4 items), and numeracy (3 items). The results are shown in Table 2.

thumbnail
Table 2. The result obtained from exploratory factor analysis with varimax rotation among adolescents aged 15–18 (n = 582).

http://dx.doi.org/10.1371/journal.pone.0149202.t002

Reliability

The Cronbach’s (alpha) coefficient for the entire scale was 0.93 and ranged from 0.61 to 0.89 for various domains. The intraclass correlation coefficient (ICC = 0.93) also indicated that HELMA had satisfactory stability (Table 3).

thumbnail
Table 3. Cronbach’s α coefficient and ICC for the HELMA and its subscales.

http://dx.doi.org/10.1371/journal.pone.0149202.t003

Discussion

This study was the first attempt to design and psychometrically evaluate an instrument to measure health literacy among adolescents in Iran. The initial questionnaire was developed based on data obtained from a qualitative study on adolescents aged 15–18, expert opinions, and extensive reviews of existing literature on health literacy. The designed questionnaire included a wide range of items to assess individual and interpersonal factors relating to adolescent health literacy. After the completion of the validity and reliability phases, the health literacy measure for adolescents (HELMA) consisted of 44 items within 8 areas. These areas were access, reading, understanding, appraisal, use, communication, self-efficacy and numeracy. As most participants completed the questionnaire without any difficulties in approximately 15 minutes, we believe that the HELMA is an easy-to-use questionnaire that can be used easily for future studies.

Some existing studies in Iran are limited as they must use translated versions of the better known instruments, such as the Test of Functional Health Literacy in Adults (TOFHLA) and the Newest Vital Sign (NVS) [3642].

Over the past two years, two new health literacy questionnaires were developed, one specifically for oral health and one for the adult urban population aged 18–65 [43,44], however, adolescent health literacy was not addressed.

Measuring health literacy among adolescents, not only in Iran but also elsewhere, is a relatively new issue. Although there are growing concerns about this, applying conventional health literacy measurements (such as TOFHLA, REALM, NVS) to this population has its limitations [45]. Few studies have investigated adolescent health literacy and fewer research projects have addressed this concept from adolescents’ perspectives.

The findings of this study indicated that the HELMA has appropriate validity and reliability. One of the features of the HELMA is that, in addition to functional health literacy, it captures other dimensions including interactive health literacy and critical health literacy. Given that health literacy is a context-specific concept [20], studying adolescents’ health literacy in a school is another important aspect of this study, which can help to overcome the challenges of health literacy assessments in non-clinical environments, particularly since this age group is often in the healthiest period of life and have less dealings with healthcare services [21].

Studies suggest that health literacy is a social feature that should be considered as a latent structure with multiple dimensions. The complex nature of the health literacy notion confirms the necessity to use a multi-dimensional tool [13,46]. The factor structure analysis of the few tools designed to assess adolescents' health literacy showed different patterns. For instance, Massey et al. introduced a multi-dimensional tool that captured health information seeking items in 3 distinct factors: health information seeking skills, confidence in health information from human sources and confidence in health information from media sources [13].

Abel et al. [20] developed a 4-dimension instrument that assesses functional, interactive and critical health literacy in adolescents. In this scale, the functional health literacy domain was reported in two discrete factors: the finding of health information and the understanding of health information.

In comparison to the mentioned studies, the factor structure of the HELMA is more varied, and due to each factor having a minimum of three items, the HELMA has a more reliable construction [47]. During the development of the items, we used the competencies necessary to address everyday life health issues that, in addition to capturing different aspects of health literacy, increased the validity of the HELMA. In the factor analysis, the items designed for the “access” area were loaded into two separate factors. In other words, to obtain health information as well as the ability to gain access to health information sources, self-confidence in attaining and using these resources was necessary.

Despite the large information gap between two generations, parents were the primary source of health information for almost half of the adolescents. The Internet was said to be the primary source of 29.4% of the respondents.

Based on the health literacy survey conducted in 2007 in five provinces, including Tehran, only 28.1% of adults have adequate health literacy [36]. Low health literacy of parents and wide and often unsupervised access of adolescents to the Internet, endorsed the need for educational interventions to improve the health literacy skills of this age group. Among the various sources of health information, physicians and health providers were in third place, which is most likely because adolescents are generally healthy and consequently have fewer interactions with the healthcare system.

As stated previously, this was the first attempt to measure the health literacy of Iranian adolescents. Future studies should be carried out among different age goups of adoelscents and in different environments. Perhaps the evaluation of such studies may lead to a stronger confirmation of the psychometric properties of the HELMA. For instance we feel that the variance obseved in the exploratory factor analysis was relatively low and this might increase in different settings. At present, both Persian and English versions of the quesionnaire are available.

Conclusion

The Health Literacy Measure for Adolescents (HELMA) is a valid and reliable instrument to measure the health literacy of adolescents and can be used for future studies.

Supporting Information

S1 File. The Health Literacy Measure for Adolescents (HELMA)-English version.

doi:10.1371/journal.pone.0149202.s001

(DOC)

S2 File. The Health Literacy Measure for Adolescents (HELMA)-Persian version.

doi:10.1371/journal.pone.0149202.s002

(DOC)

S3 File. A minimal set of data for the study.

doi:10.1371/journal.pone.0149202.s003

(SAV)

S4 File. Scoring for the HELMA.

doi:10.1371/journal.pone.0149202.s004

(DOC)

Acknowledgments

This study was part of the doctoral thesis of the first author in health education. The auhtors appreciate all of the students who participated in this research project. We wish to thank the authorities and administrators in General Directorate of Iranian Misnistry of Educantion.

Author Contributions

Conceived and designed the experiments: SG AR AM. Performed the experiments: SG. Analyzed the data: SG YM. Contributed reagents/materials/analysis tools: YM. Wrote the paper: SG AM AR YM.

References

  1. 1. Peerson A, Saunders M. Health literacy revisited: what do we mean and why does it matter? Health Promotion International. 2009; 24: 285–296. doi: 10.1093/heapro/dap014. pmid:19372101
  2. 2. Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC public health. 2012; 12: 80–92. doi: 10.1186/1471-2458-12-80. pmid:22276600
  3. 3. Wu AD, Begoray DL, MacDonald M, Higgins JW, Frankish J, Kwan B, et al. Developing and evaluating a relevant and feasible instrument for measuring health literacy of Canadian high school students. Health Promotion International. 2010; 25: 444–452. doi: 10.1093/heapro/daq032. pmid:20466776
  4. 4. World Health Organization Health Literacy: The Solid Facts; 2013. Available: http://www.euro.who.int/__data/assets/pdf_file/0008/190655/e196854.pdf.
  5. 5. Sorensen K. Health literacy: the neglected European health literacy disparity [Doctoral Dissertation]: Maastrikht University. 2013.
  6. 6. Vozikis A, Drivas K, Milioris K. Health literacy among university students in Greece: determinants and association with self-perceived health, health behaviours and health risks. Archives of Public Health. 2014; 72: 15. doi: 10.1186/2049-3258-72-15. pmid:24987522
  7. 7. DeWalt DA, Hink A. Health literacy and child health outcomes: a systematic review of the literature. Pediatrics. 2009; 124: S265–S274. doi: 10.1542/peds.2009-1162B. pmid:19861480
  8. 8. Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K. Low health literacy and health outcomes: an updated systematic review. Annals of internal medicine. 2011; 155: 97–107. doi: 10.7326/0003-4819-155-2-201107190-00005. pmid:21768583
  9. 9. DeWalt DA, Berkman ND, Sheridan S, Lohr KN, Pignone MP. Literacy and health outcomes. Journal of General Internal Medicine. 2004; 19: 1228–1239. pmid:15610334
  10. 10. van der Heide I, Wang J, Droomers M, Spreeuwenberg P, Rademakers J, Uiters E. The relationship between health, education, and health literacy: results from the Dutch adult literacy and life skills survey. Journal of Health Communication. 2013; 18: 172–184. doi: 10.1080/10810730.2013.825668. pmid:24093354
  11. 11. Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promotion International. 2000; 15: 259–267.
  12. 12. Peerson A, Saunders M. Men's health literacy in Australia: in search of a gender lens. International Journal of Men's Health. 2011; 10: 111–135. doi: 10.3149/jmh.1002.111.
  13. 13. Massey P, Prelip M, Calimlim B, Afifi A, Quiter E, Nessim S, et al. Findings toward a multidimensional measure of adolescent health literacy. American journal of health behavior. 2013; 37: 342–350. http://dx.doi.org/10.5993/AJHB.37.3.7. doi: 10.5993/AJHB.37.3.7. pmid:23985181
  14. 14. Nutbeam D. The evolving concept of health literacy. Social science & medicine. 2008; 67: 2072–2078. doi: 10.1016/j.socscimed.2008.09.050.
  15. 15. Rowlands G, Rowlands G. Health literacy and public health: a framework for developing skills and empowering citizens. Perspectives in public health. 2012; 132: 23–24. doi: 10.1177/1757913911430916. pmid:22458147
  16. 16. Kanj M, Mitic W. Health literacy and health promotion: Definitions, concepts and examples in the Eastern Mediterranean region; 2009. pp. 26–30.
  17. 17. Santoro K, Speedling C. The case for investing in youth health literacy: One step on the path to achieving health equity for adolescents. NIHCM Issue Brief. 2011: 1–15.
  18. 18. Manganello JA, Shone LP. Health Literacy: Research FACTS and findings. ACT for Youth Center of Excellence Ithaca, NY. 2013.
  19. 19. Skopelja EN, Whipple EC, Richwine P. Reaching and teaching teens: Adolescent health literacy and the internet. Journal of consumer Health on the Internet. 2008; 12: 105–118. doi: 10.1080/15398280802121406.
  20. 20. Abel T, Hofmann K, Ackermann S, Bucher S, Sakarya S. Health literacy among young adults: a short survey tool for public health and health promotion research. Health Promotion International. 2014. doi: 10.1093/heapro/dat096.
  21. 21. Manganello JA. Health literacy and adolescents: a framework and agenda for future research. Health Education Research. 2008; 23: 840–847. doi: 10.1093/her/cym069. pmid:18024979
  22. 22. Ghaddar SF, Valerio MA, Garcia CM, Hansen L. Adolescent health literacy: the importance of credible sources for online health information. Journal of School Health. 2012; 82: 28–36. doi: 10.1111/j.1746-1561.2011.00664.x. pmid:22142172
  23. 23. Davis TC, Wolf MS, Arnold CL, Byrd RS, Long SW, Springer T, et al. Development and validation of the Rapid Estimate of Adolescent Literacy in Medicine (REALM-Teen): a tool to screen adolescents for below-grade reading in health care settings. Pediatrics. 2006; 118: e1707–e1714. doi: 10.1542/peds.2006-1139. pmid:17142495
  24. 24. Chisolm DJ, Buchanan L. Measuring adolescent functional health literacy: a pilot validation of the test of functional health literacy in adults. Journal of Adolescent Health. 2007; 41: 312–314. doi: 10.1016/j.jadohealth.2007.04.015. pmid:17707303
  25. 25. Curtis LM, Revelle W, Waite K, Wilson EAH, Condon DM, Bojarski E, et al. Development and Validation of the Comprehensive Health Activities Scale: A New Approach to Health Literacy Measurement. Journal of Health Communication. 2014; 20: 157–164. doi: 10.1080/10810730.2014.917744. pmid:25375025
  26. 26. Yuen EY, Knight T, Dodson S, Ricciardelli L, Burney S, Livingston PM. Development of the Health Literacy of Caregivers Scale-Cancer (HLCS-C): item generation and content validity testing. BMC family practice. 2014; 15: 202. doi: 10.1186/s12875-014-0202-9. pmid:25491883
  27. 27. Massey P, Prelip M, Calimlim BM, Quiter ES, Glik DC. Contextualizing an expanded definition of health literacy among adolescents in the health care setting. Health Education Research. 2012; 27: 961–974. doi: 10.1093/her/cys054. pmid:22623619
  28. 28. Lawshe CH. A quantitative approach to content validity1. Personnel psychology. 1975; 28: 563–575.
  29. 29. Polit DF, Beck CT. The content validity index: are you sure you know what's being reported? Critique and recommendations. Research in nursing & health. 2006; 29: 489–497. doi: 10.1002/nur.20147.
  30. 30. Hajizadeh E, Asghari M. Statistical Methods and Analyses in Health and Biosciences: A Methodological Approach. Tehran: ACECR Press; 2011 (in Persian)
  31. 31. Munro BH. Statistical methods for health care research: Lippincott Williams & Wilkins; 2005.
  32. 32. Nunnally JC, Bernstein IH, Berge J. Mt Psychometric theory: McGraw-Hill New York; 1967.
  33. 33. Harrington D. Confirmatory factor analysis: Oxford University Press; 2008.
  34. 34. Fink A, Litwin MS. How to measure survey reliability and validity: Sage; 1995.
  35. 35. Baumgartner TA, Chung H. Confidence limits for intraclass reliability coefficients. Measurement in Physical Education and Exercise Science. 2001; 5: 179–188. doi: 10.1207/ S15327841MPEE0503_4.
  36. 36. Tehrani Banihashemi S-A, Amirkhani MA, Haghdoost AA, Alavian S-M, Asgharifard H, Baradaran H, et al. Health Literacy and the Influencing Factors: A Study in Five Provinces of Iran. Strides in Development of Medical Education. 2007; 4: 1–9 (in Persian)
  37. 37. Reisi M, Mostafavi F, Hasanzadeh A, Sharifirad G. The Relationship between Health Literacy, Health Status and Healthy Behaviors among Elderly in Isfahan, Iran. J Health Syst Res. 2011; 7: 469–480 (in Persian)
  38. 38. Ghanbari S, Majlessi F, Ghaffari M, Mahmoodi Majdabadi M. Evaluation of health literacy of pregnant women in urban health centers of Shahid Beheshti Medical University. Daneshvar(medicine) shahed University. 2012; 19: 1–13 (in Persian)
  39. 39. Javadzade SH, Sharifirad G, Reisi M, Tavassoli E, Rajati F. Health Literacy among Adults of Isfahan, Iran. J Health Syst Res. 2013; 9: 540–549 (in Persian)
  40. 40. Kooshyar H, Shoorvazi M, Dalir Z, Hosseini M. Health Literacy and its Relationship with Medical Adherence and Health-Related Quality of Life in Diabetic Community-Residing Elderly. Journal of Mazandaran University of Medical Sciences. 2014; 23: 134–143 (in Persian)
  41. 41. Tol A, Pourreza A, Tavasoli E, Rahimi Foroshani A. Determination of knowledge and health literacy among women with type 2 diabetes in teaching hospitals of TUMS. Hospital. 2012; 11: 45–52 (in Persian)
  42. 42. Qobadi M, Besharat M, Rostami R, Rahiminezhad A, M P. Health literacy, negative emotional status, and self-care behaviors in dialysis. Journal of Fundamentals of Mental Health. 2015; 17: 46–51 (in Persian)
  43. 43. Montazeri A, Tavousi M, Rakhshani F, Azin SA, Jahangiri K, Ebadi M, et al. Health Literacy for Iranian Adults (HELIA): development and psychometric Properties. Payesh. 2014; 13: 589–599 (in Persian)
  44. 44. Naghibi Sistani MM, Montazeri A, Yazdani R, Murtomaa H. New oral health literacy instrument for public health: development and pilot testing. Journal of Investigative and Clinical Dentistry. 2014; 5: 313–321. doi: 10.1111/jicd.12042. pmid:23559571
  45. 45. Shone LP, Doane C, Blumkin AK, Klein J, Wolf MS. Performance of ‘Health Literacy’ Tools Among Adolescents and Young Adults. Journal of Adolescent Health. 2009; 46: S11–S12. doi: 10.1016/j.jadohealth.2009.11.027.
  46. 46. Pleasant A, McKinney J, Rikard R. Health literacy measurement: a proposed research agenda. Journal of Health Communication. 2011; 16: 11–21. doi: 10.1080/10810730.2011.604392. pmid:21951240
  47. 47. Costello A, Osborne J. Best practices in exploratory factor analysis: four recommendations for getting the most from your analysis. Pract Assess Res Eval 2005; 10. URL http://pareonlinenet/getvn asp. 2011; 10: 7.