Figures
Abstract
Introduction
The navigational health literacy of higher education students is fundamental to effective health management and successful health navigation, thereby improving health outcomes and overall well-being. Assessing the general and navigational health literacy levels of these students is crucial for developing targeted interventions and facilitating informed decision-making on health-related issues. This study aimed to identify the levels of general and navigational health literacy, characterise access to and utilisation of healthcare services, and analyse the differences between the mean general and navigational health literacy indices and determinants among higher education students in the Alentejo region of southern Portugal.
Methodology
A descriptive and cross-sectional study was conducted between 25 May and 12 September 2023 with 1979 higher education students. An online structured questionnaire comprising the Portuguese version of the European Health Literacy Survey Questionnaire – 16 items (HLS-EU-PT-Q16) and the Navigational Health Literacy Scale (HLS19-NAV), both from the European Consortium, was used. Sociodemographic data, presence of chronic disease, perceived health status, perceived availability of money for expenses, and healthcare access and utilisation variables were included. The study data were analysed using independent samples t-test, one-way ANOVA, and post hoc Bonferroni test, followed by multiple linear regression analyses at a significance level of 0.05. Multiple linear regression analysis was performed to identify factors associated with both general and navigational health literacy. The study protocol was approved by the ethics committee of the University of Évora, and all participants provided written informed consent.
Results
Most students (86.8%) exhibited limited general health literacy, while 13.2% demonstrated adequate health literacy. Inadequate navigational health literacy was observed in 73.4% of students. Students with lower mean general and navigational health literacy were more likely to have utilised health services. Students with chronic conditions, recent use of urgent or emergency services, and difficulties in accessing healthcare had lower health literacy. Conversely, those enrolled in health-related courses, those with good financial resources and those who had not used health services during their course had higher health literacy. In addition, lower navigational health literacy was found among displaced students, those with chronic conditions and those who had recently consulted a doctor. Higher navigational health literacy was associated with enrolment in health-related courses and adequate general health literacy.
Conclusion
The findings highlight the significant influence of demographic and academic factors on general and navigational health literacy among higher education students. The prevalence of limited general and navigational health literacy underscores a significant challenge for students, institutions, and health policy makers. Effective health literacy interventions should take these factors into account. Future research should examine longitudinal changes in health literacy and evaluate the impact of targeted educational programmes.
Citation: Rosário J, Dias SS, Dias S, Pedro AR (2025) Navigational health literacy and health service use among higher education students in Alentejo, Portugal - A cross-sectional study. PLoS One 20(5): e0322181. https://doi.org/10.1371/journal.pone.0322181
Editor: Paulo Alexandre Azevedo Pereira Santos, University of Porto, Faculty of Medicine, PORTUGAL
Received: September 9, 2024; Accepted: March 18, 2025; Published: May 15, 2025
Copyright: © 2025 Rosário et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript.
Funding: This research was funded by Fundação para a Ciência e Tecnologia (FCT, Portugal) through national funds to the Associated Laboratory in Translation and Innovation Towards Global Health REAL (LA/P/0117/2020). No additional external funding was received for this study. The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Health literacy (HL) encompasses the knowledge, motivation, and competencies to access, understand, appraise, and apply health information in order to make judgements and take decisions in everyday life about healthcare, disease prevention, and health promotion [1]. The European Health Literacy Survey (HLS-EU) project emphasises health literacy as a modifiable determinant of health, integrating public health and individual approaches [2–6]. It is a part of current health, social and educational policies [7], and depends on individual competence as well as environmental factors, resources and context [1].
The Integrated Model of Health Literacy, which is widely used in Europe, provides a comprehensive framework for understanding how health literacy influences health behaviours and outcomes. It identifies key determinants and factors that impact health literacy levels (antecedents) and their resulting health outcomes (consequences) [5]. This model outlines four core competencies of health literacy: access (seeking and obtaining health information), understand (comprehending the information), appraise (interpreting, evaluating, and filtering the information), and apply (using the information to make informed health decisions). These competencies are relevant across the health continuum, encompassing healthcare, disease prevention, and health promotion [5]. Their effectiveness is influenced by organisational structures and the availability of resources, which affect individuals’ ability to make informed health decisions for their own wellbeing and that of those around them [8].
Navigational health literacy (NAV-HL), a subset of health literacy, is relevant for effective navigation of the complex, fragmented health care system. It encompasses an individual’s knowledge, motivation, and skills to access, understand, appraise, and apply information needed to navigate health care systems and services efficiently [9–12].
Navigational health literacy can be understood at three levels: the system level (macro), which deals with the organisation and functioning of the health care system; the organisational level (meso), where users organise information for decision making; and the interactional level (micro), which emphasises active engagement in the processing of health information [9].
Effective navigation of health services involves expressing preferences and gathering information from health professionals in order to participate in decision making and future health planning [9,12]. The complexity of health systems leads to challenges in accessing care, as reported by people with multiple health needs who experience disjointed and uncoordinated services [13]. Navigating the system is crucial given its different sectors and services [11,14]. Examining both general and navigational health literacy is crucial for understanding how individuals access and use health services.
Research consistently links lower health literacy with higher healthcare utilisation and costs, poorer health outcomes, and greater financial burdens [15–19]. Inadequate health literacy often results in increased medical errors and communication difficulties with providers [20–22], highlighting the critical need for improved health literacy initiatives.
Although limited health literacy has been demonstrated among Portuguese university students [23–28], the specific levels of general and navigational health literacy among students in the Alentejo region remain unexplored. This gap highlights the importance of focusing on this region to address the specific challenges related to health literacy.
The Alentejo region in southern Portugal, which covers 30% of the country’s territory, faces unique challenges such as low tertiary education rates, high drop-out rates, low population density, and risks of depopulation, making it crucial to promote health literacy and healthy behaviours, especially in rural areas. Assessing general health literacy, navigational health literacy, and access to and utilisation of health services among higher education students in the Alentejo region is essential for policy makers, academic institutions, health services, and health professionals. This assessment is fundamental for the development of targeted interventions to improve health literacy, reduce vulnerability and improve health outcomes among higher education students in the Alentejo region. To the best of our knowledge, the lack of previous studies on access, utilisation of health services, general and navigational health literacy among higher education students in the Alentejo may compromise health planning measures, health policies and the design of health literacy interventions promoted by health professionals.
In this context, our study aims to address the following research questions: (i) what are the levels of general and navigational health literacy among higher education students in the Alentejo region of southern Portugal?; (ii) what are the characteristics of access to and use of health services among these students?; and (iii) how do levels of general and navigational health literacy relate to determinants such as socio-demographic variables, presence of chronic diseases, perceived health status, perceived availability of money for expenses, and access to and use of health services?
To answer these questions, the study will: (i) identify levels of general and navigational health literacy; (ii) characterise access to and use of health services; and (iii) analyse the differences between levels of health literacy, and determinants such as socio-demographic variables, chronic diseases, perceived health status, perceived availability of money for expenses, and access to and utilisation of health services among higher education students in the Alentejo region.
This study will contribute to a deeper understanding of health literacy, and its differences in access to and use of health services among higher education students in the Alentejo. This knowledge will guide the development of targeted interventions to improve health outcomes and empower higher education students to make informed health decisions, ultimately facilitating better access to and use of health services.
Materials and methods
Study design and setting
An observational, descriptive, quantitative, cross-sectional study was conducted using an online survey between May 25 and September 12, 2023, involving four unique public higher education institutions in the Alentejo region (statistical territorial unit - NUT II) of Portugal: Polytechnic Institute of Beja, Polytechnic Institute of Portalegre, Polytechnic Institute of Santarém, and University of Évora. Following the acquisition of institutional approval, all undergraduate and integrated master’s students received an email invitation via the educational institutions’ communication channels. This email contained detailed information regarding the study, as well as a link to access the questionnaire. The invitation provided a comprehensive overview of the study’s objectives, the participation conditions, and the significance of participation. The initial section of the questionnaire encompassed all the aforementioned elements. Upon completion and understanding of the information, the students provided their consent to participate. To enhance the response rate and ensure a representative sample, follow-up reminders were sent to students, and course coordinators gave alerts during meetings.
Study population and sample size
The study population comprised all students, from all academic years, enrolled in undergraduate and integrated master’s degree programs totalling 13135 students in the 2022–2023 academic year [29] who voluntarily consented to participate and understood written Portuguese. Postgraduate students were excluded because the study aimed to design health interventions or policies for undergraduate students.
Based on similar studies [23,30–32], the minimum sample size was determined using standard statistical procedures [33,34], taking into account a 95% confidence level, a population proportion of 50% (to maximise variance and ensure a conservative estimate) and a 3% margin of error. After applying the finite population correction, the required sample size was adjusted to 952 students. To account for an expected non-response rate of 20%, the final target sample size was increased to 1143 students. However, the final dataset comprised 1979 participants, exceeding the required minimum. The augmentation in sample size is attributable to a response rate that surpassed expectations, propelled by the accessibility of the online survey, institutional support, and student interest in the subject matter. This enlarged sample size fortified the statistical power, enhanced subgroup representativeness and facilitated more detailed analyses, thus augmenting the robustness and precision of the results [34].
Study participants and data collection
The Portuguese versions of the European Health Literacy Survey instruments (developed by the European Consortium World Health Organization Action Network on Measuring Population and Organizational Health Literacy – M-POHL), specifically the 16-item HLS-EU-PT-Q16 for health literacy and the 12-item HLS19-NAV for navigational health literacy, were used [9,35–37]. The questionnaire also covered health services access, use, and socio-demographic characteristics. It was distributed via an online platform with a unique hyperlink in the study invitation. Each participant could complete the questionnaire only once to ensure data integrity.
Responses were collected electronically using software that securely recorded and stored data in accordance with ethical research standards, ensuring the anonymity and confidentiality of participants. Regular reminders were sent to maximise participation. To prevent non-responses, the questionnaire was designed to be mobile-friendly, ensuring accessibility on various devices, including smartphones and tablets, and was concise to minimise completion time. Friendly reminders were sent to reduce non-response bias.
Institutional approval and promotion.
Approval was obtained from each institution’s governing body via email, which detailed the study’s aims and requested endorsement. After approval, institutions promoted the questionnaire link and consent form to students through social media and email lists. Course coordinators emphasized the survey’s importance, and members of the National Academic Health Literacy Network assisted with dissemination and awareness efforts. This multi-channel approach aimed to increase visibility and response rates, with clear instructions to complete the questionnaire only once.
Addressing potential biases.
The potential biases associated with online data collection were recognised. All students had free access to the internet and the questionnaire was designed to work on a variety of electronic devices. To mitigate these biases, the questionnaire was made available on a variety of devices commonly used by students, including those available in higher education institutions, and technical support was provided where necessary. The multi-channel promotion strategy aimed to reach a wide range of student populations, thereby improving diversity and ensuring a representative sample. Efforts were made to emphasise the importance of responses and to maintain anonymity to reduce response bias.
Questionnaire/Measurements
The questionnaire started with informed consent and age verification. Participants then completed the HLS-EU-PT-Q16, followed by questions on health services access and use, the HLS19-NAV, and socio-demographic questions. The 50-item questionnaire was pre-tested with a subset of 31 participants.
Characterisation of the instrument HLS-EU-PT-Q16
The Portuguese version of the 16-item HLS-EU-PT-Q16, developed by the European Health Literacy Consortium, was used to assess health literacy. The HLS19 instrument, developed by M-POHL for the International Health Literacy Population Survey 2019–2021, evaluated the difficulty/ease of accessing, comprehending, appraising, and applying information in various domains [37–39].
Each item on the scale has four valid possible responses (very easy, easy, difficult, and very difficult) and also the option “don’t know/refusal” (it was considered missing). Each response corresponds to a numerical value: 0 – don’t know, 1 – very difficult, 2 – difficult, 3 – easy, 4 – very easy, and 5 – don’t know/refusal. Only responses with at least 80% of items rated 1–4 were included in the scoring; others were excluded.
The average score for all items was calculated and converted into an index according to the European Health Literacy Consortium guidelines. The calculation of the index score was performed according to the following formula: (mean-1)*(50/3), where mean corresponds to the average of items on the scale, 1 – the minimal value of the mean, 3 – the range of the mean, and 50 – the chosen maximum value of the new index scores [2,40–42].
Categories were created based on the cut-offs: excellent (>42–50); sufficient (>33–42); problematic (>25–33); and inadequate (0–25) [2,41,42]. Subsequently, the categories were dichotomised into limited (combining inadequate and problematic health literacy categories) and adequate health literacy (combining sufficient and excellent health literacy categories).
The Cronbach’s alpha coefficient for HLS-EU-PT-Q16, which indicates internal consistency, was .89 overall, and .783 for the health care subdomain, .724 for the disease prevention subdomain, and .703 for the health promotion subdomain [37,38].
Characterisation of the instrument HLS19-NAV
Navigational health literacy, a specific aspect of health literacy concerning navigation skills, was assessed using the HLS19-NAV instrument [9,12,43]. It is dedicated to evaluating navigational health literacy within the framework of the European Health Literacy Survey (HLS19-EU). The instrument comprises 12 items, with responses on a Likert scale, scored with 1 = “very difficult”; 2 = “difficult”; 3 = “easy”; 4 = “very easy”; and 5 = “don’t know/refusal”, which was considered as missing. The instrument evaluates how easily participants can access, understand, appraise, and apply information about navigating the healthcare system. Only responses with at least 80% of items rated 1–4 were included in the scoring, otherwise they were excluded. For analysis purposes, responses were dichotomized: responses indicating ease were categorised as “very easy” and “easy”, while responses indicating difficulty were categorised as “difficult” and “very difficult”. Responses categorised as “very easy” and “easy” were aggregated and converted to a unified metric on a scale of 0–100. The HLS19-NAV index represents the percentage of items answered with “easy” and “very easy”, with higher scores indicating higher navigational health literacy [43]. For descriptive analysis, scores were categorised into four levels: excellent (>83.3), sufficient (>66.6), problematic (>50), and inadequate (≤50) [12]. The HLS19-NAV instrument’s validation in Portugal and its Cronbach’s α of.939 highlight its reliability [39].
Independent variables
Sociodemographic variables included age, gender, relocation to attend the course, cohabitation with a healthcare professional, and the highest educational level of parents or the person with whom the student lived, based on the International Standard Classification of Education (ISCED) [44].
Academic background included academic institution, academic year, being a finalist, completion of a previous course in the health field, and frequenting a health-related course.
Additional variables included the presence of chronic disease, self-perceived health status (categorised as unsatisfactory or satisfactory) [31], perceived financial availability (categorised as poor or good) [39].
Variables considered for healthcare services access and utilisation included: (i) use of urgent or emergency services in the last 24 months; (ii) medical consultation in the past 12 months; (iii) hospitalisation for more than one day within the last 12 months; (iv) outpatient hospital visits in the last 12 months (e.g., day hospital or ambulatory surgery - in and out on the same day); (v) absence from work/school due to health problems in the last 12 months; (vi) utilisation of health services while attending the course; (vii) main reason for last use of health services while attending the course; (viii) difficulty accessing a scheduled appointment; (ix) difficulty accessing an urgent appointment; (x) difficulty in using health services; (xi) main reason hindering the use of health services; and (xii) first action to take if feeling ill in non-urgent situations where there is no reason to call 112 (emergency number in Europe).
Data analyses
The statistical analysis was performed using IBM-SPSS version 29. Descriptive analysis assessed the distribution of independent variables among participants. The assumption of population normality and homogeneity of variances, prerequisites for statistical tests, were supported by the Central Limit Theorem. Given normal distribution and homogeneity of variances, parametric tests (Student’s t -test and ANOVA) were employed for group comparisons. Post hoc Bonferroni tests were conducted following a significant result in the overall ANOVA to identify specific group differences. Multiple linear regression analysis was performed to identify factors associated with both general and navigational health literacy. A statistical significance level of p < 0.05 was adopted. Results will be presented in aggregate form, with additional analyses to explore variations by institution and academic year if necessary.
Ethical considerations
The study was approved by the Ethics Committee of the University of Évora (Document number 22091) and the Scientific Council. Students provided their informed consent digitally. All students were informed of the aims of the study through a written statement of voluntary and informed consent on the first page of the questionnaire. Students who did not consent were not given access to the questionnaire. Confidentiality, anonymity, and de-identification of data were strictly maintained throughout the study. To ensure confidentiality, data were stored on secure servers with access restricted only to researchers involved in data analysis, using secure passwords as a requisite for access.
Results
Students’ characteristics
The sample comprised 1979 higher education students. The mean age of the students was 21.42 ± 2.95 years. The majority of students identified as female, 57.8% (n = 986), while 42.2% (n = 720) identified as male. A total of 76.8% (n = 1519) of the students were displaced from their usual place of residence, 95.6% (n = 1892) were not living with a health professional, and 38.8% (n = 768) had completed upper secondary education (ISCED 3). Only 9.6% (n = 190) had previously completed a course in health care.
Most of the students were in their third year (n = 732; 37.0%), with the smallest proportion in their fifth year (n = 60; 3.0%). The majority of respondents (n = 1340; 67.7%) were not final year students and a significant proportion (n = 1789; 90.4%) had not completed a health-related course prior to the survey. In addition, 72.0% (n = 1425) of respondents reported that they were not currently enrolled in a health-related course.
In terms of health status, 63.8% (n = 1262) of students did not have a chronic disease, while 79.8% (n = 1574) reported an unsatisfactory health status, and in relation of the perceived availability of financial resources for expenses, 96.2% (n = 1904) of students indicated that they perceived poor availability of money for them. Table 1 summarises the sample, the mean differences of the general and navigational health literacy between student characteristics.
Healthcare services access and utilisation
Table 2 shows the mean differences in the general health literacy index and the navigational health literacy index, taking into consideration the access to and utilisation of healthcare services. The results show that a significant proportion of students used urgent or emergency services in the last 24 months (n = 1421; 71.8%) and sought medical consultation in the last 12 months (n = 1166; 58.9%). Hospitalisation for more than one day was less frequent (n = 144; 7.3%), while 18.8% (n = 373) of students reported outpatient visits.
A significant proportion of students (n = 1428; 72.2%) reported missing work or school due to health problems, while a substantial number (n = 1499; 75.7%) used health services during their studies. The main reasons for seeking healthcare were unexpected health problems (n = 452; 30.2%) and problems exacerbated by delayed treatment (n = 527; 26.6%).
The study also highlighted challenges such as difficulty accessing scheduled appointments (n = 1602; 80.9%) and identified the physical distance to the service (n = 1188; 60.0%). Interestingly, in non-urgent situations where emergency services were not required, the majority of students (n = 1188; 60.0%) chose to go to the emergency department of a public hospital.
General health literacy
Upon analysis of the mean and standard deviation of individual responses on the HLS-EU-PT-Q16, it was found that the highest mean score (2.3 ± 1.0) was observed for the item assessing the difficulty students experienced in understanding instructions from their doctor or pharmacist regarding prescribed medicine. Conversely, the lowest mean scores (1.9 ± .8) were observed for the items related to determining when to seek a second opinion from another doctor, finding information on managing mental health issues, and assessing the reliability of health risk information in the media (see Table 3).
Table 4 shows the distribution of the health literacy index according to the competencies of health literacy: access, understand, appraisal, and apply. The total overall general health literacy index ranged from 0 to 50. The mean overall health literacy index was 18.6 ± 11.7, indicating inadequate health literacy (with scores ranging from a minimum of 0 to a maximum of 47.9). Within specific health literacy domains, scores of 18.9 ± 13.8 were observed for health care, 18.4 ± 12.8 for disease prevention and 18.3 ± 11.4 for health promotion.
Fig 1 shows the percentage distribution of health literacy levels across general health literacy and domains. The general health literacy categories show that 86.8% of students had limited health literacy (67.5% inadequate and 19.3% problematic), while 13.2% had adequate health literacy (11.4% sufficient and 1.8% excellent). According to the dimensions of health literacy, limited health literacy of 83.0% was found for health promotion, 80.9% for disease prevention and 79.3% for health care.
Navigational health literacy
When analysing the distribution of responses from the HLS19-NAV instrument, as shown in Table 5, the items with the highest mean scores were assessing a health service needed for a health problem (2.1 ± .8), deciding for a particular health service (2.1 ± .8), and understanding how to book appointments at a particular health service (2.1 ± .8).
The mean navigational health literacy index was 29.1 ± 31.6, with a minimum value of 0 and a maximum value of 100. The navigational health literacy categories of the students were as follows Fig 2. The results indicated that 75.6% of the students demonstrated inadequate navigational health literacy.
Differences among students’ characteristics, healthcare services utilisation, and mean indexes of general and navigational health literacy
Students’ characteristics.
Table 1 shows the significant differences between the characteristics of higher education students and the mean of the General Health Literacy (GHL) and Navigational Health Literacy (NAV-HL) indexes. Health literacy indexes varied significantly by age group, with students aged ≥26 years (n = 265; 13.4%) showing higher GHL (24.2 ± 13.0) and NAV-HL (44.6 ± 36.3) compared to younger students (16–20 years) (p < .001). The Bonferroni post hoc analysis reveals that individuals aged 26 and above exhibit significantly higher scores on both the GHL index and NAV-HL index compared to those aged 16–20 and 21–25 (p < .001 for both indices). Specifically, the GHL index shows no significant difference between the 16–20 and 21–25 age groups (p = 1.0). For the NAV-HL index, mean differences are -20.7 (p < .001) between 26 and 16–20, and -18.9 (p < .001) between 26 and 21–25, with no significant difference between the 16–20 and 21–25 age groups (mean difference: -1.7, p = .686).
Female students (n = 986; 57.8%) had significantly higher scores in both general (21.8 ± 11.1) and navigational health literacy (33.6 ± 31.1) mean index compared to male students (n = 720, 42.2%), with 17.5 ± 11.9 for general and 27.4 ± 32.7 for navigational health literacy mean index.
Students who were displaced to attend their course (n = 1519; 76.8%) demonstrated lower general and navigational health literacy mean index (GHL: 17.4 ± 11.2; NAV-HL: 24.3 ± 30.0) compared to those who were not displaced (n = 460; 23.2%) (GHL: 22.5 ± 12.2; NAV-HL: 37.7 ± 33.1) (p < .001).
Students living with health professionals (n = 87; 4.4%) had notably higher general health literacy scores (26.1 ± 7.8) compared to those without such cohabitants (18.3 ± 11.7), for navigational health literacy it was not observed significant statistical differences. It was not observed statistically significant differences between the level of education of the student’s parents or the person with whom the student lived at general health literacy, but for navigational health literacy it was observed that students with parents with higher education level, has higher navigational health literacy mean index (p < .001).
First-year students (n = 275; 13.9%) had significantly higher health literacy scores (GHL: 27.1 ± 8.7; NAV HL: 37.8 ± 25.5) compared to students in subsequent years. Fourth-year students (n = 411; 20.8%) showed an increase in general health literacy (21.8 ± 12.8). The Bonferroni post hoc analysis reveals that first-year students have significantly higher GHL scores compared to students in the second through fifth years, with notable mean differences of 10.0, 12.4, 6.3, and 8.9, respectively (p < .001), while significant declines in scores are observed in second, third, fourth, and fifth-year students compared to first-year students, with no significant differences between these latter years; additionally, NAV-HL also peaks in the first year but significantly decreases in later years, although fourth-year students show an increase compared to some other years.
Students enrolled in healthcare-related courses (n = 554; 28.0%) demonstrated higher general and navigational mean levels (GHL: 28.8 ± 7.9; NAV-HL: 50.1 ± 28.1) compared to their peers in non-health-related courses (n = 1425; 72.0%). Students with chronic diseases (n = 717; 36.2%) reported lower health literacy scores (GHL: 15.0 ± 11.3; NAV-HL:18.9 ± 2 9.3) than those without chronic conditions (n = 1262; 63.8%). Students with satisfactory perceived health status (n = 399; 20.2%) had significantly higher health literacy scores (GHL: 30.0 ± 7.2; NAV-HL: 43.7 ± 25.2). Similarly, those perceiving good availability for expenses (n = 75; 3.8%) had higher scores (GHL: 34.8 ± 6.7; NAV-HL: 50.3 ± 23.9).
Health services access and utilisation.
Students who used urgent or emergency services in the previous 24 months (n = 1421;71.8%) had a significantly lower GHL mean index (17.9 ± 11.1) and NAV-HL mean index (24.3 ± 29.3) compared to those who did not (n = 558; 28.2%), with an HL mean index of 23.3 ± 10.3 and NAV-HL mean index of 35.4 ± 33.7 (p < .001 for both). In contrast, there was no significant difference in the GHL and NAV-HL indices between students who had a medical consultation within the last 12 months (n = 813; 41.1%) and those who did not (n = 1166; 58.9%), with p-values of.419 for GHL and.186 for NAV-HL.
Students hospitalized for more than one day in the previous 12 months (n = 144; 7.3%) had a significantly lower GHL mean index (14.4 ± 21.1) compared to those who were not hospitalized (n = 1835; 92.7%), who had an GHL mean index of 19.3 ± 11.0 (p < .001). However, the NAV-HL indexes did not differ significantly (p = .135). Those who attended a hospital on an outpatient basis in the last 12 months (18.8%, n = 373) had significantly lower GHL mean indexes (17.0 ± 11.6) compared to those who did not (n = 1606; 81.2%), with an GHL mean index of 19.4 ± 11.0 (p = .003). The NAV-HL index differences were not significant (p = .211).
Students who were absent from work or school due to health problems in the previous 12 months (n = 1428; 72.2%) had significantly lower GHL mean indices (18.0 ± 11.1) compared to those who were not absent (27.8%, n = 551), who had an HL mean index of 21.2 ± 11.2 (p < .001). The difference in NAV-HL indices was not significant (p = .090).
Relatively of the health services utilisation during course attendance students (n = 1499; 75.7%) had significantly lower GHL (18.1 ± 11.0) and NAV-HL (26.4 ± 32.2) indices compared to non-users (n = 480; 24.3%), who had HL of 21.1 ± 11.3 and NAV-HL of 30.7 ± 28.1 (p < .001 for both).
Significant differences in HL and NAV-HL indices were observed based on the reason for the last use of health services (p < .001 for both). For example, those that had an aggravation of a problem for which they had not sought help (n = 527; 26.6%,) had lower indices (GHL: 13.8 ± 9.7, NAV-HL: 19.6 ± 29.7) compared to those with other reasons (GHL: 27.5 ± 8.9, NAV-HL: 47.3 ± 31.2). The Bonferroni post hoc analysis reveals that students seeking health services for chronic diseases have lower GHL and NAV-HL indices compared to those with unexpected problems or other reasons, while those with other reasons have the highest indices; significant differences are noted among all groups. Students who reported difficulty in accessing scheduled appointments (n = 1602; 80.9%) had significantly lower GHL (16.3 ± 10.6) and NAV-HL (22.3 ± 30.1) indices compared to those who found it easy/very easy (17.1%, n = 338), who had GHL of 29.2 ± 6.4 and NAV-HL of 51.1 ± 26.5 (p < .001 for GHL; p = .040 for NAV-HL). Similar trends were observed for urgent appointments, where those who reported difficulties (n = 1762; 89.0%) had a significantly lower GHL (17.7 ± 10.8) compared to those who did not (n = 162; 8.2%), who had a GHL of 28.4 ± 8.9 (p < .001). The difference in NAV-HL was not significant (p = .093).
Students who experienced difficulties in using health services (n = 1637; 82.7%) had significantly lower GHL (17.2 ± 10.5) and NAV-HL (23.2 ± 30.1) indices than those who did not (n = 342; 17.3%), who had GHL of 26.5 ± 10.8 and NAV-HL of 47.6 ± 28.6 (p < .001 for both).
Significant differences in GHL and NAV-HL were observed according to reasons for not seeking health care (p < .001 for both). Unfamiliarity with the available system was associated with lower GHL (13.5 ± 9.5) and the reason related to the physical distance to the service for NAV-HL (26.5 ± 28.3) (p < .001).
The first action taken in non-urgent health situations also showed significant differences (p < .001 for both GHL and NAV-HL). For example, those who went to a health centre without an appointment (n = 265; 13.4%) had higher GHL (27.5 ± 7.7) and NAV-HL (43.1 ± 28.4) than those who went to the emergency department (n = 1188; 60.0%), who had GHL of 15.0 ± 10.1 and NAV-HL of 20.3 ± 29.8.
The descriptive statistics show significant differences in the GHL and NAV-HL indices for different methods of accessing health services, with the highest GHL indices observed for those who consulted pharmacists and private clinics, and the lowest for those who used public hospital emergency services, highlighting the differences in health literacy according to the method of accessing health services.
The relationship between the independent variables and general health literacy using a linear regression model
The linear regression model for general health literacy, shown in Table 6, identifies several significant predictors, ranked in order of importance. The strongest positive predictor is perceived availability of money for expenses, which has a significant positive effect on general health literacy (B = 6.4, p < .001). This highlights the crucial role of financial stability in improving individuals’ health literacy.
Experiencing ease of access to a scheduled appointment (categorised as easy or very easy) also shows a significant positive association with general health literacy (B = 5.4, p < .001) highlighting the importance of accessible health services.
Satisfactory perceived health status is another significant positive predictor, strongly associated with higher levels of general health literacy (B = 5.6, p < .001), suggesting that individuals who perceive their health positively are more likely to have better health literacy.
Age is positively associated with general health literacy (B = 2.7, p < .001), suggesting that older students tend to have higher health literacy.
Conversely, the presence of a chronic condition is associated with a significant negative impact on overall health literacy (B = -2.1, p < .001), highlighting the challenges people with chronic conditions face in maintaining high levels of health literacy.
The relationship between navigational health literacy and independent variables using a linear regression model
The linear regression model for navigational health literacy, detailed in Table 7, identifies several significant predictors. Use of urgent or emergency services in the last 24 months is associated with a significant negative effect on navigational health literacy (B = -8.5, p < .001). In addition, difficulty using health services shows a strong negative association with navigational health literacy (B = -14.5, p < .001). Conversely, taking a health-related course is positively associated with navigational health literacy (B = 4.1, p = .003). However, not having completed a health-related course is significantly negatively associated with navigational health literacy (B = -6.7, p < .001).
In addition, higher levels of general health literacy, categorised as sufficient or excellent compared to inadequate or problematic, are strongly positively associated with navigational health literacy (B = 32.3, p < .001).
Discussion
Summary of findings
This cross-sectional study aimed to identify the levels of general and navigational health literacy, characterise the access to and utilisation of health services, and analyse the differences in mean general and navigational health literacy indices across socio-demographic variables, presence of chronic disease, perceived health status, perceived availability of money for expenses, and access to and utilisation of health services among higher education students in the Alentejo region of southern Portugal.
The findings provide insights into the health literacy landscape, particularly concerning navigational health literacy among higher education students. To our knowledge, there have been no prior studies on access, utilisation of healthcare services, general and navigational health literacy among higher education students in Alentejo, making this study pioneering.
The study encompasses 1979 higher education students, for all the public academic institutions in Alentejo (NUTS II). In terms of age and gender, the results obtained are similar to the national distribution of higher education students in 2022/2023 [29,45,46]. On a scale 0–50 the general health literacy (GHL) mean index among higher education students in Alentejo was 18.6 ± 11.7. According to the competencies for health literacy it was observed that the lowest score at appraise health information (17.4 ± 10.6) and the highest at understand health information (19.4 ± 13.2). Concerning to health literacy dimensions the lower general health literacy was observed in the health promotion dimension (18.3 ± 11.14) and the highest at healthcare (18.9 ± 13.8). These findings are similar to those of Pedro et al. (2022), who highlighted that approximately 44% of higher education students in Portugal have limited health literacy [23]. Furthermore, they are consistent with studies conducted among Portuguese higher education students [24–26,28,47,48] and evidence for the general population [37,39,49–52]. This study highlights the significant proportion of students who may face challenges in understanding and processing health-related information, which is essential for making informed health decisions and managing their health effectively. The implications of this finding are profound, as inadequate health literacy can lead to poorer health outcomes, increased hospitalisations and higher healthcare costs due to poor management of health conditions.
In another study, Amaral et al. (2021) investigated health literacy levels among residents of Viseu, a town in the interior of Portugal, and found similarly low levels of health literacy. This study showed that low levels of health literacy can affect an individual’s ability to make informed health decisions [25]. Specifically, the research showed that limited health literacy was associated with difficulties in navigating the healthcare system, understanding medical instructions and adhering to prescribed treatments. The findings from Amaral et al. are consistent with broader trends observed in other regions, suggesting a more general problem that goes beyond isolated communities [27,50,53].
The higher prevalence of health literacy observed in our study, compared with the findings of Pedro et al. (44%) and Amaral et al. (32%), and more in line with Santos et al. (66%), can be attributed to several factors [25,27,37]. The socio-demographic and educational characteristics of the Alentejo (NUTS II) student population may play a role in shaping health literacy levels. In addition, increased exposure to different sources of health information, as highlighted by Santos et al, may have contributed to the observed differences in health literacy [28]. These findings underscore the dynamic nature of health literacy, influenced by education, access to reliable health information, and engagement with health-related content, and support the need for targeted health literacy interventions in the future [27].
Nutbeam (2000), Baker (2006), and Sørensen et al. (2012) criticised traditional models of health literacy for neglecting social and contextual factors [5,41,54,55]. Nutbeam proposed a broader view, distinguishing between functional, interactive and critical literacy, and emphasising the need to critically evaluate and apply health information. Baker pointed out that traditional measures fail to address social and economic inequalities, while Sørensen et al. (2012) highlighted the role of social interactions and community context [5,41,54,55]. Pelikan (2022) supports these views and advocates a holistic, contextual approach to health literacy, emphasising the importance of individual, social and societal factors [56].
The current study builds on these findings by focusing on higher education students in the Alentejo region of southern Portugal. This population is particularly important as it represents a group transitioning into adulthood, where health literacy becomes increasingly important for maintaining health and preventing disease. The results show that higher education students also had low levels of general and navigational health literacy, echoing the concerns raised by Pedro et al. and Amaral et al. [23,25].
Navigational health literacy (NAV-HL) was the most challenging, with 85.2% of the respondents in our sample having inadequate and problematic levels and a mean navigational health literacy index of 29.1 ± 31.6 on a scale of 0–100. These findings are consistent with some previous research in this area and highlight the need for future development of tailored interventions to address this issue [39].
The observed association between navigational health literacy levels and overall health literacy underlines their interdependence. Improving the environment for higher education students, who are young adults in transition, is critical given their vulnerability to current and future health challenges. For interventions to improve the health literacy and navigational health literacy of higher education students, it’s relevant in this study dimensions of health promotion and disease prevention. The competencies that can be improved are finding and appraising health information. In the specific context of the Alentejo, with socio-demographic characteristics as elderly/aging, it is important to empower the young adults to make health decisions for their health and well-being.
The study reveals significant differences in GHL and NAV-HL among higher education students based on their patterns of healthcare use. Students who had used urgent or emergency services in the previous 24 months had significantly lower GHL and NAV-HL indices than those who had not, highlighting a critical gap in health literacy among those who frequently use emergency care. Similarly, students who had been hospitalised or made outpatient visits also had lower GHL indices, although NAV-HL did not show a significant difference in these cases. In addition, students who missed school or work due to health problems had lower GHL indices, further suggesting that frequent and complex interactions with the health care system correlate with lower health literacy.
A plausible reason for these lower levels of health literacy among higher education students could be their transitional life stage, which often involves increased independence and responsibility, but limited prior exposure to complex health care systems. This transitional period may lead to inadequate health literacy due to a lack of formal health education and support systems as students navigate new environments and manage their own health needs [48,57,58]. The challenge is compounded by the rapid changes in their social and academic lives, which may reduce their ability to engage effectively with health information and services [54]. These findings highlight the importance of targeted health literacy interventions tailored to the specific needs of students during this transitional period.
The analysis highlights the influence of barriers to accessing and navigating health services on health literacy levels. Students who reported difficulties in making appointments and using health services had significantly lower GHL and NAV-HL indices. In particular, financial constraints were associated with poorer health literacy than other barriers, such as cultural factors [59–61]. he data also showed that the mode of access to health care had an impact on health literacy, with higher indices for those who used health centres or private clinics compared to public hospital emergency departments. These findings highlight the need for targeted interventions to address literacy inequalities and improve access to healthcare, particularly for students facing systemic barriers [5,54,61,62]. Higher education students often have lower health literacy due to life transitions and systemic barriers, such as financial constraints, which affect their ability to access and use health services effectively. This is compounded by difficulties in navigating complex health systems and accessing timely care, which further exacerbates health literacy inequalities [1,5,23,54,57,58,61,63].
General and navigational health literacy levels among characteristics of the students
The mean age of the students was 21.4 ± 2.9 years, and students aged 26 years or older had a higher mean general health literacy index and a higher mean navigational health literacy index compared to younger age groups (p < .001). This suggests that maturity and potentially more life experience contribute positively to health literacy [54]. Most students were female (57.8%) and had higher mean general (21.8 ± 11.1) and navigational (33.6 ± 31.1) health literacy index scores compared to males (p < .001).
Students who were displaced from their usual residence to attend the course had lower mean general health literacy index scores (17.4 ± 11.2) and lower mean navigational health literacy index scores (24.3 ± 30.0), (p < .001). The challenges associated with displacement, such as adjusting to a new environment, may affect their health literacy. Living with health professionals resulted in higher mean general health literacy index (26.1 ± 7.8) and mean navigational health literacy index (36.8 ± 29.4) scores (p < .001). Exposure to health-related discussions and behaviours at home is likely to improve understanding and navigation of health information [64].
Although there were no significant differences in mean general health literacy index scores based on parental education level, there was a trend towards higher mean navigational health literacy index scores among those with parents with higher education. This suggests that a more educated home environment may better prepare students with skills to navigate health systems [54].
First-year students had higher mean general health literacy (27.1 ± 8.7) and fourth-year students had higher mean navigational health literacy (46.3 ± 34.3) scores (p < .001). Students enrolled in health-related courses had significantly higher health literacy (28.8 ± 7.9) and navigational health literacy (50.1 ± 28.1) scores (p < .001). This highlights the impact of health education on improving health literacy [61,65].
Students with chronic diseases had lower general health literacy (15.0 ± 11.3) and navigational health literacy (18.9 ± 29.3) scores (p < .001). Chronic health conditions can be overwhelming for students, potentially leading to lower levels of health literacy.
Students who perceived their health status as satisfactory had higher general health literacy (30.0 ± 7.2) and navigational health literacy (43.7 ± 25.2) scores (p < .001). Positive health perceptions may correlate with proactive health behaviours and better health literacy.
Students with a positive perception of their availability of money for expenses reported higher health literacy (34.8 ± 6.7) and navigational health literacy (50.3 ± 23.9) scores (p < .001). Financial stability is likely to facilitate access to health resources and education, thereby improving health literacy. Further research is needed to explore additional determinants of health literacy, and their implications for public health interventions. The findings highlight the importance of different factors associated with health literacy levels [10].
General and navigational health literacy levels among students’ health services access and utilisation
The results of this study reveal significant differences in health literacy (HL) and navigational health literacy (NAV-HL) among students, highlighting critical barriers to accessing and using health services effectively.
Health service users had significantly lower HL and NAV-HL indices than non-users. This inverse relationship, with frequent service users having lower levels of literacy, may reflect the compounding difficulties faced by those with lower health literacy, including a reduced ability to search for, understand, and use health information effectively. This is consistent with the work of Sørensen et al. (2012), who highlighted that low health literacy is both a cause and a consequence of poor health outcomes, leading to a cycle of increased service use and poorer health management [5,61].
The significant differences in HL and NAV-HL based on the reasons for the last health service use provide critical insights. Students with unresolved health problems or those who did not seek help initially reported significantly lower levels of literacy. This suggests a reactive rather than proactive approach to health management, where students may only seek help when problems worsen. Such findings are consistent with research by Berkman et al. (2011), which highlighted that individuals with lower health literacy often delay seeking care until conditions worsen, resulting in higher health care utilisation and costs [57].
Accessibility issues are another major concern. Students who experienced difficulties in scheduling and attending appointments had significantly lower GHL and NAV-HL. This suggests that logistical barriers, such as scheduling conflicts and long waiting times, have a direct impact on students’ ability to manage their health effectively. Nutbeam (2008) has also pointed out that navigating the health system requires both individual skills and a supportive health system infrastructure, which appears to be lacking in this student population [66].
The finding that students who had difficulty accessing urgent care also had lower HL underlines the acute challenges of managing sudden health needs. This is consistent with Weiss et al. (2004) who documented that lower health literacy is associated with higher emergency department visits, often due to a lack of understanding of when and how to seek appropriate care [67].
Overall, these findings highlight the urgent need to address both individual and systemic factors that influence health literacy and service navigation. Interventions need to focus on educational strategies to improve students’ health literacy while streamlining access to health services. The integration of user-friendly health information systems, as advocated by Baker (2006), could significantly improve students’ ability to navigate and use health services effectively, ultimately improving health outcomes in this vulnerable population [55].
Strengths and limitations
This study makes a significant contribution to the understanding of health literacy and health services use among higher education students and has several key strengths. First, it represents a pioneering effort as the first comprehensive assessment of health literacy levels and health service use patterns in the Alentejo region of southern Portugal. This novel research fills a critical gap due to the lack of previous baseline data, and provides a foundation for future research.
Methodologically, the study demonstrates a robust design by using validated instruments, including the Portuguese version of the European Health Literacy Survey Questionnaire (HLS-EU-PT-Q16) and the Navigational Health Literacy Scale (HLS19-NAV). The HLS-EU-PT-Q16 has been psychometrically validated for the Portuguese population, demonstrating strong internal consistency (Cronbach’s alpha = 0.89), test-retest reliability and construct validity in assessing health literacy levels [38]. Similarly, the HLS19-NAV has undergone cross-national validation in several European contexts, including Portugal, confirming its reliability (Cronbach’s alpha > 0.80) and construct validity for measuring navigational health literacy [39,68]. These rigorous validation processes ensure methodological robustness and strengthen the accuracy and reliability of data collection and analysis [2,37,39,41,38,68].
The study benefits from a diverse sample of 1979 students from different institutions, which increases the generalisability of the findings. Although there are limitations in capturing variability across all higher education institutions, the diversity of the sample provides valuable insights into the health literacy levels of this population. Comprehensive data analysis techniques, including independent samples t-tests, one-way ANOVA, post hoc Bonferroni tests, and multiple linear regression, were used to thoroughly explore the relationship between health literacy levels and various determinants. According to Setia (2016), this rigorous analytical approach strengthens the validity and reliability of the study’s conclusions, in line with the recommended standards [60].
The practical implications of these findings are significant, identifying key demographic and academic factors that influence health literacy and providing a basis for the development of targeted educational programmes. This is consistent with Nutbeam’s (2000) advocacy for structured health education programmes to improve health literacy [54] and with Berkman et al. (2011) support for policy development aimed at reducing health inequalities and improving access to health services [57]. The study is relevant to health professionals, academics, community organisations and policy makers, and can inform their strategic health decisions.
However, it is important to consider the limitations of the study. Although the sample is diverse, it may not be fully representative of all higher education institutions, which may affect the generalisability of the findings. The cross-sectional design limits the ability to draw causal inferences. In addition, the study did not examine the impact of institutional health programmes on health literacy, nor did it address psychological and behavioural factors, such as academic stress and lifestyle, which may significantly influence health literacy [69]. A potential limitation of this study was the inclusion of health sciences students alongside students from other disciplines, which may have influenced the data analysis.
Another limitation is the reliance on self-reported data, which may introduce social desirability bias. Students may have given answers that they perceived to be more socially acceptable, potentially biasing the results. This bias is a common feature of studies using self-report measures, as highlighted by researchers such as Paulhus (1991), who emphasised the influence of social desirability on survey responses [59].
Several strategies have been developed to minimise these biases, such as regular reminders about how to complete the questionnaire (in different formats and at different times), availability to clarify doubts, technical support to resolve difficulties, and reassurance at all times about the anonymity and confidentiality of responses.
Implications for future research and interventions
These findings have important implications for policy planning, programme development, and future research directions. It is essential that further studies deepen the understanding of the relationship between general and navigational health literacy and health inequalities. The observed association between general and navigational health literacy and the independent variables highlights their interrelationship, which has been highlighted by Sørensen et al. (2012), who argue that improving health literacy can lead to a reduction in health inequalities [5].
Improving the environment for higher education students, who are young adults in transition, is critical given their vulnerability to current and future health challenges. The study highlights that access to, and use of health services is more prevalent among students with lower general and navigational health literacy. This finding is consistent with research by Berkman et al. (2011), which suggests that lower health literacy is associated with increased healthcare utilisation due to poor health management [57].
These findings highlight the importance of investing in targeted health literacy interventions to improve access to and use of health services, with a particular focus on navigational skills. Workshops, mini-courses or lectures on health issues and service use may be examples of interventions that could be designed with particular attention to health care and health promotion. Tailored interventions that improve students’ ability to navigate health services could reduce some of the barriers identified in this study. As Nutbeam (2000) notes, effective health literacy programmes are essential to empower individuals to make informed health decisions [54].
Future research should use longitudinal designs to monitor changes in health literacy over time. It should also evaluate specific interventions aimed at improving health literacy levels. Such studies would provide a deeper understanding of the development of health literacy and its long-term effects on health outcomes, as suggested by Coulter and Ellins (2007) [62]. It is recommended that future studies explicitly differentiate between health sciences students and those in other fields in order to facilitate a more precise investigation of any disparities in health literacy that may be evident between these two groups. Furthermore, future research should seek to include a more diverse pool of students and include additional variables such as socioeconomic status, health behaviours, and psychological factors that may influence health literacy. By addressing these variables, researchers can gain a more nuanced understanding of the determinants of health literacy and its impact on health service use.
Our study identified unanticipated health problems and worsening conditions as the main drivers of emergency service use among students. This highlights the urgent need for further research into the relationship between lifestyle factors and healthcare seeking behaviour. Specifically, future research should assess the extent to which avoidable emergency visits are associated with modifiable lifestyle factors, explore the role of health literacy in promoting engagement in preventive healthcare, and develop targeted interventions to reduce overuse of emergency services among students.
Given that 1,574 students (79.5%) reported their health as unsatisfactory, it is important to further investigate the underlying factors contributing to these perceptions. Future research should disaggregate self-reported health into physical, mental and social dimensions, identify key determinants influencing these perceptions, and explore effective intervention strategies to improve student well-being.
Conclusion
The study shows that levels of general and navigational health literacy among higher education students in Alentejo, Portugal, are notably lower than anticipated. This finding highlights a significant challenge, given the crucial role health literacy plays in accessing and using health services effectively. The study identifies several predictors of health literacy among students, including the presence of chronic conditions, frequency of health-related coursework, perceived financial resources, use of urgent or emergency services, and difficulties in accessing health services.
It has been demonstrated that students with limited health literacy encounter obstacles that have the potential to exert a detrimental influence on their well-being and health outcomes. These results reinforce the established associations between health literacy and healthcare utilisation, thus underlining the need for structured health education to improve health literacy and mitigate health inequalities.
The findings highlight the urgent need to develop and implement tailored health literacy interventions that address the specific needs of higher education students. These interventions should focus on health promotion and disease prevention, and aim to improve students’ ability to make informed health decisions and navigate health services effectively. This is particularly important given the influential role of students in shaping wider societal health decisions.
Future research should build on these findings by using longitudinal designs to track changes in health literacy over time and by examining additional variables such as socioeconomic status, health behaviours and psychological factors. Such research will provide a more comprehensive understanding of the determinants of health literacy and inform more effective intervention strategies.
Addressing the challenges identified is critical to reducing systemic barriers and ensuring equitable access to health care. By improving the health literacy and navigational skills of university students, we can promote better health outcomes and contribute to a more informed and health-conscious society.
References
- 1. Sørensen K, Levin-Zamir D, Duong TV, Okan O, Brasil VV, Nutbeam D. Building health literacy system capacity: a framework for health literate systems. Health Promot Int. 2021;36(Supplement_1):i13-23.
- 2. Sørensen K, Pelikan JM, Röthlin F, Ganahl K, Slonska Z, Doyle G, et al. Health literacy in Europe: comparative results of the European health literacy survey (HLS-EU). Eur J Public Health. 2015;25(6):1053–8. pmid:25843827
- 3. Pleasant A, Kuruvilla S. A tale of two health literacies: public health and clinical approaches to health literacy. Health Promot Int. 2008;23(2):152–9. pmid:18223203
- 4.
Kickbusch I, Pelikan JM, Apfel F, Tsouros AD, editors. Health literacy: the solid facts. Copenhagen: World Health Organization Regional Office for Europe; 2013.
- 5. Sørensen K, Van den Broucke S, Fullam J, Doyle G, Pelikan J, Slonska Z, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80. pmid:22276600
- 6. Nutbeam D, Lloyd J. Understanding and responding to health literacy as a social determinant of health. Annu Rev Public Health. 2021;42(1):159–73.
- 7. Visscher BB, Steunenberg B, Heijmans M, Hofstede JM, Devillé W, van der Heide I, et al. Evidence on the effectiveness of health literacy interventions in the EU: a systematic review. BMC Public Health. 2018;18(1):1414. pmid:30594180
- 8.
Nutbeam D, Muscat D. Advancing health literacy interventions. Stud Health Technol Inform. 2020. p. 115–27.
- 9. Griese L, Berens EM, Nowak P, Pelikan JM, Schaeffer D. Challenges in navigating the health care system: development of an instrument measuring navigation health literacy. Int J Environ Res Public Health. 2020;17(16):5731.
- 10. Kayupova G, Takuadina A, Bolatova Z, Dauletkaliyeva Z, Yerdessov N, Nukeshtayeva K, et al. General, vaccination, navigational and digital health literacy of students enrolled in different medical and Health Educational Programs. Healthcare (Basel). 2024;12(9):907. pmid:38727464
- 11. Schnitzer S, Kohl R, Fügemann H, Gödde K, Stumm J, Engelmann F, et al. Patient navigation-who needs what? Awareness of patient navigators and ranking of their tasks in the general population in Germany. Int J Environ Res Public Health. 2022;19(5):2846. pmid:35270537
- 12. Schaeffer D, Griese L, Klinger J. Navigationale gesundheitskompetenz der bevölkerung in deutschland. Gesundheitswesen. 2024;86(1):59–66.
- 13.
Funk LM. Relieving the burden of navigating health and social services for older adults and caregivers. [Internet]. Montreal: Institute for Research on Public Policy; 2019. Available from: https://irpp.org/wp-content/uploads/2019/11/Relieving-the-Burden-of-Navigating-Health-and-Social-Services-for-Older-Adults-and-Caregivers.pdf
- 14. Gui X, Chen Y, Pine KH. Navigating the Healthcare Service “Black Box”. Proc ACM Hum-Comput Interact. 2018;2(CSCW):1–26.
- 15. Haun JN, Patel NR, French DD, Campbell RR, Bradham DD, Lapcevic WA. Association between health literacy and medical care costs in an integrated healthcare system: a regional population based study. BMC Health Serv Res. 2015;15:249. pmid:26113118
- 16. Nutbeam D. Defining and measuring health literacy: what can we learn from literacy studies?. Int J Public Health. 2009;54(5):303–5. pmid:19641847
- 17. Rudd RE, Groene OR, Navarro-Rubio MD. On health literacy and health outcomes: background, impact, and future directions. Rev Calid Asist. 2013;28(3):188–92. pmid:23684050
- 18. Bennett IM, Chen J, Soroui JS, White S. The contribution of health literacy to disparities in self-rated health status and preventive health behaviors in older adults. Ann Fam Med. 2009;7(3):204–11. pmid:19433837
- 19. Howard DH, Sentell T, Gazmararian JA. Impact of health literacy on socioeconomic and racial differences in health in an elderly population. J Gen Intern Med. 2006;21(8):857–61.
- 20. Yin HS, Dreyer BP, Foltin G, van Schaick L, Mendelsohn AL. Association of low caregiver health literacy with reported use of nonstandardized dosing instruments and lack of knowledge of weight-based dosing. Ambul Pediatr. 2007;7(4):292–8. pmid:17660100
- 21. Kripalani S, Henderson LE, Chiu EY, Robertson R, Kolm P, Jacobson TA. Predictors of medication self-management skill in a low-literacy population. J Gen Intern Med. 2006;21(8):852–6. pmid:16881946
- 22.
The HLS19 Consortium of the WHO Action Network M-POHL. International Report on the Methodology, Results, and Recommendations of the European Health Literacy Population Survey 2019-2021 (HLS19) of M-POHL. [Internet]. Austrian National Public Health Institute, Vienna; 2021. Available from: https://m-pohl.net/sites/m-pohl.net/files/inline-files/HLS19%20International%20Report.pdf
- 23. Pedro A, Rosário R, Monteiro I, Cerqueira M, Roque S, Assunção V. Health literacy in higher education students: findings from a Portuguese study. Eur J Public Health. 2022;32(Supplement_3):ckac130.140.
- 24. Almeida S, Pinto E, Correia M, Veiga N, Almeida A. Evaluating e-health literacy, knowledge, attitude, and health online information in Portuguese university students: a cross-sectional study. Int J Environ Res Public Health. 2024;21(3):271.
- 25. Amaral O, Pedro A, Veiga N, Escoval A, Ferreira M. Literacia em saúde em estudantes do ensino superior: comparação entre estudantes de enfermagem e estudantes de outras áreas literacia em saúde em estudantes do ensino superior de viseu. Revista INFAD de Psicología. 2021;2(1):97–106.
- 26. Rosário J, Dias SS, Dias S, Pedro AR. Health literacy and its determinants among higher education students in the Alentejo region of southern Portugal-A cross-sectional survey. PLoS One. 2024;19(9):e0309806. pmid:39316571
- 27. Santos P, Sa L, Couto L, Hespanhol A. Sources of information in health education: a cross-sectional study in Portuguese university students. AMJ. 2018;11(6).
- 28. Silva MJ, Santos P. The impact of health literacy on knowledge and attitudes towards preventive strategies against COVID-19: a cross-sectional study. Int J Environ Res Public Health. 2021;18(10):5421. pmid:34069438
- 29. Direção-Geral de Estatísticas da Educação e Ciência (DGEEC). Inscritos em estabelecimentos de Ensino Superior - 2022/2023. 2023; Available from: https://www.Direção-GeraldeEstatísticasdaEducaçãoeCiência(DGEEC)dgeec.medu.pt/art/ensino-superior/estatisticas/vagas-e-inscritos/652fba6bbd5c2b00958292c4#artigo-6576f80c5f39ee77721e9e66
- 30. Bhusal S, Paudel R, Gaihre M, Paudel K, Adhikari T, Pradhan P. Health literacy and associated factors among undergraduates: a university-based cross-sectional study in Nepal. PLOS Glob Public Health. 2021;1(11):e0000016.
- 31. Evans A-Y, Anthony E, Gabriel G. Comprehensive health literacy among undergraduates: a Ghanaian University-Based cross-sectional study. Health Lit Res Pract. 2019;3(4):e227–37. pmid:31637363
- 32. Hajian-Tilaki K. Sample size estimation in epidemiologic studies. Caspian J Intern Med. 2011;2(4):289–98. pmid:24551434
- 33.
Scheaffer R. Elementary survey sampling. 7th ed. ed. Scheaffer R, editor. Boston, MA: Brooks/Cole, Cengage Learning; 2012.
- 34.
Cochran W. Sampling techniques. 3rd ed. New York: Wiley; 1977.
- 35. Toolkits | M-POHL - WHO Action Network on Measuring Population and Organizational Health Literacy [Internet]. [cited 2025 Feb 14]. Available from: https://m-pohl.net/HLS19_Project
- 36. Pelikan J, Link T, Straßmayr C. The European Health Literacy Survey 2019 of M-POHL: a summary of its main results. Eur J Public Health. 2021 Oct 20;31(Supplement_3):ckab164.497.
- 37. Pedro AR, Amaral O, Escoval A. Literacia em saúde, dos dados à ação: tradução, validação e aplicação do European Health Literacy Survey em Portugal. Revista Portuguesa de Saúde Pública. 2016;34(3):259–75.
- 38. Pedro A, Raposo B, Luís L, Amaral O, Escoval A, Simões Dias S. Portuguese version of the HLS-EU-Q6 and HLS-EU-Q16 questionnaire: psychometric properties. Int J Environ Res Public Health. 2023;20(4):2892.
- 39. Arriaga M, Francisco R, Nogueira P, Oliveira J, Silva C, Câmara G. Health literacy in Portugal: results of the health literacy population survey project 2019–2021. Int J Environ Res Public Health. 2022;19(7):4225.
- 40. Pelikan JM, Ganahl K. Measuring health literacy in general populations: primary findings from the HLS-EU Consortium’s Health Literacy Assessment Effort. Stud Health Technol Inform. 2017;240:34–59. pmid:28972508
- 41. Sørensen K, Van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, et al. Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q). BMC Public Health. 2013;13:948. pmid:24112855
- 42.
Pelikan JM, Röthlin F, Ganahl K. Measuring comprehensive health literacy in general populations: validation of instrument, indices and scales of the HLS-EU study [Internet]. 6 th Annual Health Literacy Research Conference; 2014 Nov 3; Bethesda, Maryland, Hyatt Regency Bethesda. Available from: https://www.bumc.bu.edu/healthliteracyconference/files/2014/06/Pelikan-et-al-HARC-2014-fin.pdf
- 43. Griese L, Schaeffer D, Berens E-M. Navigational health literacy among people with chronic illness. Chronic Illn. 2023;19(1):172–83. pmid:35014911
- 44.
UNESCO Institute for Statistics. International Standard Classification of Education (ISCED) 2011 [Internet]. UNESCO Institute for Statistics; 2012 [cited 2024 May 26]. Available from: http://uis.unesco.org/sites/default/files/documents/international-standard-classification-of-education-isced-2011-en.pdf
- 45.
Direção-Geral de Estatísticas da Educação e Ciência (DGEEC). Perfil do aluno. Continente 2022/2023 [Internet]. Lisboa: Direção-Geral de Estatísticas da Educação e Ciência (DGEEC); 2024. p. 124. Available from: https://www.dgeec.medu.pt/api/ficheiros/66e43cd6081cd43c247ab6f8
- 46.
European Commission, editor. Education and training monitor 2023: comparative report. Luxembourg: Publications Office; 2023. p. 1.
- 47. Campos S, Ferreira M, Cardoso A, Guiné R, Aparício G, Nelas P. Literacia em saúde nos estudantes do ensino superior. Millenium - J Educ. 2022:37–45.
- 48. Oliveira L, Zandonadi RP, Nakano EY, Almutairi S, Alzghaibi H, Lima MJ, et al. From validation to assessment of e-health literacy: a study among higher education students in Portugal. Healthcare (Basel). 2024;12(16):1626. pmid:39201184
- 49. Santos P, Sá L, Couto L, Hespanhol A. Health literacy as a key for effective preventive medicine. Cogent Soc Sci. 2017;3(1):1407522.
- 50. Paiva D, Silva S, Severo M, Moura-Ferreira P, Lunet N, Azevedo A. Limited health literacy in Portugal assessed with the Newest Vital Sign. Acta Med Port. 2017;30(12):861–9.
- 51. Barros A, Santos H, Santos-Silva F. A systematic review of health literacy measurement instruments in Portugal. Port J Public Health. 2022;40(3):172–87. pmid:39469254
- 52. Baccolini V, Rosso A, Di Paolo C, Isonne C, Salerno C, Migliara G, et al. What is the Prevalence of low health literacy in European Union Member States? A systematic review and meta-analysis. J Gen Intern Med. 2021;36(3):753–61. pmid:33403622
- 53. Bánfai-Csonka H, Bánfai B, Jeges S, Betlehem J. Understanding health literacy among university health science students of different nationalities. Int J Environ Res Public Health. 2022;19(18):11758.
- 54. Nutbeam D. Health literacy as a public health goal: a challenge for contemporary health education and communication strategies into the 21st century. Health Promotion Int. 2000;15(3):259–67.
- 55. Baker DW. The meaning and the measure of health literacy. J Gen Intern Med. 2006;21(8):878–83. pmid:16881951
- 56. Pelikan JM, Link T, Straßmayr C, Waldherr K, Alfers T, Bøggild H, et al. Measuring comprehensive, general health literacy in the general adult population: the development and validation of the HLS19-Q12 instrument in seventeen countries. Int J Environ Res Public Health. 2022;19(21):14129. pmid:36361025
- 57. Berkman N, Sheridan S, Donahue K, Halpern D, Crotty K. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med. 2011;155(2):97.
- 58. Rababah JA, Al-Hammouri MM, Drew BL, Aldalaykeh M. Health literacy: exploring disparities among college students. BMC Public Health. 2019;19(1):1401. pmid:31664973
- 59.
Paulhus DL. Measurement and Control of Response Bias. In: Measures of Personality and Social Psychological Attitudes [Internet]. Elsevier; 1991. p. 17–59. [cited 2024 Jul 30]. Available from: https://linkinghub.elsevier.com/retrieve/pii/B978012590241050006X
- 60. Setia MS. Methodology Series Module 3: Cross-sectional Studies. Indian J Dermatol. 2016;61(3):261–4. pmid:27293245
- 61. Kühn L, Bachert P, Hildebrand C, Kunkel J, Reitermayer J, Wäsche H. Health literacy among university students: a systematic review of cross-sectional studies. Front Public Health. 2022;9:680999.
- 62. Coulter A, Ellins J. Effectiveness of strategies for informing, educating, and involving patients. BMJ. 2007;335(7609):24–7.
- 63. Rosário J, Raposo B, Santos E, Dias S, Pedro AR. Efficacy of health literacy interventions aimed to improve health gains of higher education students-a systematic review. BMC Public Health. 2024;24(1):882. pmid:38515114
- 64. Stormacq C, VanDenBroucke S, Wosinski J. Does health literacy mediate the relationship between socioeconomic status and health disparities? integrative review. Health Promot Int. 2019;34(5):e1-17.
- 65. Mullan J, Burns P, Weston K, McLennan P, Rich W, Crowther S. Health literacy amongst health professional university students: a study using the health literacy questionnaire. Educ Sci. 2017;7(2):54.
- 66. Nutbeam D. The evolving concept of health literacy. Soc Sci Med. 2008;67(12):2072–8. pmid:18952344
- 67. Weiss BD, Palmer R. Relationship between health care costs and very low literacy skills in a medically needy and indigent Medicaid population. J Am Board Fam Pract. 2004;17(1):44–7. pmid:15014052
- 68. Griese L, Finbråten H, Francisco R, De Gani S, Griebler R, Guttersrud Ø. Hls19-nav—validation of a new instrument measuring navigational health literacy in eight European countries. Int J Environ Res Public Health. 2022;19(21):13863.
- 69. Paasche-Orlow MK, Wolf MS. The causal pathways linking health literacy to health outcomes. Am J Health Behav. 2007;31 Suppl 1:S19-26. pmid:17931132