http://orcid.org/0000-0001-9357-7543
Figures
Abstract
Introduction
People with mobility impairments often rely on wheelchairs as their primary means of mobility. Untrained wheelchair service providers may provide inappropriate wheelchairs and services which result in negative consequences in wheelchair users’ health, quality of life, safety, and social participation. This study aimed to evaluate the influence of the Spanish Hybrid Course on Basic Wheelchair Service Provision, a training based on the World Health Organization’s Wheelchair Service Training Program-Basic Level, to increase knowledge in basic level wheelchair service provision among a group of wheelchair service providers from Colombia. In addition, we developed a satisfaction survey which participants completed after the training to understand levels of satisfaction with the training intervention.
Methods
A quasi-experimental study was conducted to evaluate changes in basic level wheelchair knowledge using the Wheelchair Service Provision–Basic Test. Paired sample t tests were used to assess pre-and post-training changes in basic level wheelchair knowledge. The Hybrid Satisfaction Survey was developed in collaboration with a multidisciplinary, international stakeholders’ group. The survey’s construct of interest was level of satisfaction determined by interaction, instructor, instruction methodology, content, and technology, using a five-point Likert scale (0 = strongly disagree to 4 = strongly agree). The survey was completed anonymously after the training intervention and analyzed using frequencies and percentages.
Results
Fifteen wheelchair service providers in Colombia completed the Spanish Hybrid Course. Mean post-scores were significantly higher (Mean (M) = 56.13, Standard Deviation (SD) = 7.8), than pre-assessment scores (M = 50.07, SD = 8.38, t(14) = 4.923, p = <0.0001). Participants who completed the surveys (N = 15) reported that the Spanish Hybrid Course was well received, with 98.66% of responses distributed in favorable levels (>3).
Conclusions
The Spanish Hybrid Course proved to be effective in increasing basic level wheelchair knowledge with a high satisfaction level among participants. Further testing is needed to evaluate the effectiveness of this course across different individuals and countries as a potential tool to build professional capacity in basic level wheelchair provision.
Citation: Burrola-Mendez Y, Toro-Hernández ML, Goldberg M, Pearlman J (2018) Implementation of the hybrid course on basic wheelchair service provision for Colombian wheelchair service providers. PLoS ONE 13(10): e0204769. https://doi.org/10.1371/journal.pone.0204769
Editor: Stefano Federici, Universita degli Studi di Perugia, ITALY
Received: June 12, 2018; Accepted: September 13, 2018; Published: October 4, 2018
Copyright: © 2018 Burrola-Mendez et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: This study was produced by ISWP in collaboration with the University of Pittsburgh, subaward number APC-GM-0068, through Advancing Partners & Communities (APC), a cooperative agreement funded by the U.S. Agency for International Development under Agreement No. AID-OAA-A-12-00047, beginning October 1, 2012. This study is based upon work supported by Consejo Nacional de Ciencia y Tecnología México (CONACYT) Graduate Student Fellowship. The contents of this publication do not necessarily reflect the view of CONACYT.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The World Bank estimates that one billion people, or 15% of the world’s population, experience some form of disability, and its prevalence is higher in low- and middle-income countries (LMICs) [1]. In Latin America, 12.4% of the population, approximately 73 million people, live with at least one type of disability [2, 3]. Disability is more prevalent among women and the most economically and socially vulnerable groups: Lower-income persons, older persons, indigenous people, Afro-descendants, and inhabitants of rural areas [2]. In fact, it is estimated that around 80% of people with disabilities in Latin America live in poverty, and that mobility and vision impairments are the most common types of disability [2, 4, 5]. The World Bank classification by gross national income reports in 2018 indicate that Latin America is comprised of 4 lower-middle-income, 12 upper-middle-income, and 4 high-income countries [6, 7]. Spanish is the official language in 80% of the countries within the region and is the second most spoken language worldwide [8, 9]. The United Nations Convention on the Rights of People with Disabilities (UNCRPD), which promotes effective human rights for all persons with disabilities, has been signed and ratified by 95% of countries in Latin America [10–12]. Despite the advances in the legal recognition of the rights of people with disabilities, the situation in Latin America continues to be characterized by great inequality, socioeconomic gaps, and social vulnerability [13].
People with mobility impairments often rely on the use of assistive technology devices, such as wheelchairs, as their primary means of mobility. An appropriate wheelchair can prevent secondary health complications, enhance quality of life, improve safety, and facilitate access to human rights such as education, healthcare, and employment [14–19]. Article 20 of the UNCRPD emphasizes the need to promote personal mobility with the greatest independence by providing training to persons with disabilities and personnel providing services to them [20]. In addition, Articles 4, 9, 25, 26, and 32 mandate that an appropriate wheelchair is delivered by trained personnel [10]. Nevertheless, evidence highlights a shortage of education and training in wheelchair service provision available to personnel globally [21, 22]. Inadequate education and training of wheelchair service providers can result in inappropriate wheelchair provision, which has negative impacts in quality of life, health, safety, and other basic human rights [14–20]. This situation may be more consequential in LMICs where the incidence of disability is higher, there is a limited range of quality affordable wheelchairs, disability and poverty operate in a cycle, and people with disability often are marginalized [2, 21, 23, 24].
The World Health Organization (WHO), with the support of the United States Agency of International Development (USAID), has published a series of Wheelchair Service Training Packages (WHO WSTP) to assist nations in fulfilling the UNCRPD mandate of supporting providers’ training and helping to bridge the gap in training disparity across less-resourced settings [14, 25]. To date, there are five WHO WSTPs: Basic, intermediate, managers’, stakeholders’, and trainers’ packages [25–29]. The WHO has officially translated these packages into different languages, including Spanish, and offers access to the course materials free of charge from the WHO website [25, 30]. Since the adoption of the UNCRPD in 2006, there is a growing commitment in Latin America to provide educational programs and training in wheelchair service provision locally that enhance positive effects in the community. One such initiative, the Latin American Seating Symposium, has been held every two years as a regional effort to promote access, standard of practice, and effective use of assistive technology devices [31]. In the symposia, internationally recognized continuing education programs like the Wheelchair Skills Program and the WHO WSTPs are delivered as workshops [27, 28, 32]; however, there is still an overwhelming need for training and appropriate services that is not being met by the current workforce.
With the purpose of offering alternative learning methodologies that could be scaled across countries and regions for global capacity building, in 2016, the International Society of Wheelchair Professionals (ISWP) developed a Hybrid Course in English and Spanish using the official versions of the WHO WSTP-Basic (WHO WSTP-B) in both languages [30, 33]. The Hybrid Course consists of online modules designed for low-bandwidth internet access that reduce the in-person training exposure to 3 days, making it less expensive and easier to scale-up [33]. The English Hybrid Course proved to be effective in increasing basic level wheelchair service provision knowledge in a group of graduate students from Rehabilitation Sciences, based on the scores of the validated ISWP Wheelchair Service Provision-Basic Test [33, 34].
While initial learning outcome results offered some evidence that the Hybrid Course may be an effective mechanism to train wheelchair service provision content, the course was tested in English exclusively in a high-resource environment and it did not capture satisfaction among participants [33]. We needed to evaluate the Spanish Hybrid Course in different contexts and explore trainees’ satisfaction level post-training to determine if it is an effective and well-received learning method to build capacity for wheelchair service providers in Latin America. Thus, the purpose of this exploratory study was to test the Spanish Hybrid Course in Colombia. This country was selected for this first training intervention due to the presence of local facilitators who previously were trained through the WHO WSTP-B and the WHO WSTP–Trainer’s package, as well as the research team’s local partnerships and access to key stakeholders.
The specific aims of this study were to: (1) develop a satisfaction survey; then (2) evaluate the effect of the Spanish Hybrid Course among a group of wheelchair service providers located in Colombia. We hypothesized that trainees would have higher scores on the ISWP Wheelchair Service Provision-Basic Test after receiving the training, and that they would report overall high levels of satisfaction with the training. This study would provide further understanding of the Spanish Hybrid Course to help determine its potential implementation in other countries.
Methods
Each specific aim was completed in sequence; the methods are described below.
Specific Aim 1: Development of the satisfaction survey
For this specific aim, we followed the methodology implemented for the development of the Hybrid Course [33] in which the same international and multidisciplinary group of stakeholders oversaw and guided the development of the Hybrid Satisfaction Survey. This group, the Hybrid Subcommittee (HSC), was comprised of 8 members from lower-middle to high-income economies (Brazil, Canada, Colombia, India, Mexico, Philippines, United Kingdom, and the United States of America) with experience delivering and developing wheelchair training programs in different settings [33].
The authors of this manuscript and the HSC developed the Hybrid Satisfaction Survey to evaluate levels of satisfaction among participants after the Hybrid Course training intervention. The construct of interest was levels of satisfaction after training experiences determined by 5 sub-domains: Interaction, instructor, instruction methodology, content, and technology. The items were selected from existing surveys that evaluated satisfaction with online learning [35], satisfaction with blended learning in a gender-segregated environment [36], and satisfaction with blended learning [37]. The selected items were adapted to reflect the content of the course. The items’ adaptation followed best practices for item construction that included: Using plain language, avoiding double-barreled questions, and writing in a positively worded direction. [38, 39]. The survey used a five-point Likert scale (4 = strongly agree, 3 = agree, 2 = neither agree nor disagree, 1 = disagree, 0 = strongly disagree) that prompted participants to indicate the degree to which they agreed with each statement in the sub-domains. An open-ended question was included at the end of each sub-domain to encourage participants to provide suggestions and feedback. In addition, the sub-domain “Content” had a multiple-choice question that was analyzed individually: “For the course that you completed, would you prefer: a) to have more online modules, b) to have more in-person practice, c) to have more online materials and in-person practice, d) nothing to change, or e) other (entry box).” The Hybrid Satisfaction Survey was hosted online in Qualtrics®. Since the lead author and 3 HSC members were bilingual in English and Spanish, the Hybrid Satisfaction Survey was developed simultaneously in both languages and can be accessed in the Supporting Information section of the article (S1 File).
Specific Aim 2: Implement the hybrid course with a group of wheelchair service providers from Colombia
Study design.
This study was designed as a pre/post repeated measures study conducted to evaluate changes in basic level wheelchair knowledge and a post-assessment design to evaluate levels of satisfaction after the implementation of the Spanish Hybrid Course in a group of wheelchair service providers in Medellin, Colombia. The study was approved by the University of Pittsburgh Institutional Review Board. The study reporting complied with the Template for Intervention Description and Replication (TIDieR) checklist for reporting of interventions [40].
Study sample.
The sample was selected using a purposive sampling method guided by the local stakeholders’ input. Universidad CES in Medellin, Colombia, led the recruitment, enrollment, and delivered the Hybrid Course. The inclusion criteria included individuals who: 1) worked locally in wheelchair service delivery; and 2) who had not taken the ISWP Wheelchair Service Provision–Basic Test. Participants who were simultaneously participating in another wheelchair-related study were excluded.
The training was provided at no cost to participants. Therefore, to reduce attrition, Universidad CES sent a call for applications to disability and rehabilitation-related stakeholders (hospitals, public assistive technology, physical therapy programs, local and international non-governmental organizations, and community leaders, among others). Participants’ applications included their supervisor’s approval and a letter of commitment to complete online and in-person training activities. Universidad CES selected 15 out of the 18 applications received based on their work experience and potential to apply and to disseminate the content. The number of participants for the course was selected based on the size of the course and trainer-trainee ratio that is suggested by WHO to foster an appropriate learning environment since the program had a significant amount of hands-on practical sessions [41].
Intervention.
Table 1 presents the study overview and timeline, and Table 2 provides the TIDieR checklist for reporting interventions. Three local facilitators worked interprofessionally during the planning phase (recruiting trainees, identifying wheelchair recipients and procuring wheelchairs) and the training delivery. They were a physical therapist, a biomedical engineer, and a physical medicine and rehabilitation doctor. The first two participated in a training of trainers course specific to the WHO WSTP [42]. The physiatrist had more than 10 years of experience in wheelchair provision and also received training as a trainer in the International Classification of Functioning, Disability, and Health [43].
Online training.
The online learning was divided into two sequential phases (Table 1). At each phase, participants reviewed the content and completed the required activities asynchronously to meet the learning outcomes (S2 File). The description of the online modules’ content, course activities, instructional materials used and learners’ interactions have been described elsewhere [33]. After the completion of each phase, an online meeting (recitation) was organized synchronously between participants and trainers. During the recitations, trainers reinforced the key points of the modules, answered questions, discussed topics, and promoted interaction among participants. Recitations lasted 90 minutes, were recorded, and made available to participants and trainers. ISWP staff attended the recitations to help coordinate the sessions and provide support, if needed.
In-person training.
After the completion of the online portion of the course, participants attended 3.5 days of in-person training led by local trainers at Universidad CES in Medellin, Colombia (Table 1 and S2 File). Ten wheelchair users who previously were assessed for a wheelchair by trainers were invited to participate as volunteers for the in-person sessions. Additionally, 5 wheelchair users who had received a new wheelchair in the past year were invited as volunteers for the follow-up practical session (Day 4, Practical 3 in S2 File). The goal was for three participants to work with one wheelchair user volunteer during each practical session. On the last day, wheelchair users received the benefit of a new appropriate wheelchair provided by the trainees.
Outcome measurements.
A priori, we defined that our primary measure of interest was knowledge change, and our secondary measure, participants’ level of satisfaction. We deemed these two outcomes relevant to evaluate the influence of the Spanish Hybrid Course and to plan for a potential larger future study.
To evaluate knowledge change, participants completed the ISWP Wheelchair Service Provision–Basic Test one week before and after the training intervention. The aforementioned test has shown validity evidence for measuring basic level wheelchair service provision knowledge independent of geographic location [34]. The test consisted of 19 sociodemographic questions and 75 multiple-choice questions that evaluated basic wheelchair service delivery. The sociodemographic questions included general characteristics of the test takers such as age, gender, educational level, profession, employment status, years of experience in wheelchair service provision, work setting, and motivation to take the training. Some demographic questions, such as work setting, age group served, and motivation to take the training allowed multiple answers, and participants were asked to select all applicable options. The 75 multiple-choice questions covered seven domains of wheelchair service delivery: 1) assessment, 2) prescription, 3) fitting, 4) production, 5) user training, 6) process, and 7) follow-up and maintenance as described in the WHO WSTP-B [34]. The domains had different weights based on the pre-set number of questions that each domain was allocated. Each domain had a pool of questions created to reduce the likelihood of receiving the same question when taking the test multiple times. In addition, the test settings included: 1) random distribution of questions and answers from each domain’s pool of questions; 2) force completion that required participants to complete the test in one-time entry; and 3) immediate test scores and the ability to review correct and incorrect answers [33, 34] Test scores greater than or equal to 53 points (70% of the total points) were considered passing scores. Participants received an email with instructions on how to log into the testing platform, Test.com®, and contact information for ISWP staff and the local lead trainer in case of technical problems or questions. Participants were instructed to complete the test without accessing course materials. The test was completed in Spanish.
To evaluate levels of satisfaction after the training intervention, participants were invited to complete the Hybrid Satisfaction Survey online anonymously. Participants received an email with the survey link. The survey was hosted in Qualtrics® and included a cover letter with instructions, the purpose of the questionnaire, a confidentiality statement, and contact information for questions or technical issues.
Data management and analysis.
All data was collected in a Test.com® and Qualtrics® database, exported into a CSV file and then into SPSS® Version 24.0 where all calculations were performed. Data was visually inspected for distributional assumptions using Q-Q plots. Mean values (M), Standard Deviation (SD), and confidence intervals of 95% were calculated.
Differences between the pre- and post- test total scores and domain scores were calculated and visually inspected for distributional assumptions using Q-Q plots. Box plots were used to graphically present the pre- and post-test total scores and domain scores using percentages. The total test scores and the domain scores were converted into percentages by dividing the score obtained by the total number of questions (of the test or the specific domain) and then multiplying by 100. The percentages were used to construct the box plots of the pre- and post-test domain scores. For the primary outcome, knowledge change, a paired sample t test was calculated when the differences were normally distributed. All analyses were carried out using an alpha level of 0.05.
For the secondary outcome, participants’ satisfaction, survey responses were analyzed using frequencies and percentages. Each question was analyzed individually by summing the number of times the type of response was selected (4 = strongly agree, 3 = agree, 2 = neither agree nor disagree, 1 = disagree, 0 = strongly disagree). Then, the frequencies of the type of response were converted into percentages by dividing each Likert-type scale response by the total number of responses received and then multiplying by 100. Open-ended questions were analyzed individually.
Results
A total of 15 participants were recruited; all of them completed the pre-and post-assessments, and therefore, there were no dropouts. Summary statistics of participants’ characteristics are described in Table 3. Regarding work settings, outpatient was the most common selection (n = 9), while in-patient was the least frequent selection (n = 3). All participants selected adults as one of the age groups served (n = 15); early childhood and older adults were the second most common selection (n = 9). Professional growth (n = 12) followed by personal growth (n = 7) were the most common motivation to take the trainings.
The differences between the pre- and post-test total scores and the pre- and post-domain scores were normally distributed. A paired-sample t-test indicated that post-assessment scores were significantly higher (M = 56.13, SD = 7.8) than pre-assessment scores (M = 50.07, SD = 8.38), t(14) = 4.923, p = <0.0001 (Table 4). Fig 1 presents box plots of pre-and post-test total scores.
Comparison of the pre- and post-test total scores. Significant differences in total test scores were observed between groups. **: p<0.0001.
Knowledge change per domain was explored; all domains, except for “Fitting” presented an increase in mean scores between pre-test and post-test. “Assessment” reported a significant difference in the pre-test scores (M = 13.93, SD = 2.19) and posttest scores (M = 16.33, SD = 2.06),t(14) = 5.041, p = <0.0001 (Table 4). In Fig 2, blox plots of the seven domains were compared between pre-and post-test scores.
Comparison of the pre- and post-test total domain scores. Significant differences were observed between pre- and post-test total Assessment scores. The circles represent outliers, values between 1.5 and 3 box lengths, and an asterisk represents extreme outliers, a value more than 3 times the interquartile range. **: p<0.0001.
Fifteen anonymous Hybrid Satisfaction Surveys were received and analyzed. All participants enjoyed the course, were satisfied with the course, were willing to take another hybrid course, would recommend the course, and considered that their understanding of wheelchair service provision improved. Overall, the Spanish Hybrid Course was positively evaluated, reporting 98.66% of the responses distributed in favorable levels (3 = agree and 4 = strongly agree) (Fig 3).
Open-ended questions were individually analyzed; results showed that most students felt highly satisfied with the course (Table 5). Suggestions to improve the online portion included to revise some questions on the quiz and to increase the time allocated to review modules A5-A8. Six participants suggested increasing the in-person time; 2 suggested increasing both the in-person and the online time, and 5 suggested leaving the course as it is.
Discussion
We evaluated the influence of the Spanish Hybrid Course among a group of wheelchair service providers in Medellin, Colombia and developed a satisfaction survey to capture participants’ level of satisfaction after the training intervention. The Spanish Hybrid Course had a statistically significant influence on the total score of the ISWP Wheelchair Service Provision–Basic Test score and received overall high satisfaction ratings, demonstrating the potential value of the Spanish Hybrid Course to train wheelchair service providers at the basic level.
This project demonstrates a successful strategy that could address the lack of trained personnel and promote coordination among professionals who work with people with disabilities. In fact, lack of a coordinated multi-sectoral approach, including a disconnect between different levels of rehabilitation (e.g., acute and community-based rehabilitation), and a shortage of skilled personnel have been identified as barriers to achieving global action on the disability agenda in LMICs [44–47]. The results of this study call for more research to explore training models that can be scaled and cost-effective pathways to building a sustainable training force, including interprofessional training that may contribute to better coordinated services. For instance, a more sustainable partnership to support capacity building and a deeper understanding of global health needs could be explored, as proposed by physiotherapy programs in Ireland and Uganda [48].
Specific to Colombia, the Disability Law, enacted in 2013 after the ratification of the UNCRPD, states that the government will warrant access to appropriate assistive technology to promote social inclusion, participation, habilitation, and rehabilitation [49]. Colombia is undergoing a post-armed conflict era that focuses on building a peaceful environment by including vulnerable groups that traditionally have been discriminated against and marginalized, [50] including people with mobility impairments who need a wheelchair [51]. However, the country lacks national wheelchair provision guidelines, including defined competencies that professionals must have to be involved in wheelchair provision. Colombia has two programs specific to the context of wheelchair provision. The Assistive Technology Banks in the capital, Bogota, which are meant to provide assistive technology, including wheelchairs, to its poorest residents [52]. The requirement for professionals to work in provision is to be a rehabilitation professional with training or experience in the assistive technology field [53]. The other program is the Protocol for Assistive Technology Provision, from the military forces, which requires a prescription from a medical doctor and support of an interdisciplinary rehabilitation team for users to receive a wheelchair [54]. Both programs lack detail on the minimum competencies that professionals must have for wheelchair service provision. An intervention as proposed in this study could be explored to warrant basic wheelchair knowledge of professionals working in the aforementioned programs.
Sixty-seven percent of the pretest scores were below the passing cutoff of the test (53 points), which could indicate the need to update and/or promote training in wheelchair service provision. However, it is important to note that the majority of participants (73%) self-reported less than three years of experience working with wheelchair users. This situation may reflect the limited training time (or lack of training) professional rehabilitation training programs provide in wheelchair service provision [22] and/or the need to integrate training into existing curricula in universities to guarantee graduates are adequately prepared and skilled to assume the wheelchair provision process [21]. Increasing the sample size and including experienced wheelchair providers could help to explore the possible relationship between basic level wheelchair knowledge and wheelchair service provision experience. The Spanish Hybrid Course had a statistically significantly influence on the total ISWP Wheelchair Service Provision-Basic Test group’s mean score, and seventy-four percent of the post-test scores were above the passing cutoff for the test. These findings correlate with our previous study in which we evaluated the effect of the English Hybrid Course in a group of Rehabilitation Science students [33]. Furthermore, mean scores were calculated per domain to explore specific knowledge change. All domains, except "Fitting", reported an increase in post-test scores, an observation that also occurred in our previous evaluation of the Hybrid Course in English [33]. “Assessment” was the only domain which had a statistically significant increase. While the aim of the study was exploratory, and we did not hypothesize statistically significant changes in total test scores and domain scores, we decided to analyze the results by conducting a post-hoc paired-sample t test to gather data for future studies. It is important to note that the alpha level for multiple testing was not adjusted because this was an exploratory study with a small sample size, and we were concerned about the potential of making a Type II error [55–57]. A larger sample size, that could be achieved by conducting this training multiple times in different settings to comply with the WHO WSTP suggestion for group size, could help to determine the Spanish and English Hybrid Course's impact on each specific domain and to detect future content modifications, if needed.
A potential strength of this study is that all phases of the research process included stakeholder collaboration. This approach suggests that the study’s results will be more usable, relevant, potentially scalable, and transferable to the community [58–60]. Additionally, the group was comprised of diverse professionals, which supports that interprofessional collaboration has led to improvements in healthcare and must be promoted in educational and healthcare training [61]. Literature specific to the wheelchair field indicates that a team approach of a range of trained professionals and non-professionals is required to develop an appropriate system that increases access to wheelchair technology [14, 21, 25, 62]. Furthermore, adult learning theories indicate that discussions among a diverse group of professionals increase the amount of practical knowledge and the likelihood that individuals within the group are able to learn [63, 64]. In this training, an assistive technology program manager participated, which may have helped to promote the program implementation and advocate for the buy-in of other decision-makers. It may be necessary to investigate further whether having this type of in-depth training reflects changes in current practice. Additionally, having a community leader, who was also a wheelchair user, as a participant, aligns with Colombia’s community-based rehabilitation guidelines that indicate the importance of having community workers close to the health sector so they can support referrals and basic maintenance and repairs, and help the sector understand actual needs of people with disabilities and their families [65]. To improve the reporting of this training intervention and, ultimately, its replicability, we used the TIDier checklist, a guide of 12 items that enhance the quality of description of interventions [40].
Participants reported overall high levels of satisfaction after the training intervention in the five sub-domains of the satisfaction survey: Interaction, instructor, instruction methodology, content, and technology. One element that may be a contributing factor to participants’ satisfaction was that the facilitators had previously been trained in the WHO WSTP-Trainer’s package which takes into consideration important adult learning strategies [42]. In addition, the facilitators were from the local context which suggests that they are more familiar with contextual issues and able to tailor the training [66]. We treated the Likert-style responses as ordinal data because we did not assume that the difference between responses was equidistant even though the numbers assigned to those responses were equal [67]. As often recommended, we used non-parametric tests that included frequencies and percentages of responses in each category for data analysis [67]. This approach allowed us to explore agreement by item and by sub-domain and the opportunity to identify problematic aspects of the training. In the “Technology” sub-domain, it is unknown what technical issues participants encountered and whether they were able to solve them. Future training interventions could explore participants’ connectivity and Internet access prior to the online portion of the Hybrid Course in order to offer alternative ways to access the materials. For instance, if participants’ Internet speed is a challenge to run training videos, the material could be shared in portable storage devices such as USBs, CDs, or DVDs. The comments received in response to the open-ended questions reflected a good acceptance of the training methodology and allowed us to collect suggestions for future training interventions.
Study limitations
This study has several limitations that are important to note in interpreting the current results and planning for future research studies. While there was a significant increase in post-test scores after the training intervention, it is unknown if improvement in wheelchair service providers’ knowledge translates to better health outcomes in the wheelchair users they served and better competency in wheelchair service provision. Competency is a complex know-how that is based on combining knowledge, skills, abilities and external resources and then applying them appropriately to specific types of situations based on the context [68, 69]. Preliminary studies suggest that the involvement of properly trained professionals contributes to users’ higher satisfaction in the fitting and assignment of assistive technology devices which may turn into improvements in quality of life [70]. Future work should evaluate trainees’ retention of knowledge, improved competency and users’ health outcomes and satisfaction over a long period of time. In this study, we had a small sample size of wheelchair service providers from Colombia, mostly novices, which made our findings not generalizable to wheelchair service providers from other regions of the country and other Latin America settings. Further studies could investigate the impact of the Spanish Hybrid Course across different sub-populations and countries in Latin America to evaluate the effectiveness of this course in building professional capacity in basic level wheelchair service provision.
The Hybrid Satisfaction Survey developed and used in this study was not formally validated. Therefore, we are unsure if the tool measures the underlying outcome of interest [71]. Future work could assess validity and reliability evidence to enhance research quality. Despite this limitation, we used previous satisfaction surveys to guide question development and an international stakeholders’ group to provide further insight, review, and recommendations on the survey.
Ongoing & future work
Leveraging the potential of online learning has been used as a methodology in LMICs to build capacity in rehabilitation personnel [72]. Other training methodologies such as a complete online course could also be explored, especially to train the trainers for curriculum integration at Universities that offer programs related to wheelchair service provision (e.g., physical therapy, occupational therapy, prosthetics and orthotics, and rehabilitation sciences) [72]. Complementary training such as leadership development for rehabilitation professionals also may be considered in different contexts (e.g., community, facilities, professional organizations, governments) to promote the right to personal mobility of people with disabilities [73].
Conclusion
Evidence highlights a shortage of education and training in wheelchair service provision in LMICs [21, 22] that results in life complications and secondary health problems related to inappropriate wheelchair provision [14, 21]. The Spanish Hybrid Course proved to be effective in increasing basic level wheelchair knowledge with a high level of satisfaction in a group of wheelchair providers from Colombia. Further research is warranted to evaluate the effectiveness of the Spanish Hybrid Course across different individuals and countries as a tool to build professional capacity in basic level wheelchair provision.
Supporting information
S1 File. Hybrid satisfaction survey–English/Spanish version.
https://doi.org/10.1371/journal.pone.0204769.s001
(PDF)
S2 File. Online and in-person training agenda and learning outcomes.
https://doi.org/10.1371/journal.pone.0204769.s002
(PDF)
Acknowledgments
Authors would like to acknowledge Krithika Kandavel and Universidad CES for their support in coordinating this training and Nancy Augustine for her critical revision of the manuscript.
References
- 1.
World Bank. Disability Inclusion 2018 [cited 2018 Jun 05]. Available from: http://www.worldbank.org/en/topic/disability.
- 2.
Economic Commission for Latin America and the Caribbean (ELAC). Social Panorama of Latin America. Briefing paper. 2012.
- 3.
Worldometers. Latin America and the Caribbean Population 2018 [cited 2018 May 08]. Available from: http://www.worldometers.info/world-population/latin-america-and-the-caribbean-population/.
- 4.
World Bank. World Development Indicators: Population 2016 [cited 2018 April 17]. Available from: http://databank.worldbank.org/data/reports.aspx?source=2&country=LCN.
- 5.
World Bank. Disability in Latin America and the Caribbean—Fact sheet [cited 2018 April 23,]. Available from: http://siteresources.worldbank.org/DISABILITY/Resources/Regions/LAC/LACfactsheetEng.pdf.
- 6.
World Bank. The World Bank In Latin America and the Caribbean 2018 [cited 2018 April 20]. Available from: http://www.worldbank.org/en/region/lac/overview.
- 7.
World Bank. World Bank Country and Leading Groups: Country Classification 2018 [cited 2018 April 20]. Available from: https://datahelpdesk.worldbank.org/knowledgebase/articles/906519-world-bank-country-and-lending-groups.
- 8.
Simons G, Fenning Ce. Ethnologue: Languages of the World 2018 [cited 2018 April 17,]. Available from: https://www.ethnologue.com/browse/countries-quicktabs-browse_the_countries_of_the_worl=2.
- 9.
World Economic Forum. These are the world’s most spoken languages 2018 [cited 2018 August, 01]. Available from: https://www.weforum.org/agenda/2018/02/chart-of-the-day-these-are-the-world-s-most-spoken-languages/.
- 10.
United Nations, Division for Social Policy and Development Disability. Convention on the Rights of Persons with Disabilities (CRPD) New York: United Nations; 2006 [cited 2018 Jan 3]. Available from: https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities.html.
- 11.
Worldometers. Countries in Latin America and the Caribbean: Worldometers. Available from: http://www.worldometers.info/geography/how-many-countries-in-latin-america/.
- 12.
United Nations Treaty Collection. Convention on the Rights of Persons with Disabilities (CRPD): United Nations; 2018 [updated April 17, 2018; cited 2018 April 17]. Available from: https://treaties.un.org/Pages/ViewDetails.aspx?src=TREATY&mtdsg_no=IV-15&chapter=4&clang=_en.
- 13.
Stang-Alva MF. Las personas con discapacidad en América Latina: del reconocimiento jurídico a la desigualdad real. Santiago de Chile: Comisión Económica para América Latina y el Caribe (CEPAL), 2011.
- 14.
World Health Organization. Guidelines on the provision of manual wheelchairs in less resourced settings. Geneva: WHO; 2008.
- 15.
United Nations. The Universal Declaration of Human Rights [cited 2018 April 20]. Available from: http://www.un.org/en/universal-declaration-human-rights/.
- 16. Toro ML, Eke C, Pearlman J. The impact of the World Health Organization 8-steps in wheelchair service provision in wheelchair users in a less resourced setting: a cohort study in Indonesia. BMC Health Serv Res. 2016;16:26. Epub 2016/01/24. pmid:26801984; PubMed Central PMCID: PMCPMC4722611.
- 17. Borg J, Lindstrom A, Larsson S. Assistive technology in developing countries: national and international responsibilities to implement the Convention on the Rights of Persons with Disabilities. Lancet. 2009;374(9704):1863–5. Epub 2009/12/01. pmid:19944867.
- 18. Visagie S, Scheffler E, Schneider M. Policy implementation in wheelchair service delivery in a rural South African setting. Afr J Disabil. 2013;2(1):63. Epub 2013/09/09. pmid:28729993; PubMed Central PMCID: PMCPMC5442587.
- 19. Carver J, Ganus A, Ivey JM, Plummer T, Eubank A. The impact of mobility assistive technology devices on participation for individuals with disabilities. Disabil Rehabil Assist Technol. 2016;11(6):468–77. Epub 2015/03/31. pmid:25815679.
- 20.
Nations United, Division for Social Policy and Development Disability. Convention on the Rights of Persons with Disabilities–Articles. Geneva: United Nations; 2006 [cited 2018 Jan 3]. Available from: https://www.un.org/development/desa/disabilities/convention-on-the-rights-of-persons-with-disabilities/convention-on-the-rights-of-persons-with-disabilities-2.html.
- 21. McSweeney E, Gowran RJ. Wheelchair service provision education and training in low and lower middle income countries: a scoping review. Disabil Rehabil Assist Technol. 2017:1–13. Epub 2017/11/03. pmid:29092684.
- 22. Fung KH, Rushton PW, Gartz R, Goldberg M, Toro ML, Seymour N, et al. Wheelchair service provision education in academia. Afr J Disabil. 2017;6:340. Epub 2017/09/25. pmid:28936415; PubMed Central PMCID: PMCPMC5594266 may have inappropriately influenced them in writing this article.
- 23.
World Health Organization. World Report on Disability. Geneva: 2011.
- 24. Banks LM, Kuper H, Polack S. Poverty and disability in low- and middle-income countries: A systematic review. PLoS One. 2017;12(12):e0189996. Epub 2017/12/22. pmid:29267388; PubMed Central PMCID: PMCPMC5739437.
- 25.
World Health Organization. Wheelchair Service Training Package: Basic Level. Geneva: WHO; 2012.
- 26.
World Health Organization. Wheelchair Service Training Package: Intermediate Level. Geneva: WHO; 2013.
- 27.
World Health Organization. Wheelchair Service Training Package: Managers. Geneva: WHO; 2015.
- 28.
World Health Organization. Wheelchair Service Training Package: Stakeholders Geneva: WHO; 2015.
- 29.
World Health Organization. Wheelchair Service Training of Trainers Package. Geneva: WHO; 2018.
- 30.
Organización Mundial de la Salud. Paquete de Capacitación en Servicicio de Silla de Ruedas: Nivel Básico. Geneva: OMS; 2014.
- 31. IV Simposio Latinoamericano de Posicionamiento en Sentado y Movilidad [cited 2018 May 14]. Available from: http://www.seating.com.ar/es/quienes_somos.php.
- 32.
Dalhousie University. Wheelchair Skills Program 2012 [Mar 01 2018]. Available from: http://www.wheelchairskillsprogram.ca/eng/index.php.
- 33. Burrola-Mendez Y, Goldberg M, Gartz R, Pearlman J. Development of a Hybrid Course on Wheelchair Service Provision for clinicians in international contexts. PLoS One. 2018;13(6):e0199251. Epub 2018/06/16. pmid:29906794; PubMed Central PMCID: PMCPMC6003808.
- 34. Gartz R, Goldberg M, Miles A, Cooper R, Pearlman J, Schmeler M, et al. Development of a contextually appropriate, reliable and valid basic Wheelchair Service Provision Test. Disabil Rehabil Assist Technol. 2016;12(4):333–40. Epub 2016/04/22. pmid:27100362.
- 35. Roach V, Lemasters L. Satisfaction with Online Learning: A Comparative Descriptive Study Journal of Interactive Online Learning. 2006;5(3).
- 36. Naaj M, Nachouki M, Ankit A. Evaluating student satisfaction with blended learning in a gender-segregated environment. Journal of Information Technology Education: Research. 2012;11:185–200.
- 37. Al-Hassan S, Shukri N. The Effect of Blended Learning in Enhancing Female Students’ Satisfaction in the Saudi Context. English Language Teaching. 2017;10(6):190–203.
- 38.
Nemoto T, Beglar D, editors. Developing Likert-scale questionnaires. JALT2013; 2014; Tokio:JALT.
- 39. Tait A, Voepel‐Lewis T. Survey research: it's just a few questions, right? Pediatric Anesthesia. 2015;25(1):656–62.
- 40. Hoffmann TC, Glasziou PP, Boutron I, Milne R, Perera R, Moher D, et al. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide. BMJ. 2014;348:g1687. Epub 2014/03/13. pmid:24609605.
- 41.
World Health Organization. Wheelchair Service Training Package. Trainer’s Manual Basic Level. Geneva: WHO; 2012. 248 p.
- 42. Munera S, Goldberg M, Kandavel K, Pearlman J. Development and evaluation of a wheelchair service provision training of trainers programme. Afr J Disabil. 2017;6:360. Epub 2017/09/25. pmid:28936423; PubMed Central PMCID: PMCPMC5594273.
- 43.
International Classification of Functioning DaH. ICF Workshops 2017 [cited 2018 May 09]. Available from: https://www.icf-research-branch.org/icf-training/icf-workshops.
- 44. Khan F, Amatya B, Mannan H, Burkle FM Jr., Galea MP. Rehabilitation in Madagascar: Challenges in implementing the World Health Organization Disability Action Plan. J Rehabil Med. 2015;47(8):688–96. Epub 2015/07/02. pmid:26132505.
- 45. Khan F, Amatya B, Sayed TM, Butt AW, Jamil K, Iqbal W, et al. World Health Organisation Global Disability Action Plan 2014–2021: Challenges and perspectives for physical medicine and rehabilitation in Pakistan. J Rehabil Med. 2017;49(1):10–21. Epub 2017/01/20. pmid:28101563.
- 46. Khan F, Amatya B, Avirmed B, Yi YK, Shirmen B, Abbott G, et al. World Health Organization Global Disability Action Plan: The Mongolian Perspective. J Rehabil Med. 2018;50(4):388–66. Epub 2017/02/22. pmid:28218340.
- 47.
World Health Organization. WHO Global Disability Action Plan 2014–2021: Better health for all people with disability. 2015.
- 48. O'Sullivan C, Kazibwe H, Whitehouse Z, Blake C. Constructing a Global Learning Partnership in Physiotherapy: An Ireland-Uganda Initiative. Front Public Health. 2017;5:107. Epub 2017/07/01. pmid:28660180; PubMed Central PMCID: PMCPMC5466950.
- 49.
El Congreso de Colombia. Ley Estatuaria 1618 de 2013 [cited 2018 May 12]. Available from: https://discapacidadcolombia.com/phocadownloadpap/LEGISLACION/LEYESTATUTARIA 1618 DE 2013.pdf.
- 50.
International Association for Humanitarian Policy and Conflict Research. Empowerment: Persons with Disabilities Peace building initiative [cited 2018 May 12]. Available from: http://www.peacebuildinginitiative.org/indexd147.html?pageId=1964.
- 51.
Acuerdo final para la terminación del conflicto y la construcción de una paz estable y duradera: Oficina de Alto Comisionado para la Paz; 2016. Available from: http://www.altocomisionadoparalapaz.gov.co/procesos-y-conversaciones/Documentoscompartidos/24-11-2016NuevoAcuerdoFinal.pdf.
- 52. Rincón AR, Gutiérrez RL, Olivera RM, MC V. Lineamientos para el otorgamiento de ayudas técnicas. 2007:107.
- 53. Camargo DA, Lancheros EY, Peñaloza IS, Mora F, Amórtegui DA. Proceso de actualización de las guías del Banco de Ayudas Técnicas 2011 [cited 2018 May 12]. Available from: http://salud.univalle.edu.co/escuelas/rehabilitacion/Logros/Publicaciones/522_proceso_de_actualizacion.pdf.
- 54.
Protocolo Administrativo para la prescripción, seguimiento y control de los Productos de Apoyo en Salud (PAS) para el SSFM DGSM, (11/11/2015, 2015).
- 55. Jaeger R, Halliday T. On confirmatory versus exploratory research. Herpetologica. 1998:S64–S6.
- 56. Moore C, Carter R, Nietert P, Stewart P. Recommendations for Planning Pilot Studies in Clinical and Translational Research. Clinical and translational science. 2011;4(5):332–7. pmid:22029804
- 57. Perneger TV. What's wrong with Bonferroni adjustments. BMJ. 1998;316(7139):1236–8. Epub 1998/05/16. pmid:9553006; PubMed Central PMCID: PMCPMC1112991.
- 58. Camden C, Shikako-Thomas K, Nguyen T, Graham E, Thomas A, Sprung J, et al. Engaging stakeholders in rehabilitation research: a scoping review of strategies used in partnerships and evaluation of impacts. Disabil Rehabil. 2015;37(15):1390–400. Epub 2014/09/23. pmid:25243763.
- 59. Bowen SJ, Graham ID. From knowledge translation to engaged scholarship: promoting research relevance and utilization. Arch Phys Med Rehabil. 2013;94(1 Suppl):S3–8. Epub 2012/11/13. pmid:23141502.
- 60. Hinchcliff R, Greenfield D, J B. Is it worth engaging in multi-stakeholder health services research collaborations? Reflections on key benefits, challenges and enabling mechanisms. International journal for quality in health care 2014;26(2):124–8. pmid:24519121
- 61. Mahler C, Gutmann T, Karstens S, Joos S. Terminology for interprofessional collaboration: definition and current practice. GMS Z Med Ausbild. 2014;31(4):Doc40. Epub 2014/12/10. pmid:25489340; PubMed Central PMCID: PMCPMC4259059.
- 62. Sheldon S, NA J. ISPO consensus conference on wheelchairs for developing countries: Conclusions and recommendations. Prosthetics and Orthotics International. 2007;31(2):217–23.
- 63. Taylor DC, Hamdy H. Adult learning theories: implications for learning and teaching in medical education: AMEE Guide No. 83. Med Teach. 2013;35(11):e1561–72. Epub 2013/09/06. pmid:24004029.
- 64.
Luft J, Ingham H, editors. The JoHari window, a graphic model of interpersonal awareness. Proceedings of the western training laboratory in group development; 1955; Los Angeles, CA: UCLA.
- 65.
Grupo de Gestión en Discapacidad Oficina de Promoción Social. Lineamientos Nacionales de Rehabilitación Basada en la Comunidad (RBC) Ministerio de Salud y Protección Social2014 [cited 2018 May 13]. Available from: https://discapacidadcolombia.com/phocadownloadpap/GOBIERNO/lineamientos-nacionales-rbc.pdf.
- 66. Yarber L, Brownson CA, Jacob RR, Baker EA, Jones E, Baumann C, et al. Evaluating a train-the-trainer approach for improving capacity for evidence-based decision making in public health. BMC Health Serv Res. 2015;15:547. Epub 2015/12/15. pmid:26652172; PubMed Central PMCID: PMCPMC4676893.
- 67. Sullivan GM, Artino JA. Analyzing and interpreting data from Likert-type scales. Journal of graduate medical education. 2013;5(4):541–2. pmid:24454995
- 68. Fullerton JT, Thompson JB, Johnson P. Competency-based education: the essential basis of pre-service education for the professional midwifery workforce. Midwifery. 2013;29(10):1129–36. Epub 2013/08/03. pmid:23906879.
- 69. Goudreau J, Pepin J, Dubois S, Boyer L, Larue C, Legault A. A second generation of the competency-based approach to nursing education. Int J Nurs Educ Scholarsh. 2009;6:Article15. Epub 2009/05/05. pmid:19409071.
- 70.
Schiappa V, Lee-Houser C, Schmeler M, Schein R, Pramana G, Saptono A, editors. Impact of the Assistive Technology Professional (ATP) in the Provision of Mobility Assistive Equipment. The 34th International Seating Symposium; 2018; Vancouver, BC Canada.
- 71. Sullivan GM. A primer on the validity of assessment instruments. J Grad Med Educ. 2011;3(2):119–20. Epub 2012/06/02. pmid:22655129; PubMed Central PMCID: PMCPMC3184912.
- 72. O'Brien L, Broom L, Ullah MM. Outcomes and participant experience of an online train-the-trainer program for Bangladeshi health professionals: a case study evaluation. J Contin Educ Health Prof. 2015;35(1):46–56. Epub 2015/03/25. pmid:25799972.
- 73. Pascal MR, Mann M, Dunleavy K, Chevan J, Kirenga L, Nuhu A. Leadership Development of Rehabilitation Professionals in a Low-Resource Country: A Transformational Leadership, Project-Based Model. Front Public Health. 2017;5:143. Epub 2017/07/12. pmid:28691003; PubMed Central PMCID: PMCPMC5481310.