Figures
Abstract
Introduction
The equitable distribution of medical specialists in Indonesia’s remote areas remains a challenge. This study investigated the preferences of medical specialists regarding retention programs aimed at addressing this issue.
Methods
A Discrete Choice Experiment (DCE) was utilized to collect stated preferences from 341 medical specialist working in district general hospitals across 10 Indonesian provinces. The DCE retention questionnaire focused on eight key characteristics: location, medical facilities, net income, continuing professional development program, security, length of commitment, source of incentives, and caseload.
Results
The study found that the most influential factors for retention in remote areas were security guarantees from the local government (OR = 6.11), fully funded continuing professional development programs (OR = 2.84), and access to advanced medical facilities (OR = 2.35).
Conclusion
The findings indicate that a comprehensive intervention package, with a particular emphasis on security provisions, is necessary to retain medical specialists in remote areas. Financial incentives are also recommended to improve retention. However, it is crucial to acknowledge that no single intervention will suffice, as the factors influencing specialist retention in remote areas of Indonesia are complex and multifaceted.
Citation: Kurniati A, Efendi F, Widowati AR, Simanjuntak A, Mudina S, Ikhwansyah B, et al. (2024) What medical specialists want to stay in remote areas of Indonesia: Discrete choice experiments. PLoS ONE 19(8): e0308225. https://doi.org/10.1371/journal.pone.0308225
Editor: Gilbert Sterling Octavius, Universitas Pelita Harapan, INDONESIA
Received: August 30, 2023; Accepted: July 19, 2024; Published: August 15, 2024
Copyright: © 2024 Kurniati et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data can be found at the figshare repository here https://doi.org/10.6084/m9.figshare.26135611.v1.
Funding: This work was supported by the Ministry of Health Indonesia. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Medical doctors and specialists play an essential role among the larger group of health care workers (HCWs) [1]. However, an uneven distribution of medical specialist can negatively impact the efficiency and sustainability of healthcare systems [2]. Lack of medical specialists or medical doctors is a persistent issue in most remote areas, both regionally and globally, with substantial repercussions for the quality, scope, and equity of access to services [3]. Additionally, it limits local residents’ access to health services [4, 5]. The strategic allocation of medical specialists is crucial for enhancing the effectiveness of the healthcare system and accomplishing important health goals, especially in low- and middle-income countries [6–8]. Many countries have implemented strategies to retain medical specialists in remote areas, but results have varied [9]. While there is international evidence demonstrating the effectiveness of these strategies in diverse economic contexts, from low-income to high-income countries [7, 8, 10], this research focuses on the adaptation and implementation of these strategies in Indonesia’s unique context. Recognizing and understanding local factors is critical to designing successful retention strategies in the Indonesian healthcare landscape.
Despite the World Health Organization (WHO) setting a target doctor-to-population ratio of 1:1,000, more than 44% of WHO Member States reported doctor-to-population ratios that were lower than this benchmark. In other words, there was less than one doctor for every 1,000 people in more than 44% of Member States [11]. Based on the planning of health workers by Indonesia’s Ministry of Health, the target ratio of basic medical specialists includes 0.024 pediatricians per 1,000 population, internal medicine specialists 0.03 per 1,000 population, 0.02 obstetrics and gynecology specialists per 1,000 population, and 0.02 surgeons per 1,000 population. Meanwhile, the target ratio of medical specialists according to the health workforce utilization plan in 2025 is 0.12 per 1,000 people [12]. The ratio shows that the need for medical specialists has not reached the expected target ratio. If we compare the number of registered medical specialists with population and areas by region in Indonesia, it can be seen that the islands of Sumatra, Java-Bali and Sulawesi still have the highest ratios of medical specialists. The ratio of medical specialists to 1,000 people based on region are respectively Sumatra at 0.13, Java-Bali at 0.17, Kalimantan at 0.10, Sulawesi at 0.15, and Maluku-East Nusa Tenggara-Papua at 0.05 [12]. Data shows that the highest ratio is still in the Java-Bali region. This contrast with the situation in eastern Indonesia, which still faces a shortage of medical specialists due to uneven distribution. The overall number of medical specialists in Indonesia in 2021 was 40,320 people. Meanwhile, the need for specialist physicians according to the 2021–2024 national defense system reform is 75,657 people. Based on these data, it has been identified that the shortage of medical specialists was 35,337 people for 2021–2024 [12].
Retention of medical specialists in remote areas remains a challenge in Indonesia. The Indonesian Ministry of Health is committed to accelerating their distribution as mandated in the country’s health transformation [12]. The acceleration of health worker deployment aims to boost workforce capacity, particularly in remote areas where healthcare services remain underserved [12–14]. The crisis for health workers in remote areas risks is hampering national development, especially the target of realizing universal health coverage for all Indonesians [15]. The Indonesian Government has employed various strategies to deploy and retain medical specialists in remote areas, including civil service recruitment, non-permanent employee recruitment, and specialized assignments such as ’Penugasan Khusus’ (special assignment) programs [16]. Another mechanism involves contractual support through the Medical Specialist Education Program for in-country medical specialist education. However, these efforts are temporary and ineffective for long-term medical specialist retention [12].
Another program recently launched by the Indonesian Ministry of Health, the Academic Health System (AHS), aims to integrate the education and health systems [17]. This integration is intended to achieve an even distribution of medical specialists. The government identifies medical specialist needs in specific areas in accordance with certain regulations addressing Hospital Classification, considering factors critical for retention, such as willingness to serve in specific conditions. Mechanisms for appropriately assigning medical specialists include AHS’s integration of Teaching Hospitals, medical faculties, and other institutions, enhancing public health service quality through coordinated education, research, and service delivery, thus addressing regional specialist shortages and improving healthcare access [18, 19].
The issue of medical specialist retention in remote areas needs to be a major focus, particularly for government efforts to achieve universal health coverage. The challenge of retaining medical specialists in remote areas must be a primary focus to attain universal health coverage [20]. Various factors have been reported to impact the decisions of medical specialists to work and thrive in remote areas, encompassing location [21], security [22, 23], medical facilities, income [24], transportation facilities, housing facilities [25], educational support [26], and incentives [14].
Discrete Choice Experiment (DCE) approach has been widely applied in the health sector, particularly to understand the preferences of health workers when making choices between two or more alternatives [27, 28]. Earlier research in Ethiopia [29] utilized DCE to gauge the factors influencing health worker decisions. In Western Kenya [30], a study identified the motivations of community health workers for retention, highlighting both material and non-material incentives. Furthermore, research in Malang district, Indonesia [31], explored the employment preferences of healthcare workers, offering valuable insights for policy interventions. A recent DCE study from Indonesia examines the retention of doctors and dentists in remote areas of Indonesia, exploring factors influencing their decision to stay and strategies to improve retention rates [32]. More specifically, a 2020 study in Turkey focused on job attribute preferences of physicians and nurses, including specialists, employing DCE. The results concluded that these DCE findings could guide policymakers in understanding the characteristics that enhance the motivation of healthcare professionals to work in rural areas in Turkey [33].
Previous research has not discussed the preferences of medical specialists working in remote areas, especially in the Indonesian context. In this study, we aimed to specifically focus on medical specialist preferences for retention in remote areas. By conducting DCE, we seek to address the gaps and limitations identified in previous research and provide a deeper understanding of the factors most favorable to medical specialist retention in remote areas. It is hoped that the results of our research will provide insights into policy options that can be implemented by the government to increase the retention of medical specialists in underserved areas. The results of the current study were expected to describe preferences of medical specialists to be retained in remote areas and provide information for the government regarding policy options that can be implemented. Hence, this study aimed to analyze retention of medical specialists in remote areas using the DCE approach.
Materials and methods
Study design and setting
The research utilized the DCE approach which is a quantitative method for analyzing preferences and job choices of medical specialists [7, 28]. The study was conducted from November 11th to November 24th, 2022, in 10 provinces, with five regencies in each province, as defined by Presidential Decree No. 63 of 2020 regarding the designation of remote areas. Starting from the provinces of East Nusa Tenggara, Maluku, North Sumatra, Papua, West Papua, Central Sulawesi, West Sumatra, North Maluku, Lampung and West Nusa Tenggara. In Indonesia, a regency is an administrative region or administrative subdivision, similar to a county or district in other countries. We collected data at 48 district general hospitals in these provinces for approximately one month. These hospitals were selected to ensure diversity in terms of location and demographics of respondents, allowing for a comprehensive representation of the healthcare landscape in these regions.
Attribute development
The initial step of identifying attributes and levels was carried out through literature review and focus group discussion (FGD). A literature search for studies was conducted through a variety of academic databases namely Scopus, Web of Science, Pubmed, EBSCO, and Proquest using keywords retention AND remote areas AND Discrete Choice Experiment OR DCE AND medical specialist OR specialist physician OR specialist. The DCE attribute was developed by taking into account the indicators of medical specialist retention. The FGD included invited stakeholders such as the Director for Health Worker Empowerment, the National Research and Innovation Agency, the Health Development Policy Agency, the main DCE research team, and invitees. The invitees were representatives of medical specialists who were currently or had previously worked in remote areas for at least one year, comprising a total of five specialists. The FGD involved participants learning about remote health services and ongoing strategies for retaining medical specialists. Following that, participants shared their thoughts on these strategies, drawing on their personal experiences and knowledge. Participants then deliberated on each attribute through collaborative discussions until a consensus was reached for the final version of the DCE attributes. The FGD produced eight attributes, each with 2–3 levels, which were then converted into an instrument study questionnaire. Table 1 provides a more detailed breakdown of research levels and attributes.
DCE design and piloting
The paper-based questionnaire for the DCE retention study was designed using package support.CEs in the R software [34] (Fig 1). Due to the large number of possible combinations, an orthogonal fractional factorial design was used to generate 18 choice sets with two alternatives each [35]. We developed the questionnaire with rigor in mind to overcome the content validity issue based on WHO guideline [36]. A panel of subject matter specialists, including the Director for Health Worker Empowerment, the National Research and Innovation Agency, the Health Development Policy Agency, and medical specialists, carefully examined the original concept. In addition, the 30-health worker pilot test’s objective was to further validate the material by getting feedback on the questionnaire’s attributes and levels’ relevancy and clarity. These steps ensured the validity of the instrument content.
Population and sampling
The research included medical specialists categorized as basic specialists, medical support, other medical specialists, and subspecialists according to the Ministry of Health Regulation No. 30/2019 [37]. The sample consisted of 341 medical specialists working and residing in remote areas, selected through purposive (non-probability) sampling. Direct questionnaires were distributed to medical specialists in 10 selected provinces.
Data analysis
Descriptive statistics.
The respondent profiles were analyzed using descriptive statistics to provide details about their characteristics. Descriptive statistical analysis was relevant to determine the distribution of respondents based on their demographic characteristics.
Conditional logit regression and group analysis.
We utilized conditional logit regression to estimate preferences in the DCE retention questions. The analysis was conducted for the entire sample and also for groups based on placement and employment status. Positive coefficients indicated a preference for a particular attribute level compared to the reference level. Odds ratios (OR) were used to assess the likelihood of liking or disliking attribute levels compared to its reference level.
Willingness to Accept (WTA) analysis.
The WTA analysis was conducted to estimate the compensation medical specialists desired for changes in non-monetary attributes. The Marginal Willingness to Accept (mWTA) values, expressed in Indonesian rupiah (IDR), represent the amount of compensation respondents are willing to accept due to changes in attribute levels. Higher mWTA values indicate a higher compensation that respondents desire for specific attribute levels. The mWTA calculation is based on the assumption of maximizing respondent utility and is expressed as follows [38]:
Ethical clearance
This study received ethical approval from the Faculty of Nursing, Universitas Airlangga ethical committee, ensuring the protection of human rights and welfare in health, under the reference number 2682-KEPK. Participants, all of whom were adults, were fully informed about the study’s objectives, procedures, potential risks, and benefits before their participation. Informed consent was obtained from participants through both verbal and written means. Verbal consent was documented to ensure transparency and understanding. Participants provided their informed consent by signing the informed consent form, thereby indicating their willingness to take part voluntarily.
Results
A total of 341 respondents were spread across 10 remote areas in Indonesia. The profile of respondents is reported in Table 2. It can be seen that the highest number of respondents was from North Sumatra (17.30%). Most (53.96%) were men and 97.07% were graduates of public universities. Almost all (88.27%) were married with two or more children (61.00%). Additionally, 64.52% were not born in rural or remote areas. The majority were civil servants (73.61%) with over five years of work experience (66.57%). Respondents mostly came from one province with 195 placement locations (57.18%). The average age of the respondents was 29–40 years (49.85%). These demographic details laid the foundation for analysis of medical specialist retention factors.
Table 3 presents the estimation results from the conditional logit of medical specialist retention. The results of the analysis showed that of the eight attributes that had been determined, there was one that was not significant, namely the number of cases handled each year. In terms of the location attribute, medical specialists exhibited a preference for non-remote areas over remote areas, with an odds ratio of 0.74. On the attribute of medical facilities, the highest preference regarding attributes of medical facilities was in locations with more than standard medical facilities with an odds ratio of 2.35. In the attribute of incentive sources, respondents had positive preferences for being maintained with all incentives with an odds ratio of 1.95 compared to other incentive. In terms of the continuing professional development program attribute, they exhibit a higher preference for fully funded programs with an odds ratio of 2.84. With regards to the security attribute, medical specialists highly valued security guarantees from the local government with an odds ratio of 6.11. In the length of commitment attribute, medical specialists were unwilling to work in the same place until retirement with an odds ratio of 0.66. The coefficient for net income indeed indicates a positive value, suggesting a preference for the highest monetary income.
Discussion
The study found that the preference of medical specialists to work in remote areas of Indonesia was influenced by various kinds of interventions, both financial and non-financial. Security emerged as the top attribute in this study, with specialists valuing guarantees from both the regional government (OR = 6.1; Coef = 1.8) and local security (OR = 5.3; Coef = 1.7). If assessed based on the mWTA value, medical specialists were willing to pay Rp. 67,650,355 to get a security guarantee from the local government, indicating that security guarantees were highly valued by specialists, so they were willing to spend that amount of money to guarantee their safety. Several studies have also shown that security attributes support the work safety of medical specialists at the individual level [22, 23, 39]. The government has taken steps to address security concerns, introducing the Mandatory Service for medical specialists (Wajib Kerja Dokter Spesialis or WKDS) program in 2017 through Presidential Regulation Number 4 of 2017 [40]. This program not only ensures the welfare of medical specialists but also underscores the importance of their safety and security [41]. However, a healthcare service report in Papua and West Papua provinces (2022) identified security challenges as a persistent issue impacting the willingness of medical specialists to work in remote areas [42, 43]. Despite central government security guarantees, regional regulations and collaboration with local security are crucial in addressing security problems faced by medical specialists in remote areas. Effective security guarantees for medical specialists necessitate collaborative efforts between local governments and security entities, aligning with the broader goal of ensuring the safety of healthcare professionals in remote areas.
Continuing professional development programs were an attribute that was also considered crucial to retaining medical specialists in remote areas. The results of this assessment indicated that medical specialists wanted continuing professional development programs to be fully funded by the Indonesian government (OR = 2.8; Coef = 1.05), compared to having to pay for these themselves. If assessed based on a negative mWTA value, specialists were willing to pay IDR. 39,036,235 to participate in a fully funded program. These results suggest that fully funded programs were highly valued by medical specialists, such that they are willing to spend that amount of money to participate in the program. Continuing professional development programs are seen as important for maintaining competency and improving performance among all health workers in order to provide a quality level of service [23, 44, 45]. Continuing professional development programs can also support medical specialists in remote areas to communicate with each other in maintaining social and professional networks [23, 45]. Medical specialists often have difficulty accessing such programs because they are far from the program location and program organizers. Implementation with digital platforms is also often constrained by technicalities such as unreliable connectivity [46]. The Indonesian Ministry of Health has conducted continuing professional development programs regularly and implemented these in technical units in each province. Activities are also carried out offline, online, or hybrid with several financing categories namely independent, fully funded, and partially funded [47]. The combination of continuing professional development programs and other interventions is expected to increase the retention of medical specialists in remote areas.
Collaborative efforts present a promising solution to these challenges. Previous collaborations, such as the Academic Health System (AHS) jointly implemented by the Ministry of Education, Culture, Research, and Technology in conjunction with the Ministry of Health, aim to expedite capacity and quality improvement in medical faculties. The goal is to produce physicians and medical specialists who can enhance healthcare services [48]. However, specific collaborations focused on enhancing the capacity of medical specialists through Continuous Professional Development (CPD) programs have not been established to date. To address this gap, a potential collaboration with the Ministry of Communication and Information could introduce online CPD programs, ensuring stable and affordable internet access, even in remote areas. Professional organizations, such as the Indonesian Doctors Association (IDI) and other specialist professional organizations can also contribute to successful programs. For example, incorporating these organizations into CPD projects could bring extra resources, expertise, and networks necessary for the implementation. This initiative could be a part of a broader effort to enhance the implementation of CPD programs, reaching all medical specialists, particularly those in underserved regions.
Medical facilities (OR = 2.4; Coef = 0.9) are also an attribute that was sufficiently considered in the retention of medical specialists. The results of this assessment indicate that medical specialists preferred to work in areas with facilities exceeding standard adequacy. If rated based on a negative mWTA value, medical specialists were willing to pay Rp. 31,957,415 to be placed in higher-quality health facilities. This demonstrates that medical specialists valued excellent health facilities and were willing to spend that amount of money to work in facilities with higher standards. Medical facilities are closely related to the quality of care and readiness to practice. Medical specialists without adequate medical facilities will experience limitations in providing health services to patients [24, 49, 50]. In addition, medical facilities can affect people’s confidence in their ability to produce a specified level of performance in disadvantaged areas [31, 49, 50]. The lack of medical facilities in hospitals has an impact on the quality of services provided by medical specialists to patients [51]. Effective problem-solving requires cross-sectoral collaboration, particularly between the Ministry of Health, the Ministry of Home Affairs, and also the regional/subnational government. Simply providing standard facilities and equipment may not sufficiently address the complex challenges faced by medical specialists. Our study emphasizes the need for collaborative initiatives involving multiple stakeholders to achieve comprehensive solutions. It underscores that a holistic approach, involving various government agencies, is essential for retaining medical specialists in Indonesia’s remote locations.
The "hospital-based residency program" recently announced by the Ministry of Health intends to solve Indonesia’s medical specialized shortages and disparity. This program provides specialist medical education program under the hospital oversees with financial support from the central government, and uses a curriculum established with national and international competence to meet high standards. It prioritizes medical specialists from remote areas, with placements based on prioritizing areas after graduation [52]. While this project is critical for increasing the availability and distribution of qualified medical specialists throughout Indonesia, further evaluation is required to assess and ensure their retention in remote areas.
This study provides important insights regarding the retention of medical specialists in remote areas. The strength of this study is its emphasis on aligning retention efforts with existing regulations and analyzing the numerous elements that influence these restrictions. The present approach provides a more comprehensive understanding of the problem than studies that have focused solely on a single aspect. However, it is also crucial to understand the research’s limitations, particularly when non-probability sampling approaches are used. Although this method may make data collecting more effective, it may limit the generalizability of findings to the broader population of medical specialists in remote locations.
Conclusion
Our DCE study highlights the imperative need for a comprehensive intervention package, primarily emphasizing non-financial factors. For instance, medical specialists exhibited preference for non-remote areas, locations with more than standard medical facilities, and fully funded professional development programs. Security guarantees from the local government also emerged as a crucial factor. This strategic combination can significantly contribute to medical specialist retention. The interconnected nature of these interventions, adapted to the local context, forms a holistic approach to address the unique challenges faced by medical specialists in remote areas. We argue that existing regulations should extend beyond utilization considerations to encompass retention aspects within a cohesive policy framework. This study strongly advocates for policies that not only attract but, more importantly, retain medical specialists in remote regions. Looking ahead, future research should explore family-related variables, investigate the educational backgrounds of family members, and explore psychological aspects influencing medical specialists to further refine intervention strategies.
References
- 1.
WHO. Health Workforce [Internet]. 2024 [cited 2024 Jun 16]. Available from: https://www.who.int/teams/health-workforce
- 2. Nurlinawati I, Mujiati M, Efendi F. Factors influencing the retention of specialist doctors in the placement area: realist evaluation approach in the specialist doctor utilization program. Rural Remote Health. 2023;23(2):1–9. pmid:37072252
- 3. Allen P, May J, Pegram R, Shires L. ‘It’s mostly about the job’-putting the lens on specialist rural retention. Rural Remote Health. 2020;20(1):4–10. pmid:32228005
- 4. Williams I, Baird M, Schneider M. Experiences of radiographers working alone in remote locations: A Far North Queensland non-participant observational study. Radiography. 2020;26(4):e284–9. pmid:32386826
- 5. Mohammadiaghdam N, Doshmangir L, Babaie J, Khabiri R, Ponnet K. Determining factors in the retention of physicians in rural and underdeveloped areas: a systematic review. BMC Fam Pract. 2020;21(1):1–23.
- 6. Pagaiya N, Kongkam L, Sriratana S. Rural retention of doctors graduating from the rural medical education project to increase rural doctors in Thailand: a cohort study. Hum Resour Health. 2015;13(1):1–8. pmid:25889590
- 7. Li J, Scott A, McGrail M, Humphreys J, Witt J. Retaining rural doctors: Doctors’ preferences for rural medical workforce incentives. Soc Sci Med. 2014;121:56–64. pmid:25306410
- 8. Gillespie J, Cosgrave C, Malatzky C. Making the case for place based governance in rural health workforce recruitment and retention: Lessons from Canada and Australia. Soc Sci Humanit Open. 2022;6(1):100356.
- 9. Kumar S, Clancy B. Retention of physicians and surgeons in rural areas—what works? J Public Health (Bangkok). 2021;43(4):e689–700. pmid:32140721
- 10.
WHO. The world health report 2006: working together for health. Geneva; 2006.
- 11.
The Global Health Observatory. Density of physicians (per 1000 population). World Health Organization. 2023.
- 12.
MoH. Dokumen Rencana Kebutuhan SDMK. Agency for Development and Empowerment of Human Resources for Health, Center for Planning and Utilization of Human Resources for Health, Indonesia’s Ministry of Health; 2022.
- 13. Darbyshire D, Brewster L, Isba R, Body R, Basit U, Goodwin D. Retention of doctors in emergency medicine: a scoping review of the academic literature. Emerg Med J. 2021 Sep;38(9):663 LP– 672. pmid:34083428
- 14. Koebisch S, Rix J, Holmes M. Recruitment and retention of healthcare professionals in rural Canada: A systematic review. Can J Rural Med. 2020 Apr;25(2):67–78. pmid:32235108
- 15.
Kurniati A., Astari L. D., Efendy F., Haryanto J., Indarwati R., Has E. M. M., et al. Analisis Kebijakan Pemenuhan Pasar Kerja Tenaga Kesehatan di Tingkat Global. Kementrian Kesehatan RI, editor. Jakarta: Badan Pengembangan dan Pemberdayaan SDMK Kemenkes RI; 2020. 104 p.
- 16.
Kemenkes. Penugasan Khusus Tenaga Kesehatan [Internet]. 2023 [cited 2024 Nov 21]. Available from: https://tugsusnakes.kemkes.go.id/index.html
- 17.
Kemenkes. Workshop Implementasi Academy Health System (AHS) [Internet]. 2024 [cited 2024 Nov 18]. Available from: https://yankes.kemkes.go.id/read/824/workshop-implementasi-academy-health-system-ahs
- 18.
MoH. Rencana Aksi Kegiatan Tahun 2020–2024. Agency for Development and Empowerment of Human Resources for Health, Center for Planning and Utilization of Human Resources for Health, Indonesia’s Ministry of Health; 2020.
- 19.
Kemenkes. Pemerataan Dokter Spesialis Lewat Academic Health System. Sehat Negeriku. 2022.
- 20.
Kemenkes. Rencana KinerjaTahunan (RKT) Tahun 2022. Jakarta: Kemenkes; 2022.
- 21. Meliala A, Hort K, Trisnantoro L. Addressing the unequal geographic distribution of specialist doctors in Indonesia: The role of the private sector and effectiveness of current regulations. Soc Sci Med [Internet]. 2013;82(0):30–4. Available from: http://www.scopus.com/inward/record.url?eid=2-s2.0-84875271376&partnerID=40&md5=cd444563b17b6c04a89a3e47ea64ae1c pmid:23453314
- 22.
WHO. Health workforce policy and management in the context of the COVID-19 pandemic response: interim guidance, 3 December 2020. World Health Organization; 2020.
- 23.
WHO. WHO guideline on health workforce development, attraction, recruitment and retention in rural and remote areas: a summary. Geneva: WHO; 2021.
- 24. Okoroafor SC, Osubor MK, Nwachukwu C. Factors influencing attraction and retention of frontline health workers in remote and rural areas in Nigeria: a discrete choice experiment. J Public Health Policy [Internet]. 2022;43(3):347–59. Available from: pmid:35676329
- 25. Naher N, Balabanova D, McKee M, Khan MH, Roy P, Ahmed SM, et al. Absenteeism among doctors in the Bangladesh health system: What are the structural drivers? SSM—Qual Res Heal. 2022;2:100089.
- 26. Nguyen BM, Bounds G. Factors Affecting Specialty Choice Among Doctors Who Received Tuition Scholarships. Fam Med [Internet]. 2019 Mar 1;51(3):276–81. Available from: https://journals.stfm.org/familymedicine/2019/march/nguyen-2018-0252/ pmid:30861083
- 27. Rockers PC, Jaskiewicz W, Wurts L, Kruk ME, Mgomella GS, Ntalazi F, et al. Preferences for working in rural clinics among trainee health professionals in Uganda: a discrete choice experiment. BMC Health Serv Res [Internet]. 2012;12:212. Available from: http://search.ebscohost.com/login.aspx?direct=true&db=mnh&AN=22824497&site=ehost-live pmid:22824497
- 28. Lancsar E, Louviere J. Conducting discrete choice experiments to inform healthcare decision making: A user’s guide. Pharmacoeconomics. 2008;26(8):661–77. pmid:18620460
- 29. Lamba S, Arora N, Keraga DW, Kiflie A, Jembere BM, Berhanu D, et al. Stated job preferences of three health worker cadres in Ethiopia: A discrete choice experiment. Health Policy Plan. 2021;36(9):1418–27. pmid:34313307
- 30. Saran I, Winn L, Kipkoech Kirui J, Menya D, Prudhomme O’Meara W. The relative importance of material and non-material incentives for community health workers: Evidence from a discrete choice experiment in Western Kenya. Soc Sci Med. 2020;246(December 2019):112726. pmid:31869666
- 31. Gadsden T, Sujarwoto S, Purwaningtyas N, Maharani A, Tampubolon G, Oceandy D, et al. Understanding community health worker employment preferences in Malang district, Indonesia, using a discrete choice experiment. BMJ Glob Heal. 2022;7(8):1–9. pmid:35953209
- 32. Kurniati A, Efendi F, Ismawiningsih I, Mulyani N, Zakaria Z, Ambarwati R, et al. Retention of Doctors and Dentists to Serve in Remote Areas in Indonesia: A Discrete Choice Experiment. J Multidiscip Healthc. 2024;17(April):2215–25. pmid:38741922
- 33. İşlek E, Şahin B. What are the job attribute preferences of physicians and nurses in Türkiye? Evidence from a discrete choice experiment. Hum Resour Health. 2023;21(1):52.
- 34.
R Core Team. R: A language and environment for statistical computing. Vienna, Austria; 2017.
- 35. Aizaki H. Basic Functions for Supporting an Implementation of Choice Experiments in R. J Stat Software, Code Snippets. 2012 Sep;50(2 SE-Code Snippets):1–24.
- 36.
Ryan M, Kolstad JR, Rockers PC, Dolea C, Organization WH, Plus C, et al. How to Conduct a Discrete Choice Experiment for Health Workforce Recruitment and Retention in Remote and Rural Areas: A User Guide with Case Studies [Internet]. World Health Organization & CapacityPlus: World Bank. Geneva, D.C.: World Health Organization; 2012. Available from: http://www.who.int/hrh/resources/dceguide/en/index.html
- 37.
Ministry of Health. Peraturan Menteri Kesehatan Nomor 30 Tahun 2019 tentang Klasifikasi dan Perizinan Rumah Sakit. 30 Indonesia; 2019 p. 7–8.
- 38. Gonzalez JM. A Guide to Measuring and Interpreting Attribute Importance. Patient. 2019 Jun;12(3):287–95. pmid:30906968
- 39. Kohrt BA, Jordans MJD, Turner EL, Rai S, Gurung D, Dhakal M, et al. Collaboration With People With Lived Experience of Mental Illness to Reduce Stigma and Improve Primary Care Services: A Pilot Cluster Randomized Clinical Trial. JAMA Netw Open. 2021 Nov;4(11):e2131475–e2131475. pmid:34730821
- 40.
Kemenkes. Peraturan Menteri Kesehatan Nomor 4 Tahun 2017 tentang Perubahan Kedua atas Peraturan Menteri Kesehatan Nomor 52 Tahun 2016 Tentang Standar Tarif Pelayanan Kesehatan Dalam Penyelenggaraan Program Jaminan Kesehatan. 17 2017.
- 41.
Ministry of Health. Pemerintah Penuhi Kebutuhan Masyarakat akan Pelayanan Kesehatan Spesialistik. Sehat Negeriku. 2017.
- 42.
Kolaborasi Masyarakat dan Pelayanan untuk Kesejahteraan (KOMPAK). Kajian Peningkatan Pelayanan Kesehatan Berkualitas Pada Fasilitas Pelayanan Kesehatan Di Provinsi Papua Dan Papua Barat. 2022.
- 43. Riana F. Kemenkes Berharap Tenaga Kesehatan di Daerah Terpencil Digaji 2 Kali Lipat—Nasional Tempo.co [Internet]. 2021 [cited 2023 Feb 14]. Available from: https://nasional.tempo.co/read/1510237/kemenkes-berharap-tenaga-kesehatan-di-daerah-terpencil-digaji-2-kali-lipat
- 44. Hearle D, Lawson S. Continuing Professional Development Engagement—A UK-based Concept Analysis. J Contin Educ Health Prof. 2019;39(4):251–9. pmid:31652173
- 45. Michel-Schuldt M, Dayon MB, Klar RT, Subah M, King-Lincoln E, Kpangbala-Flomo C, et al. Continuous professional development of Liberia’s midwifery workforce—A coordinated multi-stakeholder approach. Midwifery. 2018;62:77–80. pmid:29655008
- 46.
Kominfo. Belum Tersentuh Meski Tak Terpencil [Internet]. 2023 [cited 2023 Feb 14]. Available from: https://www.kominfo.go.id/content/detail/13518/belum-tersentuh-meski-tak-terpencil/0/sorotan_media
- 47.
Kemenkes. Pedoman Umum P2KB Tenaga Kesehatan Republik Indonesia. Jakarta: Kementerian Kesehatan RI; 2020.
- 48.
Kemdikbud. Upaya Pemerintah Akselerasi Peningkatan Kapasitas dan Kualitas Fakultas Kedokteran. Kementerian Pendidikan dan Kebudayaan. 2022.
- 49. Bentley M, Dummond N, Isaac V, Hodge H, Walters L. Doctors’ rural practice self-efficacy is associated with current and intended small rural locations of practice. Aust J Rural Health. 2019 Apr;27(2):146–52. pmid:30957340
- 50. Darkwa EK, Newman MS, Kawkab M, Chowdhury ME. A qualitative study of factors influencing retention of doctors and nurses at rural healthcare facilities in Bangladesh. BMC Health Serv Res. 2015;15(1):344. pmid:26307265
- 51. Mosadeghrad AM. Factors influencing healthcare service quality. Int J Heal policy Manag. 2014 Jul;3(2):77–89. pmid:25114946
- 52.
Kemenkes. Pendidikan Dokter Spesialis Berbasis Rumah Sakit Resmi Diluncurkan Presiden Joko Widodo. Sehat Negeriku. 2024.