http://orcid.org/0000-0003-3289-5745
Figures
Abstract
Background
In this study, we aim to establish the impact of the introduction of the Family Medicine Model patient satisfaction in the Turkish health system.
Methods
We use data on data 69,028 primary health care (PHC) patients over the period 2010–2012. We estimate the impact of the Family Medicine Model in panel regressions with province fixed effects, exploiting the sequential introduction of this health systems transformation across Turkey's 81 provinces. We use principal component analysis to reduce the dimensionality of the data from the European Patients Evaluate General/Family Practice (EUROPEP) patient satisfaction survey, to focus on the fundamental dimensions of patient satisfaction and to decrease the need for multiple hypothesis testing. We identified two key principal components. The first captured primarily information on satisfaction with provider behavior and the second on satisfaction with the organization of care. We then use these two principal components as outcome variables in our panel analysis to estimate the causal impact of the introduction of the Family Medicine Model.
Results
The Family Medicine Model significantly improved patient satisfaction across a range of dimensions. The coefficient results showed a positive and statistically significant impact (p-values<0.05) of the Family Medicine Model on the outcome variables representing the satisfaction dimensions clinical behaviour and the organization of care even after controlling for calendar time fixed effects.
Conclusions
The introduction of the Family Medicine Model in Turkey, which was primarily aimed at achieving universal health coverage goals, substantially improved patient satisfaction. This study provides some of the first national-level evidence that the introduction of a Family Medicine Model can substantially improve patient satisfaction.
Citation: Sparkes SP, Atun R, Bӓrnighausen T (2019) The impact of the Family Medicine Model on patient satisfaction in Turkey: Panel analysis with province fixed effects. PLoS ONE 14(1): e0210563. https://doi.org/10.1371/journal.pone.0210563
Editor: Oathokwa Nkomazana, University of Botswana Faculty of Medicine, BOTSWANA
Received: August 28, 2017; Accepted: December 27, 2018; Published: January 30, 2019
Copyright: © 2019 Sparkes et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data are from the Ministry of Health of the Republic of Turkey, General Directorate for Health (Project Reference no. A.4.4.1/ SAGEM/17). These secondary data were collected by the Turkey Ministry of Health. A request for these data to be shared can be made to the Ministry of Health of the Republic of Turkey, General Directorate for Health (Project Reference no. A.4.4.1/ SAGEM/17), in the same way that I was able to receive access to the data. A request for these data can be made to: E-mail: sagem.satinalma@saglik.gov.tr or Tel: +90 312-585 68 00.
Funding: The authors received no specific funding for this work.
Competing interests: Rifat Atun has acted as an adviser and a consultant to the Ministry of Health of the Republic of Turkey, including in the Health Transformation Program, and has undertaken consulting assignments in Turkey for the Ministry of Health of the Republic of Turkey, WHO, and the World Bank. Susan Sparkes has acted as a consultant to the World Bank, and in that capacity worked with the Ministry of Health of the Republic of Turkey to draft a report on the political economy of the Health Transformation Program. The researchers did not receive funding for this study. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Abbreviations: EUROPEP, European Patients Evaluate General/Family Practice; PC1, Principal Component 1; PC2, Principal Component 2; PHC, Primary Health Care; TPSHSS, Turkey Patient Satisfaction with Health Services Survey
Introduction
Patient satisfaction is central to assessing the performance of primary health care (PHC) and how that care responds to needs, where preventive services and most care for chronic illness is delivered [1]. While population health outcomes and financial risk protection are objective measures of health system performance, patient satisfaction relies on subjective assessments of the health system by patients, reflecting the perceived fulfillment of their needs and desires through the use of healthcare services [2–4]. Improvement in patient satisfaction is important because of its intrinsic value, its instrumental function in improving retention and adherence amongst patients, and also its indication of public support for health policy and policy makers [5–9]. Yet, there are no studies that have established the causal impacts of health systems changes and transformation on patient satisfaction. Rather, research on patient satisfaction has correlated different types of health systems or socio-demographic characteristics with varying levels of patient satisfaction [2, 10–17].
In this study, we estimate for the first time the causal impact of a major health system transformation–the so-called Family Medicine Model, a family medicine-centred PHC transformation of the Turkish health system–on patient satisfaction. To this end, we use province fixed effects panel analysis applied to provincially-representative panel data on a range of patient satisfaction outcomes in Turkey over the period 2010–2012. The introduction of the Family Medicine Model was part of Turkey’s broader Health Transformation Programme (2003–2012) aimed at achieving universal health coverage [18]. Unlike the other elements of this national health transformation, the Family Medicine Model was introduced sequentially across the 81 provinces in Turkey between 2005 and 2011 [18].
One of the primary motivations behind the Family Medicine Model was to improve patient satisfaction [18–20]. PHC in Turkey was underfunded relative to secondary and tertiary care, and consequently facilities lacked adequate human and operational resources, as well as necessary equipment and supplies [21, 22]. As a result, PHC was characterised by long waiting times, poor quality and low levels of utilization [23].
Turkey’s Family Medicine Model consisted of five specific policy interventions. First, the Ministry of Health dedicated additional financial resources to PHC. Between 2002 and 2007 alone, expenditures on PHC and preventive services tripled [23]. Second, the Ministry of Health created a new designation for general practitioners by requiring an additional ten-day training program in family medicine. Upon completion of this training, these physicians were categorized as family medicine specialists. Third, these newly trained family medicine specialists were contracted for two-years using a mixed provider payment system. The new payment system combined per capita remuneration with performance-related pay, which rewarded good performance regarding 3 maternal and child health indicators and 35 service delivery indicators [22]. Under this mixed payment system, remuneration of family medicine specialists could be reduced by 20% if they failed to meet performance targets and their contracts could be terminated if they did not keep their enrolled patient list above 1,000 [22, 24]. Fourth, every Turkish citizen was enrolled as a patient of a named family medicine specialist. Patients could exercise choice to select their family medicine specialist. As a result, family medicine specialists faced incentives to both attract patients and ensure that patients on their lists did not switch to a different family physician. Fifth, the Ministry of Health increased the number of PHC facilities, and transformed them into family medicine centers, to expand coverage in underserved areas of the country, namely rural areas and south east Turkey [25].
As it was initially envisioned by policymakers, family medicine specialists were supposed to act as gatekeepers to the secondary and tertiary care services. However, the gatekeeping component of the reform was abandoned due to political opposition [19] and individuals could continue to bypass PHC services to seek care directly at hospitals and specialty clinics
While other studies have compared average patient satisfaction ratings with PHC services in Turkey between 2010 and 2012, as well as with the broader health systems transformation [26–29], the analysis presented in this paper shows for the first time how these average levels changed as a result of a specific intervention–the Family Medicine Model. For this purpose, we use a quasi-experimental approach to causal impact estimation–panel analysis with province fixed effects–which allows us to control results for all time-invariant province-level confounders of the relationship between the exposure (the Family Medicine Model) and satisfaction outcomes.
Methods
Intervention exposure
As of December 2009 (EUROPEP-Turkey Patient Satisfaction with Health Services Survey (EUROPEP-TPSHSS) 2010), 40 of Turkey’s 81 provinces had fully implemented the Family Medicine Model and the remaining 41 provinces introduced it after December 2009 (Fig 1). By December 2010 (EUROPEP-TPSHSS 2011 and 2012) all 81 provinces in Turkey had fully implemented the Family Medicine Model (Fig 1) [30]. The period of time between introduction and full implementation is six months, as determined by the Turkish Ministry of Health. Of the 41 provinces that introduced the Family Medicine Model after December 2009, eight provinces began introducing it between December 2009 and June 2010, when the baseline survey data was collected (five provinces in January 2010, two in April 2010, and one in May 2010) [31].
Outcomes data and variables
The outcomes data for this analysis were derived from three provincially-representative EUROPEP-TPSHSS. The Ministry of Health of the Republic of Turkey, General Directorate for Health Data oversaw data collection efforts and received related ethics approval (Project Reference no. A.4.4.1/ SAGEM/17). Oral consents of the patients willing to participate in the study were taken. These surveys used the EUROPEP Patient Satisfaction Scale, which consists of 23 standard and internationally comparable questions asking patients to make assessments of general practice care (see Table 1 for individual questions) [12, 32–34]. The sampling frame for the EUROPEP-TPSHSS included family practice centres in all 81 Turkish provinces in each of the three years 2010, 2011 and 2012. The list of these facilities was provided by provincial health directorates. The EUROPEP-TPSHSS used a multi-step random sampling approach to ensure representativeness at both the national and provincial levels. In the first step, 1,501 primary health care facilities (including both health centres and Family Medicine Units) were randomly selected from a list of local health directorates. Next, primary care facility-days were randomly selected among the selected facilities and every second patient visiting the practices on the selected days was interviewed [27]. An interview-based approach was used so as to ensure no bias was introduced due to literacy issues amongst lower socio-economic groups using the facilities. To reduce bias introduced by this in-person approach, each province trained expert pollsters to administer the survey questionnaire [33]. The data forms a provincially-representative panel data set [35]. Oral consents of the patients willing to participate in the study were taken.
The outcome data for our analysis comes from the answers to the questions in the EUROPEP-TPSHSS. The responses for satisfaction outcomes were categorical and were coded on a five-point Likert scale: “very bad/very dissatisfied” (1), “bad/dissatisfied” (2), “neither/neutral” (3), “good/satisfied” (4), and “very good/very satisfied” (5). We used principal component analysis to reduce the dimensionality of the EUROPEP patient satisfaction survey data [36]–to focus the analysis on a few fundamental dimensions of patient satisfaction and to decrease the need for multiple hypothesis testing using all of the 23 patient satisfaction outcomes contained in the dataset (see S1 Appendix) [6, 7, 37–41]. We used an orthogonal (varimax) rotation in the principal component analysis. To decide how many principal components to extract, we used the Kaiser criterion selecting principal components with eigenvalues of 1.0 or higher [42].
Analysis
The staggered introduction of the Family Medicine Model across Turkish provinces over time (Fig 1) allows us to employ province fixed effects in our panel analysis of the Family Medicine Model on patient satisfaction in Turkey [43–45]. The province fixed effects control for all–observed and unobserved–time-invariant province-level confounders of the relationship between the exposure (the Family Medicine Model) and patient satisfaction. Such province-level confounders include stabile cultural preferences, the influences of location and geography, and long-term infrastructure.
All models were estimated using the statistical software package, Stata 13.0 [46]. With principal components as outcome variables, we used ordinary least squares (OLS) models in the fixed effects estimation (STATA command reg). We also used an ordered-logit model (STATA command ologit) to estimate the results for the 23 individual estimations (analysis 1) [47].
Control variables
The province fixed effects in our analysis controlled for confounding on both all observed and all unobserved time-invariant province-level characteristics, such as geographical location, infrastructure, and local culture [48]. Additionally, we controlled for a range of potential time-varying observed confounders at the individual level–respondent’s age, sex, education, and place of residence (rural versus urban)–which have all been found to be important determinants of patient satisfaction previous studies [7, 16]. Finally, we controlled for secular trends in patient satisfaction through calendar time fixed effects. All error terms were clustered at the facility level.
Samples and sensitivity analyses
Inclusion criteria for the EUROPEP-TPSHSS were patients visiting family practice centres, aged 18 or above, and able to answer all questions. The sample size was calculated using the square root sampling methods based on city population, urban/rural population, and male/female population ratios. Importantly, effective sample sizes were always greater than the minimum calculated for representativeness at the provincial-level in Turkey [27].
Of the total 101,903 EUROPEP-TPSHSS survey respondents (34,472 respondents in 2010, 34,764 respondents in 2011, and 32,667 respondents in 2012), 32,875 did not answer one or more survey questions. We first conducted our analyses using the sample of respondents who answered all 23 patient satisfaction questions in the EUROPEP-TPSHSS (69,028). This sample had the advantage of remaining the same when we used different satisfaction questions as outcome variables, ensuring that differences across the fixed effects estimations were entirely due to the different outcomes and not due to different samples. We used this sample to carry out the principal component analysis, and the fixed effect estimation using the principal components representing the data. We also used each of the 23 individual survey questions as outcome variables in separate fixed effects analysis. We conducted the additional analyses to test the robustness of our findings by using different sample sizes, imputing missing values, and reassigning the eight provinces that had partially introduced the Family Medicine Model between January 2010 and May 2010 to the set of control provinces. All three analyses confirmed our results, with both effect sizes and determinations of significance essentially unchanged (see S2 Appendix).
Results
Table 1 shows summary statistics of the independent variables for the survey population in 2010, 2011 and 2012 respectively. At baseline, average patient ratings in intervention provinces were between “neutral” (3) and “satisfied” (4) for eight indicators and between “satisfied” (4) and “very satisfied” (5) for 15 indicators. Between 2010 and 2012, an increasing proportion of respondents indicated high satisfaction ratings (“satisfied” or “very satisfied”) across all survey questions and for the estimated principal components.
Principal component analysis
The first two components identified in the principal component analysis (with Eigen value >1.0) explained 65% of the total variance in the patient satisfaction data (principal component 1 (PC1) explains 49% and principal component 2 (PC2) explains 16%). Variables that loaded heavily (≥15%) on PC1 captured different aspects of satisfaction with healthcare workers’ clinical behaviour, such as “listening to you” and “physical examination” (survey questions 1 through 17). Variables that loaded heavily (≥15%) on PC2 captured satisfaction with the processes and policies affected by the organization of care in PHC facilities operates, such as “getting an appointment to suit you” and “waiting times” (survey questions 17 through 23) (see Table a in S1 Appendix for factor loading results). These two dimensions of patient satisfaction are the same as those identified by the researchers who developed and applied the EUROPEP survey in 16 European countries, and in line with this earlier study we interpret PC1 as a measure of patient satisfaction with clinical behaviour and PC2 as a measure of patient satisfaction with organization of care [32, 36]
Fixed effects estimations: Principal components of patient satisfaction
Table 2 presents the results of the province fixed effects panel estimations models using PC1 (satisfaction with clinical behaviour) and PC2 (satisfaction with organization of care) as outcome variables. The results that included the calendar time fixed effects were the more conservative estimates because they controlled for any variability related to time. The coefficient results showed a positive and statistically significant impact (p-values<0.05) of the Family Medicine Model on the outcome variables even after controlling for calendar time fixed effects. We found that the Family Medicine Model led to a significant increase in patient satisfaction with both clinical behaviour (PC1) and the organization of care (PC2).
Patient satisfaction principal components.
Fixed effects estimations: Satisfaction questions
Fig 2 shows the results of the province fixed effects panel estimations using the 23 individual patient satisfaction questions as outcome variables. The Family Medicine Model had a positive impact on patient satisfaction (Fig 2). The adjusted odds ratios for the outcome variables with statistically significant (18 of 23 outcome variables) results (p-values<0·05) ranged from 1·46 to 2.33, i.e. the introduction of the Family Medicine Model increased patient satisfaction ratings on average by about one and a half to two categories on the Likert scale of satisfaction categories for 18 of the 23 EUROPEP question outcomes. When using a stricter Bonferroni-adjusted threshold for significance due to multiple hypothesis testing (p-value<0.002), 11 of the 23 outcome variables have statistically significant results with coefficients ranging from 1.37 to 2.33 [49].
Individual patient satisfaction questions.
Discussion
Our results show that a major transformation of a health system–the introduction of a Family Medicine Model in Turkey–substantially improved patient satisfaction across a wide range of dimensions. These findings are the first causally strong impact size estimates of the impact of a major national health system transformation on patient satisfaction.
Our findings are consistent with those of other studies that have found high average levels of reported satisfaction with health services in Turkey between 2010 and 2012. Using the EUROPEP-TPSHSS, Aktürk, Ateşoğlu, and Çift (2015) find that on average 88.3% of users of PHC facilities were satisfied with the services they received [27]. Bulut and Oguzoncul (2014) use the same data to examine differences in satisfaction rates with the Family Medicine Model between socioeconomic groups in a single province. They found that on average males, those who had completed secondary school education, farmers, and patients with incomes between 1,001–2,500 Turkish Lira reported significantly higher rates of satisfaction as compared to other respondents [28]. Through a cross-sectional study conducted between October 2011 and January 2012, Jadoo et al (2014) observed that more than two-thirds of respondents believed that the Health Transformation Programme had a positive impact on Turkey’s health system [29]. While these studies provide information on average satisfaction levels, they differ from our study in two critical ways. First, they do not causally examine the impact of the Family Medicine Model on satisfaction levels. Second, they treat individual satisfaction-related questions individually, and do not conduct principal component analysis to provide summary indicators to measure satisfaction.
Our quasi-experimental approach demonstrates the power of province fixed effects analysis in answering important health system questions. The combination of the step-wise rollout of the Family Medicine Model with province panel data generated from patient exit surveys allowed us to estimate causal impacts of the intervention on patient satisfaction. This approach to causal inference is a powerful analytical strategy whenever national health systems reforms are introduced sequentially over time across different sub-national communities (e.g. states, provinces or districts).
In addition to contribution to evidence, our results are particularly important for Turkey’s policymakers and citizens. Our findings demonstrate that the Ministry of Health was successful in achieving one of the primary objectives of the Family Medicine Model–improved patient satisfaction and quality perceptions–and as a result translated aspirations of “people-centred health systems” into practice. This successful implementation contributed to continued political support for the political party spearheading the transformation effort [20]. Additional studies have pointed to some weak points in terms of implementation, including coordination or care and ability to fully enroll all Turkish citizens with a family medicine practitioner, which points to the need for continued investment in ensuring the system meets patient needs [50].
Another way to use the results of this study is to inform policymakers on how to change healthcare seeking behaviour of patients. Access can be viewed as the “degree of fit” between patient expectations and the health system or “responsiveness” of a health system [4, 41]. Patient satisfaction captures important dimensions of this fit or responsiveness, and is a key link between access and actual utilization of care. To even better understand how this fit can be maintained, it will be useful to study the mechanisms linking the Family Medicine Model with satisfaction.
In this study, we evaluate the Family Medicine Model as a whole and thus cannot infer which particular component of the changes were responsible for increased patient satisfaction. Future research, including qualitative interviews with patients and health workers and participant observation, may elucidate further the mechanisms transmitting the impact of the Family Medicine Model on patient satisfaction.
Limitations
There are important limitations to our analysis. Unobserved patient confounding factors could have biased our causal impact estimates. For instance, we cannot control perfectly control for patient health care need or those patients that chose not to seek care in PHC settings in the analysis. However, major changes in treatment need over a three-year period and on a national scale are unlikely, and, to a large extent, need will have been constant. An additional limitation is that the EUROPEP-TPSHSS questions are not anchored to a common reference point and may thus not be completely comparable across individuals and time. We control for a wide range of individual-level confounders, which have been shown to systematically affect patient satisfaction scores across a given population [38, 51]. The time period to analyse the implementation impact was also short given data availability, which limits the ability to assess the sustained impact of the reform on patient satisfaction. Therefore, the results relate to the immediate implementation impact and not how it changed over time. There is no data available for patients that refused to respond to the survey, which could introduce bias in the case that they were patients that tended to be more dissatisfied with the services they received. However, there is not a clear indication that this would be systematic bias given these patients may also want to complain if they had a strongly negative experience. As noted above, this paper does not assess the actual package of services or reforms that were introduced as part of the Family Medicine Model. Rather, it examines the totality of these interventions in the context of the HTP reform implementation.
Conclusions
The analysis presented in this paper shows that the Family Medicine Model in Turkey improved patient satisfaction across a range of satisfaction indicators. This study provides the first causally strong evidence that a major health systems transformation–the introduction of a Family Medicine Model–can increase patient satisfaction. Policy makers seeking to improve patient satisfaction through health system transformation should consider primary care approaches with elements similar to those used in Turkey’s transformation initiative.
Supporting information
S1 Appendix. Methodological notes on principal components analysis.
https://doi.org/10.1371/journal.pone.0210563.s001
(DOCX)
S1 Data. Dataset to replicate econometric analysis.
https://doi.org/10.1371/journal.pone.0210563.s003
(DTA)
Acknowledgments
We would like to thank the Ministry of Health of the Republic of Turkey for supplying the Turkish Patient Satisfaction with Health Service Survey data analyzed in this paper. We would also like to acknowledge the input and guidance received from Professor Michael Reich and Professor Marc Roberts in conceptualizing this paper.
References
- 1.
World Health Organization. The Ljubljana Charter on Reforming Health Care. Copenhagen: Regional Office for Europe, 1996.
- 2. Chimbindi N, Bärnighausen T, Newell M-L. Patient satisfaction with HIV and TB treatment in a public programme in rural KwaZulu-Natal: evidence from patient-exit interviews. BMC Health Services Research. 2014;14(32).
- 3.
Roberts M, Hsiao W, Berman P, Reich MR. Getting Health Reform Right: A Guide to Improving Performance and Equity. New York: Oxford University Press; 2004.
- 4.
World Health Organization. The World Health Report 2000—Health Systems: Improving Performance. Geneva: World Health Organization, 2000.
- 5.
Silva Ad. A Framework for Measuring Responsiveness. World Health Organization.
- 6. Roberts RE, Pascoe GC, Attkisson CC. Relationship of service satisfaction to life satisfaction and perceived well-being. Evaluation and Program Planning. 1983;6:373–83. pmid:10267264
- 7. Pascoe GC. Patient satisfaction in primary health care: A literature review and analysis. Evaluation and Program Planning. 1983;6(3–4):185–210. pmid:10299618
- 8.
Donabedian A. Explorations in Quaity Assessment and Monitoring: Vol I. The Definition of Quality and Approaches to its Assessment. Ann Arbor, MI: Health Administration Press; 1988.
- 9. Peltzer K. Patient experiences and health systems responsiveness in South Africa. BMC Health Services Research. 2009;9(117).
- 10. Bleich SN, Özaltin E, Murray CJL. How does satisfaction with the health-care system relate to patient experience? Bulletin of the World Health Organization. 2009;87(4):271–8. pmid:19551235. Language: English. Entry Date: 20090612. Revision Date: 20091218. Publication Type: journal article.
- 11. Xesfingi S, Vozikis A. What shapes patient’s satisfaction in countries’ health care systems? 2014.
- 12. Grol R, Wensing M, Mainz J, Jung HP, Ferreira P, Hearnshaw H, et al. Patients in Europe evaluate general practice care: an international comparison. British Journal of General Practice. 2000;50:882–7. pmid:11141874
- 13. Bjertnaes OA, Lyngstad I, Malterud K, Garratt A. The Norwegian EUROPEP questionnaire for patient evaluation of general practice: data quality, reliability and construct validity. Family Practice. 2011;28(3):342–9. pmid:21078822
- 14. Penchansky R, Thomas JW. The Concept of Access: Definition and Relationship to Consumer Satisfaction. Medical Care. 1981;19(2):127–40. pmid:7206846
- 15. Atkinson S, Haran D. Individual and district scale determinants of users' satisfaction with primary health care in developing countries. Soc Sci Med. 2005;60(3):501–13. pmid:15550299.
- 16. Hekkert KD, Cihangir S, Kleefstra SM, van den Berg B, Kool RB. Patient satisfaction revisited: a multilevel approach. Social Science & Medicine. 2009;69(1):68–75. pmid:19446942.
- 17. Young GJ, Meterko M, Desai KR. Patient Satisfaction with Hospital Care: Effects of Demographic and Institutional Characteristics. Medical Care. 2000;38(3):325–34. pmid:10718357
- 18. Atun R, Aydın S, Chakraborty S, Sümer S, Aran M, Gürol I, et al. Universal health coverage in Turkey: enhancement of equity. The Lancet. 2013;382(9886):65–99. http://dx.doi.org/10.1016/S0140-6736(13)61051-X.
- 19.
Bump JB, Sparkes SP, Tatar M, Çelik Y. Turkey on the Way to Universal Health Coverage Through the Health Transformation Program (2003–13). Washington, DC: World Bank, 2015.
- 20. Sparkes S, Bump J, Reich M. Political Strategies for Health Reform in Turkey: Extending Veto Point Theory. Health systems & Reform. 2015;1(4).
- 21.
Savas BS, Karahan O, Saka RO. Turkey Health System Review. Copenhagen: WHO, 2002.
- 22.
Akdağ R. Turkey Health Tranformation Program Evaluation Report 2003–2010. Ankara: Ministry of Health, 2011.
- 23.
Organization for Economic Cooperation and Development, World Health Organization, World Bank. OECD Reviews of Health Systems: Turkey. Paris: OECD, 2008.
- 24.
Johansen A, Guisset A-L. Successful Health Systems Reforms: The Case of Turkey. Copenhagen: World Health Organization Europe, 2012.
- 25.
Republic of Turkey Ministry of Health. The Ministry of Health of Turkey Health Statistics Yearbook 2012. In: Research GDoH, editor. Ankara2013.
- 26.
Stokes J. The effect of Turkish health system reforms 2003–2012 on user satisfaction. London: Imperial College London; 2013.
- 27. Aktürk Z, Ateşoğlu D, Çiftçi E. Patient satisfaction with family practice in Turkey: Three-year trend from 2010 to 2012. European Journal of General Practice. 2015:1–8.
- 28. Bulut A, Oguzoncul AF. Evaluating the level of satisfaction of patients utilizing first-level health facilities as a function of health system performance rating in the province of Elazig, Turkey. Patient preference and adherence. 2014;8:1483. pmid:25414572
- 29. Jadoo SAA, Aljunid SM, Sulku SN, Nur AM. Turkish health system reform from the people’s perspective: a cross sectional study. BMC health services research. 2014;14(1):30.
- 30. Cesur R, Güneş PM, Tekin E, Ulker A. The value of socialized medicine: The impact of universal primary healthcare provision on mortality rates in Turkey. Journal of Public Economics. 2017;150:75–93.
- 31.
World Bank. Turkey—Performance based contracting scheme in family medicine: design and achievements. Washington, DC: World Bank, 2013 Contract No.: Working Paper 77029.
- 32. Wensing M, Vedsted P, Kersnik J, Peersman W, Klingenberg A, Hearnshaw H, et al. Patient satisfaction with availability of general practice: an international comparison. International Journal for Quality in Health Care. 2002;14(2):111–8. pmid:11954680
- 33.
Mollahaliloglu S, Kosdak M, Sanisoglu Y, Boz D, Demgrok AB. Patient Satisfaction with Primary Health Care. Ankara: Republic of Turkey, Ministry of Health, Refik Saydam Hygiene Center Presidency, School of Public Health, 2010.
- 34. Wensing M, Baker R, Szecsenyi J, Grol R, Group E. Impact of national health care systems on patient evaluations of general practice in Europe. Health Policy. 2004;68(3):353–7. pmid:15113646
- 35. Deaton A. Panel data from time series of cross-sections. Journal of Econometrics. 1985;30(1–2):109–26. http://dx.doi.org/10.1016/0304-4076(85)90134-4.
- 36. Wensing M, Mainz J, Grol R. A standardised instrument for patient evaluations of general practice care in Europe. European Journal of General Practice. 2000;6(3):82–7.
- 37. Vyas S, Kumaranayake L. Constructing socio-economic status indices: how to use principal components analysis. Health Policy and Planning. 2006;21(6):459–68. pmid:17030551
- 38. Ware JE Jr., Snyder MK. Dimensions of Patient Attitudes regarding Doctors and Medical Care Services. Medical Care. 1975;13(8):669–82. pmid:1152557
- 39. Ware JE Jr, Snyder MK, Wright WR, Davies AR. Defining and measuring patient satisfaction with medical care. Evaluation and Program Planning. 1983;6(3–4):247–63. pmid:10267253
- 40. Linder-Pelz S. Toward a theory of patient satisfaction. Social Science & Medicine. 1982;16(5):577–82.
- 41. Thomas JW, Penchansky R. Relating Satisfaction with Access to Utilization of Services. Medical Care. 1984;22(6):553–68. pmid:6738145
- 42. Jeffers JNR. Two Case Studies in the Application of Principal Component Analysis. Journal of the Royal Statistical Society Series C (Applied Statistics). 1967;16(3):225–36.
- 43. Imbens GW, Wooldridge JM. Recent Developments in the Econometrics of Program Evaluation. Journal of Economic Literature. 2009;47(1):5–86.
- 44.
Wooldridge JM. Econometric Analysis of Cross Section and Panel Data, Second Edition. Second Edition ed. Cambridge, MA: Massachusetts Institute of Technology; 2010.
- 45. Rockers P, Rottingen J, Shemilt I, Tugwell P, Bärnighausen T. Inclusion of quasi-experimental studies in systematic reviews of health systems research. Health Policy. 2015;119(4):511–21. pmid:25776033
- 46.
StataCorp. Stata Statistical Software: Release 11. College Station, TX: StataCorp LP; 2012.
- 47.
Dobson AJ, Barnett A. An Introduction to Generalized Linear Models, Third Edition Florida: Chapman & Hall/CRC Texts in Statistical Science; 2008.
- 48. Sitzia J. How valid and reliable are patient satisfaction data? An analysis of 195 studies. Int J Qual Health Care. 1999;11(4):319–28. pmid:10501602.
- 49.
Bland JM, Altman DG. Multiple significance tests: the Bonferroni method1995 1995-01-21 08:00:00. 170 p.
- 50. Öcek ZA, Çiçeklioğlu M, Yücel U, Özdemir R. Family medicine model in Turkey: a qualitative assessment from the perspectives of primary care workers. BMC Family Practice. 2014;15(1):38. pmid:24571275
- 51. Sitzia J, Wood N. Patient satisfaction: A review of issues and concepts. Social Science & Medicine. 1997;45(12):1829–43. http://dx.doi.org/10.1016/S0277-9536(97)00128-7.