This randomized controlled trial investigated whether a patient-centered supportive counseling intervention comprising monthly telephone-based counseling sessions by practice nurses over 12 months improved diabetes-related medical and psycho-social outcomes above usual care in type 2 diabetes patients with poor glycemic control at baseline (HbA1c >7.5%) in a primary care setting.
Patients were individually randomized into intervention (n = 103) and usual care group (n = 101). The primary outcome was change in HbA1c-concentration after 12 and 18 months. Secondary outcomes were lipid levels, blood pressure, health-related quality of life and symptoms of depression. Follow-up-measurements were carried out after 6, 12 and 18 months to assess potential immediate and maintained effects of the intervention. For the multivariate analysis, hierarchical linear models were computed for each outcome to assess within-group changes in outcomes over time and between-group differences in patterns of change.
HbA1c (in %) decreased significantly from baseline to 12-month follow-up measurement both in the intervention (−0.44) and the usual care group (−0.51), but there was no significant between-group intervention effect. Significant improvements in the intervention group along with significant between-group differences were seen for health-related quality of life and, transiently, for systolic blood pressure and depression.
Although we found no beneficial effect of the supportive telephone counseling in terms of a reduction of HbA1c above usual care, our findings suggest some beneficial effects on cardiovascular risk factors, quality of life and depression. Continuous efforts might be needed to sustain improvements in patient outcomes.
Citation: Mons U, Raum E, Krämer HU, Rüter G, Rothenbacher D, Rosemann T, et al. (2013) Effectiveness of a Supportive Telephone Counseling Intervention in Type 2 Diabetes Patients: Randomized Controlled Study. PLoS ONE 8(10): e77954. doi:10.1371/journal.pone.0077954
Editor: Hamid Reza Baradaran, Iran University of Medical Sciences, Iran (Republic of Islamic)
Received: May 27, 2013; Accepted: August 31, 2013; Published: October 30, 2013
Copyright: © 2013 Mons et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was supported by a grant of the German Federal Ministry of Education and Research (01GX0746). The funding body had no role in the study design, the collection, analysis or interpretation of the data, the writing of the manuscript, or on the decision to submit the paper for publication.
Competing interests: The authors have declared that no competing interests exist.
Type 2 diabetes mellitus is a highly prevalent chronic disease especially in developed countries, and predictions indicate that prevalence will continue to increase worldwide . In Germany, the overall prevalence of diabetes mellitus is around 7 to 9% , , and between 80 and 90% of these cases are type 2 . Type 2 diabetes mellitus is associated with a high burden of related co-morbidities and complications, curtailing quality of life and increasing the risk of premature mortality , , and thus leading to considerable economic and health care costs . The public health and economic burden associated with type 2 diabetes mellitus and related complications underlines the need for high quality diabetes care to sustainably improve patient health outcomes.
In order to achieve good glycemic control and to avoid complications, key components of outpatient diabetes care comprise patient-centered chronic disease management and support of patient self-management –. General practitioners (GPs) are central in chronic diabetes care but have only limited time per patient. These circumstances call for time- and cost-effective as well as easy-to-implement routines in general care. It has been suggested that patient care could be intensified without increasing time load for the GP by enhancing involvement of practice nurses , . With regards to supporting lifestyle modifications and risk factor management, which is also crucial in type 2 diabetes care, telephone counseling has been shown to be effective in other specific patient groups , . Therefore, supplemental supportive telephone-based counseling by practice nurses could be a feasible and cost-effective method to enhance the quality of medical care and to improve patients’ risk factor profile and associated outcomes.
The specific objective of this randomized-controlled trial (RCT) was to investigate whether a patient-centered intervention comprising monthly supportive telephone-based counseling sessions by practice nurses in a general practice setting improves diabetes-related medical and psycho-social outcomes above usual care in type 2 diabetes mellitus patients with poor glycemic control at baseline, who are at increased risk for many diabetes-associated complications .
Research Design and Methods
The study protocol for this trial was approved by the Ethics Committees of the Medical Faculty of the University of Heidelberg and by the State Chamber of Physicians of Baden-Württemberg. The protocol and supporting CONSORT checklist are available as supporting information; see Protocol S1 (English), Protocol S2 (German) and Checklist S1.
Study Design, Participants and Randomization
The RCT is registered at clinicaltrials.gov (NCT00742547). The RCT was conducted in a subsample of participants of the DIANA study (“DIANA – Type 2 diabetes mellitus: New approaches to optimize medical care in general practice”), which is a prospective cohort study with patients with type 2 diabetes in general practices located in the area of Ludwigsburg/Heilbronn (South-West-Germany) . In brief, adult patients with diagnosed type 2 diabetes mellitus were recruited by 38 participating general practices during regular practice visits from October 2008 to March 2010. Exclusion criteria for patients were living in a nursing home, insufficient knowledge of the German language, and visiting the GP for palliative or emergency care only. Participation was conditional on written informed consent. Overall, 1,146 type 2 diabetes patients participated at baseline.
Originally, it was planned to collaborate with 10 recruiting practices, as set out in the study protocol. However, after the start of the recruitment period it became evident that both the number of collaborating practices as well as the recruitment period had to be extended substantially in order to achieve a sufficient quantity of participants.
At the DIANA-study baseline examination, blood samples were taken from all participants by the GPs and HbA1c-concentration was determined by a contracted central laboratory. Since the intervention focused on patients with poor glycemic control, patients with a baseline glycosylated hemoglobin A1c (HbA1c) >7.5% (equating 58.47 mmol/l) were eligible for the trial. Overall, 218 were eligible, of whom 204 (94%) gave written informed consent to participate in the trial and were randomized to intervention or control group (Figure 1). As it was originally planned to collaborate with only 10 GP practices, an individual randomization approach was chosen. A web-based randomization service for clinical trials provided by the Institute for Medical Informatics, Statistics and Documentation at the Medical University of Graz/Austria (http://www.randomizer.at) was used for the randomization. The minimization method was employed to balance group allocation by the predefined patient factors GP practice, sex and age (age <65 vs. age ≥65). 103 patients were randomized into the intervention group and 101 into the control group. After randomization, 3 patients (2.9%) of the intervention group declined to receive the intervention. 4 other patients (3.9%) never received the intervention for other reasons. 96 patients (93.2%) of those assigned to the intervention group actually received the intervention.
To evaluate immediate and long-term effects of the intervention, follow-up assessments of medical outcomes were carried out after 12 months (end-of-intervention) and 18 months (6 months post-intervention), and psycho-social outcomes were additionally measured after 6 months (during intervention). Of the 204 participants of the trial, 200 (99.5%) completed the first follow-up, 196 (96%) completed the second follow-up, and 185 (91%) also completed the third follow-up. The number of declines was somewhat higher in the intervention group (Figure 1).
The intervention was planned to consist of supportive telephone-based counseling sessions led by practice nurses (“Medizinische Fachangestellte”), who in Germany have obtained their professional qualification in a three-year dual vocational education.
After randomization, the GP practices were informed about the group allocation of their patients. Over the following 12 months, patients in the intervention group received supportive telephone-based counseling sessions on a monthly basis, which were conducted by practice nurses of the participating GP practices who had been trained beforehand. All of the sessions were conducted according to a written manual and were based on a standardized questionnaire developed by the authors. The development of the questionnaire relied on results from a qualitative study, for which interviews with GPs, practice nurses and patients had been conducted . In brief, the final questionnaire included questions on the patient’s physical and mental condition, medication adherence, medical symptoms (cardiovascular symptoms, problems with the lower limbs, vision impairment), lifestyle (physical activity, weight, nutrition), and was designed to take about 10 minutes time overall. The items were designed to motivate patients to improve their general health behaviors, but also to identify barriers and problems regarding diabetes therapy and self-management on the part of the patients, and to facilitate early detection of diabetes-associated complications. In addition, the questionnaire sheet included guidelines on the identification of problems that required a resolution by the GP. In case of the patient’s answers being indicative of any physical or mental complications or issues that might compromise the success of diabetes therapy, the practice nurse was supposed to alert the GP, who then decided about further actions and contacted the patient himself, if necessary.
82 of the 89 patients (92%) who received telephone counseling and who did not drop-out during follow-up received 10 to 12 sessions. The other 7 (8%) patients received between 6 and 9 sessions.
Patients in the control group received usual care only, i.e. no study-related telephone-based counseling sessions or other systematic procedures.
Measures and Outcomes
Primary outcome of this study was the change in HbA1c-concentration after 12 and 18 months. At baseline and at the 12- and 18-month follow-up measurements, blood samples were taken from the participants and sent to the contracted central laboratory which determined HbA1c-concentrations using ion exchange high pressure liquid chromatography (G8, Tosoh Biosciences). The inter-assay variation coefficients provided by the manufacturer are 0.7% at medium concentrations of HbA1c (mean: 7.4%) and 0.36% at high concentrations (mean: 13.5%).
Secondary outcomes of interest were diastolic and systolic blood pressure, serum cholesterol level, health-related quality of life, and symptoms of depression as an indicator of mental health. Lipid levels (total cholesterol and HDL cholesterol) as well as blood pressure were obtained from the GPs, who provided up-to-date medical information about the patient from their medical records with a standardized questionnaire at baseline and at the 12- and 18-month follow-up measurements. Because of a comparably high number of missing values in HDL cholesterol levels (Table 1), only total cholesterol was used as an outcome in the multivariate analyses. GPs also reported patient’s age at first clinical diagnosis of type 2 diabetes mellitus.
Health-related quality of life (HRQoL) was assessed with the Short Form General Health Survey (SF-12) . The item responses of the SF-12 were weighted and combined as described elsewhere  to obtain a physical and a mental component summary score, with higher scores representing greater physical and emotional well-being, respectively. Symptoms of depression were measured at baseline and all three follow-up measurements using the Geriatric Depression Scale (GDS) in the 15-item version . A sum score was calculated giving the total number of self-reported symptoms of depression ranging from 0 to 15, with scores greater than 5 suggesting depression. Both the SF-12 and the GDS were part of self-administered questionnaires that participants filled in at baseline, and at 6-, 12- and 18-month follow-up. The baseline questionnaire also collected information on the socio-demographic background, such as year of birth, educational level and marital status. Highest level of education was translated into three categories (low, moderate, high) and marital status was dichotomized (being married versus not married).
The study was designed to achieve at least 90% power to detect differences in HbA1c-concentrations of 0.5%-points across groups at a significance level of 0.05 (two tailed); the minimum required sample size would be 68 patients per group. The final group size was substantially larger, as 218 patients of the cohort were eligible for the study and 204 of these gave informed consent to participate.
For by-group comparisons of categorical variables, Chi-square tests were employed. Continuous variables were tested for normal distribution using the Shapiro-Wilk-test. The t-test for independent samples was used for by-group comparisons of normally distributed continuous variables, and the Mann-Whitney U-test in case of non-normally distributed continuous variables.
For the multivariate analysis, hierarchical linear models (HLMs) were computed, which can handle multiple measurements, intra-individual correlation in observations over time, and the nested structure of the data (with GP practices as clusters) , . For the analyses, each available measurement of each participant was treated as one single observation, i.e. there were up to four observations per participant. Separate models were computed for each outcome (all continuous), adjusted for sex, age, marital status and educational level (all fixed effects, time-invariant), and accounting for intra-individual correlation over time (first-order autoregressive covariance structure), and clustering by GP practice (random effect, time-invariant). To allow for non-linear development of outcomes, time was treated as a categorical variable with each measurement representing one category, and was included as time-varying fixed effect. Allocated group was included as time-invariant binary fixed effect. To test for between-group differences in within-group changes over time, a time-by-group interaction term was added as time-varying fixed effect. Estimates for within-group changes over time (with respective P-values) and P-values of between-group differences in within-group changes over time were reported for each outcome.
For the primary outcome HbA1c, sex-specific least square means based on the parameters estimated in sex-stratified multivariate HLMs were also graphically depicted.
All analyses were based on the initial treatment intent (intention to treat analyses). All statistical tests were two-sided, with an alpha level of 0.05. SAS v9.2 was used throughout.
Median age in the intervention and control group was 68 and 67 years and slightly more than 60% of participants were male in both groups (Table 1). Participants in intervention and usual care group did not differ significantly with regards to socio-demographic characteristics. Regarding medical characteristics, systolic blood pressure was significantly higher in the intervention group.
HbA1c decreased significantly from baseline to 12-month follow-up measurement (Table 2) both in intervention and usual care group (by 0.44 in the intervention and by 0.51 in the usual care group). However, patterns of change did not differ significantly between groups. In contrast to the usual care group, the reduction in HbA1c was not maintained in the intervention group with values measured at baseline and at 18-month follow-up not being significantly different. Again, patterns of change in this period did not differ significantly between groups.
For total cholesterol and diastolic blood pressure, neither change over time in either group nor between-group differences in patterns of change were statistically significant. Systolic blood pressure significantly decreased from baseline to 12-month follow-up in the intervention group only (by −5.27), with between-group differences in patterns of change being significant. The decrease was however not maintained with systolic blood pressure at 18-month follow-up not being significantly different from baseline and with patterns of change not being statistically significant between groups.
For the physical HRQoL (Table 3), values did not change significantly in either group from baseline to 6-month or to 12-month follow-up, and patterns of change were also not statistically different between groups. However, patterns of change from baseline to 18-month follow-up varied between groups due to a significant increase by 3.02 in the intervention group, while physical HRQoL decreased insignificantly in the usual care group. The mental HRQoL decreased significantly in the usual care group by 3.21 points from baseline to 18-month follow-up. At the same time, mental HRQoL tended to remain stable in the intervention group. However, group differences in patterns of change were not statistically significant over this period.
Symptoms of depression changed significantly only during the first six months of the intervention, with patterns of change being significantly different between groups. The depression score decreased significantly by 0.41 in the intervention group, while it increased borderline significantly by 0.35 in the usual care group. The improvement in the intervention group was however not maintained.
Sex-stratification of models yielded overall consistent results for both sexes (details not shown for secondary outcomes; see Figure 2 for primary outcome HbA1c).
Legend: solid line = Intervention group, dashed line = usual care group Note. Least square means are based on parameter estimates of sex-stratified hierarchical linear models for HbA1c. Models were adjusted for sex, age, marital status and education, were specified to take into account intra-individual correlation over time and clustering by GP practice (random effect), and included time and time×group-interaction effects.
Our results from a randomized controlled trial of regular supportive telephone-based counseling sessions by practice nurses for diabetes patients with dissatisfactory glycemic control in a general practice setting suggest only limited effects of the intervention with respect to HbA1c-levels, the primary outcome measure, whereas positive effects were seen with some of the secondary outcomes. HbA1c-levels decreased significantly in the intervention group from baseline to end-of-intervention, but not above usual care. In addition, the decrease in the intervention group was partly reversed post-intervention. However, favorable changes were observed in several of the secondary endpoints. Systolic blood pressure decreased significantly in the intervention group and above usual care; however, the reduction was not maintained post-intervention. With regard to HRQoL as measured with the SF-12, we observed significant longer-term changes post-intervention for the physical component score, which improved significantly in the intervention group compared to baseline and above usual care. For symptoms of depression, beneficial effects of the intervention were observed in the first six months of the intervention but which were not maintained.
In general, primary care interventions involving revisions of professional roles such as enhanced involvement of nurses in diabetes management have been reported to have positive effects on patient outcomes , –. To our knowledge, only few intervention studies in primary care have used telephone-based counseling by practice nurses to improve outcomes in type 2 diabetes-patients in a GP setting, of which most proved to be effective in improving at least some patient outcomes, even though no general pattern seems to be apparent. A trial of nurse-led telephone counseling (cognitive behavioral therapy plus a walking program) over one year with about 170 patients per group has not led to improvements in HbA1c, but patients in the intervention group had greater improvements in systolic blood pressure, physical activity and depressive symptoms compared to controls . A trial in 275 nearly exclusively male veterans with non-insulin-dependent diabetes designed to improve glycemic control with an intervention involving monthly nurse-led telephone calls over one year to educate patients, monitor their health status and facilitate access to primary care, could not find an improvement in coronary risk factors above the control condition . However, as reported elsewhere, the same intervention led to modest improvements in glycemic control but not in health-related quality of life or in diabetes-related symptoms . In a lifestyle intervention study in patients with hypertension, non-insulin-dependent diabetes or coronary heart disease, 212 patients either received usual care, or monthly telephone or face-to-face individual counseling by nurses for one year following one face-to-face individual counseling session. While significant improvements in dietary patterns were observed in all groups, the intervention did not result in reductions in fat intake, serum cholesterol or body mass index above usual care .
Overall, our findings are consistent with the literature suggesting some benefit of an enhanced involvement of practice nurses in diabetes care , –. Our findings are also in concordance with the aforementioned intervention studies that – albeit finding improvements in lifestyle-related and psycho-social outcomes – could not establish an added benefit to usual care in terms of distinct improvements of medical outcomes. We focused on medical and psycho-social outcomes in this study, but further analyses indicated no statistically significant beneficial intervention effect with regards to lifestyle risk factors such as smoking behavior or physical activity patterns (details not shown). Future follow-up measurements will show whether our supportive counseling intervention nonetheless exerted effects on the long-term prognosis, such as the development of secondary disorders, adverse events and mortality.
In the spirit of comparative effectiveness research, this study meant to be a pragmatic trial , . It was conducted under real-life-conditions in the general practice routine with practice nurses employed at the cooperating practices conducting the counseling sessions, instead of having study counselors perform the intervention. Furthermore, it focused only on the challenging high-risk patient group of type 2 diabetes mellitus patients with poor glycemic control. To increase generalizability of the findings, apart from this selection as few exclusion criteria as possible were applied.
Although few patients allocated to the intervention group never received the intervention due to non-availability of patients or non-cooperation of single practice nurses, the progression of the intervention was overall satisfactory and proved to be applicable. In a process evaluation sheet, a large majority of the cooperating practice nurses rated the counseling as useful and reported being mostly or very satisfied with the time and effort that was involved with the telephone counseling. The vast majority of the patients on the other hand were also quite satisfied with the intervention (details not shown).
Some limitations need to be considered when interpreting the findings of this study.
Firstly, the patients were individually and not cluster-randomized to intervention and control group. This may have led to contamination bias, with the practice nurses conducting the telephone-based counseling or the GPs unknowingly enhancing care for patients in the usual care group. This might explain the short-term improvements that were observed in patients of the usual care group and would have led to an underestimation of the intervention effect. However, the reduction of HbA1c that was observed in both groups could as well reflect a statistical artifact due to “regression toward the mean” . This phenomenon describes the tendency of extreme values measured at one point to progress toward the population average in the following and has especially relevant explanatory power in this study which included only patients with increased baseline HbA1c-values.
Secondly, another issue is sample attrition. The comparably high initial participation rate (93.6%) and retention rate (90.7%) however suggest only limited potential for selection or attrition bias. The risk of attrition bias was further reduced by using all available data over the follow-ups in the linear models, i.e. participants lost to sample attrition were included until the last recorded measurement. Adding a binary variable to the models indicating drop-out at any follow-up measurement in sensitivity analyses did not change results (details not shown), supporting that drop-out did not distort our findings.
Thirdly, seven patients of the intervention group never received the intervention and were nevertheless included in all analyses examining the treatment effect (based on intention to treat). Excluding those cases from the models in sensitivity analyses resulted in only negligibly different parameter estimates and p-values (details not shown).
Time is a scarce resource in a busy GP practice environment and any measures to enhance the quality of care in a GP practice setting should be easy-to-implement and involve as little additional financial and time costs as possible. Therefore, the intervention was designed to be telephone-based and to use a standardized questionnaire instrument. Objectives of this instrument were monitoring of patients’ health status, identification of patient-side barriers to compliance with the treatment, and support of patients’ self-management of diabetes therapy. The questionnaire instrument and accompanying guidelines thus covered crucial elements of type 2 diabetes treatment and were designed to continuously inform and support the patients’ diabetes therapy and to complement usual care. An intervention individually tailored to patient’s needs might have proven to be more effective, but would have probably required more of the practice nurses’ time and effort.
In conclusion, this randomized controlled study could not show a beneficial effect of telephone counseling in terms of an improvement of HbA1c in diabetes patients with increased HbA1c at baseline. However, our findings suggest some beneficial effects on important diabetes-associated risk factors such as blood pressure, and on quality of life and mental health. That most of the improvements in outcomes were not maintained after the end of the intervention suggests that longer-term and continuous efforts are needed to sustain improvements in patient outcomes.
Trial Protocol (German).
We gratefully acknowledge the collaboration of the recruiting GP practices and of the participating practice nurses.
Conceived and designed the experiments: HB ER HUK GR DR TR JS. Performed the experiments: HB ER HUK. Analyzed the data: UM. Wrote the paper: UM HB ER HUK GR DR TR JS.
- 1. Shaw JE, Sicree RA, Zimmet PZ (2010) Global estimates of the prevalence of diabetes for 2010 and 2030. Diabetes Res Clin Pract 87: 4–14.
- 2. Köster I, Schubert I, Huppertz E (2012) [Follow up of the CoDiM-Study: Cost of diabetes mellitus 2000–2009]. Dtsch Med Wochenschr 137: 1013–1016.
- 3. Heidemann C, Du Y, Schubert I, Rathmann W, Scheidt-Nave C (2013) Prevalence and temporal trend of known diabetes mellitus. Results of the German Health Interview and Examination Survey for adults (DEGS1). Bundesgesundheitsblatt 56: 668–677.
- 4. Sarwar N, Gao P, Seshasai SR, Gobin R, Kaptoge S, et al. (2010) Diabetes mellitus, fasting blood glucose concentration, and risk of vascular disease: a collaborative meta-analysis of 102 prospective studies. Lancet 375: 2215–2222.
- 5. Seshasai SR, Kaptoge S, Thompson A, Di Angelantonio E, Gao P, et al. (2011) Diabetes mellitus, fasting glucose, and risk of cause-specific death. N Engl J Med 364: 829–841.
- 6. Stock SA, Redaelli M, Wendland G, Civello D, Lauterbach KW (2006) Diabetes–prevalence and cost of illness in Germany: a study evaluating data from the statutory health insurance in Germany. Diabet Med 23: 299–305.
- 7. Bodenheimer T, Wagner EH, Grumbach K (2002) Improving primary care for patients with chronic illness: the chronic care model, Part 2. J Am Med Assoc 288: 1909–1914.
- 8. Bodenheimer T, Wagner EH, Grumbach K (2002) Improving primary care for patients with chronic illness. J Am Med Assoc 288: 1775–1779.
- 9. Glasgow RE, Funnell MM, Bonomi AE, Davis C, Beckham V, et al. (2002) Self-management aspects of the improving chronic illness care breakthrough series: implementation with diabetes and heart failure teams. Ann Behav Med 24: 80–87.
- 10. Renders CM, Valk GD, Griffin S, Wagner EH, Eijk JT, et al.. (2001) Interventions to improve the management of diabetes mellitus in primary care, outpatient and community settings. Cochrane Database Syst Rev: CD001481.
- 11. Vrijhoef HJ, Diederiks JP, Spreeuwenberg C, Wolffenbuttel BH, van Wilderen LJ (2002) The nurse specialist as main care-provider for patients with type 2 diabetes in a primary care setting: effects on patient outcomes. Int J Nurs Stud 39: 441–451.
- 12. Digenio AG, Mancuso JP, Gerber RA, Dvorak RV (2009) Comparison of methods for delivering a lifestyle modification program for obese patients: a randomized trial. Ann Intern Med 150: 255–262.
- 13. Stead LF, Perera R, Lancaster T (2006) Telephone counselling for smoking cessation. Cochrane Database Syst Rev: CD002850.
- 14. Stolar M (2010) Glycemic control and complications in type 2 diabetes mellitus. Am J Med 123: S3–11.
- 15. Krämer HU, Rüter G, Schöttker B, Rothenbacher D, Rosemann T, et al. (2012) Gender differences in healthcare utilization of patients with diabetes. Am J Manag Care 18: 362–369.
- 16. Götz K, Szecsenyi J, Campbell S, Rosemann T, Rüter G, et al. (2012) The importance of social support for people with type 2 diabetes - a qualitative study with general practitioners, practice nurses and patients. GMS Psychosoc Med 9: Doc02.
- 17. Ware JE, Kosinski M, Keller SD (1996) A 12-Item Short-Form Health Survey: construction of scales and preliminary tests of reliability and validity. Med Care 34: 220–233.
- 18. Ware JE, Kosinski M, Keller SD (1995) How to Score the SF-12 Physical and Mental Health Summary Scales. Boston, MA: The Health Institute, New England Medical Center.
- 19. Sheikh JI, Yesavage JA (1986) Geriatric Depression Scale (GDS) - recent evidence and development of a shorter version. Clin Gerontol 5: 165–172.
- 20. Bryk AS, Raudenbush SW (1987) Application of hierarchical linear models to assessing change. Psychol Bull 101: 147–158.
- 21. Laird NM, Ware JH (1982) Random-effects models for longitudinal data. Biometrics 38: 963–974.
- 22. Seitz P, Rosemann T, Gensichen J, Huber CA (2011) Interventions in primary care to improve cardiovascular risk factors and glycated haemoglobin (HbA1c) levels in patients with diabetes: a systematic review. Diabetes Obes Metab 13: 479–489.
- 23. Pimouguet C, Le Goff M, Thiebaut R, Dartigues JF, Helmer C (2011) Effectiveness of disease-management programs for improving diabetes care: a meta-analysis. CMAJ 183: E115–127.
- 24. Shojania KG, Ranji SR, McDonald KM, Grimshaw JM, Sundaram V, et al. (2006) Effects of quality improvement strategies for type 2 diabetes on glycemic control: a meta-regression analysis. JAMA 296: 427–440.
- 25. Tricco AC, Ivers NM, Grimshaw JM, Moher D, Turner L, et al. (2012) Effectiveness of quality improvement strategies on the management of diabetes: a systematic review and meta-analysis. Lancet 379: 2252–2261.
- 26. Piette JD, Richardson C, Himle J, Duffy S, Torres T, et al. (2011) A randomized trial of telephonic counseling plus walking for depressed diabetes patients. Med Care 49: 641–648.
- 27. Kirkman MS, Weinberger M, Landsman PB, Samsa GP, Shortliffe EA, et al. (1994) A telephone-delivered intervention for patients with NIDDM. Effect on coronary risk factors. Diabetes Care 17: 840–846.
- 28. Weinberger M, Kirkman MS, Samsa GP, Shortliffe EA, Landsman PB, et al. (1995) A nurse-coordinated intervention for primary care patients with non-insulin-dependent diabetes mellitus: impact on glycemic control and health-related quality of life. J Gen Intern Med 10: 59–66.
- 29. Woollard J, Burke V, Beilin LJ, Verheijden M, Bulsara MK (2003) Effects of a general practice-based intervention on diet, body mass index and blood lipids in patients at cardiovascular risk. J Cardiovasc Risk 10: 31–40.
- 30. Godwin M, Ruhland L, Casson I, MacDonald S, Delva D, et al. (2003) Pragmatic controlled clinical trials in primary care: the struggle between external and internal validity. BMC Med Res Methodol 3: 28.
- 31. Sox HC (2010) Defining comparative effectiveness research: the importance of getting it right. Med Care 48: S7–8.
- 32. Blomqvist N (1987) On the bias caused by regression toward the mean in studying the relation between change and initial value. J Clin Periodontol 14: 34–37.