Medication non-adherence is a prevalent problem worldwide but up to today, no gold standard is available to assess such behavior. This study was to evaluate the psychometric properties, particularly the concurrent validity of the English version of the Malaysian Medication Adherence Scale (MALMAS) among people with type 2 diabetes in Malaysia. Individuals with type 2 diabetes, aged 21 years and above, using at least one anti-diabetes agent and could communicate in English were recruited. The MALMAS was compared with the 8-item Morisky Medication Adherence Scale (MMAS-8) to assess its convergent validity while concurrent validity was evaluated based on the levels of glycated hemoglobin (HbA1C). Participants answered the MALMAS twice: at baseline and 4 weeks later. The study involved 136 participants. The MALMAS achieved acceptable internal consistency (Cronbach’s alpha=0.565) and stable reliability as the test-retest scores showed fair correlation (Spearman’s rho=0.412). The MALMAS has good correlation with the MMAS-8 (Spearman’s rho=0.715). Participants who were adherent to their anti-diabetes medications had significantly lower median HbA1C values than those who were non-adherence (7.90 versus 8.55%, p=0.032). The odds of participants who were adherent to their medications achieving good glycemic control was 3.36 times (95% confidence interval: 1.09-10.37) of those who were non-adherence. This confirms the concurrent validity of the MALMAS. The sensitivity of the MALMAS was 88.9% while its specificity was 29.6%. The findings of this study further substantiates the reliability and validity of the MALMAS, in particular its concurrent validity and sensitivity for assessing medication adherence of people with type 2 diabetes in Malaysia.
Citation: Chung WW, Chua SS, Lai PSM, Morisky DE (2015) The Malaysian Medication Adherence Scale (MALMAS): Concurrent Validity Using a Clinical Measure among People with Type 2 Diabetes in Malaysia. PLoS ONE 10(4): e0124275. https://doi.org/10.1371/journal.pone.0124275
Academic Editor: Antje Timmer, Carl von Ossietzky University of Oldenburg, GERMANY
Received: August 19, 2014; Accepted: March 12, 2015; Published: April 24, 2015
Copyright: © 2015 Chung et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All data related to the study are included in the paper.
Funding: This study was supported by the University of Malaya Research Grant(RG 457/12HTM) which was awarded to SSC. (URL: http://umresearch.um.edu.my/mainpage.php?module=Maklumat&kategori=86&id=62&papar=1 ) The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The World Health Organization (WHO) defined medication adherence as “the extent to which a person’s behavior in terms of taking medications, following diets or executing lifestyle changes, corresponds with agreed recommendations from the healthcare provider” . Although a variety of treatment options is available, only one third of people with chronic diseases adhered to their medication regimens . Medication non-adherence is a prevalent concern in translating effective treatment in research settings to clinical practice .
Depending on the complexity of the prescribed medication regimens, generally 40% of patients do not adhere to their medications [4–7]. When complex medication regimens were coupled with other requirements such as lifestyle changes, medication non-adherence was estimated to reach as high as 70% [2,5–9].
Studies found that adherence to oral anti-diabetes agents varied between 30% and 98%. This wide variation may be attributed to the different definitions used, duration of study, outcome measures and assessment methods, types of treatment and number of medications used [10–11]. In developed countries such as the United States (US), it has been estimated that 30% to 50% of patients on medications for chronic diseases are non-adherent to their medication therapies [1,12]. Medication non-adherence was higher in developing countries such as Gambia (73%) and China (54%) .
Medication non-adherence is also a costly economic burden worldwide [3,12–14] with an estimated annual disease-related medical cost of USD100 billion [15–18]. Besides limiting the effectiveness of treatment and increasing healthcare costs [19–22], medication non-adherence also leads to a rise in morbidity and mortality rates .
Potential determinants of medication adherence could be divided into factors related to patient, medication and the healthcare system . These include demographic and behavioral characteristics of patients, patients’ knowledge and awareness concerning their medications and diseases, the complex nature, convenience and cost of treatment as well as the occurrence of side effects [16–18,20,24–28].
According to the WHO, “Poor adherence to long-term therapies severely compromises the effectiveness of treatment making this a critical issue in population health both from the perspective of quality of life and of health economics” . For instance, Wood found that people with diabetes who were adherent to their medication regimens were 48% less likely to die prematurely .
A qualitative study conducted by Manias deduced that in general, patients perceived the clinician as a prescriber and one who manages their chronic conditions. The pharmacist, on the other hand is perceived as a central educator to assist patients in managing their chronic conditions and medication regimens as well as any issues related to adverse effects and medication adherence . Nonetheless, the responsibility to enhance medication adherence should reside on all healthcare professionals and the patients.
Although many studies had been conducted to improve medication adherence, currently there is no gold standard available to assess this issue [1,15]. Various methods which have been used to assess medication adherence can be divided into direct methods (such as monitoring of serum drug levels and direct observation of therapy), and indirect methods (such as patient self-report, pill counts, rate of prescription refills, patient diaries and electronic container monitors) [3,31]. Each method of assessment has its advantages and disadvantages. For example, the self-reporting method suffers from low specificity (50%) but has high sensitivity (90%) .
The Morisky, Green and Levine Scale has been commonly used for the assessment of medication adherence [29,31–33]. This instrument was originally developed with 4 items only [33–34] but has since been modified to the current 8-item Morisky Medication Adherence Scale, MMAS-8 [27,35]. The MMAS-8 is supposed to be an integral scale for assessing general medication adherence behavior and hence, does not specify the duration of recall.
Lu et al demonstrated that self-reported medication adherence was dependent on the recall period and a one-month duration was deemed practical . Therefore, the Malaysian Medication Adherence Scale (MALMAS) was developed based on the hypothesis that patients could comprehend their medication adherence behavior more easily if a recall period was specified. Therefore, the MMAS-8 is for assessing the general behavior of a patient while the MALMAS can be used when a specific recall period of one month is required.
Although the MALMAS has undergone a validation process previously , several limitations was observed and these have been addressed in the current study. Therefore, the aim of this study was to further evaluate and substantiate the psychometric properties of the English version of MALMAS, particularly its concurrent validity among people with type 2 diabetes in Malaysia.
Patients and Methods
The MALMAS was developed based on the MMAS with 9 items (MMAS-9) . One of the items in MMAS-9 about the use of a reminder system was omitted as this item measures a determinant of adherence and not the behavior itself. The other 8 items were modified to make them easier to understand and hence, the MALMAS has eight items with one domain .
The first item of the MALMAS has five responses: (1) All the time, (2) Often, (3) Sometimes, (4) Rarely and (5) Never. The remaining seven items have a dichotomous response of “Yes” or “No”. MMAS-9 has not been validated and hence, the MALMAS was compared with the validated MMAS-8 to assess its convergent validity . The responses in the MALMAS were scored based on the MMAS-8  where the total score ranged from 0 to 8. Both instruments categorized medication adherence based on the total scores obtained: low adherence (total score<6), medium adherence (6 to < 8) and high adherence (total score = 8) [27,35].
A research team consisting of 12 experienced pharmacists developed and established the face and content validity of the MALMAS. In addition, a pilot study was conducted on five patients to obtain their feedback on the clarity of the MALMAS .
People with type 2 diabetes, aged 21 years and above, who were using at least one anti-diabetes agent and could communicate in English, were recruited from the diabetes clinic of a major teaching hospital in Malaysia from April to May 2013. Based on convenience sampling, any person who met the inclusion criteria and visited the diabetes clinic during the study period would be approached to participate in the study while he/she was waiting to see the doctor. A researcher explained the purpose and study procedure to potential participants and requested them to complete a set of questionnaires, which consisted of the MALMAS and the MMAS-8. The participants took approximately 5 to 10 minutes to complete the questionnaires.
The researcher counter-checked the completed questionnaire to ensure that all the questions were answered. The same participants answered the questionnaire again four weeks later. The Medical Ethics Committee of the University Malaya Medical Centre approved the study in writing (MEC Ref. No. 757.112). The study was conducted according to the principles expressed in the Declaration of Helsinki. All participants provided their written, informed consent upon recruitment into this study.
All data were analyzed using the PASW Statistics for Windows, Version 18 (SPSS Inc., Chicago). Using the Kolmogorov-Smirnov test, data obtained from both the MALMAS and the MMAS-8 did not fulfill the normal distribution criteria. Any possible associations between categorical variables were analyzed using chi-square (χ2) test, while Wilcoxon signed ranks test or Mann-Whitney U test was used for testing the difference in continuous variables between two groups.
Cronbach’s alpha values were used to determine the internal consistency of the MALMAS and the MMAS-8. A Cronbach’s alpha value of more than 0.5 is considered as acceptable [38–40]. When an item is deleted from a scale and leads to a significant increase in Cronbach’s alpha, then this item should be excluded to produce a more homogeneous scale . On the other hand, the corrected item-total correlations indicate how much each item in an instrument correlates to its total score. These should be higher than 0.2 to be acceptable . Any item with a value less than 0.2 means that it is assessing a different construct from that of the whole instrument [38,41].
To determine whether the MALMAS has stable reliability, the test-retest results were compared using McNemar test, Wilcoxon Signed Ranks test and Spearman’s rho. Spearman’s rho is interpreted as followed: little or no correlation (0–0.25), fair correlation (0.25–0.5), moderate to good correlation (0.5–0.75) and very good to excellent correlation (> 0.75) .
Concurrent validity was assessed by analyzing the levels of medication adherence and participants’ HbA1c values, using chi-square test, Kruskal-Wallis H test and Mann-Whitney U test. The correlation between the total score of the MALMAS and the HbA1c values of the participants was determined using Spearman’s rank order correlation coefficient.
The sensitivity and specificity as well as the positive and negative predictive values of the MALMAS were generated. The sensitivity of the MALMAS determines its ability to correctly predict poor glycemic control in patients who are non-adherent to their medications, while the specificity of the MALMAS determines its ability to correctly predict good glycemic control in patients who are adherent to their medications . Positive predictive value (also known as precision rate) is the proportion of positive test results that are true positives . This value quantifies how likely participants with poor glycemic control are also non-adherent to their medications, and vice versa. On the other hand, the negative predictive value is the proportion of participants with a negative test result . This value quantifies how likely participants with good glycemic control are also adherent to their medications.
A total of 136 participants were recruited in this study and their demographic and clinical data are presented in Table 1.
Psychometric properties of the MALMAS
The MALMAS and MMAS-8 produced Cronbach’s alpha values of 0.565 and 0.595, respectively. However, the Cronbach’s alpha of MALMAS would increase to 0.571 if item 3 was excluded; while for MMAS-8, this value would increase to 0.598 if item 6 was deleted (Table 2). The item-total correlations were less than 0.2 for three items in the MALMAS (items 3, 4 and 5) and two items in the MMAS-8 (items 5 and 6) [Table 2].
The Spearman’s rho (ρ) for the test-retest results were 0.412 (p<0.001) for MALMAS and 0.376 (p<0.001) for MMAS-8. When the individual items in the MALMAS were analyzed, two out of the 8 items were significantly different at test retest while for the MMAS-8, three items were significantly different.
The results obtained with the MALMAS and that with MMAS-8 showed no significant difference (Table 3). A moderate to good correlation was obtained between the MALMAS and MMAS-8 (Spearman’s rho = 0.715, p<0.001).
The median values of HbA1c were significantly different between the levels of medication adherence, irrespective of how these levels were grouped together (Table 4). However, significant association with glycemic control (based on HbA1c values) was only observed when medication adherence was classified into two categories: high or medium adherence (considered as the adherence group) and low adherence (considered as the non-adherence group). The odds of a person with medium or high adherence achieving glycemic control is 3.36 (95% CI = 1.09–10.37) times more than those with low adherence (Table 4). In addition, a weak but significant inverse correlation was found between HbA1c values and the total scores of MALMAS (Spearman’s rho = -0.212, p = 0.014).
Sensitivity and Specificity.
The association between medication adherence and glycemic control is shown in Table 5. Thirty-two out of 36 participants (88.9%) showed true positive values. This means that they were non-adherent to their medications and had poor glycemic control. However, 69 out of 98 participants (70.4%) had false positive results, indicating that they were adherent to their medications but had poor glycemic control. On the other hand, 29 out of 98 participants (29.6%) had true negative results, which meant that they were adherent to their medications and had good glycemic control, while 4 out of 36 participants (11.1%) had false negative results, which meant that they were non-adherent to their medications but had good glycemic control.
The sensitivity and specificity of the MALMAS was 88.9% and 29.6%, respectively. The positive and negative predictive values were calculated as 31.7% and 87.9%, respectively.
This study further established the psychometric properties of the MALMAS in terms of its acceptable internal consistency, stable reliability, concurrent validity and high sensitivity. This implies that the MALMAS is a reliable and valid instrument for assessing adherence to medications.
The Cronbach’s alpha of the MALMAS was more than 0.5, which indicates that the MALMAS has acceptable internal consistency . The Cronbach’s alpha of the MALMAS would increase slightly if item 3 was excluded. However, this item was retained as there were only 8 items in this instrument, and also the deletion of item 3 only increased the Cronbach’s alpha marginally. The findings from this study concurred with that of a previous validation study on the MALMAS .
Six out of eight items in the MALMAS were not statistically different at test-retest. In addition, Spearman’s rho for the overall scores of the MALMAS showed fair correlation between the test-retest. This indicates that the MALMAS has achieved stable reliability.
The prevalence of medication non-adherence determined using the MALMAS was similar to that of the MMAS-8, confirming the convergent validity of the MALMAS. In addition, these two instruments showed moderate to good correlation. These are similar to that of previous studies that assessed medication adherence using the MMAS-8 [44–45]. Both the MALMAS and the MMAS-8 can be used to assess adherence to long-term medications. In addition, the MMAS-8 can be used for assessing short-term medications (less than a month) but not the MALMAS since a specific recall period of a month is required. However, the MALMAS is a more appropriate instrument for comparison of medication adherence between different studies than the MMAS-8, as the recall period is not specified in the latter.
The weak inverse correlation between HbA1c values and the total MALMAS scores of the participants indicates that it is better to categorize the total MALMAS scores into two groups: adherence and non-adherence, rather than using the actual score to assess medication adherence. The odds of participants who were adherent to their anti-diabetes medications and achieving good glycemic control (HbA1c less than 7%) was 3.36 times of those who were non-adherence.
Participants who were non-adherence also had significantly higher median HbA1c levels than those who were adherence. This confirms the concurrent validity of the MALMAS and the findings of previous studies where improving medication adherence would lead to better glycemic control in people with diabetes [46–47]. Previous studies have shown that a 10% improvement in medication adherence is associated with a decrease in HbA1c by 0.16% [46–47]. Therefore, efforts to improve glycemic outcomes should include an emphasis on medication adherence, which can be assessed using the MALMAS.
The MALMAS would be considered as an accurate instrument if a high number of true positives and true negatives were obtained, when compared to false positives and false negatives . The sensitivity of the MALMAS in identifying people who were non-adherent to their medications and had poor glycemic control was 88.9%. However, the specificity of the MALMAS in accurately determining participants who were adherent and also had good glycemic control was only 29.6%; indicating that the MALMAS is sensitive in assessing non-adherence to medication; but lacks specificity. These findings are similar to previous studies which used the MMAS-8 [3,27].
The high sensitivity and low specificity of the MALMAS is probably due to the small sample size [48,49] or under-reporting of non-adherence by participants . Studies have shown that patients tend to be more truthful in reporting their non-adherence to medications when they are not worried about criticism [4,50]. This is possible through continuity of care where the researcher could develop a good rapport with the participants.
One of the limitations of the present study was that the MALMAS was validated only in English. Thus, only patients who could communicate in English were recruited. However, Malaysia is a multiracial society, where other languages such as Malay, Mandarin and Tamil are also widely used. Therefore, there is a need to translate and validate the MALMAS in these languages so that studies on medication adherence in Malaysia can include participants from different ethnic groups, which will better represent its multiethnic population.
The concurrent validity of the MALMAS shows significant association between medication adherence and glycemic control while the other psychometric properties of the MALMAS conformed to that of other studies. In addition, the MALMAS has high sensitivity for identifying those who were non-adherent to their medications and had poor glycemic control. Therefore, this study further substantiates the reliability and validity, in particular the concurrent validity and sensitivity of the MALMAS for assessing adherence to long-term medications where a recall period of a month is required.
The authors would like to express their appreciation to the Pharmacist Research Team of the Community-Based Cardiovascular Risk Factors Intervention Strategies (CORFIS) Trial for designing and developing the Malaysian Medication Adherence Scale (MALMAS). We would like to thank the following persons for their assistance in this study: Dr David Wu from Monash University Sunway Campus for his advice and assistance on statistical analysis; Ms Samihah Mat Junoh for her assistance in collecting data and Ms Rita Mohan Dallumal for helping to format this manuscript. We are also very grateful to all the study participants for their willingness to be in the study. In addition, we would like to acknowledge the cooperation and assistance of all the staff in the Pharmacy Department and the Diabetes Clinic of the University Malaya Medical Centre. This study was funded by the University of Malaya Research Grant (RG 457/12HTM).
Conceived and designed the experiments: WWC SSC. Performed the experiments: WWC SSC PSML. Analyzed the data: WWC SSC PSML DEM. Contributed reagents/materials/analysis tools: SSC DEM. Wrote the paper: WWC SSC PSML DEM. Revise the manuscript critically for important intellectual content: WWC SSC PSML DEM.
- 1. World Health Organization. Non-comunicable diseases and mental health: adherence to long term therpaies—evidence for action. 2003. Available: http://www.who.int/chp/knowledge/publications/adherence_introduction.pdf. Accessed 15 June 2013.
- 2. Li WW, Kuo CT, Hwang SL, Hsu HT. Factors related to medication non-adherence for patients with hypertension in Taiwan. J Clin Nurs. 2012;21(13–14): 1816–1824.
- 3. Lingam R, Scott J. Treatment non-adherence in affective disorders. Acta Psychiatr Scand. 2002;105(3): 164–172. pmid:11939969
- 4. Martin LR, Williams SL, Haskard KB, Dimatteo MR. The challenge of patient adherence. Ther Clin Risk Manag. 2005;1(3): 189–199. pmid:18360559
- 5. Donnan PT, MacDonald TM, Morris AD. Adherence to prescribed oral hypoglycemic medication in a population of patients with Type 2 diabetes: a retrospective cohort study. Diabet Med. 2002;19(4): 279–284. pmid:11942998
- 6. Fischer MA, Stedman MR, Lii J, Vogeli C, Shrank WH, et al. Primary medication non-adherence: analysis of 195, 930 electronic prescriptions. J Gen Intern Med. 2010;25(4): 284–290. pmid:20131023
- 7. Kane S, Shaya F. Medication non-adherence is associated with increased medical health care costs. Dig Dis Sci. 2008;53(4): 1020–1024. pmid:17934828
- 8. Chesney MA. Factors affecting adherence to antiretroviral therapy. Clin Infect Dis. 2000;30(Suppl 2): S171–176. pmid:10860902
- 9. Chesney MA, Ickovics JR, Chambers DB, Gifford AL, Neidiq J, Zwickl B, et al. Self-reported adherence to antiretroviral medications among participants in HIV clinical trials: the AACTG adherence instruments. AIDS Care. 2000;12(3): 255–266. pmid:10928201
- 10. Cramer JA. A systematic review of adherence with medications for diabetes. Diabetes Care. 2004;27(5): 1218–1224. pmid:15111553
- 11. Odegard PS, Capoccia K. Medication taking and diabetes: a systematic review of the literature. Diabetes Educ. 2007;33(6): 1014–1029. pmid:18057270
- 12. Schlenk EA, Dunbar-Jacob J, Engberg S. Medication non-adherence among older adults: a review of strategies and interventions for improvement. J Gerontol Nurs. 2004;30(7): 33–43. pmid:15287325
- 13. Ho PM, Rumsfeld JS, Masoudi FA, McClure DL, Plomondon ME, Steiner DF, et al. Effect of medication nonadherence on hospitalization and mortality among patients with diabetes mellitus. Arch Intern Med. 2006;166(17): 1836–1841. pmid:17000939
- 14. Lau DT, Nau DP. Oral antihyperglycemic medication nonadherence and subsequent hospitalization among individuals with type 2 diabetes. Diabetes Care. 2004;27(9): 2149–2153. pmid:15333476
- 15. Osterberg L, Blaschke T. Adherence to medication. N Engl J Med. 2005;353(5): 487–497. pmid:16079372
- 16. Marcum ZA, Sevick MA, Handler SM. Nonadherence to medications—reply. JAMA. 2013;310(14): 1506–1507. pmid:24104382
- 17. Marcum ZA, Sevick MA, Handler SM. Medication nonadherence: a diagnosable and treatable medical condition. JAMA. 2013;309(20): 2105–2106. pmid:23695479
- 18. Marcum ZA, Zheng Y, Perera S, Strotmeyer E, Newman AB, Simonsick EM, et al. Prevalence and correlates of self-reported medication non-adherence among older adults with coronary heart disease, diabetes mellitus, and/or hypertension. Res Social Adm Pharm. 2013;9(6): 817–827. pmid:23291338
- 19. Balkrishnan R, Rajagopalan R, Camacho FT, Huston SA, Murray FT, Anderson RT. Predictors of medication adherence and associated health care costs in an older population with type 2 diabetes mellitus: a longitudinal cohort study. Clin Ther. 2003;25(11): 2958–2971. pmid:14693318
- 20. Lerman I. Adherence to treatment: the key for avoiding long-term complications of diabetes. Arch Med Res. 2005;36(3): 300–306. pmid:15925020
- 21. Laditka SB, Mastanduno MP, Laditka JN. Health Care Use of Individuals With Diabetes in an Employer-Based Insurance Population. Arch Intern Med. 2001;161: 1301–1308. pmid:11371258
- 22. Sokol MC, McGuigan KA, Verbrugge RR, Epstein RS. Impact of medication adherence on hospitalization risk and healthcare cost. Med Care. 2005;43(6): 521–530. pmid:15908846
- 23. Van den Berghe G, Wouters P, Weekers F, Verwaest C, Bruyninckx F, et al. Intensive insulin therapy in critically ill patients. N Engl J Med. 2001;345(19):1359–1367. pmid:11794168
- 24. Grant RW, Devita NG, Singer DE, Meigs JB. Polypharmacy and medication adherence in patients with type 2 diabetes. Diabetes Care. 2003;26(5): 1408–1412. pmid:12716797
- 25. Krousel-Wood M, Thomas S, Muntner P, Morisky D. Medication adherence: a key factor in achieving blood pressure control and good clinical outcomes in hypertensive patients. Curr Opin Cardiol. 2004;19(4): 357–362. pmid:15218396
- 26. Morisky DE, Malotte CK, Choi P, Davidson P, Rigler S, Sugland B, et al. A patient education program to improve adherence rates with antituberculosis drug regimens. Health Educ Q. 1990;17(3): 253–267. pmid:2228629
- 27. Morisky DE, Ang A, Krousel-Wood M, Ward HJ. Predictive validity of a medication adherence measure in an outpatient setting. J Clin Hypertens. 2008;10(5): 348–354. pmid:18453793
- 28. Cohen JS. Adverse drug effects, compliance, and initial doses of antihypertensive drugs recommended by the Joint National Committee vs the Physicians' Desk Reference. Arch Intern Med. 2001;161(6): 880–885. pmid:11268233
- 29. Wood B. Medication Adherence: the real problem when treating chronic conditions. US Pharm. 2012;37(4)(Compliance suppl): 3–6.
- 30. Manias E. Managing complex medication regimens: perspectives of consumers with osteoarthritis and healthcare professionals. Ann Pharmacother. 2007;41(5): 764–771. pmid:17456543
- 31. Chua SS, Lai PSM, Tan CH, Chan SP, Chung WW, Morisky DE. The development and validation of the Malaysian medication adherence scale (MALMAS) among patients with 2 type diabetes in Malaysia. Int J Pharm Pharm Sci. 2013;5(3): 790–794.
- 32. Ho PM, Bryson CL, Rumsfeld JS. Medication adherence: its importance in cardiovascular outcomes. Circulation. 2009;119(23): 3028–3035. pmid:19528344
- 33. Morisky DE, Green LW, Levine DM. Concurrent and predictive validity of a self-reported measure of medication adherence. Med Care. 1986;24(1): 67–74. pmid:3945130
- 34. Morisky DE, DiMatteo MR. Improving the measurement of self-reported medication nonadherence: Response to authors. J Clin Epidemiol. 2011;64(3): 255–263. pmid:21144706
- 35. Krousel-Wood M, Islam T, Webber LS, Re RN, Morisky DE, Muntner P. New medication adherence scale versus pharmacy fill rates in seniors with hypertension. Am J Manag Care. 2009;15(1): 59–66. pmid:19146365
- 36. Lu M, Safren SA, Skolnik PR, Rogers WH, Coady W, Hardy H, et al. Optimal recall period and response task for self-reported HIV medication adherence. AIDS Behav. 2008;12(1): 86–94. pmid:17577653
- 37. Sodergard B, Halvarsson M, Tully MP, Mindouri S, Nordstrom ML et al. Adherence to treatment in Swedish HIV-infected patients. J Clin Pharm Ther. 2006;31(6): 605–616. pmid:17176366
- 38. Bowling A. Research methods in health: Investigating health and health services. 3rd ed. Berkshire: Open University Press; 2009. https://doi.org/10.7748/ns.29.14.32.s36 pmid:25467349
- 39. Streiner DL, Norman GR. Health measurement scales: A practical guide to their development and use. 2nd ed. New York: Oxford University Press Inc.; 1995. https://doi.org/10.1097/DBP.0b013e31819670fa pmid:19194325
- 40. Sushil S, Verma N. Questionnaire validation made easy. Eur J Sci Res. 2010;46(2): 172–178.
- 41. De Vellis RF. Scale development: Theory and applications. 26th ed. California: Sage; 1991.
- 42. Cohen JS. Statistical power analysis for the behavioral sciences. 2nd ed. New Jersey: Lawrence Erlbaum Associates Inc.; 1988.
- 43. Lalkhen AG, McCluskey A. Clinical tests: sensitivity and specificity. Contin Educ Anaesth Crit Care Pain, 2008;8(6): 221–223.
- 44. Lerman I. Adherence to Treatment: The key for avoiding long-term complications of diabetes. Arch Med Res. 2005;36: 300–306. pmid:15925020
- 45. Al-Qazaz H, Hassali MA, Shafie AA, Sulaiman SA, Sundram S, Morisky DE. The eight-item Morisky Medication Adherence Scale MMAS: translation and validation of the Malaysian version. Diabetes Res Clin Pract. 2010;90(2): 216–221. pmid:20832888
- 46. Krapek K, King K, Warren SS, George KG, Caputo DA, Mihelich K, et al. Medication adherence and associated hemoglobin A1c in type 2 diabetes. Ann Pharmacother. 2004;38(9): 1357–1362. pmid:15238621
- 47. Schectman JM, Nadkarni MM, Voss JD. The association between diabetes metabolic control and drug adherence in an indigent population. Diabetes Care. 2002;25(6): 1015–1021. pmid:12032108
- 48. Moons KG, Van Es GA, Deckers JW, Habbema JD, Grobbee DE. Limitations of sensitivity, specificity, likelihood ratio, and bayes' theorem in assessing diagnostic probabilities: a clinical example. Epidemiology. 1997;8(1): 12–17. pmid:9116087
- 49. Simel DL, Samsa GP, Matchar DB. Likelihood ratios with confidence: sample size estimation for diagnostic test studies. J Clin Epidemiol. 1991;44(8): 763–770. pmid:1941027
- 50. Goff SL, Mazor KM, Meterko V, Dodd K, Sabin J. Patients’ beliefs and preferences regarding doctors’ medication recommendations. J Gen Intern Med. 2007;23(3): 236–241.