Out of office blood pressure measurements, using either home monitors or 24 hour ambulatory monitoring, is widely recommended for management of hypertension. Though validation protocols, meant to be used by manufacturers, exist for blood pressure monitors, there is scant data in the literature about the accuracy of home blood pressure monitors in actual clinical practice. We performed a chart review in the blood pressure assessment clinic at a tertiary care centre.
We assessed the accuracy of home blood pressure monitors used by patients seen in the nephrology clinic in Ottawa between the years 2011 to 2014. We recorded patient demographics and clinical data, including the blood pressure measurements, arm circumference and the manufacturer of the home blood pressure monitor. The average of BP measurements performed with the home blood pressure monitor, were compared to those with the mercury sphygmomanometer. We defined accuracy based on a difference of 5 mm Hg in the blood pressure values between the home monitor and mercury sphygmomanometer readings. The two methods were compared using a Bland-Altman plot and a student’s t-test.
The study included 210 patients. The mean age of the study population was 67 years and 61% was men. The average mid-arm circumference was 32.2 cms. 30% and 32% of the home BP monitors reported a mean systolic and diastolic BP values, respectively, different from the mercury measurements by 5 mm Hg or more. There was no significant difference between the monitors that were accurate versus those that were not when grouped according to the patient characteristics, cuff size or the brand of the home monitor.
Citation: Ruzicka M, Akbari A, Bruketa E, Kayibanda JF, Baril C, Hiremath S (2016) How Accurate Are Home Blood Pressure Devices in Use? A Cross-Sectional Study. PLoS ONE 11(6): e0155677. https://doi.org/10.1371/journal.pone.0155677
Editor: Dominique Guerrot, Rouen University Hospital, FRANCE
Received: November 20, 2015; Accepted: May 3, 2016; Published: June 1, 2016
Copyright: © 2016 Ruzicka et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Due to ethical restrictions related to patient confidentiality, data are available after approval from the Ottawa Health Sciences Network Research Ethics Board for researchers who meet criteria for access to confidential data. Questions regarding this process may be directed to Swapnil Hiremath (firstname.lastname@example.org).
Funding: The authors have no support or funding to report.
Competing interests: The authors have declared that no competing interests exist.
Blood pressure (BP) measurement is the cornerstone for diagnosis and management of hypertension (HTN). Oscillometric BP devices, especially when used by patients at home, offer major advantages over the century old BP assessment by the mercury sphygmomanometer. Firstly, they reduce white coat and masked effect in diagnosis and management of HTN. Secondly, they improve the accuracy of the assessment of overall BP load by BP readings obtained at different times of the day. Finally, they improve patients’ adherence by involving their participation in the HTN management. Not surprisingly, home BP (HBP) monitoring has been reported to be a stronger predictor of cardiovascular morbidity and mortality than office BP measurements. A meta-analysis comparing a strategy of HBP and office BP measurement to guide therapy found that HBP monitoring resulted in a significantly lower BP. Thus many international guidelines recommend the HBP use in HTN management[5–8]. The worldwide reported use of home BP devices varies from 30–70% [9–11].
However, despite the widespread use of HBP monitors, little data exists on the accuracy of the monitors in use. Three standard protocols exist for BP device validation, published by the Association for the Advancement of Medical Instrumentation (AAMI), the British Hypertension Society (BHS) and the European Society of Hypertension respectively[12–14]. The Food and Drug Administration requires that the AAMI standard be used for validation while Hypertension Canada endorses an HBP monitor if validated by any one of the three protocols. However, these protocols are meant for pre-licensing commercial validation, and few reports exist of real world accuracy of HBP monitors. These few studies do report a wide range of inaccuracy (10 to 69%), and are mostly from over a decade ago, from an older generation of monitors[16–18]. In addition, similar to other instruments used in clinical medicine, HBP devices might lose their original safety and accuracy over time. However no recommendation with regards to re-validation process of safety and accuracy of home BP monitors exists.
At our centre, we have been conducting a BP assessment clinic for follow up of hypertensive patients from the nephrology program, with the purpose of providing education about BP management, lifestyle modifications, and to guide self-measurement. Given the importance of home measurement of BP, and the concerns of accuracy, we undertook a chart review with a goal of assessing the accuracy of home BP monitors in our population, and to identify factors that are associated with accuracy of these monitors.
Material and Methods
A chart review of all patients referred to and seen in the BP assessment clinic from July 1 2011 to Apr 30th 2014 was performed. Only patients who did bring in a home BP monitor to their clinic visit were included in this study. For those who had multiple visits, we only included data from the first visit.
From an electronic database, the chart review involved data abstraction of patient demographics and clinical data, including details of the BP measurements (mercury and home monitor), arm circumference, and also the manufacturer of the HBP monitor. Institutional review board approval, from the Ottawa Health Sciences Research Ethics Board (20140619-01H) was obtained prior to conducting the chart review. Patient records were de-identified prior to analysis. Informed consent was waived given this was a retrospective chart review using de-identified data.
The BP measurements are all taken in a quiet clinic room, after a minimum of 5 minutes of resting. The mercury sphygmomanometer readings are done using a calibrated machine, and by a registered nurse (RN) trained to follow the standardized protocol of the Canadian Coalition for High Blood Pressure Prevention and Control. After measurement of the patients arm circumference, a proper sized cuff is chosen for the mercury measurement. Similarly, the cuff size of the home monitor is checked to be appropriate before proceeding with the measurements. All measurements are taken with the patient sitting upright with a proper back support and with feet uncrossed and placed flat on the floor. The patient’s arm is supported on a table or firm surface. Firstly, on bare arms, mercury readings are taken on both arms to determine if the BP is equal in both arms. The heart rate and the absence of any arrhythmia are confirmed before proceeding. If the BP readings are within 5 mm Hg, the manual cuff is placed on one arm and the home BP cuff on the other arm. Three simultaneous BP measurements are taken by the RN, with one minute wait in between readings, and averaged. If the BP in the two arms varies by more than 5 mm Hg, it is confirmed once again, and once confirmed, 6 sequential measurements are taken in the arm with the higher BP, with three measures using the mercury alternating with three with the home monitor.
In our analysis, we first compared the average of the three measurements with the mercury and the three measurements with the home monitor. A difference of 5 mm Hg in the systolic BP (i.e. either 5 mm Hg or higher, or 5 mm Hg or lower reading with the home monitor compared with mercury) was considered inaccurate. We compared the individual measurements using a Bland-Altman analysis. We also compared average of BP measurement recorded with home BP devices were against the average of BP measurement recorded with mercury device using a student’s t-test. In addition, we performed a comparison of the patient and device characteristics between accurate and inaccurate devices using the chi-square test for nominal variables and the t-test for continuous variables. Lastly, we report inaccuracy also using less stringent criteria of a difference of 10 mm Hg and 20 mm Hg for the systolic BP, and inaccuracy using 5, 10 and 20 mm Hg for the diastolic BP. A p value < 0.05 was considered statistically significant. All analysis was carried out using JMP (version 8.0.1, SAS Inc, Cary NC).
376 patient-visits occurred over the study period. 3 patients had home BP devices with mis-match between the cuff size and arm circumference; the nurse did not assess for accuracy of the home BP device in these cases and provided a recommendation to obtain the correct cuff size. These three patients did return with the correct cuff size at a subsequent appointment, and the measurements from that appointment were used in the analysis. After excluding patients who did not bring a home monitor, patients with repeat visits and encounters with missing data, we had data available on 210 patients and home monitors (Fig 1).
About 60% of the study population was men, with a mean age of 67 years (details in Table 1). The average mid-arm circumference was 32.2 cms. The Omron brand (Omron Healthcare, Toronto, Canada) was the most popular, used in just over half the cases. The overall mean systolic as well as diastolic BP measured with mercury was significantly lower than the HBP monitor measurements (p = 0.02).
30% (63 of 210) of the home BP monitors reported mean systolic BP values which were 5 mm Hg or more different from the mercury measurements. There was no significant difference between the monitors that were accurate versus those that were not when grouped according to the patient characteristics, cuff size or the brand of the home monitor (Table 2). The absolute difference in the diastolic blood pressure was significantly higher with the devices that were inaccurate for systolic BP than in the accurate devices.
For diastolic BP, 67 monitors (32%) reported mean values that were 5 mm Hg or more different than the mercury. Patients with inaccurate devices were more likely to be older men, however there was no significant difference between the other patient characteristics, cuff size or the brand of the home monitor (Table 3). The absolute difference in the systolic blood pressure was significantly higher with the devices that were inaccurate for diastolic BP than in the accurate devices.
Using a different threshold for accuracy (difference more than 10 mm Hg), 16 of 210 (8%) HBP monitors were inaccurate for systolic BP and 18 (9%) for diastolic BP. Four of 210 HBP monitors (2%) were inaccurate using the 20 mm Hg threshold, for both systolic and diastolic BP. The inter-arm difference in BP was more than 5 mm Hg in 28% of the patients, in whom the accuracy comparison was measured by sequential rather than simultaneous measurements. Sensitivity analysis grouping them by sequential (34% inaccuracy) versus simultaneous (30% inaccuracy) measurement did not find a significant difference.
The Bland-Altman analysis is presented in Fig 2. The 95% limits of agreement were -13, +11 mm Hg for systolic BP and -13, +8 mm Hg for diastolic BP. The difference in BP values was spread across the entire range of BP, with no trend of inaccuracy with increasing (or decreasing) blood pressure. Scatterplots to demonstrate the correlation between the blood pressures are presented in Fig 3.
Lines are drawn, for illustration purposes only, through a threshold of 140 mm Hg (for systolic) and 80 mm Hg (for diastolic).
Additional analyses conducted between the inaccurate home BP devices that underestimated SBP (N = 25) by more than 5 mm Hg and those that overestimated SBP (N = 38) by more than 5 mm Hg are presented in Table 4. The patients in whom the home BP device overestimated SBP by more than 5 mm Hg were more likely to be men, with a greater BMI, arm and waist circumference and needing a correspondingly larger cuff compared to those that underestimated SBP. In addition, there was a difference in the device brand, with Omron devices more likely to overestimate BP and A&D/Life source more likely to underestimate BP.
In this cross-sectional study with 210 patients and HBP monitors, we report a relatively high proportion of inaccurate HBP monitors. Though in the majority of the HBP monitors, the difference between readings by auscultation technique using mercury sphygmomanometer and by the automated oscillometric HBP device was small (<5 mmHg), in a disturbingly high proportion, the differences were greater than 5 mm Hg. These large differences between the measurements could have an adverse impact on the diagnosis and management of HTN. We therefore believe that we have identified a significant gap in the HBP monitoring process which needs to be further investigated, and if confirmed, addressed.
Similar to our findings, previous studies have also showed a significant proportion of inaccurate home BP devices [16–18, 22–28]. However, differences in methodologies used in these past studies including the generation of HBP monitors assessed, threshold used to determine inaccuracy, type and number of observers who assessed the accuracy limit the comparison of our results to those reported by these studies. For example, in a Canadian study published in 2001, Campbell et al. observed that 35% of home BP devices were inaccurate based on a threshold difference of 4 mmHg or more between BP values recorded by home BP devices and those indicated by mercury sphygmomanometer . In USA, Merrick et al reported that 34% of home BP monitors have recorded BP values out of a threshold difference of 10mmHg in comparison with BP values indicated by a mercury sphygmomanometer. In this study published in 1997, the comparison was between measurements taken by the patient compared to those by a technician, with a significant proportion of aneroid machines included in the mix . In 1984, Hahn et al report an 11% inaccuracy proportion using a 7 mm Hg threshold, however, again with mostly aneroid monitors (only 4% digital monitors). Studies from other countries have also reported a higher proportion of home BP monitors that were inaccurate. In Turkey, Dilek et al showed that 59.3% of home BP monitors were inaccurate  and Wong et al in China observed that errors for systolic and diastolic BP readings occurred in 62% and 64% of home BP monitors respectively.
Our study has several major strengths compared to the previous data. The evaluation process took place in the tertiary care hospital-based HTN clinic attended by a nurse specialized and trained in the management of patients with HTN, thus minimizing human error in BP measurement. Secondly, our evaluation process included repeated simultaneous measurements of BP by mercury sphygmomanometer and HBP monitor. In addition, we identified that there are differences in patient (more men with higher BMI) and device (brand) characteristics which overestimate SBP in comparison to those that underestimate SBP. Lastly, the results did not vary meaningfully with sensitivity analyses, and were consistent using different thresholds.
Our study does have also certain limitations. Firstly, we have information on the brand of the HBP, but not series or model numbers to determine their validation status. In addition, we were unable to track the age of the each individual device. Thus we cannot comment on whether and to what extent the age of the device plays a role in the accuracy of measurements. Secondly, our study was designed as retrospective analysis of collected data, and as much as the results are provocative, they should be interpreted with caution. Third, as the measurements were done in routine clinical practice, only one RN measured the BP. However, the agreement between the home BP monitor and the manual measurements may have been exaggerated given that the RN was not blinded to the previous device readings, thus any bias, if present, would be towards the null, thus making our findings of inaccuracy more robust. The differences that we report between devices that overestimate SBP and those that underestimate SBP are subject to multiple comparison fallacy, and hence should be considered hypothesis generating, though worthy of more studies. Lastly, it is possible that there could be selection bias in the overall study, since the study could only include data on patients who did monitor BP at home and were willing to bring it in for the clinic visit.
In conclusion, we believe that we have identified a significant gap in the HBP monitoring process which needs to be further investigated, and if confirmed, addressed. In fact our study raises the issues relating to the re-validation of the accuracy and safety of the devices already in use. Currently standard international protocols developed by the Association for the Advancement of Medical Instrumentation (AAMI) , the British Hypertension Society (BHS)  and the European Society of Hypertension  exist for pre-licensing commercial validation of BP devices. The validation methods proposed by these protocols are difficult to implement in a routine clinical care especially because they are time consuming and require more technicians to perform. Thus, there is a lack of a process of re-validation of the accuracy and safety of the devices already in use. This leaves the patient and the health care practitioner with unanswered questions of where and how frequently HBP device needs to be re-validated. In the worst case, the treatment decision on HTN management would be based on possibly inaccurate measurements from home BP devices.
Home BP monitoring can improve the accuracy of HTN diagnosis, and be quite valuable for HTN management. However, the overall benefit from HBP monitoring can be offset by inaccuracy of the device itself. The magnitude of this inaccuracy in specific cases could indeed lead to an adverse impact in management of HTN. Thus, increased awareness and detection of this phenomenon is warranted.
Conceived and designed the experiments: MR AA EB JFK CB SH. Performed the experiments: MR AA EB JFK CB SH. Analyzed the data: MR AA EB JFK CB SH. Contributed reagents/materials/analysis tools: MR AA EB JFK CB SH. Wrote the paper: MR AA EB JFK CB SH.
- 1. Ogedegbe G, Pickering T. Principles and techniques of blood pressure measurement. Cardiol Clin. 2010;28(4):571–86. Epub 2010/10/13. S0733-8651(10)00086-X [pii]. pmid:20937442; PubMed Central PMCID: PMC3639494.
- 2. Pickering TG, White WB. When and how to use self (home) and ambulatory blood pressure monitoring. J Am Soc Hypertens. 2008;2(3):119–24. Epub 2008/05/01. S1933-1711(08)00047-8 [pii]. pmid:20409893.
- 3. Ward AM, Takahashi O, Stevens R, Heneghan C. Home measurement of blood pressure and cardiovascular disease: systematic review and meta-analysis of prospective studies. J Hypertens. 2012;30(3):449–56. Epub 2012/01/14. pmid:22241136.
- 4. Agarwal R, Bills JE, Hecht TJ, Light RP. Role of home blood pressure monitoring in overcoming therapeutic inertia and improving hypertension control: a systematic review and meta-analysis. Hypertension. 2011;57(1):29–38. Epub 2010/12/01. HYPERTENSIONAHA.110.160911 [pii]. pmid:21115879.
- 5. Dasgupta K, Quinn RR, Zarnke KB, Rabi DM, Ravani P, Daskalopoulou SS, et al. The 2014 Canadian Hypertension Education Program recommendations for blood pressure measurement, diagnosis, assessment of risk, prevention, and treatment of hypertension. Can J Cardiol. 2014;30(5):485–501. Epub 2014/05/03. S0828-282X(14)00070-1 [pii]. pmid:24786438.
- 6. Mancia G, Fagard R, Narkiewicz K, Redon J, Zanchetti A, Bohm M, et al. 2013 ESH/ESC Guidelines for the management of arterial hypertension: the Task Force for the management of arterial hypertension of the European Society of Hypertension (ESH) and of the European Society of Cardiology (ESC). J Hypertens. 2013;31(7):1281–357. Epub 2013/07/03. 00004872-201307000-00002 [pii]. pmid:23817082.
- 7. Shimamoto K, Ando K, Fujita T, Hasebe N, Higaki J, Horiuchi M, et al. The Japanese Society of Hypertension Guidelines for the Management of Hypertension (JSH 2014). Hypertens Res. 2014;37(4):253–390. Epub 2014/04/08. hr201420 [pii]. pmid:24705419.
- 8. Weber MA, Schiffrin EL, White WB, Mann S, Lindholm LH, Kenerson JG, et al. Clinical practice guidelines for the management of hypertension in the community a statement by the American Society of Hypertension and the International Society of Hypertension. J Hypertens. 2014;32(1):3–15. Epub 2013/11/26. pmid:24270181.
- 9. Bancej CM, Campbell N, McKay DW, Nichol M, Walker RL, Kaczorowski J. Home blood pressure monitoring among Canadian adults with hypertension: results from the 2009 Survey on Living with Chronic Diseases in Canada. Can J Cardiol. 2010;26(5):e152–7. Epub 2010/05/21. pmid:20485694; PubMed Central PMCID: PMC2886560.
- 10. Baral-Grant S, Haque MS, Nouwen A, Greenfield SM, McManus RJ. Self-Monitoring of Blood Pressure in Hypertension: A UK Primary Care Survey. Int J Hypertens. 2012;2012:582068. Epub 2011/10/21. pmid:22013510; PubMed Central PMCID: PMC3195273.
- 11. Little P, Barnett J, Barnsley L, Marjoram J, Fitzgerald-Barron A, Mant D. Comparison of acceptability of and preferences for different methods of measuring blood pressure in primary care. BMJ. 2002;325(7358):258–9. Epub 2002/08/03. pmid:12153924; PubMed Central PMCID: PMC117641.
- 12. Association for the Advancement of Medical Instrumentation A. American National Standard. Manual, electronic or automated sphygmomanometers. 3330 Washington Boulevard, Suite 400, Arlington, VA 22201–4598, USA: AAMI; 2003. 3330 Washington Boulevard, Suite 400, Arlington, VA 22201–4598, USA: Association for the Advancement of Medical Instrumentation.; 2003.
- 13. O'Brien E, Petrie J, Littler W, de Swiet M, Padfield PL, O'Malley K, et al. The British Hypertension Society protocol for the evaluation of automated and semi-automated blood pressure measuring devices with special reference to ambulatory systems. J Hypertens. 1990;8(7):607–19. Epub 1990/07/01. pmid:2168451.
- 14. O'Brien E, Pickering T, Asmar R, Myers M, Parati G, Staessen J, et al. Working Group on Blood Pressure Monitoring of the European Society of Hypertension International Protocol for validation of blood pressure measuring devices in adults. Blood Press Monit. 2002;7(1):3–17. Epub 2002/06/01. pmid:12040236.
- 15. FDA UFaDA. Non-Invasive Blood Pressure (NIBP) Monitor Guidance (Text Only) 1997 [cited 2015 02/27]. Available from: http://www.fda.gov/MedicalDevices/DeviceRegulationandGuidance/GuidanceDocuments/ucm080219.htm.
- 16. Hahn LP, Folsom AR, Sprafka JM, Prineas RJ. Prevalence and accuracy of home sphygmomanometers in an urban population. Am J Public Health. 1987;77(11):1459–61. Epub 1987/11/01. pmid:3661803; PubMed Central PMCID: PMC1647089.
- 17. Merrick RD, Olive KE, Hamdy RC, Landy C, Cancellaro V. Factors influencing the accuracy of home blood pressure measurement. South Med J. 1997;90(11):1110–4. Epub 1997/12/31. pmid:9386053.
- 18. Stryker T, Wilson M, Wilson TW. Accuracy of home blood pressure readings: monitors and operators. Blood Press Monit. 2004;9(3):143–7. Epub 2004/06/17. 00126097-200406000-00007 [pii]. pmid:15199308.
- 19. Abbott D, Campbell N, Carruthers-Czyzewski P, Chockalingam A, David M, Dunkley G, et al. Guidelines for measurement of blood pressure, follow-up, and lifestyle counselling. Canadian Coalition for High Blood Pressure Prevention and Control. Can J Public Health. 1994;85 Suppl 2:S29–43. Epub 1994/09/01. pmid:7804948.
- 20. Jones DW, Appel LJ, Sheps SG, Roccella EJ, Lenfant C. Measuring blood pressure accurately: new and persistent challenges. JAMA. 2003;289(8):1027–30. Epub 2003/02/25. jco20143 [pii]. pmid:12597757.
- 21. Bland JM, Altman DG. Comparing methods of measurement: why plotting difference against standard method is misleading. Lancet. 1995;346(8982):1085–7. Epub 1995/10/21. S0140-6736(95)91748-9 [pii]. pmid:7564793.
- 22. Akpolat T. Proposal of a method for the evaluation of inaccuracy of home sphygmomanometers. Blood Press Monit. 2009;14(5):208–15. Epub 2009/09/12. pmid:19745725.
- 23. Akpolat T, Aydogdu T, Erdem E, Karatas A. Inaccuracy of home sphygmomanometers: a perspective from clinical practice. Blood Press Monit. 2011;16(4):168–71. Epub 2011/09/21. pmid:21928543.
- 24. Akpolat T, Dilek M, Aydogdu T, Adibelli Z, Erdem DG, Erdem E. Home sphygmomanometers: validation versus accuracy. Blood Press Monit. 2009;14(1):26–31. Epub 2009/02/05. pmid:19190492.
- 25. Campbell NR, Milkovich L, Burgess E, McKay DW. Self-measurement of blood pressure: accuracy, patient preparation for readings, technique and equipment. Blood Press Monit. 2001;6(3):133–8. Epub 2001/08/24. pmid:11518835.
- 26. Cuspidi C, Meani S, Lonati L, Fusi V, Magnaghi G, Garavelli G, et al. Prevalence of home blood pressure measurement among selected hypertensive patients: results of a multicenter survey from six hospital outpatient hypertension clinics in Italy. Blood pressure. 2005;14(4):251–6. pmid:16126560.
- 27. Dilek M, Adibelli Z, Aydogdu T, Koksal AR, Cakar B, Akpolat T. Self-measurement of blood pressure at home: is it reliable? Blood Press. 2008;17(1):34–41. Epub 2008/06/24. 787844983 [pii]. pmid:18568690.
- 28. Wong WC, Shiu IK, Hwong TM, Dickinson JA. Reliability of automated blood pressure devices used by hypertensive patients. J R Soc Med. 2005;98(3):111–3. Epub 2005/03/02. 98/3/111 [pii] pmid:15738553; PubMed Central PMCID: PMC1079411.
- 29. Instrumentation AftAoM. American National Standard for Electronic or Automated Sphygmomanometers: ANSI/AAMI SP10–1993. Arlington,VA: AAMI; 1993: 1993.
- 30. O'Brien E, Atkins N, Stergiou G, Karpettas N, Parati G, Asmar R, et al. European Society of Hypertension International Protocol revision 2010 for the validation of blood pressure measuring devices in adults. Blood pressure monitoring. 2010;15(1):23–38. pmid:20110786.