http://orcid.org/0000-0001-7357-9760
Figures
Abstract
Background
Right ventricular (RV) dysfunction caused by acute pulmonary embolism (PE) is associated with poor short- and long-term prognosis. RV dilatation as a proxy for RV dysfunction can be assessed by calculating the right-to-left ventricle diameter (RV/LV) ratio on standard computed tomography pulmonary angiography (CTPA) images. It is unknown whether dedicated training is required to accurately and reproducibly measure RV/LV ratio therefore we aimed to assess these parameters in residents in internal medicine without experience in CTPA reading.
Methods
CTPA images of 100 patients with PE were assessed by three residents after single instruction, and one experienced thoracic radiologist. Maximum diameters were evaluated in the axial view by measuring the distance between the ventricular endocardium and the interventricular septum, perpendicular to the long axis of the heart. RV dilatation was defined as a ratio of ≥1.0. Interobserver accuracy and reproducibility was determined using Kappa statistics, Bland-Altman analysis and Spearman's rank correlation.
Results
The kappa statistic for the presence of RV dilatation of the residents compared to the experienced radiologist ranged from 0.83–0.94. The average interobserver difference in calculated RV/LV ratio’s (±SD) between the three residents was: -0.01 (SD0.11), 0.07 (SD0.14) and 0.06 (SD0.18) with an overall mean RV/LV diameter ratio of 1.04. In line with this, Spearman's rank correlation coefficients were 0.92, 0.88 and 0.85 respectively indicating very good correlation (p<0.01 for all).
Citation: Ende-Verhaar YM, Kroft LJM, Mos ICM, Huisman MV, Klok FA (2017) Accuracy and reproducibility of CT right-to-left ventricular diameter measurement in patients with acute pulmonary embolism. PLoS ONE 12(11): e0188862. https://doi.org/10.1371/journal.pone.0188862
Editor: Christophe Leroyer, Universite de Bretagne Occidentale, FRANCE
Received: September 7, 2017; Accepted: November 14, 2017; Published: November 28, 2017
Copyright: © 2017 Ende-Verhaar et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Right ventricular (RV) dysfunction caused by acute pulmonary embolism (PE) is associated with poor short and long-term prognosis, i.e. higher risk of PE related mortality and chronic thromboembolic pulmonary hypertension (CTEPH) [1–3]. Several methods to determine RV dysfunction have been proposed and validated [4, 5]. RV dilatation based on right-to-left ventricle (RV/LV) diameter ratio on computed tomographic pulmonary angiography (CTPA) as a measure of RV dysfunction correlates well with echocardiographic parameters [6–8]. RV dilatation on CTPA has been shown to predict a higher 30-day mortality risk (OR 2.08; 95% confidence interval (CI) 1.63–2.66) in 4661 patients presenting with PE and even in 2254 haemodynamically stable patients (OR 1.64; 95%CI 1.06–2.52) [9]. The advantage of RV/LV diameter ratio measurement on CTPA compared to echocardiography is that it obviates the need of a second imaging test in addition to the diagnostic test applied to confirm the PE diagnosis.
International guidelines do not recommend standard RV/LV diameter ratio measurement in all patients with acute PE, although the initial risk assessment of PE also involves the measurement of RV function [1, 10]. Specifically, the presence of RV dysfunction as well as of biomarkers of cardiac overload and ischemia help differentiating between patients at intermediate-low risk of adverse outcome and patients at intermediate-high risk. The latter is an indication for close hemodynamic monitoring due to the 5.6% risk of hemodynamic deterioration in the first days after diagnosis [11]. RV/LV diameter ratio assessment may thus be useful in day-to-day clinical practice and especially in circumstances that echocardiography is not readily available.
The inter- and intra-observer agreement and reproducibility of RV/LV diameter ratio measurement by trained radiologists is reported to be very good with a Cohen’s Kappa statistic ranging from 0.80 to 0.87 [12–15]. The accuracy and reproducibility of RV/LV diameter ratio measurements by non-radiologist clinicians without dedicated training and expertise in CT reading is unknown. We aimed to assess the accuracy and reproducibility of CTPA RV/LV diameter ratio measurement by three residents in internal medicine without prior dedicated training in CT reading.
Methods
Study population
This is a post hoc analysis of a previously published observational prospective outcome study aimed at assessing the incremental value of ventricular function measurement with ECG-synchronized cardiac CTPA scanning over standard CTPA measured RV/LV ratio for predicting the short term prognosis in patients with acute PE [16, 17]. Consecutive, normotensive patients with suspected acute PE, based on a likely clinical probability by the Wells rule and/or an abnormal D-dimer test, were eligible for inclusion. Patients with renal function impairment, age < 18 years, pregnancy or allergy to contrast were excluded. A total of 430 consecutive haemodynamic stable patients were included and underwent standard CTPA and ECG-synchronized cardiac CT scanning, of whom 113 (26%) were diagnosed with acute PE [16, 17]. For the current analysis, the first 100 consecutive patients with confirmed PE were selected. Institutional review board (IRB) approval was obtained and written informed consent provided by all patients for the original study. The IRB of the LUMC waived the need for informed consent for this post-hoc analysis.
CTPA reading
The standard CTPA scans were reviewed chronologically by one expert thoracic radiologist (reviewer 1 (L.K)) with over 15 years of experience in pulmonary CTPA reading, two residents (reviewer 2 and 4 (Y.E-V and I.M)) and one senior resident with experience in VTE research (reviewer 3 (F.K.)), without specific training in CTPA reading. The experienced thoracic radiologist provided the following written instructions to the three residents: 1) evaluate the ventricle diameters in the standard axial view, 2) Measure the maximal distance between the ventricular endocardium and the interventricular septum, perpendicular to the long axis of the heart, and 3) Use the maximum dimensions for both ventricles which may be found at different levels [12, 18]. In addition one RV/LV diameter ratio measurement was demonstrated (Fig 1). All four reviewers were blinded to the findings of the other reviewers. RV dilatation was defined as a RV/LV diameter ratio of ≥1.0 [1].
Note: CTPA: computed tomography pulmonary angiography; RV/LV: right-to left ventricle diameter ratio in this patient was 1.4.
Study aim
The primary aim of the study was to evaluate the accuracy of assessing the presence or absence of RV dilatation, defined as an RV/LV diameter ratio of ≥1.0, by three residents in internal medicine without dedicated training in CT reading compared to the ruling of an experienced thoracic radiologist. The secondary aims of the study were to compare mean differences in the measured RV/LV diameter ratio in the individual study patients between the three residents internal medicine.
The primary endpoint was the kappa statistic for the presence or absence of RV dilatation measured by the three residents compared to the experienced thoracic radiologist. The secondary endpoint was the correlation coefficient between RV/LV ratio measurements among the three residents.
Statistical analysis
Based on previous studies on this subject, we set our sample size at 100 CTPAs [12–15]. Baseline characteristics of the patients are provided with corresponding frequencies. Interobserver reproducibility for the dichotomous variable, i.e. a RV/LV diameter ratio of ≥ 1.0, of the thoracic radiologist compared to each of the three residents and among the residents was determined by using Cohen’s kappa-statistics. The kappa value for agreement was interpreted as follows: poor (< 0.20), fair (0.21–0.40), moderate (0.41–0.60), good (0.61–0.80) or very good (0.81–1.00) [19]. Further, Bland and Altman plots were used to represent the mean difference between the RV/LV diameter ratio measurements by the three residents [20]. We predefined adequate interobserver agreement on the Bland and Altman plot by a mean difference between 2 readers <0.1. Correlations between the measurements in individual patients were determined by Spearman's rank correlation. A correlation coefficient of 1 indicates a positive correlation while a coefficient of 0 represents no correlation. All analyses were performed using SPSS software version 23 for Windows IBM Corporation.
Results
Patients
One-hundred haemodynamically stable consecutive patients diagnosed with symptomatic acute PE were selected for the current analysis [16, 17]. Patient characteristics are provided in Table 1. Their mean age was 55 ± 16 years and 51 (51%) of the patients were male. Twenty-one patients (21%) had a history of venous thromboembolism, 38 patients (38%) had an unprovoked PE (bases on the absence of immobility, recent surgery, postpartum period or use of oral contraceptives or active malignancy). Twenty-four (24%) had an active malignancy.
Accuracy of the RV/LV diameter ratio assessment
According to the measurement of the experienced radiologist, the RV was dilated (RV/LV diameter ratio of ≥1.0) in 42 CTPA scans, and the RV was not enlarged in 58 scans. Each resident individually measured the RV/LV diameter ratio of 93 (93%; 95%CI 86–97), 97 (97%; 95%CI 91–99) and 92 (92%; 95%CI 85–96) CTPA scans in accordance with the experienced radiologist resulting in a Cohen Kappa statistic of 0.86 (95%CI 0.75–0.96), 0.94 (95%CI 0.87–1.00) and 0.83 respectively (95%CI 0.72–0.94) (Table 2). The Cohen Kappa statistics between the residents internal medicine were 0.88 (95%CI 0.78–0.97; Reviewer 2 –Reviewer 3), 0.85 (95%CI 0.75–0.96; Reviewer 2 –Reviewer 4) and 0.85 (95%CI 0.75–0.96; Reviewer 3 –Reviewer 4). All discrepancies between the 3 residents concerned patients with RV/LV diameter ratio close to 1.0 (S1 Table).
Interobserver variability among the three residents internal medicine
The average RV/LV diameter ratio in the 100 measured CTPA scans by the three residents internal medicine was 1.06 (standard deviation(SD) 0.35), 1.07 (SD 0.29) and 1.00 (SD 0.26) respectively. On Bland Altman analysis, the mean difference in the calculated RV/LV diameter ratio’s (±SD) was -0.01 (SD0.11) (reviewer 2 and 3), 0.06 (SD0.18) (reviewer 2 and 4) and 0.07 (SD0.14) (reviewer 3 and 4) (Fig 2). The Spearman's rank correlation coefficient was 0.92, 0.88 and 0.85 respectively (p<0.001 for all). The outlines in the Bland Altman plots were all in patients with RV/LV diameter ratio of larger than 1.5, i.e. those patients in whom RV overload is undoubtedly present. The differences in the RV/LV diameter ratio in these patients were mainly caused by variance in identification of the wall of the ventricular endocardium.
Fig 2a reviewer 2 and 3, fig 2b reviewer 2 and 4, fig 2c reviewer 3 and 4. Note: RV/LV: right-to left ventricle diameter ratio.
Discussion
With the results of this study, we have shown that after a single focussed instruction, residents internal medicine without dedicated training and expertise in CT reading were able to accurately determine the presence or absence of RV dilatation as defined by a RV/LV diameter ratio of ≥ 1.0 on CTPA images in patients diagnosed with acute PE. Also, the mean difference in calculated RV/LV diameter ratio’s by the residents was very low (-0.01, 0.07 and 0.06 respectively), which was underlined by the very good correlation from the Spearman’s rank test (0.92, 0.88 and 0.85 respectively (p<0.01 for all)).
RV dilatation on CTPA is an indicator of RV dysfunction that can be useful in selecting PE patients with a high risk of an adverse short and long term outcome [1]. Even in haemodynamically stable patients, it has been clearly shown (OR of 1.64 (95%CI 1.06–2.52)) that an enlarged RV/LV diameter ratio on CTPA is associated with an increased risk of death at 30 days [9]. As for the long term prognosis, right ventricular dilatation at the moment of a PE diagnosis is an independent risk factor for CTEPH with a reported OR of 4.1 (95%CI 1.4–12) [2]. Alternative methods to assess RV dysfunction such as echocardiography are more time consuming, expensive and may not be available around the clock in all hospitals. With CTPA being the most commonly used method to diagnose acute PE, it is likely that this is the most simple and economic method to assess cardiac function at moment of diagnosis as well as post-hoc when patients visit the outpatient clinic for counselling on their long term prognosis.
Previous studies reported a good to very good inter- and intra-agreement on the CTPA RV/LV diameter ratio measurement between experienced radiologists (Table 3) using axial images. In four studies that evaluated a total of 393 patients with PE, the Cohen’s Kappa statistic for CT assessment of the presence of RV overload has ranged from 0.80 to 0.87 for trained radiologists with 5 to over 10 years of experience [12–15]. The first study retrospectively evaluated 61 unselected PE patients including 12 patients with massive PE and reported a kappa of at least 0.83 [13]. The remaining three studies were restricted to haemodynamic stable patients, with kappa statistics between 0.8 and 0.87 [12, 14, 15]. A fifth study evaluated the agreement between an experienced radiologist and a clinical physician with experience in CTPA reading for PE. In this study 460 unselected PE patients were included of which 49 were haemodynamically instable. The kappa statistic for a RV/LV diameter ratio of ≥0.9 was 0.88 [21].
Two further studies assessed differences in the measured ratios using axial images. In the first study 96 haemodynamically stable patients were evaluated by trained and certified radiologists whose measurements of the RV/LV ratio differed only 0.03 (SD 0.23) on average [12]. The second study included 50 unselected PE patients, of whom 10 were haemodynamically instable, and found a mean difference of the measured ratios of 0.01 (SD 0.20) between 2 radiologists with 3 and 6 years of experience [22]. A final five studies covering a total of 444 PE patients whose CTPA images were read by radiologists with 3–12 years of experience, reported Spearman rank or intra-class correlation coefficients of 0.72 to 0.98 (P<0.001 for all), indicating a clear correlation between the measured ratio’s [13, 15, 22–24].
One earlier study described the interobserver agreement between radiologists and clinicians without specific training in chest CT reading [25]. This study described the interobserver agreement of the RV/LV diameter ratio on 113 CTPA scans of patients with suspected acute PE between two radiologists with 14 and 15 years of experience and inexperienced radiology residents [25]. The inter-reader variability as assessed by using interclass coefficients was 0.95.
To our knowledge, this study is the first study evaluating the accuracy and reproducibility of CTPA RV/LV diameter ratio measurement in PE patients by residents in internal medicine who did not have dedicated training or expertise in CT reading. This is relevant for daily clinical practice because in many cases clinical residents internal medicine, cardiology, pulmonology or emergency medicine are responsible for both the initial risk assessment and treatment as well as long term follow-up of patients with PE. This simple method is of help to the clinician in identifying the patient presenting with acute PE who is at higher risk of mortality in the acute moment [9] and on the long term of the development of CTEPH [2].
The main limitation of this study is that other signs of RV failure on CTPA such as enlargement of the pulmonary truncus and backflow of contrast in the vena cava were not studied but may be relevant as well in the evaluation of RV function on CTPA. Only haemodynamically stable patients were included making our results only applicable to that patient category. The RV/LV diameter ratio depends on the diameter of the LV as well. In patients with a pathologically enlarged LV, as was present in 3 patients of this current analysis, RV dilatation based on RV/LV diameter ratio could have been missed. This was a post hoc analysis of patients diagnosed with PE in our centre from an observational multicenter study. Therefore, a formal power analysis was not performed and the sample size was based on previous studies on this subject (Table 3). Also, three residents internal medicine were selected to perform all measurements. We did not formally prove that our results can be translated to residents from other hospitals or countries, or from other specialties (cardiology, pulmonology), although we would not expect relevant differences.
In conclusion, the presence of RV dilatation on CTPA in patients with acute PE were accurately assessed by clinical residents without dedicated training in CT reading but after simple instruction. This is of help in identifying PE patients at higher risk of short and long term adverse outcome.
References
- 1. Konstantinides SV, Torbicki A, Agnelli G, Danchin N, Fitzmaurice D, Galie N, et al. 2014 ESC guidelines on the diagnosis and management of acute pulmonary embolism. European heart journal. 2014;35(43):3069a-k. Epub 2014/09/01. pmid:25173341.
- 2. Klok FA, Dzikowska-Diduch O, Kostrubiec M, Vliegen HW, Pruszczyk P, Hasenfuss G, et al. Derivation of a clinical prediction score for chronic thromboembolic pulmonary hypertension after acute pulmonary embolism. Journal of thrombosis and haemostasis: JTH. 2016;14(1):121–8. Epub 2015/10/29. pmid:26509468.
- 3. Sanchez O, Trinquart L, Colombet I, Durieux P, Huisman MV, Chatellier G, et al. Prognostic value of right ventricular dysfunction in patients with haemodynamically stable pulmonary embolism: a systematic review. European heart journal. 2008;29(12):1569–77. Epub 2008/05/23. pmid:18495689.
- 4. Coutance G, Cauderlier E, Ehtisham J, Hamon M, Hamon M. The prognostic value of markers of right ventricular dysfunction in pulmonary embolism: a meta-analysis. Critical care (London, England). 2011;15(2):R103. Epub 2011/03/30. pmid:21443777; PubMed Central PMCID: PMCPmc3219376.
- 5. Galie N, Humbert M, Vachiery JL, Gibbs S, Lang I, Torbicki A, et al. 2015 ESC/ERS Guidelines for the diagnosis and treatment of pulmonary hypertension: The Joint Task Force for the Diagnosis and Treatment of Pulmonary Hypertension of the European Society of Cardiology (ESC) and the European Respiratory Society (ERS): Endorsed by: Association for European Paediatric and Congenital Cardiology (AEPC), International Society for Heart and Lung Transplantation (ISHLT). The European respiratory journal. 2015;46(4):903–75. Epub 2015/09/01. pmid:26318161.
- 6. Ozsu S, Karaman K, Mentese A, Ozsu A, Karahan SC, Durmus I, et al. Combined risk stratification with computerized tomography /echocardiography and biomarkers in patients with normotensive pulmonary embolism. Thrombosis research. 2010;126(6):486–92. Epub 2010/10/06. pmid:20920821.
- 7. Aribas A, Keskin S, Akilli H, Kayrak M, Erdogan HI, Guler I, et al. The use of axial diameters and CT obstruction scores for determining echocardiographic right ventricular dysfunction in patients with acute pulmonary embolism. Japanese journal of radiology. 2014;32(8):451–60. Epub 2014/05/14. pmid:24819998.
- 8. Park JR, Chang SA, Jang SY, No HJ, Park SJ, Choi SH, et al. Evaluation of right ventricular dysfunction and prediction of clinical outcomes in acute pulmonary embolism by chest computed tomography: comparisons with echocardiography. The international journal of cardiovascular imaging. 2012;28(4):979–87. Epub 2011/07/01. pmid:21717126.
- 9. Becattini C, Agnelli G, Germini F, Vedovati MC. Computed tomography to assess risk of death in acute pulmonary embolism: a meta-analysis. The European respiratory journal. 2014;43(6):1678–90. Epub 2014/03/08. pmid:24603813.
- 10. Konstantinides S, Goldhaber SZ. Pulmonary embolism: risk assessment and management. European heart journal. 2012;33(24):3014–22. Epub 2012/09/11. pmid:22961946.
- 11. Meyer G, Vicaut E, Danays T, Agnelli G, Becattini C, Beyer-Westendorf J, et al. Fibrinolysis for patients with intermediate-risk pulmonary embolism. The New England journal of medicine. 2014;370(15):1402–11. Epub 2014/04/11. pmid:24716681.
- 12. Jimenez D, Lobo JL, Monreal M, Otero R, Yusen RD. Prognostic significance of multidetector computed tomography in normotensive patients with pulmonary embolism: rationale, methodology and reproducibility for the PROTECT study. Journal of thrombosis and thrombolysis. 2012;34(2):187–92. Epub 2012/03/21. pmid:22430281.
- 13. Cok G, Tasbakan MS, Ceylan N, Bayraktaroglu S, Duman S. Can we use CT pulmonary angiography as an alternative to echocardiography in determining right ventricular dysfunction and its severity in patients with acute pulmonary thromboembolism? Japanese journal of radiology. 2013;31(3):172–8. Epub 2012/11/28. pmid:23179789.
- 14. Javadrashid R, Mozayan M, Tarzamni MK, Ghaffari MR, Fouladi DF. Spiral computed tomographic pulmonary angiography in patients with acute pulmonary emboli and no pre-existing comorbidity: a prospective prognostic panel study. European radiology. 2015;25(1):147–54. Epub 2014/08/29. pmid:25163897.
- 15. Kang DK, Sun JS, Park KJ, Lim HS. Usefulness of combined assessment with computed tomographic signs of right ventricular dysfunction and cardiac troponin T for risk stratification of acute pulmonary embolism. The American journal of cardiology. 2011;108(1):133–40. Epub 2011/05/03. pmid:21529730.
- 16. van der Bijl N, Klok FA, Huisman MV, van Rooden JK, Mertens BJ, de Roos A, et al. Measurement of right and left ventricular function by ECG-synchronized CT scanning in patients with acute pulmonary embolism: usefulness for predicting short-term outcome. Chest. 2011;140(4):1008–15. Epub 2011/04/09. pmid:21474573.
- 17. Klok FA, Van Der Bijl N, Eikenboom HC, Van Rooden CJ, De Roos A, Kroft LJ, et al. Comparison of CT assessed right ventricular size and cardiac biomarkers for predicting short-term clinical outcome in normotensive patients suspected of having acute pulmonary embolism. Journal of thrombosis and haemostasis: JTH. 2010;8(4):853–6. Epub 2010/01/26. pmid:20096002.
- 18. Stein PD, Beemath A, Matta F, Goodman LR, Weg JG, Hales CA, et al. Enlarged right ventricle without shock in acute pulmonary embolism: prognosis. The American journal of medicine. 2008;121(1):34–42. Epub 2008/01/12. pmid:18187071; PubMed Central PMCID: PMCPMC2219923.
- 19. Cohen J. Weighted kappa: nominal scale agreement with provision for scaled disagreement or partial credit. Psychological bulletin. 1968;70(4):213–20. Epub 1968/10/01. pmid:19673146.
- 20. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet (London, England). 1986;1(8476):307–10. Epub 1986/02/08. pmid:2868172.
- 21. Becattini C, Agnelli G, Vedovati MC, Pruszczyk P, Casazza F, Grifoni S, et al. Multidetector computed tomography for acute pulmonary embolism: diagnosis and risk stratification in a single test. European heart journal. 2011;32(13):1657–63. Epub 2011/04/21. pmid:21504936.
- 22. Kang DK, Ramos-Duran L, Schoepf UJ, Armstrong AM, Abro JA, Ravenel JG, et al. Reproducibility of CT signs of right ventricular dysfunction in acute pulmonary embolism. AJR American journal of roentgenology. 2010;194(6):1500–6. Epub 2010/05/22. pmid:20489089.
- 23. Kumamaru KK, Hunsaker AR, Wake N, Lu MT, Signorelli J, Bedayat A, et al. The variability in prognostic values of right ventricular-to-left ventricular diameter ratios derived from different measurement methods on computed tomography pulmonary angiography: a patient outcome study. Journal of thoracic imaging. 2012;27(5):331–6. Epub 2011/12/06. pmid:22139353.
- 24. Ouriel K, Ouriel RL, Lim YJ, Piazza G, Goldhaber SZ. Computed tomography angiography with pulmonary artery thrombus burden and right-to-left ventricular diameter ratio after pulmonary embolism. Vascular. 2017;25(1):54–62. Epub 2016/04/20. pmid:27090586.
- 25. Wittenberg R, van Vliet JW, Ghaye B, Peters JF, Schaefer-Prokop CM, Coche E. Comparison of automated 4-chamber cardiac views versus axial views for measuring right ventricular enlargement in patients with suspected pulmonary embolism. European journal of radiology. 2012;81(2):218–22. Epub 2011/02/15. pmid:21315530.