Figures
Abstract
Purpose
Quantitative computed tomography (QCT) provides important prognostic information of coronary atherosclerosis. We investigated intraobserver and interobserver QCT reproducibility in asymptomatic individuals, patients with acute chest pain without acute coronary syndrome (ACS), and patients with acute chest pain and ACS.
Methods
Fifty patients from each cohort, scanned between 01/02/2010-14/11/2013 and matched according to age and gender, were retrospectively assessed for inclusion. Patients with no coronary artery disease, previous coronary artery bypass graft surgery, and poor image quality were excluded. Coronary atherosclerosis was measured semi-automatically by 2 readers. Reproducibility of minimal lumen area (MLA), minimal lumen diameter (MLD), area stenosis, diameter stenosis, vessel remodeling, plaque eccentricity, plaque burden, and plaque volumes was assessed using concordance correlation coefficient (CCC), Bland-Altman, coefficient of variation, and Cohen’s kappa.
Results
A total of 84 patients (63 matched) were included. Intraobserver and interobserver reproducibility estimates were acceptable for MLA (CCC = 0.94 and CCC = 0.91, respectively), MLD (CCC = 0.92 and CCC = 0.86, respectively), plaque burden (CCC = 0.86 and CCC = 0.80, respectively), and plaque volume (CCC = 0.97 and CCC = 0.95, respectively). QCT detected area and diameter stenosis ≥50%, positive remodeling, and eccentric plaque with moderate-good intraobserver and interobserver reproducibility (kappa: 0.64–0.66, 0.69–0.76, 0.46–0.48, and 0.41–0.62, respectively). Reproducibility of plaque composition decreased with decreasing plaque density (intraobserver and interobserver CCC for dense calcium (>0.99; 0.98), fibrotic (0.96; 0.93), fibro-fatty (0.95; 0.91), and necrotic core tissue (0.89; 0.84). Reproducibility generally decreased with worsening clinical risk profile.
Citation: de Knegt MC, Haugen M, Linde JJ, Kühl JT, Nordestgaard BG, Køber LV, et al. (2018) Reproducibility of quantitative coronary computed tomography angiography in asymptomatic individuals and patients with acute chest pain. PLoS ONE 13(12): e0207980. https://doi.org/10.1371/journal.pone.0207980
Editor: Yoshihiro Fukumoto, Kurume University School of Medicine, JAPAN
Received: July 23, 2018; Accepted: November 11, 2018; Published: December 14, 2018
Copyright: © 2018 de Knegt et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicly because it is against Danish law to share de-identified data that contain potentially identifying patient information. The data underlying the results presented in the study are available from the Danish Data Protection Agency department that handles data access for Rigshospitalet (videnscenterfordataanmeldelser.rigshospitalet@regionh.dk Tel. +45 35 45 52 11) and Klaus Fuglsang Kofoed (kkofoed@dadlnet.dk).
Funding: This study was funded by Department of Cardiology, Hvidovre Hospital, Copenhagen, Denmark and Danish Agency for Science, Technology and Innovation by The Danish Council for Strategic Research (EDITORS: Eastern Denmark initiative to improve Revascularization Strategies, Grant 09-066994). These funding sources had no involvement in study design; in the collection, analysis and interpretation of data; in the writing of the report; or in the decision to submit the article for publication.
Competing interests: Martina de Knegt has received research grants from The Danish Heart Foundation; The Danish Agency for Science, Technology and Innovation by The Danish Council for Strategic Research; and the Department of Cardiology, Hvidovre Hospital and has previously received lecturing fees from Toshiba Medical Systems. Lars Køber has received has received research grants from the Danish Research Council. Klaus Kofoed has received research grants from AP Møller og hustru Chastine McKinney Møllers Fond, The John and Birthe Meyer Foundation, Research Council of Rigshopitalet, The University of Copenhagen, The Danish Heart Foundation, The Lundbeck Foundation, The Danish Agency for Science, Technology and Innovation by The Danish Council for Strategic Research; is principle investigator of the investigator initiated CATCH-2 trial, CSub320 trial and at the steering committee of the CORE320 trial –supported in part by Toshiba Medical Corporation; and is on the Speakers Bureau of Toshiba Medical Systems, Advisory board work for VITAL Images Inc. All other authors report no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; and no other relationships or activities that could appear to have influenced the submitted work. These declarations of interest do not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Multidetector computed tomography (MDCT) is a guideline recommended non-invasive imaging modality for the assessment of obstructive coronary artery disease (CAD)[1]. Recent advancements in software technology now allow for semi-automated quantitative assessment of coronary atherosclerosis, thereby providing a detailed description of coronary plaque morphology with the potential for improved reproducibility and accuracy compared to traditional qualitative MDCT assessments[2].
Good reproducibility of quantitative computed tomography (QCT) is important for diagnostic purposes and for risk-stratification purposes in various patient populations[3–5]. Coronary plaque morphology has, however, been shown to differ in different patient populations, with the majority of research conducted in patients with stable angina and in patients with acute coronary syndrome (ACS)[6,7]. It can be hypothesized that these differences may affect QCT reproducibility assessments as correct identification of mild levels of coronary disease, especially non-calcified plaque[2], as well as correct discernment of lumen and vessel contours in severe levels of coronary disease, especially combined with even slight motion, noise, or blooming artifacts, can be difficult. Studies investigating intraobserver and interobserver reproducibility using semi-automated QCT are, however, few and reproducibility has only been investigated in relatively small numbers of highly selected patients with low-intermediate plaque burdens[8–11].
In this study, we investigated intraobserver and interobserver QCT reproducibility in asymptomatic individuals, patients with acute chest pain without ACS, and patients with acute chest pain and ACS.
Material and methods
Study population
All participants included in this study underwent MDCT at The Department of Radiology, Rigshospitalet, Copenhagen, Denmark. All patients gave written informed consent to have a MDCT performed for research purposes and the local ethics committee approved individual study protocols. This study was approved by The Danish Data Protection Agency and all procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.
Asymptomatic individuals from the general population were recruited from The Copenhagen General Population Study, CGPS[12]. Patients presenting with acute chest pain but without signs of ACS were recruited from Cardiac CT in the Treatment of Acute Chest Pain, CATCH (clinical trial number NCT01534000)[13]. Patients fulfilling criteria for either unstable angina pectoris or non-ST elevation myocardial infarction were recruited from Very Early versus Deferred Invasive Evaluation using Computerized Tomography in Patients with Acute Coronary Syndromes, VERDICT (clinical trial number NCT02061891).
Fifty patients were randomly selected from the VERDICT cohort and subsequently matched according to age and gender with participants from the CGPS and CATCH trial, as described in a previous study where all 150 participants have been reported[2]. This prior study dealt with the reproducibility of qualitatively assessed coronary atherosclerosis[2]. Matching was prioritised in this study as increasing burden of CAD and increasing calcification with age and gender are well known factors that could influence reproducibility estimates if not accounted for. Of these 150 participants scanned between 01/02/2010-14/11/2013, participants without coronary artery disease (as assessed by 2 readers) and with coronary artery bypass grafts (CABG) did not undergo QCT. Furthermore, MDCT datasets with image quality deemed unsuitable for semi-automated plaque quantification due to severe motion, noise, calcification, pacemaker artifacts, field of view problems, and poor contrast timing, were excluded as previously described[14].
MDCT image data, medical history and cardiovascular risk profile were acquired from the respective study databases. In this study, participants were divided into three subpopulations based on clinical presentation: Asymptomatic (CGPS participants), Acute chest pain–(minus) ACS (CATCH participants), and Acute chest pain + ACS (VERDICT participants).
MDCT scan protocol
All participants with a heart rate >60 beats per minute (bpm) and no contraindications to beta blockade were pretreated with oral beta blockers according to a standardised protocol. If necessary, intravenous beta blocker (CATCH and VERDICT participants) was given just before scanning. Patients received 0.8 mg nitroglycerin prior to scanning if no contraindications were present. All participants were in sinus rhythm during scanning.
Image acquisition was performed using a 320-slice MDCT (Aquilion one, Vision Edition, Canon, Tokyo, Japan). Overall scan protocol: 320 x 0.5 mm detector collimation, a median (interquartile range (IQR)) tube voltage of 120 (100, 120) kV (body mass index (BMI) dependent), a median (IQR) tube current of 450 (410, 500) mA, and a gantry rotation time of median (IQR) of 0.35 (0.35, 0.35) s (heart rate dependent). Intravenous contrast media (Visipaque, GE Healthcare, Chalfont St. Giles, United Kingdom (CGPS and VERDICT) or Omnipaque, GE Healthcare, Chalfont St. Giles, United Kingdom (CATCH)) was infused with a flow rate of 5.0–6.0 ml/s (weight dependent) with a biphasic injection protocol followed by a saline chaser. The automatic bolus triggering technique was used for initiating image acquisition. Reconstructions at best phase of the R-R interval using an automatic raw data motion analysis tool (PhaseXact, Toshiba) were performed. Images were reconstructed with 0.5 mm slice thickness and increments of 0.25 mm. The conversion factor 0.014 mSv/(mGyxcm) was used to calculate the effective radiation dose.
Quantitative plaque analysis
QCT of coronary atherosclerotic plaque per segment was performed in a semi-automated manner using dedicated software (QAngio CT Research Edition version 2.02, Medis Medical Imaging Systems, Leiden, The Netherlands) by 2 readers with 1 year and 3 years of reading experience, respectively. Coronary tree extraction with the generation of multiplanar reformatted (MPR) volumes using an automatic tree extraction algorithm[15] and coronary vessel segmentation (in accordance with Society of Cardiovascular Computed Tomography (SCCT) guidelines[1]) was performed by the primary reader. If no vessel branches were present to indicate a given segment border, vessel lengths were divided up into thirds to provide proximal, mid, and distal segments. The extracted coronary tree with segment borders (but no vessel wall or lumen contours) was then loaded and assessed by reader 1 twice with a 3 month interval (measurement 1 and measurement 2) for the assessment of intraobserver reproducibility and by reader 2 (blinded) for the assessment of interobserver reproducibility. Calculation of interobserver reproducibility was done using measurement 2 by reader 1 and the measurements by reader 2.
Each reader performed automatic lumen and outer vessel wall contour registration[16,17] followed by manual editing in longitudinal and transverse vessel views of both the lumen and outer vessel wall contours when needed. As determined by each reader, coronary segments of included individuals with motion, severe image noise, severe calcification, <1.5 mm in vessel diameter, occlusions with limited retrograde contrast filling, and segments with stents traversing the entire length of a given segment were not assessed. Furthermore, only segments with coronary atherosclerotic plaque (of any degree) underwent QCT assessment: If a reader determined that there was coronary plaque in a given segment, the reader determined the proximal and distal borders of the lesion visually and QCT parameters were automatically calculated for the lesion, see Fig 1. An automatic reference method where a regression analysis is used on the whole lesion to obtain a linear reference was used in the calculation of remodeling index (RI), area stenosis and diameter stenosis.
A. Longitudinal straightened multiplanar reconstruction where S and E are the start and end of the segment, respectively; P and D are the proximal and distal borders of the lesion, respectively; O is the point of maximal obstruction. B. Transverse vessel view at the point of maximal obstruction.
Plaque composition was assessed using Hounsfield unit (HU) cut-off values adapted to lumen attenuation[18]. This is based on the principle that lumen intensities influence plaque intensity and decrease along the length of a vessel, are lower in vessel segments with severe stenoses, and are higher in vessel segments with calcified plaque due to blooming artifacts[17–19]. Definitions of QCT derived parameters are given in Table 1.
Data are reported on both a lesion and patient basis (supplementary material) for the total population and for the subset of age and gender matched individuals.
Statistics
Continuous normally distributed data are presented as mean (standard deviation, SD) and continuous non-normally distributed data as median (IQR). Categorical data are presented as absolute numbers (percentages). One-way analysis of variance and the Kruskall-Wallis test were used to assess differences in normally distributed data and non-normally distributed data, respectively. The χ2-test was used to test for differences in categorical data. Intraobserver and interobserver reproducibility estimates were analysed using Lin’s concordance correlation coefficient (CCC with 95% confidence intervals (CI))[20]. Furthermore, Bland Altman analyses, with mean bias (95% CI) and 95% limits of agreement, were conducted[21]. Normality of mean differences of all parameters was tested. Furthermore, the coefficient of variation (CV), a measure of variability relative to the mean, was calculated as (SD of the mean difference/total average of the mean values for each pair)x100. Intraobserver and interobserver reproducibility was calculated in all participants and across subpopulations. Reproducibility for categorical variables was assessed using Cohen’s Kappa (κ) and were interpreted as: absence of agreement ≤0; poor agreement 0.00–0.20; fair agreement 0.21–0.40; moderate agreement 0.41–0.60; good agreement 0.61–0.80; and excellent agreement >0.80[22]. All statistical analyses were performed using SPSS version 22, SPSS Inc., Chicago, IL, USA). Graphical illustrations were constructed using GraphPad Prism version 6.01 for Windows, GraphPad Software, San Diego California USA. P-values <0.05 were considered statistically significant.
Results
Patient population
Out of 150 selected participants, a total of 84 participants were included in this study, see Fig 2. Of these 84 included participants, 63 were matched 1:1 according to age and gender. Baseline characteristics for all 84 participants and for the three matched subpopulations are shown in Table 2. Of the 1428 segments available for analysis, segments with no atherosclerosis, motion, noise, severe calcification, vessel diameter <1.5 mm, limited retrograde contrast filling after occlusion, and stents were excluded and 343 and 335 paired measurements were obtained for intraobserver and interobserver assessment, respectively.
ACS acute coronary syndrome; CABG coronary artery bypass graft.
Geometrical vessel and lumen parameters
Reproducibility estimates for minimal lumen area (MLA), area stenosis, minimal lumen diameter (MLD), and diameter stenosis are shown in Table 3, and Figs 3 and 4. MLA and MLD had good intraobserver and interobserver reproducibility with acceptable CCC and CV values, mean biases close to zero, and narrow limits of agreement. Reproducibility for area stenosis and diameter stenosis was weaker than their reference independent counterparts and limits of agreement for area stenosis and diameter stenosis ranged between -23.5 to 23.5% and -17.1 to 17.3% for intraobserver reproducibility and between -29.9 to 29.3% and -21.8 to 21.4% for interobserver reproducibility, respectively.
A-D show Bland Altman plots for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively; a-d show correlations for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively.
A-D show Bland Altman plots for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively; a-d show correlations for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively.
Using a binary approach, reproducibility of area and diameter stenosis (using a cut-off of 50% to identify lesions with and without significant stenosis) was found to be good for both intraobserver reproducibility (area stenosis κ (95% CI): 0.66 (0.55; 0.77), p<0.001; diameter stenosis κ (95% CI): 0.76 (0.65; 0.87), p<0.001) and interobserver reproducibility (area stenosis κ (95% CI): 0.64 (0.53; 0.74), p<0.001; diameter stenosis κ (95% CI): 0.69 (0.58; 0.80), p<0.001).
Reproducibility estimates of the RI on a continuous scale were weak (intraobserver and intraobserver CCC of 0.53 and 0.57, respectively), Table 3. Using a binary approach, reproducibility of positive remodeling (using the standard cut-off of ≥1.10 to identify positively remodelled lesions) was moderate for both intraobserver reproducibility (κ (95% CI): 0.48 (0.36; 0.60), p<0.001) and interobserver reproducibility (κ (95% CI): 0.46 (0.34; 0.58), p<0.001).
Plaque eccentricity and plaque burden
Reproducibility estimates of the eccentricity index (EI) on a continuous scale were weak (intraobserver and interobserver CCC of 0.64 and 0.58, respectively), Table 3. Using a binary approach, reproducibility of eccentric plaque (defined as EI ≥0.67, corresponding to maximal plaque thickness thrice that of minimal plaque thickness at the site of maximal obstruction) was good for intraobserver reproducibility (κ (95% CI): 0.62 (0.52; 0.73), p<0.001) and moderate for interobserver reproducibility (κ (95% CI): 0.41 (0.30; 0.52), p<0.001).
Reproducibility estimates for plaque burden showed acceptable intraobserver and interobserver reproducibility with CCCs ranging from 0.80–0.86, mean biases close to zero, relatively narrow limits of agreement, and good CVs, Table 3, Figs 3 and 4.
Plaque volume and plaque composition
Reproducibility estimates of plaque volumes on a lesion basis and patient basis for both intraobserver and interobserver reproducibility were good, Table 3, S1 Table, Figs 3 and 4. With regards to plaque composition for both intraobserver and interobserver reproducibility, decreasing CCCs and increasing CVs were seen with decreasing coronary plaque density.
Reproducibility estimates across subpopulations
Reproducibility estimates of coronary plaque parameters across subpopulations on a lesion basis and patient basis are given in Table 4 and S2 Table, respectively.
Geometrical vessel and lumen parameters: Intraobserver and interobserver reproducibility of MLA and MLD, though acceptable in all subpopulations, decreased with worsening clinical risk profile, as is expressed by widening limits of agreement and increasing CV. Intraobserver reproducibility of area and diameter stenosis was highest in the “Chest pain + ACS” subpopulation. Interobserver reproducibility of area and diameter stenosis, however, did not vary notably across subpopulations. Limits of agreement for RI increased (along with CV) with worsening clinical risk profile.
Plaque eccentricity and plaque burden: Limits of agreement for EI increased (along with CV) with worsening clinical risk profile. Intraobserver and interobserver reproducibility estimates for plaque burden were acceptable in all subpopulations but limits of agreement and CV increased with worsening clinical risk profile.
Plaque volume and plaque composition: Reproducibility of total plaque volume was acceptable in all subpopulations and, for interobserver reproducibility, was highest in the “Chest pain–ACS” subpopulation. On a lesion basis, a pattern of worsening reproducibility for plaque composition with decreasing plaque density was seen.
Discussion
This study, to our knowledge, is the largest comprehensive examination of reproducibility of semi-automated plaque quantification in and across populations with different clinical presentations. The main findings of this study are: Firstly, reproducibility of MLA, MLD, plaque burden, and plaque volumes was acceptable. Reproducibility was poorer for area stenosis, diameter stenosis, RI, and EI assessed on a continuous scale but acceptable using a categorical approach. Secondly, reproducibility varied for compositional measures where coronary plaque with higher densities had better reproducibility than coronary plaque with lower densities. Thirdly, reproducibility of the investigated parameters generally decreased with worsening clinical risk profile. Overall, this study showed that semi-automated plaque quantification provided reproducible assessments of clinically relevant coronary plaque geometry, plaque distribution, plaque burden, and plaque volumes, especially high density plaque volumes.
Our findings on the reproducibility of total plaque volume and low density plaque are comparable with a study by Øvrehus et al[8] who demonstrated an intraobserver and interobserver CV of 8% and 12% respectively for total plaque volume (compared to CV 11% and 17% respectively in the present study). Furthermore, Øvrehus et al documented a CV of 46% (intraobserver reproducibility) and 43% (interobserver reproducibility) for non-calcified plaque volume which is comparable with the findings of reproducibility for fibro-fatty and necrotic core tissue that ranged from 30% to 57% in the present study.
With regards to the poorer reproducibility found in lower plaque densities compared to higher plaque densities, other studies have found similar results[5,9]. Our findings may be due manual editing of the automatic vessel and lumen contours which may have contributed to higher intraobserver and interobserver variability, as has also been reported by Laqmani et al[11] and Blackmon et al[23]. Additionally, as discussed by Papadopoulou et al, decreased reproducibility of non-calcified plaque could be explained by incorrect incorporation of the lumen or pericoronary fat in the plaque area[9].
Across subpopulations, reproducibility of QCT parameters was seen to generally decrease with worsening clinical risk profile. This is an important observation as it relates to the clinical feasibility of QCT in different patient populations. This finding is most likely due to differences in plaque composition and disease burden between the investigated subpopulations. It has been shown that coronary atherosclerotic plaque volume and composition are strongly associated to clinical presentation and several studies have previously reported increased total non-calcified plaque volume and low attenuation plaque volume in patients with ACS compared to patients with stabile angina and asymptomatic individuals[6,7,24].
As discussed, fibro-fatty and necrotic core tissue showed poorer reproducibility compared to fibrous and dense calcium tissue. The greater volumes of lower density plaque in populations with greater likelihood of CAD would, therefore, not only result in poor reproducibility of non-calcified plaque but also of geometrical, distributional, burden and volume related parameters. This is exemplified by the findings of Kang et al who reported a decreased sensitivity to detect diameter stenosis >50% in non-calcified plaque due to underestimation when using automated techniques compared with visual assessments[25]. Furthermore, increased disease burden potentially requires greater manual correction when using semi-automated quantification techniques, thereby introducing greater variability into QCT measurements. This is important with regards to potential implementation of QCT in a clinical setting and emphasizes the importance of accurate automatic identification of especially non-calcified plaque.
At present QCT requires excellent image quality for accurate plaque measurements and, in addition for the need to further automate quantitative coronary plaque assessments, there is also a need for improvements in software technology with regards to the assessment of currently unevaluable coronary segments due to motion, noise, severe calcification, small vessel diameter, stents, etc. Further developments in novel iterative reconstruction algorithms as well as new scanners with higher resolution and rotation speeds, and the use of kV switching and iodine mapping may all improve image quality and increase the feasibility of the automated plaque assessments[26].
Perspectives
A cornerstone in the assessment of the clinical applicability of QCT is the determination of its reproducibility. This is of particular importance as various studies have found QCT assessments to be of prognostic value[3–5,27]. Furthermore, there is an increased focus on the global assessment of coronary atherosclerotic disease–which can be achieved using QCT—for the identification of the vulnerable patient instead of traditional assessments focusing on the identification potentially vulnerable lesions[28,29]. The findings of this study will, therefore, aid in the further implementation of semi-automated quantitative plaque parameters for risk stratification, especially with regards to global measures of atherosclerotic disease as our findings on patient based coronary plaque volumes were especially good. Limitations regarding plaque composition of fibro-fatty and necrotic core tissue, however, persist. Furthermore, current appropriateness criteria do not recommend contrast-enhanced MDCT in asymptomatic individuals, primarily due to possible adverse effects of x-ray radiation. Our findings regarding the good QCT reproducibility in asymptomatic individuals compared to patients with acute chest pain, however, demonstrate the potential applicability of QCT in asymptomatic individuals, especially since technological advancements of low-dose MDCT now allow for the attainment of a contrast-enhanced MDCT <1 mSv[8].
Study limitations
Firstly, potential differences in MDCT scan quality between subpopulations cannot be ruled out as the scan protocol for each of the subpopulations varied slightly (due to ethical considerations concerning radiation dose). Systematic differences in image quality between subpopulations would result in differences in reproducibility. Heart rate and BMI was, however, not statistically significantly different between the subpopulations and MDCTs with the lowest radiation doses were of participants in the “Asymptomatic” subpopulation–the subpopulation which often had the best reproducibility estimates.
Secondly, lesions in coronary segments affected by motion, noise, severe calcification, small vessel diameter, limited retrograde contrast filling due to occlusion, and stents were not assessed. Improvements in software technology may, in the future, allow for the assessment of such lesions.
Thirdly, as this is a single centre study, generalisability of our findings to other centres, due to possible variations in data acquisition, reading, and software may be reduced.
Conclusions
This study showed that semi-automated plaque quantification provided reproducible assessments of minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume and acceptably detected area and diameter stenoses ≥50%, positive remodeling, and eccentric plaque. With regards to plaque composition, reproducibility was best for high density plaque volumes. Lastly, across populations with different clinical presentations, reproducibility generally decreased with worsening clinical risk profile.
Supporting information
S1 Table. Intraobserver and interobserver reproducibility estimates on a patient basis.
CCC concordance correlation coefficient; SD standard deviation; CV coefficient of variation; CI confidence interval.
https://doi.org/10.1371/journal.pone.0207980.s001
(DOCX)
S2 Table. Intraobserver and interobserver reproducibility between cohorts on a patient basis in aged and gender matched patients.
ACS acute coronary syndrome; SD standard deviation; CV coefficient of variation; CI confidence interval.
https://doi.org/10.1371/journal.pone.0207980.s002
(DOCX)
References
- 1. Leipsic J, Abbara S, Achenbach S, Cury R, Earls JP, Mancini GJ, et al. SCCT guidelines for the interpretation and reporting of coronary CT angiography: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J Cardiovasc Comput Tomogr. 2014;8: 342–358. pmid:25301040
- 2. de Knegt MC, Linde JJ, Fuchs A, Nordestgaard BG, Køber LV, Hove JD, et al. Reproducibility of coronary atherosclerotic plaque characteristics in populations with low, intermediate, and high prevalence of coronary artery disease by multidetector computer tomography: a guide to reliable visual coronary plaque assessments. Int J Cardiovasc Imaging. 2016;32: 1555–1566. pmid:27378095
- 3. Ferencik M, Mayrhofer T, Puchner SB, Lu MT, Maurovich-Horvat P, Liu T, et al. Computed tomography-based high-risk coronary plaque score to predict acute coronary syndrome among patients with acute chest pain—Results from the ROMICAT II trial. J Cardiovasc Comput Tomogr. 2015;9: 538–545. pmid:26229036
- 4. Kristensen TS, Kofoed KF, Kühl JT, Nielsen WB, Nielsen MB, Kelbæk H. Prognostic implications of nonobstructive coronary plaques in patients with non-ST-segment elevation myocardial infarction: a multidetector computed tomography study. J Am Coll Cardiol. 2011;58: 502–509. pmid:21777748
- 5. Versteylen MO, Kietselaer BL, Dagnelie PC, Joosen IA, Dedic A, Raaijmakers RH, et al. Additive value of semiautomated quantification of coronary artery disease using cardiac computed tomographic angiography to predict future acute coronary syndrome. J Am Coll Cardiol. 2013;61: 2296–2305. pmid:23562925
- 6. Motoyama S, Kondo T, Sarai M, Sugiura A, Harigaya H, Sato T, et al. Multislice computed tomographic characteristics of coronary lesions in acute coronary syndromes. J Am Coll Cardiol. 2007;50: 319–326. pmid:17659199
- 7. Dey D, Achenbach S, Schuhbaeck A, Pflederer T, Nakazato R, Slomka PJ, et al. Comparison of quantitative atherosclerotic plaque burden from coronary CT angiography in patients with first acute coronary syndrome and stable coronary artery disease. J Cardiovasc Comput Tomogr. 2014;8: 368–374. pmid:25301042
- 8. Øvrehus KA, Schuhbaeck A, Marwan M, Achenbach S, Nørgaard BL, Bøtker HE, et al. Reproducibility of semi-automatic coronary plaque quantification in coronary CT angiography with sub-mSv radiation dose. J Cardiovasc Comput Tomogr. 2015; pmid:26712694
- 9. Papadopoulou S-L, Garcia-Garcia HM, Rossi A, Girasis C, Dharampal AS, Kitslaar PH, et al. Reproducibility of computed tomography angiography data analysis using semiautomated plaque quantification software: implications for the design of longitudinal studies. Int J Cardiovasc Imaging. 2013;29: 1095–1104. pmid:23224377
- 10. Rinehart S, Vazquez G, Qian Z, Murrieta L, Christian K, Voros S. Quantitative measurements of coronary arterial stenosis, plaque geometry, and composition are highly reproducible with a standardized coronary arterial computed tomographic approach in high-quality CT datasets. J Cardiovasc Comput Tomogr. 2011;5: 35–43. pmid:21131252
- 11. Laqmani A, Klink T, Quitzke M, Creder DD, Adam G, Lund G. Accuracy of Coronary Plaque Detection and Assessment of Interobserver Agreement for Plaque Quantification Using Automatic Coronary Plaque Analysis Software on Coronary CT Angiography. ROFO Fortschr Geb Rontgenstr Nuklearmed. 2016;188: 933–939. pmid:27433968
- 12. Çolak Y, Afzal S, Nordestgaard BG, Lange P. Characteristics and Prognosis of Never-Smokers and Smokers with Asthma in the Copenhagen General Population Study. A Prospective Cohort Study. Am J Respir Crit Care Med. 2015;192: 172–181. pmid:25914942
- 13. Linde JJ, Kofoed KF, Sørgaard M, Kelbæk H, Jensen GB, Nielsen WB, et al. Cardiac computed tomography guided treatment strategy in patients with recent acute-onset chest pain: results from the randomised, controlled trial: CArdiac cT in the treatment of acute CHest pain (CATCH). Int J Cardiol. 2013;168: 5257–5262. pmid:23998546
- 14. Kühl JT, Hove JD, Kristensen TS, Norsk JB, Engstrøm T, Køber L, et al. Coronary CT angiography in clinical triage of patients at high risk of coronary artery disease. Scand Cardiovasc J SCJ. 2017;51: 28–34. pmid:27366972
- 15. Yang G, Kitslaar P, Frenay M, Broersen A, Boogers MJ, Bax JJ, et al. Automatic centerline extraction of coronary arteries in coronary computed tomographic angiography. Int J Cardiovasc Imaging. 2012;28: 921–933. pmid:21637981
- 16. Boogers MJ, Broersen A, van Velzen JE, de Graaf FR, El-Naggar HM, Kitslaar PH, et al. Automated quantification of coronary plaque with computed tomography: comparison with intravascular ultrasound using a dedicated registration algorithm for fusion-based quantification. Eur Heart J. 2012;33: 1007–1016. pmid:22285583
- 17. de Graaf MA, Broersen A, Kitslaar PH, Roos CJ, Dijkstra J, Lelieveldt BPF, et al. Automatic quantification and characterization of coronary atherosclerosis with computed tomography coronary angiography: cross-correlation with intravascular ultrasound virtual histology. Int J Cardiovasc Imaging. 2013;29: 1177–1190. pmid:23417447
- 18. Broersen A, de Graaf MA, Eggermont J, Wolterbeek R, Kitslaar PH, Dijkstra J, et al. Enhanced characterization of calcified areas in intravascular ultrasound virtual histology images by quantification of the acoustic shadow: validation against computed tomography coronary angiography. Int J Cardiovasc Imaging. 2016;32: 543–552. pmid:26667446
- 19. Dalager MG, Bøttcher M, Andersen G, Thygesen J, Pedersen EM, Dejbjerg L, et al. Impact of luminal density on plaque classification by CT coronary angiography. Int J Cardiovasc Imaging. 2011;27: 593–600. pmid:20820922
- 20. Lin LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45: 255–268. pmid:2720055
- 21. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1: 307–310. pmid:2868172
- 22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33: 159–174. pmid:843571
- 23. Blackmon KN, Streck J, Thilo C, Bastarrika G, Costello P, Schoepf UJ. Reproducibility of automated noncalcified coronary artery plaque burden assessment at coronary CT angiography. J Thorac Imaging. 2009;24: 96–102. pmid:19465831
- 24. de Knegt MC, Linde JJ, Fuchs A, Pham MHC, Jensen AK, Nordestgaard BG, et al. Relationship between patient presentation and morphology of coronary atherosclerosis by quantitative multidetector computed tomography. Eur Heart J Cardiovasc Imaging. 2018; pmid:30325406
- 25. Kang DK, Im NJ, Park SM, Lim HS. CT comparison of visual and computerised quantification of coronary stenosis according to plaque composition. Eur Radiol. 2011;21: 712–721. pmid:20890706
- 26. Szilveszter B, Celeng C, Maurovich-Horvat P. Plaque assessment by coronary CT. Int J Cardiovasc Imaging. 2016;32: 161–172. pmid:26280890
- 27. Chang H-J, Lin FY, Lee S-E, Andreini D, Bax J, Cademartiri F, et al. Coronary Atherosclerotic Precursors of Acute Coronary Syndromes. J Am Coll Cardiol. 2018;71: 2511–2522. pmid:29852975
- 28. Arbab-Zadeh A. Coronary Atheroma Burden Is the Main Determinant of Patient Outcome: But How Much Detail Is Needed? Circ Cardiovasc Imaging. 2018;11: e007992. pmid:30012827
- 29. Arbab-Zadeh A, Fuster V. The myth of the “vulnerable plaque”: transitioning from a focus on individual lesions to atherosclerotic disease burden for coronary artery disease risk assessment. J Am Coll Cardiol. 2015;65: 846–855. pmid:25601032