Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reproducibility of quantitative coronary computed tomography angiography in asymptomatic individuals and patients with acute chest pain

  • Martina C. de Knegt ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft

    martinadeknegt@gmail.com

    Affiliations Department of Cardiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark, Department of Cardiology, Hvidovre Hospital, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Morten Haugen,

    Roles Conceptualization, Data curation, Formal analysis, Validation, Writing – review & editing

    Affiliation Department of Cardiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Jesper J. Linde,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Cardiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Jørgen Tobias Kühl,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Cardiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Børge G. Nordestgaard,

    Roles Conceptualization, Data curation, Formal analysis, Supervision, Writing – review & editing

    Affiliation Department of Clinical Biochemistry, Herlev Hospital, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Lars V. Køber,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Supervision, Writing – review & editing

    Affiliation Department of Cardiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Jens D. Hove,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Department of Cardiology, Hvidovre Hospital, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

  • Klaus F. Kofoed

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Resources, Software, Supervision, Writing – review & editing

    Affiliations Department of Cardiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark, Department of Radiology, Rigshospitalet, Faculty of Health Sciences, University of Copenhagen, Copenhagen, Denmark

Abstract

Purpose

Quantitative computed tomography (QCT) provides important prognostic information of coronary atherosclerosis. We investigated intraobserver and interobserver QCT reproducibility in asymptomatic individuals, patients with acute chest pain without acute coronary syndrome (ACS), and patients with acute chest pain and ACS.

Methods

Fifty patients from each cohort, scanned between 01/02/2010-14/11/2013 and matched according to age and gender, were retrospectively assessed for inclusion. Patients with no coronary artery disease, previous coronary artery bypass graft surgery, and poor image quality were excluded. Coronary atherosclerosis was measured semi-automatically by 2 readers. Reproducibility of minimal lumen area (MLA), minimal lumen diameter (MLD), area stenosis, diameter stenosis, vessel remodeling, plaque eccentricity, plaque burden, and plaque volumes was assessed using concordance correlation coefficient (CCC), Bland-Altman, coefficient of variation, and Cohen’s kappa.

Results

A total of 84 patients (63 matched) were included. Intraobserver and interobserver reproducibility estimates were acceptable for MLA (CCC = 0.94 and CCC = 0.91, respectively), MLD (CCC = 0.92 and CCC = 0.86, respectively), plaque burden (CCC = 0.86 and CCC = 0.80, respectively), and plaque volume (CCC = 0.97 and CCC = 0.95, respectively). QCT detected area and diameter stenosis ≥50%, positive remodeling, and eccentric plaque with moderate-good intraobserver and interobserver reproducibility (kappa: 0.64–0.66, 0.69–0.76, 0.46–0.48, and 0.41–0.62, respectively). Reproducibility of plaque composition decreased with decreasing plaque density (intraobserver and interobserver CCC for dense calcium (>0.99; 0.98), fibrotic (0.96; 0.93), fibro-fatty (0.95; 0.91), and necrotic core tissue (0.89; 0.84). Reproducibility generally decreased with worsening clinical risk profile.

Conclusions

Semi-automated QCT of coronary plaque morphology is reproducible, albeit with some decline in reproducibility with worsening patient risk profile.

Introduction

Multidetector computed tomography (MDCT) is a guideline recommended non-invasive imaging modality for the assessment of obstructive coronary artery disease (CAD)[1]. Recent advancements in software technology now allow for semi-automated quantitative assessment of coronary atherosclerosis, thereby providing a detailed description of coronary plaque morphology with the potential for improved reproducibility and accuracy compared to traditional qualitative MDCT assessments[2].

Good reproducibility of quantitative computed tomography (QCT) is important for diagnostic purposes and for risk-stratification purposes in various patient populations[35]. Coronary plaque morphology has, however, been shown to differ in different patient populations, with the majority of research conducted in patients with stable angina and in patients with acute coronary syndrome (ACS)[6,7]. It can be hypothesized that these differences may affect QCT reproducibility assessments as correct identification of mild levels of coronary disease, especially non-calcified plaque[2], as well as correct discernment of lumen and vessel contours in severe levels of coronary disease, especially combined with even slight motion, noise, or blooming artifacts, can be difficult. Studies investigating intraobserver and interobserver reproducibility using semi-automated QCT are, however, few and reproducibility has only been investigated in relatively small numbers of highly selected patients with low-intermediate plaque burdens[811].

In this study, we investigated intraobserver and interobserver QCT reproducibility in asymptomatic individuals, patients with acute chest pain without ACS, and patients with acute chest pain and ACS.

Material and methods

Study population

All participants included in this study underwent MDCT at The Department of Radiology, Rigshospitalet, Copenhagen, Denmark. All patients gave written informed consent to have a MDCT performed for research purposes and the local ethics committee approved individual study protocols. This study was approved by The Danish Data Protection Agency and all procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Asymptomatic individuals from the general population were recruited from The Copenhagen General Population Study, CGPS[12]. Patients presenting with acute chest pain but without signs of ACS were recruited from Cardiac CT in the Treatment of Acute Chest Pain, CATCH (clinical trial number NCT01534000)[13]. Patients fulfilling criteria for either unstable angina pectoris or non-ST elevation myocardial infarction were recruited from Very Early versus Deferred Invasive Evaluation using Computerized Tomography in Patients with Acute Coronary Syndromes, VERDICT (clinical trial number NCT02061891).

Fifty patients were randomly selected from the VERDICT cohort and subsequently matched according to age and gender with participants from the CGPS and CATCH trial, as described in a previous study where all 150 participants have been reported[2]. This prior study dealt with the reproducibility of qualitatively assessed coronary atherosclerosis[2]. Matching was prioritised in this study as increasing burden of CAD and increasing calcification with age and gender are well known factors that could influence reproducibility estimates if not accounted for. Of these 150 participants scanned between 01/02/2010-14/11/2013, participants without coronary artery disease (as assessed by 2 readers) and with coronary artery bypass grafts (CABG) did not undergo QCT. Furthermore, MDCT datasets with image quality deemed unsuitable for semi-automated plaque quantification due to severe motion, noise, calcification, pacemaker artifacts, field of view problems, and poor contrast timing, were excluded as previously described[14].

MDCT image data, medical history and cardiovascular risk profile were acquired from the respective study databases. In this study, participants were divided into three subpopulations based on clinical presentation: Asymptomatic (CGPS participants), Acute chest pain–(minus) ACS (CATCH participants), and Acute chest pain + ACS (VERDICT participants).

MDCT scan protocol

All participants with a heart rate >60 beats per minute (bpm) and no contraindications to beta blockade were pretreated with oral beta blockers according to a standardised protocol. If necessary, intravenous beta blocker (CATCH and VERDICT participants) was given just before scanning. Patients received 0.8 mg nitroglycerin prior to scanning if no contraindications were present. All participants were in sinus rhythm during scanning.

Image acquisition was performed using a 320-slice MDCT (Aquilion one, Vision Edition, Canon, Tokyo, Japan). Overall scan protocol: 320 x 0.5 mm detector collimation, a median (interquartile range (IQR)) tube voltage of 120 (100, 120) kV (body mass index (BMI) dependent), a median (IQR) tube current of 450 (410, 500) mA, and a gantry rotation time of median (IQR) of 0.35 (0.35, 0.35) s (heart rate dependent). Intravenous contrast media (Visipaque, GE Healthcare, Chalfont St. Giles, United Kingdom (CGPS and VERDICT) or Omnipaque, GE Healthcare, Chalfont St. Giles, United Kingdom (CATCH)) was infused with a flow rate of 5.0–6.0 ml/s (weight dependent) with a biphasic injection protocol followed by a saline chaser. The automatic bolus triggering technique was used for initiating image acquisition. Reconstructions at best phase of the R-R interval using an automatic raw data motion analysis tool (PhaseXact, Toshiba) were performed. Images were reconstructed with 0.5 mm slice thickness and increments of 0.25 mm. The conversion factor 0.014 mSv/(mGyxcm) was used to calculate the effective radiation dose.

Quantitative plaque analysis

QCT of coronary atherosclerotic plaque per segment was performed in a semi-automated manner using dedicated software (QAngio CT Research Edition version 2.02, Medis Medical Imaging Systems, Leiden, The Netherlands) by 2 readers with 1 year and 3 years of reading experience, respectively. Coronary tree extraction with the generation of multiplanar reformatted (MPR) volumes using an automatic tree extraction algorithm[15] and coronary vessel segmentation (in accordance with Society of Cardiovascular Computed Tomography (SCCT) guidelines[1]) was performed by the primary reader. If no vessel branches were present to indicate a given segment border, vessel lengths were divided up into thirds to provide proximal, mid, and distal segments. The extracted coronary tree with segment borders (but no vessel wall or lumen contours) was then loaded and assessed by reader 1 twice with a 3 month interval (measurement 1 and measurement 2) for the assessment of intraobserver reproducibility and by reader 2 (blinded) for the assessment of interobserver reproducibility. Calculation of interobserver reproducibility was done using measurement 2 by reader 1 and the measurements by reader 2.

Each reader performed automatic lumen and outer vessel wall contour registration[16,17] followed by manual editing in longitudinal and transverse vessel views of both the lumen and outer vessel wall contours when needed. As determined by each reader, coronary segments of included individuals with motion, severe image noise, severe calcification, <1.5 mm in vessel diameter, occlusions with limited retrograde contrast filling, and segments with stents traversing the entire length of a given segment were not assessed. Furthermore, only segments with coronary atherosclerotic plaque (of any degree) underwent QCT assessment: If a reader determined that there was coronary plaque in a given segment, the reader determined the proximal and distal borders of the lesion visually and QCT parameters were automatically calculated for the lesion, see Fig 1. An automatic reference method where a regression analysis is used on the whole lesion to obtain a linear reference was used in the calculation of remodeling index (RI), area stenosis and diameter stenosis.

thumbnail
Fig 1. Example of quantitative analysis of a proximal left anterior descending artery segment.

A. Longitudinal straightened multiplanar reconstruction where S and E are the start and end of the segment, respectively; P and D are the proximal and distal borders of the lesion, respectively; O is the point of maximal obstruction. B. Transverse vessel view at the point of maximal obstruction.

https://doi.org/10.1371/journal.pone.0207980.g001

Plaque composition was assessed using Hounsfield unit (HU) cut-off values adapted to lumen attenuation[18]. This is based on the principle that lumen intensities influence plaque intensity and decrease along the length of a vessel, are lower in vessel segments with severe stenoses, and are higher in vessel segments with calcified plaque due to blooming artifacts[1719]. Definitions of QCT derived parameters are given in Table 1.

thumbnail
Table 1. Definitions of quantitative computed tomography (QCT) derived parameters.

https://doi.org/10.1371/journal.pone.0207980.t001

Data are reported on both a lesion and patient basis (supplementary material) for the total population and for the subset of age and gender matched individuals.

Statistics

Continuous normally distributed data are presented as mean (standard deviation, SD) and continuous non-normally distributed data as median (IQR). Categorical data are presented as absolute numbers (percentages). One-way analysis of variance and the Kruskall-Wallis test were used to assess differences in normally distributed data and non-normally distributed data, respectively. The χ2-test was used to test for differences in categorical data. Intraobserver and interobserver reproducibility estimates were analysed using Lin’s concordance correlation coefficient (CCC with 95% confidence intervals (CI))[20]. Furthermore, Bland Altman analyses, with mean bias (95% CI) and 95% limits of agreement, were conducted[21]. Normality of mean differences of all parameters was tested. Furthermore, the coefficient of variation (CV), a measure of variability relative to the mean, was calculated as (SD of the mean difference/total average of the mean values for each pair)x100. Intraobserver and interobserver reproducibility was calculated in all participants and across subpopulations. Reproducibility for categorical variables was assessed using Cohen’s Kappa (κ) and were interpreted as: absence of agreement ≤0; poor agreement 0.00–0.20; fair agreement 0.21–0.40; moderate agreement 0.41–0.60; good agreement 0.61–0.80; and excellent agreement >0.80[22]. All statistical analyses were performed using SPSS version 22, SPSS Inc., Chicago, IL, USA). Graphical illustrations were constructed using GraphPad Prism version 6.01 for Windows, GraphPad Software, San Diego California USA. P-values <0.05 were considered statistically significant.

Results

Patient population

Out of 150 selected participants, a total of 84 participants were included in this study, see Fig 2. Of these 84 included participants, 63 were matched 1:1 according to age and gender. Baseline characteristics for all 84 participants and for the three matched subpopulations are shown in Table 2. Of the 1428 segments available for analysis, segments with no atherosclerosis, motion, noise, severe calcification, vessel diameter <1.5 mm, limited retrograde contrast filling after occlusion, and stents were excluded and 343 and 335 paired measurements were obtained for intraobserver and interobserver assessment, respectively.

thumbnail
Fig 2. Flow chart of patient inclusion.

ACS acute coronary syndrome; CABG coronary artery bypass graft.

https://doi.org/10.1371/journal.pone.0207980.g002

Geometrical vessel and lumen parameters

Reproducibility estimates for minimal lumen area (MLA), area stenosis, minimal lumen diameter (MLD), and diameter stenosis are shown in Table 3, and Figs 3 and 4. MLA and MLD had good intraobserver and interobserver reproducibility with acceptable CCC and CV values, mean biases close to zero, and narrow limits of agreement. Reproducibility for area stenosis and diameter stenosis was weaker than their reference independent counterparts and limits of agreement for area stenosis and diameter stenosis ranged between -23.5 to 23.5% and -17.1 to 17.3% for intraobserver reproducibility and between -29.9 to 29.3% and -21.8 to 21.4% for interobserver reproducibility, respectively.

thumbnail
Fig 3. Intraobserver reproducibility (lesion basis) for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume.

A-D show Bland Altman plots for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively; a-d show correlations for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively.

https://doi.org/10.1371/journal.pone.0207980.g003

thumbnail
Fig 4. Interobserver reproducibility (lesion basis) for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume.

A-D show Bland Altman plots for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively; a-d show correlations for minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume, respectively.

https://doi.org/10.1371/journal.pone.0207980.g004

thumbnail
Table 3. Intraobserver and interobserver reproducibility estimates on a lesion basis.

https://doi.org/10.1371/journal.pone.0207980.t003

Using a binary approach, reproducibility of area and diameter stenosis (using a cut-off of 50% to identify lesions with and without significant stenosis) was found to be good for both intraobserver reproducibility (area stenosis κ (95% CI): 0.66 (0.55; 0.77), p<0.001; diameter stenosis κ (95% CI): 0.76 (0.65; 0.87), p<0.001) and interobserver reproducibility (area stenosis κ (95% CI): 0.64 (0.53; 0.74), p<0.001; diameter stenosis κ (95% CI): 0.69 (0.58; 0.80), p<0.001).

Reproducibility estimates of the RI on a continuous scale were weak (intraobserver and intraobserver CCC of 0.53 and 0.57, respectively), Table 3. Using a binary approach, reproducibility of positive remodeling (using the standard cut-off of ≥1.10 to identify positively remodelled lesions) was moderate for both intraobserver reproducibility (κ (95% CI): 0.48 (0.36; 0.60), p<0.001) and interobserver reproducibility (κ (95% CI): 0.46 (0.34; 0.58), p<0.001).

Plaque eccentricity and plaque burden

Reproducibility estimates of the eccentricity index (EI) on a continuous scale were weak (intraobserver and interobserver CCC of 0.64 and 0.58, respectively), Table 3. Using a binary approach, reproducibility of eccentric plaque (defined as EI ≥0.67, corresponding to maximal plaque thickness thrice that of minimal plaque thickness at the site of maximal obstruction) was good for intraobserver reproducibility (κ (95% CI): 0.62 (0.52; 0.73), p<0.001) and moderate for interobserver reproducibility (κ (95% CI): 0.41 (0.30; 0.52), p<0.001).

Reproducibility estimates for plaque burden showed acceptable intraobserver and interobserver reproducibility with CCCs ranging from 0.80–0.86, mean biases close to zero, relatively narrow limits of agreement, and good CVs, Table 3, Figs 3 and 4.

Plaque volume and plaque composition

Reproducibility estimates of plaque volumes on a lesion basis and patient basis for both intraobserver and interobserver reproducibility were good, Table 3, S1 Table, Figs 3 and 4. With regards to plaque composition for both intraobserver and interobserver reproducibility, decreasing CCCs and increasing CVs were seen with decreasing coronary plaque density.

Reproducibility estimates across subpopulations

Reproducibility estimates of coronary plaque parameters across subpopulations on a lesion basis and patient basis are given in Table 4 and S2 Table, respectively.

thumbnail
Table 4. Intraobserver and interobserver reproducibility in each cohort on a lesion basis in age and gender matched patients.

https://doi.org/10.1371/journal.pone.0207980.t004

Geometrical vessel and lumen parameters: Intraobserver and interobserver reproducibility of MLA and MLD, though acceptable in all subpopulations, decreased with worsening clinical risk profile, as is expressed by widening limits of agreement and increasing CV. Intraobserver reproducibility of area and diameter stenosis was highest in the “Chest pain + ACS” subpopulation. Interobserver reproducibility of area and diameter stenosis, however, did not vary notably across subpopulations. Limits of agreement for RI increased (along with CV) with worsening clinical risk profile.

Plaque eccentricity and plaque burden: Limits of agreement for EI increased (along with CV) with worsening clinical risk profile. Intraobserver and interobserver reproducibility estimates for plaque burden were acceptable in all subpopulations but limits of agreement and CV increased with worsening clinical risk profile.

Plaque volume and plaque composition: Reproducibility of total plaque volume was acceptable in all subpopulations and, for interobserver reproducibility, was highest in the “Chest pain–ACS” subpopulation. On a lesion basis, a pattern of worsening reproducibility for plaque composition with decreasing plaque density was seen.

Discussion

This study, to our knowledge, is the largest comprehensive examination of reproducibility of semi-automated plaque quantification in and across populations with different clinical presentations. The main findings of this study are: Firstly, reproducibility of MLA, MLD, plaque burden, and plaque volumes was acceptable. Reproducibility was poorer for area stenosis, diameter stenosis, RI, and EI assessed on a continuous scale but acceptable using a categorical approach. Secondly, reproducibility varied for compositional measures where coronary plaque with higher densities had better reproducibility than coronary plaque with lower densities. Thirdly, reproducibility of the investigated parameters generally decreased with worsening clinical risk profile. Overall, this study showed that semi-automated plaque quantification provided reproducible assessments of clinically relevant coronary plaque geometry, plaque distribution, plaque burden, and plaque volumes, especially high density plaque volumes.

Our findings on the reproducibility of total plaque volume and low density plaque are comparable with a study by Øvrehus et al[8] who demonstrated an intraobserver and interobserver CV of 8% and 12% respectively for total plaque volume (compared to CV 11% and 17% respectively in the present study). Furthermore, Øvrehus et al documented a CV of 46% (intraobserver reproducibility) and 43% (interobserver reproducibility) for non-calcified plaque volume which is comparable with the findings of reproducibility for fibro-fatty and necrotic core tissue that ranged from 30% to 57% in the present study.

With regards to the poorer reproducibility found in lower plaque densities compared to higher plaque densities, other studies have found similar results[5,9]. Our findings may be due manual editing of the automatic vessel and lumen contours which may have contributed to higher intraobserver and interobserver variability, as has also been reported by Laqmani et al[11] and Blackmon et al[23]. Additionally, as discussed by Papadopoulou et al, decreased reproducibility of non-calcified plaque could be explained by incorrect incorporation of the lumen or pericoronary fat in the plaque area[9].

Across subpopulations, reproducibility of QCT parameters was seen to generally decrease with worsening clinical risk profile. This is an important observation as it relates to the clinical feasibility of QCT in different patient populations. This finding is most likely due to differences in plaque composition and disease burden between the investigated subpopulations. It has been shown that coronary atherosclerotic plaque volume and composition are strongly associated to clinical presentation and several studies have previously reported increased total non-calcified plaque volume and low attenuation plaque volume in patients with ACS compared to patients with stabile angina and asymptomatic individuals[6,7,24].

As discussed, fibro-fatty and necrotic core tissue showed poorer reproducibility compared to fibrous and dense calcium tissue. The greater volumes of lower density plaque in populations with greater likelihood of CAD would, therefore, not only result in poor reproducibility of non-calcified plaque but also of geometrical, distributional, burden and volume related parameters. This is exemplified by the findings of Kang et al who reported a decreased sensitivity to detect diameter stenosis >50% in non-calcified plaque due to underestimation when using automated techniques compared with visual assessments[25]. Furthermore, increased disease burden potentially requires greater manual correction when using semi-automated quantification techniques, thereby introducing greater variability into QCT measurements. This is important with regards to potential implementation of QCT in a clinical setting and emphasizes the importance of accurate automatic identification of especially non-calcified plaque.

At present QCT requires excellent image quality for accurate plaque measurements and, in addition for the need to further automate quantitative coronary plaque assessments, there is also a need for improvements in software technology with regards to the assessment of currently unevaluable coronary segments due to motion, noise, severe calcification, small vessel diameter, stents, etc. Further developments in novel iterative reconstruction algorithms as well as new scanners with higher resolution and rotation speeds, and the use of kV switching and iodine mapping may all improve image quality and increase the feasibility of the automated plaque assessments[26].

Perspectives

A cornerstone in the assessment of the clinical applicability of QCT is the determination of its reproducibility. This is of particular importance as various studies have found QCT assessments to be of prognostic value[35,27]. Furthermore, there is an increased focus on the global assessment of coronary atherosclerotic disease–which can be achieved using QCT—for the identification of the vulnerable patient instead of traditional assessments focusing on the identification potentially vulnerable lesions[28,29]. The findings of this study will, therefore, aid in the further implementation of semi-automated quantitative plaque parameters for risk stratification, especially with regards to global measures of atherosclerotic disease as our findings on patient based coronary plaque volumes were especially good. Limitations regarding plaque composition of fibro-fatty and necrotic core tissue, however, persist. Furthermore, current appropriateness criteria do not recommend contrast-enhanced MDCT in asymptomatic individuals, primarily due to possible adverse effects of x-ray radiation. Our findings regarding the good QCT reproducibility in asymptomatic individuals compared to patients with acute chest pain, however, demonstrate the potential applicability of QCT in asymptomatic individuals, especially since technological advancements of low-dose MDCT now allow for the attainment of a contrast-enhanced MDCT <1 mSv[8].

Study limitations

Firstly, potential differences in MDCT scan quality between subpopulations cannot be ruled out as the scan protocol for each of the subpopulations varied slightly (due to ethical considerations concerning radiation dose). Systematic differences in image quality between subpopulations would result in differences in reproducibility. Heart rate and BMI was, however, not statistically significantly different between the subpopulations and MDCTs with the lowest radiation doses were of participants in the “Asymptomatic” subpopulation–the subpopulation which often had the best reproducibility estimates.

Secondly, lesions in coronary segments affected by motion, noise, severe calcification, small vessel diameter, limited retrograde contrast filling due to occlusion, and stents were not assessed. Improvements in software technology may, in the future, allow for the assessment of such lesions.

Thirdly, as this is a single centre study, generalisability of our findings to other centres, due to possible variations in data acquisition, reading, and software may be reduced.

Conclusions

This study showed that semi-automated plaque quantification provided reproducible assessments of minimal lumen area, minimal lumen diameter, plaque burden, and plaque volume and acceptably detected area and diameter stenoses ≥50%, positive remodeling, and eccentric plaque. With regards to plaque composition, reproducibility was best for high density plaque volumes. Lastly, across populations with different clinical presentations, reproducibility generally decreased with worsening clinical risk profile.

Supporting information

S1 Table. Intraobserver and interobserver reproducibility estimates on a patient basis.

CCC concordance correlation coefficient; SD standard deviation; CV coefficient of variation; CI confidence interval.

https://doi.org/10.1371/journal.pone.0207980.s001

(DOCX)

S2 Table. Intraobserver and interobserver reproducibility between cohorts on a patient basis in aged and gender matched patients.

ACS acute coronary syndrome; SD standard deviation; CV coefficient of variation; CI confidence interval.

https://doi.org/10.1371/journal.pone.0207980.s002

(DOCX)

References

  1. 1. Leipsic J, Abbara S, Achenbach S, Cury R, Earls JP, Mancini GJ, et al. SCCT guidelines for the interpretation and reporting of coronary CT angiography: a report of the Society of Cardiovascular Computed Tomography Guidelines Committee. J Cardiovasc Comput Tomogr. 2014;8: 342–358. pmid:25301040
  2. 2. de Knegt MC, Linde JJ, Fuchs A, Nordestgaard BG, Køber LV, Hove JD, et al. Reproducibility of coronary atherosclerotic plaque characteristics in populations with low, intermediate, and high prevalence of coronary artery disease by multidetector computer tomography: a guide to reliable visual coronary plaque assessments. Int J Cardiovasc Imaging. 2016;32: 1555–1566. pmid:27378095
  3. 3. Ferencik M, Mayrhofer T, Puchner SB, Lu MT, Maurovich-Horvat P, Liu T, et al. Computed tomography-based high-risk coronary plaque score to predict acute coronary syndrome among patients with acute chest pain—Results from the ROMICAT II trial. J Cardiovasc Comput Tomogr. 2015;9: 538–545. pmid:26229036
  4. 4. Kristensen TS, Kofoed KF, Kühl JT, Nielsen WB, Nielsen MB, Kelbæk H. Prognostic implications of nonobstructive coronary plaques in patients with non-ST-segment elevation myocardial infarction: a multidetector computed tomography study. J Am Coll Cardiol. 2011;58: 502–509. pmid:21777748
  5. 5. Versteylen MO, Kietselaer BL, Dagnelie PC, Joosen IA, Dedic A, Raaijmakers RH, et al. Additive value of semiautomated quantification of coronary artery disease using cardiac computed tomographic angiography to predict future acute coronary syndrome. J Am Coll Cardiol. 2013;61: 2296–2305. pmid:23562925
  6. 6. Motoyama S, Kondo T, Sarai M, Sugiura A, Harigaya H, Sato T, et al. Multislice computed tomographic characteristics of coronary lesions in acute coronary syndromes. J Am Coll Cardiol. 2007;50: 319–326. pmid:17659199
  7. 7. Dey D, Achenbach S, Schuhbaeck A, Pflederer T, Nakazato R, Slomka PJ, et al. Comparison of quantitative atherosclerotic plaque burden from coronary CT angiography in patients with first acute coronary syndrome and stable coronary artery disease. J Cardiovasc Comput Tomogr. 2014;8: 368–374. pmid:25301042
  8. 8. Øvrehus KA, Schuhbaeck A, Marwan M, Achenbach S, Nørgaard BL, Bøtker HE, et al. Reproducibility of semi-automatic coronary plaque quantification in coronary CT angiography with sub-mSv radiation dose. J Cardiovasc Comput Tomogr. 2015; pmid:26712694
  9. 9. Papadopoulou S-L, Garcia-Garcia HM, Rossi A, Girasis C, Dharampal AS, Kitslaar PH, et al. Reproducibility of computed tomography angiography data analysis using semiautomated plaque quantification software: implications for the design of longitudinal studies. Int J Cardiovasc Imaging. 2013;29: 1095–1104. pmid:23224377
  10. 10. Rinehart S, Vazquez G, Qian Z, Murrieta L, Christian K, Voros S. Quantitative measurements of coronary arterial stenosis, plaque geometry, and composition are highly reproducible with a standardized coronary arterial computed tomographic approach in high-quality CT datasets. J Cardiovasc Comput Tomogr. 2011;5: 35–43. pmid:21131252
  11. 11. Laqmani A, Klink T, Quitzke M, Creder DD, Adam G, Lund G. Accuracy of Coronary Plaque Detection and Assessment of Interobserver Agreement for Plaque Quantification Using Automatic Coronary Plaque Analysis Software on Coronary CT Angiography. ROFO Fortschr Geb Rontgenstr Nuklearmed. 2016;188: 933–939. pmid:27433968
  12. 12. Çolak Y, Afzal S, Nordestgaard BG, Lange P. Characteristics and Prognosis of Never-Smokers and Smokers with Asthma in the Copenhagen General Population Study. A Prospective Cohort Study. Am J Respir Crit Care Med. 2015;192: 172–181. pmid:25914942
  13. 13. Linde JJ, Kofoed KF, Sørgaard M, Kelbæk H, Jensen GB, Nielsen WB, et al. Cardiac computed tomography guided treatment strategy in patients with recent acute-onset chest pain: results from the randomised, controlled trial: CArdiac cT in the treatment of acute CHest pain (CATCH). Int J Cardiol. 2013;168: 5257–5262. pmid:23998546
  14. 14. Kühl JT, Hove JD, Kristensen TS, Norsk JB, Engstrøm T, Køber L, et al. Coronary CT angiography in clinical triage of patients at high risk of coronary artery disease. Scand Cardiovasc J SCJ. 2017;51: 28–34. pmid:27366972
  15. 15. Yang G, Kitslaar P, Frenay M, Broersen A, Boogers MJ, Bax JJ, et al. Automatic centerline extraction of coronary arteries in coronary computed tomographic angiography. Int J Cardiovasc Imaging. 2012;28: 921–933. pmid:21637981
  16. 16. Boogers MJ, Broersen A, van Velzen JE, de Graaf FR, El-Naggar HM, Kitslaar PH, et al. Automated quantification of coronary plaque with computed tomography: comparison with intravascular ultrasound using a dedicated registration algorithm for fusion-based quantification. Eur Heart J. 2012;33: 1007–1016. pmid:22285583
  17. 17. de Graaf MA, Broersen A, Kitslaar PH, Roos CJ, Dijkstra J, Lelieveldt BPF, et al. Automatic quantification and characterization of coronary atherosclerosis with computed tomography coronary angiography: cross-correlation with intravascular ultrasound virtual histology. Int J Cardiovasc Imaging. 2013;29: 1177–1190. pmid:23417447
  18. 18. Broersen A, de Graaf MA, Eggermont J, Wolterbeek R, Kitslaar PH, Dijkstra J, et al. Enhanced characterization of calcified areas in intravascular ultrasound virtual histology images by quantification of the acoustic shadow: validation against computed tomography coronary angiography. Int J Cardiovasc Imaging. 2016;32: 543–552. pmid:26667446
  19. 19. Dalager MG, Bøttcher M, Andersen G, Thygesen J, Pedersen EM, Dejbjerg L, et al. Impact of luminal density on plaque classification by CT coronary angiography. Int J Cardiovasc Imaging. 2011;27: 593–600. pmid:20820922
  20. 20. Lin LI. A concordance correlation coefficient to evaluate reproducibility. Biometrics. 1989;45: 255–268. pmid:2720055
  21. 21. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1: 307–310. pmid:2868172
  22. 22. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33: 159–174. pmid:843571
  23. 23. Blackmon KN, Streck J, Thilo C, Bastarrika G, Costello P, Schoepf UJ. Reproducibility of automated noncalcified coronary artery plaque burden assessment at coronary CT angiography. J Thorac Imaging. 2009;24: 96–102. pmid:19465831
  24. 24. de Knegt MC, Linde JJ, Fuchs A, Pham MHC, Jensen AK, Nordestgaard BG, et al. Relationship between patient presentation and morphology of coronary atherosclerosis by quantitative multidetector computed tomography. Eur Heart J Cardiovasc Imaging. 2018; pmid:30325406
  25. 25. Kang DK, Im NJ, Park SM, Lim HS. CT comparison of visual and computerised quantification of coronary stenosis according to plaque composition. Eur Radiol. 2011;21: 712–721. pmid:20890706
  26. 26. Szilveszter B, Celeng C, Maurovich-Horvat P. Plaque assessment by coronary CT. Int J Cardiovasc Imaging. 2016;32: 161–172. pmid:26280890
  27. 27. Chang H-J, Lin FY, Lee S-E, Andreini D, Bax J, Cademartiri F, et al. Coronary Atherosclerotic Precursors of Acute Coronary Syndromes. J Am Coll Cardiol. 2018;71: 2511–2522. pmid:29852975
  28. 28. Arbab-Zadeh A. Coronary Atheroma Burden Is the Main Determinant of Patient Outcome: But How Much Detail Is Needed? Circ Cardiovasc Imaging. 2018;11: e007992. pmid:30012827
  29. 29. Arbab-Zadeh A, Fuster V. The myth of the “vulnerable plaque”: transitioning from a focus on individual lesions to atherosclerotic disease burden for coronary artery disease risk assessment. J Am Coll Cardiol. 2015;65: 846–855. pmid:25601032