Advertisement
  • Loading metrics

Derivation and Validation of Two Decision Instruments for Selective Chest CT in Blunt Trauma: A Multicenter Prospective Observational Study (NEXUS Chest CT)

  • Robert M. Rodriguez ,

    robert.rodriguez@emergency.ucsf.edu

    Affiliation: Department of Emergency Medicine, University of California, San Francisco, California, United States of America

  • Mark I. Langdorf,

    Affiliation: Department of Emergency Medicine, University of California, Irvine, California, United States of America

  • Daniel Nishijima,

    Affiliation: Department of Emergency Medicine, University of California, Davis, California, United States of America

  • Brigitte M. Baumann,

    Affiliation: Department of Emergency Medicine, Cooper Medical School of Rowan University, Camden, New Jersey, United States of America

  • Gregory W. Hendey,

    Affiliation: Department of Emergency Medicine, UCSF Fresno Medical Education and Research, Fresno, California, United States of America

  • Anthony J. Medak,

    Affiliation: Department of Emergency Medicine, School of Medicine, University of California, San Diego, California, United States of America

  • Ali S. Raja,

    Affiliation: Department of Emergency Medicine, Massachusetts General Hospital/Harvard Medical School, Boston, Massachusetts, United States of America

  • Isabel E. Allen,

    Affiliation: University of California, San Francisco, California, United States of America

  • William R. Mower

    Affiliation: Department of Emergency Medicine, University of California, Los Angeles, California, United States of America

Derivation and Validation of Two Decision Instruments for Selective Chest CT in Blunt Trauma: A Multicenter Prospective Observational Study (NEXUS Chest CT)

  • Robert M. Rodriguez, 
  • Mark I. Langdorf, 
  • Daniel Nishijima, 
  • Brigitte M. Baumann, 
  • Gregory W. Hendey, 
  • Anthony J. Medak, 
  • Ali S. Raja, 
  • Isabel E. Allen, 
  • William R. Mower
PLOS
x

Abstract

Background

Unnecessary diagnostic imaging leads to higher costs, longer emergency department stays, and increased patient exposure to ionizing radiation. We sought to prospectively derive and validate two decision instruments (DIs) for selective chest computed tomography (CT) in adult blunt trauma patients.

Methods and Findings

From September 2011 to May 2014, we prospectively enrolled blunt trauma patients over 14 y of age presenting to eight US, urban level 1 trauma centers in this observational study. During the derivation phase, physicians recorded the presence or absence of 14 clinical criteria before viewing chest imaging results. We determined injury outcomes by CT radiology readings and categorized injuries as major or minor according to an expert-panel-derived clinical classification scheme. We then employed recursive partitioning to derive two DIs: Chest CT-All maximized sensitivity for all injuries, and Chest CT-Major maximized sensitivity for only major thoracic injuries (while increasing specificity). In the validation phase, we employed similar methodology to prospectively test the performance of both DIs.

We enrolled 11,477 patients—6,002 patients in the derivation phase and 5,475 patients in the validation phase. The derived Chest CT-All DI consisted of (1) abnormal chest X-ray, (2) rapid deceleration mechanism, (3) distracting injury, (4) chest wall tenderness, (5) sternal tenderness, (6) thoracic spine tenderness, and (7) scapular tenderness. The Chest CT-Major DI had the same criteria without rapid deceleration mechanism. In the validation phase, Chest CT-All had a sensitivity of 99.2% (95% CI 95.4%–100%), a specificity of 20.8% (95% CI 19.2%–22.4%), and a negative predictive value (NPV) of 99.8% (95% CI 98.9%–100%) for major injury, and a sensitivity of 95.4% (95% CI 93.6%–96.9%), a specificity of 25.5% (95% CI 23.5%–27.5%), and a NPV of 93.9% (95% CI 91.5%–95.8%) for either major or minor injury. Chest CT-Major had a sensitivity of 99.2% (95% CI 95.4%–100%), a specificity of 31.7% (95% CI 29.9%–33.5%), and a NPV of 99.9% (95% CI 99.3%–100%) for major injury and a sensitivity of 90.7% (95% CI 88.3%–92.8%), a specificity of 37.9% (95% CI 35.8%–40.1%), and a NPV of 91.8% (95% CI 89.7%–93.6%) for either major or minor injury. Regarding the limitations of our work, some clinicians may disagree with our injury classification and sensitivity thresholds for injury detection.

Conclusions

We prospectively derived and validated two DIs (Chest CT-All and Chest CT-Major) that identify blunt trauma patients with clinically significant thoracic injuries with high sensitivity, allowing for a safe reduction of approximately 25%–37% of unnecessary chest CTs. Trauma evaluation protocols that incorporate these DIs may decrease unnecessary costs and radiation exposure in the disproportionately young trauma population.

Editors' Summary

Background

Trauma—a serious injury to the body caused by violence or an accident—is a major global health problem. Every year, events that include traffic collisions, falls, and burns cause injuries that kill more than 5 million people (9% of annual global deaths). Road traffic accidents alone cause about 1.24 million deaths per year. In many countries, including the US, trauma is the number one killer of individuals aged 1–46 years. Chest injuries—damage to the chest wall such, as rib fractures, or damage to the lungs, heart, airways, or major blood vessels within the chest—are responsible for a quarter of trauma deaths. Chest injuries can be penetrating or blunt. Penetrating injuries (for example, stabbings) are generally easy to diagnose and usually require surgery. Blunt injuries, which are often the result of falls or road accidents, can often be managed with relatively simple interventions such as mechanical ventilation but can be hard to diagnose.

Why Was This Study Done?

Computed tomography (CT) is often used to evaluate patients with blunt trauma. This imaging procedure uses special X-ray equipment and computer programs to create two-dimensional and three-dimensional pictures of the organs, bones, and other tissues of the body. CT is good at providing information about internal injuries, and many trauma centers now routinely examine victims of major trauma using head-to-pelvis CT. However, chest CT exposes patients to radiation doses that may increase their risk of cancer. Moreover, chest CT is expensive and does not always provide much additional information if completed after a normal chest X-ray. To reduce the costs and radiation risks of unnecessary CT imaging after blunt trauma, in this prospective observational study, the researchers develop and validate two clinical decision instruments that identify patients with blunt chest injuries, thereby allowing clinicians to forego CT in patients who do not meet the decision instrument criteria for blunt injuries.

What Did the Researchers Do and Find?

The researchers had clinicians record the presence or absence of 14 candidate clinical criteria in 6,002 patients aged over 14 years attending eight US trauma centers with blunt trauma before viewing chest CT results and categorizing the injuries seen as major or minor using a preset classification scheme. They then derived two clinical decision instruments from these data using a statistical method called recursive partitioning. The Chest CT-All decision instrument, which maximized sensitivity (the ability to correctly identify people with a condition) for either major and minor chest injuries, consisted of seven clinical criteria including an abnormal x-ray, rapid deceleration mechanism (trauma caused by, for example, a road collision occurring at more than 40 mph), and bone tenderness (pain that occurs when an area is touched) in the chest. The Chest CT-Major instrument, which maximized sensitivity for only major chest injuries, consisted of the same criteria without rapid deceleration mechanism. Applied to 5,475 additional patients who presented with blunt trauma, the Chest CT-All instrument correctly identified 95.4% of patients with a major or minor blunt chest injury as having an injury (a sensitivity of 95.4%) and 25.5% of patients without a major or minor injury as not having an injury (a specificity of 25.5%); the instrument had a negative predictive value (NPV) of 93.9% (a patient judged injury-free using the instrument had a 93.9% probability of being injury-free). The Chest CT-Major instrument had a sensitivity of 99.2%, specificity of 31.7%, and NPV of 99.9% for major injuries.

What Do These Findings Mean?

These findings describe two decision instruments that detect clinically important blunt chest injuries with high sensitivity. Because the use of these instruments allows clinicians to identify virtually everyone who has this type of injury, clinicians can forego CT in patients who do not exhibit any of the decision instrument criteria for blunt chest injury. That is, clinicians can safely use physical examination and history findings, instead of imaging, to rule out blunt chest injury in many patients attending a trauma center. Limitations of this study include the criteria used to classify injuries as minor or major. Moreover, these decision instruments should be used to augment rather than replace clinical judgment and should not be used to evaluate patients younger than 15 years old. Importantly, however, use of these decision instruments could reduce the number of unnecessary chest CTs undertaken in trauma centers by up to a third, thus reducing costs and radiation exposure in people with trauma.

Additional Information.

This list of resources contains links that can be accessed when viewing the PDF on a device or via the online version of the article at http://dx.doi.org/10.1371/journal.pmed.1001883.

Introduction

The use of computed tomography (CT) in adult blunt trauma evaluation has risen dramatically in the past two decades, and many trauma centers have adopted routine head-to-pelvis CT protocols (pan-scan) that include chest CT for victims of major trauma [17]. Multiple investigators have concluded, however, that this escalation in CT use is associated with clear and quantifiable cancer risks [811]. Several major specialty organizations have therefore called for a review of widespread CT use in trauma, and in 2014 the American College of Surgeons listed avoidance of routine whole body trauma CT as one of its five Choosing Wisely recommendations [1214].

With an effective radiation dose among the highest in all diagnostic imaging, the cancer induction risk of chest CT is considerable [7]. Unnecessary trauma chest CT may also be especially expensive. In our previous blunt trauma work, we showed that chest CT after a normal chest X-ray (CXR) may be a particularly low-yield, concerning practice, resulting in over US$200,000 in hospital charges and potentially inducing one cancer for every 23 major injuries diagnosed [15].

Seeking to reduce the costs and radiation risks of unnecessary blunt trauma imaging, our objective in this study was to derive and validate clinical decision instruments (DIs) that identify patients with thoracic injury and can therefore safely guide selective ordering of chest CT by allowing clinicians to forego CT in patients who do not have any DI criteria. Recognizing that practice patterns vary among clinicians, we sought to establish two DIs: the first (Chest CT-All) would have high sensitivity for all thoracic injuries seen on chest CT, and the second (Chest CT-Major) would have high sensitivity for major injuries, while accepting a small miss rate for minor injuries (in order to maximize specificity).

Methods

Sites, Participants, and Enrollment

We conducted this study at eight urban, US level 1 trauma centers located in California (San Francisco, Irvine, Los Angeles, Davis, Fresno, and San Diego), New Jersey (Camden), and Massachusetts (Boston). We conducted the derivation phase from September 2011 to December 2012 and the validation phase from February 2013 to May 2014. Our inclusion criteria in both phases of the study were as follows: (1) being over 14 y of age, (2) presenting to the emergency department (ED) for blunt trauma that occurred within 6 h of arrival, and (3) having chest imaging (either CXR or chest CT) ordered in the ED (including trauma resuscitation rooms). Using convenience sampling primarily from 07:00 to 23:00, research personnel enrolled patients when CXR or chest CT was ordered. We excluded patients after enrollment if we later determined that they did not receive chest imaging, were under 15 y of age, or primarily had a penetrating (e.g., gunshot wound, stabbing) mechanism of trauma. We left all imaging decisions to the discretion of the treating providers.

Decision Instrument Candidate Criteria

From our prior NEXUS Chest study work, reviews of the literature, and investigator consensus, we generated a list of 14 candidate DI criteria [1619]: (1) age greater than 60 y, (2) altered mental status or altered level of consciousness, (3) intoxication, (4) rapid deceleration mechanism, (5) chest pain, (6) distracting injury, (7) chest wall tenderness, (8) sternal tenderness, (9) thoracic spine tenderness, (10) scapular tenderness, (11) abnormality in the pericardial window of focused assessment with sonography in trauma (FAST), (12) abnormality in any of the abdominal FAST windows, (13) abnormality in the pulmonary component of extended FAST (eFAST), and (14) abnormality in portable CXR. We had previously determined that shortness of breath, abnormal chest auscultation, visible chest wall skin injury, and hypoxia (oxygen saturation on ED presentation of <95%) had insufficient discriminatory value for use as DI criteria [16]. We presented the candidate criteria on data collection forms, along with definitions (see S1 Appendix), to trauma providers and asked them to record the presence or absence of these criteria prior to their review of any chest imaging results.

To measure inter-rater reliability of clinical criteria, we conducted dual, independent provider criteria assessments of 160 patients (20 from each study site) and calculated a kappa statistic of agreement. Only criteria with a kappa > 0.6 were considered acceptable for use in the DIs. To avoid overestimation of the safety (sensitivity) of the DIs, missing and unknown criteria (<0.1% of the total) were assumed to be absent.

Outcomes

Prior to the study, we generated a comprehensive list of thoracic and intra-thoracic injuries seen on thoracic CT. We then convened an expert panel of ten physicians at the associate professor level or higher (six emergency medicine physicians and four trauma surgeons) to classify these injuries as clinically major, minor, or insignificant based on associated interventions, observation, and hospital admission. See Table 1 for this classification.

thumbnail
Table 1. Trauma expert panel determination of clinical significance of injuries seen on chest imaging.

http://dx.doi.org/10.1371/journal.pmed.1001883.t001

We used radiologists’ official reports for all imaging outcomes. When radiology reports regarding outcomes were vague (“possible pulmonary contusion”), we assumed the finding to be present. Abnormal CXR was defined as having any thoracic injury (including clavicle fracture) or a widened mediastinum.

Blinded to clinical assessment or DI criteria, study personnel (abstractors) followed all enrolled patients through their hospital course to determine clinical outcomes (hospital admission and injury-associated interventions). In order to check abstractor reliability, a second abstractor independently abstracted patient outcomes (radiology reports, admission, and interventions) in 80 of the first 1,000 patients. Given that we found extremely high inter-abstractor agreement for all outcomes (radiology reports—99% agreement, kappa = 0.97; hospital admission and interventions—100% agreement, kappa = 1.0), we limited our subsequent checks of outcomes to random monthly audits.

Sample Size Considerations and Analyses

The explicit goal of this work was to develop DIs that clinicians can use to effectively rule out injury and forego imaging in patients who do not have any DI criteria. Because sensitivity is less affected by prevalence variations than negative predictive value (NPV), we focused on sensitivity and calculated our sample size based on the need to derive and validate DIs that were highly sensitive for clinically significant injury. We sought a 95% CI width of approximately 2% around the targeted sensitivities of 98% for major injury and 95% for major or minor injury. Using lower end estimates of the prevalence of injury in patients who had CXR and CT at an early point of data collection in our prior work (5% for major injury and 10% for major or minor injury) [17], we calculated that we would need to enroll at least 4,570 patients in each phase of the study. We continued enrollment beyond this sample size in both phases as a buffer for variations in prevalence of injury.

We used binary recursive partitioning in R (algorithms BRP and Rpart, R version 3.1.1 [2014]) to derive Chest CT-All and Chest CT-Major. We sought to maximize sensitivity for clinically major injury, with a goal of 99%, by omitting candidate criteria and recalculating sensitivity and DI stability systematically via a jackknife analysis. For Chest CT-All we additionally sought a sensitivity for major or minor injury of at least 95%. After we derived Chest CT-All, we derived the higher specificity Chest CT-Major by removing criteria, with the same goal of high sensitivity for major injury but a lower acceptable sensitivity for major and minor injury of at least 90%.

We used Research Electronic Data Capture (REDCap), hosted by the University of California, San Francisco, to manage data [20]. After validation phase data collection, we calculated the relevant screening performance parameters (sensitivity, specificity, NPV, and negative likelihood ratio) of Chest CT-All and Chest CT-Major using Stata v. 13.2 (StataCorp).

Controls for Bias

Our explicit goal was to develop DIs that detect clinically significant injuries seen on chest CT performed in the ED. In order to control for the potential spectrum bias that could arise from the fact that less than half of trauma patients receive chest CT, we enrolled and followed all patients who received any ED chest imaging even if they did not receive chest CT. We performed a sensitivity (and full screening performance) analysis of our DIs in this larger group of patients taken from the validation cohort, comparing DI performance in this population to the DI performance in the primary analysis (the subgroup of patients who received both CXR and chest CT). Regarding bias that could arise from lack of enrollment of patients who did not receive any imaging at all in the ED, we have previously demonstrated that the clinically significant injury rate in this non-imaged group of patients approaches zero and is therefore negligible [17].

Using a multi-campus review mechanism, we obtained institutional review board approval from the University of California San Francisco Committee on Human Research for the six University of California sites. We obtained separate approval from the Cooper Medical School of Rowan University and Brigham and Women’s Hospital institutional review boards for their respective participating institutions. Because of the strictly observational nature of the study and the fact that many patients who were critically injured, were intoxicated, or had head injury would be unable to provide consent, we obtained a waiver of consent at all sites. We controlled all aspects of study design, implementation, analysis, and manuscript preparation without influence from the grant funding agency.

Results

The median age of the 11,477 enrolled patients was 46 y (interquartile range [IQR] 29–62), 61.0% were male, 47.9% were admitted to the hospital, and their median injury severity score was 5 (IQR 1–10). The most common trauma mechanisms were motorized vehicle collisions (35.6%) and falls (27.4%). See Table 2 for demographics separated according to study phase.

thumbnail
Fig 1. Study flow: derivation and validation phases.

In the derivation phase, we enrolled 6,033 patients and derived the DIs on the 1,873 patients who received both CXR and chest CT. We then enrolled 5,501 patients in the validation phase and validated the two DIs in the 2,628 patients who had both CXR and chest CT. Along with these 2,628 patients, we incorporated the 2,555 validation phase patients who received only CXR into an enrollment bias sensitivity analysis.

http://dx.doi.org/10.1371/journal.pmed.1001883.g001

Of the 6,002 enrolled and included patients during the derivation phase, 1,873 (31.2%) had both CXR and chest CT; 144 (7.7%) of these patients had clinically major injury and 649 (34.7%) had either clinically major or minor injury. See Tables 3 and 4 for the lists of major and minor injuries diagnosed during both phases.

Because pericardial FAST windows, abdominal FAST windows, and eFAST were reported in only 62%, 63%, and 37% of patients, respectively, they were not included as candidate criteria in our derivation algorithms. Kappa statistics of agreement for the remaining criteria were all acceptable according to our predetermined criteria: distracting injury, 0.60; rapid deceleration mechanism, 0.66; intoxication, 0.79; altered mental status, 0.73; chest pain, 0.75; chest wall tenderness, 0.75; thoracic spine tenderness, 0.78; sternal tenderness; and scapular tenderness, 0.82.

Recursive partitioning produced Chest CT-All, which consisted of (1) abnormal CXR, (2) rapid deceleration mechanism, (3) distracting injury, (4) chest wall tenderness, (5) sternal tenderness, (6) thoracic spine tenderness, and (7) scapular tenderness, and which had a sensitivity for major injury of 99.3% (95% CI 96.2%–100%) and a sensitivity for major or minor injury of 98.2% (95% CI 96.8%–99%). The derived Chest CT-Major DI consisted of the same criteria without rapid deceleration mechanism and had sensitivities for major injury and for major or minor injury of 99.3% (95% CI 96.2%–100%) and 94.8% (95% CI 92.8%–96.3%), respectively.

Of the 5,475 enrolled and included patients during the validation phase, 2,628 (48.0%) had both CXR and chest CT; 120 (4.6%) of these patients had clinically major injury, and 706 (26.9%) had either clinically major or minor injury. Chest CT-All had sensitivities for major injury and for major or minor injury of 99.2% (95% CI 95.4%–100%) and 95.4% (95% CI 93.6%–96.9%), respectively. Chest CT-Major had sensitivities for major injury and for major or minor injury of 99.2% (95% CI 95.4%–100%) and 90.7% (95% CI 88.3%–92.8%), respectively.

Chest CT-All had a NPV for major injury and for major or minor injury of 99.8% (95% CI 98.9%–100%) and 93.9% (95% CI, 91.5%–95.8%), respectively. Chest CT-Major had a NPV for major injury and for major or minor injury of 99.9% (95% CI 99.3%–100%) and 91.8% (95% CI 89.7%–93.6%), respectively.

With a specificity for major or minor injury of 25.5% (95% CI 23.5%–27.5%), Chest CT-All would correctly avoid approximately 25% of non-diagnostic chest CTs. Chest CT-Major would correctly avoid approximately 37% of chest CTs (specificity for major or minor injury = 37.9%, 95% CI 35.8%–40.1%). See Table 5 for the full validation screening performance of Chest CT-All and Chest CT-Major.

thumbnail
Table 5. Screening performance characteristics of Chest CT-All and Chest CT-Major in validation cohort (n = 2,628).

http://dx.doi.org/10.1371/journal.pmed.1001883.t005

The sensitivity for major injury of both Chest CT-All and Chest CT-Major in our spectrum bias control group (all patients in the validation cohort who received chest imaging) was 99.2% (95% CI 95.8%–100%). The sensitivities for major or minor injury of Chest CT-All and Chest CT-Major in this control group were 95.8% (95% CI 94.1%–97.1%) and 91.5% (95% CI 89.3%–93.4%), respectively.

Chest CT-All and Chest CT-Major failed to detect one of the 120 patients with a clinically major injury. This 80-y-old male fell down seven stairs and had a subarachnoid hemorrhage and an isolated pneumothorax that was treated with a chest tube. Chest CT-All and Chest CT-Major failed to detect 31 and 64 patients with clinically minor injury, respectively. These minor injuries, by definition, were all non-operative and consisted of rib fractures (25), sternal fracture (8), pulmonary contusion (6), thoracic spine fracture (4), scapular fracture (2), pneumothorax (1), and more than one minor injury (19). All admitted false negative patients survived to hospital discharge. Nine of the 65 (13.4%) false negative patients were discharged to home from the ED, and none of them returned to their index hospital for care within two weeks.

Regarding our assessment of patients who had negative (no injury seen) thoracic imaging in the ED, only one patient in both the derivation and validation cohorts was later diagnosed with a significant thoracic injury (a pneumothorax on hospital day two). Because he was assessed with the criterion of chest wall tenderness, his injury nevertheless would have been picked up by both DIs.

Discussion

Although trauma chest CT clearly plays an integral role in blunt trauma evaluation, its indiscriminate use results in undeniable risks and costs. Toward the goal of reducing unnecessary trauma chest CT, we developed two DIs that detect clinically significant injuries with very high sensitivity, allowing clinicians to forego CT in patients who do not have DI criteria. In effect, our work provides clinicians with an evidence-based mechanism to use basic physical exam and history findings—instead of advanced imaging—to safely and efficiently rule out injury in appropriate patients.

Our DIs are not the first to attempt to decrease the use of chest CT in blunt trauma patients. In a single site study, Brink et al. derived a blunt trauma chest CT DI with 95% sensitivity for clinically significant injury [18]. However, because this DI requires the performance of several types of imaging beyond CXR (abdominal ultrasound, thoracic spine X-ray, and pelvic X-ray), it is unlikely to be useful to guide acute trauma imaging decisions. Aside from the CXR, all of the criteria in our DIs are simple, straightforward portions of the routine trauma history and physical exam (primarily palpation for tenderness of the bony elements of the thorax and upper back), none of which should require extra provider time, costs, or effort. Foregoing the chest CT portion of a pan-scan has been considered by other trauma investigators. Barrios et al. reported that the addition of thoracic CT in patients who had a normal CXR and abdominal CT was of limited diagnostic utility [19].

We followed the guidelines put forth by Stiell et al. [21] for optimal development of DIs and by Gilbert et al. [22] for chart abstraction. Specifically, we emphasized the use of simple criteria that can be easily and reliably assessed; we controlled extensively for spectrum bias and ensured complete follow-up of all enrolled participants; we defined outcomes independently of the criteria, with complete blinding of abstractors for these elements; and, most importantly, we conducted all of this work prospectively, with separate, independent cohorts for derivation and subsequent validation.

To further optimize the external validity of our work, we emphasized real-world conditions [23]. Our criteria assessments were performed during routine trauma physical exams and recorded before imaging result acquisition, thereby closely replicating the manner in which clinicians would apply a DI for CT decisions.

When designing this study, we were cognizant of distinct trauma practice variations and ideological differences in terms of injury diagnosis thresholds [24]. We therefore convened a multidisciplinary panel to classify injuries seen on CT and developed two distinct DIs. For clinicians who believe it is important to diagnose all (or nearly all) injuries, we developed Chest CT-All, which detects both major and minor injuries with high sensitivity and which may allow providers to forego unnecessary chest CT in approximately 25% of patients. For clinicians who seek to detect only those injuries that result in interventions, we recommend our second DI, Chest CT-Major, which maintains an equally high sensitivity for major injuries and has a greater specificity of over 37%, thereby sparing more patients from unnecessary CT. The only difference between the two DIs is the inclusion of the criterion of rapid decelerating mechanism in Chest CT-All, which allowed for greater detection of minor injuries. See Fig 2 for our recommended implementation of Chest CT-All and Chest CT-Major.

thumbnail
Fig 2. NEXUS Chest CT decision instrument implementation.

Abnormal CXR is any thoracic injury (including clavicle fracture) or a widened mediastinum. Rapid deceleration mechanism is a fall from >20 feet (6.1 m) or a motor vehicle accident at >40 miles (64.4 km) per hour with sudden deceleration. Thoracic injury is defined as pneumothorax, hemothorax, aortic or great vessel injury, multiple rib fractures, ruptured diaphragm, sternal fracture, scapular fracture, thoracic spine fracture, esophageal injury, tracheal/bronchial injury, or pulmonary contusion/laceration. *These four criteria may be evaluated together as any thoracic wall, sternal, spine, or scapular tenderness. Sen, sensitivity; Spec, specificity.

http://dx.doi.org/10.1371/journal.pmed.1001883.g002

Vigilance for highly lethal aortic or great vessel injuries is commonly used as a primary justification for ordering chest CT in blunt trauma cases [46,25,26]. Our DIs detected all of the 21 aortic/great vessel injuries seen in our derivation and validation sets, and they would have detected all 17 of the aortic injuries in our prior NEXUS Chest studies [16,18]. Notably, CXR was normal (including normal mediastinal width) in eight (38%) of these cases, and there was no rapid deceleration mechanism in seven (33%) of these cases.

FAST, especially eFAST for pneumothorax, has been shown to have great utility in trauma evaluation [27]. Although adherence to our a priori rules of DI development precluded the use of eFAST in our current DIs, we plan to incorporate it in another decision rule.

Perhaps the greatest criticism of our work may come from those who strongly espouse chest CT as part of universal head-to-pelvis CT (pan-scan) in major blunt trauma evaluation [46]. We recognize that pan-scan may be the most practical and appropriate diagnostic approach in patients with severe, hemodynamically unstable trauma affecting multiple anatomic regions, especially when clinicians have concerns about repeat CT scans and multiple doses of intravenous contrast [6,7,28,29]. Our DIs, however, are intended to benefit the less critically injured patient, in whom portable anteroposterior CXR is the most common initial diagnostic step. Even the staunchest trauma CT scan advocates may recognize a tipping point for the utility of pan-scan—that there must exist a group of patients in whom the risks (and costs) of CT outweigh its potential diagnostic benefits. With a risk of significant missed injury of approximately 1%, we believe that our DIs meet a practical threshold for safety.

Some authorities may also contend that that the true added cost of CT to hospitals is minimal and that CT radiation concerns are overblown and should not be considered in acute trauma situations [6]. However, patient-centered care requires that physicians consider patients’ views and respect their autonomy whenever possible. We have demonstrated that most patients wish to discuss the risks and costs of trauma CT and that they would often choose to accept a low risk (<2%) of missed life-threatening injury to avoid the radiation exposure and charges attendant with chest CT [30].

The radiation risks of CT are underappreciated, and as we acknowledged and addressed from the outset of our preliminary study planning, opinions vary widely regarding the need to diagnose non-interventional injuries [47,3133]. Prior to the widespread use of chest CT in trauma, minor injuries would commonly go undetected, and providers would focus on dealing with clinical complications as they arose, rather than attempting to diagnose these injuries preemptively. Most of the missed injuries were rib fractures, isolated sternal fractures, and small pulmonary contusions. Most authorities agree that isolated sternal fractures can be managed on an outpatient basis, and, similarly, occult pulmonary contusions (those that are seen only on CT) are of little consequence [3436]. Given that the management of all these injuries is primarily pain control and observation (care that is routine and occurs with thoracic trauma in general) [37], we believe that the extra radiation exposure and cost of chest CT for a 100% detection rate of these injuries is not justified.

Our work does not refute studies reporting that CXR alone has a low sensitivity for important findings that are seen on chest CT [3840]. CXR (without the other elements in our DIs) failed to detect many of the injuries in Table 4. Similarly, we are not arguing against the use of CT to better characterize injuries suggested by CXR.

As we have emphasized in our prior work [18], these NEXUS Chest CT DIs are one-way directive rules that should be used only to rule out major injury and forego chest CT. Having DI criteria, such as an abnormal CXR or chest wall tenderness, in no way indicates the need for CT—misapplication of our DIs in this manner can paradoxically lead to greater imaging.

We recognize that clinicians may order CT scans in response to fear of missing injuries and medical-legal concerns. We believe that clinicians, by documenting that patients are low risk based on NEXUS Chest CT DI criteria, may use our work to counter this legal risk in a manner similar to the current clinical implementation of the NEXUS cervical spine and PECARN pediatric head trauma rules [41,42].

Limitations

Variance in injury prevalence may impact the NPV of our DIs when applied to different populations. Lower level trauma centers likely treat a less severely injured population, and our NEXUS Chest CT DIs may therefore exhibit lower NPV at these sites. Sensitivity, however, should remain consistent.

Although most of the providers assessing patients were resident physicians, potentially limiting external applicability to non-teaching hospitals, all of our criteria are simple, with high inter-rater reliability. We believe that they can be assessed easily by a broad range of clinicians.

We believe that the differences in the rates of major and minor injury diagnosis between the derivation and validation cohorts resulted from changes in CT evaluation protocols at our trauma centers over time. As new trauma protocols dictated that more patients receive automatic head-to-pelvis CT (regardless of whether or not they had evidence of thoracic trauma), the diagnostic efficiency of chest CT was decreased.

With regard to injuries missed by the DIs, most were rib, sternal, thoracic spine, or scapular fractures. Considering that our DIs include criteria for tenderness to palpation of all of these bony structures, these missed injuries were likely very minor (causing no clinically detectable tenderness). It is also possible that some clinicians in the study did not thoroughly examine these structures or that they merely checked boxes when filling out the DI data collection forms; some of these cases may therefore not reflect true injury detection failures.

Practitioners may disagree with our injury classifications, placing greater or lesser value on certain diagnoses. For example, some clinicians may believe that all sternal fractures are major injuries, impacting patient care even without surgical intervention. Our designation of injuries as major and minor, however, reflects a balanced consensus of both emergency medicine physicians and trauma surgeons. Furthermore, our development of two distinct DIs reflects our recognition that perspectives and practice patterns are likely to vary among clinicians.

Finally, our DIs cannot replace clinical judgment—rather they are meant to augment it. They also do not apply to the pediatric population under 15 y of age. Given that the radiation risks of chest CT are higher in younger patients and may be negligible in elderly patients, providers may wish to apply our DIs differentially by age.

Conclusions

Evaluating two cohorts of adult blunt trauma patients, we prospectively derived and validated two NEXUS Chest CT DIs, which consist of simple, readily available criteria that detect clinically significant thoracic and intra-thoracic injury with very high sensitivity. Incorporation of these DIs into trauma evaluation protocols may allow for a safe reduction of approximately 25%–37% of non-diagnostic chest CTs, thereby reducing costs and avoiding radiation exposure in the disproportionately young trauma population.

Supporting Information

S1 STARD. STARD checklist.

doi:10.1371/journal.pmed.1001883.s001

(DOCX)

S1 Appendix. Criteria definitions.

The criteria are defined for purposes of clarity and to ensure consistent data collection. They do not represent recommendations for patient evaluation.

doi:10.1371/journal.pmed.1001883.s002

(DOC)

Acknowledgments

Funded by University of California Center for Health Quality and Innovation.

Author Contributions

Conceived and designed the experiments: RR ML DN AR BB GH WM AM. Performed the experiments: RR ML DN AR BB GH WM AM. Analyzed the data: RR IA. Wrote the first draft of the manuscript: RR. Contributed to the writing of the manuscript: RR ML DN AR BB GH WM AM IA. Enrolled patients: RR ML DN AR BB GH WM AM. Agree with the manuscript’s results and conclusions: RR ML DN AR BB GH WM AM IA. All authors have read, and confirm that they meet, ICMJE criteria for authorship.

References

  1. 1. Korley FK, Pham JC, Kirsch TD. Use of advanced radiology during visits to US emergency departments for injury-related conditions, 1998–2007. JAMA. 2010;304:1465–1471. doi: 10.1001/jama.2010.1408. pmid:20924012
  2. 2. Larson DB, Johnson LW, Schnell BM, Salisbury SR, Forman HP. National trends in CT use in the emergency department: 1995–2007. Radiology. 2011;258:164–173. doi: 10.1148/radiol.10100640. pmid:21115875
  3. 3. Broder J, Warshauer DM. Increasing utilization of computed tomography in the adult emergency department, 2000–2005. Emerg Radiol. 2006;13:25–30. pmid:16900352 doi: 10.1007/s10140-006-0493-9
  4. 4. Huber-Wagner S, Lefering R, Qvick LM, Körner M, Kay MV, Pfeifer KJ, et al. Effect of whole-body CT during trauma resuscitation on survival: a retrospective multicentre study. Lancet. 2009;373:1455–1461. doi: 10.1016/S0140-6736(09)60232-4. pmid:19321199
  5. 5. Salim A, Sangthong B, Martin M, Brown C, Plurad D, Demetriades D. Whole body imaging in blunt multisystem trauma patients without obvious signs of injury. Arch Surg. 2006;141:468–475. pmid:16702518 doi: 10.1001/archsurg.141.5.468
  6. 6. Tillou A, Gupta M, Baraff LJ, Schriger DL, Hoffman JR, Hiatt JR, et al. Is the use of pan-computed tomography for blunt trauma justified? A prospective evaluation. J Trauma. 2009;67:779–787. doi: 10.1097/TA.0b013e3181b5f2eb. pmid:19820586
  7. 7. Campion EM, Mackersie RC. Recent developments in the assessment of the multiply injured trauma patient. Opin Crit Care. 2014;20:620–625. doi: 10.1097/mcc.0000000000000151
  8. 8. Smith-Bindman R, Lipson J, Marcus R, Kim KP, Mahesh M, Gould R, et al. Radiation dose associated with common computed tomography examinations and the associated lifetime attributable risk of cancer. Arch Intern Med. 2009;169:2078–2086. doi: 10.1001/archinternmed.2009.427. pmid:20008690
  9. 9. Brenner DJ, Hall EJ. Computed tomography—an increasing source of radiation exposure. N Engl JMed. 2007;357:2277–2284. doi: 10.1056/nejmra072149
  10. 10. Fazel R, Krumholz HM, Wang Y, Ross JS, Chen J, Ting HH, et al. Exposure to low-dose ionizing radiation from medical imaging procedures. N Engl J Med. 2009;361:849–857. doi: 10.1056/NEJMoa0901249. pmid:19710483
  11. 11. Berrington de González A, Mahesh M, Kim KP, Bhargavan M, Lewis R, Mettler F, et al. Projected cancer risks from computed tomographic scans performed in the United States in 2007. Arch Intern Med. 2009;169:2071–2077. doi: 10.1001/archinternmed.2009.440. pmid:20008689
  12. 12. Amis ES Jr, Butler PF, Applegate KE, Birnbaum SB, Brateman LF, Hevezi JM, et al. American College of Radiology white paper on radiation dose in medicine. J Am Coll Radiol. 2007;4:272–284. pmid:17467608 doi: 10.1016/j.jacr.2007.03.002
  13. 13. ABIM Foundation, American College of Surgeons. Five things physicians and patients should question. Chicago: American College of Surgeons. Available: https://www.facs.org/~/media/files/education/acslist.ashx. Accessed 3 September 2015.
  14. 14. Hricak H, Brenner DJ, Adelstein SJ, Frush DP, Hall EJ, Howell RW, et al. Managing radiation use in medical imaging: a multifaceted challenge. Radiology. 2011;258:889–905. doi: 10.1148/radiol.10101157. pmid:21163918
  15. 15. Rodriguez RM, Baumann BM, Raja AS, Langdorf MI, Anglin D, Bradley RN, et al. Diagnostic yields, charges, and radiation dose of chest imaging in blunt trauma evaluation. Acad Emerg Med. 2014;6:644–650. doi: 10.1111/acem.12396
  16. 16. Rodriguez RM, Hendey GW, Mower W, Kea B, Fortman J, Merchant G, et al. Derivation of a decision instrument for selective chest radiography in blunt trauma. J Trauma. 2011;71:549–553. doi: 10.1097/TA.0b013e3181f2ac9d. pmid:21045745
  17. 17. Rodriguez RM, Anglin D, Langdorf MI, Baumann BM, Hendey GW, Bradley RN, et al. NEXUS Chest: validation of a decision instrument for selective chest imaging in blunt trauma. JAMA Surg. 2013;148:940–946. doi: 10.1001/jamasurg.2013.2757. pmid:23925583
  18. 18. Brink M, Deunk J, Dekker HM, Edwards MJ, Kool DR, van Vugt AB, et al. Criteria for the selective use of chest computed tomography in blunt trauma patients. Eur Radiol. 2010;20:818–828. doi: 10.1007/s00330-009-1608-y. pmid:19760233
  19. 19. Barrios C, Pham J, Malinoski D, Dolich M, Lekawa M, Cinat M. Ability of a chest X-ray and an abdominal computed tomography scan to identify traumatic thoracic injury. Am J Surg. 2010;200:741–744. doi: 10.1016/j.amjsurg.2010.08.004. pmid:21146014
  20. 20. Harris PA, Taylor R. Thielke R, Payne J, Gonzalez N, Conde JG. Research electronic data capture (REDCap)—a metadata-driven methodology and workflow process for providing translational research informatics support, J Biomed Inform. 2009;42:377–381. doi: 10.1016/j.jbi.2008.08.010. pmid:18929686
  21. 21. Stiell IG, Wells GA. Methodologic standards for the development of clinical decision rules in emergency medicine. Ann Emerg Med. 1999;33:437–447. pmid:10092723 doi: 10.1016/s0196-0644(99)70309-4
  22. 22. Gilbert EH, Lowenstein SR, Koziol-McLain J, Barta DC, Steiner J. Chart reviews in emergency medicine research: where are the methods? Ann Emerg Med. 1996;27:305–308. pmid:8599488 doi: 10.1016/s0196-0644(96)70264-0
  23. 23. Brehaut JC, Stiell IG, Visentin L, Graham ID. Clinical decision rules “in the real world”: how a widely disseminated rule is used in everyday practice. Acad Emerg Med. 2005;12:948–956. pmid:16166599 doi: 10.1111/j.1553-2712.2005.tb00805.x
  24. 24. Gupta M, Schriger DL, Hiatt JR, Cryer HG, Tillou A, Hoffman JR, et al. Selective use of computed tomography compared with routine whole body imaging in patients with blunt trauma. Ann Emerg Med. 2011;58:407–416. doi: 10.1016/j.annemergmed.2011.06.003. pmid:21890237
  25. 25. Chen MYM, Miller PR, McLaughlin CA, Kortesis BG, Kvavnagh PV, Dyer RB. The trend of using computed tomography in the detection of acute thoracic aortic and branch vessel injury after blunt thoracic trauma: single-center experience over 13 years. J Trauma. 2004;56:783–785. pmid:15187742 doi: 10.1097/01.ta.0000063407.47520.f7
  26. 26. Fishman JE. Imaging of blunt aortic and great vessel trauma. J Thorac Imaging. 2000;15:97–103. pmid:10798628 doi: 10.1097/00005382-200004000-00004
  27. 27. Nandipati KC, Allamaneni S, Kalcarla R, Wong A, Richards N, Satterfield J, et al. Extended focused assessment with sonography for trauma (EFAST) in the diagnosis of pneumothorax: experience at a community based level I trauma center. Injury. 2011;42:511–514. doi: 10.1016/j.injury.2010.01.105. pmid:20149371
  28. 28. Huber-Wagner S, Biberthaler P, Habarle S, Wierer M, Dobritz M, Rummeny E, et al. Whole-body CT in haemodynamically unstable severely injured patients—a retrospective, multicentre study. PLoS ONE. 2013;8:e68880. doi: 10.1371/journal.pone.0068880. pmid:23894365
  29. 29. Jiang L, Ma Y, Jiang S, Ye L, Zheng Z, Xu Y, et al. Comparison of whole-body computed tomography vs selective radiological imaging on outcomes in major trauma patients: a meta-analysis. Scand J Trauma Resusc Emerg Med. 2014;22:54. doi: 10.1186/s13049-014-0054-2. pmid:25178942
  30. 30. Rodriguez RM, Henderson TM, Ritchie AM, Langdorf MI, Raja AS, Silverman E, et al. Patient preferences and acceptable risk for computed tomography in trauma. Injury. 2014;45:1345–1349. doi: 10.1016/j.injury.2014.03.011. pmid:24742979
  31. 31. Lee CI, Haims AH, Monico EP, Brink JA, Forman HP. Diagnostic CT scans: assessment of patient, physician, and radiologist awareness of radiation dose and possible risks. Radiology. 2004;231:393–398. pmid:15031431 doi: 10.1148/radiol.2312030767
  32. 32. Hall EJ, Brenner DJ. Cancer risks from diagnostic radiology. Br J Radiol. 2008;81:362–378. doi: 10.1259/bjr/01948454. pmid:18440940
  33. 33. Sarma A, Heilbrun ME, Conner KE, Stevens SM, Woller SC, Elliott CG. Radiation and chest CT scan examinations: what do we know? Chest. 2012;142:750–760. doi: 10.1378/chest.11-2863. pmid:22948579
  34. 34. Odell DD, Peleg K, Givon A, Radomislensky I, Makey I, Decamp MM, et al. Sternal fracture: isolated lesion versus polytrauma from associated extrasternal injuries—analysis of 1,867 cases. J Trauma. 2013; 75:448–452. doi: 10.1097/ta.0b013e31829e227e
  35. 35. Hossian M, Ramavath A, Kulangara J, Andrew JG. Current management of isolated sterna fractures in the UK: time for evidences based practice? A cross-sectional survey and review of the literature. Injury. 2010;41:495–498. doi: 10.1016/j.injury.2009.07.072. pmid:19682680
  36. 36. Deunk J, Poels TC, Brink M, Dekker HM, Kool DR, Blickman JG, et al. The clinical outcome of occult pulmonary contusion on multidetector-row computed tomography in blunt trauma patients. J Trauma. 2010;68:387–394. doi: 10.1097/TA.0b013e3181a7bdbd. pmid:20154551
  37. 37. de Lesquen H, Avaro J, Gust L, Ford RM, Beranger F, Natale C, et al. Surgical management for the first 48 h following blunt chest trauma: state of the art (excluding vascular injuries). Interact Cardiovasc Thorac Surg. 2015; 20:399–408. doi: 10.1093/icvts/ivu397. pmid:25476459
  38. 38. Ziegler K, Feeny JM, Desai C, Sharpio D, Marshall WT, Twohig M. Retrospective review of the use and costs of routine chest x rays in a trauma setting. J Trauma Manag Outcomes. 2013;7:2. doi: 10.1186/1752-2897-7-2. pmid:23656999
  39. 39. Traub M, Stevenson M, McEvoy S, Briggs G, Lo SK, Leibman S, et al. The use of chest computed tomography versus chest X-ray in patients with major blunt trauma. Injury. 2007;38:43–47. pmid:17045268 doi: 10.1016/j.injury.2006.07.006
  40. 40. Kea B, Gamarallage R, Fortman J, Lunney K, Hendey GW, Rodriguez RM. What is the clinical significance of chest computed tomography when the chest x-ray result is normal in patients with blunt trauma? Am J Emerg Med. 2013;31:1268–1273. doi: 10.1016/j.ajem.2013.04.021. pmid:23796979
  41. 41. Kuppermann N, Holmes JF, Dayan PS, Hoyle JD Jr, Atabaki SM, Holubkov R, et al. Identification of children at very low risk of clinically-important brain injuries after head trauma: a prospective cohort study. Lancet. 2009;374:1160–1170. doi: 10.1016/S0140-6736(09)61558-0. pmid:19758692
  42. 42. Hoffman JR, Mower WR, Wolfson AB, Todd KH, Zucker MI. Validity of a set of clinical criteria to rule out injury to the cervical spine in patients with blunt trauma. National Emergency X-Radiography Utilization Study Group. N Engl J Med. 2000;343:94–99. pmid:10891516 doi: 10.1056/nejm200007133430203