Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Use of Lumbar Spine Magnetic Resonance Imaging in Eastern China: Appropriateness and Related Factors

  • Liedao Yu,

    Affiliation Spine lab, Department of Orthopedic Surgery, The First Affiliated Hospital of Zhejiang University, Hangzhou, 310003, PR China

  • Xuanwei Wang,

    Affiliation Spine lab, Department of Orthopedic Surgery, The First Affiliated Hospital of Zhejiang University, Hangzhou, 310003, PR China

  • Xiangjin Lin ,

    wangyuespine@gmail.com (YW); doclinxj@126.com (XL)

    Affiliation Spine lab, Department of Orthopedic Surgery, The First Affiliated Hospital of Zhejiang University, Hangzhou, 310003, PR China

  • Yue Wang

    wangyuespine@gmail.com (YW); doclinxj@126.com (XL)

    Affiliation Spine lab, Department of Orthopedic Surgery, The First Affiliated Hospital of Zhejiang University, Hangzhou, 310003, PR China

The Use of Lumbar Spine Magnetic Resonance Imaging in Eastern China: Appropriateness and Related Factors

  • Liedao Yu, 
  • Xuanwei Wang, 
  • Xiangjin Lin, 
  • Yue Wang
PLOS
x

Abstract

Back pain is common and costly. While a general scene of back pain related practice in China remains unknown, there are signs of excessive use of lumbar spine magnetic resonance (MR). We retrospectively studied 3107 lumbar spine MRIs in Eastern China to investigate the appropriateness of lumbar spine MR use. Simple back pain is the most common chief complaint for ordering a lumbar MR study. Only 41.3% of lumbar spine MR studies identified some findings that may have potential clinical significance. Normal lumbar spine is the most common diagnosis (32.7%), followed by lumbar disc bulging and lumbar disc herniation. Walk difficulties, back injury and referred leg pain as chief complaints were associated with greater chance of detecting potentially clinically positive lumbar MR image findings, as compare with simple back pain. There was no difference in positive rates among orthopedic surgeon and specialists of other disciplines. Lumbar spine MR imaging was generally overused in Eastern China by various specialists, particularly at health assessment centers. For appropriate use of lumbar spine MR, orthopedic surgeons are no better than physicians of other disciplines. Professional training and clinical guidelines are needed to facilitate evidence-based back pain practice in China.

Introduction

Back pain is a worldwide health problem in adults [1]. The costly diagnostic imaging and clinical interventions for back pain add considerable burden on health care systems in many countries [2]. Using standard radiologic studies, however, only a small portion of back pain patients could be precisely diagnosed with pathoanatomical findings [1]. Radiologic study, therefore, is of limited value, if past history and clinical evaluation are not suggestive of a serious underlying pathology.

Magnetic resonance (MR) imaging, which is able to provide a clear three-dimensional visualization of spinal structures, is regarded as the best non-invasive approach to detect lumbar pathologies. The most common findings on MR images perhaps are degenerative changes of the lumbar spine, such as disc degeneration, disc herniation, spinal canal stenosis, and facet joint hypertrophy. These findings, however, are common in both symptomatic and asymptomatic adults [36], and are weakly associated with back pain [7]. Lumbar degenerative findings, therefore, may not necessarily represent pathological changing. Rather, most of them are signs of physiological ageing. For patients with common back pain, MR have limited diagnostic and therapeutic impacts [8]. Epidemiology studies revealed that excessive imaging for back pain is associated with increased medication and spine surgery [9]. Unnecessary imaging, therefore, could be harmful to patients [10].

Yet, there is a wildly spread misconception that MR imaging is necessary to establish the cause of back pain [11, 12]. Despite the well-defined limitations, lumbar spine MR is commonly used for back pain screening and its use keeps increasing in a considerable rate [9, 13]. A number of clinical guidelines or strategies, such as red flags marking, appropriateness criteria (ACR), radiology benefits management (RBM) and clinical decision support systems [14], were developed to enhance an appropriate use of lumbar spine MR imaging in back pain practice. Despite decades of efforts to transfer scientific conclusions to clinical practice, it was estimated that one third to two thirds of spinal MR imaging may be inappropriately prescribed in the United States [15].

Little attention has been paid to back pain in China. Only recently is there an epidemiology study reported a point prevalence rate of 26% for back pain in Beijing adults [16]. Different from health care systems in Western countries, however, general practitioner and community service have yet to be developed in China. Specialists are available for direct consultation and back pain patients may refer to physicians of many disciplines. Lumbar spine MR imaging, thus, could be prescribed by various practitioners, regardless of their training background. Moreover, professional training for back pain care is scarce. Although scientific research evidenced that there is a gap between MR findings and back pain, there is a common misunderstanding among Chinese physicians that MR could identify the cause of back pain. In addition, currently there is no applicable clinical guideline for back pain practice and lumbar spine imaging in China.

While a general scene of back related practice in China remains largely unknown, there are signs of excessive use of lumbar spine MR. We retrospectively studied a large sample of lumbar spine MRIs in Eastern China to investigate the appropriateness of lumbar spine MR imaging and further to determine associated factors.

Materials and Methods

Study samples

The current study was conducted in Hangzhou, a typical middle-size city in China. Hangzhou is the capital city of Zhejiang Province in Eastern China, with a registered population of approximately six million. In Hangzhou, public general hospitals own all MR scanners. In Chinese health care system, public hospitals are classified as university hospitals, provincial hospitals and city hospitals, based on their size and abilities to provide medical care and education.

We aimed to include the vast majority of lumbar spine MR imaging conducted in Hangzhou city (not including satellite cities) on the January of 2013. A hospital in Hangzhou city will be included if: 1) it is a general hospital; 2) owns at least one MR scanner; 3) electronic records and images are available; 4) ethic review approved. Military hospital and specialized hospital, such as children’s hospital, women’s hospital, and cancer center, were excluded.

All lumbar spine MR imaging conducted during the defined period were included. Related data, including the patients’ age, gender, chief complaints, duration of symptoms, specialties of prescribing physician, and MR images, were extracted from Picture Archiving and Communication Systems (PACS) for analyses. The study was approved by the medical ethic board of the 1st hospital of Zhejiang University. As this is only a retrospective image study, written informed consent from patient was waived and the patients’ information was anonymized and de-identified prior to any data analyses.

Criteria for MR diagnosis

In most cases, MR reports written by local radiologists typically provided detailed descriptions of image findings but not diagnostic conclusion. Moreover, there are considerable variations of definitions in MR diagnosis of common lumbar spine disorders. In addition, there is substantial variability among radiologists of different levels. To minimize errors and standardize lumbar MR diagnoses, we specifically proposed strict MR diagnostic criteria for various lumbar spine disorders (Table 1). The criteria were proposed in such a way that the MR diagnosis could reasonably explain clinical symptoms. Degenerative findings of slight to moderate degrees, which are less likely to produce clinical symptoms, were regarded as normal. Such findings include disc degeneration (decreased signal intensity, narrowed disc space), annular tear and Modic Changes [17].

A routine lumbar spine MR study conducted in Hangzhou includes 11 T1-weighted sagittal images, 11 T2-weighted sagittal images, and 9 T2-weighted axial images for the lower three lumbar intervertebral discs. There are special sequences for some cases, such as fat depression sequence and contrast sequence. All available MR images were evaluated to draw a main MR diagnosis for the imaged lumbar spine.

Three senior orthopedic surgeons, who are on average with 10 years’ experience with MRI, reviewed included lumbar spine MRIs. Before MRI evaluation, the three raters reviewed 50 sets of lumbar MRIs together to acquire a common sense of the proposed diagnostic criteria. The MRI review was performed in a PACS workstation and the raters were blinded to the patient’s history and physical examinations.

Definition of potentially clinically positive diagnosis

Based on potential clinical relevance, MR diagnosis was classified as potentially clinically positive or clinically negative. MR diagnoses of systematic lumbar spine diseases or neurologic compression which may need clinical interventions are defined as potentially clinically positive diagnosis, including lumbar disc herniation, lumbar spinal canal stenosis, spondylolisthesis, spinal tumor, spinal infection, fresh vertebral fracture, and spinal deformity (scoliosis or kyphosis). Findings that are common among both healthy individuals and back pain patients, which deserve little or no clinical attention, were classified as clinically negative diagnosis, including disc degeneration, high intensity zone in the disc, obsolete vertebral fractures, fat deposition in the vertebral body, Modic Changes, facet joint degeneration, and cysts on the disc, facet joint or sacral canal.

A MR study was regarded as appropriate if there are potentially clinically positive findings on MR images. Otherwise, it was considered to be inappropriate.

Statistical analysis

Data were analyzed using STATA (Version 12.0, StataCorp LP, USA). Descriptive statistics were used to compare findings among hospitals, departments, and physicians of different specialties. Multivariable logistic regressions were used to determine the associations between potentially clinically positive findings and related factors, and the associations between positive lumbar MR findings and the duration of a specific chief complaint.

Results

Except for three relatively small hospitals, all general hospitals in Hangzhou city which own a MR scanner were included in the current study. As a result, we studied 10 leading hospitals of various ranks in Hangzhou, including 3 hospitals affiliated to Zhejiang University, 3 provincial hospitals and 4 city hospitals. For the three excluded hospitals, electronic MR images database was not available in two and ethic permission was not obtained in another.

From January 1st to January 31st of 2013, there were 3107 patients (1369 male and 1738 female patients, age 52.73±16.14 years, range 3 to 100 years) underwent lumbar MR imaging at the included 10 hospitals. Among them, 1406 (45.3%) cases were conducted at hospitals affiliated to Zhejiang University, 752 (24.2%) cases at provincial hospitals, and 949 (30.5%) cases at city hospitals. There are 2513 outpatient cases (81.1%) and 285 hospitalized patients (18.9%).

Of all the lumbar spine MR studies, 64.1% were ordered by orthopedic surgeons, 21.7% by various specialists of internal medicine, 7.2% by neurologists and neurosurgeons, and the remaining 7.0% by the practitioners at health assessment centers which specifically provide routine health evaluation service.

The rate of potentially clinically positive diagnosis

Using our definition, only 41.3% of all lumbar spine MR studies were considered as potentially clinically positive diagnosis. Findings of the remaining 58.3% lumbar spine MRIs were regarded as clinically negative. Normal lumbar spine is the most common diagnosis (32.7%) on lumbar spine MRIs, followed by lumbar disc bulging (26.2%) and lumbar disc herniation (15.0%) (Fig 1).

thumbnail
Fig 1. MR diagnosis evaluated by orthopedic surgeons for 3107 lumbar spine MR studies.

http://dx.doi.org/10.1371/journal.pone.0146369.g001

Chief complaints for ordering a lumbar MR study

Simple back pain is the most common chief complaint for ordering a lumbar MR study (40.0%), followed by back pain with radiating leg pain (27.2%) and simple leg pain (11.8%). The constitution of chief complaints is presented in Fig 2.

thumbnail
Fig 2. The constitution of chief complaints for ordering a lumbar spine MR study (N = 3107).

http://dx.doi.org/10.1371/journal.pone.0146369.g002

Factors associated with the rate of potentially clinically positive diagnosis

The rates of potentially clinically positive diagnosis in relation to patient’s age, gender, chief complaint, hospital rank and prescribing physician are presented in Table 2. A trend of greater age associated with higher rate of potentially clinically positive diagnosis was clear.

thumbnail
Table 2. Percentage of potentially clinically positive diagnosis in relation to studied factors.

http://dx.doi.org/10.1371/journal.pone.0146369.t002

A multiple variable regression model was used to explore the determinants for the rate of potentially clinically positive diagnosis (Table 3). Male patients were statistically significantly associated with greater rate of potentially clinically positive MR findings, as compared with female patients (OR = 1.22, P = 0.03). Chief complaints were important determinants for potentially clinically positive MR findings. Except for health assessment, leg pain, back and leg pain, walk difficulties, and back injury as chief complaints were statistically significantly associated with greater possibility of detecting potentially clinically positive lumbar MR findings, as compare to simple back pain (Table 3).

thumbnail
Table 3. Associations between presence of clinically significant MR findings and related factors: results from multiple variable regression analysis*.

http://dx.doi.org/10.1371/journal.pone.0146369.t003

Provincial hospitals, but not city hospitals, were statistically associated with lower rate of positive MR findings, as compared with university hospitals. Practitioners at health assessment centers had significantly lower rate of potentially clinically positive findings than orthopedic surgeons (OR = 0.36, P<0.001). There was no statistically significant difference among the rates of potentially clinically positive findings among orthopedic surgeon, neurologist/neurosurgeon, and specialist of internal medicine, after adjusting for other confounding factors.

Duration of chief complaint and potentially clinically positive diagnosis

The duration of simple back pain, leg pain, back and back pain, and walk difficulties were not associated with greater rate of potentially clinically positive lumbar spine MR diagnosis, adjusting for age and gender (Table 4).

thumbnail
Table 4. Associations between the presence of potentially clinically positive MR findings and duration of chief complaints, adjusting for age and gender.

http://dx.doi.org/10.1371/journal.pone.0146369.t004

Discussion

For the first time, the appropriateness of lumbar spine MR use in China was investigated. The current study revealed that most lumbar spine MR imaging did not identify any finding that may have potential clinical significance, suggesting that lumbar spine MR imaging was considerably overused in Eastern China. In particular, lumbar MR was abused at health assessment centers, as merely a rather small percentage of lumbar MR imaging proscribed there detected findings may have potential clinical significance. Moreover, the rates of potentially clinically positive findings on lumbar spine MRIs were similar among specialists of various disciplines, suggesting that there may be a general insufficiency in back pain related training for physicians in China.

It should be noted that the identified positive rate of 41.3% may represent a maximal rate of appropriateness of lumbar spine MR use. Occasionally, clinical symptoms and history strongly indicated for a lumbar MR study but as a result identified no significant findings. Therefore, MR imaging with negative findings does not fully represent inappropriate use of MR as it may have ruled out suspicious pathologies. To a larger degree, however, MR may be inappropriately used for those without any positive finding on MRIs. On the other hand, the identified positive lumbar MR findings may not necessarily mean to have clinical significance, as MR is not able to reliably differentiate symptomatic from asymptomatic spinal image abnormalities [4]. Some of them are incidental findings that are not responsible for the current complaints [18]. For example, disc herniation and lumbar spine canal stenosis are common findings on asymptomatic volunteers and thus, may not be able to explain the current back pain [18]. In addition, MR imaging does not influence or change clinical management, even if clinical symptoms could be attributable to the identified MR findings. As such, the true appropriateness rate for lumbar spine MR use may be much lower than that observed in the current study.

As an important component of back pain management, the appropriateness of lumbar spine MR utilization has been studied in developed countries using ACR criteria [12], expert opinion [19], or other criteria derived from clinical guidelines [20, 21]. The reported rates of appropriateness of lumbar MR use ranged considerably from 12% to 56.7%. Different from previous studies, we used image findings, as assessed by experienced orthopedic surgeons, to estimate the appropriateness of lumbar MR use. As MR diagnosis criteria for lumbar disorders vary, we specifically proposed a restrict MR diagnosis criterion to minimize errors from evaluators’ conceptual differences on MR findings. This diagnosis protocol counts only severe image findings that deserve further clinical attentions. Mild and moderate degenerative pathologies, such as disc degeneration and canal stenosis, which are less likely associated with current pain and thus, were regarded as accidental findings did not cause clinical symptoms. Although the criteria and cut-off rationale remain controversial, we think it is reasonable for appropriateness evaluation, given the fact that a severe image finding is typically regarded as an indicator for clinical intervention.

There are several reasons that may explain the relatively high rate of inappropriate use of lumbar spine MR imaging in China. It is well-known that explicit guidelines to support physician’s decision making could improve clinical practice and outcomes [22]. Yet, the managements of back pain and related problems are inadequately addressed in the developing country of China. Applicable clinical guidelines for back pain screening and appropriate use of lumbar spine MR imaging are currently absent in China. As a result, back pain practice largely relies on physicians’ clinical experience. On the other hand, back pain education in China is inadequate. Resident training or post-graduate education was absent for most Chinese physicians in the past half century. As there is no general practitioner for back pain screening, most back pain patients directly visit orthopedic surgeons. One may expect that the rate of appropriate use of lumbar MR would be higher with orthopedic consultation than that with general practitioners, as did in many countries. Yet, the rate of potentially clinically positive findings was low, despite 65% of lumbar spine MR imaging was ordered by orthopedic surgeons. The appropriateness rates were not different between orthopedic surgeons and other physicians, suggesting that the excessive use of lumbar spine MR is a holistic problem and professional back pain training is generally insufficient for most physicians.

Other possible reasons for inappropriate use of lumbar spine MR include medical liability fears, meeting patient’s demand, and economic motivation. Reportedly many practitioners order a lumbar MR study to meet the patients’ expectations about MR tests [23]. Another unexpected finding is that the rate of potentially clinically positive MR findings was only 16% at health assessment centers. Such department, however, is highly economically motivated. Lumbar spine MR imaging is prescribed on a self-service basis, or recommended by practitioners there without any screening.

Although there is no radiation exposure, MR imaging may do more harms than good [10]. Even among patients with back pain, MRI findings may be misleading. Incidental findings may lead to over diagnosis and over medication. In addition to the high costs of MR imaging and consequent medication, increased use of lumbar MR imaging is associated with higher rates of spine surgery without better outcomes [9]. Moreover, label patients with a MR diagnosis may result in fear, anxiety and depression in the patients and dependence on medical care [24]. A lumbar MR study, therefore, should be saved for those who potentially have underlying serious systemic problems and should not be used as a routine for health assessment. Targeted use of lumbar spine MR should be emphasized as it can reduce patients’ health expanse, shorten waiting time, and promote the reasonable allocation of medical resources [25, 26].

The current study confirmed that walk difficulties and back injury are better indicators for a lumbar MR study, as relative to simple back pain. This is consistent with previous studies that back pain without referred leg pain is a risk factor for inappropriate prescription of lumbar spine MR [20, 21]. Opposing to common view, however, increased duration of back pain, leg pain or walk problems was not associated with greater chance of detecting potentially clinically significant findings on MR images. Chronic low back pain, a condition without radiculopathy or anatomical abnormalities clearly responsible for the pain [1], could explain the identified association between back pain duration and negative MR findings. Referred leg pain and difficulties in walking are clear signs of nerve root compression or stenosis [1] and thus, the presence but not duration is related to significant MR findings.

The current study is a retrospective investigation of lumbar spine MR use in a typical city of Eastern China. As the use of lumbar spine MR may vary in different geographic regions, it may not be able to represent that in whole China. Although the diagnostic criterion proposed is restrict, we did not take clinical history or physical examinations into consideration. While most leading hospitals in a typical city were studied and the study sample is large, we had experienced orthopedic surgeons reviewed all MR images to have a precise image diagnosis. Nevertheless, the present study provides a preliminary overview of the current status of back pain practice in China.

In summary, there is considerable overuse use of lumbar spine MR imaging by various specialists in Eastern China. Lumbar spine MR should not be routinely used for the purpose of back pain screening and health assessment. Professional training on back pain screening and clinical guidelines for the management of back related conditions are needed to promote effective allocation of medical resources and to facilitate evidence-based practice in China.

Acknowledgments

The authors thank Ms Ying Yuan for her assistance in data collection.

Author Contributions

Conceived and designed the experiments: XL YW. Performed the experiments: LY XW. Analyzed the data: YW. Contributed reagents/materials/analysis tools: XW. Wrote the paper: LY YW.

References

  1. 1. Deyo RA, Weinstein JN. Low back pain. N Engl J Med 2001;344: 363–70. pmid:11172169
  2. 2. Andersson GB. Epidemiological features of chronic low-back pain. Lancet 1999;354: 581–5. pmid:10470716
  3. 3. Boden SD, McCowin PR, Davis DO, Dina TS, Mark AS, Wiesel S. Abnormal magnetic-resonance scans of the cervical spine in asymptomatic subjects. A prospective investigation. J Bone Joint Surg Am 1990;72: 1178–84. pmid:2398088
  4. 4. Jensen MC, Brant-Zawadzki MN, Obuchowski N, Modic MT, Malkasian D, Ross JS. Magnetic resonance imaging of the lumbar spine in people without back pain. N Engl J Med 1994;331: 69–73. pmid:8208267
  5. 5. Stadnik TW, Lee RR, Coen HL, Neirynck EC, Buisseret TS, Osteaux MJ. Annular tears and disk herniation: prevalence and contrast enhancement on MR images in the absence of low back pain or sciatica. Radiology 1998;206: 49–55. pmid:9423651
  6. 6. Weishaupt D, Zanetti M, Hodler J, Boos N. MR imaging of the lumbar spine: prevalence of intervertebral disk extrusion and sequestration, nerve root compression, end plate abnormalities, and osteoarthritis of the facet joints in asymptomatic volunteers. Radiology 1998;209: 661–6. pmid:9844656
  7. 7. Battie MC, Bigos SJ, Fisher LD, Spengler DM, Hansson TH, Nachemson AL, et al. Anthropometric and clinical measures as predictors of back pain complaints in industry: a prospective study. J Spinal Disord 1990;3: 195–204. pmid:2151987
  8. 8. Chou R, Fu R, Carrino JA, Deyo RA. Imaging strategies for low-back pain: systematic review and meta-analysis. Lancet 2009;373: 463–72. doi: 10.1016/S0140-6736(09)60172-0. pmid:19200918
  9. 9. Deyo RA, Mirza SK, Turner JA, Martin BI. Overtreating chronic back pain: time to back off? J Am Board Fam Med 2009;22: 62–8. doi: 10.3122/jabfm.2009.01.080102. pmid:19124635
  10. 10. Flynn TW, Smith B, Chou R. Appropriate use of diagnostic imaging in low back pain: a reminder that unnecessary imaging may do as much harm as good. J Orthop Sports Phys Ther 2011;41: 838–46. doi: 10.2519/jospt.2011.3618. pmid:21642763
  11. 11. Chou R, Qaseem A, Owens DK, Shekelle P. Diagnostic imaging for low back pain: advice for high-value health care from the American College of Physicians. Ann Intern Med 2011;154: 181–9. doi: 10.7326/0003-4819-154-3-201102010-00008. pmid:21282698
  12. 12. Davis PC, Wippold FJ 2nd, Brunberg JA, Cornelius RS, De La Paz RL, Dormont PD, et al. ACR Appropriateness Criteria on low back pain. J Am Coll Radiol 2009;6: 401–7. doi: 10.1016/j.jacr.2009.02.008. pmid:19467485
  13. 13. Iglehart JK. Health insurers and medical-imaging policy—a work in progress. N Engl J Med 2009;360: 1030–7. doi: 10.1056/NEJMhpr0808703. pmid:19264694
  14. 14. Sistrom CL. The appropriateness of imaging: a comprehensive conceptual framework. Radiology 2009;251: 637–49. doi: 10.1148/radiol.2513080636. pmid:19474372
  15. 15. Rao JK, Kroenke K, Mihaliak KA, Eckert GJ, Weinberger M. Can guidelines impact the ordering of magnetic resonance imaging studies by primary care providers for low back pain? Am J Manag Care 2002;8: 27–35. pmid:11814170
  16. 16. Lu YW, Tian W, Liu YJ, Xiao B, Han X. A cross-sectional study on the prevalence and distribution of lumbar degenerational disease among adults in Beijing. Chinese Journal of Orthopaedics 2013;33: 6.
  17. 17. Modic MT, Ross JS. Lumbar degenerative disk disease. Radiology 2007;245: 43–61. pmid:17885180
  18. 18. Carragee E, Alamin T, Cheng I, Franklin T, van den Haak E, Hurwitz E. Are first-time episodes of serious LBP associated with new MRI findings? Spine J 2006;6: 624–35. pmid:17088193
  19. 19. Emery DJ, Shojania KG, Forster AJ, Mojaverian N, Feasby TE. Overuse of magnetic resonance imaging. JAMA Intern Med 2013;173: 823–5. doi: 10.1001/jamainternmed.2013.3804. pmid:23529302
  20. 20. Lehnert BE, Bree RL. Analysis of appropriateness of outpatient CT and MRI referred from primary care clinics at an academic medical center: how critical is the need for improved decision support? J Am Coll Radiol 2010;7: 192–7. doi: 10.1016/j.jacr.2009.11.010. pmid:20193924
  21. 21. Kovacs FM, Arana E, Royuela A, Cabrera A, Casillas C, Pinero P, et al. Appropriateness of lumbar spine magnetic resonance imaging in Spain. Eur J Radiol 2013;82: 1008–14. doi: 10.1016/j.ejrad.2013.01.017. pmid:23422282
  22. 22. Grimshaw JM, Russell IT. Effect of clinical guidelines on medical practice: a systematic review of rigorous evaluations. Lancet 1993;342: 1317–22. pmid:7901634
  23. 23. Deyo RA. Imaging idolatry: the uneasy intersection of patient satisfaction, quality of care, and overuse. Arch Intern Med 2009;169: 921–3. doi: 10.1001/archinternmed.2009.124. pmid:19468081
  24. 24. Deis N, Findlay JM. Appropriateness of lumbar spine referrals to a neurosurgical service. Can J Neurol Sci 2010;37: 843–8. pmid:21059549
  25. 25. Blackmore CC, Mecklenburg RS, Kaplan GS. Effectiveness of clinical decision support in controlling inappropriate imaging. J Am Coll Radiol 2011;8: 19–25. doi: 10.1016/j.jacr.2010.07.009. pmid:21211760
  26. 26. Graves JM, Fulton-Kehoe D, Martin DP, Jarvik JG, Franklin GM. Factors associated with early magnetic resonance imaging utilization for acute occupational low back pain: a population-based study from Washington State workers' compensation. Spine (Phila Pa 1976) 2012;37: 1708–18.