Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Diagnostic accuracy of three ultrasonography strategies for deep vein thrombosis of the lower extremity: A systematic review and meta-analysis

  • Noémie Kraaijpoel ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    n.kraaijpoel@amsterdamumc.nl

    Affiliation Department of Vascular Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands

  • Marc Carrier,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Department of Medicine, Division of Hematology, The Ottawa Hospital, Ottawa, ON, Canada, Ottawa Hospital Research Institute, Ottawa, ON, Canada, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada

  • Grégoire Le Gal,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Department of Medicine, Division of Hematology, The Ottawa Hospital, Ottawa, ON, Canada, Ottawa Hospital Research Institute, Ottawa, ON, Canada, Faculty of Medicine, University of Ottawa, Ottawa, ON, Canada

  • Matthew D. F. McInnes,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Clinical Epidemiology Program, Ottawa Hospital Research Institute, The Ottawa Hospital, ON, Canada, Department of Radiology, University of Ottawa, Ottawa, ON, Canada

  • Jean-Paul Salameh,

    Roles Conceptualization, Data curation, Project administration, Writing – review & editing

    Affiliation Clinical Epidemiology Program, Ottawa Hospital Research Institute, The Ottawa Hospital, ON, Canada

  • Trevor A. McGrath,

    Roles Conceptualization, Data curation, Project administration, Writing – review & editing

    Affiliation Department of Radiology, University of Ottawa, Ottawa, ON, Canada

  • Nick van Es,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Vascular Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands

  • David Moher,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliations Clinical Epidemiology Program, Ottawa Hospital Research Institute, The Ottawa Hospital, ON, Canada, School of Epidemiology, Public Health and Preventive Medicine, Ottawa University, Ottawa, ON, Canada

  • Harry R. Büller,

    Roles Conceptualization, Supervision, Writing – review & editing

    Affiliation Department of Vascular Medicine, Amsterdam UMC, University of Amsterdam, Amsterdam Cardiovascular Sciences, Amsterdam, the Netherlands

  • Patrick M. Bossuyt,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation Department of Clinical Epidemiology, Biostatistics, and Bioinformatics, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands

  • Mariska M. G. Leeflang

    Roles Conceptualization, Funding acquisition, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Clinical Epidemiology, Biostatistics, and Bioinformatics, Amsterdam UMC, University of Amsterdam, Amsterdam, the Netherlands

Abstract

Background

Compression ultrasonography (CUS) is the first-line imaging test in the diagnostic management of suspected deep vein thrombosis (DVT) of the lower extremity. Three CUS strategies are used in clinical practice. However, their relative diagnostic accuracy is uncertain.

Objectives

This systematic review and meta-analysis aimed to summarize and compare the diagnostic accuracy of single limited, serial limited, and whole-leg CUS for DVT.

Methods

MEDLINE, Embase, and CENTRAL were searched from January 1st, 1989 to July 23rd, 2019 for studies assessing at least one of the CUS strategies in adults with suspected DVT of the lower extremity, using clinical follow-up for venous thromboembolism or contrast venography as the reference standard. Study selection, data extraction, and risk of bias assessment were performed in duplicate by independent authors. A bivariate random-effects model was used to compute diagnostic accuracy summary estimates.

Results

Forty studies (n = 21,250) were included. The venous thromboembolic event rate after a negative CUS (failure rate) of single limited (1.4%; 95% CI, 0.83–2.5), serial limited (1.9%; 95% CI, 1.4–2.5), and whole-leg CUS (1.0%; 95% CI, 0.6–1.6) did not differ significantly. The proportion of positive results was lower with single limited CUS, as was DVT prevalence in this group.

Conclusions

The failure rates of single limited, serial limited, and whole-leg CUS for DVT appeared to be quite comparable. The relative failure rate of single limited CUS remains uncertain, as the DVT prevalence was lower in these studies. Therefore, this CUS strategy may only be safe in a selected group of low-risk patients. Preference for one of the strategies may be based on pretest probability assessment, feasibility, expertise, and perceived clinical relevance of isolated distal DVT.

Introduction

The first-line imaging test in the diagnostic management of patients presenting with clinically suspected deep vein thrombosis (DVT) is compression ultrasonography (CUS). Historically, contrast venography was the gold standard for DVT diagnosis, which assessed both distal and proximal deep veins of the lower extremity. When CUS emerged, its diagnostic accuracy for distal DVT was found to be suboptimal when compared with venography. However, technology improvements have led to better visualization of the deep venous system with CUS and at present, three CUS strategies are interchangeably used in clinical practice: single limited, serial limited, and whole-leg CUS.

Limited CUS, also called two-point, rapid, or proximal CUS, is easier and faster to perform as only the proximal deep veins of the lower extremity (i.e. popliteal veins or more proximal vessels) are assessed. It can be performed in a single or serial approach. The latter includes a second CUS examination after 5 to 10 days following an initial negative CUS to evaluate if a possible distal DVT has propagated to the proximal veins.

Whole-leg CUS, also referred to as complete CUS, is a single examination of the distal and proximal deep veins of the lower extremity, thereby detecting both distal and proximal DVT. It is relatively time-consuming and technically more demanding than limited CUS. Therefore, availability may differ between centers, depending on expertise and feasibility at busy emergency departments.

The relative diagnostic performance of the different CUS strategies is unclear. Current guidelines include conflicting recommendations with regard to preferred CUS strategy [15]. This guidance is mostly based on indirect comparisons between the strategies, as intra-individual comparisons and randomized trials in this particular field are scarce. The present systematic review of published literature and a meta-analysis of the reported results aimed to summarize and compare the diagnostic accuracy of single limited, serial limited, and whole-leg CUS for DVT.

Methods

This systematic review followed the reporting recommendations of the Preferred Reporting Items for Systematic reviews and Meta-Analyses for Diagnostic Test Accuracy statement (PRISMA-DTA checklist; S1 Appendix) [6]. The protocol was registered at the International Prospective Register of Systematic Reviews Registry (PROSPERO; CRD42018086651).

Literature search

A systematic search was conducted on July 23rd, 2019, in MEDLINE and Embase from January 1st, 1989 (the year in which the first high-quality study evaluating two-point CUS for suspected DVT was published [7]) up to the search date, combining terms for ‘deep vein thrombosis’ and ‘ultrasonography’ (see S2 Appendix for search strategies). The Cochrane Central Register of Controlled Trials (CENTRAL) was searched from April 1st, 2019 to July 23rd, 2019. In addition, conference proceedings of the American Society of Hematology (2004 to 2018) and the International Society for Thrombosis and Hemostasis (2003 to 2019), and references in reports of eligible studies were hand searched. The search was restricted to original studies reported in English, German, Dutch, French, Italian, or Spanish.

Eligibility criteria

Studies evaluating single or serial limited and/or single whole-leg CUS in adults in whom DVT of the lower extremity was clinically suspected in the inpatient or outpatient setting were eligible. At least one ultrasonography strategy had to be evaluated in all-comers or in a subgroup of patients referred for imaging based on pre-test probability assessment and/or D-dimer testing.

Limited CUS was defined as either a two-point or (extended) proximal approach. The two-point technique includes an examination of two venous segments, i.e. the common femoral vein at the level of the inguinal ligament and the popliteal vein in the popliteal fossa [8]. The (extended) proximal strategy examines additional segments of the proximal venous system, and may include the common and superficial femoral veins, the popliteal vein, and sometimes includes the confluence of the deep calf veins (i.e. calf trifurcation). Limited CUS comprises either a single or a serial examination in which a second assessment is performed after 5 to 10 days.

Whole-leg CUS was defined as an examination of both the proximal and distal deep venous system of the leg, including the femoral veins, the popliteal vein, the posterior and anterior tibial vein, and the peroneal vein. It may include the muscular veins (gastrocnemius or soleus).

Two types of studies were included: 1) contemporary diagnostic management studies in which only patients with a negative ultrasonography were assessed with a reference standard consisting of a clinical follow-up of at least 45 days for the occurrence of venous thromboembolism (i.e. DVT and fatal or non-fatal pulmonary embolism), and 2) earlier diagnostic accuracy studies in which contrast venography was the reference method.

Studies were excluded if patients were younger than 18 years, if those with a negative CUS or venography were systematically treated with anticoagulants, if diagnostic accuracy measures could not be obtained or reconstructed, or if different reference standards were used following CUS in the subgroups of interest.

Study selection, data extraction, and risk of bias and applicability assessment

Three authors (NK, JPS, and TMG) independently screened titles, abstracts, and subsequently full-text articles for eligibility. In case of disagreement between the reviewers, a discussion was held to reach consensus. Data extraction was performed by three independent authors (NK, JPS, and TMG) using standardized piloted forms, including study characteristics, patient characteristics, index and reference test characteristics, additional ultrasonography modalities, 2 x 2 data (total number of positives, true positives, false positives, true negatives, and false negatives), and venous thromboembolic events and mortality during follow-up. In case only a subgroup underwent the index test, only data from that specific subgroup were extracted. Diagnosis of DVT at baseline or venous thromboembolism during follow-up was considered confirmed as per the study physician’s judgement based on objective imaging.

Summary estimates were used to reconstruct 2 x 2 data in case such tables were not reported. Inconclusive or non-diagnostic test results were excluded from the 2 x 2 tables and were documented separately.

The risk of bias and applicability of each included study was independently assessed by three authors (NK, JPS, and TMG) using the QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies) tool [9], of which the items were adjusted as appropriate for the present study.

Outcomes of interest

Diagnostic accuracy measures of single limited, serial limited, and whole-leg CUS were separately assessed for 1) diagnostic management studies using clinical follow-up to document the occurrence of venous thromboembolic events, and 2) earlier diagnostic accuracy studies that had used contrast venography as the clinical reference standard.

For studies using clinical follow-up, the failure rate was the primary outcome, which is the proportion of patients with a negative ultrasonography at baseline who were diagnosed with a venous thromboembolic event during follow-up. In these studies, the lack of a reference test at baseline limits assessment of true and false positive test results, as all positive CUS examinations are considered diagnostic for DVT. As a consequence, evaluation of the sensitivity, specificity, and positive predictive value is hampered. Therefore, to provide information on the ratio between positive and negative test results, the proportion of positive results was also assessed. This measure is highly correlated with the prevalence of DVT among the examined patients.

For studies in which contrast venography was used as the reference standard, the false negative rate (1-negative predictive value) was the primary outcome. Estimates of sensitivity, specificity, positive predictive value, and negative predictive value were also assessed.

Statistical analysis

For the primary analysis, only studies with a low risk of bias and no concerns regarding applicability based on QUADAS-2 evaluation were included. Diagnostic accuracy measures were computed from the 2 x 2 contingency tables for each individual study.

A bivariate logit-normal random-effects model was used to compute diagnostic accuracy summary estimates with 95% confidence intervals (CI). Diagnostic accuracy summary estimates of the different CUS strategies were compared by adding CUS strategy type as covariate to the bivariate model.

Statistical heterogeneity was evaluated by estimating the between-study variance (tau-squared) and by providing a 95% prediction interval (PI), which is an estimate of the interval in which 95% of future observations in similar studies will fall. Potential sources of heterogeneity were explored using random-effects meta-regression analyses in which different study or patient characteristics were added to the model as dichotomous and/or continuous covariates, including DVT prevalence, patient selection prior to CUS examination (all-comers versus selected patients based on pre-test probability assessment and/or D-dimer), duration of symptoms, publication date, and proximal (examination of the proximal veins starting at the popliteal vein) versus extended limited ultrasonography (examination of the proximal veins starting at the calf trifurcation). Several additional pre-planned subgroup analyses were hampered by a lack of studies or unpublished data.

Additionally, sensitivity analyses were performed in which all studies were included, regardless of QUADAS-2 appraisal.

Statistical tests were two-sided and P-values below 0.05 were regarded as indicating statistical significance. All analyses were performed in R (R Foundation for Statistical Computing, Vienna, Austria, https://www.R-project.org), using the ‘mada’ package for the bivariate logit-normal random effects model and for meta-regression analyses. Forest plots were designed with Review Manager (RevMan version 5.3; Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014).

Role of the funding source

This project was supported by The Netherlands Organization for Scientific Research (NWO; project number 015.012.052). The funder had no role in the design and conduct of the study, or in the decision to submit the manuscript.

Results

Study characteristics

Of the 9,288 citations identified in the literature search, 40 studies (n = 21,250) were eligible and included in the analyses (see Fig 1 for the PRISMA flowchart) [7,1048]. Twenty-seven studies (68%), published between 1991 and 2017 (median, 2003), used clinical follow-up for venous thromboembolic events as reference standard. The remaining 13 studies used contrast venography (median year of publication, 1991; range, 1989 to 2007).

Twenty-two studies (55%; n = 15,779) were considered to have a low risk of bias and no concerns regarding applicability (S3 Appendix). The remaining 18 studies showed risk of bias or applicability concerns in at least one domain; mostly in the patient selection domain (n = 13; 33%), as it was often unclear whether a consecutive or random sample was enrolled (n = 10; 25%). In addition, in studies with contrast venography as the reference standard, knowledge of the reference standard results at interpretation of the index test (n = 3; 23%) and the time frame between CUS and venography assessment (n = 3; 23%) were often unclear.

Characteristics of the included studies are detailed in S4 Appendix. Thirty-six (90%) were prospective studies and four had a retrospective design. One study was in the primary care setting, the remaining 39 (98%) in the secondary care setting, of which 6 were reported to be in the emergency department setting only. Sample size ranged from 38 to 1,739 patients.

Characteristics of the index and comparator test and of the reference standard are shown in S5 Appendix. None of the studies had directly compared CUS strategies intra-individually. However, one study randomized patients to undergo either serial limited or whole-leg CUS [25]. Single limited CUS was evaluated in 16 studies (40%), serial limited CUS in 10 (25%), and single whole-leg CUS in 19 (48%). In studies with clinical follow-up as the reference standard, follow-up duration was 3 months, except for one study in which it was 6 months [35]. Ultrasonography was reported to be performed by radiologists in 10 studies (25%), ultrasonography technicians in 9 (23%), vascular physicians in 6 (15%).

Patient characteristics are detailed in S6 Appendix. Mean age ranged from 29 to 72 years (median, 60), the proportion of males from 0 to 68% (median, 41%), and the DVT prevalence from 2.8 to 59% (median, 25%).

Diagnostic accuracy in studies using clinical follow-up as reference standard

Single limited compression ultrasonography.

Six studies assessed single limited CUS of which 2,079 patients could be included in the meta-analysis [10,12,38,43,44,47]. Before CUS examination, patients were managed with the use of different diagnostic algorithms and were selected for imaging based on pretest probability assessment and/or D-dimer testing (S7 Appendix). Median DVT prevalence was 8.5% (IQR, 4.7 to 12). Summary estimates were 1.4% (95% CI, 0.83 to 2.5; 95% PI, 0.42 to 4.8) for the failure rate and 6.4% (95% CI, 3.5 to 11; 95% PI, 0.84 to 35) for the proportion of positive results (see Fig 2 for forest plots; see Table 1 for summary estimates). There was evidence of substantial heterogeneity across the results of the included studies, which was associated with DVT prevalence (as a continuous variable: p<0.001 for the proportion of positive results, p = 0.13 for the failure rate in meta-regression analysis).

thumbnail
Fig 2. Forest plots diagnostic accuracy of compression ultrasonography in studies that used clinical follow‐up as a reference standard.

Abbreviations: CI: confidence interval, CUS: compression ultrasonography. Pos and Neg indicate the number of positive and negative CUS results; FN (false negative) indicates the number of venous thromboembolic events during follow-up in those with a negative CUS result.

https://doi.org/10.1371/journal.pone.0228788.g002

thumbnail
Table 1. Summary estimates diagnostic accuracy of compression ultrasonography in studies that used clinical follow-up as a reference standard.

https://doi.org/10.1371/journal.pone.0228788.t001

Subgroup analyses were hampered by a lack of studies per group (S8 Appendix). Sensitivity analyses including all studies regardless of quality showed comparable results (n = 9 [1012,19,33,38,43,44,47]; see S9 Appendix for summary estimates).

Serial limited compression ultrasonography.

Serial limited CUS was evaluated in 11 studies of which 3,360 patients were included in the meta-analysis [12,15,25,31,35,38,39,43,4547]. Patients were either all-comers or were selected for imaging based on pretest probability assessment and/or D-dimer testing (S7 Appendix). Median DVT prevalence was 25% (IQR, 18 to 34). Median proportion of DVTs detected at second examination was 5.1% (IQR, 3.2 to 7.1). The summary failure rate was 1.9% (95% CI, 1.4 to 2.5; 95% PI, 1.1 to 3.2) and the proportion of positive results was 25% (95% CI, 18 to 33; 95% PI 6.8 to 60; see Fig 2 for forest plots; see Table 1 for summary estimates). Heterogeneity was partly explained by DVT prevalence (as a continuous variable: p<0.001 for the proportion of positive results, p = 0.23 for the failure rate in meta-regression analysis).

Subgroup analyses are shown in S8 Appendix. Diagnostic accuracy was comparable between all-comers and patients referred for imaging guided by pre-test probability and/or D-dimer, and was similar for proximal and extended limited CUS.

Sensitivity analyses including all studies regardless of quality included the same studies.

Whole-leg compression ultrasonography.

Seven studies assessed whole-leg CUS of which 3,159 patients were included in the meta-analysis [10,17,22,25,4042]. Patients were either all-comers or were selected for imaging based on pretest probability assessment and/or D-dimer testing (S7 Appendix). Median DVT prevalence was 27% (IQR, 18 to 34). The proportion of isolated distal DVTs relative to the total number of diagnosed DVTs ranged between 23 and 62% (S10 Appendix). The failure rate was 1.0% (95% CI, 0.6 to 1.6; 95% PI, 0.37 to 2.5) and the pooled proportion of positive results was 25% (95% CI, 16 to 36; 95% PI, 4.4 to 70; see Fig 2 for forest plots; see Table 1 for summary estimates). Heterogeneity was partly explained by DVT prevalence (as a continuous variable: p<0.001 for the proportion of positive results, p = 0.277 for the failure rate in meta-regression analysis).

Subgroup analyses are shown in S8 Appendix. Diagnostic accuracy was comparable between all-comers and patients referred for imaging based on pre-test probability and/or D-dimer. Sensitivity analyses including all studies regardless of quality showed comparable results (n = 12 [10,17,2125,29,30,4042]; see S9 Appendix for summary estimates).

Comparison compression ultrasonography strategies.

The failure rate did not differ significantly between the three techniques (serial limited vs. single limited CUS: p = 0.36 for meta-regression; whole-leg vs. single limited CUS: p = 0.51, and serial limited vs. whole-leg CUS: p = 0.08).

The proportion of positive results was significantly higher with serial limited and whole-leg CUS compared with single limited CUS (p<0.001 and p<0.001, respectively), and was comparable between serial and whole-leg CUS (p = 0.95).

Diagnostic accuracy in studies using contrast venography as reference standard

Single limited compression ultrasonography.

Single limited CUS was assessed in 2 studies totaling 686 patients of whom all underwent CUS [7,48]. DVT prevalence in these studies was 22% and 32%, respectively. Summary estimates for the detection of proximal DVT were 1.3% (95% CI, 0.1 to 10; 95% PI, 0.0 to 100) for the false negative rate, 96% (95% CI, 64 to 100; 95% PI, 0.0 to 100) for sensitivity, 98% (95% CI, 95 to 99; 95% PI, 0.0 to 100) for specificity, 95% (95% CI, 81 to 99; 95% PI, 0.0 to 100) for the positive predictive value, and 99% (95% CI, 90 to 100; 95% PI, 0.0 to 100) for the negative predictive value (see Fig 3 for forest plots and Table 2 for summary estimates).

thumbnail
Fig 3. Forest plots diagnostic accuracy of compression ultrasonography in studies that used contrast venography as a reference standard.

Abbreviations: CI: confidence interval, CUS: compression ultrasonography, FN: false negative, FP: false positive, NPV: negative predictive value, PPV: positive predictive value, TN: true negative, TP: true positive.

https://doi.org/10.1371/journal.pone.0228788.g003

thumbnail
Table 2. Summary estimates diagnostic accuracy of compression ultrasonography in studies that used contrast venography as a reference standard.

https://doi.org/10.1371/journal.pone.0228788.t002

Sensitivity analyses including all studies regardless of quality showed comparable results (n = 6 [7,20,26,32,36,48]; see S11 Appendix for summary estimates).

Serial limited compression ultrasonography.

None of the studies in which contrast venography was the reference standard assessed serial limited CUS.

Whole-leg compression ultrasonography.

One study published in 1990 (n = 75) assessed whole-leg CUS in all patients [37]. DVT prevalence was 45%. The proportions of proximal and isolated distal DVTs were not reported. The false negative rate was 16% (95% CI, 7.4 to 31), sensitivity was 79% (95% CI, 62 to 91), specificity 88% (95% CI, 73 to 95), positive predictive value 84% (95% CI, 66 to 94), and negative predictive value 84% (95% CI, 69 to 93).

Sensitivity analyses including all studies regardless of quality showed comparable results (n = 7 [14,16,18,27,28,34,37]; see S11 Appendix for summary estimates).

Comparison compression ultrasonography strategies.

The diagnostic accuracy of the three techniques across studies that had used contrast venography as reference test could not be compared due to a lack of studies in both groups.

Discussion

This systematic review summarizes the diagnostic accuracy of single limited, serial limited, and whole-leg CUS for the diagnosis of DVT. In earlier studies with contrast venography as the reference method, whole-leg CUS appeared to have a higher false negative rate than single limited CUS (16% vs. 1.3%). However, in more recent studies using clinical follow-up as the reference method, the thromboembolic event rate during follow-up (failure rate) appeared to be comparable among the three techniques. The proportion of positive test results was significantly lower with single limited CUS (6.4%) compared with serial limited and whole-leg CUS (both 25%), which is mainly explained by the difference in DVT prevalence among the groups (median prevalence, 8.5% vs. 25% and 27%, respectively). Likely, pretest selection with clinical decision rules and D-dimer caused the difference in DVT prevalence among the three groups.

Single limited, serial limited, and whole-leg CUS are the current imaging strategies for the diagnosis of DVT. Preference for one strategy over the other differs between centers and ultrasonographers. Recent guidelines and consensus statements have had conflicting recommendations regarding the preferred strategy. The 2018 American Society of Hematology, the 2012 American College of Chest Physicians, and the 2012 National Institute for Health and Care Excellence guidelines recommend single limited CUS for patients deemed to have a low pretest probability of DVT and serial limited or whole-leg CUS for those with a moderate or high probability [13]. Two recent consensus reports published in 2018 recommend either whole-leg US [4] or no preference for a particular CUS strategy [5], regardless of pretest probability. However, recommendations are mostly based on the efficiency and safety of the individual strategies and expert opinion, as evidence on direct comparisons between the three strategies is scarce.

In the present meta-analysis, more recent studies using clinical follow-up as the reference method showed very comparable failure rates of the three strategies. This could imply that there may not be a preferred strategy when taking only safety into account. Importantly, the failure rate is highly dependent on DVT prevalence. In studies assessing single limited CUS, DVT prevalence was lower, most likely due to pretest selection of lower-risk patients with clinical decision rules and/or D-dimer. Although speculative, a higher prevalence in the single limited CUS group may have led to a higher failure rate. Therefore, the safety of single limited CUS relative to the other strategies remains unclear.

In the earlier studies, in which the reference method was contrast venography, the false negative rate was higher with whole-leg CUS than with single limited CUS (16% vs. 1.3%, respectively). Although ultrasonography technology may have been outdated compared with modern ultrasonography standards, these results suggest that visualization of the distally located, smaller veins as assessed by whole-leg CUS is suboptimal. Theoretically, based on these findings, 16% of patients with a negative whole-leg examination would be expected to develop a thromboembolic event during follow-up. However, as previously discussed, in the studies using clinical follow-up as the reference standard, the thromboembolic event rate during follow-up of whole-leg CUS was comparable with that of the other strategies (1.0 to 1.9%). Otherwise stated, although whole-leg CUS misses one in six thrombi as detected by contrast venography, in the studies with clinical follow-up the thromboembolic event rate after a negative whole-leg CUS appears to be low. This leads to the hypothesis that the majority of thrombi missed by whole-leg CUS are self-limiting and do not progress to symptomatic thromboembolic events during follow-up.

Whole-leg CUS showed isolated distal DVT in 23 to 62% of all detected DVT cases. Previous studies have questioned the clinical relevance of distal DVT and anticoagulant treatment for this condition remains controversial [49]. The CACTUS trial, which is the only randomized placebo-controlled trial to date, compared 6-week nadroparin therapy with placebo in patients with isolated distal DVT who were considered to have a low risk of recurrent venous thromboembolism [50]. The results of this study suggest that anticoagulant treatment in patients with isolated distal DVT may cause more harm than benefit as the primary outcome rate (extension of calf DVT to proximal veins, contralateral proximal DVT, and symptomatic pulmonary embolism) was comparable between both groups (3.3% vs. 5.4%; p = 0.54) at the expense of a higher rate of clinically relevant bleeding in the nadroparin group (4% vs. 0%; p = 0.0255). However, the results of the study should be interpreted with caution, since it was prematurely terminated when only half of the estimated sample size was included. The 2016 American College of Chest Physicians guideline suggests that anticoagulant treatment should not be given to all patients with isolated distal DVT [51]. However, at present no validated tools are available to discriminate between low- and high-risk patients and to guide decisions on anticoagulant therapy in these patients. The clinical relevance and anticoagulant treatment strategies of distal DVT will further determine the role of whole-leg CUS in the diagnostic management of DVT.

Strengths of this study include the complete overview of diagnostic accuracy studies of the three CUS strategies for DVT and the use of a bivariate meta-analysis model, which incorporates any correlation that might exist between two diagnostic accuracy measures. Only studies with a low risk of bias and low concerns regarding applicability were included in the primary analysis, which increases the validity of the findings. Studies or subgroups of patients in which different reference standards were used were excluded from the analysis, thereby preventing differential verification bias.

Several limitations deserve to be acknowledged. There was substantial heterogeneity across the included studies, most likely due to differences in DVT prevalence, but other factors such as experience of the ultrasonographers, ultrasonography technology at the time of the study, and use of additional ultrasonography modalities may also have contributed. The prevalence of DVT varied widely across the patients assessed with CUS. Yet, as DVT prevalence in clinical practice may also differ depending on the use of diagnostic algorithms including pretest probability assessment and D-dimer testing, geographical location, and patient comorbidity, the findings of the present study were considered to apply to current practice. None of the included studies directly compared CUS techniques intra-individually. However, the only randomized study included in the present analysis found similar results as the overall analysis. In total, 521 patients with an abnormal D-dimer or a ‘DVT likely’ Wells score were randomized to undergo serial limited or whole-leg CUS; the failure rates were found to be comparable (2.0% [95% CI, 0.6 to 5.1] vs. 1.2% [95% CI, 0.2 to 4.3]; p = 0.69, respectively) [25]. Several important subgroup analyses, such as for patients with suspected recurrent DVT, could not be performed due to a lack of studies per subgroup or unreported data. In the main analysis both patients with and without a history of venous thromboembolism were included. Moreover, the effect of different modalities on the diagnostic accuracy of ultrasonography could not be studied. Language restrictions for study selection may have led to undetected studies. However, we expect that the vast majority of studies performed on this subject have been published in the languages deemed eligible, as also reflected in the low number of studies excluded based on language at full-text screening (n = 5).

The results from the present study suggest that single limited, serial limited, and whole-leg CUS may be considered equivalent in clinical practice regarding safety. Several factors may be considered when choosing for one of the strategies. From a practical point of view, a single diagnostic examination may be preferred over a serial approach as the latter implies that the patient must return for a second examination when the first examination was negative for DVT. However, performing whole-leg CUS may not always be feasible, for example at the emergency department with limited time to examine the patient or when CUS is performed at the bedside by less experienced ultrasonographers.

In conclusion, the failure rates of single limited, serial limited, and whole-leg CUS for DVT were found to be quite comparable in patients selected as per the individual study diagnostic algorithms. The relative safety of single limited CUS remains uncertain as the DVT prevalence was lower in the included studies. Therefore, use of this CUS strategy in higher prevalence groups may not be appropriate. Preference for one of the strategies should be based on pretest probability assessment, feasibility, and expertise. Future studies should focus on direct comparisons of the diagnostic accuracy, for example by randomizing patients with suspected DVT who are referred for imaging to each of the three CUS strategies. The clinical relevance of isolated distal DVT found by whole-leg CUS as well as the need for anticoagulant treatment should also be further assessed.

Supporting information

S3 Appendix. Results risk of bias and applicability concerns assessment according to the QUADAS-2 tool.

https://doi.org/10.1371/journal.pone.0228788.s003

(DOCX)

S5 Appendix. Index and comparator test, and reference standard characteristics.

Abbreviations: CUS: compression ultrasonography, DVT: deep vein thrombosis, PE: pulmonary embolism, US: ultrasonography *Limited CUS is restricted to the proximal deep veins of the lower extremity and can be categorized into (1) two-point CUS, which assesses the common femoral and popliteal veins; (2) three-point CUS, which assesses the common femoral and popliteal vein, and the calf trifurcation; (3) proximal CUS, which assesses any of the proximal deep veins of the lower extremity starting at the popliteal vein; and (4) extended proximal CUS, which assesses any of the proximal deep veins of the lower extremity starting at the calf trifurcation. Limited CUS is performed as a single examination (single limited CUS) or is repeated after 5 to 10 days in case of a negative result (serial limited CUS). Whole-leg CUS assesses both proximal and distal deep veins of the lower extremity.†Only a subgroup of patients was included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0228788.s005

(DOCX)

S6 Appendix. Patient characteristics.

Abbreviations: CUS: compression ultrasonography, DVT: deep vein thrombosis, PE: pulmonary embolism * DVT prevalence in the subgroup of patients that was included in the meta-analysis.

https://doi.org/10.1371/journal.pone.0228788.s006

(DOCX)

S7 Appendix. Selection of patients prior to ultrasonography examination.

Abbreviations: CUS: compression ultrasonography PTP: pretest probability Patients were all-comers or were selected for CUS imaging with the use of a diagnostic algorithm consisting of a pretest probability (PTP) assessment and/or D-dimer. PTP was classified as either low, moderate, or high, or as ‘DVT likely’ or ‘DVT unlikely’.

https://doi.org/10.1371/journal.pone.0228788.s007

(DOCX)

S8 Appendix. Subgroup analyses—Summary estimates diagnostic accuracy of compression ultrasonography in studies that used clinical follow-up as a reference standard.

Abbreviations: CI: confidence interval, CUS: compression ultrasonography, DVT: deep vein thrombosis, PTP: pretest probability assessment *Patients undergoing CUS were either all-comers or were referred for imaging based on pretest probability assessment and/or D-dimer testing †Proximal limited CUS includes examination of the popliteal vein up to the femoral vein, extended limited CUS also includes the calf trifurcation. ‡P-value for meta-regressionSubgroup analyses for age, body mass index, history of venous thromboembolism, duration of symptoms, ultrasonography modalities, ultrasonography operator, and retrospective versus prospective study design were hampered as the number of studies in several subgroups was lower than 2.

https://doi.org/10.1371/journal.pone.0228788.s008

(DOCX)

S9 Appendix. Sensitivity analysis including all studies regardless of quality—Summary estimates diagnostic accuracy of compression ultrasonography in studies that used clinical follow-up as a reference standard.

Abbreviations: CI: confidence interval, CUS: compression ultrasonography, DVT: deep vein thrombosis, PI: prediction interval * Tau-squared (τ2) represents the between-study variance and indicates the degree of heterogeneity. †The failure rate is the proportion of patients with a negative ultrasonography at baseline who were diagnosed with venous thromboembolism during follow-up.

https://doi.org/10.1371/journal.pone.0228788.s009

(DOCX)

S10 Appendix. Distribution of proximal and distal deep vein thrombosis diagnosed with whole-leg compression ultrasonography in studies that used clinical follow-up as a reference standard.

Abbreviations: DVT: deep vein thrombosis.

https://doi.org/10.1371/journal.pone.0228788.s010

(DOCX)

S11 Appendix. Sensitivity analysis including all studies regardless of quality—Summary estimates diagnostic accuracy of compression ultrasonography in studies that used contrast venography as a reference standard.

Abbreviations: CI: confidence interval, CUS: compression ultrasonography, DVT: deep vein thrombosis, NPV: negative predictive value, PI: prediction interval, PPV: positive predictive value * Tau-squared (τ2) represents the between-study variance and indicates the degree of heterogeneity. †The false negative rate equals 1-NPV.

https://doi.org/10.1371/journal.pone.0228788.s011

(DOCX)

References

  1. 1. Lim W, Le Gal G, Bates SM, Righini M, Haramati LB, Lang E, Kline JA, Chasteen S, Snyder M, Patel P, Bhatt M, Patel P, Braun C, Begum H, Wiercioch W, Schünemann HJ, Mustafa RA. American Society of Hematology 2018 guidelines for management of venous thromboembolism: diagnosis of venous thromboembolism. Blood Adv 2018; 2: 3226–56. pmid:30482764
  2. 2. Bates SM, Jaeschke R, Stevens SM, Goodacre S, Wells PS, Stevenson MD, Kearon C, Schunemann HJ, Crowther M, Pauker SG, Makdissi R, Guyatt GH, American College of Chest Physicians. Diagnosis of DVT: Antithrombotic Therapy and Prevention of Thrombosis, 9th ed: American College of Chest Physicians Evidence-Based Clinical Practice Guidelines. Chest 2012; 141: e351S–418S. pmid:22315267
  3. 3. National Institute for Health and Care Excellence guideline—Venous thromboembolic diseases: diagnosis, management and thrombophilia testing—2012 (last updated: November 2015). Available at: https://www.nice.org.uk/guidance/cg144. 2012;.
  4. 4. Mazzolai L, Aboyans V, Ageno W, Agnelli G, Alatri A, Bauersachs R, Brekelmans MPA, Büller HR, Elias A, Farge D, Konstantinides S, Palareti G, Prandoni P, Righini M, Torbicki A, Vlachopoulos C, Brodmann M. Diagnosis and management of acute deep vein thrombosis: a joint consensus document from the European Society of Cardiology working groups of aorta and peripheral vascular diseases and pulmonary circulation and right ventricular function. Eur Heart J 2018; 39: 4208–18. pmid:28329262
  5. 5. Needleman L, Cronan JJ, Lilly MP, Merli GJ, Adhikari S, Hertzberg BS, DeJong MR, Streiff MB, Meissner MH. Ultrasound for Lower Extremity Deep Venous Thrombosis. Circulation 2018; 137: 1505–15. pmid:29610129
  6. 6. McInnes MDF, Moher D, Thombs BD, McGrath TA, Bossuyt PM, the PRISMA-DTA Group, Clifford T, Cohen JF, Deeks JJ, Gatsonis C, Hooft L, Hunt HA, Hyde CJ, Korevaar DA, Leeflang MMG, Macaskill P, Reitsma JB, Rodin R, Rutjes AWS, Salameh J-P, et al. Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies: The PRISMA-DTA Statement. JAMA 2018; 319: 388–96. pmid:29362800
  7. 7. Lensing AW, Prandoni P, Brandjes D, Huisman PM, Vigo M, Tomasella G, Krekt J, Wouter Ten Cate J, Huisman M V, Büller HR. Detection of deep-vein thrombosis by real-time B-mode ultrasonography. N Engl J Med 1989; 320: 342–5. pmid:2643771
  8. 8. Guanella R, Righini M. Serial limited versus single complete compression ultrasonography for the diagnosis of lower extremity deep vein thrombosis. Semin Respir Crit Care Med 2012; 33: 144–50. pmid:22648486
  9. 9. Whiting PF, Rutjes AWS, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, Leeflang MMG, Sterne JAC, Bossuyt PMM, QUADAS-2 Group. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med 2011; 155: 529–36. pmid:22007046
  10. 10. Ageno W, Camporese G, Riva N, Iotti M, Bucherini E, Righini M, Kamphuisen PW, Verhamme P, Douketis JD, Tonello C, Prandoni P, PALLADIO Study Investigators. Analysis of an algorithm incorporating limited and whole-leg assessment of the deep venous system in symptomatic outpatients with suspected deep-vein thrombosis (PALLADIO): a prospective, multicentre, cohort study. Lancet Haematol 2015; 2: e474–80. pmid:26686257
  11. 11. Aguilar C, del Villar V. Combined D-dimer and clinical probability are useful for exclusion of recurrent deep venous thrombosis. Am J Hematol 2007; 82: 41–4. pmid:16947316
  12. 12. Anderson DR, Kovacs MJ, Kovacs G, Stiell I, Mitchell M, Khoury V, Dryer J, Ward J, Wells PS. Combined use of clinical assessment and d-dimer to improve the management of patients presenting to the emergency department with suspected deep vein thrombosis (the EDITED Study). J Thromb Haemost 2003; 1: 645–51. pmid:12871396
  13. 13. Anderson DR, Wells PS, Stiell I, MacLeod B, Simms M, Gray L, Robinson KS, Bormanis J, Mitchell M, Lewandowski B, Flowerdew G. Thrombosis in the Emergency Department. Arch Intern Med 1999; 159: 477. pmid:10074956
  14. 14. Aywak AA, Masesa J V. Comparison of sonography with venography in the diagnosis of deep venous thrombosis. East Afr Med J 2007; 84: 304–11. pmid:17886423
  15. 15. Bates SM, Kearon C, Crowther M, Linkins L, O’Donnell M, Douketis J, Lee AYY, Weitz JI, Johnston M, Ginsberg JS. A diagnostic strategy involving a quantitative latex D-dimer assay reliably excludes deep venous thrombosis. Ann Intern Med 2003; 138: 787–94. pmid:12755550
  16. 16. Baxter GM, McKechnie S, Duffy P. Colour Doppler ultrasound in deep venous thrombosis: a comparison with venography. Clin Radiol 1990; 42: 32–6. pmid:2202536
  17. 17. Bernardi E, Camporese G, Büller HR, Siragusa S, Imberti D, Berchio A, Ghirarduzzi A, Verlato F, Anastasio R, Prati C, Piccioli A, Pesavento R, Bova C, Maltempi P, Zanatta N, Cogo A, Cappelli R, Bucherini E, Cuppini S, Noventa F, et al. Serial 2-point ultrasonography plus D-dimer vs whole-leg color-coded Doppler ultrasonography for diagnosing suspected symptomatic deep vein thrombosis: a randomized controlled trial. JAMA 2008; 300: 1653–9. pmid:18840838
  18. 18. Cavaye D, Kelly AT, Graham JC, Appleberg M, Briggs GM. Duplex ultrasound diagnosis of lower limb deep venous thrombosis. Aust N Z J Surg 1990; 60: 283–8. pmid:2181993
  19. 19. Chan W-S, Spencer FA, Lee AYY, Chunilal S, Douketis JD, Rodger M, Ginsberg JS. Safety of withholding anticoagulation in pregnant women with suspected deep vein thrombosis following negative serial compression ultrasound and iliac vein imaging. CMAJ 2013; 185: E194–200. pmid:23318405
  20. 20. Chance JF, Abbitt PL, Tegtmeyer CJ, Powers RD. Real-time ultrasound for the detection of deep venous thrombosis. Ann Emerg Med 1991; 20: 494–6. pmid:2024786
  21. 21. Cornuz J, Pearson SD, Polak JF. Deep venous thrombosis: complete lower extremity venous US evaluation in patients without known risk factors—outcome study. Radiology 1999; 211: 637–41. pmid:10352585
  22. 22. Cornuz J, Ghali WA, Hayoz D, Stoianov R, Depairon M, Yersin B. Clinical prediction of deep venous thrombosis using two risk assessment methods in combination with rapid quantitative D-dimer testing. Am J Med 2002; 112: 198–203. pmid:11893346
  23. 23. Dybowska M, Tomkowski WZ, Kuca P, Ubysz R, Jóźwik A, Chmielewski D. Analysis of the accuracy of the Wells scale in assessing the probability of lower limb deep vein thrombosis in primary care patients practice. Thromb J 2015; 13: 18. pmid:26045696
  24. 24. Elias A, Mallard L, Elias M, Alquier C, Guidolin F, Gauthier B, Viard A, Mahouin P, Vinel A, Boccalon H. A single complete ultrasound investigation of the venous network for the diagnostic management of patients with a clinically suspected first episode of deep venous thrombosis of the lower limbs. Thromb Haemost 2003; 89: 221–7. pmid:12574799
  25. 25. Gibson NS, Schellong SM, Kheir DY El, Beyer-Westendorf J, Gallus AS, McRae S, Schutgens REG, Piovella F, Gerdes VEA, Buller HR. Safety and sensitivity of two ultrasound strategies in patients with clinically suspected deep venous thrombosis: a prospective management study. J Thromb Haemost 2009; 7: 2035–41. pmid:19817986
  26. 26. Gudmundsen TE, Vinje B, Pedersen T. Deep vein thrombosis of lower extremities. Diagnosis by real time ultrasonography. Acta Radiol 1990; 31: 473–5. pmid:2261293
  27. 27. Heijboer H, Cogo A, Büller HR, Prandoni P, ten Cate JW. Detection of deep vein thrombosis with impedance plethysmography and real-time compression ultrasonography in hospitalized patients. Arch Intern Med 1992; 152: 1901–3. pmid:1520059
  28. 28. Kennedy PT, Loan W, Buckley M, Rice P, Hanley P. Early experience using duplex ultrasonography in the diagnosis of deep venous thrombosis; a prospective evaluation. Ulster Med J 1999; 68: 59–63. pmid:10661629
  29. 29. Le Gal G, Kercret G, Ben Yahmed K, Bressollette L, Robert-Ebadi H, Riberdy L, Louis P, Delluc A, Labalette M-L, Baba-Ahmed M, Bounameaux H, Mottier D, Righini M, EDVIGE Study Group. Diagnostic value of single complete compression ultrasonography in pregnant and postpartum women with suspected deep vein thrombosis: prospective study. BMJ 2012; 344: e2635. pmid:22531869
  30. 30. Le Gal G, Prins A-M, Righini M, Bohec C, Lacut K, Germain P, Vergos J-C, Kaczmarek R, Guias B, Collet M, Bressollette L, Oger E, Mottier D. Diagnostic value of a negative single complete compression ultrasound of the lower limbs to exclude the diagnosis of deep venous thrombosis in pregnant or postpartum women: a retrospective hospital-based study. Thromb Res 2006; 118: 691–7. pmid:16414102
  31. 31. Linkins L-A, Bates SM, Lang E, Kahn SR, Douketis JD, Julian J, Parpia S, Gross P, Weitz JI, Spencer FA, Lee AYY, O’Donnell MJ, Crowther MA, Chan HH, Lim W, Schulman S, Ginsberg JS, Kearon C. Selective D-dimer testing for diagnosis of a first suspected episode of deep venous thrombosis: a randomized trial. Ann Intern Med 2013; 158: 93–100. pmid:23318311
  32. 32. Mantoni M. Diagnosis of deep venous thrombosis by duplex sonography. Acta Radiol 1989; 30: 575–9. pmid:2698743
  33. 33. Mitsunaga MM, Kogachi S, Yoon H-C. Risk of Venous Thromboembolism after a Single Normal Proximal Lower Extremity Venous Ultrasound. Perm J 2017; 21: 4–8.
  34. 34. Pasquariello F, Kurol M, Wiberg S, Krekmanova M, Leppert J. Diagnosis of deep venous thrombosis of the lower limbs: it is premature to introduce ultrasound as a routine method. Angiology 1999; 50: 31–6. pmid:9924886
  35. 35. Prandoni P, Lensing AWA, Bernardi E, Villalta S, Bagatella P, Girolami A, DERECUS Investigators Group. The diagnostic value of compression ultrasonography in patients with suspected recurrent deep vein thrombosis. Thromb Haemost 2002; 88: 402–6. pmid:12353067
  36. 36. Quintavalla R, Larini P, Miselli A, Mandrioli R, Ugolotti U, Pattacini C, Pini M. Duplex ultrasound diagnosis of symptomatic proximal deep vein thrombosis of lower limbs. Eur J Radiol 1992; 15: 32–6. pmid:1396785
  37. 37. Rose SC, Zwiebel WJ, Nelson BD, Priest DL, Knighton RA, Brown JW, Lawrence PF, Stults BM, Reading JC, Miller FJ. Symptomatic lower extremity deep venous thrombosis: accuracy, limitations, and role of color duplex flow imaging in diagnosis. Radiology 1990; 175: 639–44. pmid:2188293
  38. 38. Schutgens REG, Ackermark P, Haas FJLM, Nieuwenhuis HK, Peltenburg HG, Pijlman AH, Pruijm M, Oltmans R, Kelder JC, Biesma DH. Combination of a normal D-dimer concentration and a non-high pretest clinical probability score is a safe strategy to exclude deep venous thrombosis. Circulation 2003; 107: 593–7. pmid:12566372
  39. 39. Sluzewski M, Koopman MM, Schuur KH, van Vroonhoven TJ, Ruijs JH. Influence of negative ultrasound findings on the management of in- and outpatients with suspected deep-vein thrombosis. Eur J Radiol 1991; 13: 174–7. pmid:1756742
  40. 40. Stevens SM, Elliott CG, Chan KJ, Egger MJ, Ahmed KM. Withholding anticoagulation after a negative result on duplex ultrasonography for suspected symptomatic deep venous thrombosis. Ann Intern Med 2004; 140: 985–91. pmid:15197015
  41. 41. Stevens SM, Woller SC, Graves KK, Aston V, Jones J, Snow G, Elliott CG. Withholding anticoagulation following a single negative whole-leg ultrasound in patients at high pretest probability for deep vein thrombosis. Clin Appl Thromb Hemost 2013; 19: 79–85. pmid:22589458
  42. 42. Subramaniam RM, Heath R, Chou T, Cox K, Davis G, Swarbrick M. Deep venous thrombosis: withholding anticoagulation therapy after negative complete lower limb US findings. Radiology 2005; 237: 348–52. pmid:16126924
  43. 43. ten Wolde M, Kraaijenhagen R a, Prins MH, Büller HR. The clinical usefulness of D-dimer testing in cancer patients with suspected deep venous thrombosis. Arch Intern Med 2002; 162: 1880–4. pmid:12196087
  44. 44. Tick LW, Ton E, van Voorthuizen T, Hovens MMC, Leeuwenburgh I, Lobatto S, Stijnen PJ, van der Heul C, Huisman PM, Kramer MHH, Huisman M V. Practical diagnostic management of patients with clinically suspected deep vein thrombosis by clinical probability test, compression ultrasonography, and D-dimer test. Am J Med 2002; 113: 630–5. pmid:12505112
  45. 45. Wells PS, Anderson DR, Bormanis J, Guy F, Mitchell M, Gray L, Clement C, Robinson KS, Lewandowski B. Value of assessment of pretest probability of deep-vein thrombosis in clinical management. Lancet (London, England) 1997; 350: 1795–8.
  46. 46. Wells PS, Anderson DR, Bormanis J, Guy F, Mitchell M, Gray L, Clement C, Robinson KS, Lewandowski B. Application of a diagnostic clinical model for the management of hospitalized patients with suspected deep-vein thrombosis. Thromb Haemost 1999; 81: 493–7. pmid:10235426
  47. 47. Wells PS, Anderson DR, Rodger M, Forgie M, Kearon C, Dreyer J, Kovacs G, Mitchell M, Lewandowski B, Kovacs MJ. Evaluation of D-dimer in the diagnosis of suspected deep-vein thrombosis. N Engl J Med 2003; 349: 1227–35. pmid:14507948
  48. 48. Wells PS, Hirsh J, Anderson DR, Lensing AW, Foster G, Kearon C, Weitz J, Cogo A, Prandoni P, Minuk T. Comparison of the accuracy of impedance plethysmography and compression ultrasonography in outpatients with clinically suspected deep vein thrombosis. A two centre paired-design prospective trial. Thromb Haemost 1995; 74: 1423–7. pmid:8772213
  49. 49. Robert-Ebadi H, Righini M. Management of distal deep vein thrombosis. Thromb Res 2017; 149: 48–55. pmid:27889688
  50. 50. Righini M, Galanaud J-P, Guenneguez H, Brisot D, Diard A, Faisse P, Barrellier M-T, Hamel-Desnos C, Jurus C, Pichot O, Martin M, Mazzolai L, Choquenet C, Accassat S, Robert-Ebadi H, Carrier M, Le Gal G, Mermilllod B, Laroche J-P, Bounameaux H, et al. Anticoagulant therapy for symptomatic calf deep vein thrombosis (CACTUS): a randomised, double-blind, placebo-controlled trial. Lancet Haematol 2016; 3: e556–62. pmid:27836513
  51. 51. Kearon C, Akl EA, Ornelas J, Blaivas A, Jimenez D, Bounameaux H, Huisman M, King CS, Morris TA, Sood N, Stevens SM, Vintch JRE, Wells P, Woller SC, Moores L. Antithrombotic therapy for VTE disease: CHEST guideline and expert panel report. Chest 2016; 149: 315–52. pmid:26867832