Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Testing and Treating Women after Unsuccessful Conservative Treatments for Overactive Bladder or Mixed Urinary Incontinence: A Model-Based Economic Evaluation Based on the BUS Study

  • Ilias Goranitis,

    Affiliation Health Economics Unit, University of Birmingham, Birmingham, United Kingdom

  • Pelham Barton,

    Affiliation Health Economics Unit, University of Birmingham, Birmingham, United Kingdom

  • Lee J. Middleton,

    Affiliation Birmingham Clinical Trials Unit, University of Birmingham, Birmingham, United Kingdom

  • Jonathan J. Deeks,

    Affiliations Birmingham Clinical Trials Unit, University of Birmingham, Birmingham, United Kingdom, Public Health, Epidemiology and Biostatistics, University of Birmingham, Birmingham, United Kingdom

  • Jane P. Daniels,

    Affiliations Birmingham Clinical Trials Unit, University of Birmingham, Birmingham, United Kingdom, School of Clinical and Experimental Medicine, University of Birmingham, Birmingham, United Kingdom

  • Pallavi Latthe,

    Affiliations School of Clinical and Experimental Medicine, University of Birmingham, Birmingham, United Kingdom, Birmingham Women’s National Health Service (NHS) Foundation Trust, Birmingham, United Kingdom

  • Arri Coomarasamy,

    Affiliations School of Clinical and Experimental Medicine, University of Birmingham, Birmingham, United Kingdom, Birmingham Women’s National Health Service (NHS) Foundation Trust, Birmingham, United Kingdom

  • Suneetha Rachaneni,

    Affiliation School of Clinical and Experimental Medicine, University of Birmingham, Birmingham, United Kingdom

  • Shanteela McCooty,

    Affiliation Birmingham Women’s National Health Service (NHS) Foundation Trust, Birmingham, United Kingdom

  • Tina S. Verghese,

    Affiliations School of Clinical and Experimental Medicine, University of Birmingham, Birmingham, United Kingdom, Birmingham Women’s National Health Service (NHS) Foundation Trust, Birmingham, United Kingdom

  • Tracy E. Roberts

    T.E.Roberts@bham.ac.uk

    Affiliation Health Economics Unit, University of Birmingham, Birmingham, United Kingdom

Abstract

Objective

To compare the cost-effectiveness of bladder ultrasonography, clinical history, and urodynamic testing in guiding treatment decisions in a secondary care setting for women failing first line conservative treatment for overactive bladder or urgency-predominant mixed urinary incontinence.

Design

Model-based economic evaluation from a UK National Health Service (NHS) perspective using data from the Bladder Ultrasound Study (BUS) and secondary sources.

Methods

Cost-effectiveness analysis using a decision tree and a 5-year time horizon based on the outcomes of cost per woman successfully treated and cost per Quality-Adjusted Life-Year (QALY). Deterministic and probabilistic sensitivity analyses, and a value of information analysis are also undertaken.

Results

Bladder ultrasonography is more costly and less effective test-treat strategy than clinical history and urodynamics. Treatment on the basis of clinical history alone has an incremental cost-effectiveness ratio (ICER) of £491,100 per woman successfully treated and an ICER of £60,200 per QALY compared with the treatment of all women on the basis of urodynamics. Restricting the use of urodynamics to women with a clinical history of mixed urinary incontinence only is the optimal test-treat strategy on cost-effectiveness grounds with ICERs of £19,500 per woman successfully treated and £12,700 per QALY compared with the treatment of all women based upon urodynamics. Conclusions remained robust to sensitivity analyses, but subject to large uncertainties.

Conclusions

Treatment based upon urodynamics can be seen as a cost-effective strategy, and particularly when targeted at women with clinical history of mixed urinary incontinence only. Further research is needed to resolve current decision uncertainty.

Introduction

Lower urinary tract symptoms involving urgency or urinary incontinence are prevalent in approximately 20% of the population world-wide [1]. Urinary incontinence is the involuntary leakage of urine, and is classified into urge incontinence, stress incontinence (e.g. with sneezing or coughing), or mixed incontinence—when it is both urge- and stress-related. Overactive bladder is a syndrome characterised by urinary urgency, with or without urge incontinence, and often frequency and nocturia [2]. The prevalence of overactive bladder is estimated in the region of 12–17% of the population [3, 4]. Evidence, however, suggests that it remains a highly underdiagnosed and undertreated syndrome [5]. The cost implications associated with these urinary syndromes and their impact on quality of life have been well documented [610].

The uncertainty around the correct diagnosis among syndromes sharing common symptomatology has established urodynamic testing as the gold-standard test when first line conservative treatments have been unsuccessful. Urodynamics provides a pathophysiological explanation of symptoms [11], and lasts approximately 30 minutes. It can identify detrusor overactivity (DO), which commonly is the underlying pathology behind overactive bladder symptoms, or provide alternative diagnoses including urodynamic stress incontinence, mixed incontinence, voiding dysfunction, low compliance, or normal bladder physiology. However, comprehensive evidence on the accuracy of urodynamics is lacking, and its role in determining patient outcomes is increasingly questioned. For patients with uncomplicated stress incontinence, evidence suggests that urodynamics is neither necessary nor cost-effective [1214]. For patients with overactive bladder, clinical evidence is contradictory. While there are studies concluding that urodynamics is required, as symptoms tend to be an unreliable indicator of DO [15, 16], there are also studies concluding that an urodynamic observation of DO is not a good predictor of the outcome of a number of different treatments [17].

Current guidelines on urinary incontinence recommend conservative management of urinary symptoms as a first line treatment, and the use of urodynamics only prior to more invasive interventions in a secondary care setting [18]. Nevertheless, robust evidence for the use of urodynamics in this context is lacking. The National Institute for Health and Care Excellence (NICE) in the UK has encouraged further investigation into the role of bladder ultrasonography to measure bladder wall thickness, which, if sufficiently accurate, offers a less invasive and potentially cheaper alternative to urodynamics [19]. The objective of the model-based economic evaluation is to compare the relative cost-effectiveness of basing treatment decisions on bladder ultrasonography, clinical history, or urodynamics in women with persistent symptoms of overactive bladder or urge-predominant mixed incontinence for whom first line conservative treatments were not effective.

Methods

This study reports an economic evaluation carried out alongside the Bladder Ultrasound Study (BUS), the largest cross-sectional study undertaken to estimate the accuracy of ultrasound measurement of bladder wall thickness (BWT) in the diagnosis of DO. Details of the accuracy study are reported in the full Health Technology Assessment (HTA) report [20]. In brief, 687 women with symptoms of overactive bladder or urgency-predominant mixed incontinence were recruited across 22 hospitals in the UK. To be included in the study, women had to have urinary frequency of ≥ 9 voids for at least one day in a 3 day bladder diary, mild to severe urgency recorded on at ≥ 2 occasions in the bladder diary, and post void residual volume < 100 ml on the bladder scan to rule out voiding dysfunction. Women with symptoms of pure stress urinary incontinence or stress-predominant mixed incontinence, current pregnancy or up to six weeks postpartum, stress incontinence-related surgery and/or intradetrusor Botulinum toxin A in the past six months, positive urine dipstick for leucocytes or nitrites, pelvic organ prolapse > grade II (any compartment), previous urodynamics in the past six months, and continuous use of antimuscarinics for more than six months were excluded from the study.

Test accuracy was determined by comparing BWT measurements from ultrasonography (index test) against the results obtained from urodynamic testing (reference standard). Urodynamic testing was carried out following the Good Urodynamic Practices Guidelines of the International Continence Society [21]. In the BUS study, DO was defined as the occurrence of involuntary detrusor contractions during filling cystometry that could occur spontaneously or because of provocation [2], and filling cystometry was done with fluid filled domes and fill rate of 100 ml/min in sitting position. Using the ultrasound, BWT was determined as the mean measurement of the thickest part of the trigone, dome of the bladder in the midline, and the anterior wall of the bladder. Sensitivity, specificity and predictive values for ultrasonography were calculated using a BWT threshold of ≥ 5 mm for the diagnosis of DO [22]. All women provided written informed consent and ethical approval was granted from the Nottingham Research Ethics Committee (Reference: 10/H0408/57). Given the objective of the economic evaluation, the analysis relied on data for women who had been taking conservative treatments before enrolling into the study and had complete accuracy data (n = 209), in line with NICE clinical recommendations [18].

Model structure

For the purpose of maintaining patient history, and given the short-term nature of the decision problem, a decision tree was used to describe the alternative diagnostic options being compared and the treatment pathways determined upon their diagnosis. The model was developed in TreeAge Pro 2014 software (TreeAge Software, Inc., Williamstown, MA, USA) and concerned women with unsuccessful first line conservative treatment. Women in the model would require invasive interventions determined by the findings of urodynamics, bladder ultrasonography, and clinical history. Alternative second line treatment options for each diagnostic finding were modelled based on clinical input and NICE’s guidelines on the management of urinary incontinence [23].

In this study, two different model structures were explored. In the first structure, the three test-treat strategies were directly compared assuming that clinical history plays no role in determining the need for urodynamics or ultrasound, or in influencing treatment options in cases of disagreement. The second structure, allows for these diagnostic tests to depend upon the outcome of clinical history.

Urodynamic testing provides diagnoses of overactive bladder, urodynamic stress and mixed incontinence, normal bladder physiology, low compliance, and voiding dysfunction. For overactive bladder, treatment with either botulinum toxin injections or a neurostimulation (percutaneous tibial nerve) was modelled, depending on patient and physician preferences. For women remaining symptomatic, a peripheral nerve evaluation was assumed to follow in order to assess whether a permanent implantation of a neurostimulator device would be successful, or women would require further botulinum toxin injections or neurostimulation, depending on which of the two interventions had not been carried out earlier in the model (Fig 1). For stress incontinence, initial treatment in the model involved a sling surgery followed by a Burch colposuspension if women remained symptomatic, unless treatment for overactive bladder had previously been given. For the treatment of mixed incontinence, a sling surgery and Burch colposuspension were also assumed to take place with the exception that, due to the presence of urinary urgency, women had the option of botulinum toxin injections prior to sling surgery. Women with urodynamic findings of normal bladder physiology, low compliance only, or voiding dysfunction only were assumed to remain symptomatic without further invasive interventions.

thumbnail
Fig 1. Decision sub-tree representing the treatment pathway of women with an urodynamic diagnosis of detrusor overactivity [The + sign denotes similar model structure].

https://doi.org/10.1371/journal.pone.0160351.g001

Treatment pathways following bladder ultrasonography and clinical history are similar, but reflect variations arising from the fact that for both strategies, treatment for either overactive bladder or mixed urinary incontinence can only be initiated given the urgency-predominant symptoms of the population modelled (S1 and S2 Figs). The primary study assessed the accuracy of bladder ultrasonography for diagnosing DO using a predefined threshold of BWT (5mm) on the basis of previous research [22]. This was followed in the model using accuracy data from the primary study [20]. When BWT is below this threshold, the ultrasound cannot distinguish between alternative urinary syndromes and treatment for mixed incontinence was assumed to be initiated. For clinical history, the criterion of whether women only had urinary urgency, with or without urge incontinence, or had urgency-predominant mixed incontinence was used to indicate diagnoses either of overactive bladder or of mixed incontinence. A more detailed graphical representation of the decision model is provided in the HTA report [20].

Additional model assumptions

For the purposes of the analysis some further assumptions were required:

  • Treatment with botulinum toxin may result in voiding dysfunction [24].
  • Women with voiding dysfunction would require self-catheterisation training [25].
  • Repeated botulinum toxin injections, commonly provided at yearly intervals, have shown to be clinically effective [26, 27]. It was assumed that women could have up to 3 injections.
  • Neurostimulation was offered in 12 sessions, a week apart over the first 3 months [28]. If it was clinically effective, a monthly maintenance session would be needed thereafter [29].
  • After an implantation of a neurostimulator device, a revision of the surgery, maintenance or removal of the neurostimulator may be needed [30, 31]. These were assumed to take place at the end of the model’s time horizon.
  • A maximum of two diagnostic tests were assumed to be carried out, one when entering the model, and another if women remained symptomatic.
  • If a woman became subjectively cured, improvements were assumed to last throughout the model’s time horizon.

Probabilities

Probabilities for symptoms’ prevalence and test accuracy were taken from the primary study (S1 and S2 Tables) [20]. The probability of a woman becoming subjectively cured by a given intervention and subject to the stated underlying condition, and other probabilities used in the model were drawn from secondary sources [24, 26, 28, 3037]. These are shown in Table 1. Probabilities applying to rare circumstances, such as in cases of misdiagnosis, were not all available in published sources, and values were, therefore, elicited independently from the expert opinion of eight study collaborators on the 18th of June 2014 (Table 1). In the absence of relevant information, expert opinion is considered a legitimate source of information in decision-analytic modelling [38]. Since these probabilities are not commonly encountered, it was considered appropriate to decide a priori the use of a beta distribution and a simple elicitation approach, asking for most likely value as well as lowest and highest, and interpreting these as mean and 95% confidence intervals (CIs). Use of more elaborate elicitation techniques [39] was not expected to have an appreciable impact on the modelling.

Costs

Cost data were drawn from national sources (Table 2) [40, 41], and calculated in 2012–2013 UK pounds (£). Unit costs adopted from the NHS Reference Costs (2012–13) [40] were calculated based on the weighted average value of elective inpatient and day-case costs and the proportion of patients in each type of care. Unit costs from the “Urology” category were selected instead of the average across different medical specialties, apart from the case of the bladder ultrasonography for which a total Healthcare Resource Groups (HRG) cost was only available. The cost of three botulinum toxin injections was calculated by multiplying the unit cost of each injection (£912; 95% CIs: £704–£1,060) by the proportion of women undergoing each injection.

Outcomes

The primary outcome was “women successfully treated”, determined by subjective cure. The secondary outcome was “quality-adjusted life-years (QALYs)”, which is the recommended outcome for economic evaluations in the UK [42], and combines quantity with quality of life measured using preference weights. Quality of life data for women entering the model were taken from the primary study (Table 3) [20]. To identify quality of life data for outcomes experienced during the modelled time horizon, a review of the Cost-Effectiveness Analysis Registry [43] was performed using the search terms “overactive bladder”, “urinary incontinence”, and “detrusor overactivity”. Eighteen studies were identified and preference weights from one study were selected to represent the quality of life of women subjectively cured, with and without side-effects [44]. This study was selected because values were obtained using the time trade-off method, which has sound theoretical underpinnings in utility theory, and were relevant to the symptoms and type of interventions modelled [45]. In the absence of other estimates, women remaining symptomatic were assumed to retain their initial quality of life, which is a common assumption in cost-effectiveness analyses in this clinical context [44, 4648]. QALYs were estimated by combining the utility weights with estimates of duration of the different health states.

Analyses

Two separate economic analyses were carried out from the perspective of the UK National Health Service (NHS) and results were presented in incremental cost-effectiveness ratios (ICERs). The first analysis assessed the cost-effectiveness of basing treatment decision upon bladder ultrasonography and clinical history alone compared with the treatment based upon the gold-standard urodynamics. The second analysis additionally explored all the different ways in which clinical history and a diagnostic test could be used together. This aimed to assess whether a diagnostic test would be more cost-effective when offered in a selective sub-group of women (i.e. those with clinical history of overactive bladder only or those with a clinical history of mixed incontinence only). A 5-year time-horizon was considered appropriate to reflect key differences in terms of costs and benefits for the test-treat strategies compared. Costs and QALYs accruing beyond 12 months were discounted at an annual rate of 3.5% [42].

A number of sensitivity analyses were performed. Univariate analyses explored the impact of: (a) reducing the cost of urodynamics from £401 (95% CIs: £216–£462) to £173, which represents the weighted average value of total HRGs [40]; (b) doubling the cost of sling surgery to account for possible adverse events [32]; and (c) lowering the utility weight of women subjectively cured from 0.92 to 0.84, which represents the mean EQ-5D index score for women who reported low symptoms bother in the primary study [20]. Multivariate analyses explored the impact of: (a) lowering the accuracy of urodynamics [13], while improving the accuracy of clinical history by complementing it with urinary diaries [49]; (b) placing the rates of effectiveness elicited from expert opinion to the lowest and highest value; and (d) assuming one diagnostic test is only performed when entering the model.

For a more comprehensive representation of parameter uncertainty, a probabilistic sensitivity analysis (PSA) was undertaken. Using a Monte Carlo simulation, 10,000 iterations of the model were performed by repeated random draws from probability distributions attached to model parameters. Beta and Dirichlet distributions were used for binomial and multinomial data respectively, and a Gamma distribution for costs [50]. The results from all model iterations were averaged, and at any given level of decision-makers’ willingness-to-pay (WTP) per additional unit of outcome the optimal strategy was determined from the average results. To present the proportion of model iterations that favoured the overall optimal test-treat strategy at each threshold of WTP, cost-effectiveness acceptability frontiers (CEAFs) were used [51]. CEAFs plot the probability of the optimal strategy being cost-effective, under current uncertainty, at different WTP values per additional unit of outcome.

Given that decision uncertainty may lead to sub-optimal policy recommendations, the opportunity cost of gaining further information to assist decision-making in the future needs to be evaluated. A metric which indicates whether undertaking further research is potentially more worthwhile than adopting a decision under current uncertainty is the expected value of perfect information (EVPI). The EVPI represents the maximum monetary value that rational decision-makers would be willing to spend for gaining more information at each threshold of WTP per additional unit of outcome, and combines the probability of a wrong decision with the monetary value of the gain that would be expected in changing the decision from the wrong to the correct one [50, 52, 53]. For example, if the cost of further research, such as a randomised controlled trial, is lower than the EVPI then investing on further research is potentially more worthwhile. The EVPI was estimated at a population level based on estimates of incidence (54,000) [3, 4, 54, 55], and the number of years that research was assumed to be useful (10 years) with 3.5% annual discount rate.

Results

In the first analysis, a test-treat strategy based upon bladder ultrasonography was dominated by the strategies of urodynamics and clinical history, as it was more expensive and less effective for both outcomes of the analysis. As shown in Table 4, treatment based upon clinical history led to an additional 26 cases per 10,000 women successfully treated compared with treatment based upon urodynamics at an additional cost of £1,278 per woman, and the corresponding ICER was £491,100 per woman successfully treated.

The CEAF in Fig 2 shows that the probability of the urodynamics test-treat strategy being cost-effective exceeded 61% for any value of WTP below £100,000 per additional woman successfully treated. In terms of QALYs, treatment based upon clinical history resulted in an additional 0.021 QALYs gained per woman compared with treatment based upon urodynamics. Given the additional cost of £1,278 per woman, the mean ICER for the clinical history strategy compared with urodynamics was estimated at £60,200 per QALY. The results of the PSA show that urodynamics was likely to be the optimal test-treat strategy with 72% probability of being cost-effective at the conventional threshold of £20,000 per QALY (Fig 3) [56].

thumbnail
Fig 2. Cost-effectiveness acceptability frontier (CEAF) indicating the probability of the optimal test-treat strategy (i.e. urodynamics) being cost-effective across different willingness to pay thresholds per additional woman successfully treated.

https://doi.org/10.1371/journal.pone.0160351.g002

thumbnail
Fig 3. Cost-effectiveness acceptability frontier (CEAF) indicating the probability of the optimal test-treat strategy being cost-effective across different willingness to pay thresholds per additional quality-adjusted life-year (QALY).

https://doi.org/10.1371/journal.pone.0160351.g003

The results of the second analysis showed that, in comparison to the treatment of all women on the basis of urodynamics, restricting the use of urodynamics to women with clinical history of mixed urinary incontinence led to an additional 309 successfully treated women per 10,000 at an additional cost of £603 per woman (Table 4). This resulted in an ICER of £19,500 per woman successfully treated. Treating these women on the basis of bladder ultrasonography required an additional £641 per woman and led to an additional 82 cases per 10,000 women successfully treated compared with the use of urodynamics in the same women, which gave an ICER of £78,600 per additional woman successfully treated. In the absence of a pre-specified threshold of WTP per additional woman successfully treated, the identification of the probability of the optimal strategy being cost-effective is less straightforward, but £28,000 could be a theoretically acceptable threshold of WTP per woman subjectively cured [20]. At this value, there is almost 50% probability that performing urodynamics only in women with a clinical history of mixed incontinence is a cost-effective test-treat strategy (Fig 4).

thumbnail
Fig 4. Cost-effectiveness acceptability frontier (CEAF) indicating the probability of the optimal test-treat strategy being cost-effective across different willingness to pay thresholds per additional woman successfully treated.

https://doi.org/10.1371/journal.pone.0160351.g004

In terms of QALYs, having urodynamics as an adjunct to clinical history in women with patient history of mixed incontinence led to an additional 0.476 QALYs gained per woman at an additional cost of £603 compared with the treatment of all women on the basis of urodynamics, leading to an ICER of £12,700 per additional QALY. The results of the PSA indicated that, under current uncertainty, treating only in women with clinical history of mixed incontinence based upon urodynamics, with the rest being treated based upon clinical history, was likely to be the optimal test-treat strategy with 76% probability of being cost-effective at the commonly cited threshold of £20,000 per QALY (Fig 5). Conclusions drawn from both analyses remained robust to all sensitivity analyses except for the scenario where the highest effectiveness rates elicited from expert opinion were assumed in all cases of misdiagnosis (S3 Table).

thumbnail
Fig 5. Cost-effectiveness acceptability frontier (CEAF) indicating the probability of the optimal test-treat strategy being cost-effective across different willingness to pay thresholds per additional quality-adjusted life-year (QALY).

https://doi.org/10.1371/journal.pone.0160351.g005

Figs 6 and 7 show the population expected value of perfect information (EVPI) for both outcomes (i.e. women successfully treated and QALYs) of the two analyses undertaken across a range of WTP values for an additional unit of outcome. For the thresholds of £28,000 per woman successfully treated and £20,000 per QALY, population EVPI was found to be £36 million and £98 million respectively for the first analysis, and £77 million and £40 million for the second analysis. The large population EVPI indicates that further research for reducing current decision uncertainty is worthwhile.

thumbnail
Fig 6. Population expected value of perfect information (EVPI) for the two outcomes of first analysis.

https://doi.org/10.1371/journal.pone.0160351.g006

thumbnail
Fig 7. Population expected value of perfect information (EVPI) for the two outcomes of second analysis [The “spikes” in the figure correspond to the points where decision changes, namely to the ICER of the test-treat strategy “Urodynamics for women with clinical history of mixed incontinence” compared with “Urodynamics for all women”, which was £19,500 per woman successfully treated and £12,700 per QALY].

https://doi.org/10.1371/journal.pone.0160351.g007

Discussion

Main findings

This model-based economic evaluation suggested that urodynamics is a cost-effective component in the treatment of women failing first line conservative treatments. The first analysis showed that whilst treating on the basis of clinical history resulted in slightly more cases of women successfully treated and QALYs over the modelled time period compared with urodynamics, treating on the basis of urodynamics led to a worthwhile saving in cost achieved by the lower levels of unnecessary and expensive treatment. The second analysis explored whether urodynamic testing of a sub-group of women would provide a more efficient use of public health care resources. The analysis concluded that the more cost-effective test-treat strategy was to treat women with clinical history of overactive bladder without diagnostic testing and to undertake urodynamics in women with clinical history of mixed urinary incontinence. For both analyses, decisions remained robust to extensive sensitivity analysis concerning the model assumptions but subject to large uncertainties relating to the data inputs, which, as shown in the value-of-information analysis, indicate that further primary research is required.

Strengths and limitations

To the best of our knowledge, this is the first study attempting to compare the cost-effectiveness of urodynamics, bladder ultrasonography, and clinical history as test-treat strategies for women with symptoms of overactive bladder or urgency-predominant mixed incontinence referred to a secondary care setting. The study benefited from prevalence and accuracy data directly estimated from the BUS study. Costs were informed from national sources, and the main clinical pathways were parameterised with data mostly from meta-analyses and systematic reviews, and based on national treatment guidelines. These are likely to have extended the generalisability of the study’s findings beyond the UK setting. Finally, all assumptions used in the model were agreed in advance and key assumptions were tested in sensitivity analyses.

There are, however, a number of limitations. The results of the economic evaluation may overstate the cost-effectiveness of urodynamic testing. On one hand, this is because urinary diaries complement clinical history in practice, and thus providing a joint decision based upon clinical assessment rather than patient history alone. On the other hand, ambulatory urodynamics may be more sensitive in detecting DO [57], and other diagnoses [58, 59], than conventional laboratory urodynamics. An attempt to explore the cost-effectiveness of the different strategies in light of this evidence was undertaken in a sensitivity analysis. Furthermore, in the absence of available estimates of clinical effectiveness in cases of misdiagnosis, values were elicited from expert opinion. Deterministic and probabilistic sensitivity analyses were undertaken to account for the uncertainty around these estimates. Another limitation is that symptoms of urinary incontinence are commonly associated with profound personal costs. Therefore, economic analyses from a societal perspective may provide further insight into the cost-effectiveness of the test-treat strategies modelled.

An additional limitation relates to the quality of life data used in the model. In the absence of robust utility weights, it was assumed that women remaining symptomatic would maintain their initial quality of life, or that they would have a utility score of 0.92 if they became subjectively cured, with the impact of an alternative utility score being explored in a sensitivity analysis. In reality, however, utility decrements can occur after invasive interventions, and utility gains may differ among different urinary syndromes or severity of symptoms. This lack of evidence is potentially attributable to the common use of disease-specific outcome measures, which offer limited usefulness as outcome measures in cost-effectiveness analyses [60], although mapping algorithms have now started to be developed [61]. Nevertheless, lower urinary tract symptoms are likely to be associated with significant non-health impacts (e.g. embarrassment) and instruments capturing wider wellbeing benefits, such as the ICECAP measures, may offer a more relevant evaluative framework for treatment outcomes [62].

Finally, although the model’s time horizon is long enough to capture important costs and outcomes associated with the different test-treat strategies, the assumption that subjective improvements will last for the modelled period may not be completely valid in all instances. For example, tachyphylaxis to neurostimulation is not well known over time. It is better studied in botulinum toxin injections where there is a known tachyphylaxis rate with repeated injections, although this is small. Such variations from the model assumption, however, were not expected to have a significant impact on the study’s findings.

Interpretation

Based on the decision model used and the limitations discussed, the results of the first analysis indicated that determining second line invasive interventions in women with persistent symptoms of overactive bladder or urgency-predominant mixed incontinence on the basis of urodynamics is the optimal strategy. This finding supports the conclusions of other studies in favour of urodynamic testing [15, 16]. These studies, however, are all underpinned by the premise that effective treatment for overactive bladder symptoms is only determined through a successful identification of DO, symptom which explains a part of overactive bladder syndrome, and which can only be identified urodynamically. This study also used urodynamics as a gold-standard test, and this is a potential limitation because its accuracy is still open to debate.

An increasing number of studies conclude that an urodynamic identification of DO does not predetermine the clinical effectiveness of a number of different interventions for women with overactive bladder [17, 6365]. These findings are aligned to the conclusions drawn from the second analysis, which indicated that the most cost-effective test-treat strategy is to carry out urodynamic testing only in women with a clinical history of mixed urinary incontinence. Restricting the use of urodynamics to these women seems to be further supported from evidence pointing out that mixed urinary symptoms are more commonly encountered than mixed conditions [66], which result in a large proportion of women reporting symptoms of mixed urinary incontinence in clinical history [67]. The order of magnitude of this figure appears to be around 50% [66], which is similar to what was found in the BUS study (52%) [20].

Conclusion

The findings of this paper indicate that restricting the use of urodynamics to women with patient history of mixed urinary incontinence only is potentially the more cost-effective way forward for guiding second line treatment decisions. Further research is, however, needed to reduce the expected opportunity loss associated with the decision of moving away from current practice of basing invasive treatments for all women failing first line conservative treatments on urodynamic findings.

Supporting Information

S1 Fig. Decision sub-tree representing the treatment pathway of women with a diagnosis of detrusor overactivity from bladder ultrasonography; The [+] sign denotes similar model structure.

https://doi.org/10.1371/journal.pone.0160351.s001

(TIF)

S2 Fig. Decision sub-tree representing the treatment pathway of women with a diagnosis of overactive bladder from clinical history; The [+] sign denotes similar model structure.

https://doi.org/10.1371/journal.pone.0160351.s002

(TIF)

S3 Table. Results of univariate and multivariate sensitivity analyses.

https://doi.org/10.1371/journal.pone.0160351.s005

(PDF)

Acknowledgments

The authors want to thank the members of the Trial Steering Committee and Data Monitoring committee: Professor D Tincello (Professor of Urogynaecology & Honorary Consultant Gynaecologist, University of Leicester), Jean Perks (Patient Representative, Birmingham Women’s Hospital), Dr Patrick Chein, (Consultant Obstetrician and Gynaecologist, University of Dundee, Scotland), Professor Jonathan Cook (University of Oxford) and Dr Karen Ward (Consultant Urogynaecologist, Central Manchester Hospitals). Finally, the authors want to thank the rest co-investigators/applicants of the study: Professor Khalid Khan, Mr Philip Toozs-Hobson, Mr Dharmesh Kapoor, Mr Abu-Bakr-El-Mardi, Mr Zaki Almallah and Dr Karen Powell.

Author Contributions

  1. Conceived and designed the experiments: PL AC JJD JPD LJM.
  2. Performed the experiments: PL SR SM TSV.
  3. Analyzed the data: IG PB TER LJM JJD.
  4. Contributed reagents/materials/analysis tools: IG PB LJM JJD JPD PL AC SR SM TSV TER.
  5. Wrote the paper: IG PB LJM JJD JPD PL AC SR SM TSV TER.

References

  1. 1. Irwin DE, Kopp ZS, Agatep B, Milsom I, Abrams P. Worldwide prevalence estimates of lower urinary tract symptoms, overactive bladder, urinary incontinence and bladder outlet obstruction. BJU international. 2011;108(7):1132–8. pmid:21231991
  2. 2. Haylen BT, De Ridder D, Freeman RM, Swift SE, Berghmans B, Lee J, et al. An International Urogynecological Association (IUGA)/International Continence Society (ICS) joint report on the terminology for female pelvic floor dysfunction. International urogynecology journal. 2010;21(1):5–26. pmid:19937315
  3. 3. Milsom I, Abrams P, Cardozo L, Roberts R, Thüroff J, Wein A. How widespread are the symptoms of an overactive bladder and how are they managed? A population‐based prevalence study. BJU international. 2001;87(9):760–6. pmid:11412210
  4. 4. Stewart W, Van Rooyen J, Cundiff G, Abrams P, Herzog A, Corey R, et al. Prevalence and burden of overactive bladder in the United States. World journal of urology. 2003;20(6):327–36. pmid:12811491
  5. 5. Marinkovic SP, Rovner ES, Moldwin RM, Stanton SL, Gillen LM, Marinkovic CM. The management of overactive bladder syndrome. BMJ-British Medical Journal. 2012;344(7):e2365.
  6. 6. Hu T-W, Wagner TH, Bentkover JD, Leblanc K, Zhou SZ, Hunt T. Costs of urinary incontinence and overactive bladder in the United States: a comparative study. Urology. 2004;63(3):461–5. pmid:15028438
  7. 7. Irwin DE, Mungapen L, Milsom I, Kopp Z, Reeves P, Kelleher C. The economic impact of overactive bladder syndrome in six Western countries. BJU international. 2009;103(2):202–9. pmid:19278532
  8. 8. Abrams P, Kelleher C, Kerr LA, Rogers RG. Overactive bladder significantly affects quality of life. The American journal of managed care. 2000;6(11 Suppl):S580–90. pmid:11183901
  9. 9. Coyne KS, Payne C, Bhattacharyya SK, Revicki DA, Thompson C, Corey R, et al. The impact of urinary urgency and frequency on health‐related quality of life in overactive bladder: results from a national community survey. Value in health. 2004;7(4):455–63. pmid:15449637
  10. 10. Coyne KS, Sexton CC, Irwin DE, Kopp ZS, Kelleher CJ, Milsom I. The impact of overactive bladder, incontinence and other lower urinary tract symptoms on quality of life, work productivity, sexuality and emotional well‐being in men and women: results from the EPIC study. BJU international. 2008;101(11):1388–95. pmid:18454794
  11. 11. Abrams P. Describing bladder storage function: overactive bladder syndrome and detrusor overactivity. Urology. 2003;62(5):28–37. pmid:14662404
  12. 12. Rachaneni S, Latthe P. Does preoperative urodynamics improve outcomes for women undergoing surgery for stress urinary incontinence? A systematic review and meta‐analysis. BJOG: An International Journal of Obstetrics & Gynaecology. 2015;122(1):8–16.
  13. 13. Weber A, Taylor R, Wei J, Lemack G, Piedmonte M, Walters M. The cost‐effectiveness of preoperative testing (basic office assessment vs urodynamics) for stress urinary incontinence in women. BJU international. 2002;89(4):356–63. pmid:11872024
  14. 14. Geisler JP, Drenchko R. Cost-effectiveness of urodynamics testing in women with predominant stress incontinence symptoms. Obstetrics and gynecology. 2014;123:197S–S.
  15. 15. Digesu GA, Khullar V, Cardozo L, Salvatore S. Overactive bladder symptoms: do we need urodynamics? Neurourology and urodynamics. 2003;22(2):105–8. pmid:12579626
  16. 16. Hashim H, Abrams P. Is the bladder a reliable witness for predicting detrusor overactivity? The Journal of urology. 2006;175(1):191–4. pmid:16406907
  17. 17. Bosch J, Cardozo L, Hashim H, Hilton P, Oelke M, Robinson D. Constructing trials to show whether urodynamic studies are necessary in lower urinary tract dysfunction. Neurourology and urodynamics. 2011;30(5):735–40.
  18. 18. National Institute for Health and Care Excellence (NICE). Urinary incontinence: The management of urinary incontinence in women. NICE, 2013.
  19. 19. National Collaborating Centre for Women's and Children's Health. Urinary incontinence: The management of urinary incontinence in women. National Institute for Health and Care Excellence, 2006.
  20. 20. Rachaneni S, McCooty S, Middleton L, Brookes V, Daniels J, Coomarasamy A, et al. Accuracy and economic evaluation of Bladder Ultrasound in the diagnosis of Detrusor Overactivity: a study to evaluate if ultrasound can reduce the need for urodynamics. NIHR Health Technology Assessment. 2016;20(7):1–150.
  21. 21. Schäfer W, Abrams P, Liao L, Mattiasson A, Pesce F, Spangberg A, et al. Good urodynamic practices: Uroflowmetry, filling cystometry, and pressure‐flow studies**. Neurourology and urodynamics. 2002;21(3):261–74. pmid:11948720
  22. 22. Latthe P, Champaneria R, Khan K. Systematic review of the accuracy of ultrasound as the method of measuring bladder wall thickness in the diagnosis of detrusor overactivity. International urogynecology journal. 2010;21(8):1019–24. pmid:20424825
  23. 23. National Collaborating Centre for Women’s and Children’s Health. Urinary incontinence: The management of urinary incontinence in women (Quick reference guide). National Institute for Health and Care Excellence, 2006.
  24. 24. Tincello DG, Kenyon S, Abrams KR, Mayne C, Toozs-Hobson P, Taylor D, et al. Botulinum toxin a versus placebo for refractory detrusor overactivity in women: a randomised blinded placebo-controlled trial of 240 women (the RELAX study). European urology. 2012;62(3):507–14. pmid:22236796
  25. 25. Stöhrer M, Blok B, Castro-Diaz D, Chartier-Kastler E, Del Popolo G, Kramer G, et al. EAU guidelines on neurogenic lower urinary tract dysfunction. European urology. 2009;56(1):81–8. pmid:19403235
  26. 26. Dowson C, Watkins J, Khan MS, Dasgupta P, Sahai A. Repeated botulinum toxin type A injections for refractory overactive bladder: medium-term outcomes, safety profile, and discontinuation rates. European urology. 2012;61(4):834–9. pmid:22204745
  27. 27. Grosse J, Kramer G, Stöhrer M. Success of repeat detrusor injections of botulinum a toxin in patients with severe neurogenic detrusor overactivity and incontinence. European urology. 2005;47(5):653–9. pmid:15826758
  28. 28. Burton C, Sajja A, Latthe P. Effectiveness of percutaneous posterior tibial nerve stimulation for overactive bladder: A systematic review and meta‐analysis. Neurourology and urodynamics. 2012;31(8):1206–16. pmid:22581511
  29. 29. Peters KM, Carrico DJ, Wooldridge LS, Miller CJ, MacDiarmid SA. Percutaneous tibial nerve stimulation for the long-term treatment of overactive bladder: 3-year results of the STEP study. The Journal of urology. 2013;189(6):2194–201. pmid:23219541
  30. 30. Brazzelli M, Murray A, Fraser C. Efficacy and safety of sacral nerve stimulation for urinary urge incontinence: a systematic review. The Journal of urology. 2006;175(3):835–41. pmid:16469561
  31. 31. Siddiqui NY, Wu JM, Amundsen CL. Efficacy and adverse events of sacral nerve stimulation for overactive bladder: A systematic review. Neurourology and urodynamics. 2010;29(S1):S18–S23.
  32. 32. Latthe PM, Foon R, Toozs‐Hobson P. Transobturator and retropubic tape procedures in stress urinary incontinence: a systematic review and meta‐analysis of effectiveness and complications. BJOG: An International Journal of Obstetrics & Gynaecology. 2007;114(5):522–31.
  33. 33. Jain P, Jirschele K, Botros SM, Latthe PM. Effectiveness of midurethral slings in mixed urinary incontinence: a systematic review and meta-analysis. International urogynecology journal. 2011;22(8):923–32. pmid:21455757
  34. 34. Novara G, Artibani W, Barber MD, Chapple CR, Costantini E, Ficarra V, et al. Updated systematic review and meta-analysis of the comparative data on colposuspensions, pubovaginal slings, and midurethral tapes in the surgical treatment of female stress urinary incontinence. European urology. 2010;58(2):218–38. pmid:20434257
  35. 35. Dean N, Herbison P, Ellis G, Wilson D. Systematic review: Laparoscopic colposuspension and tension‐free vaginal tape: a systematic review*. BJOG: An International Journal of Obstetrics & Gynaecology. 2006;113(12):1345–53.
  36. 36. Kulseng‐Hanssen S, Berild GH. Subjective and objective incontinence 5 to 10 years after Burch colposuspension. Neurourology and urodynamics. 2002;21(2):100–5. pmid:11857661
  37. 37. Weber AM, Walters MD. Cost-effectiveness of urodynamic testing before surgery for women with pelvic organ prolapse and stress urinary incontinence. American journal of obstetrics and gynecology. 2000;183(6):1338–47. pmid:11120494
  38. 38. Philips Z, Bojke L, Sculpher M, Claxton K, Golder S. Good practice guidelines for decision-analytic modelling in health technology assessment. Pharmacoeconomics. 2006;24(4):355–71. pmid:16605282
  39. 39. Leal J, Wordsworth S, Legood R, Blair E. Eliciting expert opinion for economic models: an applied example. Value in Health. 2007;10(3):195–203. pmid:17532812
  40. 40. Department of Health. National Schedule of Reference Costs 2012–13 for NHS Trusts and NHS Foundation Trusts: NHS Own Costs. 2013.
  41. 41. Curtis L. Unit Costs of Health and Social Care 2013. University of Kent, 2013.
  42. 42. National Institute for Health and Care Excellence (NICE). Guide to the Methods of Technology Appraisal. NICE, 2013.
  43. 43. https://research.tufts-nemc.org/cear4/SearchingtheCEARegistry/SearchtheCEARegistry.aspx. 2013.
  44. 44. Chen HW, Bercik RS, Werner EF, Thung SF. Cost-effectiveness of percutaneous tibial nerve stimulation versus extended release tolterodine for overactive bladder. The Journal of urology. 2012;187(1):178–84. pmid:22100006
  45. 45. Wu JM, Fulton RG, Amundsen CL, Knight SK, Kuppermann M. Patient preferences for different severities of and treatments for overactive bladder. Female pelvic medicine & reconstructive surgery. 2011;17(4):184–9.
  46. 46. Leong RK, de Wachter SG, Joore MA, van Kerrebroeck PE. Cost‐effectiveness analysis of sacral neuromodulation and botulinum toxin A treatment for patients with idiopathic overactive bladder. BJU international. 2011;108(4):558–64. pmid:21166750
  47. 47. Siddiqui NY, Amundsen CL, Visco AG, Myers ER, Wu JM. Cost-effectiveness of sacral neuromodulation versus intravesical botulinum A toxin for treatment of refractory urge incontinence. The Journal of urology. 2009;182(6):2799–804. pmid:19837427
  48. 48. Wu JM, Siddiqui NY, Amundsen CL, Myers ER, Havrilesky LJ, Visco AG. Cost-effectiveness of botulinum toxin a versus anticholinergic medications for idiopathic urge incontinence. The Journal of urology. 2009;181(5):2181–6. pmid:19296983
  49. 49. Martin J, Williams K, Abrams KR, Turner DA, Sutton AJ, Chapple C, et al. Systematic review and evaluation of methods of assessing urinary incontinence. 2006.
  50. 50. Briggs AH, Claxton K, Sculpher MJ. Decision modelling for health economic evaluation: Oxford university press; 2006.
  51. 51. Barton GR, Briggs AH, Fenwick EA. Optimal Cost‐Effectiveness Decisions: The Role of the Cost‐Effectiveness Acceptability Curve (CEAC), the Cost‐Effectiveness Acceptability Frontier (CEAF), and the Expected Value of Perfection Information (EVPI). Value in Health. 2008;11(5):886–97. pmid:18489513
  52. 52. Claxton K. Bayesian approaches to the value of information: implications for the regulation of new pharmaceuticals. Health economics. 1999;8(3):269–74. pmid:10348422
  53. 53. Andronis L, Billingham LJ, Bryan S, James ND, Barton PM. A practical application of value of information and prospective payback of research to prioritize evaluative research. Medical Decision Making. 2015:0272989X15594369.
  54. 54. Thüroff JW, Abrams P, Andersson K-E, Artibani W, Chapple CR, Drake MJ, et al. EAU guidelines on urinary incontinence. Actas Urológicas Españolas (English Edition). 2011;35(7):373–88.
  55. 55. Office for National Statistics (ONS). Population estimates by Age and Sex. ONS; 2013.
  56. 56. National Institute for Health and Care Excellence (NICE). Social Value Judgements: Principles for the Development of NICE Guidance (2nd edn). NICE, 2008.
  57. 57. Radley SC, Rosario DJ, Chapple CR, Farkas AG. Conventional and ambulatory urodynamic findings in women with symptoms suggestive of bladder overactivity. The Journal of urology. 2001;166(6):2253–8. pmid:11696746
  58. 58. Dokmeci F, Seval M, Gok H. Comparison of ambulatory versus conventional urodynamics in females with urinary incontinence. Neurourology and urodynamics. 2010;29(4):518–21. pmid:19731314
  59. 59. Gorton E, Stanton S. Ambulatory urodynamics: do they help clinical management? BJOG: an International Journal of Obstetrics & Gynaecology. 2000;107(3):316–9.
  60. 60. Gray A, Clarke PM, Wolstenholme JL, Wordsworth S. Applied methods of cost-effectiveness analysis in healthcare: Oxford University Press; 2010.
  61. 61. Kay S, Tolley K, Colayco D, Khalaf K, Anderson P, Globe D. Mapping EQ-5D Utility scores from the Incontinence Quality of Life Questionnaire among patients with neurogenic and idiopathic overactive bladder. Value in Health. 2013;16(2):394–402. pmid:23538192
  62. 62. Goranitis I, Coast J, Al-Janabi H, Latthe P, Roberts TE. The validity and responsiveness of the ICECAP-A capability-well-being measure in women with irritative lower urinary tract symptoms. Quality of Life Research. 2016:1–13.
  63. 63. Groenendijk PM, Lycklama à Nyeholt AA, Heesakkers JP, Van Kerrebroeck PE, Hassouna MM, Gajewski JB, et al. Urodynamic evaluation of sacral neuromodulation for urge urinary incontinence. BJU international. 2008;101(3):325–9. pmid:18070199
  64. 64. Rovner E, Kennelly M, Schulte‐Baukloh H, Zhou J, Haag‐Molkenteller C, Dasgupta P. Urodynamic results and clinical outcomes with intradetrusor injections of onabotulinumtoxina in a randomized, placebo‐controlled dose‐finding study in idiopathic overactive bladder. Neurourology and urodynamics. 2011;30(4):556–62. pmid:21351127
  65. 65. Vandoninck V, van Balken MR, Finazzi Agrò E, Petta F, Micali F, Heesakkers JP, et al. Percutaneous tibial nerve stimulation in the treatment of overactive bladder: urodynamic data. Neurourology and urodynamics. 2003;22(3):227–32. pmid:12707873
  66. 66. Bump RC, Norton PA, Zinner NR, Yalcin I, Group DUIS. Mixed urinary incontinence symptoms: urodynamic findings, incontinence severity, and treatment response. Obstetrics & Gynecology. 2003;102(1):76–83.
  67. 67. Digesu GA, Salvatore S, Fernando R, Khullar V. Mixed urinary symptoms: what are the urodynamic findings? Neurourology and urodynamics. 2008;27(5):372–5. pmid:17943988