Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Defining and measuring acceptability of surgical interventions: A scoping review

  • Sophie James ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Methodology, Project administration, Validation, Visualization, Writing – original draft, Writing – review & editing

    sophie.j.james@york.ac.uk

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

  • Jennie Lister,

    Roles Data curation, Writing – review & editing

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

  • Joy Adamson,

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

  • Catherine Hewitt,

    Roles Conceptualization, Methodology, Supervision, Visualization, Writing – review & editing

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

  • Antonina Yakimova,

    Roles Data curation, Writing – review & editing

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

  • Andrew Mott,

    Roles Data curation, Writing – review & editing

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

  • Helen Fulbright,

    Roles Data curation, Methodology, Writing – review & editing

    Affiliation Centre for Reviews and Dissemination, University of York, York, United Kingdom

  • Catriona McDaid

    Roles Conceptualization, Methodology, Supervision, Visualization, Writing – review & editing

    Affiliation York Trials Unit, Department of Health Sciences, University of York, York, United Kingdom

Abstract

Background

Acceptability, in the context of healthcare interventions is a frequently used term, including in evaluations of surgical interventions. This reflects the importance of the concept to all stakeholders and significance to designing, implementing and evaluating interventions. Despite this, definitions and measurement of acceptability are not standardised, and acceptability is often poorly conceptualised. The aim of this scoping review was to identify how studies define, measure and report the acceptability of a surgical intervention.

Methods

A scoping review was conducted adhering to the Joanna Briggs Institute guidelines and reported according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews. A comprehensive search of MEDLINE; Embase:APA PsycInfo; EBHealth-KSR Evidence; Cochrane Central Register of Controlled Trials; International HTA database; ClinicalTrials.gov and WHO International Clinical Trials Registry Platform was conducted for the period January 2000 to November 2023. No language limits were applied.

Results

Sixty-seven studies from 25 countries were included. The majority of studies (n = 60; 90%) did not provide a definition of acceptability. Various methods were used to collect data on acceptability, most frequently a questionnaire (n = 36; 54%), followed by qualitative interviews (n = 16; 24%). Thirty-three studies (49%) reported acceptability of the surgical intervention received to patients, nine (13%) reported hypothetical acceptability of the surgical intervention to patients, four (6%) reported acceptability to both patients and surgeons, and four studies (6%) the acceptability to surgeons alone.

Conclusion

Studies assessing acceptability of a surgical intervention tended not to provide a definition of acceptability and demonstrated a lack of clarity in the use of acceptability in the context of surgical interventions. There was substantial variability in how and when acceptability was measured and from which perspective.

Further research is required to explore the most appropriate approaches to address variability and promote a more consistent conceptualisation and accurate measurement of acceptability in evaluations of surgical interventions.

1. Introduction

The acceptability of healthcare interventions is recognised as important across all stakeholders [13]. In the UK context, the acceptability of an intervention is often a requested outcome in National Institute of Health Research (NIHR) commissioning briefs. There are a number of definitions of acceptability in healthcare [35] which tend to be broad and nonspecific. A recent definition, developed alongside the Theoretical Framework of Acceptability (TFA) describes acceptability as:

“a multi-faceted construct that reflects the extent to which the people who provide or receive an intervention consider it to be appropriate, based on anticipated or experienced cognitive and emotional responses to the intervention” [6].

Several different ways of capturing acceptability have been explored, including through qualitative interviews and focus groups, quantitative patient reported outcome measures, or by proxy through the reporting of participants’ behaviours (e.g., giving consent) [59]. However, there is no agreed definition of acceptability and the concept is generally considered as vague [10], and not well measured [6,11].

Surgical interventions are a common, yet distinctive, form of healthcare intervention. There are more than six million surgical procedures taking place within the NHS annually [12] and over 300 million worldwide [13]. The acceptability of a surgical intervention to patients, or lack of acceptability, could affect their willingness to undergo a surgical procedure. Additionally, the IDEAL Framework [14] provides a structured evaluation pathway for surgical innovation, and recommends that evaluation and assessment of a surgery should include standards for acceptable delivery.

There is currently no conceptualisation of acceptability specific to surgery. There are existing definitions and frameworks developed for evaluating the acceptability of complex behavioural healthcare interventions, such as the TFA, [6] however, it is unclear whether these can be applied to surgical interventions [15]. Surgery has many different concomitant factors that may have implications for acceptability, for example variations in the skills of those delivering the care, the surgical wider team and setting, all of which can occur pre-, peri- or post-operatively [16,17].

There is uncertainty as to how best to assess the acceptability of surgical interventions. Acceptability is often grouped with closely related concepts such as patient satisfaction or treatment preference [1] and there remains a need for a better understanding of acceptability in this context. Therefore, we sought to answer the research question: how do studies evaluating the acceptability of a surgical intervention define, measure and report this? In order to achieve this and broadly map the existing evidence to identify, characterise and summarise this topic, rather than addressing feasibility, appropriateness or effectiveness, a scoping review was considered the most appropriate method [18].

1.1 Aim and objectives

The aim of this scoping review was to identify how studies define, measure and report acceptability of a surgical intervention. The specific objectives were:

  1. To describe the definitions of acceptability used in these studies.
  2. To describe the methods of collecting data on acceptability used in studies (qualitative and quantitative) and key contextual factors (e.g. who reported the acceptability, the stage of development of the intervention and when the measurement of acceptability had taken place).
  3. To identify knowledge gaps in the literature on acceptability measurement for surgical interventions.

2. Methods

2.1 Protocol and registration

A scoping review was conducted according to best practice guidance from the Joanna Briggs Institute (JBI) Scoping Review Methodology Group [19]. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for scoping reviews (PRISMA-ScR) guidelines [20] were utilised in the reporting of this study (S1 Table). The protocol was published through the Open Science Framework (https://osf.io/uaxvp).

2.2 Eligibility criteria

The eligibility criteria are detailed in Table 1. Studies which reported measuring the acceptability of at least one surgical intervention were eligible for inclusion. Studies that approached acceptability using only proxy terms such as ‘feasibility’ alone were excluded [6]. Only studies published since 2000 were included to reflect contemporary practice for evaluation of surgical interventions.

Systematic reviews and meta-analyses were excluded to avoid duplication of reporting; however, reference lists were checked for additional studies. Articles were limited to those written in English, or those that could be translated into English by Google translate (https://translate.google.com/).

2.3 Searches

A comprehensive search strategy was developed by an Information Specialist (HF). Text word searches for terms appearing in the titles and abstracts of database records were included in the strategy alongside searches of relevant subject headings. The final Ovid MEDLINE strategy was adapted with relevant subject headings (controlled vocabularies) and search syntax, appropriate to each resource (S1 Fig). No language limits were applied. A date limit of 2000 was applied.

2.4 Information sources

The following databases were searched on 09 November 2023: Ovid MEDLINE® ALL; Embase (via Ovid); APA PsycInfo (via Ovid); EB Health - KSR Evidence (via Ovid); Cochrane Central Register of Controlled Trials (via Wiley); International HTA database (via https://database.inahta.org/); ClinicalTrials.gov (via https://clinicaltrials.gov/); and WHO International Clinical Trials Registry Platform (via https://trialsearch.who.int/).) Results were imported into EndNote 21 (Clarivate Analytics, USA) for de-duplication.

2.5 Selection of sources of evidence

Results of all searches were uploaded to Covidence (http://www.covidence.org) and screened independently by two reviewers (SJ and JL, AM or AY). Full texts of potentially relevant articles were reviewed against inclusion criteria by two reviewers independently (SJ and JL, AM or AY). Disagreements were resolved through discussion.

2.6 Data charting process

Data extraction was performed independently by two reviewers (SJ and AM or AY) in Covidence (http://www.covidence.org). Disagreements were discussed and a final version agreed by consensus.

2.7 Data items

Data extracted included year and country published, study aim, methodology, disease area, description of the surgical intervention and any comparator, stage of development of the surgical intervention according to the IDEAL Framework [14], population characteristics of those reporting acceptability, definition of acceptability provided, and how and when acceptability was measured (S2 Table).

2.8 Critical appraisal of individual sources of evidence

The quality of studies was not assessed, which is consistent with guidance for scoping review conduct [19].

2.9 Analysis and presentation of the results

To address the research questions, the data extracted was mapped and tabulated by study characteristics (year published, country, methodology, surgery type, stage of development, who reported acceptability, how was acceptability measured and when was acceptability measured) and presented descriptively. The data extracted for definitions of acceptability and the content of the measurement methods provided were tabulated and narratively synthesised.

3. Results

3.1 Overall description of the included studies

The searches yielded 9,104 records after de-duplication (Fig 1). Researchers screened 805 full-text articles and 67 studies were included. Fifty-three of the included studies were full publications of completed studies, six were conference abstracts of completed studies, and eight were protocols.

thumbnail
Fig 1. PRISMA 2020 flow diagram for reviews which included searches of databases and registers.

https://doi.org/10.1371/journal.pone.0323738.g001

Of the 738 full-text articles that were excluded the main reason was that they did not assess the acceptability of the surgical intervention: 29% (n = 213) used a ‘patient acceptable symptomatic state’ which measured acceptability of symptoms, 8% (n = 60) described acceptability of another outcome measure, 7% (n = 49) reported the acceptability of male circumcision for HIV prevention and 1% (n = 8) were feasibility randomised controlled trials (RCT) assessing the acceptability of trial processes (see Fig 1. for further reasons for exclusion). Two studies were not published in English and it was not possible to translate these sufficiently using Google translate (https://translate.google.com/) and were therefore excluded.

The included studies were published between 2001 and 2023, with the highest number published in 2021 (n = 8; 12%). The included studies and were undertaken in 25 countries, with most studies taking place in the UK (n = 20; 30%) followed by India (n = 7; 10%) and the USA (n = 6; 9%). There were six studies conducted in more than one country (Table 2).

thumbnail
Table 2. Summary of key characteristics of included studies.

https://doi.org/10.1371/journal.pone.0323738.t002

The most common clinical speciality for the surgical intervention was oncology (n = 13) followed by obesity (n = 9) and orthopaedics/trauma (n = 9) (Fig 2). The majority (92.5%) of studies investigated the acceptability of an elective surgical intervention (as opposed to a trauma surgical intervention).

thumbnail
Fig 2. Clinical speciality of the surgical intervention in the included studies.

https://doi.org/10.1371/journal.pone.0323738.g002

3.2 Defining acceptability

Twenty-four (36%) of the 67 included studies used the term acceptability in their title and 36 (54%) as part of their main study aim, with 17 (25%) using the term in both the title and within the aim.

Seven (10%) of the included studies provided an explicit conceptual definition of acceptability, with six of these (85%) utilising or referencing the definition provided in the TFA [6] (Table 3).

thumbnail
Table 3. Conceptual definitions used by the studies who provided this information.

https://doi.org/10.1371/journal.pone.0323738.t003

3.3 Measuring acceptability

3.3.1 Study design.

The included studies utilised different methods and procedures to collect and analyse the data on acceptability. The most common study design used was a cross sectional design (using a questionnaire) (n = 20; 30%), qualitative methods (n = 10; 15%) and RCTs in which acceptability of surgery was measured as one of the study outcomes (n = 9; 13%). Six (9%) were embedded qualitative studies to assess acceptability of a surgical intervention within an RCT or feasibility RCT (Table 2).

Over half of the included studies reported the acceptability of a single surgical intervention (n = 38; 57%), 19 (28%) reported the acceptability in a study comparing two or more surgical interventions and eight (12%) considered surgical vs non-surgical interventions.

3.3.2 Who reported acceptability?

Thirty-three studies (49%) asked patients who had received the surgical intervention to report acceptability, whilst 9 studies (13%) asked patients to report acceptability of a possible future surgical intervention. Seven studies (10%) asked both patients who had received and those who may receive the surgical intervention to report acceptability. Five studies (7%) reported acceptability of the intervention to both patients and surgeons, and a further three (4%) reported acceptability to surgeons (further detail of who reported acceptability in all included studies is provided in Table 2).

Of the 59 studies that were complete, 49 (83%) provided the age of the participants in the study (the age of the participants ranged from 20 to 84 years), 46 (79%) provided information on the gender of the participants (across the included studies, 24% of the participants were male and 76% of the participants were female) and 12 (20%) of the studies reported ethnicity of the participants who had reported acceptability (where this was reported it was most predominantly described as ‘British’/ 'White British’/ 'White’/ 'Caucasian’).

3.3.3 When was acceptability measured?

Thirty studies (45%) measured acceptability after the surgical intervention had taken place, 20 studies (30%) collected data on acceptability before the surgical intervention had taken place, with 16 of these 20 studies (80%) asking patients to report acceptability of a possible future surgical intervention. Nine studies (13%) measured acceptability both before the surgical intervention and after the surgical intervention had taken place and for three studies it was unclear when the measurement had taken place in relation to the surgical intervention (Table 2).

To explore at what stage in the surgical interventions development the acceptability was measured, all studies were classified according to the IDEAL Framework [14]. Sixty-three studies were Stage 4 (which is described as surveillance to identify rare and late outcomes as well as a possible broadening of ‘accepted’ indications), three studies were Stage 3, (described as evaluation of the intervention against current practice) and one study was Stage 1 (described as proof of concept, involving first use in humans).

3.3.4 How was data on acceptability collected?

Most studies (n = 62; 92%) provided a description of the data collection methods, with the most common being a questionnaire used to collect data regarding acceptability of the surgical intervention (n = 37; 55.2%) followed by qualitative interviews (n = 16; 23.8%) (Fig 3).

thumbnail
Fig 3. Data collection methods used to obtain information about acceptability of the surgical intervention in the included studies.

https://doi.org/10.1371/journal.pone.0323738.g003

Of the 43 studies utilising questionnaires, (comprising of n = 37 studies that used a questionnaire only to collect data on acceptability and n = 6 studies that used a combination of both a questionnaire and qualitative interviews), 40 (93%) provided details of the questionnaire or questions used and it was unclear on the remaining three (S3 Table). Of the 40 studies that provided some detail, 30 (73%) reported using bespoke questions or a combination of scales to measure acceptability; five (17%) of these reported at least some information about the validity and reliability of the measure. Eleven studies (27%) that used a questionnaire reported using or adapting an existing questionnaire or using a combination of existing questionnaires, and six (55%) of these 11 provided information about the validity and reliability of the acceptability measure that was used.

Of the 25 studies that undertook qualitative interviews or focus groups (comprising of n = 16 studies that conducted qualitative interviews alone, n = 2 studies conducting focus groups, n = 6 studies conducting both qualitative interviews and using a questionnaire and n = 1 study conducted both interviews and focus groups), 20 studies (80%) gave further details of the methods of exploring acceptability, with six studies (29%) of these 20 specifically mentioning a topic guide (S4 Table).

Within the measurement of acceptability, eight studies (12%) used (or included as a component of the measure) the concept of satisfaction. In addition, seven studies (10%) included pain scores, seven (10%) cosmesis/cosmetic appearance assessment and six (9%) used ‘would you recommend the intervention to family or friends’.

4. Discussion

4.1 Summary of evidence

This scoping review sought to map the existing evidence on how studies evaluating the acceptability of a surgical intervention define, measure and report acceptability. The findings highlighted a lack of clarity and consistency in the definition and measurement of acceptability. The vast majority (n = 60; 90%) of the included studies did not provide a definition of acceptability, despite 25% (n = 17) of them using the term in both their title and aim. This is an increase compared to a previous study which identified systematic reviews that claim to define, theorise or measure acceptability of healthcare interventions and reported from 43 reviews included, none explicitly theorised or defined acceptability [6].

Where a conceptual definition of acceptability was provided by a study, it was most frequently the Theoretical Framework of Acceptability definition [6]; although this conceptual definition was only used in a very small number of studies overall.

Studies assessed acceptability using a variety of qualitative and quantitative methods. This variation reflects the current lack of standardisation in measurement of acceptability in evaluations of surgical interventions. A standardised conceptualisation and measurement instrument for acceptability of a surgery is a necessary step to being able to report and improve acceptability, enhancing clinical decision-making, and enriching patient experiences. Development of a new measure should involve evaluation of the strengths and limitations of the various methods used to date. Providing patients with clearer information on acceptability will help in making informed decisions about surgical treatments, promoting patient-centered care and better health outcomes.

Terms and concepts associated with acceptability were also used by some of the included studies. For example, eight studies reported measuring acceptability, but used satisfaction measures either solely or as part of the assessment. This finding is similar to an overview of reviews identifying studies that claimed to define, theorise or measure the acceptability of healthcare interventions. In this overview 50% of the identified reviews using self-report assessments of acceptability included a measure of satisfaction [6]. This suggests a knowledge gap as to whether concepts used in the assessment of acceptability, such as satisfaction, are separate to acceptability, or whether they form components of acceptability.

Over 90% of the included studies assessed the acceptability of an elective surgical intervention, as opposed to a trauma or emergency surgical intervention. It is possible that the definition of acceptability differs depending on if a surgery is elective or related to trauma or emergency and on the clinical speciality, which should also be considered in future research.

Most studies (73%) asked patients who had undergone, or may potentially undergo the surgical intervention to report acceptability, reflecting the known importance of patient reported outcome measures in understanding patient perspectives [88], engaging patients in co-evaluation of their surgery [89] and capturing what matters to them [90]. However, overall the population characteristics of those reporting acceptability were not well reported. It is suggested that age, gender, ethnicity, cultural and other socio-economic factors may influence the acceptability of a surgical intervention [67], therefore, it would be beneficial to examine how these characteristics and any other systemic differences, affect how acceptability is reported. It would also be valuable to explore if surgeon and patient perspectives should be considered separately, or if it is feasible to combine different stakeholder responses in a single outcome measure to gather comprehensive information about acceptability of surgical interventions [91].

The majority (98.5%) of included studies were investigating an already established surgical intervention (described in this scoping review using the IDEAL framework [14]), yet it is suggested that the development stage of a surgical intervention can affect its acceptability [56]. The guidance and workstreams specifically for safely developing, refining and testing novel surgical procedures during their early-stages of development are in their infancy [92,93] which may account for why only one study reported acceptability at this very early-stage of the surgical interventions development.

There was further variability demonstrated in the timing of when acceptability was assessed. There were 30 studies (45%) that measured acceptability after the surgical intervention and 20 studies (30%) that measured acceptability before the surgical intervention. It has been suggested that different factors influence prospective (i.e., anticipated) and retrospective (i.e., experienced) acceptability and that acceptability should be assessed prior to the patient experiencing an intervention wherever possible [6,8,29]. Additionally, measuring acceptability early in the surgical intervention’s development [14], would allow improvements in acceptability to be made, and therefore improving patient care, and health outcomes. Future research should consider when the optimal time is to measure acceptability of a surgical intervention.

4.2 Strengths and Limitations

This scoping review included rigorous database searches, and mapped the evidence on how the acceptability of surgical interventions is currently defined and measured in evaluation research [94]. The protocol was written and made publicly available prior to the searches being undertaken. Study selection and data extraction were undertaken independently by two reviewers. The included studies were undertaken across 25 countries, highlighting that acceptability is an internationally utilised concept, and has wide relevance. The concept of acceptability may be considered differently in different languages or countries, which may in turn affect the definition and measurement of it [6].

While the searches were designed to be comprehensive, relevant literature assessing acceptability using alternative terminology or varied interpretations of the word acceptability could have been missed. It was beyond the scope of this project to include search terms for patient or surgeon preferences, perspectives, satisfaction, or for proxy questions such as ‘would you recommend this to your friends and family’ due to the number of results that this would generate. We focused on studies that reported acceptability in the title or abstract (specifically, only records with ‘acceptab*’ in the title or abstract were searched for) on the assumption that these studies would provide the richest data source for how surgical intervention acceptability is being defined and measured within the field.

5. Conclusion

Despite searching across all types of surgery over a twenty-three year period, we identified only a small pool of studies reporting measuring acceptability of a surgical intervention in the title or abstract. Studies often did not provide a definition of acceptability and there was a lack of clarity in the use of the concept. There was also substantial variability in how and when acceptability was measured and from which perspective.

Further research is required to explore the most appropriate approaches to promote a more consistent conceptualisation and accurate measurement by addressing the variability in whether, how and when acceptability is considered in the evaluation of surgical interventions. This should include development of consensus on core components of acceptability for a surgical intervention, with consideration of the stage of surgical innovation, measurement tools and implementation of good practice.

Supporting information

S2 Table. Copy of Covidence Data extraction form.

https://doi.org/10.1371/journal.pone.0323738.s002

(DOCX)

S3 Table. Details provided on the questionnaires of questions used to collect data on acceptability.

https://doi.org/10.1371/journal.pone.0323738.s003

(DOCX)

S4 Table. Details provided by the studies utilising interviews/ focus groups on the questions used to collect data on acceptability.

https://doi.org/10.1371/journal.pone.0323738.s004

(DOCX)

References

  1. 1. Perski O, Short C. Acceptability of digital health interventions: embracing the complexity. Transl Behav Med. 2021;11(7):1473–80.
  2. 2. Skivington K, Matthews L, Simpson S, Craig P, Baird J, Blazeby J. A new framework for developing and evaluating complex interventions: update of Medical Research Council guidance. BMJ. 2021;374:n2061.
  3. 3. Kazdin AE. Acceptability of alternative treatments for deviant child behavior. J Appl Behav Anal. 1980;13(2):259–73. pmid:7380752
  4. 4. Donabedian A. An introduction to quality assurance in health care. Oxford University Press; 2002.
  5. 5. Weiner BJ, Lewis CC, Stanick C, Powell BJ, Dorsey CN, Clary AS, et al. Psychometric assessment of three newly developed implementation outcome measures. Implement Sci. 2017;12(1):108. pmid:28851459
  6. 6. Sekhon M, Cartwright M, Francis J. Acceptability of healthcare interventions: an overview of reviews and development of a theoretical framework. BMC Health Serv Res. 2017;17(1):88.
  7. 7. Tarrier N, Liversidge T, Gregg L. The acceptability and preference for the psychological treatment of PTSD. Behav Res Ther. 2006;44(11):1643–56. pmid:16460671
  8. 8. Sidani S, Epstein DR, Bootzin RR, Moritz P, Miranda J. Assessment of preferences for treatment: validation of a measure. Res Nurs Health. 2009 Aug;32(4):419–31.
  9. 9. Hunsley J. Development of the treatment acceptability questionnaire. J Psychopathol Behav Assess. 1992;14(1):55–64.
  10. 10. Iphofen R. Finding common ground: consensus in research ethics across the social sciences. Emerald Group Publishing; 2017.
  11. 11. Bucyibaruta JB, Doriccah M, Bamford L, Elizabeth van der Wath A, Dyer TA, Murphy A, et al. Building consensus in defining and conceptualizing acceptability of healthcare: A Delphi study. Public Health Nurs. 2023;40(2):273–82. pmid:36478298
  12. 12. Chetter IC, Oswald AV, Fletcher M, Dumville JC, Cullum NA. A survey of patients with surgical wounds healing by secondary intention; an assessment of prevalence, aetiology, duration and management. J Tissue Viability. 2017;26(2):103–7. pmid:28049612
  13. 13. Meara JG, Leather AJM, Hagander L, Alkire BC, Alonso N, Ameh EA, et al. Global Surgery 2030: evidence and solutions for achieving health, welfare, and economic development. Int J Obstet Anesth. 2016;25:75–8. pmid:26597405
  14. 14. McCulloch P, Altman DG, Campbell WB, Flum DR, Glasziou P, Marshall JC, et al. No surgical innovation without evaluation: the IDEAL recommendations. Lancet. 2009;374(9695):1105–12. pmid:19782876
  15. 15. Paynter C, McDonald C, Story D, Francis JJ. Application of the theoretical framework of acceptability in a surgical setting: Theoretical and methodological insights. Br J Health Psychol. 2023;28(4):1153–68. pmid:37353989
  16. 16. Ergina P, Cook J, Blazeby J, Boutron I, Clavien P-A, Reeves B. Challenges in evaluating surgical innovation. Lancet. 2009;374(9695):1097–104.
  17. 17. Cook JA. The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials. 2009;10(1):9.
  18. 18. Munn Z, Peters MDJ, Stern C, Tufanaru C, McArthur A, Aromataris E. Systematic review or scoping review? Guidance for authors when choosing between a systematic or scoping review approach. BMC Med Res Methodol. 2018;18(1):143. pmid:30453902
  19. 19. Peters MDJ, Marnie C, Tricco AC, Pollock D, Munn Z, Alexander L, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Implement. 2021;19(1):3–10. pmid:33570328
  20. 20. Tricco A, Lillie E, Zarin W, O’Brien K, Colquhoun H, Levac D. Prisma extension for scoping reviews (prisma-scr): checklist and explanation. Ann Intern Med. 2018;169(7):467–73.
  21. 21. Google Translate [Internet]. [cited 2023 Nov 25]. Available from: https://translate.google.com/.
  22. 22. Andley M, Abhishek A, Saurabh G, Saha S, Kumar A, Pusuluri R. Randomised controlled study to compare surgical outcome of vaaft with conventional fistulotomy in low fistula in ano patients. Surg Endosc. 2018;32(Suppl 2):S460.
  23. 23. Awoyinka BS, Ayinde OA, Omigbodun AO. Acceptability of caesarean delivery to antenatal patients in a tertiary health facility in south-west Nigeria. J Obstet Gynaecol. 2006;26(3):208–10.
  24. 24. Banieghbal B, Beale P. Day-case laparoscopic Nissen fundoplication in children. J Laparoendosc Adv Surg Tech A. 2007;17(3):350–2. pmid:17570787
  25. 25. Baste NM, Shelke RS, Patil V, Radhakrishna S. Reluctance to accept breast conservation surgery for early breast cancers in tribal women of northern Maharashtra - a cross sectional study. Neuroquantology. 2022;20(22):3528–31.
  26. 26. Batten TJ, Patel NG, Birdsall P. Olecranon fractures: is nonoperative treatment acceptable in older patients?. Curr Orthop Pract. 2016;27(1):103–6.
  27. 27. Bell GM, Anderson AE, Diboll J, Reece R, Eltherington O, Harry RA, et al. Autologous tolerogenic dendritic cells for rheumatoid and inflammatory arthritis. Ann Rheum Dis. 2017;76(1):227–34. pmid:27117700
  28. 28. Bhattacharya S. ISRCTN registry. [cited 2023 Dec 5. ]. Available from: https://www.isrctn.com/ISRCTN49013893
  29. 29. Bowling A, Culliford L, Smith D, Rowe G, Reeves BC. What do patients really want? Patients’ preferences for treatment for angina. Health Expect. 2008;11(2):137–47. pmid:18494958
  30. 30. Bunce A, Guest G, Searing H, Frajzyngier V, Riwa P, Kanama J, et al. Factors affecting vasectomy acceptability in Tanzania. Int Fam Plan Perspect. 2007;33(1):13–21. pmid:17462984
  31. 31. Chen H, Lei R, Liu L. Efficacy and acceptability of lateral and medial approach vs. posterolateral and anteromedial approach in treating terrible triad of the elbow. Int J Clin Exp Med. 2018;11(6):5873–8.
  32. 32. Cook JA, Merritt N, Rees JL, Crocker JC, Hopewell S, Dritsaki M, et al. Patch-augmented rotator cuff surgery (PARCS) study-protocol for a feasibility study. Pilot Feasibility Stud. 2018;4:188. pmid:30598834
  33. 33. Cook E, Booth A, Coleman E, Scantlebury A, McDaid C, Hewitt C, et al. Pragmatic randomised evaluation of stable thoracolumbar fracture treatment outcomes (PRESTO): study protocol for a randomised controlled feasibility trial combined with a qualitative study and survey. Pilot Feasibility Stud. 2020;6:38. pmid:32190347
  34. 34. Crombag N, Sacco A, Stocks B, De Vloo P, van der Merwe J, Gallagher K, et al. ’We did everything we could’- a qualitative study exploring the acceptability of maternal-fetal surgery for spina bifida to parents. Prenat Diagn. 2021;41(8):910–21. pmid:34228835
  35. 35. Deshmane V, Raniwala A, Cardoza C. Patient-reported outcome after oncoplastic breast conservation surgery using level i or techniques without contralateral symmetrization. In: Cancer Research Conference. 2021;82(4 SUPPL).
  36. 36. Dunmoye OO, Moodley J, Popis M. Vasectomy in developing countries. J Obstet Gynaecol. 2001;21(3):295–7. pmid:12521864
  37. 37. Eisinger F, Stoppa-Lyonnet D, Lasset C, Vennin P, Chabal F, Noguès C, et al. Comparison of physicians’ and cancer prone women’s attitudes about breast/ovarian prophylactic surgery. Results from two national surveys. Fam Cancer. 2001;1(3–4):157–62. pmid:14574172
  38. 38. Ferreres A, Rondan A, Horgan S, Paleari J, Gimenez M, Laudanno O. Prospective randomized trial comparing laparoscopic and notes cholecystectomy: preliminary results. Surg Endosc. 2010;24(1):S226.
  39. 39. Ficty M, Teisseyre N. The acceptability of prophylactic mastectomy among lay people and health professionals: a pilot study. Eur Rev Appl Psychol. 2021;71(5):1–10.
  40. 40. Gaba F, Blyuss O, Chandrasekaran D, Osman M, Goyal S, Gan C, et al. Attitudes towards risk-reducing early salpingectomy with delayed oophorectomy for ovarian cancer prevention: a cohort study. BJOG. 2021;128(4):714–26. pmid:32803845
  41. 41. Giampaolino P, Morra I, Della Corte L, Sparice S, Di Carlo C, Nappi C, et al. Serum anti-Mullerian hormone levels after ovarian drilling for the second-line treatment of polycystic ovary syndrome: a pilot-randomized study comparing laparoscopy and transvaginal hydrolaparoscopy. Gynecol Endocrinol. 2017;33(1):26–9. pmid:27228002
  42. 42. Giannoudis VP, Rodham P, Antypas A, Mofori N, Chloros G, Giannoudis PV. Patient perspective on the use of carbon fibre plates for extremity fracture fixation. Eur J Orthop Surg Traumatol. 2023;33(6):2573–7. pmid:36656438
  43. 43. Gordon-Maclean C, Nantayi LK, Quinn H, Ngo TD. Safety and acceptability of tubal ligation procedures performed by trained clinical officers in rural Uganda. Int J Gynaecol Obstet. 2014;124(1):34–7. pmid:24156987
  44. 44. Goto O, Takeuchi H, Akimoto T, Kawakubo H, Sasaki M, Kitagawa Y. Availability of laparoscopic and endoscopic cooperative surgery: an international questionnaire survey. United Eur Gastroenterol J. 2016;4(5 Supplement 1):A582.
  45. 45. Hajong R, Khariong PD. A comparative study of two-port versus three-port laparoscopic cholecystectomy. J Minim Access Surg. 2016;12(4):311–4. pmid:27251814
  46. 46. Handaya AY, Setyawan N, Pangastuti N, , Barmawi A, Sofii I, et al. Double pedicle artery rotation sigmoid vaginoplasty for vaginal aplasia management. Ann Coloproctol. 2020;36(3):198–203. pmid:31991533
  47. 47. Harrison E, Tan W, Mills N, Karantana A, Sprange K, Duley L, et al. A feasibility study investigating the acceptability and design of a multicentre randomised controlled trial of needle fasciotomy versus limited fasciectomy for the treatment of Dupuytren’s contractures of the fingers (HAND-1): study protocol for a randomised controlled trial. Trials. 2017;18(1):392. pmid:28841903
  48. 48. Herman-Roloff A, Otieno N, Agot K, Ndinya-Achola J, Bailey RC. Acceptability of medical male circumcision among uncircumcised men in Kenya one year after the launch of the national male circumcision program. PLoS One. 2011;6(5):e19814. pmid:21603622
  49. 49. Hii A, Liu DS, Kholmurodova F, Irvine T, Bright T, Watson DI, et al. Partial fundoplication is effective treatment for female patients with gastroesophageal reflux and scleroderma: a multicenter comparative cohort study. World J Surg. 2022;46(1):147–53. pmid:34590163
  50. 50. Holman L, Friedman S, Daniels M, Sun C, Lu K. Acceptability of salpingectomy alone as risk-reducing surgery for brca mutation carriers. Gynecol Oncol. 2013;130(1):e104.
  51. 51. Huang W-S, Chin C-C, Yeh C-H, Lin PY, Wang J-Y. Randomized comparison between stapled hemorrhoidopexy and Ferguson hemorrhoidectomy for grade III hemorrhoids in Taiwan: a prospective study. Int J Colorectal Dis. 2007;22(8):955–61. pmid:17171354
  52. 52. Kawamura H, Yokota R, Homma S, Sato M. Acceptability of laparoscopy-assisted gastrectomy for patients with previous intra-abdominal surgery. Surg Laparosc Endosc Percutan Tech. 2009;19(6):431–5. pmid:20027083
  53. 53. Kim RS, Ene G, Simpson A, Gesink D, Ferguson S. Acceptability of bariatric surgery in young women with endometrial cancer and atypical endometrial hyperplasia: a qualitative study. Int J Gynecol Cancer. 2021;31(SUPPL 4):A88.
  54. 54. Langford CF, Elmissiry MM, Ghoniem GM. Do women have realistic expectations of treatment for stress urinary incontinence?. Neurourol Urodyn. 2008;27(6):480–4. pmid:18551570
  55. 55. Littlewood C, Wade J, Butler-Walley S, Lewis M, Beard D, Rangan A, et al. Protocol for a multi-site pilot and feasibility randomised controlled trial: Surgery versus PhysiothErapist-leD exercise for traumatic tears of the rotator cuff (the SPeEDy study). Pilot Feasibility Stud. 2021;7(1):17. pmid:33413664
  56. 56. Mir T, Dirks P, Mason WP, Bernstein M. Are patients open to elective re-sampling of their glioblastoma? A new way of assessing treatment innovations. Acta Neurochir (Wien). 2014;156(10):1855–62; discussion 1862-3. pmid:25085543
  57. 57. Nair NS, Penumadu P, Yadav P, Sethi N, Kohli PS, Shankhdhar V. Awareness and acceptability of breast reconstruction among women with breast cancer: A prospective survey. JCO Glob Oncol. 2021;7:253–60.
  58. 58. Nebgen DR, Hurteau J, Holman LL, Bradford A, Munsell MF, Soletsky BR. Bilateral salpingectomy with delayed oophorectomy for ovarian cancer risk reduction: a pilot study in women with BRCA1/2 mutations. Gynecol Oncol. 2018.
  59. 59. Nuccio O, Sendek B, Park M, Mesele T, Okello F, Gordon-Maclean C. Optimizing tubal ligation service delivery: a prospective cohort study to measure the task-sharing experience of Marie Stopes International Ethiopia. Health Policy Plan. 2017;32(2):163–9.
  60. 60. O’Brien PE, DeWitt DE, Laurie C, Brennan L, Wentworth JM, Anderson M, et al. The effect of weight loss on indigenous australians with diabetes: a study of feasibility, acceptability and effectiveness of laparoscopic adjustable gastric banding. Obes Surg. 2016;26(1):45–53. pmid:25990379
  61. 61. Olakkengil SA, Norwood MGA, Strickland AD, Behnia-Willison F, Mohan Rao M, Hewett PJ. Perspectives of laparoscopic donors toward a new procedure: transvaginal donor nephrectomy. J Laparoendosc Adv Surg Tech A. 2010;20(10):803–6. pmid:21133807
  62. 62. Parkar RB, Thagana NG, Baraza R, Otieno D. Experience with laparoscopic surgery at the Aga Khan Hospital, Nairobi. East Afr Med J. 2003;80(1):44–50.
  63. 63. Penketh R, Griffiths A, Chawathe S. A prospective observational study of the safety and acceptability of vaginal hysterectomy performed in a 24-hour day case surgery setting. BJOG. 2007;114(4):430–6. pmid:17378817
  64. 64. Penna M, Markar S, Hewes J, Fiennes A, Jones N, Hashemi M. Adolescent bariatric surgery--thoughts and perspectives from the UK. Int J Environ Res Public Health. 2013;11(1):573–82. pmid:24384777
  65. 65. Pulman K, Covens A, Bouchard-Fortier G, Hallet J, Karanicolas P, Vicus D. The acceptability and perception of the morbidity and mortality of complex surgical procedures in primary debulking of ovarian cancer: a survey of American and Canadian gynecologic oncologists. Gynecol Oncol. 2015;1:44.
  66. 66. Qiu H, Li L, Wu S, Liang H, Yuan W, He Y. A comparative study of female sterilization via modified Uchida and silver clip techniques in rural China. Int J Gynaecol Obstet. 2011;112(3):190–4. pmid:21247561
  67. 67. Retrouvey H, Zhong T, Gagliardi A, Baxter N, Webster F. How patient acceptability affects access to breast reconstruction: a qualitative study. BMJ Open. 2019;9(9):e029048.
  68. 68. Rosnov DL. Acceptability of weight loss treatments among overweight adolescents and their caregivers. Diss. Abstr. Int. B 2009;69(7-B):4441.
  69. 69. Sacco A, Ahmed S, Deprest J, David AL. A study to assess knowledge and acceptability of foetal surgery for spina bifida amongst healthcare professionals in the UK. J Obstet Gynaecol. 2020;40(4):448–54. pmid:31429339
  70. 70. Sarwer DB, Ritter S, Wadden TA, Spitzer JC, Vetter ML, Moore RH. Attitudes about the safety and efficacy of bariatric surgery among patients with type 2 diabetes and a body mass index of 30-40 kg/m2. Surg Obes Relat Dis. 2013;9(5):630–5. pmid:23260805
  71. 71. Smith L, Meggy A, Watts T, Knight L, Torkington J, Cornish J. Incisional hernia prevention: risk-benefit from a patient perspective (INVITE) - protocol for a single-centre, mixed-methods, cross-sectional study aiming to determine if using prophylactic mesh in incisional hernia prevention is acceptable to patients. BMJ Open. 2022;12(12):e069568. pmid:36585153
  72. 72. Smithling KR, Rwabizi D, Rutikanga K, Blomquist J, Gutman RE. 50: Acceptability of urinary diversion amongst women deemed inoperable for vesicovaginal fistula repair in Rwanda. Am J Obstet Gynecol. 2018;218(2):S925.
  73. 73. Sokal DC, Li PS, Zulu R, Awori QD, Combes SL, Simba RO. Randomized controlled trial of the shang ring versus conventional surgical techniques for adult male circumcision: safety and acceptability. J Acquir Immune Defic Syndr. 2014;65(4):447–55.
  74. 74. Solanki S, Babu MN, Jadhav V, Shankar G, Ramesh S. Continent catheterizable conduit for urinary diversion in children: Applicability and acceptability. Afr J Paediatr Surg. 2015;12(1):33–5. pmid:25659547
  75. 75. Soomro N. The partial study a randomised trial of the clinical and cost effectiveness of complex partial vs radical nephrectomy for clinically localised renal cell carcinoma. Urology Department The Newcastle Upon Tyne Hospitals NHS Foundation Trust Newcastle; 2023.
  76. 76. Srikesavan C, Toye F, Brealey S, Goodchild L, Northgraves M, Lamb SE, et al. The experiences of participants and healthcare professionals in the United Kingdom Frozen Shoulder Trial (UK FROST): A nested qualitative study. Physiotherapy. 2021;113:e15.
  77. 77. Stanford FC, Kyle TK, Claridy MD, Nadglowski JF, Apovian CM. The influence of an individual’s weight perception on the acceptance of bariatric surgery. Obesity (Silver Spring). 2015;23(2):277–81. pmid:25546377
  78. 78. Straiton N, Gullick J, Gallagher R. Acceptability of transcatheter aortic valve replacement: patient and carer perspectives and experiences. Heart Lung Circ. 2022;31:S46–7.
  79. 79. Summers RH, Elsey H, Moore M, Byrne C, Byrne J, Welbourn R, et al. Weight loss surgery for non-morbidly obese populations with type 2 diabetes: is this an acceptable option for patients?. Prim Health Care Res Dev. 2014;15(3):277–86. pmid:23735219
  80. 80. Thaha MA, Campbell KL, Kazmi SA, Irvine LA, Khalil A, Binnie NR, et al. Prospective randomised multi-centre trial comparing the clinical efficacy, safety and patient acceptability of circular stapled anopexy with closed diathermy haemorrhoidectomy. Gut. 2009;58(5):668–78. pmid:19091821
  81. 81. Turner KM, Percival J, Dunger DB, Olbers T, Barrett T, Shield JPH. Adolescents’ views and experiences of treatments for Type 2 diabetes: a qualitative study. Diabet Med. 2015;32(2):250–6. pmid:25186101
  82. 82. Tyagi V, Perera M. Treatment for pelvic organ prolapse: repair, mesh or nothing? a quantitative questionnaire based study. Neurourol Urodyn. 2012;31(6):910–1.
  83. 83. van Geelen SM, Bolt IL, van der Baan-Slootweg OH, van Summeren MJ. The controversy over pediatric bariatric surgery: an explorative study on attitudes and normative beliefs of specialists, parents, and adolescents with obesity. J Bioeth Inq. 2013;10(2):227–37.
  84. 84. Vartanian JG, Kowalski LP. Acceptance of major surgical procedures and quality of life among long-term survivors of advanced head and neck cancer. Arch Otolaryngol Head Neck Surg. 2009;135(4):376–9. pmid:19380360
  85. 85. Wagg A, Sheri N, Gibson W, Hunter K. What treatments for urinary incontinence and lower urinary tract symptoms are acceptable and what outcomes desirable to older people?. Neurourol Urodyn. 2017;36(Suppl 3):S281-3.
  86. 86. Wong K, Kinsella N, Seth J, Nicol D, Cahill D, Kasivisvanathan R, et al. COmparing Urolift and Standard Transurethral resection of prostate Ahead of Radiotherapy in men with urinary symptoms secondary to prostate enlargement in Southwest London and North Cumbria (CO-STAR): a study protocol for a randomised feasibility study. BMJ Open. 2023;13(10):e076621. pmid:37802612
  87. 87. Yasir M, Kapoor M, Bansal V, Masood I, Aiman A, Sharma A, et al. Prospective study on evaluation of stapler hemorrhoidectomy. Internet J Surg. 2009;22(1).
  88. 88. Fries JF, Witter J, Rose M, Cella D, Khanna D, Morgan-DeWitt E. Item response theory, computerized adaptive testing, and PROMIS: assessment of physical function. J Rheumatol. 2014;41(1):153–8. pmid:24241485
  89. 89. Brusco NK, Atkinson V, Woods J, Myles PS, Hodge A, Jones C, et al. Implementing PROMS for elective surgery patients: feasibility, response rate, degree of recovery and patient acceptability. J Patient Rep Outcomes. 2022;6(1):73. pmid:35798915
  90. 90. Braithwaite T, Calvert M, Gray A, Pesudovs K, Denniston AK. The use of patient-reported outcome research in modern ophthalmology: impact on clinical trials and routine clinical practice. Patient Relat Outcome Meas. 2019;10:9–24. pmid:30774489
  91. 91. Macefield R, Brookes S, Blazeby J, Avery K, Bluebelle Study Group*. Development of a “universal-reporter” outcome measure (UROM) for patient and healthcare professional completion: a mixed methods study demonstrating a novel concept for optimal questionnaire design. BMJ Open. 2019;9(8):e029741. pmid:31446412
  92. 92. Evidence based and patient centred information for surgery [Internet]. Bristol Centre for Surgical Research. [cited 2024 May 5. ]. Available from: https://www.bristol.ac.uk/population-health-sciences/centres/surgical-research/research/evidence.html
  93. 93. NIHR Bristol Biomedical Research Centre [Internet]. Surgical and orthopaedic innovation. [cited 2024 May 7. ]. Available from: https://www.bristolbrc.nihr.ac.uk/research/surgical-and-orthopaedic-innovation/#:~:text=Our%20workstreams&text=Developing%20novel%20surgical%20and%20orthopaedic%20devices%20and%20procedures%20to%20benefit%20patients.&text=Co%2Ddeveloping%20interventions%20to%20improve,and%20outcomes%20after%20surgical%20procedures.&text=Creating%20patient%2Dcentred%2C%20transparent%20systems%20for%20surgical%20innovation.,-Research%20projects
  94. 94. Pollock D, Davies EL, Peters MDJ, Tricco AC, Alexander L, McInerney P, et al. Undertaking a scoping review: A practical guide for nursing and midwifery students, clinicians, researchers, and academics. J Adv Nurs. 2021;77(4):2102–13. pmid:33543511