Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Reference rate for post-tonsillectomy haemorrhage in Australia—A 2000–2020 national hospital morbidity database analysis

  • Jonathan C. Li ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    jcyli@icloud.com

    Affiliation Department of Otolaryngology Head and Neck Surgery, Royal North Shore Hospital, Sydney, NSW, Australia

  • Martin Forer,

    Roles Investigation, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Department of Otolaryngology Head and Neck Surgery, Royal North Shore Hospital, Sydney, NSW, Australia

  • David Veivers

    Roles Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – review & editing

    Affiliations Department of Otolaryngology Head and Neck Surgery, Royal North Shore Hospital, Sydney, NSW, Australia, Northern Clinical School, The University of Sydney, Sydney, NSW, Australia

Correction

27 Mar 2025: The PLOS One Staff (2025) Correction: Reference rate for post-tonsillectomy haemorrhage in Australia—A 2000–2020 national hospital morbidity database analysis. PLOS ONE 20(3): e0321297. https://doi.org/10.1371/journal.pone.0321297 View correction

Abstract

This study aims to provide a national benchmark rate of post-tonsillectomy haemorrhage (PTH) in Australia. Using data from Australia’s National Hospital Morbidity Database (NHMD) from 1 July 2000 to 30 June 2020, we have conducted a nation-wide population-based study to estimate a reference rate of PTH. Outcomes of interest included the overall rate and time-trend of PTH, the relationship between PTH rates with age and gender as well as the epidemiology of tonsillectomy procedures. A total of 941,557 tonsillectomy procedures and 15,391 PTH episodes were recorded for the study period. Whilst the incidence of tonsillectomy procedures and the number of day-stay tonsillectomy procedures have increased substantially over time, the overall rate of PTH for all ages has remained relatively constant (1.6% [95% CI: 1.61 to 1.66]) with no significant association observed between the annual rates of PTH and time (year) (Spearman correlation coefficient, Rs = 0.24 (95% CI: -0.22 to 0.61), P = 0.3). However, the rate of PTH in adults (aged 15 years and over) experienced a statistically significant mild to moderate upward association with time (year) Rs = 0.64 (95% CI: 0.28 to 0.84), P = 0.003. Analysis of the odds of PTH using the risk factors of increasing age and male gender showed a unique age and gender risk pattern for PTH where males aged 20 to 24 years had the highest risk of PTH odds ratio 7.3 (95% CI: 6.7 to 7.8) compared to patients aged 1 to 4 years. Clinicians should be mindful of the greater risk of PTH in male adolescents and young adults. The NHMD datasets can be continually used to evaluate the benchmark PTH rate in Australia and to facilitate tonsillectomy surgical audit activities and quality improvement programs on a national basis.

Introduction

Tonsillectomy is one of the most performed surgical procedures in the field of otolaryngology. In Australia, over 50,000 tonsillectomies are performed annually [1]. The common indications for tonsillectomy include obstructive sleep disordered breathing and recurrent acute tonsillitis. Depending on the clinical context, tonsillectomy is carried out either as a sole procedure or in combination with other procedures. Tonsillar haemorrhage following tonsillectomy is a significant post-operative complication with the potential to cause serious morbidity and death [2, 3]. Patients with post-tonsillar haemorrhage (PTH) may require hospital re-admission including the urgent return to theatre under general anaesthesia for operative haemostasis. Due to the sheer numbers of tonsillectomies that are performed, even seemingly low rates of PTH at the population level can affect a large number of patients and generate a significant cost burden to the healthcare system and to our society.

Surgical audits and quality assurance activities are an essential part of surgical practice to improve patient safety. Contemporary clinical practice guidelines on tonsillectomy recommend clinicians to continually self-monitor their rates of PTH and compare their personal PTH rates with those from published reports and national benchmarks [4]. However, there has not been a population-based study or large multi-centre study conducted in Australia to provide a reference rate for PTH.

Australian PTH rates that are currently available have been derived from single-centre studies, often containing limited study population sizes [511]. As a result, these studies may be subject to inherent biases in the reporting of factors that have been shown to be determinants of PTH including age, gender, surgical technique, surgeon’s level of experience and underlying indication for tonsillectomy [12]. Furthermore, the reporting of PTH rates vary significantly in the literature, making it difficult for comparisons. This variability is largely owed to the different definitions of PTH that are used by studies. PTH can be divided into primary (< 24 hours) and secondary (> 24 hours) based on the timing of onset following the index operation. Studies that define PTH by episodes that require re-operation tend to have lower PTH rates than studies that use a definition based on the patient’s self-reporting of bleeding or on the number of emergency room or hospital admissions [13]. Accordingly, a national benchmark rate for PTH that is transparently derived and representative of the practice of tonsillectomy across Australia can facilitate quality improvement in tonsillectomy on a national scale. Given that age and gender are significant predictors of PTH [12, 1416], a benchmark rate of PTH should be adjusted for these two universal risk factors.

The primary aim of this study is to devise an Australian PTH reference rate and to evaluate its time-trend using publicly available data from the National Hospital Morbidity Database (NHMD). The estimated reference rate for PTH will be based on the return to theatre rate, specific for age and gender and devised using population-based data over the time period 2000 to 2020. A secondary aim of this study is to evaluate the epidemiology of tonsillectomy procedures to provide the context for the interpretation of the PTH rates in Australia.

Materials and methods

Data sources

The study utilises the procedure datasets contained within the NHMD which is a comprehensive collection of clinical and non-clinical records associated with each episode of admitted patient care within Australia. The NHMD commenced in 1993–94 and is maintained and governed by the Australian Institute of Health and Welfare (AIHW), an Australian Government’s health information agency [17]. All state and territory health authorities under the National Health Information Agreement (NHIA) are required to report to the NHMD annually following each Australian financial year. The coverage of the NHMD includes almost all public and private hospitals and free-standing day hospital facilities in Australia [17].

The annual hospital procedure datasets from 2000–01 through to 2019–20 (total period coverage from 1 July 2000 to 30 June 2020) were retrieved for this study. This data is available in the public domain and is freely accessible from AIHW’s website [1]. The data is de-identified and contains the procedure counts categorised by procedures codes. These codes are classified according to the Australian Classification of Health Interventions (ACHI) which is an Australian coding standard based on the Medicare Benefits Schedule (MBS). The variables contained within these datasets are age (grouped in 5-year intervals), gender, and hospital care type (i.e., day-stay versus overnight care).

The source population for incidence rate calculations was the annual mid-year resident population compiled and estimated from the Census population by the Australian Bureau of Statistics (ABS) [18].

Ethical consideration

This study was approved by the Northern Sydney Local Health District Human Research Ethics Committee (2022/ETH00229).

Definition of outcome measures

For our study, we have used the definition of PTH as episodes that were clinically severe to require the return to theatre for surgical haemostasis (ACHI code 41797–00 Arrest of haemorrhage following tonsillectomy). The count of this procedure code is synonymous with the return to theatre rate for haemorrhage control following tonsillectomy. Similarly, patients who had undergone a tonsillectomy procedure were identified using the following ACHI codes; Tonsillectomy with adenoidectomy (41789–01), tonsillectomy without adenoidectomy (41789–00) and tonsillectomy with uvulopharyngopalatoplasty (UPPP) (41786–01). The PTH rate was calculated by dividing the number of return to theatre episodes (41797–00) by the total number of tonsillectomy procedures (41789–01 + 41789–00 + 41786–01). The annual incidence for tonsillectomy procedures was calculated by dividing the yearly total number of tonsillectomy procedures by the mid-year resident population. For analyses involving the dichotomous comparison between adults and children, the age groups containing ages 1 to 14 were collectively defined as the paediatric age group and the age groups aged 15 years and above defined as the adult age group.

Statistical analysis

Categorical variables were analysed using descriptive statistics to determine frequency of counts, percentages of total, means and standard deviation. The 95% confidence intervals (95% CI) for rate calculations were estimated using the Poisson regression model. Time-trend analysis of annual PTH rates was performed using the Spearman’s rank correlation coefficient (Rs) to examine the strength of the association between the annual PTH rate (the dependent variable) and year (independent variable). The Pearson chi-square test was used where appropriate, and binomial logistic regression was used to analyse the univariate associations between the PTH rate with age and gender and are presented as odd ratios with 95% CI. All statistical tests were two sided with significance set at P < 0.05. Study data was collated using Excel (Microsoft Corporation) and statistical analyses were performed using StatsDirect 3.3.5 (StatsDirect Ltd., Wirral, UK).

Reporting guideline

The reporting of this study conforms to the STROBE statement.

Results

Post-tonsillectomy haemorrhages in Australia

Overview.

A total of 15,391 episodes of PTH and 941,557 tonsillectomy procedures were recorded between 1 July 2000 and 30 June 2020. This equates to an overall PTH rate of 1.63% (95% CI: 1.61 to 1.66) for the study period. The average annual PTH rate for the study period was 1.6 ± 0.1% [mean ± standard deviation (SD)] (S1 Table).

Time-trends of post-tonsillectomy rates.

Time series of the annual PTH rates is shown in Fig 1A. It demonstrates no discernible monotonic time-trend for the study period. Correspondingly, the Spearman’s rank correlation showed no significant association between annual PTH rate and time (year) (Rs = 0.24 [95% CI: -0.22 to 0.61], P = 0.3).

thumbnail
Fig 1. Annual post-tonsillectomy haemorrhage rates, 2000–01 to 2019–20.

A; Overall annual rates of PTH calculated for all ages. The absolute values of PTH episodes and tonsillectomy procedures used to calculate the PTH rates are available in S1 Table. B; Annual rates of PTH calculated for the adult (age over 15 years) and paediatric age groups (age 1 to 14). PTH = post-tonsillectomy haemorrhage. Year represents the Australian financial year-ended period from 1 July to 30 June. Data obtained from the National Hospital Morbidity Database.

https://doi.org/10.1371/journal.pone.0273320.g001

Further analyses were performed separately on the annual PTH rates for the adult and the paediatric patient populations (Table 1) with their time-series shown in Fig 1B. The paediatric age group had an average annual PTH rate of 1.0 ± 0.1% (mean ± SD) for the study period. Similarly, the Spearman’s correlation test showed no statistically significant association between the annual PTH rates and time (year) for the paediatric age group (Rs = 0.03 [95% CI: -0.42 to 0.47], P = 0.9). In contrast, a higher average annual PTH rate was calculated for the adult age group at 2.8 ± 0.3% (mean ± SD). The Spearman’s correlation test for association between annual PTH rates and time (year) performed for the adult age group showed a statistically significant, mild to strongly positive correlation, indicating an increasing trend of adult PTH rates over time (year) (Rs = 0.64 [95% CI: 0.28 to 0.84], P = 0.003).

thumbnail
Table 1. Annual rates of post-tonsillectomy haemorrhage in Australia for the adult and paediatric population, 2000–01 to 2019–20.

https://doi.org/10.1371/journal.pone.0273320.t001

Relationship of haemorrhage rates with age and gender.

Fig 2 shows the age-specific PTH rates calculated for the total study period for males and females. Two distinct gender patterns are evident. For both genders, the rates of PTH increased marginally with increasing age from age 1 to 14. From the age of 15, the increase was notably marked and sustained for the male gender with the rate of PTH reaching a maximum in the 20 to 24 years age group. The comparison of the odds of PTH between male and female were also calculated for each age group and are presented in Table 2. It demonstrates that male patients had a higher risk of PTH that was statistically significant as compared to females for all age groups except for patients aged 5 to 9.

thumbnail
Fig 2. Gender and age specific rates of post-tonsillectomy haemorrhage in Australia, 2000–01 to 2019–20.

Age-specific incidence rates of post-tonsillectomy haemorrhage (PTH) calculated by 5-year age groups for the male and female gender. Data obtained from the National Hospital Morbidity Database.

https://doi.org/10.1371/journal.pone.0273320.g002

thumbnail
Table 2. Comparison of age-specific post-tonsillectomy haemorrhage rates between the male and female gender.

https://doi.org/10.1371/journal.pone.0273320.t002

For both male and female, patients aged 1 to 4 years had the lowest rate of PTH (0.8% and 0.7%, respectively). Males aged 20 to 24 years had over 7 times the odds of PTH than males aged 1 to 4 years (odds ratio 7.3 [95% CI: 6.7 to 7.8], P < 0.0001). Correspondingly, females in the 20 to 24 years age group had3 times the odds of PTH than females in the 1 to 4 years age group (odds ratio 3.1 [95% CI: 2.8 to 3.4], P < 0.0001). Further comparison of the odds of PTH between age groups for each gender using the 1 to 4 years age group as the reference age group is presented in S2 Table.

The odds of PTH between the paediatric and adult age groups for both genders were also calculated (Table 3). It shows that, collectively, adult males were twice as likely to experience a PTH episode compared to adult females (odds ratio of 4.3 [95% CI: 4.1 to 4.9], P < 0.0001, versus 2.1 [95% CI: 2.0 to 2.2], P < 0.0001, respectively). Table 3 also shows that adult female patients had twice the odds of experiencing PTH compared to paediatric patients whereas adult male patients had 4 times the odds of experiencing a PTH episode compared to paediatric patients.

thumbnail
Table 3. Comparison of age-specific post-tonsillectomy haemorrhage rates between the adult and paediatric age groups between the male and female genders.

https://doi.org/10.1371/journal.pone.0273320.t003

Epidemiology of tonsillectomy in Australia

Characteristics of tonsillectomy procedures.

Characteristics of 941,557 tonsillectomy procedures recorded during the study period are also shown in S3 Table. These tonsillectomy procedures consisted of tonsillectomy with adenoidectomy (61.2%), tonsillectomy without adenoidectomy (36.8%) and tonsillectomy with UPPP (2%). The gender ratio had a slight preponderance for females (51.3%). The young paediatrics age groups contributed the highest number of tonsillectomy procedures (age 1 to 4 years with 28.7% and age 5 to 9 years with 26.9%). The data also included counts of tonsillectomy performed on infants (age <1 year) with an incidence rate of 0.04% (1 in every 2,500 tonsillectomy procedures). Analysis by treatment type showed that an overwhelming majority of tonsillectomy procedures were performed as an inpatient procedure (91.3%).

Incidence of tonsillectomy procedures.

Over the past two decades, there has been a sustained increase in the incidence rate of tonsillectomy procedures performed in Australia. The incidence rate rose from 156.5 per 100,000 persons (95% CI: 154.7 to 158.3) in 2000–01 to a peak of 264.4 per 100,000 persons (95% CI: 262.4 to 266.5) in 2016–17 (Fig 3 and S4 Table). From 2016–17 onwards, a plateauing and trending decrease in the incidence rate of tonsillectomy procedures was observed (Fig 3).

thumbnail
Fig 3. Annual incidence of tonsillectomy procedures, 2000–01 to 2019–20.

Rate expressed in procedures per 100,000 person-years. R1 arrow marks the release of the Guideline Indications for Tonsillectomy and Adenotonsillectomy released by the Royal Australasian College of Physicians and The Australian Society of Otolaryngology Head and Neck Surgery in July 2008. R2 arrow marks the introduction of Australian Government’s restrictions on elective surgery to free hospital resources to during the COVID-19 pandemic. Data obtained from the National Hospital Morbidity Database for the period 1 July 2000 to 30 June 2020.

https://doi.org/10.1371/journal.pone.0273320.g003

Tonsillectomy time-trends by procedure types, age-specific incidence, and proportion of day-stay procedures.

Contained within Fig 4 are other time-series plots related to tonsillectomy procedures in Australia. Fig 4A shows that tonsillectomy with adenoidectomy has consistently been the most performed tonsillectomy procedure type, with a prominent increase since 2007–08. From 2015, there has been twice as many tonsillectomy procedures performed with adenoidectomy than without adenoidectomy. The pattern of increase in adenotonsillectomy directly matches the increase in the age-specific incidence of tonsillectomy procedures for paediatric patients aged 1 to 9 years as shown in Fig 4B. Fig 4C shows that the annual percentage of day-stay tonsillectomy procedures has steadily risen during the study period.

thumbnail
Fig 4. Tonsillectomy procedure time-trends in Australia, 2000–01 to 2019–20.

Data obtained from the National Hospital Morbidity Database. A. Time-trend by tonsillectomy procedure type. Y axis displays number of procedures. Abbreviation UPPP; Uvulopharyngopalatoplasty. B. Time-trend by age group-specific incidence rates. Y axis displays rate per 100,000 person-years. C. Time-trend of percentage proportion tonsillectomy procedures performed as ambulatory day stay procedures.

https://doi.org/10.1371/journal.pone.0273320.g004

Age-specific incidence of tonsillectomy by gender.

The plots of age-specific incidence rates of tonsillectomy procedures for each gender are shown in Fig 5. Each line series represents the age-specific incidence rate averaged over a 5-year period to illustrate the changes in age-specific incidence rates over time. The age-specific incidence rate for females showed a clear bimodal pattern with a peak incidence between the 1 to 9 years and the 15 to 19 years age groups (Fig 5A). For males, a tapering of the age-specific rate for the 15 to 19 years age group was observed (Fig 5B). Comparison between the two figures shows that the incidence rate of tonsillectomy in males was consistently higher than that of females for the ages from 1 to 9 years. This relationship is reversed for the population aged between 10 to 24 years with the incidence rate for females exceeding males.

thumbnail
Fig 5. Age-specific incidence of tonsillectomy procedures for males and females, 2000–01 to 2019–20.

https://doi.org/10.1371/journal.pone.0273320.g005

Age-specific incidence rate averaged over 5-year periods from 2000–01 to 2019–20 for females (A) and males (B). Rate expressed in procedures per 100,000 person-years. Data obtained from the National Hospital Morbidity Database.

Discussion

Using data from the NHMD, we have conducted a national population-based analysis on the rates of PTH in tonsillectomy in Australia. Our study has found that over the past 20 years, the rate of PTH has essentially remained unchanged whilst the incidence of tonsillectomy procedures has substantially increased. This increase in tonsillectomy procedures has been predominantly driven by the increase incidence of paediatric tonsillectomies.

Reference PTH rates

PTH rates that are widely considered as benchmarks rates had been derived either from national database studies [1416, 1924], large prospective cohort studies [25, 26] or national surgery quality registers, conducted in various countries [27, 28]. For comparative purposes, only studies that have reported PTH rates defined by severe haemorrhage episodes that required the return to theatre are listed in Table 4.

thumbnail
Table 4. Summary of population studies in the literature with reported post-tonsillectomy haemorrhage rates defined by rates of return to theatre.

https://doi.org/10.1371/journal.pone.0273320.t004

The foremost study that provided an account on the PTH rates on a nation-wide scale was the National Prospective Tonsillectomy Audit (NPTA) conducted in the UK (England and North Ireland) between 2003 and 2004 which consisted of 33,921 patients [25]. The NPTA study relied on information supplied by participating hospital units and voluntary consenting patients. One of the main findings of the NPTA was that hot surgical techniques that involve the use electrocautery, bipolar diathermy, Coblation or other thermal welding surgical were associated with a statistically higher risk of PTH than cold steel techniques. This finding resulted in the release of the interim national guidance in the UK on tonsillectomy by the British Association of Otorhinolaryngology Head and Neck Surgery (BAO-HNS) that cautioned the use of hot techniques for tonsillectomy. The study found an overall return to theatre rate of 1.0% and 0.9% before and after the release of the National guidance respectively. The NPTA investigators acknowledged in their report that their rates of PTH requiring the return to theatre were in fact under-estimated by up to fifty percent based on their comparison with the analysis of national hospital data from the UK’s Hospital Episodes Statistics (HES) database. Possible causes include reduced data quality due to the potential of bias reporting from the incomplete capturing of PTH episodes for the NPTA study. After taking the under-estimation into account, these guidance rates in the UK are comparable to the overall PTH rate we have calculated using our Australian data.

There are nuances in care practices by individual clinicians and hospital units between different countries, such as differences in the philosophies and processes of care surrounding tonsillectomy as well as the management of PTH. For example, the PTH rates as measured by return to theatre reported by studies conducted in Germany and Austria are some of the highest in the literature [22, 26]. The higher rates may reflect a more conservative approach to managing risks following tonsillectomy, which is demonstrated by their avoidance of outpatient or ambulatory tonsillectomies and their routine practice of several nights of hospital stays following tonsillectomy procedures [26, 29]. The higher rates in these countries may therefore be explained by a lower clinical threshold for re-operations due to PTH, rather than by reason of significant differences in the risk profile of their patient population or other factors such as choice of surgical techniques.

Time-trend of PTH rate in Australia

This study also revealed that despite a stable annual rate of PTH for all ages over the 20-year period, there was a small but statistically significant trend increase in the incidence of PTH among adult patients.

We have used the non-parametric Spearman’s rank correlation test in our study to avoid the violation of statistical assumptions that are required for the use of higher-power statistical analysis models. Firstly, PTH rates are discrete epidemiological events that do not follow a normal distribution [30]. Secondly, in time-trends analysis, the consecutive time periods (year) are the predictor variable such that the PTH rate of one year may have correlations to the PTH rate in a following year. These correlations between consecutive years would violate the statistical assumption of independence that are required for the use of regression model for time-trend analyses [31].

This time-trend finding has real-world implications on patient outcomes concerning tonsillectomies. The statistically significant increase in the PTH rate for adults can be interpreted as an indicator of a decreased quality of care associated with adult tonsillectomy procedures. For example, the difference in PTH rate for adults between 2000–01 and 2019–20 was 0.6% which equates to 94 adult patients (0.6% x 15,672 adult tonsillectomies) encountering a return to theatre for PTH based on the number of adult tonsillectomies performed in 2019–20.

In contrast, an increasing trend in the rate of PTH in paediatric tonsillectomy was not detected by the time-trend analysis. One possible reason for the stability in the annual paediatric PTH rate may be due to an offset of any increasing trend in PTH rates by an increased adoption of tonsillotomy procedures over time. Tonsillotomy or partial intracapsular tonsillectomy is an alternative surgical procedure to conventional tonsillectomy for the treatment of paediatric obstructive sleep disordered breathing [32]. It has been shown to improve patient outcomes in terms of reducing post-operative pain [33], as well as having a reduced rate of post-operative haemorrhage compared to tonsillectomy [28, 33]. In some countries such as Sweden, the number of paediatric tonsillotomy procedures has increased significantly over time and currently outnumbers tonsillectomy procedures [34].

Unfortunately, we are unable to evaluate or estimate the influence of tonsillotomy procedures on paediatric rates of PTH as our study data does not differentiate tonsillotomy from tonsillectomy procedures. The incidence of tonsillotomy procedures in Australia is currently unknown.

There are other potential factors that may influence the national trend in PTH rates for both adult and paediatric tonsillectomies over time. Since the initial finding by the NPTA study, surgical techniques have been a subject of much investigation. The available evidence that supports the use of cold techniques (both for dissection and for haemostasis) over hot techniques to reduce PTH rates has been supported by other large perspective cohort studies, quality registers and large population studies [15, 26, 27, 35]. A study published in 2020 using data from the National Tonsil Surgery Register in Sweden (NTSRS) suggested that the recognition of the increased risk of PTH with the use of hot techniques has resulted in the subsequent stabilising of the national PTH rate in Sweden [35]. Furthermore, the association of cold techniques with lower rates of PTH has also been supported by the outcomes of quality improvement projects conducted in Sweden that specifically promoted the increased practice of cold techniques [36]. The increasing PTH rates in adult tonsillectomy in Australia may be explained by the preference in surgical techniques. In Australia, a survey study conducted in 2005 found that the hot technique of monopolar diathermy has been the preferred technique for tonsillectomy [37]. It is unknown how this practice has changed since the study, but the use of the other hot technique Coblation (also known as radiofrequency ablation) has been increasingly mentioned in Australian studies [10, 38, 39]. Whilst advocates of the use of Coblation offers less post-operative pain and faster return to normal diet following surgery, a systematic review has showed there is currently a lack of quality evidence to support these claims [40].

Another explanation for Australia’s PTH rates for adults may be a potential change in the risk-profile of PTH in patients over time. This may occur as a result of clinicians becoming more stringent with the indication criteria for tonsillectomy, as suggested by Milner et al. as a conceivable reason for an increase in national rates of PTH over time as observed in Scotland [23]. The joint position paper released in July 2008 by the Royal Australasian College of Physicians and The Australian Society of Otolaryngology Head and Neck Surgery provided a national guideline on the indications for tonsillectomy and adenotonsillectomy [41]. The implementation of this guideline corresponded with a subsequent marked increase in the incidence of paediatric tonsillectomy for the treatment of paediatric obstructive sleep apnoea, which suggests that the guideline was widely adopted by the Australian medical community. The guideline may also likely to have triggered more clinicians conforming with the criteria outlined by Paradise et al. for the performance of tonsillectomy for the treatment of recurrent acute tonsillitis [42]. This may have led to a higher proportion of patients meeting the stricter definition of recurrent or chronic tonsillitis, which in turn increases the overall risk and rate of PTH or the entire tonsillectomy patient cohort.

Association of PTH with age and gender

This study extends the insight into the age-gender risk relationship of PTH reported in other large population studies [15, 16, 22]. Our study results show that the risk of PTH increased from age of one and plateaued beyond the age of 14 in females whilst the risk continued to increase sharply until the ages of 20 to 24 years for males. This indicates that increasing age is directly associated with the increased risk of PTH, with male patients in the 20 to 24 years age group having the highest risk of PTH. Although our datasets did not include information on the underlying indications for each tonsillectomy procedure, the higher rates of PTH in males were likely independent of the known association of infectious indications with higher rates of PTH. This is supported by studies that have shown that women are more likely than men to require tonsillectomy as treatment for chronic tonsillitis [43, 44]. In addition, our results show that for persons aged 15 to 24 years, more tonsillectomy procedures were performed in females than in males despite males having two to two and a half times the risk of PTH than females.

Tomkinson et al. [16] have suggested a possible association between the increased risk of PTH and puberty. This relationship is supported by our results and in particular the relationship between the risk of PTH and male puberty, suggesting male sex hormone testosterone may be associated with the risk of PTH. This link between PTH and testosterone may be due to the effects of circulating testosterone levels on the modulation of oropharyngeal tissue healing and mucosal re-epithelialisation that follow tonsillectomy. Experiments on oral mucosa in human subjects have shown that lower circulating testosterone levels were related to the faster healing of oral mucosal wounds in both young men and women [45]. This study also showed a significant difference in both the rate and temporal pattern of mucosal healing between younger and older men but not between younger and older women [45].

Using this age and gender relationship of PTH, we were able to analyse the odds of PTH based on age and gender. We found that in general, adult males (aged 15 years and over) had 4 times the odds of bleeding compared to persons in the paediatric age group (aged 1 to 14 years) and twice the odds of bleeding compared to adult females.

Epidemiology of tonsillectomy in Australia

The observed increase in tonsillectomy procedures in Australia over time was shown to be mainly due to the increased incidence of paediatric adenotonsillectomy. Although our data does not contain information on the indications for each tonsillectomy procedure, this finding most likely reflects the growing recognition within the Australian medical community during the study period of the morbidity of obstructive sleep disordered breathing and obstructive sleep apnoea in children [41, 46].

Our results also showed that the number of tonsillectomy procedures in Australia plateaued in 2016–17 followed by a slight downward trend. The reason behind this is unclear, but the notable decrease in the incidence rate in 2019–2020 is most likely a result of the restrictions and suspensions on elective surgery that were initiated by the Australian government in response to the COVID-19 pandemic [47].

The tonsillectomy procedure count used in our study included tonsillectomies that were performed as part of UPPP surgery for obstructive sleep disordered breathing. Tonsillectomy with UPPP procedures were included in our study to provide a more complete representation of the haemorrhage rates following all forms of tonsillectomy procedures. The results show that tonsillectomy with UPPP represented only 2% of the total tonsillectomy procedures and therefore their inclusion does not statistically affect the estimation of our PTH rate calculations. Patients who undergo tonsillectomy with UPPP should be at no lesser or greater risk of developing PTH but tonsillectomy involving palate procedures are often excluded from studies examining PTH rates [48], possibly due to concern of palate procedures affecting the risk of PTH. There is a paucity of studies examining the PTH rates between UPPP alone and UPPP with tonsillectomy. However, data from two studies that allowed the comparison of PTH rates between tonsillectomy with or without UPPP showed the rate of PTH between these two procedures to be comparable and were not statistically different [49, 50].

Another finding from our study is a steady rise in the number of day-stay tonsillectomy cases in Australia over the last 20 years. Tonsillectomy performed as day-stay or ambulatory surgery in Australia has risen continuously from 2.7% in 2000–01 to 14.2% in 2019–20. Day-stay tonsillectomy, in itself, has not been found to be a risk factor for tonsillectomy and a Swedish study using data from the NTSRS showed that patients who had met the criteria for day-stay surgery have a lower risk of PTH [51]. A meta-analysis of 16 studies have also suggested overnight tonsillectomy conferred minimal benefit for patients in terms of PTH, with an estimate of only 1 of 14 episodes of primary haemorrhages noted to occur between 8 and 24 hours of surgery [52]. With the growing recognition of the safety of day-stay tonsillectomy, the practice of day-stay tonsillectomy has been increasingly adopted by some countries. In Sweden, day-stay has over time become the preferred care type for tonsillectomy [14]. Similarly, day-stay tonsillectomy, and in particular paediatric tonsillectomy, has also increased in the UK. Since 2008, an average of 46% of paediatric tonsillectomies in the UK were day-stay cases [24]. Conversely, in countries such as Germany and Taiwan, while the trends in the practice of day-stay tonsillectomy is unclear, in-patient surgery has remained the preferred treatment care type for tonsillectomy cases [19, 21].

Strengths and limitations

This study utilised national hospital data covering a period of 20-years from the 1 July 2000 to 30 June 2020. The data derived from the NHMD enabled a high degree of data coherency, transparency and consistency for estimating a PTH reference rate for the Australian population. Further, as the data captures all tonsillectomy practices irrespective of clinicians or institutions, the findings in this study are generalisable and comparable for use by hospital unit and clinicians throughout Australia. Given that the source of our data is from the public domain, our results can be re-validated and continuously updated over time, without the need for additional resources and costs involved in data collection.

Nonetheless, there are known limitations in the use of national administrative health databases for epidemiological research including concerns over data completeness and data accuracy [53]. Under the provisions of the NHIA, health authorities of each State and Territory are responsible for the quality and completeness of the data they contribute to the NHMD. According to the AIHW Data Quality Statement, in order to maintain and continually improve data quality, the AIHW undertakes extensive validations on receipt of data and cross checks the data with other datasets where possible [17]. Systematic coding and reporting errors can also affect data quality and lead to errors in the estimation of rates. However, these are likely to be rare occurrences and therefore should not significantly affect the results of our study.

Another limitation of our study is the inability to distinguish between primary and secondary PTH that are frequently reported in other PTH studies. However, we believe a return to theatre rate regardless of its primary or secondary nature provides a more universal indicator of the safety of tonsillectomy and is more suitable for use as a reference PTH rate. Further data-linkage projects using the existing NHMD datasets can help determine those return to theatre procedures that are involved in secondary PTH episodes. Another drawback of using administrative database for clinical research is the limited depth of clinical information available for analysis. An expanded NHMD datasets available through requests to the AIHW can be customised to include additional variables of interest. This would allow the analysis of other patient outcome parameters related to PTH such as the rates of blood transfusion and unplanned intensive care admissions as well as the mortality rates associated with PTH.

Additionally, the code that is used to identify return to theatre episodes for PTH (ACHI code 41797–00) is also used invariably for coding haemorrhage following adenoidectomy. However, haemorrhage following adenoidectomy that is sufficiently severe to require the return to theatre is relatively uncommon and has been estimated by a UK study to occur in 0.5% of adenoidectomy cases [54]. Adjusting for rates of adenoidectomy haemorrhage in adenotonsillectomy procedures would have the effect of correcting an over-estimation of the PTH reported in our study for the paediatric age group, and to a lesser degree, correcting an over-estimation of the overall PTH rate (i.e., for all ages) given adenoidectomy is an uncommon procedure among adults [55]. Further, patients that required multiple return to theatre for PTH were not identifiable from the NHMD datasets. There are no reports of the rate of multiple returns to theatre from Australian studies to estimate the size of this confounding factor. Correction for this factor would also lower our estimated rate of PTH.

Conclusions

Using national hospital data, our study estimated the overall PTH rate, and more importantly, the age and gender-specific rates of PTH in Australia. These rates are defined by PTH episodes that required the need to return to theatre. Adult males (aged 15 years and over) had four times the risk of PTH compared to children (aged 1 to 14 years) and twice the risk compared to adult females. Our proposed national reference rates for PTH are generalisable for use by surgical audits and tonsillectomy quality assurance projects across Australia. The age and gender weighted PTH rates can be used during informed consent discussions and facilitate a more tailored explanation of PTH risks to individual patients. Our study also showed that the time-trend in the overall annual rates of PTH in Australia has been stable over the past two decades. Nevertheless, our findings indicate that the morbidity of tonsillectomy in Australia from a haemorrhage perspective has not improved over the study period as the annual rates of PTH for adult patients (aged over 15 years and over) have increased whilst the overall rates of PTH for all ages have not reduced over time. All clinicians should be mindful of the greater risk of PTH that is inherently present among male youths and young adults. Further large-multicentre studies or the adoption of a national tonsillectomy surgery register may help cross-validate our study findings and may provide continual improvements to the safety and quality of tonsillectomy procedures.

Supporting information

S1 Table. Annual rates of post-tonsillectomy haemorrhage in Australia, 2000–01 to 2019–20.

Data obtained from the National Hospital Morbidity Database for the period 1 July 2000 to 30 June 2020. PTH = post-tonsillectomy haemorrhage; CI = confidence interval; SD = standard deviation. Annual data are presented as absolute number of episodes of PTH and tonsillectomy procedures. PTH defined by re-operations for haemostasis. Annual PTH rates are calculated by dividing the number of PTH with the number of tonsillectomy procedures. The annual mean and standard deviation were calculated for the entire study period.

https://doi.org/10.1371/journal.pone.0273320.s001

(DOCX)

S2 Table. Comparison of age-specific post-tonsillectomy haemorrhage rates between age groups for each gender.

Data obtained from the National Hospital Morbidity Database for the period 1 July 2000 to 30 June 2020. PTH = post-tonsillectomy haemorrhage; CI = confidence interval. *P < 0.0001.

https://doi.org/10.1371/journal.pone.0273320.s002

(DOCX)

S3 Table. Characteristics of tonsillectomy procedures in Australia.

Data obtained from the National Hospital Morbidity Database for the period 1 July 2000 to 30 June 2020. Data are presented as n (%). Total number of tonsillectomy procedures was calculated by the sum of tonsillectomy procedure codes. ACHI = The Australian Classification of Health Interventions; UPPP = Uvulopharyngopalatoplasty.

https://doi.org/10.1371/journal.pone.0273320.s003

(DOCX)

S4 Table. Annual incidence of tonsillectomy procedures in Australia, 2000–01 to 2019–20.

Population data are the mid-year estimated resident population sourced from the Australian Bureau of Statistics (ABS). Absolute tonsillectomy procedure counts are obtained from the National Hospital Morbidity Database for the period 1 July 2000 to 30 June 2020. 95% confidence intervals for incidence rates are estimated using the Poisson regression model.

https://doi.org/10.1371/journal.pone.0273320.s004

(DOCX)

Acknowledgments

We wish to acknowledge the Australian Institute of Health and Welfare for data from the National Hospital Morbidity Database.

References

  1. 1. Procedure data cubes: web report. Australian Institute of Health and Welfare. [cited 2022 April 4]. Available from: https://www.aihw.gov.au/reports/hospitals/procedures-data-cubes/contents/data-cubes
  2. 2. Windfuhr JP, Schloendorff G, Baburi D, Kremer B. Life‐Threatening Posttonsillectomy Hemorrhage. Laryngoscope. 2008;118: 1389–1394. pmid:18496156
  3. 3. Østvoll E, Sunnergren O, Ericsson E, Hemlin C, Hultcrantz E, Odhagen E, et al. Mortality after tonsil surgery, a population study, covering eight years and 82,527 operations in Sweden. Eur Arch Oto-rhino-l. 2015;272: 737–743. pmid:25274044
  4. 4. Mitchell RB, Archer SM, Ishman SL, Rosenfeld RM, Coles S, Finestone SA, et al. Clinical Practice Guideline: Tonsillectomy in Children (Update). Otolaryngology Head Neck Surg. 2018;160: S1–S42. pmid:30798778
  5. 5. O’Leary S, Vorrath J. Postoperative Bleeding after Diathermy and Dissection Tonsillectomy. Laryngoscope. 2005;115: 591–594. pmid:15805865
  6. 6. Walker P, Gillies D. Post-tonsillectomy hemorrhage rates: Are they technique-dependent? Otolaryngology—Head Neck Surg. 2007;136: S27–S31. pmid:17398338
  7. 7. Cadd B, Rogers M, Patel H, Crossland G. (Ton)silly seasons? Do atmospheric conditions actually affect post-tonsillectomy secondary haemorrhage rates? J Laryngology Otology. 2015;129: 702–705. pmid:26044296
  8. 8. Hinton-Bayre AD, Noonan K, Ling S, Vijayasekaran S. Experience is more important than technology in paediatric post-tonsillectomy bleeding. J Laryngology X0026 Otology. 2017;131: S35–S40. pmid:28393742
  9. 9. Morris S, Hassin E, Borschmann M. Overnight in-hospital observation following tonsillectomy: retrospective study of post-operative intervention. J Laryngology X0026 Otology. 2018;132: 46–52. pmid:29103384
  10. 10. Kwok MM, Subramaniyan M, Rimmer J, Karahalios A. Post-tonsillectomy haemorrhage in Australia—a multivariable analysis of risk factors. Australian J Otolaryngology. 2018;1: 2–2.
  11. 11. Jones A, Grant A, Saputra L, Lathif A, Krishan B. Tonsillectomy in regional Australia: management and outcomes. Australian J Otolaryngology. 2021;4: 41–41.
  12. 12. Lowe D, Meulen J van der. National Prospective Tonsillectomy Audit. Bulletin Royal Coll Surg Engl. 2003;85: 352–353.
  13. 13. Evans AS, Khan AM, Young D, Adamson R. Assessment of secondary haemorrhage rates following adult tonsillectomy–a telephone survey and literature review. Clin Otolaryngology Allied Sci. 2003;28: 489–491. pmid:14616663
  14. 14. Østvoll E, Sunnergren O, Stalfors J. Increasing Readmission Rates for Hemorrhage after Tonsil Surgery: A Longitudinal (26 Years) National Study. Otolaryngology Head Neck Surg. 2017;158: 167–176. pmid:28828912
  15. 15. Tomkinson A, Harrison W, Owens D, Harris S, McClure V, Temple M. Risk factors for postoperative hemorrhage following tonsillectomy. Laryngoscope. 2011;121: 279–288. pmid:21271574
  16. 16. Tomkinson A, Martin SD, Gilchrist CR, Temple M. Instrumentation and patient characteristics that influence postoperative haemorrhage rates following tonsil and adenoid surgery. Clin Otolaryngol. 2005;30: 338–346. pmid:16209676
  17. 17. Data quality statement: Admitted Patient Care 2017–18. Australian Institute of Health and Welfare. [cited 2022 April 4]. Available from: https://meteor.aihw.gov.au/content/index.phtml/itemId/724188.pdf
  18. 18. National, state and territory population, June 2021. Australian Bureau of Statistics. [cited 2022 April 4]. Available from: https://www.abs.gov.au/statistics/people/population/national-state-and-territory-population/latest-release
  19. 19. Mueller J, Boeger D, Buentzel J, Esser D, Hoffmann K, Jecker P, et al. Population-based analysis of tonsil surgery and postoperative hemorrhage. Eur Arch Oto-rhino-l. 2015;272: 3769–3777. pmid:25502742
  20. 20. Hsueh W-Y, Hsu W-C, Ko J-Y, Yeh T-H, Lee C-H, Kang K-T. Population-based survey of inpatient pediatric tonsillectomy and postoperative hemorrhage in Taiwan, 1997–2012. Int J Pediatr Otorhi. 2018;108: 55–62. pmid:29605366
  21. 21. Hsueh W-Y, Hsu W-C, Ko J-Y, Yeh T-H, Lee C-H, Kang K-T. Postoperative hemorrhage following tonsillectomy in adults: Analysis of population-based inpatient cohort in Taiwan. Auris Nasus Larynx. 2019;46: 397–406. pmid:30392979
  22. 22. Windfuhr JP, Chen Y-S. Do changing trends in tonsil surgery affect hemorrhage rates? A longitudinal study covering 1,452,637 procedures. Eur Arch Oto-rhino-l. 2019;276: 2585–2593. pmid:31256244
  23. 23. Milner TD, Hilmi O, Marshall J, MacKenzie K. Pan‐Scotland tonsillectomy outcomes: A national cross‐sectional study. Clin Otolaryngol. 2021;46: 138–145. pmid:32686267
  24. 24. Keltie K, Donne A, Daniel M, Stephenson K, Wyatt M, Kuo M, et al. Paediatric tonsillectomy in England: A cohort study of clinical practice and outcomes using Hospital Episode Statistics data (2008‐2019). Clin Otolaryngol. 2021;46: 552–561. pmid:33377276
  25. 25. Lowe D, Meulen J van der, Cromwell D, Lewsey J, Copley L, Browne J, et al. Key Messages From the National Prospective Tonsillectomy Audit. Laryngoscope. 2007;117: 717–724. pmid:17415144
  26. 26. Sarny S, Ossimitz G, Habermann W, Stammberger H. Hemorrhage following tonsil surgery: A multicenter prospective study. Laryngoscope. 2011;121: 2553–2560. pmid:22109752
  27. 27. Söderman A ‐C. H, Odhagen E, Ericsson E, Hemlin C, Hultcrantz E, Sunnergren O, et al. Post‐tonsillectomy haemorrhage rates are related to technique for dissection and for haemostasis. An analysis of 15734 patients in the National Tonsil Surgery Register in Sweden. Clin Otolaryngol. 2015;40: 248–254. pmid:25515059
  28. 28. Hallenstål N, Sunnergren O, Ericsson E, Hemlin C, Söderman A-CH, Nerfeldt P, et al. Tonsil surgery in Sweden 2013–2015. Indications, surgical methods and patient-reported outcomes from the National Tonsil Surgery Register. Acta Oto-laryngol. 2017;137: 1–8. pmid:28598766
  29. 29. Windfuhr JP, Chen YS, Remmert S. Hemorrhage following tonsillectomy and adenoidectomy in 15,218 patients. Otolaryngology Head Neck Surg. 2005;132: 281–286. pmid:15692542
  30. 30. Blakley BW. Post-tonsillectomy bleeding: How much is too much? Otolaryngology Head Neck Surg. 2008;140: 288–290. pmid:19248930
  31. 31. Birnbaum D, Ely JW, Dawson JD, Lemke JH, Rosenberg J. An Introduction to Time-Trend Analysis. Infect Control. 1997;18: 267–274.
  32. 32. Koempel JA, Solares CA, Koltai PJ. The evolution of tonsil surgery and rethinking the surgical approach to obstructive sleep-disordered breathing in children. J Laryngology Otology. 2006;120: 993–1000. pmid:16923328
  33. 33. Wood JM, Cho M, Carney AS. Role of subtotal tonsillectomy (‘tonsillotomy’) in children with sleep disordered breathing. J Laryngology Otology. 2014;128: S3–S7. pmid:24280113
  34. 34. Borgström A, Nerfeldt P, Friberg D, Sunnergren O, Stalfors J. Trends and changes in paediatric tonsil surgery in Sweden 1987–2013: a population-based cohort study. Bmj Open. 2017;7: e013346. pmid:28087550
  35. 35. Lundström F, Stalfors J, Østvoll E, Sunnergren O. Practice, complications and outcome in Swedish tonsil surgery 2009–2018. An observational longitudinal national cohort study. Acta Oto-laryngol. 2020;140: 1–8. pmid:32436799
  36. 36. Odhagen E, Sunnergren O, Söderman A-CH, Thor J, Stalfors J. Reducing post-tonsillectomy haemorrhage rates through a quality improvement project using a Swedish National quality register: a case study. Eur Arch Oto-rhino-l. 2018;275: 1631–1639. pmid:29574597
  37. 37. MacFarlane PL, Nasser S, Coman WB, Kiss G, Harris PK, Carney AS. Tonsillectomy in Australia: An audit of surgical technique and postoperative care. Otolaryngology—Head Neck Surg. 2008;139: 109–114.e3. pmid:18585571
  38. 38. Carney AS, Harris PK, MacFarlane PL, Nasser S, Esterman A. The coblation tonsillectomy learning curve. Otolaryngology—Head Neck Surg. 2008;138: 149–152. pmid:18241706
  39. 39. Dharmawardana N, Chandran D, Elias A, Kao SS-T, Ooi EH. Management of post tonsillectomy secondary haemorrhage: Flinders experience. Australian J Otolaryngology. 2018;1: 31–31.
  40. 40. Pynnonen M, Brinkmeier JV, Thorne MC, Chong LY, Burton MJ. Coblation versus other surgical techniques for tonsillectomy. Cochrane Db Syst Rev. 2017;2017: CD004619. pmid:28828761
  41. 41. Indications for tonsillectomy and adenotonsillectomy in children. A joint Position paper of the Paediatrics & Child Health Division of The Royal Australasian College of Physicians and The Australian Society of Otolaryngology Head and Neck Surgery. July 2008. [cited 2022 April 4]. Available from: https://www.kidshealth.org.nz/sites/kidshealth/files/pdfs/Final_approved_Tonsillectomy_document-3.pdf
  42. 42. Paradise JL, Bluestone CD, Bachman RZ, Colborn DK, Bernard BS, Taylor FH, et al. Efficacy of Tonsillectomy for Recurrent Throat Infection in Severely Affected Children—Results of Parallel Randomized and Nonrandomized Clinical Trials. New Engl J Medicine. 1984;310: 674–683. pmid:6700642
  43. 43. Chen MM, Roman SA, Sosa JA, Judson BL. Safety of Adult Tonsillectomy: A Population-Level Analysis of 5968 Patients. Jama Otolaryngology Head Neck Surg. 2014;140: 197–202. pmid:24481159
  44. 44. Coordes A, Soudry J, Hofmann VM, Lenarz M. Gender-specific risk factors in post-tonsillectomy hemorrhage. Eur Arch Oto-rhino-l. 2016;273: 4535–4541. pmid:27328963
  45. 45. Engeland CG, Sabzehei B, Marucha PT. Sex hormones and mucosal wound healing. Brain Behav Immun. 2009;23: 629–635. pmid:19111925
  46. 46. Lumeng JC, Chervin RD. Epidemiology of Pediatric Obstructive Sleep Apnea. Proc Am Thorac Soc. 2008;5: 242–252. pmid:18250218
  47. 47. Elective surgery activity. Admissions, by intended procedure, state and territories 2016–17 to 2020–21. Australian Institute of Health and Welfare. [cited 2022 April 4]. Available from: https://www.aihw.gov.au/reports-data/myhospitals/intersection/activity/eswt
  48. 48. Wei JL, Beatty CW, Gustafson RO. Evaluation of posttonsillectomy hemorrhage and risk factors. Otolaryngology—Head Neck Surg. 2000;123: 229–235. pmid:10964296
  49. 49. Creighton FX, Bhattacharyya N. Does septoplasty performed at the same time as oropharyngeal surgery increase complication rates? Laryngoscope. 2015;125: 2828–2831. pmid:26297935
  50. 50. Adams MTA, Wilhelm MJ, Demars SM, Harsha WJ. Effects of Synchronous Nasal Surgery on Posttonsillectomy Hemorrhage. Archives Otolaryngology Head Neck Surg. 2009;135: 936–939. pmid:19770429
  51. 51. Söderman AH, Ericsson E, Hemlin C, Hultcrantz E, Månsson I, Roos K, et al. Reduced risk of primary postoperative hemorrhage after tonsil surgery in Sweden: Results from the national tonsil surgery register in Sweden covering more than 10 years and 54,696 operations. Laryngoscope. 2011;121: 2322–2326. pmid:21994191
  52. 52. Bennett AMD, Clark AB, Bath AP, Montgomery PQ. Meta‐analysis of the timing of haemorrhage after tonsillectomy: an important factor in determining the safety of performing tonsillectomy as a day case procedure. Clin Otolaryngol. 2005;30: 418–423. pmid:16232245
  53. 53. Liu C, Talaei-Khoei A, Zowghi D, Daniel J. Data completeness in healthcare: a literature survey. Pacific Asia Journal of the Association for Information Systems. 2017;9(2):5.
  54. 54. Tomkinson A, Harrison W, Owens D, Fishpool S, Temple M. Postoperative hemorrhage following adenoidectomy. Laryngoscope. 2012;122: 1246–1253. pmid:22522935
  55. 55. Bhamra N, Osborne MS, Balai E, Jolly K, Barraclough J. Prevalence of Patients Who Return to Theatre Post-Adenoidectomy: A Review of Hospital Episode Statistics Data (2012–2019). Cureus. 2021;13: e13980. pmid:33880306