https://orcid.org/0000-0003-0506-0398
Figures
Abstract
Background
Maxillary protraction with or without expansion is a widely known orthopedic treatment modality in growing skeletal Class III patients. However, limited data are available regarding the outcomes of long-term changes in the maxilla. Aim of this meta-analysis was to assess the effectiveness of the long-term maxillary anteroposterior changes following a facemask therapy with or without rapid maxillary expansion in growing skeletal Class III patients.
Methods
A comprehensive literature search was conducted using the databases of PubMed, Science Direct, Web of Science, and Embase. Randomized controlled trials and cohort studies, published up to Sep. 2020, with maxillary protraction and/or expansion as keywords were included in this meta-analysis. Risk of bias within and across studies were assessed using the Cochrane tools (RoB2.0 and ROBINS-I) and GRADE approach. Overall and subgroup comparisons with the random-effect model were performed in this meta-analysis. Meta-regression models were designed to determine potential heterogeneity.
Results
There was a statistically significant increase (Mean difference, 2.29°; 95% confidence interval, 1.86–2.73; and p < 0.001 after facemask (FM) protraction. Mean difference, 1.73°; 95% confidence interval, 1.36–2.11; and p < 0.001 after rapid maxillary expansion(RME) and facemask protraction) in the Sella-Nasion-A point (SNA) angle in the treatment groups as compared with the control groups, when measured during the less than 3-year follow-up period. However, no statistically significant changes (Mean difference, 0.28°; 95% confidence interval, -0.57–1.13; and p = 0.52 after facemask protraction. Mean difference, 0.34°; 95% confidence interval, -0.64–1.33; and p = 0.50 after rapid maxillary expansion and facemask protraction) were observed in the SNA angle in the groups, when measured after 3 years of follow-up. Meta-regression analysis also showed that with increased follow-up duration, the effectiveness of maxillary protraction decreased.
Conclusion
This meta-analysis revealed that maxillary protraction therapy could be effective for a short-term in correcting maxillary hypoplasia and the treatment result was not affected by mean age and sex. However, with increased follow-up duration, the sagittal maxillary changes gradually decreased. Limitations on this review were only the SNA angle was used and clinical heterogeneity was not discussed. The quality of evidence was moderate. Further long-term observational studies are necessary for a comprehensive evaluation of the effects on maxillary skeletal changes.
Citation: Lee W-C, Shieh Y-S, Liao Y-F, Lee C-H, Huang CS (2021) Long-term maxillary anteroposterior changes following maxillary protraction with or without expansion: A meta-analysis and meta-regression. PLoS ONE 16(2): e0247027. https://doi.org/10.1371/journal.pone.0247027
Editor: Claudia Trindade Mattos, Universidade Federal Fluminense, BRAZIL
Received: April 24, 2020; Accepted: January 29, 2021; Published: February 22, 2021
Copyright: © 2021 Lee et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the manuscript and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The prevalence of skeletal class III malocclusion varies in different populations. Based on some studies, the prevalence of Class III malocclusion is approximately 1% to 5% in white populations and around 9% to 19% in Asian populations [1, 2]. In skeletal Class III malocclusion, the etiology is multifactorial including genetic inheritance, ethnic, environmental and habitual components [3] and genetic is the main etiology of skeletal Class III malocclusion [4]. According to surveys, 75% of skeletal Class III malocclusions are associated with maxillary retrognathism or a combination of maxillary retrognathism and mandibular prognathism [5]. In addition, nearly 30 to 40% of patients display some degree of maxillary deficiency [6]. Several studies also claimed that maxillary retrognathism is the most common contributing component of Class III characteristics [3, 7]. Thus, using maxillary protraction devices to enhance maxillary growth become more important [3, 7]. Furthermore, early treatment of growing patients with skeletal CIII malocclusion could provide them higher quality of life and make them more confident throughout the years they are most vulnerable by how they look like [8, 9]. Growing patients with skeletal Class III midfacial hypoplasia have been treated satisfactorily by orthopedic treatment of maxillary protraction with or without maxillary expansion [10–15]. In the past few years, facemask (FM) and rapid maxillary expansion (RME) were combined as a treatment modality for improving the maxillary transverse and midface deficiency. Another treatment option introduced was alternate rapid maxillary expansion and constriction, to open the circummaxillary sutures before maxillary protraction [16]. Furthermore, bone-anchored maxillary protraction is another recently developed method to enhance the therapeutic influence on midface deficiency [13, 17–20]. The correction of skeletal Class III malocclusion is challenging in orthodontics due to the unpredictable growth potential of the maxilla and potentially unfavorable mandibular growth.
Application of the FM protraction therapy in growing children with skeletal CIass III malocclusion is considered as a feasible treatment option for maxillary advancement [14, 15, 21]. The FM treatment has also been advised during the early orthopedic treatment of Class III malocclusion with maxillary deficiency [10, 22]. However, in the long-term observational studies, the results were inconsistent [23, 24] and the skeletal effect on the reinforcement of maxillary growth over time from the traditional methods has been debated, and remains controversial. Statistically significant maxillary changes were observed after FM with or without RME treatment in some studies [13, 17, 21, 25, 26]. In contrast, limited or no significant evidence was observed in others [12, 14, 22, 27]. The major limitations among these studies were the lack of long-term follow-up [11, 13, 17, 23, 25, 28], absence of untreated control groups [29–31], and differences in the follow-up durations or treatment timing among studies [23, 32–34].
Even though several studies evaluating maxillary anteroposterior effects following maxillary protraction have been reported, most are conflicting results and still uncertain. Therefore, we systematically searched and analyzed the available literature for the advancement of scientific knowledge and clinical decision making. The purpose of this study was to evaluate the long-term maxillary anteroposterior changes following FM treatment with or without RME in growing skeletal Class III patients when compared to that in the untreated control group through meta-analysis and meta-regression.
Materials and methods
Preferred Reporting Items for Systematic Reviews and Meta Analyses (PRISMA) [35] guidelines was adhered to perform systematic reviews and meta-analyses. This review protocol was also registered with the Open Science Framework platform (protocol available at osf.io/39kfs).
Search strategy
Studies that described growing patients with skeletal Class III midfacial hypoplasia who received orthopedic treatment of maxillary protraction with or without expansion were included. Further, the skeletal changes after orthopedic treatment with FM or FM+RME were assessed and compared to that of the untreated control groups.
This meta-analysis aimed to determine whether any maxillary anteroposterior changes exist in those who need maxillary protraction with or without expansion. Four electronic databases, namely PubMed, Science Direct, Embase, and Web of Science, were searched to identify studies. This search included “maxilla constriction” or “midfacial deficiency” or “maxillary retrognathism” or “Class III malocclusion” AND “maxillary protraction” or “FM” or “facemask” or “reverse headgear” or “rapid maxillary expansion” or “maxillary expansion” or “RME” or”early treatment” or “orthopedic” AND “children/adolescence” or “growing” or “growth” AND "randomized controlled trial" or "randomized" or “randomly” or "RCT" or "cohort study" or "cohort" or "prospective" or "retrospective" or “controlled clinical trial”. A detailed description of the search strategy applied to PubMed is provided in Table 1. In the extracted studies, references were evaluated to meet the following inclusion and exclusion criteria. Additionally, a manual search was carried out through the reference lists of the finally included articles, and the relevant systematic reviews and orthodontic journals not indexed in database.
Inclusion and exclusion criteria
The PRISMA checklist is described in the S1 Table. The included studies were cohort studies and randomized controlled trials (RCTs) with at least 6 months of follow-up that were published until September 2020 without language restrictions. Other inclusion criteria were following the PICOS principle. Type of participant (P), the patients selected were those with skeletal Class III malocclusion with maxillary hypoplasia or transverse maxillary deficiency, from the early mixed dentition to early permanent dentition (age ranged from 6 to 16 years). Type of interventions (I), the intervention was the selection of different treatment of FM and FM/RME. We performed two different types of comparisons (C) separately: 1) FM vs. control, 2) FM/RME vs. control in the long-term follow up. The outcome (O) of maxillary changes in sagittal dimensions, defined as Sella-Nasion-A point (SNA), was obtained by cephalometric radiography. Studies that satisfied the inclusion criteria were retrieved and screened using the following exclusion criteria: (1) patients with craniofacial anomalies, (2) No CIII malocclusion and (3) less than 6 months of follow-up.
Data extraction
Among the included studies, we extracted and collected the following variables in a standardized form: authors, publication years, study design, patient classification, number of participants, mean age, sex, follow-up period, measurement method, and the clinical outcome. Three reviewers (WCL, YFL, and CHL) individually verified the data in the included studies. Subsequently, we overcame disagreements by means of discussion with the help of a fourth reviewer (CSH) to make the final decision.
Risk of bias in individual studies
Four authors (WCL, YFL, CHL, and CSH) evaluated each RCT or controlled clinical trial’s quality according to revised Cochrane risk of bias (RoB 2.0) [36] or risk of bias in non-randomized studies of interventions (ROBINS-I) [37], respectively. The quality assessments in the RoB 2.0 included the bias in the randomization process, deviations from the intended interventions, missing outcome data, measurement of the outcome, selection of the reported result, and overall bias. The quality assessments in the ROBINS-I included the bias in the pre-intervention, at intervention, post-intervention, and overall bias. In addition, the quality of the resultant evidence was assessed by the Grading of Recommendations Assessment, Development and Evaluation (GRADE) [38].
Statistical analysis
We used the OpenMetaAnalyst software to obtain the mean difference (MD) and 95% confidence interval (CI). We used MD for continuous data in statistical pooling. We also used the I2 statistical test to evaluate the heterogeneity of the included studies. An I2 value ranged from 0 to 100%. An I2 value = 0% meant there was no heterogeneity and I2 value ≥ 50% proposed considerable heterogeneity [39]. We explored the source of heterogeneity by meta-regression using an average summary value. Possible moderators (age, sex, publication year, follow up period and study design) were tested to explore heterogeneity. And then we conducted a subgroup analysis from the meta-regression result. We used the OpenMetaAnalyst and Comprehensive Meta-Analysis software version 3 to perform meta-regression analysis, and subgroup analysis. Funnel plots were used to explore potential small study bias via visual inspection and Egger’s test.
Results
Search results and description
Characteristics of the included studies.
The PRISMA flow diagram is presented in Fig 1. Three hundred and twenty-nine articles were identified from the databases and other sources. Fifty-eight full-text articles were evaluated for eligibility and after 41 exclusions, 17 articles were included in this meta-analysis. The studies included were published between 1996 and 2016. Of the 17 included studies, four studies were RCTs and 13 studies were cohort studies. 10 studies [17, 22, 25–27, 40–44] were categorized into the FM group; whereas, eight studies [11–15, 21, 26, 28] were allotted to the FM+RME group. In the FM versus control group comparison, patients’ ages ranged from 6.36 to 11.54 years and the follow-up period ranged between 6 months and 6 years. In the FM+RME versus control group comparison, patients’ ages ranged between 6.4 and 10.91 years and the follow-up period ranged between 6.78 months and 9 years. The characteristics of the included studies are presented in Table 2.
Assessment of risk of bias
Four of the included studies were RCTs and we evaluated the risk of bias using the RoB 2.0 tool. Four RCTs were found to have a low risk of bias. For observational studies, we used the ROBINS-I tool to classify the risk of bias among the studies into one of the four levels (low, moderate, serious, and critical). The overall result of the assessment showed that eight studies presented a low risk of bias, while the other five were at moderate risk of bias (Table 3). The most difficult domains involved were selection bias. The FM group included three RCTs and seven cohort studies that presented a moderate risk of bias in three cohort studies, while the others presented a low risk of bias. The FM+RME group included two RCTs and six cohort studies that presented a moderate risk of bias in three cohort studies, while the others presented a low risk of bias.
Quantitative data synthesis
Primary outcome on the SNA.
Primary outcomes on the SNA are shown in Fig 2. There were total 715 participants of the 17 studies included in the quantitative data synthesis as follows: 223 in the FM group, 182 in the FM+RME group, and 310 in the untreated control group. The results of the performed meta-analyses are given in Table 4. In the FM versus control group comparison, the pooled data demonstrated that the FM therapy had better treatment effect on the SNA (mean difference, 1.79°; 95% CI, 1.20–2.39; and I2 = 54.96%). However, significant heterogeneity was seen among the included studies. Similarly, in the FM+RME versus control group comparison, the pooled data also demonstrated that the FM+RME therapy had better treatment effect on the SNA (mean difference, 1.54°; 95% CI, 1.06–2.02; and I2 = 41.59%). Significant heterogeneity was also seen among included studies.
Fig 2(A). The FM treated group versus control group. Fig 2(B). The FM+RME treated group versus control group.
Meta-regression results
Table 5 shows the results of a meta-regression that investigated the origin of significant association (p < 0.1). All potential factors including mean age, sex, publication years, and study design did not present significant associations in this meta-analysis with the exception of follow-up period. Meta-regression model was developed to assess the amount of heterogeneity based on the study characteristics with respect to the SNA angle between treatment groups and untreated control groups. Regarding the difference between the SNA angle, a significant relationship was noted during the follow-up period in the FM or FM+RME groups in contrast to the untreated control group (Fig 3). Based on this meta-regression result, we conducted a subgroup analysis involving groups of participants with follow-up period less than 3 years and more than 3 years. This subgroup analysis demonstrated a significantly lower heterogeneity in each group.
Fig 3(A). The FM treated group versus control group. Fig 3(B). The FM+RME treated group versus control group.
From the meta-regression plot correction, we determined that follow-up period less than 3 years correlated with higher efficacy. However, the efficacy gradually reduced in the long-term follow-up period. The point of determination for difference in efficacy was approximately 3 years of follow-up.
Subgroup analysis in the SNA
SNA changes from subgroup analysis of follow-up periods of less than and more than 3 years (Fig 4) were recorded and discussed. The results of the performed meta-analyses are given in Table 4.
Fig 4(A). The FM treated group versus control group. Fig 4(B). The FM+RME treated group versus control group.
The FM treated group versus untreated control group. The overall mean difference in the FM treated group versus the untreated control group regarding SNA angle was 1.79° (95% CI, 1.20–2.39 and p < 0.001 for the FM treated group). The subgroup analysis showed a significantly increased SNA angle with FM treatment than that in the untreated control group with a follow-up period of less than 3 years (Mean difference, 2.29°; 95% confidence interval, 1.86–2.73; and p < 0.001 after facemask protraction), but not in the groups with more than 3 years of follow-up (Mean difference, 0.28°; 95% confidence interval, -0.57–1.13; and p = 0.52 after facemask protraction). Regarding SNA angle heterogeneity, the I2 was 54.96% in the overall included studies, less than 0.01% in the group with follow-up periods of less than 3 years, and less than 0.01% in the group with follow-up periods of more than 3 years.
The FM+RME treated group versus untreated control group. The overall mean difference in the FM+RME treated group versus the untreated control group regarding SNA angle was 1.54° (95% CI, 1.06–2.02 and p < 0.001 for the FM+RME treated group). The subgroup analysis showed a significantly increased SNA angle in the FM+RME treated group than in the untreated control group with follow-up period of less than 3 years (Mean difference, 1.73°; 95% confidence interval, 1.36–2.11; and p < 0.001 after rapid maxillary expansion and facemask protraction), but not in the groups with follow-up period of more than 3 years (Mean difference, 0.34°; 95% confidence interval, -0.64–1.33; and p = 0.5 after rapid maxillary expansion and facemask protraction). Regarding SNA heterogeneity, the I2 was 41.59% in the overall included studies, 6.26% in the group with follow-up period of less than 3 years, and less than 0.01% in the group with follow-up period of more than 3 years.
Publication bias.
Reporting biases are best performed only when we have a sufficient number in this study. And insufficient number of studies was included in this meta-analysis. Therefore, funnel plots were not performed in this meta-analysis.
GRADE.
GRADE was used to assess overall evidence of both RCTs and observational studies in maxillary anteroposterior changes. Low quality of evidence shows that maxillary protraction may have benefit when compared to untreated control in SNA degree. The level of evidence for SNA changes was downgraded due to statistical heterogeneity and low number of included studies in outcome assessment. Summary of findings table according to GRADE approach was shown in Table 6.
Discussion
Summary of evidence
This meta-analysis assessed the long-term anteroposterior changes on the maxilla, defined as SNA, following maxillary protraction with or without expansion via different devices including FM and FM+RME. This topic is not novel since many systematic reviews have been published in the past on similar topics [23, 45–49]. In the comparison between the FM treated group versus the untreated control group, 10 studies were included to investigate the orthopedic effects on the SNA. There was a significant increase in the SNA angle after FM treatment and it had similar effects on the SNA angle in the FM+RME treated group as compared with the untreated control group, which was consistent with the previous concept [5, 13, 17, 21]. Further, in the subgroup analysis of the FM treated group versus untreated control group, seven studies were included related to follow-up periods less than 3 years and three studies with follow-up periods more than 3 years. Patients undergoing FM treatment presented with a greater orthopedic effect on the SNA angle in the group with a follow-up period of less than 3 years when compared with the untreated control group. However, the effect was not significant in the group with more than 3 years follow-up period. Similarly, there was a greater orthopedic effect on the SNA angle after FM+RME treatment in the group with less than 3 years follow-up period. However, the effect was not significant in the group with more than 3 years follow-up period.
In this analysis, we included 17 studies (Table 2). Nevertheless, there was significant heterogeneity in the overall included studies in the FM or the FM+RME treatment group. The reason for this heterogeneity could be that the periods between the initial and final records were different among the included studies. Different follow-up durations of maxillary protraction may exist among studies, and this cannot be ignored when considering the potential origins of heterogeneity. Therefore, meta-regression models of the SNA angle differences were established with age, sex, follow-up period, and publication years as covariates (Table 5). In long-term follow-up periods, the effect on maxillary sagittal changes gradually decreased and became nearly equal to that in the control group with time [14, 22, 27]. Furthermore, other potential factors including mean age, sex, publication years, and study design could not significantly clarify heterogeneity in this meta-analysis.
Orthopedic maxillary protraction with or without expansion has been widely used for the treatment of the skeletal Class III growing patients with maxillary deficiency [10–15], and there have been several systematic reviews and meta-analyses [5, 23, 24, 45, 46, 49–51] investigating this treatment. A few studies [13, 17, 21, 25, 26] with orthopedic maxillary protraction reported a significant increase in the SNA angle. Other studies [24, 45–47, 50] found that protraction FM therapy in growing Class III patients is short-term effective. However, there was a lack of evidence on the long-term benefits, which remains controversial. Furthermore, conclusive evidence about the relationships between such changes and other potential factors, such as mean age, sex, publication years, and study design were lacking. In this analysis, our results showed that the patients who underwent maxillary protraction therapy (FM or FM+RME) with follow-up period of less than 3 years were likely to have an increased SNA angle than in the untreated control group. However, this benefit was not significant and maxillary anteroposterior changes gradually relapsed in the long-term follow-up period. In addition, the treatment timing was not affected by the early or late orthopedic treatment, which was similar to that reported in a previous study [5]. The treatment effect on maxillary anteroposterior changes was not affected by sex.
Limitations and strengths
This study has several limitations. Firstly, only the SNA angle was used in this study as it was the most common denominator to represent the anteroposterior dimension of maxilla in various studies even though many other measurements were used [12, 14, 27]. Second, although we discussed the heterogeneity from the statistical point of view, we did not discuss clinical heterogeneity including the different treatment methods employed by different clinicians or the medical quality in the early periods, etc. The strength of this meta-analysis was that the studies we included were RCTs and observational studies instead of only RCTs. Admittedly, if the RCTs are blinded, they can supply the highest and reliable epidemiologic evidence for causality [52]. Observational studies were enrolled in this study, these studies may have strong probability of confounding and bias, are likely to have incomplete and poor quality of data, and less likely to have verifiable outcomes [53, 54]. Nevertheless, in particular conditions, observational studies may be of certain advantages. For example, they can provide us long-term investigation on orthopedic treatment of Class III malocclusion. Furthermore, in ethical issues, with patients that are seeking the treatment due to their orthopedic problems, observational studies may be more appropriate than RCTs in real-world circumstances as a result of the possibility of larger sample sizes, extensive participants included, and longer follow-up [52, 55]. However, in this analysis, few RCTs base were available. Instead, the included studies went through quality assessment (Table 3), meta-regression (Table 5 and Fig 3), and subgroup analyses (Fig 4) to evaluate the quality of evidence and heterogeneity.
This study investigated the relationship between maxillary anteroposterior changes following FM with or without RME. Certainly, some studies reported that maxillary protraction is significantly associated with the changes in the maxillary anteroposterior dimension, while other studies reported otherwise. This inconsistency was due to the different follow-up period in different included studies, and untreated control groups were not included in most studies. Furthermore, only the difference between initial and final records was compared between identically treated groups. Nevertheless, the maxillary changes were also associated with the effect of growth in children, and we included the untreated control group to decide the real effect of orthopedic maxillary protraction. Hence, we excluded case series studies resulting in reduced final sample size. Moreover, most studies evaluated the short-term effect, and did not include information regarding the population under study, age, sex, follow-up period, among others to investigate how these factors affected the treatment. Hence, we included studies from short-term to long-term follow-up period and conducted meta-regression analyses to evaluate heterogeneity in the included studies.
Conclusion
Maxillary protraction treatments could be effective for a short-term in correcting maxillary hypoplasia in young patients and the treatment result was not affected by mean age and sex. Nevertheless, the skeletal effects gradually decreased with time in the long-term follow-up of maxillary sagittal changes. Hence, more high-quality long-term RCTs and observational studies are required to further evaluate the effects on maxillary skeletal changes.
Supporting information
S2 Table. List of included and excluded studies, with the corresponding reasons.
https://doi.org/10.1371/journal.pone.0247027.s002
(DOCX)
Acknowledgments
The authors gratefully acknowledge the Center for Evidence-based Medicine, Tri-Service General Hospital, Taipei, Taiwan and Chang Gung Craniofacial Research Center, Taoyuan, Taiwan.
References
- 1. Haynes S (1970) The prevalence of malocclusion in English children aged 11–12 years. Rep Congr Eur Orthod Soc: 89–98. pmid:5287526
- 2. Thilander B, Myrberg N (1973) The prevalence of malocclusion in Swedish schoolchildren. Scand J Dent Res 81: 12–21. pmid:4510864
- 3. Guyer EC, Ellis EE 3rd, McNamara JA Jr, Behrents RG (1986) Components of class III malocclusion in juveniles and adolescents. Angle Orthod 56: 7–30. pmid:3485393
- 4. Litton SF, Ackermann LV, Isaacson RJ, Shapiro BL (1970) A genetic study of Class 3 malocclusion. Am J Orthod 58: 565–577. pmid:5273734
- 5. Zhang W, Qu HC, Yu M, Zhang Y (2015) The Effects of Maxillary Protraction with or without Rapid Maxillary Expansion and Age Factors in Treating Class III Malocclusion: A Meta-Analysis. PLoS One 10: e0130096. pmid:26068221
- 6. Arman A, Toygar TU, Abuhijleh E (2004) Profile changes associated with different orthopedic treatment approaches in Class III malocclusions. Angle Orthod 74: 733–740. pmid:15673133
- 7. Ellis E 3rd, McNamara JA Jr. (1984) Components of adult Class III malocclusion. J Oral Maxillofac Surg 42: 295–305. pmid:6585502
- 8. Liu Z, McGrath C, Hägg U (2009) The impact of malocclusion/orthodontic treatment need on the quality of life. A systematic review. Angle Orthod 79: 585–591. pmid:19413386
- 9. Cunningham SJ, Hunt NP (2001) Quality of life and its importance in orthodontics. J Orthod 28: 152–158. pmid:11395531
- 10. Baccetti T, McGill JS, Franchi L, McNamara JA Jr., Tollaro I (1998) Skeletal effects of early treatment of Class III malocclusion with maxillary expansion and face-mask therapy. Am J Orthod Dentofacial Orthop 113: 333–343. pmid:9517727
- 11. Kajiyama K, Murakami T, Suzuki A (2004) Comparison of orthodontic and orthopedic effects of a modified maxillary protractor between deciduous and early mixed dentitions. Am J Orthod Dentofacial Orthop 126: 23–32. pmid:15224055
- 12. Masucci C, Franchi L, Defraia E, Mucedero M, Cozza P, et al. (2011) Stability of rapid maxillary expansion and facemask therapy: a long-term controlled study. Am J Orthod Dentofacial Orthop 140: 493–500. pmid:21967936
- 13. Sar C, Arman-Ozcirpici A, Uckan S, Yazici AC (2011) Comparative evaluation of maxillary protraction with or without skeletal anchorage. Am J Orthod Dentofacial Orthop 139: 636–649. pmid:21536207
- 14. Westwood PV, McNamara JA Jr., Baccetti T, Franchi L, Sarver DM (2003) Long-term effects of Class III treatment with rapid maxillary expansion and facemask therapy followed by fixed appliances. Am J Orthod Dentofacial Orthop 123: 306–320. pmid:12637903
- 15. Yuksel S, Ucem TT, Keykubat A (2001) Early and late facemask therapy. Eur J Orthod 23: 559–568. pmid:11668875
- 16. Liou EJ, Tsai WC (2005) A new protocol for maxillary protraction in cleft patients: repetitive weekly protocol of alternate rapid maxillary expansions and constrictions. Cleft Palate Craniofac J 42: 121–127. pmid:15748102
- 17. Akin M, Ucar FI, Chousein C, Sari Z (2015) Effects of chincup or facemask therapies on the orofacial airway and hyoid position in Class III subjects. J Orofac Orthop 76: 520–530. pmid:26446505
- 18. De Clerck H, Cevidanes L, Baccetti T (2010) Dentofacial effects of bone-anchored maxillary protraction: a controlled study of consecutively treated Class III patients. Am J Orthod Dentofacial Orthop 138: 577–581. pmid:21055597
- 19. Elnagar MH, Elshourbagy E, Ghobashy S, Khedr M, Evans CA (2016) Comparative evaluation of 2 skeletally anchored maxillary protraction protocols. Am J Orthod Dentofacial Orthop 150: 751–762. pmid:27871701
- 20. Sar C, Sahinoglu Z, Ozcirpici AA, Uckan S (2014) Dentofacial effects of skeletal anchored treatment modalities for the correction of maxillary retrognathia. Am J Orthod Dentofacial Orthop 145: 41–54. pmid:24373654
- 21. Xu B, Lin J (2001) [The orthopedic treatment of skeletal class III malocclusion with maxillary protraction therapy]. Zhonghua Kou Qiang Yi Xue Za Zhi 36: 401–403. pmid:11930708
- 22. Chong YH, Ive JC, Artun J (1996) Changes following the use of protraction headgear for early correction of Class III malocclusion. Angle Orthod 66: 351–362. pmid:8893105
- 23. Almuzian M, McConnell E, Darendeliler MA, Alharbi F, Mohammed H (2018) The effectiveness of alternating rapid maxillary expansion and constriction combined with maxillary protraction in the treatment of patients with a class III malocclusion: a systematic review and meta-analysis. J Orthod 45: 250–259. pmid:30252620
- 24. Lin Y, Guo R, Hou L, Fu Z, Li W (2018) Stability of maxillary protraction therapy in children with Class III malocclusion: a systematic review and meta-analysis. Clin Oral Investig 22: 2639–2652. pmid:29429068
- 25. Balos Tuncer B, Ulusoy C, Tuncer C, Turkoz C, Kale Varlik S (2015) Effects of reverse headgear on pharyngeal airway in patients with different vertical craniofacial features. Braz Oral Res 29. pmid:25992786
- 26. Vaughn GA, Mason B, Moon HB, Turley PK (2005) The effects of maxillary protraction therapy with or without rapid palatal expansion: a prospective, randomized clinical trial. Am J Orthod Dentofacial Orthop 128: 299–309. pmid:16168327
- 27. Mandall N, Cousley R, DiBiase A, Dyer F, Littlewood S, et al. (2016) Early class III protraction facemask treatment reduces the need for orthognathic surgery: a multi-centre, two-arm parallel randomized, controlled trial. J Orthod 43: 164–175. pmid:27564126
- 28. Masucci C, Franchi L, Giuntini V, Defraia E (2014) Short-term effects of a modified Alt-RAMEC protocol for early treatment of Class III malocclusion: a controlled study. Orthod Craniofac Res 17: 259–269. pmid:25041370
- 29. Ngan P, Hagg U, Yiu C, Merwin D, Wei SH (1996) Treatment response to maxillary expansion and protraction. Eur J Orthod 18: 151–168. pmid:8670927
- 30. Shanker S, Ngan P, Wade D, Beck M, Yiu C, et al. (1996) Cephalometric A point changes during and after maxillary protraction and expansion. Am J Orthod Dentofacial Orthop 110: 423–430. pmid:8876495
- 31. Williams MD, Sarver DM, Sadowsky PL, Bradley E (1997) Combined rapid maxillary expansion and protraction facemask in the treatment of Class III malocclusions in growing children: a prospective long-term study. Semin Orthod 3: 265–274. pmid:9573888
- 32. Ngan P, Wilmes B, Drescher D, Martin C, Weaver B, et al. (2015) Comparison of two maxillary protraction protocols: tooth-borne versus bone-anchored protraction facemask treatment. Prog Orthod 16: 26. pmid:26303311
- 33. Ge YS, Liu J, Chen L, Han JL, Guo X (2012) Dentofacial effects of two facemask therapies for maxillary protraction. Angle Orthod 82: 1083–1091. pmid:22639823
- 34. Chen XH, Xie XQ (2012) [The effect of two different methods of rapid maxillary expansion on treatment results of skeletal Class III malocclusion patients with maxillary protraction in early permanent dentition]. Shanghai Kou Qiang Yi Xue 21: 580–583. pmid:23135193
- 35. Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, et al. (2009) The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate health care interventions: explanation and elaboration. J Clin Epidemiol 62: e1–34. pmid:19631507
- 36. Sterne JAC, Savovic J, Page MJ, Elbers RG, Blencowe NS, et al. (2019) RoB 2: a revised tool for assessing risk of bias in randomised trials. Bmj 366: l4898. pmid:31462531
- 37. Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, et al. (2016) ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. Bmj 355: i4919. pmid:27733354
- 38. Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, et al. (2008) GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. Bmj 336: 924–926. pmid:18436948
- 39. Higgins JP, Thompson SG (2002) Quantifying heterogeneity in a meta-analysis. Stat Med 21: 1539–1558. pmid:12111919
- 40. Chen L, Chen R, Yang Y, Ji G, Shen G (2012) The effects of maxillary protraction and its long-term stability—a clinical trial in Chinese adolescents. Eur J Orthod 34: 88–95. pmid:21325335
- 41. Cozza P, Baccetti T, Mucedero M, Pavoni C, Franchi L (2010) Treatment and posttreatment effects of a facial mask combined with a bite-block appliance in Class III malocclusion. Am J Orthod Dentofacial Orthop 138: 300–310. pmid:20816299
- 42. Kilicoglu H, Kirlic Y (1998) Profile changes in patients with class III malocclusions after Delaire mask therapy. Am J Orthod Dentofacial Orthop 113: 453–462. pmid:9563362
- 43. Mandall N, DiBiase A, Littlewood S, Nute S, Stivaros N, et al. (2010) Is early Class III protraction facemask treatment effective? A multicentre, randomized, controlled trial: 15-month follow-up. J Orthod 37: 149–161. pmid:20805344
- 44. Ucem TT, Ucuncu N, Yuksel S (2004) Comparison of double-plate appliance and facemask therapy in treating Class III malocclusions. Am J Orthod Dentofacial Orthop 126: 672–679. pmid:15592214
- 45. Rongo R, D’Anto V, Bucci R (2017) Skeletal and dental effects of Class III orthopaedic treatment: a systematic review and meta-analysis. 44: 545–562.
- 46. Cordasco G, Matarese G, Rustico L, Fastuca S, Caprioglio A, et al. (2014) Efficacy of orthopedic treatment with protraction facemask on skeletal Class III malocclusion: a systematic review and meta-analysis. Orthod Craniofac Res 17: 133–143. pmid:24725349
- 47. Woon SC, Thiruvenkatachari B (2017) Early orthodontic treatment for Class III malocclusion: A systematic review and meta-analysis. Am J Orthod Dentofacial Orthop 151: 28–52. pmid:28024779
- 48. Bucci R, D’Anto V, Rongo R, Valletta R, Martina R, et al. (2016) Dental and skeletal effects of palatal expansion techniques: a systematic review of the current evidence from systematic reviews and meta-analyses. J Oral Rehabil 43: 543–564. pmid:27004835
- 49. Pithon MM, Santos NL, Santos CR, Baiao FC, Pinheiro MC, et al. (2016) Is alternate rapid maxillary expansion and constriction an effective protocol in the treatment of Class III malocclusion? A systematic review. Dental Press J Orthod 21: 34–42.
- 50. Polito I, Martina R, Michelotti A, Woon SC, Thiruvenkatachari B (2017) Early orthodontic treatment for Class III malocclusion: A systematic review and meta-analysis. J Oral Rehabil 151: 28–52.
- 51. Foersch M, Jacobs C, Wriedt S, Hechtner M, Wehrbein H (2015) Effectiveness of maxillary protraction using facemask with or without maxillary expansion: a systematic review and meta-analysis. Clin Oral Investig 19: 1181–1192. pmid:25982454
- 52. Kim HS, Lee S (2018) Real-world Evidence versus Randomized Controlled Trial: Clinical Research Based on Electronic Medical Records. 33: e213.
- 53. Sibbald B, Roland M (1998) Understanding controlled trials. Why are randomised controlled trials important? Bmj 316: 201. pmid:9468688
- 54. Silverman SL (2009) From randomized controlled trials to observational studies. Am J Med 122: 114–120. pmid:19185083
- 55. Edwards SJ, Lilford RJ, Braunholtz DA, Jackson JC, Hewison J, et al. (1998) Ethical issues in the design and conduct of randomised controlled trials. Health Technol Assess 2: i–vi, 1–132.