Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Demirjian versus the Willems method for dental age estimation in different populations: A meta-analysis of published studies

  • Temitope Ayodeji Esan ,

    Contributed equally to this work with: Temitope Ayodeji Esan, Veerasamy Yengopal, Lynne A. Schepartz

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    Affiliations Human Variation and Identification Unit, School of Anatomical Sciences, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa, Faculty of Dentistry, Obafemi Awolowo University, Ile-Ife, Nigeria

  • Veerasamy Yengopal ,

    Contributed equally to this work with: Temitope Ayodeji Esan, Veerasamy Yengopal, Lynne A. Schepartz

    Roles Data curation, Formal analysis, Methodology, Software, Writing – original draft

    Affiliation Department of Community Dentistry, School of Oral Health Sciences, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa

  • Lynne A. Schepartz

    Contributed equally to this work with: Temitope Ayodeji Esan, Veerasamy Yengopal, Lynne A. Schepartz

    Roles Conceptualization, Methodology, Project administration, Resources, Supervision, Writing – original draft, Writing – review & editing

    Lynne.Schepartz@wits.ac.za

    Affiliation Human Variation and Identification Unit, School of Anatomical Sciences, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa

Abstract

Background

The accuracy of radiographic methods for dental age estimation is important for biological growth research and forensic applications. Accuracy of the two most commonly used systems (Demirjian and Willems) has been evaluated with conflicting results. This study investigates the accuracies of these methods for dental age estimation in different populations.

Methods

A search of PubMed, Scopus, Ovid, Database of Open Access Journals and Google Scholar was undertaken. Eligible studies published before December 28, 2016 were reviewed and analyzed. Meta-analysis was performed on 28 published articles using the Demirjian and/or Willems methods to estimate chronological age in 14,109 children (6,581 males, 7,528 females) age 3–18 years in studies using Demirjian’s method and 10,832 children (5,176 males, 5,656 females) age 4–18 years in studies using Willems’ method. The weighted mean difference at 95% confidence interval was used to assess accuracies of the two methods in predicting the chronological age.

Results

The Demirjian method significantly overestimated chronological age (p<0.05) in males age 3–15 and females age 4–16 when studies were pooled by age cohorts and sex. The majority of studies using Willems’ method did not report significant overestimation of ages in either sex. Overall, Demirjian’s method significantly overestimated chronological age compared to the Willems method (p<0.05). The weighted mean difference for the Demirjian method was 0.62 for males and 0.72 for females, while that of the Willems method was 0.26 for males and 0.29 for females.

Conclusion

The Willems method provides more accurate estimation of chronological age in different populations, while Demirjian’s method has a broad application in terms of determining maturity scores. However, accuracy of Demirjian age estimations is confounded by population variation when converting maturity scores to dental ages. For highest accuracy of age estimation, population-specific standards, rather than a universal standard or methods developed on other populations, need to be employed.

Introduction

Population-based data on human biological growth and development processes are fundamental for assessing the health status of a community. This includes an understanding of the growth pattern for the children as well as the environmental stresses that disrupt or impede their growth. These stresses are often easy to identify, but data on uncompromised development and growth variation in most populations are surprisingly lacking. Instead, researchers typically compare growth in the population of interest to standards formulated for European or US children. The problems associated with using non population-specific standards are complex, and their application can lead to misrepresentations of health status.

The importance of population-specific growth standards extends beyond their utility in biological anthropology and health research. For many populations in rural Africa birth registry and eliciting date of birth is still a challenge. Occlusal tooth wear and anthropological details can be very useful for identification and aging [1,2]. Data on timing of tooth formation, tooth emergence and dental morphometrics are also needed for forensic purposes, especially with the increasing global incidences of mass deaths and disasters [3,4]. Additionally, tables of tooth emergence chronology are useful when birth records are unreliable or lost, where people seek asylum [5], where specific aging is needed to prevent cheating in age-graded sports competitions, or where individuals seek favourable outcomes in civil or criminal cases [610]. The age at death is usually the only biological parameter that can be estimated for unidentified juvenile remains with any degree of accuracy [11]. Beyond this, information from dental development may play a major role in determining many clinical decisions, including choices about treatment options and sequence [12]. In the absence of population-specific standards, data from other regions and populations are used as references, often without considering whether they are appropriate for comparison.

Variation in dental development among populations is reported in the literature [1317]. The reason for the variation among groups is not fully understood, although several explanations involving the interplay of genetic and environmental factors have been proposed [18]. With increasing globalisation there have been observable changes in the demographic features of many populations as well as changes in their physical profiles [19]. Dental parameters are also evolving, and may be related to observable alterations in nutritional status, socioeconomic status, and genetic admixture. With these transformations it is expected that dental growth and development standards of populations will modify with time.

Another source of variation in the timing of dental development is biological sex. Universally, females in any given population are more advanced in tooth formation than their male counterparts [2023]. Furthermore, other studies [2426] found that girls are also ahead of boys in permanent tooth emergence in Northern Irish, Finnish and Iranian children respectively, and similar differences are found for most populations.

The effect of malnutrition on dental development remains controversial, with conflicting results from different studies. Malnutrition is thought to have a greater negative impact on skeletal development than on the forming dentition. A recent study by Elamin and Liversidge [27] on severely undernourished children in South Sudan reported no significant impact of nutrition on dental development. However, studies of African Americans and European Americans [28,29] found that children from high socioeconomic backgrounds had earlier tooth emergence, which was attributed to better nutritional status.

Age estimation

Different methods have been proposed to estimate dental age using permanent tooth formation. Among these is Demirjian's method formulated on a sample of French Canadian children, which involves the assessment of eight specific stages of tooth formation of the seven left mandibular teeth. Biologic weights, which are numerical and derived using the method described in research on skeletal maturity [30], are assigned to each tooth stage. The weights are added together to give a dental maturity score. Separate tables of dental maturity for males and females are used to convert the maturity scores to dental age [20]. The advantage of the Demirjian method is the objective criteria for describing the stages of tooth development. The methodology gained worldwide acceptability and became the most commonly used method for estimation of dental age [20,21]. Studies using the method on other populations documented patterns of comparatively advanced or delayed dental development [18,3137]. This led several authors to question the cross-populational validity of Demirjian’s method and to argue for population-specific standards for age estimation [18,36,38,39]

Willems and colleagues [14] modified the Demirjian technique by creating new tables from which a maturity score could be directly expressed in years. The step of converting the maturity score to a dental age was omitted, making the new method simpler to use while retaining the advantages of Demirjian's method. There was also a reduction in the overestimation of dental age, which was not statistically different from zero in a Belgian population [14]. This modification was evaluated for several populations and reported to be more accurate than Demirjian’s method [4045].

No systematic review has compared the accuracy of the Demirjian and Williams methods for dental age estimation versus chronological age in different populations. This review therefore posed the following research question: Does the Demirjian method for dental age estimation provide a more accurate estimate of chronological age when compared to the Willems method in dental age estimation of different populations? The null hypothesis tested was that there was no difference in the accuracy of the two methods for dental age estimation against chronological age.

Methodology

Systematic literature search

The literature search was designed to find both published and unpublished studies on the research question. A three-step search strategy was utilized. An initial limited search of MEDLINE and CINAHL was undertaken, followed by an analysis of the text words contained in the title and abstract, and of the index terms used to describe articles. A second search using all identified keywords and index terms was then conducted across all the included databases. Thirdly, the reference lists of all identified reports and articles were searched for additional studies. Studies published in English and only those published from 1973 onward were considered for inclusion. This systematic review is registered with PROSPERO International prospective register of systematic reviews with registration number CRD42016029995. The protocol (under modification) can be accessed via the following website.

http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42016029995

The databases searched included:

MEDLINE, accessed via PubMed: SCOPUS: OVID: Biomed Central: Database of Open Access Journals (DOAJ): Ended: OpenSIGLE and Google Scholar

The search for unpublished studies included:

Hand search: reports: Thesis

Search terms included the following adjusted for the search engine/database used:

  • (“Age estimation”) AND (Demirjian OR Willems)
  • (“Dental age”) AND (Demirjian OR Willems)
  • (“Tooth formation” AND Demirjian)
  • Willems AND (“Tooth formation”)

The search was limited up to 28 December 2016.

Studies were eligible for inclusion if they met the following criteria:

  • Cross-sectional studies
  • Non-cross-sectional studies
  • Comparative studies of either method or both methods
  • Study focus relevant to the research question
  • Full reports (abstracts without full reports not included)
  • Study participants ranging in age from 0–18 years

Articles were further excluded according to the following criteria:

  • No computable data reported
  • For comparative studies, test and control groups not evaluated the same way
  • Studies conducted on subjects who were physically or medically compromised and those with developmental anomalies
  • Studies conducted exclusively on third molars
  • Studies published in any language other than English

Titles and abstracts of identified citations from data sources were scanned by two reviewers (Temitope Esan (TE) and Veerasamy Yengopal (VY)) in duplication, for possible inclusion according to the above criteria. Articles with a suitable title but without a listed abstract were retrieved in full copy. All included articles were judged separately by the authors for possible exclusion with reason or for acceptance, in line with the exclusion/inclusion criteria. Disagreements between authors were solved through discussion and consensus with the third reviewer (Lynne Schepartz (LS)).

Data collection from accepted trials and analysis

Two reviewers (TE, VY) extracted data from accepted studies independently without being blinded to authors, institutions, journal name or study results. Disagreements between authors concerning data extracted were solved through discussion and consensus. All data were entered in specifically designed data sheets and are reported in the Table of Included Studies (Table 1). The following data were extracted:

  1. General important information: First author, year of publication and full article reference, place of trial, age, trial participant characteristics, type of study design
  2. Information per test and control group: details of method used, age of participants (dental and chronological age), sex, numbers included

There were three outcome measures assessed:

  1. The difference in the dental age versus chronological age for the Demirjian method
  2. The difference in the dental age versus chronological age for the Willems method
  3. The mean age difference using the Demirjian method versus the Willems method

The above outcomes were compared independently for age and sex in different populations as per the included studies.

Datasets were created to facilitate pooling of similar outcomes into a meta-analysis. A dataset was defined as any extracted set of N, mean and standard deviation (SD) for test and control groups. For comparisons of continuous variables (dental age and chronological age), the mean with the SD was used. If the mean was reported without an SD, then attempts were made to obtain an SD from either the standard error of the mean or the 95% confidence intervals. If the standard error (SE) was reported instead of the SD, then the following formula was used [46]:

When making this transformation, the standard errors were from means calculated from within a group and not standard errors of the difference in means computed between the groups.

If studies reported the 95% confidence intervals (CI, with upper limit CIu and lower limit CIl), then the following formula was used to calculate the SD:

The above formula applies to larger sample sizes (>60). If the sample size was small or less than 60 in each group then the denominator (3.92) in the formula above was replaced by 4.128. Again, when making this transformation, the confidence intervals were from means calculated from within a group and not standard errors of the difference in means computed between groups [46].

For each dataset, the Mean Difference (MD) for continuous data with 95% Confidence Intervals (CI) and p-values were computed using a fixed effects model that used the inverse variance for continuous data to include studies directly proportionate to their sample size. Statistical significance was set at p<0.05. For computation of all point estimates, the statistical software program Cochrane RevMan version 5.3 was used.

In order to fulfill the criteria of clinical and methodological homogeneity, which allow for pooling of data for meta-analyses, datasets from the accepted publications did not differ in the following minimum set of characteristics: similar characteristics of children, assessment criteria similar in both groups, data collection and measurements similar in both groups.

Pooling of datasets

The I2 test with 95% CI was used to establish whether any statistical heterogeneity existed between datasets that were assumed to be methodologically homogenous. The thresholds for I2 point estimates (in %) and upper confidence values were used in order to interpret the test results [46]: 0–40% = might not be important; 30–60% = may represent moderate heterogeneity; 50–90% = may represent substantial heterogeneity; 75–100% = considerable heterogeneity. Identified (clinically/methodologically/statistically) homogenous datasets were pooled using a fixed effects meta-analysis with the Cochrane RevMan 5.3 software.

Assessment of methodological quality

Quantitative papers selected for this study were assessed by two independent reviewers for methodological validity prior to inclusion in the review using a revised standardized critical appraisal instrument from the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement [47]. This is a 40 item checklist used for observational studies (cross-sectional, cohort, case-control). Included studies were assessed according to the checklist and papers that achieved a score of at least 28 out of 40 were regarded as having high methodological quality [48].

Assessment of publication bias risk

Funnel plots were derived from pooled datasets using the Cochrane RevMan 5.3 software. Symmetrical funnel plots indicate no publication bias and asymmetrical plots are an indication of publication bias.

Statistical analysis

All statistical analyses were done using the Cochrane RevMan 5.3 software. Analysis was done separately for the two methods under review (Demirjian and Willems) with separate analyses of male and female data. The two methods were compared to determine their accuracy. The weighted mean difference (WMD) was used to assess accuracy of the methods in predicting the chronological age of the children. Heterogeneity and between study variability was assessed using the Tau and I2 tests. A significant value of Tau (p<0.05) indicates significant heterogeneity. A value greater than 50% for the I2 tests (with values ranging from 0 to 100%) is assumed to be significant. The effect sizes of the Demirjian method for different age groups were compared with those from the Willems method using a Student’s t-test. Statistical significant was inferred at p<0.05.

Results

Literature search

Fig 1 provides the flow diagram with details of how the identified studies were evaluated for final inclusion in this review. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) is an evidence-based minimum set of items for reporting in systematic reviews and meta-analyses [49]. PRISMA focuses on the reporting of reviews evaluating randomized trials, but it can also be used as a basis for reporting systematic reviews of other types of research, particularly evaluations of interventions [49]. The common reasons for exclusion were that studies used a different age range (greater than 12 months cohort range, or different age cohort ranges, such as 3.5–4.5), absence of standard deviations, or lack of information regarding the methods for estimating the dental age.

thumbnail
Fig 1. PRISMA 2009 flow diagram for systematic review with meta-analysis.

https://doi.org/10.1371/journal.pone.0186682.g001

All the cross-sectional studies met the inclusion criteria and were further analysed in this review. Information on these studies is provided in Table 1. Meta-analysis was performed on 28 published articles using the Demirjian and/or Willems methods to estimate chronological age in 14,109 children (6,581 males and 7,528 females) age 3–18 years in studies using the Demirjian method and 10,832 children (5,176 males and 5,656 females) age 4–18 years in studies using the Willems method. Most papers reported that the Demirjian method significantly overestimated the chronological age and was therefore not applicable for use in that specific population. This was observed in studies that used only the Demirjian method and also in studies that compared the Demirjian method to other methods such as the Willems method. The Willems method was found to be a more accurate tool to estimate chronological age (Table 1).

The Strobe 40 item checklist for included cross-sectional studies S1 Table provides the scores obtained when assessing the included studies. The item scores are not intended to be a reflection of the quality of the included papers [76], but are used to provide some insights on the methodological rigor of the individual papers. Most papers achieved scores of around 28, which has been used in previously published studies as an indication of high methodological quality [48].

Pooled meta-analysis of studies using the Demirjian method to determine difference in the dental age versus chronological age in males and females

The pooled effect estimates for ages 3–18 years in all the included studies were analyzed for males and females and a summary of the results obtained is presented in Figs 2 and 3. Considerable heterogeneity (I2 = 97% in males and 98% in females) was found in the pooled analyses for age groups 3–18 years. This can be explained by the pooling together of the ages and studies from different populations that have been found to grow at different rates [77]. Overall, the meta-analysis showed a significant weighted mean difference (WMD) between the dental age and the chronological age in males (WMD = 0.62 years, 95% CI (0.56, 0.66)) and in females (WMD = 0.72 years, 95% CI (0.69, 0.75)). For males (Fig 2), the majority of the studies reported significant overestimation by the Demirjian method. The exception is that of Zhai and colleagues [75], who reported a significant under-estimation of chronological age in males (WMD = -0.63 years, 95% CI (-0.85, -0.41). Three studies [53,56,69] reported no significant difference between dental age estimation and chronological age for males. For females, most studies reported overestimation of the chronological age; only two studies [56,75] reported underestimation of the chronological age (Fig 3).

thumbnail
Fig 2. Comparison of dental age and chronological age pooled for males using the Demirjian method.

https://doi.org/10.1371/journal.pone.0186682.g002

thumbnail
Fig 3. Comparison of dental age and chronological age pooled for females) using the Demirjian method.

https://doi.org/10.1371/journal.pone.0186682.g003

Meta-analysis of each age cohort of males and females demonstrated that the majority of the age cohorts had considerable heterogeneity (75–100%) with the exception of age cohorts 4 and 16 years in females. The heterogeneity may be due to the pooling of different studies into the meta-analyses. In males, significant overestimation of the chronological age by the Demirjian method was observed in the 3–15 year age cohorts. On the contrary, significant underestimation of the chronological ages was observed in the 16–18 year age cohorts (Table 2). Significant overestimation of the chronological ages of females was observed in all the age cohorts except 3 and 16–18 years where significant underestimation of chronological ages was observed (Table 2).

thumbnail
Table 2. Pooled effect estimates (dental age vs. chronological age) for ages 3–18 and sex using the Demirjian method.

https://doi.org/10.1371/journal.pone.0186682.t002

Pooled meta-analysis of studies using the Willems method to determine difference in the dental age versus chronological age in males and females

The pooled effect estimates of the Willems method for ages 4–18 in all the included studies were analyzed for males and females (Figs 4 and 5). Considerable heterogeneity (I2 = 85% in males and 93% in females) was detected in the pooled analyses for age groups 4–18 years. Again this can be explained by the pooling together of the ages and studies from different populations, as mentioned above. The meta-analysis showed significant difference between the dental age and the chronological age in males (WMD = 0.26 years, 95% CI (0.20, 0.32)) and in females (WMD = 0.29, 95% CI (0.24, 0.35)). Six studies reported significant overestimation in males while only four studies reported significant overestimation in females. Furthermore, three studies reported significant underestimation in males, while only one study [75] reported significant underestimation in females. Seven studies of males and 11 of females did not report significant differences (Figs 4 and 5).

thumbnail
Fig 4. Comparison of dental age and chronological age pooled for males using the Willems method.

https://doi.org/10.1371/journal.pone.0186682.g004

thumbnail
Fig 5. Comparison of dental age and chronological age pooled for females using the Willems method.

https://doi.org/10.1371/journal.pone.0186682.g005

Variation in heterogeneity of the included studies was observed for both males and females when the studies were pooled by sex and age cohorts. The I2 values ranged from “might not be important” (0–40%) to “considerable heterogeneity” (75–100%) in both males and females. Again, this can be attributed to the pooling together of different ages and populations. Meta-analysis of the age cohorts in males showed significant overestimation in age cohorts 5–14 years, while significant underestimation was found in age cohorts 16–18 years (Table 3). No significant differences were found between the dental ages and chronological ages of children in the age cohorts 4 and 15 years. In females, overestimation of the chronological age was observed in the age cohorts 5–8 and 11–13 years, while significant underestimation was found in the age cohorts 15–18 years (Table 3).

thumbnail
Table 3. Pooled effect estimates (dental age vs. chronological age) for ages 4–18 and sex using the Willems method.

https://doi.org/10.1371/journal.pone.0186682.t003

Pooled meta-analysis of studies comparing the Willems and Demirjian methods in males

At age 4 years there was no significant difference (p>0.05) in the effect size between the Willems and the Demirjian methods in age estimation. From age cohorts 5–14 years there were significant differences in the effect estimate between the two methods (p<0.001), with the magnitude of deviation of the dental age from the chronological age significantly greater with the Demirjian method compared to the Willems method (Table 4). It should be noted that the two methods overestimated the chronological ages for these age groups. The Willems method estimated age group 13 accurately, judging from the WMD of 0.00 found in this review. From ages 14–18 years, no significant difference (p>0.05) exists between the effect sizes of Demirjian’s method and the Willems method (Table 4). Overall, the Demirjian method significantly overestimated chronological age compared to the Willems method in males (p = 0.000).

thumbnail
Table 4. Comparison of the effect estimates (pooled for age cohorts) of the Demirjian and Willems methods in males.

https://doi.org/10.1371/journal.pone.0186682.t004

Pooled meta-analysis of studies comparing the Willems and Demirjian methods in females

There was no significant difference (p>0.05) in the effect estimate of the Demirjian and the Willems methods at age 4 years. However, significant differences were noted in the effect sizes of the two methods from ages 5–14 years (p<0.001), while no significant differences were noted for ages 15–18 years (p>0.05). Demirjian’s method overestimated chronological age from 4–14 years and thereafter underestimated ages for 15–18 years. The Willems method overestimated dental age from 4–13 years and thereafter underestimated the chronological age from 15–18 years (Table 5). Overall, the Demirjian method significantly overestimated the chronological age of the females compared to the Willems method (p = 0.000).

thumbnail
Table 5. Comparison of the effect estimates (pooled for age cohorts) of the Demirjian and Willems methods in females.

https://doi.org/10.1371/journal.pone.0186682.t005

Evaluation of heterogeneity and publication bias

No significant difference was noted in the sensitivity test done to determine the influence of individual studies on the overall effect size by omitting each study in turn. Funnel plots were generated to determine the publication bias of the included studies. Visual analysis of the funnel plots does not indicate any evidence of asymmetry as points are distributed across the baseline (Figs 6 and 7).

thumbnail
Fig 6. Funnel plots, Demirjian method.

Distribution of points across the baseline indicates symmetry. (A) Males. (B) Females.

https://doi.org/10.1371/journal.pone.0186682.g006

thumbnail
Fig 7. Funnel plots, Willems method.

Distribution of points across the baseline indicates symmetry. (A) Males. (B) Females.

https://doi.org/10.1371/journal.pone.0186682.g007

Discussion

Standards for growth and development are desirable for forensic, anthropological and clinical purposes [11]. Most methods for assessing growth and development, especially those based on the skeleton, are not highly reliable for estimating age due to the variability stemming from genetic and environmental factors. Dental development is viewed as a more reliable gauge for assessing the age of children and juveniles in forensic and anthropological contexts [20,78], although population variability in dental development has been reported [1317]. The accuracies of the methods derived from dental maturity, such as the Demirjian and Willems methods, for estimating chronological age across populations are still a subject of debate. Hence this systematic review focused on studies investigating the Demirjian and Willems methods in different populations with the aim of determining the method with a better accuracy.

A limitation of this review is the considerable heterogeneity observed in our results when the results were pooled and also stratified by age and sex. The reason could be due to differences in population characteristic in terms of differences in growth patterns. Furthermore, Demirjian and colleagues stated that their method is based entirely on a French Canadian population and that variation may occur when it is used in other populations. They therefore cautioned that although the stages of the dental maturity scoring system may be universal in application, population differences may affect the accuracy levels when maturity scores are converted to dental ages [20]. This observation highlights the need for population-specific standards for age estimation, especially for forensic and anthropological applications where there are demands for high levels of accuracy.

Comparison between chronological age and dental age using Demirjian’s method

This review found the Demirjian method significantly overestimates the ages of males and females aged up to 16 years by 0.62 and 0.74 years respectively. This level of overestimation from the Demirjian method makes it unsuitable for forensic purposes in other populations. Other systematic reviews found similar results of age overestimation with Demirjian’s method [48,79]. The overestimation was greater in females than in males. The reason for this difference is not clear from the meta-analysis, but it may be due to varying levels of sexual dimorphism or sex-based differences in environmental stresses.

The underestimation of the chronological age by the Demirjian method in age cohorts 16–18 years in both males and females is due to the non-availability of values for ages 16 years and above in the Demirjian conversion tables of maturity scores to dental age. By that age, all individuals have attained full maturity of the seven tooth (I1-M2) dental sequence. Hence, all ages above 16 years are underestimated.

Comparison between chronological age and dental age using Willems’ method

This review found no significant mean difference between dental age estimated by the Willems method and chronological age for the total sample. Overall the Willems method overestimated the chronological age of males by only 0.26 years, while it overestimated females by 0.29 years. This pattern is similar to the result for Demirjian’s method where the ages of females were overestimated more than the males. Similar to the Demirjian method, the Willems method cannot be used to estimate chronological age above 16 years because the upper limit of the total maturity score, which is the dental age of 15.77 years, has been achieved. Therefore anyone above the age of 16 years of age is underestimated.

Comparison between the Willems and Demirjian methods

This is the first systematic review and meta-analysis comparing the Willems and Demirjian methods. Significant differences between dental ages estimated by the two methods were found. The wide gap between the estimates of the two methods is due to the Demirjian method’s significantly overestimating the dental age in all age groups (except for older children aged 15–18 years, primarily due to the constraints of the method, as discussed above).

Based on our results, the Willems method may be used for age estimation for anthropological or forensic purposes in populations where specific reference values are unknown and the levels of accuracy reported here are deemed acceptable. Nevertheless, it is important to emphasize that both methods significantly overestimated chronological age. Hence, our results illustrate that there is a need for population-specific standards for age estimation when the highest levels of accuracy are required.

Variation in dental development in human populations: Implications for age estimation

The debate is still ongoing whether tooth development is influenced by factors such as nutrition, climate and chronic or infectious diseases. Studies of fluctuating dental asymmetry, thought to be caused by response to stresses, are inconclusive [80,81]. Although tooth size and basic morphology are generally perceived to be relatively immune to major disruptions compared to other growth indicators, the widespread presence of enamel hypoplasias in human populations attests to some level of disruption affecting dental morphology- one counter example among many. The investigation of differences in the timing of dental maturation is challenging. The relationship between malnutrition and tooth formation is difficult to evaluate, with some researchers reporting no effect of malnutrition on tooth formation [27,82,83], while others observed a delay in formation [41,84]. Such studies are based on selected proxies of nutritional status such as height, weight and body mass index (BMI). Well-designed studies on severely malnourished children are lacking and constrained by ethical considerations. Recent research on Southern African Black children documents significant differences in the timing of tooth formation in children of different BMI statuses (Esan and Schepartz, n.d.).

Fewer researchers have considered whether the timing of tooth formation varies significantly among human populations. The consistent pattern of variability in overestimation of ages documented by the published studies considered here suggests that variation in the timing of dental development may be influenced by genetic as well as environmental factors. Tables of tooth formation and age of attainment of specific developmental stages from one region of the world may not apply in a different setting, as is clearly demonstrated by our analysis. The documentation of significant variation in dental maturation among human populations, which is growing with expanded research that includes a broader range of populations, needs to be recognized and accounted for in the same way that skeletal and other aspects of growth variation are considered. When the highest levels of accuracy in age estimation are required, population-specific standards need be developed, rather than working toward a global standard.

In conclusion, the Willems method of dental age estimation provides a better and more accurate estimation of chronological age in different populations than the Demirjian method. The Demirjian scoring system has broad application in terms of determining maturity scores, but the accuracies of Demirjian age estimates are confounded by population variation when converting maturity scores to dental ages. Both of the methods reviewed here, when applied to other populations, do not yield a level of accuracy comparable to estimates from population-specific reference data, which should be employed when the highest accuracy is needed.

Supporting information

S1 File. Modified STROBE quality score system.

https://doi.org/10.1371/journal.pone.0186682.s001

(DOCX)

S1 Table. STROBE 40 item checklist scores for included cross-sectional studies.

https://doi.org/10.1371/journal.pone.0186682.s003

(PDF)

S1 Dataset. Esan et al systematic review data 19 December 2016.

https://doi.org/10.1371/journal.pone.0186682.s004

(XLSX)

S2 Dataset. Esan et al systematic review pooled results.

https://doi.org/10.1371/journal.pone.0186682.s005

(XLSX)

Acknowledgments

We thank Dr. Elizabeth Oziegbe for helping with the hand search of some articles. We are also very appreciative of the reviewer who devoted much effort to evaluating this paper and greatly enriched our perspectives on age estimation.

References

  1. 1. Kim YK, Kho HS, Lee KH. Age estimation by occlusal tooth wear. J Forensic Sci. 2000;45(2): 303–309. pmid:10782950
  2. 2. Yun JI, Lee JY, Chung JW, Kho HS, Kim YK. Age estimation of Korean adults by occlusal tooth wear. J Forensic Sci. 2007;52(3): 678–683. pmid:17456094
  3. 3. Kieser JA, Laing W, Herbison P. Lessons learned from large-scale comparative dental analysis following the South Asian tsunami of 2004. J Forensic Sci. 2006;51(1): 109–112. pmid:16423233
  4. 4. Perrier M, Bollmann M, Girod A, Mangin P. Swiss DVI at the tsunami disaster: Expect the unexpected. Forensic Sci Int. 2006;159: S30–S32. pmid:16600548
  5. 5. Schmeling A, Geserick G, Reisinger W, Olze A. Age estimation. Forensic Sci Int. 2007;165: 178–181. pmid:16782291
  6. 6. Schulze D, Rother U, Fuhrmann A, Richel S, Faulmann G, Heiland M. Correlation of age and ossification of the medial clavicular epiphysis using computed tomography. Forensic Sci Int. 2006;158: 184–189. pmid:16046092
  7. 7. Meijerman L, Maat GJR, Schulz R, Schmeling A. Variables affecting the probability of complete fusion of the medial clavicular epiphysis. Int J Legal Med. 2007;121: 463–468. pmid:17909834
  8. 8. Rios L, Weisensee K, Rissech C. Sacral fusion as an aid in age estimation. Forensic Sci. Int. 2008;180: 111.e1–111.e7. pmid:18707831
  9. 9. Baumann U, Schulz R, Reisinger W, Heinecke A, Schmeling A, Schmidt S. Reference study on the time frame for ossification of the distal radius and ulnar epiphyses on the hand radiograph. Forensic Sci Int. 2009;191: 15–18. pmid:19577387
  10. 10. Rios L, Cardoso HFV. Age estimation from stages of union of the vertebral epiphyses of the ribs. Am J Phys Anthropol. 2009;140(2): 265–274. pmid:19358290
  11. 11. Scheuer L, Black S. Developmental juvenile osteology. New York: Elsevier; 2000.
  12. 12. Suri L, Gagari E, Vastardis H. Delayed tooth eruption: pathogenesis, diagnosis, and treatment. A literature review. Am J Orthod Dentofacial Orthop. 2004;126(4): 432–445. pmid:15470346
  13. 13. Pahkala R, Pahkala A, Laine T. Eruption pattern of permanent teeth in rural community in North Eastern Finland. Acta Odontol Scand. 1991;49: 341–349. pmid:1776401
  14. 14. Willems G, Van Olmen A, Spiessens B, Carels C. Dental age estimation in Belgian children: Demirjian's technique revisited. J Forensic Sci. 2001;46(4): 893–895. pmid:11451073
  15. 15. Liversidge HM. Variation in modern human dental development. In: Thompson JL, Krovitz G, Nelson A, editors. Patterns of growth and development in the genus Homo. Cambridge: Cambridge University Press; 2003. pp. 73–113.
  16. 16. Liversidge HM, Chaillet N, Mörnstad H, Nyström M, Rowlings K, Taylor J, Willems G. Timing of Demirjian's tooth formation stages. Ann Hum Bio. 2006;33(4): 454–470.
  17. 17. Tunc ES, and Koyuturk AE. Dental age assessment using Demirjian's method on northern Turkish children. Forensic Sci Int. 2008;175(1): 23–26. pmid:17560060
  18. 18. Chaillet N, Nyström M, Demirjian A. Comparison of dental maturity in children of different ethnic origins: international maturity curves for clinicians. J Forensic Sci. 2005;50(5):1164–1174. pmid:16225225
  19. 19. Kearney M. The local and the global: The anthropology of globalization and transnationalism. Ann. Rev. Anthropol. 1995;24(1): 547–565.
  20. 20. Demirjian A, Goldstein H, Tanner JM. A new system of dental age assessment. Hum Biol. 1973;45:211–227. pmid:4714564
  21. 21. Demirjian A, Goldstein H. New systems for dental maturity based on seven and four teeth. Ann Hum Biol. 1976;3:411–421. pmid:984727
  22. 22. Demirjian A, Levesque GY. Sexual differences in dental development and prediction of emergence. J Dent Res. 1980;59(7):1110–1122. pmid:6966636
  23. 23. Oziegbe EO, Esan TA, Oyedele TA. Brief communication: Emergence chronology of permanent teeth in Nigerian children. Am J Phys Anthropol. 2014;153: 506–511. pmid:24323544
  24. 24. Kochhar R, Richardson A. The chronology and sequence of eruption of human permanent teeth in Northern Ireland. Int J Paediatr Dent. 1998;8(4): 243–252. pmid:9927925
  25. 25. Eskeli R, Laine-Alava MT, Hausen H, Pahkala R. Standards for permanent tooth emergence in Finnish children. Angle Orthod. 1999;69: 529–533. pmid:10593443
  26. 26. Moslemi M. An epidemiological survey of the time and sequence of eruption of permanent teeth in 4–15-year-olds in Tehran, Iran. Int J Paediatr Dent. 2004;14: 432–438. pmid:15525312
  27. 27. Elamin F, Liversidge HM. Malnutrition has no effect on the timing of human tooth formation. PLoS One. 2014;8(8): e72274.
  28. 28. Garn SM, Sandusky ST, Nagy JM, Trowbridge F. Negro-Caucasoid differences in permanent tooth emergence at a constant income level. Arch Oral Biol. 1973;18(5): 609–615. pmid:4515979
  29. 29. Clements EMB, Davies-Thomas E, Pickett KG. Time of eruption of permanent teeth in British children at independent, rural, and urban schools. Br Med J. 2009;1: 1511–1513.
  30. 30. Tanner JM, Whitehouse RJ. A new system for estimating skeletal maturity from the hand and wrist: With standards derived from a study of 2,600 healthy British children. International Children's Centre, 1962.
  31. 31. Haavikko K. Tooth formation age estimated on a few selected teeth. A simple method for clinical use. Proc Finn Dent Soc. 1974;70(1): 15–19. pmid:4821943
  32. 32. Hägg U, Matsson L. Dental maturity as an indicator of chronological age: the accuracy and precision of three methods. Eur J Orthod. 1985;7(1): 25–34. pmid:3856522
  33. 33. Davis PJ, Hagg U. The accuracy and precision of the “Demirjian system” when used for age determination in Chinese children. Swed Dent J. 1994;18: 113–116. pmid:8085218
  34. 34. Mörnstad H, Staaf V, Welander U. Age estimation with the aid of tooth development: a new method based on objective measurements. Scand J Dent Res. 1994;102: 137–143. pmid:8085119
  35. 35. Liversidge HM. Dental maturation of 18th and 19th century British children using Demirjian's method. Int J Paediatr Dent. 1999;9(2): 111–115. pmid:10530220
  36. 36. Baghdadi ZD, Pani SC. Accuracy of population-specific Demirjian curves in the estimation of dental age of Saudi children. Int J Paediatr Dent. 2012;22(2): 125–131. pmid:21895813
  37. 37. Celikoglu M, Cantekin K, Ceylan I. Dental age assessment: the applicability of Demirjian method in eastern Turkish children. J Forensic Sci. 2011;56: (s1).
  38. 38. Chaillet N, Willems G. Dental maturity in Belgian children using Demirjian's method and polynomial functions: new standard curves for forensic and clinical use. J Forensic Odontostomatol. 2004;22(2): 18–27. pmid:16223016
  39. 39. Lee SS, Ki DM, Lee S, Lee UY, Seo JS, Ahn YW, Han SH. Validity of Demirjian's and modified Demirjian's methods in age estimation for Korean juveniles and adolescents. Forensic Sci Int. 2011;211(1–3): 41–46. pmid:21561728
  40. 40. Maber M, Liversidge HM, Hector MP. Accuracy of age estimation of radiographic methods using developing teeth. Forensic Sci Int. 2006;159 (Suppl. 1): S68–S73.
  41. 41. Mani SA, Naing L, John J, Samsudin AR. Comparison of two methods of dental age estimation in 7-15-year-old Malays. Int J Paediatr Dent. 2008;18: 380–8. pmid:18284472
  42. 42. EL-Bakary AA, Hammad SM, Ibrahim FM. Comparison between two methods of dental age estimation among Egyptian children. Mansoura J Forensic Med ClinToxicol. 2009;17: 75–86.
  43. 43. Liversidge HM, Smith BH, Maber M. Bias and accuracy of age estimation using developing teeth in 946 children. Am J Phys Anthropol. 2010;143: 545–554. pmid:20623675
  44. 44. Pinchi V, Norelli GA, Pradella F, Vitale G, Rugo D, Nieri M. Comparison of the applicability of four odontological methods for age estimation of the 14 years legal threshold in a sample of Italian adolescents. J Forensic Odontostomatol. 2012;30: 17–25. pmid:23474505
  45. 45. Ramadan N, Thevissen P, Fleuws S, Willems G. Dental age estimation in Japanese individuals combining permanent teeth and third molars. J Forensic Odontostomatol. 2012;30: 34–9. pmid:23474507
  46. 46. Higgins JP, Green S, editors. Cochrane handbook for systematic reviews of interventions (Vol. 4). Hoboken, NJ: John Wiley & Sons; 2011.
  47. 47. da Costa BR, Cevallos M, Altman DG, Rutjes AW, Egger M. Uses and misuses of the STROBE statement: Bibliographic study. BMJ. 2011;1(1): e000048.
  48. 48. Yan J, Lou X, Xie L, Yu D, Shen G, Wang Y. Assessment of dental age of children aged 3.5 to 16.9 years using Demirjian’s method: A meta-analysis based on 26 studies. PloS One. 2013;8(12): e84672. pmid:24367690
  49. 49. Moher D, Liberati A, Tetzlaff J, Altman DG, Prisma Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. PLoS Med. 2009;6(7):e1000097. pmid:19621072
  50. 50. Ambarkova V, Galić I, Vodanović M, Biočina-Lukenda D, Brkić H. Dental age estimation using Demirjian and Willems methods: Cross-sectional study on children from the Former Yugoslav Republic of Macedonia. Forensic Sci Int. 2014;234: 187–e1. pmid:24262808
  51. 51. Asab SA, Noor SNFM, Khamis MF. The accuracy of Demirjian method in dental age estimation of Malay children. Sing Dent J. 2011;32(1): 19–27.
  52. 52. Bagherpour A, Imanimoghaddam M, Bagherpour MR, Einolghozati M. Dental age assessment among Iranian children aged 6–13 years using the Demirjian method. Forensic Sci Int. 2010;197(1): 121–e1.
  53. 53. Carneiro JL, Caldas IM, Afonso A, Cardoso HFV. Is Demirjian’s original method really useful for age estimation in a forensic context? Forensic Sci Med Pathol. 2015;11(2): 216–221. pmid:25700829
  54. 54. Cavrić J, Vodanović M, Marušić A, Galić I. Time of mineralization of permanent teeth in children and adolescents in Gaborone, Botswana. Ann Anat Anatomischer Anzeiger. 2016;203: 24–32. pmid:26342513
  55. 55. Djukic K, Zelic K, Milenkovic P, Nedeljkovic N, Djuric M. Dental age assessment validity of radiographic methods on Serbian children population. Forensic Sci Int. 2013;231(1): 398–e1.
  56. 56. Erdem PA, Yamac E, Erdem MA, Sepet E, Aytepe Z. A new method to estimate dental age. Acta Odontol Scand. 2013;71(3–4): 590–598. pmid:22783838
  57. 57. Feijóo G, Barbería E, De Nova J, Prieto JL. Dental age estimation in Spanish children. Forensic Science Int. 2012;223(1): 371–e1.
  58. 58. Flood SJ, Franklin D, Turlach BA, McGeachie J. A comparison of Demirjian's four dental development methods for forensic age estimation in South Australian sub-adults. J Forensic Legal Med. 2013;20(7): 875–883.
  59. 59. Galić I, Vodanović M, Cameriere R, Nakaš E, Galić E, Selimović E, Brkić H. Accuracy of Cameriere, Haavikko, and Willems radiographic methods on age estimation on Bosnian–Herzegovian children age groups 6–13. Int J Legal Med. 2011;125(2): 315–321. pmid:20878416
  60. 60. Hegde SAPNA, Patodia AKASH, Dixit UMA. Willems I vs Willems II: A comparative study of accuracy in 5–15 year old Indian children. Forensic Sci Int. 2016;266: 117–122. pmid:27258920
  61. 61. Ifesanya JU, Adeyemi AT. Accuracy of age estimation using Demirjian method among Nigerian children. Afr J Med Sci. 2012;41(3): 297–300.
  62. 62. Javadinejad S, Sekhavati H, Ghafari R. A comparison of the accuracy of four age estimation methods based on panoramic radiography of developing teeth. J Den Res Dent Clinics, Dental Prospects. 2015;9(2): 72.
  63. 63. Khoja A, Fida M, Shaikh A. Validity of different dental age estimation methods in Pakistani orthodontic patients. Aus J Forensic Sci. 2015;47(3): 283–292.
  64. 64. Kırzıoğlu Z, Ceyhan D. Accuracy of different dental age estimation methods on Turkish children. Forensic Sci Int. 2012;216(1): 61–67.
  65. 65. Koshy S, Tandon S. Dental age assessment: The applicability of Demirjian's method in south Indian children. Forensic Sci Int. 1998 94(1): 73–85.
  66. 66. Kumaresan R, Cugati N, Chandrasekaran B, Karthikeyan P. Reliability and validity of five radiographic dental age estimation methods in a population of Malaysian children. J Investigative Clin Dent. 2014;7(1): 102–109.
  67. 67. Leurs IH, Wattel E, Aartman IHA, Etty E, Prahl-Andersen B. Dental age in Dutch children. Eur J Orthod. 2005;27(3): 309–314. pmid:15947233
  68. 68. Mohammed RB, Krishnamraju PV, Prasanth PS, Sanghvi P, Reddy MAL, Jyotsna S. Dental age estimation using Willems method: A digital orthopantomographic study. Cont Clin Dent. 2014;5(3): 371–376.
  69. 69. Mohammed RB, Sanghvi P, Perumalla KK, Srinivasaraju D, Srinivas J, Kalyan US, Rasool SMI. Accuracy of four dental age estimation methods in southern Indian children. J Clin Diagnostic Res. 2015;9(1): 1–8.
  70. 70. Nik-Hussein NN, Kee KM, Gan P. Validity of Demirjian and Willems methods for dental age estimation for Malaysian children aged 5–15 years old. Forensic Science Int. 2011;204(1): 208–e1.
  71. 71. Patel PS, Chaudhary AR, Dudhia BB, Bhatia PV, Soni NC, Jani YV. Accuracy of two dental and one skeletal age estimation methods in 6–16 year old Gujarati children. J Forensic Dent Sci. 2015;7(1): 18–27. pmid:25709315
  72. 72. Urzel V, Bruzek J. Dental age assessment in children: A comparison of four methods in a recent French population. J Forensic Sci. 2013;58(5): 1341–1347. pmid:23822870
  73. 73. Uys A, Fabris-Rotelli IN, Bernitz H. Estimating age in black South African children. SADJ. 2014;69(2): 54–61 pmid:24974518
  74. 74. Ye X, Jiang F, Sheng X, Huang H, Shen X. Dental age assessment in 7-14-year-old Chinese children: Comparison of Demirjian and Willems methods. Forensic Sci Int. 2014;244: 36–41. pmid:25195126
  75. 75. Zhai Y, Park H, Han J, Wang H, Ji F, Tao J. Dental age assessment in a northern Chinese population. J Forensic Legal Med. 2016;38: 43–49.
  76. 76. Von Elm E, Altman DG, Egger M, Pocock S J, Gøtzsche PC, Vandenbroucke JP, Strobe Initiative. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. Prev Med. 2007;45(4): 247–251. pmid:17950122
  77. 77. Cohen JE. Human population: The next half century. Science. 2003;302(5648): 1172–1175. pmid:14615528
  78. 78. Liversidge HM. The assessment and interpretation of Demirjian, Goldstein and Tanner's dental maturity. Ann Hum Bio. 2012;39(5): 412–431.
  79. 79. Jayaraman J, Wong HM, King NM, Roberts GJ. The French–Canadian data set of Demirjian for dental age estimation: A systematic review and meta-analysis. J Forensic Legal Med. 2013;20(5): 373–381.
  80. 80. Perzigian AJ. Fluctuating dental asymmetry: variation among skeletal populations. Am J Phys Anthropol. 1977;47(1): 81–88. pmid:888937
  81. 81. Smith BH, Garn SM, Cole PE. Problems of sampling and inference in the study of fluctuating dental asymmetry. Am J Phys Anthropol. 1982;58(3): 281–289. pmid:7124921
  82. 82. Eid R, Simi R, Friggi M, Fisberg M. Assessment of dental maturity of Brazilian children aged 6 to 14 years using Demirjian's method. Int J Paed Dent, 2002. 12(6), 423–428.
  83. 83. Cameriere R, Flores-Mir C, Mauricio F, Ferrante L. Effects of nutrition on timing of mineralization in teeth in a Peruvian sample by the Cameriere and Demirjian methods. Ann Human Bio, 2007:34(5), 547–556.
  84. 84. Hilgers KK, Akridge M, Scheetz JP, Kinane DF. Childhood obesity and dental development. Pediatric Dent, 2006:28(1), 18–22.