A universal barcode system for land plants would be a valuable resource, with potential utility in fields as diverse as ecology, floristics, law enforcement and industry. However, the application of plant barcoding has been constrained by a lack of consensus regarding the most variable and technically practical DNA region(s). We compared eight candidate plant barcoding regions from the plastome and one from the mitochondrial genome for how well they discriminated the monophyly of 92 species in 32 diverse genera of land plants (N = 251 samples). The plastid markers comprise portions of five coding (rpoB, rpoC1, rbcL, matK and 23S rDNA) and three non-coding (trnH-psbA, atpF–atpH, and psbK–psbI) loci. Our survey included several taxonomically complex groups, and in all cases we examined multiple populations and species. The regions differed in their ability to discriminate species, and in ease of retrieval, in terms of amplification and sequencing success. Single locus resolution ranged from 7% (23S rDNA) to 59% (trnH-psbA) of species with well-supported monophyly. Sequence recovery rates were related primarily to amplification success (85–100% for plastid loci), with matK requiring the greatest effort to achieve reasonable recovery (88% using 10 primer pairs). Several loci (matK, psbK–psbI, trnH-psbA) were problematic for generating fully bidirectional sequences. Setting aside technical issues related to amplification and sequencing, combining the more variable plastid markers provided clear benefits for resolving species, although with diminishing returns, as all combinations assessed using four to seven regions had only marginally different success rates (69–71%; values that were approached by several two- and three-region combinations). This performance plateau may indicate fundamental upper limits on the precision of species discrimination that is possible with DNA barcoding systems that include moderate numbers of plastid markers. Resolution to the contentious debate on plant barcoding should therefore involve increased attention to practical issues related to the ease of sequence recovery, global alignability, and marker redundancy in multilocus plant DNA barcoding systems.
Citation: Fazekas AJ, Burgess KS, Kesanakurti PR, Graham SW, Newmaster SG, Husband BC, et al. (2008) Multiple Multilocus DNA Barcodes from the Plastid Genome Discriminate Plant Species Equally Well. PLoS ONE 3(7): e2802. doi:10.1371/journal.pone.0002802
Editor: Robert DeSalle, American Museum of Natural History, United States of America
Received: March 11, 2008; Accepted: June 23, 2008; Published: July 30, 2008
Copyright: © 2008 Fazekas et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was funded by a grant from Genome Canada through the Ontario Genomics Institute to the Canadian Barcode of Life Network. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The development of DNA barcoding markers for discriminating among the >300,000 species of land plants is an unresolved problem, in contrast to some other groups of organisms where effective barcoding markers are now available. A portion of the mitochondrial cytochrome c oxidase 1 (COI or cox1) gene sequence is currently being used as a universal barcode in certain animal groups , , but mitochondrial genes are generally thought to lack promise for plants –, primarily because of their low nucleotide substitution rates (e.g., ). It is generally agreed that a multilocus approach based on plastid (‘chloroplast’) data is currently the most effective strategy for species identification and species recognition in plants –, – (but see ). However, both the identity and number of the most appropriate regions for plant barcoding remain contentious (e.g., the competing proposals reviewed in ).
Plant researchers have proposed several different barcode regions. These focus on coding and non-coding regions located primarily in the plastid genome. Kress et al.  suggested that two non-coding regions (the nuclear ITS region and the plastid trnH-psbA intergenic spacer) may have potential as universal plant barcodes, but subsequently proposed the combination rbcL and trnH-psbA . Other combinations involving three plastid regions have also been proposed by a working group that includes the Royal Botanical Gardens, Kew, UK (http://www.rbgkew.org.uk/barcoding). These comprise the trnH-psbA region and portions of two coding regions (matK and rpoC1), or three coding regions combined (matK, rpoB and rpoC1) . Other regions, such as a portion of the plastid 23S rDNA locus (referred to as the “universal plastid amplicon” or UPA ), and the plastid trnL–trnF intergenic spacer  have been proposed. Additionally, it has been suggested that the mitochondrial cox1 locus not be discounted as a plant barcode marker without sufficient evidence (P.D.N. Hebert, University of Guelph, pers. comm.). Based on a study focused primarily on Orchidaceae, Lahaye et al. , recently proposed that matK be adopted “as a universal DNA barcode for flowering plants” (either alone or in combination with trnH-psbA), leaving its suitability for other plants largely unresolved. Finally, at a recent conference (Second International Barcode of Life Conference), the Plant Working Group of the Consortium for the Barcode of Life (PWG-CBOL) proposed additional combinations of non-coding and coding plastid regions (i.e., matK+atpF–atpH+trnH-psbA; matK+atpF–atpH+psbK–psbI; see ).
Because of the size of the task in establishing a reference barcoding database for all plants, it is widely accepted that a single (“universal”) set of barcode regions should be adopted. To date there has been no comprehensive empirical test of the utility of all gene regions and multilocus combinations currently under consideration. The assessment of different solutions is complicated by the multiplicity of ideas on what the most relevant criteria are for choosing among different single and multilocus barcoding strategies, and by lack of clarity about the weightings that ought to be placed on their relative importance. The amount of variation obtained per sequencing read is obviously a key parameter (the more the better, within limits). However, other technical considerations are likely to be at least as important, such as the ease of sequence recovery, the frequency of DNA sequencing artifacts, and the question of whether DNA sequence alignment is useful for identifying species using barcodes. The Barcode of Life Data System (BOLD, www.boldsystems.org ) currently relies on aligned sequences, but other alignment-independent algorithms have been proposed or are in development (e.g., , ).
Here, we compare the ability of nine different gene regions to discriminate among species within clades of closely related organisms — portions of five coding plastid regions (rbcL, matK, rpoC1, rpoB and 23S rDNA), three non-coding plastid intergenic spacer regions (trnH-psbA, atpF–atpH and psbK–psbI), and the mitochondrial cox1 gene (the animal barcode region). We tested these regions individually and in various combinations (including the most commonly proposed ones) for a diverse set of genera from major clades of land plants from temperate N. America. The surveyed genera include bryophytes, a lycophyte, and several monilophytes and gymnosperms, in addition to numerous angiosperms. Each species is represented by accessions from multiple populations.
We apply a distinct approach to evaluating species resolution here, by assessing whether clusters of populations that correspond to monophyletic species in a floristic sample are well supported (see  for a somewhat similar approach). A high degree of correlation should exist between support for species monophyly and the ability of DNA barcoding marker systems to discriminate species, since the robustness of the branch that subtends a single species (representing a monophyletic cluster of populations) determines whether that species is distinct from closely related species, at least within the limits of sampling error. Our survey necessarily focuses on gene-tree monophyly, because this is what is quantifiable using markers belonging to a single linkage group (e.g., the plastid genome). However, in a few cases we find evidence of gene-tree paraphyly that also raises questions about the monophyly of some sampled species. It is worth emphasizing that species assessed to have well-supported monophyly in a local context may not be monophyletic on a global scale (and in fact our locally focused sampling precludes testing this). Nonetheless, we argue that the strength of support for species monophyly in a local context provides a useful comparative framework (benchmark) for predicting the relative DNA barcoding success of different regions, or combinations of them in a larger sample. In addition, it provides an estimate of the upper bound to DNA barcoding success, since broader geographic sampling will only find more evidence against monophyly where such evidence exists.
In total, we obtained 2048 sequences from 251 samples (mean = 8.3 regions sequenced per sample) for the nine regions. Sequencing success averaged 91.9% overall, ranging from 72.0% for cox1 to 100% for rbcL and 23S rDNA (Table 1). The nine regions differed in the degree of technical complexity that was required to retrieve them. Success primarily depended on whether amplification product could be obtained using available primers. Non-seed plants (bryophytes, lycophytes and monilophytes) were generally the most difficult to amplify, particularly cox1 (where attempted), matK and psbK–psbI. In contrast, rbcL and trnH-psbA were readily retrievable for these taxa (Tables 2, S1). Overall, matK required the most effort, needing a larger number of primers than other regions to complete the sequences presented (although 10 primers were required in total for this region, we did not assay the comparative success of each PCR primer pair). In comparison, sequence recovery for the three non-coding regions involved only one primer pair each: almost all samples were amplifiable for trnH-psbA, with ~5–15% failure rates for atpF–atpH and psbK–psbI, respectively (Table 1; note that we did not attempt to design new primers for either region), and with a particular concentration of failures in bryophytes, monilophytes and lycophytes for psbK–psbI (Table 2). Two of three coding regions (rpoC1, rpoB) had intermediate levels (5–8%) of unsuccessful amplifications.
The total laboratory effort required for amplification is also affected by the number of sequencing reads required per region (summarized in Table 1). Considering only the successful amplifications, seven of the nine regions required more than two successful sequencing reactions to yield contigs with sufficiently high quality (only cox1 and 23S rDNA did not require resequencing). Three regions (matK, trnH-psbA and psbK–psbI) required the most effort, up to 50% additional sequencing beyond the minimum needed to obtain two-fold coverage (2.67–2.96 reads per contig; Table 1). These regions also had the highest degree of unidirectional coverage (~20–27% of samples with at least 20% unidirectional sequence; Table 1). When we experienced difficulty in obtaining bidirectional reads this was primarily due to the existence of homopolymer runs (e.g., sporadically for all non-coding regions, but also for matK in some instances).
Single region analysis
The percentage of species resolved as monophyletic was usually very poor for the mitochondrial cox1 and plastid 23S rDNA regions (10% and 7%, respectively) considered alone; each of these two regions was consistently outperformed by other single regions (Table 2) (except for cox1 in Plantago, a genus known to have elevated rates of mitochondrial nucleotide substitution ). Two coding regions, rbcL and rpoB, had similar overall rates of resolution to two of the non-coding regions, atpF–atpH and psbK–psbI (42–48%), but matK and trnH-psbA had the highest individual resolution rates overall (56% and 59%, respectively). Ignoring cox1 and 23S rDNA, several taxa were consistently resolved by all regions, considered individually (Plantago lanceolata, Polygonum convolvulus and all of the sampled species of Lactuca, Poa, Solanum and Trifolium). Most species outside the angiosperms and gymnosperms were consistently resolved by each region when we were able to generate data. In contrast, species of Betula, Erigeron, Solidago, Sonchus, Typha and most species of Symphyotrichum were not resolved by any single region.
Combining regions improved the proportion of species resolved as monophyletic within genus-level clades (Figs. 1 and 2; note that cox1 and 23S rDNA were not considered in these combinations). Species resolution was positively related to the amount of phylogenetically informative variation (parsimony informative characters, PICs, calculated within each genus and summed across them: Fig. 1; Table S2), and the number of regions used in combination (Fig. 2; Table S2). The variance among combinations decreased as more regions were combined, with the single, two and three-region combinations exhibiting the greatest variation (Fig. 2). Among two-region combinations examined, species resolution ranged from 50% with the rpoB+rpoC1 combination, to 64% using rbcL+trnH-psbA or matK+atpF–atpH. Among three-region combinations examined, species resolution ranged from 61% to 69% (matK+rpoB+rpoC1 had the lowest resolution; matK+atpF–atpH+psbK–psbI had the highest resolution). The success of species resolution reached an asymptote of 71% with increasing numbers of regions considered in each combination (Fig. 1). This plateau in performance was approached with four regions, with percentage species resolution barely changing with addition of further regions (Fig. 2).
The number of regions used per combination is indicated by different symbols and colors (see legend). The specific regions used in each combination are noted in Table S2 (note that the combinations exclude cox1 and 23S rDNA). Circled symbols correspond to combinations proposed in the recent plant barcoding literature (see text): 1) rbcL+trnH-psbA; 2) matK+rpoC1+rpoB; 3) matK+rpoC1+trnH-psbA; 4) matK+atpF–atpH+psbK–psbI; 5) matK+atpF–atpH+trnH-psbA. All regions are from the plastid genome (except cox1; mitochondrial genome).
Means (±SD) for two to six regions are based on the relatively arbitrarily chosen combinations of regions considered here (note that the plastid 23S rDNA locus and the mitochondrial locus cox1 were not considered in these combinations). Least square regression: R2 = 0.73; y = 0.52+0.11 ln x = 0.05 (ln x−1.1)2; F1,43 = 56.8, P<0.0001. Note: cpDNA = plastid DNA.
The bootstrap values generated from a seed-plant-wide alignment of the four coding regions using the ‘fast bootstrap’ option in PAUP* , generally agreed well with values generated using this gene combination for each genus considered separately. Our species monophyly estimates were all obtained in the context of individual genera (see Materials and Methods), and so it is notable that all genera were supported as clades at the current limited taxon samplings in analysis of this seed-plant alignment (data not shown). We next repeated the main analyses (performed within each genus) using more vs. less conservative bootstrap cut-offs (80% and 60%, instead of 70%) for considering a species to be well supported, to see whether this affected the overall results. We found these different cut-offs had little effect on maximum resolution (data not shown). With a 60% threshold, the resolution of some single regions and combinations of two and three regions increased towards the maximum level of resolution obtained (71%). Using an 80% threshold resulted in a slower approach to the plateau in performance, but the resolution was nearly identical with a ~70% threshold for all combinations of four or more regions.
We also re-evaluated the results described above by excluding all individuals with one or more missing regions (~23% of samples had at least one of the seven regions missing: ~8% had one region missing, ~10% two regions missing, and less than 2% of samples had 3–5 regions missing in each case, respectively). We used ANOVA to evaluate the joint effects of deleting samples and the number of regions on species resolution. As might be expected, the number of regions used had a significant effect (F6,76 = 40.6, P<0.0001) on percentage species resolution, whereas deleting samples had no effect (F1,76 = 0; P = 1). An insignificant interaction indicated that missing samples here had no effects on the relation between region number and species resolution (F6,76 = 0.13, P = 0.99).
Overall there were 27 species in our dataset that could not be resolved even with the seven-region combination. Of these, four (15% of unresolved species) are in two genera (Acer, Dryopteris) that show variation in the plastid regions, but in which one or more species are clearly not monophyletic. The remaining species (85%) are in groups that exhibit very little (or no) variation in the plastid regions examined, with identical or nearly identical multilocus barcodes shared by samples from different species. These include the species of Betula, Erigeron, Solidago, Sonchus, Typha and Symphyotrichum that were not resolved by any single region.
Species resolution differed among the five plastid DNA combinations proposed in the literature (Table 3), although the range was not large. The highest species resolution was observed in the combination matK+atpF–atpH+psbK–psbI (proposed by Ki-Joong Kim, School of Life Sciences and Biotechnology, Korea University, Seoul, Korea; see ), in which 69% of species were resolved and the lowest resolution (61%) was obtained from the combination rpoB+rpoC1+matK (proposed by Chase et al. ). There was considerable overlap among the combination categories, both in terms of the mean resolution and the number of parsimony informative characters, with several combinations of three regions falling in the 65–70% range (Figs. 1, and 2).
The search for a universal barcode for plants has generated intense debate within the botanical community, in addition to considerable public interest. Multiple solutions have been proposed in terms of the number and combination of barcoding regions, but no clear consensus has yet emerged (e.g., , ). To some extent, the difference of opinion is related to the criteria deemed most important for measuring barcoding success. A major factor in the failure to reach a consensus has been the lack of a satisfactory or standardized metric for assessing success in species assignment or discriminability . We agree with Kress and Erickson  that a plant barcoding system should be effective for all land plants, not just angiosperms, to permit their use in floristic and ecological applications. We also distinguish between the technical difficulties associated with retrieving each region from the relative success of each region or multilocus combination in species discrimination. Some previous studies have tended to confound these when quantifying barcoding success , , although both are important. Most of our discussion focuses on seven core plastid regions, as we readily ruled out two of the regions as standard solutions to plant barcoding (cox1, 23S rDNA) due to their poor ability to resolve species monophyly (Table 1; Fig. 1).
Ability to resolve monophyletic clusters that correspond to individual species
We used a metric that focuses on the monophyly of individual species; that is, the percentage of well-supported monophyletic species across our sample of taxa. Based on this criterion we demonstrate that no single barcoding region has an ability to resolve species to the same degree as almost any of the multilocus barcoding solutions we evaluated (Fig. 1, Table S2; note that a few two-gene combinations were poorer than trnH-psbA or matK alone)
A single-locus solution to plant barcoding is therefore substantially less effective than a multilocus system, and the variation in resolving power between most multilocus systems is marginal, at best, particularly when four or more loci are considered. The small differences that we observed at this level of combination are likely a function of the particular sampling of taxa we surveyed, although it is probable that a larger sampling of taxa would provide finer-scale comparisons of success rates. We examined all combinations of loci that were recently proposed at the Second International Barcode of Life Conference (see ). These all performed about as well as each other, ranging from a low of 61% (matK+rpoC1+rpoB) to a high of 69% (matK+atpF–atpH+psbK–psbI) (Fig. 1, Table 3), just below the maximum observed (71%). A number of additional combinations of two and three gene regions also fall into this range (Fig. 1, Table S2). When only one or two barcoding regions are considered, species resolution is moderately to strongly related to the number of parsimony informative characters. The strong but declining relationship between the number of regions used and the mean percentage of species resolved (Fig. 2) reinforces the point that species resolution is less dependent on the particular regions used than the number of regions. While the general shape of the curve is predicted by combining data in this manner, the observed reduction in variance with additional regions indicates that most of the multilocus combinations discriminate nearly the same number of species. All else being equal (i.e., setting aside technical differences related to the ease of retrieval of DNA barcodes from samples), it follows that the component regions in these multilocus combinations are largely interchangeable in any multilocus plastid-based DNA barcoding system that consists of more than two loci.
It could be argued that the plateau in species resolution and reduced variance that occurs with increasing numbers of loci may be due, in part, to the high number of regions shared among different multi-locus comparisons. We do not doubt that this is a contributing factor. However, comparable rates of resolution were seen when we considered independent combinations that shared no regions in common. For example, among those combinations assessed here (Table S2), the mean resolution for all independently drawn two-locus combinations (mean of three independent pairs drawn three different ways from the eight possible pairs; Table S2) was 61%, and resolution for all independent three-locus combinations (mean of two independent triplets drawn four different ways from the eight possible triplets; e.g. rpoB+rpoCI+rbcL and trnH-psbA+atpF–atpH+psbK–psbI; Table S2) was 65%. These values are comparable to the means of 60% and 65% for two and three locus combinations (Fig. 2), which include some lack of independence. While it is possible that some unexamined two- or three-region combinations might work better than those considered, an exhaustive comparison of all possible combinations is unlikely to yield combinations that will be more successful across all land plants.
Species resolution is likely limited both by lack of resolving power for monophyly (reflecting rapid successive speciation events) and by ambiguities in species boundaries (a consequence of various “paraphyly” issues; see below). Unexamined regions of the plastid genome are unlikely to resolve the first problem, as the current regions were chosen for their relatively rapid rate of evolution  and they will all be similarly affected by phenomena like failed coalescence and introgression, wherever these may occur. Although species resolution and the number of informative characters are well correlated, the best single gene regions did not necessarily perform the best in combination. For example, the two best single gene resolution rates were attained with matK and trnH-psbA (56% and 59%, respectively), however both rbcL+trnH-psbA, and matK+atpF–atpH had marginally better resolution than matK+trnH-psbA (both 64%, versus 63%). Examination of the particular species resolved by these combinations reveals that not all regions are complementary. Certain species are resolved only by inclusion of differing sets of specific regions; even the worst performing region (rpoC1) provided informative characters for some species for which the best performing region (trnH-psbA) did not. This suggests that regardless of the region(s) ultimately adopted for plant barcoding, there will always be some species that would be better resolved by some other region. The success of a given region or combination is therefore likely to be in part an idiosyncratic function of the set of taxa surveyed.
Predicting barcoding success based on the monophyly of species
We assessed the various proposals for plant DNA barcoding using the percentage of well-supported monophyletic species across our sample of taxa as a criterion for predicting successful species resolution. Does this constitute a rigorous method for comparing gene regions? The relation between bootstrap support for species monophyly in a gene tree and barcoding discrimination should be tightly linked: clearly, when a species is not confidently distinct from related species, new sequences may not be reliably assignable to the “correct” species. In effect, bootstrapping provides a measure of the expected mis-assignment due to local homoplasy, or of assignment failure due to simple lack of evidence of species monophyly. It measures the strength of support (“confidence”) for the species branch: If there is no clear evidence for this, a confident assignment may not be possible by any barcoding assignment method, unless, perhaps, one is certain that all relevant haplotypes have been sampled (although see ). It follows that “consistent non-zero sequence variation that distinguishes two species”  may not practically distinguish closely related species if one or more of these species is nested in another ( = non-monophyly), or if there is at least the possibility that they are. Our results also suggest that the branch separating two species may often be too short to detect with reasonable quantities of plastid data (29% of species not resolved, even with seven loci combined). Few would currently accept that a system with more than seven loci would be suitable as a universal plant barcode.
There are several possible complications with using bootstrap support for species monophyly as a metric for measuring barcoding success. First, not all species may be mutually monophyletic with their closest relatives. For example, one species may in practice be nested within another, making the latter paraphyletic at the species level (e.g., speciation of peripheral isolates, and the plesiospecies-apospecies concept of Olmstead ). Even when species are mutually monophyletic across much of their genomic complement, “mis-assignment” of individuals to the “wrong” species cluster for a given barcode (single or multi-locus) may reflect coalescence failure, introgression of the particular linkage group under study, or repeated origins of polyploid species (e.g., ). We noted any strongly supported paraphyly when we encountered it. However, these various “paraphyly” phenomena, reflecting the often complex genetics of plant species, should affect all plastid loci equally, as this genome is a single genetic linkage group. Because these phenomena should act consistently across plastid loci in a given sample of plants, they can be effectively ignored in our comparisons of the relative efficacy of different plastid regions or combinations in resolving monophyly.
Second, a related problem is that the bootstrap support criterion measures monophyly only in the context of the surveyed samples, and necessarily ignores the possibility that unsampled individuals from the same or different species might have disrupted monophyly had they been sampled (e.g., due to unsampled paraphyly, coalescence failures, or successful introgression events). Indeed, paraphyly, broadly construed, is thought to be a widespread phenomenon in plants , . Because of this, the maximum set of species we resolved as monophyletic undoubtedly includes false positives, but this should affect all current barcoding methods that use comparable loci and taxon sampling. Current assignment methods may implicitly assume reciprocal monophyly of closely related species (e.g., comparison of within vs. between species variation); here, we noted only four species that approach well-supported paraphyly (Acer rubrum, A. saccharinum, Dryopteris carthusiana, D. intermedia). The geographic taxon sampling strategy we employed might generally be expected to upwardly bias the support for monophyly, since it does not sample all of the biological complexity of each species and all its relatives across their range. We attempted to mitigate this by examining multiple sets of closely related species, where possible, and by including representatives from at least two geographically disjunct populations. Within the limits of our local floristic sampling, we can only partly control for the bias, but again, this should affect all plastid regions equally, given their location on the same linkage group.
Third, all the assessments we made were in analyses that focused on individual genera, because it was not possible to unambiguously align non-coding regions beyond the genus level. The actual placement of the relevant root branch for a genus ( = local clade at the current taxon sampling) was therefore untested in these unrooted analyses by design, and may in reality sometimes fall inside one of the clusters corresponding to individual species. This would also have the effect of biasing our support values upwards, since we may have recognized some between-species splits that are not real. However, in general where we observed well supported taxon splits within genera, these also corresponded to monophyletic species in a combined analysis of a seed-plant alignment of the four coding regions (see Results), suggesting that this source of bias, if it occurs here at all, may be minor. This effect should be consistent across plastid data sets, again a function of their genetic linkage.
Finally, we do not necessarily intend the species-monophyly support measure to be a general assignment tool in barcoding applications, as bootstrapping and related approaches (e.g., jackknifing) are computationally demanding, although bootstrapping without branch swapping (“fast bootstrapping”) can be performed relatively rapidly for large alignments, and provides a conservative estimate of branch support . More rapid assignment criteria such as those used in BOLD may be preferred in barcoding applications. However, we use species monophyly here as a metric for comparing the efficacy of different regions in the context of our very incomplete species and population sampling. We note that it is estimated that there are 320,000–400,000 species of seed plants alone , , and only a small fraction of these have been examined to date for barcoding markers.
Paraphyly and limits to plant barcoding
One of the strengths of our study is the consistent inclusion of multiple samples for species, and multiple species per genus. These are critical components of any evaluation of potential barcoding regions, which have often been lacking in previous studies. While failure is usually ascribed to lack of variation between species, this is only one possible explanation. In this data set, we estimate that 4 of 27 (15%) of the total monophyly failures are not due to lack of detected variation, but rather to “paraphyly” (of whatever source) in the trees examined. The failures due to paraphyly include two species of Acer (A. rubrum, A. saccharinum), and two species of Dryopteris (D. carthusiana, D. intermedia). The paraphyly in Dryopteris is particularly well supported (e.g., 96–100% with three or more loci; data not shown), but paraphyly of two species in Acer is supported by only three parsimony informative characters when all seven regions are included (bootstrap support 75–86%).
Although we compared the largest number of congeneric species and regions to date, our absolute species number is still small in the context of an entire flora. It should be emphasized that as a result of our “thinly sampled” experimental design (relative to land-plant phylogeny as a whole), the maximum resolution that we report here should tend to be on the upper end of what is possible with a broader sampling of species and populations in the clades we considered. However, our maximum (71%) is lower than other values that have been reported in plant barcoding studies. Some of these studies may be biased as a result of having included too few close relatives. For example, although the recent study by Lahaye et al.  reports a 90% success rate for matK, they include a number of genera, and even some families, represented by only a single species (see ). The very large interspecific distances that result from this approach have the potential to inflate support for species monophyly (e.g., where two distant taxa are each other's closest relatives in a given survey). Conversely, we have not shied away from including congeneric species of taxonomically complex groups that are morphologically difficult to distinguish as a method of challenging the proposed regions. We estimate that exclusion of the two most intractable genera in our data set (Solidago, Symphyotrichum) would result in an increase in resolution of approximately 10% for all of the single gene regions and combinations. However, the inclusion of more populations per species or more species per genus would generally be expected to decrease it.
Technical problems with the proposed regions
MatK is present in a number of previous barcoding proposals and has been suggested as sufficient for the task of barcoding plants . In our study, matK provided among the highest species resolution of any single region; however, its success is complicated by the technical difficulties in retrieving sequences (Table 1). Despite the considerable effort that we made to retrieve it across all individuals (several sets of new primers, different sequencing chemistry) matK had a relatively low amplification success (88%), Lahaye et al.  reported that amplification in matK was straightforward with a single primer set. To test their claim of primer universality, we attempted to amplify all our samples with the primer set they used. We achieved <50% success in these comparisons. Similar difficulties have been reported by Kress and Erickson  and Sass et al. . The Plant Working Group (http://www.kew.org/barcoding/update.html) and Ki-Joong Kim (pers. comm.) (Table S1) have put considerable effort into designing a number of primers targeting matK to address this problem. However, most of these have been designed for seed plants; as can be seen in Table 2, much of our missing data for matK is in the remaining land plants. With a limited amount of data available for matK in these groups, additional effort may be required for primer design. As our data collection phase coincided with development and publication of primers from other researchers, we did not perform comprehensive evaluations of the available primer sets. Nonetheless, it is fair to say that no universal (or nearly so) set of primers for amplifying matK currently exists.
We believe that a high percentage of bidirectional reads will be critical for a successful plant barcoding system, given the generally low amount of variation that separates many plant species , , and the increased danger of mis-assignment due to sequencing error that can be anticipated with incomplete bidirectional reads. Sporadic homopolymer runs regularly prevented us from obtaining fully bidirectional reads for two of the non-coding regions (trnH-psbA and psbK–psbI) and one of the coding regions (matK, mostly restricted to two genera); these three regions had by far the highest percentage of partly unidirectional reads (Table 1).
Maximum variation in the adopted barcode region(s) is clearly critical. From this perspective, non-coding regions are particularly important, as they tend to have the most variation (Table 1). However, they are also typically too difficult to align among distantly related organisms. The inclusion of highly variable non-coding regions generally precludes global sequence alignment across land plants, or even angiosperms. This introduces a new set of challenges, as the current Barcode of Life Data System (BOLD, www.boldsystems.org ) relies on distance measures generated from aligned sequences. The metric we used for predicting the assignment success of barcoding markers also requires alignments. An accurate alignment also facilitated the detection of short inversions in each of the non-coding regions examined. We noted small inversions in some sequences of the non-coding regions: Four inversions were seen in the trnH-psbA intergenic spacer (one each in the genera Quercus and Brachythecium, and two in Pinus); Plantago, Salix and Juniperus had one inversion each in psbK–psbI; Solanum had one inversion in atpF–atpH. While the inversions we noted were all species-limited for the current sample, their presence can be problematic . Short inversions can re-invert with a high frequency (e.g., ), potentially yielding polymorphisms within one or more species. When inversions are not detected, this could lead to parallel inversion alleles from closely related species becoming artificially clustered together.
Our comparative survey focused on individual genera, because we were generally not comfortable aligning most of the non-coding regions beyond the level of genus. This contrasts with Lahaye et al. , who aligned one of the non-coding regions, trnH-psbA, from taxa across several orders. While this may be possible in a subset of cases, alignment of non-coding barcoding regions will be generally intractable across broader levels of phylogeny. Database support for non-coding regions may soon be provided, as BOLD is now providing support for ITS as a barcode for fungi. However, the debate on how to handle non-coding regions from a bioinformatics perspective is not settled (e.g., , , ). From the perspective of land plant alignments, matK is also problematic, as it was difficult to align seed plants with other land plants (e.g., the seed plant alignment took about two person days to complete and carefully check for the current small sample of taxa).
A universal plant barcode should include multiple regions. From the perspective of species resolution, the identity of the regions used is less important than the number. It should also be recognized that there are fundamental upper limits to what is possible for any current plant DNA barcoding approach. An ideal system should come close to these limits, and include markers that are straightforward to amplify, sequence and align. Unfortunately, none of the individual barcoding markers currently proposed simultaneously satisfy all these criteria (and it is unlikely that other single plastid markers exist that would). For example, in our study each coding region required at least two primer pairs (up to 10 for matK) and some (matK) required adjustment of PCR conditions; only rbcL was amplifiable in all individuals assessed here, and it was typically one of the least problematic for sequencing (but it and the other coding regions are considerably less variable than matK or the non-coding regions). RpoB and rpoC1 were moderately more difficult to handle than rbcL; amplification failures were as high as 8% for rpoB, and rpoC1 yields the fewest informative characters of the seven core regions we compared. Currently proposed non-coding regions have a variable rate of amplification from the single primer pairs we considered in each case (trnH-psbA was the best performing, with nearly 100% amplification; closely followed by atpF–atpH, with 4% failed amplifications). We experienced less sequencing and alignment problems for atpF–atpH than the other non-coding regions; i.e., it has a substantially higher frequency of bidirectional reads, fewer sequencing reads per amplification product, and (compared to trnH-psbA) fewer micro-inversions.
How, then, to proceed? Ignoring the technical issues related to DNA barcode retrieval, there are multiple multilocus plant DNA barcoding combinations that perform about equally well in resolving species. However, the debate about which combination of regions is “best” should now be focused more strongly on these sorts of practical issues. Based on our survey of nine candidate barcoding loci, we suggest that a multilocus plant barcoding region should have multiple regions chosen from among three of the coding (rbcL, rpoB, matK) and two of the non-coding regions (trnH-psbA, atpF–atpH). This should still be considered a flexible shortlist. For example, while rpoC1 might be dropped from consideration due to its lower levels of variation, and psbK–psbI because of its higher failure rate in amplification and sequencing, these sorts of decisions boil down to the weights one is willing to place on different criteria for inclusion. If a heavy weight is placed on alignability (required for tree-based identification, which is recommended when sampling is sparse ), or the ability to produce fully bidirectional sequences, this would favor all of the coding regions except matK. If a high premium is placed on raw variation, then a multilocus barcode should include one or more non-coding regions. Critically, while we would suggest that matK continue to be considered given its high variability, this comes with the strong caveat that the significant technical issues for this locus, particularly relating to amplification (primer universality, especially, but not exclusively, for plants other than angiosperms), must be addressed in short order.
We demonstrate that three, and perhaps four regions yield close to optimal discriminating ability. Setting aside the technical challenges involved in obtaining and analyzing the regions it is clear that there are only marginal differences in the resolution possible with such combinations. Some may feel reluctant to consider more than two loci because of the greater costs involved. However, in our experience the main costs for barcoding relate to sample acquisition and processing (identification, DNA extraction), which are one-time costs that depend on the salaries of expert personnel. Indeed, as the costs of PCR and sequencing costs continue to decline rapidly relative to collecting expenses, the overall proportion of costs associated with them should become less of a concern. We therefore recommend that more regions than two should be preferred, because of the reduced variation in barcoding success in systems with three or more regions (Figs. 1 and 2), and because of the improved redundancy that this would provide when one or more regions cannot be recovered with satisfactory quality. Missing regions had no statistically significant effect here (see Results), but this could be misleading, as we made a substantially greater effort to reach a ‘complete’ sampling than might be feasible in real-world DNA barcoding applications (see Tables 1, S3). Additionally, if more conservative thresholds for support were favored, this would also tend to require the use of more loci. We hope that the practical issues related to our ability to deal with non-coding regions from a bioinformatics perspective can be satisfactorily resolved in the near future. If they cannot, a barcoding system with a higher proportion of readily alignable coding regions should be preferred, with little if any reduction expected in barcoding success. It is vital that the plant barcoding community adopt a consistent subset of regions as soon as possible to enable the assemblage of a global barcode database, permitting its application in floristic and ecological research.
Materials and Methods
We sampled 92 species representing 32 genera primarily from locations in southern Ontario, Canada (Table S3). Our sampling over-represents some groups (gymnosperms, lycophytes) relative to the total number of land-plant species in these major clades (i.e., <1% in each case), and it is richest within the angiosperms, which are by far the largest group of land plants. In addition, although the number of true sister species pairs may be relatively low in the Ontario flora, our selection of taxa includes cases that are quite challenging for routine morphological identification, and which may also present a considerable challenge for barcoding (e.g., Rubus, Salix, Solidago, Symphyotrichum) due to hybridization (e.g., –), polyploidy (e.g., , ), and agamospermy (e.g., ). The selection of species for our study was based on a survey of the flora of the Koffler Scientific Reserve (KSR) at Jokers Hill near Newmarket, in Southern Ontario (44°03′N, 79°29′W). We selected genera that were each represented by at least two species, where we could sample each species from at least one other location outside the reserve (each location >80 km apart) (Table S3), giving a total of 251 individuals. The taxa we chose represent some of the most common species in the landscape of the region, including those most likely to be encountered during ecological/floristic applications of barcoding. The resulting complement of taxa contains sets of species that, based on our review of the literature and knowledge of the flora, exhibit potential for hybridization (e.g., Acer), polyploidy (e.g., Dryopteris), and phenotypic similarity (e.g., Solidago) that often make them difficult to tell apart using morphology. Specimens were mounted on herbarium sheets, photographed and stored at the University of Guelph Herbarium as barcode vouchers. For each specimen, we collected 3–5 cm2 of leaf tissue in the field stored in silica gel for DNA isolation.
DNA isolation and amplification
For each sample, we isolated total genomic DNA from approximately 10 mg of dried leaf material using DNeasy 96 Plant Kits (QIAGEN) following manufacturer instructions. We performed DNA amplification with various annealing temperatures depending on the primers used (Table S1). In some instances the primer pairs available at the outset of the study did not work well for specific taxonomic groups. In particular, we designed new primers for both rbcL, and cox1 and several sets of taxonomically-specific primer sets for matK, rpoB and rpoC1 (Table S1). We did not test all the possible primer combinations on all samples, but rather designed primers for taxonomic groups as needed.
DNA was amplified in 20 ul reaction mixtures containing 1 U AmpliTaq Gold Polymerase with GeneAmp 10× PCR Buffer II (100 mM Tris-HCl pH 8.3, 500 mM KCl) and 2.5 mM MgCl2 (Applied Biosystems, Foster City, CA), 0.2 mM dNTPs, 0.1 µM of each primer (0.5 µM for matK), and ~20 ng/ul template DNA. We sequenced amplification products directly in both directions with the primers used for amplification, following the protocols of the University of Guelph Genomics facility (http://www.uoguelph.ca/ib/facilities/Genomics/GenomicsFacility.shtml). For many of the matK amplification products, we encountered significant sequencing problems. The use of DMSO in the sequencing mix as suggested by Royal Botanic Gardens, Kew, UK  was helpful in some cases, but several samples required the use of dGTP BigDye Terminator (Applied Biosystems, Foster City, CA) sequencing mix. We cleaned sequence products from each specimen on Sephadex columns and ran the samples on an ABI 3730 sequencer (Applied Biosystems, Foster City, CA). We obtained bidirectional sequence reads from most PCR products, but in some cases either the forward or reverse sequencing reaction consistently failed, or only a partial sequence was recovered, frequently due to homopolymer runs. For these samples, a minimum of two-fold coverage was obtained by repeating the sequencing reactions in the direction that was successful initially, an approach that may, however, lead to more unrecognized sequencing errors than is possible with bidirectional reads. The mean number of reads performed per region, and the proportion of sequence with <80% bidirectional coverage is indicated in Table 1.
We assembled and base-called sequences using Sequencher 4.5 (Gene Codes Corp, Ann Arbor, MI), and aligned them manually using Bioedit version 7.0.9  or Se-Al version 2.04  following criteria laid out in Graham et al. . For rpoB, rpoC1, rbcL, cox1 and 23S rDNA it was possible to make global alignments with all samples. For matK, it was possible to align sequences of taxa across seed plants, but not outside them (alignments were then performed for each genus). Sequences from the non-coding regions (trnH-psbA, atpF–atpH, and psbK–psbI) were usually only readily alignable within genera, and so we did not attempt higher-order alignments for them. We therefore performed the main analyses (see below) separately for each genus
Four coding regions (rpoB, rpoC1, rbcL and matK) required the use of multiple primer sets for amplification. Consequently, the portion of these regions that was sequenced varied somewhat among taxonomic groups, depending on the primer set used. To minimize the amount of missing data in the resulting alignments, a small proportion of nucleotides at the 5′- and 3′-ends of the matrix for these four regions were excluded prior to analysis (to a point where at least 50% of sequences were full length on each edge). Because global alignments were not obtained for the non-coding regions, we simply included the entire sequence for each genus (ignoring incorporated primers, as usual). The nucleotide positions of the regions included in our analyses are provided in Table 1, relative to coordinates for corresponding genes in the plastid and mitochondrial genomes of Arabidopsis thaliana.
To estimate whether a species ought to be resolvable (discriminable) for a given genomic region or combination, we scored how well supported the monophyly of individual species was in bootstrap analysis of each genus (see also ). We used a reasonably conservative numerical cut-off (≥70%) (see , ) to define support for “successful” resolution as a monophyletic species. For a given region or combination we then determined the proportion of well-supported monophyletic species as a percentage of the total number of species. To determine whether using a different bootstrap threshold value would affect our overall results, we also calculated total resolution using more or less conservative (60% and 80%, respectively) thresholds
We performed bootstrap analyses on each genus  in PAUP*  using maximum parsimony, with MaxTrees set at 500, and with a single random addition replicate for each of 500 bootstrap replicates. We recorded the bootstrap values for each monophyletic species (or rather, taxon split in unrooted genus trees), and the number of parsimony informative characters per genus. For each gene region, we calculated identification success (species resolution) as the number of species forming monophyletic groups with bootstrap values 70% or greater, divided by the total number of species for which sequences were obtained (see Table 1).
The trees that we scored are unrooted and so genera that contain only two species were separated (if resolved) by a single branch, with a single bootstrap value. In these situations, we applied the bootstrap value to each species. To assess whether taxon splits on unrooted trees generally correspond with monophyletic species in rooted trees, we generated bootstrap values from a global alignment of the four coding regions for the seed plants (angiosperms and gymnosperms), and compared the profile of resolved species to what we saw when for each genus considered separately for the same four-region combination.
To assess the effect of multi-region combinations on species resolution, we selected a subset of the possible two-, three-, four-, five- and six-region combinations, in addition to the seven-region combination for analysis (Table S2) (cox1 and 23S rDNA were excluded because of their low individual success, see Results). We chose specific combinations such that: 1) all five previously proposed barcode combinations  were included; 2) there were seven to eight different combinations for each multi-region set (two regions, three regions etc.); 3) the number of times that a given region was represented within each set was uniform, or nearly so; and 4) each set included the coding and non-coding combinations we expected to be least and most able to resolve species. In total, we analyzed 38 multi-region combinations in the same manner as the individual regions. We plotted species resolution for each of the resulting 47 comparisons (single regions and multi-region combinations) against the total number of parsimony-informative characters (PICs) summed across the genus-level analyses, which we used as a measure of the amount of information per region. We did not pro-rate the PICs by the sequence length in these comparisons (lengths of each region are variable, particularly for non-coding regions), since the most important outcome from a barcoding perspective is the amount of information retrieved for a region, not the amount of information per nucleotide sequenced. To determine the relation between number of regions used in the analysis and species resolution, we also performed a least-squares regression using JMP IN version 5.1.2 (SAS Institute Inc., SAS Campus Drive, Cary, NC.
To examine any potential bias in the estimates of total resolution due to missing data we repeated the analyses, excluding any samples that had data missing from any one of the regions of a multi-region set. Using JMP software (SAS Institute Inc., SAS Campus Drive, Cary, NC) we used ANOVA to evaluate the effects of method of analysis (species deleted versus not deleted), number of regions and their interaction on species resolution (JMP IN software, version 5.1.2, SAS Institute Inc. Cary, NC).
Primer sequences and PCR conditions for eight plastid genomic regions and one mitochondrial region. PCR and sequencing reactions followed standard procedures described in the text; annealing temperatures varied among primers. See Table S3 for a complete list of species. 1Not all primer combinations were tested on all samples. Primers from: †; ††; ‡; *This paper; **Ki-Joong Kim, School of Life Sciences and Biotechnology, Korea University, Seoul, Korea, unpublished primers kimkjkorea.ac.kr; ***; ¶.
(0.08 MB DOC)
Regions and combinations analyzed, with total number of parsimony informative characters (summed across genus-level comparisons) and species resolution (percentage of species supported as monophyletic with at least 70% bootstrap support). Single and combined regions are presented in order of increasing species resolution.
(0.10 MB DOC)
GenBank and collection accession numbers for species sampled.
(0.65 MB DOC)
We thank the Canadian Centre for DNA Barcoding at Biodiversity Institute of Ontario and the University of Guelph Sequencing Facility for sequencing support, and the Koffler Scientific Reserve at Joker's Hill, Royal Botanical Gardens, Bruce Peninsula National Park, Ontario Ministry of Natural Resources, Algonquin Provincial Park, Municipality of Wellington County and the Long Point Region Conservation Authority for providing access for plant collections. Annabel Por and John Gerrath helped with collections, and the staff of the University of Guelph Herbarium (OAC) provided help with collection and specimen preparation. Ki-Joong Kim graciously provided primer sequences for three of the plastid regions before publication. Finally, we thank Paul Hebert for support and encouragement.
Conceived and designed the experiments: AF KSB PRK SG SGN BH DMP MH SCHB. Performed the experiments: AF KSB PRK. Analyzed the data: AF KSB PRK SG SGN BH. Contributed reagents/materials/analysis tools: SG SGN BH. Wrote the paper: AF KSB PRK SG SGN BH SCHB. Co-led the analysis and writing: SG.
- 1. Hebert PDN, Cywinska A, Ball SL, DeWaard JR (2003) Biological identification through DNA barcodes. Proc Roy Soc Lond B 270: 313–321.
- 2. Hebert PDN, Ratnasingham S, deWaard JR (2003) Barcoding animal life: cytochrome c oxidase subunit 1 divergences among closely related species. Proc Roy Soc Lond B 270: (Suppl.)S96–S99.
- 3. Chase MW, Salamin N, Wilkinson M, Dunwell JM, Kesanakurthi RO, et al. (2005) Land plants and DNA barcodes: short-term and long-term goals. Phil Trans Lond B 360: 1889–1895.
- 4. Kress WJ, Wurdack KJ, Zimmer EA, Weigt LA, Janzen DH (2005) Use of DNA barcodes to identify flowering plants. Proc Natl Acad Sci U S A 102: 8369–8374.
- 5. Newmaster SG, Fazekas AJ, Ragupathy S (2006) DNA barcoding in the land plants: evaluation of rbcL in a multigene tiered approach. Can J Bot 84: 335–341.
- 6. Cowan RS, Chase MW, Kress WJ, Savolainen V (2006) 300,000 species to identify: problems, progress, and prospects in DNA barcoding of land plants. Taxon 55: 611–616.
- 7. Mower JP, Touzet P, Gummow JS, Delph LF, Palmer JD (2007) Extensive variation in synonymous substitution rates in mitochondrial gene of seed plants. BMC Evol Biol 7: 135. doi:10.1186/1471-2148-7-135.
- 8. Kress WJ, Erickson DL (2007) A two-locus global DNA barcode for land plants: the coding rbcL gene complements the non-coding trnH-psbA spacer region. PLoS ONE 2(6): e508. doi:10.1371/journal.pone.0000508.
- 9. Chase MW, Cowan RS, Hollingsworth PM, van den Berg C, Madrinan S, et al. (2007) A proposal for a standardised protocol to barcode all land plants. Taxon 56: 295–299.
- 10. Newmaster SG, Fazekas AJ, Steeves RAD, Janovec J (2008) Testing candidate plant barcode regions with species of recent origin in the Myristicaceae. Mol Ecol Notes 8: 480–490. doi:10.1111/j.1471-8286.2007.02002.x.
- 11. Lahaye R, van der Bank M, Bogarin D, Warner J, Pupulin F, Gigot G, Maurin O, Duthoit S, Barraclough TG, Savolainen V (2008) DNA barcoding the floras of biodiversity hotspots. Proc Natl Acad Sci U S A 105: 2923–2928. doi:10.1073/pnas.0709936105.
- 12. Pennisi E (2007) Wanted: A barcode for plants. Science 318: 190–191.
- 13. Presting GG (2006) Identification of conserved regions in the plastid genome: implications for DNA barcoding and biological function. Can J Bot 84: 1434–1443.
- 14. Taberlet P, Coissac E, Pompanon F, Gielly L, Miquel C, Valentini A, Vermat T, Corthier G, Brochmann C, Willerslev E (2006) Power and limitations of the chloroplast trnL (UAA) intron for plant DNA barcoding. Nucleic Acids Res 35: e1–e8.
- 15. Ratnasingham S, Hebert PDN (2007) BOLD: The Barcode of Life Data System (www.barcodinglife.org). Mol Ecol Notes 7: 355–364. doi: 10.1111/j.1471-8286.2006.01678.x.
- 16. DeSalle R, Egan MG, Siddall M (2005) The unholy trinity: taxonomy, species delimitation and DNA barcoding. Phil Trans Lond B 360: 1905–1916.
- 17. Little DP, Stevenson DW (2007) A comparison of algorithms for the identification of specimens using DNA barcodes: examples from gymnosperms. Cladistics 23: 1–21.
- 18. Cho Y, Mower JP, Qiu Y-L, Palmer JD (2004) Mitochondrial substitution rates are extraordinarily elevated and variable in a genus of flowering plants. Proc Natl Acad Sci U S A 101: 17741–17746.
- 19. Swofford DL (2000) PAUP*: phylogenetic analysis using parsimony (*and other methods), version 4. Sunderland, Mass: Sinauer.
- 20. Lee H-L, Yi D-K, Kim J-S, Kim K-J (2007) Development of plant DNA barcoding markers from the variable noncoding regions of chloroplast genome. Abstract presented at the Second International Barcode of Life Conference. Academia Sinica, Taipei, Taiwan. September 18–20, 2007. http://www.bolinfonet.org/conferences/assets/files/conference_abstract_book.pdf.
- 21. Kress J, Erickson DL (2008) DNA barcodes: Genes, genomics, and bioinformatics. Proc Natl Acad Sci U S A 105: 2761–2762.
- 22. Sass C, Little DP, Stevenson DM, Specht CD (2007) DNA Barcoding in the Cycadales: Testing the Potential of Proposed Barcoding Markers for Species Identification of Cycads. PLoS ONE 2(11): e1154. doi:10.1371/journal.pone.0001154.
- 23. Olmstead RG (1997) Species concepts and plesiomorphic species. Syst Bot 20: 623–630.
- 24. Maddison WP (1997) Gene trees in species trees. Syst Biol 46: 523–536.
- 25. Crisp MD, Chandler GT (1996) Paraphyletic species. Telopea 6: 813–844.
- 26. Funk DJ, Omland KE (2003) Species-level paraphyly and polyphyly: frequency, causes, and consequences, with insights from animal mitochondrial DNA. Ann Rev Ecol Syst 34: 397–423.
- 27. Mort ME, Soltis PS, Soltis DE, Mabry M (2000) Comparison of three methods for estimating internal support on phylogenetic trees. Syst Biol 49: 160–171.
- 28. Govaerts R (2001) How many species of seed plants are there? Taxon 50: 1085–1090.
- 29. Prance GT (2001) Discovering the Plant World. Taxon 50: 345–360.
- 30. Shaw J, Lickey EB, Schilling EE, Small RL (2007) Comparisons of whole chloroplast genome sequences to choose noncoding regions for phylogenetic studies in angiosperms: the tortoise and the hare III. Am J Bot 94: 275–288.
- 31. Graham SW, Reeves PA, Burns ACE, Olmstead RG (2000) Microstructural changes in noncoding chloroplast DNA: interpretation, evolution, and utility of indels and inversions in basal angiosperm phylogenetic inference. Int J Plant Sci 161: (6 Suppl.)S83–S96.
- 32. Craft KJ, Ashely MV (2006) Population differentiation among three species of white oak in northeastern Illinois. Can J For Res 36: 206–215.
- 33. Jensen RJ, Ciofani KM, Miramontes LC (2002) Lines, outlines, and landmarks: morphometric analyses of leaves of Acer rubrum, Acer saccharinum (Aceraceae) and their hybrid. Taxon 51: 475–492.
- 34. Xiang L, Werth CR, Emery SN, McCauley DE (2000) Population-specific gender-biased hybridization between Dryopteris intermedia and Dryopteris carthusiana; evidence from chloroplast DNA. Am J Bot 87: 1175–1180.
- 35. Noyes RD, Rieseberg LH (2000) Two independent loci control agamospermy (apomixis) in the triploid flowering plant Erigeron annuus. Genetics 155: 379–390.
- 36. Royal Botanic Gardens, Kew, UK (2007-onwards) DNA Barcoding, Phase 2 Update. http://www.kew.org/barcoding/update.html (Accessed March 12, 2007).
- 37. Hall T (2007) BioEdit, version 7.0.9. Carlsbad, CA: Computer Program and documentation, Ibis Biosciences.
- 38. Rambaut A (2002) Se-Al (Sequence Alignment Editor, version 2.0a11). UK: Computer program and documentation, Institute of Evolutionary Biology, University of Edinburgh.
- 39. Hillis DM, Bull JJ (1993) An empirical test of bootstrapping as a method for assessing confidence in phylogenetic analysis. Syst Biol 42: 182–192.
- 40. Felsenstein J, Kishino H (1993) Is there something wrong with the bootstrap on phylogenies? A reply to Hillis and Bull. Syst Biol 42: 193–200.
- 41. Felsenstein J (1985) Confidence limits on phylogenies: An approach using the bootstrap. Evolution 39: 783–791.
- 42. Ross HA, Murugan S, Li WLS (2008) Testing the reliability of genetic methods of species identification via simulation. Syst Biol 57: 216–230.
- 43. Cho Y, Qiu Y-L, Kuhlman P, Palmer JD (1998) Explosive invasion of plant mitochondria by a group I intron. Proc Natl Acad Sci U S A 95: 14244–12249.
- 44. Ivanova NV, Fazekas AJ, Hebert PDN (2008) Semi-automated, membrane-based protocol for DNA isolation from plants. Plant Mol Bio Rep [On-line early]. doi:10.1007/s11105-008-0029-4.