The goal of this study was to compare the ability of morphology and molecular-based surveys to estimate species richness for two species-rich diatom genera, Chaetoceros Ehrenb. and Thalassiosira Cleve, in the Bay of Fundy. Phytoplankton tows were collected from two sites at intervals over two years and subsampled for morphology-based surveys (2010, 2011), a culture-based DNA reference library (DRL; 2010), and a molecular-based survey (2011). The DRL and molecular-based survey utilized the 3′ end of the RUBISCO large subunit (rbcL-3P) to identify genetic species groups (based on 0.1% divergence in rbcL-3P), which were subsequently identified morphologically to allow comparisons to the morphology-based survey. Comparisons were compiled for the year (2011) by site (n = 2) and by season (n = 3). Of the 34 taxa included in the comparisons, 50% of taxa were common to both methods, 35% were unique to the molecular-based survey, and 12% were unique to the morphology-based survey, while the remaining 3% of taxa were unidentified genetic species groups. The morphology-based survey excelled at identifying rare taxa in individual tow subsamples, which were occasionally missed with the molecular approach used here, while the molecular methods (the DRL and molecular-based survey), uncovered nine cryptic species pairs and four previously overlooked species. The last mentioned were typically difficult to identify and were generically assigned to Thalassiosira spp. during the morphology-based survey. Therefore, for now we suggest a combined approach encompassing routine morphology-based surveys accompanied by periodic molecular-based surveys to monitor for cryptic and difficult to identify taxa. As sequencing technologies improve, molecular-based surveys should become routine, leading to a more accurate representation of species composition and richness in monitoring programs.
Citation: Hamsher SE, LeGresley MM, Martin JL, Saunders GW (2013) A Comparison of Morphological and Molecular-Based Surveys to Estimate the Species Richness of Chaetoceros and Thalassiosira (Bacillariophyta), in the Bay of Fundy. PLoS ONE 8(10): e73521. doi:10.1371/journal.pone.0073521
Editor: Keith A. Crandall, George Washington University, United States of America
Received: February 10, 2013; Accepted: July 28, 2013; Published: October 9, 2013
Copyright: © 2013 Hamsher et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported through funding to the Canadian Barcode of Life Network from Genome Canada (through the Ontario Genomics Institute), National Sciences and Engineering Research Council of Canada (NSERC), and other sponsors listed at www.BOLNET.ca. Additional funding was provided by NSERC and the Canada Research Chair Program to GWS, as well as infrastructure support from the Canada Foundation for Innovation and the New Brunswick Foundation for Innovation. Additional support was provided by the Department of Fisheries and Oceans. The funders had no role in study design, data collection and analyses, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Planktonic marine diatoms are a key component to oceanic primary productivity, contributing ∼40% of the organic carbon generated in the sea each year , but their diversity is not well known , , . As the stress on marine environments increases and species loss is more apparent, studies of phytoplankton diversity are becoming more important as a measure of ecosystem health .
Since 1987, the phytoplankton in the Bay of Fundy (BoF) have been monitored regularly by personnel at the Canadian Department of Fisheries and Oceans (DFO) to alert fisherman to harmful algal blooms (primarily Alexandrium fundyense Balech and species of Pseudo-nitzschia H. Perag. in H. & M. Perag.), establish a baseline of diversity, and determine seasonal trends and distribution of species , , , , , , . These extensive monitoring efforts have allowed the DFO to track the introduction of new species into the flora and density changes in harmful algal bloom-forming species . Two of the most species-rich and abundant diatom genera in the BoF are Chaetoceros spp. and Thalassiosira spp. , , , , , . These genera are widespread, difficult to identify due to the morphological similarity of their constituent species, and each genus is known to contain >100 species , , . However, their identification in the BoF has been based solely on morphology.
Two molecular surveys of planktonic diatoms in the BoF have been published previously , . Savin et al. compared morphological and molecular methods of measuring plankton diversity in the BoF and found little overlap (5%) between methodologies: while diatoms were the taxa most frequently encountered in the morphological surveys, only three of the 64 sequences generated were attributed to them . In fact, many of the sequences in that study were not closely related to known organisms, making comparisons between the two methodologies difficult . However, their method of using universal primers to amplify DNA from an environmental sample would presumably lead to PCR bias and large numbers of sequences from smaller organisms that would be missed by the morphological survey. Kaczmarska et al. conducted a molecular survey of Pseudo-nitzschia delicatissima (Cleve) Heiden, a diatom that produces domoic acid in some regions in eastern Canada, including four sites in the BoF, and concluded that their isolates belonged to a single metapopulation lacking phylogeographic pattern .
In contrast to the results for Pseudo-nitzschia delicatissima by Kaczmarska et al., molecular surveys for other diatom species (e.g., Navicula cryptocephala Kütz., Nitzschia palea (Kütz.) W. Sm., Pseudo-nitzschia spp., Sellaphora pupula (Kütz.) Mereschk., etc.) in other geographic areas have revealed ‘cryptic’ species that are reproductively and genetically distinct, but with virtually identical morphology (, , , , , respectively) making accurate identification without molecular data difficult to impossible for these species complexes . These cases of ‘cryptic’ diversity can confound monitoring efforts leading to an underestimation of species richness and could foreseeably result in overlooking introduction events for taxa from such cryptic complexes.
The application of contemporary molecular tools to routine monitoring efforts can effectively resolve the issues presented by cryptic complexes leading to more accurate estimates of species richness and plankton community composition. The most common molecular markers used to identify diatoms are based on genes from genomes of three cellular compartments including: the 5′ end of the cytochrome c oxidase I gene (COI-5P) as a mitochondrial marker; the RUBISCO large subunit (rbcL) and the universal plastid amplicon (UPA) as plastid markers; and the large subunit ribosomal DNA (LSU), the small subunit ribosomal DNA (SSU), and the internal transcribed spacer (ITS) as nuclear markers , , , , , , . While the shorter, less variable markers, such as UPA and SSU, have greater utility for identifying a diversity of protistan taxa in broad surveys , , they are too conserved to be able to distinguish between closely related diatom species , . The highly variable COI-5P and ITS regions are able to distinguish between diatom species, but either cannot be easily amplified and sequenced for some taxa (COI-5P, ) or can display intraclonal variability that makes reading the sequences of some species difficult to impossible without cloning (ITS, ). Owing to the previous issues, Hamsher et al. advocated the use of a 780-bp region near the 3′ end of the rbcL (rbcL-3P) as well as the variable D2/D3 region of the LSU (LSU D2/D3) as species-level markers for diatom identification . Each marker can be easily amplified and sequenced for many genera using a single marker-specific primer pair and in combination they provide adequate resolving power to differentiate between closely related diatom species .
The primary objective of this study was to compare the ability of morphological and molecular techniques (rbcL-3P data) to identify Chaetoceros and Thalassiosira during monitoring surveys and assess the strengths and limitations of each approach. To accomplish these goals, species of Chaetoceros and Thalassiosira from the BoF were isolated into unialgal culture to develop a DNA reference library (DRL). Cultures in the DRL were sequenced (rbcL-3P and LSU D2/D3 data) and morphologically identified so that sequences generated during the subsequent molecular-based survey could be tied to known species. For the molecular-based survey, single colonies were isolated, sequenced, and overall species richness recorded. These data were then compared to the species composition and richness recorded from the routine morphology-based survey for the same samples.
No permits were required for collection of water samples in Canadian coastal waters.
Plankton tows were collected at Passamaquoddy Bay (PB; 45.067N, −66.967W) and, starting in April 2010, the Wolves (WV; 45.000N, −66.733W), in the BoF in 2010–2011. In 2010, tows were collected monthly during the winter months (Jan–Apr, Oct–Dec) and weekly during the summer months (May–Sept) resulting in 59 tows. In 2011, tows were collected at a similar interval (monthly in January and April; twice in May; weekly from June-September; twice in October; and monthly in November and December) resulting in 46 tows. All tows were collected from the CCGS Pandalus III or the Viola M. Davidson. At each site, a 10 m vertical plankton haul was collected with a 20-µm mesh plankton net, 0.3 m in diameter. Organisms were flushed into a collection container. Plankton tows were kept in the dark on ice until returning to the lab. All tows were subsampled for routine monitoring purposes (see Morphology-based survey below) and either development of a culture-based DRL for 2010 tows or for the molecular-based survey for 2011 tows. For the DRL, tow subsamples were immediately brought back to UNB on ice. For the molecular-based survey, each tow subsample was settled in a 50 mL Falcon™ tube for 2–4 hours, the supernatant was then removed by reverse osmosis filtration, and finally 95% ethanol was added for cell preservation. These concentrated samples were stored at −20°C until the molecular-based survey was completed.
Approximately two drops of each tow subsample was examined at 200–400X using a Nikon Eclipse 50i light microscope with phase contrast. Phytoplankton were identified live within four hours of sampling and their abundance noted using the Helsinki Commission (HELCOM, ) rating scale (i.e., 1 = very sparse/rare; 2 = sparse; 3 = scattered/common; 4 = abundant; 5 = dominant). Species discovery curves were used to determine when examination of a tow subsample should discontinue. Diatoms were identified using the following references: Bérard-Therriault et al., Horner, Hoppenrath et al., Jensen & Moestrup, Kraberg et al., Rines & Hargraves, Throndsen et al., and Tomas , , , , , , , . Due to the semi-quantitative abundance data, results discussing abundance were based on the number of plankton tow subsamples in which a particular species occurred (n = 46 in 2011) and the number of tow subsamples for which a species had a HELCOM rating of >1. Only data for the colony-forming species of Chaetoceros and Thalassiosira were included in this study. Due to the low magnification (320X) used for isolating colonies during development of the DRL and the molecular-based survey (see below), the following species of these genera were excluded from comparisons between morphology and molecular-based surveys because they do not form colonies with >2 cells (i.e., easily visible colonies at 320X) in the BoF: C. convolutus f. trisetosa Brunel, C. danicus Cleve, and C. simplex Ostenf. One additional taxon, C. socialis Lauder, was excluded because, while it was common in the flora and in the DRL, colony structure degenerated during ethanol preservation making inclusion of this taxon in the molecular-based survey (below) not feasible with the techniques employed in this study.
Development of the Culture-based DNA Reference Library (DRL)
Colonies were isolated from each of the tow subsamples collected in 2010 as follows. In the laboratory, ∼200 µL of the tow subsample was diluted with sterile seawater in a Petri dish. Individual phytoplankton colonies were rudimentarily identified (i.e., identified to ‘species group’ such as Chaetoceros diadema/decipiens or large Thalassiosira) using a dissecting scope at 320X and subsequently isolated into F/2 liquid media using a glass micropipette. Species-discovery curves (see example curve, Fig. 1) were generated for each tow subsample to determine when identification and isolation of cells should discontinue. All cultures were maintained at 10°C in growth chambers with 8∶16 for January-April and October 19-Dec isolates or 12∶12 for May-October 12 isolates L:D. Morphological species that were not successfully entered into culture from one tow subsample were sought after during the next sampling period. Cultures were partially harvested and preserved within a month of isolation for morphological identification with formalin-acetic acid (FAA; 420 µL concentrated culture: 600 µL of 70% ethanol: 120 µL commercial formalin: 60 µL glacial acetic acid ). Preserved cultures have been deposited in the Connell Memorial Herbarium (UNB) and representative cultures of most genetic species groups have been deposited in the Culture Collection of Algae and Protozoa (CCAP) (see Table S1 for details).
This curve was generated for colonies isolated from the Passamaquoddy Bay plankton tow subsamples on June 1, 2010 for development of the culture-based DNA reference library (DRL). Isolation was terminated after 60 mins (n = 42 colonies of 26 morphological species isolated) because 30 mins had elapsed with no new morphological types found.
A subsample of each culture (Table S1) was harvested by centrifugation for DNA extraction. The DNA extraction followed the diatom protocol outlined in Saunders & McDevit with modification to account for low sample volume (samples were extracted in 200 µL of brown algal buffer and DNA was eluted in 100 µL of TE) or the Chelex protocol described by Richlen & Barber , . Extracted DNA from a majority of species has been deposited at the Ocean Genome Legacy (SE23396–SE23435, ). Data for the rbcL-3P and LSU D2/D3 regions were generated following Hamsher et al. (2011) . Sequences were assembled and edited using Sequencher™ 4.8 (Gene Codes Corporation, Ann Arbor, MI, USA) and aligned by eye in MacClade 4 (Version 4.06) for OSX . The final alignment of rbcL-3P sequences included data from 184 cultures (780 bp with no indels). The LSU D2/D3 alignment had data from 173 cultures (834 sites). Cluster analyses were preformed on each alignment separately using the neighbor-joining algorithm on uncorrected dissimilarities (p) in Geneious v5.4  to identify genetic species groups for the DRL.
Following genetic species assignment, preserved material from representatives of each genetic species group was examined at 1000X using a Leica DM5000B light microscope and photographed using a Leica DFC480 digital camera (Leica, Heidelberg, Germany). In some cases (e.g., some Thalassiosira species), morphological features were obscured by the presence of the cell contents so preserved material was boiled in H2O2 for 30 mins, systematically settled and washed with ddH2O, dried to coverslips, and mounted with Naphrax® for identification. References utilized to identify these diatoms were similar to those used during the morphology-based survey (i.e., , , , , ).
The 2011 preserved tow subsamples (50 mL) were subsampled again (300 µL) and these were combined for each season based on the abundance of phytoplankton: winter included January, April, May (winter); summer included June through September (summer); and fall included October through December (fall). From six samples in total (i.e., one from each of two sites for each of three seasons), individual colonies of Chaetoceros spp. and Thalassiosira spp. were isolated into microtubes for DNA extraction. Individual colonies were isolated following the species-discovery curve methodology described above. A sketch/description of each isolated colony was recorded to facilitate the subsequent identification in case the sequence generated did not match data in the DRL. After the ethanol was allowed to evaporate, 20 µL of a 10% (w/v) Chelex solution was added to each isolated colony and the DNA extracted following Richlen & Barber . The rbcL-3P region was amplified and sequenced in the forward direction following Hamsher et al. . Resulting sequences were compared to the DRL and their affinity noted. Colonies lacking a match to the DRL were identified based on the notes taken during isolation. A representative sequence from each genetic species group (from both the DRL and novel groups uncovered during the molecular-based survey) was included in an alignment as described above (46 sequences with 780 bp, no indels) and cluster analysis performed as above. Resulting sequences from this study (from cultures and single colony isolations) have been deposited in BOLD (www.boldsystems.org) and GenBank (see Table S1 for BOLD identifiers and accession numbers, respectively).
During 2010, 20 Chaetoceros spp. and seven Thalassiosira spp. were identified. Of the 20 Chaetoceros spp., 20% were unique to a single tow subsample. Chaetoceros debilis Cleve was the most abundant Chaetoceros: this taxon was present in the greatest number of tow subsamples (n = 29) and had the greatest number of tow subsamples with a HELCOM rating >1 (n = 15; Table 1). In contrast, all of the Thalassiosira spp. identified occurred in multiple tow subsamples with only two species, T. bioculata var. bioculata (Grunow) Ostenf. and Thalassiosira tiny sp., in fewer than five tow subsamples (Table 1). The most abundant was Thalassiosira gravida Cleve (n = 37 tow subsamples and n = 8 with HELCOM rating >1; Table 1). Only 16% (4) of taxa were unique to Passamaquoddy Bay or the Wolves and these were only found in single tow subsamples at low abundance. Thalassiosira spp. were present throughout 2010, while most Chaetoceros spp. were present only from May to October 2010.
In 2011, fifteen Chaetoceros and seven Thalassiosira spp. were identified. Only four species, Chaetoceros affinis Lauder, C. concavicornis L. Mangin, C. diadema (Ehrenb.) Gran., and Thalassiosira bioculata var. exigua (Grunow) Hust., were restricted to one site and in low abundance when present (i.e., fewer than three tow subsamples and none with HELCOM ratings>1; Table 1). Again, C. debilis (n = 26 tow subsamples, n = 6 with HELCOM rating>1) and T. gravida (n = 31 tow subsamples, n = 10 with HELCOM rating>1; Table 1) were the most abundant taxa. A majority (69%) of taxa reported in 2010 were also found in 2011 (Table 2). Almost all of the taxa unique to 2010 (n = 7) or 2011 (n = 2) sampling years were Chaetoceros spp. and five of these were at low abundance (i.e., present in fewer than four tow subsamples, none with HELCOM ratings>1; Table 1).
Culture-based DNA Reference Library (DRL)
The DRL served as a bridge between the morphological and molecular assessments by tying sequence data to known taxa. Cultures were analyzed primarily using rbcL-3P data (Fig. 2), with LSU D2/D3 data (Table S1) generated for at least one representative of most rbcL-3P genetic species groups to confirm the rbcL-3P results. The within genetic species divergence threshold was set at 0.1% (0–1 bp) for rbcL-3P based on Trobajo et al. . At this level of divergence, rbcL-3P and LSU D2/D3 data agreed on delineation of genetic species groups. While this level of divergence is slightly higher than that reported between closely related Sellaphora spp. (0.1%, ), making an underestimate of diversity possible, it will not change the overall conclusions of our work as no taxonomic conclusions are drawn, and it is better to under-estimate than over-estimate diversity for the objectives of this study.
An asterisk indicates species included in the 2010 culture-based DNA reference library (DRL). n indicates the number of sequences generated for each genetic species group during the 2011 molecular-based survey. If no number is indicated then this taxon was encountered in the 2010 DRL only. Cryptic species pairs are indicated in bold font.
Based on this threshold, 51 Chaetoceros and 141 Thalassiosira cultures successfully isolated and sequenced for inclusion in the DRL resolved into 13 and 11 genetic species groups, respectively (Fig. 2, asterisk) from the 2010 tow subsamples (n = 59). Of the 27 species of Chaetoceros and Thalassiosira identified during the morphology-based survey in 2010, 56% (n = 15) were represented in the DRL. Of the 11 species not represented in culture, only six had a HELCOM rating>1 in any single tow subsample (C. contortus F. Schütt, C. convolutus Castracane, C. furcellatus J.W. Bailey, C. ingolfianus Ostenf. Thalassiosira tiny sp., and T. baltica (Grunow) Ostenf.). The remaining species (i.e., C. affinis Lauder, C. atlanticus Cleve, C. borealis J.W. Bailey, C. concavicornis, C. lorenzianus Grunow and T. bioculata) never had a HELCOM rating>1 and almost all of these species, except C. lorenzianus and T. bioculata, were reported only in a single tow subsample in 2010. Seven species were identified from the DRL that were not recorded during the morphology-based survey. Three of these unreported taxa (i.e., C. pseudobrevis Pavill., T. angulata (W. Greg.) Hasle, and T. decipiens (Grunow) E.G. Jørg.) were recorded in previous years, but were not in 2010 (Table 2). Some of the unreported taxa may have been rare in the field because they were represented by only a few cultures (<5; Table S1) including: C. pseudobrevis, T. angulata, T. antarctica Comber, T. decipiens, and T. delicata (J.A. Barron) Akiba. However, two taxa were common in the DRL and possibly misidentified in the morphology-based survey, including: T. eccentrica (Ehrenb.) Cleve (n = 27 cultures), which may have been mistaken for T. nordenskioeldii Cleve; and T. pacifica Gran & Angst (n = 29 cultures), which may have been identified as T. punctigera (Castracane) Hasle (Table S1). The culturing efforts also uncovered four cases of possible cryptic diversity: each morphological taxon had two genetic species groups based on rbcL-3P and LSU D2/D3 data. The four cryptic species pairs were for the morpho-species C. debilis, C. diadema, C. pseudobrevis, and T. eccentrica and members of each species pair were often represented by more than one culture (Fig. 2, see Table S1). In contrast, no single genetic species group was found to include more than one morphospecies based on the representatives examined.
From the six combined tow subsamples for 2011 (three seasons at two sites), 17 Chaetoceros and 13 Thalassiosira genetic species groups were identified based on rbcL-3P data (Fig. 2) including eight Chaetoceros and four Thalassiosira genetic species groups that were not present in the DRL. The identification of these 12 additional taxa was based on the sketches/notes taken during colony isolation. Ten of these genetic species groups could be identified to the species level (or variety) and included: C. concavicornis, Chaetoceros contortus Lauder (sp. 1 and 2), C. decipiens sp. 2, C. laciniosus Schütt sp. 2, C. lorenzianus (sp. 1 and 2), C. radicans F. Schütt sp. 2, T. baltica, and T. bioculata var. exigua (Fig. 2). Of the two remaining groups, one (Thalassiosira tiny sp.) matched the description of a morphological species in the morphology-based survey and the other could not be identified to species based on the sketch/notes taken (recorded simply as Thalassiosira sp.) (Fig. 2).
A few interesting trends were uncovered when comparing the cryptic species in the 2010 DRL to those identified in the 2011 molecular-based survey. For example, for some cryptic species pairs one partner of the pair was present in the 2010 DRL, but not in the 2011 molecular-based survey and vice versa (e.g. Chaetoceros radicans; Table S1). Other cryptic species pairs were both present in the 2010 DRL, but with only of the pair found in the 2011 molecular-based survey (e.g., C. pseudobrevis; Table S1) and vice versa (e.g., C. laciniosus; Table S1). Based on the molecular-based survey data, a few of these cryptic taxa may be seasonal, which has substantial consequences for the morphology-based surveys. For example, at site PB Chaetoceros debilis sp. 1 was not found in summer, but both C. debilis sp. 1 and 2 were found in fall; Chaetoceros decipiens sp. 2 was found throughout the year, but C. decipiens sp. 1 was only found in fall; and Chaetoceros diadema sp. 2 was found in winter and summer while Chaetoceros diadema sp. 1 was found only in fall. The isolation date of the cultures in the DRL (2010) support these trends, except for two cases: C. decipiens sp. 1 and C. diadema sp. 1 were isolated in September instead of only fall, perhaps due to differences in temperature between years. All of the previous observations would go unnoticed for these cryptic species pairs in the morphology-based survey.
Comparison of Morphology and Molecular-based Surveys to Estimate Species Richness
A comparison of the number of taxa identified during the morphology-based versus the molecular-based surveys was compiled for 2011 (Fig. 3). Taxa were placed into one of five categories. The largest category, 50% of taxa, included taxa that were identified in both the morphology-based and molecular-based surveys (Fig. 3A). This category was separated further into subcategories based on the confidence we could place in the match of the molecular to the morphological species. The most confident matches, and also the largest subcategory (29% of all taxa), included taxa that were in the DRL (Fig. 3A). All of these taxa were recorded in the 2011 morphology-based survey in more than one tow subsample (Table 1). The next subcategory (15% of all taxa) included those taxa whose match could be confidently surmised from the sketches drawn during isolation of individual colonies during the 2011 molecular-based survey (Fig. 3A, strong). The subcategory with the lowest confidence (6% of all taxa) included taxa whose match was also predicted based on the sketch drawn during isolation (T. bioculata var. exigua and Thalassiosira tiny sp.), but their match was less certain than those in the previous category (Fig. 3A, weak).
Data were summarized for the 2011-monitoring year (A), and then by site (B), and by season (C). In the year summary (A), taxa were placed into five main categories in bold font (two of these were divided further into three subcategories each) as indicated on the figure and described in the text. In the by site (B) and by season (C) summaries, the taxa are placed in only three categories including taxa that were identified: in common to the morphology (morph) and molecular (mol) -based surveys (black); or in the morphology-based survey only (white); in the molecular-based survey only as unique (gray) or cryptic (vertical lines) species. Sites were Passamaquoddy Bay (PB) and The Wolves (WV). Seasons were Jan, Apr, May (winter), June–Sept (summer), and Oct–Dec (fall).
The second category (3% of all taxa) was designated for a single taxon, Thalassiosira sp., whose basic morphology and resulting sketch were too general to tie this genetic species to a morphological taxon and so was recorded as an unidentified sequence (Fig. 3A).
The third category included taxa that were identified only during the morphology-based survey (12% of all taxa, Fig. 3A, morphological only) and was limited to four species of Chaetoceros (i.e., C. affinis, C. convolutus, C. furcellatus and C. similis Cleve) that were reported in fewer than five tow subsamples (except for C. similis found in 18 tow subsamples) and never in high abundance (i.e., no tow subsamples with HELCOM ratings>1, including C. similis; Table 1).
The fourth category included taxa unique to the molecular-based survey that were nonetheless included in the DRL and thus were assigned a morphological species designation (17% of all taxa, Fig. 3A, molecular only). Most of the species missed during the morphology-based survey (Fig. 3A, molecular only) were Thalassiosira spp. (T. angulata, T. antarctica, T. decipiens, T. eccentrica, and T. pacifica), as well as Chaetoceros constrictus Gran.
The final category was for cryptic species and included 18% of all taxa (Fig. 3A). Cryptic species uncovered always occurred in pairs and thus one partner of each pair was considered a match (Fig. 3A, morphological and molecular match) and the other a cryptic species in the summary presentation (Fig. 3A). Each cryptic partner (i.e., the partner of the cryptic species pair not considered a morphological and molecular match) was again placed into one of three subcategories based on the confidence of their morphological identification: 1) the cryptic partner was uncovered previously during the development of the DRL and thus the morphological comparison was detailed in support of the cryptic designation (6% of all taxa, Fig. 3A, DRL); 2) the sketch of the cryptic partner drawn during isolation for the molecular-based survey was sufficiently detailed to allow for a strong morphological association (9% of all taxa, Fig. 3A, strong); and 3) a single cryptic partner, C. laciniosus sp. 2, that is likely a cryptic species, but whose sketches were insufficient to render a solid morphological identification (3% of all taxa, Fig. 3A, weak). All of the cryptic species pairs found during these comparisons were attributed to Chaetoceros spp. (C. contortus (n = 2), C. debilis (n = 2), C. decipiens (n = 2), C. diadema (n = 2), C. laciniosus (n = 2) and C. lorenzianus (n = 2)).
To compare differences between sites (PB and WV) and seasons (winter, summer, fall) between the morphological and molecular-based surveys the data were lumped according to the main categories in Figure 3A: morphological and molecular matches (Figs 3B and 3C, black): cryptic species (Figs 3B and 3C, vertical lines): morphological based-survey only (Figs 3B and 3C, white): and molecular-based survey only (Figs 3B and 3C, grey) (Fig. 3A, unidentified sequence was removed from further comparisons). Cryptic taxa were only recorded as such in the ‘by site’ and ‘by season’ comparisons if both partners (e.g., Chaetoceros decipiens sp. 1 and 2) were present at the same site or during the same season in the molecular-based survey.
For both sites, greater species richness was recorded for the molecular-based (Fig. 3B, Mol) than morphology-based survey (Fig. 3B, Morph). At both sites, the majority (60% for PB and 80% for WV) of additional species recorded during the molecular-based survey (Fig. 3B, gray) were probably lumped into the general Chaetoceros spp. or Thalassiosira spp. categories during the morphology-based survey. Most of these taxa (67%) were common to both sites (i.e., T. angulata, T. delicata, T. eccentrica, and T. pacifica) and none of the taxa in this category were unique to WV. The additional species in this category at PB were C. constrictus and T. antarctica. The remaining additional taxa recorded in the molecular-based survey were due to cryptic species (Fig. 3B, vertical lines) with more found at PB (4) than at WV (1), most likely due to the higher abundance of Chaetoceros spp. at PB (Table 1). All of the taxa unique to the morphology-based survey (Fig. 3B, white) were in low abundance (i.e., fewer than five tow subsamples and never with a HELCOM rating>1; Table 1), except for C. similis, which was found in 18 tow subsamples, but with no HELCOM ratings>1 (Table 1).
When comparing seasons only winter, the season with the lowest species richness, had higher species richness recorded in the morphology-based (Fig. 3C, Morph) than the molecular-based survey (Fig. 3C, Mol). Taxa contributing to the higher species richness (i.e., C. convolutus, C. debilis, C. furcellatus, C. laciniosus, C. similis) were not abundant in winter (i.e., fewer than four tow subsamples, none with HELCOM ratings>1 in this season; Table 1) and were missed during the molecular-based survey with the techniques used here. The species that were unique to the molecular-based survey during winter were all Thalassiosira spp. (i.e., T. delicata, T. eccentrica, and T. pacifica). The summer season had the highest species richness (Fig. 3C) and abundance (Table 1). None of the taxa missed by the molecular-based survey (i.e., C. affinis, C. similis, T. nordenskioeldii, and Thalassiosira tiny sp.) were abundant during this season (i.e., none with HELCOM ratings>1 in this season; Table 1). Taxa missed in the morphology-based survey were almost exclusively Thalassiosira spp. (as well as C. constrictus). The summer season had the greatest number of cryptic species pairs. The fall season had intermediate species richness (Fig. 3C) and all of the taxa missing from the molecular-based survey (i.e., C. laciniosus, C. lorenzianus, C. similis, and T. baltica) were again in low abundance (i.e., none with HELCOM ratings>1; Table 1). Species unique to the molecular-based survey in fall included: C. diadema sp. 1, T. angulata, T. antarctica, T. eccentrica, and T. pacifica. Two cryptic species pairs, C. debilis sp. 1 and 2 and C. decipiens sp. 1 and 2, were recorded during the molecular-based survey in this season.
Similarities and Differences between the Morphology and Molecular-based Surveys
Half of the taxa (50%) were reported in the morphology and molecular-based surveys, indicating that both types of surveys provide a reasonably good estimation of the abundant, easily recognizable taxa. Therefore, monitoring efforts primarily concerned with abundant taxa can be confident using either approach, except where cryptic species are a concern. The majority (59%) of the matched species were Chaetoceros spp., possibly due to the way samples were processed for the morphology-based survey (i.e., live or formalin-acetic acid preserved samples). The features used for discriminating between Chaetoceros spp., such as setae position and length, shape and size of aperture between cells  are more easily discernable in live/recently preserved tow subsamples than the features used to identify Thalassiosira spp., such as position of labiate and strutted processes on the valve . This difference in the ability to identify live material may have led to more lumping of individuals into the Thalassiosira spp. category than the Chaetoceros spp. category during the morphology-based survey and explain the bias against matches between morphology and molecular-based surveys for Thalassiosira spp. The high degree of similarity between morphology and molecular-based surveys in this study (50%) is in contrast to the 5% similarity reported by Savin et al. . However, the differences in methodology between the two studies (i.e., whole water samples vs. plankton tows, denatured gradient gel electrophoresis (DGGE) vs. colony isolation, and the use of universal vs. diatom specific primers) likely explain the difference in congruence.
The other half of the taxa showed differences between the morphology and molecular-based surveys. The molecular-based survey excelled in identifying the six cryptic species pairs that were completely missed in the morphology-based surveys. In addition, by developing the DRL, the molecular-based survey was able to identify six Thalassiosira spp. that were most likely recorded simply as Thalassiosira spp. in the morphology-based survey due to the difficulty of their identification from live material. While more careful analysis during the morphology-based survey, such as cleaning the valves before identification and utilizing a scanning electron microscope (SEM), may increase the species-level identification of the Thalassiosira spp., the cryptic species pairs may remain difficult to distinguish without molecular data. Some of the cryptic Chaetoceros species pairs (e.g., C. debilis, C. decipiens, and C. diadema) did show seasonal trends indicating the possibility of different growth optima, but further research is necessary to determine whether these trends are consistent across multiple years with similar conditions. Many Chaetoceros spp. can form resting spores depending on conditions  so if the colonies are seasonal (as our data suggest), the ‘missing’ taxa are not necessarily absent, but may be surviving as resting spores until more favorable conditions are available.
The morphology-based survey excelled in identifying rare taxa. Of the taxa missed during the molecular-based survey, 80% were recorded in less than five tow subsamples in the morphology-based survey and none of them had HELCOM ratings>1 when they were missed. The molecular-based survey captured some rare taxa, but there was less consistency between the two methods when taxa were less abundant (i.e., either found in less than three tow subsamples or with a HELCOM rating = 1). One contributing factor to this discrepancy may be a result of comparing multiple subsamples – abundant taxa often show <10% variability between subsamples, but results for rare taxa are more variable . In addition to this subsample variation, only ∼65% of the individual colonies isolated during the molecular-based survey resulted in positive amplification (most likely due to poor isolation or preservation since similar taxa amplified well during the DRL development). Therefore, rare taxa may have been isolated that did not amplify, leading to additional mismatch of rare taxa between methods. Unlike the previous factor, this problem may be eliminated through the use of next-generation sequencing technologies. However, this inconsistency between morphology and molecular-based surveys should not be dismissed. The rare taxa missed using either method could be important because different species may present different concerns to resource managers and/or cryptic species may go unnoticed and with potential economic consequences, especially if the unnoticed cryptic species produce toxins (e.g., some ‘cryptic’ Pseudo-nitzschia spp., ).
Strengths and Limitations of Morphology and Molecular-based Surveys
The morphology-based survey was not able to identify the cryptic Chaetoceros spp. and also missed the less abundant (i.e., T. angulata, T. antarctica, T. delicata) or more difficult to identify (i.e., T. eccentrica and T. pacifica) Thalassiosira spp. However, the rare Chaetoceros spp. were more likely to be identified during the morphology-based survey, and missed in the molecular-based survey as discussed above. In addition to its ability to identify rare taxa, the morphology-based survey can more easily be adapted to producing quantitative abundance data (e.g., counting the number of cells in a specific volume). Using cleaned material for species identification and utilizing an SEM may improve the accuracy of the morphology-based survey, but this would also increase costs by adding materials (i.e., oxidizing chemicals, carbon tape, SEM stubs), time (i.e., time to process the materials, hourly rates for the SEM) and trained personnel (i.e., for processing samples and running the SEM). The equipment costs of the current morphology-based survey are lower than those for the molecular (i.e., identification books, slides, a microscope, etc.), but the personnel costs are high (i.e., time spent requiring a dedicated and highly trained taxonomic expert is critical for meaningful data acquisition).
The molecular-based survey was able to assign every specimen to a genetic species group, obviating the lumping of many individuals into general categories such as Thalassiosira spp. and Chaetoceros spp. In this study, genetic species groups were tied to species names, allowing even rare and cryptic taxa to be easily identified. Even in cases in which the sequence could not be tied to an identified species (e.g., Thalassiosira sp.), individual colonies could be assigned to genetic species groups and cataloged for future taxonomic determination. Also, the use of molecular data in continuing surveys would allow for comparisons between cryptic taxa over time considering abundance and seasonality of the different species. For example, T. eccentrica sp. 2 and C. pseudobrevis sp. 2 were only encountered in 2010 during the development of the DRL, and not during the 2011 molecular-based survey. This trend of different cryptic species being present/absent during different years would not be detected by the morphology-based survey.
However, development of the DRL and our molecular-based survey also have limitations. For instance, the isolation of colonies for developing the DRL was labor intensive and not all of the colonies isolated were successfully introduced into culture. However, the development of a DRL generates an ongoing and valuable resource. Indeed a majority (56%) of the species recorded in the morphology-based survey was found in our DRL after only one season of culture work. The DRL could be continually developed over subsequent years by targeting morphological species uncovered during the morphology and molecular-based surveys that are not yet represented in the database. After development of the DRL is complete, molecular technicians with limited taxonomic expertise could conduct the molecular-based surveys, a big advantage since the number of taxonomic experts is becoming more limited . If technicians performed the routine surveys, this would also allow time for the taxonomic experts to critically validate the data generated, attempt to culture any new species observed, and pursue other research initiatives.
As for the limitations of the molecular-based survey, combining samples based on site and season may have missed trends in diatom abundance since methods are currently qualitative. Also, the molecular-based survey methodology used in this study was relatively costly requiring personnel with experience in isolating cells, various reagents, and extensive laboratory equipment (i.e., centrifuges, thermocycler, genetic analyzer, etc.). However, with decreasing sequencing costs , the limited number of taxonomic experts , and additional sequence data tied to morphologically identified specimens (e.g., www.barcodinglife.org and our DRL), the cost will be reduced relative to the enhanced benefits in the future. In addition, using new technologies such as next-generation sequencing to process environmental samples will improve the recovery of sequence data from rare taxa while decreasing the cost per sequence and personnel hours required to isolate colonies or cells making molecular-based surveys even more practical and affordable relative to the benefits. While the use of next-generation sequencing technology for qualitative comparisons is being used more frequently to investigate the diversity of microbial life, its use in determining quantitative abundance remains a work in progress due to PCR biases .
The most effective means of measuring species richness for monitoring purposes will depend on the goals of a particular program. When species-level resolution is important, molecular-based surveys should be implemented or used to complement existing programs. In some cases, this resolution is unwarranted, but should be considered imperative for taxa that cause harmful algal blooms, contribute significantly to phytoplankton biomass, or are especially species-rich and/or difficult to identify. Our recommendation would be a combined approach with a continuation of routine morphology-based surveys and periodic molecular-based surveys to determine whether or not cryptic species are present, the seasonality of these cryptic species, and to record any non-indigenous cryptic species that may have been introduced to an area. This short-term study of only two diatom genera led to an increase in the known number of species in these two genera in the BoF by 25%. One of the labor-intensive portions of this study, developing the culture-based DRL, is not an ongoing expense since this legacy database has been established and can be augmented over the years by targeting morphological species known to harbor cryptic diversity based on the annual molecular-based surveys. With this publically available legacy database (www.barcodinglife.org), molecular-based surveys could become routine and less costly with improved sequence technology. While some researchers may conclude that matching sequence data to taxonomically validated species is too time consuming because the number of unique molecular sequences can provide rudimentary species richness, monitoring programs will continue to evaluate historic data (comparing the present to the past). Tying the sequence data of today and tomorrow to known and named species of the past will be, in our opinion, crucial for these studies.
Isolates sequenced from the Bay of Fundy in 2010–2011 that were utilized in this study.
We thank Kevin MacKenzie, Eddy Gao, and the captain and crew of the Pandalus III and the Viola M. Davidson for assisting with the field sampling and Tanya Moore for technical assistance.
Conceived and designed the experiments: SEH GWS JLM. Performed the experiments: SEH MML JLM. Analyzed the data: SEH. Contributed reagents/materials/analysis tools: JLM GWS. Wrote the paper: SEH GWS MML JLM.
- 1. Nelson DM, Treguer P, Brzezinski MA, Leynaert A, Queguiner B (1995) Production and dissolution of biogenic silica in the ocean: revised global estimates, comparison with regional data and relationship to biogenic sedimentation. Global Biogeochem Cy 9: 359–372. doi: 10.1029/95gb01070
- 2. Lundholm N, Moestrup Ø, Hasle GR, Hoef-Emden K (2003) A study of the Pseudo-nitzschia pseudodelicatissima/cuspidata complex (Bacillariophyceae): What is P. pseudodelicatissima? J Phycol 39: 797–813. doi: 10.1046/j.1529-8817.2003.02031.x
- 3. Savin MC, Martin J, LeGresley M, Giewat M, Rooney-Varga J (2004) Plankton diversity in the Bay of Fundy as measured by morphological and molecular methods. Microb Ecol 48: 51–63. doi: 10.1007/s00248-003-1033-8
- 4. Sarno D, Kooistra WHCF, Medlin LK, Percopo I, Zingone A (2005) Diversity in the genus Skeletonema (Bacillariophyceae). II. An assessment of the taxonomy of S. costatum-like species with the description of four new species. J Phycol 41: 151–176. doi: 10.1111/j.1529-8817.2005.04067.x
- 5. Ptacnik R, Solimini AG, Andersen T, Tamminen T, Brettum P, et al. (2008) Diversity predicts stability and resource use efficiency in natural phytoplankton communities. Proc Natl Acad Sci U S A 105: 5134–5138. doi: 10.1073/pnas.0708328105
- 6. Martin JL, Wildish DJ, LeGresley MM, Ringuette MM (1995) Phytoplankton monitoring in the southwestern Bay of Fundy during 1990–92. Can Manuscr Rep Fish Aquat Sci 2277: iii +154 p.
- 7. Martin JL, LeGresley MM, Strain PM, Clement P (1999) Phytoplankton monitoring in the Southwest Bay of Fundy during 1993–96. Can Tech Rep Fish Aquat Sci 2265: iv +132 p.
- 8. Martin JL, LeGresley MM, Strain PM (2001) Phytoplankton monitoring in the Western Isles region of the Bay of Fundy during 1997–98. Can Tech Rep Fish Aquat Sci 2349: iv +85 p.
- 9. Martin JL, LeGresley MM, Strain PM (2006) Plankton monitoring in the Western Isles region of the Bay of Fundy during 1999–2000. Can Tech Rep Fish Aquat Sci 2629: iv +88 p.
- 10. Martin JL, Hanke AR, LeGresley MM (2009) Long term phytoplankton monitoring, including harmful algal blooms, in the Bay of Fundy, eastern Canada. J Sea Res 61: 76–83. doi: 10.1016/j.seares.2008.05.011
- 11. Wildish DJ, Martin JL, Wilson AJ, DeCoste AM (1988) Environmental monitoring of the Bay of Fundy salmonid mariculture industry during 1986 and 1987. Can Tech Rep Fish Aquat Sci 1648 44 pp.
- 12. Wildish DJ, Martin JL, Wilson AJ, Ringuette M (1990) Environmental monitoring of the Bay of Fundy salmonid mariculture industry during 1988–89. Can Tech Rep Fish Aquat Sci 1760 123 pp.
- 13. Hasle GR (1976) The biogeography of some marine planktonic diatoms. Deep Sea Res A 23: 319–338. doi: 10.1016/0011-7471(76)90873-1
- 14. Rines JEB, Hargraves PE (1987) The seasonal distribution of the marine diatom genus Chaetoceros Ehr. in Narragansett Bay, Rhode Island (1981–1982). J Plankton Res 9: 917–933. doi: 10.1093/plankt/9.5.917
- 15. Guiry MD, Guiry GM (2012) AlgaeBase. World-wide electronic publication, National University of Ireland, Galway. http://www.algaebase.org; searched on 01 February 2012.
- 16. Kaczmarska I, Reid C, Martin JL, Moniz MBJ (2008) Morphological, biological, and molecular characteristics of the diatom Pseudo-nitzschia delicatissima from the Canadian Maritimes. Botany 86: 763–772. doi: 10.1139/b08-046
- 17. Poulíčková A, Veselá J, Neustupa J, Škaloud P (2010) Pseudocryptic diversity versus cosmopolitanism in diatoms: a case study on Navicula cryptocephala Kütz. (Bacillariophyceae) and morphologically similar taxa. Protist 161: 353–369. doi: 10.1016/j.protis.2009.12.003
- 18. Trobajo R, Clavero E, Evans KM, Vanormelingen P, McGregor RC, et al. (2010) The use of partial cox1 rbcL and LSU rDNA sequences for phylogenetics and species identification within the Nitzschia palea complex (Bacillariophyceae). Eur J Phycol 45: 413–425. doi: 10.1080/09670262.2010.498586
- 19. Amato A, Kooistra WHCF, Levialdi Ghiron JH, Mann DG, Proschold T, et al. (2007) Reproductive isolation among sympatric cryptic species in marine diatoms. Protist 158: 193–207. doi: 10.1016/j.protis.2006.10.001
- 20. Evans KM, Wortley AH, Mann DG (2007) An assessment of potential diatom “barcode” genes (cox1, rbcL, 18S and ITS rDNA) and their effectiveness in determining relationships in Sellaphora (Bacillariophyta). Protist 158: 349–364. doi: 10.1016/j.protis.2007.04.001
- 21. Mann DG, Sato S, Trobajo R, Vanormelingen P, Souffreau C (2010) DNA barcoding for species identification and discovery in diatoms. Cryptogamie algology 31: 557–577.
- 22. Sherwood AR, Presting GG (2007) Universal primers amplify a 23S rDNA plastid marker in eukaryotic algae and Cyanobacteria. J Phycol 43: 605–608. doi: 10.1111/j.1529-8817.2007.00341.x
- 23. Moniz MBJ, Kaczmarska I (2009) Barcoding diatoms: Is there a good marker? Mol Ecol Resour 9: 65–74. doi: 10.1111/j.1755-0998.2009.02633.x
- 24. Moniz MBJ, Kaczmarska I (2010) Barcoding of diatoms: Nuclear encoded ITS revisited. Protist 161: 7–34. doi: 10.1016/j.protis.2009.07.001
- 25. Hamsher SE, Evans KM, Mann DG, Poulíčková A, Saunders GW (2011) Barcoding diatoms: exploring alternatives to COI-5P. Protist 162: 405–422. doi: 10.1016/j.protis.2010.09.005
- 26. Zimmerman J, Jahn R, Gemeinholzer B (2011) Barcoding diatoms: evaluation of the V4 subregion on the 18S rRNA gene, including new primers and protocols. Organism Diversity & Evolution 11: 173–192. doi: 10.1007/s13127-011-0050-6
- 27. Amann R, Ludwig W, Schliefer KH (1995) Phylogenetic identification in situ detection of individual microbial cells without cultivation. Microbiol Rev 59: 143–169.
- 28. Sherwood AR, Chan YL, Presting GG (2008) Application of universally amplifying plastid primers to environmental sampling of a stream periphyton community. Mol Ecol Resour 8: 1011–1014. doi: 10.1111/j.1755-0998.2008.02138.x
- 29. Behnke A, Friedl T, Chepurnov VA, Mann DG (2004) Reproductive compatibility and rDNA sequence analyses in the Sellaphora pupula species complex (Bacillariophyta). J Phycol 40: 193–208. doi: 10.1046/j.1529-8817.2004.03037.x
- 30. Helsinki Commission (HELCOM) (2006). Manual for Marine Monitoring in the COMBINE Programme of HELCOM. Available: http://www.helcom.fi/groups/monas/CombineManual/en_GB/main/.
- 31. Bérard-Therriault L, Poulin M, Bossé L (1999) Guide d’identification du phytoplancton marin de l’estuaire et du golfe du Saint-Laurent incluant également certains protozoaires. Publ spéc Can Sci halieut aquatic 128. 387 p.
- 32. Horner RA (2002). A Taxonomic Guide to Some Common Marine Phytoplankton. Bristol: Biopress ltd. 200 p.
- 33. Hoppenrath M, Elbrächter M, Drebes G (2009) Marine Phytoplankton: Selected microsphytoplankton species from the North Sea around Helgoland and Sylt. Stuttgart: E. Schweizerbart Science Publishers. 264 p.
- 34. Jensen KG, Moestrup Ø (1998) The genus Chaetoceros (Bacillariophyceae) in inner Danish coastal waters. Opera Botanica 133: 1–68. doi: 10.1111/j.1756-1051.1998.tb01103.x
- 35. Kraberg A, Baumann M, Dürselen CD (2010) Coastal Phytoplankton: Photo Guide for Northern European Seas. Munich: Verlag Dr. Fiedrich Pfeil. 204 p.
- 36. Rines JEB, Hargraves PE (1988) The Chaetoceros Ehrenberg (Bacillariophyceae) flora of Narragansett Bay, Rhode Island, USA. Biobliotheca Phycologica: 79 196 p.
- 37. Throndsen J, Hasle G, Tangen K (2007) Phytoplankton of Norwegian coastal waters. Oslo: Almater Gorlag As. 343 p.
- 38. Tomas CR (1993). Identifying Marine Phytoplankton. Boston: Academic Press. 858 p.
- 39. Berlyn GP, Miksche JP (1976) Botanical Microtechnique and Cytochemistry. Ames: Iowa State University Press. 326 p.
- 40. Saunders GW, McDevit D (2012) Methods for DNA barcoding photosynthetic protists emphasizing the macroalgae and diatoms. In: Kress WJ, Erickson DL, editors. DNA Barcodes: Methods and Protocols. New York: Humana Press. 207–222.
- 41. Richlen ML, Barber PH (2005) A technique for the rapid extraction of microalgal DNA from single live and preserved cells. Mol Ecol Notes 5: 688–691. doi: 10.1111/j.1471-8286.2005.01032.x
- 42. OGL Accession ID numbers SE23396–SE23435. Ocean Genome Legacy, Ocean Genome Resource database. Available: www.oglf.org/Catalog.htm; deposited May 2013.
- 43. Maddison WP, Maddison DR (2003) MacClade, version 4.06. Sinauer, Sunderland.
- 44. Drummond AJ, Ashton B, Buxton S, Cheung M, Cooper A, et al.. (2011). Geneious v 5.4, Available: http://www.geneious.com.
- 45. Trobajo R, Clavero E, Chepurnov VA, Sabbe K, Mann DG, et al. (2009) Morphological, genetic, and mating diversity within the widespread bioindicator Nitzschia palea (Bacillariophyta). Phycologia 48: 443–459. doi: 10.2216/08-69.1
- 46. McQuoid MR, Hobson LA (1996) Diatom resting stages. J Phycol 32: 889–902. doi: 10.1111/j.0022-3646.1996.00889.x
- 47. Agnarsson I, Kuntner M (2007) Taxonomy in a changing world: seeking solutions for a science in crisis. Syst Biol 56: 531–539.
- 48. Hall N (2007) Advanced sequencing technologies and their wider impact in microbiology. J Exp Biol 209: 1518–1525. doi: 10.1242/jeb.001370
- 49. Lee CK, Herbold CW, Polson SW, Wommack KE, Williamson SJ, et al. (2012) Groundtruthing Next-Gen Sequencing for Microbial Ecology–Biases and Errors in Community Structure Estimates from PCR Amplicon Pyrosequencing. PLoS ONE 7(9): e44224. doi: 10.1371/journal.pone.0044224