Molecular analysis of environmental DNA (eDNA) can be used to assess vertebrate biodiversity in aquatic systems, but limited work has applied eDNA technologies to marine waters. Further, there is limited understanding of the spatial distribution of vertebrate eDNA in marine waters. Here, we use an eDNA metabarcoding approach to target and amplify a hypervariable region of the mitochondrial 12S rRNA gene to characterize vertebrate communities at 10 oceanographic stations spanning 45 km within the Monterey Bay National Marine Sanctuary (MBNMS). In this study, we collected three biological replicates of small volume water samples (1 L) at 2 depths at each of the 10 stations. We amplified fish mitochondrial DNA using a universal primer set. We obtained 5,644,299 high quality Illumina sequence reads from the environmental samples. The sequence reads were annotated to the lowest taxonomic assignment using a bioinformatics pipeline. The eDNA survey identified, to the lowest taxonomic rank, 7 families, 3 subfamilies, 10 genera, and 72 species of vertebrates at the study sites. These 92 distinct taxa come from 33 unique marine vertebrate families. We observed significantly different vertebrate community composition between sampling depths (0 m and 20/40 m deep) across all stations and significantly different communities at stations located on the continental shelf (<200 m bottom depth) versus in the deeper waters of the canyons of Monterey Bay (>200 m bottom depth). All but 1 family identified using eDNA metabarcoding is known to occur in MBNMS. The study informs the implementation of eDNA metabarcoding for vertebrate biomonitoring.
Citation: Andruszkiewicz EA, Starks HA, Chavez FP, Sassoubre LM, Block BA, Boehm AB (2017) Biomonitoring of marine vertebrates in Monterey Bay using eDNA metabarcoding. PLoS ONE 12(4): e0176343. https://doi.org/10.1371/journal.pone.0176343
Editor: Hideyuki Doi, University of Hyogo, JAPAN
Received: November 11, 2016; Accepted: April 10, 2017; Published: April 25, 2017
Copyright: © 2017 Andruszkiewicz et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: We have submitted the sequencing files to the NCBI SRA repository under the following identification number: PRJNA349471.
Funding: This work was supported by a gift from the Seaver Institute to Woods Institute for the Environment at Stanford University and was partially supported by NASA grant NNX14AP62A ‘National Marine Sanctuaries as Sentinel Sites for a Demonstration Marine Biodiversity Observation Network (MBON)’ funded under the National Ocean Partnership Program (NOPP RFP NOAA-NOS-IOOS-2014-2003803 in partnership between NOAA, BOEM, and NASA), and the U.S. Integrated Ocean Observing System (IOOS) Program Office. This publication was developed under STAR Fellowship Assistance Agreement no. F15E211913419 awarded by the U.S. Environmental Protection Agency (EPA). It has not been formally reviewed by EPA. The views expressed in this publication are solely those of Elizabeth Andruszkiewicz and co-authors, and EPA does not endorse any products or commercial services mentioned in this publication. The CANON cruise was supported by the David and Lucile Packard Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Stressors such as ocean acidification, overfishing, coastal development, pollution, and changes in sea surface temperature can cause loss of biodiversity and shifts in species distributions within marine and estuarine environments [1–5]. The rate of species extinction is higher today than it was in pre-human periods and the introduction of invasive species has changed the structure and function of ecosystems [4,6,7]. The National Oceanic and Atmospheric Administration (NOAA) currently lists 2,270 marine species as endangered or threatened under the Endangered Species Act and estimates an annual cost of $137 billion for control and eradication of marine or estuarine invasive species [8,9]. Oceanographic efforts to measure organism abundance and distributions are often conducted annually using shiptime surveys, electric and conventional tags, nets, and ROVs and in some cases can be harmful to species or habitats. New data collection methods are needed to better understand changes in organismal abundance, biodiversity and community structure over shorter time scales [6,10].
Recent advances in metagenomics suggest that the presence and abundance of aquatic vertebrates and invertebrates can be determined by analyzing environmental DNA (eDNA) extracted from water samples . Because of its non-invasive nature, and the relative ease of water sampling, using eDNA for biomonitoring in aquatic systems could enable the acquisition of temporally and spatially intensive biodiversity data sets [6,12]. eDNA is DNA that has been shed from organisms and then retained in environmental matrices such as soil or water. eDNA from macroorganisms may originate from feces, mucus, blood, and sloughed cells, tissue, or scales; in some cases, it may be attached to particles [10,13,14]. Early studies investigated ancient eDNA preserved in soil matrices [15–19]. More recently, methods have been applied to capture contemporary eDNA in sediment  and in aquatic matrices by filtering or precipitating eDNA from water . eDNA captured on a filter or precipitated from water samples can be PCR-amplified using either species-specific or “universal” primers. Amplification using species-specific primers in conjunction with a hydrolysis probe yields quantitative results regarding gene copy concentration via real-time quantitative PCR (qPCR). To conduct a community analysis, eDNA can be PCR-amplified with “universal” primers (e.g. targeting the mitochondrial 12S rRNA gene, 16S rRNA gene, 18S rRNA gene) and then sequenced using next generation sequencing (NGS) [22–24]. Universal primers are developed by aligning whole genomes of groups of species of interest (e.g., bony fishes, marine vertebrates) and optimizing primers to target a short region of a gene that is evolutionarily conserved among all species in the group, but varies enough within that region among species to correctly identify taxa to the genus or species level . Each environmental sample gets a unique “tag” (6 base pairs) added to the primers during PCR amplification, making it possible to sequence several samples on one sequencing run and to separate samples post-sequencing. This significantly reduces the cost of sequencing and is commonly referred to as “eDNA metabarcoding”.
The power of NGS for marine biomonitoring is already being realized. For example, the TARA expeditions conducted large-scale global sampling and the associated researchers have analyzed more than 7 terabases of metagenomic data. They have focused primarily on viruses, prokaryotes, and picoeukaryotes, and the researchers have not yet investigated the use of eDNA to identify macroorganisms [25,26]. Other researchers have applied eDNA methods for identifying macroorganisms and have shown that under some conditions, eDNA methods can more accurately identify species by avoiding biases inherent to traditional biomonitoring methods (e.g., misidentification or lack of identification in visual surveys) [10,27–30]. Though results from previous studies provide evidence that eDNA methods hold promise as sound biomonitoring tools, questions still remain about how to properly sample water and interpret sequencing results [31,32] and few studies [2,10,23,33–36] have investigated the feasibility of using eDNA methods to detect macroorganisms in marine waters.
The present study uses eDNA metabarcoding to census marine vertebrates in the Monterey Bay National Marine Sanctuary (MBNMS). This study expands on a previous eDNA metabarcoding study conducted along a short, 2.5 km transect within MBNMS  by extending the spatial scale to 45 km. We use a recently published universal primer set (MiFish-U)  that targets fish for eDNA metabarcoding. The objectives of our work are to: (i) investigate whether eDNA metabarcoding identifies spatial differences between vertebrate communities present in MBNMS, (ii) compare operational taxonomic units (OTUs) identified using eDNA metabarcoding across biological replicates, and (iii) compare the eDNA metabarcoding census with historical records of species known to occur in MBNMS. To date, there have been seven studies published that use eDNA metabarcoding to identify vertebrates in marine water and some of these studies used microcosms and not actual environmental waters [2,10,23,33–36]. Given the paucity of studies applying eDNA metabarcoding to environmental oceanic samples, this study provides additional proof of concept needed to inform the potential implementation of eDNA metabarcoding for biomonitoring.
Materials and methods
Sample collection and laboratory processing
We collected seawater in MBNMS from 29 September 2015 to 1 October 2015 from the Monterey Bay Aquarium Research Institute (MBARI) R/V Western Flyer, as a part of MBARI’s Controlled, Agile, and Novel Ocean Network (CANON) project. Research activities in the MBNMS are covered in an annual permit to MBARI by MBNMS. The CANON cruise activities are included in the 2015 permit. The water samples collected and processed as part of this study are not subject to any other permit requirement and no other disposition is required. No approval was needed from the Institutional Animal Care and Use Committee because our methods collect water samples with eDNA shed from vertebrates, not vertebrates themselves. We sampled ten stations at two depths, with one station (OA2) being sampled on two days (Fig 1, Table 1).
All are located within the Monterey Bay National Marine Sanctuary. See Table 1 for bottom depth of each station; green stations are on the shelf (<200 m water column depth) and blue stations are in a canyon (>200 m water column depth). Isobaths are labeled with water column depth in meters.
At each station, two depths were sampled; the surface (0 m) and subsurface (20 or 40 m). At each depth, three 1 L samples were collected using a 12-bottle rosette sampler. The three samples were collected in distinct niskin bottles and represent true biological triplicates. Each 1 L sample was transferred from the niskin into a new, polycarbonate single-use sterile, disposable bottle. Samples were vacuum-filtered onto 0.22 μm pore size (47 mm diameter) Durapore polyvinylidene flouride filters (Millipore, USA) using 250 mL disposable analytical test filter funnels filled four times (Nalgene, USA). This resulted in 66 environmental samples (three replicates per sampling depth, two sampling depths per station, ten stations with one station sampled twice). Filtration blanks (n = 3) were created by filtering 1 L of deionized water in the same manner as the environmental samples to check for contamination during field collection. Filters were immediately placed in sterile 5 ml plastic scintillation tubes and stored at -80°C for the remainder of the cruise (until 5 October 2015). The samples were transported to the lab post-cruise on dry ice and stored at -80°C until extraction within 2 months of collection.
For this study, we refer to the location where sampling was conducted as a “station” (i.e., 1F, 2F, etc.), a depth at a station as a “sampling depth” (i.e., 0 m or 20/40 m, surface or subsurface), and each biological replicate (1 L of water filtered) a “sample”. We therefore collected 3 samples at each sampling depth, and 2 sampling depths at each of the 10 stations.
Processing was performed at Stanford University. Benchtops were cleaned with 10% bleach for 10 minutes and then wiped with 70% ethanol. Benchtops were wiped with RNASE AWAY before beginning molecular work. Pipettes were wiped with RNASE AWAY and UV-irradiated for at least 10 minutes before use. DNA extractions were performed on one bench, PCR preparation was performed in a designated DNA-free hood, PCR amplification was performed in a separate room in the laboratory, and post-PCR work was performed in yet another separate room.
We performed extractions in 6 sets, adding in an extraction blank (extraction reagents added to an empty 5 mL tube with no filter, n = 6) for each extraction set. Samples were randomized prior to extraction. We extracted DNA from each filter using the DNeasy Blood and Tissue Kit (Qiagen, USA) following the manufacturer’s protocol with the following modifications. We added 850 μL of lysis buffer , 100 μL of SDS (final concentration (Cf) = 1%), and 100 μL of proteinase K (Qiagen, USA) (Cf = 1 mg/mL) to each filter and incubated at 56°C for 14–16 hours. After incubation, we added 1 mL of Buffer AL (Qiagen, USA) and incubated at 56°C for 10 minutes. Then we added 1 mL of 100% molecular grade ethanol and mixed thoroughly by vortexing. We loaded the lysate from each filter into spin columns and used a QIAvac 24 Plus (Qiagen, USA) vacuum manifold. Luer plugs were soaked in 10% bleach and rinsed with deionized water before each use. After loading the 3 mL of lysate, we followed the DNeasy Blood and Tissue Kit protocol. We performed 2 elutions of 50 μL each for a total extract volume of 100 μL. We immediately quantified total DNA using the QUBIT DSDNA HS ASSAY (Invitrogen, USA) and stored extracts at -20°C until amplification within 1 month of extraction.
In addition to the environmental samples (n = 66), we also included negative controls and positive controls in our study. As negative controls, we included filtration blanks (n = 3) and extraction blanks (n = 6). We also included PCR no-template controls as discussed further below. We included two different positive controls in triplicate (n = 6 total) in the analysis. The two positive controls were (1) genomic DNA extracted from swordfish tissue (Xiphias gladius) and (2) a mock community with equal mass concentration of DNA from 9 species of bony fishes (S1 Table). The mock community and the methods used to create it are described in more detail elsewhere .
We used a two-step PCR method  to amplify extracted eDNA as well as add a unique tag to each sample. For the first PCR amplification, we used a published fish-specific primer set targeting a hypervariable region of the mitochondrial DNA 12S rRNA gene . The primer sequences were F-5’ GTCGGTAAAACTCGTGCCAGC and R-5’ CATAGTGGGGTATCTAATCCCAGTTTG, amplifying a ca 170 bp region. PCR reactions were carried out using 3 μL of DNA extract diluted 1:10 (see “Inhibition testing” below), 0.4 μL of 10 μM forward and reverse primer (Cf = 0.2 μM), 10 μL of HotStarTaq Plus Master Mix (Qiagen, USA), and 6.2 μL of molecular-biology-grade water (Sigma-Aldrich, USA) for a total PCR reaction volume of 20 μL. We used eight-strip PCR tubes with individual caps to prevent cross contamination between samples. Each DNA extract (environmental samples, positive controls, and filtration and extraction blanks) (n = 81) was amplified in triplicate. A no template control (NTC) using molecular-biology-grade water in lieu of DNA template was included for each DNA extract to monitor for contamination in the master mix. A total of 81 NTCs were run; 81 NTCs were needed as 81 mastermixes (each with a unique set of tagged primers) were used in the second PCR (see below) and a NTC was needed for each mastermix. Thermal conditions for the first PCR amplification were 95°C for 5 min followed by 40 cycles of 95°C for 15 s, 55°C for 30 s and 72°C for 30 s.
After amplification, triplicate PCR products were pooled and visualized on a 1.5% agarose gel stained with ethidium bromide to confirm the presence of the target band and confirm no amplification in the NTCs. Pooled PCR products were cleaned using the Agencourt AMPure XP bead system (Beckman Coulter, USA), which removes primer dimers by size selection; cleaned products were quantified using the QUBIT DSDNA HS ASSAY (data not shown). The PCR product from the first amplification was then used as the template for the second PCR amplification. Despite the lack of amplification in NTCs, we included the NTCs in downstream processing as template for the second PCR amplification. This is a conservative approach to ensure that no contamination was present, even if no product was visualized in a gel. Similarly, none of the filtration or extraction blanks showed amplification in the gel visualization, but we carried these through the method with the other PCR products.
The second PCR amplification used the same primers listed above, but with the addition of 6 bp indices on the 5’ ends of the primers to allow concurrent sequencing of multiple samples. The tag sequences were used in a previous study  and were designed with a Hamming distance of at least three bases between tags and were preceded by NNN (S2 Table) . The same tag was added to both the forward and reverse primer used to amplify each sample in order to reduce tag jumping . The second PCR reactions were carried out in triplicate using 3 μL of the PCR product from the first PCR as template, 0.4 μL of 10 μM tagged forward and reverse primers unique for each sample (Cf = 0.2 μM), 10 μL of HotStarTaq Plus Master Mix (Qiagen, USA), and 6.2 μL of molecular-biology-grade water (Sigma-Aldrich, USA) for a total reaction volume of 20 μl. Thermal conditions for the second PCR amplification were 95°C for 5 min followed by 20 cycles of 95°C for 15 s, 57°C for 30 s and 72°C for 30 s.
After the second amplification, triplicate PCR products were pooled, visualized, cleaned, and quantified using the methods described above for the first PCR amplification. None of the negative controls showed amplification (no band in the gel) but were still prepared for sequencing. Similarly, none of the NTCs showed amplification after the first or second PCR amplification. We pooled individual NTCs together so that the pooled NTC could be included on the sequencing run (as described below). We prepared environmental samples, positive controls, negative controls, and the pooled NTC (hereafter “NTC”) for sequencing (n = 82).
Before amplification, a subset of samples was selected to test for inhibition by performing a series of dilutions. Samples were amplified using the untagged primers (first step PCR amplification) at the following dilutions: 1:1, 1:10, 1:50, 1:100. Based on the results of the test (data not shown), all samples were diluted 1:10 before amplification in order to reduce PCR inhibition.
Library preparation and DNA sequencing
The tagged products from the second PCR amplification (environmental samples, positive controls, negative controls, and the NTC) were combined into 3 pools to create 3 libraries. As these pools were designed to have similar volumes, 50 ng of DNA from each sample was added to each pool. For the filter blanks, extraction blanks, and NTC, we added the average volume added to the pool for the environmental samples/positive controls because their DNA concentrations were too low to quantify. The total concentrations of DNA for each of the 3 pools were quantified using the QUBIT DSDNA HS ASSAY (data not shown), and 250 ng of each pool was used for library preparation with the KAPA Hyper Prep kit (KAPA Biosystems, USA). Each library had a NEXTFLEX DNA barcode (BIOO Scientific, USA) added during the library preparation containing a unique 6 bp identifier as well as the Illumina adapter sequence, resulting in 3 barcoded libraries. The 3 libraries were then combined with an equal mass of DNA (227 ng per library). The final concentration of the 3 combined libraries was 22.2 ng/μl. We used a Bioanalyzer with High Sensitivity DNA assay (Agilent Technologies, USA) to confirm library size and concentration. We sequenced the 3 libraries on an Illumina MiSeq platform at the Stanford Functional Genomics Facility using 2x250 paired-end sequencing and adding a 20% Phi-X spike-in control.
Bioinformatic analyses were performed using a Unix shell script . Paired-end reads were merged using PEAR (v0.9.6)  with the following parameters: maximum assembly length = 251, minimum assembly length = 150, quality score threshold = 15, and p-value = 0.01. The reads were filtered using the fastq_filter command in USEARCH (v1.8.0)  for a minimum sequence length of 251 and expected errors per read of 0.5. Sequences were demultiplexed and only retained if the tag added during amplification was found on both the forward and reverse read to eliminate samples with tag jumping [38,43]. Primers were removed using cutadapt (v1.8.3) and singleton reads were removed. Sequences were clustered into OTUs using SWARM (v2.1.5)  with a cluster radius of 1; OTUs less abundant than 0.005% were removed .
We then compared the number of reads for each OTU in the filtration blanks, extraction blanks, and NTC with the number of reads in the environmental samples and positive controls. For each OTU for which there were reads in the blanks and/or NTC, we subtracted the maximum read number among the blanks and NTC from the read number in the environmental samples and positive controls (S3 Table).
OTUs were then annotated by comparing a representative sequence of each OTU to sequences deposited in the National Center for Biotechnology Information (NCBI) nucleotide (nt) database (downloaded January 4th, 2017) using BLAST+ (2.2.31+) . The following parameters were used: percent identity = 97%, word size = 30, e value = 1e-20. The percent identity cut-off of 97% is the parameter used by the authors who developed the primers as well as another published marine metabarcoding study [2,23]. As representative sequences from OTUs often hit multiple entries in the NCBI database, we used the “taxize” package in R  to summarize the BLAST+ results, and we used the entry with the lowest e-value for each OTU to assign taxonomy. In the case that an OTU matched multiple entries in the nt database with the same percent identity and e-value, we used the lowest common taxonomic rank to annotate the OTU. For example, if an OTU matched two species with the equal parameters, no distinction could be made between which species the OTU represented so we assigned a genus level annotation. For this paper, we define a “taxon” as an OTU that was annotated using the set parameters described above.
We then removed OTUs classified as non-vertebrates (e.g., Gammaproteobacteria) and non-marine vertebrates (e.g., Canis lupis or Homo sapiens) (S4 Table). To account for uneven sequencing depths, we rarefied each sample (environmental and positive controls) to 45,000 reads using the “rrarefy” function in the R package vegan . We chose 45,000 as 63/66 environmental samples had >45,000 reads (S1 Fig). The 3 environmental samples with less than 45,000 reads had the majority of reads assigned to non-marine vertebrates (i.e., Sus scrofa, Homo sapiens). These three environmental samples (3F-0m-Rep3, 5F-0m-Rep1, and 5F-0m-Rep3) were removed from subsequent analyses.
We investigated whether vertebrate community composition, as inferred using eDNA metabarcoding, was related to sampling depth or water column depth using a 2-way crossed ANOSIM implemented in the software package Plymouth Routines in Multivariate Ecological Research (PRIMER6) . ANOSIM used Jaccard distance matrices generated using presence/absence data at the OTU level. The null hypotheses were that the distances between samples collected at the same sampling depth are smaller or equal to the distances between samples collected at different depths; and that the distances between samples collected at stations with similar water column depth are smaller or equal to the distances between samples collected at stations with different water column depths. Samples were either collected at the “surface” (0 m) or at “subsurface” (20 or 40 m), and at stations either in a “canyon” (>200 m deep) or on the “shelf” (<200 m deep). We used Kruskal-Wallis tests and Spearman rank correlations with presence/absence at the OTU level to investigate relationships among biological replicates (only at sampling depths with three biological replicates after removing samples with <45,000 reads). A p-value of 0.05 served as a cut off for statistical significance.
Census of marine vertebrate taxa and cross-verification.
We compared taxa identified using eDNA metabarcoding to a historical record of taxa in MBNMS to determine if eDNA metabarcoding gives a reasonable census of marine vertebrates in the surveyed region. Annotation of representative OTU sequences varied in taxonomic rank. We took assignments at the species, genus, tribe, subfamily, and family level and generated a list of all taxa using their family designation. We used the “Checklist of Fishes Known to Occur in Monterey Bay National Marine Sanctuary”  compiled in 2013 from a variety of guidebooks, local experts, and field studies, as well as a “Site Characterization” published by MBNMS managers for pinnipeds and cetaceans  as the historical record.
Raw sequence processing
Across the 82 samples, including positive controls, blanks, and the NTC, the sequencing runs produced 14,928,120 reads with an average error rate of 1.65%; 92.53% of reads had a Q score of ≥30. After merging paired-end reads, fastq quality filtering, identifying tags and adapters, and removing singletons, 6,010,859 high quality reads remained in the environmental samples, positive controls, and negative controls (Table 2). The average number of high quality reads per environmental sample was 85,240 and ranged from 45,829 to 127,269. The blanks and NTC (n = 10) had between 24 and 11,421 reads (median = 47) (S3 Table). SWARM generated 4,775 OTUs across the environmental samples, positive controls, blanks, and NTC. We subtracted the maximum number of reads for each OTU found in the negative controls from the positive controls and environmental samples and we removed any OTUs annotated to non-vertebrates and non-marine vertebrates. The reads from positive controls and environmental samples were then rarefied to 45,000 per sample to account for unequal sequencing depths (S1 Fig). 3,530 OTUs remained across the environmental samples, which we annotated to the lowest taxonomic rank. Of the 3,530 OTUs, 1,165 were annotated as 92 unique marine vertebrate taxa using the NCBI database (S4 Table). Although 2,365 OTUs were not annotated, they represent just 4.4% of the rarefied reads.
Positive and negative controls
Three types of negative controls samples were sequenced; these included 3 filter blanks, 6 extraction blanks, and a representative NTC for a total of 10 negative controls. The negative controls had orders of magnitude lower number of reads than the environmental samples and positive controls (S3 Table, median = 47 for negative controls compared to 84,595 for environmental samples). To be conservative, for each OTU, if one or more negative control contained reads for that OTU, we subtracted the maximum number of reads found in the negative control from the number of reads recorded for that OTU in each environmental sample and positive control, while not letting the number of reads fall below 0. This affected a total of 61 unique OTUs (S3 Table). We made this adjustment before rarifying the data and before any statistical analyses. We also completed all the analyses described in this paper with unadjusted data (ignoring the results from the negative controls) and the results of the analyses did not change (data not shown).
We sequenced two types of positive controls each in triplicate: DNA extracted from swordfish (Xiphias gladius) tissue and a mock “community” constructed from DNA extracted from the tissue of 9 fish (S1 Table). The three replicates of the swordfish control produced 134,999 reads out of 135,000 (3 x 45,000) reads assigned to Xiphias gladius; 1 read was assigned to Chilara taylori, suggesting extremely low cross contamination or sequencing errors occurred in these samples. Combining reads from the three mock community replicates, eDNA metabarcoding identified 8 of the 9 mock community taxa. No reads were assigned to the 9th taxon: Paralichthys (large-tooth flounder). Of all the sequencing reads from the mock community samples, 25.5% were not annotated using the criteria described in the methods section. There were no reads assigned to taxa not present in the mock community. Although DNA from each of the 9 taxa were combined in equal mass concentrations to construct the standard, the relative abundance of the taxa inferred from the number of sequencing reads do not reflect equal proportions (S1 Table) .
Difference among biological replicates
We found that biological replicates did not identify the same OTUs (Fig 2). The majority of OTUs (over 52%) identified at each sampling depth was found in only one of three biological replicates; between 0 and 13.7% of OTUs were found in all three replicates. There was a significant negative correlation between the total number of OTUs identified at a sampling depth and the percent of the OTUs found in just one biological replicate (Spearman rho = -0.54, p = 0.014, n = 20). However, there is no difference in the percent of total OTUs found in only one biological replicate between samples collected at surface versus those collected at subsurface (Kruskal-Wallis test, p = 0.21, H = 1.57); the median percent for surface samples was 85.23% and for subsurface samples was 94.96%. There is also no difference in the percent of OTUs found in only a single biological replicate and the depth of the water column where the sample was collected (Kruskal-Wallis test, p = 0.16, H = 1.98); the median percent of OTUs was 85.23% in the shelf samples versus 95.12% in the canyon samples.
Samples are labeled with station (i.e., 1F, 2F, etc.) followed by the sampling depth (i.e., 0 m, 20 m, 40 m). 3F-0 m and 5F-0 m are not shown because they do not have complete sets of three replicates after rarefying.
We recognize that rare OTUs might not be found in all three biological replicates. However, even if we consider just the 100 most abundant OTUs across all samples, there is still a large percentage of OTUs found in just one biological replicate (S2 Fig, range: 0% to 100%, median: 61.90%).
Taxa/Families identified via eDNA metabarcoding
We identified 92 marine vertebrate taxa annotated at the taxonomic rank of family or lower in the environmental samples. These taxa were annotated at variable ranks: 72 were identified to species level, 10 to genus level, 3 to subfamily level, and 7 to family level. The 92 taxa represent 33 unique marine vertebrate families (Table 3). Between 3–21 unique families were detected at each station (across both sampling depths and all biological replicates) (S3 Fig, S5 Table), and the four most common were Myctophidae, Paralichthyidae, Scombridae, and Sebastidae (Table 4), which are all families with species well known to be in the region.
Station OA2, located on the continental shelf and inside the Año Nuevo State Marine Reserve, had the greatest number of families present (26 families across the 2 sampling days). This was also the shallowest of all sampling stations. Of the 33 families found across all stations and sampling depths, 20 were identified only at stations on the continental shelf, 2 were identified only at stations within a canyon, and 11 were found both at stations on the shelf and stations in a canyon (Fig 3). Similarly, 6 of the 35 families were only found in surface samples, 6 were only found in subsurface samples (20/40 m deep), and 21 were found in both surface and subsurface samples (Fig 4).
20 families were only found on the shelf, 2 were only found in a canyon, and 11 were found at both.
Comparison of taxa identified using eDNA metabarcoding and those known to occur in MBNMS
Of the 33 marine vertebrate families identified using eDNA metabarcoding, 32 are known to occur within MBNMS (Table 3 and S6 Table). Cryptacanthodidae (wrymouths) was the only family not noted in the historical list that was identified in the sequences.
Of the 72 species level taxonomic assignments, 52 are known to occur within MBMNS. Most of the remaining species (18 of 20), although not on the MBMNS checklist, belong to genera or families represented on the checklist (Table 3 and S6 Table).
Vertebrate community composition at different sampling and bottom depths of Monterey Bay
Samples collected at the same depth in the water column (n = 30) were more similar than samples collected at different depths (n = 33) (ANOSIM R = 0.059, p = 0.041). Also, samples collected at stations on the shelf (n = 34) or in a canyon (n = 29) were more similar to each other than to samples collected at stations with varying water column depths (R = 0.100, p = 0.002). The R values are small, despite the null hypotheses being rejected, suggesting that there is overlap in community composition among the samples.
eDNA metabarcoding provides a realistic census of marine vertebrates
Thirty-two out of 33 families detected using eDNA metabarcoding are known to be present in MBNMS. The families have been documented in regional guidebooks and literature, identified in recent field surveys, or have been catalogued in ichthyology collections . Cryptacanthodidae (wrymouths) is the only family detected by eDNA metabarcoding not known to occur in the area. The native habitats for the two species within Cryptacanthodidae (Cryotacanthodes bergi and Cryptacanthodes giganteus) occur in the Northwest Pacific for C. bergi and the Northeast Pacific extending down to Northern California for C. giganteus. It remains possible that Cryptacanthodidae have migrated into MBNMS since 2013 when the historical list of MBNMS organisms was last updated. It is also possible that the eDNA identifications of Cryptacanthodidae were false positives. If they were, the family-level false positive rate of eDNA metabarcoding in this study would be 3%. Other eDNA metabarcoding studies have reported false positive rates of 0  to 8.3% .
The historical list of species present in MBNMS contains 146 families whose presence presumably varies over time and space. It is unlikely that all of these families were present during our sampling cruise, thus, we are not able to generate a false negative rate for this study. Studies using species-specific qPCR report false negative rates ranging from 0–8.2% [21,28,52], but most eDNA metabarcoding studies in environmental waters do not report false negative rates. Port et al.  reported an eDNA metabarcoding false negative rate of 8.3% using organism counts from a visual dive survey as the “true” census of marine vertebrates. However, the use of visual counts as the “gold standard” for biomonitoring has drawbacks as described by Kelly et al. .
There are differences in vertebrate community composition identified by eDNA metabarcoding between the surface and subsurface waters, and between neritic (<200 m depth) stations versus deepwater stations in Monterey canyons. Certain taxa were found in deep waters within canyons and others remain close to shore in shallow waters. For example, we identified taxa in the family Cottidae only at stations on the shelf; the family is known to be found in shallow waters near shore . Other families that were found only on the shelf are known to inhabit neritic, shallower waters, living in rocky areas or kelp forests [51,54]. We found the shallowest station (OA2) to have the highest biodiversity.
In addition to biodiversity changing across the topographical environments, we found differences in vertebrate communities in surface versus subsurface waters. During the cruise, the water column was stratified with a continuous, nearly linear trend between temperature and depth (|ΔT| between surface and subsurface sampling depths was, on average 2.7°C, and ranged from 1.4°C–3.6°C). The thermocline limits vertical mixing of eDNA in the water column and the environments above and below the thermocline represent different ecological niches. Thus the presence of the thermocline may explain the observation of different vertebrate taxa identified using eDNA metabarcoding at different sampling depths in the water column. However, the discrepancy between eDNA found at the surface and subsurface could potentially be due to physical properties of eDNA (i.e., its density or whether it is particle-association) or the latency in degradation between warmer waters and cooler waters at depth.
Biological replicates identify different taxa
Previous eDNA studies have not included true biological replicates. Rather, they included pseudoreplicates (multiple subsamples from one large volume sample) [2,23,33], or pooled sequencing results from biological replicates . The results from our study indicate that a single, unreplicated sample is not necessarily representative of the water being sampled. This may be due to eDNA not being homogenously mixed throughout the sampled water mass. We found a negative correlation between number of OTUs and the percent found in one replicate. This indicates that as more OTUs are identified in a sample, fewer OTUs are found in just one replicate. Until there is a better understanding of the spatial heterogeneity of eDNA in the water column, biological replicates should be collected for eDNA metabarcoding studies and combined when analyzing presence and/or absence data. Another possibility is that the difference between biological replicates could be influenced by the stochastic nature of the PCR process .
eDNA metabarcoding limitations
False positives and false negatives are concerns for any biomonitoring method. Potential sources of false positives in eDNA metabarcoding include cross-contamination between samples or from positive controls, sequences being assigned to the wrong taxa, or a misidentification of a species deposited in the NCBI database [31,32]. False negatives might result from eDNA from an organism not being captured in the water sample, target eDNA not being amplified by universal primers, taxa with low numbers of sequencing reads being lost during rarefaction, or PCR amplification bias [6,31,32,55,56]. False negatives could also be a result of an OTU that is not annotated. Species occupancy models and statistical methods have been developed to account for false positives and false negatives when interpreting traditional biomonitoring data (i.e., data collected using fish trawls, electroshocking, and visual surveys) [57,58] and may also be useful for interpreting eDNA metabarcoding data [31,34,59–61]. However, these models require that species be identified using multiple detection methods or that false positive and negative detection rates are known a priori .
Of the 3,530 OTUs identified in the environmental samples, 2,150 did not have representative sequences matching entries in the NCBI nucleotide database. While those 2,150 OTUs only contain 4.3% of sequencing reads, the lack of matches in the database can be explained in part by a data gap in the repository with respect to fish, shark, and marine mammal mitochondrial genomes. As an example, teleost fish (fish of the infraclass Teleostei) are the largest known group of vertebrates with more than 27,000 species, making up 96% of bony fish of the superclass Osteichthyes . As of August 2016, the database had 28,462 entries of the mitochondrial 12S rRNA gene of teleosts, but only ~8,000 unique species meaning that only about 30% of teleost species have sequences deposited in the database. Results from the mock community positive control illustrate that this can occur, as the taxon present in the mock community that was not identified using eDNA metabarcoding (Paralichthys) has entries in the database. We found that the most abundant OTU that was not annotated by our methods in the mock community matched an entry in the NCBI nt database for Paralichthys olivaceus, submitted by the Kyoto Aquarium at 95% identity (a lower percent identity cutoff than used in the present study).
Finally, results from the mock community positive control highlight the challenges of using the described eDNA metabarcoding in a quantitative manner. The relative proportions of sequencing reads in the mock community are different than original proportions (based on DNA mass) used to construct the community potentially owing to the high cycles of PCR used in this study. Previous eDNA metabarcoding studies of fish (one in freshwater mesocosms and one in marine environmental waters) have reported that taxa relative abundance is positively associated with taxa counts obtained using visual surveys [33,63]. More work is needed to explore how eDNA metabarcoding may be used to obtain quantitative information on taxa abundance .
This observational study in MBNMS finds that marine vertebrate communities identified using eDNA metabarcoding varied with depth in the water column. In addition, the vertebrate community varied as expected with total water column depth as the transect extended from coastal waters into canyon realms. These findings expand our current knowledge of the spatial heterogeneity of vertebrate eDNA. It also highlights the importance of collecting biological replicates for eDNA metabarcoding. eDNA metabarcoding provides a realistic census of marine vertebrates in MBNMS, including 33 total families found across all replicates, sampling depths, and stations, of which 32 were known to be in MBNMS.
eDNA metabarcoding offers enormous potential for biomonitoring. Sampling collection is fairly straightforward, and filters can be archived at -80°C for extended periods of time. Preliminary studies have shown that eDNA metabarcoding can identify vertebrate species missed by traditional monitoring methods and sample vertical distributions that would otherwise not be possible with traditional techniques. Moreover, eDNA metabarcoding can be used at finer temporal and spatial resolution compared to traditional biomonitoring methods to document changes in biodiversity over seasonal and annual cycles, and over topographic gradients.
S1 Fig. Rarefaction curves for environmental samples.
Rarefaction curves for all environmental samples. Vertical line highlights 45,000 reads. Horizontal lines show number of OTUs per sample with 45,000 reads.
S2 Fig. Percent of top 100 OTUs (in terms of number of sequences across all samples) identified in 1, 2 or 3 of the biological replicates collected at each station/sampling depth.
Samples are labeled with station (i.e., 1F, 2F, etc.) followed by the sampling depth (i.e., 0 M, 20 M, 40 M).
S3 Fig. Number of families found at each station across all biological replicates and sampling depths.
Isobaths are labeled with their depth in meters.
S1 Table. Composition of mock community used as positive control and sequencing reads annotated to taxa in mock community and tissue sample positive controls.
S2 Table. Sequences of tagged primers used for second PCR amplification.
S3 Table. Sequence counts in negative control samples and representative NTC sample with annotations.
"EB" stands for extraction blank. "FB" stands for filter blank.
S4 Table. Complete list of taxa before and after removing reads assigned to non-vertebrates and non-marine vertebrates.
S5 Table. Number of total OTUs, annotated OTUs, and families found at each sampling station.
We thank Collin Closek, Ryan Kelly, and Rebecca Martone for their comments on a previous version of the manuscript and Nick Mendoza for contributing to the initial sampling on the cruise.
- Conceptualization: EAA HAS FPC LMS BAB ABB.
- Data curation: EAA.
- Formal analysis: EAA.
- Funding acquisition: ABB FPC.
- Investigation: HAS EAA ABB.
- Methodology: ABB EAA BAB LMS.
- Project administration: ABB BAB.
- Resources: FPC ABB BAB.
- Software: EAA.
- Supervision: ABB BAB.
- Validation: EAA ABB.
- Visualization: ABB BAB EAA.
- Writing – original draft: EAA ABB.
- Writing – review & editing: EAA ABB FPC BAB HAS LMS.
- 1. Roberts CM, Hawkins JP. Extinction risk in the sea. TREE. 1999;14: 241–246. pmid:10354629
- 2. Kelly RP, Port JA, Yamahara KM, Crowder LB. Using Environmental DNA to Census Marine Fishes in a Large Mesocosm. Hofmann GE, editor. PLoS ONE. 2014;9: e86175–11. pmid:24454960
- 3. McCauley DJ, Pinsky ML, Palumbi SR, Estes JA, Joyce FH, Warner RR. Marine defaunation: Animal loss in the global ocean. Science. 2015;347: 1255641–1255641. pmid:25593191
- 4. Coll M, Libralato S, Tudela S, Palomera I, Pranovi F. Ecosystem Overfishing in the Ocean. Hector A, editor. PLoS ONE. Public Library of Science; 2008;3: e3881–10. pmid:19066624
- 5. Haigh R, Ianson D, Holt CA, Neate HE, Edwards AM. Effects of Ocean Acidification on Temperate Coastal Marine Ecosystems and Fisheries in the Northeast Pacific. Thiyagarajan Rajan V, editor. PLoS ONE. 2015;10: e0117533–46. pmid:25671596
- 6. Thomsen PF, Willerslev E. Environmental DNA. Biological Conservation. Elsevier Ltd; 2015;183: 4–18.
- 7. MacDougall AS, Turkington R. Are invasive species the drivers or passengers of change in degrated ecosystems? Ecology. 2005;86: 42–55.
- 8. Endangered and Threatened Marine Species under NMFS' Jurisdiction [Internet]. 2016. [Cited 18 Jul 2016]. National Oceanic and Atmospheric Administration Fisheries; [about 4 screens]. Available from: http://www.nmfs.noaa.gov/pr/species/esa/listed.htm#fish.
- 9. Invasive Species [Internet]. 2016. [Cited 18 Jul 2016]. National Oceanic and Atmospheric Administration Fisheries; [about 2 screens]. Available from: http://www.habitat.noaa.gov/restoration/programs/invasivespecies.html.
- 10. Thomsen PF, Kielgast J, Iversen LL, Møller PR, Rasmussen M, Willerslev E. Detection of a Diverse Marine Fish Fauna Using Environmental DNA from Seawater Samples. Lin S, editor. PLoS ONE. 2012;7: e41732–9. pmid:22952584
- 11. Foote AD, Thomsen PF, Sveegaard S, Wahlberg M, Kielgast J, Kyhn LA, et al. Investigating the Potential Use of Environmental DNA (eDNA) for Genetic Monitoring of Marine Mammals. Lin S, editor. PLoS ONE. 2012;7: e41781–6. pmid:22952587
- 12. Schratzberger M, Dinmore T, Jennings S. Impacts of trawling on the diversity, biomass and structure of meiofauna assemblages. Marine Biology. 2002;140: 83–93.
- 13. Thomsen PF, Kielgast J, Iversen LL, Wiuf C, Rasmussen M, Gilbert TP, et al. Monitoring endangered freshwater biodiversity using environmental DNA. Mol Ecol. 2011;21: 2565–2573. pmid:22151771
- 14. Barnes MA, Turner CR, Jerde CL, Renshaw MA, Chadderton WL, Lodge DM. Environmental Conditions Influence eDNA Persistence in Aquatic Systems. Environ Sci Technol. 2014;48: 1819–1827. pmid:24422450
- 15. Pedersen MW, Overballe-Petersen S, Ermini L, Sarkissian CD, Haile J, Hellstrom M, et al. Ancient and modern environmental DNA. Philosophical Transactions of the Royal Society B: Biological Sciences. 2014;370: 20130383–20130383.
- 16. Haile J, Holdaway R, Oliver K, Bunce M, Gilbert MTP, Nielsen R, et al. Ancient DNA Chronology within Sediment Deposits: Are Paleobiological Reconstructions Possible and Is DNA Leaching a Factor? Molecular Biology and Evolution. 2007;24: 982–989. pmid:17255121
- 17. Anderson-Carpenter LL, McLachlan JS, Jackson ST, Kuch M, Lumibao CY, Poinar HN. Ancient DNA from lake sediments: Bridging the gap between paleoecology and genetics. BioMed Central Ltd; 2011;11: 1–15.
- 18. Jorgensen T, Haile J, Moller P, Andreev A, Boessenkool S, Rasmussen M, et al. A comparative study of ancient sedimentary DNA, pollen and macrofossils from permafrost sediments of northern Siberia reveals long-term vegetational stability. Mol Ecol. 2012;21: 1989–2003. pmid:22590727
- 19. Thomsen PF, Elias S, Gilber MTP, Haile J, Munch K, Kuzmina S, et al. Non-Destructive Sampling of Ancient Insect DNA. PLoS ONE. 2009;: 1–6.
- 20. Yoccoz NG, Brathen KA, Gielly L, Haile J, Edwards ME, Goslar T, et al. DNA from soil mirrors plant taxonomic and growth form diversity. Mol Ecol. 2012;21: 3647–3655. pmid:22507540
- 21. Ficetola GF, Miaud C, Pompanon F, Taberlet P. Species detection using environmental DNA from water samples. Biology Letters. 2008;4: 423–425. pmid:18400683
- 22. Ivanova NV, Zemlak TS, Hanner RH, Hebert PDN. Universal primer cocktails for fish DNA barcoding. Molecular Ecology Notes. 2007;7: 544–548.
- 23. Miya M, Sato Y, Fukunaga T, Sado T, Poulsen JY, Sato K, et al. MiFish, a set of universal PCR primers for metabarcoding environmental DNA from fishes: detection of more than 230 subtropical marine species. R Soc open sci. 2015;2: 150088–33. pmid:26587265
- 24. Riaz T, Shehzad W, Viari A, Pompanon F, Taberlet P, Coissac E. ecoPrimers: inference of new DNA barcode markers from whole genome sequence analysis. Nucleic Acids Research. 2011;39: e145–e145. pmid:21930509
- 25. Karsenti E, Acinas SG, Bork P, Bowler C, de Vargas C, Raes J, et al. A Holistic Approach to Marine Eco-Systems Biology. PLoS Biology. 2011;9: e1001177–5. pmid:22028628
- 26. Sunagawa C, Coelho LP, Chaffron S, Kultima JR, Labadie K, Salazar G, et al. Structure and function of the global ocean microbiome. Science. 2015;348: 1–10.
- 27. Pilliod DS, Goldberg CS, Arkle RS, Waits LP, Richardson J. Estimating occupancy and abundance of stream amphibians using environmental DNA from filtered water samples. Can J Fish Aquat Sci. 2013;70: 1123–1130.
- 28. Laramie MB, Pilliod DS, Goldberg CS. Characterizing the distribution of an endangered salmonid using environmental DNA analysis. Biological Conservation. Elsevier Ltd; 2015;183: 29–37.
- 29. Dejean T, Valentini A, Miquel C, Taberlet P, Bellemain E, Miaud C. Improved detection of an alien invasive species through environmental DNA barcoding: the example of the American bullfrog Lithobates catesbeianus. Journal of Applied Ecology. 2012;49: 953–959.
- 30. Sigsgaard EE, Carl H, Møller PR, Thomsen PF. Monitoring the near-extinct European weather loach in Denmark based on environmental DNA from water samples. Biological Conservation. Elsevier Ltd; 2015;183: 46–52.
- 31. Shelton AO, O'Donnell JL, Samhouri JF, Lowell N, Williams GD, Kelly RP. A framework for inferring biological communities from environmental DNA. Ecological Applications. 2016;: 1–47.
- 32. Goldberg CS, Turner CR, Deiner K, Klymus KE, Thomsen PF, Murphy MA, et al. Critical considerations for the application of environmental DNA methods to detect aquatic species. Methods Ecol Evol. 2016;: 1–34.
- 33. Port JA, O'Donnell JL, Romero-Maraccini OC, Leary PR, Litvin SY, Nickols KJ, et al. Assessing vertebrate biodiversity in a kelp forest ecosystem using environmental DNA. Mol Ecol. 2015;25: 527–541. pmid:26586544
- 34. Valentini A, Taberlet P, Miaud C, Civade R, Herder J, Thomsen PF, et al. Next-generation monitoring of aquatic biodiversity using environmental DNA metabarcoding. Mol Ecol. 2016;25: 929–942. pmid:26479867
- 35. Yamamoto S, Masuda R, Sato Y, Sado T, Araki H, Kondoh M, et al. Environmental DNA metabarcoding reveals local fish communities in a species-rich coastal sea. Nature Publishing Group. Nature Publishing Group; 2016;: 1–12.
- 36. Thomsen PF, Møller PR, Sigsgaard EE, Knudsen SW, Jørgensen OA, Willerslev E. Environmental DNA from Seawater Samples Correlate with Trawl Catches of Subarctic, Deepwater Fishes. Mahon AR, editor. PLoS ONE. 2016;11: e0165252–22. pmid:27851757
- 37. Bostrom KH, Simu K, Hagstrom A, Riemann L. Optimization of DNA extraction for quantitative marine bacterioplankton community analysis. Limnology and Oceanography Methods. 2004;2: 365–373.
- 38. O'Donnell JL, Kelly RP, Lowell NC, Port JA. Indexed PCR Primers Induce Template-Specific Bias in Large-Scale DNA Sequencing Studies. Mahon AR, editor. PLoS ONE. 2016;11: e0148698–11. pmid:26950069
- 39. De Barba M, Miquel C, Boyer F, Mercier C, Rioux D, Coissac E, et al. DNA metabarcoding multiplexing and validation of data accuracy for diet assessment: application to omnivorous diet. Mol Ecol Resour. 2013;14: 306–323. pmid:24128180
- 40. Xiong W, Li H, Zhan A. Early detection of invasive species in marine ecosystems using high-throughput sequencing: technical challenges and possible solutions. Marine Biology. Springer Berlin Heidelberg; 2016;163: 1–12.
- 41. Zhang J, Kobert K, Flouri T, Stamatakis A. PEAR: a fast and accurate Illumina Paired-End reAd mergeR. Bioinformatics. 2014;30: 614–620. pmid:24142950
- 42. Edgar RC. Search and clustering orders of magnitude faster than BLAST. Bioinformatics. 2010;26: 2460–2461. pmid:20709691
- 43. Schnell IB, Bohmann K, Gilbert TP. Tag jumps illuminated—reducing sequence-to-sample misidentifications in metabarcoding studies. Mol Ecol Resour. 2015;15: 1289–1303. pmid:25740652
- 44. Mahé F, Rognes T, Quince C, de Vargas C, Dunthorn M. Swarm: robust and fast clustering method for amplicon-based studies. PeerJ. 2014;2: e593–13. pmid:25276506
- 45. Bokulich NA, Subramanian S, Faith JJ, Grevers D, Gordon JI, Knight R, et al. Quality-filtering vastly improves diversity estimates from illumina amplicon sequencing. Nature Methods. 2013;10: 57–60. pmid:23202435
- 46. Camacho C, Coulouris G, Avagyan V, Ma N, Papadopoulos J, Bealer K, et al. BLAST+: architecture and applications. BMC Bioinformatics. 2009;10: 421–9. pmid:20003500
- 47. Chamberlain SA, Szöcs E. taxize: taxonomic search and retrieval in R. F1000Res. 2013;2: 1–28.
- 48. Oksanen J, Blanchet FG, Kindt R, Legendre P, Minchin PR, OHara RB, et al. vegan: Community Ecology Package. 2016;: 1–291.
- 49. Clarke KR, Warwick RM. Change in marine communities: an approach to statistical analysis and interpretation. 2nd ed. Plymouth; 2001.
- 50. Burton EJ, Lea RN. Checklist of Fishes Known to Occur in Monterey Bay National Marine Sanctuary. 2013 Sep pp. 1–19.
- 51. Guerrero J, Kvitek R, editors. Monterey Bay National Marine Sanctuary Site Characterization [Internet]. 5 Mar 2014. Available from: http://montereybay.noaa.gov/sitechar/welcome.html.
- 52. Wilcox TM, McKelvey KS, Young MK, Sepulveda AJ, Shepard BB, Jane SF, et al. Understanding environmental DNA detection probabilities: A case study using a stream-dwelling char Salvelinus fontinalis. Biological Conservation. 2016;194: 209–216.
- 53. Kelly RP, Closek CJ, O'Donnell JL, Kralj JE, Shelton AO, Samhouri JF. Genetic and Manual Survey Methods Yield Different and Complementary Views of an Ecosystem. In review.
- 54. Pauly D, Froese R, editors. Fishbase [Internet]. [cited 12 Jul 2016]. Available: www.fishbase.org
- 55. Radulovici AE, Archambault P, Dufresne F. DNA Barcodes for Marine Biodiversity: Moving Fast Forward? Diversity. 2010;2: 450–472.
- 56. Bohmann K, Evans A, Gilbert TP, Carvalho GR, Creer S, Knapp M, et al. Environmental DNA for wildlife biology and biodiversity monitoring. Trends in Ecology & Evolution. Elsevier Ltd; 2014;29: 358–367.
- 57. Gu W, Swihart RK. Absent or undetected? Effects of non-detection of species occurrence on wildlife–habitat models. Biological Conservation. 2004;116: 195–203.
- 58. MacKenzie D, Nichols J, Lachman G, Droege S, Royle JA, Langtimm C. Estimating site occupancy rates when detection probabilities are less than one. Ecology. 2002;83: 2248–2255.
- 59. Lahoz-Monfort JJ, Guillera-Arroita G, Tingley R. Statistical approaches to account for false-positive errors in environmental DNA samples. Mol Ecol Resour. 2015;16: 673–685. pmid:26558345
- 60. Ficetola GF, Pansu J, Bonin A, Coissac E, Giguet-Covex C, De Barba M, et al. Replication levels, false presences and the estimation of the presence/absence from eDNA metabarcoding data. Mol Ecol Resour. 2014;15: 543–556. pmid:25327646
- 61. Kelly RP, O'Donnell JL, Lowell NC, Shelton AO, Samhouri JF, Hennessey SM, et al. Genetic signatures of ecological diversity along an urbanization gradient. PeerJ. 2016;: 1–22.
- 62. Spaink HP, Jansen HJ, Dirks RP. Advances in genomics of bony fish. Briefings in Functional Genomics. 2014;13: 144–156. pmid:24291769
- 63. Evans NT, Olds BP, Renshaw MA, Turner CR, Li Y, Jerde CL, et al. Quantification of mesocosm fish and amphibian species diversity via environmental DNA metabarcoding. Mol Ecol Resour. 2016;16: 29–41. pmid:26032773