Reader Comments

Post a new comment on this article

Issues with sampling design and methods

Posted by jkipling on 02 Feb 2012 at 20:04 GMT

Belda et al. have conducted a potentially interesting study that is, I believe, marred by flaws in methodology and sampling design.

The most important issue is that conclusions were drawn from a comparison of two unreplicated samples. All individual gut communities from each group (lab and field) were pooled and a single metagenome generated from each pool. Thus we have no idea of the variability within each group, and you will find no mention of statistical tests anywhere in the paper -- yet there are statements such as "Lab-reared and field-collected ECB also differ significantly in terms of their GH and CBM profiles." See Prosser (“Replicate or Lie,” Environmental Microbiology, 2010 12(7), 1806-1810) about the importance of replicates in microbial ecology studies.

There are additional issues with the methods. One is that the lab larvae were fed an (apparently) nonsterile artificial diet, and that the larvae were not starved prior to gut collection (which is commonly done in caterpillar gut microbe sampling; e.g. Broderick 2004). It is very likely that the lab larvae's Staph, Bacilli, etc. were all from diet "contaminants" present in the gut lumen and not so interesting in terms of insect-specific microbiota. It would have been valuable to have sequenced the diets themselves.

Some other comments. The age and number of caterpillars (and their guts) do not seem to have been very carefully controlled. The amplification on artificial media and the exposure of the lab caterpillars to antibiotics (as Belda et al. do mention in the paper) are very important to note when interpreting their results. There are a number of typos, and there does not appear to be a legend in Fig 5. In Fig 1 there is a “Bacteroidetes” bin and also a “Bacteroidetes-Chlorobi” bin.

Nevertheless, the finding of a high diversity of genera in the wild caterpillars’ guts is interesting, in a descriptive sense, and the paper illustrates how metagenomics could be valuable in insect gut censuses.

No competing interests declared.

RE: Issues with sampling design and methods

manelwatanabe replied to jkipling on 03 Feb 2012 at 10:29 GMT

I agree on the main point raised by jkipning. We just did not have enough funding for more replicates. Howover, the high diversity of taxa found in the two (pooled) samples remains a major conclusion of the work.
Regarding the other issues: larvae were fed with sterile diet, which was changed every day. We were aware that fast growing bacteria colonising the food might be present in the Lab-reared metagenome and we state so in the text. Starvation could indeed have partially removed this "contaminant" bacteria but it can also eliminate other resident species, those that are attached to the peritrophic membrane, for example. There were no antibiotics on the diet, as stated in the text. The problem is that whatever the conditions of artificial diet rearing are, they will always remain "artificial". We just compared two pooled samples from natural (and not starved) and lab-reared (and not starved either) O. nubilalis populations.

No competing interests declared.

RE: RE: Issues with sampling design and methods

jkipling replied to manelwatanabe on 03 Feb 2012 at 22:17 GMT

Regarding the argument that replicates would have been too expensive, I point to the response by Prosser (see citation above) on p. 2, point (i) under “Excuses for not replicating.”

It is not stated in the paper if or how the artificial diet was sterilized, only that the diet mix was added to sterile water. I don’t know how autoclaving affects DNA, but perhaps it is possible that sequencing could have picked up free DNA from lysed bacteria in the sterile diet (i.e. that the Staph, etc. were not alive/active inside the O. nubilalis guts)...

I agree that the observation of high bacterial diversity in wild samples is a valuable finding, and it will be interesting to see how this pool of taxa is partitioned among genotypes and individual hosts in the future. I also agree that artificial rearing will always present some kind of bias -- at the very least the hosts need to be feeding on their native diet to get a realistic picture of their wild microbial diversity.

No competing interests declared.