2 Aug 2012: Schrimpe-Rutledge AC, Jones MB, Chauhan S, Purvine SO, Sanford JA, et al. (2012) Correction: Comparative Omics-Driven Genome Annotation Refinement: Application across Yersiniae. doi: info:doi/10.1371/annotation/03110e8b-3e10-4334-9ff7-969c85ad25d8 View correction
Genome sequencing continues to be a rapidly evolving technology, yet most downstream aspects of genome annotation pipelines remain relatively stable or are even being abandoned. The annotation process is now performed almost exclusively in an automated fashion to balance the large number of sequences generated. One possible way of reducing errors inherent to automated computational annotations is to apply data from omics measurements (i.e. transcriptional and proteomic) to the un-annotated genome with a proteogenomic-based approach. Here, the concept of annotation refinement has been extended to include a comparative assessment of genomes across closely related species. Transcriptomic and proteomic data derived from highly similar pathogenic Yersiniae (Y. pestis CO92, Y. pestis Pestoides F, and Y. pseudotuberculosis PB1/+) was used to demonstrate a comprehensive comparative omic-based annotation methodology. Peptide and oligo measurements experimentally validated the expression of nearly 40% of each strain's predicted proteome and revealed the identification of 28 novel and 68 incorrect (i.e., observed frameshifts, extended start sites, and translated pseudogenes) protein-coding sequences within the three current genome annotations. Gene loss is presumed to play a major role in Y. pestis acquiring its niche as a virulent pathogen, thus the discovery of many translated pseudogenes, including the insertion-ablated argD, underscores a need for functional analyses to investigate hypotheses related to divergence. Refinements included the discovery of a seemingly essential ribosomal protein, several virulence-associated factors, a transcriptional regulator, and many hypothetical proteins that were missed during annotation.
Citation: Schrimpe-Rutledge AC, Jones MB, Chauhan S, Purvine SO, Sanford JA, Monroe ME, et al. (2012) Comparative Omics-Driven Genome Annotation Refinement: Application across Yersiniae. PLoS ONE 7(3): e33903. doi:10.1371/journal.pone.0033903
Editor: Christos A. Ouzounis, The Centre for Research and Technology, Hellas, Greece
Received: October 24, 2011; Accepted: February 19, 2012; Published: March 27, 2012
Copyright: © 2012 Schrimpe-Rutledge et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by the National Institute of Allergy and Infectious Diseases NIH/DHHS through Interagency agreement Y1-AI-8401. Proteomics capabilities were developed under support from the U.S. Department of Energy (DOE) Office of Biological and Environmental Research and the NIH National Center for Research Resources (RR018522). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The vast majority of global microarray and proteomic studies generate thousands of measurements representative of a system under a specific set of treatment or growth conditions. Interpretation of this high-throughput data is usually highly dependent on protein-coding genes being properly annotated within an organism's genome, making genome annotation a critical component of modern biological research. The rapid pace of technological improvement in genome sequencing has triggered the generation of genomic sequences at a pace previously inconceivable . It took the coordination of countless people from both public and private sectors nearly a decade to sequence the first draft of the human genome , , yet Pushkarev et al. recently achieved this feat in several weeks on a single instrument with a single operator for under $50,000 . Advances to the genome annotation process appear modest by comparison. Computational tools for high-throughput data are being steadily introduced , but many challenges still exist (e.g., a lack of gold-standard gene models for training the ‘exotic’ organisms that are the focus of many second-generation sequencing projects) . Curation by knowledgeable scientists remains an essential component to complement and enhance computational work .
An understanding of the genome annotation process provides insight into how experimental measurements can be used to improve both the process itself and the extraction of biological knowledge. Automated annotation efforts reduce the burden of manual curation by employing algorithms to predict transcriptional and translational start and stop sites, promoter regions, protein coding regions, and untranslated regions, among other genetic features . However, even for prokaryotes which are inherently less complex than eukaryotes in terms of gene structure, the reliability of computational predictions remains imperfect. For example, de Souza and colleagues analyzed a Mycobacterium tuberculosis culture filtrate sample to examine discrepancies between two established gene prediction methods. Even with the reduced complexity of a culture filtrate (∼10% of the predicted M. tuberculosis proteome), nearly 2% of the identified peptides were specific to only one of the two automated annotations suggesting that a substantial number of missed genes are present in the genome-wide annotation . Bakke et al. compared annotations of the entire expressed proteome of the archean Halorhabdus utahensis using three different gene-calling platforms . The authors found that less than half of the nearly 3000 predicted protein-coding regions were consistent across the automatic annotations, supporting the speculation that significant deviations in gene calling efforts would be revealed in global-scale analyses.
Evidence shows that automated annotations are subject to error, yet financial constraints lead to most gene predictions being directly incorporated into databases. Libraries of potential coding sequences with varying levels of confidence are generated. These libraries directly influence the quality of high-throughput biological studies. For example, microarray chip probe selections are typically chosen from libraries of predicted protein coding genes. The absence of a probe targeting a specific nucleotide sequence does not mean that complementary mRNA is not expressed; it simply reflects the inherent bias of the microarray design. An example of error propagation associated with proteomics relates to databases comprised of candidate proteins, a crux of many modern experimental proteomic studies. The majority of peptide-centric proteomic analyses occur by matching, not direct interpretation, of spectra . Search tools rely on peptide-matching algorithms to compare experimental MS/MS spectra to in-silico peptide spectra generated from protein databases. Several of the unmatched high-quality spectra present in bottom-up proteomic analyses may be explained by errors in protein predictions from the genome. Importantly, the same omics datasets that suffer from incorrect or absent gene assignments can in fact help provide experimental revisions to existing genome annotations.
The practice of utilizing MS/MS data for genome annotation refinement was documented as early as 1995 when Yates et al. introduced the concept of searching a six frame translation of a nucleotide sequence with tandem MS data . Annotations of a number of prokaryotic and eukaryotic systems have since been investigated using this approach, commonly referred to as proteogenomics, resulting in the validation of predicted genes and elucidation of annotation errors. Gupta and colleagues identified 8 novel genes, redefined boundaries for 30 genes, and observed expression of 13 pseudogenes in Shewanella oneidensis MR-1 . Similarly, Castellana et al. estimated that 13% of the Arabidopsis thaliana protein coding genes were incorrect or absent from the genome annotation .
Comparative proteomics can be applied to extrapolate findings of peptide identifications from a single species to orthologs based on evolutionary constraints , , . This approach allows researchers to either salvage or increase the confidence of evidence used for annotation refinement. This is extremely important for coding sequences that are expressed at low levels, encode short products, or exhibit poor detection efficiency. Transcriptional knowledge can also be used for annotation refinement. High density tiling arrays and RNA sequencing aid in the discovery of novel genetic features, and while their data alone does not confirm protein expression, detection provides supporting evidence. Complementary evidence is indispensable in instances when proteins are inferred by single peptide identifications, a situation that is typically insufficient for a protein's identification. The greatest potential for annotation refinement should come from simultaneously merging transcriptomic and proteomic data  with a comparative genomic approach.
We undertook a comparative omics approach to simultaneously refine the genome annotations of three highly orthologous Yersinia strains. The work presented herein extends typical proteogenomic methodology by incorporating not only peptide measurements, but also experimental oligo data and sequence comparisons across strains. Yersinia was chosen as a model in part due to the high genetic similarity between species possessing dissimilar characteristics , . The examined strains were annotated by different groups of researchers using different methods over several years , ; as such, variations in both sensitivity and specificity of annotation are expected. Yersinia comprises three species pathogenic to humans: Y. enterocolitica, Y. pseudotuberculosis, and Y. pestis. The latter two species diverged most recently, and while their genomes are closely related, the bacteria exhibit markedly different modes of transmission and pathogenecities . Y. pseudotuberculosis causes non-fatal gastrointestinal disease, and Y. pestis is the causative agent of plague. The data described here characterize Y. pseudotuberculosis PB1/+ and two Y. pestis strains, CO92 and Pestoides F. The Y. pestis strains represent “epidemic” (CO92) and “non-epidemic” (Pestoides F) isolates, which differ in their biochemical properties, virulence to different animal species, and rearrangements of the genome mediated by the insertion sequences , . The genomes of the examined strains have been sequenced ,  and are available at NCBI (www.ncbi.nlm.nih.gov). Each strain is currently annotated with approximately 4000 protein coding genes (Table 1). Our results validate predicted protein-coding genes and revise the current genome annotations through identification of 96 unannotated or erroneous protein coding regions among the three strains. The refined genome annotations are immediately useful for the entire Yersiniae research community, and the comparative omics-based approach is applicable to other organisms possessing similarity between strains or species.
Results and Discussion
Comparative Yersinia omics-based annotation
A typical proteogenomic workflow integrates experimental peptide evidence and computationally-predicted protein-coding sequences. The approach presented herein (Figure 1) extends that approach by also including orthogonal genome-wide measurements (i.e., microarray probe hybridization). This comparative omics approach was used to investigate current annotations for three highly similar Yersinia strains: Y. pestis CO92 (YPO), Y. pestis Pestoides F (YPDSF), and Y. pseudotuberculosis PB1/+ (YPTS). Seventy-five matched RNA and protein samples from each strain were collected across a range of thermal and temporal conditions (26 or 37°C for 1, 2, 4, or 8 h) to maximize transcriptome and proteome coverage. Analyses focused on validating predicted genome annotations and discovering experimentally-supported annotation errors. Existing genus level Yersinia annotations were also compared across the examined strains to extrapolate putative annotation errors. Experimental omics data were combined with these findings to predict sequences that may exhibit protein expression in the absence of experimental evidence.
Transcriptomic data generated from an unbiased universal Yersinia microarray and peptide data matched to a 6-frame genome translation were layered on existing genome annotations to validate predicted protein coding sequences and identify annotation anomalies. This evidence can be used independently or combined with putative protein identifications derived from a comparative genomics approach for genome annotation refinement.
A universal microarray was used to obtain genome-wide expression measurements. Unlike a traditional microarray that targets annotated genes for a single strain, this universal array incorporated 7641 probes designed against seven sequenced Yersinia strains on a single chip. As illustrated in Figure 2, 89% of the probes were complementary to genes present in multiple, if not all, represented Yersinia strains. The remaining probes targeted genes annotated as purportedly unique to one of the Yersinia strains. Comprehensive Yersinia genus level gene expression measurements were made since each strain's sample was individually hybridized against the universal array. More specifically, the expression of a nucleotide sequence (represented by a probe targeted against at least one of the seven Yersinia genomes) was examined for individual strains regardless of whether or not a protein-coding sequence was currently annotated for the strain being analyzed. Results were assessed for all probes present on the universal array for all three strains.
A universal array was designed to represent genes from seven different Yersinia strains on a single chip. A) A representative sample of oligos and their purported mapping to genes from each of the seven Yersinia strains represented on the array is shown. The number of strains (n = x) for which a given oligo corresponds to an annotated protein coding sequence is indicated, illustrating a subset of the possible combinations of unique or shared orthologs at the oligo level. B) The distribution of oligos based on existing annotations is provided; oligos were predicted to be either unique to any one of the seven strains (n = 1) or shared by multiple strains (n>1).
In parallel to the transcriptional study, bottom-up proteomics was used to identify peptides for inference of protein expression. Approximately 1.6 million MS/MS spectra per strain were searched against a stop-stop FASTA file comprised of a six-frame translation (minimum length of 30 amino acids) of each corresponding Yersinia genome. Data were filtered to <0.4% false-discovery rate using a reversed sequence decoy strategy . A modest number of redundant peptides (i.e., peptides that map to multiple genomic loci) were excluded from the workflow to remove potential ambiguity. Post-filtering, nearly 20,000 peptides per strain were mapped to each respective genome, corresponding to the expression of 41%, 44%, and 38% of YPO, YPDSF, and YPTS proteins (minimum of two peptides/protein), respectively. Table 1 summarizes these identifications and illustrates the high level of orthology between strains. Additionally, genome annotation refinements for both annotated and unannotated open reading frames (ORFs) are reported, indicating the utility of the comparative omics-based annotation presented herein.
Identification of annotation anomalies exhibiting a minimum of two peptides per ORF
Confident gene expression and peptide identification measurements, along with predicted protein coding genes, were independently layered on genome sequences for each Yersinia strain's chromosome and corresponding plasmid(s). Experimental evidence observed within a protein-coding region of a gene was considered validation of an existing annotation, and evidence outside of annotated ORFs highlighted regions suggestive of missed/incorrect annotation calls. Figure 3 shows the distribution of experimental evidence across annotated ORFs (i.e., predicted proteins) and unannotated ORFs (i.e., putative proteins not associated with any existing transcript/protein annotations). Using peptide measurements as primary evidence of protein expression, it was determined that 1682, 1773, and 1603 predicted protein-coding sequences were expressed with a minimum of two unique peptide identifications for YPO, YPDSF, and YPTS, respectively. Notably, greater than 98% of these protein identifications also had complementary oligo hybridization evidence as support. Kolker et al. generated both protein and gene expression data for a functional annotation study in S. oneidensis . Gene expression was observed for 2082 of 2252 predicted proteins (93%), comparable to the overlap represented in this work. In contrast to Kolker's work, the microarrays utilized for the current studies possess a unique advantage important for an omics-based refinement study, i.e., the ‘unbiased’ nature of oligos present on the universal chip aid in the discovery of unannotated sequence expression. Figure 3a shows the identification of currently unannotated ORFs exhibiting experimental evidence; 37 (29), 22 (20), and 1 (0) unannotated ORFs mapped at least two unique peptides (and a minimum of one oligo) for YPO, YPDSF, and YPTS, respectively, warranting further investigation.
Preliminary analysis shows the distribution of peptide and oligo evidence across annotated open reading frames (ORFs) (i.e., predicted proteins) in black and unannotated ORFs in grey. Solid regions indicate ORFS with complementary oligo and peptide evidence and hashed regions show ORFs with only peptide evidence. A) shows ORFs exhibiting two or more unique non-redundant peptides and B) shows ORFs exhibiting a single unique non-redundant peptide.
Proteins identified by single peptide identifications
It has been shown that random peptides exhibit a peptide-to-protein distribution favoring single peptide correlations ; however many single peptide observations are in fact authentic, confounding the choice to include or exclude these identifications. Nearly universally, single peptides are discarded for proteomics applications due to the high probability of false-positives for proteins identified by a single unique peptide relative to proteins with multiple unique peptides using a given set of filtering criteria. These single peptide identifications (singlets) are often pejoratively referred to as one-hit wonders. Unfortunately, removal of singlets by increasing the stringency of filter criteria results in the loss of a large number of possible true-positive protein identifications , . Omics-based annotation can benefit from retaining single peptide identifications as the main goal is to provide layers of experimental evidence of gene expression. Figure 3b illustrates 380, 392, and 398 annotated proteins that were identified by evidence of a single peptide. Using the stringent filters chosen for this study, >96.7% of the proteins corresponding to singlets also had evidence of at least one oligo with hybridization. These findings lend increased support to the validity of proteins inferred from single peptide identifications in this study  and prompted examination of a group of 44, 27, and 7 unannotated ORFs eliciting both singlets and oligo evidence for YPO, YPDSF, and YPTS, respectively.
Orthologous and single peptide identifications
Orthology has been employed for global applications including the identification of core genomes and proteomes , , . Proteomic profiles of diverse environmental and pathogenic bacteria  revealed the expression of a core genome, indicating conservation amid diverse speciation events. Bottom-up proteomic data have been measured in five model eukaryotic species and quantitative protein abundances were found to be significantly correlated for orthologs across a conserved core proteome . Even for homologous proteins with varying sequences, individual peptide biases averaged out at the protein level. Relevant to the present work, core proteins with similar sequences are expected to have comparable peptide abundances given an inherent peptide “MS-detectability” . While proteogenomics approaches are qualitative in nature, the above concepts support the notion that an orthologous peptide in one Yersinia strain has a high probability of being detected in the alternate strains in the current experiments. The caveat may be for regulated proteins where differential protein abundance is sample dependent. For pathogenic bacteria such as Yersinia, qualitative genomic divergence and quantitative expression profiles contribute to a switch from a less-pathogenic lifestyle (e.g., Y. pseudotuberculosis) to one of high virulence (e.g., Y. pestis).
Ortho-proteogenomics and comparative proteogenomics, two branches of proteogenomic pipelines, demonstrate the utility of evolutionary constraints for refinements of genome annotation. The ortho-proteogenomic approach has been demonstrated for the Mycobacterium genus using M. smegmatis as the reference sample. Genome refinements were made for the reference genome and knowledge was propagated to other Mycobacterium species . This approach is invaluable, however care must be taken when extrapolating annotations to homologous genomes . Comparative proteogenomics is a more definitive approach to refining highly similar genomes. This method incorporates parallel experimental peptide data from multiple orthologous proteomes with their respective genome sequences as performed for Shewenella .
Orthologous singlet peptides (i.e., related peptides found across multiple species) can be used to infer protein translation . In this study, this group of putative annotation errors includes unannotated ORFs that exhibit singlet peptide evidence but lack oligo hybridization data. Identical singlet peptides are valued; however, identification is more reliable when peptides are correlated (i.e., differ in sequence in at least one position). Correlated peptides are related through sequence but either possess mutations or modifications at a given amino acid residue or comprise different lengths (ladder sequences). This results in different b- and y-ion fragments and thus differing mass spectra for matching. The likelihood of two independent false-positives for correlated peptides in conserved species is extremely low. Notably, 245 (63) of the 705 YPO singlet peptides, 246 (55) of the 708 YPDSF singlet peptides, and 234 (61) of the 638 YPTS singlet peptides are identical (correlated) to a peptide found in at least one of the other Yersinia strains examined in this study (File S1).
Based on the preliminary analysis shown in Figure 3, the following criteria were established to objectively generate a conservative list of potential annotation errors for examination: 1) the presence of a non-redundant peptide and either an additional non-redundant peptide or a hybridized oligo or 2) a non-redundant peptide that has an orthologous peptide observed in at least one alternate strain. Using these criteria, potential protein sequences from unannotated regions were aligned to other Yersinia species using BLASTp (NCBI). The presence of a highly related structural homolog to an unannotated protein sequence was considered evidence of a novel (i.e., missing) gene, incorrect protein start site, or frameshift. Additionally, expression of annotated pseudogenes was noted. This suggests that regions of many of these ‘dead’ genes are in fact expressed, albeit not necessarily functional, in agreement with other reports , . A summary of these findings is shown in Table 1, and detailed information for all annotation refinements including peptide and oligo evidence, proposed gene boundaries, proposed protein sequence, and corresponding ortholog data is provided in File S2.
Identification of novel genes
The first category of annotation anomalies identified represents ‘novel’ genes that were missed during the annotation process. These errors reveal experimental evidence in intergenic regions that currently lack annotation. The protein coding sequences corresponding to these novel genes are annotated in at least one other Yersinia strain (determined by BLASTp) but are missing in their entirety in the strain containing the error. This analysis found evidence indicative of 8, 18, and 2 novel genes in YPO, YPDSF, and YPTS, respectively (for detail see File S2). Figure 4 represents a novel gene found in Y. pestis Pestoides F: 13 peptides corresponding to the same translational frame were observed in a 427 nucleotide ORF between YPDSF_3634 and YPDSF_3635. Using the high level of orthology between Yersinia strains, the potential sequence of this missed protein was predicted and maps with 100% identity to both Y. pestis CO92 and Y. pseudotuberculosis PB1/+. Peptide evidence represented 79% sequence coverage of the predicted protein, and correlated peptides were found in YPO and YPTS supporting the inclusion of this hypothetical protein in Y. pestis Pestoides F.
In the upper frame, gene level alignments are shown for the three strains examined in this study. Predicted protein coding genes are shown in grey and oligo evidence is shown in black. Sequence alignments are shown in the lower frame. Annotated protein sequences are underlined, and experimental peptide evidence is shown in black text. For YPDSF, this region reveals substantial oligo and peptide evidence in an unannotated region indicating a novel gene.
One major flaw of automated annotation is the under-prediction of small genes. This often occurs because large ORFs are conspicuous. Examination of protein lengths for these novel genes substantiates this issue. Protein length histograms (Figure S1) clearly show that the missed genes possess lengths that fall on the short end of the range of annotated Yersinia proteins. Given that short proteins yield fewer peptides, there is an increased likelihood that short proteins will be identified by single peptide hits. Thus the inclusion of confident singlet peptides is important, particularly for genome refinement studies.
Protein coding genes may also fail to be predicted due to the presence of an alternative translational start site. In the existing annotations, 82%, 88%, and 91% of predicted proteins for YPO, YPDSF, and YPTS, respectively, have an AUG initiation codon. Noticeably, YPDSF and YPTS have a higher percentage of purported AUG start codons relative to YPO and another enterobacteria, E. coli, which has been reported to use 83% AUG . Based on comparison with orthologous sequences in other Yersinia strains, for YPO, YPDSF, and YPTS, respectively, 5, 6, and 2 of the novel genes found in this study are proposed to have a less common initiation codon: UUG/UUA or GUG rather than AUG. While no peptide evidence is present to confirm the predicted N-termini of these novel genes, it seems plausible that these genes were overlooked during annotation due to the presence of less common start codons.
Comparison of missed proteins from the targeted strain with orthologous sequences from the other two examined strains highlights a significant intention of this study: highly similar strains possess orthologous genes that can be used for cross-validation of proteomics data and for genome refinement. Of the 8 missed proteins in YPO, 6 and 4 orthologous proteins are not predicted in either YPDSF or YPTS, respectively. Similarly, of the 18 missed proteins in YPDSF, 5 and 2 orthologous proteins are presumed absent in YPO and YPTS, respectively. Two proteins were missed in YPTS; of these, 1 ortholog is not predicted in either YPO or YPDSF, and the remaining ortholog is not predicted in YPDSF. As YPO was the first Yersinia genome annotated, these results suggest transitive annotation omissions. During the genome annotation process, predicted protein coding genes are searched against protein databases. Homology findings are based on the quality of the software utilized and on the quality of the annotations that compile the protein databases . The overlap of missing proteins across the three strains examined in this work suggests a propagation of errors for Yersinia strains. These overlaps may be a result of failed searches against previously annotated Yersinia genomes lacking predictions for the gene of interest.
Identification of upstream start sites
Another category of annotation error occurs when the translational start site of a gene is predicted incorrectly. This type of error has potentially deleterious effects for the structural genomics community which relies on accurate protein sequences for structure determinations and both function and localization predictions. The accuracy of start site prediction has been estimated to be as low as 80–90% . Targeted proteogenomics strategies have successfully been used to characterize N-termini of Deinococcus proteins and findings revealed 73 incorrectly predicted start codon sites and the use of several non-canonical translational initiation codons . Peptide evidence upstream of a predicted start site, but C-terminal to a stop codon, suggests that the start site was predicted to occur at the wrong codon. In YPO, YPDSF, and YPTS, there is evidence for the incorrect prediction of 3, 3, and 2 start sites, respectively (File S2). Comparative analysis of BLASTp results from sequences generated from a 5′ extension of each gene was used to assign new start sites. In all cases, orthologous sequences implied new start codons that were consistent with the observed experimental evidence. In 4 of the 8 start site anomalies, peptide evidence spanned the existing start codon substantiating extension to an upstream start site. Figure 5 shows an example of an incorrectly predicted start site in Y. pestis CO92 with peptide evidence spanning and oligo evidence 5′ of the existing TTG start codon of YPO0453. Comparison of orthologs suggests that translation should begin five residues upstream of the predicted start site. Notably, translation of TTG as a start codon would result in the generation of a methionine, however the unbiased search performed for this study identified this amino acid as a leucine supporting an incorrect start codon prediction.
Protein sequence alignments are shown for the three strains examined (YPO, YPDSF, and YPTS) in addition to several other Yersinia species. Annotated protein sequences are underlined and experimental peptide and oligo evidence is shown in black text. For YPO0453, evidence flanks the predicted start site (shown by boxed region) and the observed peptide sequence reveals translation of a leucine instead of methionine confirming an N-terminal extension.
Identification of translated pseudogenes
Pseudogenes can be described as sequences of DNA that possess disruptions such as insertions, premature stop codons, or frameshifts that render them nonfunctional . As such, these entries are typically excluded from protein databases because the DNA is not thought to be translated to protein. Pseudogenes are not uncommon in prokaryotes (although much less common than in eukaryotes which lack compact genomes), but Y. pestis is reported to have a disproportionately high number of predicted pseudogenes , . Divergence from Y. pseudotuberculosis required a change in both the bacteria's phenotype and mode of transmission, and gene loss is presumed to play a major role in Y. pestis acquiring its niche as a virulent pathogen , , , . It was originally reported that the genome for Y. pestis CO92 contained 149 pseudogenes . Subsequently, comparative studies were performed and additional Y. pestis CO92 pseudogenes that were missed during the original annotation have been proposed , . In this work, 40, 16, and 1 pseudogenes from YPO, YPDSF, and YPTS, respectively, exhibited experimental evidence of protein expression. The finding of pseudogene expression is not a novel proteogenomic observation. A number of authors present evidence challenging the belief that pseudogenes are translationally silent , , , , . Since the function of expressed disrupted genes is ablated in most cases, the existence of inteins  and the active expression of interrupted genes in vivo  are very interesting. It seems valuable in high-throughput studies to include all coding sequences with the potential for expression in a protein database and allow biological validation studies to guide functional conclusions.
We identified the translation of genomic regions currently labeled as pseudogenes (File S2) belonging to two major categories. First, split genes containing insertion elements/transposons or other cargo, and second, altered genes containing indels or nonsense mutations. The argD locus represents an example of a split gene. In CO92, the DNA sequence homologous to argD is interrupted by the insertion of two IS21 genes (File S3). Notably, argD peptides and oligos were observed on both termini, flanking the insertion. The expression of the N-terminal portion of argD is presumably under the normal promotor structure. Inspection of the DNA region between the second IS21 element and the C-terminal portion of argD revealed that the promoter structure typically used to drive the IS element had likely been co-opted to drive expression of argD (Michael Chandler and Guy Duval, personal communication, and ).
The presence of the transposable element insertion was tested in a dozen Y. pestis strains of different biovars including eight biovar orientalis (same as CO92) strains from USA, Indonesia, South America, and Madagascar, and it was confirmed that the insertion occurs only in CO92 (data not shown). In Yersinia, as well as other species with high genomic fluidity , it is not unexpected to find ‘unique’ proteins lacking homology. Evolutionary relationships with transposons have been described , and speculatively, this process may provide one driver for reassembly of domains that could produce non-homologous proteins  for novel adaptive functions. The nature of the “pseudogenes” identified as present as translated proteins offers an enticing clue that the broad range of proteins that are found to be unique within many sequenced genomes may be driven by rapid evolution.
Another example of pseudogene expression in Y. pestis CO92 is illustrated in Figure 6. YPO1195 encodes a 310 aa protein, but a single point variation from A to T (confirmed by Sanger sequencing, File S4) renders a premature TAG stop codon in lieu of an AAG-encoded lysine rendering a truncated protein/predicted pseudogene with a 155 aa N-terminus and a 154 aa C-terminus. Interestingly, both peptide and oligo evidence span the regions on either side of the stop codon. Regardless of the means for expression, this example highlights a case where the YPO1195 protein sequence should be included in the CO92 protein database.
Pseudogenes are considered translationally silent and typically excluded from protein databases. YPO1195 is categorized as a pseudogene due to the presence of a stop site mid sequence (shown by vertical black bar). Both oligo evidence (black boxes, upper frame) and peptide evidence (black text, lower frame) were observed on either side of the predicted stop codon, indicating expression of this feature.
Identification of translational frameshifts
Determination of translational frameshifts is one of the more difficult tasks of genome annotation. This phenomenon, opposed to mutational or replication-based frameshifts, occurs when the ribosome either slips -1 base, stalls +1 base, or hops over a stretch of nucleotides during translation causing two translational reading frames to be expressed as a single protein . Authentic frameshifting events can either be spontaneous or programmed, but what appear to be frameshifted proteins can also result from DNA sequencing errors. Annotation predictions can be guided by the referencing of known frameshifted proteins in similar species, but more often than not, there are few if any proteins to reference. Peptide chain release factor II (prfB) is one example of a +1 frameshift observed in several bacterial genomes. While prfB is annotated in some Yersinia, the frameshift is missing in many strains  revealing the challenge in annotating frameshifts even when reference frameshifts are known. As previously mentioned with regard to incorrectly predicted start sites, missed frameshifts result in truncated sequences that may impact structural biology studies. The current analysis identified three genes, all found in Y. pestis Pestoides F, that have evidence indicative of frameshifts (File S2). These genes currently have protein coding sequences predicted, but the predicted proteins appear to be truncated due to an apparent frameshift. Eight predicted pseudogenes in Y. pestis CO92 have experimental evidence in multiple reading frames suggestive of translational frameshifts which may explain a misclassification as a pseudogene.
Figure 7 illustrates an apparent frameshift in YPDSF_1005, an ortholog of YPO2124. This gene encodes a hypothetical protein in both Y. pestis strains. YPDSF_1005 encodes a 63 amino acid protein, and the expression of YPO2124 produces a 210 amino acid product. Both genes have hybridization evidence showing similar thermal shift expression patterns for three oligos. All three oligos fall within the protein coding sequence boundaries for YPO, but two of the three oligos lie 5′ of the boundary for YPDSF_1005. Examination of YPDSF peptide data revealed four peptides upstream of the predicted start site, consistent with the oligo data. Importantly, Sanger sequencing (File S4) confirmed that these peptides all fell on a translational reading frame different from the predicted polypeptide. Extension of the N-terminus of YPDSF_1005 on the alternate frame allowed the entire 210 amino acid product of YPO2124 to be overlaid on the YPDSF_1005 sequence indicating the presence of a frameshift.
A) Hybridization evidence for oligos labeled A, B, and C is shown. Expression levels are shown normalized to each oligo's mean (via a Z-score calculation) across a time course/thermal switch (37°C/26°C) experiment for Y. pestis CO92 (YPO) and Y. pestis Pestoides F (YPDSF). Green indicates down-regulation relative to the mean, and red indicates up-regulation relative to the mean. Genome annotations are labeled for YPDSF_1005 and YPO2124 corresponding to annotated coding sequences. Although oligos A and B purportedly lack a corresponding transcription for YPDSF (NA = not applicable), evidence clearly shows hybridization consistent with oligo C. B) illustrates the 210 aa translation of YPO2124 and C) illustrates the 63 aa translation of YPDSF_1005. Frame translations are shown below gene level detail with oligo evidence (black) overlaid on each gene and peptide evidence (red) overlaid on the appropriate reading frame. For YPDSF_1005, gene alignment with YPO2124 reveals two oligos upstream of the coding region. Corroborating peptide evidence was also seen upstream but in a different reading frame than the existing annotation. This evidence supports the expression of YPDSF_1005 as a frameshifted protein.
Utility of comparative data from orthologous strains
The genome annotation corrections presented here are in addition to the recent Yersinia annotation revisions by Payne et al. . In that work, peptides were identified from Y. pestis KIM 6+ strain, and orthology clusters were used to extrapolate findings to the remaining 11 complete published Yersinia genomes (including the three examined in this work). Comparison of genome refinements made solely based on the orthology of experimental Y. pestis KIM 6+ results  with data gathered for this study revealed many annotation error overlaps thereby validating the prediction of proteins based on orthology. The comparative results from this omics-based study were confirmed by experimental design. Rather than extrapolating data to orthologous species, orthologous data was generated for multiple Yersinia strains in parallel. Unbiased oligo data is valuable evidence for these genome annotation refinements. The high level of overlap between peptide data and oligo data within coding sequences of predicted proteins (Figure 3) validates the use of oligo data as complementary support when the only evidence of protein expression is from singlet peptides. By allowing oligo evidence and orthologous peptide identifications to rescue singlets (Figure 8), 21, 18, and 5 annotation errors that otherwise would have been rejected by the two-peptide rule  were retained in YPO, YPDSF, and YPTS, respectively.
Open reading frames with evidence were initially filtered based on the presence of a non-redundant peptide. All singlet peptides were required to have corroborating oligo evidence or it was required that the singlet peptide mapped to an orthologous peptide in one of the alternate strains examined.
All errors described to this point were elucidated by the evidence thresholds described previously and are thus considered primary errors. Sequences of target strains possessing primary errors were aligned to the other strains examined in this study (File S2). Eight proteins had primary errors identified in multiple examined strains. Four of these errors indicate novel proteins in both strains, 2 errors suggest a novel protein in one strain and an upstream start site found in an alternate strain, 1 error shows an upstream start site in two strains, and 1 error shows a translated pseudogene in one strain and an upstream start site in the other. This level of overlap suggests a propagation of error during the predicted sequence searching portion of the annotation process. Primary errors found in 8 proteins from the target strain suggest 14 ‘secondary annotation errors’ in the orthologs. These secondary errors have experimental oligo evidence but lack peptide data, thus explaining their exclusion from the primary error list. Similar to ortho-proteogenomics studies, this information can be extrapolated to the respective genomes and these errors can be refined. It seems probable that as proteome coverage increases, expression of many of these proteins will be demonstrated with tangible evidence for each strain.
Prokaryotic genome annotation is primarily performed ab-initio, but recent studies demonstrate that a combinatorial approach with both computational predictions and experimental evidence increases the accuracy of annotations , , . The ease and utility of the proteogenomic approach is now well-documented and suggests that incorporation of experimental data for genome annotation refinement could become routine in the future. The finding of 96 previously undocumented errors in this study (Table 1) enforces the concept that genome annotation refinement is required for accurate studies by the scientific Yersinia community. Similar approaches could readily be applied to annotation refinement studies of other larger prokaryotic or eukaryotic  organisms.
The thresholds set for this comparative omics-based workflow were based on peptide evidence with oligo evidence included as optional secondary support, yet several hundred open reading frames across the genomes examined exhibited oligo hybridization without any confirmation that the mRNA was translated. This suggests that many additional annotation errors likely exist and implies that the refinement process is far from complete for these three genomes. Nearly 40% of each strain's predicted proteome was covered by peptide identifications in this work. Limitations of the technology contributed to incomplete coverage. Several bioanalytical factors inherent to bottom-up proteomics likely affected detection: post-translationally modified peptides and peptides from low abundance proteins or small proteins are difficult to observe. Itshould also be noted that the expression of many genes is tightly regulated and/or inducible only under specific conditions. For example, as much as a third of the Salmonella typhimurium proteome has been shown to be regulated at the translational level by the single virulence regulator Hfq , . Hfq is only one mechanism of post-transcriptional regulation, but it does highlight the fact that regulation of translation and protein turn-over can lead to limited detection of highly regulated proteins. The conditions used here for Yersinia are intended to simulate important environmental transitions during pathogenesis so it is reasonable to assume that some RNA are transcribed but not translated into protein. A protein's observation is informative of a gene's presence, however, the absence of a protein when a transcript is present requires further analysis. Proteome depth will become greater and many of these oligo-supported protein predictions will be clarified as more experimental data is generated, growth conditions are tested, sample throughput is increased, and instrument sensitivity is improved.
The universal microarray used in these experiments proved fruitful for the discovery of annotation errors. High density tiling arrays and next generation sequencing technologies show even more promise for genome refinement studies. These newer technologies have the potential for increased sensitivity, specificity, and dynamic range relative to microarray profiling, and most importantly for annotation studies, the expression of open reading frames that have not been predicted to encode protein coding sequences can be measured , , .
The comparative omics-based approach employed in this study corroborates the utility of similar proteogenomic (simultaneously examining orthologous genome annotations)  and evidence-based (combining both transcriptional and peptide data)  work in different prokaryotic organisms. These results also help to define the transcription unit architecture , , a fundamental property that provides the basis for understanding key cellular processes such as metabolism and transcriptional regulation at the genome scale, of the Yersinia strains examined.
Materials and Methods
Cultivation of bacterial strains
Y. pseudotuberculosis PB1/+, Y. pestis Pestoides F, and a wild-type Y. pestis CO92 cured from pPCP1 plasmid were grown in a chemically defined medium BCS  in which neutral pH 7.2 was maintained by addition of 50 mM of morpholinopropanesulfonic acid (MOPS) as described previously . Bacterial cultures were grown in Erlenmeyer flasks aerated at 200 rpm at 26°C. A starter culture was grown, diluted to optical density OD600 = 0.1 to begin overnight culture, and grown to an OD600 of ∼3.0. The overnight culture was back-diluted to OD600 = 0.1 and grown in two flasks at 26°C. When the cultures reached OD600 ∼0.5, one flask was moved to 37°C. Aliquots from both cultures were taken at 0, 1, 2, 4, and 8 hours, OD's measured, and samples prepared as described below for proteomics and transcriptomics.
Reversed-phase nanocapillary LC-MS/MS analyses
Approximately 2×1010 bacteria were harvested from the culture at each time point, pelleted, and immediately frozen at −80°C. Thawed cell pellets were washed with 100 mM NH4HCO3 (pH 8), lysed via bead beating, and global protein digestions were performed as described previously . Peptides were concentrated in a Speed-Vac (ThermoFisher, Savant) to ∼100 uL, a BCA protein assay performed to quantitate peptide concentration, and samples were either diluted for analysis or subjected to SCX fractionation. Aliquots (60 ug) from each time point were pooled together for each strain and subjected to offline LC fractionation by strong cation exchange (SCX) chromatography on a 200 mm×2.1 mm Polysulfoethyl A column (PolyLC, Columbia, MD) preceded by a 10 mm×2.1 mm guard column, using a flow rate of 0.2 mL/min. LC separations were performed using an Agilent 1100 series HPLC system (Agilent, Palo Alto, CA). Mobile phase solvents consisted of (A) 10 mM ammonium formate, 25% acetonitrile, pH 3.0 and (B) 500 mM ammonium formate, 25% acetonitrile, pH 6.8. Once loaded, isocratic conditions at 100% A were maintained for 10 min. Fraction collection began at 2.8 min. Peptides were separated using a gradient from 0 to 50% B over 40 min, followed by a gradient of 50 to 100% B over 10 min. The gradient was then held at 100% solvent B for 10 min. Following lyophilization, all 24 fractions for each of the two pools collected during this gradient were dissolved in 25 mM ammonium bicarbonate and stored at −80°C. Peptides (0.5 µg/µL) from global preparations (i.e., total unfractionated lysate) were run in triplicate on a linear ion trap (LTQ) Orbitrap Velos mass spectrometer (Thermo Scientific) (n = 30 LC-MS/MS runs per strain), and SCX fractionated samples were run on a LTQ mass spectrometer (Thermo Scientific) (n = 48 fractionated samples run per strain). Peptides were separated by a custom-built nanocapillary HPLC system as previously described , . The eluate from the global preparations and fractionated samples was directly analyzed by electrospray ionization (ESI). The MS instruments were operated in data-dependent mode with m/z range of 400–2000, collision energy of 35 eV, and the 10 most intense peaks were selected for fragmentation. Raw data are available to the public at omics.pnl.gov and further information available at www.SysBEP.org.
Six-frame peptide identification
MS/MS fragmentation spectra were searched against a six frame translation (minimum open reading frame length of 30 amino acids) of the Y. pestis CO92 genome and plasmids (NC_003143), Y. pestis Pestoides F genome and plasmids (NC_009381), and Y. pseudotuberculosis PB1/+ genome and plasmid (NC_010634) located at NCBI using SEQUEST  peptide identification software. The parent and fragment mass tolerances used for matching were set to ±3 and ±1 Da, respectively. The average peptide mass errors for the high resolution data were 0.79, 1.11, and 1.09 ppm for YPCO, YPPF, and YSTB, respectively. Peptide identifications were retained based upon the following criteria: 1) SEQUEST DelCn2 value ≥0.10; 2) SEQUEST correlation score (Xcorr) ≥1.9 for charge state 1+ for fully tryptic peptides and Xcorr ≥2.20 for 1+ for partially tryptic peptides; Xcorr ≥2.2 for charge state 2+ and fully tryptic peptides and Xcorr ≥3.3 for charge state 2+ and partially tryptic peptides; Xcorr ≥3.3 for charge state 3+ and fully tryptic peptides and Xcorr ≥4.0 for charge state 3+ and partially tryptic peptides. For each strain, the distribution of charges for detected peptides was as follows: YPCO (q1 = 3.8%, q2 = 55.5%, and q3 = 40.7%), YPPF (q1 = 3.8%, q2 = 56.7%, and q3 = 39.5%), and YSTB (q1 = 3.4%, q2 = 54.9%, and q3 = 41.7%). Redundant peptides (i.e., peptides that map to multiple proteins) were excluded from the analysis to minimize potential ambiguity. Using the reverse (decoy) database approach, the false discovery rate (FDR) of filter-passing spectra/proteins (minimum of two unique peptides per protein) was estimated to be 0.2%/0.1% for the Velos data, 0.8%/0.6% for the LTQ data, and 0.4%/0.8% for the combined data. Higher false-positive rates were associated with singlet peptide identifications, so annotations for these spectra are provided in the supporting data. As multiple pieces of evidence (peptide, oligo, and orthology) were used to identify annotation errors, we feel that the true FDR values are nominally lower than the peptide-based FDR values reported.
Universal Yersiniae microarray design
A universal Yersiniae array was designed to contain probes targeting genes for seven different Yersinia genomes on a single microarray chip. In order to incorporate probes representative of both unique and homologous genes between the seven strains, gene FASTA files containing predicted ORF sequences for Y. pestis strains CO92, KIM, Pestoides F, Antiqua, Nepal516, and biovar Microtus str. 91001, and Y. pseudotuberculosis strain PB1/+ were collected as targets for oligonucleotide design. Homologous genes with high sequence similarity (i.e., >99% identity over the full length of the genes) were combined resulting in a single representative homolog for each homologous group. ArrayOligoSelector (http://arrayoligosel.sourceforge.net/) was used to design 70-mer oligonucleotides for each target with the goal of maximizing oligo to target gene binding energy (assessed as melting temperature, Tm) while optimizing specificity by minimizing cross hybridization with non-target gene sequences. Following the first round of design, resultant oligos were assessed for the potential to cross hybridize with genes other than the intended target. Gene targets having ambiguous oligos mapping to other genes underwent a second round of design. The second round of design tiled the remaining gene sequences with matching oligos, followed by selection of the oligo for having the lowest number of unintended gene hits. Preference was made for designed oligos to target the 3′ end of each gene. Blastn (W = 15, bit score> = 280) was used to create a target map detailing each oligo's gene matches exhibiting a bit score > = 280 (90% identity over 70 bases). The final universal array included 7641 designed oligos which were printed in duplicate, in addition to 1000 control and 1958 empty probes. The array platform description and oligo list are available at NCBI Gene Expresssion Omnibus (GEO) under accession GPL9009.
Microarray analysis of transcripts
At the appropriate times, 20–40 mL from each culture was removed and immediately mixed with an equal volume of cold RNAlater (Qiagen). Total RNA was isolated with a Qiagen Midi kit according to manufacturer's protocol. RNA was isolated from approximately 8×109 bacteria per sample and concentrated with ethanol. RNA concentrations were determined by spectrophotometer (SmartSpecPlus, BioRad), quality was assessed by gel electrophoresis, and purified RNA was stored at −80°C until analysis. RNA samples were treated further to remove residual DNA contamination prior to labeling and microarray hybridizations with Ambion Turbo DNA-free DNAse. Microarray hybridizations with cDNA probes were accomplished on version 5QYP aminosilane-coated slides printed with a set of 18,240 elements; scanning, image analysis, and normalization were performed as outlined in PFGRC standard protocol (http://pfgrc.jcvi.org/index.php/microarray/protocols.html). Individual TIFF images from each channel were analyzed with JCVI Spotfinder software, and microarray data were normalized by LOWESS normalization using TM4 software MIDAS (both available at http://pfgrc.jcvi.org/index.php/bioinformatics.html). Oligos generating intensity signals ≥35,000 (≥3σ of control probes across all chips) were considered to have positive hybridization above background and therefore incorporated as experimental measurements. While not presented for all findings, in cases where multiple oligos map to a single open reading frame, expression patterns of annotated mRNA (as shown in Figure 7) can support the identification of anomalous hybridization signals across experimental samples. Transcriptomics data have been deposited in the GEO repository under series accession GSE30634.
Data processing and genome refinement
Peptides that are correlated (i.e., differ at a single amino acid residue due to divergence/modification or otherwise identical peptides that differ in length) across strains were identified using PepAligner, an in-house program that compares two peptide files using Smith-Waterman alignment. The following criteria were established to objectively filter potential annotation errors based on experimental peptide and oligo evidence: 1) a non-redundant peptide and ≥1 additional non-redundant peptide or hybridized oligo or 2) a singlet peptide that has an orthologous peptide observed in ≥1 alternate strain. For the latter case, mass spectra were manually validated for confidence of protein expression (File S5). Distributions of evidence are provided in File S6. Experimental evidence was visualized using the Artemis genome browser  or Visual Exploration and Statistics for Proteomic Analyses (VESPA) ((https://www.biopilot.org/docs/Software/index.php). Using the established criteria, potential protein sequences from unannotated 5′ or intergenic regions were aligned to other Yersinia spp. and the non-redundant database using BLASTp .
Lists of orthologous peptides. All two-way comparisons from the three strains examined are provided. Singlet peptide observations from one strain are compared against all peptide observations from another strain. Detailed information including coverage and alignments is given.
Comparisons of errors across strains. Both peptide and oligo evidence of errors is provided as visualized using the Artemis viewer. Errors were assigned arbitrary numerical values for organization only, and each proposed error (along with orthologous sequences from the other examined strains regardless of their error statuses) is represented on an individual page. .Forward and reverse DNA strands are labeled, along with each of the six translational reading frames. Vertical black bars represent stop codons, white regions represent DNA features, cyan regions represent protein coding sequences, yellow regions represent oligo evidence, and magenta regions represent peptide evidence.
Peptide evidence related to the insertion-ablated pseudogene, argD. The regions encompassing argD loci from Yersinia pestis strains CO92 and Pestoides F are shown. Annotated open reading frames are colored in yellow. Detected peptide evidence is mapped by blue arrows and sequences are provided.
Sanger sequencing. Methodology, primer sequences, primer maps, and sequence alignments are shown for YPO1195 and YPDSF_1005.
Singlet peptide validations. Three errors were supported by singlet identifications. Annotated spectra are provided for these peptides.
Evidence summaries. Evidence for all detected open reading frames is provided for each of the three strains.
Protein length histograms. Bins are used to show the distribution of protein lengths for all protein coding genes (black) and novel annotation errors (grey).
The authors thank Drs. Brooke L. Deatherage and Ernesto Nakayasu (PNNL), Dr. Pep Charusanti (UCSD) and John C. Braisted (JCVI) for valuable discussions and input.
Conceived and designed the experiments: JNA MBJ VLM ACSR SNP RDS. Performed the experiments: ACSR MBJ SC HMB BCF. Analyzed the data: ACSR MBJ SOP MEM JAS JNA. Contributed reagents/materials/analysis tools: MEM SHP CA RDS SNP VLM. Wrote the paper: ACSR VM JNA.
- 1. Nagarajan N, Pop M (2010) Sequencing and genome assembly using next-generation technologies. Methods Mol Biol 673: 1–17.
- 2. Lander ES, Linton LM, Birren B, Nusbaum C, Zody MC, et al. (2001) Initial sequencing and analysis of the human genome. Nature 409: 860–921.
- 3. Venter JC, Adams MD, Myers EW, Li PW, Mural RJ, et al. (2001) The sequence of the human genome. Science 291: 1304–1351.
- 4. Pushkarev D, Neff NF, Quake SR (2009) Single-molecule sequencing of an individual human genome. Nat Biotechnol 27: 847–850.
- 5. Li JW, Robison K, Martin M, Sjödin A, Usadel B, et al. (2012) The SEQanswers wiki: a wiki database of tools for high-throughput sequencing analysis. Nucleic Acids Research 40: D1313–D1317.
- 6. Holt C, Yandell M (2011) MAKER2: an annotation pipeline and genome-database management tool for second-generation genome projects. BMC Bioinformatics 12: 491.
- 7. Carver T, Harris SR, Berriman M, Parkhill J, McQuillan JA (2012) Artemis: An integrated platform for visualisation and analysis of high-throughput sequence-based experimental data. Bioinformatics 28: 464.
- 8. Stein L (2001) Genome annotation: from sequence to biology. Nat Rev Genet 2: 493–503.
- 9. de Souza GA, Malen H, Softeland T, Saelensminde G, Prasad S, et al. (2008) High accuracy mass spectrometry analysis as a tool to verify and improve gene annotation using Mycobacterium tuberculosis as an example. BMC Genomics 9: 316.
- 10. Bakke P, Carney N, Deloache W, Gearing M, Ingvorsen K, et al. (2009) Evaluation of three automated genome annotations for Halorhabdus utahensis. PLoS One 4: e6291.
- 11. Duncan MW, Aebersold R, Caprioli RM (2010) The pros and cons of peptide-centric proteomics. Nat Biotechnol 28: 659–664.
- 12. Yates JR 3rd, Eng JK, McCormack AL (1995) Mining genomes: correlating tandem mass spectra of modified and unmodified peptides to sequences in nucleotide databases. Anal Chem 67: 3202–3210.
- 13. Gupta N, Tanner S, Jaitly N, Adkins JN, Lipton M, et al. (2007) Whole proteome analysis of post-translational modifications: applications of mass-spectrometry for proteogenomic annotation. Genome Res 17: 1362–1377.
- 14. Castellana NE, Payne SH, Shen Z, Stanke M, Bafna V, et al. (2008) Discovery and revision of Arabidopsis genes by proteogenomics. Proc Natl Acad Sci U S A 105: 21034–21038.
- 15. Gallien S, Perrodou E, Carapito C, Deshayes C, Reyrat JM, et al. (2009) Ortho-proteogenomics: multiple proteomes investigation through orthology and a new MS-based protocol. Genome Res 19: 128–135.
- 16. Gupta N, Benhamida J, Bhargava V, Goodman D, Kain E, et al. (2008) Comparative proteogenomics: combining mass spectrometry and comparative genomics to analyze multiple genomes. Genome Res 18: 1133–1142.
- 17. Payne SH, Huang ST, Pieper R (2010) A proteogenomic update to Yersinia: enhancing genome annotation. BMC Genomics 11: 460.
- 18. Price MN, Deutschbauer AM, Kuehl JV, Liu H, Witkowska HE, et al. (2011) Evidence-based annotation of transcripts and proteins in the sulfate-reducing bacterium Desulfovibrio vulgaris Hildenborough. Journal of Bacteriology. doi:10.1128/JB.05563-05511.
- 19. Butler T (1994) Yersinia infections: centennial of the discovery of the plague bacillus. Clin Infect Dis 19: 655–661; quiz 662–653.
- 20. Chain PS, Carniel E, Larimer FW, Lamerdin J, Stoutland PO, et al. (2004) Insights into the evolution of Yersinia pestis through whole-genome comparison with Yersinia pseudotuberculosis. Proc Natl Acad Sci U S A 101: 13826–13831.
- 21. Garcia E, Worsham P, Bearden S, Malfatti S, Lang D, et al. (2007) Pestoides F, an atypical Yersinia pestis strain from the former Soviet Union. Adv Exp Med Biol 603: 17–22.
- 22. Parkhill J, Wren BW, Thomson NR, Titball RW, Holden MT, et al. (2001) Genome sequence of Yersinia pestis, the causative agent of plague. Nature 413: 523–527.
- 23. Achtman M, Zurth K, Morelli G, Torrea G, Guiyoule A, et al. (1999) Yersinia pestis, the cause of plague, is a recently emerged clone of Yersinia pseudotuberculosis. Proc Natl Acad Sci U S A 96: 14043–14048.
- 24. Motin VL, Georgescu AM, Elliott JM, Hu P, Worsham PL, et al. (2002) Genetic variability of Yersinia pestis isolates as predicted by PCR-based IS100 genotyping and analysis of structural genes encoding glycerol-3-phosphate dehydrogenase (glpD). Journal of Bacteriology 184: 1019–1027.
- 25. Zhou D, Tong Z, Song Y, Han Y, Pei D, et al. (2004) Genetics of metabolic variations between Yersinia pestis biovars and the proposal of a new biovar, microtus. Journal of Bacteriology 186: 5147–5152.
- 26. Qian WJ, Liu T, Monroe ME, Strittmatter EF, Jacobs JM, et al. (2005) Probability-based evaluation of peptide and protein identifications from tandem mass spectrometry and SEQUEST analysis: the human proteome. J Proteome Res 4: 53–62.
- 27. Kolker E, Picone AF, Galperin MY, Romine MF, Higdon R, et al. (2005) Global profiling of Shewanella oneidensis MR-1: expression of hypothetical genes and improved functional annotations. Proc Natl Acad Sci U S A 102: 2099–2104.
- 28. Zhu P, Bowden P, Tucholska M, Zhang D, Marshall JG (2010) Peptide-to-protein distribution versus a competition for significance to estimate error rate in blood protein identification. Anal Biochem.
- 29. Gupta N, Pevzner PA (2009) False discovery rates of protein identifications: a strike against the two-peptide rule. J Proteome Res 8: 4173–4181.
- 30. Higdon R, Kolker E (2007) A predictive model for identifying proteins by a single peptide match. Bioinformatics 23: 277–280.
- 31. Callister SJ, McCue LA, Turse JE, Monroe ME, Auberry KJ, et al. (2008) Comparative bacterial proteomics: analysis of the core genome concept. PLoS One 3: e1542.
- 32. Koonin EV (2003) Comparative genomics, minimal gene-sets and the last universal common ancestor. Nat Rev Microbiol 1: 127–136.
- 33. Weiss M, Schrimpf S, Hengartner MO, Lercher MJ, von Mering C (2010) Shotgun proteomics data from multiple organisms reveals remarkable quantitative conservation of the eukaryotic core proteome. Proteomics 10: 1297–1306.
- 34. Armengaud J (2009) A perfect genome annotation is within reach with the proteomics and genomics alliance. Curr Opin Microbiol 12: 292–300.
- 35. Castellana N, Bafna V (2010) Proteogenomics to discover the full coding content of genomes: a computational perspective. J Proteomics 73: 2124–2135.
- 36. Blattner FR, Plunkett G 3rd, Bloch CA, Perna NT, Burland V, et al. (1997) The complete genome sequence of Escherichia coli K-12. Science 277: 1453–1462.
- 37. Salzberg SL (2007) Genome re-annotation: a wiki solution? Genome Biol 8: 102.
- 38. Baudet M, Ortet P, Gaillard JC, Fernandez B, Guerin P, et al. (2010) Proteomics-based refinement of Deinococcus deserti genome annotation reveals an unwonted use of non-canonical translation initiation codons. Mol Cell Proteomics 9: 415–426.
- 39. Balakirev ES, Ayala FJ (2003) Pseudogenes: are they “junk” or functional DNA? Annu Rev Genet 37: 123–151.
- 40. Lerat E, Ochman H (2005) Recognizing the pseudogenes in bacterial genomes. Nucleic Acids Res 33: 3125–3132.
- 41. Kukkonen M, Suomalainen M, Kyllonen P, Lahteenmaki K, Lang H, et al. (2004) Lack of O-antigen is essential for plasminogen activation by Yersinia pestis and Salmonella enterica. Mol Microbiol 51: 215–225.
- 42. Simonet M, Riot B, Fortineau N, Berche P (1996) Invasin production by Yersinia pestis is abolished by insertion of an IS200-like element within the inv gene. Infect Immun 64: 375–379.
- 43. Tong Z, Zhou D, Song Y, Zhang L, Pei D, et al. (2005) Pseudogene accumulation might promote the adaptive microevolution of Yersinia pestis. J Med Microbiol 54: 259–268.
- 44. Raoult D, Audic Sp, Robert C, Abergel C, Renesto P, et al. (2004) The 1.2-Megabase Genome Sequence of Mimivirus. Science 306: 1344–1350.
- 45. Sellam A, Hogues H, Askew C, Tebbji F, van Het Hoog M, et al. (2010) Experimental annotation of the human pathogen Candida albicans coding and noncoding transcribed regions using high-resolution tiling arrays. Genome Biol 11: R71.
- 46. Cobucci-Ponzano B, Guzzini L, Benelli D, Londei P, Perrodou E, et al. (2010) Functional characterization and high-throughput proteomic analysis of interrupted genes in the archaeon Sulfolobus solfataricus. J Proteome Res 9: 2496–2507.
- 47. Chandler M, Mahillon J (2002) Insertion Sequences Revisited. In: Craig NL, Craigie R, Gellert M, Lambowitz AM, editors. Mobile DNA II. Washington, D.C.: ASM Press. pp. 305–366.
- 48. Ahmed N, Dobrindt U, Hacker J, Hasnain SE (2008) Genomic fluidity and pathogenic bacteria: applications in diagnostics, epidemiology and intervention. Nat Rev Micro 6: 387–394.
- 49. Bejerano G, Lowe CB, Ahituv N, King B, Siepel A, et al. (2006) A distal enhancer and an ultraconserved exon are derived from a novel retroposon. Nature 441: 87–90.
- 50. Yin Y, Fischer D (2006) On the origin of microbial ORFans: quantifying the strength of the evidence for viral lateral transfer. BMC Evolutionary Biology 6: 63–69.
- 51. Farabaugh PJ (1996) Programmed translational frameshifting. Annu Rev Genet 30: 507–528.
- 52. Cottingham K (2009) Two are not always better than one. J Proteome Res 8: 4172.
- 53. Ansong C, Tolic N, Purvine S, Porwollik S, Jones M, et al. (2011) Experimental annotation of post-translational features and translated coding regions in the pathogen Salmonella Typhimurium. BMC Genomics 12: 433.
- 54. Prasad TS, Harsha HC, Keerthikumar S, Sekhar NR, Selvan LD, et al. (2012) Proteogenomic Analysis of Candida glabrata using High Resolution Mass Spectrometry. Journal of Proteome Research 11: 247–260.
- 55. Ansong C, Yoon H, Porwollik S, Mottaz-Brewer H, Petritis BO, et al. (2009) Global Systems-Level Analysis of Hfq and SmpB Deletion Mutants in Salmonella: Implications for Virulence and Global Protein Translation. PLoS ONE 4: e4809.
- 56. Sittka A, Lucchini S, Papenfort K, Sharma CM, Rolle K, et al. (2008) Deep Sequencing Analysis of Small Noncoding RNA and mRNA Targets of the Global Post-Transcriptional Regulator, Hfq. PLoS Genet 4: e1000163.
- 57. Thomassen GO, Weel-Sneve R, Rowe AD, Booth JA, Lindvall JM, et al. (2010) Tiling array analysis of UV treated Escherichia coli predicts novel differentially expressed small peptides. PLoS One 5: e15356.
- 58. Vivancos AP, Guell M, Dohm JC, Serrano L, Himmelbauer H (2010) Strand-specific deep sequencing of the transcriptome. Genome Res 20: 989–999.
- 59. Cho BK, Zengler K, Qiu Y, Park YS, Knight EM, et al. (2009) The transcription unit architecture of the Escherichia coli genome. Nat Biotechnol 27: 1043–1049.
- 60. Qiu Y, Cho B-K, Park YS, Lovley D, Palsson BØ, et al. (2010) Structural and operational complexity of the Geobacter sulfurreducens genome. Genome Research 20: 1304–1311.
- 61. Fowler JM, Brubaker RR (1994) Physiological basis of the low calcium response in Yersinia pestis. Infect Immun 62: 5234–5241.
- 62. Brubaker RR (2005) Influence of Na(+), dicarboxylic amino acids, and pH in modulating the low-calcium response of Yersinia pestis. Infect Immun 73: 4743–4752.
- 63. Mottaz-Brewer HM, Norbeck AD, Adkins JN, Manes NP, Ansong C, et al. (2008) Optimization of proteomic sample preparation procedures for comprehensive protein characterization of pathogenic systems. J Biomol Tech 19: 285–295.
- 64. Adkins JN, Mottaz HM, Norbeck AD, Gustin JK, Rue J, et al. (2006) Analysis of the Salmonella typhimurium proteome through environmental response toward infectious conditions. Mol Cell Proteomics 5: 1450–1461.
- 65. Livesay EA, Tang K, Taylor BK, Buschbach MA, Hopkins DF, et al. (2008) Fully automated four-column capillary LC-MS system for maximizing throughput in proteomic analyses. Anal Chem 80: 294–302.
- 66. Eng JK, McCormack AL, Yates JR (1994) An approach to correlate tandem mass spectral data of peptides with amino acid sequences in a protein database. Journal of the American Society for Mass Spectrometry 5: 976–989.
- 67. Rutherford K, Parkhill J, Crook J, Horsnell T, Rice P, et al. (2000) Artemis: sequence visualization and annotation. Bioinformatics 16: 944–945.
- 68. Altschul SF, Gish W, Miller W, Myers EW, Lipman DJ (1990) Basic local alignment search tool. J Mol Biol 215: 403–410.