Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Analytical “bake-off” of whole genome sequencing quality for the Genome Russia project using a small cohort for autoimmune hepatitis

  • Daria V. Zhernakova ,

    Roles Formal analysis, Methodology, Software, Writing – original draft, Writing – review & editing

    dasha.zhernakova@gmail.com(DVZ); lgdchief@gmail.com(SJO)

    Affiliations Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation, University of Groningen, University Medical Center Groningen, Department of Genetics, Groningen, the Netherlands

  • Sergei Kliver,

    Roles Formal analysis, Software

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Nikolay Cherkasov,

    Roles Data curation

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Gaik Tamazian,

    Roles Formal analysis, Software

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Mikhail Rotkevich,

    Roles Formal analysis, Software

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Ksenia Krasheninnikova,

    Roles Formal analysis, Software

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Igor Evsyukov,

    Roles Formal analysis

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Sviatoslav Sidorov,

    Roles Formal analysis, Software

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Pavel Dobrynin,

    Roles Methodology

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Andrey A. Yurchenko,

    Roles Methodology

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Valentin Shimansky,

    Roles Formal analysis

    Affiliation Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation

  • Irina V. Shcherbakova,

    Roles Investigation

    Affiliation Research Resource Center for Molecular and Cell Technologies, Research Park, Saint-Petersburg State University, St. Petersburg, Russia

  • Andrey S. Glotov,

    Roles Resources

    Affiliation Research Resource Center for Molecular and Cell Technologies, Research Park, Saint-Petersburg State University, St. Petersburg, Russia

  • David L. Valle,

    Roles Formal analysis

    Affiliation Institute of Genetic Medicine, Johns Hopkins University School of Medicine, Baltimore, MD, United States of America

  • Minzhong Tang,

    Roles Investigation

    Affiliation Wuzhou Red Cross Hospital, Guangxi, China

  • Emilia Shin,

    Roles Resources

    Affiliation Pediatric Liver Center, Department of Pediatrics, Johns Hopkins University School of Medicine, Baltimore, United States of America

  • Kathleen B. Schwarz,

    Roles Methodology, Resources

    Affiliation Pediatric Liver Center, Department of Pediatrics, Johns Hopkins University School of Medicine, Baltimore, United States of America

  •  [ ... ],
  • Stephen J. O'Brien

    Roles Conceptualization, Formal analysis, Project administration, Supervision, Writing – original draft, Writing – review & editing

    dasha.zhernakova@gmail.com(DVZ); lgdchief@gmail.com(SJO)

    Affiliations Theodosius Dobzhansky Center for Genome Bioinformatics, St. Petersburg State University, St. Petersburg, Russian Federation, Guy Harvey Oceanographic Center, Halmos College of Natural Sciences and Oceanography, Nova Southeastern University, Fort Lauderdale, Florida, United States of America

  • [ view all ]
  • [ view less ]

Abstract

A comparative analysis of whole genome sequencing (WGS) and genotype calling was initiated for ten human genome samples sequenced by St. Petersburg State University Peterhof Sequencing Center and by three commercial sequencing centers outside of Russia. The sequence quality, efficiency of DNA variant and genotype calling were compared with each other and with DNA microarrays for each of ten study subjects. We assessed calling of SNPs, indels, copy number variation, and the speed of WGS throughput promised. Twenty separate QC analyses showed high similarities among the sequence quality and called genotypes. The ten genomes tested by the centers included eight American patients afflicted with autoimmune hepatitis (AIH), plus one case’s unaffected parents, in a prelude to discovering genetic influences in this rare disease of unknown etiology. The detailed internal replication and parallel analyses allowed the observation of two of eight AIH cases carrying a rare allele genotype for a previously described AIH-associated gene (FTCD), plus multiple occurrences of known HLA-DRB1 alleles associated with AIH (HLA-DRB1-03:01:01, 13:01:01 and 7:01:01). We also list putative SNVs in other genes as suggestive in AIH influence.

Introduction

In the last decades whole genome sequencing (WGS) has become widely used in genomic studies. WGS technology improvement and decreasing sequencing costs have led to its increasing usage in medical diagnostics. As a consequence more and more groups set up new sequencing facilities to enable processing their samples in-house. A commonly used alternative is to outsource the sequencing, sending samples to a well-established sequencing center. Comprehensive comparisons of different next-generation sequencing (NGS) technologies have been performed to-date [15], aiding to the choice of NGS platform depending on the purpose of the study.

The Genome Russia Project will gather blood samples of some 3500 Russian people, including several hundred family trios (DNA samples of a child and both parents). The project will create a national collection of genetic data and engage researchers from multiple educational institutions and research organizations [6,7]. Genome Russia will reach across Russian Biomedical Centers and join with the international “1000 genomes project” created to uncover rare gene variants in different human populations [8]. DNA from the Russian volunteers will be subject to whole genome sequencing (WGS) suitable for estimating population-specific allele frequencies of determinants of complex chronic and infectious diseases with a genetic underpinning.

Genome Russia is important not only for the medical field and healthcare but also for biologists, political scientists, ethnographers, and historians, since we shall compile a comprehensive DNA variant information database for major ethnic groups living on the Russian territory. Population genetic analyses will enable historians and ethnographers to achieve better understanding of historic movements of ethnic groups, while pharmacists and clinicians will access data on efficacy of different medical drugs for different people, a beginning to precision medicine in Russia.

Recently, a new sequencing center has been set up at Peterhof (St. Petersburg State University, Russia) to provide sequencing facilities for various research projects including Genome Russia. Here we aimed at evaluating the performance of this center to determine whether it is suitable for sequencing thousands of human genomes within Genome Russia Project in comparison with commercial sequencing centers abroad.

We evaluated the WGS quality, efficiency and reproducibility of sequences obtained from the newly established core sequencing facility at Peterhof and from two established sequencing centers: Illumina (UK) and Macrogen (Seoul, Korea). Each center received DNA from the same ten individuals (8 clinical cases and two healthy parents of one case) who were involved in a disease association study targeting autoimmune hepatitis (AIH). Each facility provided 30x coverage of the same ten individuals with no financial charge, as they wanted to be considered for sequencing the volunteers collected by the Genome Russia Consortium.

We report here the detailed quality control analyses performed for each center, the efficiency of SNV and genotype calling, genotype comparison with each other and with DNA array chips of the same patients, the assessment of copy number variation and the speed of WGS thoughput promised. These data are offered with explicit recommendations for the Genome Russia sequencing based upon our interpretation. Additionally, we examined variants predicted as loss-of-function within the AIH cases in a prelude to discovering genetic influences in this rare disease of unknown etiology.

Our analysis highlights the differences in various aspects of resulting data between commercially available sequencing providers and thus will be of use not only for the newly established sequencing centers, but also for those who outsource their DNA-sequencing.

Results

I. Comparison of whole genome sequencing results

Sample description and data generation.

Sequencing was performed on a newly generated dataset of ten samples, of which eight (3 males and 5 females) were patients having autoimmune hepatitis and two were non-affected parents of one of the patients (Table 1).

In order to compare the results of sequencing performed by different sequence providers, the same six samples were sequenced at three sequencing centers Illumina-X10 (UK), Macrogen-X10 (Korea) and Peterhof-HiSeq4000 (Russia). Illumina-X10 and Macrogen-X10 sequenced all 10 samples (see Table 1).

Quality control of raw reads.

Comparison of raw data quality must take into account the presence of adapters, read quality, error rate, coverage of target genome and uniformity of coverage. To that aim we have chosen five parameters to compare: fraction of read pairs without adapters or Ns, fraction of read pairs with both reads retained after filtration, fraction of 23-mers with errors, estimated mean coverage and variance coefficient of coverage (see Methods). These parameters were used to set up criteria for including sequenced samples (see Methods for the detailed description). Histograms and values of corresponding parameters are presented in Fig 1, Table 2 and S1 Table.

thumbnail
Fig 1. Raw read quality control parameters.

Raw sequence read QC parameters are shown for three sequencing centers (colored differently).

https://doi.org/10.1371/journal.pone.0200423.g001

thumbnail
Table 2. Comparison of sequencing results (N = 17 parameters).

https://doi.org/10.1371/journal.pone.0200423.t002

Read coverage is on average the highest in Illumina-X10, followed by Macrogen-X10 and Peterhof-HiSeq4000 (Fig 1A, Table 2, S1 Table). The significance of this difference is illustrated by the mean coverage by both ANOVA (p-value = 0.0041) and Kruskall-Wallis test (p-value = 0.009609) (Fig 1A). Pairwise tests also show this trend (Illumina-X10 vs Macrogen-X10 p-value = 0.00031, 95% CI [1.51, 4.92]); Illumina-X10 vs Peterhof-HiSeq4000 data (p-value = 0.00101, 95% CI [1.41, 5.35]). As the lower boundary of confidence interval is less than 1.6 (i. e. only approximately 5% of the target 30x coverage) this measure is not important for our purposes.

Statistically significant differences between facilities were also detected for variance coefficient of coverage (Fig 1B) by Kruskal-Wallis test (p-value = 0.04262; ANOVA is inapplicable for this parameter). Pairwise comparison of variance coefficient of coverage showed a significant difference only between Illumina-X10 and Macrogen-X10 (p-value = 0.02105). Macrogen-X10 had lower values of variance coefficient (which is calculated as a ratio of standard deviation to mean value), which means more uniform coverage, while Peterhof-HiSeq4000 data fell between Macrogen-X10 and Illumina-X10 datasets (Fig 1B, Table 2, S1 Table).

We detected no statistically significant difference between the datasets for the fraction of read pairs with both reads retained after filtration and the fraction of 23-mers with errors (Table 2, S1 Table) as tested under a parametric model (ANOVA mixed model p-values 0.0930, 0.3291) or a nonparametric model (Kruskal-Wallis test p-values 0.075, 0.4209).

Statistically significant difference for fraction of read pairs without adapters or Ns (Fig 1C, Table 2, S1 Table) was detected only by Kruskal-Wallis test (p-value = 0.0011) and was not supported by ANOVA (p-value = 0.0697). This discrepancy was possibly due to fewer samples (N = 6) sequenced by the Peterhof-HiSeq4000 facility, thus making the parametric test not able to detect the difference. Pairwise tests showed a small but significant difference in the comparisons of Illumina-X10 vs Peterhof-HiSeq4000 (p-value = 0.001) and Macrogen-X10 vs Peterhof-HiSeq4000 (p-value = 0.001045).

Read alignment.

In order to compare genomic variation, we first aligned reads to the human reference genome. Our dataset contained two samples of non-European descent (Native American and African American). All samples irrespective of ethnicity were aligned to the same human reference genome, due to the absence of an alternative reference genome, and presuming this is not likely to substantially bias genotyping in non-repetitive regions [8]. Indeed, the percentage of mapped reads was not substantially different in the non-European samples.

Overall, alignment rate was similar across the three sequencing centers yielding around 97.5% of reads mapped (Table 2). We first aligned all datasets using the same default parameters of bowtie2 aligner. This resulted in discordant read pairing in 31% of read pairs in Illumina-X10 dataset. After detailed investigation we found that this happened due to a larger insert size of Illumina-X10 reads (see Table 2) than the default insert size used by bowtie2. To overcome this we increased the bowtie2 insert size to 800bp, which indeed increased the percentage of properly paired reads to 95%. The results obtained for other datasets with the default settings were acceptable; therefore we did not rerun bowtie2 with an increased insert size for the other datasets. This resulted in slightly lower percentages of properly paired reads in Macrogen-X10 and Peterhof-HiSeq4000 as compared to Illumina-X10 (Table 2). Detailed mapping statistics for all datasets can be found in S2 Table.

Variant calling and genotyping.

Alignments were then used for variant calling and genotyping. We performed joint genotyping on all sequenced samples separately in each dataset.

Variant calling identified more than 3.5 million SNPs and more than 50,000 short indels (Table 2). Peterhof-HiSeq4000 data had the lowest number of identified variants partly due fewer samples (N = 6) compared to Illumina-X10 and Macrogen-X10 datasets (N = 10). This difference becomes lower when comparing only the 6 shared samples (S3 Table). We also compared the number of Mendelian inheritance errors based on trio genotypes and found a lower error rate in Peterhof-HiSeq4000 and inMacrogen-X10 (Table 2, S4 Table). Allele count distributions were similar across datasets (S1 Fig). To assess genotyping quality we used microarray genotypes of the trio provided by Illumina. It was previously shown that comparison of WGS with microarrays provides an accurate estimation of variant detection sensitivity [9]. We estimated the percentage of microarray SNPs that were correctly genotyped in sequencing datasets. All datasets detected more than 96% of microarray SNPs with the same genotypes, while Illumina-X10 showed the highest number of concordant SNPs (Fig 2A, Table 2). We also investigated per-sample genotype concordance rate to identify potential outliers, such as sample ethnicity (S5 Table). Sample ethnicity did not appreciably influence genotype concordance (S5 Table), likely reflecting that read alignment and subsequent genotyping of common variants are not dramatically sensitive to common population-specific genetic variation in line with previous studies [8]. As expected, the number of variants (and the percentage of singletons) is higher in African American sample, in line with our knowledge of human ancestry with maximal variation and private alleles found across African populations.

thumbnail
Fig 2. Genotype comparison.

(A) Concordance of WGS genotypes with microarray genotypes. The concordance was estimated based on the trio data as the ratio of microarray SNPs with identical genotypes in WGS results. (B) Comparison of the three WGS datasets between each other in terms of precision, sensitivity and F-measure for pairwise comparisons. Color legend is given on the top right. (C) Concordance of genotypes in the three WGS datasets for all variants, SNPs and indels. Color legend is given on the top right.

https://doi.org/10.1371/journal.pone.0200423.g002

Variants genotyped in the three datasets show a high overlap, more than 86% of variants identified in one dataset could be found with the same genotype in another dataset (Fig 2B, S5 Table). Highest overlap was observed between Macrogen-X10 and Peterhof-HiSeq4000 variants. The overlap is higher for SNPs than for short indels (Fig 2C) probably partly due to alignment difficulties at indel borders, contributing to lower indel calling quality and increased discrepancies

Copy number variation and segmental duplication.

The copy number values distribution is close to normal with expected value around 2, which corresponds to the diploidy of the genome (S2 Fig).

Segmental duplications (SD) were defined as regions larger than 1Kbp of increased average copy number value in comparison to the mean copy number value in control regions of the corresponding individual with correction for dispersion [1012]. The results for the trio are shown in S3 Fig. We evaluated the number of segmental duplications present in patients but absent in the non-diseased individuals in each dataset. Overall, there are eight such shared duplications in Illumina-X10 dataset, two in Macrogen-X10 dataset, 40 in Peterhof-HiSeq4000 dataset. The fact that there were only 4 AIH patients sequenced in the Peterhof dataset compared to 8 AIH cases in the two other centers (Table 1) likely affected the quantities of common duplications. The segmental duplications identified in patients, but not present in the two healthy parents, do not overlap among different datasets.

Long insertions and deletions

We also called long indels (20–100 bp) in the three datasets. Illumina-X10 and Macrogen-X10 yielded around 2,500 long indels, whereas 6 samples from Peterhof-HiSeq4000 had around 1,900 long indels (S6 Table). In each dataset, about 80% of long indels were previously reported variants, and about 20% were novel.

From Illumina-X10 and Macrogen-X10, we selected 6 samples corresponding to the 6 samples present in Peterhof-HiSeq4000 and compared the three sets of long indels called in these 6 samples. Illumina-X10, Macrogen-X10, and Peterhof-HiSeq4000 shared approximately 50% of long indels, whereas about 20% of long indels were unique in each set (S4 Fig). This variation in long indels may be explained by variation in read mapping affecting the calling process. Long indel call sets for the 6 samples shared three indels overlapping with exons, and all the three were previously reported indel variants located in KTI12, BRCA1 and PKD1L2.

HLA genotyping

We investigated how well we can produce HLA genotypes based on sequencing results as compared to molecular HLA typing. We produced HLA genotypes using Athlates software for HLA-A, HLA-B, HLA-C and HLA-DRB1 genes (S7 Table). All three datasets showed a similar mismatch rate as compared with molecular typing results: Macrogen-X10 had the lowest number of mismatches (17) and Illumina-X10 had the highest number of mismatches (21). S7 Table

II. Autoimmune hepatitis

The cohort used for sequencing results comparisons consisted of eight patients diagnosed with autoimmune hepatitis (Table 1). Autoimmune hepatitis (AIH) is a rare highly heterogeneous complex disease of the liver with unknown etiology [1315]. AIH occurs both in children and in adults, more often affecting females than males. There are two distinct forms of AIH, type 1 and type 2, which differ by the presence of autoantibodies [16]. Genetic studies have identified several genetic variants increasing the risk of developing AIH. HLA class II DRB1 alleles were found to be associated with AIH disease in various populations [1720]. Variants in several genes outside of HLA were also associated with AIH susceptibility or progression: CTLA4 [21,22], FAS [23], VDR [24], TBX21 [25], TNF2 [26], SH2B3, CARD10 [27] and FTCD [28].

The number of patient samples (N = 8) in our data was too low for a robust gene association analyses, thus we annotated the identified SNPs and indels to produce a list of variants potentially having an impact on AIH disease. In this study we aimed to make use of multiple variant and genotyping replicates for each individual to filter errors and validate associated variants, thereby reducing false positive calls. We recovered 897 variants predicted to be high-confidence loss-of-function (LoF) by LOFTEE tool [29] (398 SNPs and 497 short indels; S8 and S9 Tables respectively). We further identified variants with reported AIH associations in GWAS catalog [30] and in HGMD [31], performed pathogenicity annotation by Gavin [32], and investigated the reported gene expression in liver according to GTEx [33]. S8 and S9 Tables provide an unabridged detailed description of these annotated SNP and indel variants respectively.

In a filtered gene list (S10 and S11 Tables) we selected rare variant alleles that occurred at least twice in the eight AIH patients, and excluded those with MAF > 0.01 in 1000G [8],ExAC [34], or gnomAD [34] databases. We retained SNPs with zero occurrence of alternative allele in the healthy parents (or up to two alleles when their offspring carried the variant). In order to provide an additional filtering criterion in variant prioritization, we also processed the same Illumina dataset using BWA-GATK pipeline to capture pipeline-specific mapping and genotyping errors.

We included only SNPs with genotypes that were > 98% concordant in Macrogen, Illumina, Peterhof, and Illumina GATK replication results, and also included those with rare homozygous cases. In S10 and S11 Tables we list relevant information for each LoF variant: 1) Chromosome; 2) Coordinates; 3) rs id number; 4) Reference and alternative allele sequence; 5) Number of gene isoforms (transcripts) this variant falls into; 6) Most severe genetic impact of the variant (e.g. gained stop codon, frameshift, splice effect etc.); 7) Novelty of the variant; 8) Mendel transmission error in trio; 9) Liver expression according to GTEx [25]; 10) Gene associations from GWAS catalog [30] and in HGMD [31] and 11). Gavin [32] pathogenicity prediction for each variant. After variant filtering according to these aspects (see Methods), we derived a short list of 54 SNPs and 27 indels, which offer potential for replication in a larger study (S10 and S11 Tables).

We compared these SNP and indel variants (S10 and S11 Tables) to genes identified in additional AIH patient exploration studies described in S12 Table. Briefly, we examined gene candidates derived from three separate AIH gene lists produced by studies on AIH onset: 1) 39 genes with segmental duplications among the 8 cases studied here; 2) 21 genes identified in two AIH patient trios with elevated incidence of homozygotes for rare alleles; and 3) genes implicated in AIH by previous studies (HLA-DRB1[1720], CTLA4 [21,22], FAS [23], VDR [24], TBX21 [25], TNF2 [26], SH2B3, CARD10 [27] and FTCD [28]).

We observed among the AIH cases two genes that were reported previously in multiple AIH gene association studies. First, HLA-DRB1 13:01 and 03:01 alleles are known to be associated with AIH type I and HLA-DRB1 07:01 allele is known to be associated with AIH type II in the literature[1720]. Molecular HLA typing in our samples [35] showed these HLA-DRB1 alleles known to be associated with AIH present in our samples (Table 3). Second, a [G>GC] insertion variant within the FTCD gene on chromosome 21 appeared in one homozygous case in trio and one heterozygous case while this insertion is absent in the 1000G and ExAC databases and listed with MAF 0.006 in the larger gnomAD database (Table 3, S11 Table). The FTCD gene encodes formimidoyltransferase cyclodeaminase and is known to play a role in AIH [28]. Mutations in the FTCD gene on chromosome 21 have been implicated as causal for glutamate formiminotransferase deficiency, a rare metabolic disorder that affects physical and mental development[36]. The single FTCD [G>GC] homozygous case was inherited from her mother but missing in the father suggesting a constitutive spontaneous mutation in this type II AIH case (Table 3).

Discussion

We present here the results of a comprehensive analysis of whole genome sequencing (WGS) of the St. Petersburg State University Sequencing Center at Peterhof as compared with the same samples sequenced by commercial sequencing centers outside of Russia: Illumina and Macrogen (Table 1). We compare the sequence quality, efficiency of DNA variant and genotype calling with each other and with DNA array chips of the same patients, Mendel allele transmission errors, the assessment of copy number variation and the speed of WGS throughput promised. There were slight differences in sequence coverage (Illumina was highest) and variance (Illumina was highest). For all other parameters measured (~20 in total) Peterhof and outside vendors provided very good and comparable sequence and data throughput. We must note here that while our new sequencing center produced high quality results, the time required for setting up a new sequencing facility and the cost was high as compared to the service providers outside Russia (S13 Table).

In this study we were primarily focused on WGS results comparison as the dataset used for this evaluation, consisting of eight AIH samples and two healthy parents of one case, was too small for a statistically robust association study. However, we were interested in the opportunity to use the technical replicates sequenced three times in different sequencing centers for variant prioritization. Using this replication and additional filtering steps (see Results) we identified a set of loss-of-function SNPs and short indels occurring in some of the AIH samples (S10 and S11 Tables). One of these was an insertion located in a gene FTCD known to be associated with autoimmune hepatitis, for which the trio case was homozygous.

Overall, the findings affirm comparable sequence data and genotyping quality in the compared centers, however differences in the timing were considerable. The success and speed of the Genome Russia Project may indeed depend on cost and speed of sequencing as expected. The AIH study lent credence to the influence of both HLA-DRB1 and the FTCD association with this complex disease occurring in several patients and in different studies compared here (Table 3, S7 Table).

Methods

Data generation and sequencing

Ten samples from a cohort on autoimmune hepatitis were used in this work. The study was approved by the Johns Hopkins Institutional Review Board. Parents/caregivers of patients all signed informed consent prior to enrolment into the study. Blood (1–5 ml) was drawn from AIH patients and the parents of one AIH case using EDTA vacutainer tubes. Genomic DNA was isolated from 1–5 ml blood using Puregene Blood Kit chemistry on an Autopure LS automated DNA purification instrument (Qiagen, Valencia, CA) at the Johns Hopkins University Institute of Genetic Medicine Biorepository/Shipping Coordinator, GRCF Cell Center and Biorepository. Detailed description of DNA extraction protocol and chemistry are presented at https://www.qiagen.com/us/resources/resourcedetail?id=a9e6a609-4600-4b03-afbd-974318590ce5&lang=en and also https://www.qiagen.com/us/shop/sample-technologies/dna/genomic-dna/gentra-puregene-blood-kit/#productdetails. DNA concentrations were determined by spectrophotometry using a NanoDrop 1000 Spectrophotometer (Thermo Fisher Scientific, Wilmington DE).

These ten samples were sent to three sequencing centers including our local Peterhof center, Illumina (UK) and Macrogen (South Korea). Quality control during sequencing library preparation was performed by sequencing centers and was not included in sequencing center comparison.

Macrogen-X10.

Genomic DNA libraries were prepared using TruSeq DNA PCR-Free Library Preparation Kit in accordance with TruSeq DNA PCR-free library preparation guide, producing a PCR-free library with 300–400 bp average insert size. 1 μg of each DNA sample was fragmented by Covaris system. Pairs of 151bp reads were sequenced on Illumina HiSeq X10 sequencer.

Illumina-X10.

Illumina TruSeq PCR free sample preparation kit was used to make libraries for all 10 samples from 600ng of DNA for each sample selecting fragments with 450 bp insert size. Fragmentation was performed using Covaris system; fragments with 450 bp insert size were selected. Pairs of 151bp reads were sequenced on Illumina HiSeq X10 sequencer.

Illumina microarray.

For validation purposes Illumina genotyped the trio using HumanOmni2.5–8 v1.2 genotyping chip.

Peterhof-HiSeq4000.

Genomic DNA libraries were prepared using TruSeq DNA PCR-Free Library Preparation Kit (Illumina, USA). All procedures were conducted in accordance with the protocol TruSeq DNA PCR-Free Library Prep Reference Guide (2015). 1 μg of each DNA sample was used for library preparation. Clusterization of 2 nM libraries was conducted on a cBot using HiSeq 3000/4000 PE Cluster Kit (Illumina, USA). 2x150 paired-end sequencing was done by Illumina HiSeq 4000 using HiSeq 3000/4000 SBS Kit (Illumina, USA) at Peterhof, St. Petersburg State University in accordance with Illumina HiSeq 4000 System Guide (2016).

Data quality control

Quality control (QC) was carried at the following levels:

  1. Raw sequence read QC
  2. QC after alignment of raw reads to human reference genome
  3. Variant calling and genotyping QC

1. Raw read quality control

The initial quality control was performed using FastQC [37]. The distribution of 23-mer coverage was calculated and drawn by KrATER [https://pypi.python.org/pypi/KrATER/0.1] tool based on Jellyfish [38] k-mer counter. Adapter occurrence was estimated using Cookiecutter [39]. As adapter occurrence was low (less than 3% of reads, see Table 2 and S1 Table) and had little impact on the genome alignment, we skipped the adapter removal stage. Finally, only reads with mean quality equal or higher than 20 were retained. In addition, the fraction of pairs with both reads retained was estimated and examined as a QC parameter.

Five explicit parameters were measured to assess and compare the quality of sequencing data between sequencing centers (see below):

  1. Estimated mean coverage (calculated only for the non-repetitive regions of genome using 23-mer distribution);
  2. Variance coefficient of coverage (estimation of uniformity of coverage);
  3. Fraction of read pairs with both reads retained after filtration (estimation of sequencing quality);
  4. Fraction of 23-mers with errors (estimation of sequencing error rate);
  5. Fraction of read pairs without adapters or "N"s (estimation of library preparation and sequencing quality).

To assess the significance of detected differences, Kruskal-Wallis and ANOVA tests (where the sequencing center was considered a fixed factor and individual sample as a random factor) were performed where applicable (for parameters No 1,2,3,4). Pairwise comparisons of estimated mean coverage (plus 95% confidence intervals) were also done between sequencing centers. All tests were performed using Stats and Lme4 R packages.

Based on raw read QC we determine whether a sample can be used in further analyses. To that aim we set the minimum or maximum value for several parameters:

  1. Fraction of read pairs without adapters or Ns: F ≥ 0.95
  2. Fraction of read pairs with both reads retained after filtration: F ≥ 0.95
  3. Fraction of kmers with errors: F ≤ 0.15
  4. Mode of coverage: C ≥ 27

If a sample fails one or more criteria, we required additional sequencing done for this sample.

2. Read alignment QC

We mapped raw reads that passed quality control to the GRCh38 human reference genome using bowtie2 2.2.8 [40] with the "—very-sensitive" option and obtained one BAM file per sample. Due to large insert sizes in Illumina-X10 dataset (larger than the default 500bp for bowtie2), we aligned Illumina-X10 reads with an increased insert size parameter (-X 800).

We obtained alignment statistics from BAM files using a combination of SAMtools-1.3 [41], BEDTools2-2.25.0 [42] and custom scripts written in Python 2.7. Genotype statistics was collected using BCFtools 1.3 [41]. Genotype comparison was performed using vcfeval utility from RTG Tools 3.7.1 [43].

In general we found two parameters useful for assessing differences between sequencing centers:

  1. Number of reads before mapping;
  2. Percentage of reads mapped.

3. Variant calling and genotyping QC

We sorted and indexed the individual BAM files using Sambamba 0.6.1 [44]. We used SAMtools 1.3 mpileup utility with options -q 37 -Q 30 -t AD,INFO/AD,ADF,INFO/ADF,ADR,INFO/ADR,DP,SP and BCFtools 1.3 call utility [41] with options -v -m -f GQ,GP for joint genotyping of all samples on the basis of the sorted and indexed BAM files. From the resulting VCF file we selected only SNVs that passed the following filters: (1) QUAL > 40, (2) FORMAT/GQ > 20, (3) FORMAT/DP > 10, and (4) FORMAT/SP < 20 using BCFtools view utility. We removed variants in repeated regions (as defined by RepeatMasker 4.0.5 based on Repbase Update 20140131).

We used the following main parameters to assess the quality of genotyping:

  1. Number of SNVs;
  2. Percentage of novel SNVs;
  3. Number of indels;
  4. Number of multiallelic sites;
  5. Rate of Mendel inheritance errors;
  6. Concordance with microarray genotypes.

Variant annotation and prioritization.

Variant annotation was performed by Ensembl Variant Effect Predictor (VEP) release 84 [45]. Using only canonical transcripts we annotated the variants with PolyPhen [46], SIFT [47] and Condel [48] pathogenicity scores; PhyloP [49] conservation score; loss-of-function (LoF) predictions by Loss-Of-Function Transcript Effect Estimator (LOFTEE) [29]; and minor allele frequencies from 1000G [8], ExAC [34] and gnomAD [34] data. We checked the reported associations in GWAS catalog [30] and HGMD [31], performed pathogenic annotation by Gavin [32] and annotated the genes with their expression levels in liver according to GTEx [33].

To filter the LoF SNPs, we excluded variants whose genotypes failed to replicate >98% of the time in all ten individuals by three platforms (Macrogen, Illumina and Peterhof). SNPs that could not be found in databases (or had a MAF<0.01 in 1000G, ExAC, and gnomAD databases; S6 Table, S7 Table), which had >2 alternative alleles among the eight AIH cases were included. We ranked high those variants, which had a zero incidence in two healthy parents (except when the offspring case carried the allele).

In order to exclude wrong genotyping due to bowtie2 + BCFtools pipeline errors, we also ran BWA alignment followed by GATK genotyping on Illumina-X10 samples as described in GATK best practices guide [50]. We used the concordance of genotypes produced by our default pipeline as compared to the GATK pipeline to further reduce the number of false positive variants.

CNV and SD identification

We searched for segmental duplications in the genomes sequenced with each of the three sequencing centers using the human genome assembly hg38 as reference.

The reference assembly was hard-masked from the repetitive regions using Repeat Masker and Tandem Repeat Finder software. Some other potential repeats were identified using kmer approach. The overrepresented kmers were masked out from the assembly using mapping of chromosome subregions of fixed length k = 36 onto the genome using mrFast [10] software.

The copy number (CN) values were evaluated along the chromosomes using mrCanavar [10] software in non-overlapping windows of 1Kbp of unmasked sequence. From each read of length 100 we selected two non-overlapping kmers. The flanking regions of potentially lower quality of length 9bps were excluded from the analysis.

According to the definition used in our analysis segmental duplications (SDs) are regions that span at least 10Kbp in genomic coordinates of increased average copy number value in comparison to the mean copy number value in control (non-repetitive) regions of the corresponding individual with correction for dispersion [1012]. An SD can be considered as an aggregated segment of increased variation and as other types of polymorphism can be inherited from a common ancestor distant enough to reveal such an imprint of variation in individuals not related in three or more generations and considered unrelated in our study. The goal of SD comparison is to estimate the total level of duplications in a genome and probably identify common and unique genes and other genomic signatures affected by SDs. Segmental duplication in two or more individuals are called not overlapping if their genomic coordinates do not overlap.

Identification of longer indels

We called genomic variants in each of Illumina-X10, Macrogen-X10 and Peterhof-HiSeq4000 samples using Platypus [51] with default options except for—assemble = 1. We filtered the obtained variants in the following series of steps: (1) indels called by Platypus (with "PASS" tag in "FILTER" field); (2) indels successfully normalized; (3) long indels (20 to 100 bp); (4) indels with quality score (QUAL) greater than 40; (5) indels with minimal genotype quality (GQ) greater than 20; (6) indels outside of low-complexity and low-mappability regions defined below. For steps (1), (2), (4), (5) we used BCFtools utilities. In step (2) we normalized indels using BCFtools norm utility with the following options:—check-ref x -m-.

In step (3) we selected long indels (20 to 100 bp) using a custom script. An indel was considered to have length of 20 to 100 bp if the difference between the lengths of the reference allele and the alternative allele was greater or equal to 20 bp and less or equal to 100 bp. In step (6) we filtered out indels located in low-complexity and low-mappability genomic regions using BEDtools intersect utility.

The regions of low mappability were identified in the following way: for each position in the genome, all 151-mers covering it were mapped back to the reference human genome using the bowtie2 aligner with the same options as used for the read alignment and the ratio of the uniquely mapped 151-mers was calculated. If the ratio was less than 0.5, then the position was considered to belong to a low-mappability region. The low-complexity genomic regions were obtained by merging three sets of regions: homopolymers of 7 bp or longer, DustMasker-identified low-complexity regions, and RepeatMasker-annotated low-complexity and microsatellite regions, and adding 10 bp to their flanks.

HLA typing

We performed HLA genotyping using Athlates software [52] with default parameters. For that we extracted the reads mapped to HLA region and the unmapped reads and aligned them using bowtie2 [40] to the HLA database provided by Athlates. We confirmed the HLA genotypes of each individual using molecular HLA genotyping as described previously [35].

Supporting information

S1 Fig. Distribution of alternative allele counts in called genotypes.

Three datasets of genotypes for 10 individuals (Illumina and Macrogen) and one dataset of genotypes for 6 individuals (Peterhof) were considered. For each variant, the number of alternative alleles was obtained; the variants were classified according to this number. Multiallelic variants were excluded from this analysis.

https://doi.org/10.1371/journal.pone.0200423.s001

(PDF)

S2 Fig. Distribution of copy numbers in non-duplicated (control) regions.

The distributions are plotted for each sample from (A) Illumina, (B) Macrogen, (C) Peterhof.

https://doi.org/10.1371/journal.pone.0200423.s002

(PDF)

S3 Fig. Segmental duplications identified in trio in three datasets.

"Common" bar corresponds to segmental duplications present in all three datasets.

https://doi.org/10.1371/journal.pone.0200423.s003

(PDF)

S4 Fig. Overlap of long indels across three sequencing centers.

The Venn diagram shows the number of shared long indels in the three datasets.

https://doi.org/10.1371/journal.pone.0200423.s004

(PDF)

S1 Table. Comparison of various QC parameters for raw reads.

Raw read quality control parameters assessed for all sequenced samples for each sequencing center.

https://doi.org/10.1371/journal.pone.0200423.s005

(XLSX)

S2 Table. Alignment statistics.

Various parameters of alignment results are averaged over all samples in each dataset.

https://doi.org/10.1371/journal.pone.0200423.s006

(DOCX)

S3 Table. Statistics on called variants.

Statistics on variant calling and genotyping were calculated on the 6 samples shared in the three datasets. The variants were classified as known or novel according to their presence or absence in the NCBI dbSNP database build 147.

https://doi.org/10.1371/journal.pone.0200423.s007

(XLSX)

S4 Table. Mendel inheritance errors.

Variants violating the Mendel inheritance law were counted in the trio genotype data.

https://doi.org/10.1371/journal.pone.0200423.s008

(DOCX)

S5 Table. Per-sample genotype comparison between datasets.

https://doi.org/10.1371/journal.pone.0200423.s009

(XLSX)

S6 Table. Long indel counts.

The number of identified long indels is given for each sequencing center to illustrate the effect of filtering (described in the first column).

https://doi.org/10.1371/journal.pone.0200423.s010

(DOCX)

S7 Table. HLA genotyping and concordance of WGS-based and molecular typing.

https://doi.org/10.1371/journal.pone.0200423.s011

(XLSX)

S8 Table. All identified LoF SNP list with annotation.

https://doi.org/10.1371/journal.pone.0200423.s012

(XLSX)

S9 Table. All identified LoF short indel list with annotation.

https://doi.org/10.1371/journal.pone.0200423.s013

(XLSX)

S12 Table. List of candidate AIH-related genes obtained from separate studies.

https://doi.org/10.1371/journal.pone.0200423.s016

(XLSX)

S13 Table. Time estimates for 30X coverage from sequencing centers per person.

https://doi.org/10.1371/journal.pone.0200423.s017

(DOCX)

Acknowledgments

We thank Macrogen and Illumina teams for providing sequencing results: Nick Bates, Zoya Kingsbury, Tonya McSherry, Jennifer Bae and Woon-Ah Seo.

References

  1. 1. Ratan A, Miller W, Guillory J, Stinson J, Seshagiri S, Schuster SC. Comparison of sequencing platforms for single nucleotide variant calls in a human sample. PLoS One. Public Library of Science; 2013;8: e55089. pmid:23405114
  2. 2. Clark MJ, Chen R, Lam HYK, Karczewski KJ, Chen R, Euskirchen G, et al. Performance comparison of exome DNA sequencing technologies. Nat Biotechnol. NIH Public Access; 2011;29: 908–14. pmid:21947028
  3. 3. Loman NJ, Misra R V, Dallman TJ, Constantinidou C, Gharbia SE, Wain J, et al. Performance comparison of benchtop high-throughput sequencing platforms. Nat Biotechnol. Nature Research; 2012;30: 434–439. pmid:22522955
  4. 4. Quail MA, Smith M, Coupland P, Otto TD, Harris SR, Connor TR, et al. A tale of three next generation sequencing platforms: comparison of Ion Torrent, Pacific Biosciences and Illumina MiSeq sequencers. BMC Genomics. BioMed Central; 2012;13: 341. pmid:22827831
  5. 5. Patwardhan A, Harris J, Leng N, Bartha G, Church DM, Luo S, et al. Achieving high-sensitivity for clinical applications using augmented exome sequencing. Genome Med. BioMed Central; 2015;7: 71. pmid:26269718
  6. 6. Oleksyk TK, Brukhin V, O’Brien SJ. Putting Russia on the genome map. Science. American Association for the Advancement of Science; 2015;350: 747. pmid:26564837
  7. 7. Oleksyk TK, Brukhin V, O’Brien SJ. The Genome Russia project: closing the largest remaining omission on the world Genome map. Gigascience. Oxford University Press; 2015;4: 53. pmid:26568821
  8. 8. Auton A, Abecasis GR, Altshuler DM, Durbin RM, Bentley DR, Chakravarti A, et al. A global reference for human genetic variation. Nature. Nature PublishAuton, A. et al., 2015. A global reference for human genetic variation. Nature, 526(7571), pp.68–74. Available at: http://www.nature.com/nature/journal/v526/n7571/full/nature15393.html#ref1 [Accessed September 30, 2015].ing Group; 2015;526: 68–74. pmid:26432245
  9. 9. DePristo MA, Banks E, Poplin R, Garimella K V, Maguire JR, Hartl C, et al. A framework for variation discovery and genotyping using next-generation DNA sequencing data. Nat Genet. Nature Publishing Group, a division of Macmillan Publishers Limited. All Rights Reserved.; 2011;43: 491–498. pmid:21478889
  10. 10. Alkan C, Kidd JM, Marques-Bonet T, Aksay G, Antonacci F, Hormozdiari F, et al. Personalized copy number and segmental duplication maps using next-generation sequencing. Nat Genet. NIH Public Access; 2009;41: 1061–7. pmid:19718026
  11. 11. Serres-Armero A, Povolotskaya IS, Quilez J, Ramirez O, Santpere G, Kuderna LFK, et al. Similar genomic proportions of copy number variation within gray wolves and modern dog breeds inferred from whole genome sequencing. BMC Genomics. 2017;18: 977. pmid:29258433
  12. 12. Dobrynin P, Liu S, Tamazian G, Xiong Z, Yurchenko AA, Krasheninnikova K, et al. Genomic legacy of the African cheetah, Acinonyx jubatus. Genome Biol. 2015;16: 277. pmid:26653294
  13. 13. Krawitt EL. Autoimmune Hepatitis. N Engl J Med. 2006;354: 54–66. pmid:16394302
  14. 14. Zhu JY, Han Y. Autoimmune hepatitis: Unveiling faces. J Dig Dis. 2015;16: 483–488. pmid:26332151
  15. 15. Gossard AA, Lindor KD. Autoimmune hepatitis: a review. J Gastroenterol. Springer Japan; 2012;47: 498–503. pmid:22526272
  16. 16. Ferri Liu PM, de Miranda DM, Fagundes EDT, Ferreira AR, Simões e Silva AC. Autoimmune hepatitis in childhood: the role of genetic and immune factors. World J Gastroenterol. Baishideng Publishing Group Inc; 2013;19: 4455–63. pmid:23901220
  17. 17. Donaldson PT. Genetics of liver disease: immunogenetics and disease pathogenesis. Gut. BMJ Group; 2004;53: 599–608. pmid:15016758
  18. 18. Ngu JH, Wallace MC, Merriman TR, Gearry RB, Stedman CA, Roberts RL. Association of the HLA locus and TNF with type I autoimmune hepatitis susceptibility in New Zealand Caucasians. Springerplus. Springer; 2013;2: 355. pmid:23961418
  19. 19. Czaja AJ, Souto EO, Bittencourt PL, Cancado ELR, Porta G, Goldberg AC, et al. Clinical distinctions and pathogenic implications of type 1 autoimmune hepatitis in Brazil and the United States. J Hepatol. 2002;37: 302–8. Available: http://www.ncbi.nlm.nih.gov/pubmed/12175624 pmid:12175624
  20. 20. Yoshizawa K, Ota M, Katsuyama Y, Ichijo T, Matsumoto A, Tanaka E, et al. Genetic analysis of the HLA region of Japanese patients with type 1 autoimmune hepatitis. J Hepatol. 2005;42: 578–584. pmid:15763345
  21. 21. Agarwal K, Czaja AJ, Jones DE, Donaldson PT. Cytotoxic T lymphocyte antigen-4 (CTLA-4) gene polymorphisms and susceptibility to type 1 autoimmune hepatitis. Hepatology. 2000;31: 49–53. pmid:10613727
  22. 22. Djilali-Saiah I, Ouellette P, Caillat-Zucman S, Debray D, Kohn JI, Alvarez F. CTLA-4/CD 28 region polymorphisms in children from families with autoimmune hepatitis. Hum Immunol. 2001;62: 1356–62. Available: http://www.ncbi.nlm.nih.gov/pubmed/11756004 pmid:11756004
  23. 23. Hiraide A, Imazeki F, Yokosuka O, Kanda T, Kojima H, Fukai K, et al. Fas Polymorphisms Influence Susceptibility to Autoimmune Hepatitis. Am J Gastroenterol. 2005;100: 1322–1329. pmid:15929764
  24. 24. Vogel A, Strassburg CP, Manns MP. Genetic association of vitamin D receptor polymorphisms with primary biliary cirrhosis and autoimmune hepatitis. Hepatology. 2002;35: 126–131. pmid:11786968
  25. 25. Chen S, Zhao W, Tan W, Luo X, Dan Y, You Z, et al. Association of TBX21 promoter polymorphisms with type 1 autoimmune hepatitis in a Chinese population. Hum Immunol. 2011;72: 69–73. pmid:20977921
  26. 26. Cookson S, Constantini PK, Clare M, Underhill JA, Bernal W, Czaja AJ, et al. Frequency and nature of cytokine gene polymorphisms in type 1 autoimmune hepatitis. Hepatology. 1999;30: 851–856. pmid:10498633
  27. 27. De Boer YS, Van Gerven NMF, Zwiers A, Verwer BJ, Van Hoek B, Van Erpecum KJ, et al. Genome-wide association study identifies variants associated with autoimmune hepatitis type 1. Gastroenterology. Elsevier, Inc; 2014;147: 443–452.e5. pmid:24768677
  28. 28. Lapierre P, Hajoui O, Homberg JC, Alvarez F. Formiminotransferase cyclodeaminase is an organ-specific autoantigen recognized by sera of patients with autoimmune hepatitis. Gastroenterology. 1999;116: 643–9. Available: http://www.ncbi.nlm.nih.gov/pubmed/10029623 pmid:10029623
  29. 29. https://github.com/konradjk/loftee.
  30. 30. Macarthur J, Bowler E, Cerezo M, Gil L, Hall P, Hastings E, et al. The new NHGRI-EBI Catalog of published genome-wide association studies (GWAS Catalog). 2017;45: 896–901. pmid:27899670
  31. 31. Stenson PD, Ball E V., Mort M, Phillips AD, Shiel JA, Thomas NST, et al. Human Gene Mutation Database (HGMD ®): 2003 update. Hum Mutat. 2003;21: 577–581. pmid:12754702
  32. 32. van der Velde KJ, de Boer EN, van Diemen CC, Sikkema-Raddatz B, Abbott KM, Knopperts A, et al. GAVIN: Gene-Aware Variant INterpretation for medical sequencing. Genome Biol. BioMed Central; 2017;18: 6. pmid:28093075
  33. 33. The Gtex Consortium. The Genotype-Tissue Expression (GTEx) project. Nat Genet. 2013;45: 580–5. pmid:23715323
  34. 34. Lek M, Karczewski KJ, Minikel E V., Samocha KE, Banks E, Fennell T, et al. Analysis of protein-coding genetic variation in 60,706 humans. Nature. Nature Research; 2016;536: 285–291. pmid:27535533
  35. 35. Tang M, Lautenberger JA, Gao X, Sezgin E, Hendrickson SL, Troyer JL, et al. The principal genetic determinants for nasopharyngeal carcinoma in China involve the HLA class I antigen recognition groove. PLoS Genet. Public Library of Science; 2012;8: e1003103. pmid:23209447
  36. 36. Hilton JF, Christensen KE, Watkins D, Raby BA, Renaud Y, de la Luna S, et al. The molecular basis of glutamate formiminotransferase deficiency. Hum Mutat. 2003;22: 67–73. pmid:12815595
  37. 37. Andrews S. FastQC. http://www.bioinformatics.babraham.ac.uk/projects/fastqc/; 2010.
  38. 38. Marçais G, Kingsford C. A fast, lock-free approach for efficient parallel counting of occurrences of k-mers. Bioinformatics. Oxford University Press; 2011;27: 764–70. pmid:21217122
  39. 39. Starostina E, Tamazian G, Dobrynin P, O’Brien S, Komissarov A. Cookiecutter: a tool for kmer-based read filtering and extraction. bioRxiv. 2015;
  40. 40. Langmead B, Salzberg SL. Fast gapped-read alignment with Bowtie 2. Nat Methods. NIH Public Access; 2012;9: 357–9. pmid:22388286
  41. 41. Li H, Handsaker B, Wysoker A, Fennell T, Ruan J, Homer N, et al. The Sequence Alignment/Map format and SAMtools. Bioinforma. 2009;25: 2078–2079. pmid:19505943
  42. 42. Quinlan AR, Hall IM. BEDTools: a flexible suite of utilities for comparing genomic features. Bioinformatics. 2010;26: 841–2. pmid:20110278
  43. 43. Cleary JG, Braithwaite R, Gaastra K, Hilbush BS, Inglis S, Irvine SA, et al. Comparing Variant Call Files for Performance Benchmarking of Next-Generation Sequencing Variant Calling Pipelines. bioRxiv. 2015;
  44. 44. Tarasov A, Vilella AJ, Cuppen E, Nijman IJ, Prins P. Sambamba: fast processing of NGS alignment formats. Bioinformatics. Oxford University Press; 2015;31: 2032–4. pmid:25697820
  45. 45. Mclaren W, Gil L, Hunt SE, Riat HS, Ritchie GRS, Thormann A, et al. The Ensembl Variant Effect Predictor. Genome Biol. Genome Biology; 2016; 1–14.
  46. 46. Adzhubei IA, Schmidt S, Peshkin L, Ramensky VE, Gerasimova A, Bork P, et al. A method and server for predicting damaging missense mutations. Nat Methods. NIH Public Access; 2010;7: 248–9. pmid:20354512
  47. 47. Kumar P, Henikoff S, Ng PC. Predicting the effects of coding non-synonymous variants on protein function using the SIFT algorithm. Nat Protoc. 2009;4: 1073–1081. pmid:19561590
  48. 48. González-Pérez A, López-Bigas N. Improving the assessment of the outcome of nonsynonymous SNVs with a consensus deleteriousness score, Condel. Am J Hum Genet. Elsevier; 2011;88: 440–9. pmid:21457909
  49. 49. Pollard KS, Hubisz MJ, Rosenbloom KR, Siepel A. Detection of nonneutral substitution rates on mammalian phylogenies. Genome Res. Cold Spring Harbor Laboratory Press; 2010;20: 110–21. pmid:19858363
  50. 50. Van der Auwera GA, Carneiro MO, Hartl C, Poplin R, Del Angel G, Levy-Moonshine A, et al. From FastQ data to high confidence variant calls: the Genome Analysis Toolkit best practices pipeline. Curr Protoc Bioinforma. NIH Public Access; 2013;43: 11.10.1–33. pmid:25431634
  51. 51. Rimmer A, Phan H, Mathieson I, Iqbal Z, Twigg SRF, WGS500 Consortium W, et al. Integrating mapping-, assembly- and haplotype-based approaches for calling variants in clinical sequencing applications. Nat Genet. Europe PMC Funders; 2014;46: 912–918. pmid:25017105
  52. 52. Liu C, Yang X, Duffy B, Mohanakumar T, Mitra RD, Zody MC, et al. ATHLATES: accurate typing of human leukocyte antigen through exome sequencing. Nucleic Acids Res. Oxford University Press; 2013;41: e142. pmid:23748956