For accurate and reliable gene expression analysis, normalization of gene expression data against housekeeping genes (reference or internal control genes) is required. It is known that commonly used housekeeping genes (e.g. ACTB, GAPDH, HPRT1, and B2M) vary considerably under different experimental conditions and therefore their use for normalization is limited. We performed a meta-analysis of 13,629 human gene array samples in order to identify the most stable expressed genes. Here we show novel candidate housekeeping genes (e.g. RPS13, RPL27, RPS20 and OAZ1) with enhanced stability among a multitude of different cell types and varying experimental conditions. None of the commonly used housekeeping genes were present in the top 50 of the most stable expressed genes. In addition, using 2,543 diverse mouse gene array samples we were able to confirm the enhanced stability of the candidate novel housekeeping genes in another mammalian species. Therefore, the identified novel candidate housekeeping genes seem to be the most appropriate choice for normalizing gene expression data.
Citation: de Jonge HJM, Fehrmann RSN, de Bont ESJM, Hofstra RMW, Gerbens F, Kamps WA, et al. (2007) Evidence Based Selection of Housekeeping Genes. PLoS ONE 2(9): e898. https://doi.org/10.1371/journal.pone.0000898
Academic Editor: Michael Lichten, National Cancer Institute, United States of America
Received: July 12, 2007; Accepted: August 27, 2007; Published: September 19, 2007
Copyright: © 2007 de Jonge et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by a grant from the Dutch Cancer Society (grantnr 3661) to E.S.J.M. de B, a grant of the Foundation for Pediatric Oncology to H.J.M. de J and A ter E. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Measuring transcript abundance by real-time reverse transcription PCR (RT-PCR) has become the method of choice due to its high sensitivity, specificity and broad quantification range for high-throughput and accurate expression profiling of selected genes. RT-PCR is the most commonly used method for molecular diagnostics, validating microarray data of a smaller set of genes and is especially useful when only a small number of cells is available.– Besides being a powerful technique RT-PCR suffers from certain pitfalls, with inappropriate data normalization as the most important problem. Various strategies have been applied to control gene expression results. Standardization of the amount of cells is for instance a problem when tissue samples are used. Quantification of total RNA is difficult when only minimal RNA quantities are available. More importantly, it measures the total RNA fraction of a sample, which consists for only a relatively small percentage (<10%) of mRNA and predominantly of rRNA molecules. A drawback to the use of 18S or 28S rRNA molecules as control genes is the abovementioned imbalance between mRNA and rRNA fractions. In addition, it has been shown that certain biological factors and drugs may affect rRNA transcription.,  Finally, those approaches still do not take a correction for the efficiency of enzymatic reactions into account. At this moment housekeeping genes are the gold standard to normalize the mRNA fraction. However, the known considerable variation in gene expression of commonly used housekeeping genes will add noise to an experiment and could ultimately lead to erroneous results.– This even resulted in strategies to control for the instability by using sets of control genes and calculation of normalization factors using statistical algorithms., ,  In order to identify the most stable expressed housekeeping genes we used a large set of expression data from 13,629 published human gene arrays and investigated the abundance and stability in gene expression levels. We validated the human results in mice using a set of 2,543 published mouse gene arrays.
Results and Discussion
A candidate housekeeping gene was defined as a gene with the most stable expression, i.e. a gene with a small coefficient of variation (CV) and a maximum fold change <2 (MFC, the ratio of the maximum and minimum values observed within the dataset). In addition, a mean expression level lower than the maximum expression level subtracted with 2 standard deviation (SD) was a prerequisite for a candidate housekeeping gene. The expression levels of 13,037 unique genes in the set of 13,629 diverse samples were used. Table 1 shows the identified top 15 candidate housekeeping genes (Table S1 shows CVs of all 13,037 unique genes). All 15 genes had a CV beneath the 4% level and a standard deviation below 0.49. Moreover, the MFCs ranged from 1.41 (RPL27) to 1.99 (RPS12), reflecting the minor variation in expression of those candidate housekeeping genes within the large dataset. Thirteen of these top 15 genes encode for ribosomal proteins involved in protein biosynthesis. The distribution of the expression levels is given in Figure 1A.
Next, we studied the expression levels of commonly used housekeeping genes (e.g. ACTB, GAPDH, HPRT1 and B2M). The expression levels of those commonly used housekeeping genes fluctuated dramatically (Table 2). The MFC ranged from 1.91 (ACTB) to 15.15 (ALDOA). Moreover, for only one of 12 commonly used housekeeping genes (ACTB) the CV was beneath the 5% level, reflecting the highly variable levels of those commonly used housekeeping genes within our large dataset. Remarkably, none of the classical housekeeping genes ranked among the top 50 identified candidate housekeeping genes. The distribution of expression levels of commonly used housekeeping genes is depicted in Figure 1B.
To demonstrate the feasibility of the use of these novel candidate housekeeping genes, we created for 5 of the top 15 candidate housekeeping genes primers (i.e. RPL27, RPL30, OAZ1, RPL22 and RPS29). We tested with PCR for desired product length and specificity; no pseudogenes were amplified (Figure 2 shows the PCR results).
S indicates sample, cDNA of a HL-60 leukemic cell line was used for all primers, B indicates the blanc (H2O) and L indicates the 100 base pair ladder (Fermentas).
To validate the enhanced stability of the identified novel candidate housekeeping genes we used another mammalian model system, i.e. the mouse. The expression levels of 21,377 unique genes in a set of 2,543 diverse mouse samples were used. The novel candidate housekeeping genes identified in the human data set also showed stability in expression in mouse arrays (Table 3). Also in mouse expression arrays genes encoding for ribosomal proteins are the most stable expressed ones. So, the stability in expression of the identified candidate housekeeping genes was confirmed in another species.
Our results clearly reveal novel candidate housekeeping genes with a more stable expression in different cellular and experimental contexts in comparison to frequently used housekeeping genes (e.g. ACTB, GAPDH and HPRT). On the basis of a definition of ubiquitous and stable expression, our results indicate however that no single gene qualifies as a ‘real’ housekeeping gene. GAPDH and ACTB were used as single control genes in more then 90% of the cases in high impact journals. Commonly used control genes are historical carryovers and were considered good references for many years in techniques where a qualitative change was being measured, because these genes are expressed at relatively high levels in nearly all cells. However, the advent of RT-PCR placed the emphasis on quantitative change, and asks for a re-evaluation of the use of these historical housekeeping genes. Here we show for the first time a genome wide evaluation of candidate housekeeping genes by a meta-analysis of more then 13,000 samples. Interestingly, the identified candidate novel housekeeping genes do not vary much in terms of functionality; they are predominantly ribosomal proteins involved in protein biosynthesis. Therefore, experimenters that tinker with this specific cellular process would better use other candidate housekeeping genes of our analysis, for example OAZ1.
Using meta-analysis we were able to find candidate housekeeping genes with a much lower level of variance in expression across tissue types and experimental conditions than commonly used housekeeping genes. Our identified candidate housekeeping genes can be applied in (nearly) all future RT-PCR experiments without any restrictions.
Materials and Methods
Microarray expression data of 13,629 publicly available samples hybridized to Affymetrix HG-U133A and HG-U133 Plus 2.0 GeneChips (Affymetrix, Santa Clara, Ca.) were downloaded from the Gene Expression Omnibus. This set of samples comprises gene expression data of a wide variety of different tissues (e.g. primary patient material, cell lines, diseased as well as normal tissues, stem cells etc.) and varying experimental conditions (e.g. transfected/transduced cells, cytokine stimulated, cells under hypoxic conditions, ultraviolet treated cells, cells treated with chemotherapeutics or non cytotoxic drugs etc.). Probesets that were available on both platforms were converted to official gene symbols, averaging expression values of multiple probesets targeting the same gene. Next, quantile normalization was applied to the log2 transformed expression values. For each gene the CV of the expression was calculated. The CV equals the standard deviation divided by the mean (expressed as a percentage). The CV is used as a statistic for comparing the degree of variation between genes, even if the mean expressions are drastically different from each other. The calculated CVs for all genes were ranked. In addition, the MFC was calculated to reflect the minor variation in expression of those candidate housekeeping genes within the large dataset. For validation 2,543 publicly available mouse samples hybridized to Affymetrix Mouse Genome 430 2.0 GeneChips (Affymetrix) were downloaded from the Gene Expression Omnibus.. Again, this validation set comprises a wide variety of different mouse tissues and varying experimental conditions.
Total RNA was extracted with Absolutely RNA Miniprep Kit (Stratagene, Amsterdam, The Netherlands), and reverse-transcribed to cDNA with random hexamer and RevertAidTM M-MuLV Reverse Transcriptase (Fermentas, Burlington, Ontario, Canada) according to the manufacturer's protocols. Table 4 shows primer sequences for RPL27, RPL30, OAZ1, RPL22 and RPS29. The same annealing temperature (i.e. 60 °C) and number of cycles (i.e. 25) was used for all primers. The PCR products were analyzed by electrophoresis in a 1.0% agarose gel.
Conceived and designed the experiments: Ed At Hd RF Ed RH FG WK Av Gt. Performed the experiments: Hd RF. Analyzed the data: Ed At Hd RF Ed RH FG WK Av Gt. Contributed reagents/materials/analysis tools: At Hd RF Gt. Wrote the paper: Ed At Hd RF Ed RH FG WK Av Gt.
- 1. Bustin SA (2000) Absolute quantification of mRNA using real-time reverse transcription polymerase chain reaction assays. J Mol Endocrinol 25: 169–193.SA Bustin2000Absolute quantification of mRNA using real-time reverse transcription polymerase chain reaction assays.J Mol Endocrinol25169193
- 2. Chuaqui RF, Bonner RF, Best CJ, Gillespie JW, Flaig MJ, et al. (2002) Post-analysis follow-up and validation of microarray experiments. Nat Genet 32 Suppl509–514.RF ChuaquiRF BonnerCJ BestJW GillespieMJ Flaig2002Post-analysis follow-up and validation of microarray experiments.Nat Genet32 Suppl509514
- 3. Fink L, Seeger W, Ermert L, Hanze J, Stahl U, et al. (1998) Real-time quantitative RT-PCR after laser-assisted cell picking. Nat Med 4: 1329–1333.L. FinkW. SeegerL. ErmertJ. HanzeU. Stahl1998Real-time quantitative RT-PCR after laser-assisted cell picking.Nat Med413291333
- 4. Giulietti A, Overbergh L, Valckx D, Decallonne B, Bouillon R, et al. (2001) An overview of real-time quantitative PCR: applications to quantify cytokine gene expression. Methods 25: 386–401.A. GiuliettiL. OverberghD. ValckxB. DecallonneR. Bouillon2001An overview of real-time quantitative PCR: applications to quantify cytokine gene expression.Methods25386401
- 5. Heid CA, Stevens J, Livak KJ, Williams PM (1996) Real time quantitative PCR. Genome Res 6: 986–994.CA HeidJ. StevensKJ LivakPM Williams1996Real time quantitative PCR.Genome Res6986994
- 6. Higuchi R, Fockler C, Dollinger G, Watson R (1993) Kinetic PCR analysis: real-time monitoring of DNA amplification reactions. Biotechnology (N.Y.) 11: 1026–1030.R. HiguchiC. FocklerG. DollingerR. Watson1993Kinetic PCR analysis: real-time monitoring of DNA amplification reactions.Biotechnology (N.Y.)1110261030
- 7. Solanas M, Moral R, Escrich E (2001) Unsuitability of using ribosomal RNA as loading control for Northern blot analyses related to the imbalance between messenger and ribosomal RNA content in rat mammary tumors. Anal Biochem 288: 99–102.M. SolanasR. MoralE. Escrich2001Unsuitability of using ribosomal RNA as loading control for Northern blot analyses related to the imbalance between messenger and ribosomal RNA content in rat mammary tumors.Anal Biochem28899102
- 8. Johnson ML, Redmer DA, Reynolds LP (1995) Quantification of lane-to-lane loading of poly(A) RNA using a biotinylated oligo(dT) probe and chemiluminescent detection. Biotechniques 19: 712–715.ML JohnsonDA RedmerLP Reynolds1995Quantification of lane-to-lane loading of poly(A) RNA using a biotinylated oligo(dT) probe and chemiluminescent detection.Biotechniques19712715
- 9. Spanakis E (1993) Problems related to the interpretation of autoradiographic data on gene expression using common constitutive transcripts as controls. Nucleic Acids Res 21: 3809–3819.E. Spanakis1993Problems related to the interpretation of autoradiographic data on gene expression using common constitutive transcripts as controls.Nucleic Acids Res2138093819
- 10. Lee PD, Sladek R, Greenwood CM, Hudson TJ (2002) Control genes and variability: absence of ubiquitous reference transcripts in diverse mammalian expression studies. Genome Res 12: 292–297.PD LeeR. SladekCM GreenwoodTJ Hudson2002Control genes and variability: absence of ubiquitous reference transcripts in diverse mammalian expression studies.Genome Res12292297
- 11. Suzuki T, Higgins PJ, Crawford DR (2000) Control selection for RNA quantitation. Biotechniques 29: 332–337.T. SuzukiPJ HigginsDR Crawford2000Control selection for RNA quantitation.Biotechniques29332337
- 12. Thellin O, Zorzi W, Lakaye B, De Borman BB, Coumans B, et al. (1999) Housekeeping genes as internal standards: use and limits. J Biotechnol 75: 291–295.O. ThellinW. ZorziB. LakayeBB De BormanB. Coumans1999Housekeeping genes as internal standards: use and limits.J Biotechnol75291295
- 13. Vandesompele J, De Preter PK, Pattyn F, Poppe B, Van Roy RN, et al. (2002) Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol 3: 1–11.J. VandesompelePK De PreterF. PattynB. PoppeRN Van Roy2002Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes.Genome Biol3111
- 14. Edgar R, Domrachev M, Lash AE (2002) Gene Expression Omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res 30: 207–210.R. EdgarM. DomrachevAE Lash2002Gene Expression Omnibus: NCBI gene expression and hybridization array data repository.Nucleic Acids Res30207210
- 15. Bolstad BM, Irizarry RA, Astrand M, Speed TP (2003) A comparison of normalization methods for high density oligonucleotide array data based on variance and bias. Bioinformatics 19: 185–193.BM BolstadRA IrizarryM. AstrandTP Speed2003A comparison of normalization methods for high density oligonucleotide array data based on variance and bias.Bioinformatics19185193
- 16. Novak JP, Sladek R, Hudson TJ (2002) Characterization of variability in large-scale gene expression data: implications for study design. Genomics 79: 104–113.JP NovakR. SladekTJ Hudson2002Characterization of variability in large-scale gene expression data: implications for study design.Genomics79104113