Reverse transcription-quantitative real-time PCR (RT-qPCR) is a widely used technique for gene expression analysis. The reliability of this method depends largely on the suitable selection of stable reference genes for accurate data normalization. Hypericum perforatum L. (St. John's wort) is a field growing plant that is frequently exposed to a variety of adverse environmental stresses that can negatively affect its productivity. This widely known medicinal plant with broad pharmacological properties (anti-depressant, anti-tumor, anti-inflammatory, antiviral, antioxidant, anti-cancer, and antibacterial) has been overlooked with respect to the identification of reference genes suitable for RT-qPCR data normalization. In this study, 11 candidate reference genes were analyzed in H. perforatum plants subjected to cold and heat stresses. The expression stability of these genes was assessed using GeNorm, NormFinder and BestKeeper algorithms. The results revealed that the ranking of stability among the three algorithms showed only minor differences within each treatment. The best-ranked reference genes differed between cold- and heat-treated samples; nevertheless, TUB was the most stable gene in both experimental conditions. GSA and GAPDH were found to be reliable reference genes in cold-treated samples, while GAPDH showed low expression stability in heat-treated samples. 26SrRNA and H2A had the highest stabilities in the heat assay, whereas H2A was less stable in the cold assay. Finally, AOX1, AOX2, CAT1 and CHS genes, associated with plant stress responses and oxidative stress, were used as target genes to validate the reliability of identified reference genes. These target genes showed differential expression profiles over time in treated samples. This study not only is the first systematic analysis for the selection of suitable reference genes for RT-qPCR studies in H. perforatum subjected to temperature stress conditions, but may also provide valuable information about the roles of genes associated with temperature stress responses.
Citation: Velada I, Ragonezi C, Arnholdt-Schmitt B, Cardoso H (2014) Reference Genes Selection and Normalization of Oxidative Stress Responsive Genes upon Different Temperature Stress Conditions in Hypericum perforatum L. PLoS ONE9(12): e115206. https://doi.org/10.1371/journal.pone.0115206
Editor: Giancarlo López-Martínez, New Mexico State University, United States of America
Received: August 27, 2014; Accepted: November 19, 2014; Published: December 11, 2014
Copyright: © 2014 Velada et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. All relevant data are within the paper and its Supporting Information files.
Funding: This work was supported by the Portuguese Foundation for Science and Technology within the frame of the project PTDC/AGR-GPL/099263/2008 and the program POPH – Operational Program for Human Potential (Ciência 2007 to BA and Ciência 2008 to HC: C2008-UE/ICAM/06). This work is funded by FEDER Funds through the Operational Program for Competitiveness Factors – COMPETE, and National Funds through FCT under the Strategic Projects PEst-C/AGR/UI0115/2011 and PEst-OE/AGR/UI0115/2014. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Gene expression analysis has been widely used as a method to study the complex signaling and metabolic pathways underlying cellular and developmental processes in biological organisms, including plants. Growing number of studies of expression levels of several genes in plants have been carried out in order to understand the cellular and molecular mechanisms involved in plant development and growth, as well as, in plant responses to biotic (pathogen infection) and abiotic (environmental) stresses –.
The analysis of gene expression has been performed by using different methods such as, northern blotting, ribonuclease protection assay, reverse transcription-polymerase chain reaction (RT-PCR), reverse transcription-quantitative real-time PCR (RT-qPCR), DNA microarrays , and next generation sequencing (NGS) technologies . These last three technologies in particular have gained a wider appeal for the quantification of gene expression. It is clear that microarrays and NGS are extremely popular due to the ability to perform high throughput analysis. It is also clear that because of their relative simplicity and portability, qPCR-based assays will continue to be in demand for some considerable time . Moreover, NGS data is currently expanding in many plant species – and RT-qPCR provides a reliable method for validating such huge amount of RNA Sequencing (RNA-seq) data . However, several variables need to be controlled to obtain reliable quantitative expression measures by RT-qPCR. These include variations in initial sample quantity, RNA recovery, RNA integrity, efficiency of cDNA synthesis, and differences in the overall transcriptional activity of the tissues or cells analyzed . To overcome the problem of variability, a normalization step has to be used prior to gene expression analysis in order to minimize its effects. The most common approach to normalize RT-qPCR data is the introduction of reference genes (RG) –. A suitable reference gene is assumed to be unaffected by the experimental conditions and therefore should be expressed at a constant level among samples . Consequently, any changes in its expression level are due only to technical variations which should be discounted from the variation of the target gene expression levels. Indeed, the purpose of a reference gene is to remove the technical variations, ending up with true biological changes . The use of only one reference gene as well as the use of the most frequently used reference genes for normalization without a prior validation is no longer considered a good strategy . It is widely recognized that the use of inappropriate RGs may result in misinterpretation of the expression pattern of a given target gene thereby introducing flaws in the understanding of the gene's role. Recently, efforts have been directed towards systematization and standardization of these type of analyses, and the MIQE (minimum information for publication of quantitative real-time PCR experiments) guidelines suggest the use of three reference genes to generate more reliable results . The identification of stable RGs in various experimental designs will therefore contribute to have more accurate and reliable gene expression data.
Several algorithms such as GeNorm , NormFinder , BestKeeper , ΔCt , qBasePlus , as well as single-factor analysis of variance (ANOVA) and linear regression analysis  have been utilized. These algorithms have been applied in order to analyze the expression stability of candidate RGs among genotypes, organs, tissues, developmental stages and several biotic and abiotic stress conditions. Nowadays, a high diversity of plant species have been studied, including a number of important crops, vegetables and fruit plant species (Table 1).
However, to the best of our knowledge, no studies were performed on the evaluation of the expression stability of candidate RGs in Hypericum perforatum L. (commonly named St. John's wort). Moreover, the few studies on gene expression by RT-qPCR performed in H. perforatum rely, even recently, on only one reference gene for data normalization –. Apart from these studies, no information is available on the most appropriate RGs to be used in data normalization in studies related with temperature stress response in this plant species.
H. perforatum is a widely known medicinal herb used mostly as a medication for depression  having also other broad pharmacological activities, such as anti-tumor, anti-inflammatory, antiviral, antioxidant, anti-cancer, and antibacterial properties , . These properties are mainly due to the biosynthesis and accumulation of important secondary metabolites in its tissues. Naphtodianthrones, which include hypericin and pseudohypericins, and hyperforin, are the main biological active substances naturally present in H. perforatum . H. perforatum, as a field growing plant, is frequently exposed to a variety of adverse environmental stresses which negatively affect both productivity and secondary metabolites content . Environmental stress, such as extreme cold and heat stress (CS and HS, respectively), are two factors that greatly affect cultivated plants. The Mediterranean climate is characterized by high thermal amplitude, not only during a season, but also within a day, and therefore, plants need to suppress and respond quickly to the adverse effects of extreme temperature changes. It is important to understand how plants adapt to adverse temperatures in face of the current temperature changes that are occurring globally and that can critically affect plants behavior, such as physiological processes, crop production, and metabolite production.
Examples of genes which are associated with plant responses to abiotic stresses are, the alternative oxidase (AOX1 and AOX2), the chalcone synthase (CHS) and catalase (CAT). AOX is a mitochondrial membrane protein that functions as terminal oxidase in the alternative (cyanide-resistant) respiratory pathway, where it reduces oxygen to water . AOX relieves oxygen species (OS) originating from environmental stresses by limiting mitochondrial reactive oxygen species (ROS) formation and preventing specific components of the respiration chain from over-reduction  and canalizing ROS signals . In dicot plant species AOX is nuclear encoded by a small multigene family composed by two sub-family genes, AOX1 and AOX2 . CAT is a nuclear encoded enzyme which depending on its isoform could be localized in both the cytosol and peroxisomes  and probably also in the mitochondria . CAT, the major H2O2-scavenging enzyme in all aerobic organisms , performs the rapid removal of H2O2 from the cell by oxidation of H2O2 to H2O and O2 . CHS, a key enzyme of the flavonoid/isoflavonoid biosynthesis pathway and a component of the plant developmental program, is induced in plants under stress conditions such as UV light, bacterial or fungal infection .
For further development of RT-qPCR studies in H. perforatum that analyze the expression of stress responsive genes upon temperature stress conditions, the present study aimed to determine the most suitable RGs for data normalization. Here, we report a systematic analysis of eleven candidate RGs of H. perforatum, out of which some are commonly used as such, like the 18S ribosomal RNA (18SrRNA), the glyceraldehyde-3-phosphate dehydrogenase A subunit (GAPDH), and the beta-tubulin (TUB) , , but others not, such as the ribulose-1,5-bisphosphate carboxylase/oxygenase large subunit (RBCL), glutamate-1-semialdehyde 2,1-aminomutase (GSA), chamba phenolic oxidative coupling protein (HYP1), short-chain dehydrogenase/reductase (SDR), polyketide synthase 1 (PKS1) and polyketide synthase 2 (PKS2). The expression stabilities of these candidate RGs were evaluated using the three distinct statistical algorithms, GeNorm, NormFinder and BestKeeper, in order to determine the most stable and therefore most suitable genes for an accurate RT-qPCR normalization in H. perforatum upon temperature stress conditions.
Materials and Methods
Plant material and experimental conditions
Hypericum perforatum L. seeds were removed from the achenes of a mother plant growing under field conditions in the Alentejo region (Viana do Alentejo, Portugal, 38°21′37″N, 7°59′13″W). H. perforatum is not considered an endangered or protected species and no specific permissions were required for achene harvesting. After disinfection, seeds were in vitro inoculated (see details in ). Eight weeks after germination seedlings were transferred to 6.6×5.9 cm glass culture vessels (100 ml, Sigma-Aldrich, Sintra, Portugal) with fresh MS medium  (10 seedlings per flask). Cultures were maintained in a growth chamber at 16 h photoperiod, constant temperature of 25°C, and 80 µmol m−2s−1 of light intensity provided by day-light Philips fluorescent lamps. Nine-week-old seedlings were used for gene expression assays.
Two different experimental conditions were conducted in this study:
1) Cold stress (CS): cultures were transferred to 4°C. All the other parameters were maintained. Samples were collected at different time points: 0, 4, 8, 12, 24, 48 and 72 hours post incubation (hpi). Each biological sample consisted in a bulked sample of 10 seedlings. Three replicates were collected per time point.
2) Heat stress (HS): cultures were transferred to 35°C (the remaining parameters were maintained). Samples were collected at different time points: 0, 12, 24, 72 hpi and 7 days post incubation (dpi). Each biological sample consisted in a bulked sample of 3 seedlings. Three replicates were collected per time point.
RNA isolation and first-strand cDNA synthesis
Total RNA was isolated with the RNeasy Plant Mini Kit (Qiagen, Hilden, Germany), according to the supplier's instructions and eluted in 30 µl volume of RNase-free water. To digest residual genomic DNA, RNA samples were treated on-column with DNase I (RNase-Free DNase Set, Qiagen, Hilden, Germany) following the manufacturer's instructions. The concentration of total RNA was determined with the NanoDrop-2000C spectrophotometer (Thermo Scientific, Wilmington, DE, USA) and its integrity analyzed by agarose gel electrophoresis (prepared with DEPC-treated water) after visualization of the two ribosomal subunits in a Gene Flash Bio Imaging system (Syngene, Cambridge, UK). A maximum of 1.5 µg of total RNA was used for reverse transcription with the Maxima First Strand cDNA Synthesis Kit for RT-qPCR (Thermo Scientific, Wilmington, DE, USA). All the subsequent procedures were performed according to the manufacturer's instructions.
Quantitative real-time PCR
Relative quantification of gene expression was performed in the Applied Biosystems 7500 Real-Time PCR System (Applied Biosystems, Foster City, CA, USA). Real-time PCR reactions were carried out using 1× Maxima SYBR Green qPCR Master Mix, 300 nM of forward and reverse primers, and 1.25 ng of cDNA in a total volume of 18 µl. Primers for 11 candidate RGs and 4 target genes (Table 2) (designed from H. perforatum sequences deposited in National Center for Biotechnology Information - NCBI) were designed with the Primer Express v3.0 (Applied Biosystems, Foster City, CA, USA) using the default properties given by the software: amplicon length between 50 and 150 bp; primer length between 18 and 25 bp; melting temperature (Tm) of 60°C; guanine and cytosine (GC) content of 60%. All primer pairs were checked for their probability to form dimmers and secondary structures with the primer test tool of the software. cDNA samples were previously diluted in order to get the same concentration for all samples followed by a ten-fold dilution. The reactions were performed using the following thermal profile: 10 min at 95°C, and 40 cycles of 15 s at 95°C and 60 s at 60°C. No-template controls (NTCs) were used to assess contaminations and primer dimmers. A standard curve was performed using undiluted pool of all cDNA samples and three five-fold serial dilutions. All samples were run in duplicate. Melting curve analysis was done to ensure amplification of the specific amplicon. Quantification cycle (Cq) values were acquired for each sample with the Applied Biosystems 7500 software (Applied Biosystems, Foster City, CA, USA).
Determination of gene expression stability
GeNorm determines the pairwise variation of every control gene with all other control genes as the standard deviation of the logarithmically transformed expression ratios, and defines the internal control gene-stability measure M as the average pairwise variation of a particular gene with all other control genes. GeNorm also determines the optimal number of genes required to calculate a reliable normalization factor . The advantage of GeNorm is that it can find suitable combinations of reference genes required for normalization, which is more reliable than using only one reference gene. The main limitation of GeNorm is its sensitivity to co-regulation –. Co-regulated genes will have similar expression patterns having similar M values in the pairwise analysis of GeNorm, however, they might not have a stable expression in a specific tissue.
NormFinder enables estimation not only of the overall variation in the expression level of the candidate reference genes but also of the variation between sample subgroups of the sample set. It provides a direct measure for the estimated expression variation, enabling the user to evaluate the systematic error introduced when using the gene. The advantage of NormFinder is that it takes into account the inter- and intra-group variations and it shows less sensitivity to co-regulation of the candidate reference genes .
BestKeeper is an Excel based tool able to compare expression levels for up to ten reference genes together with ten target genes, each in up to hundred biological samples. It determines the ‘optimal’ reference genes employing the pair-wise correlation analysis of all pairs of candidate genes and calculates the geometric mean of the ‘best’ suited ones. The weighted index is correlated with up to ten target genes using the same pair-wise correlation analysis. While GeNorm software is restricted to the reference genes analysis only, in BestKeeper software, additionally up to ten target genes can be analyzed. Once a robust BestKeeper index is constructed, it can be applied as an expression standard in the same way like any single reference gene . Both NormFinder and BestKeeper were used to avoid co-regulation and to compare the results obtained by these two software programs with those obtained by GeNorm, one of the most used software to determine suitable reference genes.
RefFinder is a user-friendly web-based comprehensive tool developed for evaluating and screening reference genes from extensive experimental datasets. It integrates the currently available major computational programs (GeNorm, NormFinder, BestKeeper, and the comparative ΔΔCt method) to compare and rank the tested candidate reference genes. Based on the rankings from each program, it assigns an appropriate weight to an individual gene and calculates the geometric mean of their weights for the overall final ranking (http://www.leonxie.com/referencegene.php). RefFinder was used here in order to obtain the expression stabilities values from GeNorm, NormFinder and BestKeeper in the same tool, instead of using each program separately.
The input data were the raw Cq values for each sample and each of the candidate RGs (these were organized in columns). For each candidate gene, the stability values from the GeNorm (or average expression stability value, M) and NormFinder algorithms were taken, as well as, the values of the standard deviation of Cq value and the Pearson coefficient of correlation (r) were taken from the BestKeeper algorithm. For each RG a weight was given which corresponds to the number of the position given by GeNorm, NormFinder and BestKeeper. That is, the most stable RG was assigned the number 1 and the least stable RG was assigned the number 11. By calculating the geometric mean of these values, a ranking of the RGs using the three algorithms together was obtained and designated in this work by geometric mean.
Reference genes validation
In order to validate the candidate RGs, four target genes, namely CHS, CAT1, AOX1 and AOX2, were selected from the literature based on their response to environmental stress conditions , –. For normalization of the target genes expression levels, Cq values were converted into relative quantities (RQ) by the delta-Ct method  using the formula RQ = EΔCq, where E is the amplification efficiency calculated for each primer pair and ΔCq = lowest Cq – sample Cq. Amplification efficiency (E) was calculated using the formula E = 10(-1/slope), where the slope was given by the Applied Biosystems (AB) software. A normalization factor was obtained by calculating the geometric mean between the relative quantities of the selected RGs (for each normalization strategy) for each sample. For each target gene, calculating the ratio between the relative quantities for each sample and the corresponding normalization factor, a normalized gene expression value was obtained. The graphs show the mean ± standard deviation of three biological replicates and correspond to the ratio between treated and untreated samples for each time point, with bars representing the fold-change related to control group (0 hpi), which was set to 1. Statistical significances (p≤0.05 and p≤0.01) between the two means were determined by the t-test using IBM SPSS Statistics version 22.0 (SPSS Inc., USA).
Amplification specificity and efficiency
RNA samples were analyzed for their quantity and purity with a NanoDrop-2000C spectrophotometer (Thermo Scientific, Wilmington, DE, USA). All samples showed an absorbance ratio at 260/280 nm of above 1.8. Agarose gel electrophoresis revealed only the two rRNA subunits (18S and 28S) with well-defined bands and with no indication of RNA degradation (data not shown).
The amplification specificity of each gene was confirmed by performing a melting curve analysis after each PCR run. All the primer pairs used amplified the expected specific product and no formation of primer dimmers was observed (S1 Figure and S2 Figure). Amplification in NTCs was observed only for 18S and 26S rRNAs which was due to high transcript abundance and therefore confirmed by low Cq (Cq<15) values (data not shown). PCR efficiency of each primer pair was calculated using a standard curve with four points: the undiluted pool, containing all cDNA samples, and three five-fold serial dilutions of the undiluted cDNA pool. The slope, y-intercepts, correlation coefficient (r2), and efficiency values were given by the AB software. The slope values ranged between −3.234 and −3.674 for CS assays, and between −3.259 and −3.574 for HS assays (data not shown). The correlation coefficient (r2) ranged from 0.991 to 0.999 for CS assays and from 0.993 to 1.00 for HS assays (except for TUB which has a lower value of 0.985) (Table 3). PCR efficiency, it ranged from 1.90 (90.50%) to 2.04 (103.81%) in CS assays (except for PKS2 having only 87.15%), and from 1.90 (90.45%) to 2.03 (102.70%) in HS assays.
The expression levels of the candidate RGs were determined as Cq values. The 11 tested genes showed a wide range of transcript abundance in both CS and HS assays (Fig. 1). The candidate genes showed a relatively narrow variation in their expression levels across all samples, particularly in CS assays, as shown in box-plots where the boxes and whiskers are smaller than in HS assays. 18SrRNA, 26SrRNA and RBCL were the most highly expressed genes for both CS and HS with the lowest mean Cq (mCq) values (mCq between 7.97 and 13.91). SDR was the lowest expressed gene on both, CS and HS, showing the highest mCq (27.30 for CS and 28.02 for HS). With the exception of the ribosomal genes and the RBCL presenting mCq values around 8.0 and 14.0 for both assays, as mentioned above, the mCq values ranged between approximately 20.0 and 28.0 for all other candidate, being the HYP1 the most highly expressed gene with lower mCq values for both CS and HS assays (19.98 and 21.29, respectively), and SDR the less expressed gene.
Each box corresponding to each candidate reference gene indicates the 25% and 75% percentiles. Whiskers represent the maximum and minimum values. The median is represented by the line across the box. 26SrRNA: 26S ribosomal RNA; 18SrRNA: 18S ribosomal RNA; RBCL: ribulose-1,5-bisphosphate carboxylase/oxygenase large subunit; HYP1: Chamba phenolic oxidative coupling protein; GAPDH: glyceraldehyde-3-phosphate dehydrogenase A subunit; GSA: glutamate-1-semialdehyde 2,1-aminomutase; H2A: histone 2A; TUB: beta-tubulin; PKS1: polyketide synthase 1; PKS2: polyketide synthase 2; SDR: short-chain dehydrogenase/reductase.
Analysis of gene expression stability data
From the overall analysis, differences can be observed in the expression stability ranking of the candidate RGs between the two experimental conditions for each tested algorithm (Table 4). Additionally, differences can be also seen, although less significant, among the three algorithms applied within each assay. For CS experiments, GeNorm ranked GAPDH and GSA (M = 0.147) simultaneously as the most stable genes, and the 18SrRNA (M = 0.166) as the third best gene. For NormFinder, the most stable gene was the TUB (SV = 0.104) followed by 18SrRNA together with 26SrRNA (SV = 0.121 for both genes) and GAPDH (SV = 0.124). The BestKeeper algorithm ranked RBCL (SD = 0.10, r = 0.213) first, followed by TUB (SD = 0.12, r = 0.641) and 26SrRNA (SD = 0.12, r = 0.704) as the second and third ranked genes, respectively. From the geometric mean of all three algorithms, TUB, GSA, and GAPDH, were ranked in first, second and third positions, respectively.
For HS tolerance assays, 26SrRNA and H2A were ranked in the two first positions with GeNorm (M = 0.174 for both genes) and BestKeeper (SD = 0.28, r = 0.798, SD = 0.34, r = 0.826, respectively). NormFinder ranked TUB in the first position (SV = 0.139) and H2A and 26SrRNA were selected as the second and the third best genes, respectively (SV = 0.207 and SV = 0.262, respectively). The third ranked RG by GeNorm was the GSA (M = 0.336) and by BestKeeper was the 18SrRNA (SD = 0.35, r = 0.494). For the overall final ranking, obtained by calculating the geometric mean of the ranked genes by the three algorithms, the three top RGs for the HS assay were the 26SrRNA, H2A, and TUB.
Determination of the optimal number of reference genes for normalization by GeNorm
The Genorm pairwise variation (V) values were determined for the candidate RGs in both experimental designs (CS and HS) using a cut-off value of 0.15, below which the inclusion of an additional RG is not required for normalization (Fig. 2). Interestingly, the optimal number of RGs used for normalization was only two for both CS assay (V2/3 = 0.054) and HS assay (V2/3 = 0.136), being both V values below the 0.15 cut-off value.
Expression analysis of target genes for reference genes validation
In order to validate the suitability of the selected candidate RGs, the expression profile of 4 target genes was analyzed in the present work. The target genes, selected from the literature based on their reaction to temperature stress response and oxidative stress , –, were CHS, CAT1, AOX1 and AOX2. A single normalization strategy was applied to both assays, based on the geometric mean of the three algorithms by using the 3 top-ranked RGs. TUB, GSA and GAPDH were used as RGs for data normalization in CS whilst TUB together with 26S and H2A were used to normalize the expression results in HS assays. In CS assays, an accumulation of the CHS transcript was observed until 48 hpi with a 3.6 fold-change (p≤0.01) (Fig. 3a). From 24 hpi to 72 hpi, a down-regulation in the CAT1 mRNA expression for roughly half (p≤0.05) of the corresponding expression in the control group was observed (Fig. 3b). AOX1 transcript expression showed a gradual up-regulation in cold-treated samples until 24 hpi of about 2.8-fold (p≤0.05) with a following expression recovery until 72 hpi (Fig. 3c). AOX2 mRNA showed a reduction in its expression after 24 hpi in 1.9-fold (p≤0.01), with a further slight tendency to recover (Fig. 3d).
Expression of a) CHS, b) CAT, c) AOX1, and d) AOX2 in cold-treated samples using TUB, GSA and GAPDH as reference genes in data normalization. The relative expression values are depicted as the mean ± standard deviation of three biological replicates and correspond to the ratio between treated and untreated samples for each time point. The bars represent the fold-change related to control group (0 hours) which was set to 1. Statistical significances (*p≤0.05 and **p≤0.01) between the two means were determined by the t-test using IBM SPSS Statistics version 22.0 (SPSS Inc., USA).
In HS assays, our results showed a down-regulation in the CHS at 12 hpi of 3.8 fold-change (p≤0.01) with a subsequent gradual recovery until 72 hpi (Fig. 4a). Similarly in CS, the mRNA expression of CAT1 had a tendency to decrease in heat-treated samples and after 24 hpi the value was around half (p≤0.05) of the expression in the control group (Fig. 4b). For AOX1, a slight increase in the mRNA expression of 1.8 fold-change (p≤0.05) was observed after 24 hpi, and this expression was maintained until 72 hpi (Fig. 4c). Although statistically significant (p≤0.05), the reduction in the AOX2 mRNA expression after 12 hpi was very modest demonstrating, in general, a high stability of this gene over time (Fig. 4d).
Expression of a) CHS, b) CAT, c) AOX1, and d) AOX2 in heat-treated samples using TUB, 26S and H2A as reference genes in data normalization. The relative expression values are depicted as the mean ± standard deviation of three biological replicates and correspond to the ratio between treated and untreated samples for each time point. The bars represent the fold-change related to control group (0 hours) which was set to 1. Statistical significances (*p≤0.05 and **p≤0.01) between the two means were determined by the t-test using IBM SPSS Statistics version 22.0 (SPSS Inc., USA).
In H. perforatum, studies on the expression stability of candidate RGs in a variety of experimental contexts has received no attention, and even recently only one RG is being used in RT-qPCR data normalization in this plant species – neglecting the knowledge that such a strategy is no longer admissible , . Despite the pharmacological interest of the compounds produced by H. perforatum, very limited genomic information is available in NCBI. This is reflected by the absence of sequence data on a large number of frequently used genes. Consequently, for this study, a significant number of the genes selected had been recently isolated by members of our research group (GAPDH: EU301783, GSA: KJ624985, H2A: EU034009, SDR: EU034010, TUB: KJ669725, AOX1: EU330415, AOX2: EU330413). This study is the first detailed evaluation of the expression stability of several candidate RGs to be used for normalization in RT-qPCR studies in H. perforatum upon different stressful temperature conditions. Our analysis was based on the three most frequently used mathematical softwares, GeNorm, NormFinder and BestKeeper. Instead of using each software separately, the RefFinder tool was used here, since it integrates all three algorithms. We tested the expression stability of 11 candidate RGs, including commonly used RGs (TUB, GAPDH, and 18SrRNA), as well as, less frequently used RGs (HYP1, GSA, H2A, PKS1, PKS2, RBCL, SDR, and 26SrRNA). Within each algorithm, differences in the expression stability of the candidate genes were found when comparing the two experimental conditions of our study. These results reinforce previous conclusions, achieved by several authors using different plant species and experimental conditions, stating that the selection of the most stable RGs is highly dependent on the plant species and the experimental context , – and, therefore, assuming the existence of general RGs which can be used in different experimental situations could be of great risk. For example GAPDH, a commonly used RG, is ranked in first position by GeNorm in CS experiments, together with GSA. However, in heat treatment, this gene appeared to be an unsuitable RG ranking only in ninth position by the same algorithm. GAPDH has been also reported by others as a suitable RG, for example in Chlamydomonas during freezing acclimation  and in coffee upon CS . However, it is not recommended for normalization of gene expression data in several studies involving temperature stress response and acclimatization performed in other plant species , , . Another example from our study is the H2A, which is in final rankings in CS. However, in contrast, this gene is identified as one of the most stable RGs in HS, using the three algorithms.
In addition to the differences encountered in the selection of the most stable genes between the two experimental conditions, we also found some slight differences amongst the distinct algorithms tested. For example, RBCL was ranked in the first position by BestKeeper and therefore considered a good candidate in CS. However, it showed high expression variability using both NormFinder and GeNorm, staying only in seventh and eighth positions, respectively. One example, in HS, is the case of SDR, which is ranked in fourth position by GeNorm, but ranked only in tenth position by both NormFinder and BestKeeper. Similarly, results from other authors also demonstrate the existence of minor differences among distinct algorithms , , , and that are most probably due to the differences in the statistical algorithms. Nevertheless, taking into account the existence of some differences between algorithms, and additionally to overcome different limitations of each algorithm studied here, the stability of candidate RGs was also determined based on the geometric mean of all three statistical algorithms. Indeed, depending on the software used, the ranking of candidate reference genes can be slightly different , , . Although many statistical approaches exist to determine both the stability of gene expression and to select the most appropriate RGs, to date, there is no consensus on which approach gives valid results. Thus, some authors consider the best approach is to combine the distinct algorithms for the selection of the most reliable reference genes in order to reduce the risk of artificial selection . In fact, the simultaneous use of more than one algorithm has been also noted by other authors ,  as producing highly correlated results and thus represents a good strategy for the selection of RGs for RT-qPCR normalization. In this study, the normalization strategy adopted to analyze the expression levels of the target genes to validate the RGs was based on the geometric mean of all three algorithms. Indeed, the software programs such as GeNorm, NormFinder and BestKeeper exist to determine the stability of the candidate RGs. However, the suitability of these genes should be evaluated with target genes associated with the experimental conditions in order to obtain reliable results . The target genes used here were the CHS, CAT1, AOX1 and AOX2, which encode for proteins, documented in the literature, as associated with plant stress responses and oxidative stress. From our study, AOX1 transcripts were revealed to be affected by both cold and heat stressful temperatures, presenting an up-regulation in both conditions. In recent years, transgenic plants overexpressing AOX1 genes have provided molecular evidence that AOX improves cold tolerance , . AOX was proposed, in a hypothesis-driven approach, as target to develop functional markers for general stress tolerance across species and stresses , . Extensive reports have shown that the expression of the AOX1 gene is highly responsive to environmental stress, such as CS and HS, whilst AOX2 members are generally not responsive, or are much less responsive (see reviews , ). Indeed, from our results, AOX2 showed high expression stability in heat-treated samples. However, in contrast, this gene showed differential expression, being down-regulated in cold-treated samples. Both AOX and CAT are two antioxidative enzymes already described as being highly involved in ROS detoxification . Our results demonstrate that despite a slight tendency for CAT1 transcript to be up-regulated (not statistically significant) in CS for the first time points, CAT1 mRNA is down-regulated both in CS and HS. Previous reports on the effects of stress on CAT activities vary depending on experiment and plant species or cultivars. Decreases in CAT activity have been reported upon HS in various plant species –, in contrast with other studies which reported increases in CAT activity –. An increase in the CAT activity has also been reported upon CS , –. Nevertheless, the majority of studies available have focused on protein content and activity, with very few studies analyzing the link between transcript accumulation and protein. Locato et al.  have reported that in Nicotiana tabacum there is a decrease in transcript accumulation upon HS starting at 4 h after HS exposition. These authors suggest that under those experimental conditions, the regulation of CAT occurs with a mechanism acting downstream gene expression. In the same way, Watanabe and co-workers  revealed that in Arabidopsis thaliana a decrease in CAT1 transcript level was detected 20 h after CS exposure. Mhamdi and co-workers  suggested that a transcriptional down-regulation of CAT could be important to induce or sustain increased H2O2 availability necessary for certain environmental responses or developmental processes. Our data are in agreement with these previous results, suggesting that the molecular mechanisms associated with temperature stress response involving differential expression of CAT mRNA encountered both in N. tabacum and in A. thaliana might be also found in H. perforatum. In contrast, previous studies from Skyba et al.  demonstrated, in H. perforatum, an increase in CAT transcript accumulation upon a low-temperature associated stressor, being the results genotype-dependent. The similar expression profile of CAT1 and AOX2 in CS, shown by our study, in which both are down-regulated, supports current knowledge of these proteins regarding their common involvement in ROS detoxification . Worth a notice, our results suggest an earlier involvement of AOX2 than CAT1 in this process, as shown by the AOX2 having the lowest mRNA expression at a time point earlier than CAT1.
We observed an increase in the CHS transcript accumulation upon CS. It is known that CHS can be induced in response to a diversity of biotic and abiotic stress factors, thus resulting in enhanced production of secondary metabolites (see review in ). Interestingly, we found a similar expression profile for CHS and AOX1 in CS, and even for HS, with the exception of the first time point (12 hpi) for which a marked reduction was observed for CHS, from this time point on, both genes are similarly up-regulated. These findings corroborate the results obtained by Fiorani and co-workers  who reported a relationship between AOX1a and CHS, demonstrating that, at low temperature, transgenic A. thaliana overexpressing AOX1a shows enhanced transcription of CHS, a key gene of the polyketide phenylpropanoids biosynthesis .
In summary, to the best of our know ledge, this is the first study in which a set of candidate reference genes are analyzed in terms of their expression stability, by three distinct mathematical algorithms, in order to be used in RT-qPCR data normalization with H. perforatum submitted to stressful temperature conditions. Our results demonstrate considerable differences in the gene expression stability between cold and heat stress treatments, highlighting the importance of performing a selection of the most suitable reference genes prior to the RT-qPCR studies for each experimental condition. Our data also show that the reference gene ranking obtained by GeNorm, NormFinder and BestKeeper were overall very similar and presenting only slight differences. The present study pointed to TUB as a suitable RG in RT-qPCR data normalization in temperature-treated H. perforatum plants. Additionally, GSA and GAPDH are recommended for data normalization in studies of cold treatment, whilst 26SrRNA and H2A are suggested for studies of heat treatment. The expression of the target genes CHS, CAT1, AOX1 and AOX2 were analyzed in order to emphasize the importance of validating the reference genes. They showed differential expression in both CS/HS experimental conditions, showing consistent results with what is known about the involvement of these genes in plant response to stressful temperatures, allowing the validation of the identified candidate reference genes.
Melting curves of the 11 candidate reference genes and 4 target genes tested in cold assays.
The authors are very grateful to Tânia Nobre for valuable suggestions, critical comments and careful proofreading of the manuscript. The authors especially thank Mary Albury (School of Biological Sciences, University of Sussex, UK) for great help in the English-language correction of the manuscript. We also thank to Amaia Nogales for helpful suggestions, Vera Valadas for the help in sample preparation and to Virginia Sobral for technical assistance. We also thank the reviewers for their valuable comments on the manuscript.
Conceived and designed the experiments: CR BA HC. Performed the experiments: IV CR. Analyzed the data: IV HC. Contributed reagents/materials/analysis tools: BA HC. Wrote the paper: IV HC.
- 1. Moreno-Risueno MA, Van Norman JM, Moreno A, Zhang J, Ahnert SE, et al. (2010) Oscillating gene expression determines competence for periodic Arabidopsis root branching. Science 329:1306–1311.
- 2. Yamaguchi H, Fukuoka H, Arao T, Ohyama A, Nunome T, et al. (2010) Gene expression analysis in cadmium-stressed roots of a low cadmium-accumulating solanaceous plant, Solanum torvum. J Exp Bot 61:423–437.
- 3. Wang D, Pan Y, Zhao X, Zhu L, Fu B, et al. (2011) Genome-wide temporal-spatial gene expression profiling of drought responsiveness in rice. BMC Genomics 12:149.
- 4. Dechorgnat J, Patrit O, Krapp A, Fagard M, Daniel-Vedele F (2012) Characterization of the Nrt2.6 gene in Arabidopsis thaliana: A link with plant response to biotic and abiotic stress. PLoS One 7.
- 5. Guénin S, Mauriat M, Pelloux J, Van Wuytswinkel O, Bellini C, et al. (2009) Normalization of qRT-PCR data: The necessity of adopting a systematic, experimental conditions-specific, validation of references. J Exp Bot 60:487–493.
- 6. Bustin SA (2010) Why the need for qPCR publication guidelines?-The case for MIQE. Methods 50:217–226.
- 7. Zenoni S, Ferrarini A, Giacomelli E, Xumerle L, Fasoli M, et al. (2010) Characterization of transcriptional complexity during berry development in Vitis vinifera using RNA-Seq. Plant Physiol 152:1787–1795.
- 8. Bhargava A, Clabaugh I, To JP, Maxwell BB, Chiang Y-H, et al. (2013) Identification of cytokinin-responsive genes using microarray meta-analysis and RNA-Seq in Arabidopsis. Plant Physiol 162:272–294.
- 9. Zhai R, Feng Y, Wang H, Zhan X, Shen X, et al. (2013) Transcriptome analysis of rice root heterosis by RNA-Seq. BMC Genomics 14:19.
- 10. Imai T, Ubi BE, Saito T, Moriguchi T (2014) Evaluation of Reference Genes for Accurate Normalization of Gene Expression for Real Time-Quantitative PCR in Pyrus pyrifolia Using Different Tissue Samples and Seasonal Conditions. PLoS One 9:e86492.
- 11. Andersen CL, Jensen JL, Ørntoft TF (2004) Normalization of real-time quantitative reverse transcription-PCR data: a model-based variance estimation approach to identify genes suited for normalization, applied to bladder and colon cancer data sets. Cancer Res 64:5245–5250 doi:10.1158/0008-5472.CAN-04-0496.
- 12. Yoo WG, Kim TI, Li S, Kwon OS, Cho PY, et al. (2009) Reference genes for quantitative analysis on Clonorchis sinensis gene expression by real-time PCR. Parasitol Res 104:321–328.
- 13. Demidenko N V, Logacheva MD, Penin AA (2011) Selection and validation of reference genes for quantitative real-time PCR in buckwheat (Fagopyrum esculentum) based on transcriptome sequence data. PLoS One 6.
- 14. Everaert BR, Boulet GA, Timmermans JP, Vrints CJ (2011) Importance of suitable reference gene selection for quantitative real-time PCR: Special reference to mouse myocardial infarction studies. PLoS One 6.
- 15. Hoenemann C, Hohe A (2001) Selection of reference genes for normalization of quantitative real-time PCR in cell cultures of Cyclamen persicum. Electron J Biotechnol 14. doi: 10.2225/vol14-issue1-fulltext-8..
- 16. Bustin SA (2002) Quantification of mRNA using real-time reverse transcription PCR (RT-PCR): trends and problems. J Mol Endocrinol 29:23–39 doi:10.1677/jme.0.0290023.
- 17. Derveaux S, Vandesompele J, Hellemans J (2010) How to do successful gene expression analysis using real-time PCR. Methods 50:227–230 doi:10.1016/j.ymeth.2009.11.001.
- 18. Gutierrez L, Mauriat M, Pelloux J, Bellini C, Van Wuytswinkel O (2008) Towards a systematic validation of references in real-time rt-PCR. Plant Cell 20:1734–1735.
- 19. Bustin SA, Benes V, Garson JA, Hellemans J, Huggett J, et al. (2009) The MIQE guidelines: minimum information for publication of quantitative real-time PCR experiments. Clin Chem 55:611–622.
- 20. Vandesompele J, De Preter K, Pattyn F, Poppe B, Van Roy N, et al. (2002) Accurate normalization of real-time quantitative RT-PCR data by geometric averaging of multiple internal control genes. Genome Biol 3:RESEARCH0034.
- 21. Pfaffl MW, Tichopad A, Prgomet C, Neuvians TP (2004) Determination of stable housekeeping genes, differentially regulated target genes and sample integrity: BestKeeper - Excel-based tool using pair-wise correlations. Biotechnol Lett 26:509–515.
- 22. Silver N, Best S, Jiang J, Thein SL (2006) Selection of housekeeping genes for gene expression studies in human reticulocytes using real-time PCR. BMC Mol Biol 7:33.
- 23. Hellemans J, Mortier G, De Paepe A, Speleman F, Vandesompele J (2007) qBase relative quantification framework and software for management and automated analysis of real-time quantitative PCR data. Genome Biol 8:R19.
- 24. Brunner AM, Yakovlev IA, Strauss SH (2004) Validating internal controls for quantitative plant gene expression studies. BMC Plant Biol 4:14.
- 25. Li Q, Fan C-M, Zhang X-M, Fu Y-F (2012) Validation of reference genes for real-time quantitative PCR normalization in soybean developmental and germinating seeds. Plant Cell Rep 31:1789–1798.
- 26. Ma S, Niu H, Liu C, Zhang J, Hou C, et al. (2013) Expression stabilities of candidate reference genes for RT-qPCR under different stress conditions in soybean. PLoS One 8:e75271.
- 27. Manoli A, Sturaro A, Trevisan S, Quaggiotti S, Nonis A (2012) Evaluation of candidate reference genes for qPCR in maize. J Plant Physiol 169:807–815.
- 28. Lin Y, Zhang C, Lan H, Gao S, Liu H, et al. (2014) Validation of Potential Reference Genes for qPCR in Maize across Abiotic Stresses, Hormone Treatments, and Tissue Types. PLoS One 9:e95445.
- 29. Maksup S, Supaibulwatana K, Selvaraj G (2013) High-quality reference genes for quantifying the transcriptional responses of Oryza sativa L. (ssp. indica and japonica) to abiotic stress conditions. Chinese Sci Bull 58:1919–1930.
- 30. Castro-Quezada P, Aarrouf J, Claverie M, Favery B, Mugniéry D, et al. (2013) Identification of Reference Genes for Normalizing RNA Expression in Potato Roots Infected with Cyst Nematodes. Plant Mol Biol Report 31:936–945.
- 31. Lopez-Pardo R, Ruiz de Galarreta JI, Ritter E (2013) Selection of housekeeping genes for qRT-PCR analysis in potato tubers under cold stress. Mol Breed 31:39–45.
- 32. Dekkers BJW, Willems L, Bassel GW, van Bolderen-Veldkamp RPM, Ligterink W, et al. (2012) Identification of reference genes for RT-qPCR expression analysis in Arabidopsis and tomato seeds. Plant Cell Physiol 53:28–37.
- 33. Yang H, Liu J, Huang S, Guo T, Deng L, et al. (2014) Selection and evaluation of novel reference genes for quantitative reverse transcription PCR (qRT-PCR) based on genome and transcriptome data in Brassica napus L. Gene 538:113–122.
- 34. Borowski JM, Galli V, da Silva Messias R, Perin EC, Buss JH, et al. (2014) Selection of candidate reference genes for real-time PCR studies in lettuce under abiotic stresses. Planta: 1–14.
- 35. Amil-Ruiz F, Garrido-Gala J, Blanco-Portales R, Folta KM, Muñoz-Blanco J, et al. (2013) Identification and validation of reference genes for transcript normalization in strawberry (Fragaria × ananassa) defense responses. PLoS One 8:e70603.
- 36. Kong Q, Yuan J, Gao L, Zhao S, Jiang W, et al. (2014) Identification of suitable reference genes for gene expression normalization in qRT-PCR analysis in watermelon. PLoS One 9:e90612.
- 37. Kong Q, Yuan J, Niu P, Xie J, Jiang W, et al. (2014) Screening Suitable Reference Genes for Normalization in Reverse Transcription Quantitative Real-Time PCR Analysis in Melon. PLoS One 9:e87197.
- 38. Wang L, Wang Y, Zhou P (2013) Validation of reference genes for quantitative real-time PCR during Chinese wolfberry fruit development. Plant Physiol Biochem 70:304–310.
- 39. Zeng S, Liu Y, Wu M, Liu X, Shen X, et al. (2014) Identification and validation of reference genes for quantitative real-time PCR normalization and its applications in lycium. PLoS One 9:e97039.
- 40. Goulao LF, Fortunato AS, C. Ramalho J (2011) Selection of Reference Genes for Normalizing Quantitative Real-Time PCR Gene Expression Data with Multiple Variables in Coffea spp. Plant Mol Biol Report 30:741–759.
- 41. Figueiredo A, Loureiro A, Batista D, Monteiro F, Várzea V, et al. (2013) Validation of reference genes for normalization of qPCR gene expression data from Coffea spp. hypocotyls inoculated with Colletotrichum kahawae. BMC Res Notes 6:388.
- 42. Monteiro F, Sebastiana M, Pais MS, Figueiredo A (2013) Reference gene selection and validation for the early responses to downy mildew infection in susceptible and resistant Vitis vinifera cultivars. PLoS One 8:e72998.
- 43. Yan J, Yuan F, Long G, Qin L, Deng Z (2012) Selection of reference genes for quantitative real-time RT-PCR analysis in citrus. Mol Biol Rep 39:1831–1838.
- 44. Podevin N, Krauss A, Henry I, Swennen R, Remy S (2012) Selection and validation of reference genes for quantitative RT-PCR expression studies of the non-model crop Musa. Mol Breed 30:1237–1252.
- 45. Zhu X, Li X, Chen W, Chen J, Lu W, et al. (2012) Evaluation of new reference genes in papaya for accurate transcript normalization under different experimental conditions. PLoS One 7:e44405.
- 46. Luo X, Shi T, Sun H, Song J, Ni Z, et al. (2014) Selection of suitable inner reference genes for normalisation of microRNA expression response to abiotic stresses by RT-qPCR in leaves, flowers and young stems of peach. Sci Hortic (Amsterdam) 165:281–287.
- 47. Xia W, Liu Z, Yang Y, Xiao Y, Mason AS, et al. (2014) Selection of reference genes for quantitative real-time PCR in Cocos nucifera during abiotic stress. Botany 92:179–186.
- 48. He M, Wang Y, Hua W, Zhang Y, Wang Z (2012) De novo sequencing of Hypericum perforatum transcriptome to identify potential genes involved in the biosynthesis of active metabolites. PLoS One 7:e42081.
- 49. Skyba M, Petijová L, Kosuth J, Koleva DP, Ganeva TG, et al. (2012) Oxidative stress and antioxidant response in Hypericum perforatum L. plants subjected to low temperature treatment. J Plant Physiol 169:955–964.
- 50. Košuth J, Hrehorová D, Jaskolski M, Čellárová E (2013) Stress-induced expression and structure of the putative gene hyp-1 for hypericin biosynthesis. Plant Cell, Tissue Organ Cult 114:207–216.
- 51. Butterweck V (2003) Mechanism of action of St John's wort in depression: what is known? CNS Drugs 17:539–562.
- 52. Birt DF, Widrlechner MP, Hammer KDP, Hillwig ML, Wei J, et al. (2009) Hypericum in infection: Identification of anti-viral and anti- inflammatory constituents. Pharm Biol 47:774–782 doi:10.1080/13880200902988645.Hypericum.
- 53. Caraci F, Crupi R, Drago F, Spina E (2011) Metabolic drug interactions between antidepressants and anticancer drugs: focus on selective serotonin reuptake inhibitors and hypericum extract. Curr Drug Metab 12:570–577.
- 54. Sirvent TM, Krasnoff SB, Gibson DM (2003) Induction of hypericins and hyperforins in Hypericum perforatum in response to damage by herbivores. J Chem Ecol 29:2667–2681.
- 55. Gadzovska S, Maury S, Delaunay A, Spasenoski M, Hagège D, et al. (2013) The influence of salicylic acid elicitation of shoots, callus, and cell suspension cultures on production of naphtodianthrones and phenylpropanoids in Hypericum perforatum L. Plant Cell, Tissue Organ Cult 113:25–39.
- 56. Umbach AL, Gonzalez-Meler MA, Sweet CR, Siedow JN (2002) Activation of the plant mitochondrial alternative oxidase: insights from site-directed mutagenesis. Biochim Biophys Acta 1554:118–128.
- 57. Popov V, Simonian R, Skulachev V, Starkov A. (1997) Inhibition of the alternative oxidase stimulates H2O2 production in plant mitochondria. FEBS Lett 415:87–90.
- 58. Amirsadeghi S, Robson C a, Vanlerberghe GC (2007) The role of the mitochondrion in plant responses to biotic stress. Physiol Plant 129:253–266.
- 59. Costa JH, McDonald AE, Arnholdt-Schmitt B, Fernandes de Melo D (2014) A classification scheme for alternative oxidases reveals the taxonomic distribution and evolutionary history of the enzyme in angiosperms. Mitochondrion: 1–12.
- 60. McClung CR (1997) Regulation of catalases in Arabidopsis. Free Radic Biol Med 23:489–496.
- 61. Møller IM, Jensen PE, Hansson A (2007) Oxidative modifications to cellular components in plants. Annu Rev Plant Biol 58:459–481.
- 62. Mhamdi A, Queval G, Chaouch S, Vanderauwera S, Van Breusegem F, et al. (2010) Catalase function in plants: A focus on Arabidopsis mutants as stress-mimic models. J Exp Bot 61:4197–4220.
- 63. Dao TTH, Linthorst HJM, Verpoorte R (2011) Chalcone synthase and its functions in plant resistance. Phytochem Rev 10:397–412.
- 64. Ferreira AO, Cardoso HG, Macedo ES, Breviario D, Arnholdt-Schmitt B (2009) Intron polymorphism pattern in AOX1b of wild St John's wort (Hypericum perforatum) allows discrimination between individual plants. Physiol Plant 137:520–531.
- 65. Murashige T, Skoog F (1962) A Revised Medium for Rapid Growth and Bio Assays with Tobacco Tissue Cultures. Physiol Plant 15:473–497.
- 66. Expósito-Rodríguez M, Borges AA, Borges-Pérez A, Pérez JA (2008) Selection of internal control genes for quantitative real-time RT-PCR studies during tomato development process. BMC Plant Biol 8:131.
- 67. Paolacci AR, Tanzarella OA, Porceddu E, Ciaffi M (2009) Identification and validation of reference genes for quantitative RT-PCR normalization in wheat. BMC Mol Biol 10:11.
- 68. Yeap W-C, Loo JM, Wong YC, Kulaveerasingam H (2013) Evaluation of suitable reference genes for qRT-PCR gene expression normalization in reproductive, vegetative tissues and during fruit development in oil palm. Plant Cell, Tissue Organ Cult 116:55–66.
- 69. Sugie A, Naydenov N, Mizuno N, Nakamura C, Takumi S (2006) Overexpression of wheat alternative oxidase gene Waox1a alters respiration capacity and response to reactive oxygen species under low temperature in transgenic Arabidopsis. Genes Genet Syst 81:349–354.
- 70. Cansev A, Gulen H, Eris A (2011) The activities of catalase and ascorbate peroxidase in olive (Olea europaea L. cv. Gemlik) under low temperature stress. Hortic Environ Biotechnol 52:113–120.
- 71. Li CR, Liang DD, Xu RF, Li H, Zhang YP, et al. (2013) Overexpression of an alternative oxidase gene, OsAOX1a, improves cold tolerance in Oryza sativa L. Genet Mol Res. 12:5424–5432.
- 72. Ma NL, Rahmat Z, Lam SS (2013) A Review of the “Omics” Approach to Biomarkers of Oxidative Stress in Oryza sativa. Int J Mol Sci 14:7515–7541.
- 73. Hruz T, Wyss M, Docquier M, Pfaffl MW, Masanetz S, et al. (2011) RefGenes: identification of reliable and condition specific reference genes for RT-qPCR data normalization. BMC Genomics 12:156.
- 74. Zhu J, Zhang L, Li W, Han S, Yang W, et al. (2013) Reference gene selection for quantitative real-time PCR normalization in Caragana intermedia under different abiotic stress conditions. PLoS One 8:e53196.
- 75. Liu M, Jiang J, Han X, Qiao G, Zhuo R (2014) Validation of reference genes aiming accurate normalization of qRT-PCR data in Dendrocalamus latiflorus Munro. PLoS One 9.
- 76. Liu C, Wu G, Huang X, Liu S, Cong B (2012) Validation of housekeeping genes for gene expression studies in an ice alga Chlamydomonas during freezing acclimation. Extremophiles 16:419–425.
- 77. Løvdal T, Lillo C (2009) Reference gene selection for quantitative real-time PCR normalization in tomato subjected to nitrogen, cold, and light stress. Anal Biochem 387:238–242.
- 78. Qi J, Yu S, Zhang F, Shen X, Zhao X, et al. (2010) Reference Gene Selection for Real-Time Quantitative Polymerase Chain Reaction of mRNA Transcript Levels in Chinese Cabbage (Brassica rapa L. ssp. pekinensis). Plant Mol Biol Report 28:597–604.
- 79. Rivera-Vega L, Mamidala P, Koch JL, Mason ME, Mittapalli O (2012) Evaluation of Reference Genes for Expression Studies in Ash (Fraxinus spp.). Plant Mol Biol Report 30:242–245.
- 80. Ayers D, Clements DN, Salway F, Day PJR (2007) Expression stability of commonly used reference genes in canine articular connective tissues. BMC Vet Res 3:7.
- 81. Reid KE, Olsson N, Schlosser J, Peng F, Lund ST (2006) An optimized grapevine RNA isolation procedure and statistical determination of reference genes for real-time RT-PCR during berry development. BMC Plant Biol 6:27.
- 82. Arnholdt-Schmitt B, Costa JH, De Melo DF (2006) AOX–a functional marker for efficient cell reprogramming under stress? Trends Plant Sci 11:281–287.
- 83. Cardoso HG, Arnholdt-Schmitt A (2013) Functional Marker Development Across species in Selected Traits. In: Lübberstedt T, Varshney RK, editors. Diagnostics in Plant Breeding.Dordrecht: Springer Netherlands. pp.467–515.
- 84. Feng H, Guan D, Sun K, Wang Y, Zhang T, et al. (2013) Expression and signal regulation of the alternative oxidase genes under abiotic stresses. Acta Biochim Biophys Sin (Shanghai). doi: 10.1093/abbs/gmt094.
- 85. Vanlerberghe GC (2013) Alternative Oxidase: A Mitochondrial Respiratory Pathway to Maintain Metabolic and Signaling Homeostasis during Abiotic and Biotic Stress in Plants. Int J Mol Sci 14:6805–6847.
- 86. Møller IM (2001) P LANT M ITOCHONDRIA AND O XIDATIVE S TRESS: Electron Transport, NADPH Turnover, and Metabolism of Reactive Oxygen Species.
- 87. Foyer CH, LopezDelgado H, Dat JF, Scott IM (1997) Hydrogen peroxide- and glutathione-associated mechanisms of acclimatory stress tolerance and signalling. Physiol Plant 100:241–254.
- 88. Dat J, Lopez-Delgado H, Foyer C, Scott I (1998) Parallel changes in H2O2 and catalase during thermotolerance induced by salicylic acid or heat acclimation in mustard seedlings. Plant Physiol 116:1351–1357.
- 89. Sato Y (2001) Heat shock-mediated APX gene expression and protection against chilling injury in rice seedlings. J Exp Bot 52:145–151.
- 90. Jiang Y (2001) Effects of calcium on antioxidant activities and water relations associated with heat tolerance in two cool-season grasses. J Exp Bot 52:341–349.
- 91. Sairam RK, Srivastava GC, Saxena DC (2000) Increased Antioxidant Activity under Elevated Temperatures: A Mechanism of Heat Stress Tolerance in Wheat Genotypes. Biol Plant 43:245–251.
- 92. Chaitanya K V, Sundar D, Masilamani S, Ramachandra Reddy A (2002) Variation in heat stress-induced antioxidant enzyme activities among three mulberry cultivars. Plant Growth Regul 36:175–180.
- 93. Orendi G, Zimmermann P, Baar C, Zentgraf U (2001) Loss of stress-induced expression of catalase3 during leaf senescence in Arabidopsis thaliana is restricted to oxidative stress. Plant Sci 161:301–314.
- 94. He Y, Liu Y, Cao W, Huai M, Xu B, et al. (2005) Effects of Salicylic Acid on Heat Tolerance Associated with Antioxidant Metabolism in Kentucky Bluegrass. Crop Sci 45:988–995 doi:10.2135/cropsci2003.0678.
- 95. He Y, Huang B (2010) Differential Responses to Heat Stress in Activities and Isozymes of Four Antioxidant Enzymes for Two Cultivars of Kentucky Bluegrass Contrasting in Heat Tolerance. J Amer Soc Hort Sci 135:116–124.
- 96. Almeselmani M, Deshmukh PS, Sairam RK, Kushwaha SR, Singh TP (2006) Protective role of antioxidant enzymes under high temperature stress. Plant Sci 171:382–388.
- 97. Locato V, Gadaleta C, De Gara L, De Pinto MC (2008) Production of reactive species and modulation of antioxidant network in response to heat shock: a critical balance for cell fate. Plant Cell Environ 31:1606–1619.
- 98. Kumar RR, Goswami S, Sharma SK, Singh K, Gadpayle KA, et al. (2012) Protection against heat stress in wheat involves change in cell membrane stability, antioxidant enzymes, osmolyte, H2O2 and transcript of heat shock protein. Int J Plant Physiol Biochem 4:83–91.
- 99. Matsumura T, Tabayashi N, Kamagata Y, Souma C, Saruyama H (2002) Wheat catalase expressed in transgenic rice can improve tolerance against low temperature stress. Physiol Plant 116:317–327.
- 100. Kuk YI, Shin JS, Burgos NR, Hwang TE, Han O, et al. (2003) Antioxidative Enzymes Offer Protection from Chilling Damage in Rice Plants. Crop Sci 43:2109–2117.
- 101. Chen Y, Zhang M, Chen T, Zhang Y, An L (2006) The relationship between seasonal changes in anti-oxidative system and freezing tolerance in the leaves of evergreen woody plants of Sabina. South African J Bot 72:272–279.
- 102. Cansev A, Gulen H, Eris A (2011) The activities of catalase and ascorbate peroxidase in olive (Olea europaea L. cv. Gemlik) under low temperature stress. Hortic Environ Biotechnol 52:113–120.
- 103. Gong X-Q, Hu J-B, Liu J-H (2014) Cloning and characterization of FcWRKY40, A WRKY transcription factor from Fortunella crassifolia linked to oxidative stress tolerance. Plant Cell, Tissue Organ Cult: 1–14.
- 104. Watanabe CK, Hachiya T, Terashima I, Noguchi K (2008) The lack of alternative oxidase at low temperature leads to a disruption of the balance in carbon and nitrogen metabolism, and to an up-regulation of antioxidant defence systems in Arabidopsis thaliana leaves. Plant Cell Environ 31:1190–1202.
- 105. Mhamdi A, Noctor G, Baker A (2012) Plant catalases: peroxisomal redox guardians. Arch Biochem Biophys 525:181–194.
- 106. Fiorani F, Umbach AL, Siedow JN (2005) The Alternative Oxidase of Plant Mitochondria Is Involved in the Acclimation of Shoot Growth at Low Temperature. A Study of Arabidopsis AOX1a Transgenic Plants. Plant Physiol 139:1795–1805.