Gene expression profiling of peripheral blood mononuclear cells (PBMCs) is a powerful tool for the identification of surrogate markers involved in disease processes. The hypothesis tested in this study was that chronic exposure of PBMCs to a hypertensive environment in remodeled pulmonary vessels would be reflected by specific transcriptional changes in these cells.
The transcript profiles of PBMCs from 30 idiopathic pulmonary arterial hypertension patients (IPAH), 19 patients with systemic sclerosis without pulmonary hypertension (SSc), 42 scleroderma-associated pulmonary arterial hypertensio patients (SSc-PAH), and 8 patients with SSc complicated by interstitial lung disease and pulmonary hypertension (SSc-PH-ILD) were compared to the gene expression profiles of PBMCs from 41 healthy individuals. Multiple gene expression signatures were identified which could distinguish various disease groups from controls. One of these signatures, specific for erythrocyte maturation, is enriched specifically in patients with PH. This association was validated in multiple published datasets. The erythropoiesis signature was strongly correlated with hemodynamic measures of increasing disease severity in IPAH patients. No significant correlation of the same type was noted for SSc-PAH patients, this despite a clear signature enrichment within this group overall. These findings suggest an association of the erythropoiesis signature in PBMCs from patients with PH with a variable presentation among different subtypes of disease.
In PH, the expansion of immature red blood cell precursors may constitute a response to the increasingly hypoxic conditions prevalent in this syndrome. A correlation of this erythrocyte signature with more severe hypertension cases may provide an important biomarker of disease progression.
Citation: Cheadle C, Berger AE, Mathai SC, Grigoryev DN, Watkins TN, Sugawara Y, et al. (2012) Erythroid-Specific Transcriptional Changes in PBMCs from Pulmonary Hypertension Patients. PLoS ONE 7(4): e34951. https://doi.org/10.1371/journal.pone.0034951
Editor: Lisa Ng Fong Poh, Agency for Science, Technology and Research – Singapore Immunology Network, Singapore
Received: November 1, 2011; Accepted: March 8, 2012; Published: April 24, 2012
Copyright: © 2012 Cheadle et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: Supported by NHLBI P50 Grant HL084946 (Specialized Center for Clinically- Oriented Research, to P.M.H.). Supported in part by the Mary Beryl Patch Turnbull Scholar Program (to K.C.B.). The Scleroderma Research Foundation has provided support for the Johns Hopkins Scleroderma Center. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Pulmonary arterial hypertension (PAH) is a vascular disease that carries significant morbidity and mortality , , . Morbidity and mortality rates vary and depend on the age, the degree of pulmonary hypertension, and the response to vasodilator therapy. Death as a result of both acute and chronic right heart failure may occur. PAH is currently characterized by uncontrolled cell proliferation and inflammation involving the pulmonary vascular resistive vessels, leading to a progressive increase in pulmonary vascular resistance, right ventricle hypertrophy, and eventual heart failure.
PAH can complicate connective tissue diseases such as scleroderma ,  as well as other autoimmune diseases such as systemic lupus erythematosus and rheumatoid arthritis , . Scleroderma, or systemic sclerosis (SSc), is a chronic multisystem autoimmune disease characterized by a vasculopathy, diffuse fibrosis of skin and various internal organs, and immune abnormalities. Up to 10–15% of SSc patients eventually develop PAH . While the factors which lead a subset of SSc patients to go on to develop PAH are unclear, it is of great clinical interest to develop early markers of SSc-associated PAH (SSc-PAH) disease in order to provide more aggressive treatment to the “at risk” patient population. The early phase of the disease process has been difficult to study rigorously because of the delay in the diagnosis of SSc-PAH and the lack of reliable biomarkers for early disease. Lung biopsy is avoided since it is invasive and unsafe in these patients. For this reason we chose to use gene expression profiling of peripheral blood mononuclear cells (PBMCs) as a surrogate tissue which is readily obtainable from patients and provides a large pool of gene transcripts shown to have the potential to be highly sensitive to the disease microenvironments on a systems wide basis , . Previous studies using PBMCs have demonstrated an ability to discriminate between PAH, in general, and healthy controls, identify PAH-specific genes , as well as distinguish between IPAH and SSc-PAH gene signatures . However, more recent studies have shown considerable heterogeneity when examining directly the contrast in gene expression profiles in PBMCs from SSc-PAH and SSc patients , , . For example, while Pendergrass et al.  focused on the increased expression of 9 genes that distinguished SSc-PAH from SSc, Risbano et al.  describe 5 genes which when down-regulated distinguish SSc-PAH from SSc patients. We hypothesized that chronic exposure of PBMCs to elevated pulmonary pressures in remodeled pulmonary vessels will be reflected by specific transcriptional changes in these cells and distinguish PH of various etiologies from both SSc and normal controls.
The transcript profiles of PBMCs from 42 SSc associated PAH (SSc-PAH) patients, 30 IPAH patients, 19 patients with SSc, and 8 patients with SSc complicated by interstitial lung disease and PH (SSc-PH-ILD) were compared to the transcript profiles of PBMCs from 41 healthy individuals (see Table 1 for a summary of demographic and clinical patient descriptions, see Table S3 for all relevant clinical data and descriptions, on a patient-by-patient basis). In our initial data analysis we compared the gene expression for each disease group versus that of the controls (as described in Methods) and found large numbers of significantly regulated genes between patients and controls (Figure 1). Among the 89 genes significantly up-regulated in common among IPAH and SSc with or without accompanying PH were components of the Toll-like receptor (TLR) signaling pathway including the STAT1, TLR7, and TLR8 genes. An expanded search of all genes in the TLR signaling pathway revealed a broad general trend (Figure 2A) of up-regulation of these genes in each disease group (ttest p-values of the average expression of these pathway genes by group versus controls were p = 0.04 for IPAH, p = 0.0006 for SSc-PAH, and p = 0.004 for SSc, SSc-PH-ILD was not significant at p = 0.09) altogether suggesting a chronic activation of the innate immune system in these patients. Scleroderma patients with or without PAH demonstrated a pattern of 30 distinct immune response genes (DAVID [NIH Database for Annotation, Visualization, and Integrated Discovery]: defense response; p<7×10−4) up-regulated in common including CXCL10, FCGR1A, HCK, MX2, NCF1C, PARP4, and TLR4 (see Table S1 for all cited genes, enrichment results, and complete group comparison results).
A) up-regulated and B) down-regulated gene expression for comparisons between SSc, SSc-PAH, and IPAH patients versus healthy controls. Total number of calculated differentially expressed genes for each comparison are as indicated below each diagram.
A) TLR (Toll-like Receptor) Signaling, B) TCR (T cell receptor) Pathway, Ca2+/NFAT Signaling. Red indicates increase and green indicates decrease in relative gene expression for each gene calculated individually across all samples.
Interestingly, PH patients (IPAH and SSc-PAH) shared a large number of distinct genes (118) (Figure 1A) that were significantly up-regulated in these PH groups but not in SSc including a total of seven genes CA2, HBA2, HBD, HBG1, HBG2, HBM, HBQ1 shown to be highly enriched for blood gas transport (DAVID: gas transport: p<7×10−10). This same group of 118 genes also contained a sub-group of genes involved in platelet biology (DAVID: platelet alpha granule: p<1×−6), a finding seen as well using MsigDB (Broad Institute Molecular Signatures Data Base) (platelet specific genes: p<1.6×−12).
The 136 genes down-regulated for all disease groups relative to healthy controls were significantly enriched for apoptosis (DAVID: apoptosis: p<1.4×−4), a trend that extended to the additional 170 down-regulated genes in common between SSc-PAH and IPAH (DAVID: regulation of apoptosis: p<3.0×−6). Further examination of down-regulated changes in gene expression individually in each condition using the methods of gene set analysis (webPAGE ) revealed a common trend of down-regulation of multiple pathways involved in T cell function (Table 2). Examination of several of these pathways in detail (Figure 2B) demonstrated a clear pattern of down-regulation of genes in these pathways across all patient groups relative to controls.
Unsupervised clustering of 296 genes (chosen from a pool of the 500 most variable genes and which displayed distinct clustering patterns) across all samples shows a clear trend of multiple clusters of correlated gene expression (Figure 3). Many of these clusters overlap the groups noted above. For example, in the first cluster, Immune Response genes down-regulated (IR-DR), 56 of the 58 genes depicted in this cluster are members of the group of the statistically down-regulated genes shared by all three major disease groups (IPAH, SSc-PAH, and SSc). Conversely, over half of the genes (41/81) in the Immune Response genes up-regulated (IR-UR) cluster are members of the group of the statistically up-regulated genes shared by all three major disease groups (IPAH, SSc-PAH, and SSc). Additional clusters included a gene expression signature originally identified in neutrophils  and found as an immature neutrophil signature (INS) in the PBMC fraction of blood from both vasculitis related to Wegener's granulomatosis  and systemic lupus erythematosus  patients relative to healthy controls, presumably as part of an aggravated chronic immune response. In this study the INS signature, when present, appears to be distributed nonspecifically among all samples. Although these three signatures (IR-UR, IR-DR, and INS) were clearly identified and annotated they were of less interest to this study either because of their general non-specificity (INS) or because of their inability to distinguish among separate disease groups (IR-UR, IR-DR). Two other signatures, however, both of which had been identified by functional annotation during our initial analysis (the gas transport and platelet specific genes), were represented by clusters shown here also to be related. The average expression levels for the Illumina probes in these two distinct groups have a Pearson correlation r = 0.6 across all subjects (see Table S2 for a complete listing of the genes in these two clusters). A distinctive feature of the gene expression of these two signatures (Erythroid Differentiation Signature – EDS; and Platelet derived – Pl) is that they are specific primarily to disease groups of patients with PH studied in this cohort (IPAH, SSc-PAH, SSc-PH-ILD).
These patterns included an Immune Response signature (up- or down-regulated between controls and disease: IR-UR and IR-DR, respectively), the Erythroid Differentiation Signature (EDS) a Platelet specific signature (Pl), and an Immature Neutrophil Signature (INS). The gender specific cluster acts as a positive control, the specific signatures are discussed in detail in the text, particularly that of the EDS.
In order to further characterize disease specific gene expression, all patient and control samples (see Methods) were directly evaluated by the methods of gene set analysis using gene lists derived from the Mouse Genome Informatics (MGI) database . The file used for mouse phenotypic information contains 5011 distinct genes and 5142 phenotypic terms derived from information from specific gene mutations in multiple mouse strains, including an extensive library of specific gene knock-in and knock-out strains. In this analysis, patterns of gene expression among the PH, control and SSc groups were visualized across the entirety of the dataset by displaying the average gene expression for every mouse gene set for each human sample (Figure 4A). Patterns of disease specific gene set expression were detected which mapped to mouse gene lists involved in multiple phenotypes of blood disorders (Figure 4A, as indicated by arrows in the right panel). A summary of the differential expression p-value scores for these six blood disorder pathways when the individual disease groups were compared to controls shows a marked elevation of gene expression in the SSc-PH-ILD, IPAH, and SSc-PAH groups but not for SSc patients (Figure 4B). In particular, the contrast between SSc-PAH and SSc patients is striking.
A) Gene set enrichment scores were calculated by the PAGE method using row normalized data for all (filtered) genes and samples. The scores were averaged by group and are normalized in the sense that that the average gene expression as scored by PAGE for any one gene set is expressed as the z transformation ((gene set size adjusted) of the average gene expression for that set. Disease specific patterns of gene set enrichment are as shown in the zoomed image. B) Average gene set expression in disease groups versus controls for various blood disorder-specific gene sets (as indicated by arrows in Fig. 4A) were tested by Students t test, the results being reported as the negative log (base 10) of the derived p-value (− log(p)).
The combination of elevated hemoglobin gene expression in patients with PH and the preliminary evidence that many differentially regulated genes in these disease groups mapped by gene set analysis to mouse blood disorder phenotypes suggested that human PH patients may be distinguished from healthy controls and SSc patients by a programmatic shift in gene expression in PBMCs, perhaps related to conditions of tissue hypoxia such as induced by PH. In order to further explore the functional implications of these regulated gene groups, a comprehensive list of genes was derived for the EDS and for the Pl groups by selecting all microarray probes in the complete dataset whose expression levels have a Pearson Correlation ≥0.7 with the average expression for the probes in each cluster (EDS; 42 Illumina probes, 40 unique genes, and Pl; 60 probes, 54 unique genes) as initially shown in Figure 3, across all the samples. This resulted in the identification of 169 Illumina probes representing 149 unique genes for the EDS, and 456 probes covering 384 unique genes for the Pl signatures, respectively (Table S2). These are the sets of probes and genes used for further analysis of these signatures.
Tissue specificity of the EDS
The full gene list for the EDS signature (149 unique genes) was next tested against the Gene Expression Barcode, a web-based tool  which allows for highly accurate estimates of tissue specific gene expression. Inspection of the EDS gene expression across a catalog of over 130 curated human tissue types derived from the GEO (Gene Expression Omnibus) and the ArrayExpress public repositories demonstrated that the expression of EDS genes as a group is highly restricted to a few distinctive cell types (Figure 5) of the hematopoietic lineage including a very high level of enrichment in reticulocytes and in bone marrow. Reticulocytes from cord blood were particularly enriched relative to reticulocytes from circulation. It is interesting to note in this context that cord blood has been well characterized as having a less mature reticulocyte population than adult blood .
The heat map is derived from individual barcode scores from zero (black) to one (red) with red indicating an increased likelihood that the gene is present in all samples in the experiment from which the tissue specific expression estimate is derived (see McCall et al. for complete description of the barcode algorithm ). As shown, the genes for the EDS signature were overrepresented for three tissues, in particular (cord blood reticulocytes, adult blood reticulocytes, and bone marrow), and their respective number of barcode expression calls are as indicated in the barchart directly below the corresponding areas of the barcode heatmap.
Inspection of the EDS specific gene list showed markedly increased levels of expression for two genes in particular, ALAS2 (aminolevulinate, delta-, synthase2) (Illumina Probe ID [ILMN 2367126]) and ERAF (erythroid differentiation associated factor; recently renamed to AHSP [alpha hemoglobin stabilizing protein]) (Illumina Probe ID [ILMN 1696512]), (Figure 6 A&B) both essential for the terminal differentiation of erythroid cells . The specific overexpression of ALAS2 and ERAF in hypertension samples was confirmed by RT-PCR (Figure 6C). The expression levels of these two genes track so well with the EDS gene expression signature overall (Pearson's correlation coefficient of r = 0.92 for ERAF and r = 0.95 for ALAS2 versus the average EDS gene expression across all samples) that we are using them as single gene candidate biomarkers to track EDS-specific gene expression elevation in patients currently enrolled in ongoing longitudinal studies. The tissue specific expression of both of these genes is restricted, primarily to fetal liver, bone marrow (in adults), and most abundantly in CD71+ early erythroid cells in the circulation (BioGPS http://biogps.gnf.org). We note that hemoglobin production in erythroid cells is one of the most important stages in their terminal differentiation , the induction of ALAS2 is essential for hemoglobin production  and ERAF/AHSP is essential for proper assembly of nascent alpha globin incorporation into hemoglobin-A . In addition, conditions of hypoxia have been shown to directly result in elevated levels of ALAS2 in a human model of erythroid terminal differentiation .
A) ALAS2 and B) ERAF/AHSP genes in hypertension groups (SSc-PH-ILD, IPAH, and SSc-PAH) versus healthy controls and scleroderma (SSc). The box plots give the mean (horizontal black line), sample values (short blue lines), and 84% confidence interval (CI) (red lines) for each group, (non-overlap of the 84% CIs of two groups is an approximate indicator of significant difference between their means at the 0.05 level of significance). C) Individual ALAS2 and ERAF gene expression microarray results were validated by RT-PCR for high and low EDS patients across all hypertension classes (SSc-PAH, IPAH, SSc-PH-ILD).
Further inspection of the EDS gene list also showed the inclusion of genes for both the GATA1 and KLF transcription factors which are both essential for erythroid development [28,29]. A test by gene set analysis of the entire dataset comparing each PH group directly versus the SSc group as the baseline group showed a significant and specific enrichment among genes which contain three different GATA transcription factor binding sites in their upstream promoter regions (TRANSFAC ) (Figure 7A). Interestingly, the genes up-regulated in each of the GATA transcription factor binding site gene sets were mostly non-overlapping either with each other (an average of 59–62% unique genes for each gene list) or with the EDS gene expression signature itself (95% unique non-overlapping genes) (Figure 7B) indicating that the effects of elevated GATA1 gene expression are both pervasive in the PH groups and are supplemental to the EDS gene expression signature itself. The observation that downstream regulatory events are related directly to EDS elevation (through the up-regulation of the GATA1 transcription factor gene) and are associated with PH groups, taken together with the previously demonstrated strong association of the EDS with reticulocyte maturation (Figure 5), led us to the identification of this signature as the Erythroid Development Signature (EDS).
A). The average changes in gene expression for patients with SSc-PH-ILD, IPAH, and SSc-PAH were tested versus patients with SSc. The p-values associated with the gene set enrichment scores are reported here as −log(p). B). Venn diagram illustrating overlap between the average up-regulated gene expression associated with the presence of 3 distinct GATA transcription factor binding sites. The EDS gene signature is included for comparison.
External Validation of the Association of the EDS with Pulmonary Hypertension
In order to examine the extent of EDS association with PH, in general, beyond this current study, a survey was carried out of other published PH microarray studies (with and without SSc) in which PBMCs were the target tissue and for which full datasets were available through GEO (NCBI – Gene Expression Omnibus) . A total of four datasets were identified, three of them recently published (in 2010), each of which contained at least one phenotype for PH (Table 3). Two of these datasets also included phenotypes for SSc both with and without accompanying PH (Risbano et al.  and Pendergrass et al. ). Each dataset was queried using the methods of gene set analysis using the EDS gene expression signature gene list embedded in a background of over 550 pathway gene lists derived from multiple sources. The strongest overall enrichment scores for the EDS were, not surprisingly, generated from the PH phenotypes of our own study (JHU; SSc-PH-ILD-33.3, IPAH-21.1, and SSc-PAH-17.9). The slightly positive enrichment score for the JHU SSc group reflects several patients who are EDS positive (and who may be progressing towards PH).
In every external study examined, the PH phenotypes were significantly enriched for the EDS signature relative to controls and other non-PH phenotypes. In many cases the EDS gene list was the top scorer above all other pathways and signatures. In Risbano et al.  IPAH and SSc-PAH had scores of 26 and 7.6, respectively, while the SSc phenotype showed a strong negative enrichment of -15.5. An explanation for this anomaly can be seen by a sample by sample analysis using the gene expression of both ALAS2 and ERAF/AHSP as surrogate EDS biomarkers (Figure S1). In the Risbano et al. study , for reasons unclear, the EDS is suppressed in SSc patients relative to controls, while both the IPAH and the SSc-PAH groups contain patients with elevated biomarker levels relative to either controls or SSc groups. Conversely, in Pendergrass et al , patients with a diagnosis of SSc-PAH are clearly enriched for the EDS (PAGE enrichment score = 15) but so also, albeit to a lesser degree, are patients diagnosed with SSc (PAGE enrichment score = 9.25). A possible explanation for this, once again, becomes clear upon the examination of gene expression sample by sample (Figure S1). In the Pendergrass data at least three patients scored as SSc have a high EDS score perhaps indicating, as within our own cohort, a further, as yet undetected, progression to the PH state. In datasets examining only PH (Bull et al.  and Rajkumar et al.  there is a clear and unambiguous enrichment (Table 3. Bull et al.; IPAH-7.7 and Rajkumar et al.; PAH-4.1, respectively) in their PH groups relative to controls. In the Rajkumar data, patients with idiopathic pulmonary fibrosis (IPF), a lung disease group not associated with PH did not display the EDS.
Interestingly, the platelet specific signature (Pl), while distinct in terms of gene content from the EDS (less than 5% gene overlap), was present in some patients with high EDS (Figure 3, Table S2), but did not show as much specificity for hypertension in our study or others (Figure S2) and for this reason was not pursued further. An additional data set was also evaluated which compared the gene expression between reticulocytes from cord blood and in the circulation . The EDS was highly over-expressed in cord blood reticulocytes relative to peripheral blood supporting previous observations characterizing the presence of a less mature reticulocyte population in cord blood ,  and supporting the identification of the EDS with reticulocyte development.
Correlation of the EDS with Hemodynamic Measurements
It should be noted that despite the strong association of the EDS signature with the PH phenotype in our data and in others, only a subset of the patients in each group actually display elevated EDS levels. In order to better understand the association of EDS positive patients with disease progression, EDS gene expression regulation was examined for those patients for whom hemodynamic measurements were available within four months of the date of blood draw for the PBMC isolations used in this study (12 IPAH; 23 SSc-PAH). The clinical parameters of mean right atrial pressure (RAmean), cardiac index (CI), pulmonary vascular resistance index (PVRI), and pulmonary artery saturation (PA sat) were used. ALAS2 gene expression was taken as a primary biomarker representing the entire EDS (note the Pearson correlation r between ALAS2 and ERAF/AHSP gene expression, among the subjects used for this analysis, was 0.987, and 0.957 for IPAH and SSc-PAH, respectively), and was hence used for the purpose of computing correlations of the EDS with hemodynamic measurements (Figure 8). Disease severity in IPAH patients as indicated by increasing RAmean and PVRI were strongly correlated with increasing ALAS2 gene expression (r = 0.776, p = 0.003; r = 0.752, p = 0.0048, respectively). Conversely, measures of healthy lung and cardiac function such as PA saturation and Cardiac Index (CI) were negatively correlated with decreasing ALAS2 gene expression (r = −0.71, p = 0.0098; r = −0.449, p = 0.14, respectively). The consistency of these measurements suggests that there is indeed a direct correlation between disease severity and EDS gene expression in IPAH patients. Surprisingly, there were no corresponding significant correlations for any of these four hemodynamic parameters among the SSc-PAH patients (Figure S3) despite the clear and significant enrichment for EDS genes (see Figure 6A&B) in this group. The level of EDS gene over-expression among SSc-PAH patients was thus not seen to be directly related to the markers of PH disease status examined here and distinguishes IPAH and SSc-PAH for that reason.
EDS gene expression for 12 IPAH patients for whom hemodynamic measurements were available within four months of the date of blood draw. The clinical parameters of right atrial pressure (RAmean), cardiac index (CI), pulmonary vascular resistance index (PVRI), and pulmonary artery saturation (PA sat) were used. Disease severity in IPAH patients as indicated by increasing RAmean and PVRI are strongly correlated with increasing ALAS2 gene expression and negatively correlated with measures of healthy lung and coronary function such as PA saturation and Cardiac Index (CI).
Previous studies using PBMC have been used to identify PH-specific genes  as well as distinguishing between IPAH and SSc-PAH . In general, however, these studies have shown considerable heterogeneity when examining directly the contrast in gene expression profiles in PBMC from SSc-PAH and SSc patients , . For example, while Pendergrass et al.  focused on the increased expression of 9 genes that distinguished SSc-PAH from SSc, Risbano et al.  described 5 genes which when down-regulated distinguish SSc-PAH from SSc patients. In a comparison of the complete datasets from these studies in combination with results from this current study we found one gene, in particular, ALAS2, which is significantly over-expressed in SSc-PAH versus SSc in all three datasets. We present data here in support of the finding that one of the distinguishing molecular phenotypes in terms of gene expression between patients with PAH versus either healthy controls or patients with SSc alone, involves a distinctive signature uniquely associated with erythrocyte development. This signature was also present in patients with IPAH and SSc-PH-ILD in the current study and segregates with PH in multiple published clinical studies for which data is publicly available , , , . We have demonstrated here that the EDS signature is quantitatively enriched and validated in at least four independently published datasets derived from microarray studies across multiple microarray platforms (Affymetrix, Illumina, and Agilent) in which the PBMCs from PH patients were tested.
In all cases (our data and others) only a subset of PH patients in the affected groups were EDS positive and in our data, at least, the presence of the EDS was associated with increasingly severe disease (as judged by hemodynamic parameters) for IPAH but not for SSc-PAH patients (Figure 8, Figure S3). The presence of the EDS signature induced by PAH may be indicative of increased red blood cell recruitment as part of a systemic response to severe chronic local hypoxia. An increase of up-regulated genes selectively expressed in erythrocytes/reticulocytes (including ALAS2 and ERAF/AHSP, and many other EDS genes) in whole blood was also noted to be consistent with previous observations of higher red blood cell counts (hematocrit) in obesity . An increase in RBC trafficking may constitute a useful marker of PH disease, in general, and serve as a useful marker of increased disease severity specifically in IPAH patients. The lack of correlation of the EDS genes with hemodynamic measurements in the SSc-PAH patients is puzzling, particularly, as the signature as a whole is similarly enriched in patients from both disease groups. This perhaps reflects the different etiologies of these two different types of PH and emphasizes their distinct origins. Furthermore, we have previously reported that hemodynamic alterations are distinct between IPAH and SSc-PAH patients and do not always reflect, in the latter group, the severity of PAH , .
The cell specific source of the EDS remains an open question. In order to eliminate the likelihood that direct RBC contamination in the PBMC preparations used in this current study might account for the presence of the EDS, PBMC samples from both high and low EDS patients were subjected to multiple rounds of isotonic ammonium chloride hemolysis. This treatment lyses mature red blood cells with minimal effect on lymphocytes and does not appreciably affect nucleated red cells. In our test samples high EDS gene expression was not affected by this treatment (Figure S4).
High levels of gene expression for ALAS2 and ERAF are found almost exclusively in CD71+ erythroid progenitor cells, and the complete EDS signature (as defined here) appears to correlate especially well with genes known to be expressed in reticulocytes and particularly well in cell populations enriched for less mature reticulocytes (as in cord blood – Figure 5). Our hypothesis is that the EDS gene expression signature is derived from a population of nucleated reticulocytes which co-sediment with lymphocytes and monocytes in the PBMC fraction of Ficoll gradients.
The identity of the EDS corresponds closely to a gene expression signature reported by Ebert et al.,  where the authors provide detailed gene expression information for an in vitro experiment in which bone marrow CD34+ cells were expanded under conditions which induced erythroid differentiation and major changes in gene expression were recorded pre- and post- induction. Our EDS gene list overlapped the induced erythroid gene list by over 50% including both the ALAS2 and ERAF genes (ALAS2, CA1, EPB42, ERAF, FECH, GLRX5, GSPT1, GYPB, GYPE, HBA2, MYL4, SELENBP1, SLC25A37, SNCA, TMCC2, and TSPAN5). Interestingly, a major difference between the Ebert induced erythroid signature and the PAH EDS is the very strong upregulation of IL8 recorded in the Ebert signature but not in the PAH-EDS (IL8 was upregulated sporadically and non-specifically across the entire PAH dataset). The reason for this discrepancy is not clear but worth noting given the otherwise very strong correlation between the two signatures.
Additional evidence for the source of the EDS in PBMCs has recently been obtained indirectly by others. Researchers from the Children's Hospital in Cincinnati reported the up-regulation of the expression of genes involved in the processes of hemoglobin synthesis and oxygen transport in the PBMCs of systemic juvenile idiopathic arthritis (sJIA) patients relative to healthy controls . They suggested (as we do here) that this cluster of genes might represent the signature of immature nucleated RBCs that can copurify with PBMCs isolated on Ficoll gradients. The PH and the sJIA erythropoiesis signatures are highly overlapping (Figure S5) suggesting a common PBMC cell source. The Cincinnati team also mapped their experimentally derived EDS using bioinformatics methods to CD71+ immature erythroid precursor cells  and, in addition, they present data showing that patients with sJIA had significantly increased proportions of immature cell populations, including CD34+ cells, correlating highly with the strength of their measurements of the erythropoiesis signature. It has been independently demonstrated by in vitro expansion experiments that the potential, at least, for the production of large amounts of erythroid progenitor cells can be derived directly from PBMCs without additional purification , although whether the source of this expansion is derived from CD34+ cells remains uncertain . Despite the strong indirect evidence presented by ourselves and others, the direct evidence for the expansion of CD71+ erythrocyte precursors in the periphery as the source of the EDS remains to be demonstrated.
The exact role of the EDS in specific disease states remains to be determined. Clearly there are strong associations between the EDS and PH and sJIA, but also the EDS has been observed in active lupus as well, and co-segregates with multiple additional immune-related signatures in a large asthma cohort study (unpublished data). In an ongoing longitudinal PAH study that we are currently conducting, it has become clear that the EDS as well as the immune response and platelet signatures are also variable in patients over time. Unfortunately, it is still too early for more than a speculative interpretation of these results. For now, it would appear that the EDS is an important new marker in chronic disease with the distinct property that in hypertension, at least, the expansion of immature precursor cells may actually constitute an active biological response to increasingly severe disease conditions.
Materials and Methods
All the samples used during this study were obtained following written informed consent from the donors. The Johns Hopkins University Institutional Review Board approved the conduct of this study.
The cohort was comprised of subjects identified from the Johns Hopkins Pulmonary Hypertension Program and the Johns Hopkins Scleroderma Center as part of our center's Specialized Center for Clinically-Oriented Research program. Consecutive outpatients with a diagnosis of IPAH, SSc-PAH, SSc-PH-ILD and SSc were recruited and enrolled in the study between 2007 and 2010. Controls subjects were family and friends who accompanied subjects to clinic visits and had no known cardiovascular, pulmonary, or renal disease.
Limited or diffuse SSc was as previously defined . PAH was defined as a mean pulmonary artery pressure (mPAP) of >25 mmHg, pulmonary artery wedge pressure (PAWP) ≤15 mmHg, and pulmonary vascular resistance (PVR) >3 Wood units , in the absence of other known causes of pulmonary hypertension. Results of pulmonary function tests (PFT) and high-resolution computed tomography (HRCT) of the chest closest to the date of the diagnostic RHC (right heart catheterization) were recorded. Percent of predicted results for all PFT data were calculated according to Crapo . Patients with significant obstructive lung disease, defined as a forced expiratory volume in one second over forced vital capacity ratio (FEV1/FVC) <0.5 or 0.5–0.7 accompanied by radiographic evidence of emphysema, were excluded , . Interstitial lung disease was defined by a combination of PFT and HRCT criteria as previously described in epidemiologic studies and clinical trials of PAH therapy , , . Patients were classified as having SSc-PH-ILD if they met all the above criteria, and had a total lung capacity (TLC) of <60% of predicted or a TLC between 60% and 70% of predicted combined with moderate to severe fibrosis (grade 3–4) on HRCT . The onset of scleroderma was defined by the first non-Raynaud's phenomenon manifestation.
Severity of PAH was assessed by routine functional and hemodynamic measurements obtained closest to the date of blood collection for genomic analyses. Subjects were then stratified by cardiac index dichotomized at 2.2 L/min/m2 based upon prior studies demonstrating poorer survival for PAH patients with a CI less than this value .
Isolation of Peripheral Blood Mononuclear Cells
Venous blood was collected by simple venipuncture under aseptic conditions. All samples were processed within two hours of collection to minimize gene expression variations associated with longer sample incubation times . PBMCs were separated by Ficoll density gradient, immediately lysed in Trizol reagent (Invitrogen, Carlsbad, California), and stored at −80°C.
Purification of RNA
Total RNA was extracted using the Trizol Reagent method (Invitrogen, Carlsbad, California 92008, cat. no. 15596-026). Additional purification was performed on RNeasy columns (Qiagen, Valencia, CA 913555, cat. no. 74104). The quality of total RNA samples was assessed using an Agilent 2100 Bioanalyzer (Agilent Technologies, Palo Alto, CA).
RNA samples were labeled according to the chip manufacturer's recommended protocols. In brief, for Illumina, 0.5 µg of total RNA from each sample was labeled by using the Illumina TotalPrep RNA Amplification Kit (Ambion, Austin, TX 78744-1832, cat. no. IL1791) in a two step process of cDNA synthesis followed by in vitro RNA transcription. Single stranded RNA (cRNA) was generated and labeled by incorporating biotin-16-UTP. 0.75 ugs of biotin-labeled cRNA was hybridized (16 hours) to Illumina Sentrix Human HT12_v3 BeadChips (Illumina, San Diego, CA 92121-1975, cat.no. BD-103-0203). The hybridized biotinylated cRNA was detected with streptavidin-Cy3 and quantitated using Illumina's BeadStation 500GX Genetic Analysis Systems scanner. The expression data discussed in this publication have been deposited in NCBI's Gene Expression Omnibus  and are accessible through GEO Series accession number GSE 33463 (http://www.ncbi.nlm.nih.gov/geo/query/acc.cgi?acc=GSE 33463).
Quantitative RT-PCR (QRT-PCR) Analysis
cDNA was obtained from total RNA using the cDNA Archive Kit according to the manufacturer's protocol (Applied Biosystems, Foster City, CA). Probes and primers were designed and synthesized by Applied Biosystems. All PCR amplifications were carried out in triplicate on an ABI Prism® 7300 Sequence Detection System, using a fluorogenic 5′ nuclease assay (TaqMan® probes). Relative gene expressions were calculated by using the 2−ΔΔCt method as described in . The ΔCt value of each sample was calculated using 3 endogenous control genes (GAPDH, ACTB, and PGK1).
Analytical Methods and Statistical Analysis
A single intensity (expression) value for each Illumina probe on the array was obtained using Illumina BeadStudio software with standard settings and no background correction. The expression values for all the probes for each sample were scaled to have median 256 (28) and then log (base 2) transformed before performing statistical analysis. Analysis for differential expression between pairs of disease groups and between individual disease groups and the group of controls was carried out for each Illumina microarray probe.
Illumina probes (and consequently, the corresponding genes) considered to be significantly differentially expressed between two groups of samples were those satisfying the three criteria: (i) Two-sided Welch t-test p-values less than or equal to 0.01 ; (ii) a Benjamini-Hochberg false discovery rate (FDR) less than or equal to 0.1 ; and (iii) a fold change above 1.5 or below 1/1.5 (calculated using geometric means). Statistical testing for differences in expression levels of a given probe between two groups was not done unless at least 80% of the samples in the group with the higher average expression level for that probe had Illumina detection p-values <0.01 (thus avoiding false positives based on background noise and also reducing the number of statistical tests for the subsequent false discovery rate calculation). A comprehensive spreadsheet of group comparison results is given in Table S1.
Heat maps (and the ordering by hierarchical clustering of the samples and the genes in heat maps) were based on normalization of the expression values for each sample using z transformation , ,  (utilizing only the probes which had an Illumina detection p-value <0.01 for least one sample, and for which there was an available gene symbol), followed by z-transformation of the normalized expression values for each Illumina probe across all samples. Hierarchical clustering was performed using the Cluster and TreeView software programs . The clustering algorithm was set to complete linkage clustering using uncentered correlation.
Gene set analysis was carried out using the web-PAGE tool  (http://dpwebpage.nia.nih.gov/PAGE/index.html) with the p-value cutoff set to 0.01 and the minimum number of genes per gene set equal to 10. The input used was either a z ratio (z transformation of the difference between the means computed for two groups  (Table 2, Table 3-JHU data, Figure 7) for all internal data; or a simple difference metric was computed and used for all external data (Table 2). One exception was the use of all row normalized data on a sample by sample basis to generate the functional genomic landscape as illustrated in Figure 4A. In this variation of the gene set algorithm, gene sets are tested against the complete expression data for each sample, enrichment scores map the relative abundance levels of groups of genes which can then be compared for variation between samples and groups of samples as seen. The gene sets used are as described in the corresponding Table and Figure legends.
Evaluation of lists of differentially expressed genes for enrichment in predefined categories and functional groups of genes was carried out using the NIH functional analysis tool DAVID , and the Broad Institute Molecular Signatures Database MSigDB facility .
Associating hemodynamic measurements with gene expression
Correlation between expression levels of a given gene and the values of a selected clinical variable for a specified group of n subjects was evaluated as the Pearson product-moment correlation coefficient r estimating the population correlation coefficient ρ. Tests of the null hypothesis ρ = 0 were conducted using the customary t-test depending on r and n.
PAH significance tests, gender specific EDS stats, siglists-unique, UR functional enrichment, DR functional enrichment.
Demographic and clinical data for subjects.
EDS genes in published PH gene expression datasets.
Platelet signature in published PH gene expression datasets.
Correlations of ALAS2 gene expression with clinical measurements in SSc-PAH patients.
RBC lysis treatment shows no effect on EDS gene expression.
We would like to thank Danielle Boyce from the JHU SOM Pulmonary Division for patient demographic and clinical data.
Conceived and designed the experiments: CC SCM DNG ALZ REG RAJ MAM FMW KCB PMH. Performed the experiments: TW SB JF MB. Analyzed the data: CC AEB YS DNG. Contributed reagents/materials/analysis tools: SCM LH FMW. Wrote the paper: CC AEB SCM DNG PMH.
- 1. D'Alonzo GE, Barst RJ, Ayres SM, Bergofsky EH, Brundage BH, et al. (1991) Survival in patients with primary pulmonary hypertension. Results from a national prospective registry. Ann Intern Med 115: 343–349.
- 2. Gaine SP, Rubin LJ (1998) Primary pulmonary hypertension. Lancet 352: 719–725.
- 3. Rich S, Dantzker DR, Ayres SM, Bergofsky EH, Brundage BH, et al. (1987) Primary pulmonary hypertension. A national prospective study. Ann Intern Med 107: 216–223.
- 4. Hassoun PM (2009) Therapies for scleroderma-related pulmonary arterial hypertension. Expert Rev Respir Med 3: 187–196.
- 5. Hassoun P (2011) Lung involvement in systemic sclerosis. Presse Med 40: e3–e17.
- 6. Fagan KA, Badesch DB (2002) Pulmonary hypertension associated with connective tissue disease. Prog Cardiovasc Dis 45: 225–234.
- 7. Bendayan D, Shitrit D, Kramer MR (2006) Pulmonary arterial hypertension associated with autoimmune disease: a single medical center experience. Isr Med Assoc J 8: 252–254.
- 8. Steen VD (2005) The lung in systemic sclerosis. J Clin Rheumatol 11: 40–46.
- 9. Burczynski ME, Dorner AJ (2006) Transcriptional profiling of peripheral blood cells in clinical pharmacogenomic studies. Pharmacogenomics 7: 187–202.
- 10. Liew CC, Ma J, Tang HC, Zheng R, Dempsey AA (2006) The peripheral blood transcriptome dynamically reflects system wide biology: a potential diagnostic tool. J Lab Clin Med 147: 126–132.
- 11. Bull TM, Coldren CD, Moore M, Sotto-Santiago SM, Pham DV, et al. (2004) Gene microarray analysis of peripheral blood cells in pulmonary arterial hypertension. Am J Respir Crit Care Med 170: 911–919.
- 12. Grigoryev DN, Mathai SC, Fisher MR, Girgis RE, Zaiman AL, et al. (2008) Identification of candidate genes in scleroderma-related pulmonary arterial hypertension. Transl Res 151: 197–207.
- 13. Pendergrass SA, Hayes E, Farina G, Lemaire R, Farber HW, et al. (2010) Limited systemic sclerosis patients with pulmonary arterial hypertension show biomarkers of inflammation and vascular injury. PLoS One 5: e12106.
- 14. Risbano MG, Meadows CA, Coldren CD, Jenkins TJ, Edwards MG, et al. (2010) Altered immune phenotype in peripheral blood cells of patients with scleroderma-associated pulmonary hypertension. Clin Transl Sci 3: 210–218.
- 15. Christmann RB, Hayes E, Pendergrass S, Padilla C, Farina G, et al. (2011) Interferon and alternative activation of monocyte/macrophages in systemic sclerosis-associated pulmonary arterial hypertension. Arthritis Rheum 63: 1718–1728.
- 16. De S, Zhang Y, Garner JR, Wang SA, Becker KG (2010) Disease and phenotype gene set analysis of disease-based gene expression in mouse and human. Physiol Genomics 42A: 162–167.
- 17. Martinelli S, Urosevic M, Daryadel A, Oberholzer PA, Baumann C, et al. (2004) Induction of genes mediating interferon-dependent extracellular trap formation during neutrophil differentiation. J Biol Chem 279: 44123–44132.
- 18. Cheadle C, Berger AE, Andrade F, James R, Johnson K, et al. (2010) Transcription of proteinase 3 and related myelopoiesis genes in peripheral blood mononuclear cells of patients with active Wegener's granulomatosis. Arthritis Rheum 62: 1744–1754.
- 19. Bennett L, Palucka AK, Arce E, Cantrell V, Borvak J, et al. (2003) Interferon and granulopoiesis signatures in systemic lupus erythematosus blood. J Exp Med 197: 711–723.
- 20. Bult CJ, Eppig JT, Kadin JA, Richardson JE, Blake JA (2008) The Mouse Genome Database (MGD): mouse biology and model systems. Nucleic Acids Res 36: D724–728.
- 21. McCall MN, Uppal K, Jaffee HA, Zilliox MJ, Irizarry RA (2011) The Gene Expression Barcode: leveraging public data repositories to begin cataloging the human and murine transcriptomes. Nucleic Acids Res 39: D1011–1015.
- 22. Paterakis GS, Lykopoulou L, Papassotiriou J, Stamulakatou A, Kattamis C, et al. (1993) Flow-cytometric analysis of reticulocytes in normal cord blood. Acta Haematol 90: 182–185.
- 23. Harigae H, Suwabe N, Weinstock PH, Nagai M, Fujita H, et al. (1998) Deficient heme and globin synthesis in embryonic stem cells lacking the erythroid-specific delta-aminolevulinate synthase gene. Blood 91: 798–805.
- 24. Friend C, Scher W, Holland JG, Sato T (1971) Hemoglobin synthesis in murine virus-induced leukemic cells in vitro: stimulation of erythroid differentiation by dimethyl sulfoxide. Proc Natl Acad Sci U S A 68: 378–382.
- 25. Greer J, Wintrobe M (2009) Wintrobe's clinical hematology; Greer J, Foerster J, Rodgers G, Paraskevas F, Glader B, et al., editors. Philadelphia, PA: Lippincot Williams & Wilkins. 837 p.
- 26. Yu X, Mollan TL, Butler A, Gow AJ, Olson JS, et al. (2009) Analysis of human alpha globin gene mutations that impair binding to the alpha hemoglobin stabilizing protein. Blood 113: 5961–5969.
- 27. Kaneko K, Furuyama K, Aburatani H, Shibahara S (2009) Hypoxia induces erythroid-specific 5-aminolevulinate synthase expression in human erythroid cells through transforming growth factor-beta signaling. Febs J 276: 1370–1382.
- 28. Ohneda K, Yamamoto M (2002) Roles of hematopoietic transcription factors GATA-1 and GATA-2 in the development of red blood cell lineage. Acta Haematol 108: 237–245.
- 29. Nuez B, Michalovich D, Bygrave A, Ploemacher R, Grosveld F (1995) Defective haematopoiesis in fetal liver resulting from inactivation of the EKLF gene. Nature 375: 316–318.
- 30. Matys V, Fricke E, Geffers R, Gossling E, Haubrock M, et al. (2003) TRANSFAC: transcriptional regulation, from patterns to profiles. Nucleic Acids Res 31: 374–378.
- 31. Barrett T, Troup DB, Wilhite SE, Ledoux P, Evangelista C, et al. (2011) NCBI GEO: archive for functional genomics data sets–10 years on. Nucleic Acids Res 39: D1005–1010.
- 32. Rajkumar R, Konishi K, Richards TJ, Ishizawar DC, Wiechert AC, et al. (2010) Genomewide RNA expression profiling in lung identifies distinct signatures in idiopathic pulmonary arterial hypertension and secondary pulmonary hypertension. Am J Physiol Heart Circ Physiol 298: H1235–1248.
- 33. Goh SH, Josleyn M, Lee YT, Danner RL, Gherman RB, et al. (2007) The human reticulocyte transcriptome. Physiol Genomics 30: 172–178.
- 34. Ghosh S, Dent R, Harper ME, Gorman SA, Stuart JS, et al. (2010) Gene expression profiling in whole blood identifies distinct biological pathways associated with obesity. BMC Med Genomics 3: 56.
- 35. Le Pavec J, Humbert M, Mouthon L, Hassoun PM (2010) Systemic sclerosis-associated pulmonary arterial hypertension. Am J Respir Crit Care Med 181: 1285–1293.
- 36. Fisher MR, Mathai SC, Champion HC, Girgis RE, Housten-Harris T, et al. (2006) Clinical differences between idiopathic and scleroderma-related pulmonary hypertension. Arthritis Rheum 54: 3043–3050.
- 37. Ebert BL, Galili N, Tamayo P, Bosco J, Mak R, et al. (2008) An erythroid differentiation signature predicts response to lenalidomide in myelodysplastic syndrome. PLoS Med 5: e35.
- 38. Fall N, Barnes M, Thornton S, Luyrink L, Olson J, et al. (2007) Gene expression profiling of peripheral blood from patients with untreated new-onset systemic juvenile idiopathic arthritis reveals molecular heterogeneity that may predict macrophage activation syndrome. Arthritis Rheum 56: 3793–3804.
- 39. Hinze CH, Fall N, Thornton S, Mo JQ, Aronow BJ, et al. (2010) Immature cell populations and an erythropoiesis gene-expression signature in systemic juvenile idiopathic arthritis: implications for pathogenesis. Arthritis Res Ther 12: R123.
- 40. Filippone C, Franssila R, Kumar A, Saikko L, Kovanen PE, et al. (2010) Erythroid progenitor cells expanded from peripheral blood without mobilization or preselection: molecular characteristics and functional competence. PLoS One 5: e9496.
- 41. van den Akker E, Satchwell TJ, Pellegrin S, Daniels G, Toye AM (2010) The majority of the in vitro erythroid expansion potential resides in CD34(-) cells, outweighing the contribution of CD34(+) cells and significantly increasing the erythroblast yield from peripheral blood samples. Haematologica 95: 1594–1598.
- 42. LeRoy EC, Black C, Fleischmajer R, Jablonska S, Krieg T, et al. (1988) Scleroderma (systemic sclerosis): classification, subsets and pathogenesis. J Rheumatol 15: 202–205.
- 43. McLaughlin VV, Archer SL, Badesch DB, Barst RJ, Farber HW, et al. (2009) ACCF/AHA 2009 expert consensus document on pulmonary hypertension: a report of the American College of Cardiology Foundation Task Force on Expert Consensus Documents and the American Heart Association: developed in collaboration with the American College of Chest Physicians, American Thoracic Society, Inc., and the Pulmonary Hypertension Association. Circulation 119: 2250–2294.
- 44. Crapo RO, Morris AH, Gardner RM (1981) Reference spirometric values using techniques and equipment that meet ATS recommendations. Am Rev Respir Dis 123: 659–664.
- 45. Crapo RO, Morris AH (1981) Standardized single breath normal values for carbon monoxide diffusing capacity. Am Rev Respir Dis 123: 185–189.
- 46. Crapo RO, Morris AH, Clayton PD, Nixon CR (1982) Lung volumes in healthy nonsmoking adults. Bull Eur Physiopathol Respir 18: 419–425.
- 47. Hachulla E, Gressin V, Guillevin L, Carpentier P, Diot E, et al. (2005) Early detection of pulmonary arterial hypertension in systemic sclerosis: a French nationwide prospective multicenter study. Arthritis Rheum 52: 3792–3800.
- 48. Simonneau G, Barst RJ, Galie N, Naeije R, Rich S, et al. (2002) Continuous subcutaneous infusion of treprostinil, a prostacyclin analogue, in patients with pulmonary arterial hypertension: a double-blind, randomized, placebo-controlled trial. Am J Respir Crit Care Med 165: 800–804.
- 49. Girgis RE, Frost AE, Hill NS, Horn EM, Langleben D, et al. (2007) Selective endothelin A receptor antagonism with sitaxsentan for pulmonary arterial hypertension associated with connective tissue disease. Ann Rheum Dis 66: 1467–1472.
- 50. MacDonald SL, Rubens MB, Hansell DM, Copley SJ, Desai SR, et al. (2001) Nonspecific interstitial pneumonia and usual interstitial pneumonia: comparative appearances at and diagnostic accuracy of thin-section CT. Radiology 221: 600–605.
- 51. McLaughlin VV, Archer SL, Badesch DB, Barst RJ, Farber HW, et al. (2009) ACCF/AHA 2009 expert consensus document on pulmonary hypertension a report of the American College of Cardiology Foundation Task Force on Expert Consensus Documents and the American Heart Association developed in collaboration with the American College of Chest Physicians; American Thoracic Society, Inc.; and the Pulmonary Hypertension Association. J Am Coll Cardiol 53: 1573–1619.
- 52. Baechler EC, Batliwalla FM, Karypis G, Gaffney PM, Moser K, et al. (2004) Expression levels for many genes in human peripheral blood cells are highly sensitive to ex vivo incubation. Genes Immun 5: 347–353.
- 53. Edgar R, Domrachev M, Lash AE (2002) Gene Expression Omnibus: NCBI gene expression and hybridization array data repository. Nucleic Acids Res 30: 207–210.
- 54. Yuan JS, Reed A, Chen F, Stewart CN (2006) Statistical analysis of real-time PCR data. BMC Bioinformatics 7: 85.
- 55. Pan W (2002) A comparative review of statistical methods for discovering differentially expressed genes in replicated microarray experiments. Bioinformatics 18: 546–554.
- 56. Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. JRSS-B 57: 289–300.
- 57. Cheadle C, Vawter MP, Freed WJ, Becker KG (2003) Analysis of microarray data using Z score transformation. J Mol Diagn 5: 73–81.
- 58. Nadon R, Woody E, Shi P, Rghei N, Hubschle H, et al. (2002) Statistical inference in array genomics. In: Geschwind D, Gregg J, editors. Microarrays for the Neurosciences. Cambridge: MIT Press.
- 59. Eisen MB, Spellman PT, Brown PO, Botstein D (1998) Cluster analysis and display of genome-wide expression patterns. Proc Natl Acad Sci U S A 95: 14863–14868.
- 60. Cheadle C, Cho-Chung YS, Becker KG, Vawter MP (2003) Application of z-score transformation to Affymetrix data. Appl Bioinformatics 2: 209–217.
- 61. Huang da W, Sherman BT, Lempicki RA (2009) Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc 4: 44–57.
- 62. Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, et al. (2005) Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci U S A 102: 15545–15550.