Figures
Abstract
A major challenge in developmental biology is to understand the genetic and cellular processes/programs driving organ formation and differentiation of the diverse cell types that comprise the embryo. While recent studies using single cell transcriptome analysis illustrate the power to measure and understand cellular heterogeneity in complex biological systems, processing large amounts of RNA-seq data from heterogeneous cell populations creates the need for readily accessible tools for the analysis of single-cell RNA-seq (scRNA-seq) profiles. The present study presents a generally applicable analytic pipeline (SINCERA: a computational pipeline for SINgle CEll RNA-seq profiling Analysis) for processing scRNA-seq data from a whole organ or sorted cells. The pipeline supports the analysis for: 1) the distinction and identification of major cell types; 2) the identification of cell type specific gene signatures; and 3) the determination of driving forces of given cell types. We applied this pipeline to the RNA-seq analysis of single cells isolated from embryonic mouse lung at E16.5. Through the pipeline analysis, we distinguished major cell types of fetal mouse lung, including epithelial, endothelial, smooth muscle, pericyte, and fibroblast-like cell types, and identified cell type specific gene signatures, bioprocesses, and key regulators. SINCERA is implemented in R, licensed under the GNU General Public License v3, and freely available from CCHMC PBGE website, https://research.cchmc.org/pbge/sincera.html.
Citation: Guo M, Wang H, Potter SS, Whitsett JA, Xu Y (2015) SINCERA: A Pipeline for Single-Cell RNA-Seq Profiling Analysis. PLoS Comput Biol 11(11): e1004575. https://doi.org/10.1371/journal.pcbi.1004575
Editor: Andreas Prlic, UCSD, UNITED STATES
Received: April 14, 2015; Accepted: September 30, 2015; Published: November 24, 2015
Copyright: © 2015 Guo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: The source code of SINCERA with reproducible demonstrations can be found at CCHMC PBGE website, https://research.cchmc.org/pbge/sincera.html. The raw data have been submitted to GEO (http://www.ncbi.nlm.nih.gov/geo/, Accession number GSE69761). The interpreted data from this study are publically available via our website (https://research.cchmc.org/pbge/lunggens/default.html) and LungMAP website (http://lungmap.net).
Funding: This work was supported by the National Heart, Lung, and Blood Institute of National Institutes of Health (http://www.nhlbi.nih.gov, grants U01HL110964 (LRRC), U01HL122642 (LungMAP), and R01HL105433. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
This is a PLOS Computational Biology Software paper.
Introduction
Genetic and phenotypic heterogeneity among cells is a general phenomenon, associated with the development of biological function and disease processes [1–3]. The epigenetic status, cell cycle, microenvironment and intrinsic transcriptional ‘noise’ are all likely to influence the extent of heterogeneity within a seemingly homogenous cell population within an organ [4–6]. Cell fate decisions during organ development are largely operative at the level of individual cells, wherein cell identity and function are determined by a unique combination of regulators operating at transcriptional targets and via encoded proteins in each cellular environment. While the analysis of whole organ RNA expression profiles together with cell lineage tracing and gene targeting studies have provided an increasingly detailed framework for understanding the processes and cell-cell interactions directing organ formation, the extent of cellular heterogeneity, transitional stages of differentiation, and dynamic changes in gene expression within individual cells cannot be addressed using transcripts derived from whole organs or pooled cell populations. Transcriptome analysis at single cell resolution provides new insights into the genetic cellular response during health and disease.
Recent advances in microfluidics, robotics, amplification chemistries, and DNA sequencing technologies provide the ability to isolate, sequence, and quantitate RNA transcripts from single cells. Single-cell RNA-seq (scRNA-seq) can now be applied to study the individual transcriptomes of large numbers of cells in parallel using techniques such as fluorescence-activated cell sorting, microfluidics or optofluidic-based cell handling [7–10]. The combination of a high-throughput cell isolation and sequencing at the single-cell level is crucial for identification of transcriptional networks and molecular mechanisms controlling the formation of complex organs at single cell resolution, providing new insights into the diversity of cell types, lineage relationships, and gene expression patterns accompanying embryogenesis, organogenesis, and disease pathogenesis [11–18]. Recent studies by Satija et al. [19] and Pettit et al. [20] combined single-cell RNA-seq gene expression profiles with complementary in situ hybridization (ISH) data to reveal the 3D expression patterns. Both relied on a spatial reference map to infer the spatial location of cells from their scRNA-seq profiles via either a small set of known landmarks’ in situ patterns or a pre-existing spatially referenced ISH atlas. These efforts addressed spatial localization more directly and precisely than previous efforts using independent component analysis (ICA) or principal component analysis (PCA) to approximate spatial location. scRNA-seq has also been applied to isolated lung epithelial cells to characterize the epithelial lineage during development and after injury [21,22], identified multi-potent epithelial progenitors and progenitor cells responding to lung injury. Nevertheless, using scRNA-seq to characterize heterogeneous cell populations from whole lung sample has not been reported.
While the future for single-cell next-generation sequencing based genomic studies is promising, it brings new and specific analytical challenges. Most of the current available methods were designed for quantifying the mean behaviors of millions of cells by averaging the signal of individual cells. Although some tools for analyzing RNA-seq and Microarray data from bulk cell populations can be applied to scRNA-seq data, new analytic strategies and workflows are required to address the unique issues associated with the single cell data including the identification and characterization of unknown cell types, handing the confounding factors such as batch and cell cycle effects, addressing the cellular heterogeneity in complex biological systems, to name a few [23–27]. For cell type identification, most single cell studies used hierarchical clustering or PCA-like methods or the combination of the two [21,28–31]. Recently, a number of methods specifically designed for scRNA-seq analysis have been introduced including SNN-Cliq [32], scLVM [27] and BackSPIN [33] for clustering; SAMstrt and Bayesian approach for single-cell differential expression analysis [25,34,35]; Monocle [26] and SCUBA [36] for extracting lineage relationships from scRNA-seq and modeling the dynamic changes associated with cell differentiation. These advanced methods mostly focused on one aspect of the data analysis. How to design the analytic workflow to process large amounts scRNA-seq data from heterogeneous cell populations and reveal biological insights represent a substantial challenge for most investigators.
The present study is motivated to design a top-to-toe tool set to the research community for their practical usage. Here we present SINCERA, a computational pipeline for SINgle CEll Rna-seq profiling Analysis, to enable researchers to analyze RNA-seq data from single cells isolated from whole organ preparations and/or sorted cells. Practically, the pipeline enables investigators analyzing scRNA-seq data using standard desktop/laptop computers to conduct data filtering, normalization, clustering, cell type identification, gene signature prediction, transcriptional regulatory network construction, and identification of driving force (key nodes) for each cell type. In addition to providing the research community with a ready to use tool set, the present work introduced a number of innovative approaches in several critical steps of the analytic pipeline including logistic regression based ranking model to predict cell type specific signature genes, automated “Cell Type Enrichment Analysis”, and rank aggregation based validation of cell type identification, and integrative node importance ranking based on both disruptive and centrality metrics to predict cell type specific transcriptional regulatory driving force. Through the application of SINCERA to analyze RNA-seq data from single cells isolated from whole fetal mouse lung at E16.5, we demonstrated its utility and accuracy. The computational pipeline generated by our work provides a valuable tool set for the analysis of single cell transcriptome data in whole tissue during normal development and from various pathological states.
Design and Implementation
We developed a pipeline designed to enable analysis of scRNA-seq from heterogeneous cell populations. Fig 1 depicts the schematic workflow of the pipeline consisting of three major analytic components: (1) pre-processing, (2) cell type identification, and (3) gene signature and driving force analysis. The pipeline takes RNA-seq expression values (e.g., FPKM [37] or TPM [38]) from heterogeneous single cell populations as inputs. Functions related to obtaining the RNA-seq expression values, such as sequencing data mapping, alignment, quantification, and annotation, are not part of the pipeline; and they can be processed using widely available software such as Tophat [39,40], BWA [41], Cufflinks [37], and RSEM [38]. Let us denote by E = {Es |1 ≤ s ≤ m} the input expression profiles to the pipeline, where m is the number of samples prepared. Each sample Es is represented as a two-dimensional real-valued matrix that encodes the expression profiles of ns > 0 genes in qs > 0 cells. represents the expression of gene i in cell j of sample s,
is a row vector encoding the expression profile of gene i in qs cells of s, and
is a column vector that represents the expression of ns genes in cell j of s. The pipeline supports unequal numbers of cells in different samples. The output of the pipeline includes a set of refined cell clusters, differentially expressed genes for each cluster, and gene signature and driving forces of a given cell cluster. Each cluster is considered as a unique cell type with defined biological functionality. Considering the heterogeneity of cell states at a given developmental stage, sub-clusters are likely present in each major cluster. The procedures of cell type identification, gene signature prediction, and driving force analysis can be iterated and refined to identify subpopulations of cells. The design of three main components in the pipeline is elaborated in the sections below.
The analytic pipeline consists of three main components: pre-processing, cell type identification, and cell type specific gene signature and driving force identification.
Pre-processing: Gene pre-filtering
The pre-filtering of genes is based on the gene expression abundancy and selectivity as described below.
The expression filter selects genes with , where
denotes the number of cells in sample s with the expression of gene i no less than θ (measured in FPKM in the demonstration). This step filters out non- or low-expressive genes, as well as genes that are expressed in less than N cells per sample preparation. In the demonstration section, we applied the expression filter of
to two independent single cell preparations from E16.5 mouse lung (i.e., gene i was selected if it expressed ≥ 5 FPKM in at least 2 cells in sample s). We recommend addressing rare cell types that are not forming clusters with other cells by adjusting
in a separate study.
The cell specificity filter is defined by a cell specificity index , which is modified from the calculation of tissue specificity index in [42].
denotes the cell specificity of gene i in sample s,
is the expression of gene i in cell j in s, qs is the number of cells in s, and
encodes the expression of gene i in qs cells of sample s. In the demonstration section, we chose genes with
. The cell specificity filter removes genes unselectively expressed across all cell types (many of these would be housekeeping genes with extremely high expression levels); and thus, this step results in the selection of genes that may be selectively expressed in certain cell types.
Pre-processing: Normalization and quality control
Normalization methods can be applied to reduce batch effect and enable expression level comparisons within or across sample preparations. The pipeline provides both gene level and cell level normalizations. For gene level normalization, per-sample z-score transformation are applied to each expression profile, i.e., , where
denotes the z-score normalized expression of gene i in cell j of sample s,
and
represent the mean and standard deviation of gene i in all cells of sample s. In the demonstration, this z-score normalized data were used prior to clustering to reduce sample variations and facilitate the identification of major cell types. For cell level normalizations, we use the trimmed mean. If starting with normalized expression data (e.g., FPKM), cell level normalization is not always necessary. To assess whether cell level normalization is needed for a specific dataset and to help understand the quality of the RNA-seq data for further in-depth analysis, we utilized several quality control checks, including MA plot [43], Q-Q plot [44], and inter-sample cell correlation and distance measurements (S1 Text).
Cell type identification
Optimizing cell clusters.
Cell type identification starts with a two-dimensional unsupervised hierarchical clustering of the cells using pre-filtered expression profiles. Use of an unsupervised hierarchical clustering approach does not impose prerequisite external biological knowledge, nor does it require preset knowledge of the number of clusters; therefore, it is capable of discovering novel cell types. Centered Pearson’s correlation and average linkage are used as default setting for the similarity measurement and linkage method, respectively. Pearson’s correlation for similarity measurement is used because we consider that the trend of gene expression among individual cells is more important than the absolute distance (e.g. Euclidean distance) among the cell profiles. The use of average linkage takes the contribution of individual cells into account. Per-sample z-score gene-by-gene normalization is applied before the clustering. In addition to the default cluster method, we also include consensus clustering [45,46], tight clustering [47] and ward linkage for similarity measurement [48] as optional clustering methods in the pipeline. When using hierarchical clustering for cell cluster identification, users can select a distance threshold or the number of clusters to identify the cell clusters along with visual inspection. If the distance threshold and the number of clusters are not provided, the algorithm finds a minimum distance that generates no more than a specified number (γ) of singleton clusters. In the demonstration, we set distance threshold to 0.5 and γ = 0 to obtain non-singleton cell clusters and identified 9 distinct cell clusters with this setting. A permutation analysis (S2 Text) is provided for determining significance of clusters [21].
Detecting differentially expressed genes.
To facilitate the mapping of major cell types to the cell clusters, we identified differentially expressed genes for each cluster using a procedure described as follows. Let C = {cl |1 ≤ l ≤ k} be a clustering scheme that divides cells into k disjoint clusters. For each cluster cl ∈ C, we calculated p-value of each gene based on a two-group statistical test of gene expression between the cells in cl and the cells not in cl. If the expression in the two groups can be assumed from two independent normal distributions, we use the one-tailed Welch’s t-test [49], which is suitable for samples having unequal variances and different sample sizes. In the case of small sample sizes, we use the one-tailed Wilcoxon rank sum test [50]. In the demonstration, we used Welch’s t-test when the sizes of both groups were greater than 5; otherwise, Wilcoxon rank sum test was used instead. Since the differential expression analysis involves multiple simultaneous tests, the Benjamini and Hochberg method [51] is utilized to control the False Discovery Rate (FDR). In addition, we include a resampling based method, SAMseq [35], as an optional method for identifying differentially expressed genes.
Matching major cell types to the corresponding cell clusters.
Starting with differentially expressed genes in each cluster, we use a combination of functional enrichment analysis, co-expression with publically available gene sets, validation with known biomarkers using a rank aggregation based algorithm, and expert curation to define the major cell type for each cluster.
Functional enrichment analysis. In the demonstration, we used ToppGene Suite [52] (http://toppgene.cchmc.org), DAVID Bioinformatics Resources [1,53] (http://david.abcc.ncifcrf.gov), MSigDB [54] (http://www.broadinstitute.org/gsea/msigdb), and Genecards (http://www.genecards.org) for gene sets functional enrichment analysis. Cell type information was extracted from EBI Expression Atlas (http://www.ebi.ac.uk/gxa), and co-expressed gene information was obtained from ToppGene Suite [52] and MSigDB [54].
Cell type enrichment analysis. To our knowledge, there are multiple tools for gene sets enrichment analysis but there is a lack of tools for cell type enrichment analysis. We are unaware of any available tool or knowledge base that can be directly used to predict cell types based on gene expression patterns. Information extraction and knowledge integration by an expert is usually required for this step. To facilitate the general usage of the pipeline, we implemented a cell type enrichment analysis based on gene expression and cell type association data obtained from EBI Expression Atlas. Associations with significant positive experimental support (p-value<0.05) and without negative experimental evidence were used for cell type enrichment analysis. One-tailed Fisher’s exact test was utilized to assert the significance of the association between a specific cell type and the input gene list (cluster specific differentially expressed genes). Data processing and algorithm design for cell type enrichment analysis are described in S3 Text.
Known marker based cell type validation. Once major cell types are assigned to matched cell clusters, biomarkers from the literature are collected and used to cross validate the assignments. At single cell resolution, expression values of individual markers exhibit high intercellular variance, even within closely related cells. In addition, some markers are shared by multiple cell types, such as Acta2 (actin, alpha 2, smooth muscle), commonly used as a marker of myofibroblasts, smooth muscle cells, and pericytes, while some markers are expressed in more specialized cell types, e.g., surfactant proteins are selectively expressed in lung epithelial type II cells. Therefore, at single cell level, reliance on the expression of a single marker for cell type identification is error prone. Using the expression patterns of multiple markers can provide a more reliable validation of a given cell type assignment. In the pipeline, we designed a rank-aggregation-based approach to quantitatively validate the performance of cell type assignments using the collective expression patterns of multiple markers. The approach consists of three steps to validate the assignment of each cell type. We use the validation of the assignment of epithelial cells as an example to illustrate the approach. Let N be the total number of single cells, n out of N cells were assigned as epithelial cells, and m known epithelial markers are used for validation. The rank-aggregation-based approach first generates m individual partial rankings (based on the assumption that a cell with a higher expression of the known epithelial marker is more likely to be an epithelial cell), then it aggregates the m individual partial rankings to produce a global ranking [55]. Cells with a high global ranking shall have high expression of multiple epithelial markers, and thus have high likelihood of being epithelial cells. The last step of the approach is to validate the accuracy of cell assignment using Receiver Operating Characteristic curve (ROC curve). Specifically, the “n” defined epithelial cells are considered as positive instances and the remaining cells are used as negative instances; then a ROC curve of the global ranking can be generated, and the area under the curve (AUC) measures the consistency between the cell type assignment and the global ranking. A high AUC indicates that the cell type assignment is highly consistent with the global ranking of cells based on known markers, and therefore, represents a higher accuracy of the cell type assignment.
Cell type specific signature identification
Once we defined cell types, the analysis proceeds with the identification of cell type specific gene signatures and driving forces (key factors that determine the cell identity and activity). We define cell type specific gene signature as a group of genes uniquely or selectively expressed in a given cell type. To identify the signature for each major cell type (i.e., cell cluster), we designed a ranking system to rank genes based on their importance to the intra-cluster similarity and inter-cluster dissimilarity. Four features were used to evaluate the specificity of genes related to each cluster, including common gene metric, unique gene metric, test statistic metric, and synthetic profile similarity metric. A logistic regression model was used to integrate the features to predict the gene signature for each cluster. The features and their integration procedures are described below.
Common gene metric identifies RNAs shared by a given cluster of cells. We consider a common gene (RNA) for a given cell cluster if it is expressed in at least δ percent of cells in the cluster. Using δ percent of cells instead of all cells takes into consideration of the intra-cluster heterogeneity among co-existing cells in the same cell cluster. In the demonstration, we used δ = 80%. One can change the parameter to 100% when dealing with more unified cell clusters. The result of this metric is a binary variable
.
Unique gene metric aims to find RNAs selectively expressed in a given cluster of cells. We consider a gene as a unique gene for a given cell cluster if the mean expression of this gene in the cluster cells is at least α times higher than the expression of this gene in η quantile of all the other cells. Using the η quantile value instead of the max value allows the metric to tolerate a small amount of exceptionally high expression (outliers). In the demonstration, we used α = 2 and η = 0.85. The result of this metric is a binary variable
.
Test statistic metric identifies RNAs differentially expressed in a given cell cluster by using a two-group statistical test of gene expression between cluster cells and all the other cells. It assigns a test statistic metric value
to each gene i for each cluster cl. To obtain a normalized and smoothened test statistic value, we define
as
, where
is the p-value derived from the differential expression analysis of gene i in cluster cl using either one-tailed Welch’s t-test or one-tailed Wilcoxon rank sum test. In the demonstration, we used Welch’s t-test when the sizes of both groups were greater than 5; otherwise, Wilcoxon rank sum test was used instead.
Synthetic profile similarity metric . For a given cluster cl, we construct
, a synthetic reference profile of gene expression in cl (S4 Text); and measure the synthetic profile similarity metric for gene i in cl as
, the Pearson’s correlation between
(gene i’s expression profile in cl) and
.
Model based cell type specific gene signature prediction. The four metrics are a mixture of continuous and categorical variables and capture different features of gene expression profiles, so we used a logistic regression model to integrate metrics for the prediction of cell type specific gene signatures. Given ,
,
,
, the probability of gene i being a signature gene for cluster cl is given by a logistic regression function as follows:
(4)
Model parameters ,
,
,
, and
are obtained using cell type specific training sets. In each training set, positive instances are comprised of known signature genes and negative instances are genes that are non-differentially-expressed (i.e., low
) and are neither common nor unique for the given cell cluster (i.e.,
). We chose similar numbers of negative and positive instances for the class balance of the training set. Once the ranking models are established, they are used to predict cell type specific signature genes from the total number of cluster specific differentially expressed genes.
Repeated random subsampling for validation of signature prediction. Lack of a gold standard (i.e. gene sets represent true positives and true negatives) for performance evaluation is a general problem in bioinformatics. The paucity of cell type specific markers (especially for rare or novel cell types) represents a major challenge in our analysis. To overcome this problem, a repeated random subsampling approach was used to evaluate the performance of cell type specific signature prediction. In this approach, the validation of the signature prediction for each cluster (e.g., cl) involves r repetitions; in each repetition, we randomly sample 80% of the cells from cl, re-perform signature prediction for cl using those sampled cells, use the newly predicted signature to train k– 1 (k is the total number of cell clusters/cell types) binary classifiers (each receives 80% of cells from cl and 80% of cells from one of the remaining k—1 clusters as the training set, and learns to distinguish the cells from these two clusters), and measure the performance of the signature prediction as the classification accuracies of the binary classifiers on the remaining 20% of data; the accuracies are averaged over r repetitions. We demonstrated the procedures of training, prediction, and validation of the gene signature ranking system for each cell type in the Results and Discussion section.
Cell type specific driving force analysis
Identification of the key regulators controlling cell fate/activities is fundamentally important for understanding complex biological systems. In the present study, we prioritize and identify key transcription factors (TFs) regulating the expression of cell type specific regulatory target genes. By utilizing a transcriptional regulatory network (TRN) approach, we establish the relationships between TFs and target genes on the basis of their expression-based regulatory potential and identify the key TFs for a given cell type by measuring the importance of each node in the constructed TRN. Unlike traditional TRNs derived from whole-organ or whole-tissue data, which inevitably target a mixed genomic response, we tailor TRN reconstruction using the expression patterns of genes representing a specific cell type at a specific developmental time point, and require that TFs be expressed with their potential regulatory targets in the same cell type. Our approach enables the construction of high resolution TRN at single cell level. The method consists of three main steps as illustrated in the following.
(1) Identification of candidate TFs and regulatory targets for TRN construction. For cluster cl, we first extract a candidate set of cell type specific regulatory targets Gl and a candidate set of TFs Tl for network construction. Gl can be the differentially expressed genes or the predicted signature genes identified from the previous steps. Tl consists of TFs that are either differentially expressed in cl or common in cl (based on the common gene metric), and verified as a TF or transcription cofactor by TF databases, e.g., MatBase (Release 9.1) of Genomatix (https://www.genomatix.de) in our demonstration.
(2) Development of cell type specific TRN. Using the expression profiles of Gl and Tl in the cells of cluster cl, we construct a TRN Hl = 〈Vl,Dl〉, where Vl ⊆ {Tl ∪ Gl} is the set of nodes in the network and Dl ⊆ Tl × Gl is the set of edges in the network, representing the regulatory interactions between Tl and Gl in the network. We focus on identifying the interactions between TF-TF and TF-TG. The possible feedback regulation from target genes to TFs and TF auto-regulations are not considered in the present work. Interactions are established based on first-order conditional dependence of gene expression, adapted from the inference of first-order conditional dependence Directed Acyclic Graph (DAG) in [56]. Let denote the expression profile of gene i ⊆ {Tl ∪ Gl} in cells of cluster cl. The significance of a regulatory interaction between i ∈ Tl and j ∈ Gl is evaluated via the first-order conditional dependence between the two random variables
and
given any other variable
, where k ∈ Tl and k ≠ i. Assuming linear dependence, the relation between three variables is formulated as
, where
and
are linearly independent, and errors are under normal distribution and not correlated. The coefficients,
and
, are estimated using the Least Square estimator. The significance of an edge between i and j is measured by
, where
is the p-value derived from the one-sample t-test under the null hypothesis “
”.
represents the maximum probability of falsely rejecting the null hypothesis if it is in fact true. The smaller the
, the more significant the edge (i, j) for Hl. In the demonstration, we used 0.05 as the cutoff of
. Conditional dependence graphical models (e.g., Bayesian network) are widely used for constructing TRNs [57]. These models handle noisy data sets robustly, can simultaneously model non-linear combinatorial relations, and guard against over-fitting [58]. Since biological TRNs are known to be sparse [59], it is assumed that the low-order conditional independencies fit well with the full conditional independence structure between variables and can be accurately estimated with only a small number of observations [60].
(3) Identification of key TFs based on their critical roles in the network. Based on the constructed cell type specific TRN Hl, we identify TFs with high node importance in Hl as cell type specific driving forces. Network node importance is determined by measuring centrality and/or disruption [61,62]. Degree centrality (DC) is the most commonly used node importance metric in biological networks; however, it has its own limitations (e.g., the node importance is measured using a local view of the network (1-hop) and does not take network elements beyond 1-hop into consideration). To overcome the limitations, Borgatti raised the concept that disruption-based centrality can be used to identity key players in a social network for the purpose of disrupting or fragmenting the network by removing key nodes [63]. This concept has been applied to the analysis of node importance in terrorist and social networks [61,64], criminal networks [65], and food webs [66]. In this work, we introduce the integration of six node importance metrics to identify cell type specific driving forces in a mammalian system. The metrics we integrated for the driving force identification are described below.
- Degree Centrality (DC): the number of nodes that a given node is adjacent to. A node with a high degree centrality can potentially influence many others (Hub).
- Closeness Centrality (CC): the sum of geodesic distances from a given node to all others. A node with high closeness centrality should be able to influence many others. The CC of node i in Hl is defined as
, where
is the length of shortest path between node i and node j in Hl.
- Betweenness Centrality (BC): the number of shortest paths that pass through a given node. A node with high betweenness centrality connects many pairs of nodes via the best path. The BC of node i in Hl is defined as
, where
is the number of shortest paths between node j and node k in Hl and
is the number of those paths passing through i other than j and k.
- Disruptive Fragmentation Centrality (DFC): the impact of the removal of a node on the fragmentation of the residual network. The DFC of node i in Hl is defined as
, where
is the number of connected components in Hl after removing node i and Nl is the total number of nodes in Hl.
- Disruptive Connection Centrality (DCC): the impact of the removal of node i on the nodes connection in the residual network. The DCC of node i in Hl is defined
, where
if node j can reach node k in Hl after removing i; otherwise,
.
- Disruptive Distance Centrality (DDC): the impact of the removal of a node on the shortest path between nodes in the residual network. The DDC of node i in Hl is defined as
, where
denotes the length of the shortest path from node i to node k in Hl after removing i.
We collect the values of the six metrics for each TF in Hl, rank TFs in the descending order of each metric (breaking ties by assigning lowest rank to every tied element), and take the average rank of a TF in six metrics as its node importance in Hl.
Pipeline implementation
The entire pipeline is implemented in R. In addition to our own innovation, the pipeline incorporated several R and Bioconductor packages, including ROCR [67] for evaluating and visualizing classifier/prediction performance, RobustRankAggreg [55] for the rank aggregation in validating cell type assignment using the expression patterns of multiple markers, igraph (http://igraph.org) for the implementation of TF importance metrics, G1DBN [56] for the implementation of expression-based regulatory interaction inference, Bioconductor::Biobase [68] for data management, tightClust [47] and ConsensusClustPlus [46] for the implementation of alternative clustering methods for cell cluster identification, and samr for the implementation of SAMseq [35] as an alternative option for differential expression test.
Results and Discussion
Single cells were isolated from protease-dispersed mouse lung at E16.5. Cell suspensions were loaded onto a Fluidigm C1 Single-Cell Auto Prep System. Two independent experiments of 96 chambers single cell RNA-seq have been performed; sequence alignment to the mouse genome using Cufflinks [37]; quality controls were done in CCHMC DNA Core using standard protocols. Fifteen cells were removed for the poor quality and resulted in developing transcriptomes of a total of 148 individual lung cells (86 cells from sample 1 and 62 cells from sample 2). RNA expression values were calculated using the FPKM (Fragments Per Kilobase of transcript per Million mapped reads) method [37]. We set FPKM = 0.01 as the minimal expression and converted all expression values less than 0.01 to 0.01. The expression profiles of 36188 transcripts in 148 cells constituted the input data to our analytic pipeline. The present study focuses on pipeline development and demonstration of the application. Detailed sample preparation, data analysis, and biological interpretations will be presented in a separate manuscript.
Pre-filtering
The specificity filter and expression filter
were applied to the expression profiles of 36188 transcripts and divided the profiles into four sections (S1A Fig). 11180 profiles (Section 1 in S1A Fig) passed both filters and were selected for further analysis. At the cell level, the pre-filtering step increased the correlation of data obtained from two independent single cell preparations (biological replicates) (S1B Fig) and reduced the batch difference of the two replicates (S1C Fig). At the gene level, the linearity of 11180 profiles passing the pre-filtering in Q-Q plot suggests that the data follow a similar distribution after pre-filtering (S1D Fig). MA plots were used for pairwise comparison of log-intensity of samples and identification of intensity-dependent biases. The MA plots before and after filtering demonstrate the efficiency of correction for intensity-dependent biases. Data from 11180 profiles are well balanced around zero and straight across the horizontal axis in MA plots (S1E–S1I Fig). The results indicate that the designed gene pre-filtering processing is useful in reducing batch effects of biological replicates.
Major cell types
Using clustering and differential expression analysis described in the Design and Implementation section, we placed 148 cells into 9 clusters (Fig 2) and identified cluster specific differentially expressed genes. A permutation analysis showed that the derived clustering scheme was statistically significant (p-value = 1.69e-137, S2 Text). The overlap of differentially expressed genes among different clusters was small (S2 Fig), indicating that the current clustering scheme achieved expected modularity and separation, and that the differential expression analysis procedure was an effective approach. Differentially expressed genes in each cluster were subjected to functional enrichment analysis and cell type mapping using ToppGene Suite [52], DAVID Bioinformatics Resources [1,53], EBI Expression Atlas (http://www.ebi.ac.uk/gxa), MSigDB [54], and Genecards (http://www.genecards.org). We identified the major lung cell types at E16.5 (Fig 2), including (C1) proliferative fibroblast, (C2) myofibroblast/smooth muscle-like cells, (C3) pericyte, (C5) matrix fibroblast, (C7) endothelial cells, (C8) myeloid/immune cells, and (C9) epithelial cells, based on integrated information of most enriched GO terms, mouse phenotypes, pathways, co-expressed gene sets, and transcription factor binding sites (S3–S9 Figs and S1 Table). For example, Cluster C3 was defined as “pericytes” based on the co-expression of gene markers (S10 Fig), including Pdgfrb (platelet derived growth factor receptor, beta polypeptide), Dlk1 (delta-like 1 homolog), Rgs5 (regulator of G-protein signaling 5), Cspg4 (chondroitin sulfate proteoglycan 4), Mcam (melanoma cell adhesion molecule), and Notch3 (notch 3) (literature support in S2 Table). To validate the cell type assignment, we collected a set of known markers to serve as a training set based on their functional association with lung development/diseases and their cell specific expression (S2 Table). Selective expression patterns of the representative gene markers of different lung cell types were shown in S11 Fig and Fig 3.
Cells (n = 148) from two sample preparations from fetal mouse lung at E16.5 were assigned into 9 clusters via hierarchical clustering using average linkage and centered Pearson’s correlation. Each color represents a distinct cell cluster, labeled as C1-C9. The rectangles represent single lung cells from the first preparation and the ellipses consist of single cells from a second independent preparation. Connection lines indicate the z-score correlation between the two cells > = 0.05. The blue lines connect cells within the same preparation, while the red lines connect cells across preparations.
(A) Expression patterns of representative known cell type markers were used to validate the correct assignment of major lung cell types at E16.5. Expression levels were normalized by per-sample z-score transformation. (B) ROC curves of the rank-aggregation-based validation showed a high consistency (AUC>0.8) between the cell type assignments and the expression patterns of known cell type specific markers (S2 Table).
We used the cell type enrichment analysis to cross validate the cell type assignment for each cluster. The most enriched cell types for the endothelial (C7), immune cell (C8), and epithelial (C9) clusters (Fig 4 and S3 Table) were consistent with our cell type assignments. Results related to four mesenchymal cell clusters were less clear. The most enriched cell types for clusters C2, C3, and C5 (Fig 4 and S3 Table) largely overlapped and shared common annotations, “mesenchymal cell” and “CD45-”, suggesting these cell types may be derived from common progenitors and that the heterogeneity among cell clusters likely represents different transitional stages of differentiation. The enriched cell types for Cluster C1 showed a high frequency of annotations related to proliferation, stem cells, or progenitor cells (S3 Table), suggesting a proliferative, less-differentiated state of the cells in Cluster C1. The lack of a high quality and complete knowledge base for gene and cell type association directly influenced the quality of cell type prediction using our method. The current version of pipeline used open source gene expression data downloaded from EBI Expression Atlas (S3 Text) for cell type annotations; bias and incompleteness from the collection of individual experimental sources are inevitable. Nevertheless, it is the only freely accessible resource for us to run automated cell type predictions. We recommend the use of the cell type enrichment analysis for initial screening, together with curation and knowledge integration by experts to refine the prediction. We foresee that single cell transcriptome analyses will largely improve cell type prediction by providing a high resolution and unbiased cell type separation for lung and other organs.
Information on gene expression in certain cell types were downloaded from EBI Expression Atlas (http://www.ebi.ac.uk/gxa). Results were obtained using differentially expressed genes as the input gene lists. The lengths of the bars represent transformed p-value (−log10 (p)) of highly enriched cell types for each cell cluster, where p is the p-value calculated by one-tailed Fisher’s exact test and represents the degree of a cell type enrichment in a given cell cluster.
Cell type specific gene signature prediction and validation
After mapping the individual lung cell types, we predicted cell type specific gene signatures using a logistic-regression model based ranking systems described in the Design and Implementation section. The training set collection is described in the Design and Implementation section and the collected training instances are presented in S4 Table. As visualized in Fig 5, predicted signature genes (S5 Table) were selectively expressed in defined cell types. Comparative gene set enrichment analysis showed that logistic-regression model based signature prediction enhanced cell type related functional enrichment compared to the use of the same number of differentially expressed genes identified by applying t-test alone (S12 Fig), suggesting that the logistic-regression model based approach represents a refinement of cell type specific signature gene identification. The repeated random subsampling validation (S13 Fig) showed a high accuracy of the predicted cell type specific signature genes in distinguishing cells of the defined cell types from other cell types, demonstrating the capability of the high-performance of the logistic-regression-based ranking models for cell type specific signature gene prediction.
(A) Heatmap shows that the predicted cell type specific signature genes are selectively expressed in defined cell types. Gene expression was per sample z-score normalized. (B) The top 20 signature genes based on the ranking scores for each lung cell type are listed. Genes in red are the known markers that were used to train the signature prediction models.
Epithelial specific driving force analysis
We identified the key TFs controlling the fate of lung epithelial cells at E16.5 by applying the driving force analysis developed for the pipeline. We collected 140 TFs as potential regulators, which were either differentially expressed (p-value<0.05) or commonly expressed (i.e., expressed in at least 80% percent of cells in the cluster) in the epithelial cells in Cluster C9, and were verified as either a transcription factor or a transcription cofactor by MatBase (Release 9.1) of Genomatix (https://www.genomatix.de). Genes (n = 342) differentially expressed (p-value<0.01) in epithelial cells were collected as epithelial specific regulatory targets. Potential regulators (140 genes) and targets (342 genes) constituted the input nodes for epithelial specific transcriptional regulatory network (TRN) construction. The construction was based on the first-order conditional dependence approach described in the Design and Implementation section with a cutoff of . 348 nodes (including 108 TFs) and 432 edges passed this threshold and became the main connected component of the reconstructed epithelial specific TRN (Fig 6A). We then calculated the values of six TF-importance metrics, including Disruptive Fragmentation Centrality (DFC), Disruptive Connection Centrality (DCC), Disruptive Distance Centrality (DDC), Degree Centrality (DC), Closeness Centrality (CC), and Betweenness Centrality (BC), for the 108 TFs and ranked them based on their node importance (average rank in the six metrics) in the main connected component of epithelial specific TRN. The top 20 most important TFs in the lung epithelial cell network are presented in Table 1. The full ranking of 108 TFs can be found in S6 Table. Hopx (HOP Homeobox) and Nkx2-1 (NK2 homeobox 1) were ranked at the top as key regulators in the epithelial cell cluster. Nkx2-1 is known to be a core TF critical for early differentiation of pulmonary endodermal progenitors and a key regulator of lung morphogenesis and maturation before birth [69–71]. Hopx is directly activated by Nkx2-1 and Gata6 (GATA binding protein 6); in turn, Hopx inhibits Nkx2-1 and Gata6, providing a potential negative feedback loop to regulate expression of surfactant associated genes in the lung epithelium [72]. Loss of Hopx impaired normal pulmonary maturation, causing respiratory failure at birth [73]. The prediction that known type I alveolar cell markers including Pdpn (podoplanin) and Ager (advanced glycosylation end product-specific receptor) are regulated by Hopx (Fig 6B) suggests a potential important role of Hopx as a key regulator for the early differentiation of type I precursors at E16.5 [74]. Expression of Hopx in type I alveolar epithelial cells was supported by Treutlein’s recent study [21]. Other top ranked TFs, including Klf5, Etv5, Mecom, Bclaf1, and Sp1, have associations with lung-related mouse phenotypes (MP:0005388) [75], indicating that they may play important roles in lung development. We further performed a one-tailed Fisher’s exact test and demonstrated that the top 20 most important TFs that we predicted have a significant functional association with lung-related mouse phenotypes (p-value<0.05, S7 Table).
(A) Rank importance of transcription factors (TFs) in the main connected component of epithelial specific transcriptional regulatory network (TRN). The sizes of the TF nodes are proportional to their average-ranked node importance. The main connected component of epithelial TRN is comprised of 348 nodes and 432 edges. The nodes in red are the TFs and the nodes in grey are differentially expressed genes (p-value<0.01) in epithelial cells and are not TFs. The edges were established using the first-order conditional dependence approach described in the Methods section with a cutoff at 0.05. (B) The Hopx local network (the first hop is shown). Hopx was the top ranked TF identified by driving force analysis (Table 1).
We used three disruption-based centrality metrics (DFC, DCC, and DDC) and three centrality metrics (DC, CC, and BC) to measure node importance in a given TRN. To estimate the performance of individual metrics in the combined ranking, we designed two measurements: sensitivity and relative power. Sensitivity is defined as the average tie width of a ranking generated by a metric. The width of a tie in a TF ranking is the number of TFs with the same rank. The lower the sensitivity, the less likely that metric is capable of distinguishing the importance of individual TFs. Relative power measures the relative contribution of each metric in the integrated ranking system. The higher the relative power, the larger role the given metric may play in the ranking. By using an integrated ranking system, we expect that each metric provides a local view of the ground-truth ranking and is complementary to other metrics; as a consequence, the integrated system takes into account of individual metrics and provides a global view of the desired ranking. S14 Fig shows that no two metrics share the prediction of the common top 20 most important TFs. While each metric contributed to a similar degree to the consensus prediction of the top 20 most important TFs in the lung epithelial TRN; the sensitivity of the each metric is quite different: DDC, CC, and BC (measures the node importance at a fine-grained resolution) were more sensitive than DFC, DCC, and DC (measures the node importance at a coarse resolution, such as component, degree, or pairwise connection level). While the metrics with high sensitivity measure the global importance of a node, metrics with low sensitivity have advantages in capturing unique aspects of the node importance in sparse TRNs; for example, DFC and DC measure the importance of a TF in a TRN from the perspective of the number of targets specific to the TF in the TRN. The computational design of the sensitivity and the relative power measurements are elaborated in S5 Text.
Inferring TRNs from gene expression data is difficult because of the high number of genes relative to the small number of samples/conditions, and the random noise presented in data. Recent studies on TRN development and refinement support the concept that regulatory network inference can be largely improved by integrating different types of data [76] and biological knowledge [77]. Our pipeline is capable of constructing TRN based on the RNA expression data alone (as demonstrated in epithelial specific TRN construction, Fig 6), as well as using integrated data and knowledge resources for network refinement. We implanted a consensus maximization framework [78] in the pipeline to integrate data, method, and external knowledge for TRN construction at the decision level. As a demonstration, we applied this strategy to improve the prediction of Nkx2-1 target genes in epithelial cells by integration of expression-based predictions, Nkx2-1 ChIP-seq results [79] and literature evidence (S6 Text) to reach a maximal consensus score. The ranks of known Nkx2-1 targets, including Cldn18 [80], Sftpb [81–87], Sftpc [86,88,89], and Hopx [73], were largely improved via this optimization (Table 2 and S8 Table). Users can combine their own data resources (e.g., RNA-seq and ChIP-seq) for the TFs of interest in the TRN or collect useful information from ENCODE (https://www.encodeproject.org) and other public domains to optimize network and TF-TG predictions.
Methodologies comparison and evaluation
Cell type identification and characterization is a key and unique task for scRNA-seq analysis, especially for single cells isolated from heterogeneous cell population or whole organ/tissue as in the present study. Most single cell studies used hierarchical clustering or PCA-like methods or the combination of the two [21,28–31]. Recently, a number of methods specifically designed for scRNA-seq analysis have been introduced. SNN-Cliq employed a secondary similarity based on the shared nearest neighbor in combination with the initial Euclidean distance similarity, outperformed other clustering methods tested and predicted cell types or origins with high accuracy [32]. scLVM (single-cell latent variable model), utilized a two-step approach to address the effect of unobserved factors on gene expression heterogeneity (e.g., confounding effects of the cell cycle), thereby the downstream analyses can be independent of the cell cycle effect. Using this algorithm, the authors identified hidden subpopulations of cells that otherwise cannot be identified [27]. BackSPIN, a divisive biclustering method based on sorting points into neighborhoods, can avoid unnecessary cluster fragmentation (common in hierarchical clustering) by simultaneously clustering genes and cells [33].
We performed a comparative evaluation of SINCERA with three recently available single-cell RNA-seq analysis tools, SNN-Cliq [32], scLVM [27] and SINGuLAR Analysis Toolset (https://cn.fluidigm.com/software), using three single cell data sets produced by different techniques from a variety of contexts in human and mouse, including the E16.5 mouse lung single cells (n = 148) used in the demonstration of the present work, human embryonic cells (n = 90) from Yan et al. [28], and E18.5 mouse lung Epcam+ epithelial cells (n = 80) from Treutlein et al. [21]. The functionality of the tools (SINCERA, SINGuLAR, SNN-Cliq, and scLVM) does not totally overlap; SINCERA is the most comprehensive one. The common function shared among all the tools is the cell cluster identification. We thereby compared the different approaches for cell cluster identification using single cell datasets from three independent studies. Through the comparative analysis, we showed that SNN-Cliq achieved the best performance in the human embryonic dataset [28], SINCERA achieved the best performance in E18.5 mouse lung Epcam+ epithelial cells [21] and E16.5 mouse whole lung dataset. SINCERA may not always be the best way, but it is generally applicable to different datasets to identify biological meaningful major cell clusters from single cell RNA-seq data (see S7 Text for detailed comparison).
In addition to clustering and cell type identification, SINCERA provides a more comprehensive toolset than current available tools for downstream functional analysis, network construction and key nodes identification. Some of the functions are unique and novel for SINCERA. For example, in contrast to most of RNA-seq studies identifying differentially expressed genes using parametric or nonparametric test, we developed a logistic regression based ranking model to predict cell type specific signature genes and we have shown that the model out-performs traditional t-test. To our knowledge, there are multiple tools for Gene Sets Enrichments analysis but a paucity of tools for cell type enrichment analysis. This motivated us to build up an automated “Cell Type Enrichment Analysis” based on collected gene expression information in certain cell types (S3 Text). For the network driving force prediction, we introduced disruption-based centrality metrics in combine with commonly used centrality metrics to predict cell type specific transcriptional regulatory driving force. For cell type assignment validation, we designed a rank aggregation and ROC based approach to quantitatively assess the accuracy of the cell type assignment using a panel of known cell type markers.
Conclusion
Recent advances in single-cell next-generation RNA and DNA sequencing provide the opportunity to conduct the genomic/transcriptomic analysis of complex organs at single cell resolution. We have developed an analytic pipeline to facilitate processing single-cell RNA-seq data from heterogeneous cell populations (using whole lung in the demonstration). The proposed pipeline identified major lung cell types, cell type specific gene signatures, and key regulators for specific cell types from the fetal mouse lung at E16.5. The pipeline provides a panel of analytic tools for users to conduct data filtering, normalization, clustering, cell type identification, and gene signature prediction, TRN construction and important regulatory node identification. The pipeline enables RNA-seq analysis from heterogeneous single cell preparations after the nucleotide sequence reads are aligned to the genome of interest. SINCERA is under on-going development in parallel with the expanding of the single cell studies generated by the CCHMC LungMAP research center (http://lungmap.net). More complex tools will be developed to facilitate access/analysis/integration of the “omic” data.
Availability and Future Directions
The source code of SINCERA with reproducible demonstrations can be found at CCHMC PBGE website, https://research.cchmc.org/pbge/sincera.html, and we are in the process of submitting the package to Bioconductor as well. The source code is licensed under GNU General Public License v3. The raw data have been submitted to GEO (http://www.ncbi.nlm.nih.gov/geo/, Accession number GSE69761). The interpreted data from this study have been provided to research centers and are publically available via our website (https://research.cchmc.org/pbge/lunggens/default.html) and LungMAP website (http://lungmap.net).
Supporting Information
S1 Fig. Pre-filtering Reduced Batch Effects and Improved Correlations among Biological Replicates.
(A) The selection criteria divided the entire gene expression profiles into four sections: genes in Section 1 (red) passed both expression level and cell specificity filters, genes in Section 2 (blue) passed expression filter but failed to pass the specificity filter, genes in Section 3 (green) did not pass the expression filter, and genes in Section 4 (black) passed the expression filter for one sample but failed for the other. (B) Inter-sample cell correlation before (36188 profiles) and after (11180 profiles of Section 1) the pre-filtering. (C) Inter-sample cell distance before (36188 profiles) and after (11180 profiles of Section 1) the pre-filtering. The calculation of inter-sample cell correlation and inter-sample cell distance is elaborated in (S1 Text). (D) Q-Q plot of the selected 11180 profiles. (E) MA plot of 36188 profiles, M (intensity ratio) and A (average intensity). (F) MA plot of the selected 11180 profiles (Section 1). (G) MA plot of profiles in Section 2. (H) MA plot of profiles in Section 3. (I) MA plot of profiles in Section 4. In all MA plots, the M-value and A-value for a gene i is calculated by and
respectively, where
represents the mean FPKM of i in the cells in Sample 1 and
represents the mean FPKM of i in the cells in Sample 2.
https://doi.org/10.1371/journal.pcbi.1004575.s001
(TIF)
S2 Fig. Overlaps of Cluster Specific Differentially Expressed Genes.
https://doi.org/10.1371/journal.pcbi.1004575.s002
(TIF)
S3 Fig. Enriched Functional Annotations for Cell Cluster C1 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C1 (p-value<0.01) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s003
(TIF)
S4 Fig. Enriched Functional Annotations for Cell Cluster C2 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C2 (p-value<0.01) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s004
(TIF)
S5 Fig. Enriched Functional Annotations for Cell Cluster C3 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C3 (p-value<0.03) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s005
(TIF)
S6 Fig. Enriched Functional Annotations for Cell Cluster C5 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C5 (p-value<0.01) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s006
(TIF)
S7 Fig. Enriched Functional Annotations for Cell Cluster C7 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C7 (p-value<0.01) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s007
(TIF)
S8 Fig. Enriched Functional Annotations for Cell Cluster C8 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C8 (p-value<0.01) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s008
(TIF)
S9 Fig. Enriched Functional Annotations for Cell Cluster C9 Using Cluster Specific Differentially Expressed Genes.
The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using differentially expressed genes in C9 (p-value<0.01) as the input gene list.
https://doi.org/10.1371/journal.pcbi.1004575.s009
(TIF)
S10 Fig. Cluster C3 was Defined as “Pericyte” based on the Co-expression of Gene Markers.
The following pericyte markers were collected for the cell type assignment, including Pdgfrb, Dlk1, Rgs5, Cspg4, Mcam, and Notch3 (literature support in S2 Table). (A) The collected pericyte markers showed their highest mean expression levels in Cluster C3. (B) The collected pericyte markers were differentially expressed in Cluster C3. P-values were obtained from differential expression analysis described in the Methods section.
https://doi.org/10.1371/journal.pcbi.1004575.s010
(TIF)
S11 Fig. The Expression Patterns of the Collected Cell Type Markers in 148 Lung Single Cells.
Expression levels were per-sample z-score transformed. Literature support is in S2 Table.
https://doi.org/10.1371/journal.pcbi.1004575.s011
(TIF)
S12 Fig. Signature Prediction Enhanced Cell Type Related Functional Enrichment.
White bars represent the enrichment using top (n = 100) differentially expressed genes based on t-test, and black bars represent the enrichment using top (n = 100) predicted signature genes derived from the logistic-regression model. Gene set enrichment analysis was performed using ToppGene suite (https://toppgene.cchmc.org). X-axis represents the Benjamini–Hochberg adjusted p-values (-log2 transformed) of functional enrichments.
https://doi.org/10.1371/journal.pcbi.1004575.s012
(TIF)
S13 Fig. Validation of Cell Type Specific Signature Prediction.
The repeated random subsampling approach described in Design and Implementation was used to validate the performance of signature prediction. Each row represents the classification accuracy (average ± standard error) of the predicted cluster specific signature in distinguishing the cluster cells and the cells from each of the other clusters. For example, row 1 and column 2 means that the predicted signature of cluster C1 achieved 91.9% accuracy (via the construction of a binary classifier) on average (100 repetitions, standard error: 0.015) in distinguishing C1 cells and C2 cells. Support vector machine was used as the binary classification models. 80% of cells from each pair of clusters were used as train sets, and the remaining cells were used as test sets. The average accuracy is 96.5%.
https://doi.org/10.1371/journal.pcbi.1004575.s013
(TIF)
S14 Fig. Evaluation of the Relative Contribution and Sensitivity of the Six TF-Importance Metrics.
(A) Mean-normalized relative power showed that all six TF-importance metrics (DFC, DCC, DDC, DC, CC, and BC) provide similar degree of contributions to the prediction of the top 20 key regulators listed based on the average ranking score. (B) Mean-normalized sensitivity identified the differences in the granularity of the six metrics in distinguishing the importance of each TF. The calculation of the relative power and sensitivity for each metric is elaborated in S5 Text. (C) The overlapping of the top 20 TFs ranked by each metric is shown. Each column represents one of the six metrics and each row represents a TF that was ranked as the top 20 by at least one of the six metrics. TFs in bold were in the top 20 list by the average ranking (Table 1). A black cell indicates the TF was ranked within the top 20 list by the metric while a white cell indicates the TF was not ranked within the top 20 list by the metric e.g., Hopx was commonly predicted by all six metrics as one of the top most important TFs in the E16.5 developing lung.
https://doi.org/10.1371/journal.pcbi.1004575.s014
(TIF)
S1 Text. Calculation of Inter-Sample Cell Correlation and Inter-Sample Cell Distance.
https://doi.org/10.1371/journal.pcbi.1004575.s015
(DOC)
S2 Text. Permutation Analysis for Determining Statistical Significance of Cell Clusters.
https://doi.org/10.1371/journal.pcbi.1004575.s016
(DOC)
S4 Text. Construction of Cluster Specific Synthetic Reference Profile of Gene Expression.
https://doi.org/10.1371/journal.pcbi.1004575.s018
(DOC)
S5 Text. Calculation of Relative Power and Sensitivity of TF-Importance Metrics.
https://doi.org/10.1371/journal.pcbi.1004575.s019
(DOC)
S6 Text. Nkx2-1 ChIP-seq Peak Calling and Literature Evidence Collection.
https://doi.org/10.1371/journal.pcbi.1004575.s020
(DOC)
S1 Table. Enriched Functional Annotations for Each Cluster Using Cluster Specific Differentially Expressed Genes.
The following categories of functional annotations are included: GO: Biological Process, GO: Cellular Component, mouse phenotype, co-expressed gene sets, pathway, and transcription factor binding site. The results were obtained using the ToppGene suite (https://toppgene.cchmc.org) using cluster specific differentially expressed genes as the input gene lists.
https://doi.org/10.1371/journal.pcbi.1004575.s022
(XLSX)
S2 Table. Collection of Lung Cell Type Markers and the Associated Evidence.
https://doi.org/10.1371/journal.pcbi.1004575.s023
(XLSX)
S3 Table. Enriched Cell Types for Each Cluster Using Cluster Specific Differentially Expressed Genes.
The enriched cell types for each cluster were ranked in the increasing order of p-value of one-tailed Fisher’s exact test.
https://doi.org/10.1371/journal.pcbi.1004575.s024
(XLSX)
S4 Table. Training Sets for Cell Type Specific Gene Signature Prediction.
In the training set of each cell type, positive instances are comprised of known cell type markers, and negative instances are genes that are non-differentially-expressed and are neither common nor unique for the given cell type.
https://doi.org/10.1371/journal.pcbi.1004575.s025
(XLSX)
S5 Table. Results of Cell Type Specific Gene Signature Prediction.
The predicted signature genes for each cell type were ranked in the decreasing order of "NORMALIZED PREDICTION SCORE".
https://doi.org/10.1371/journal.pcbi.1004575.s026
(XLSX)
S6 Table. Ranking of 108 Transcription Factors in the Main Connected Component of Epithelial Transcriptional Regulatory Network.
https://doi.org/10.1371/journal.pcbi.1004575.s027
(XLSX)
S7 Table. Evaluation of Lung Functional Association of the Top 20 Predicted Key Regulators for Epithelial Cells.
The lung mouse phenotype annotations were retrieved from MGI database at http://www.informatics.jax.org/mp/annotations/MP:0005388. The significance was obtained using one-tailed Fisher’s exact test.
https://doi.org/10.1371/journal.pcbi.1004575.s028
(XLSX)
S8 Table. Refined Prediction of Regulatory Targets of Nkx2-1.
Targets are ranked in the decreasing order of “Consensus Maximized Score (CM)”. The full set of candidate targets for consensus maximization consisted of genes that are differentially expressed in epithelial cells (p-value<0.01). “Expression based Prediction (EP)” is the output of the first-order conditional dependence inference described in the Methods section. “ChIP-seq” is based on the results of a previous ChIP-seq experiment. “Literature Evidence 1" encodes the literature support from IPA. “Literature Evidence 2” encodes the literature support from Genomatix. “Consensus Maximized Score (CM)” is the output of the consensus maximization.
https://doi.org/10.1371/journal.pcbi.1004575.s029
(XLSX)
S9 Table. Gene Symbols Used in the Manuscript.
https://doi.org/10.1371/journal.pcbi.1004575.s030
(XLSX)
Acknowledgments
We thank Phillip Dexheimer for sequencing alignment and QC, thank Drs. Bruce Aronow, Michael Wagner and Anne Perl for their insightful comments and discussions.
Author Contributions
Conceived and performed the single cell experiments: SSP JAW. Helped generate the lung single cell data: SSP JAW. Conceived and designed the analytic pipeline: YX MG. Analyzed the data: MG HW YX. Developed and implemented R code: MG. Contributed to the writing of the manuscript: MG YX JAW
References
- 1. Huang DW, Sherman BT, Lempicki RA (2009) Systematic and integrative analysis of large gene lists using DAVID bioinformatics resources. Nat Protoc 4: 44–57. pmid:19131956
- 2. Li L, Clevers H (2010) Coexistence of quiescent and active adult stem cells in mammals. Science 327: 542–545. pmid:20110496
- 3. Pujadas E, Feinberg AP (2012) Regulated noise in the epigenetic landscape of development and disease. Cell 148: 1123–1131. pmid:22424224
- 4. Neildez-Nguyen TM, Parisot A, Vignal C, Rameau P, Stockholm D, Picot J, Allo V, Le Bec C, Laplace C, Paldi A (2008) Epigenetic gene expression noise and phenotypic diversification of clonal cell populations. Differentiation 76: 33–40. pmid:17825084
- 5. Raj A, van Oudenaarden A (2008) Nature, nurture, or chance: stochastic gene expression and its consequences. Cell 135: 216–226. pmid:18957198
- 6. Johnston RJ Jr., Desplan C (2010) Stochastic mechanisms of cell fate specification that yield random or robust outcomes. Annu Rev Cell Dev Biol 26: 689–719. pmid:20590453
- 7. Yin H, Marshall D (2012) Microfluidics for single cell analysis. Curr Opin Biotechnol 23: 110–119. pmid:22133547
- 8. Shapiro E, Biezuner T, Linnarsson S (2013) Single-cell sequencing-based technologies will revolutionize whole-organism science. Nat Rev Genet 14: 618–630. pmid:23897237
- 9. Saliba AE, Westermann AJ, Gorski SA, Vogel J (2014) Single-cell RNA-seq: advances and future challenges. Nucleic Acids Res 42: 8845–8860. pmid:25053837
- 10. Guo G, Huss M, Tong GQ, Wang C, Li Sun L, Clarke ND, Robson P (2010) Resolution of cell fate decisions revealed by single-cell gene expression analysis from zygote to blastocyst. Dev Cell 18: 675–685. pmid:20412781
- 11. Tang F, Barbacioru C, Wang Y, Nordman E, Lee C, Xu N, Wang X, Bodeau J, Tuch BB, Siddiqui A, Lao K, Surani MA (2009) mRNA-Seq whole-transcriptome analysis of a single cell. Nat Methods 6: 377–382. pmid:19349980
- 12. Tang F, Barbacioru C, Bao S, Lee C, Nordman E, Wang X, Lao K, Surani MA (2010) Tracing the derivation of embryonic stem cells from the inner cell mass by single-cell RNA-Seq analysis. Cell Stem Cell 6: 468–478. pmid:20452321
- 13. Qiu S, Luo S, Evgrafov O, Li R, Schroth GP, Levitt P, Knowles JA, Wang K (2012) Single-neuron RNA-Seq: technical feasibility and reproducibility. Front Genet 3: 124. pmid:22934102
- 14. Ramskold D, Luo S, Wang YC, Li R, Deng Q, Faridani OR, Daniels GA, Khrebtukova I, Loring JF, Laurent LC, Schroth GP, Sandberg R (2012) Full-length mRNA-Seq from single-cell levels of RNA and individual circulating tumor cells. Nat Biotechnol 30: 777–782. pmid:22820318
- 15. Islam S, Kjallquist U, Moliner A, Zajac P, Fan JB, Lonnerberg P, Linnarsson S (2011) Characterization of the single-cell transcriptional landscape by highly multiplex RNA-seq. Genome Res 21: 1160–1167. pmid:21543516
- 16. Narsinh KH, Sun N, Sanchez-Freire V, Lee AS, Almeida P, Hu S, Jan T, Wilson KD, Leong D, Rosenberg J, Yao M, Robbins RC, Wu JC (2011) Single cell transcriptional profiling reveals heterogeneity of human induced pluripotent stem cells. J Clin Invest 121: 1217–1221. pmid:21317531
- 17. Shalek AK, Satija R, Adiconis X, Gertner RS, Gaublomme JT, Raychowdhury R, Schwartz S, Yosef N, Malboeuf C, Lu D, Trombetta JJ, Gennert D, Gnirke A, Goren A, Hacohen N, Levin JZ, Park H, Regev A (2013) Single-cell transcriptomics reveals bimodality in expression and splicing in immune cells. Nature 498: 236–240. pmid:23685454
- 18. Wills QF, Livak KJ, Tipping AJ, Enver T, Goldson AJ, Sexton DW, Holmes C (2013) Single-cell gene expression analysis reveals genetic associations masked in whole-tissue experiments. Nat Biotechnol 31: 748–752. pmid:23873083
- 19. Satija R, Farrell JA, Gennert D, Schier AF, Regev A (2015) Spatial reconstruction of single-cell gene expression data. Nat Biotechnol 33: 495–502. pmid:25867923
- 20. Pettit JB, Tomer R, Achim K, Richardson S, Azizi L, Marioni J (2014) Identifying cell types from spatially referenced single-cell expression datasets. PLoS Comput Biol 10: e1003824. pmid:25254363
- 21. Treutlein B, Brownfield DG, Wu AR, Neff NF, Mantalas GL, Espinoza FH, Desai TJ, Krasnow MA, Quake SR (2014) Reconstructing lineage hierarchies of the distal lung epithelium using single-cell RNA-seq. Nature 509: 371–375. pmid:24739965
- 22. Vaughan AE, Brumwell AN, Xi Y, Gotts JE, Brownfield DG, Treutlein B, Tan K, Tan V, Liu FC, Looney MR, Matthay MA, Rock JR, Chapman HA (2015) Lineage-negative progenitors mobilize to regenerate lung epithelium after major injury. Nature 517: 621–625. pmid:25533958
- 23. Kim JK, Marioni JC (2013) Inferring the kinetics of stochastic gene expression from single-cell RNA-sequencing data. Genome Biol 14: R7. pmid:23360624
- 24. Brennecke P, Anders S, Kim JK, Kolodziejczyk AA, Zhang X, Proserpio V, Baying B, Benes V, Teichmann SA, Marioni JC, Heisler MG (2013) Accounting for technical noise in single-cell RNA-seq experiments. Nat Methods 10: 1093–1095. pmid:24056876
- 25. Kharchenko PV, Silberstein L, Scadden DT (2014) Bayesian approach to single-cell differential expression analysis. Nat Methods 11: 740–742. pmid:24836921
- 26. Trapnell C, Cacchiarelli D, Grimsby J, Pokharel P, Li S, Morse M, Lennon NJ, Livak KJ, Mikkelsen TS, Rinn JL (2014) The dynamics and regulators of cell fate decisions are revealed by pseudotemporal ordering of single cells. Nat Biotechnol 32: 381–386. pmid:24658644
- 27. Buettner F, Natarajan KN, Casale FP, Proserpio V, Scialdone A, Theis FJ, Teichmann SA, Marioni JC, Stegle O (2015) Computational analysis of cell-to-cell heterogeneity in single-cell RNA-sequencing data reveals hidden subpopulations of cells. Nat Biotechnol 33: 155–160. pmid:25599176
- 28. Yan L, Yang M, Guo H, Yang L, Wu J, Li R, Liu P, Lian Y, Zheng X, Yan J, Huang J, Li M, Wu X, Wen L, Lao K, Qiao J, Tang F (2013) Single-cell RNA-Seq profiling of human preimplantation embryos and embryonic stem cells. Nat Struct Mol Biol 20: 1131–1139. pmid:23934149
- 29. Xue Z, Huang K, Cai C, Cai L, Jiang CY, Feng Y, Liu Z, Zeng Q, Cheng L, Sun YE, Liu JY, Horvath S, Fan G (2013) Genetic programs in human and mouse early embryos revealed by single-cell RNA sequencing. Nature 500: 593–597. pmid:23892778
- 30. Usoskin D, Furlan A, Islam S, Abdo H, Lonnerberg P, Lou D, Hjerling-Leffler J, Haeggstrom J, Kharchenko O, Kharchenko PV, Linnarsson S, Ernfors P (2015) Unbiased classification of sensory neuron types by large-scale single-cell RNA sequencing. Nat Neurosci 18: 145–153. pmid:25420068
- 31. Darmanis S, Sloan SA, Zhang Y, Enge M, Caneda C, Shuer LM, Hayden Gephart MG, Barres BA, Quake SR (2015) A survey of human brain transcriptome diversity at the single cell level. Proc Natl Acad Sci U S A 112: 7285–7290. pmid:26060301
- 32. Xu C, Su Z (2015) Identification of cell types from single-cell transcriptomes using a novel clustering method. Bioinformatics 31: 1974–1980. pmid:25805722
- 33. Zeisel A, Munoz-Manchado AB, Codeluppi S, Lonnerberg P, La Manno G, Jureus A, Marques S, Munguba H, He L, Betsholtz C, Rolny C, Castelo-Branco G, Hjerling-Leffler J, Linnarsson S (2015) Brain structure. Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq. Science 347: 1138–1142. pmid:25700174
- 34. Katayama S, Tohonen V, Linnarsson S, Kere J (2013) SAMstrt: statistical test for differential expression in single-cell transcriptome with spike-in normalization. Bioinformatics 29: 2943–2945. pmid:23995393
- 35. Li J, Tibshirani R (2013) Finding consistent patterns: a nonparametric approach for identifying differential expression in RNA-Seq data. Stat Methods Med Res 22: 519–536. pmid:22127579
- 36. Marco E, Karp RL, Guo G, Robson P, Hart AH, Trippa L, Yuan GC (2014) Bifurcation analysis of single-cell gene expression data reveals epigenetic landscape. Proc Natl Acad Sci U S A 111: E5643–5650. pmid:25512504
- 37. Trapnell C, Williams BA, Pertea G, Mortazavi A, Kwan G, van Baren MJ, Salzberg SL, Wold BJ, Pachter L (2010) Transcript assembly and quantification by RNA-Seq reveals unannotated transcripts and isoform switching during cell differentiation. Nat Biotechnol 28: 511–515. pmid:20436464
- 38. Li B, Dewey CN (2011) RSEM: accurate transcript quantification from RNA-Seq data with or without a reference genome. BMC Bioinformatics 12: 323. pmid:21816040
- 39. Kim D, Pertea G, Trapnell C, Pimentel H, Kelley R, Salzberg SL (2013) TopHat2: accurate alignment of transcriptomes in the presence of insertions, deletions and gene fusions. Genome Biol 14: R36. pmid:23618408
- 40. Trapnell C, Pachter L, Salzberg SL (2009) TopHat: discovering splice junctions with RNA-Seq. Bioinformatics 25: 1105–1111. pmid:19289445
- 41. Li H, Durbin R (2009) Fast and accurate short read alignment with Burrows-Wheeler transform. Bioinformatics 25: 1754–1760. pmid:19451168
- 42. Yanai I, Benjamin H, Shmoish M, Chalifa-Caspi V, Shklar M, Ophir R, Bar-Even A, Horn-Saban S, Safran M, Domany E, Lancet D, Shmueli O (2005) Genome-wide midrange transcription profiles reveal expression level relationships in human tissue specification. Bioinformatics 21: 650–659. pmid:15388519
- 43. Dudoit S, Yang YH, Callow MJ, Speed TP (2002) Statistical methods for identifying differentially expressed genes in replicated cDNA microarray experiments. Statistica Sinica. 111–140 p.
- 44. Wilk MB, Gnanadesikan R (1968) Probability plotting methods for the analysis of data. Biometrika 55: 1–17. pmid:5661047
- 45. Monti S, Tamayo P, Mesirov JP, Golub TR (2003) Consensus Clustering: A Resampling-Based Method for Class Discovery and Visualization of Gene Expression Microarray Data. Machine Learning 52: 91–118.
- 46. Wilkerson MD, Hayes DN (2010) ConsensusClusterPlus: a class discovery tool with confidence assessments and item tracking. Bioinformatics 26: 1572–1573. pmid:20427518
- 47. Tseng GC, Wong WH (2005) Tight clustering: a resampling-based approach for identifying stable and tight patterns in data. Biometrics 61: 10–16. pmid:15737073
- 48. Ward JH Jr (1963) Hierarchical Grouping to Optimize an Objective Function. Journal of the American Statistical Association 58: 236–244.
- 49. Welch BL (1947) The generalisation of student's problems when several different population variances are involved. Biometrika 34: 28–35. pmid:20287819
- 50. Macklin MT, Mann HB (1947) Fallacies inherent in the proband method of analysis of human pedigrees for inheritance of recessive traits; two methods of correction of the formula. Am J Dis Child 74: 456–467. pmid:18896867
- 51. Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. Journal of the Royal Statistical Society Series B 57: 289–300.
- 52. Chen J, Bardes EE, Aronow BJ, Jegga AG (2009) ToppGene Suite for gene list enrichment analysis and candidate gene prioritization. Nucleic Acids Res 37: W305–311. pmid:19465376
- 53. Huang DW, Sherman BT, Lempicki RA (2009) Bioinformatics enrichment tools: paths toward the comprehensive functional analysis of large gene lists. Nucleic Acids Res 37: 1–13. pmid:19033363
- 54. Subramanian A, Tamayo P, Mootha VK, Mukherjee S, Ebert BL, Gillette MA, Paulovich A, Pomeroy SL, Golub TR, Lander ES, Mesirov JP (2005) Gene set enrichment analysis: a knowledge-based approach for interpreting genome-wide expression profiles. Proc Natl Acad Sci U S A 102: 15545–15550. pmid:16199517
- 55. Kolde R, Laur S, Adler P, Vilo J (2012) Robust rank aggregation for gene list integration and meta-analysis. Bioinformatics 28: 573–580. pmid:22247279
- 56. Lebre S (2009) Inferring dynamic genetic networks with low order independencies. Stat Appl Genet Mol Biol 8: Article 9.
- 57. Marbach D, Costello JC, Kuffner R, Vega NM, Prill RJ, Camacho DM, Allison KR, Kellis M, Collins JJ, Stolovitzky G (2012) Wisdom of crowds for robust gene network inference. Nat Methods 9: 796–804. pmid:22796662
- 58.
Yu J, Smith VA, Wang PP, Hartemink EJ, Jarvis ED (2002) Using Bayesian network inference algorithms to recover molecular genetic regulatory networks. International Conference on Systems Biology.
- 59. Leclerc RD (2008) Survival of the sparsest: robust gene networks are parsimonious. Mol Syst Biol 4: 213. pmid:18682703
- 60. Wille A, Buhlmann P (2006) Low-order conditional independence graphs for inferring genetic networks. Stat Appl Genet Mol Biol 5: Article1.
- 61. Borgatti SP, Mehra A, Brass DJ, Labianca G (2009) Network Analysis in the Social Sciences. Science 323: 892–895. pmid:19213908
- 62. Hahn MW, Kern AD (2005) Comparative genomics of centrality and essentiality in three eukaryotic protein-interaction networks. Mol Biol Evol 22: 803–806. pmid:15616139
- 63.
Borgatti SP (2003) The Key Player Problem. In: Breiger R, Carley K, Pattison P, editors. Dynamic Social Network Modeling and Analysis: Workshop Summary and Papers: National Academy of Sciences Press. pp. 241–252.
- 64. Borgatti SP (2006) Identifying sets of key players in a social network. Computational & Mathematical Organization Theory 12: 21–34.
- 65. Schwartz D, Rouselle T (2009) Using social network analysis to target criminal networks. Trends in Organized Crime 12: 188–207.
- 66. Jordán F, Liu W-c, Davis AJ (2006) Topological keystone species: measures of positional importance in food webs. Oikos 112: 535–546.
- 67. Sing T, Sander O, Beerenwinkel N, Lengauer T (2005) ROCR: visualizing classifier performance in R. Bioinformatics 21: 3940–3941. pmid:16096348
- 68. Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J (2004) Bioconductor: open software development for computational biology and bioinformatics. Genome Biol 5: R80. pmid:15461798
- 69. Bohinski RJ, Di Lauro R, Whitsett JA (1994) The lung-specific surfactant protein B gene promoter is a target for thyroid transcription factor 1 and hepatocyte nuclear factor 3, indicating common factors for organ-specific gene expression along the foregut axis. Mol Cell Biol 14: 5671–5681. pmid:8065304
- 70. DeFelice M, Silberschmidt D, DiLauro R, Xu Y, Wert SE, Weaver TE, Bachurski CJ, Clark JC, Whitsett JA (2003) TTF-1 phosphorylation is required for peripheral lung morphogenesis, perinatal survival, and tissue-specific gene expression. J Biol Chem 278: 35574–35583. pmid:12829717
- 71. Kimura S, Hara Y, Pineau T, Fernandez-Salguero P, Fox CH, Ward JM, Gonzalez FJ (1996) The T/ebp null mouse: thyroid-specific enhancer-binding protein is essential for the organogenesis of the thyroid, lung, ventral forebrain, and pituitary. Genes Dev 10: 60–69. pmid:8557195
- 72. Xu Y, Wang Y, Besnard V, Ikegami M, Wert SE, Heffner C, Murray SA, Donahue LR, Whitsett JA (2012) Transcriptional programs controlling perinatal lung maturation. PLoS One 7: e37046. pmid:22916088
- 73. Yin Z, Gonzales L, Kolla V, Rath N, Zhang Y, Lu MM, Kimura S, Ballard PL, Beers MF, Epstein JA, Morrisey EE (2006) Hop functions downstream of Nkx2.1 and GATA6 to mediate HDAC-dependent negative regulation of pulmonary gene expression. Am J Physiol Lung Cell Mol Physiol 291: L191–199. pmid:16510470
- 74. Dahlin K, Mager EM, Allen L, Tigue Z, Goodglick L, Wadehra M, Dobbs L (2004) Identification of genes differentially expressed in rat alveolar type I cells. Am J Respir Cell Mol Biol 31: 309–316. pmid:15205179
- 75. Blake JA, Bult CJ, Eppig JT, Kadin JA, Richardson JE, Mouse Genome Database G (2014) The Mouse Genome Database: integration of and access to knowledge about the laboratory mouse. Nucleic Acids Res 42: D810–817. pmid:24285300
- 76. Nazri A, Lio P (2012) Investigating meta-approaches for reconstructing gene networks in a mammalian cellular context. PLoS One 7: e28713. pmid:22253694
- 77. Lo K, Raftery AE, Dombek KM, Zhu J, Schadt EE, Bumgarner RE, Yeung KY (2012) Integrating external biological knowledge in the construction of regulatory networks from time-series expression data. BMC Syst Biol 6: 101. pmid:22898396
- 78. Gao J, Liang F, Fan W, Sun Y, Han J (2013) A Graph-Based Consensus Maximization Approach for Combining Multiple Supervised and Unsupervised Models. IEEE Transactions on Knowledge and Data Engineering 25: 15–28.
- 79. Maeda Y, Tsuchiya T, Hao H, Tompkins DH, Xu Y, Mucenski ML, Du L, Keiser AR, Fukazawa T, Naomoto Y, Nagayasu T, Whitsett JA (2012) Kras(G12D) and Nkx2-1 haploinsufficiency induce mucinous adenocarcinoma of the lung. J Clin Invest 122: 4388–4400. pmid:23143308
- 80. Niimi T, Nagashima K, Ward JM, Minoo P, Zimonjic DB, Popescu NC, Kimura S (2001) claudin-18, a novel downstream target gene for the T/EBP/NKX2.1 homeodomain transcription factor, encodes lung- and stomach-specific isoforms through alternative splicing. Mol Cell Biol 21: 7380–7390. pmid:11585919
- 81. Bondjers C, He L, Takemoto M, Norlin J, Asker N, Hellstrom M, Lindahl P, Betsholtz C (2006) Microarray analysis of blood microvessels from PDGF-B and PDGF-Rbeta mutant mice identifies novel markers for brain pericytes. FASEB J 20: 1703–1705. pmid:16807374
- 82. Li C, Zhu NL, Tan RC, Ballard PL, Derynck R, Minoo P (2002) Transforming growth factor-beta inhibits pulmonary surfactant protein B gene transcription through SMAD3 interactions with NKX2.1 and HNF-3 transcription factors. J Biol Chem 277: 38399–38408. pmid:12161428
- 83. Margana RK, Boggaram V (1997) Functional analysis of surfactant protein B (SP-B) promoter. Sp1, Sp3, TTF-1, and HNF-3alpha transcription factors are necessary for lung cell-specific activation of SP-B gene transcription. J Biol Chem 272: 3083–3090. pmid:9006959
- 84. Wert SE, Dey CR, Blair PA, Kimura S, Whitsett JA (2002) Increased expression of thyroid transcription factor-1 (TTF-1) in respiratory epithelial cells inhibits alveolarization and causes pulmonary inflammation. Dev Biol 242: 75–87. pmid:11820807
- 85. Yan C, Naltner A, Conkright J, Ghaffari M (2001) Protein-protein interaction of retinoic acid receptor alpha and thyroid transcription factor-1 in respiratory epithelial cells. J Biol Chem 276: 21686–21691. pmid:11274148
- 86. Yang MC, Guo Y, Liu CC, Weissler JC, Yang YS (2006) The TTF-1/TAP26 complex differentially modulates surfactant protein-B (SP-B) and -C (SP-C) promoters in lung cells. Biochem Biophys Res Commun 344: 484–490. pmid:16630564
- 87. Yang YS, Yang MC, Wang B, Weissler JC (2001) BR22, a novel protein, interacts with thyroid transcription factor-1 and activates the human surfactant protein B promoter. Am J Respir Cell Mol Biol 24: 30–37. pmid:11152647
- 88. Kelly SE, Bachurski CJ, Burhans MS, Glasser SW (1996) Transcription of the lung-specific surfactant protein C gene is mediated by thyroid transcription factor 1. J Biol Chem 271: 6881–6888. pmid:8636114
- 89. Minoo P, Hu L, Xing Y, Zhu NL, Chen H, Li M, Borok Z, Li C (2007) Physical and functional interactions between homeodomain NKX2.1 and winged helix/forkhead FOXA1 in lung epithelial cells. Mol Cell Biol 27: 2155–2165. pmid:17220277