Influence of Choice of Null Network on Small-World Parameters of Structural Correlation Networks

S. M. Hadi Hosseini; Shelli R. Kesler

doi:10.1371/journal.pone.0067354

Abstract

In recent years, coordinated variations in brain morphology (e.g., volume, thickness) have been employed as a measure of structural association between brain regions to infer large-scale structural correlation networks. Recent evidence suggests that brain networks constructed in this manner are inherently more clustered than random networks of the same size and degree. Thus, null networks constructed by randomizing topology are not a good choice for benchmarking small-world parameters of these networks. In the present report, we investigated the influence of choice of null networks on small-world parameters of gray matter correlation networks in healthy individuals and survivors of acute lymphoblastic leukemia. Three types of null networks were studied: 1) networks constructed by topology randomization (TOP), 2) networks matched to the distributional properties of the observed covariance matrix (HQS), and 3) networks generated from correlation of randomized input data (COR). The results revealed that the choice of null network not only influences the estimated small-world parameters, it also influences the results of between-group differences in small-world parameters. In addition, at higher network densities, the choice of null network influences the direction of group differences in network measures. Our data suggest that the choice of null network is quite crucial for interpretation of group differences in small-world parameters of structural correlation networks. We argue that none of the available null models is perfect for estimation of small-world parameters for correlation networks and the relative strengths and weaknesses of the selected model should be carefully considered with respect to obtained network measures.

Citation: Hosseini SMH, Kesler SR (2013) Influence of Choice of Null Network on Small-World Parameters of Structural Correlation Networks. PLoS ONE 8(6): e67354. https://doi.org/10.1371/journal.pone.0067354

Editor: Renaud Lambiotte, University of Namur, Belgium

Received: January 9, 2013; Accepted: May 17, 2013; Published: June 28, 2013

Copyright: © 2013 Hosseini, Kesler. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Funding: This work was supported by grants from the National Institutes of Health (1 DP2 OD004445-01 to SK) and the National Cancer Institute (K07 CA134639 to SK). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

In recent years, coordinated variations in brain morphology (e.g. volume, thickness, surface area) have been employed as a measure of structural association between brain regions to infer large-scale structural correlation networks [1]–[20]. Alterations in the arrangements of these large-scale structural correlation networks have been associated with normal aging [3], [9], [10], multiple sclerosis [6], Alzheimer’s disease [4], [12], schizophrenia [8] and epilepsy [2], [15].

Structural correlation networks constructed in this manner are usually represented by a set of nodes that correspond to brain regions and a set of edges (connections) that correspond to statistical correlations in morphometric values between regions, across individuals [5], [11]. These networks have been shown to follow small-world architecture in healthy individuals [2]–[4], [6], [8], [17]; an architecture that provides optimal balance between local and global information processing in the network [21]–[24] and has been observed in biological and social networks [25], [26].

The small-worldness of a network is often characterized by two key metrics: the clustering coefficient C and the characteristic path length L of the network. The clustering coefficient of a node is a measure of the number of edges that exist between its nearest neighbors (nodes that are directly connected) [21], [27]. The clustering coefficient of a network is thus the average of clustering coefficients across nodes and is a measure of network segregation [28]. The characteristic path length of a network is the average shortest path length between all pairs of nodes in the network and is the most commonly used measure of network integration [28], [29]. To evaluate the small-world topology of the brain networks, these topological parameters must be benchmarked against corresponding mean values of a null random graph [30]–[33]. Thus, the small-worldness index of a network is obtained as SW = [C/C_null]/[L/L_null] where C_null and L_null are the mean clustering coefficient and the characteristic path length of the m null random networks, respectively [22]. In a small-world network, the clustering coefficient is significantly higher than that of random networks (C/C_null ratio greater than 1) while the characteristic path length is comparable to random networks (L/L_null ratio close to 1) resulting in a small world index of SW >1. Obviously, the small-world index of a network is largely affected by the choice of null network [32], [33].

In the present study, we investigated the effects of choice of null networks on small-world properties of structural correlation networks. The null networks are usually constructed using rewiring algorithms that preserve the topology of the graphs; i.e. random graphs with the same number of nodes, total edges and degree distribution as the network of interest [30], [31]. However, recent evidence suggests that networks constructed from correlations are inherently more clustered than random networks of the same size and degree and correlation transitivity induces an additive small-world organization to the network [33]. The correlation transitivity effect suggests that the existence of a strong positive correlation between regions A and B as well as B and C would result in a strong positive correlation between regions A and C. This effect induces an inflated clustering in correlation networks. Thus, constructing networks from correlation of a set of random vectors would also lead to a network with small-world characteristic rather than a random network. Therefore, topology randomization overestimates the small-worldness of correlation networks by annihilating the transitive structure induced by correlation transitivity. To overcome this limitation, Zalesky and colleagues [33] proposed generating null covariance matrices that are matched to the distributional properties of the observed covariance matrix using the Hirschberger-Qi-Steuer (HQS) algorithm [34]. The suggested null network is believed to solely annihilate intrinsic structure in the empirical network and does not affect the transitive structure (i.e. structure induced by correlation transitivity). Thus, it gives a more conservative estimate of normalized clustering coefficient of correlation networks relative to random graphs. However, compared to topology-preserving methods, the HQS method underestimates the relative characteristic path length of the network [33]. There is still no evidence on how the choice of null networks affects the small-world parameters of empirical structural correlation networks.

In this report, we investigated the influence of choice of null network on small-world index of gray matter correlation networks in healthy individuals and survivors of acute lymphoblastic leukemia (ALL), a population that we previously demonstrated to have altered large-scale brain networks [19]. We studied three types of null networks: 1) networks constructed by topology randomization (TOP) [30], [31], 2) networks matched to the distributional properties of the observed covariance matrix using Hirschberger-Qi-Steuer algorithm (HQS) [33], [34], and 3) networks generated from correlation of randomized input data (COR). The latter is an intuitive way of generating null networks for benchmarking correlation networks by applying the same network construction procedure on the randomized input data. We studied the influence of choice of null networks on the small-world parameters of the networks at group-level as well as on the significance of between-group differences in small-world parameters. In addition, we investigated whether differences between null networks are affected by the regime of binarization threshold. We discussed the pros and cons of different null networks and qualitatively discuss potential solutions that need to be formulated and validated in future studies.

Materials and Methods

Participants

The detailed procedures of participants, data acquisition and preprocessing are published elsewhere [35]. In summary, 28 children and adolescents with a history of ALL (age 5.0–19.8 years old) who had completed all anti-cancer treatments for at least 6 months as well as 31 healthy controls (HC) (age 4.1–18.4 years old), matched for age, gender, maternal education level and minority status, were recruited.

Ethics Statement

The study was approved by the Stanford University Institutional Review Board and the Stanford Cancer Institute’s Scientific Review Board and written informed consent was obtained from adult participants or from the parent/legal guardian of minor participants and assent was obtained from participants age 8 years and older per Stanford University’s regulations. We could not make this data available to public because of privacy issues (i.e. participants were not consented for inclusion in a public database).

MRI Data Acquisition and Preprocessing

High resolution, 3D spoiled gradient recall MR images were obtained using a 3 Tesla GE Signa whole body scanner (GE Medical Systems, Milwaukee, WI) with the following parameters: repetition time = 6.436 ms, echo time = 2.064 ms, flip angle = 15°, number of excitation = 3, matrix size = 256×256 voxels, field of view = 220, slice thickness = 1.5 mm, 124 contiguous slices. To extract individual gray matter volumes, voxel-based morphometry analysis was conducted in Statistical Parametric Mapping (SPM8) [36] using the VBM8 toolbox (http://dbm.neuro.uni-jena.de/vbm). We utilized the optimized VBM process [37] which included 1) segmentation and extraction of the brain in native space, 2) normalization of the images to a standard space using a customized pediatric template, created via Template-O-Matic software [38] using images from all subjects, 3) segmentation and extraction of the normalized brain (extraction is repeated to ensure that no non-brain tissues remain), 4) modulation of the normalized images to correct for tissue volume differences due to the normalization procedure, and 5) inspection of the resulting gray matter images by expert raters, blinded to group assignment for quality, guided by boxplots and covariance matrices output by the VBM8 toolbox.

Anatomical Parcellation

We generated 90 cortical and subcortical regions of interest (ROIs), excluding the cerebellum, from the Automated Anatomical Labeling (AAL) atlas using the WFU PickAtlas Toolbox [39]. The ROIs were identical to those used in previous graph analysis studies of structural and functional correlation networks [9], [17], [19], [20], [40]–[50]. These AAL ROIs were resliced to the same dimension as that of tissue segmented images obtained from the VBM preprocessing step. The ROIs were subsequently used to mask the individual modulated, normalized GM images and extract the average volume within each ROI using the REX toolbox (http://web.mit.edu/swg/software.htm). A linear regression analysis was performed at every ROI to remove the effects of age, gender and total brain volume. The residuals of this regression were then substituted for the raw ROI volume values [2], [5], [17], [19], [20] and are referred to as corrected regional gray matter volumes (RGV), hereafter.

Network Construction

For each group, a 90 × 90 association matrix was generated by performing Pearson correlation coefficient between the corrected RGV across subjects [1]–[6], [17], [19], [20]. Thresholding the association matrices of different groups at an absolute threshold results in networks with a different number of nodes (and degrees) that might influence the network measures and reduce interpretation of between group results [32]. Therefore, binary networks are usually compared by thresholding the association matrices at fixed network densities (number of existing edges to the number of possible edges in the network). We derived binary adjacency matrices by thresholding the association matrices at a range of network densities (D_min: 0.02∶0.5). The lower bound of the range is determined as the minimum density in which the networks of both groups are not fragmented (D_min = 0.22 (see Results section)). For densities above 0.5 the graphs become increasingly random (small-world index close to 1). Additionally, for anatomical networks, connections above this density are less likely biological [51]. Each of the derived binary adjacency matrices represents a network with a specific density.

Null Networks

In order to estimate the small-world parameters of the constructed networks, three different choices of null networks were generated: 1) Null networks with the same number of nodes, total edges, and degree distribution as the network of interest (TOP) [30], [31]. This method preserves the degree distribution of the original network while randomizing its topology. There are several algorithms for generating random graphs with prescribed degree distribution [52]–[54]. These algorithms differ in terms of the type of output network (connected vs. disconnected, simple vs. complex) as well as the implemented method (e.g. matching vs. switching) [52]. The null networks generated for benchmarking correlation networks should be simple (no loops or parallel edges) and connected. We used the algorithm implemented in Brain Connectivity Toolbox (BCT) [28] that generates connected simple random graphs with prescribed degree sequence by directly searching for rewirable edge pairs in the original network. 2) Null networks corresponding to null covariance matrices that are matched to the distributional properties of the observed covariance matrix using Hirschberger-Qi-Steuer algorithm (HQS) [33], [34]. Null networks generated in this way preserve the transitive structure of the original network. Since the empirical correlation values might not follow a normal distribution, the density of the generated null networks were matched the density of the network of interest. 3) Null networks generated from the correlation of randomized corrected RGV data (COR). This method is an intuitive way of generating null networks for benchmarking correlation networks by applying the same network construction procedure on the randomized corrected GMV data. This procedure involved randomizing the original corrected RGV data for each subject separately and then obtaining a null correlation matrix by performing Pearson’s correlation analysis between the randomized RGV data across subjects. It should be noted that this procedure is different from correlating a group of random vectors. Finally, a binary null network is extracted by thresholding the generated null correlation matrix at a correlation level that matches the density of the resultant binary null network to the density of the network of interest. While the implemented TOP algorithm ensures that the generated null networks maintain connectedness (no fragmentation in the network), there is no guarantee that the null networks generated from COR and HQS method would be connected.

Network Metrics

We investigated the influence of choice of null network on small-world parameters including clustering coefficient (CC), characteristic path length (CPL), and small-world index (SW). These network measures were extracted using the codes developed in the Brain Connectivity Toolbox (BCT) based on the formulation described in [28]. The network and statistical analyses were performed using our in-house software, graph analysis toolbox (GAT) [19].

Influence of Null Networks on Small-world Parameters

In order to investigate the influence of null networks on small-world parameters of a network, we quantified the small-world parameters for the HC network and compared them among different choices of null networks. Normalized clustering coefficient C_HC/C_null, normalized path length [L_HC/L_null, and small-world index SW_HC = [C_HC/C_null]/[L_HC/L_null] were quantified for each type of null networks, namely TOP, HQS and COR, separately. These metrics were quantified at each density step for the specified range of densities [0.22∶0.02∶0.5]. We also quantified the small-world parameters for the ALL network to examine if the patient network follows a small-world organization across different null models.

Since the algorithms used for generation of null networks are stochastic by nature, the generated null networks would be different when applied many times to the same network. Therefore, C_null and L_null were considered as the mean clustering coefficient and the characteristic path length of 20 null random networks [19]. For comparison purposes, we examined whether the replicability of the null networks would differ between different null models. We generated 50 sets of null networks each consisting of 20 null networks for the HC network thresholded at D_min using different null models. We then performed a one-way analysis of variance (ANOVA) to compare the mean network parameters (C_null and L_null) between these sets for each null model. In addition, we compared differences in the dispersion of C_null and L_null among different null models using Levene’s test of variance for 20 null networks.

In addition, to analyze the influence of null networks on between-group differences in small-world parameters, we quantified the small-world parameters of the ALL network employing different null networks and then compared the results with those obtained for the HC network. In addition, we compared the original clustering coefficient and characteristic path length between HC and ALL networks. This comparison allowed us to investigate the similarity between the results of group differences in original network metrics and differences in the normalized metrics.

Finally, for the purpose of comparison only, we also computed the small-world parameters for networks thresholded at a range of correlation values (rather than network density). The resultant network parameters are regarded as absolute network metrics [6] and will be used to examine if the results are compatible with those obtained by thresholding networks at a range sparsity thresholds.

Statistical Analysis

Each network metric extracted across the specified density range [0.22∶0.02∶0.5] is represented by a curve that depicts the changes in network metric as a function of network density (threshold). In order to compare these curves between groups (or among choice of null networks), functional data analysis (FDA) was performed [40], [55]. In summary, each network measure curve was treated as a function (y = f(x)) where y represents the graph metric value and x represents the connection density. In order to compare two network metric curves (between groups or null models), the area A, between the two curves (y₂ vs. y₁) was computed by summing the differences between y-values of the two groups (or the two null models) at each value of x: A = Σ_i |y₂ (x_i) – y₁ (x_i)| [40]. The obtained A value will be regarded as the difference in FDA between two network metric curves, hereafter. While there are several methods for comparing curves using FDA [55], we employed a non-parametric permutation test as described below. The FDA analysis was performed using our in-house GAT software [19].

In order to test the statistical significance of the differences in small-world parameter curves (SW_HC), between different null networks, a non-parametric permutation test for dependent samples was performed as described in [16]. In summary, 1) 300 bootstrap samples of the association matrix of HC group were acquired by randomly selecting subjects’ corrected RGV data from HC group, with replacement, and computing the Pearson’s correlation coefficients. 2) The graph metric curves were quantified for each of the bootstrap samples and for each null network type. 3) The obtained curves were randomly shuffled between different null networks in each bootstrap sample across all samples. 4) The differences in FDA of the shuffled graph metric curves (i.e. the area between the two curves) among different null networks were calculated. 5) Steps 3–4 were repeated 5000 times and histograms of the between-null network differences in mean were constructed. 6) The observed actual between-null network differences in FDA were then placed on the constructed histograms and a p-value was calculated based on its percentile position. The permutation procedure was performed separately for each pair of null networks. It should be noted that sampling with replacement introduces an inflated correlation into the bootstrap correlation matrices. Thus, the mean of the network measures for bootstrap networks might not conform to those for original networks (Figure S1). However, this difference would not influence our results since we are comparing the null models across the same bootstrap networks (networks constructed from the same set of subjects). In addition, the obtained small-world parameters for bootstrap networks were consistent with previous reports (Figures 1 and 2).

Download:

Figure 1. Changes in small-world properties of the HC bootstrap networks as a function of network density.

A) normalized clustering, B) normalized path length and C) small-world index for different choices of null networks across the density range [0.22∶0.02∶0.5]. The dashed lines represent the 95% confidence interval for the mean network parameter of 300 bootstrap networks. All the benchmarking methods revealed a small-world organization for the HC networks.

https://doi.org/10.1371/journal.pone.0067354.g001

Download:

Figure 2. Changes in small-world properties of the ALL bootstrap networks as a function of network density.

A) normalized clustering, B) normalized path length and C) small-world index for different choices of null networks across the density range [0.22∶0.02∶0.5]. The dashed lines represent the 95% confidence interval for the mean network parameter of 300 bootstrap networks. All the benchmarking methods revealed a small-world organization for the ALL networks.

https://doi.org/10.1371/journal.pone.0067354.g002

To test the statistical significance of the differences in small-world parameters between groups, a non-parametric permutation test for independent samples with 1000 repetitions was used [2], [4], [8], [19], [20]. In each repetition, the corrected RGV data of each participant were randomly reassigned to one of the two groups so that each randomized group had the same number of subjects as in the original group. Then, an association matrix was obtained for each randomized group by performing Pearson’s correlation analysis. The binary adjacency matrices were then estimated by applying the same thresholding procedure as described above. The network metric curves were then calculated for all the constructed randomized networks. The differences in FDA of the network metric curves between randomized groups were then calculated resulting in a permutation distribution of difference under the null hypothesis. The actual between-group difference in FDA of the network metric curves was then placed in the corresponding permutation distribution and a p-value was calculated based on its percentile position.

We applied FDA on a cumulative threshold (cumulative FDA) over the full range of density [0.22∶0.02∶0.5] to investigate the influence of null network type on small-world properties of the correlation networks. In addition, we used a windowed thresholding procedure (windowed FDA) [40] to investigate the influence of different density regimes on small-world parameters quantified using different null networks. To this purpose, the specified density range [0.22∶0.02∶0.5] was divided into four threshold ranges [0.22∶0.02∶0.3], [0.3∶0.02∶0.38], [0.38∶0.02∶0.46] and [0.46∶0.02∶0.5] and the binary graphs were constructed by retaining connections that fell in each of these density ranges. It should be noted that in the windowed analysis, the connections within a lower-density window (e.g. [0.22∶0.02∶0.3]) would also present in higher-density windows (e.g. [0.3∶0.02∶0.38]). This procedure enables us to examine how adding lower-strength connections (i.e. less stable connections) to the network would affect the benchmarking results. The network metric curves were then compared across groups (and across choices of null networks) at each window, separately.

Finally, we examined whether the observed differences in network parameters between different null models are influenced by differences in the skewness of degree distributions of the networks. To this purpose, we performed a correlation analysis between skewness of the degree distribution of bootstrap networks across groups and differences in the obtained network metrics from different null models. We also performed correlation analysis between skewness of the degree distribution of bootstrap networks and the parameters of the corresponding null networks. These analyses were done on networks thresholded at D_min = 0.22.

Results

Influence of Null Networks on Small-world Parameters

Changes in small-world properties of the HC bootstrap networks as a function of network density [0.22∶0.02∶0.5] for different choices of null networks are shown in Figure 1. For all the null networks, the estimated normalized clustering coefficients of the HC structural correlation networks (CC_TOP, CC_HQS, CC_COR) were greater than 1, the normalized path lengths (CPL_TOP, CPL_HQS, CPL_COR) were close to 1, resulting in small-world indices (SW_TOP, SW_HQS, SW_COR) that were greater than 1. The small-world indices were also greater than 1 in ALL bootstrap networks for different null models (Figure 2).

We also quantified the small-world parameters for the HC and ALL networks thresholded at a range of correlation values (Figures S2 and S3). The small-world indices quantified using different null models revealed a small-world architecture in both networks and confirms the results obtained by thresholding the networks at a range of sparsity thresholds.

The results of cumulative FDA analysis in the density range [0.22∶0.02∶0.5] and nonparametric permutation test for dependent samples showed that the cumulative FDA of normalized clustering coefficient, normalized path length, and small-world index in HC network are significantly different between all three choices of null networks (p<0.01) after correction for multiple comparisons (Bonferroni correction). The windowed FDA analysis also showed a significant difference in normalized clustering, normalized path length and small-world index of the HC network between all three null networks and for all the thresholding windows (p<0.01).

The correlation analysis revealed a significant correlation between the skewness of degree distribution of bootstrap networks (across both groups) and the observed differences in normalized clustering between TOP and HQS (r = −0.44, p<0.01) as well as TOP and COR null models (r = −0.39, p<0.01) (Figure 3). Similar correlation results were observed between skewness and differences in small-worldness between TOP and HQS (r = −0.45, p<0.01) as well as TOP and COR models (r = −0.41, p<0.01). In addition, a significant positive correlation was found between the skewness of degree distribution of bootstrap networks and the clustering coefficient of corresponding TOP null networks (r = 0.41, p<0.01) (Figure 3C).

Download:

Figure 3. Relationship between skewness and normalized clustering.

A significant negative correlation was found between the skewness of degree distribution of bootstrap networks (across both HC and ALL networks) and differences in normalized clustering between A) TOP and COR and B) TOP and HQS methods. C) the skewness of degree distribution of TOP null networks showed a significant positive correlation with mean clustering of corresponding networks.

https://doi.org/10.1371/journal.pone.0067354.g003

Comparing the replicability of null network parameters revealed no significant difference in the mean C_null and L_null between different sets (p>0.2). However, the dispersions of C_null and L_null were significantly higher for HQS and COR compared with TOP null networks (p<0.05). Changes in the mean C_null and L_null as a function of number of generated null networks for different null models are shown in Figure S4.

Influence of Null Networks on between-group Differences in Small-world Parameters

We also investigated the influence of null networks on the results of between-group differences in small-world parameters. Between-group differences (HC vs. ALL) in normalized clustering (ΔCC_TOP, ΔCC_HQS, ΔCC_COR), normalized path length (ΔCPL_TOP, ΔCPL_HQS, ΔCPL_COR) and small-world index (ΔSW_TOP, ΔSW_QS, ΔSW_COR) as a function of network density are shown in Figure 4. The detailed results of nonparametric permutation test for independent samples on cumulative FDA and windowed thresholding data are given in Table 1. In summary, the cumulative FDA analysis over the density range [0.22∶0.02∶0.5] revealed that only normalized clustering quantified by the TOP method (ΔCC_TOP) was significantly different between groups (p<0.05). The small-world indices derived from TOP methods (ΔSW_TOP) were also marginally significant between groups (p = 0.056). The windowed thresholding procedure revealed that in lower densities (stronger correlation) [0.22∶0.02∶0.3], the small-world indices ΔSW_HQS was significantly different between groups (p<0.05) while ΔSW_TOP and ΔCC_TOP were only marginally significant (p = .058 and 0.05, respectively). On the other hand, in higher densities [0.38∶0.02∶0.46] and [0.46∶0.02∶0.5], only ΔCC_TOP was significantly different between groups (p<0.05).

Download:

Figure 4. Between-group differences (HC vs. ALL) in small-world parameters.

The 95% confidence intervals and between-group differences in A) normalized clustering (ΔCC_TOP, ΔCC_HQS, ΔCC_COR), B) normalized path length (ΔCPL_TOP, ΔCPL_HQS, ΔCPL_COR) and C) small-world index (ΔSW_TOP, ΔSW_QS, ΔSW_COR) as a function of network density for different benchmarking methods. The red circles show the difference between HC vs. ALL networks; the circles falling out of the confidence intervals (blue dashed lines) indicate the densities in which the difference is significant. The positive values indicate HC>ALL and negative values indicate HC<ALL.

https://doi.org/10.1371/journal.pone.0067354.g004

Download:

Table 1. Significance of between-group differences in small-world parameters across different benchmarking methods.

https://doi.org/10.1371/journal.pone.0067354.t001

Additionally, we compared group differences in original network measures, i.e. clustering coefficient (ΔCC_ORG) and path length (ΔCPL_ORG), between HC and ALL networks (Figure 5) (Table 1). Neither cumulative FDA nor windowed thresholding data reflected significant differences in original clustering and path length between groups.

Download:

Figure 5. Between-group differences (HC vs. ALL) in original network parameters.

The 95% confidence intervals and between-group differences in A) original network clustering (ΔCC_ORG) and B) normalized path length (ΔCPL_ORG) as a function of network density. The red circles show the difference between HC vs. ALL networks; the circles falling out of the confidence intervals (blue dashed lines) indicate the densities in which the difference is significant. The positive values indicate HC>ALL and negative values indicate HC<ALL.

https://doi.org/10.1371/journal.pone.0067354.g005

Discussion

Recent evidence suggests that brain networks constructed from correlations are inherently more clustered than random networks of the same size and degree. Thus, null networks constructed by randomizing topology are not a good choice for benchmarking small-world parameters of correlation networks. In the present report, we investigated the influence of choice of null networks on small-world parameters of gray matter correlation networks in healthy individuals (HC) and survivors of acute lymphoblastic leukemia (ALL). The results revealed that the choice of null network not only influences the estimated small-world parameters, it also influences the results of between-group differences in small-world parameters. Our data suggest that the choice of null network is quite crucial for interpretation of group differences in small-world parameters of structural correlation networks.

Influence of Null Networks on Small-world Parameters

For all three choices of null models, the HC network showed a small-world architecture, i.e. the estimated normalized clustering coefficients of the network were greater than 1 and the normalized path lengths were close to 1 resulting in small-world indices of greater than 1 (Figure 1). However, the estimated small-world parameters were significantly different among the choices of null networks. As was expected, both the cumulative and windowed FDA results showed that CC_HQS and CC_COR were significantly lower than CC_TOP. This is because the TOP method compared with HQS and COR, does not cancel out the effect of transitive structure induced by correlation transitivity. Thus, the HQS and COR methods give more conservative estimates of normalized clustering coefficient. On the other hand, CPL_HQS was significantly lower than CPL_TOP and CPL_COR. This implies that the HQS method, compared with TOP and COR, underestimates the normalized path length of the network resulting in overestimation of network global efficiency [28], [53], [57]. Consequently, the HQS method gives a more conservative estimate of small-world index (SW_HQS <1.2) compared with TOP and COR methods. The same pattern was observed for small-world parameters in ALL network (Figure 2) as well as for networks thresholded at a range of correlation thresholds (Figures S2 and S3). Note that the rate of decrease in SW_HQS and SW_COR was much slower than the rate for SW_TOP for both ALL and HC networks. This is mainly influenced by the slower rate of decrease in normalized clustering in HQS and COR compared with TOP method. We speculate that correlation transitivity is mainly influenced by strong correlations and thus the amount of transitive clustering that cancels out at lower densities (strong connections) in HQS and COR methods is much higher compared with TOP method. However, as the lower strength connections are added (higher densities), less transitive structure is added to the network and thus the HQS and COR estimates of normalized clustering (and small-worldness) decrease at a slow rate.

Correlation analysis revealed that the skewness of degree distribution predicts the observed differences in normalized clustering and small-worldness between TOP and HQS and between TOP and COR models. Specifically, the skewness toward high-degree nodes reduced the differences in normalized network parameters between Top and other null models. We speculated that this difference might be driven by the influence of skewness on parameters of TOP null network. The results were confirmatory and the clustering coefficient of the TOP null network was higher for networks with skewness toward high-degree nodes. Since we did not observe such an effect for parameters of COR and HQS null networks, the differences in clustering coefficient between TOP and HQS as well as TOP and COR decreased for networks with skewness toward high-degree nodes. However, the mechanism underlying the observed positive correlation between skewness of original networks and clustering coefficient of corresponding TOP null networks remains unclear. The results suggest that networks with high skewness are less sensitive to correlation transitivity effect and the corresponding TOP null networks would be closer to HQS and COR null networks in terms of clustering.

While the replicability of null network parameters for 20 null networks were not significantly different within each null model, the dispersion of C_null and L_null for HQS and COR models was significantly higher than that for COR model. The observed difference in the dispersion remained significant even for 100 iterations of null networks. These data suggest that the mean C_null and L_null of 20 random networks gives a reliable estimate of small-world parameters for replicating the results for different null models. However, the network parameters in HQS and COR models would be more variable compared with those in TOP model.

Influence of Null Networks on between-group Differences in Small-world Parameters

Cumulative FDA.

The cumulative FDA results showed that normalized clustering is greater in the HC network than in ALL and normalized path length is greater in the ALL network than in HC, resulting in a small-world index that is greater in HC network. These results were consistent across all benchmarking methods. However, the choice of null network did influence the statistics of between-group differences in small-world parameters. The cumulative FDA analysis showed that ΔCC_TOP was statistically significant between groups while ΔCC_HQS and ΔCC_COR did not show significant difference between groups. This implies that the TOP method overestimates the differences in network clustering between groups compared with the HQS and COR methods. The estimated normalized clustering in HQS and COR methods as well as the statistics for ΔCC_HQS and ΔCC_COR were comparable suggesting that both HQS and COR methods are consistent for computing normalized clustering coefficient of structural correlation networks. Conversely, the TOP method gave the most conservative estimate of between-group differences in normalized path length among other methods while HQS method was the least conservative among them. The results of between-group differences in small-world index were more consistent between TOP and HQS methods than COR method. The COR method gave the most conservative estimate of between-group differences in small-world index among three methods. Together, the cumulative FDA result suggests that while the choice of null network influences the statistics of between group differences in small-world parameters, the direction of difference is preserved across all methods.

Windowed FDA.

Consistent with cumulative FDA results, the windowed FDA results showed that the normalized clustering and small-world index were greater in the HC than in ALL network across all benchmarking methods and all windows. Normalized path length was greater in ALL than in HC network at lower densities (strong correlations) while it was smaller in ALL network at higher densities (weak correlations). This pattern was consistent across all methods except that the flip occurred in lower densities in TOP measures compared with HQS and COR measures. The observed flip in the direction of between-group differences in normalized path length at higher densities (weak correlations) can be attributed to increased randomized structure in both networks by introducing more weak densities. Perhaps, the TOP method is more susceptible to this random structure and therefore the flip occurs at lower densities when using this method.

In line with cumulative FDA results, the windowed FDA results suggest that the choice of null network influences the statistics of between-group differences in small-world parameters. For lower densities (strong correlations), the observed between-group difference in normalized clustering was the largest in TOP method among others. Conversely, the observed group difference in normalized path length was the smallest in TOP method. These results were consistent with cumulative FDA results. However, at higher densities where the network behavior becomes more random, the observed consistency was violated.

The pattern of group-differences in small-world index for windowed FDA was consistent with those obtained from cumulative FDA at higher densities [0.3 to 0.5]. At lower densities [0.22 to 0.3], the small-world index was significantly lower in the ALL network than in HC network for HQS method while it was nonsignificantly lower in ALL for TOP and COR methods. This suggests that the TOP and COR methods, compared with HQS, gives a less conservative estimate of between-group differences in small-world index for strong correlations. Together, the windowed FDA result confirms the cumulative FDA results by showing that the choice of null network influences the statistics of between group differences in small-world parameters. In addition, it showed that the choice of null network influences the direction of difference in normalized path length between groups.

Small-world parameter is a relative measure and one may argue that the drawbacks/advantages of each null model may affect the networks of both groups equally. However, our data showed that the choice of null model influences the direction of group differences in network measures. This is especially problematic since, for some null models, the network measures are higher in one group but are lower in the same group using a different null model. Therefore, our data emphasize the importance of a universal null model for benchmarking correlation networks.

Which Null Network is More Suitable?

So far, we investigated how the choice of null network affects the small-world parameters of correlation networks at within-group and between-group levels using cumulative and windowed FDA. However, the critical question remains: which of the above mentioned null networks is more suitable for the purpose of benchmarking structural correlation networks?

Recently, Zalesky and colleagues [33] suggest that HQS method is more suitable for estimation of normalized clustering coefficient of correlation networks compared with TOP method. Unlike TOP method that annihilates the transitive structure of correlation networks, the HQS method does not affect the transitive structure and thus gives a more conservative estimate of normalized clustering for correlation networks. Using empirical data, our results confirmed that TOP method, compared with HQS, gives a higher estimate of the clustering coefficient of structural correlation networks. Thus, compared to TOP, HQS method is more appropriate for estimation of normalized clustering coefficient of correlation networks. However, the degree distribution of null networks generated using HQS method does not match the degree distribution of original network [33]. Thus, HQS method is less appropriate for estimation of normalized path length compared with TOP.

Intuitively, the COR method should be a suitable method for normalization of clustering and path length since it applies the same network construction procedure on the randomized input data. However, careful examination of the correlation matrices generated using COR method reveals that the correlation distribution of the COR null network does not match the correlation distribution of the original network (Figure 6). This mismatch in correlation strength influences the correlation transitivity in the null models and further affects the clustering coefficient of the null networks [33]. Thus, the COR null networks also do not give an appropriate estimate of small-world parameters for correlation networks.

Download:

Figure 6. Cumulative distribution of correlation values.

The correlation distribution of HC network (green), ten HQS null networks (red) and ten COR null networks (black). The cumulative distribution of correlation values in HQS model is very close to the original distribution while the distribution in COR model does not fit the original distribution. We did not show the correlation distribution for TOP model because the TOP model works on thresholded binarized networks.

https://doi.org/10.1371/journal.pone.0067354.g006

Apart from differences in the estimation of small-world parameters, the examined null models differ in terms of connectedness of the generated null networks. Unlike the TOP null networks, there is no guarantee that the outputs from HQS and COR methods would be connected. The connectedness of the null network is very crucial since the small-world parameters depend on the network size [32]. Therefore, fragmentation in the generated null networks would affect the normalized network metrics. However, this problem is slightly alleviated by averaging null network parameters across a number of null networks. In addition, disconnection of null networks at higher density thresholds is less probable. At lower densities, it is possible to discard null networks that are fragmented and only use the connected outputs for normalizing network parameters. Nonetheless, this process would increase the computational time and might not be feasible for all networks.

Together, our results suggest a lack of gold-standard null model for benchmarking correlation networks. Future research is needed to model gold-standard null networks that maintain both correlation distribution and degree distribution of the original correlation networks for appropriate normalization of clustering coefficient and characteristic path length of correlation networks, respectively. One potential solution is to use rewiring algorithms that work on weighted networks and preserve the degree (or strength) distribution of the original weighted network. These algorithms can be applied directly to correlation matrices. However, the available rewiring models for weighted networks only preserve the out-degree (or in-degree) distribution and thus not perfect for benchmarking correlation networks. Some attempts have been made to resolve this deficiency but the proposed models either fail to maintain the correlation distribution or fail to preserve the symmetry of the network [58], [59].

Conclusions

We investigated the influence of choice of null networks on small-world properties of structural correlation networks. As was expected, the results revealed that the choice of null network significantly influences the estimates of small-world parameters of the networks, within group. In addition, the statistics of between group results were affected by the choice of null network. While the direction of the between-group differences in network parameters was not affected by the choice of null network at lower network density ranges (strong correlations), it was influenced at higher densities where the networks become more random. Finally, our data suggests that none of the available null models can be regarded as a gold-standard for benchmarking correlation networks and the relative strengths and weaknesses of the selected model should be carefully considered with respect to obtained network measures. Future studies need to examine new rewiring algorithms that work on weighted networks and preserve the degree (or strength) distribution of the original weighted network. Alternatively, hybrid models that employ correlation distribution from HQS method and apply the correlation values to the structure obtained from COR method are also promising.

Although we demonstrated the effects of null models on benchmarking small-world parameters for structural correlation networks, the results can be generalized to various kinds of correlation networks including networks constructed from gene expression and proteomics data [31], [60].

Supporting Information

Figure S1.

Changes in the original clustering and path length of HC network as a function of network density. A) clustering and B) path length for the original HC network (+) as well as the corresponding mean (SD) values for the HC bootstrap networks (squares). The mean network parameters for bootstrap networks were slightly deviated from those of the original network. Sampling with replacement results in having a number of similar subjects within the bootstrap samples that leads to obtaining inflated correlations and thus the results would deviate from those for original network.

https://doi.org/10.1371/journal.pone.0067354.s001

(TIF)

Figure S2.

Changes in small-world properties of the HC network as a function of correlation threshold. A) normalized clustering, B) normalized path length and C) small-world index for different choices of null networks as a function of correlation threshold. All the benchmarking methods revealed a small-world organization for the HC network. The pattern of differences in small-world parameters between null models is similar to the pattern observed for networks thresholded at a range of sparsity thresholds.

https://doi.org/10.1371/journal.pone.0067354.s002

(TIF)

Figure S3.

Changes in small-world properties of the ALL network as a function of correlation threshold. A) normalized clustering, B) normalized path length and C) small-world index for different choices of null networks as a function of correlation threshold. All the benchmarking methods revealed a small-world organization for the ALL network. The pattern of differences in small-world parameters between null models is similar to the pattern observed for networks thresholded at a range of sparsity thresholds.

https://doi.org/10.1371/journal.pone.0067354.s003

(TIF)

Figure S4.

Changes in the mean C_null and L_null as a function of number of null networks generated. A) Changes in the mean C_null for COR (top panel), TOP (middle panel) and HQS (bottom panel) null networks as a function of number of null networks generated. B) Changes in the mean L_null for COR (top panel), TOP (middle panel) and HQS (bottom panel) null networks as a function of number of null networks generated. No significant difference in the mean C_null and L_null were observed between different sets (p>0.2). However, the dispersions of C_null and L_null were significantly higher for HQS and COR compared with TOP null networks (p<0.05).

https://doi.org/10.1371/journal.pone.0067354.s004

(TIF)

Author Contributions

Conceived and designed the experiments: HH SK. Performed the experiments: HH SK. Analyzed the data: HH. Contributed reagents/materials/analysis tools: HH SK. Wrote the paper: HH.

References

1. Chen ZJ, He Y, Rosa-Neto P, Germann J, Evans AC (2008) Revealing modular architecture of human brain structural networks by using cortical thickness from MRI. Cereb Cortex 18: 2374–2381.
- View Article
- Google Scholar
2. Bernhardt BC, Chen Z, He Y, Evans AC, Bernasconi N (2011) Graph-theoretical analysis reveals disrupted small-world organization of cortical thickness correlation networks in temporal lobe epilepsy. Cereb Cortex 21: 2147–2157.
- View Article
- Google Scholar
3. Chen ZJ, He Y, Rosa-Neto P, Gong G, Evans AC (2011) Age-related alterations in the modular organization of structural cortical network by using cortical thickness from MRI. Neuroimage 56: 235–245.
- View Article
- Google Scholar
4. He Y, Chen Z, Evans A (2008) Structural insights into aberrant topological patterns of large-scale cortical networks in Alzheimer’s disease. J Neurosci 28: 4756–4766.
- View Article
- Google Scholar
5. He Y, Chen ZJ, Evans AC (2007) Small-world anatomical networks in the human brain revealed by cortical thickness from MRI. Cereb Cortex 17: 2407–2419.
- View Article
- Google Scholar
6. He Y, Dagher A, Chen Z, Charil A, Zijdenbos A, et al. (2009) Impaired small-world efficiency in structural cortical networks in multiple sclerosis associated with white matter lesion load. Brain 132: 3366–3379.
- View Article
- Google Scholar
7. He Y, Evans A (2010) Graph theoretical modeling of brain connectivity. Curr Opin Neurol 23: 341–350.
- View Article
- Google Scholar
8. Bassett DS, Bullmore E, Verchinski BA, Mattay VS, Weinberger DR, et al. (2008) Hierarchical organization of human cortical networks in health and schizophrenia. J Neurosci 28: 9239–9248.
- View Article
- Google Scholar
9. Wu K, Taki Y, Sato K, Kinomura S, Goto R, et al. (2012) Age-related changes in topological organization of structural brain networks in healthy individuals. Hum Brain Mapp 33: 552–568.
- View Article
- Google Scholar
10. Sun J, Tong S, Yang GY (2012) Reorganization of Brain Networks in Aging and Age-related Diseases. Aging and disease 3: 181–193.
- View Article
- Google Scholar
11. Gong G, He Y, Chen ZJ, Evans AC (2012) Convergence and divergence of thickness correlations with diffusion connections across the human cerebral cortex. Neuroimage 59: 1239–1248.
- View Article
- Google Scholar
12. Zhou L, Wang Y, Li Y, Yap PT, Shen D (2011) Hierarchical anatomical brain networks for MCI prediction: revisiting volumetric measures. PLoS One 6: e21935.
- View Article
- Google Scholar
13. Guye M, Bettus G, Bartolomei F, Cozzone PJ (2010) Graph theoretical analysis of structural and functional connectivity MRI in normal and pathological brain networks. Magma 23: 409–421.
- View Article
- Google Scholar
14. Lv B, Li J, He H, Li M, Zhao M, et al. (2010) Gender consistency and difference in healthy adults revealed by cortical thickness. Neuroimage 53: 373–382.
- View Article
- Google Scholar
15. Raj A, Mueller SG, Young K, Laxer KD, Weiner M (2010) Network-level analysis of cortical thickness of the epileptic brain. Neuroimage 52: 1302–1313.
- View Article
- Google Scholar
16. Sanabria-Diaz G, Melie-Garcia L, Iturria-Medina Y, Aleman-Gomez Y, Hernandez-Gonzalez G, et al. (2010) Surface area and cortical thickness descriptors reveal different attributes of the structural human brain networks. Neuroimage 50: 1497–1510.
- View Article
- Google Scholar
17. Fan Y, Shi F, Smith JK, Lin W, Gilmore JH, et al. (2011) Brain anatomical networks in early human brain development. Neuroimage 54: 1862–1871.
- View Article
- Google Scholar
18. Lerch JP, Worsley K, Shaw WP, Greenstein DK, Lenroot RK, et al. (2006) Mapping anatomical correlations across cerebral cortex (MACACC) using cortical thickness from MRI. Neuroimage 31: 993–1003.
- View Article
- Google Scholar
19. Hosseini SM, Hoeft F, Kesler SR (2012) GAT: A Graph-Theoretical Analysis Toolbox for Analyzing Between-Group Differences in Large-Scale Structural and Functional Brain Networks. PLoS One 7: e40709.
- View Article
- Google Scholar
20. Hosseini SH, Koovakkattu D, Kesler SR (2012) Altered Small-world Properties of Gray Matter Networks in Breast Cancer. BMC neurology 12: 28.
- View Article
- Google Scholar
21. Watts DJ, Strogatz SH (1998) Collective dynamics of ‘small-world’ networks. Nature 393: 440–442.
- View Article
- Google Scholar
22. Bassett DS, Bullmore E (2006) Small-world brain networks. Neuroscientist 12: 512–523.
- View Article
- Google Scholar
23. Amaral LA, Scala A, Barthelemy M, Stanley HE (2000) Classes of small-world networks. Proceedings of the National Academy of Sciences of the United States of America 97: 11149–11152.
- View Article
- Google Scholar
24. Latora V, Marchiori M (2001) Efficient behavior of small-world networks. Physical review letters 87: 198701.
- View Article
- Google Scholar
25. Sporns O (2011) Networks of the Brain. Cambridge: The MIT Press.
26. Boccaletti S, Latora V, Moreno Y, Chavez M, Hwang DU (2006) Complex networks: Structure and dynamics. Physics Reports 424: 175–308.
- View Article
- Google Scholar
27. Schaeffer SE (2007) Graph Clustering. Computer Science Review 1: 27–64.
- View Article
- Google Scholar
28. Rubinov M, Sporns O (2010) Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52: 1059–1069.
- View Article
- Google Scholar
29. Sporns O, Zwi JD (2004) The small world of the cerebral cortex. Neuroinformatics 2: 145–162.
- View Article
- Google Scholar
30. Milo R, Shen-Orr S, Itzkovitz S, Kashtan N, Chklovskii D, et al. (2002) Network motifs: simple building blocks of complex networks. Science 298: 824–827.
- View Article
- Google Scholar
31. Maslov S, Sneppen K (2002) Specificity and stability in topology of protein networks. Science 296: 910–913.
- View Article
- Google Scholar
32. van Wijk BCM, Stam CJ, Daffertshofer A (2010) Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory. PLoS One 5: e13701.
- View Article
- Google Scholar
33. Zalesky A, Fornito A, Bullmore E (2012) On the use of correlation as a measure of network connectivity. Neuroimage 60: 2096–2106.
- View Article
- Google Scholar
34. Hirschberger M, Qi Y, Steuer RE (2004) Randomly generating portfolio-selection covariance matrices with specified distributional characteristics. Eur J Oper Res 177: 1610–1625.
- View Article
- Google Scholar
35. Kesler SR, Tanaka H, Koovakkattu D (2010) Cognitive reserve and brain volumes in pediatric acute lymphoblastic leukemia. Brain imaging and behavior 4: 256–269.
- View Article
- Google Scholar
36. Friston KJ (2007) Statistical parametric mapping : the analysis of funtional brain images. Amsterdam; Boston: Elsevier/Academic Press. vii, 647.
37. Good CD, Johnsrude IS, Ashburner J, Henson RN, Friston KJ, et al. (2001) A voxel-based morphometric study of ageing in 465 normal adult human brains. Neuroimage 14: 21–36.
- View Article
- Google Scholar
38. Wilke M, Holland SK, Altaye M, Gaser C (2008) Template-O-Matic: a toolbox for creating customized pediatric templates. Neuroimage 41: 903–913.
- View Article
- Google Scholar
39. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, et al. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15: 273–289.
- View Article
- Google Scholar
40. Bassett DS, Nelson BG, Mueller BA, Camchong J, Lim KO (2012) Altered resting state complexity in schizophrenia. Neuroimage 59: 2196–2207.
- View Article
- Google Scholar
41. Zhang J, Wang J, Wu Q, Kuang W, Huang X, et al. (2011) Disrupted brain connectivity networks in drug-naive, first-episode major depressive disorder. Biological psychiatry 70: 334–342.
- View Article
- Google Scholar
42. Sanz-Arigita EJ, Schoonheim MM, Damoiseaux JS, Rombouts SA, Maris E, et al. (2010) Loss of ‘small-world’ networks in Alzheimer’s disease: graph analysis of FMRI resting-state functional connectivity. PLoS One 5: e13788.
- View Article
- Google Scholar
43. Supekar K, Menon V, Rubin D, Musen M, Greicius MD (2008) Network analysis of intrinsic functional brain connectivity in Alzheimer’s disease. PLoS Comput Biol 4: e1000100.
- View Article
- Google Scholar
44. Supekar K, Musen M, Menon V (2009) Development of large-scale functional brain networks in children. PLoS Biol 7: e1000157.
- View Article
- Google Scholar
45. Meunier D, Achard S, Morcom A, Bullmore E (2009) Age-related changes in modular organization of human brain functional networks. Neuroimage 44: 715–723.
- View Article
- Google Scholar
46. He Y, Wang J, Wang L, Chen ZJ, Yan C, et al. (2009) Uncovering intrinsic modular organization of spontaneous brain activity in humans. PLoS One 4: e5226.
- View Article
- Google Scholar
47. Achard S, Bullmore E (2007) Efficiency and cost of economical brain functional networks. PLoS computational biology 3: e17.
- View Article
- Google Scholar
48. Achard S, Salvador R, Whitcher B, Suckling J, Bullmore E (2006) A resilient, low-frequency, small-world human brain functional network with highly connected association cortical hubs. J Neurosci 26: 63–72.
- View Article
- Google Scholar
49. Wang L, Zhu C, He Y, Zang Y, Cao Q, et al. (2009) Altered small-world brain functional networks in children with attention-deficit/hyperactivity disorder. Hum Brain Mapp 30: 638–649.
- View Article
- Google Scholar
50. Lynall ME, Bassett DS, Kerwin R, McKenna PJ, Kitzbichler M, et al. (2010) Functional connectivity and brain networks in schizophrenia. J Neurosci 30: 9477–9487.
- View Article
- Google Scholar
51. Kaiser M, Hilgetag CC (2006) Nonoptimal component placement, but short processing paths, due to long-distance projections in neural systems. PLoS Comput Biol 2: e95.
- View Article
- Google Scholar
52. Viger F, Latapy M (2005) Efficient and simple generation of random simple connected graphs with prescribed degree sequence. Lect Notes Comp Sci 3595: 440–449.
- View Article
- Google Scholar
53. Del Genio CI, Kim H, Toroczkai Z, Bassler KE (2010) Efficient and exact sampling of simple graphs with given arbitrary degree sequence. PLoS ONE 5(4): e10012.
- View Article
- Google Scholar
54. Gkantsidis C, Mihail M, Zegure E (2003) The markov chain simulation method for generating connected power law random graphs. in Proc. of 5^th Workshop on Algorithm Engineering and Experiments (ALENEX), 16–25.
55. Ramsay JO, Silverman BW (2005) Functional data analysis: Springer.
56. van den Heuvel MP, Stam CJ, Kahn RS, Hulshoff Pol HE (2009) Efficiency of functional brain networks and intellectual performance. The Journal of neuroscience : the official journal of the Society for Neuroscience 29: 7619–7624.
- View Article
- Google Scholar
57. Li Y, Liu Y, Li J, Qin W, Li K, et al. (2009) Brain anatomical network and intelligence. PLoS computational biology 5: e1000395.
- View Article
- Google Scholar
58. Opsahl T, Colizza V, Panzarasa P, Ramasco JJ (2008) Prominence and control: the weighted rich club effect. Phys Rev Lett 101, 168702.
59. Zlatic V, Bianconi G, Diaz-Guilera A, Garlaschelli D, Rao F, et al.. (2009) On the rich-club effect in dense and weighted networks. Eur Phys J B 67, 271–275.
60. Gillis J, Pavlidis P (2011). The role of indirect connections in gene networks in predicting funcion. Bioinformatics 27(13), 1860–66.

[ref1] 1. Chen ZJ, He Y, Rosa-Neto P, Germann J, Evans AC (2008) Revealing modular architecture of human brain structural networks by using cortical thickness from MRI. Cereb Cortex 18: 2374–2381.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Bernhardt BC, Chen Z, He Y, Evans AC, Bernasconi N (2011) Graph-theoretical analysis reveals disrupted small-world organization of cortical thickness correlation networks in temporal lobe epilepsy. Cereb Cortex 21: 2147–2157.
View Article
Google Scholar

[5] View Article

[6] Google Scholar

[ref3] 3. Chen ZJ, He Y, Rosa-Neto P, Gong G, Evans AC (2011) Age-related alterations in the modular organization of structural cortical network by using cortical thickness from MRI. Neuroimage 56: 235–245.
View Article
Google Scholar

[8] View Article

[9] Google Scholar

[ref4] 4. He Y, Chen Z, Evans A (2008) Structural insights into aberrant topological patterns of large-scale cortical networks in Alzheimer’s disease. J Neurosci 28: 4756–4766.
View Article
Google Scholar

[11] View Article

[12] Google Scholar

[ref5] 5. He Y, Chen ZJ, Evans AC (2007) Small-world anatomical networks in the human brain revealed by cortical thickness from MRI. Cereb Cortex 17: 2407–2419.
View Article
Google Scholar

[14] View Article

[15] Google Scholar

[ref6] 6. He Y, Dagher A, Chen Z, Charil A, Zijdenbos A, et al. (2009) Impaired small-world efficiency in structural cortical networks in multiple sclerosis associated with white matter lesion load. Brain 132: 3366–3379.
View Article
Google Scholar

[17] View Article

[18] Google Scholar

[ref7] 7. He Y, Evans A (2010) Graph theoretical modeling of brain connectivity. Curr Opin Neurol 23: 341–350.
View Article
Google Scholar

[20] View Article

[21] Google Scholar

[ref8] 8. Bassett DS, Bullmore E, Verchinski BA, Mattay VS, Weinberger DR, et al. (2008) Hierarchical organization of human cortical networks in health and schizophrenia. J Neurosci 28: 9239–9248.
View Article
Google Scholar

[23] View Article

[24] Google Scholar

[ref9] 9. Wu K, Taki Y, Sato K, Kinomura S, Goto R, et al. (2012) Age-related changes in topological organization of structural brain networks in healthy individuals. Hum Brain Mapp 33: 552–568.
View Article
Google Scholar

[26] View Article

[27] Google Scholar

[ref10] 10. Sun J, Tong S, Yang GY (2012) Reorganization of Brain Networks in Aging and Age-related Diseases. Aging and disease 3: 181–193.
View Article
Google Scholar

[29] View Article

[30] Google Scholar

[ref11] 11. Gong G, He Y, Chen ZJ, Evans AC (2012) Convergence and divergence of thickness correlations with diffusion connections across the human cerebral cortex. Neuroimage 59: 1239–1248.
View Article
Google Scholar

[32] View Article

[33] Google Scholar

[ref12] 12. Zhou L, Wang Y, Li Y, Yap PT, Shen D (2011) Hierarchical anatomical brain networks for MCI prediction: revisiting volumetric measures. PLoS One 6: e21935.
View Article
Google Scholar

[35] View Article

[36] Google Scholar

[ref13] 13. Guye M, Bettus G, Bartolomei F, Cozzone PJ (2010) Graph theoretical analysis of structural and functional connectivity MRI in normal and pathological brain networks. Magma 23: 409–421.
View Article
Google Scholar

[38] View Article

[39] Google Scholar

[ref14] 14. Lv B, Li J, He H, Li M, Zhao M, et al. (2010) Gender consistency and difference in healthy adults revealed by cortical thickness. Neuroimage 53: 373–382.
View Article
Google Scholar

[41] View Article

[42] Google Scholar

[ref15] 15. Raj A, Mueller SG, Young K, Laxer KD, Weiner M (2010) Network-level analysis of cortical thickness of the epileptic brain. Neuroimage 52: 1302–1313.
View Article
Google Scholar

[44] View Article

[45] Google Scholar

[ref16] 16. Sanabria-Diaz G, Melie-Garcia L, Iturria-Medina Y, Aleman-Gomez Y, Hernandez-Gonzalez G, et al. (2010) Surface area and cortical thickness descriptors reveal different attributes of the structural human brain networks. Neuroimage 50: 1497–1510.
View Article
Google Scholar

[47] View Article

[48] Google Scholar

[ref17] 17. Fan Y, Shi F, Smith JK, Lin W, Gilmore JH, et al. (2011) Brain anatomical networks in early human brain development. Neuroimage 54: 1862–1871.
View Article
Google Scholar

[50] View Article

[51] Google Scholar

[ref18] 18. Lerch JP, Worsley K, Shaw WP, Greenstein DK, Lenroot RK, et al. (2006) Mapping anatomical correlations across cerebral cortex (MACACC) using cortical thickness from MRI. Neuroimage 31: 993–1003.
View Article
Google Scholar

[53] View Article

[54] Google Scholar

[ref19] 19. Hosseini SM, Hoeft F, Kesler SR (2012) GAT: A Graph-Theoretical Analysis Toolbox for Analyzing Between-Group Differences in Large-Scale Structural and Functional Brain Networks. PLoS One 7: e40709.
View Article
Google Scholar

[56] View Article

[57] Google Scholar

[ref20] 20. Hosseini SH, Koovakkattu D, Kesler SR (2012) Altered Small-world Properties of Gray Matter Networks in Breast Cancer. BMC neurology 12: 28.
View Article
Google Scholar

[59] View Article

[60] Google Scholar

[ref21] 21. Watts DJ, Strogatz SH (1998) Collective dynamics of ‘small-world’ networks. Nature 393: 440–442.
View Article
Google Scholar

[62] View Article

[63] Google Scholar

[ref22] 22. Bassett DS, Bullmore E (2006) Small-world brain networks. Neuroscientist 12: 512–523.
View Article
Google Scholar

[65] View Article

[66] Google Scholar

[ref23] 23. Amaral LA, Scala A, Barthelemy M, Stanley HE (2000) Classes of small-world networks. Proceedings of the National Academy of Sciences of the United States of America 97: 11149–11152.
View Article
Google Scholar

[68] View Article

[69] Google Scholar

[ref24] 24. Latora V, Marchiori M (2001) Efficient behavior of small-world networks. Physical review letters 87: 198701.
View Article
Google Scholar

[71] View Article

[72] Google Scholar

[ref25] 25. Sporns O (2011) Networks of the Brain. Cambridge: The MIT Press.

[ref26] 26. Boccaletti S, Latora V, Moreno Y, Chavez M, Hwang DU (2006) Complex networks: Structure and dynamics. Physics Reports 424: 175–308.
View Article
Google Scholar

[75] View Article

[76] Google Scholar

[ref27] 27. Schaeffer SE (2007) Graph Clustering. Computer Science Review 1: 27–64.
View Article
Google Scholar

[78] View Article

[79] Google Scholar

[ref28] 28. Rubinov M, Sporns O (2010) Complex network measures of brain connectivity: uses and interpretations. Neuroimage 52: 1059–1069.
View Article
Google Scholar

[81] View Article

[82] Google Scholar

[ref29] 29. Sporns O, Zwi JD (2004) The small world of the cerebral cortex. Neuroinformatics 2: 145–162.
View Article
Google Scholar

[84] View Article

[85] Google Scholar

[ref30] 30. Milo R, Shen-Orr S, Itzkovitz S, Kashtan N, Chklovskii D, et al. (2002) Network motifs: simple building blocks of complex networks. Science 298: 824–827.
View Article
Google Scholar

[87] View Article

[88] Google Scholar

[ref31] 31. Maslov S, Sneppen K (2002) Specificity and stability in topology of protein networks. Science 296: 910–913.
View Article
Google Scholar

[90] View Article

[91] Google Scholar

[ref32] 32. van Wijk BCM, Stam CJ, Daffertshofer A (2010) Comparing Brain Networks of Different Size and Connectivity Density Using Graph Theory. PLoS One 5: e13701.
View Article
Google Scholar

[93] View Article

[94] Google Scholar

[ref33] 33. Zalesky A, Fornito A, Bullmore E (2012) On the use of correlation as a measure of network connectivity. Neuroimage 60: 2096–2106.
View Article
Google Scholar

[96] View Article

[97] Google Scholar

[ref34] 34. Hirschberger M, Qi Y, Steuer RE (2004) Randomly generating portfolio-selection covariance matrices with specified distributional characteristics. Eur J Oper Res 177: 1610–1625.
View Article
Google Scholar

[99] View Article

[100] Google Scholar

[ref35] 35. Kesler SR, Tanaka H, Koovakkattu D (2010) Cognitive reserve and brain volumes in pediatric acute lymphoblastic leukemia. Brain imaging and behavior 4: 256–269.
View Article
Google Scholar

[102] View Article

[103] Google Scholar

[ref36] 36. Friston KJ (2007) Statistical parametric mapping : the analysis of funtional brain images. Amsterdam; Boston: Elsevier/Academic Press. vii, 647.

[ref37] 37. Good CD, Johnsrude IS, Ashburner J, Henson RN, Friston KJ, et al. (2001) A voxel-based morphometric study of ageing in 465 normal adult human brains. Neuroimage 14: 21–36.
View Article
Google Scholar

[106] View Article

[107] Google Scholar

[ref38] 38. Wilke M, Holland SK, Altaye M, Gaser C (2008) Template-O-Matic: a toolbox for creating customized pediatric templates. Neuroimage 41: 903–913.
View Article
Google Scholar

[109] View Article

[110] Google Scholar

[ref39] 39. Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, et al. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage 15: 273–289.
View Article
Google Scholar

[112] View Article

[113] Google Scholar

[ref40] 40. Bassett DS, Nelson BG, Mueller BA, Camchong J, Lim KO (2012) Altered resting state complexity in schizophrenia. Neuroimage 59: 2196–2207.
View Article
Google Scholar

[115] View Article

[116] Google Scholar

[ref41] 41. Zhang J, Wang J, Wu Q, Kuang W, Huang X, et al. (2011) Disrupted brain connectivity networks in drug-naive, first-episode major depressive disorder. Biological psychiatry 70: 334–342.
View Article
Google Scholar

[118] View Article

[119] Google Scholar

[ref42] 42. Sanz-Arigita EJ, Schoonheim MM, Damoiseaux JS, Rombouts SA, Maris E, et al. (2010) Loss of ‘small-world’ networks in Alzheimer’s disease: graph analysis of FMRI resting-state functional connectivity. PLoS One 5: e13788.
View Article
Google Scholar

[121] View Article

[122] Google Scholar

[ref43] 43. Supekar K, Menon V, Rubin D, Musen M, Greicius MD (2008) Network analysis of intrinsic functional brain connectivity in Alzheimer’s disease. PLoS Comput Biol 4: e1000100.
View Article
Google Scholar

[124] View Article

[125] Google Scholar

[ref44] 44. Supekar K, Musen M, Menon V (2009) Development of large-scale functional brain networks in children. PLoS Biol 7: e1000157.
View Article
Google Scholar

[127] View Article

[128] Google Scholar

[ref45] 45. Meunier D, Achard S, Morcom A, Bullmore E (2009) Age-related changes in modular organization of human brain functional networks. Neuroimage 44: 715–723.
View Article
Google Scholar

[130] View Article

[131] Google Scholar

[ref46] 46. He Y, Wang J, Wang L, Chen ZJ, Yan C, et al. (2009) Uncovering intrinsic modular organization of spontaneous brain activity in humans. PLoS One 4: e5226.
View Article
Google Scholar

[133] View Article

[134] Google Scholar

[ref47] 47. Achard S, Bullmore E (2007) Efficiency and cost of economical brain functional networks. PLoS computational biology 3: e17.
View Article
Google Scholar

[136] View Article

[137] Google Scholar

[ref48] 48. Achard S, Salvador R, Whitcher B, Suckling J, Bullmore E (2006) A resilient, low-frequency, small-world human brain functional network with highly connected association cortical hubs. J Neurosci 26: 63–72.
View Article
Google Scholar

[139] View Article

[140] Google Scholar

[ref49] 49. Wang L, Zhu C, He Y, Zang Y, Cao Q, et al. (2009) Altered small-world brain functional networks in children with attention-deficit/hyperactivity disorder. Hum Brain Mapp 30: 638–649.
View Article
Google Scholar

[142] View Article

[143] Google Scholar

[ref50] 50. Lynall ME, Bassett DS, Kerwin R, McKenna PJ, Kitzbichler M, et al. (2010) Functional connectivity and brain networks in schizophrenia. J Neurosci 30: 9477–9487.
View Article
Google Scholar

[145] View Article

[146] Google Scholar

[ref51] 51. Kaiser M, Hilgetag CC (2006) Nonoptimal component placement, but short processing paths, due to long-distance projections in neural systems. PLoS Comput Biol 2: e95.
View Article
Google Scholar

[148] View Article

[149] Google Scholar

[ref52] 52. Viger F, Latapy M (2005) Efficient and simple generation of random simple connected graphs with prescribed degree sequence. Lect Notes Comp Sci 3595: 440–449.
View Article
Google Scholar

[151] View Article

[152] Google Scholar

[ref53] 53. Del Genio CI, Kim H, Toroczkai Z, Bassler KE (2010) Efficient and exact sampling of simple graphs with given arbitrary degree sequence. PLoS ONE 5(4): e10012.
View Article
Google Scholar

[154] View Article

[155] Google Scholar

[ref54] 54. Gkantsidis C, Mihail M, Zegure E (2003) The markov chain simulation method for generating connected power law random graphs. in Proc. of 5^th Workshop on Algorithm Engineering and Experiments (ALENEX), 16–25.

[ref55] 55. Ramsay JO, Silverman BW (2005) Functional data analysis: Springer.

[ref56] 56. van den Heuvel MP, Stam CJ, Kahn RS, Hulshoff Pol HE (2009) Efficiency of functional brain networks and intellectual performance. The Journal of neuroscience : the official journal of the Society for Neuroscience 29: 7619–7624.
View Article
Google Scholar

[159] View Article

[160] Google Scholar

[ref57] 57. Li Y, Liu Y, Li J, Qin W, Li K, et al. (2009) Brain anatomical network and intelligence. PLoS computational biology 5: e1000395.
View Article
Google Scholar

[162] View Article

[163] Google Scholar

[ref58] 58. Opsahl T, Colizza V, Panzarasa P, Ramasco JJ (2008) Prominence and control: the weighted rich club effect. Phys Rev Lett 101, 168702.

[ref59] 59. Zlatic V, Bianconi G, Diaz-Guilera A, Garlaschelli D, Rao F, et al.. (2009) On the rich-club effect in dense and weighted networks. Eur Phys J B 67, 271–275.

[ref60] 60. Gillis J, Pavlidis P (2011). The role of indirect connections in gene networks in predicting funcion. Bioinformatics 27(13), 1860–66.