Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Extending Ripley’s K-Function to Quantify Aggregation in 2-D Grayscale Images

Abstract

In this work, we describe the extension of Ripley’s K-function to allow for overlapping events at very high event densities. We show that problematic edge effects introduce significant bias to the function at very high densities and small radii, and propose a simple correction method that successfully restores the function’s centralization. Using simulations of homogeneous Poisson distributions of events, as well as simulations of event clustering under different conditions, we investigate various aspects of the function, including its shape-dependence and correspondence between true cluster radius and radius at which the K-function is maximized. Furthermore, we validate the utility of the function in quantifying clustering in 2-D grayscale images using three modalities: (i) Simulations of particle clustering; (ii) Experimental co-expression of soluble and diffuse protein at varying ratios; (iii) Quantifying chromatin clustering in the nuclei of wt and crwn1 crwn2 mutant Arabidopsis plant cells, using a previously-published image dataset. Overall, our work shows that Ripley’s K-function is a valid abstract statistical measure whose utility extends beyond the quantification of clustering of non-overlapping events. Potential benefits of this work include the quantification of protein and chromatin aggregation in fluorescent microscopic images. Furthermore, this function has the potential to become one of various abstract texture descriptors that are utilized in computer-assisted diagnostics in anatomic pathology and diagnostic radiology.

Introduction

Spatial point analysis, the analysis of dispersion and clustering of events, has been well-studied and heavily utilized in many fields [1,2]. One of the earliest attempts at providing a solid mathematical foundation to quantify “significant” clustering or dispersion was that of Clark and Evans in 1954, which relied on the “average distance to the nearest neighbor” [3]. However, the problem with Clark’s method is that it does not quantify clustering at different scales, unlike other methods that have been later devised to address this issue.

Nowadays, Ripley’s K-function, developed in 1977, is considered to be the “golden standard” in spatial point analysis [4]. Since its original development, Ripley’s K-function has been extensively used in a very large spectrum of applications, including geography, epidemiology, economics and biomedical research [1,2,58]. The concept behind Ripley’s K-function is rather simple; it is the average number of events (particles) located within a predefined radius of any typical event, normalized for the event intensity (density) over the same field of view. Ripley’s K-function compares the distribution of events in a given field of view to Complete Spatial Randomness (CSR), otherwise known as a “homogeneous Poisson process”. At CSR, the locations of events are completely random; not regular but random (Fig 1).

thumbnail
Fig 1. The concept behind Ripley’s K-function.

Panel A: Ripley’s K-function is defined as the average number of events within a predefined radius of any event, normalized for the event intensity (density) over the whole field of view. A set of radii is typically used to quantify the scale at which clustering (or dispersion) of events occurs (red circles). Panel B: Events within a given field of view could be distributed in many forms, including Complete Spatial Randomness (CSR), regularity and clustering (with or without a diffuse pool). Panel C: plots for two of the event distributions in Panel B: CSR (upper) and Clustering (lower). The dashed lines represent the upper and lower critical quantiles (Q01 and Q99).

https://doi.org/10.1371/journal.pone.0144404.g001

Previous attempts to integrate Ripley’s K-function into image processing include its utilization in concrete (segmentation-based) statistics [9,10]. In this paper, we test and optimize the use of Ripley’s K-function as an abstract index of clustering, to allow for event overlap at very high densities. As will be described later, problematic edge effects become of particular relevance at very high densities, and previously-reported patterns linking the radius at which the K-function is maximized with the underlying cluster radius break down. But why would it be useful to extend Ripley’s K-function to allow for event overlap? Our main motivation was to develop an image processing approach to quantifying protein aggregation in fluorescent microscopic images.

While the quantification of higher order protein homo-oligomerization and aggregation propensity in-vitro has been thoroughly developed over many decades of protein biochemistry research, the quantification of in-vivo oligomerization or aggregation has received relatively less attention. Over the past few years, however, the importance of in-situ characterization of protein solubility and aggregation became increasingly clear [11]. This paradigm shift has been caused by a number of developments in protein research including: a) a better understanding of the role played by complex intra-cellular environments in altering reaction equilibria and causing a disparity between in-vitro and in-vivo assays [12,13], b) a wealth of evidence outlining the crucial involvement of protein aggregation in a multitude of diseases, including Alzheimer's disease, Huntington's disease, Amyotrophic Lateral Sclerosis (ALS), Parkinson's disease and Prion disease [14], c) an increasingly widening scope of protein aggregation research to include emerging fields such as ageing research [15,16], and d) the realization that bacterial inclusion bodies (IB's) may be used as sources of active recombinant proteins [17] as well as a model system for amyloid aggregation studies [18].

One of the most problematic issues that arise when trying to quantify in-vivo aggregation of proteins is the interference caused by the soluble pool of proteins with accurate and specific identification and characterization of aggregates. Several experimental approaches have been devised to overcome this limitation, and fall into four broad categories, reviewed in a recent commentary by Ami et al [11]: Genetically-encoded fusion tags such as GFP or tetra-Cys tags; Conformation-sensitive dyes such as Thioflavin-S; Direct spectroscopic methods such as Nuclear Magnetic Resonance (NMR); Aggregation-sensitive reporters. The majority of these experimental approaches rely on parameters that can differentiate between soluble an aggregated forms of proteins.

Our focus is on the first category: fluorescence microscopy. When fluorescent aggregates are formed as a result of defective protein folding, it has been shown that in some situations it may be possible to quantify aggregation propensity simply by measuring the bulk cell fluorescence of GFP-fusion constructs. That is, since unfolded GFP does not fluoresce while folded GFP (in non-aggregated mutants) emits a detectable fluorescent signal [19]. Other interesting approaches to detect misfolded (or partially folded) aggregates through fluorescence microscopy include the pioneering work of Ignatova et al showing that tetra-Cys fusion tags form hyper-fluorescent aggregates, enabling the detection of protein stability and aggregation in-vivo in real time [20]; But what about situations in which aggregation and misfolding are not necessarily coupled?

Oftentimes, proteins in their native state oligomerize and form cytoplasmic puncta which may or may not be of regular sizes and shapes, and which may constitute only a fraction of the amount of protein in the cell, the rest being in diffuse (soluble) form [2123]. In such cases, studies of protein supramolecular complexes or aggregates traditionally involved in-vitro biochemical methods such as chromatographic and centrifugation assays to separate aggregates from soluble protein pools. The problem, however, is that these biochemical techniques are often prone to in-vitro artifacts.

Generally speaking, there are two broad categories of calculations that can be applied to two-dimensional fluorescence microscopic images: "concrete" (segmentation-based) statistics and "abstract" (e.g. texture) statistics [24]. Concrete statistics try to separate out objects from background (segmentation), allowing further calculations to be performed on the objects such as total intensity, volume, localization and so on. Depending on the context, the most suitable segmentation techniques may vary considerably [25]. We faced some difficulty when we tried to quantify the effect of various mutations on the incorporation of a protein, Cubitus interruptus (Ci), into cytoplasmic puncta using confocal fluorescence microscopy. The differentiation between punctate and diffuse protein forms in our case was often tricky due to the following factors: a) the presence of a soluble pool introduces high background, reducing signal-to-background ratio; b) the amount of soluble protein is variant in different regions, causing high variability in background intensity; c) clumping of aggregates introduces further ambiguity into the image segmentation process. Besides, the highly heterogeneous nature of the aggregates prevents filtering based on a common morphology, as would have been possible for tube-like [26] or sheet-like [27] structures, for example.

Can an abstract statistical metric be used to quantify protein aggregation? Because of the low signal-to-background ratio and the inherent variability in background in images of protein aggregation studies, isolating aggregates reliably using concrete statistical measures (i.e. segmentation) may sometimes be very difficult. The golden standard, of course, would be to devise better experimental methods that enable the reliable separation of proteins in the soluble and aggregated pool. However, were this unavailable, it may be necessary to use an abstract metric to quantify aggregation. Many abstract image metrics exist, including simple histogram-based metrics such as mean, variance, skewness and kurtosis, and Haralick Gray Level Colocalization Matrix (GLCM) texture descriptors [24,28]. Besides, a number of user-friendly machine learning programs have been developed, most notably CellProfiler and CellProfiler Analyst [29,30], that allow automatic identification of features of interest after initial training by the program user. As we will describe later, we demonstrate the validity of our extension of Ripley’s K-function as a theory-driven abstract index in quantifying protein aggregation using simulated and experimental ground-truth controls. In addition, we argue for the generalizability of our approach by performing a proof-of-concept analysis on a previously-published dataset, in order to validate its use in chromatin condensation quantification as well.

Materials and Methods

1. Software used and data availability

All simulations and image processing codes were written and maintained in MATLAB (Version R2015a, The Mathworks Inc., USA). Preprocessing of protein aggregation images was done using ImageJ 1.49v and CellProfiler 2.1.1 [29,31]. The dataset and codes used for K-function calculation and validation are available in the supplementary materials (S1 and S2 Files).

2. Mathematical development

2a. The original K-function.

Ripley’s K is given by the equation: (1) Where E is the expectation (i.e. “average”) number of events within radius r, n is the total number of events within the study area and λ is the intensity (density) of events, such that and |Ω| is the area of the study region (the entire field, including all potential event locations). Hence: (2) Where dxy is the distance between event locations x and y and Ir is an indicator function that has a value of 1 if the distance between locations x and y is less or equal to r. That is,

As with many image processing metrics, edge effects can be particularly challenging when it comes to Ripley’s K-function calculation. Given the definitions described earlier, consider the events that fall at a distance less than r from the edge of the image. Summing up the number of events within radius r of each of these “central” events would result in under-estimation; since the “empty” potential locations outside the study region may well have been populated with events were the field of view larger in size. Multiple edge correction methods have been devised for Ripley’s K-function; the most famous one was developed by Ripley himself, and is still used often in the literature. Ripley’s correction consists of dividing the number of events at a certain distance from the central event by the proportion of the circumference of a circle of the same radius that is included within the field of view. Since its original development, it was noted that this edge correction method is biased as it gives more weight to events that are farthest from the central event. One of the best and most widely accepted methods to correct for this bias was proposed by Besag [32]. Instead of correcting for events at each distance from the central event separately, Besag’s correction corrects for all events at once. That is, the overall number of events within a particular radius is divided by the proportion of the area of a circle of the same radius (centered on the central event) that is included within the field of view. For these reasons, we used Besag’s edge correction for all experiments in this paper.

Therefore, (3)

Axr is the area of the portion of circle b(x,r), centered on position x and having a radius r, that lies within the study region. Besag’s edge correction term is given by the equation:

Because Ripley’s K-function normalizes for the event density, its expectation at CSR is simply the area a circle of the same radius as that used to calculate the function. One problem with the original K-function is that it is not centered on zero, nor is it normalized to have a unit variance. While there are multiple versions of the K-function (including the L- and the H- functions [32,33]), we used the version proposed recently by Lagache et al [34], which also has a unit variance, and has the following equation: (4)

Once the K-function of a particular field of view is obtained, it is compared to the upper and lower limits (typically, the 1st and 99th quantiles) of what its value would be at CSR. The theoretical determination of these “critical quantiles” proved to be especially difficult due to edge effects, and even though multiple attempts existed in the past, extensive Monte-Carlo simulations remained to be the only reliable method for critical quantile determination. It wasn’t until recently that Lagache and colleagues provided the first solid theoretical foundation for critical quantile determination, based on the Cornish-Fisher expansion [34]. As can be seen in Fig 1C, at CSR lies within the bounds of the theoretically-determined critical quantiles, while it lies outside these bounds when the events are clustered.

2b. Extension to allow for event overlap.

Our extension of Ripley’s K-function is as follows. We imagined each intensity unit to be one particle such that, in an 8-bit grayscale image, the saturation limit is 28−1 = 255 particles per pixel. The number of particles around any particle within the same pixel = Px−1, where Px is the intensity at pixel x. The number of particles around any particle in surrounding pixels within a circle of radius r = , where Np is the total number of pixels in the field of view and .

Hence, the number of particles within radius r around each particle at pixel x = (5)

Summing up for all particles in a given pixel location x (and injecting Besag’s edge correction term), it follows that the total number of particles around particles at pixel x within radius r = (6)

Finally summing up over the whole field of view and normalizing to obtain K, (7) Where Np is the total number of pixels and n is the total intensity (i.e. total number of particles) over the whole field of view.

2c. Different implementations of Besag’s edge correction term.

To test the validity of our extension of Ripley’s K-function to grayscale (non-binary) fields of view, we devised the following validation workflow (illustrated in Fig 2).

thumbnail
Fig 2. Approaching problematic edge effects at non-binary fields of view and small radii.

Panel A: Three implementations of Besag’s edge correction term were tested. Note that the black region (black pixels) are considered to be outside the study region (i.e. the border between the grey and black area represents the edge of the study region), The implementations are as follows: i) Dividing the total number of pixels, located within a pre-defined radius from a given border pixel (light-gray area), by the total area of an ideal circle (area enclosed by the dotted red line). ii) Same as implementation i, but dividing by the total area of a non-ideal/pixelated circle (light-gray plus pink regions). iii) Same as implementation i, but applied for all pixels within the field of view. Hence, even for non-border pixels, the edge correction term would be obtained by dividing the area of the pixelated circle by the area of a perfect circle of the same radius. Panel B: The difference between an “ideal” circle and its pixelated counterpart at the four radii tested in this paper. Panel C: Complete Spatial Randomness (CSR) at a selected number of event densities (intensities). Each field of view measures 256 x 256 pixels. The image intensities were re-scaled for display purposes; the simulations used in Ripley’s K-function validation were set such that one intensity unit is akin to one event, at a saturation limit of 255 events per pixel (8-bit grayscale images).

https://doi.org/10.1371/journal.pone.0144404.g002

We generated synthetic fields of view measuring 256 x 256 pixels and assigned particles at various densities to these pixels in a random manner, in order to create a homogenous Poisson distribution (CSR). The densities were exponentially increased and the K-function calculated at four different radii. In order to keep our method suitable for practical applications, particularly the quantitative ranking of mutant constructs in order of increasing protein aggregation, we used small-to-medium radii for K-function calculation. Two implementations of Besag’s edge correction term were tested, described by the following equations:

Both edge correction methods were applied to “border pixels”, where a border pixel is defined as any pixel located at a distance less than r from the margin of the field of view. Note that the area b(x,r) is actually less than πr2 due to pixilation effects. As we will discuss in the results section, the two methods fail to maintain centralization of the K-function at high densities, and a simple adaptation where method I was applied to all pixels (not just border pixels) was needed.

3. Validation using simulations

3a. Testing shape-dependence of the K-function.

In order to adapt Ripley’s K-function for practical applications, zero pixels were ignored during edge correction, such that Regions of Interest (ROI’s) could be thresholded, with the background given a value of zero, before K-function calculation. Circular decimations, with a radius of 20 pixels, were randomly-scattered across a field of view with a minimum offset of one pixel. After the positions of decimations were determined, events were randomly distributed across all the other locations within the 256 x 256 pixel square field of view.

3b. Testing correspondence between and the Aggregate-to-Diffuse Ratio (ADR).

We validated our approach by simulating the aggregation process and noting the change in as the ground-truth ADR values were gradually increased. Two modalities of increasing ADR were tested: (i) increasing the number of aggregates (clusters) while keeping the Signal-to-Background ratio (SBR) constant. (ii) increasing the SBR (effectively increasing the contrast) while keeping the number of aggregates constant.

Simulated 256 x 256 pixel fields of view were used in this experiment, with randomly-located circular clusters (aggregates) having a radius of 8 pixels. The signal was added to the background. In other words, pixels belonging to the aggregates had a value equal to the signal plus the background [35].

After particles were distributed across the field of view, the resulting image was convolved with a Gaussian blur filter having a diameter of 3 pixels and a sigma of 1 pixel, and Poisson noise was generated at high and low Signal-to-Noise ratios (SNR’s), simulating the Point Spread Function (PSF) and noise of a confocal microscope [36,37]. Poisson noise, being the main form of degradation occurring in confocal microscopy [35], was added by applying a Poisson noise generator to each pixel independently, with a lambda equal to the intensity of the pixel of interest [38]. was calculated for each image at a radius (rk) ranging between 2 and 15 pixels.

3c. Characterizing aggregates.

Kiskowski et al reported that a variable degree of correspondence existed between the radius at which Ripley’s K-function was maximized () and the true aggregate radius (ragg) [39]. They showed, using simulations of circular clusters of particles, that ranges between ragg and 2ragg, depending on the separation distance between aggregates, as well as the presence of a diffuse (non-aggregated) pool of particles. We tested whether this still held true when particle overlap was allowed using the following method. Simulated 256 x 256 pixel fields of view were generated, with randomly-located circular clusters (aggregates) having a radius ranging between 2 and 10 pixels. was calculated for each image at a radius (rk) ranging between 1 and 35 pixels.

In addition, we illustrated the use of other, less speculative, techniques in characterizing aggregates. Two well-known methodologies may be used once the “abstract” measure of clustering (Ripley’s K-function) has been calculated: segmentation and granulometry. We generated 10 sets of 30 synthetic images, each containing four sets of 20 randomly-located aggregates having radii of 2, 4, 6 and 8 pixels. After particles were distributed across the field of view, the resulting image was convolved with a Gaussian blur filter and Poisson noise was added in the same manner described earlier.

Segmentation of the original images was achieved by passing the synthetic images through an imageJ pipeline consisting of the “Subtract Background” command [40], Auto-thresholding using the “MaxEntropy” method [41], followed by a “Close” operation with edge padding [42]. The granulometric profile was obtained by repeatedly opening the image using progressively larger radii and obtaining the pixel value sum of the resulting image [43,44].

We employed the bivariate similarity index described by Dima et al to illustrate the comparative accuracy and specificity of the two approaches described [45]. The bivariate similarity index, which is itself an extension of the widely used Jaccard Similary Index [46], relies on two measures: TET and TEE, given by the following equations: Where T represents the number of non-zero pixels in the ground “Truth” mask, E represents the number of pixels in the “Estimate” mask, and TE is the number of pixels that are common to both the Truth and Estimate masks. Note that where there were no non-zero pixels in the Estimate mask, TEE was given a value of one [45].

4. Experimental validation

4a. Quantifying protein aggregation.

To further test the validity of our approach, we devised the following experimental setup. We created five constructs containing cells that have been co-transfected with two proteins, Ci and eGFP, which possess different intracellular localization behaviors. Ci (Cubitus interruptus) is the main transcription factor in the hedgehog signaling pathway. Ci generally exists in two forms in the cytoplasm: diffuse form and aggregated in large protein complexes with other signaling molecules such as Cos2, fused and su(fu) [23,47]. Complexed/aggregated Ci is readily sedimentable by ultracentrifugation [48], and has been shown to dimerize under certain conditions [49]. We found that forced constitutive dimerization of Ci, by replacing its first 440 amino acids with the dimerization domain of CGN4 (GCN4-Ci), results in a predominantly-punctate Ci distribution that appears mainly in the pellet fraction upon ultracentrifugation.

eGFP (Green Fluorescent Protein), on the other hand, is predominantly distributed in a diffuse manner when transfected into Clone 8 Drosophila cells. Hence, by controlling the co-transfection ratio and using the same tag and antibody for both GCN4-Ci and eGFP (in this case, HA- tag), we had a way to “artificially control” the ratio between aggregates and diffuse protein in a cell; an experimental “ground truth control” so-to-speak. Since the transfection efficiencies of Ci and eGFP are not equal, we confirmed the expression of both proteins by subcellular fractionation (differential centrifugation). Hence, the ratio between the pellet and soluble fractions represents the “true” ratio between aggregated and diffuse protein. We calculated the value for each cell by averaging out the values for different stacks obtained with confocal microscopy.

Co-transfection: Clone 8 cell lines [50] were obtained from (and maintained in accordance with) Indiana University's Drosophila Genomics Resource Center. The cells, which were passaged every three days, were cultured in T-25 flasks (Corning) using Complete M3 medium (Shields and Sang M3 insect medium Sigma S3652 with 2% FBS (Fetal Bovine Serum, Perbio Science), 100 units/ml penicillin G, 100 mg/ml streptomycin sulphate, 0.125 IU/ml insulin and 2.5% fly extract). Twenty-four hours before transfection, the cells were seeded onto 12-well plates at a density of 0.5x106 cells per well. Afterwards, transfection with various amount of DNA was carried out using Effectene transfection reagent (QIAGEN) according to the manufacturer's protocol. All ROI's shown in this paper are from cells that express the following 3xHemagglutinin (HA) -tagged constructs: (i) GCN4-Ci and (ii) eGFP. The amount of DNA used for each of the five constructs is as follows:

Construct 1 –GCN4-Ci: 400ng, eGFP: 0ng;

Construct 2 –GCN4-Ci: 400ng, eGFP: 13.3ng;

Construct 3– GCN4-Ci: 400ng, eGFP: 33ng;

Construct 4 –GCN4-Ci: 330ng, eGFP: 67ng;

Construct 5 –GCN4-Ci: 0ng, eGFP: 300ng.

Confocal microscopy: Immunostaining was performed using mouse monoclonal anti-HA antibodies (1:500, 12CA5, Roche) followed by an anti-mouse secondary conjugated with Alexfluor594. Confocal microscopic images were acquired using LSM 510 (Zeiss Microscopy, Germany) and converted to 8-bit grayscale images for further processing.

Differential centrifugation: Cell were washed 3 times with ice-cold PBS and re-suspended in lysis buffer (10mM HEPES, ph7.4, 150mM NaCl, 0.5mM MgSO4, 1mM DTT and 1X Complete protease inhibitor (Roche)). Cells were lysed by passage through 27.5G needles 20 times. Unlysed cells and nuclei were removed by centrifugation at 800 gavg for 5 mins. The pellet fraction was then obtained from centrifugation of the supernatant at 162,000 gavg for 1 hr using a S140AT rotor (Hitachi), and the resulting supernatant was concentrated five times by methanol/chloroform precipitation (soluble fraction).

Image pre-processing: The raw images were convolved with a Gaussian blur operator with a sigma of 0.1 μm using ImageJ, in order to increase their SNR. Afterwards, all images were thresholded using Otsu’s method, which relies on minimizing the intra-class variance. Three-class Otsu thresholding was performed, with the middle class set to belong to the background [51]. The resultant images consisted of cytoplasmic protein (foreground) against a background of zeros.

values of stacks belonging to the same cell were “ensemble averaged” to get the “overall” for each cell. The “overall” results for all cells were then averaged to get the final metric for each construct. Error bars represent the standard error of the mean (SEM).

4b. Quantifying chromatin condensation.

We demonstrate the generalizability of the K-function by applying the algorithm to images of Arabidopsis plant cell nuclei that have been obtained by Poulet et al [52] and published as a dataset at: https://www.gred-clermont.fr/media/WorkDirectory.zip. Two nuclear phenotypes, originally described by Wang et al [53], were distinguished in the dataset: wild type (wt) and a double mutant lacking both crwn1 and crwn2 (shorthand for “crowded nuclei”) proteins, which are plant nucleoskeletal proteins. Crwn1 crwn2 has been shown independently by Wang et al and Poulet et al to possess different phenotypic features, the most relevant of which is the smaller number of chromocentres than wt nuclei. Chromocentres are organized condensations of heterochromatin found in interphase nuclei. While Wang et al used manual methods to quantify the differences between wt and crwn1 crwn2, Poulet et al used semi-automated segmentation-based methods to do so. We calculated for each nucleus by calculating the value for each stack and averaging out the values to calculate the resultant value.

All images analyzed in this paper, whether simulated or experimental, were not subjected to intensity normalization, histogram equalization or any other contrast-altering process before calculation. All experimental images were 8-bit grayscale images, and all simulations were limited to the 8-bit dynamic range of 0–255 intensity units per pixel.

Results and Discussion

1. Restoring the centralization of

We noticed that deviated markedly from zero when either one of the edge-correction methods described was utilized (Figs 3 and 4). We solved this issue by applying the edge correction term in method I not just to edge pixels, but to all pixels in the field of view (Fig 5). Essentially, what this means is that the “aggregation score” at every pixel is corrected for the difference between the “pixelated” circle forming the moving window and its “ideal” counterpart (Fig 2A and 2B).

thumbnail
Fig 3. Unsuccessful implementations of Besag’s edge correction term at non-binary fields of view ( with respect to event density at different radii).

The normalized and centered K-function (), as described by Lagache et al, was calculated at different particle intensities and radii using simulated square fields of view measuring 256 x 256 pixels, with a homogeneous Poisson distribution of particles (Complete Spatial Randomness). Densities are expressed in particles per pixel. The black line represents the mean and the dotted lines represent the upper and lower critical quantiles (Q01 and Q99). Each mean/quantile was determined using a set of 1000 simulations. Panel A: Applying Besag’s correction term only to edge pixels, by dividing the pixels within a given radius by the area of an ideal circle of the same radius. It can be seen that is no longer centered around zero at high particle intensities. Panel B: Same as panel A, but dividing by a pixelated circle rather than an ideal one. Like panel A, it can be seen that is no longer centered around zero at high intensities. Panel C: For comparison, was calculated without applying any edge correction terms. It can be seen that edge effects play a significant role at high particle intensities, making deviate remarkably from zero.

https://doi.org/10.1371/journal.pone.0144404.g003

thumbnail
Fig 4. Unsuccessful implementations of Besag’s edge correction term at non-binary fields of view ( with respect to radius at different event densities).

The normalized and centered K-function (), as described by Lagache et al, was calculated at different particle intensities and radii using simulated square fields of view measuring 256 x 256 pixels, with a homogeneous Poisson distribution of particles (Complete Spatial Randomness). Densities are expressed in particles per pixel. The black line represents the mean and the dotted lines represent the upper and lower critical quantiles (Q01 and Q99). Each mean/quantile was determined using a set of 1000 simulations. Panel A: Applying Besag’s correction term only to edge pixels, by dividing the pixels within a given radius by the area of an ideal circle of the same radius. It can be seen that is no longer centered around zero at high particle intensities. Panel B: Same as panel A, but dividing by a pixelated circle rather than an ideal one. Like panel A, it can be seen that is no longer centered on zero at high intensities. Panel C: For comparison, was calculated without applying any edge correction terms. It can be seen that edge effects play a significant role at high particle intensities, making deviate remarkably from zero.

https://doi.org/10.1371/journal.pone.0144404.g004

thumbnail
Fig 5. Successful adaptation of Besag’s boundary correction at non-binary fields of view.

The normalized and centered K-function (), as described by Lagache et al, was calculated at different particle intensities and radii using simulated square fields of view measuring 256 x 256 pixels, with a homogeneous Poisson distribution of particles (Complete Spatial Randomness). Densities are expressed in particles per pixel. Besag’s boundary correction was applied to all particles within the field of view and not just border pixels, as described in the text and in Fig 2. Panels A and B: The black line represents the mean and the dotted lines represent the upper and lower critical quantiles (Q01 and Q99). In order to ensure convergence, each mean/quantile was determined using a set of 25,000 simulations. The red dotted lines represent the Cornish-Fisher expansion used to estimate the critical quantiles, as validated by Lagache et al., while the green dotted lines represent the normal quantiles. Unlike the other unsuccessful implementations shown in Figs 3 and 4, mean remains centered on zero even at very high particle densities. Panel C: Quantifying relative error in the Cornish-Fisher expansion estimation of the empirically-determined critical quantiles.

https://doi.org/10.1371/journal.pone.0144404.g005

The reason the former two methods failed while the latter worked is that at large particle densities, differences between the “pixelated” circle forming the moving window and its “ideal” counterpart become highly significant.

Consistent with Lagache et al. [34], the relative error is, for the most part, below the 5% benchmark. At very small radii (radius = 3) and very high densities (>7 particles per pixel), the relative error is higher than 5%, but still below 20%. At very high event densities, it can be seen that the empirical quantiles are closer to the mean than the Cornish-Fisher expansion, indicating that under these conditions the Cornish-Fisher expansion is a good “positive” (confirming clustering/dispersion), but a poorer “negative” (ruling out clustering/dispersion).

Having shown that the extended form of Ripley’s K-function remains centralized at both small radii and high densities, we also showed that the modified form (which ignores zero pixels) is shape-invariant. Fig 6 shows that retains is centralization at zero even when a large proportion of the image has been decimated.

thumbnail
Fig 6. Testing the shape-dependence of our adaptation of Ripley’s K-function using repeated random decimation of simulated fields of view.

Note that the black circular regions (black pixels) are considered to be outside the study region, and are generated to create artificial “edges”. Panel A: Sample simulated fields of view at decimation frequencies of 4, 6, 10 and 12. Panel B: The normalized and centered K-function () at various decimation frequencies. The black line represents the mean and the dotted lines represent the upper and lower critical quantiles (Q01 and Q99). Each mean/quantile was determined using a set of 1000 simulations. It can be seen that remains centered on zero regardless of the decimation frequency or radius at which was calculated.

https://doi.org/10.1371/journal.pone.0144404.g006

2. successfully ranks simulated images in the order of increasing ADR

It can be seen in Fig 7 that increases when the proportion of particles assigned to aggregates (ADR) is increased, whether by increasing the number of aggregates or by increasing the number of particles assigned to each aggregate.

thumbnail
Fig 7. The normalized and centered K-function () increases as the Aggregate-to-Diffuse ratio (ADR) increases.

Each result displayed represents the average of 30 simulated fields of view using the exact same experimental parameters. The x-axis in the right panels shows the radius at which was calculated (rk). Panel A: Left—ADR was varied (the proportion of particles allocated to aggregates) by varying the number of aggregates (Nagg) while keeping the Signal-to-Background ratio (SBR) constant. Note that the signal is added to the background. Since the aggregates have a pre-defined radius, SBR was not the exact same, but varied subtly due to “quantization” effects as the number of aggregates is increased. Right—As ADR increases, increases. This remains true at SNR = 2. Panel B: Left—ADR was varied by varying the SBR while keeping Nagg constant. Right—As ADR increases, increases. This remains true at SNR = 2.

https://doi.org/10.1371/journal.pone.0144404.g007

Our recommendation is to not consider to be a “hard” mathematical metric to quantify ADR itself. Instead, we prefer viewing as an abstract metric that increases as either component of clumping increases: spatial proximity of higher intensity pixels and intensity of aggregates relative to the background. Thus, is best used to rank images in the order of increasing aggregation under well-controlled conditions.

3. At very high densities, fails to correspond to the ragg

Even though we were able to replicate the pattern reported by Kiskowski et al at low particle densities [39], the pattern broke down when the densities were increased to very large values. While it did remain true that as ragg increased the radius at which was maximized (that is, ) also increased, no longer ranged between ragg and 2ragg at high particle densities (Fig 8).

thumbnail
Fig 8. Correspondence between the radius at which is maximized and the radius of aggregates at binary and non-binary fields of view.

Each result displayed represents the average of 30 simulated fields of view using the exact same experimental parameters. Panel A: Simulations were applied at very low event densities (0.01 particles per pixel) with and without a diffuse pool. Left—Sample simulated fields of view. The image intensities have been rescaled for display purposes. Right—Corresponding profile. Panel B: Simulations were applied at high event densities (10 particles per pixel) with and without a diffuse pool. For simulations where a diffuse pool is present, the Aggregate-to-Diffuse ratio (ADR) and Signal-to-Background ratio (SBR) were set at 0.05 and 3, respectively. Left—Sample simulated fields of view. Right—Corresponding profile.

https://doi.org/10.1371/journal.pone.0144404.g008

Given the above results, the following question arises: are there any alternative methods that could be used to characterize the sizes of aggregates in grayscale images (other than the radius at which is maximized)? The answer is: yes, and in fact the existing methodologies for characterizing grayscale images are more abundant and intuitive than those of binary spatial distribution maps. Characterizing aggregates is arguably an easier process in grayscale images, since “concrete” statistical methods can be used, including segmentation and granulometry. For example, when traditional segmentation methods are applied to the image in Fig 8A, each particle is considered to be a separate “cluster”. On the other hand, at high particle densities (Fig 8B), a cluster would be successfully segmented.

The comparative performance of segmentation and granulometry is illustrated in Fig 9. Generally-speaking, global thresholding has a more superior performance, but it performs poorer than granulometry at low SBR’s. Thus, even though cannot be used to approximate the size of clusters in grayscale images in the same manner that it could in binary spatial distributions, segmentation and granulometry are obvious alternatives. These methods offer the added benefit of spatial mapping of clusters as well as the ability to isolate clusters of variable sizes and shapes. The accuracy and specificity of such characterization process depends on the method used, as well as the image SBR and SNR values.

thumbnail
Fig 9. Alternative methodologies for characterizing aggregates at non-binary fields of view.

Panel A: Sample simulated field of view, corresponding ground truth and parameters used in the 10 sets generated. Panel B: Upper—First-derivative of the granulometric profile of the sample field of view shown in Panel A. It can be seen that there are four major troughs at radii 2, 5, 7 and 9 approximately corresponding to the ground truth radii of the aggregates. Lower—Extracting aggregates with a radius of 8 pixels, by subtracting the opened image at a radius of 9 from that opened at a radius of 8. Further thresholding and processing may be performed (described in Panel C). Panel C: Demonstrating the effect of SBR on the accuracy and specificity of segmentation of aggregates. The blue crosses represent the TET and TEE values of individual simulated fields of view (see text for a description of how TET and TEE are calculated), while the means of Sets 1 through 10 are represented by different shades of red, from darker to lighter respectively. Upper—As SBR increases, TET increases. Notice the low TET values obtained for the Sets 1–3, especially at low SNR. Lower—The result of applying the same segmentation pipeline not to the original image but to aggregates of a single radius (8 pixels) obtained using granulometric analysis (as in Panel B). The TEE values are generally lower than those of the pipeline in the upper panel. However, this method offers better results at low SBR’s (Sets 1–3).

https://doi.org/10.1371/journal.pone.0144404.g009

4. successfully ranks protein constructs in the order of increasing soluble (diffuse) fractions

It can be seen in Fig 10 that the value of successfully ranks four of the five constructs in the correct order of their GCN4-Ci:eGFP co-transfection ratios. Of course, this method has its limitations, and it can be seen that the subtle differences between the two most-aggregated constructs were not detected by .

thumbnail
Fig 10. Quantifying protein aggregation in Drosophila Clone 8 cells co-transfected with GCN4-Ci (a predominantly-aggregated protein) and eGFP (a predominantly-soluble protein) in various ratios.

Panel A: Sample images from the five constructs tested. Panel B: Western blot showing the results of subcellular fractionation of the five constructs. Panel C: Quantification of the western blot in panel B using ImageJ. Panel D: values for the five constructs tested. The number of cells analyzed in constructs 1, 2, 3, 4 and 5 is 17, 15, 16, 27 and 20 cells, respectively. Error bars represent the standard error of the mean (SEM).

https://doi.org/10.1371/journal.pone.0144404.g010

The results are consistent with our simulation results, particularly those in Fig 7A, as the main difference between various constructs is the increasing number (rather than intensity) of aggregates.

5. successfully ranks chromatin condensation in wt and crwn1 crwn2 Arabidopsis nuclei

Our results, obtained using the same dataset as Poulet et al, confirm the findings of both Wang et al and Poulet et al; values of the wt construct were significantly higher than those of the crwn1 crwn2 mutant (Fig 11). This can be attributed to the higher number of chromocentres in the wt construct (i.e. higher chromatin condensation state). One major advantage of using our approach is its applicability to large-scale batch processing of datasets. Manual methods, by comparison, are rather qualitative, often unreliable, and take a lot of time therefore limiting their utility in large-scale and real-time settings. Even semi-automated methods are time-consuming. Poulet et al reported that the time-limiting step in their analysis was the manual thresholding operation. Our method, which avoids segmentation altogether and uses an abstract index, avoids this step while still reliably reproducing the same results.

thumbnail
Fig 11. Quantifying chromatin condensation in Arabidopsis plant cells using the same dataset published by Poulet et al [52].

Panel A: Sample images from the two constructs tested: wt (wild type) and crwn1 crwn2 mutant. Crwn1 crwn2 mutant is known to have less chromocentres than wt. Panel B: values for the two constructs tested. The number of nuclei analyzed in the wt and crwn1 crwn2 constructs is 38 and 39 nuclei, respectively. Error bars represent the standard error of the mean (SEM).

https://doi.org/10.1371/journal.pone.0144404.g011

Note that since is a spatially-variant metric that calculates the intensity distribution over an entire field of view, care should be taken when any type of intensity-altering process is applied, as this will almost certainly affect the resultant values (Fig 12). Another precaution to take is that images being compared should have the same bit-depth.

thumbnail
Fig 12. Distorting effect of intensity rescaling on values.

Panel A: Left—Sample images from each of the five constructs described in Fig 10. Right—Same images after intensity normalization to occupy the full 8-bit dynamic range. Panel B: values for the images in Panel A at three different radii (2, 4, and 6 pixels). Note the distorting effect of intensity normalization not only on the values, but also on the relative ranking of images.

https://doi.org/10.1371/journal.pone.0144404.g012

Moreover, it should be noted that, since is an abstract metric that quantifies clustering over an entire field of view, correct segmentation of the field of view against a background of zeros is quintessential to its success. For example, under-segmentation of the field of view may result in the whole cell being considered to be a “single big clump”, falsely increasing the value. By contrast, over-segmentation can result in falsely low values.

While the focus of this paper has been on protein and chromatin aggregation, it should be noted that the methods described could be used to quantify aggregation in any type of 2-D grayscale image without regard to the “material” being aggregated.

Not only does an abstract aggregation metric have implications in research, it could potentially be useful in diagnostic pathology as well. Indeed, computer-assisted diagnostics have gained a lot of attention over the past few years, and there are numerous efforts to integrate automated image processing and analysis methods into daily anatomic pathology practice. As a matter of fact, an image processing approach is probably the only realistic method to quantify aggregation in diagnostic pathology practice, which typically involves visual scanning of stained histopathological slides under brightfield microscopy.

Conclusions

In conclusion, we extended the use of Ripley’s K-function to grayscale (non-binary) fields of view. A simple correction to Besag’s edge correction was presented, and was successful at restoring the function’s centralization at high densities. We showed that the extended form of the function is shape-invariant, and that previously-reported correspondence between the radius at which the K-function is maximized and true cluster radius break down at high densities. Simulations as well as co-transfection experiments were used to validate the function’s use as an abstract index of protein aggregation. In addition, proof-of-concept analysis was performed on a published chromatin condensation dataset to illustrate the generalizability of the extended form of the K-function.

Supporting Information

S1 File. Dataset used for the protein aggregation validation experiment.

https://doi.org/10.1371/journal.pone.0144404.s001

(RAR)

S2 File. MATLAB functions and scripts used in this paper.

https://doi.org/10.1371/journal.pone.0144404.s002

(RAR)

Acknowledgments

The authors would like to acknowledge with gratitude the institutional support provided by the Okinawa Institute of Science and Technology (OIST) Graduate University, as well as the help provided by: Dr Mostafa Amgad (running the simulations); Dr Mohamed Abdelhak and Dr Shareef Nazzal (technical advice on programming); Dr Maha A. Temraz, Dr Ahmed E. Elmanzalawi and Dr Heba Salah (critically reviewing the manuscript and providing excellent insights and comments). The authors are grateful to the critical comments and suggestions provided by the editor and anonymous reviewers on an earlier version of this manuscript, which improved and solidified the methodology, findings and conclusions of this work.

Author Contributions

Conceived and designed the experiments: MA MMKT. Performed the experiments: MA AI MMKT. Analyzed the data: MA MMKT. Contributed reagents/materials/analysis tools: MA MMKT. Wrote the paper: MA AI MMKT.

References

  1. 1. Gatrell AC, Bailey TC, Diggle PJ, Rowlingson BS. Spatial Point Pattern Analysis and Its Application in Geographical Epidemiology. Trans Inst Br Geogr. 1996;21: 256.
  2. 2. Eckel SM. Statistical analysis of spatial point patterns: Applications to economical, biomedical and ecological data [Internet]. Universit¨at Ulm. 2008. Available: http://www.cabnr.unr.edu/weisberg/NRES675/Diggle2003.pdf
  3. 3. Clark PJ, Evans FC. Distance to Nearest Neighbor as a Measure of Spatial Relationships in Populations. Ecology. 1954;35: 445.
  4. 4. Ripley BD. Modelling Spatial Patterns. J R Stat Soc Ser B. 1977;39: 172–212. Available: http://www.jstor.org/stable/2984796
  5. 5. Jafari-Mamaghani M. Spatial point pattern analysis of neurons using Ripley’s K-function in 3D. Front Neuroinform. 2010;4.
  6. 6. Lasserre R, Charrin S, Cuche C, Danckaert A, Thoulouze M-I, de Chaumont F, et al. Ezrin tunes T-cell activation by controlling Dlg1 and microtubule positioning at the immunological synapse. EMBO J. 2010;29: 2301–2314. pmid:20551903
  7. 7. Prior IA. Direct visualization of Ras proteins in spatially distinct cell surface microdomains. J Cell Biol. 2003;160: 165–170. pmid:12527752
  8. 8. Peterson CJ, Squiers ER. An Unexpected Change in Spatial Pattern Across 10 Years in an Aspen-White Pine Forest. J Ecol. 1995;83: 847.
  9. 9. Streib K, Davis JW. Using Ripley’s K-function to improve graph-based clustering techniques. CVPR 2011. IEEE; 2011. pp. 2305–2312. https://doi.org/10.1109/CVPR.2011.5995509
  10. 10. Kosarevych R, Rusyn B. Application of the ripley’s k-function for image segmentation. Modern Problems of Radio Engineering Telecommunications and Computer Science (TCSET), 2012 International Conference. 2012. pp. 412–412. Available: http://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=6192665&isnumber=6192411
  11. 11. Ami D, Natalello A, Lotti M, Doglia SM. Why and how protein aggregation has to be studied in vivo. Microb Cell Fact. 2013;12: 17. pmid:23410248
  12. 12. Minton AP. How can biochemical reactions within cells differ from those in test tubes? J Cell Sci. 2006;119: 2863–9. pmid:16825427
  13. 13. Ignatova Z. Monitoring protein stability in vivo. Microb Cell Fact. 2005;4: 23. pmid:16120213
  14. 14. Ross CA, Poirier MA. Protein aggregation and neurodegenerative disease. Nat Med. 2004;10 Suppl: S10–7. pmid:15272267
  15. 15. David DC, Ollikainen N, Trinidad JC, Cary MP, Burlingame AL, Kenyon C. Widespread protein aggregation as an inherent part of aging in C. elegans. PLoS Biol. 2010;8: e1000450. pmid:20711477
  16. 16. David DC. Aging and the aggregating proteome. Front Genet. 2012;3: 247. pmid:23181070
  17. 17. Gatti-Lafranconi P, Natalello A, Ami D, Doglia SM, Lotti M. Concepts and tools to exploit the potential of bacterial inclusion bodies in protein science and biotechnology. FEBS J. 2011;278: 2408–18. pmid:21569207
  18. 18. García-Fruitós E, Sabate R, de Groot NS, Villaverde A, Ventura S. Biological role of bacterial inclusion bodies: a model for amyloid aggregation. FEBS J. 2011;278: 2419–27. pmid:21569209
  19. 19. Kim W, Hecht MH. Mutations enhance the aggregation propensity of the Alzheimer’s A beta peptide. J Mol Biol. 2008;377: 565–74. pmid:18258258
  20. 20. Ignatova Z, Gierasch LM. Monitoring protein stability and aggregation in vivo by real-time fluorescent labeling. Proc Natl Acad Sci U S A. 2004;101: 523–8. pmid:14701904
  21. 21. Schwarz-Romond T, Merrifield C, Nichols BJ, Bienz M. The Wnt signalling effector Dishevelled forms dynamic protein assemblies rather than stable associations with cytoplasmic vesicles. J Cell Sci. 2005;118: 5269–77. pmid:16263762
  22. 22. Liapis E, Sandiford S, Wang Q, Gaidosh G, Motti D, Levay K, et al. Subcellular localization of regulator of G protein signaling RGS7 complex in neurons and transfected cells. J Neurochem. 2012;122: 568–81. pmid:22640015
  23. 23. Wang G, Jiang J. Multiple Cos2/Ci interactions regulate Ci subcellular localization through microtubule dependent and independent mechanisms. Dev Biol. 2004;268: 493–505. pmid:15063184
  24. 24. Hamilton N. Quantification and its applications in fluorescent microscopy imaging. Traffic. 2009;10: 951–61. pmid:19500318
  25. 25. Sankur B. Survey over image thresholding techniques and quantitative performance evaluation. J Electron Imaging. 2004;13: 146.
  26. 26. Sato Y, Nakajima S, Shiraga N, Atsumi H, Yoshida S, Koller T, et al. Three-dimensional multi-scale line filter for segmentation and visualization of curvilinear structures in medical images. Med Image Anal. 1998;2: 143–168. pmid:10646760
  27. 27. Pop S, Dufour A, Olivo-Marin J-C. Image filtering using anisotropic structure tensor for cell membrane enhancement in 3D microscopy. 2011 18th IEEE International Conference on Image Processing. IEEE; 2011. pp. 2041–2044. 10.1109/ICIP.2011.6115880
  28. 28. Haralick RM. Statistical and structural approaches to texture. Proc IEEE. 1979;67: 786–804.
  29. 29. Carpenter AE, Jones TR, Lamprecht MR, Clarke C, Kang IH, Friman O, et al. CellProfiler: image analysis software for identifying and quantifying cell phenotypes. Genome Biol. 2006;7: R100. pmid:17076895
  30. 30. Jones TR, Carpenter AE, Lamprecht MR, Moffat J, Silver SJ, Grenier JK, et al. Scoring diverse cellular morphologies in image-based screens with iterative feedback and machine learning. Proc Natl Acad Sci U S A. 2009;106: 1826–31. pmid:19188593
  31. 31. Schneider CA, Rasband WS, Eliceiri KW. NIH Image to ImageJ: 25 years of image analysis. Nat Methods. 2012;9: 671–5. Available: http://www.ncbi.nlm.nih.gov/pubmed/22930834 pmid:22930834
  32. 32. Besag JE. Comments on Ripley’s paper. J R Stat Soc B. 1977;39: 193–195.
  33. 33. Ehrlich M, Boll W, van Oijen A, Hariharan R, Chandran K, Nibert ML, et al. Endocytosis by Random Initiation and Stabilization of Clathrin-Coated Pits. Cell. 2004;118: 591–605. pmid:15339664
  34. 34. Lagache T, Lang G, Sauvonnet N, Olivo-Marin J-C. Analysis of the Spatial Organization of Molecules with Robust Statistics. Rappoport JZ, editor. PLoS One. 2013;8: e80914. pmid:24349021
  35. 35. Waters JC. Accuracy and precision in quantitative fluorescence microscopy. J Cell Biol. 2009;185: 1135–1148. pmid:19564400
  36. 36. Svoboda D, Kašík M, Maška M, Hubený J, Stejskal S, Zimmermann M. On Simulating 3D Fluorescent Microscope Images. Computer Analysis of Images and Patterns. Berlin, Heidelberg: Springer Berlin Heidelberg; pp. 309–316. https://doi.org/10.1007/978-3-540-74272-2_39
  37. 37. Rooms F, Philips W, Lidke DS. Simultaneous degradation estimation and restoration of confocal images and performance evaluation by colocalization analysis. J Microsc. 2005;218: 22–36. pmid:15817060
  38. 38. Smal I, Loog M, Niessen W, Meijering E. Quantitative comparison of spot detection methods in fluorescence microscopy. IEEE Trans Med Imaging. 2010;29: 282–301. pmid:19556194
  39. 39. Kiskowski MA, Hancock JF, Kenworthy AK. On the use of Ripley’s K-function and its derivatives to analyze domain size. Biophys J. 2009;97: 1095–1103. pmid:19686657
  40. 40. Sternberg. Biomedical Image Processing. Computer (Long Beach Calif). 1983;16: 22–34.
  41. 41. Kapur JN, Sahoo PK, Wong AKC. A new method for gray-level picture thresholding using the entropy of the histogram. Comput Vision, Graph Image Process. 1985;29: 273–285.
  42. 42. Bovik AC, Aggrawal SJ, Merchant F, Kim NH, Diller KR. Automatic area and volume measurement from digital biomedical images. In: Hader DP, editor. Image Analysis: Methods and Applications, Second Edition. 2, illustr. CRC Press, 2000; 2003. pp. 38–42.
  43. 43. Dougherty ER, Kraus EJ, Pelz JB. Image Segmentation By Local Morphological Granulometries. 12th Canadian Symposium on Remote Sensing Geoscience and Remote Sensing Symposium,. IEEE; pp. 1220–1223. https://doi.org/10.1109/IGARSS.1989.576052
  44. 44. The Mathworks Inc. USA. Granulometry of snowflakes. In: MATLAB Documentation [Internet]. [cited 9 Sep 2015]. Available: http://www.mathworks.com/help/images/examples/granulometry-of-snowflakes.html
  45. 45. Dima AA, Elliott JT, Filliben JJ, Halter M, Peskin A, Bernal J, et al. Comparison of segmentation algorithms for fluorescence microscopy images of cells. Cytometry A. 2011;79: 545–59. pmid:21674772
  46. 46. Zijdenbos AP, Dawant BM, Margolin RA, Palmer AC. Morphometric analysis of white matter lesions in MR images: method and validation. IEEE Trans Med Imaging. 1994;13: 716–24. pmid:18218550
  47. 47. Aza-Blanc P, Ramírez-Weber F-A, Laget M-P, Schwartz C, Kornberg TB. Proteolysis That Is Inhibited by Hedgehog Targets Cubitus interruptus Protein to the Nucleus and Converts It to a Repressor. Cell. 1997;89: 1043–1053. pmid:9215627
  48. 48. Ruel L, Rodriguez R, Gallet A, Lavenant-Staccini L, Thérond PP. Stability and association of Smoothened, Costal2 and Fused with Cubitus interruptus are regulated by Hedgehog. Nat Cell Biol. 2003;5: 907–913. pmid:14523402
  49. 49. Zhang Q, Shi Q, Chen Y, Yue T, Li S, Wang B, et al. Multiple Ser/Thr-rich degrons mediate the degradation of Ci/Gli by the Cul3-HIB/SPOP E3 ubiquitin ligase. Proc Natl Acad Sci. 2009;106: 21191–21196. pmid:19955409
  50. 50. Peel DJ, Milner MJ. The expression of PS integrins in Drosophila melanogaster imaginal disc cell lines. Roux’s Arch Dev Biol. 1992;201: 120–123.
  51. 51. Otsu N. A Threshold Selection Method from Gray-Level Histograms. IEEE Trans Syst Man Cybern. 1979;9: 62–66.
  52. 52. Poulet A, Arganda-Carreras I, Legland D, Probst AV, Andrey P, Tatout C. NucleusJ: an ImageJ plugin for quantifying 3D images of interphase nuclei. Bioinformatics. 2015;31: 1144–1146. pmid:25416749
  53. 53. Wang H, Dittmer TA, Richards EJ. Arabidopsis CROWDED NUCLEI (CRWN) proteins are required for nuclear size control and heterochromatin organization. BMC Plant Biol. 2013;13: 200. pmid:24308514