## Figures

## Abstract

Genetically identical cell populations exhibit considerable intercellular variation in the level of a given protein or mRNA. Both intrinsic and extrinsic sources of noise drive this variability in gene expression. More specifically, extrinsic noise is the expression variability that arises from cell-to-cell differences in cell-specific factors such as enzyme levels, cell size and cell cycle stage. In contrast, intrinsic noise is the expression variability that is not accounted for by extrinsic noise, and typically arises from the inherent stochastic nature of biochemical processes. Two-color reporter experiments are employed to decompose expression variability into its intrinsic and extrinsic noise components. Analytical formulas for intrinsic and extrinsic noise are derived for a class of stochastic gene expression models, where variations in cell-specific factors cause fluctuations in model parameters, in particular, transcription and/or translation rate fluctuations. Assuming mRNA production occurs in random bursts, transcription rate is represented by either the burst frequency (how often the bursts occur) or the burst size (number of mRNAs produced in each burst). Our analysis shows that fluctuations in the transcription burst frequency enhance extrinsic noise but do not affect the intrinsic noise. On the contrary, fluctuations in the transcription burst size or mRNA translation rate dramatically increase both intrinsic and extrinsic noise components. Interestingly, simultaneous fluctuations in transcription and translation rates arising from randomness in ATP abundance can decrease intrinsic noise measured in a two-color reporter assay. Finally, we discuss how these formulas can be combined with single-cell gene expression data from two-color reporter experiments for estimating model parameters.

**Citation: **Singh A, Soltani M (2013) Quantifying Intrinsic and Extrinsic Variability in Stochastic Gene Expression Models. PLoS ONE 8(12):
e84301.
https://doi.org/10.1371/journal.pone.0084301

**Editor: **Julio Vera, University of Erlangen-Nuremberg, Germany

**Received: **July 11, 2013; **Accepted: **November 17, 2013; **Published: ** December 31, 2013

**Copyright: ** © 2013 Singh, Soltani. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Funding: **This work is funded by the National Science Foundation Grant DMS-1312926, University of Delaware Research Foundation (UDRF) and Oak Ridge Associated Universities (ORAU). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing interests: ** The authors have declared that no competing interests exist.

## Introduction

Genetically identical cell populations exposed to same extracellular environment exhibit considerable variability in gene expression [1]–[5]. This variation in the level of a given protein is often referred to as *gene expression noise*. Increasing evidence suggests that noise plays important functional roles in many cellular processes. For example, tight control of expression noise is vital for optimal functioning of housekeeping proteins [6]–[8], and diverse diseased states have been attributed to an elevated expression noise [9]–[11]. Not surprisingly, genes actively use different regulatory mechanism to reduce stochastic fluctuations in protein levels [12]–[22], [22]–[25]. Expression noise is also exploited to drive genetically identical cells to different cell-fates [26]–[31], and to buffer cellular populations from hostile changes in the environment [27], [32]–[34].

Gene expression noise can be decomposed into intrinsic and extrinsic noise [35]–[37]. More specifically, *intrinsic noise* is the protein variability that arises from the inherent stochastic nature of biochemical reactions associated with transcription, translation, mRNA and protein degradation. Given that many mRNA species are present at low copy numbers inside cells, random birth and death of individual mRNA transcripts generates considerable intrinsic noise [38]–[41]. Let *Z* be any cell-specific factor (such as cell cycle stage, abundance of RNA polymerases/ribosomes, cellular environment, etc.) that affects expression of a given gene. Then, cell-to-cell differences in *Z* will create intercellular variability in gene expression, that is referred to as *extrinsic noise* Variations in *Z* induce fluctuations in model parameters (such as the transcription and translation rate), and extrinsic noise can be effectively quantified through analysis of deterministic gene expression models with corresponding parameter fluctuations [42].

We define intrinsic and extrinsic noise in the context of a two-color experiment, where the gene of interest is duplicated inside the cell (Figure 1). Consider two identical copies of a promoter that express two different reporter proteins and . Let and denote the level of these proteins at time inside the cell. Since cell-specific factor is common to both copies of the gene, cell-to-cell variations in will make and correlated. The contribution of to expression noise is quantified via the extrinsic noise defined as(1)and is related to the covariance between reporter levels. If reporter levels are perfectly correlated, and assuming , ,(2)which is the total noise in protein level measured by its coefficient of variation squared. Intrinsic noise is the protein variability that is not accounted for by extrinsic noise, and is defined as (3)

Two identical copies of a promoter express two different reporter proteins. Correlation in reporter levels is a measure of extrinsic noise that arises from cell-to-cell differences in shared cellular factors. Intrinsic noise is the protein variability that is not accounted for by extrinsic noise, and typically originates from the inherent stochastic nature of biochemical processes.

In summary, a two-color assay can be used to decompose the total protein noise level into intrinsic and extrinsic noise components, computed via (1) and (3), respectively.

Analytical formulas for intrinsic and extrinsic noise are derived for a class of stochastic gene expression models with fluctuations in the transcription or translation rate. Assuming mRNA production occurs in random bursts, transcription rate is represented by either the burst frequency (how often the bursts occur) or the burst size (number of mRNAs produced in each burst). Our results show that fluctuations in the transcription burst frequency enhance extrinsic noise but do not affect the intrinsic expression noise. However, fluctuations in the transcriptional burst size or mRNA translation rate increase both intrinsic and extrinsic noise. A recent study has implicated fluctuations in ATP levels as a major driver of gene expression variability [43]. Since ATP affects both transcription and translation, simultaneous fluctuations in multiple model parameters is investigated. Interestingly, simultaneous fluctuations in the transcription and translation rates decrease intrinsic noise in certain parameter regimes. Finally, usefulness of these formulas in interpreting two-color reporter experiments and estimating model parameters is discussed.

## Gene Expression with Constant Parameters

We begin by introducing the standard stochastic gene expression model [44]–[47], where all model parameters are fixed, and expression variability arises due to the stochastic nature of transcription and translation processes.

### Model Formulation

Transcription has been shown to occurs in “bursts” with each burst producing multiple mRNA copies [48]–[53]. Assume mRNAs are produced in bursts of size that occur at a rate . We refer to and as the *transcriptional burst frequency and burst size*, respectively. Consistent with measurements [50], is assumed to be a geometrically distributed random variable with probability distribution(4)and mean burst size . Proteins are produced from each mRNA at a translation rate . Finally, mRNAs and proteins degrade at constant rates and , respectively. The stochastic model considers transcription, translation and degradation as probabilistic events that occur at exponentially-distributed time intervals [54], [55]. Moreover, whenever a particular event occurs, the mRNA and protein population count is reset accordingly. Let and denote the number of molecules of the mRNA and protein at time , respectively. Then, the reset in and for different events is shown in the second column of the table in Figure 2. The third column lists the propensity functions which determine how often an event occurs. In particular, the probability that a particular event will occur in the next infinitesimal time interval is given by .

Schematic of the gene expression model (left). The stochastic model consists of four events that occur randomly at exponentially-distributed time intervals. Discrete changes in the mRNA () and protein () population count for different events are shown in the second column of the table. Third column lists the event propensity function that determines how often an event occurs.

### Computation of Intrinsic Noise

It is relatively straight forward to derive differential equations describing the time evolution of the different statistical moments of the mRNA and protein count. For the above model, the time-derivative of the expected value of any differentiable function is given by(5)where is the change in when an event occurs, is the event propensity function, and represents the expected value [56], [57]. Using the resets and propensity functions in Figure 2 this corresponds to(6)

Choosing as and in the above equation yields(7a)(7b)(7c)(7d)

Setting the left-hand-side of (7) to zero and solving for the moments results in the following steady-state mean protein and mRNA levels(8)where is the mean transcriptional burst size and represents the steady-state expected value. As done in previous studies of intrinsic and extrinsic noise [35], [36], [58], the *steady-state coefficient of variation squared* (variance divided by mean squared) is used as a metric for quantifying the extent of variability/noise in protein copy numbers. From the steady-state protein variance and mean we obtain(9)which represents the total intrinsic noise in protein level for fixed parameters. As is geometrically distributed, , and (9) reduces to

(10)The first term on the right-hand-side of (10) represents the noise in mRNA copy numbers that is transmitted to the protein level [15], [46]. The second term is the Poissonian noise arising from random birth-death of protein molecules. Next, the noise additional to (10) that comes from fluctuations in individual model parameters (such as , and ) is quantified.

## Transcription Burst Frequency Fluctuations

Consider a cell-specific factor at the transcriptional level (such as a transcription factor). Then, fluctuations in can either affect the transcriptional frequency or burst size in the model. The former case of burst frequency fluctuations is considered first.

### Modeling Parameter Fluctuations

Let denote the level of a cellular factor inside the cell at time . Fluctuations in are modeled through a simple birth-death process with probabilities of formation and degradation in the infinitesimal time interval given by(11a)(11b)where and represent the production and degradation rate of , respectively. For the process described in (11), the steady-state mean, coefficient of variation squared and the auto-correlation function are given by

(12)Thus by changing and , both the extent and time-scale of fluctuations in can be independently modulated. Note the inverse relationship between and implies Poisson statistics. Fluctuations in are incorporated in the model by assuming that the transcription burst frequency is no longer a constant but given by , making it a random process with mean and coefficient of variation squared . Throughout this manuscript, represents the extent of parameter fluctuations. Since similarly affects expression of both copies of the gene in a two-color assay, fluctuations in make reporter levels correlated in Figure 1 and induce extrinsic noise.

### Computation of Total Noise

The stochastic model consists of six birth-death events that change cellular factor, mRNA and protein copy numbers by integer amounts. Using the propensity functions in Figure 2 and (11) in (5) we obtain(13)for any differentiable function . Appropriate choices of result in

(14a)(14b)(14c)(14d)(14e)(14f)(14g)which yield the steady-state variability in protein level as

(15)The first two terms on the right-hand-side of (15) represent the noise level with fixed parameters (Eq. (10)). The third term is the additional noise due to burst frequency fluctuations. Next, (15) is decomposed into intrinsic and extrinsic noise components as measured by the two-color reporter assay (Figure 1).

### Computation of Intrinsic and Extrinsic Noise

Extrinsic noise can be approximated by the coefficient of variation squared of the protein level in a deterministic gene expression model with corresponding parameter fluctuations [42]. The deterministic counterpart to the stochastic model is the set of ordinary differential equations(16a)(16b)driven by the stochastic process defined in (11). For this hybrid model, where some states are continuous and other are discrete, the time derivate of is given by (see Theorem 1 in [59])(17)and leads to moment dynamics identical to (14) except for

Quantification of protein noise level from (14) (with (14c)–(14d) replaced by (18a)–(18b)) gives the extrinsic noise, which is subtracted from (15) for the intrinsic noise. This analysis results in(19a)(19b)(19c)

As expected, extrinsic noise increases with extent of parameter fluctuations . On the contrary, intrinsic noise is independent of and is equal to . An important limit considered previously is the case where parameter values (in this case transcription burst frequency) are drawn from a static distribution [36]. In our model, this corresponds to a scenario where the time-scale of fluctuations in are slow compared to mRNA/protein turnover rates. When , Eq. (19c) reduces to , and this result is consistent with previous calculations of extrinsic noise for parameter values drawn from a static distribution (see Eq. 25 in [36]).

## Transcription Burst Size Fluctuations

Consider an alternative scenario of a fixed transcription burst frequency but varying burst size. Assume mRNAs are produced in geometrically distributed bursts with mean , where is the level of the cellular factor inside the cell at time . This implies(20)and mean burst size

(21)### Computation of Total Noise

Time derivative of statistical moments is obtained from(23)where is given by (21). Equation (24) yields moment dynamics identical to (14) except for the time derivative of . For ,

(23)Using the fact that for a geometric distribution(24)and (21), (23) is written as

(25)Steady-state analysis of (14) (with (14c) replaced by (25)) results in(26)the total protein noise level for transcriptional burst size fluctuations. As expected when (no parameter fluctuations) (26) reduces to (10). Comparison of (26) with (15) reveals that for a given , burst size fluctuations generates larger variability in protein level than burst frequency fluctuations.

### Computation of Intrinsic and Extrinsic Noise

For burst size fluctuations, the deterministic model used for quantifying extrinsic noise will be identical to (16). Since both transcriptional burst size and frequency appear together, replacing with , and with in (16) does not alter the model. Thus, extrinsic noise is same irrespective of whether fluctuations are in the transcriptional burst size or frequency. Using (19c) and (26)(27a)(27b)(27c)

In contrast to (19), intrinsic noise linearly increases with for burst size fluctuations (Figure 3).

Intrinsic and extrinsic noise measured in two-color assay as a function of (extent of parameter fluctuations) for fluctuations in the transcription burst frequency (left), transcription burst size (middle) and mRNA translation rate (right). Intrinsic noise is independent of for transcription burst frequency fluctuations. However, for transcription burst size or translation rate fluctuations, intrinsic noise increases with . Extrinsic noise always increases with and is the largest for translation rate fluctuations.

## Translation Rate Fluctuations

Next, we consider mRNA translation rate fluctuations and set it equal to . From Figure 2, this implies that the propensity function for the translational event is now nonlinear and given by . Since mRNA production is no longer dependent on , and are independent random processes.

### Computation of Total Noise

Statistical moments of are obtained from (13) with replaced by , and replaced by . Using the fact that and are independent yields(28a)(28b)(28c)(28d)(28e)(28f)

Note that the moment dynamics is not closed, in the sense that, the time derivative of the second order moments depends on the third order moment This phenomenon occurs due to nonlinear propensity functions and typically closure methods are needed to solve for the moments [56], [57]. The independence of and is exploited for moment closure. More specifically,(29)which is dependent on the fourth order moment . As(30)equations (28)–(30) form a closed system of equations that yield total variability in protein level as(31)

### Computation of Intrinsic and Extrinsic Noise

Strategy for decomposing (31) into its intrinsic/extrinsic components is similar to previous sections: extrinsic noise is first computed from a deterministic model and then subtracted from (31) for the intrinsic noise. Consider the differential equation model(32a)(32b)with translation rate fluctuations. Replacing by , and by in (17), we obtain moment dynamics identical to (28) except for

Steady-state analysis of (28)–(30) (with (28c)–(28d) replaced by (33a)–(33b)) yields(34a)(34b)(34c)

As in (27), fluctuations in the translation rate enhance both intrinsic and extrinsic noise (Figure 3).

## Simultaneous Model Parameter Fluctuations

Previous sections focused on expression variability generated by fluctuations in individual parameters. However, stochasticity in the abundance of certain cellular factors (such as ATP) can simultaneously affect both transcription and translation. Motivated by this scenario, we investigate how perfectly correlated fluctuations in the transcription rate (measured by either the transcriptional burst frequency or burst size) and translation rate affect intrinsic and extrinsic noise.

### Transcription Burst Frequency and Translation Rate Fluctuations

Assume transcriptional bursts occur at a rate with a geometrically distributed burst size independent of and given by (4). Each mRNA produces proteins at a rate , which is perfectly correlated with burst frequency. Let(35)be a vector containing all the first and second order moments of the population counts. Then, using (13) with replaced by , time evolution of can be compactly represented as(36)where vector , matrices , depend on model parameters and is a vector of third order moments. As one would expect, nonlinear propensity function for the translation event leads to unclosed moment dynamics. It turns out that incorporating certain higher order moments in can close moment equations. More specifically, the time derivative of(37)is closed and is given by(38)for some vector and matrix . Steady-state analysis of (38) results in an exact analytical formula for the total steady-state protein noise level. In previous sections (individual parameter fluctuations), average protein copy number was invariant of and given by (8). However, simultaneous transcription/translation rate fluctuations enhance mean protein level from (8) to

(39)To resolve total noise into its intrinsic/extrinsic components the following deterministic model is used(40a)(40b)

For (40), the moment generator equation is obtained by replacing with in (17). Performing an identical analysis as (36)–(38) for the hybrid model (40) yields the extrinsic noise, which is subtracted from the total noise to obtain the intrinsic noise. Unfortunately, these expressions are too complex to be listed here but are illustrated in Figure 4. Interestingly, simultaneous fluctuations in the burst frequency and translation rate can either increase or decrease intrinsic noise depending on model parameters.

Intrinsic noise measured in two-color assay as a function of (extent of parameter fluctuations) for simultaneous fluctuations in the transcription burst frequency/translation rate (left), and transcription burst size/translation rate (right). The latter case generates larger intrinsic noise and also yields different qualitative trends compared to burst frequency/translation rate fluctuations. Depending on parameter regimes, intrinsic noise can increase, decreases or change non-monotonically with . High, medium, low protein populations correspond to an average of 300, 30 and 10 protein copies per cell, respectively. Other model parameters taken as mRNA half-life = 2 hours, protein half-life = time-scale of parameter fluctuations = 10 hours, mean transcriptional burst size = 10 and mean mRNA copy number per cell = 50.

To further elucidate the relationship between intrinsic noise and , the case of slow fluctuations in compared to mRNA/protein turnover rates (i.e., ) is considered. In this case noise expressions reduce to(41a)(41b)where the mean mRNA and protein levels are given by (see (39))

(42)Equation (41a) reveals that when(43)intrinsic noise monotonically decreases with . On the other hand when(44)intrinsic noise first increases with , reaches a maximum at(45)and then decreases with increasing .

### Transcription Burst Size and Translation Rate Fluctuations

Let transcriptional bursts occur at a constant rate with a geometrically distributed burst size that is dependent on and given by (21). mRNA translation rate is assumed to be perfectly correlated with burst size and is set equal to . The time evolution of moments is obtained from (22) with replaced by . As in the previous section, although the time derivative of (Eq. (35)) is not closed, the evolution of (Eq. (37)) is given by a closed system of linear equations that yield an exact expression for the total protein noise level. Recall that extrinsic noise is similar for transcription burst size and burst frequency fluctuations. Hence, calculation of extrinsic noise for model (40) is used to resolve the total noise into its intrinsic and extrinsic components. These results show that simultaneous transcription burst size/translation rate fluctuations not only generate a larger intrinsic noise but also have qualitatively different trends compared to burst frequency/translation rate fluctuations (Figure 4).

For slow fluctuations in compared to mRNA/protein turnover rates(46a)(46b)where and are given by (42). Analysis of (46a) shows that when(47)intrinsic noise increases with . However, when(48)intrinsic noise first decreases with increasing and then increases (Figure 4).

## Discussion

Given the different functional roles of gene expression noise inside cells [3], [32], much work has focused on understanding how variations in the level of a protein arises between otherwise identical cells. A class of models were introduced where stochasticity arises from two sources: i) Random production and degradation of individual mRNA transcripts/protein molecules stemming from the inherent probabilistic nature of biochemical reactions and ii) Fluctuations in model parameters that correspond to randomness in cell-specific factors. Exact analytical formulas for total variability in protein level were derived, in spite of the fact that in many cases parameter fluctuations lead to nonlinear propensity functions. These formulas were decomposed into intrinsic and extrinsic noise components as measured by the two-color reporter assay (Figure 1).

### Which Mechanism Generates the Largest Gene Expression Noise?

#### Individual-parameter fluctuations.

Comparison of (19), (27) and (34) shows that for low values of , fluctuations in the translation rate create the most variability in protein copy numbers. On the other hand for high , burst size fluctuations generate the most variability. Burst frequency fluctuations always generate the lowest noise.

#### Multiple-parameter fluctuations.

Equations (41) and (46) reveal that simultaneous fluctuations in translation and transcription rates can dramatically increase expression variability. For example, consider protein half-life = time-scale of parameter fluctuations = 24 hours, mRNA half-life = 8 hours, mean mRNA count/cell = 100, and . Then, for constant parameters, (Eq. (10)). Assuming ATP affects transcriptional burst size and translation rate, variability in ATP abundance () enhances noise level three-fold from to 0.32. In comparison, burst size fluctuations of similar magnitude only increase 0.1 to 0.16. These results reinforce recent observations that intercellular variation in ATP abundance can be a major driver of gene expression noise [43]. An implicit assumption in this analysis is that protein and mRNA degradation is insensitive to ATP. Since both ATP-dependent and ATP-independent degradation pathways exist within cells, further work on ATP-sensitive degradation rates is clearly needed.

### Relationship between Intrinsic Noise and

Using Monte Carlo simulation techniques previous studies had shown that parameter fluctuations can alter intrinsic noise measurements in a two-color assay [42], [60]. Building up on these results, a systematic analytical analysis of how fluctuations in both individual and multiple model parameters affect randomness in protein populations counts was performed. Main findings are as follows:

- Intrinsic noise is invariant of fluctuations in the transcription burst frequency (i.e., how often mRNA bursts occur from the promoter).
- Intrinsic noise increases with (extent of parameter fluctuations) for fluctuations in the transcription burst size (i.e., mean number of mRNAs produced in each burst) or mRNA translation rate.
- For simultaneous fluctuations in the burst frequency and translation rate, intrinsic noise decreases with for low protein abundance (Figure 4). Intuitively, for low protein abundance (as determined by (43)), the Poissonian term has a significant contribution to intrinsic noise (second term on the right-hand-side of (41a)). Simultaneous fluctuations increase mean protein level (see (39)), decreasing intrinsic noise. For high protein abundance, ignoring the second term in (41a) yields(49)which first increases, and then decreases with . The maximal value is achieved at .
- Simultaneous fluctuations in the transcription burst size and translation rate typically increases intrinsic noise. However, for low protein abundance intrinsic noise exhibits a U-shape profile with (Figure 4).
- In contrast to intrinsic noise, extrinsic noise always monotonically increases with .

We comment on how these trends change if Fano factor (variance/mean), instead of coefficient of variation, is used for quantifying noise. This is particularly important in the case of multiple-parameter fluctuations, where mean protein levels are dependent on (see (39)). Our analysis shows that in contrast to the above trends, the intrinsic noise Fano factor always monotonically increases with for simultaneous fluctuations in the transcription and translation rates.

Recall that our results correspond to a model where mRNAs are produced in instantaneous transcriptional bursts. For a promoter that stochastically toggles between active and inactive states, this approximation corresponds to an unstable active state [47], where the promoter quickly transitions back to the inactive state after producing a burst of mRNA transcripts form the active state. It turns out that some of the above intrinsic noise versus trends are also valid outside the instantaneous burst limit. For example, Monte Carlo simulations have shown that for fluctuations in the translation rate or transcription burst size, intrinsic noise increases with when promoter spends a finite amount of time in active and inactive states [60]. Future work will extend analytical formulas for intrinsic and extrinsic noise to cases where the promoter stochastically transitions between different transcriptional states.

### Estimation of Model Parameters from Noise Measurements

Gene expression noise is often used to calculate the mean transcriptional burst size and frequency for a specific gene or promoter [40], [48], [51], [52]. Recall from (10) that for fixed model parameters(50)

Given measurements of and , a priori knowledge of , , , mean burst size and frequency can be computed from (50). Typically, is assumed to be equal to the intrinsic noise measured in a two-color assay. However, our results show that this is only valid for transcription burst frequency fluctuations. For all other cases, , and using intrinsic noise for in (50) will lead to erroneous parameter estimates [42].

Analytical formulas developed here can be used to back calculate from intrinsic and extrinsic noise measurements. This point is illustrated for the physiologically relevant parameter regime(51a)(51b)(51c)

In this regime, intrinsic noise is expressed as(52)where for burst frequency fluctuations and in all other cases. Analytical expressions for are provided in the Text S1, and it depends only on mRNA, protein turnover rates and time-scale of parameter fluctuations (more specifically on ratios and ). Consider a stable reporter protein where = time-scale of cell division, and , then

Therefore, if in an experiment, from (52) and (53d), for burst size fluctuations. Traditional approach of assuming would overestimate by . Using for simultaneous burst frequency/translation rate fluctuations gives , and may not be a bad approximation in this case. It can be shown that(54)with upper (lower) bound being realized for burst size (frequency) fluctuations. Without prior knowledge on the source of extrinsic noise, (54) yields the following bounds on :(55)for the physiologically relevant parameter regime (51). Thus, our results provide the necessary correction factors for accurately determining from two-color reporter experiments, which would be useful for estimating and .

In conclusion, our analysis reveals how stochastic synthesis and degradation of biomolecules combines with parameters fluctuations to generate heterogeneity in protein level across a clonal cell population. These results will help understand how stochastic variability is regulated inside cells, and for extracting meaningful information from single-cell gene expression measurements. Future work will consider scenarios where randomness in cellular factor levels simultaneously affects synthesis and degradation pathways, or only degradation. Unfortunately, exact solutions are unavailable in many of these cases. However, preliminary analysis has found moment closure techniques useful for obtaining closed-form solutions for the statistical moments. A recent study has generalized notions of intrinsic and extrinsic noise from statistical moments to temporal correlations [61]. In particular, the auto-correlation function of can be decomposed into intrinsic and extrinsic components based on the two-color assay [61]. Future will work will derive analytical expressions for protein auto-correlation and cross-correlation functions in stochastic models with parameter fluctuations, and study how noise signature within them can be used for probing genetic systems.

## Author Contributions

Conceived and designed the experiments: AS. Performed the experiments: AS MS. Analyzed the data: AS MS. Wrote the paper: AS.

## References

- 1. Blake WJ, Kaern M, Cantor CR, Collins JJ (2003) Noise in eukaryotic gene expression. Nature 422: 633–637.
- 2. Raser JM, O’Shea EK (2005) Noise in gene expression: Origins, consequences, and control. Science 309: 2010–2013.
- 3. Raj A, van Oudenaarden A (2008) Nature, nurture, or chance: stochastic gene expression and its consequences. Cell 135: 216–226.
- 4. Munsky B, Neuert G, van Oudenaarden A (2012) Using gene expression noise to understand gene regulation. Science 336: 183–187.
- 5. Kaern M, Elston TC, Blake WJ, Collins JJ (2005) Stochasticity in gene expression: from theories to phenotypes. Nature Reviews Genetics 6: 451–464.
- 6. Libby E, Perkins TJ, Swain PS (2007) Noisy information processing through transcriptional regulation. Proceedings of the National Academy of Sciences 104: 7151–7156.
- 7. Fraser HB, Hirsh AE, Giaever G, Kumm J, Eisen MB (2004) Noise minimization in eukaryotic gene expression. PLoS Biology 2: e137.
- 8. Lehner B (2008) Selection to minimise noise in living systems and its implications for the evolution of gene expression. Molecular Systems Biology 4: 170.
- 9. Kemkemer R, Schrank S, Vogel W, Gruler H, Kaufmann D (2002) Increased noise as an effect of haploinsufficiency of the tumor-suppressor gene neurofibromatosis type 1 in vitro. Proceedings of the National Academy of Sciences 99: 13783–13788.
- 10. Cook DL, Gerber AN, Tapscott SJ (1998) Modeling stochastic gene expression: implications for haploinsufficiency. Proceedings of the National Academy of Sciences 95: 15641–15646.
- 11. Bahar R, Hartmann CH, Rodriguez KA, Denny AD, Busuttil RA, et al. (2006) Increased cell-to-cell variation in gene expression in ageing mouse heart. Nature 441: 1011–1014.
- 12. Alon U (2007) Network motifs: theory and experimental approaches. Nature Reviews Genetics 8: 450–461.
- 13. Becskei A, Serrano L (2000) Engineering stability in gene networks by autoregulation. Nature 405: 590–593.
- 14. El-Samad H, Khammash M (2006) Regulated degradation is a mechanism for suppressing stochastic fluctuations in gene regulatory networks. Biophysical Journal 90: 3749–3761.
- 15. Pedraza JM, Paulsson J (2008) Effects of molecular memory and bursting on fluctuations in gene expression. Science 319: 339–343.
- 16. Morishita Y, Aihara K (2004) Noise-reduction through interaction in gene expression and biochemical reaction processes. J of Theoretical Biology 228: 315–325.
- 17. Swain PS (2004) Efficient attenuation of stochasticity in gene expression through posttranscriptional control. J Molecular Biology 344: 956–976.
- 18. Singh A, Hespanha JP (2009) Optimal feedback strength for noise suppression in autoregulatory gene networks. Biophysical Journal 96: 4013–4023.
- 19. Singh A (2011) Negative feedback through mRNA provides the best control of gene-expression noise. IEEE Transactions on NanoBioscience 10: 194–200.
- 20. Dublanche Y, Michalodimitrakis K, Kummerer N, Foglierini M, Serrano L (2006) Noise in transcription negative feedback loops: simulation and experimental analysis. Molecular Systems Biology 2: 41.
- 21. Jia T, Kulkarni RV (2011) Intrinsic noise in stochastic models of gene expression with molecular memory and bursting. Journal of Mathematical Biology 106: 058102.
- 22. Nevozhay D, Adams RM, Murphy KF, Josic K, Balazsi G (2009) Negative autoregulation linearizes the doseresponse and suppresses the heterogeneity of gene expression. Proceedings of the National Academy of Sciences 106: 5123–5128.
- 23. Orrell D, Bolouri H (2004) Control of internal and external noise in genetic regulatory networks. J of Theoretical Biology 230: 301–312.
- 24. Bleris L, Xie Z, Glass D, Adadey A, Sontag E, et al. (2011) Synthetic incoherent feedforward circuits show adaptation to the amount of their genetic template. Molecular Systems Biology 7: 519.
- 25. Singh A, Hespanha J (2007) Stochastic analysis of gene regulatory networks using moment closure. In: American Control Conference, 2007. ACC ’ 07: 1299–1304.
- 26. Losick R, Desplan C (2008) Stochasticity and cell fate. Science 320: 65–68.
- 27. Veening JW, Smits WK, Kuipers OP (2008) Bistability, epigenetics, and bet-hedging in bacteria. Annual Review of Microbiology 62: 193210.
- 28.
Arkin A, Ross J, McAdams HH (1998) Stochastic kinetic analysis of developmental pathway bifurcation in phage λ-infected
*Escherichia coli*cells. Genetics 149: 1633–1648. - 29. Weinberger L, Burnett J, Toettcher J, Arkin A, Schaffer D (2005) Stochastic gene expression in a lentiviral positive-feedback loop: HIV-1 Tat fluctuations drive phenotypic diversity. Cell 122: 169–182.
- 30. Weinberger LS, Dar RD, Simpson ML (2008) Transient-mediated fate determination in a transcriptional circuit of HIV. Nature Genetics 40: 466–470.
- 31. Hasty J, Pradines J, Dolnik M, Collins JJ (2000) Noise-based switches and amplifiers for gene expression. Proceedings of the National Academy of Sciences 97: 2075–2080.
- 32. Eldar A, Elowitz MB (2010) Functional roles for noise in genetic circuits. Nature 467: 167–173.
- 33. Kussell E, Leibler S (2005) Phenotypic diversity, population growth, and information in fluctuating environments. Science 309: 2075–2078.
- 34. Balaban N, Merrin J, Chait R, Kowalik L, Leibler S (2004) Bacterial persistence as a phenotypic switch. Science 305: 1622–1625.
- 35. Elowitz MB, Levine AJ, Siggia ED, Swain PS (2002) Stochastic gene expression in a single cell. Science 297: 1183–1186.
- 36. Swain PS, Elowitz MB, Siggia ED (2002) Intrinsic and extrinsic contributions to stochasticity in gene expression. Proceedings of the National Academy of Sciences 99: 12795–12800.
- 37. Scott M, Ingalls B, Kaern M (2006) Estimations of intrinsic and extrinsic noise in models of nonlinear genetic networks. Chaos 16: 026107.
- 38. Ozbudak EM, Thattai M, Kurtser I, Grossman AD, van Oudenaarden A (2002) Regulation of noise in the expression of a single gene. Nature Genetics 31: 69–73.
- 39. Taniguchi Y, Choi P, Li G, Chen H, Babu M, et al. (2010) Quantifying E. coli proteome and transcriptome with single-molecule sensitivity in single cells. Science 329: 533–538.
- 40. Newman JRS, Ghaemmaghami S, Ihmels J, Breslow DK, Noble M, et al. (2006) Single-cell proteomic analysis of S. cerevisiae reveals the architecture of biological noise. Nature Genetics 441: 840–846.
- 41. Bar-Even A, Paulsson J, Maheshri N, Carmi M, O’Shea E, et al. (2006) Noise in protein expression scales with natural protein abundance. Nature Genetics 38: 636–643.
- 42. Hilfinger A, Paulsson J (2011) Separating intrinsic from extrinsic fluctuations in dynamic biological systems. Proceedings of the National Academy of Sciences 108: 12167–12172.
- 43. Johnston IG, Gaal B, das Neves RP, Enver T, Iborra FJ, et al. (2012) Mitochondrial variability as a source of extrinsic cellular noise. PLoS Comput Biology 8: e1002416.
- 44. Bokes P, King JR, Wood A, Loose M (2012) Exact and approximate distributions of protein and mrna levels in the low-copy regime of gene expression. Journal of Mathematical Biology 64: 829–854.
- 45. Munsky B, B Trinh B, Khammash M (2009) Listening to the noise: random fluctuations reveal gene network parameters. Molecular systems biology 5: 318.
- 46. Paulsson J (2005) Model of stochastic gene expression. Physics of Life Reviews 2: 157–175.
- 47. Shahrezaei V, Swain PS (2008) Analytical distributions for stochastic gene expression. Proceedings of the National Academy of Sciences 105: 17256–17261.
- 48. Singh A, Razooky B, Cox CD, Simpson ML, Weinberger LS (2010) Transcriptional bursting from the HIV-1 promoter is a significant source of stochastic noise in HIV-1 gene expression. Biophysical Journal 98: L32–L34.
- 49. Raj A, Peskin C, Tranchina D, Vargas D, Tyagi S (2006) Stochastic mRNA synthesis in mammalian cells. PLoS Biology 4: e309.
- 50. Golding I, Paulsson J, Zawilski S, Cox E (2005) Real-time kinetics of gene activity in individual bacteria. Cell 123: 1025–1036.
- 51. Dar RD, Razooky BS, Singh A, Trimeloni T, McCollum J, et al. (2012) Transcriptional burst frequency and burst size are equally modulated across the human genome. Proceedings of the National Academy of Sciences 109: 17454–17459.
- 52. Hornung G, Bar-Ziv R, Rosin D, Tokuriki N, Tawfik DS, et al. (2012) Noise-mean relationship in mutated promoters. Genome Research 22: 2409–2417.
- 53. Singh A, Razooky BS, Dar RD, Weinberger LS (2012) Dynamics of protein noise can distinguish between alternate sources of gene-expression variability. Molecular Systems Biology 8: 607.
- 54. Gillespie DT (2001) Approximate accelerated stochastic simulation of chemically reacting systems. J of Chemical Physics 115: 1716–1733.
- 55.
Wilkinson DJ (2011) Stochastic Modelling for Systems Biology. Chapman and Hall/CRC.
- 56. Singh A, Hespanha JP (2011) Approximate moment dynamics for chemically reacting systems. IEEE Trans on Automatic Control 56: 414–418.
- 57. Singh A, Hespanha JP (2010) Stochastic hybrid systems for studying biochemical processes. Phil Trans R Soc A 368: 4995–5011.
- 58. Paulsson J (2004) Summing up the noise in gene networks. Nature 427: 415–418.
- 59. Hespanha JP, Singh A (2005) Stochastic models for chemically reacting systems using polynomial stochastic hybrid systems. Int J of Robust and Nonlinear Control 15: 669–689.
- 60. Shahrezaei V, Ollivier JF, Swain PS (2008) Colored extrinsic fluctuations and stochastic gene expression. Molecular Systems Biology 4: 196.
- 61. Hilfinger A, Chen M, Paulsson J (2012) Using temporal correlations and full distributions to separate intrinsic and extrinsic fluctuations in biological systems. Phys Rev Lett 109: 248104.