Kinetic models of metabolism require detailed knowledge of kinetic parameters. However, due to measurement errors or lack of data this knowledge is often uncertain. The model of glycolysis in the parasitic protozoan Trypanosoma brucei is a particularly well analysed example of a quantitative metabolic model, but so far it has been studied with a fixed set of parameters only. Here we evaluate the effect of parameter uncertainty. In order to define probability distributions for each parameter, information about the experimental sources and confidence intervals for all parameters were collected. We created a wiki-based website dedicated to the detailed documentation of this information: the SilicoTryp wiki (http://silicotryp.ibls.gla.ac.uk/wiki/Glycolysis). Using information collected in the wiki, we then assigned probability distributions to all parameters of the model. This allowed us to sample sets of alternative models, accurately representing our degree of uncertainty. Some properties of the model, such as the repartition of the glycolytic flux between the glycerol and pyruvate producing branches, are robust to these uncertainties. However, our analysis also allowed us to identify fragilities of the model leading to the accumulation of 3-phosphoglycerate and/or pyruvate. The analysis of the control coefficients revealed the importance of taking into account the uncertainties about the parameters, as the ranking of the reactions can be greatly affected. This work will now form the basis for a comprehensive Bayesian analysis and extension of the model considering alternative topologies.
An increasing number of mathematical models are being built and analysed in order to obtain a better understanding of specific biological systems. These quantitative models contain parameters that need to be measured or estimated. Because of experimental errors or lack of data, our knowledge about these parameters is uncertain. Our work explores the effect of including these uncertainties in model analysis. Therefore, we studied a particularly well curated model of the energy metabolism of the parasite Trypanosoma brucei, responsible for African sleeping sickness. We first collected all the information we could find about how the model parameters were defined on a website, the SilicoTryp wiki (http:///silicotryp.ibls.gla.ac.uk/wiki/). From this information, we were able to quantify our uncertainty about each parameter, thus allowing us to analyse the model while explicitly taking these uncertainties into account. We found that, even though the model was well-defined and most of its parameters were experimentally measured, taking into account the remaining uncertainty allows us to gain more insight into model behavior. We were able to identify previously unrecognised fragilities of the model, leading to new hypotheses amenable to experimental testing.
Citation: Achcar F, Kerkhoven EJ, The SilicoTryp Consortium, Bakker BM, Barrett MP, Breitling R (2012) Dynamic Modelling under Uncertainty: The Case of Trypanosoma brucei Energy Metabolism. PLoS Comput Biol 8(1): e1002352. https://doi.org/10.1371/journal.pcbi.1002352
Editor: Jason A. Papin, University of Virginia, United States of America
Received: September 14, 2011; Accepted: November 30, 2011; Published: January 19, 2012
Copyright: © 2012 Achcar et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by SysMO (http://www.sysmo.net/), NWO-Vidi (http://www.nwo.nl/nwohome.nsf/pages/NWOP_5VTGQW_Eng) and SULSA (http://www.sulsa.ac.uk/). Barbara Bakker is the recipient of a Rosalind Franklin Fellowship (http://www.rug.nl/fwn/onderzoek/rff/index). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Kinetic models of metabolism require quantitative knowledge of detailed kinetic parameters (e.g. maximum reaction rates, enzyme affinities for substrates and regulators). However, our knowledge about these parameters is often uncertain. When the parameters are measured, various sources of error can affect the results: experimental noise at the technical and biological levels, systematic bias introduced by parameters being measured in vitro instead of in vivo or by the choice of specific experimental conditions (pH, temperature, ionic strength, etc.). Moreover, a substantial number of important parameters have never been measured and the estimates included in models are based either on values measured in closely related species or on the general distribution of similar parameters . Few general methods for dealing with this uncertainty have been suggested –.
Here we present an analysis of the effect of parameter uncertainties on a particularly well defined example of a quantitative metabolic model: the model of glycolysis in bloodstream form Trypanosoma brucei  (see Fig. 1). This ordinary differential equation (ODE) model is mainly using parameters measured on purified enzymes rather than fitted, and, since its first publication in 1997, it has been updated  and extended – several times, making it one of the most highly refined dynamic models of a metabolic pathway published to date. The model has been successfully used to predict the “turbo explosion” that would happen in the absence of the glycosome, the subcellular compartment in which the first seven enzymes of glycolysis are localized in T. brucei . This important property was confirmed experimentally more than 10 years after the model was initially proposed . In this paper we used the last updated version of the model published  with slight modifications to take into account the equilibrium constants of all reactions (see methods).
Abbreviations: Metabolites: Glc-6-P = Glucose 6-phosphate, Fru-6-P = Fructose 6-phosphate, Fru-1,6-BP = Fructose 1,6-bisphosphate, DHAP = dihydroxyacetone phosphate, GA-3-P = glyceraldehyde 3-phosphate, Gly-3-P = glycerol 3-phosphate, 1,3-BPGA = 1,3-bisphosphoglycerate, 3-PGA = 3-phosphoglycerate, 2-PGA = 2-phosphoglycerate, PEP = phosphoenolpyruvate. Reactions: 1 = transport of glucose across the cytosolic membrane, 2 = transport of glucose across the glycosomal membrane, 3 = hexokinase, 4 = phosphoglucose isomerase, 5 = phosphofructokinase, 6 = aldolase, 7 = triosephosphate isomerase, 8 = glyceraldehyde 3-phosphate dehydrogenase, 9 = phosphoglycerate kinase, 10 = transport of 3-PGA across the glycosomal membrane, 11 = phosphoglycerate mutase, 12 = enolase, 13 = pyruvate kinase, 14 = transport of pyruvate across the cytosolic membrane, 15 = glycerol 3-phosphate dehydrogenase, 16 = glycerol kinase, 17 = DHAP-Gly-3-P antiporter, 18 = glycerol-3-phosphate oxidation, 19 = ATP utilisation, 20 = adenylate kinase.
Explicitly considering the uncertainties of parameters in the analysis of the model allowed us to gain interesting new insights into its behaviour. Most importantly, our analysis allowed us to quantify the degree of confidence concerning diverse properties of the system, including the hierarchy of control which is relevant for prioritizing potential drug targets. The resulting quantitative profile of model uncertainties, including the identification of major fragilities and areas in need of further examination, provides a solid basis for future model extensions. These will in turn introduce new uncertainties and should be dealt with using the same general framework established here.
In order to specify the uncertainty associated with each parameter, we gathered all available information relating to the sources of the values used in the model. Information included data on how kinetics were measured, the number of replicates and the standard error of mean values when available, additional calculations used to estimate the parameter from the observed values, and any “corrections” for additional factors such as temperature or pH. For this purpose, we created the “SilicoTryp” wiki, a MediaWiki-based (http://www.wikimedia.org) website dedicated to the detailed documentation of the sources of parameters used in the latest version of the model of glycolysis in T. brucei (http://silicotryp.ibls.gla.ac.uk/wiki/Glycolysis) . Each reaction is described on its own page, which contains the rate equation and the detailed references and calculations for each parameter (see Fig. 2 for an example).
Each reaction of the model has its own page. On this page, the rate equation is specified and a table includes all parameters with their detailed source and calculations when necessary.
The effects of uncertainty
To model the effect of uncertainty, we sampled values for each parameter according to its probability distribution, generating a ensemble of alternative models. Together these alternative models accurately represent our degree of uncertainty about the correct parameters, assuming that our knowledge of each parameter value is independent of the other parameters (see Methods for one example, the equilibrium constant, where this assumption is violated and needs to be accounted for). This collection of models can then be used to analyse model behavior and the associated uncertainties. The same properties that were studied with the fixed parameter version of the model can be studied with each alternative model. The distribution of the results shows the robustness and the degree of certainty we have about the inferred model properties (e.g. the steady-state concentrations of the metabolites and the control coefficients) considering our current knowledge about the parameters and the topology of the model.
The first property of the models that we analyzed is whether or not a steady-state is reached in a reasonable time. Our simulation uses the steady-state of the model with the fixed set of parameters to set the initial concentrations of the metabolites. From this initial state, each model is simulated until steady-state is reached. Considering the generous threshold we set for these simulations, steady-state should be reached rapidly. Yet, only 33% of the 10,000 models reached steady-state within 50 simulated minutes or less, and only 36% within 300 simulated minutes. As shown in Fig. 3, models that could not reach steady-state within 300 minutes had all produced a very high concentration of either 3-phosphoglycerate (3-PGA) or pyruvate. The accumulation of these metabolites to unreasonable concentrations indicates that the models contain fragilities. These cases are studied in more detail below (section Effects on steady-state concentrations).
The contour lines indicate when steady-state was reached (in minutes of simulated time). If steady-state was not reached before, simulations were stopped at 300 minutes (see Methods). When a model did not reach steady-state before 300 minutes, the concentrations of pyruvate and/or 3-phosphoglycerate reached unreasonably high concentrations (black contour lines). Note that the models that do not reach steady-state within 300 minutes because of 3-PGA accumulation will eventually reach steady-state at very high 3-PGA concentrations if the simulations are run much longer. This is not the case for the models that show pyruvate accumulation. Since pyruvate kinase is not product-sensitive in the model, nothing stops the accumulation of pyruvate and steady state is never reached (see supplementary Fig. S1 for example of simulations).
Effects on steady-state flux.
In bloodstream form T. brucei, glucose is mainly converted to pyruvate in aerobic conditions, while it is divided equally between pyruvate production and glycerol production under anaerobic conditions , . These flux distributions were also observed in cultured cell  and reproduced by the model  (anaerobic conditions are modelled by setting the of glycerol 3-phosphate oxidase (GPO, reaction used to model the mitochondrial glycerol 3-phosphate dehydrogenase coupled with the trypanosome alternative oxidase) to zero, the only model reaction requiring oxygen; the experimental measurements correspond to its inhibition as T. brucei does not survive total anaerobic conditions ).
This property is well-conserved in all our models using the full range of plausible parameter values (see Fig. 4). As expected, the effect of uncertainty is more important in aerobic conditions: for most of the models that do reach steady-state within 300 minutes, the proportion of glucose that ends in glycerol varies between 0 and 20% (mean standard deviation of the models that reaches steady-state within 300 minutes: ). In contrast, under anaerobic conditions, the glycolytic flux is always shared 50/50% between the production of glycerol and pyruvate (; the small error is most probably due to numerical rounding effects).
The glycolytic flux is defined as the sum of the fluxes producing glycerol and pyruvate. The black lines represents the percentage of the glycolytic flux in the pyruvate branch (top) and the glycerol branch (bottom) in the fixed parameter model. The red line is the distribution of the percentage of the glycolytic flux in the collection of models generated from the parameter probability distributions. The division of the flux between the pyruvate branch and the glycerol branch is well conserved. The effect of the uncertainties of the parameters is almost non-existent in anaerobic conditions (simulated by setting the glycerol 3-phosphate oxidase parameter to 0). In aerobic conditions the effect is more important, indicating that this division is not entirely due to the topology of the model in this case.
Indeed, anaerobically, the flux distribution is entirely determined by the topology and stoichiometry of the model: the 6-carbon product derived from glucose (fructose 1,6-bisphosphate) is split into two 3-carbon products by aldolase. Anaerobically, the NADH formed in the pyruvate branch can only be reoxidized to in the glycerol branch . Hence the 50/50% split is independent of the parameters of the model as expected from the topology of the model. Under aerobic conditions, glycerol 3-phosphate is mostly reoxidized using the mitochondrial glycerol 3-phosphate dehydrogenase (GPO) and then re-routed through the pyruvate branch via triose-phosphate isomerase . However, a small proportion of the flux ends with the production of glycerol. This small proportion depends on the parameters used in the model. No single parameter can easily predict the proportion of the flux that ends in the production of glycerol.
The fixed-parameter version of the model (i.e. the model with the set of parameter defined to be as close as possible to the model described in ) predicted only a very small portion of the glycolytic flux through the glycerol branch, while a wider range of plausible values are permitted when parameter uncertainty is considered. Indeed, a wide range of aerobic flux distributions has been measured experimentally: from a few percent glycerol measured by  to about 9% glycerol measured by . This range of observed biological variety can be explained using the variety of kinetic parameters included in our collection of models, or by partial anaerobiosis leading to a mixture of oxygenation states in individual cells within the population measured.
Effects on steady-state concentrations.
Using our collection of models, we are able to see the effect of parameter uncertainties on the steady-state concentration estimates. Considering only the models that reach steady-state within 300 simulated minutes, several cases can be distinguished (see Fig. 5 and supplementary text S2):
- For many metabolites, steady-state concentrations are well-conserved in all plausible models and their distribution is approximately log-normal: glucose 6-phosphate, fructose 6-phosphate, glycosomal glyceraldehyde 3-phosphate, cytosolic and glycosomal dihydroxyacetone phosphate and glycerol 3-phosphate, , NADH, 2-phosphoglycerate and phosphoenolpyruvate. These distributions may be expected, given that most of the parameters are sampled from log-normal distributions and thus approximately log-normal distributions for the steady-state concentrations are expected too.
- For several metabolites, steady-state concentrations do not follow approximate log-normal distributions, although their steady-state concentrations are distributed within a range of values consistent with physiological metabolite concentrations. These include glycosomal and cytosolic ATP, ADP, AMP, glycosomal and cytosolic glucose, fructose 1,6-bisphosphate and glycosomal 1,3-bisphosphoglycerate. For example, the concentration of glycosomal ATP and AMP is predicted to be between 0 and 6 mM (see Fig. 5 B. for ATP), compared to the fixed-parameter values of 4.2 mM and 0.25 mM respectively. The concentration is bounded by the fact that the total adenine nucleotide concentration in the glycosome is set to 6 mM in the model. Given the uncertainty regarding the exact parameters, any ratio between ATP and AMP seems possible and consistent with our parameter knowledge.
- For two metabolites, 3-phosphoglycerate and pyruvate, the steady-state concentration distribution has a long, heavy tail, indicating that some combinations of plausible parameter values can lead to extreme predicted concentrations (several hundreds to thousands of , see Fig. 3). These cases were studied in more detail as they point to interesting fragilities in the existing model, which indicate a need to refine our knowledge of some parameters and/or model topology.
The cytosolic 2-phosphoglycerate and glycosomal ATP steady-state concentrations are consistent with physiological metabolite concentration, whereas 3-phosphoglycerate and pyruvate sometimes reach hundreds of millimoles per liter. The value for the fixed parameter model is indicated by a vertical black line.
The accumulation of 3-phosphoglycerate (3-PGA) and/or pyruvate to unreasonable concentrations causes some models to reach steady-state at extremely high concentrations or to fail reaching steady-state within 300 minutes. This occurs when the maximum reaction rates () of phosphoglycerate mutase (PGAM) for the 3-PGA accumulation or pyruvate transport (PyrT) for the pyruvate accumulation are smaller than their mean values. Fig. 6 shows the percentage of models that break as a function of PGAM (Fig. 6 A) and PyrT (Fig. 6 B). The data show that these models break even when these parameters have values very close to the original value used in the fixed-parameter version of the model. Yet, these two reactions can both be inhibited experimentally in vivo. When PGAM was inhibited using tetracycline-inducible RNAi, diminishing to 51% of its original value , no adverse effects on the viability of the organism were observed. The pyruvate transporter can also be inhibited substantially before the cells start dying . The reason for the newly revealed model fragilities thus could be twofold: either the relevant parameter values are significantly higher than the currently used values (which are fitted, not measured; ), or some unknown regulatory interaction or missing reaction stabilizes the biological system. The pyruvate accumulation is due to a known fragility of the model: the pyruvate kinase is insensitive to its products, which can lead to the accumulation of pyruvate when the of its transporter is not high enough.
(A) Percentage of models that reach steady-state within 300 minutes as a function of phosphoglycerate mutase (B) Percentage of models that reach steady-state within 300 minutes as a function of pyruvate transport . The red line is the distribution of the parameter as it is usually sampled. The black line is the fixed-parameter value. A model which has a value for one of these two parameters smaller than the mean will easily fail to reach steady-state, whatever the other parameter values and despite these values still being close to their mean. This reveals fragilities in the model.
Vanderheyden et al. have measured the pyruvate efflux at in bloodstream form T. brucei  as nmol/min/mg of protein (mean SD). Assuming an activation energy of 50 kJ/mol, the at would be about 230 nmol/min/mg of protein, very close to the 200 nmol/min/mg of protein currently used in the model. Using Vanderheyden et al.'s value to compute the probability distribution of the of pyruvate transport (using the corrected mean and calculating the standard deviation as for any value with a measured mean and unknown standard deviation; see methods), only 0.58% of models cannot rapidly reach a steady-state because of pyruvate accumulation (pyruvate concentration at 300 minutes higher than 100 mM), compared to 35.4% when the is set as described in Methods). But this still imply that even a small inhibition of the pyruvate transporter should kill the cells, which is inconsistent with the experimental observations . Therefore, there is probably an additional mechanism that prevents the accumulation of pyruvate in the cytosol. Among the possible hypotheses, it is interesting to note that alanine aminotransferase activity has been measured in bloodstream forms by Spitznagel et al.  ( nmol/min/mg of protein in whole cell extracts at ). This enzyme, which catalyses the reversible reaction , was shown to be essential in bloodstream form trypanosomes and might have a significant role in the regulation of the intracellular pyruvate concentration.
Adding alanine aminotransferase into the model would require adding several other reactions as well: the production and recycling of 2-oxoglutarate and glutamate need to be incorporated, as well as the export of alanine ,  and probably 2-oxoglutarate .
Effects on control coefficients.
Control coefficients are one of the most important high-level properties of kinetic models of metabolism: they allow the quantification of how much influence each reaction has on the flux of the pathway. In the glycolytic model of T. brucei, individual control coefficients have been used to predict the most promising trypanocidal drug targets. The T. brucei glycolysis model published by Alberts et al.  indicated that the glucose consumption flux is controlled mainly by the glucose transporter at 5 mM of extracellular glucose (control coefficient ). As the sum of the control coefficients over the pathway is one , the other enzymes have no or very little control over the glucose consumption flux in this fixed-parameter model.
Using our collection of models, we calculated the control coefficients for every reaction and every model (see Methods). These control coefficients were then ranked from the highest to the lowest. Our analysis (Fig. 7) shows that, given our uncertainty on the parameters, we cannot be certain about the identity of the reaction that has most control over the glucose consumption flux. Moreover, we show that the fixed-parameter model scenario, where almost all the control is held by one reaction - the glucose transporter - is not the only scenario possible, but that even at 5 mM of glucose the control might be shared by several reactions.
(A) Percentage of models which have either the glucose transporter (GlcTc), phosphoglycerate mutase (PGAM) or glyceraldehyde 3-phosphate dehydrogenase (GAPDH) as the reaction with the highest control coefficient either over the glucose consumption flux (red) or the oxygen consumption flux (blue). (B) Percentage of models vs. the number of reactions that have a control coefficient higher than 0.001. The color inside the bars represents the proportion that has either the glucose transporter, PGAM or GAPDH as the reaction with the highest control coefficient over the glucose consumption flux within these subgroups.
Fig. 7A (red) shows the reaction that has the highest control coefficient over the glucose consumption flux as a percentage of the sampled model. The glucose transporter has the highest control over the glucose consumption flux in only 40.3% of the models. A substantial proportion of models yield either the phosphoglycerate mutase (PGAM, 31.1%) or GAPDH (28.5%) as having the highest control coefficient.
In 1999, Bakker et al.  estimated the control coefficient over the oxygen consumption flux of the glucose transporter experimentally (at 5 mM of extracellular glucose) as being between 0.3 and 0.5. In the fixed-parameter model, the of the glucose transporter was fitted to this control coefficient (0.4) by Alberts et al. . In 17.3% of our models, the glucose transporter has the highest control coefficient over the oxygen consumption flux (Fig. 7A (blue)). Among these models, the control coefficient of the glucose transporter varies between 0.2 and 1.0; when another reaction has the largest control coefficient, the control coefficient of the glucose transporter is always lower than 0.4. A similar distribution of the control coefficient is observed over the glucose consumption flux. No single parameter alone can explain the wide range of values of . It has been shown, however, that the extreme sensitivity of to various parameters can be attributed to the large difference between the values of the glucose transporter and the next enzyme, hexokinase, towards intracellular glucose .
Fig. 7B represents the number of reactions that exert some control over the glucose consumption flux (defined as the reactions with control coefficients above 0.001) as a percentage of the sampled models. For 21% of the sampled models, only one reaction controls the glucose consumption flux and this reaction is most of the time the glucose transporter, as is the case in the fixed-parameter model. When PGAM exerts most control over the flux, it shares the control with at least one other reaction. When GAPDH exerts most control over the flux, it shares the control with at least four other reactions. Interestingly, the activity of GAPDH has been reported to be inhibited by an unknown compound . If this inhibition is physiological and also occurs in vivo, it might have an important role in the control of glycolytic flux. Indeed, partial inhibition of GAPDH has already been shown to decrease the glycolytic flux and kill the cell . The fact that PGAM exerts the most control in some models might reflect our lack of knowledge about the parameters describing the rate of this reaction. Further analysis of the kinetics of this reaction is necessary to know whether it really exerts some control over the glycolytic flux and thus represents interesting potential drug target.
In the fixed-parameter model, shared control was only seen at glucose concentrations higher than 5 mM . Taking our uncertainty about the parameters values into account shows that this might be the case already at 5 mM of glucose, as has already been suggested by the preliminary analysis of the sensitivity of control coefficients to variations in values in this model . Improving our knowledge about GAPDH and PGAM parameters will allow us to know with a higher degree of confidence if only one of these scenarios is relevant in vivo or if a similar diversity can be found in a parasite population. This knowledge will be essential to predict if a single glycolytic drug target is sufficient or if multiple reactions need to be inhibited to control parasite infections.
Dynamic models of metabolism are powerful tools to infer interesting and often unexpected properties of cellular physiology. However, the data used to build models from diverse sources can lack accuracy and precision. Here we demonstrate how model output can vary when the uncertainties associated with incomplete and variable datasets are explicitly considered in studying a model. We took as an example the well characterised model of the compartmentalised glycolysis in the parasitic protozoan T. brucei. It should be noted that our assessment of the effect of parameter uncertainty on the conclusions that are possible is very conservative. Whenever possible, we have restricted our uncertainty estimates to the level of experimental uncertainty seen within a single assay. This ignores the systematic effects of differences in, e.g., temperature, pH or ion compositions, or biases introduced in sample preparation, all of which would increase uncertainty as can also be seen when parameter values from different laboratories are compared. However, even with these relatively limited uncertainties, we were able to assess the robustness and variability of various properties of the model.
The first property that we studied is the ability of the model to reach steady-state rapidly. Surprisingly, a significant proportion (60%) of the models we generated by sampling the parameters did not allow the model to reach steady-state within 300 minutes, due to the accumulation of either 3-phosphoglycerate or pyruvate in the cytosol. This phenomenon could be attributed to two individual parameters, the maximal reaction rates of phosphoglycerate mutase and pyruvate transport which, when operating below their mean value (but still very close to it), caused the accumulation of two metabolites (3-phosphoglycerate and pyruvate respectively). For the pyruvate transporter, the analysis suggested a mechanism that could avoid this problem: alanine aminotransferase has been shown, unexpectedly, to be essential in bloodstream form T. brucei , and its activity comparable with the rate of pyruvate efflux. This would be sufficient to exert a substantial influence on the intracellular pyruvate concentration. The maximal reaction rate of phosphoglycerate mutase is difficult to measure directly , therefore further experimental and theoretical studies are required to refine our knowledge about this reaction. Indeed, the model predicts that current values for PGAM are probably lower than those operative in T. brucei, and some effort should be made to determine whether the values are indeed higher.
We then analysed the distribution of the steady-state fluxes between the pyruvate and glycerol producing branches of glycolysis both in aerobic and anaerobic conditions. In totally anaerobic conditions, the distribution was very well conserved. Indeed, this property is entirely constrained by the topology of the model and thus this result was expected. Our analysis shows that the distribution of the fluxes is more variable in aerobic conditions, consistent with previously unexplained variation in experimental observations (although changes in oxygen tension within different cells in measured populations would create the same effect).
Further analysis of the steady-state concentrations allowed us to distinguish the metabolites that are only moderately affected by the parameter uncertainties and follow an approximate log-normal distribution, such as and NADH, from the metabolites that follow a more complex distribution such as glycosomal ATP. ATP is constrained by a conserved sum, therefore its steady-state concentration always stays within reasonable limits. Technical limitations mean that the concentration of glycosomal ATP is not directly accessible for experimentation (glycosomes cannot be purified efficiently enough). Therefore, only by acquiring additional data about the parameters of the model can assumptions about these concentrations at steady-state be refined.
Finally, we analysed the control coefficients of each enzyme using our collection of models. These properties are especially important in the case of glycolysis in T. brucei, as they allow us to identify potential drug targets. Our analysis reveals that, although the reaction that has the most control over the glucose consumption flux is the glucose transporter in 40.3% of the models, two other reactions maximally control the flux in a significant proportion of the models: PGAM (31.1%) and GAPDH (28.5%). Moreover, the activity of GAPDH has been reported to be inhibited by an unknown metabolite ; if this inhibition occurs in vivo, it might have an important role in the control of glycolytic flux. Interestingly, partial inhibition of GAPDH has been shown to affect parasite growth and glycolytic flux , and selective inhibitors of the T. brucei enzyme have been shown to be trypanocidal . The rest of the control coefficient hierarchy is more variable. Either this variability is a true reflexion of biological noise or the result of our lack of knowledge about some parameters of the model.
The data derived from the work performed here point to several further studies, including analysis of the role of alanine amino transferase in the regulation of pyruvate concentration and more exact quantification of pyruvate transport and phosphoglycerate mutase kinetics. The detailed description of parameter uncertainty will now form the basis for a comprehensive Bayesian analysis and extension of the model using alternative topologies . These analyses will allow us to quantify our posterior belief about the parameters of the model when it is confronted with new experimental data such as measured metabolite concentrations in different conditions.
To allow a straight-forward sampling of parameters, the rate equations were rewritten to contain the equilibrium constant instead of the ratio of values (reverse over forward), using the Haldane equation . This does not change the rates, but simplifies the sampling of the parameters, as we do not need to check for consistency with the thermodynamic equilibrium constant. For example, the phosphoglucose isomerase (PGI) rate equation was:(1)where . The Haldane equation gives:(2)Therefore, the rate equation of PGI can be rewritten as:(3)
The list of sources used to compute the values of the equilibrium constants is available in supplementary text S3 and on the SilicoTryp wiki (http://silicotryp.ibls.gla.ac.uk/wiki/Glycolysis). The model in  considered the transport reactions between the cytosol and the glycosome and adenylate kinase (see special cases) to be very fast compared the other reactions of the model. Therefore, they were not explicitly modelled. To enable consideration of the effect of parameter uncertainty on the rate of these transport reactions, we modelled them explicitly using mass action kinetics. As we considered that these reactions have an equilibrium constant of unity (no preferential accumulation or exclusion in one of the compartments), we used a single rate parameter for each transport reaction. For example, the transport of glucose between the cytosol and the glycosome is modelled as:(4)The model is available as supplementary dataset S1 (SBML file ). The parameter values are as in . The equilibrium constant are calculated from the values and the ration of over when necessary.
Probability distributions of the parameters
In order to sample the model parameters, we needed to define a probability distribution for each parameter. These distributions can be defined empirically using arbitrary shapes, but for the sake of convenience it is usually appropriate to use standard shapes (e.g. normal or log-normal distributions) and then to estimate the parameters of these distributions (usually the mean and standard deviation).
These parameters represent concentrations, therefore they cannot be negative and our uncertainty about their values is best represented by a log-normal distribution.
For each or value of the model, the mean and standard deviation of the corresponding log-normal distribution must be estimated from available experimental data (indicated as and ). Five situations occur:
- The parameter has been measured experimentally: a mean () and standard deviation () or standard error (, where n is the number of observations) are available. and . If a standard deviation is available and the number of observations is not specified, is supposed to be 3.
- The parameter has been measured experimentally, but only a mean value is reported. is computed as above, is computed using the average relative standard error () of all values of the model for which or is available. The value of calculated from the published data is usually between 10 and 20%, indicating that the RSE can be expected to be similar for those values where it has not been specified.
- The parameter has not been measured, and no estimate of its value is available. When no other information is available, the parameter is calculated from the list of values of all T. brucei enzymes retrieved from BRENDA  (, , Fig. 8).
- The parameter has not been measured, but some indication of its mean is available, e.g. a value measured for a phylogenetically closely related species (Trypanosoma cruzi or a Leishmania species). This heterologous mean is used to compute the as above. As this value is considered to be more uncertain than a value measured in T. brucei, the is calculated so that the upper or lower limit of the 95% confidence interval equals the upper or lower limit of the 95% confidence interval of all T. brucei enzyme retrieved from BRENDA (if the heterologous mean is higher than the mean calculated from all T. brucei enzyme retrieved from BRENDA, then the upper limit is used, otherwise, the lower limit is used). However, if the 95% confidence interval calculated is bigger than then is used to calculate .
values retrieved from the database (green) and a log-normal distribution with the same mean and standard-deviation (red) are shown.
The values of PGAM used in the published version of the model were measured in the presence of cobalt, as this was believed to be the cofactor used by the enzyme. However, the nature of the metallic cofactor used by this enzyme has recently been questioned: Fuad et al. (2011)  have shown that the concentration of cobalt is too small to be relevant in vivo. For this reason, the values of PGAM were set according to the earlier measurements done by Chevalier et al. (2000) : mM and 0.03 mM.
The equilibrium constants, , can be calculated from the Gibbs free energy of a reaction, , using equation 5:(5) is expressed in J/mol and can be positive, negative or null. Therefore, we assumed that our uncertainty about the exact value of can be described by a normal distribution. As a consequence, according to equation 5, the plausible values of the equilibrium constant will be log-normally distributed.
As the equilibrium constant does not depend on the organism (assuming constant temperature, pH and ionic strength), the mean and standard-deviation of the distribution can be calculated from the various values reported in the literature (see supplementary text S3). When only one published value could be found, the standard deviation was calculated using the mean relative standard deviation of the other equilibrium constants in the model as described above.
The maximum rate of the reactions () can only have positive values. The values are linked to the equilibrium constant and values by the Haldane equation. Therefore, we assume again that our uncertainty about them can best be described by a log-normal distribution.
For each , the mean and standard deviation of the log-normal distribution must be defined (respectively and ). When the had been measured, the and were calculated the same way as for the values. When no information was available, the was set using the value fitted by Alberts et al.  for the fixed-parameter model. In these cases, the was then set so that the upper limit of the confidence interval (95%) is 4000 nmol/min/mg protein (the largest in the model is 2862 nmol/min/mg protein for phosphoglycerate kinase ).
If the was measured in the reverse direction (), is sampled. is then calculated from the sampled , and values using the Haldane equation. The value used for phosphoglycerate kinase is calculated from the measured . However, as two of the values were not measured and therefore have large standard deviations, sampling this from the , and would result in sampling values much larger than 4000 nmol/min/mg of proteins. Therefore, the phosphoglycerate kinase was sampled using the calculated value as a mean, and the standard deviation was calculated so that the upper limit of the confidence interval (95%) is 4000 nmol/min/mg protein.
The of GAPDH reported in the literature  was measured in crude extracts where a non-identified metabolite seems to inhibit it . The inhibition factor () was estimated by Misset et al.  as about three-fold and was sampled separately in our study. As needs to be higher than 1, it was sampled using a log-normal distribution (with and calculated so that the upper limit of the confidence interval (95%) is 3.5) to which 1 is added. The of GAPDH in the model is then multiplied by this sampled inhibition factor.
The glucose transporter was set according to the measurements of Seyfang et al. . Using the at and the activation energy they measured, we estimated the of glucose transporter at to nmol/min/mg of protein. Note that this value is close to the fitted value used in  (108.9 nmol/min/mg of protein).
The model includes several transport reactions. Among them, only the transport rates across the cytosolic membrane have been measured. The transport rates across the glycosomal membrane have not been characterised and are currently modelled using mass action kinetics (i.e., as non-saturable, non-enzymatic reactions) to maintain maximal compatibility with the published model , . The corresponding parameters have not been measured. The equilibrium constant of these transport reactions is assumed to be 1, so that only one kinetic parameter is required per transport reaction.
No information is available about the uncertainty of these parameters. As these parameters are strictly positive, they are sampled using a log-normal distribution as are and values. The means are set to the minimum value so that the reaction will be within 5% of equilibrium (using the mean values for all the other parameters). The standard deviation is calculated so that the upper limit of the confidence interval (95%) is equal to 100 times the mean to allow a large exploration of the parameter space.
Bakker et al.  and the following versions of the model included adenylate kinase implicitly, considering this reaction to be at equilibrium. We modelled adenylate kinase using mass action kinetics, with two rate constants and . As only the equilibrium constant of this reaction is known, is sampled using the same methods as for the parameters of the transport reactions. is then calculated from and the sampled equilibrium constant: .
ATP utilization is modelled using mass action kinetics with a single rate constant. As this reaction represents all of the cytosolic reactions that consume ATP and are not explicitly included in the model, the rate constant of this reaction is unknown. As for glycosomal transport reactions, this parameter was sampled according to a log-normal distribution. The mean used is the value fitted by Bakker et al. . The standard deviation is calculated so that the upper limit of the 95% confidence interval equals 2 times the mean.
The glucose transport across the cytosolic membrane is assumed to be symmetric  based on experimental evidence . Moreover, it exhibits a trans-acceleration phenomenon  which is quantify by a parameter, in the underlying model of the transporter kinetics. As this parameter varies between 0 and 1, it was sampled using a logit-normal distribution. The estimated value from Bakker et al.  was used as a mean. The standard deviation was arbitrarily set so that the upper limit of the 95% confidence interval is the mean +20%.
All parameters were sampled using the MT19937 random number generator of Makoto Matsumoto and Takuji Nishimura  implemented in the GNU Scientific Library (GSL) . The random numbers where then transformed to follow their assumed probability distribution using the random number distribution function implemented in the GSL library.
The steady states were calculated using the SOSlib library . Steady-state is considered if the mean+standard deviation of the rates of change of all metabolite concentrations is lower than a user-defined parameter of SOSlib. The initial conditions were set using the steady-state concentrations calculated using the mean values of all parameters. For any sampled model, it is assumed that steady state should be reached within 300 minutes of simulated time (steady state detection threshold , parameter 1 per simulated minute). We checked that the steady-state calculations give similar results in COPASI  and PySCeS  using their default parameters. We also verified that the parameter sets that do not allow the model to reach steady state in these conditions show accumulation of individual metabolites beyond reasonable concentrations (hundreds or thousands of millimol per liter, see Results and Fig. 3).
The control coefficients were computed using the methodology described by Bakker et al. . The computation of control coefficients requires more precise steady-states calculations. Therefore, the parameters of SOSlib were set to: maximal time minutes and the threshold .
Fixed-parameter model (sbml file).
Examples of simulations of models unable to reach steady-state (within 1000 simulated minutes). (A) Simulation of pyruvate concentration in a model unable to reach steady-state because of pyruvate accumulation. Models of this type will never reach steady-state. (B) Simulation of glycosomal 3-PGA concentration in a model unable to reach steady-state because of 3-PGA accumulation. Models of this type will eventually reach steady-state, but at extremely high concentrations of 3-PGA.
Distributions of the sampled parameters.
Distributions of the steady-state concentrations of the metabolites in mmol/l.
The authors would like to thank Rainer Machné for his help with SOSLib.
The members of the SysMO2-funded SilicoTryp Consortium are: Rainer Breitling, Michael P. Barrett, Barbara M. Bakker, Keith Matthews, Christine Clayton, Luise Krauth-Siegel, Mark Girolami, Fiona Achcar, Eduard J. Kerkhoven, Dong-Hyun Kim, Jurgen R. Haanstra, Federico Rojas, Abeer Fadda, and Alejandro Leroux.
Conceived and designed the experiments: FA RB. Performed the experiments: FA. Analyzed the data: FA EJK BMB MPB RB. Contributed reagents/materials/analysis tools: FA RB. Wrote the paper: FA EJK BMB MPB RB.
- 1. Borger S, Liebermeister W, Klipp E (2006) Prediction of enzyme kinetic parameters based on statistical learning. Genome Inform Ser 17: 80–87.S. BorgerW. LiebermeisterE. Klipp2006Prediction of enzyme kinetic parameters based on statistical learning.Genome Inform Ser178087
- 2. Wang L, Birol I, Hatzimanikatis V (2004) Metabolic control analysis under uncertainty: Framework development and case studies. Biophys J 87: 3750–3763.L. WangI. BirolV. Hatzimanikatis2004Metabolic control analysis under uncertainty: Framework development and case studies.Biophys J8737503763
- 3. Tran LM, Rizk ML, Liao JC (2008) Ensemble modeling of metabolic networks. Biophys J 95: 5606–5617.LM TranML RizkJC Liao2008Ensemble modeling of metabolic networks.Biophys J9556065617
- 4. Rizk ML, Liao JC (2009) Ensemble modeling and related mathematical modeling of metabolic networks. J Taiwan Inst Chem E 40: 595–601.ML RizkJC Liao2009Ensemble modeling and related mathematical modeling of metabolic networks.J Taiwan Inst Chem E40595601
- 5. Mišković L, Hatzimanikatis V (2011) Modeling of uncertainties in biochemical reactions. Biotechnol Bioeng 108: 413–423.L. MiškovićV. Hatzimanikatis2011Modeling of uncertainties in biochemical reactions.Biotechnol Bioeng108413423
- 6. Murabito E, Smallbone K, Swinton J, Westerhoff HV, Steuer R (2011) A probabilistic approach to identify putative drug targets in biochemical networks. J Roy Soc Interface 8: 880–895.E. MurabitoK. SmallboneJ. SwintonHV WesterhoffR. Steuer2011A probabilistic approach to identify putative drug targets in biochemical networks.J Roy Soc Interface8880895
- 7. Bakker BM, Michels PA, Opperdoes FR, Westerhoff HV (1997) Glycolysis in bloodstream form Trypanosoma brucei can be understood in terms of the kinetics of the glycolytic enzymes. J Biol Chem 272: 3207–3215.BM BakkerPA MichelsFR OpperdoesHV Westerhoff1997Glycolysis in bloodstream form Trypanosoma brucei can be understood in terms of the kinetics of the glycolytic enzymes.J Biol Chem27232073215
- 8. Bakker BM, Michels PAM, Opperdoes FR, Westerhoff HV (1999) What controls glycolysis in bloodstream form Trypanosoma brucei? J Biol Chem 274: 14551–14559.BM BakkerPAM MichelsFR OpperdoesHV Westerhoff1999What controls glycolysis in bloodstream form Trypanosoma brucei?J Biol Chem2741455114559
- 9. Helfert S, Estévez AM, Bakker B, Michels P, Clayton C (2001) Roles of triosephosphate isomerase and aerobic metabolism in Trypanosoma brucei. Biochem J 357: 117–125.S. HelfertAM EstévezB. BakkerP. MichelsC. Clayton2001Roles of triosephosphate isomerase and aerobic metabolism in Trypanosoma brucei.Biochem J357117125
- 10. Albert M, Haanstra JR, Hannaert V, Van Roy J, Opperdoes FR, et al. (2005) Experimental and in silico analyses of glycolytic ux control in bloodstream form Trypanosoma brucei. J Biol Chem 280: 28306–28315.M. AlbertJR HaanstraV. HannaertJ. Van RoyFR Opperdoes2005Experimental and in silico analyses of glycolytic ux control in bloodstream form Trypanosoma brucei.J Biol Chem2802830628315
- 11. Haanstra JR, van Tuijl A, Kessler P, Reijnders W, Michels PAM, et al. (2008) Compartmentation prevents a lethal turbo-explosion of glycolysis in trypanosomes. Proc Natl Acad Sci USA 105: 17718–17723.JR HaanstraA. van TuijlP. KesslerW. ReijndersPAM Michels2008Compartmentation prevents a lethal turbo-explosion of glycolysis in trypanosomes.Proc Natl Acad Sci USA1051771817723
- 12. Ryley JF (1956) Studies on the metabolism of the protozoa. 7. comparative carbohydrate metabolism of eleven species of trypanosome. Biochem J 62: 215–222.JF Ryley1956Studies on the metabolism of the protozoa. 7. comparative carbohydrate metabolism of eleven species of trypanosome.Biochem J62215222
- 13. Hammond DJ, Bowman IB (1980) Trypanosoma brucei: the effect of glycerol on the anaerobic metabolism of glucose. Mol Biochem Parasit 2: 63–75.DJ HammondIB Bowman1980Trypanosoma brucei: the effect of glycerol on the anaerobic metabolism of glucose.Mol Biochem Parasit26375
- 14. Haanstra J (2009) The power of network-based drug design and the interplay between metabolism and gene expression in Trypanosoma brucei. J. Haanstra2009The power of network-based drug design and the interplay between metabolism and gene expression in Trypanosoma brucei.Ph.D. thesis, Vrije Universiteit Amsterdam. Ph.D. thesis, Vrije Universiteit Amsterdam.
- 15. Eisenthal R, Panes A (1985) The aerobic/anaerobic transition of glucose metabolism in Try-panosoma brucei. FEBS Lett 181: 23–27.R. EisenthalA. Panes1985The aerobic/anaerobic transition of glucose metabolism in Try-panosoma brucei.FEBS Lett1812327
- 16. Wiemer EA, Michels PA, Opperdoes FR (1995) The inhibition of pyruvate transport across the plasma membrane of the bloodstream form of Trypanosoma brucei and its metabolic implications. Biochem J 312(Pt 2): 479–484.EA WiemerPA MichelsFR Opperdoes1995The inhibition of pyruvate transport across the plasma membrane of the bloodstream form of Trypanosoma brucei and its metabolic implications.Biochem J312Pt 2479484
- 17. Vanderheyden N, Wong J, Docampo R (2000) A pyruvate-proton symport and an H+-ATPase regulate the intracellular pH of Trypanosoma brucei at different stages of its life cycle. Biochem J 346 Pt 1: 53–62.N. VanderheydenJ. WongR. Docampo2000A pyruvate-proton symport and an H+-ATPase regulate the intracellular pH of Trypanosoma brucei at different stages of its life cycle.Biochem J346 Pt 15362
- 18. Spitznagel D, Ebikeme C, Biran M, Nic a' Bháird N, Bringaud F, et al. (2009) Alanine aminotransferase of Trypanosoma brucei–a key role in proline metabolism in procyclic life forms. FEBS J 276: 7187–7199.D. SpitznagelC. EbikemeM. BiranN. Nic a' BháirdF. Bringaud2009Alanine aminotransferase of Trypanosoma brucei–a key role in proline metabolism in procyclic life forms.FEBS J27671877199
- 19. Newport GR, Page CR III, Ashman PU, Stibbs HH, Seed JR (1977) Alteration of free serum amino acids in voles infected with trypanosoma brucei gambiense. J Parasitol 63: 15–24.GR NewportCR Page IIIPU AshmanHH StibbsJR Seed1977Alteration of free serum amino acids in voles infected with trypanosoma brucei gambiense.J Parasitol631524
- 20. Mackenzie NE, Hall JE, Seed JR, Scott AI (1982) Carbon-13 Nuclear-Magnetic-Resonance studies of glucose catabolism by trypanosoma brucei gambiense. Eur J Biochem 121: 657–661.NE MackenzieJE HallJR SeedAI Scott1982Carbon-13 Nuclear-Magnetic-Resonance studies of glucose catabolism by trypanosoma brucei gambiense.Eur J Biochem121657661
- 21. Grant PT, Fulton JD (1957) The catabolism of glucose by strains of trypanosoma rhodesiense. Biochem J 66: 242–250.PT GrantJD Fulton1957The catabolism of glucose by strains of trypanosoma rhodesiense.Biochem J66242250
- 22. Kacser H, Burns JA (1973) The control of ux. Sym Soc Exp Biol 27: 65–104.H. KacserJA Burns1973The control of ux.Sym Soc Exp Biol2765104
- 23. Bakker BM, Walsh MC, ter Kuile BH, Mensonides FI, Michels PA, et al. (1999) Contribution of glucose transport to the control of the glycolytic ux in Trypanosoma brucei. Proc Natl Acad Sci USA 96: 10098–10103.BM BakkerMC WalshBH ter KuileFI MensonidesPA Michels1999Contribution of glucose transport to the control of the glycolytic ux in Trypanosoma brucei.Proc Natl Acad Sci USA961009810103
- 24. Bakker BM, Michels PAM, Westerhoff HV (1996) Control of the glycolytic flux in Trypanosoma brucei: why control can shift suddenly. In: Snoep JL, Westerhoff HV, Sluse FE, Wijker JE, Kholodenko BN, editors. Biothermokinetics of the living cell. Amsterdam: Biothermokinetics Press. pp. 136–142.BM BakkerPAM MichelsHV Westerhoff1996Control of the glycolytic flux in Trypanosoma brucei: why control can shift suddenly.JL SnoepHV WesterhoffFE SluseJE WijkerBN KholodenkoBiothermokinetics of the living cellAmsterdamBiothermokinetics Press136142Available: http://dare.uva.nl/record/16345. Available: http://dare.uva.nl/record/16345.
- 25. Misset O, Bos OJ, Opperdoes FR (1986) Glycolytic enzymes of Trypanosoma brucei. Eur J Biochem 157: 441–453.O. MissetOJ BosFR Opperdoes1986Glycolytic enzymes of Trypanosoma brucei.Eur J Biochem157441453
- 26. Cáceres AJ, Michels PA, Hannaert V (2010) Genetic validation of aldolase and glyceraldehyde-3-phosphate dehydrogenase as drug targets in Trypanosoma brucei. Mol Biochem Parasit 169: 50–54.AJ CáceresPA MichelsV. Hannaert2010Genetic validation of aldolase and glyceraldehyde-3-phosphate dehydrogenase as drug targets in Trypanosoma brucei.Mol Biochem Parasit1695054
- 27. Chevalier N, Rigden DJ, Van Roy J, Opperdoes FR, Michels PA (2000) Trypanosoma brucei contains a 2,3-bisphosphoglycerate independent phosphoglycerate mutase. Eur J Biochem 267: 1464–1472.N. ChevalierDJ RigdenJ. Van RoyFR OpperdoesPA Michels2000Trypanosoma brucei contains a 2,3-bisphosphoglycerate independent phosphoglycerate mutase.Eur J Biochem26714641472
- 28. Aronov AM, Suresh S, Buckner FS, Van Voorhis WC, Verlinde CL, et al. (1999) Structure-based design of submicromolar, biologically active inhibitors of trypanosomatid glyceraldehyde-3-phosphate dehydrogenase. Proc Natl Acad Sci USA 96: 4273–4278.AM AronovS. SureshFS BucknerWC Van VoorhisCL Verlinde1999Structure-based design of submicromolar, biologically active inhibitors of trypanosomatid glyceraldehyde-3-phosphate dehydrogenase.Proc Natl Acad Sci USA9642734278
- 29. Xu T, Vyshemirsky V, Gormand A, von Kriegsheim A, Girolami M, et al. (2010) Inferring signaling pathway topologies from multiple perturbation measurements of specific biochemical species. Sci Signal 3: ra20.T. XuV. VyshemirskyA. GormandA. von KriegsheimM. Girolami2010Inferring signaling pathway topologies from multiple perturbation measurements of specific biochemical species.Sci Signal3ra20
- 30. Haldane JBS (1930) Enzymes. JBS Haldane1930Enzymes.Longmans, Green. Longmans, Green.
- 31. Cornish-Bowden A, Hunter PJ, Cuellar AA, Mjolsness ED, Juty NS, et al. (2003) The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models. Bioinformatics 19: 524–531.A. Cornish-BowdenPJ HunterAA CuellarED MjolsnessNS Juty2003The systems biology markup language (SBML): a medium for representation and exchange of biochemical network models.Bioinformatics19524531
- 32. Scheer M, Grote A, Chang A, Schomburg I, Munaretto C, et al. (2011) BRENDA, the enzyme information system in 2011. Nucleic Acids Res 39: D670–676.M. ScheerA. GroteA. ChangI. SchomburgC. Munaretto2011BRENDA, the enzyme information system in 2011.Nucleic Acids Res39D670676
- 33. Fuad FAA, Fothergill-Gilmore LA, Nowicki MW, Eades LJ, Morgan HP, et al. (2011) Phosphoglycerate mutase from trypanosoma brucei is hyperactivated by cobalt in vitro, but not in vivo. Metallomics 3: 1310–1317.FAA FuadLA Fothergill-GilmoreMW NowickiLJ EadesHP Morgan2011Phosphoglycerate mutase from trypanosoma brucei is hyperactivated by cobalt in vitro, but not in vivo.Metallomics313101317
- 34. Seyfang A, Duszenko M (1991) Specificity of glucose transport in Trypanosoma brucei. Eur J Biochem 202: 191–196.A. SeyfangM. Duszenko1991Specificity of glucose transport in Trypanosoma brucei.Eur J Biochem202191196
- 35. Eisenthal R, Game S, Holman GD (1989) Specificity and kinetics of hexose transport in Try-panosoma brucei. Biochim Biophys Acta 985: 81–89.R. EisenthalS. GameGD Holman1989Specificity and kinetics of hexose transport in Try-panosoma brucei.Biochim Biophys Acta9858189
- 36. Stein WD, Lieb WR (1986) Transport and diffusion across cell membranes. Academic Press. WD SteinWR Lieb1986Transport and diffusion across cell membranesAcademic Press
- 37. Matsumoto M, Nishimura T (1998) Mersenne Twister: A 623-dimensionally equidistributed uniform pseudorandom number generator. ACM T Model Comput S 8: 3–30.M. MatsumotoT. Nishimura1998Mersenne Twister: A 623-dimensionally equidistributed uniform pseudorandom number generator.ACM T Model Comput S8330
- 38. Galassi M, Davies J, Theiler J, Gough B, Jungman G, et al. (2009) GNU scientific library reference manual: (v. 1.12). Bristol, UK: Network Theory Ltd. M. GalassiJ. DaviesJ. TheilerB. GoughG. Jungman2009GNU scientific library reference manual: (v. 1.12)Bristol, UKNetwork Theory Ltd
- 39. Machné R, Finney A, Müller S, Lu J, Widder S, et al. (2006) The SBML ODE solver library: a native API for symbolic and fast numerical analysis of reaction networks. Bioinformatics 22: 1406–1407.R. MachnéA. FinneyS. MüllerJ. LuS. Widder2006The SBML ODE solver library: a native API for symbolic and fast numerical analysis of reaction networks.Bioinformatics2214061407
- 40. Hoops S, Sahle S, Gauges R, Lee C, Pahle J, et al. (2006) COPASI–a COmplex PAthway SImulator. Bioinformatics 22: 3067–3074.S. HoopsS. SahleR. GaugesC. LeeJ. Pahle2006COPASI–a COmplex PAthway SImulator.Bioinformatics2230673074
- 41. Olivier BG, Rohwer JM, Hofmeyr JS (2005) Modelling cellular systems with PySCeS. Bioinformatics 21: 560–561.BG OlivierJM RohwerJS Hofmeyr2005Modelling cellular systems with PySCeS.Bioinformatics21560561