## Figures

## Abstract

### Background

The main objective of flux balance analysis (FBA) is to obtain quantitative predictions of metabolic fluxes of an organism, and it is necessary to use an appropriate objective function to guarantee a good estimation of those fluxes.

### Methodology

In this study, the predictive performance of FBA was evaluated, using objective functions arising from the linear combination of different cellular objectives. This approach is most suitable for eukaryotic cells, owing to their multiplicity of cellular compartments. For this reason, *Saccharomyces cerevisiae* was used as model organism, and its metabolic network was represented using the genome-scale metabolic model iMM904. As the objective was to evaluate the predictive performance from the FBA using the kind of objective function previously described, substrate uptake and oxygen consumption were the only input data used for the FBA. Experimental information about microbial growth and exchange of metabolites with the environment was used to assess the quality of the predictions.

### Conclusions

The quality of the predictions obtained with the FBA depends greatly on the knowledge of the oxygen uptake rate. For the most of studied classifications, the best predictions were obtained with “maximization of growth”, and with some combinations that include this objective. However, in the case of exponential growth with unknown oxygen exchange flux, the objective function “maximization of growth, plus minimization of NADH production in cytosol, plus minimization of NAD(P)H consumption in mitochondrion” gave much more accurate estimations of fluxes than the obtained with any other objective function explored in this study.

**Citation: **García Sánchez CE, Vargas García CA, Torres Sáez RG (2012) Predictive Potential of Flux Balance Analysis of *Saccharomyces cerevisiae* Using as Optimization Function Combinations of Cell Compartmental Objectives. PLoS ONE 7(8):
e43006.
doi:10.1371/journal.pone.0043006

**Editor: **Peter Csermely,
Semmelweis University, Hungary

**Received: **April 4, 2012; **Accepted: **July 16, 2012; **Published: ** August 9, 2012

**Copyright: ** © García Sánchez et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

**Funding: **CEGS and CAVG received funding from a scholarship of the Universidad Industrial de Santander. Development of the study was supported by the Grupo de Investigación en Bioquímica y Microbiología of the Universidad Industrial de Santander. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

**Competing interests: ** The authors have declared that no competing interests exist.

## Introduction

Gradual development on genetic manipulation techniques has opened great possibilities for alteration of microorganisms for different purposes. These approaches have ranged from improvements and developments in the production of several metabolites, to multiple biochemical and microbiological investigations [1]. Since early developments in this field, the need for global analysis of cellular systems was evident, because interaction between cellular components does not allow cell functions to be explained simply by characterizing the components comprised in it [2].

This environment led to the emergence of metabolic engineering, which is a combination of systematic analysis from different cellular networks (metabolic, signaling, etc.) with molecular biology techniques to improve cellular properties through rational design and the implementation of genetic modifications [1]. Among the areas studied by metabolic engineering, one of the most relevant fields is searching for techniques to quantitatively predict the metabolic behavior of microorganisms under different conditions. In this category, the most widely used mathematical modeling approach has been flux balance analysis (FBA) [3].

FBA is based on the assumption that evolutionary pressure has led to the redirection of cellular metabolic fluxes, seeking for an optimal distribution according to a certain cellular goal [4]. This assumption make it possible to solve (i.e. to find a flux distribution based on) the underdetermined system that results from a mass balance in steady state of the intracellular metabolites [3], shown in equation (1), transforming the issue into the optimization problem of the equation (2).

In equations (1) and (2), is the objective function that represents the cellular goal, is the stoichiometric matrix, is the flux value vector, and and are the lower and upper bounds of the flux values, respectively. It is evident that the flux distribution estimated by the FBA depends on the objective function used, and therefore the chosen goal will have a direct impact on the quality of the predictions. It has been shown that, qualitatively, simulations carried out with FBA are consistent with experimental data [5], but in many cases, quantitative predictions are not reliable.

To apply FBA as a predictive technique, it should be ensured that fluxes predicted clearly represent cell growth and exchange of metabolites by only using information related to the medium in which cells are growing as input data. For this aim, it is necessary to have metabolic models of higher quality, to improve the available knowledge about the restrictions on the metabolic fluxes, and to obtain objective functions that represent in a better way the biological goals.

In most analysis, maximization of biomass production has been assumed as the most appropriate objective function (e.g. [6]–[12]). Recently, this objective function has been reviewed [13]. However, it has been found that growth-based optimization may not occur in all substrates [9], and that in some cases other objective functions perform better adjustments (e.g. [14]–[16]).

The problem of creating objective functions from experimental data has already been addressed; for example, finding the coefficients of importance (*CoIs*), representing the consistency of the hypothesis that a given flux is maximized by the organism as part of its cellular objective [17], or with the BOSS method, in which an objective function is generated from the stoichiometric network, together with constraints over the fluxes and a set of experimental data [18]. However, the objective functions obtained with these approaches are highly dependent on particular data sets, and cannot always be interpreted from a physiological point of view.

This work was aimed to determine whose FBA objective functions, composed of linear combination of objectives that represents targets of the cell compartments, allow better predictions of the metabolic fluxes. There are many objective functions previously proposed that are included in the linear combinations studied. Errors in predictions of both cell growth and exchange of metabolites (i.e. excretion) were evaluated quantitatively. The methodology presented here is most suitable for eukaryotic organisms, because prokaryotes do not possess multiple organelles. Therefore, as *Saccharomyces cerevisiae* is generally used as the eukaryotic model organism, experimental data and a metabolic model of this microorganism were used for the calculations [19]. While most FBA performance evaluations have been done using moderate size stoichiometric models, this study used a genome-scale model of the metabolism of *S. cerevisiae*, which led to the use of much of the information available about its metabolism. The experimental data sets were classified in various categories, according to growth and environmental conditions.

To sum up, the performance of different FBA objective functions (composed by linear combination of different compartmental objectives) was assessed, using a genome-scale metabolic network as metabolic model, and experimental data to determine the quality of every objective function. The objective functions evaluated can be represented by equation (3).

are the FBA objective functions tested in the study, is the number of cellular compartments considered, is an (1×) row vector of relative weighting, and is an (1×) row vector whose *o*-th element correspond to a possible objective of the *o*-th cellular compartment (the *T* superscript in equation (3) indicates transposition).

Errors in the estimations produced for the FBA when every was used as objective function were evaluated, comparing exchange fluxes and biomass production predictions with experimental data. The tested combinations of compartmental objectives were ranked according to the absolute value of the error percentage in the prediction of the specific growth rate, when the combination of objectives is used as objective function in the FBA. This approach can be expressed as shown by equation (4), but instead of selecting only one combination of objectives (i.e. solving the outer optimization problem) for every category, the five best combinations of objectives for every category (of environmental/growth conditions) were analyzed; the errors in the estimated values obtained with those five best objective functions in the FBA were compared with the errors found using the most popular objective function (i.e. maximization of biomass production), and the errors found with an objective function that generally does not give good predictions (i.e. maximization of ATP production).

In equation (4), is the measured specific growth rate in the *k*-th experimental data set of the category, is the specific growth rate predicted by the internal optimization problem (i.e. a FBA done using as objective function) for the *k*-th data set, and is the number of experimental data sets that belongs to the category (of environmental/growth conditions) analyzed.

## Methods

Multiple data sets of *S. cerevisiae* growth experiments were obtained from the literature, forming a wide range of conditions for the estimations so that the conclusions obtained would be as versatile as possible. Subsequently, selected data sets went under a carbon balance analysis, to avoid considering experimental data with too much error, or too much uncertainty in the measurement. We excluded data sets with errors greater than 10% in the overall mass balance. **Table 1** shows the list of experimental data sets taken into account in this study, and some important experimental conditions from the experiments carried out in the selected data sets from every listed source. Table S1 presents a more detailed description of the experimental data sets used.

A genome-scale compartmentalized model, the iMM904 model, was selected as the metabolic model of *S. cerevisiae*. This model consists of 1577 reactions (including transport reactions) and 1228 metabolites, distributed in eight locations: extracellular space, cytosol, mitochondria, peroxisome, nucleus, endoplasmic reticulum, Golgi apparatus and vacuole [31]. As it can be seen, the model has seven cellular compartments that could be considered as contributors to the global cellular objective. However, the number of reactions in the compartments has different orders of magnitude, so it was decided to consider the five compartments with higher number of reactions as possible contributors to the cellular objective function. The five compartments that accomplish this condition are cytosol, mitochondria, nucleus, endoplasmic reticulum and peroxisome. The other two compartments, vacuole and Golgi apparatus, only contain three and six reactions, respectively.

Subsequently, some preliminary tests were addressed to explore the influence of the objective functions from the compartments in the modeling. For each one of these five compartments, a number of potential objectives were selected, and their linear combinations would compose the objective functions studied. These preliminary tests showed that the maximization of growth was one of the functions that had a greater impact on the quality of the predictions, and that potential objectives from the compartments “nucleus” and “endoplasmic reticulum” did not contribute adequately to the quality of the estimations, possibly because of the insufficient connectivity of metabolites within these compartments in the model [32]. Therefore, those two compartments were discarded in the modeling of this study, and the objective functions related to the biomass were moved into a virtual compartment, named “global”. **Table 2** shows the different possible objectives considered for every compartment studied; those objectives are related mainly to production and consumption of reductive power and ATP, owing to the outstanding importance of these cofactors in explaining the cellular behavior. Other objectives considered are associated with biomass production, because the relevance of this objective in the FBA modeling is well established, and with production of diverse secondary metabolites.

The objective functions evaluated in this study consisted of linear combinations from the objectives of the compartments, as was established in equation (3). The evaluated relative weightings represent a big amount of different ratios (e.g., 1∶1∶1∶1, 1∶2∶3∶4, 1∶1∶1∶4, 1∶1∶1∶8, etc); vectors with elements equal to zero were also included allowing the evaluation of objective functions composed by subsets of compartmental objectives, and even each possible objective independently. Table S2 shows the complete list of the relative weighting vectors used in this study. Many previously evaluated objective functions (e.g. [6], [15], [16]) are also represented, including maximization of biomass production {*Z* = (max biomass production)_{glb}}, minimization of reductive power {*Z* = (min NAD(P)H production)_{cyt}+(min NAD(P)H consumption)_{mit}+(min NAD(P)H consumption)_{per}}, maximization of ATP production rate {*Z* = (max ATP production)_{cyt}+(max ATP production)_{mit}}, and minimization of production of NADH {*Z* = (min NADH production)_{cyt}}.

This study was aimed to compare predictive potential from the different objective functions formed by the combinations of the compartment objectives, as mentioned above. Therefore, only the flux values corresponding to substrate uptake and (if available) exchange of oxygen, were used as input data in each FBA executed. Values of biomass production and other fluxes determined experimentally in the data sets were used to quantify the predictive potential of the diverse objective functions. Errors in the estimation of biomass production for the *k*-th data set were calculated as percentage of relative error and were named “*Biomass error*”, as displayed in equation (5).

The sign of *Biomass error* indicates if the prediction overestimates the growth (positive sign) or underestimates it (negative sign), and this was utilized in the analysis of the different objective functions. However, for rating the objective functions, the absolute value of this kind of error was used, as was shown in equation (4).

On the other hand, errors in the prediction of the (experimentally known) exchange fluxes were calculated as the Euclidean distance between the experimental values of the exchange fluxes and the FBA estimated values; this kind of error was named “*Exchange fluxes error*”, and its calculation is presented in equation (6).

In equation (6), is the vector of measured values of the exchange fluxes experimentally determined in the *k*-th data set, and is the vector of the estimated values of the same exchange fluxes.

The simulations and comparisons were made with Matlab® (The Mathworks, Inc.) software and the COBRA toolbox package [33]. The linear programming solver used was the glpk free solver, with glpkmex link as the interface with Matlab.

## Results

The experimental data sets were classified into different categories to explore the relationship between environmental conditions and the objective functions that best model cell behavior, as well as the relationship between cell growth and the better objective functions in FBA. The categories utilized to classify the data sets were dependent on the availability of oxygen in the media, on the specific growth rate, and on the type of substrate.

The results obtained in the simulations for every category were ordered according to the accuracy in estimating the growth rate, but both classes of error calculated (i.e. *Biomass error* and *Exchange fluxes error*) were considered in the analyses. The errors are shown in the figures using box-and-whisker plots, with blue color for *Biomass error* and green color for *Exchange fluxes error*. In general, the objective functions that performed better estimations with respect to the prediction of microbial growth had also errors in the estimation of the exchange fluxes that were among the lowest ones.

The analysis carried out consisted in identifying trends among the best functions, rather than limiting the analysis to the objective function that gives the best performance in FBA. It was better to do it that way because of the existence of random error during experiments, the diversity of experimental techniques used for obtaining data in this work, the small difference in errors obtained with several of the functions and the fact that values calculated using FBA represent a “average cell” in pseudo-stable state [34]. The figures show the errors in the predictions of the best five objective functions (i.e. the five combinations of compartmental objectives which cause better growth predictions), and the errors in the predictions of two global objectives: “maximization of growth” (being the most used FBA objective until now) and “maximization of ATP production” (this objective always predicts a growth rate of zero, because the fluxes are oriented towards other pathways rather than biomass production), for comparison in every category studied.

The simulations showed that the possible peroxisomal objectives did not play any role on the predictions obtained with the FBA, since its contribution in every case was null or not significant.

Because of this, the figures and results do not mention any peroxisomal objective. Another unexpected phenomenon found was that all the different estimations obtained could be represented using only ones and zeros as relative weightings (i.e. all the predictions obtained using relative weightings that include values different to –exclusively– ones and zeros were equal to the obtained with some relative weighting composed only by ones and zeros). Therefore, the results in the figures do not show relative weighting values because all of them are ones and zeros (a weight that is zero means that none of the objectives from this compartment is active).

### Predictive potential concerning availability of oxygen

The experimental data [20]–[30] were classified according to the availability of oxygen in the cell culture, categorizing those in anaerobic growth in continuous culture (six of the data sets utilized belong to this category), aerobic growth with known oxygen uptake rate in continuous culture (25 data sets), aerobic growth with unknown oxygen uptake rate in continuous culture (six data sets), and aerobic exponential growth in a batch reactor with unknown oxygen uptake rate (eight data sets). This subdivision from the aerobic growth cases was made because there is a huge difference in the accuracy of the FBA predictions between these cases. When oxygen uptake is unknown, the oxygen flux in the FBA restrictions was bounded by a lower limit of zero, while the upper limit was a value higher than the experimental oxygen uptake measured in experiments with high growth rates, and this caused that accuracy of the estimations was more limited. This election of the upper limit in the oxygen flux value was done to compare the performance of the different objective functions when there is lack of information about this flux. **Figure 1** shows the predictions errors from the five best objective functions, compared to the errors obtained with maximization of growth and maximization of ATP production as objective functions, for each one of the categories mentioned at the start of this section.

Errors of the FBA estimations using the five best compartmentalized objective functions ** Z** (for every category), and “max biomass production” and “max ATP production” functions. The compartmental objectives that correspond to minimizations have negative sign, so

**is always maximized.**

*Z**Biomass error*: error percentage in the estimation of the specific growth rate (blue boxes).

*Exchange fluxes error*: Euclidean distance between the estimated values and the experimental values of the known exchange fluxes (green boxes).

**A**: Anaerobic growth.

**B**: Aerobic growth with known flux exchange of oxygen.

**C**: Aerobic growth with unknown oxygen uptake.

**D**: Aerobic growth with unknown oxygen uptake, in batch experiments (exponential phase).

*prod.*: production;

*cons.*: consumption;

*cyt*: cytosolic;

*mit*: mitochondrial;

*trans t cyt*: transport towards cytosol.

In the case of anaerobic growth (**Figure 1A**), the best predictions were obtained with “maximization of growth”, “maximization of growth plus minimization of NADH production in cytosol” and “maximization of growth plus minimization of succinate production in cytosol”. Based on the data employed, these three objectives led to an overestimation of the growth rate of about 25%, and a low error in the exchange fluxes' prediction. The other two interesting objectives were “maximization of growth plus minimization of ethanol production in cytosol” and “maximization of growth plus minimization of CO_{2} production in cytosol” These two objectives led to a slightly better prediction of growth rate (less than 20%), but underestimating it. Anyway, the other fluxes' estimations for those two functions are much poorer, so these combinations are not good objectives. The other possible combinations evaluated led to significantly worst predictions. For example, the fifth best objective function (“minimization of ATP consumption in cytosol”) had a *Biomass error* of almost 100%.

In the second case (aerobic growth with known oxygen uptake rate (**Figure 1B**)) “maximization of growth” and “maximization of growth plus minimization of NADH production in cytosol” were again between the best objective functions, and “maximization of growth plus minimization of NAD(P)H consumption in mitochondrion” achieved the same prediction error. Additionally, other two objective functions presented a comparable prediction level, and the rest of the combinations of compartmental objectives led to estimations of much lower quality.

The third category (aerobic growth with unknown oxygen uptake rate (**Figure 1C**)) shows some functions with a precision comparable to that of “maximization of growth” again, and between those functions we can also find “maximization of growth plus minimization of NADH production in cytosol”. It is evident that the lack of knowledge about the oxygen uptake rate causes a tendency to considerably overestimate the growth rate, exceeding 100% of error in some cases, for the combinations of objective functions having “maximization of biomass” between its elements. Only one of the best functions, “maximization of growth plus minimization of CO_{2} production in cytosol”, tends to underestimate the growth instead of overestimating it, showing only a slightly worst exchange fluxes' prediction. But in general, the predictions are worst than the ones obtained when the oxygen uptake rate is known (it is clear that in the anaerobic case the oxygen uptake is also known, being equal to zero).

The trends were totally different in the fourth case (aerobic exponential growth in a batch reactor with unknown oxygen uptake rate (**Figure 1D**)). “Maximization of growth” now causes a *Biomass error* higher than 300% in all studied data sets. Quantitatively, the best predictions were obtained with functions that predict no growth (i.e. underestimating the growth by 100%), except for one function, that really stands out among all: the combination “maximization of growth plus minimization of NADH production in cytosol plus minimization of NAD(P)H consumption in mitochondrion”; which permits to obtain predictions with *Biomass error* of less than 20%, and *Exchange fluxes error* lower than 10. **Figure 1D** clearly shows the big difference in the predictions obtained with the previously mentioned combination of objectives for the data sets evaluated, which seem to be a very attractive option for modeling exponential growth phase of *S. cerevisiae*. This indicates that the addition of the objectives “minimization of NADH production in cytosol plus minimization of NAD(P)H consumption in mitochondrion” to the “maximization of biomass” objective causes that the objective function models the real oxygen uptake rate in an outstanding way, in cases where the growth rate is high (exponential growth), despite the lack of accurate information about the oxygen exchange flux.

### Predictive potential concerning growth rate, in aerobic growth with known oxygen flux

The data with measured oxygen consumption came from chemostat experiments with different dilution rates, so it was decided to explore the performance of the functions according to growth rates. The data was classified into three subgroups: growth rate less than or equal to 0.15 h^{−1} (19 of the data sets utilized belong to this category), growth rate higher than 0.15 h^{−1} and lower than or equal to 0.28 h^{−1} (three data sets), and growth rate higher than 0.28 h^{−1} (three data sets). **Figure 2** shows the five objective functions that cause better FBA predictions in each one of these categories, and the two objectives used for comparison.

Errors of the FBA estimations using the five best compartmentalized objective functions ** Z** (for every clasification), and “max biomass production” and “max ATP production” functions. The compartmental objectives that correspond to minimizations have negative sign, so

**is always maximized.**

*Z**Biomass error*: error percentage in the estimation of the specific growth rate (blue boxes).

*Exchange fluxes error*: Euclidean distance between the estimated values and the experimental values of the known exchange fluxes (green boxes).

**A**: Growth rate less than or equal to 0.15 h

^{−1}.

**B**: Growth rate higher than 0.15 h

^{−1}and lower than or equal to 0.28 h

^{−1}.

**C**: Growth rate higher than 0.28 h

^{−1}.

*prod.*: production;

*cons.*: consumption;

*cyt*: cytosolic;

*mit*: mitochondrial;

*trans t cyt*: transport towards cytosol.

With the three ranges of growth rates, the tendency was that the best predictions were given for “maximization of growth”, and a couple of combinations including it (between them “maximization of growth plus minimization of NADH production in cytosol” and “maximization of growth plus minimization of NAD(P)H consumption in mitochondrion” in the three cases). The only case in which a better prediction is found among these three categories is in medium growth rates (i.e. growth rates between 0.15 h^{−1} and 0.28 h^{−1}, see Figure 2B), where “maximization of growth plus minimization of ethanol production in cytosol” and “maximization of growth plus minimization of ethanol production in cytosol plus minimization of NAD(P)H consumption in mitochondrion” led to lower values of *Exchange fluxes error*, with an equal *Biomass error*.

### Predictive potential concerning type of substrate, in aerobic growth with known oxygen flux

Predictions of FBA with different objective functions in the cases in which the substrate was glucose (20 of the data sets utilized belong to this category) were compared with cases in which the substrate was not glucose (four data sets), because some previous studies have suggested that the best objective function in the application of FBA may depend on the type of substrate [9]. The combinations of objectives with better performance when the oxygen consumption is known and the substrate is glucose are shown in **Figure 3A**, and the best objectives for the experiments where oxygen flux was measured but substrate is not glucose, are depicted in **Figure 3B**.

Errors of the FBA estimations using the five best compartmentalized objective functions ** Z** (for every case), and “max biomass production” and “max ATP production” functions. The compartmental objectives that correspond to minimizations have negative sign, so

**is always maximized.**

*Z**Biomass error*: error percentage in the estimation of the specific growth rate (blue boxes).

*Exchange fluxes error*: Euclidean distance between the estimated values and the experimental values of the known exchange fluxes (green boxes).

**A**: Experiments with glucose as substrate.

**B**: Experiments with substrates other than glucose.

*prod.*: production;

*cons.*: consumption;

*cyt*: cytosolic;

*mit*: mitochondrial;

*trans t cyt*: transport towards cytosol.

In **Figure 3** it is shown that there is not much difference between the best objective functions in both cases. With or without glucose as substrate, the best objectives were “maximization of biomass production” and a couple of combinations containing the aforementioned objective. The only exception in this figure is the best function in the ‘substrate not glucose’ case: the combination “minimization of ATP consumption in cytosol plus maximization of ATP transport towards cytosol in mitochondrion”, with which slightly better growth prediction and almost equal exchange fluxes' prediction are obtained. Anyway, there was a lack of data with substrates other than glucose in the data sets used in this study, making this observation not very reliable. Nevertheless, this could be an interesting FBA objective to analyze by using a bigger amount of ‘substrate not glucose’ data.

## Discussion

Quality of the predictions obtained with FBA was dramatically dependent on the knowledge of the oxygen uptake rate. Previous studies used this flux to evaluate the quality of FBA predictions, but used the other exchange fluxes as input data [16]. As the predictions has a lower quality when the oxygen uptake rate is unknown, lack of information about oxygen flux is a big problem for using FBA as a predictive technique in aerobic cases, because it is very difficult to predict the exact value of oxygen uptake rate for a determined medium condition. In any case, for certain experimental conditions, lower and upper bounds of oxygen uptake rate can be determined. In consequence, restrictions of oxygen uptake can be tightened and therefore predictions of FBA can be remarkably improved.

For the most of studied classifications, the best predictions were obtained with “maximization of growth”, and other combinations that included this previous objective. This result agrees with previous studies that supported the use of maximization of biomass production as objective function for FBA (e.g. [6], [9], [18]). “Minimization of NADH production in cytosol” and “minimization of NAD(P)H consumption in mitochondrion” were two objectives that constantly showed up in combination with “maximization of growth” in the best objective functions for every classification. These two objectives did not modify greatly the predictions obtained by “maximization of growth”, but change slightly the estimations obtained. This biochemical condition has been observed in *S. cerevisiae*, that strives to minimize the excess NADH formation under anaerobic conditions [35]. The biomass yield was positively correlated with the net amount of NADH reoxidized in respiration and glycerol formation, indicating that the turnover of excess NADH from biosynthesis is an important factor influencing the biomass yield under oxygen-limiting conditions [36]. Minimization of redox potential had already showed good results as FBA objective function for *Escherichia coli* [16], so its relevance is not something new.

The case of exponential aerobic growth with unknown oxygen flux is the only exception to the tendency mentioned in the preceding paragraph. A previous study had already indicated that the best objective can be different depending on if the cells are growing in a batch or a continuous culture [15]. In the present study, the combination “maximization of growth plus minimization of NADH production in cytosol plus minimization of NAD(P)H consumption in mitochondrion” gives estimates of fluxes that are much more accurate than the given by any other objective function explored, when *S. cerevisiae* was growing in a batch culture. With the aforementioned combination, errors in the growth rate were lower than 20%, while all of the others objective functions explored gave predictions with -100% (no growth) o more than 300% of error in the estimation of growth. This is a really interesting result, and it seems valuable to explore the performance of this FBA objective function with a higher amount of exponential growth data sets.

An extensive redistribution of fluxes has been observed in anaerobic conditions compared to all the aerobic conditions [27]. In addition, under aerobic conditions *S. cerevisiae* regenerates NAD^{+} mainly through respiration. When limited oxygen availability restricts respiration, cells are forced to use other means for regeneration of NAD^{+}, and mitochondrial NADH needs to be transported to the cytosol for re-oxidation. For the transport of NADH, mitochondrial alcohol dehydrogenase, encoded by *ADH3,* provides a probable redox shuttle [23], [37].

The results did not indicate that different objective functions allow a better performance of FBA depending on substrate type (glucose or not glucose), as proposed by a previous study [9]. However, there was an uncommon objective function with unexpectedly good performance when the substrate is not glucose (“minimization of ATP consumption in cytosol plus maximization of ATP transport towards cytosol in mitochondrion”). Anyway, the amount of experimental data in the both categories studied was very different, having too little data with substrates other than glucose. To obtain better conclusions regarding the type of substrate, it is necessary to perform the analysis using more experiments with different substrates, being able to assess the possible existence of differences according to the path where the metabolites are integrated into the metabolic network. Similarly, the assessment of the effect of other factors, such as pH or unfavorable osmotic pressure in the culture medium, requires more and better experiments.

## Supporting Information

### Table S1.

Detailed experimental data sets used in the study.

doi:10.1371/journal.pone.0043006.s001

(DOC)

### Table S2.

Relative weighting vectors used for generate all the tested objective functions.

doi:10.1371/journal.pone.0043006.s002

(DOC)

## Author Contributions

Conceived and designed the experiments: CEGS RGTS. Performed the experiments: CEGS CAVG. Analyzed the data: CEGS RGTS. Wrote the paper: CEGS RGTS. Designed the software used in analysis: CEGS CAVG.

## References

- 1. Koffas M, Roberge C, Lee K, Stephanopoulos G (1999) Metabolic engineering. Annu Rev Biomed Eng 01: 535–557. doi: 10.1146/annurev.bioeng.1.1.535
- 2. Papin JA, Price ND, Wiback SJ, Fell DA, Palsson BØ (2003) Metabolic pathways in the post-genome era. Trends Biochem Sci 28: 250–258. doi: 10.1016/s0968-0004(03)00064-1
- 3. Raman K, Chandra N (2009) Flux balance analysis of biological systems: applications and challenges. Brief Bioinform 10(4): 453–449. doi: 10.1093/bib/bbp011
- 4. Llaneras F, Picó J (2008) Stoichiometric modelling of cell metabolism. J Biosci Bioeng 105: 1–11. doi: 10.1263/jbb.105.1
- 5. Kauffman KJ, Prakash P, Edwards JS (2003) Advances in flux balance analysis. Curr Opin Biotechnol 14: 491–496. doi: 10.1016/j.copbio.2003.08.001
- 6.
Edwards JS, Ibarra RU, Palsson BØ (2001)
*In silico*predictions of*Escherichia coli*metabolic capabilities are consistent with experimental data. Nat Biotechnol 19: 125–130. - 7.
Edwards JS, Palsson BØ (2000) The
*Escherichia coli*MG1655*in silico*metabolic genotype: its definition, characteristics and capabilities. Proc Natl Acad Sci USA 97: 5528–5533. doi: 10.1073/pnas.97.10.5528 - 8.
Förster J, Famili I, Fu P, Palsson BØ, Nielsen J (2003) Genome-scale reconstruction of the
*Saccharomyces cerevisiae*metabolic network. Genome Res 13: 244–253. doi: 10.1101/gr.234503 - 9.
Ibarra RU, Edwards JS, Palsson BØ (2002)
*Escherichia coli*K-12 undergoes adaptive evolution to achieve*in silico*predicted optimal growth. Nature 420(6912): 186–189. doi: 10.1038/nature01149 - 10.
Schilling CH, Covert MW, Famili I, Church GM, Edwards JS, et al. (2002) Genome-scale metabolic model of
*Helycobacter pylori*26695. J Bacteriol 184(16): 4582–4593. doi: 10.1128/jb.184.16.4582-4593.2002 - 11. Varma A, Palsson BØ (1994) Metabolic flux balancing: basic concepts, scientific and practical use. Nat Biotechnol 12: 994–998. doi: 10.1038/nbt1094-994
- 12.
Almaas E, Kovács B, Vicsek T, Oltvai ZN, Barabási A-L (2004) Global organization of metabolic fluxes in the bacterium
*Escherichia coli*. Nature 427: 839–843. doi: 10.1038/nature02289 - 13. Feist A, Palsson BØ (2010) The biomass objective function. Curr Opin Microbiol 13: 344–349. doi: 10.1016/j.mib.2010.03.003
- 14. Ramakrishna R, Edwards JS, McCulloch A, Palsson BØ (2001) Flux balance analysis of mitochondrial energy metabolism: consequences of systemic stoichiometric constraints. Am J Physiol Regul Integr Comp Physiol 280: R695–R704.
- 15.
Schuetz R, Kuepfer L, Sauer U (2007) Systematic evaluation of objective functions for predicting intracellular fluxes in
*Escherichia coli*. Mol Syst Biol 3: 119. doi: 10.1038/msb4100162 - 16. Knorr AL, Jain R, Srivastava R (2007) Bayesian-based selection of metabolic objective functions. Bioinformatics 23(3): 351–357. doi: 10.1093/bioinformatics/btl619
- 17. Burgard AP, Maranas CD (2002) Optimization-based framework for inferring and testing hipotesized metabolic objective functions. Biotechnol and Bioeng 82(6): 670–677. doi: 10.1002/bit.10617
- 18. Gianchadani EP, Oberhardt MA, Burgard AP, Maranas CD, Papin JA (2008) Predicting biological system objectives de novo from internal state measurements. BMC Bioinformatics 9: 43. doi: 10.1186/1471-2105-9-43
- 19.
Ostergaard S, Olsson L, Nielsen J (2000) Metabolic engineering of
*Saccharomyces cerevisiae*. Microbiol Mol Biol Rev 64: 34–50. doi: 10.1128/mmbr.64.1.34-50.2000 - 20. Çakır T, Efe Ç, Dikicioglu D, Hortacsu A, Kırdar B, et al. (2007) Flux Balance Analysis of a genome-scale yeast model constrained by exometabolomic data allows metabolic system identification of genetically different strains. Biotechnol Prog 23: 320–326. doi: 10.1021/bp060272r
- 21.
Nissen T, Schulze U, Nielsen J, Villadsen J (1997) Flux distributions in anaerobic, glucose-limited continuous cultures of
*Saccharomyces cerevisiae*. Microbiology 143: 203–218. doi: 10.1099/00221287-143-1-203 - 22.
Gombert AK, dos Santos MM, Christensen B, Nielsen J (2001) Network identification and flux quantification in the central metabolism of
*Saccharomyces cerevisiae*under different conditions of glucose repression. J Bacteriol 183(4): 1441–1451. doi: 10.1128/jb.183.4.1441-1451.2001 - 23.
Daran-Lapujade P, Jansen MLA, Daran J-M, van Gulik W, de Winde JH, et al. (2004) Role of transcriptional regulation in controlling fluxes in central carbon metabolism of
*Saccharomyces cerevisiae*. J Biol Chem 279(10): 9125–9138. doi: 10.1074/jbc.m309578200 - 24.
Frick O, Wittmann C (2005) Characterization of the metabolic shift between oxidative and fermentative growth in
*Saccharomyces cerevisiae*by comparative 13C flux analysis. Microbial Cell Factories 4: 30. - 25.
van Winden WA, van Dam JC, Ras C, Kleijn RJ, Vinke JL, et al. (2005) Metabolic-ﬂux analysis of
*Saccharomyces cerevisiae*CEN.PK113-7D based on mass isotopomer measurements of 13C-labeled primary metabolites. FEMS Yeast Res 5: 559–568. doi: 10.1016/j.femsyr.2004.10.007 - 26.
Ostergaard S, Olsson L, Nielsen J (2001) In vivo dynamics of galactose metabolism in
*Saccharomyces cerevisiae*: metabolic fluxes and metabolite levels. Biotechnol and Bioeng 73(5): 412–425. doi: 10.1002/bit.1075 - 27.
Jouhten P, Rintala E, Huuskonen A, Tamminen A, Toivari M, et al. (2008) Oxygen dependence of metabolic fluxes and energy generation of
*Saccharomyces cerevisiae*CEN.PK113-1A. BMC Syst Biol 2: 60. doi: 10.1186/1752-0509-2-60 - 28.
Wiebe MG, Rintala E, Tamminen A, Simolin H, Salusjärvi L, et al. (2007) Central carbon metabolism of
*Saccharomyces cerevisiae*in anaerobic, oxygen-limited and fully aerobic steady-state conditions and following a shift to anaerobic conditions. FEMS Yeast Res 8: 140–154. doi: 10.1111/j.1567-1364.2007.00234.x - 29.
Heyland J, Fu J, Blank LM (2009) Correlation between TCA cycle flux and glucose uptake rate during respiro-fermentative growth of
*Saccharomyces cerevisiae*. Microbiology 155: 3827–3837. doi: 10.1099/mic.0.030213-0 - 30. van Hoek P, van Dijken JP, Pronk JT (1998) Effect of specific growth rate on fermentative capacity of baker's yeast. Appl Environ Microbiol 64(11): 4226–4233.
- 31. Mo ML, Palsson BØ, Herrgård MJ (2009) Connecting extracellular measurements to intracellular flux states in yeast. BMC Syst Biol 3: 37. doi: 10.1186/1752-0509-3-37
- 32.
Zomorrodi AR, Maranas CD (2010) Improving the iMM904
*S. cerevisiae*metabolic model using essentiality and synthetic lethality data. BMC Syst Biol 4: 178. doi: 10.1186/1752-0509-4-178 - 33. Schellenberger J, Que R, Fleming RMT, Thiele I, Orth JD, et al. (2011) Quantitative prediction of cellular metabolism with constraint-based models: the COBRA Toolbox v2.0. Nat Protoc 6: 1290–1307. doi: 10.1038/nprot.2011.308
- 34. Wiechert W (2002) Modeling and simulation: tools for metabolic engineering. J Biotechnol 94: 37–63. doi: 10.1016/s0168-1656(01)00418-7
- 35.
Albers E, Larsson C, Lidén G, Niklasson C, Gustafsson L (1996) Influence of the nitrogen source on
*Saccharomyces cerevisiae*anaerobic growth and product formation. Appl Environ Microbiol 62: 3187–3195. - 36.
Franzén CJ (2003) Metabolic flux analysis of RQ –controlled microaerobic ethanol production by
*Saccharomyces cerevisiae*. Yeast 20: 117–132. - 37.
Bakker BM, Overkamp KM, van Maris AJA, Kötter P, Luttik MAH, et al. (2001) Stoichiometry and compartmentation of NADH metabolism in
*Saccharomyces cerevisiae*. FEMS Microbiol Rev 25: 15–37. doi: 10.1111/j.1574-6976.2001.tb00570.x