Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Multimodel inference applied to oxygen recovery kinetics after 6-min walk tests in patients with chronic obstructive pulmonary disease

  • Florent Baty ,

    Roles Conceptualization, Formal analysis, Methodology, Software, Validation, Visualization, Writing – original draft

    florent.baty@kssg.ch

    Affiliation Department of Pulmonary Medicine, Cantonal Hospital St. Gallen, St. Gallen, Switzerland

  • Christian Ritz,

    Roles Conceptualization, Formal analysis, Methodology, Software, Writing – original draft

    Affiliation Department of Nutrition, Exercise and Sports, University of Copenhagen, Copenhagen, Denmark

  • Signe Marie Jensen,

    Roles Conceptualization, Formal analysis, Methodology, Software

    Affiliation Department of Plant and Environmental Sciences, University of Copenhagen, Copenhagen, Denmark

  • Lukas Kern,

    Roles Supervision, Validation

    Affiliation Department of Pulmonary Medicine, Cantonal Hospital St. Gallen, St. Gallen, Switzerland

  • Michael Tamm,

    Roles Conceptualization, Supervision

    Affiliation Department of Pulmonary Medicine, University Hospital Basel, Basel, Switzerland

  • Martin Hugo Brutsche

    Roles Conceptualization, Funding acquisition, Project administration, Supervision

    Affiliation Department of Pulmonary Medicine, Cantonal Hospital St. Gallen, St. Gallen, Switzerland

Abstract

6-min walk tests (6MWT) are routinely performed in patients with chronic obstructive pulmonary disease (COPD). Oxygen uptake () kinetics during 6MWT can be modeled and derived parameters provide indicators of patients’ exercise capacity. Post-exercise recovery also provides important parameters of patients’ fitness which has not been extensively investigated in COPD. Several nonlinear regression models with different underlying biological assumptions may be suitable for describing recovery kinetics. Multimodel inference (model averaging) can then be used to capture the uncertainty in considering several models. Our aim was to apply multimodel inference in order to better understand the physiological underpinnings of recovery after 6MWT in patients with COPD. 61 patients with COPD (stages 2 to 4) were included in this study. Oxygen kinetics during 6MWT were modeled using nonlinear regression. Three statistical approaches (mixed-effects, meta-analysis and weighted regression) were compared in order to summarize estimates obtained from multiple kinetics. The recovery phase was modeled using 3 distinct equations (log-logistic, Weibull 1 and Weibull 2). Three models were fitted to the set of 61 kinetics. A significant model-averaged difference of 40.39 sec (SE = 17.1) in the time to half decrease of level () was found between stage 2 and 4 (p = 0.0178). In addition, the Weibull 1 model characterized by a steeper decrease at the beginning of the recovery phase showed some improvement of goodness of fit when fitted to the kinetics of patients with stage 2 COPD in comparison with the 2 other models. Multimodel inference was successfully used to model recovery after 6MWT in patients with COPD. Significant model-averaged differences in were found between moderate and very severe COPD patients. Furthermore, specific patterns of recovery could be identified across COPD stages.

Introduction

In patients with chronic obstructive pulmonary disease (COPD), dyspnea is a frequent respiratory symptom which progressively leads to exercise intolerance. In order to assess the exercise capacity of patients with COPD, 6-min walk tests (6MWT) are commonly performed. This submaximal test is of particular interest as it reflects patients daily life activities.

Oxygen uptake () kinetics during 6MWT can be modeled using nonlinear regression and derived parameters provide indicators of patients’ exercise capacity [1]. Established parameters include the oxygen uptake at steady state () and the mean response time (MRT) corresponding to the time needed for to reach 63% of .

The post-exercise recovery phase also provides important indicators of physical fitness as shown by Cohen-Solal et al. [2] in patients with chronic heart failure. However, it has not been extensively investigated in patients with COPD. In a recent publication, Bellefleur and colleagues showed that patients with COPD undergoing cardiopulmonary exercise tests have a slower kinetics in the early recovery period compared with healthy individuals and that the quarter-time recovery of oxygen uptake () increased with the severity of COPD [3]. Modeling approaches have also been used to characterize the recovery phase of patients with COPD and significant differences in the steepness of the recovery and the half-time recovery of oxygen uptake () have been found across all disease severity stages [4].

In practice, a series of curves from multiple patients are often collected and various modeling strategies can be used to summarize estimates obtained from multiple experiments. Nonlinear mixed-effects models can be fitted to the entire data set [1]. Mixed-effects models are designed to provide parameter estimates by taking into account within- and between-experiments variability. However fitting nonlinear mixed models is not always straightforward and problems of convergence may occur, especially when considering small data sets and complex models. A second strategy consists in combining estimates obtained by separate univariate model fits. In this situation either a meta-analysis strategy or a simpler weighted regression can be chosen to summarize the estimates [5].

Furthermore, the choice of the model taken to describe the recovery phase plays a critical role. A number of nonlinear regression models with partly different underlying biological assumptions and implied mechanisms may be suitable to describe recovery kinetics. Therefore, there is not always an obvious choice in selecting one model over another. In order to capture the uncertainty in considering several models, multimodel inference (a.k.a. model averaging) can be used [6, 7]. Model averaging combines parameter estimates from several candidate models into one single model-averaged estimate corresponding to the weighted mean of the individual estimates. The weight applied to each individual estimate is related to the goodness of fit of the particular model relative to the other models. Model averaging can be applied to mixed-effects, meta-analysis and weighted regression approaches. On the other hand, when analyzing multiple curves originated from a heterogeneous population (e.g., COPD patients with pathophysiological heterogeneity), one model may better fit data acquired in a particular subgroup of patients. In this situation, model selection tools can be used to compare the goodness of fit of several models in various subgroups of the population.

Our aim was to apply and compare results from multimodel inference for three statistical approaches—mixed-effects, meta-analysis and weighted regression—in order to possibly achieve improved characterizations of the physiological underpinnings of the recovery after 6MWT in patients with COPD. Mixed-effects models are based on individual measurements from all patients whereas meta analysis and weighted analysis of variance (ANOVA) are fitted using summary data, i.e., parameter estimates obtained from models fitted separately to data from each patient. We hypothesized that the pattern of recovery may differ among the different groups of disease severity, with potential clinical implications on the indidualized handling of patients with COPD before, during and after exercise testing.

Materials and methods

COPD data set

We performed a cross-sectional observational study in patients with COPD [8]. Patients referred for a 6MWT at the Department of Pulmonary Medicine of the University Hospital Basel, Switzerland between August 2003 and June 2007 were considered for participation in the study. Exclusion criteria were as follows: need for oxygen supply or resting transcutaneous oxygen saturation (SpO2) of < 85% while breathing room air, inability to walk, any acute coronary event during the previous month and conditions precluding the use of a face mask (e.g., anatomic anomaly, claustrophobia or panic disorder).

Patients gave their written informed consent to participate in the study. The study was approved by the local institutional review board (Ethikkommission beider Basel). The data analyzed in the present study were fully anonymized and no individual clinical data are presented. A minimal anonymized supporting data set is provided in S1 Dataset. Further study details can be found in previous publications [810].

Oxygen monitoring during 6MWT

The Oxycon Mobile® (Viasys Healthcare, USA) portable, wireless cardiopulmonary exercise testing device was used to measure breath-by-breath consumption. Pulse rate was determined by using an ECG-triggered belt (Polar® Electro OY T-61). Blood oxygen saturation level (SpO2) was measured by using a finger clip. and carbon dioxide output (), tidal volumes and breathing frequency were assessed by using a facemask (dead space < 70 mL) with a flow sensor and a gas analyzer. The patient carried data storage and transfer units by using a dedicated harness. Wireless transfer of breath-by-breath data to a laptop computer allowed real-time monitoring. The additional weight (950 g) of the equipment had no effect on walking distance [8]. The exact 6MWT procedure with mobile telemetry has been previously described [8]. Original breath-by-breath data were imported from the mobile telemetry device. Raw data were pre-processed by averaging the breath-by-breath measurements over consecutive periods of 20 seconds in agreement with the recommendations from the American Thoracic Society on cardiopulmonary exercise testing [11]. Since the optimal averaging period in breath-by-breath data is still debated [1214], we carried out a sensitivity analysis in order to evaluate the influence of the choice of the averaging period (5-, 10-, and 15-sec) on our findings.

A set of nonlinear regression models

The recovery phase was modelled using three different equations. One equation describes a symmetrical sigmoid pattern (log-logistic, Eq 1) while the two others depict asymmetrical sigmoid patterns with an inflection point located either at the beginning or at the end of the recovery kinetics (Weibull models 1 and 2, Eqs 2 and 3, respectively). (1) (2) (3) with , and the oxygen level at rest, steady state during exercise and recovery, respectively; τ1 the growth rate of the mono-exponential function during 6MWT; τ2 the steepness of the exponential decay during the recovery phase and the time for half decrease of the level in the recovery phase. λ is the length of the resting period, which is controlled by the experimenter and therefore not estimated during the fitting procedure. The maximum length of the resting period among the experiments (λmax) is determined a priori hence it need not be estimated during the fitting procedure; it is used to “align” multiple kinetics by removing differences in the duration of individual resting phases.

Mixed effects modeling

In mixed-effects models, individual experiments are treated as samples taken from a population by means of random effects [15].

For i = 1, …, m patients, the following models were assumed: where yij are the response vectors of length j = 1, …, ni with the corresponding vectors of individual times tij. The nonlinear function such as the above six-parameter models (Eqs 1, 2 and 3) evaluated at time tij is denoted by with a p-dimensional patient-specific parameter βi. The residual vectors are assumed to be normally distributed with a correlation structure defined by the elements of the matrices Λi; for the current COPD data set we assumed that Λi is the identity matrix. The curve is described by the functions with a patient-specific (p × 1) vector of parameters βi.

Between-patient effects are described by modeling the βi. These effects are separated into fixed and random effects: where β is the vector of fixed-effects parameters and Ai the design matrix of patient characteristics. Differences between patients not captured by the recorded patient characteristics, are described by the patient-specific random effects vector bi; these random effects may possibly be modified through explanatory variables encoded in the corresponding design matrix Bi. Random effects are assumed to follow a mean-zero, possibly multivariate normal distribution: where G denotes the between-patient variance-covariance matrix.

In our example, the nonlinear mixed-effects regression models were parametrized as follows: each individual kinetics defines one cluster for which different mean trends for the different disease stages (2 to 4) is assumed (all 6 parameters defined as fixed effects); random effects were specified for the four parameters that characterize the recovery phase , , τ2, . In this particular case, Ai is defined as the dummy coded design matrix specifying disease stage specific fixed-effect parameters, and Bi is defined as the random effect design matrix using dummy coded patient identifiers for four of the nonlinear model parameters.

Meta-analytic approach

The meta-analytic approach is a two-step procedure [5, 16]. In the first step a nonlinear regression model is fitted to data from each patient separately. In the second step the estimate for the parameter of interest is extracted from each of the model fits obtained in the first step. The corresponding standard error is also extracted. A meta analysis may be conducted based on the parameter estimates and standard errors [17]. Specifically, we define to be the parameter estimate derived for the ith patient. Then the meta-analytic random-effects model may be defined as follows: (4) where θi is the unknown true parameter estimate for the ith patient (there are only few different θ’s corresponding to the categories that the patients are divided into) and where σi denote the estimated standard error for the ith patient (from the first step). Note that this means that no residual standard error is estimated from the data. The Ai’s are random effects, which are assumed to be normally distributed with τ2 being the heterogeneity variance between patients. The model is commonly fitted using maximum likelihood or restricted maximum likelihood [17].

Weighted regression approach

A modification of the meta-analytic two-step approach is to assume that the ϵi’s are distributed as follows: where the residual standard error σ has to be estimated from the data. This analysis is referred to as the weighted regression approach. As a consequence of introducing the residual standard error, estimation has to be carried out using different procedures in statistical softwares; it is strictly speaking no longer a meta analysis but just a weighted regression.

Model averaging

Model averaging is commonly used to capture uncertainty due to model selection [7]. If one considers P candidate models to be fitted to a data set, and θ the derived parameter of interest, the model averaged estimate from the P models is given by: where wps are model-specific weights defined as ), with Δp = ICpICmin and ICp being the information criterion evaluated for the model p (). An conservative approximation of the unconditional variance of the estimate [18] is given by:

Model selection

The Akaike’s information criterion (AIC) was used for model selection. AIC is defined as: where K is the number of estimated parameters included in the model.

AIC provides for a given data set (or subset) a measure of the strength of evidence for plausible biological assumptions / mechanisms associated with a given model relative to a set of other models considered [19]. The model with the lowest AIC is the best model among all models for a given data set.

Software

All analyses were done using the R statistical software (version 3.3.2) [20]. Nonlinear mixed effects modeling was performed using the package medrc [1, 21] which combines functionalities of the packages drc [22] (nonlinear regression) and nlme [23] (mixed effects modeling). The package metafor was used for meta-analysis [17] and multcomp for statistical inference [24]. Packages AICcmodavg [19] and MuMIn [6] were used for multimodel inference (model averaging) and model selection.

Results

Modeling recovery kinetics using three summarization strategies

Oxygen kinetics were measured in 61 patients with COPD (Global Initiative for Chronic Obstructive Lung Disease (GOLD) stages 2, 3 and 4). Patients characteristics and anthropometrics are presented in Table 1.

thumbnail
Table 1. Anthropometrics, pulmonary functions, cardio-pulmonary exercise capacity.

Values are presented as median [IQR].

https://doi.org/10.1371/journal.pone.0187548.t001

Three approaches were used to summarize the fit of three distinct models on a data set including 61 kinetics. Fig 1 shows the recovery kinetics estimated by the mixed effects, meta-analysis and weighted regression strategies (left, central and right panels, respectively). Within each strategy, recovery curves are summarized for each of the three models and for all of the three COPD disease severity stages (GOLD stages 2, 3 and 4). The estimates obtained for each model within each of the 3 statistical approaches are summarized in Table 2. Due to their asymmetrical shapes, Weibull models provide either lower (Weibull 1) or higher (Weibull 2) estimates than the symmetrical log-logistic model. Independent of choice of statistical approach and model, a significant increase of about 40 seconds in was observed between patients with moderate and severe COPD (stages 2 vs. 4). Both the mixed effects and meta-analysis strategies resulted in very similar estimates, whereas weighted regression provided estimates which tended to shrink towards the overall mean. Moreover, the choice of the breath-by-breath averaging period did not impact significantly on the estimates (S1 Table).

thumbnail
Fig 1. Fitted curves of three models on oxygen kinetics recovery summarized within each COPD disease stage (2-4) for the mixed-effects, meta-analysis and weighted regression approach (left, central and right panels, respectively).

The log-logistic, Weibull 1 and Weibull 2 models are displayed by plain, dashed and dotted lines, respectively.

https://doi.org/10.1371/journal.pone.0187548.g001

thumbnail
Table 2. Time for half-decrease of the level during recovery () parameter estimates obtained using 3 models and 3 statistical approaches.

The estimates are provided together with their associated standard error (SE) and p-values. The difference in between patients with moderate and severe COPD (GOLD stages 4 vs. 2) is also reported.Three summarization methods are investigated (mixed effects, meta-analysis and weighted regression), and three nonlinear regression models (log-logistic, Weibull 1, and Weibull 2) are compared.

https://doi.org/10.1371/journal.pone.0187548.t002

Multimodel inference / Model averaging

The goodness of fit of the three models for each summarization strategy is reported in Table 3. The model-averaged estimates of the difference of () between patients with moderate and severe COPD was calculated within each statistical approach. The mixed-effects strategy provided the largest model-averaged estimates (, SE = 17.1). Both the meta-analysis and weighted regression strategy provided smaller model-averaged estimates of : 34.9 (SE = 21.2) and 34.2 (SE = 14.2), respectively.

thumbnail
Table 3. Multimodel inference / Model averaging.

Akaike information criterion (AIC) and Akaike weights are reported for the 3 models (log-logistic, Weibull 1 and Weibull 2) analyzed through the 3 summarization strategies (mixed effects, meta-analysis and weighted regression). The estimates and model averaged estimates of the difference of the time for half-decrease of the level during recovery between patients with moderate and severe COPD (GOLD 4 vs. 2) are provided together with their associated standard error (SE).

https://doi.org/10.1371/journal.pone.0187548.t003

No statistically significant difference in was found between COPD GOLD 3 and 2, whereas a statistically significant difference was found between COPD GOLD 4 and 3 (S2 Table).

Model selection in subgroups of patients

The AIC obtained for the fit of each of the three models within each statistical approach and all subgroups defined by the disease severity (COPD stages) were compared. The mixed models approach applied to subsets of data resulted in problems of convergence due to small sample size.

Results obtained from both meta-analysis and weighted regression approaches show that the Weibull 1 model characterized by a steeper decrease at the beginning of the recovery phase showed some improvement of goodness of fit when fitted to the kinetics of the stage 2 patients in comparison with the 2 other models (meta-analysis: AIC = 221.9 in Weibull 1 vs. 223.4 and 222.6 for the log-logistic and Weibull 2 models; weighted regression: AIC = 219.3 in Weibull 1 vs. 220.9 and 219.6 for the log-logistic and Weibull 2).

Discussion

As shown in the current example from pulmonary medicine, the simultaneous analysis of multiple experiments using a set of plausible models is associated with two important challenges: i) the choice of the statistical approach needed to combine the information from multiple experiments, and ii) the multimodel inference.

We found some differences among statistical approaches. Estimates provided by the mixed-effects and meta-analysis approaches were similar whereas the weighted regression strategy differed more importantly from the 2 other strategies. The mixed effects strategy resulted in estimates showing larger between group differences whereas estimates obtained from the meta-analysis and more importantly the weighted regression tended to shrink towards the overall mean in the data set. In another context (economical science), Stanley and colleagues [25] provided a comparison of weighted regression with random-effects meta-analysis, demonstrating the superiority of the former in comparison to the latter in settings with high heterogeneity and in particular for small sample sizes. Their findings support the results presented here, where we found estimates from the meta-analysis and the weighted regression to differ the most for the stratified analyses containing less observations. On the contrary, heterogeneity between patients may be expected, but to a smaller extend within subgroups of patients with the same disease severity rather than across all patients. It should also be noted that an extra layer of complexity was added here in terms of the multimodel inference and that coverage of the model-averaged estimates is expected to be higher than the nominal level due to the choice of a conservative variance estimates [18].

We successfully applied multimodel inference in our data in order to take into account the uncertainty due to the model selection, resulting in more precise and robust estimates. Although inference was based on model-averaging we used model selection in order to test the plausibility of biological hypotheses underlying different models and get a better idea of the nature of the patterns of oxygen recovery in subgroups of the population of patients with COPD. Independently from the choice of the statistical approach, the goodness of fit of the 3 models within each subgroup of patients was comparable. However, small but consistent improvements of goodness-of-fit were found when fitting the Weibull 1 model to the subgroup of patients with stage 2 COPD in comparison with the 2 other models (log-logistic and Weibull 2). Differences occuring in the early part of the oxygen recovery and possibly originated from distinct physiological processes seem to play a critical role among patients with COPD resulting into pattern variations among the 3 investigated severity stages. This is in line with the findings from Bellefleur and colleagues [3] who showed some significant between-severity stages differences in the early period of the recovery phase.

Physiological mechanisms explaining variations in the speed and pattern of post-exercise recovery phases associated with COPD severity can tentatively be explained. After aerobic exercise, recovery phases are needed to normalize the excess post-exercise oxygen consumption (EPOC) [26]. Excess oxygen is required to rebuild adenosine triphosphatase and phosphocreatine [27, 28], and is also involved in the removal of accumulated lactic acid. Prolonged recovery kinetics observed in more severe patients with COPD might be attributed to slow respiratory gas exchanges [29], or slow recovery of energy stores in peripheral skeletal muscles [30]. The present study shows that some of the physiological recovery mechanisms occurring immediately after exercise are more efficiently initiated in patients with moderate COPD (in comparison with very severe COPD). This may explain the more abrupt oxygen decline observed in the early recovery phase of patients with moderate COPD.

Conclusion

Multimodel inference is a powerful tool to summarize information from multiple recovery kinetics when modelled by a set of plausible models. Significant model-averaged differences in were found between moderate and very severe COPD patients. Furthermore, the pattern of recovery differed among COPD stages, patients with moderate COPD showing a steeper decline of their consumption at the beginning of recovery. Finally, our study indicates that recovery kinetics include clinically relevant information about the exercise capacity of patients with COPD which can be apprehended using advanced methodology. In clinical practice, exercise testing protocols should further emphasize the importance of recovery phases, whereas individualized handling of patients based on their disease severity should be advised.

Supporting information

S1 Table. Sensitivity analysis of the breath-by-breath averaging pre-processing approach.

The time for half-decrease of the level during recovery () was estimated based on the mixed effects statistical approach using three different time-averaging period (5-sec, 10-sec and 15 sec).

https://doi.org/10.1371/journal.pone.0187548.s001

(PDF)

S2 Table. Multimodel inference / Model averaging.

Akaike information criterion (AIC) and Akaike weights are reported for the 3 models (log-logistic, Weibull 1 and Weibull 2) analyzed through the 3 summarization strategies (mixed effects, meta-analysis and weighted regression). The estimates and model averaged estimates of the difference of the time for half-decrease of the level during recovery between patients with COPD GOLD 3 vs. 2 and GOLD 4 vs. 3 are provided together with their associated standard error (SE).

https://doi.org/10.1371/journal.pone.0187548.s002

(PDF)

S1 Dataset. Supporting oxygen recovery kinetics data set.

https://doi.org/10.1371/journal.pone.0187548.s003

(RDA)

Acknowledgments

The study was supported by an unconditional research grant by the Lungenliga St. Gallen and an institutional grant by the Cantonal Hospital St. Gallen.

References

  1. 1. Baty F, Ritz C, van Gestel A, Brutsche M, Gerhard D. Modeling the oxygen uptake kinetics during exercise testing of patients with chronic obstructive pulmonary diseases using nonlinear mixed models. BMC Med Res Methodol. 2016;16:66. pmid:27245328
  2. 2. Cohen-Solal A, Laperche T, Morvan D, Geneves M, Caviezel B, Gourgon R. Prolonged kinetics of recovery of oxygen consumption after maximal graded exercise in patients with chronic heart failure. Analysis with gas exchange measurements and NMR spectroscopy. Circulation. 1995;91(12):2924–2932. pmid:7796502
  3. 3. Bellefleur M, Debeaumont D, Boutry A, Netchitailo M, Cuvelier A, Muir JF, et al. Early-Phase Recovery of Cardiorespiratory Measurements after Maximal Cardiopulmonary Exercise Testing in Patients with Chronic Obstructive Pulmonary Disease. Pulm Med. 2016;2016:9160781. pmid:28018674
  4. 4. Baty F, van Gestel AJ, Kern L, Brutsche MH. Oxygen Uptake Recovery Kinetics after the 6-Minute Walk Test in Patients with Chronic Obstructive Pulmonary Disease. Respiration. 2016;92(6):371–379. pmid:27825150
  5. 5. Jiang X, Kopp-Schneider A. Summarizing EC50 estimates from multiple dose-response experiments: a comparison of a meta-analysis strategy to a mixed-effects model approach. Biom J. 2014;56(3):493–512. pmid:24478144
  6. 6. Burnham KP, Anderson DR. Model selection and multimodel inference: a practical information-theoretic approach. New York: Springer Science and Business Media; 2003.
  7. 7. Jensen SM, Ritz C. Simultaneous inference for model averaging of derived parameters. Risk Anal. 2015;35(1):68–76. pmid:24952957
  8. 8. Tueller C, Kern L, Azzola A, Baty F, Condrau S, Wiegand J, et al. Six-minute walk test enhanced by mobile telemetric cardiopulmonary monitoring. Respiration. 2010;80(5):410–418. pmid:20699610
  9. 9. Kern L, Condrau S, Baty F, Wiegand J, van Gestel AJ, Azzola A, et al. Oxygen kinetics during 6-minute walk tests in patients with cardiovascular and pulmonary disease. BMC Pulm Med. 2014;14:167. pmid:25355483
  10. 10. van Gestel AJ, Baty F, Rausch-Osthof AK, Brutsche MH. Cardiopulmonary and gas-exchange responses during the six-minute walk test in patients with chronic obstructive pulmonary disease. Respiration. 2014;88(4):307–314. pmid:25227115
  11. 11. ATS. ATS/ACCP Statement on cardiopulmonary exercise testing. Am J Respir Crit Care Med. 2003;167(2):211–277. pmid:12524257
  12. 12. Kemps HM, De Vries WR, Hoogeveen AR, Zonderland ML, Thijssen EJ, Schep G. Reproducibility of onset and recovery oxygen uptake kinetics in moderately impaired patients with chronic heart failure. Eur J Appl Physiol. 2007;100(1):45–52. pmid:17277937
  13. 13. Keir DA, Murias JM, Paterson DH, Kowalchuk JM. Breath-by-breath pulmonary O2 uptake kinetics: effect of data processing on confidence in estimating model parameters. Exp Physiol. 2014;99(11):1511–1522. pmid:25063837
  14. 14. Bringard A, Adami A, Moia C, Ferretti G. A new interpolation-free procedure for breath-by-breath analysis of oxygen uptake in exercise transients. Eur J Appl Physiol. 2014;114(9):1983–1994. pmid:24920551
  15. 15. Davidian M, Giltinan DM. Nonlinear Models for Repeated Measurement Data. Chapman & Hall/CRC Monographs on Statistics & Applied Probability. Taylor & Francis; 1995.
  16. 16. Jensen SM, Andreasen C, Streibig JC, Keshtkar E, Ritz C. A note on the analysis of germination data from complex experimental designs. Seed Science Research. 2017; p. 1–7.
  17. 17. Viechtbauer W. Conducting meta-analyses in R with the metafor package. Journal of Statistical Software. 2010;36(3):1–48.
  18. 18. Buckland ST, Burnham KP, Augustin NH. Model selection: an integral part of inference. Biometrics. 1997; p. 603–618.
  19. 19. Mazerolle MJ. Improving data analysis in herpetology: using Akaike’s Information Criterion (AIC) to assess the strength of biological hypotheses. Amphibia-Reptilia. 2006;27(2):169–180.
  20. 20. R Core Team. R: A Language and Environment for Statistical Computing; 2016. Available from: https://www.R-project.org/.
  21. 21. Gerhard D, Ritz C. medrc: Mixed effect dose-response curves; 2015.
  22. 22. Ritz C, Baty F, Streibig JC, Gerhard D. Dose-Response Analysis Using R. PLoS ONE. 2015;10(12):e0146021. pmid:26717316
  23. 23. Pinheiro J, Bates D, DebRoy S, Sarkar D, R Core Team. nlme: Linear and Nonlinear Mixed Effects Models; 2015. Available from: http://CRAN.R-project.org/package=nlme.
  24. 24. Hothorn T, Bretz F, Westfall P. Simultaneous Inference in General Parametric Models. Biometrical Journal. 2008;50(3):346–363. pmid:18481363
  25. 25. Stanley T, Doucouliagos H. Neither fixed nor random: weighted least squares meta-analysis. Statistics in medicine. 2015;34(13):2116–2127. pmid:25809462
  26. 26. Gaesser GA, Brooks GA. Metabolic bases of excess post-exercise oxygen consumption: a review. Med Sci Sports Exerc. 1984;16(1):29–43. pmid:6369064
  27. 27. Kutsuzawa T, Shioya S, Kurita D, Haida M, Ohta Y, Yamabayashi H. Muscle energy metabolism and nutritional status in patients with chronic obstructive pulmonary disease. A 31P magnetic resonance study. Am J Respir Crit Care Med. 1995;152(2):647–652. pmid:7633721
  28. 28. Wuyam B, Payen JF, Levy P, Bensaidane H, Reutenauer H, Le Bas JF, et al. Metabolism and aerobic capacity of skeletal muscle in chronic respiratory failure related to chronic obstructive pulmonary disease. Eur Respir J. 1992;5(2):157–162. pmid:1559579
  29. 29. Chick TW, Cagle TG, Vegas FA, Poliner JK, Murata GH. Recovery of gas exchange variables and heart rate after maximal exercise in COPD. Chest. 1990;97(2):276–279. pmid:2298051
  30. 30. Thompson CH, Davies RJ, Kemp GJ, Taylor DJ, Radda GK, Rajagopalan B. Skeletal muscle metabolism during exercise and recovery in patients with respiratory failure. Thorax. 1993;48(5):486–490. pmid:8322233