Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

External validation of VO2max prediction models based on recreational and elite endurance athletes

  • Szczepan Wiecha ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Validation, Writing – original draft, Writing – review & editing

    szczepan.wiecha@awf.edu.pl

    Affiliation Faculty in Biala Podlaska, Department of Physical Education and Health, Jozef Pilsudski University of Physical Education in Warsaw, Biala Podlaska, Poland

  • Przemysław Seweryn Kasiak,

    Roles Project administration, Writing – original draft

    Affiliation 3rd Department of Internal Medicine and Cardiology, Students’ Scientific Group of Lifestyle Medicine, Medical University of Warsaw, Warsaw, Poland

  • Igor Cieśliński,

    Roles Data curation, Software, Visualization

    Affiliation Faculty in Biala Podlaska, Department of Physical Education and Health, Jozef Pilsudski University of Physical Education in Warsaw, Biala Podlaska, Poland

  • Tim Takken,

    Roles Supervision, Writing – review & editing

    Affiliation Department of Medical Physiology, Child Development & Exercise Center, Wilhelmina Children’s Hospital, UMC Utrecht, Utrecht, The Netherlands

  • Tomasz Palka,

    Roles Formal analysis, Supervision

    Affiliation Faculty of Physical Education and Sport, Department of Physiology and Biochemistry, University of Physical Education in Krakow, Krakow, Poland

  • Beat Knechtle,

    Roles Formal analysis, Methodology, Writing – review & editing

    Affiliation Institute of Primary Care, University of Zurich, Zurich, Switzerland

  • Pantelis Τ. Nikolaidis,

    Roles Methodology, Writing – original draft

    Affiliation School of Health and Caring Sciences, University of West Attica, Athens, Greece

  • Łukasz A. Małek,

    Roles Methodology, Writing – review & editing

    Affiliation Department of Epidemiology, Cardiovascular Disease Prevention and Health Promotion, National Institute of Cardiology, Warsaw, Poland

  • Marek Postuła,

    Roles Supervision

    Affiliation Department of Experimental and Clinical Pharmacology, Centre for Preclinical Research and Technology, Medical University of Warsaw, Warsaw, Poland

  • Artur Mamcarz,

    Roles Supervision

    Affiliation 3rd Department of Internal Medicine and Cardiology, Medical University of Warsaw, Warsaw, Poland

  • Daniel Śliż

    Roles Formal analysis, Project administration, Writing – original draft

    Affiliation 3rd Department of Internal Medicine and Cardiology, Medical University of Warsaw, Warsaw, Poland

Abstract

In recent years, numerous prognostic models have been developed to predict VO2max. Nevertheless, their accuracy in endurance athletes (EA) stays mostly unvalidated. This study aimed to compare predicted VO2max (pVO2max) with directly measured VO2max by assessing the transferability of the currently available prediction models based on their R2, calibration-in-the-large, and calibration slope. 5,260 healthy adult EA underwent a maximal exertion cardiopulmonary exercise test (CPET) (84.76% male; age 34.6±9.5 yrs.; VO2max 52.97±7.39 mL·min-1·kg-1, BMI 23.59±2.73 kg·m-2). 13 models have been selected to establish pVO2max. Participants were classified into four endurance subgroups (high-, recreational-, low- trained, and “transition”) and four age subgroups (18–30, 31–45, 46–60, and ≥61 yrs.). Validation was performed according to TRIPOD guidelines. pVO2max was low-to-moderately associated with direct CPET measurements (p>0.05). Models with the highest accuracy were for males on a cycle ergometer (CE) (Kokkinos R2 = 0.64), females on CE (Kokkinos R2 = 0.65), males on a treadmill (TE) (Wasserman R2 = 0.26), females on TE (Wasserman R2 = 0.30). However, selected models underestimated pVO2max for younger and higher trained EA and overestimated for older and lower trained EA. All equations demonstrated merely moderate accuracy and should only be used as a supplemental method for physicians to estimate CRF in EA. It is necessary to derive new models on EA populations to include routinely in clinical practice and sports diagnostic.

Introduction

The concept of maximal oxygen uptake (VO2max) was first suggested by Hill et al. in the 1920s [1]. VO2max is the highest attained oxygen uptake during an incremental exercise test with large muscle groups (e.g., treadmill or cycling). VO2max is an important parameter to objectively assess cardiorespiratory fitness (CRF) both in healthy people and those suffering from cardiovascular diseases (CVD) [2,3]. The American Heart Association (AHA) recognized that CRF, described mainly as a VO2max, should be used as an essential factor in the comprehensive diagnostic process [3]. Moreover, a lower level of CRF is strongly related to a higher risk of CVDs, death from numerous cancer types, and all-cause mortality [4]. This represents a switch from risk factors widely discussed in recent decades, such as smoking, hypertension, or hyperlipidemia [2,3,5].

VO2max in sports & performance diagnostics

VO2max is an important variable in endurance sports, such as running, cycling, swimming, triathlon, or team sports [6]. VO2max strongly correlates with athlete’s aerobic performance, could be applied to prescribe training properly, and is useful to assess adaptation to exercise [79]. Furthermore, the VO2max could help in the prediction of a race time [10,11]. Elite athletes achieve varied VO2max values, dependent on their discipline and training experience [12,13]. Males typically have higher VO2max than females [14], and VO2max values decrease with age [15]. Body weight and height are related as well as the testing mode. Higher VO2max values are observed on a treadmill compared to the cycle ergometer [16]. Briefly, Kaminky et al. indicate the level of training, the method of testing (cycle ergometry, treadmill, rowing machine, etc.), co-existing CVDs, and respiratory exchange ratio (RER) as factors influencing VO2 [17]. Other contributors perhaps include the psychological attitude of the athlete to the effort (i.e. that the CPET conducting until refuse may potentially last longer), race, and ethnicity [18,19]. Due to its numerous practical implications and variability, it is important to precisely assess VO2max in different athletic disciplines and populations [20].

VO2max in clinical practice

Measuring VO2max is also especially important under clinical conditions during the examination of the cardiovascular system [3,21]. It could be regarded as the integrated function of (amongst others) lungs, heart, blood vessels, and muscles [9,22]. Recommendations for VO2max-testing include the presence of ambiguous pathologic exertional symptoms, cardiovascular risk estimation, and monitoring response to applied treatment [21]. Moreover, understanding the exercise limitation is crucial information for healthcare professionals to monitor cardiac status and could be used to prescribe treatment properly for those suffering from CVDs [2,23]. Therefore, VO2max is a practically relevant parameter for a new, growing population of patients in cardiologic ambulatory care- endurance athletes (EA) [21]. Both highly trained endurance athletes (HTEA), recreational endurance athletes (REA) and low-trained endurance athletes (LTEA) with suspected CVD and those undergoing cardiopulmonary exercise testing (CPET) for periodic training evaluation are potential candidates for VO2max assessment [21].

Epidemiology of CVDs among EA

In light of current literature, there is growing importance in preventing and treating CVDs in athletes. As the number of people practicing endurance sports increases, new patient populations arose, professional and former EAs [3]. For example, in recent times, due to the SARS-CoV-2 infection, some athletes have had cardiac involvement. CPET and VO2max assessment are important elements of a comprehensive diagnostic approach [24]. To deepen the epidemiological data, it is worth mentioning that arterial hypertension is the most common CVD among physically active people. The risk of CVD is found especially in the group of people after 35 years old (thus former and retired EA). Although sport is recognized as a preventive factor for CVD, Medical Practitioners should be aware of the prevalence of risk factors among EA [25]. What is more, as claimed by Petek et al. among the wide cohort of collegiate athletes prevalence of persistent or exertional symptoms on return to exercise occurs only in 44/3529 (1.2%). This has been achieved, among others, by a properly conducted diagnostic and screening process consisting of CPET and VO2 assessment [21].

Again, as observed by Petek et al. the comparison of VO2max with cardiac morphology and echocardiography may facilitate the correct planning of the therapy [24]. Moreover, Moulson et al. recently found that CPET is a valuable component of the Return to Play Program and cardiac screening in young competitive EAs following SARS-CoV-2 infection [26]. To summarize, directly measured VO2max can be used as a valuable predictive cardiometabolic risk factor.

CPET protocol and applicability of prediction formulae

The gold standard to measure VO2max is performing a CPET [27]. VO2max is reached when the subject meets the physiological limit and maintains it for some time (usually 15-s, 30-s, or 60-s) [28]. Due to practical reasons, such as high costs of the procedure or a lack of testing devices as well as health contraindications, this form of measuring is often not possible to apply in a sports setting [27].

Parameters such as age, sex, and heart rate (HR) could be used to predict VO2max through various models [27,29]. The reliability of this potentially non-sophisticated and valuable method is complicated and doubtful because of low accuracy, especially in women, extremely small or tall subjects, and in individuals with high BMI values [30,31]. In the 2013 statement, AHA pointed out that there is a need for a universal and transferable prediction standard [32].

Prediction formulae undoubtedly have numerous advantages, however, those currently used were created on different populations and with the incorporation of heterogeneous testing modes [33]. Indeed, proper external validation should be a mandatory stage before the new model will be widely used [34,35]. Moreover, the risk of using only predicted values is a certain inaccuracy and error in the particular equations [36]. On the other hand, the benefit is that there is no need to undergo full CPET, which may be expensive, or when there is limited availability of specialized clinics, equipment, etc (eg. in a field settings) [37,38].

Validation studies are performed to evaluate a given model in varied conditions and on differentiated populations to assess its possible measurement bias and the ability to extrapolate its results [39]. This study aimed to externally evaluate prediction formulae on EA tested under the same conditions from one tertiary care sports diagnostic center. EAs were selected for a study population as VO2max is an important parameter in the evaluation of the overall fitness level and the selected equations are often derived from the athletic population [22]. The secondary aim was to assess the impact of age and CRF on the risk of error and bias in tested models. We hypothesize that their validity may not be sufficient to make them an equivalent method for directly measured VO2max.

Material and methods

We applied TRIPOD guidelines for the development and validation of prediction models (for detailed protocol see Supplementary information. TRIPOD Checklist for Prediction Model Validation) [39]. Results from CPETs collected between 2013–2021 were retrospectively analyzed. Maximal-effort examinations consisted of the treadmill (TE) or the cycle ergometry (CE) tests, paired with body composition (BC) analysis took place in the medical clinic (www.sportslab.pl, Warsaw, Poland). Tests were performed on an individual request as a part of regular endurance assessment or training monitoring.

Cardiopulmonary exercise testing protocol

Cardiopulmonary exercise tests (CPET) were preceded by body mass (BM) and fat mass (FM) analysis with 5 kHz/50 kHz/250 kHz electrical bioimpedance method on the body composition (BC) monitor (Tanita, MC 718, Japan. Conditions during BC and CPET were: 40 m2 indoor, air-conditioned area, 40–60% humidity, temperature 20–22°C, altitude 100 m MSL. Endurance athletes (EA) were instructed via e-mail on how to prepare: avoid any demanding exercises 24 hours before CPET, consume a high carbohydrate meal and hydrate with isotonic beverages 2–3 hours earlier, and exclude any stimulants or caffeine on the day of the procedure.

Cycle ergometry (CE) examination was performed on a cycle ergometry Cyclus-2 (RBM elektronik-automation GmbH, Leipzig, Germany) and treadmill (TE) examination was conducted on a mechanical treadmill (h/p/Cosmos quasar, Germany). CPET scores were measured using a Hans Rudolph V2 Mask (Hans Rudolph, Inc, Shawnee, KS, USA), a gas exchange analyzer Cosmed Quark CPET (Rome, Italy), and dedicated manufacturer’s software (from PFT Suite to Omnia 10.0E.). Data collection was performed with a breath-by-breath acquisition system and a 15-s filter was used for data analysis. Each breath was considered as a separate point and all points were included in the calculation of the average VO2max value.HR was measured via ANT and a torso strap as a part of the Cosmed Quark set (product accuracy comparable to ECG; ± 1 bpm.). The CPET device was calibrated with reference gas (16% O2; 5% CO2) and turbine flow for each person separately, according to manufacturer recommendations. Equipment software was regularly actualized between 2013–2021. Three gas analyzing devices were utilized and each one has been changed after 36–48 months. Every part of CPET equipment was periodically verified by manufacturer employees to keep their mechanical certificates valid. Blood lactate (LA) was assessed with the usage of Super GL2 analyzer (Müller Gerätebau GmbH, Freital, Germany). The instrument was also individually prepared before each round of analysis and calibrated with reference solution before each sample set.

Exercises begin with a 5-min. warm-up (walking or pedaling with minimal resistance). Participants’ endurance capacities were used to assess starting load. The initial power for CE was 60-150W and was increased in 2 min. intervals by 20-30W. The initial speed for TE was 7–12 km·h-1 (described by a person as a “conversation pace”) at 1% inclination. The pace was raised by 1 km·h-1 every 2 min. Observer verbally encouraged athletes to keep effort as long as possible due to assess their endurance most exactly. Achievement of oxygen uptake (VO2) or heart rate (HR) plateau, or volitional inability to maintain intensity were reasons for test termination. LA was measured by taking a 20 μL blood sample from a fingertip: directly prior to exercises, after any resistance or pace modification, and 3 min. after termination. Samples were obtained without an interruption in CE and TE tests. Before a proper sample was obtained, the first drops were gathered in a swab. HR (not averaged) was recorded at the highest point during intervals and used in further analysis [40]. Maximal oxygen uptake (VO2max) was defined as an averaged maximum oxygen uptake during the 15-s period at the end of the CPET.

Derivation cohort

The rigorous inclusion/exclusion process was applied to narrow the validation group to only those EAs who achieved maximum exertion during CPET and were free of any possible VO2max alleviating factors (see Fig 1. Flowchart of the inclusion-exclusion and further groups classification process).

thumbnail
Fig 1. Flowchart of the inclusion-exclusion and further groups classification process.

Age classification is presented in years. Endurance classification has been performed based on speed/power at respiratory compensation point (RCP) which is currently described as a variable most closely corresponding to the critical power. Moreover, the selection of a variable different from VO2max to the classification of participants in terms of their endurance capacity, enable to make group assignments independent of the factor directly validated in the study. Abbreviations: EA, endurance athlete; CPET, cardiopulmonary exercise testing; SD, standard deviation; RER, respiratory exchange ratio; VO2, oxygen uptake(mL·min-1·kg-1); LA, lactate concentration (mmol·L-1); fR, breathing frequency (breaths·min-1); RCP, respiratory compensation point; HRpeak, peak heart rate during CPET (bpm); HRmax, maximal heart rate during CPET (bpm); F, female; M, male; HTEA, high-trained endurance athletes; REA, recreational endurance athletes, LTEA, low-trained endurance athletes.

https://doi.org/10.1371/journal.pone.0280897.g001

6,439 EAs underwent CPET. Participants were eligible for preliminary inclusion if they had: (1) experience in regular running or cycling training ≥3 months, (2) age ≥18 years, (3) ≤±3 standard deviations (SD) from mean for all of the testing variables (extreme outliers were excluded), (4) lack of any acute or chronic medical condition (also musculoskeletal injuries, or addictions), (5) not taking any medications, (6) not being an active smoker.

Maximum exertion in CPET was defined as fulfilment ≥6 criteria: (1) RER ≥1.10, (2) present VO2 plateau (growth <100 mL·min-1 in VO2 with more increased running or cycling intensity), (3) respiratory frequency (fR) ≥45 breaths·min-1, (4) declared exertion during CPET ≥18 in the Borg scale [31], (5) lactate concentration (LA) ≥8 mmol·L-1, (6) growth in speed/power ≥10% of RCP after exceeding the respiratory compensation point (RCP), (7) peak heart rate (HRpeak) ≥15 bpm below predicted maximal heart rate (HRmax) [40].

Finally, 5,260 EA met all inclusion criteria. The population was divided between males and females into four age groups: 18–30; 31–45; 46–60, ≥61 years, and 4 endurance groups: HTEA, REA, LTEA, and “transition”. Endurance classification was conducted based on the speed (km·h-1) or power (W·kg-1) at the RCP calculated independently for each sex. Speed/power at RCP was a variable-of-choice because it is currently described as a parameter most closely corresponding to the critical endurance capacity [41,42]. Moreover, the selection of a variable different from VO2max to the classification of participants in terms of their endurance capacity, enabled to make group assignments independent of the factor directly validated in the study. Participants with >+1.5 SD were classified as HTEA (n = 309), <+0.5SD/>–0.5SD as REA (n = 2,033), <–1.5 SD as LTEA (n = 339). To precisely distinguish endurance subgroups, those placed between ≥+0.5SD/≤+1.5SD and between ≤–0.5SD/≥–1.5SD were classified as “transition” (n = 2.579). Models’ validation was conducted on each of the age and endurance cohorts independently (except the „transition” group) both for TEVO2max and CEVO2max.

Selected prediction models

Candidate models were found from previous systematic reviews for CPET testing (up to February 2019) [43,44] and additional literature search in PubMed, MEDLINE, EMBASE, Scopus, and Web of Science databases (for a period between March 2019- December 2021 and meta-analyses) for keywords: Cardiopulmonary exercise testing, Cardiorespiratory fitness, Exercise testing, VO2max, VO2peak.

Exclusion criteria were: (1) not reporting VO2max parameters, (2) usage of other ergometers than CE or TE during CPET, (3) consideration of parameters not possible to verify in our sample (declared physical activity level, time to exhaustion), (4) generating unviable results multiple times (<0 or >100 mL·min-1·kg-1 VO2peak), (5) being derived from pediatric (the oldest participant <18 years old) or geriatric population (the youngest participant ≥61 yrs.), (6) being derived before 01.01.2000, (7) not reporting R2 from internal/external validation, (8) being derived from group <1000 participants (for the general population) or <200 participants (specifically for EA population), (9) methodological quality <7 points according to ATS/ACCP guidelines [37], (10) usage of other testing technique than breath by breath, (11) CPET protocol not carried out following the recommended clinical ATS/ACCP guidelines [45].

Moreover, the Wasserman et al. [22] model was validated in the study due to its well-established reputation. Equations from 2 meta-analyses [46,47] were also considered because of their wide range of applications for EA.

During studies selection, we did not define the criteria for the VO2max measurement protocol due to the high variability of the currently described methods. Nevertheless, according to the current literature, different testing protocols were applied for runners and cyclists [4851]. Similar values of VO2max were observed, which suggests that it is possible to provide an exact comparison between them.

13 equations from 8 different publications were included in the analysis. Their detailed characteristics are presented in the supplementary material (S2 File).

Statistical analysis

Baseline statistics were exported into the Excel file (Microsoft Corporation, Washington, USA) and are presented as mean (±SD and 95% CI) or frequency (percentage) for categorical variables, and median for continuous variables. Differences between subgroups (all continuous variables) were analyzed using the ANOVA test-of-variance and post-hoc HSD Tukey test. There was not any missing data in the whole population. Thus, an entire cohort has been validated.

External validation was conducted by following the recommendations for the validation and interpretation of diagnostic prediction models [34]. In summary, we assessed equations accuracy by comparisons between the originally established formulas and data obtained directly from CPETs and BC examinations (e.g., VO2max, BMI). Linear model regressing measured VO2max on pVO2max was generated for each equation. Performance considered as the proximity of the observed and expected CRF, was evaluated with the usage of the R2, root mean square error (RMSE). Cutoffs for R2 were: (1) R2<0.3 for none or very weak effect size; (2) 0.3<R2<0.5 for weak or low effect size; (3) 0.5<R2<0.7 for moderate effect size; (4) R2>0.7 for high effect size [52]. Additionally, calibration slope (the slope of a linear regression model that includes the model’s linear predictor as the only covariate parameter estimate where 1 being ideal; C1), and calibration-in-the-large (mean observed compared to mean predicted value where 0 being ideal; C2) were calculated.

Ggplot 2 package in RStudio (R Core Team, Vienna, Austria; version 3.6.4), originally written Python script (Python Software Foundation, Delaware, USA; version 3.10.1), and STATA software (StataCorp, College Station, Texas, USA; version 15.1) were used in statistical analysis. The significance borderline was at a two-sided p-value <0.05.

Ethical approval

All parts of the study were approved by the Bioethical Committee-IRB of the Medical University of Warsaw (AKBE/32/2021) and were conducted in line with the Declaration of Helsinki. Moreover, each EA has to provide their written consent in a separate document.

Results

From a total of 6,439 endurance athletes (EA) who underwent CPET at a tertiary care sports diagnostic center in Poland, 5,260 EA met the inclusion criteria. Participants’ basic anthropometric characteristics are shown in Table 1. The average age of was 35.04±9.58 yrs. in the male population (n = 4,459; 84.76%) and 32.25±8.99 yrs. in the female population (n = 801; 15.24%).

thumbnail
Table 1. Participants’ basic anthropometric characteristics.

https://doi.org/10.1371/journal.pone.0280897.t001

CPET data are shown in the supplementary material (S3 File). For male EA, observed VO2max was significantly higher for TE (n = 3,330) than for CE (n = 1,129) (54.10±6.93 vs 51.92±8.05 mL·min-1·kg-1; p<0.05). In female athletes, VO2max was similar for TE (n = 671) and for CE (n = 130) (48.79±6.67 vs 49.05±6.64 mL·min-1·kg-1; (p>0.05). HTEA had significantly higher (p<0.05) levels of VO2max, the speed at RCP (SRCP), and the power at RCP (PRCP). Observed VO2max was significantly lower (p<0.05) in the LTEA subgroup.

Briefly, VO2max differed significantly between the selected equations. The performance of prediction models is presented in Tables 2 and 3 along with R2, root mean square error (RMSE), calibration-in-the-large (C1), and calibration slope (C2). Figs 25 shows the regression analysis of observed vs predicted VO2max stratified by age for the whole population, HTEA, REA, and LTEA, respectively. Subgroups that did not meet the TRIPOD guidelines [30] to consider their validation results as reliable (i.e., n≥100) were additionally marked in tables and graphs.

thumbnail
Fig 2. Regression analysis (RA) of predicted and observed VO2max for whole population (both males and females with included „transition” group) stratified by age.

95% confidence intervals are presented with grey color. Subgroups that did not meet the TRIPOD guidelines to consider their validation results as reliable (i.e n≥100) were marked with [‡]. Abbreviations: VO2max, maximal oxygen uptake. [A] RA for males and females for CE models; [B] RA for males and females for TE models; [C] RA for males for TE or CE models (Wilson et al. and Kokkinos et al.[1]); [D] RA for females for TE or CE models (Fitzgerald et al. and Kokkinos et al.[2]); [E] RA for males for TE or CE model (Kokkinos et al.[3]); [F] RA for females for TE or CE model (Kokkinos et al.[3]).

https://doi.org/10.1371/journal.pone.0280897.g002

thumbnail
Fig 3. Regression analysis (RA) of predicted and observed VO2max for HTEA stratified by age.

95% confidence intervals are presented with grey color. Subgroups that did not meet the TRIPOD guidelines to consider their validation results as reliable (i.e n≥100) were marked with [‡]. Abbreviations: VO2max, maximal oxygen uptake. [A] RA for males‡ and females‡ for CE models; [B] RA for males and females‡ for TE models; [C] RA for males for TE or CE‡ models (Wilson et al. and Kokkinos et al.[1]); [D] RA for females for TE‡ or CE‡ models (Fitzgerald et al. and Kokkinos et al.[2]); [E] RA for males for TE or CE‡ model (Kokkinos et al.[3]); [F] RA for females for TE‡ or CE‡ model (Kokkinos et al.[3]).

https://doi.org/10.1371/journal.pone.0280897.g003

thumbnail
Fig 4. Regression analysis (RA) of predicted and observed VO2max for REA stratified by age.

95% confidence intervals are presented with grey color. Subgroups that did not meet the TRIPOD guidelines to consider their validation results as reliable (i.e n≥100) were marked with [‡]. Abbreviations: VO2max, maximal oxygen uptake. [A] RA for males and females‡ for CE models; [B] RA for males and females‡ for TE models; [C] RA for males for TE or CE models (Wilson et al. and Kokkinos et al.[1]); [D] RA for females for TE‡ or CE‡ models (Fitzgerald et al. and Kokkinos et al.[1]); [E] RA for males for TE or CE model (Kokkinos et al.[3]); [F] RA for females for TE‡ or CE‡ model (Kokkinos et al.[3]).

https://doi.org/10.1371/journal.pone.0280897.g004

thumbnail
Fig 5. Regression analysis (RA) of predicted and observed VO2max for LTEA stratified by age.

95% confidence intervals are presented with grey color. Subgroups that did not meet the TRIPOD guidelines to consider their validation results as reliable (i.e n≥100) were marked with [‡]. Abbreviations: VO2max, maximal oxygen uptake. [A] RA for males‡ and females‡ for CE models; [B] RA for males and females‡ for TE models; [C] RA for males for TE or CE‡ models (Wilson et al. and Kokkinos et al.[1]); [D] RA for females for TE‡ or CE‡ models (Fitzgerald et al. and Kokkinos et al.[2]); [E] RA for males for TE or CE‡ model (Kokkinos et al.[3]); [F] RA for females for TE‡ or CE‡ model (Kokkinos et al.[3]).

https://doi.org/10.1371/journal.pone.0280897.g005

thumbnail
Table 2. Performance of selected models stratified by endurance level and sex.

https://doi.org/10.1371/journal.pone.0280897.t002

thumbnail
Table 3. Performance of selected models stratified by age and sex.

https://doi.org/10.1371/journal.pone.0280897.t003

Performance calculations for the whole population and each subgroup, with comparison (mean and SD) between observed and predicted VO2max are presented in the supplementary material (Table 3a–3d in S4 File). For TE, the lowest non-significant differences (mean and CI) were for Petek’s equation both in males (mean = –0.11; CI, –0.42, 0.20) and females (mean = –0.52; CI,–1.20, 0.16). For CE, the lowest non-significant differences (mean and CI) were for Petek’s equation in the male population (mean = –0.08; CI, –0.68, 0.52). Similarly, for the female population, the lowest but significant differences were also for Petek’s equation (mean = 2.65; CI, 1.15, 4.15,). For TE, other models significantly overestimated VO2max (Wilson’s for males and Fitzgerald’s for females) or underestimated (Wasserman’s, Myers’s, Nevill’s both allometric (1) and additive (2) formulae for males and Wasserman’s, Myers’s, Nevill’s (1) and (2) for females). For CE, significant overestimation was observed in Wilson’s and Fitzgerald’s models respectively for males and females, and underestimation in Wasserman’s, Mylius’s, and Kokkinos’s formulae for both males, females, and the whole population.

For HTEA a group size ≥ 100 was only for male runners (n = 188). For TE, significant differences between the observed and predicted VO2max were both in males and females for the HTEA subgroup. The lowest obtained differences on TE were for the Wilson’s for males (mean = 2.52; CI, 1.50, 3.54) and for the Fitzgerald’s for females (mean = 4.1; CI, 1.92, 6.28). For CE, there were no significant differences for Wilson’s model (mean = 1.82; CI, –0.32, 3.96) and Fitzgerald’s model formula (mean = 2.57; CI, –1.38, 6.52), respectively for male and female EA.

The equation based on the general population explained varied performance, from none or very weak effect size, up to moderate. For TE, R2 ranged from 0.28 for Nevill’s (1) equation up to 0.54 for Petek’s equation. In CE, R2 ranged from 0.38 for Petek’s equation up to 0.64 in Kokkinos’s equations. In the HTEA cohort (only one with n≥100), for males TE, R2 ranged from 0.15 in Wilson’s equation up to 0.44 in Wasserman’s equation. Although, they were poorly calibrated (for Wasserman’s C1 = 1461.98 mL·min-1).

Discussion

The aim of the current study was to assess the accuracy of common VO2max prediction equations in a large sample of healthy EA tested under standardized conditions. We hypothesized that their accuracy may not be adequate to make them a comparable approach for CPET.

The main novelty of this study is a comprehensive comparison of the accuracy of various formulas and their usefulness for determining VO2max in the athletic population (including different subpopulations depending on participants’ training level). The analysis of the accuracy of prediction equations suggests that more precise models are required to better establish the VO2max level, which may be crucial for the clinical assessment of EAs.

The main findings are that: (1) the currently available equations show limited accuracy, (2) it is most recommended to use models derived from populations with the possibly most similar characteristics to the target group, (3) models derived from active athletic populations works the most accurately and showed the highest transferability, and (4) a steeper decline in predicted VO2max for older participants was noted.

Current limitations in model’s transferability

Until now, most frequently underestimation of results of what in younger EA and overestimation in older ones have been observed [21,29]. Malek et al. found that 16 of 18 commonly used prediction equations were inaccurate when used in an athlete population [29]. Moreover, there was a lack of equations to predict VO2max developed in large samples of trained participants, especially elite athletes [21]. In one recent study, Petek et. al. validated previous and developed new VO2max equations for EA, although the sample size was relatively small [21]. Their main finding was that the previously established models, both on general cohorts and EA, perform poorly when used for EA undergoing CPET for clinical reasons.

Valid VO2max prediction equations are important as they can lead to false-negative or false-positive results and inadequate recommendations regarding a safe level of physical activity or the level of advancement of the training plan [8,21]. Furthermore, the normality of the VO2max values is often a very important step to determine the cause of the exercise limitation [53].

Practical application of the most accurately derived predictive equations is a better distinction of physiological vs impaired endurance. Moreover, it undoubtedly improves the clinical usage of VO2max assessment for EA examined with the suspected or confirmed CVD or to precisely prepare individualized training plans.

One of the reasons for obtaining very heterogeneous predicted results is the discrepancy in the methodology [21,30]. Potential complications were mainly related to CPET- usage of cardiology-specific protocols for TE (e.g., Bruce protocol [54]) which are not commonly used in sports-performance diagnostics [55]. Individual running economy, general fatigue, or nonspecific stress during testing rise the probability of bias [20]. The error could be even up to 40% of the actual value [28]. Our study population is larger and contains EA from the individual- or team-sports disciplines. The testing protocol was strictly standardized, and measurements included advanced parameters influencing performance- LA and BM [55].

Repercussions of using predictive equations with low to moderate accuracy

Consequences of applying prediction models with limited accuracy could be seen in sports and performance diagnostics, clinical practice, the applicability of particular equations, training prescription, and follow-up. In sports diagnostics, this can lead to prescribing incorrect, ineffective training [56]. In sports medicine and cardiology obtaining accurate VO2max values is especially important for patients with CVDs, given the growing data suggesting the role of CRF in stratifying the risk in such groups [3,57]. Moreover, there are currently more inaccuracies in the estimation of VO2max among patients suffering from CVDs than in healthy individuals. Overestimation is especially noticeable among patients with impaired cardiac output during exercise. Relying on inaccurate VO2max values may result in a missed diagnosis and incorrectly prescribed therapy, which does not bring the expected results and poses a health risk. Among other conditions, of particular importance is heart failure as referred to by Kokkinos et al [57]. Furtherly, for such equations, their applicability is limited to narrow populations with characteristics as close as possible to the group from which they were originally created (i.e. derivation cohorts) [21].

Specificity of particular subgroups

Outcome of the present study was that the examined prediction equations of VO2max had limited prediction value in the locomotion (running versus cycling), age, and performance subgroups of participants. An explanation of this limited prediction value might be due to the selection of specific predictors (sex, age, and weight) that were not measures of CRF. Among the selected predictors, the only mechanical workload was a measure of CRF. CRF in EA consisted not only of a health-related but also a sport-related physical fitness parameter; thus, it would be of great practical importance that predicted VO2max could reflect changes in sports performance. Furthermore, performance subgroups of participants might differ for body composition (i.e. lower body fat percentage in HTEA than in LTEA), which in turn might consist a bias in the assessment of CRF [58]. Ceaser and Hunter point out that endurance capacity may also depend on participant ethnicity, so this factor should be considered when deriving new models [18,58]. It is worth noting that models derived from wide populations or EA groups showed the highest performance. This is in line with the results observed so far by Petek et al. and Malek et al. [21,29]. The sex-specific equations (i.e. those provided by Kokkinos et al for CE) did not show noticeable higher accuracy. The underlying mechanism remains further investigation as females are presented physiologically with lower VO2max than males [59]. A steeper decline in predicted values for older EA in VO2max may be justified by maintaining a higher VO2 with age through regular physical activity. Similar results have already been confirmed by Kaminsky et al [59]. EAs observe a lower decline in VO2 with age than their corresponding reference group [59]. The highest inaccuracies have been noted for HTEA and younger participants. Perhaps, due to their physically higher VO2max which is also supported by additional endurance training. Thus, those EA placed above normal reference values [59]. As we underlined, there is a need for more advanced prediction models which will consider additional parameters (like age and physical activity) and fits demanding of HTEA and young individuals.

Source of errors measured & differences between protocols

The observed R2 ranged from 0.02 (Fitzgerald et al. equation for TE) to 0.65 (Kokkinos et al. equation for CE). Large discrepancies between particular equations were observed. Briefly, RMSE support the equation provided by Petek et al. The one for TE represented the lowest RMSE from all validated formulae (RMSE = 0.48). We stipulate that this finding could result from similar characteristics of the primary cohort to our validation cohort. As different CPET results are achieved on CE and TE, the Petek et al. models adjusted for both modalities and athletic group showed the best performance. It is worth mentioning, that the tested formulae represented generally lower validity for women. It is well established that female athletes achieve lower CPET scores compared to male athletes. Although, the underlying mechanism for the reduced VO2 prediction rate in this sex remains unclear. Moreover, the results between the models differed significantly (p<0.05), despite validating them on our one population. It is suggested to consider the most outlying results. More research is needed to refine the effects and recalibration of the currently available equations. The models derived from broader cohorts (provided from FRIENDS by Kokkinos et al.) or sports cohorts (provided by Petek et al.) showed less inaccuracy in both direct comparison of measured and predicted VO2 and statistical indices (R2, RMSE and calibrations). Thus, we recommended them for estimating in male and female EAs. We would like to note that the equations derived from meta-analyses, i.e. Figerald and Wilson represented the smallest inaccuracy between directly measured VO2max and predicted. The salient feature of the meta-analysis equations is that they utilize attainable demographic information for the widest cohorts. This advantage is not feasible for equations derived from original papers due to practical limitations in recruiting such a numerous amount of participants. To summarize, models represent wide differences, and innacuracies were lower when applied to cohorts with comparable profiles.

Directions of future research

We recommend that the formulas used to estimate VO2max should be applied to groups with a similar profile to the one from which they were originally derived, especially in narrow populations like LTEA, REA, or HTEA [45]. At the same time, we emphasize that there is a significant need to create new, more advanced models under unified guidelines and with the incorporation of PROBAST-AI [60] and TRIPOD checklist [35]. It will facilitate the further selection of the appropriate equation to apply in EA depending on their level of CRF. In addition, the need of selecting other predictors, such as oxygen uptake at submaximal exercise intensity, ethnicity, or a daily number of steps, should be considered in future studies.

Conclusions

To conclude, we have accomplished an independent external validation of prognostic models for the prediction of the CRF level, defined as a VO2max. Each included prognostic model showed only moderate discriminatory ability, but acceptable performance at derivation population. Direct VO2max determination by CPET cannot be replaced or interchangeable with predictive equations for EA based only on their own results. An updated and unified prognostic formula for clinical and experimental use in EA populations is necessary. Despite no formula being completely exact, the best performance was noted for males on the CE in Kokkinos model (R2 = 0.64) and males on the TE in the Wasserman model (R2 = 0.26), whereas for females on the CE in Kokkinos (R2 = 0.65) and female on the TE in Wasserman (R2 = 0.30) equations. Those models seem to better predict VO2max in our EA population and may provide utility as a method-of-choice in assessment tool during sports diagnostics or clinical practice. The overall lowest model accuracy has been observed for HTEA and EA 18–30 yr. A potential limitation of the study was the ethnic homogeneity of our group, as the subjects were mainly Caucasian.

References

  1. 1. Hill V., CNH L., H L. & B C. Muscular exercise, lactic acid and the supply and utilisation of oxygen.—Parts VII–VIII. Proc R Soc London Ser B, Contain Pap a Biol Character. 1924;97: 155–176.
  2. 2. Guazzi M, Arena R, Halle M, Piepoli MF, Myers J, Lavie CJ. 2016 focused update: Clinical recommendations for cardiopulmonary exercise testing data assessment in specific patient populations. Circulation. 2016;133: e694–e711. pmid:27143685
  3. 3. Ross R, Blair SN, Arena R, Church TS, Després JP, Franklin BA, et al. Importance of Assessing Cardiorespiratory Fitness in Clinical Practice: A Case for Fitness as a Clinical Vital Sign: A Scientific Statement from the American Heart Association. Circulation. 2016;134: e653–e699. pmid:27881567
  4. 4. Harber MP, Kaminsky LA, Arena R, Blair SN, Franklin BA, Myers J, et al. Impact of Cardiorespiratory Fitness on All-Cause and Disease-Specific Mortality: Advances Since 2009. Prog Cardiovasc Dis. 2017;60: 11–20. pmid:28286137
  5. 5. de Souza e Silva CG, Kaminsky LA, Arena R, Christle JW, Araújo CGS, Lima RM, et al. A reference equation for maximal aerobic power for treadmill and cycle ergometer exercise testing: Analysis from the FRIEND registry. Eur J Prev Cardiol. 2018;25: 742–750. pmid:29517365
  6. 6. ROWELL LB, TAYLOR HL, WANG Y. Limitations To Prediction of Maximal Oxygen Intake. J Appl Physiol. 1964;19: 919–927. pmid:14207745
  7. 7. Bentley DJ, Newell J, Bishop D. Incremental Exercise Test Design and Analysis. Sport Med. 2007;37: 575–586. pmid:17595153
  8. 8. Coyle EF. Integration of the physiological factors determining endurance performance ability. Exerc Sport Sci Rev. 1995;23: 25–63. pmid:7556353
  9. 9. Bassett DR, Howley ET. Limiting factors for maximum oxygen uptake and determinants of endurance performance. Med Sci Sports Exerc. 2000;32: 70–84. pmid:10647532
  10. 10. Hawley JA, Noakes TD. Peak power output predicts maximal oxygen uptake and performance time in trained cyclists. Eur J Appl Physiol Occup Physiol. 1992;65: 79–83. pmid:1505544
  11. 11. Noakes TD, Myburgh KH, Schall R. Peak treadmill running velocity during the vo2 max test predicts running performance. J Sports Sci. 1990;8: 35–45. pmid:2359150
  12. 12. Millet GP, Vleck VE, Bentley DJ. Physiological differences between cycling and running: Lessons from triathletes. Sport Med. 2009;39: 179–206. pmid:19290675
  13. 13. Basset FA, Boulay MR. Specificity of treadmill and cycle ergometer tests in triathletes, runners and cyclists. Eur J Appl Physiol Occup Physiol. 2000;81: 214–221. pmid:10638380
  14. 14. Al-Mallah MH, Juraschek SP, Whelton S, Dardari ZA, Ehrman JK, Michos ED, et al. Sex Differences in Cardiorespiratory Fitness and All-Cause Mortality. Mayo Clin Proc. 2016;91: 755–762. pmid:27161032
  15. 15. Stensvold D, Bucher Sandbakk S, Viken H, Zisko N, Reitlo LS, Nauman J, et al. Cardiorespiratory Reference Data in Older Adults: The Generation 100 Study. Med Sci Sports Exerc. 2017;49: 2206–2215. pmid:28598909
  16. 16. Myers J, Arena R, Franklin B, Pina I, Kraus WE, McInnis K, et al. Recommendations for clinical exercise laboratories: A scientific statement from the american heart association. Circulation. 2009;119: 3144–3161. pmid:19487589
  17. 17. Kaminsky LA, Arena R, Myers J, Peterman JE, Bonikowske AR, Harber MP, et al. Updated Reference Standards for Cardiorespiratory Fitness Measured with Cardiopulmonary Exercise Testing. Mayo Clin Proc. 2022;97: 285–293. pmid:34809986
  18. 18. Ceaser TG, Fitzhugh EC, Thompson DL, Bassett DR. Association of physical activity, fitness, and race: NHANES 1999–2004. Med Sci Sports Exerc. 2013;45: 286–293. pmid:22968305
  19. 19. McCormick A, Meijen C, Marcora S. Psychological Determinants of Whole-Body Endurance Performance. Sport Med. 2015;45: 997–1015. pmid:25771784
  20. 20. Wagner PD. New ideas on limitations to vo2max. Exerc Sport Sci Rev. 2000;28: 10–14. pmid:11131681
  21. 21. Petek BJ, Tso J V., Churchill TW, Guseh JS, Loomer G, Dicarli M, et al. Normative cardiopulmonary exercise data for endurance athletes: The Cardiopulmonary Health and Endurance Exercise Registry (CHEER). Eur J Prev Cardiol. 2022;29: 536–544. pmid:34487164
  22. 22. Wasserman K, Hansen JE, Sue DY, Stringer WW, Sietsema KE, Sun XG. Principles of exercise testing and interpretation: Including pathophysiology and clinical applications. Fifth. Principles of Exercise Testing and Interpretation: Including Pathophysiology and Clinical Applications. Philadelphia: Wolters Kluwer Health/Lippincott Williams & Wilkins; 2012.
  23. 23. Wisloff U, Lavie CJ. Taking Physical Activity, Exercise, and Fitness to a Higher Level. Prog Cardiovasc Dis. 2017;60: 1–2. pmid:28793972
  24. 24. Moulson N, Gustus SK, Scirica C, Petek BJ, Vanatta C, Churchill TW, et al. Diagnostic evaluation and cardiopulmonary exercise test findings in young athletes with persistent symptoms following COVID-19. Br J Sports Med. 2022;56: 927–932. pmid:35584886
  25. 25. De Matos LDNJ Caldeira NDAO, Perlingeiro PDS Dos Santos ILG, Negrao CE Azevedo LF. Cardiovascular risk and clinical factors in athletes: 10 years of evaluation. Med Sci Sports Exerc. 2011;43: 943–950. pmid:21085042
  26. 26. Moulson N, Petek BJ, Churchill TW, Drezner JA, Harmon KG, Kliethermes SA, et al. Cardiac Troponin Testing as a Component of Return to Play Cardiac Screening in Young Competitive Athletes Following SARS-CoV-2 Infection. J Am Heart Assoc. 2022;11. pmid:35929475
  27. 27. Wiecha S, Price S, Cieśliński I, Kasiak PS, Tota Ł, Ambroży T, et al. Transferability of Cardiopulmonary Parameters between Treadmill and Cycle Ergometer Testing in Male Triathletes—Prediction Formulae. Int J Environ Res Public Health. 2022;19: 1830. pmid:35162854
  28. 28. Lavie CJ, Arena R, Swift DL, Johannsen NM, Sui X, Lee DC, et al. Exercise and the cardiovascular system: Clinical science and cardiovascular outcomes. Circulation Research. Lippincott Williams and Wilkins; 2015. pmid:26139859
  29. 29. Malek MH, Berger DE, Housh TJ, Coburn JW, Beck TW. Validity of equations for aerobically trained males and females. Med Sci Sports Exerc. 2004;36: 1427–1432. pmid:15292753
  30. 30. Lorenzo S, Babb TG. Quantification of cardiorespiratory fitness in healthy nonobese and obese men and women. Chest. 2012;141: 1031–1039. pmid:21940772
  31. 31. Peterson MJ, Pieper CF, Morey MC. Accuracy of VO2(max) prediction equations in older adults. Med Sci Sports Exerc. 2003;35: 145–9. pmid:12544648
  32. 32. Kaminsky LA, Arena R, Beckie TM, Brubaker PH, Church TS, Forman DE, et al. The importance of cardiorespiratory fitness in the United States: The need for a national registry: A policy statement from the american heart association. Circulation. 2013;127: 652–662. pmid:23295916
  33. 33. Collins GS, Omar O, Shanyinde M, Yu LM. A systematic review finds prediction models for chronic kidney disease were poorly reported and often developed using inappropriate methods. J Clin Epidemiol. 2013;66: 268–277. pmid:23116690
  34. 34. Debray TPA, Vergouwe Y, Koffijberg H, Nieboer D, Steyerberg EW, Moons KGM. A new framework to enhance the interpretation of external validation studies of clinical prediction models. J Clin Epidemiol. 2015;68: 279–289. pmid:25179855
  35. 35. Moons KGM, Kengne AP, Grobbee DE, Royston P, Vergouwe Y, Altman DG, et al. Risk prediction models: II. External validation, model updating, and impact assessment. Heart. 2012;98: 691–698. pmid:22397946
  36. 36. Petek BJ, Tso J V., Churchill TW, Guseh JS, Loomer G, Dicarli M, et al. Normative cardiopulmonary exercise data for endurance athletes: The Cardiopulmonary Health and Endurance Exercise Registry (CHEER). Eur J Prev Cardiol. 2022;29: 536–544. pmid:34487164
  37. 37. Sánchez-Otero T, Iglesias-Soler E, Boullosa DA, Tuimil JL. Verification criteria for the determination of VO2max in the field. J Strength Cond Res. 2014;28: 3544–3551. pmid:24936896
  38. 38. Ekblom-Bak E, Björkman F, Hellenius ML, Ekblom B. A new submaximal cycle ergometer test for prediction of VO2max. Scand J Med Sci Sport. 2014;24: 319–326. pmid:23126417
  39. 39. Collins GS, Reitsma JB, Altman DG, Moons K. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): the TRIPOD Statement. BMC Med. 2015;13: 1. pmid:25563062
  40. 40. Lach J, Wiecha S, Śliż D, Price S, Zaborski M, Cieśliński I, et al. HR Max Prediction Based on Age, Body Composition, Fitness Level, Testing Modality and Sex in Physically Active Population. Front Physiol. 2021;12. pmid:34393819
  41. 41. Gómez-Molina J, Ogueta-Alday A, Camara J, Stickley C, Rodríguez-Marroyo JA, García-López J. Predictive variables of half-marathon performance for male runners. J Sport Sci Med. 2017;16: 187–194. Available: http://www.ncbi.nlm.nih.gov/pubmed/28630571. pmid:28630571
  42. 42. Paap D, Takken T. Reference values for cardiopulmonary exercise testing in healthy adults: A systematic review. Expert Rev Cardiovasc Ther. 2014;12: 1439–1453. pmid:25418758
  43. 43. Esteve-Lanao J, Del Rosso S, Larumbe-Zabala E, Cardona C, Alcocer-Gamboa A, Boullosa DA. Predicting Recreational Runners’ Marathon Performance Time During Their Training Preparation. J strength Cond Res. 2021;35: 3218–3224. pmid:31268991
  44. 44. Takken T, Mylius CF, Paap D, Broeders W, Hulzebos HJ, Van Brussel M, et al. Reference values for cardiopulmonary exercise testing in healthy subjects–an updated systematic review. Expert Rev Cardiovasc Ther. 2019;17: 413–426. pmid:31161825
  45. 45. A.T.S./A.C.C.P. ATS/ACCP Statement on Cardiopulmonary Exercise Testing. Am J Respir Crit Care Med. 2003;167: 211–277. pmid:12524257
  46. 46. Fitzgerald MD, Tanaka H, Tran Z V., Seals DR. Age-related declines in maximal aerobic capacity in regularly exercising vs. sedentary women: A meta-analysis. J Appl Physiol. 1997;83: 160–165. pmid:9216959
  47. 47. Wilson TM, Tanaka H. Meta-analysis of the age-associated decline in maximal aerobic capacity in men: Relation to training status. Am J Physiol—Hear Circ Physiol. 2000;278: H829–H834. pmid:10710351
  48. 48. Boone J, Bourgois J. The oxygen uptake response to incremental ramp exercise: Methodogical and physiological issues. Sport Med. 2012;42: 511–526. pmid:22571502
  49. 49. Beltz NM, Amorim FT, Gibson AL, Janot JM, Kravitz L, Mermier CM, et al. Hemodynamic and metabolic responses to self-paced and ramp-graded exercise testing protocols. Appl Physiol Nutr Metab. 2018;43: 609–616. pmid:29334615
  50. 50. Weston SB, Gray AB, Schneider DA, Gass GC. Effect of ramp slope on ventilation thresholds and in male cyclists. Int J Sports Med. 2002;23: 22–27. pmid:11774062
  51. 51. Silva SC, Monteiro WD, Cunha FA, Farinatti P. Influence of Different Treadmill Inclinations on and Ventilatory Thresholds During Maximal Ramp Protocols. J strength Cond Res. 2021;35: 233–239. pmid:29933356
  52. 52. Moore LM. The Basic Practice of Statistics. Technometrics. 1996;38: 404–405.
  53. 53. Radtke T, Crook S, Kaltsakas G, Louvaris Z, Berton D, Urquhart DS, et al. ERS statement on standardisation of cardiopulmonary exercise testing in chronic lung diseases. Eur Respir Rev. 2019;28. pmid:31852745
  54. 54. Muscat KM, Kotrach HG, Wilkinson-Maitland CA, Schaeffer MR, Mendonca CT, Jensen D. Physiological and perceptual responses to incremental exercise testing in healthy men: Effect of exercise test modality. Appl Physiol Nutr Metab. 2015;40: 1199–1209. pmid:26501683
  55. 55. Schabort EJ, Killian SC, St Clair Gibson A, Hawley JA, Noakes TD. Prediction of triathlon race time from laboratory testing in national triathletes. Med Sci Sports Exerc. 2000;32: 844–849. pmid:10776905
  56. 56. Mann T, Lamberts RP, Lambert MI. Methods of prescribing relative exercise intensity: Physiological and practical considerations. Sport Med. 2013;43: 613–625. pmid:23620244
  57. 57. Kokkinos P, Kaminsky LA, Arena R, Zhang J, Franklin B, Kraus W, et al. New Equations for Predicting Maximum Oxygen Uptake in Patients With Heart Failure. Am J Cardiol. 2020;128: 7–11. pmid:32650927
  58. 58. Ceaser T, Hunter G. Black and White Race Differences in Aerobic Capacity, Muscle Fiber Type, and Their Influence on Metabolic Processes. Sport Med. 2015;45: 615–623. pmid:25739558
  59. 59. Kaminsky LA, Arena R, Myers J. Reference standards for cardiorespiratory fitness measured with cardiopulmonary exercise testing data from the fitness registry and the importance of exercise national database. Mayo Clin Proc. 2015;90: 1515–1523. pmid:26455884
  60. 60. Moons KGM, Wolff RF, Riley RD, Whiting PF, Westwood M, Collins GS, et al. PROBAST: A Tool to Assess Risk of Bias and Applicability of Prediction Model Studies: Explanation and Elaboration. Ann Intern Med. 2019;170: W1. pmid:30596876