Imprecise measurement of physical activity variables might attenuate estimates of the beneficial effects of activity on health-related outcomes. We aimed to compare the cardiometabolic risk factor dose-response relationships for physical activity and sedentary behaviour between accelerometer- and questionnaire-based activity measures.
Physical activity and sedentary behaviour were assessed in 317 adults by 7-day accelerometry and International Physical Activity Questionnaire (IPAQ). Fasting blood was taken to determine insulin, glucose, triglyceride and total, LDL and HDL cholesterol concentrations and homeostasis model-estimated insulin resistance (HOMAIR). Waist circumference, BMI, body fat percentage and blood pressure were also measured.
For both accelerometer-derived sedentary time (<100 counts.min−1) and IPAQ-reported sitting time significant positive (negative for HDL cholesterol) relationships were observed with all measured risk factors – i.e. increased sedentary behaviour was associated with increased risk (all p≤0.01). However, for HOMAIR and insulin the regression coefficients were >50% lower for the IPAQ-reported compared to the accelerometer-derived measure (p<0.0001 for both interactions). The relationships for moderate-to-vigorous physical activity (MVPA) and risk factors were less strong than those observed for sedentary behaviours, but significant negative relationships were observed for both accelerometer and IPAQ MVPA measures with glucose, and insulin and HOMAIR values (all p<0.05). For accelerometer-derived MVPA only, additional negative relationships were seen with triglyceride, total cholesterol and LDL cholesterol concentrations, BMI, waist circumference and percentage body fat, and a positive relationship was evident with HDL cholesterol (p = 0.0002). Regression coefficients for HOMAIR, insulin and triglyceride were 43–50% lower for the IPAQ-reported compared to the accelerometer-derived MVPA measure (all p≤0.01).
Using the IPAQ to determine sitting time and MVPA reveals some, but not all, relationships between these activity measures and metabolic and vascular disease risk factors. Using this self-report method to quantify activity can therefore underestimate the strength of some relationships with risk factors.
Citation: Celis-Morales CA, Perez-Bravo F, Ibañez L, Salas C, Bailey MES, Gill JMR (2012) Objective vs. Self-Reported Physical Activity and Sedentary Time: Effects of Measurement Method on Relationships with Risk Biomarkers. PLoS ONE 7(5): e36345. doi:10.1371/journal.pone.0036345
Editor: Kaberi Dasgupta, McGill University, Canada
Received: March 3, 2012; Accepted: April 5, 2012; Published: May 9, 2012
Copyright: © 2012 Celis-Morales et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by a scholarship to CACM from the Government of Chile. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
There is clear evidence from a large body of epidemiological data that high levels of physical activity are associated with reduced risk of a number of adverse health outcomes, including type 2 diabetes , cardiovascular disease , and mortality from any cause . In addition, there is a growing body of evidence that high levels of sedentary time – usually assessed as time spent sitting or watching television – are also associated with adverse metabolic and vascular health outcomes –, and these effects are often independent of physical activity level.
However, quantification of the strength and nature of the relationship between physical activity (or sedentary behaviour) and health outcomes in population-based studies is reliant on accurate measurement of activity behaviour: poor methods increase chances of misclassification and can add bias, which can mask or distort the true underlying relationship between activity and health , . Much of the evidence generated in this area – on which current physical activity guidelines have largely been based ,  – has derived from estimates of physical activity or sedentary behaviour from self-report questionnaires. Such questionnaires are easy to administer, inexpensive and do not alter behaviour, making them well suited to large-scale investigations , . However, activity information derived from self-report is potentially subject to response bias (e.g. imprecise recall, influence of social desirability)  – and thus validation of activity questionnaires against criterion measures is vital . One commonly used physical activity questionnaire is the International Physical Activity Questionnaire (IPAQ), which, in its long-form, provides a comprehensive measure of activity in a variety of contexts (occupational, transport, household, leisure) and intensity (sitting, moderate, vigorous, walking, cycling) domains . In validation studies the IPAQ performs at least as well as other self-report activity measures , ; criterion validity of the long-form IPAQ (last 7-days) has been assessed, with ‘fair to moderate’ associations being reported between measures of total activity derived from IPAQ and criterion accelerometer methods (r-values ranging from 0.05 to 0.55 in different populations) , . Reported correlations between IPAQ-derived sitting time and accelerometer-derived sedentary time (<100 counts.min−1) have also been relatively modest (r = 0.14 to 0.51) –.
Imprecise measurement of activity variables can lead to a diminution of the apparent effects of activity on health-related outcomes due to regression dilution bias . It is therefore conceivable that the apparent effects of physical activity and sedentary behaviour on risk for metabolic and vascular disease are attenuated when the activity variables are assessed using relatively imprecise self-report questionnaires, compared to when activity is assessed by objective techniques such as accelerometry. This has potentially important implications for the determination of the precise dose-response relationships between activity and health benefits, with associated implications for recommendations for the amounts and types of physical activity needed for optimal health. Thus, additional validation to quantify the magnitude of this potential error with questionnaire-based physical activity or sedentary time assessment is important. A recent study, using the NHANES database, has compared the relationship between self-reported and accelerometer-measured moderate-to-vigorous activity (MVPA) on health-related biomarkers, reporting stronger associations for the objective activity measures . However, the self-report questionnaire used in NHANES has not been as extensively validated as the IPAQ , and there have been no published data comparing the strength of relationship between self-reported and objectively assessed sedentary behaviour and metabolic and vascular disease risk factors.
The aim of the present study was therefore to determine whether the strength of relationships for physical activity and sedentary behaviour with risk factors for metabolic and vascular disease differed between measures obtained from IPAQ vs objective accelerometer in a population of adults with a wide range of physical activity levels living in rural and urban settings.
All participants gave written informed consent prior to inclusion in this study, which was approved by Research Ethics Committees at the University of Glasgow, University of Chile, and University of Concepción.
Participants were 317 adults (140 men, 177 women), aged 18–73 years drawn from a wider study investigating the effects of environment and ethnicity on metabolic risk in the Chilean population . Of these, 163 were of European ethnic origin and 154 were of Mapuche origin (an Amerindian group native to Chile); 163 participants lived an urban environment and 154 lived rurally. Their characteristics are shown in Table 1. Individuals with a known history of cardiovascular disease or taking anti-hypertensive or diabetes medications were excluded from participation.
Measurement of physical activity by accelerometer
Participants wore accelerometers (ActiTrainer, ActiGraph, LLC, Pensacola, FL, USA) on the left hip at all times, except when showering, swimming and sleeping, for seven consecutive days to objectively assess physical activity levels. Accelerometer readings were summarized in 60-second epochs and Freedson cut-points used to define intensity domains (light <1952 count.min−1; moderate 1952–5724 count.min−1; vigorous >5725 count.min−1) . Data from participants with at least 10 hours of daily accelerometer wear time for 4 days were included in the analysis. Non-wear was defined by intervals of at least 60 minutes of zero activity counts . Wear time was calculated by subtracting non-wear time from 24 hours. Activity count values of <100 count.min−1 were defined as sedentary behaviour . Activity was reported as minutes per day of sedentary time, moderate activity and vigorous activity and as MET-minutes (where 1 MET is equivalent to resting energy expenditure) of moderate-to-vigorous physical activity (minutes of moderate activity×4.0 METs+minutes of vigorous activity×8.0 METs). These specific MET values within the moderate (3.0–6.0 METs) and vigorous (>6.0 METs) intensity ranges were chosen for consistency with the MET values assigned for moderate and vigorous activity in the IPAQ scoring protocol (see below).
Measurement of physical activity by IPAQ
Physical activity and sitting time were measured using a Spanish language long-form, last 7-day, self-administered version IPAQ, which was completed immediately following their 7 days of accelerometer wear . This version of the IPAQ asks questions about the amount of walking undertaken and participation in moderate and vigorous activities in work, transportation, domestic and garden, and leisure domains, amount of cycling undertaken for transport, and time spent sitting on weekdays and weekend days, over the preceding 7 days . Data were analyzed in accordance with the IPAQ scoring protocol (https://sites.google.com/site/theipaq/scoring-protocol). Although walking is a moderate intensity activity by MET value, the IPAQ questionnaire includes walking as a separate activity domain from moderate activity, explicitly excluding walking in the moderate activity questions. Thus, to provide a comparable index to the accelerometer-derived moderate activity measure, the walking and moderate activity domains from the IPAQ were combined into a single ‘moderate’ activity domain for analysis. However, in line with the IPAQ scoring protocol, walking was assigned an intensity of 3.3 METs, with all other moderate activity assigned an intensity of 4.0 METs. Thus, IPAQ data are reported as minutes per day of sitting, moderate activity (including walking) and vigorous activity and as MET-minutes of MVPA (minutes of walking×3.3 METS+minutes of moderate activity (excluding walking)×4.0 METS+minutes of vigorous activity×8.0 METS). Transport cycling activity was not included in analyses, but this is unlikely to substantially influence the study findings as only 13% of the study population reported any cycling for transport and mean reported cycling activity was only 5.0 minutes per day in this cohort.
Physical, biochemical and demographic measurements
Height, body mass, waist and hip circumferences and skinfolds at four sites (biceps, triceps, subscapular, suprailiac) were measured using standard protocols . Body composition was calculated from skinfold measures . Blood pressure was measured on the right arm after at least 10 minutes of seated rest using an automated blood pressure monitor (Omron HEM705 CP, Omron Healthcare UK Limited, Milton Keynes, UK) which has been validated according to the European Society of Hypertension International Protocol . The mean of two blood pressure readings was used in analysis.
Venous blood samples were drawn after an overnight fast and collected into potassium EDTA tubes and placed on ice. Plasma was separated within 10 minutes of collection and frozen at −20°C until analysis. Glucose, triglyceride (TG), total cholesterol and HDL cholesterol, were determined by enzymatic colorimetric methods using commercially available kits (Roche Diagnostics Gmbh, Mannheim, Germany; Randox Laboratories Ltd., Co. Antrim, Ireland; and Kamiya Biomedical, Seattle, USA). LDL cholesterol was calculated using the Friedewald equation . Insulin concentrations were determined by radioimmunoassay (Diagnostic System Labs, TX, USA). Coefficients of variation were <3.0% for all enzymatic colorimetric assays, 5.0% for insulin.
Socioeconomic status was determined with the European Society for Opinion and Marketing Research (ESOMAR) questionnaire validated in the Chilean population . The original 6 ESOMAR socioeconomic classes were re-grouped into three classes by combining the two lower, two middle and two higher classes for analysis. Demographic and cultural data (age, attained education, most recent occupation, and ethnicity) were determined using the Chilean Socioeconomic Characterisation Questionnaire . All questionnaire data were collected during in-person interviews.
Data were analysed using STATA (version 11; Statacorp, TX, USA). Accelerometer- and IPAQ-derived values for time or MET-minutes in the different intensity domains were compared by paired t-test, and the bias and variability between the two measurement methods for each intensity domain was determined using a limits of agreement approach . The relationships between accelerometer-derived and IPAQ-reported activity measures were assessed using Pearson correlations (r) and concordance correlation coefficients (Pc). The latter correlation adjusts the r-value using a bias correction factor, which measures how far the best-fit line deviates from the line y = x. Pc therefore provides a composite measure of correlation and agreement between the two measures.
The relationships between activity variables and risk factor levels for the accelerometer-derived and IPAQ reported activity measures were determined in two ways. Firstly, to determine the strength of relationships between activity variables and risk factor levels, β values for the unit change in each risk factor with unit (or unit multiple) change in each accelerometer-derived or IPAQ-reported measure of activity were calculated using general linear regression models, adjusted for age, sex, ethnicity, environment (rural or urban), socio-economic status and smoking. To determine whether the strength of relationships differed between the accelerometer and IPAQ activity measures, the analyses were repeated with the equivalent accelerometer and IPAQ measures both included in the same model (adjusted for the same confounders as above) and the interaction between the accelerometer- vs IPAQ-derived regression lines was assessed. This, in effect, assesses whether the β values for the effects of accelerometer and IPAQ measures on risk factors differed significantly.
Secondly, to determine whether IPAQ-reported and accelerometer-derived activity measures would similarly detect trends for differences in risk factors across the population distribution of physical activity and sedentary time, participants were divided into quartiles for accelerometer-derived MVPA and sedentary time and for IPAQ-reported MVPA and sitting time. General Linear Models were used to determine effects of increasing MVPA or sedentary/sitting time quartile (included in the model as an ordinal variable) on each risk factor, in models adjusted for age, ethnicity, sex, environment (rural or urban), socio-economic status and smoking status. Models for MVPA were then further adjusted for sitting time (for IPAQ) or sedentary time (for accelerometer) and models for sitting/sedentary time were adjusted for MVPA. To determine whether the relationships between MVPA or sedentary/sitting time quartile and risk factors differed between the accelerometer and IPAQ activity measures, the analyses were repeated with the equivalent accelerometer and IPAQ measures for MVPA or sedentary/sitting time both included in the same model (adjusted for the same confounders as above) and the interaction between the accelerometer-derived vs IPAQ-reported relationships were assessed.
Statistical significance was accepted at p<0.05.
Agreement and correlation between accelerometer-derived and IPAQ-reported activity measures
Participants had a wide range of physical activity and sedentary behaviour levels (Table 2, Figure 1). Mean IPAQ-reported sitting time was ∼13% lower than accelerometer-derived sedentary time (p<0.0001). Both the Pearson and concordance correlation coefficients between these two indices of sedentary behaviour were reasonably strong (Figure 1). In contrast, agreement between accelerometer-derived and IPAQ-reported measures of physical activity behaviour was much poorer. IPAQ-reported estimates of moderate activity, vigorous activity and MVPA were 2.6-, 4.0- and 2.6-fold higher, respectively, than the corresponding accelerometer-derived measures of these indices (all p<0.0001). Pearson correlations between accelerometer-derived and IPAQ-reported indices of moderate activity and of MVPA were reasonably strong, but the Pearson correlation between the two vigorous activity measures was modest (Table 2). Concordance correlation coefficients for moderate activity, vigorous activity and MVPA were all weak (Pc≤0.22), reflecting the large divergence of the regression lines for these correlations from the line of equality (Figure 1 illustrates these data for MVPA).
Solid line on each plot represents the linear regression line; dotted line represents the line of equality, y = x. Pearson (r) and concordance (Pc) correlation coefficients shown.
Table 3 shows the ranges for each quartile of sitting/sedentary time (in min.day−1) and MVPA (in MET.min.day−1) for accelerometer-derived and IPAQ-reported activity measures. Notably, there was no overlap in quartile threshold values for accelerometer-derived and IPAQ-reported MVPA: the threshold for the highest quartile (quartile 4) for accelerometer-derived MVPA fell within the range of the lowest quartile (quartile 1) for IPAQ-reported MVPA.
Strength of relationships between IPAQ-reported and accelerometer-derived activity measures and metabolic and vascular disease risk factors
Table 4 shows β coefficients for the change in metabolic and vascular risk factor levels per 100-minute change in accelerometer-derived sedentary or IPAQ-reported sitting time. Figure 2 provides a graphical representation of the sitting/sedentary time vs risk factor relationship for the accelerometer-derived and IPAQ-reported measures, using triglyceride concentration as an illustrative example of the data presented in Table 4. Data and regression lines presented in Figure 2 are for unadjusted data, but β coefficients in Table 4 were adjusted as described in the data analysis section above. For both accelerometer-derived and IPAQ-reported measures, significant positive (negative for HDL cholesterol) β coefficients were observed for all risk factors; in other words increases in sedentary or sitting time were associated with increases in risk factor (or decreases in protective factor) level. For both insulin concentration and HOMAIR there were significant interactions between the linear regression lines for accelerometer-derived vs IPAQ-reported relationships: β coefficients were 54% and 67% larger, for insulin and HOMAIR respectively, for the accelerometer-derived compared to IPAQ-reported measure of sedentary behaviour (p for both interactions <0.0001). The β coefficients did not differ significantly between accelerometer-derived vs IPAQ-reported sitting/sedentary time measures for any other risk factor.
Solid line on each plot represents the linear regression line for accelerometer-derived activity measure; dotted line is the regression line for IPAQ-reported activity measure. Unadjusted data values presented. See Tables 4 and 5 for β coefficients and p-values for regression lines, adjusted for age, sex, ethnicity, environment and socio-economic status and smoking.
Table 5 presents the same data for accelerometer-derived and IPAQ-reported measures of MVPA. Figure 2 shows the MVPA vs triglyceride concentration relationships for accelerometer-derived and IPAQ-reported measures. For the accelerometer-derived measure of MVPA, significant negative β coefficients (positive for HDL cholesterol) were evident for all risk factor measures except blood pressure, demonstrating that increasing MVPA was associated with reductions in metabolic and vascular risk. However, for the IPAQ-reported measure of MVPA, significant negative β coefficients were only evident for HOMAIR, glucose and insulin concentrations. There were significant interactions between the linear regression lines for accelerometer-derived vs IPAQ-reported MVPA relationships for insulin concentration, triglyceride concentration and HOMAIR, with β coefficients being 43%, 50% and 50% greater for the accelerometer-derived compared to IPAQ-reported MVPA measures, respectively. The β coefficients did not differ significantly between accelerometer-derived vs IPAQ-reported MVPA measures for any other risk factor.
Trends in metabolic and vascular disease risk factors across quartiles for IPAQ-reported and accelerometer-derived measures
Table 6 shows risk factor levels for each quartile of accelerometer-derived sedentary time or IPAQ-reported sitting time. As an illustrative example, the data for triglyceride concentrations by quartile of sitting/sedentary time for the accelerometer and IPAQ measures are shown in Figure 3. When the data were analysed in this manner, significant trends to increase risk factor values with increasing time spent in sedentary behaviours were observed for insulin, HOMAIR, triglyceride, BMI and body fat, for both accelerometer-derived and IPAQ-reported measures. A significant negative trend for HDL with increasing sedentary behaviour was evident for both measures. For total and LDL cholesterol, systolic blood pressure and waist circumference significant trends were observed for accelerometer-derived but not IPAQ-reported measures; in other words increases in objectively measured sedentary behaviours but not sitting time were associated with increases in these risk factor levels. No significant trends were found for glucose or diastolic blood pressure for either the accelerometer-derived and IPAQ-reported measures of sedentary behaviour. Further adjustment for MVPA in the models did not alter the significance of any of these findings. There were no significant interactions between the accelerometer-derived sedentary time and IPAQ-reported sitting time vs risk factor trends for any risk factor.
Trends for triglyceride concentration by sitting/sedentary time quartile significant for both accelerometer (p = 0.0001) and IPAQ (p = 0.014) measures. Trends for triglyceride concentration by MVPA quartile significant for the accelerometer (p = 0.022), but not the IPAQ (p = 0.139), activity measure.
Table 7 presents the same data for accelerometer-derived and IPAQ-reported measures of MVPA. Data for triglyceride concentration by quartile of MVPA for the accelerometer and IPAQ measures are also shown in Figure 3. For the accelerometer-derived measure of MVPA, significant negative trends in risk factor levels with increasing MVPA were evident for insulin, HOMAIR, triglyceride, systolic blood pressure and percentage body fat and a positive trend was observed for HDL cholesterol. In other words, increasing MVPA was associated with reductions in metabolic and vascular risk. However, after adjusting the model for sedentary time, only the trends for insulin and HOMAIR remained statistically significant.
In contrast, for the IPAQ-reported data, significant negative trends in risk factor levels with increasing MVPA were only evident for insulin and HOMAIR concentrations. A borderline (p = 0.055) trend towards a decrease in total cholesterol with increasing MVPA was also observed. After adjusting the model for sitting time, the trend to decrease cholesterol with increasing MVPA became statistically significant, but the significant trends for insulin and HOMAIR were lost. To determine whether including walking in the IPAQ-reported MVPA measure influenced these dose-response relationships, the analyses were repeated excluding walking from the IPAQ MVPA measure – i.e. defining MVPA as: minutes of moderate activity (excluding walking)×4.0 METS+minutes of vigorous activity×8.0 METS. This analysis yielded essentially identical results. No significant interactions were observed between the accelerometer-derived and IPAQ-reported MVPA vs risk factor trends for any risk factor.
The main findings of this study were: 1) Compared to objective, accelerometer-derived measures, using the IPAQ to determine activity measures led to significant over-reporting of physical activity and under-reporting of sedentary behaviour. The concordance correlation coefficient for accelerometer-derived vs IPAQ-reported activity measures was reasonably strong for sedentary behaviour (Pc = 0.52, p<0.0001), but much weaker for indices of physical activity (Pc≤0.22 for all measures), indicating that the IPAQ quantified sedentary behaviour more accurately than it quantified physical activity. 2) For some metabolic and vascular disease risk factors, significant trends were observed between amount of sedentary behaviour or MVPA and the risk factor when activity was assessed by IPAQ. However, for other risk factors significant trends with amount of sedentary behaviour or MVPA were only apparent when activity was assessed objectively by accelerometer. In addition, significant interactions were observed for some risk factors (insulin, triglyceride and HOMAIR) in the gradient of the activity vs risk factor regression lines for accelerometer-derived compared to IPAQ-reported activity measures. These data suggest that, compared to the use of objective accelerometry, using the IPAQ to estimate physical activity and sedentary behaviour may result in failure to detect real relationships with metabolic and vascular disease risk factors or in underestimation of the strength of those relationships. 3) Irrespective of the activity measurement method, time spent engaging in sedentary behaviour was more robustly associated with the cardio-metabolic risk profile than time spent undertaking MVPA.
The IPAQ systematically overestimated vigorous activity by ∼8 minutes per day (4-fold), and, when walking was included in the moderate activity domain, overestimated moderate activity by 55 minutes per day – a 2.6-fold difference. However, agreement between accelerometer- and IPAQ-derived indices of sedentary behaviour was somewhat better with a mean difference of 69 minutes per day (∼13%), despite the measures not being directly equivalent (i.e. time spent sitting down vs time at <100 accelerometer counts.min−1). These data suggest that while reports of absolute amounts of physical activity determined by the IPAQ questionnaire should be viewed with caution – a minute of IPAQ-reported physical activity is not equivalent to a minute of accelerometer-derived activity – questionnaire-derived estimates of sedentary time agree reasonably well with the objective measure. The Pearson correlations observed between IPAQ-reported and accelerometer-derived indices of physical activity in the present study were in line with, or slightly higher than, previous reports in the literature –, indicating that the IPAQ performed at least as well in our hands as for others. Thus, the relative differences in the magnitude of dose-response relationships with risk factors between IPAQ-reported and accelerometer-derived activity measures observed in the present study are likely to be broadly transferable to populations beyond that used in the present study.
In the analysis reported here, the relationships between activity variables and risk factor levels were determined in two different ways. Firstly, β-coefficients for the change in risk factor level per unit change in sedentary behaviour or MVPA were calculated for the IPAQ-reported and accelerometer-determined activity measures. This provides a measure of the unit change in risk factor per 100 minute change in sedentary behaviour or per 100 MET.min−1 change (equivalent to 25 minutes of moderate activity) in MVPA. This approach revealed significant relationships between sedentary behaviour and all of the measured risk factors, irrespective of whether sedentary behaviour was assessed by IPAQ or accelerometer. However, the β-coefficients for insulin and HOMAIR were over 50% larger when sedentary behaviour was determined objectively by accelerometer, indicating that using the IPAQ for activity assessment leads to a significant underestimation of the steepness of the dose-response relationship between sedentary behaviour and metabolic risk factors related to insulin resistance. The IPAQ also performed less well for MVPA than it did for sitting time in revealing significant associations with risk factors that were evident when activity was objectively measured. The IPAQ missed significant trends for MVPA that were evident for the accelerometer for total, LDL and HDL cholesterol, triglyceride, BMI, waist circumference and body fat, with only significant trends for glucose, insulin and HOMAIR being detected. Furthermore, the β-coefficients for insulin, triglyceride and HOMAIR were significantly lower for the IPAQ-reported compared to accelerometer-derived MVPA measures. These findings are in broad agreement with the NHANES report which found that the relationships of MVPA with a large number of risk factors were less strong when activity was assessed by questionnaire rather than accelerometer . The present findings extend the NHANES data by presenting data for sedentary behaviour as well as MVPA.
In a separate analysis, the trends for activity measures with risk factors were presented in terms of change in risk factor per quartile change in MVPA or sedentary behaviour within the population, rather than change in risk factor by change in sedentary behaviour or MVPA in terms of absolute units (i.e. per min.day−1 or per MET.min−1.day−1). This approach, in effect, adjusts for any systematic bias in reporting from the questionnaires. For example, the mean reported MET.min.day−1 value for MVPA for IPAQ was 2.6 times the accelerometer-derived MVPA measure, but a consistent 2.6 fold over-reporting of MVPA with the IPAQ compared to the accelerometer measure would have no effect on the population distribution into quartiles of MVPA. Using this approach, the present data revealed that the trends for changes in MVPA/sedentary behaviour across the population distribution with a wide range of vascular and metabolic risk factors were broadly similar – there were no significant interactions with measurement method in the activity vs risk factor relationships for any risk factor – but not all of the significant trends identified when activity was objectively quantified were observed with the IPAQ. This suggests that imprecision of measurement of activity – i.e. regression dilution bias – when using the IPAQ reduced the ability to detect significant trends with some risk factors, but the overall pattern of the activity vs risk factor trends were similar for both measurement approaches. Thus, the relative imprecision of activity measurement by IPAQ could potentially be overcome by studying larger cohorts, but accelerometers offer the advantage of detecting significant trends with risk factors in smaller numbers of individuals, when activity variables are expressed in terms of position in the population distribution. However, while this analytical approach is useful in determining general trends between activity and risk factors, it does have the clear limitations of being unable of providing absolute activity values to quantify the dose-response relationships, as well as having less statistical power than when activity behaviour is considered as a continuous variable.
The observation that the dose-response relationship between activity measures and some risk factors is quantitatively different between self-reported and objectively measured activity is an important consideration when formulating guidelines for physical activity. Current physical activity guidelines, which were largely based on evidence from self-report activity measures, recommend that adults undertake 150 minutes of moderate intensity physical activity or 60–75 minutes of vigorous activity per week to maintain and improve health , . The present findings suggest that the amounts of activity required for good health are likely to be lower for objectively measured (compared to reported) activity, an issue which has been alluded to by others , , . Indeed, accelerometer-derived measures of physical activity are consistently lower than values obtained from self-reported data . Thus, it is important that objective activity monitoring methods are used in the epidemiological studies to determine the optimal activity levels for guidelines as well as in surveillance of activity levels within the population. Using objective measures to assess compliance with guidelines that were based on evidence from self-reported activity, risks providing an inaccurate picture of the proportion of the population who are insufficiently active, which can have important implications with respect to formulation of physical activity policy.
It is of interest that sedentary behaviour was more consistently associated with vascular and metabolic risk factor levels than MVPA was. The difference was most evident for the IPAQ-reported activity measures (12 vs 3 significant β-coefficients with risk factors for sitting time vs MVPA), so may reflect in part the fact that the IPAQ quantifies sedentary behaviour more accurately than MVPA. However, the effect was still evident, albeit to a lesser extent, for accelerometer-derived measures (12 vs 10 significant β-coefficients). Furthermore, adjusting the sedentary behaviour vs risk factor trends for MVPA did not alter the strength of association. A number of significant trends for MVPA vs risk factor were lost after adjustment for sedentary behaviour, even for accelerometer-derived activity measures, suggesting that this is a real biological effect and not simply a consequence of measurement error. This observation is in agreement with other published data revealing a larger effect of sedentary behaviour than physical activity on a number of vascular and metabolic risk factors , , although this is not an unequivocal finding . Nevertheless, the present findings add to the growing literature highlighting the important influence of sedentary behaviour on indices of vascular and metabolic health.
A particular strength of this study is that the study population was diverse. Participants were men and women, with a wide range of educational and socioeconomic backgrounds and spanned a wide range of activity levels. Mean activity levels in the present cohort were higher than in NHANES, which represented a nationally representative sample for the US, and half the cohort lived in rural settings. Our findings were robust to adjustment for age, sex, ethnicity, environment and socio-economic status, and thus should be generalisable across a wide demographic range and particularly to populations outside the US where physical activity levels may be higher. This is also the first study to compare the effects of objective vs subjective measurements of sedentary time on the dose-response relationship with vascular and metabolic risk factors. However, while we showed good agreement between the accelerometer-derived and IPAQ-reported sedentary time measures, it is important to recognise the <100 accelerometer counts per minute is not exactly the same as time spent sitting down, as the former measure can also include standing and some very low intensity upright activities (such as swaying). It has been suggested that contractions in postural muscles elicited by standing may confer some metabolic benefit compared to sitting , thus the potential inclusion of standing activities in our accelerometer-derived sedentary behaviour measure could conceivably have attenuated the apparent risk factor dose-response relationships. Further study, using inclinometers, comparing the risk factor dose-response relationships for objectively- and questionnaire-assessed sitting time is needed to address this issue.
In conclusion, the findings of this study indicate that using IPAQ to determine physical activity or sitting time reveals a number of significant trends with metabolic and vascular disease risk factors. However, the IPAQ missed some significant trends that were evident when activity was objectively assessed, particularly for MVPA, and led to underestimation of the strength of some relationships between activity and risk factors. Thus, a degree of caution is advised when using activity measurements obtained from the IPAQ to quantify dose-response relationships for activity and risk factors for metabolic and vascular disease.
Conceived and designed the experiments: CACM FPB MESB JMRG. Performed the experiments: CACM FPB LI CS. Analyzed the data: CACM MESB JMRG. Wrote the paper: CACM MESB JMRG.
- 1. Gill JM, Cooper AR (2008) Physical activity and prevention of type 2 diabetes mellitus. Sports Med 38: 807–824.
- 2. Nocon M, Hiemann T, Muller-Riemenschneider F, Thalau F, Roll S, et al. (2008) Association of physical activity with all-cause and cardiovascular mortality: a systematic review and meta-analysis. Eur J Cardiovasc Prev Rehabil 15: 239–246. 10.1097/HJR.0b013e3282f55e09 [doi];00149831-200806000-00001 [pii].
- 3. Gill JM, Bhopal R, Douglas A, Wallia S, Bhopal R, et al. (2011) Sitting Time and Waist Circumference Are Associated With Glycemia in U.K. South Asians: Data from 1,228 adults screened for the PODOSA trial. Diabetes Care 34: 1214–1218. dc10-2313 [pii];10.2337/dc10-2313 [doi].
- 4. Katzmarzyk PT, Church TS, Craig CL, Bouchard C (2009) Sitting time and mortality from all causes, cardiovascular disease, and cancer. Med Sci Sports Exerc 41: 998–1005. 10.1249/MSS.0b013e3181930355 [doi];00005768-200905000-00005 [pii].
- 5. Dunstan DW, Barr EL, Healy GN, Salmon J, Shaw JE, et al. (2010) Television viewing time and mortality: the Australian Diabetes, Obesity and Lifestyle Study (AusDiab). Circulation 121: 384–391. CIRCULATIONAHA.109.894824 [pii];10.1161/CIRCULATIONAHA.109.894824 [doi].
- 6. Hu FB, Leitzmann MF, Stampfer MJ, Colditz GA, Willett WC, et al. (2001) Physical activity and television watching in relation to risk for type 2 diabetes mellitus in men. Arch Intern Med 161: 1542–1548.
- 7. Hu FB, Li TY, Colditz GA, Willett WC, Manson JE (2003) Television watching and other sedentary behaviors in relation to risk of obesity and type 2 diabetes mellitus in women. JAMA 289: 1785–1791. 10.1001/jama.289.14.1785 [doi];289/14/1785 [pii].
- 8. Terwee CB, Mokkink LB, van Poppel MN, Chinapaw MJ, van MW, et al. (2010) Qualitative attributes and measurement properties of physical activity questionnaires: a checklist. Sports Med 40: 525–537. 1 [pii];10.2165/11531370-000000000-00000 [doi].
- 9. Lagerros YT, Lagiou P (2007) Assessment of physical activity and energy expenditure in epidemiological research of chronic diseases. Eur J Epidemiol 22: 353–362. 10.1007/s10654-007-9154-x [doi].
- 10. Haskell WL, Lee IM, Pate RR, Powell KE, Blair SN, et al. (2007) Physical activity and public health: updated recommendation for adults from the American College of Sports Medicine and the American Heart Association. Med Sci Sports Exerc 39: 1423–1434.
- 11. Department of Health (2011) Start Active, Stay Active: a report on physical activity for health from the four home countries' Chief Medical Officers 1–59.
- 12. Shephard RJ (2003) Limits to the measurement of habitual physical activity by questionnaires. Br J Sports Med 37: 197–206.
- 13. van Poppel MN, Chinapaw MJ, Mokkink LB, van MW, Terwee CB (2010) Physical activity questionnaires for adults: a systematic review of measurement properties. Sports Med 40: 565–600. 3 [pii];10.2165/11531930-000000000-00000 [doi].
- 14. Craig CL, Marshall AL, Sjostrom M, Bauman AE, Booth ML, et al. (2003) International physical activity questionnaire: 12-country reliability and validity. Med Sci Sports Exerc 35: 1381–1395.
- 15. Hagstromer M, Oja P, Sjostrom M (2006) The International Physical Activity Questionnaire (IPAQ): a study of concurrent and construct validity. Public Health Nutr 9: 755–762.
- 16. Rosenberg DE, Bull FC, Marshall AL, Sallis JF, Bauman AE (2008) Assessment of sedentary behavior with the International Physical Activity Questionnaire. J Phys Act Health 5: Suppl 1S30–S44.
- 17. Frost C, Thompson SG (2000) Correcting for regression dilution bias: comparison of methods for a single predictor variable. J R Statist Soc A 163: 173–189.
- 18. Atienza AA, Moser RP, Perna F, Dodd K, Ballard-Barbash R, et al. (2011) Self-reported and objectively measured activity related to biomarkers using NHANES. Med Sci Sports Exerc 43: 815–821. 10.1249/MSS.0b013e3181fdfc32 [doi].
- 19. Fan AZ, Ham SA, Muppidi SR, Mokdad AH (2009) Validation of reported physical activity for cholesterol control using two different physical activity instruments. Vasc Health Risk Manag 5: 649–661.
- 20. Celis-Morales CA, Perez-Bravo F, Ibanes L, Sanzana R, Hormazabal E, et al. (2011) Insulin resistance in Chileans of European and Indigenous descent: evidence for an ethnicity x environment interaction. PLoS ONE 6: e24690.
- 21. Freedson PS, Melanson E, Sirard J (1998) Calibration of the Computer Science and Applications, Inc. accelerometer. Med Sci Sports Exerc 30: 777–781.
- 22. Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, et al. (2008) Physical activity in the United States measured by accelerometer. Med Sci Sports Exerc 40: 181–188. 10.1249/mss.0b013e31815a51b3 [doi].
- 23. Hagstromer M, Oja P, Sjostrom M (2007) Physical activity and inactivity in an adult population assessed by accelerometry. Med Sci Sports Exerc 39: 1502–1508. 10.1249/mss.0b013e3180a76de5 [doi];00005768-200709000-00010 [pii].
- 24. Marfell-Jones M, Olds T, Stewart A, Carter L (2006) International standards for anthropometric assessment. Potchefstroom: ISAK. 133 p.
- 25. Durnin JVGA, Womersley J (1974) Body fat assessed from total body density and its estimation from skinfold thickness: measurements on 481 men and women aged from 16 to 72 years. British Journal of Nutrition 32: 77–97.
- 26. El Assaad MA, Topouchian JA, Asmar RG (2003) Evaluation of two devices for self-measurement of blood pressure according to the international protocol: the Omron M5-I and the Omron 705IT. Blood Press Monit 8: 127–133. 10.1097/01.mbp.0000087393.96145.b1 [doi].
- 27. Friedewald WT, Levy RI, Fredrickson DS (1972) Estimation of the concentration of low-density lipoprotein cholesterol in plasma, without use of the preparative ultracentrifuge. Clin Chem 18: 499–502.
- 28. ESOMAR (1997) The ESOMAR Standard Demographic Classification. A System of International Socio-Economic Classification of Respondents to Survey Research. In: Hoffmeyer-Zlotnik JHP, Wolf C, editors. Advances in Cross-National Comparison. A European Working Book for Demographic and Socio-Economic Variables. New York: Kluwer Academic/Plenum Publishers. pp. 97–121.
- 29. National Socioeconomic Survey (2006) Poll of Quality of Life in Households. Santiago: Ministry of Planning, Government of Chile. 42 p.
- 30. Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8: 135–160.
- 31. Troiano RP (2007) Large-scale applications of accelerometers: new frontiers and new questions. Med Sci Sports Exerc 39: 1501. 10.1097/mss.0b013e318150d42e [doi];00005768-200709000-00009 [pii].
- 32. Healy GN, Wijndaele K, Dunstan DW, Shaw JE, Salmon J, et al. (2008) Objectively measured sedentary time, physical activity, and metabolic risk: the Australian Diabetes, Obesity and Lifestyle Study (AusDiab). Diabetes Care 31: 369–371. dc07-1795 [pii];10.2337/dc07-1795 [doi].
- 33. Ekelund U, Brage S, Griffin SJ, Wareham NJ (2009) Objectively measured moderate- and vigorous-intensity physical activity but not sedentary time predicts insulin resistance in high-risk individuals. Diabetes Care 32: 1081–1086. dc08-1895 [pii];10.2337/dc08-1895 [doi].
- 34. Hamilton MT, Hamilton DG, Zderic TW (2007) Role of low energy expenditure and sitting in obesity, metabolic syndrome, type 2 diabetes, and cardiovascular disease. Diabetes 56: 2655–2667. db07-0882 [pii];10.2337/db07-0882 [doi].