Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Predicting ambulatory energy expenditure in lower limb amputees using multi-sensor methods

  • Peter Ladlow,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Writing – original draft

    Affiliations Department for Health, University of Bath, Bath, United Kingdom, Academic Department of Military Rehabilitation, Defence Medical Rehabilitation Centre (DMRC) Headley Court, Surrey, United Kingdom

  • Tom E. Nightingale,

    Roles Formal analysis, Methodology, Validation, Writing – review & editing

    Affiliation Department for Health, University of Bath, Bath, United Kingdom

  • M. Polly McGuigan ,

    Contributed equally to this work with: M. Polly McGuigan, Alexander N. Bennett, Rhodri D. Phillip

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Department for Health, University of Bath, Bath, United Kingdom

  • Alexander N. Bennett ,

    Contributed equally to this work with: M. Polly McGuigan, Alexander N. Bennett, Rhodri D. Phillip

    Roles Conceptualization, Methodology, Resources, Supervision, Writing – review & editing

    Affiliations Academic Department of Military Rehabilitation, Defence Medical Rehabilitation Centre (DMRC) Headley Court, Surrey, United Kingdom, National Heart and Lung Institute, Faculty of Medicine, Imperial College London, London, United Kingdom

  • Rhodri D. Phillip ,

    Contributed equally to this work with: M. Polly McGuigan, Alexander N. Bennett, Rhodri D. Phillip

    Roles Conceptualization, Project administration, Resources, Supervision, Writing – review & editing

    Affiliation Academic Department of Military Rehabilitation, Defence Medical Rehabilitation Centre (DMRC) Headley Court, Surrey, United Kingdom

  • James L. J. Bilzon

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    J.Bilzon@Bath.ac.uk

    Affiliation Department for Health, University of Bath, Bath, United Kingdom

Abstract

Purpose

To assess the validity of a derived algorithm, combining tri-axial accelerometry and heart rate (HR) data, compared to a research-grade multi-sensor physical activity device, for the estimation of ambulatory physical activity energy expenditure (PAEE) in individuals with traumatic lower-limb amputation.

Methods

Twenty-eight participants [unilateral (n = 9), bilateral (n = 10) with lower-limb amputations, and non-injured controls (n = 9)] completed eight activities; rest, ambulating at 5 progressive treadmill velocities (0.48, 0.67, 0.89, 1.12, 1.34m.s-1) and 2 gradients (3 and 5%) at 0.89m.s-1. During each task, expired gases were collected for the determination of and subsequent calculation of PAEE. An Actigraph GT3X+ accelerometer was worn on the hip of the shortest residual limb and, a HR monitor and an Actiheart (AHR) device were worn on the chest. Multiple linear regressions were employed to derive population-specific PAEE estimated algorithms using Actigraph GT3X+ outputs and HR signals (GT3X+HR). Mean bias±95% Limits of Agreement (LoA) and error statistics were calculated between criterion PAEE (indirect calorimetry) and PAEE predicted using GT3X+HR and AHR.

Results

Both measurement approaches used to predict PAEE were significantly related (P<0.01) with criterion PAEE. GT3X+HR revealed the strongest association, smallest LoA and least error. Predicted PAEE (GT3X+HR; unilateral; r = 0.92, bilateral; r = 0.93, and control; r = 0.91, and AHR; unilateral; r = 0.86, bilateral; r = 0.81, and control; r = 0.67). Mean±SD percent error across all activities were 18±14%, 15±12% and 15±14% for the GT3X+HR and 45±20%, 39±23% and 34±28% in the AHR model, for unilateral, bilateral and control groups, respectively.

Conclusions

Statistically derived algorithms (GT3X+HR) provide a more valid estimate of PAEE in individuals with traumatic lower-limb amputation, compared to a proprietary group calibration algorithm (AHR). Outputs from AHR displayed considerable random error when tested in a laboratory setting in individuals with lower-limb amputation.

Introduction

Individuals who experience traumatic lower-limb amputation have been shown to be at increased risk of developing cardiometabolic diseases [13]. Reducing the development of unfavourable body composition changes [46] and the secondary health conditions associated with obesity, such as cardiovascular disease and type 2 diabetes mellitus [13], is a primary objective in the long-term recovery of individuals with lower-limb amputation. It is well established that the higher the level of amputation (above knee versus below knee) and the greater number of lower-limbs amputated (bilateral versus unilateral) are associated with a higher metabolic cost of walking and reduced ambulatory physical activity (PA) [79]. However, little is known about the consequences of amputation severity on habitual PA levels or ambulatory physical activity energy expenditure (PAEE). Consequently, PA requirements for the maintenance or improvement of metabolic health and protection against chronic degenerative diseases, is poorly understood in this population. Severe lower-limb injuries have also been associated with high levels of mental health disorders, such as moderate to severe depression (38%) and anxiety (29%) [10]. Strategies to mitigate the risk or managing these conditions are of upmost importance. Exercise and PA interventions aimed at improving function, health and wellbeing in individuals with amputation may benefit from the use of objective PA measurements.

Criterion or ‘gold standard’ measures of energy expenditure (i.e. indirect calorimetry and doubly labelled water) are highly accurate, but relatively expensive, requiring sophisticated equipment rendering them impractical to use outside of the laboratory when assessing free-living PA. The ability to detect subtle or large variances in the duration spent at different PA levels during free-living conditions, patterns of PAEE (morning, afternoon, evening) and exercise intensity are not possible using doubly labelled water technique (only total energy expenditure) during a monitoring period. Pedisic and Bauman [11] suggested that accelerometer-assessed PAEE, using algorithms intrinsic to certain devices may not be generalizable to a target population, an important consideration for individuals predisposed to significant gait deficiencies such as individuals with lower-limb amputation [12, 13]. Therefore, the logical first step prior to using objective devices in surveillance research is to ensure that the method has been validated in the population of interest.

Research in the area of assessing PA in individuals with amputation has previously relied on subjective amputation specific self-reported questionnaires [14, 15] in conjunction with objective measures of functional mobility (e.g. step count and timed up and go). Limitations to using self-reported measures of PA are well-known and include inaccurate subjective reporting and recall bias [16]. A systematic review [17] of instruments used for the assessment of PA in individuals with amputation demonstrated that most instruments are not specific enough for the population (i.e. they do not account for the loss of articular structures and sensory/motor function in the lower-extremity) [18]. Therefore, previous instruments have been unable to discriminate for the known differences in PAEE between persons with and without lower-limb amputation, thereby potentially underestimating the ‘actual’ PA levels of this population. Having access to an objective measurement of PAEE can facilitate our understanding of a number of other clinically important areas with greater accuracy than we might have had before. Recently, our group demonstrated that the Actigraph GT3X+ accelerometer, worn at the hip on the shortest residual limb, provides a valid estimation of PAEE in individuals with unilateral and bilateral traumatic lower-limb amputation [19]. However, accelerometry data alone doesn’t capture the physiological strain associated with certain ambulatory behaviours, such as walking up a gradient [20]. While this initial exploration into the objective measurement of PAEE in individuals with amputation is positive, multi-sensor devices, incorporating physiological signals, might offer a greater improvement in prediction accuracy [21]. Heart rate is known to be a valuable physiological signal in the estimation of energy expenditure due to its near linear relationship, also the relative success of using the Physiological Cost Index (PCI) in quantifying energy expenditure among individuals with lower limb amputation [22, 23].

Wearable PA monitors (e.g. Fitbit, Microsoft Band and Apple Watch) are growing in popularity and provide an opportunity for large numbers of the public to self-monitor their own PA behaviours [24]. Albert et al. [25] performed a feasibility study monitoring daily function in persons with trans-femoral amputations using a commercial activity monitor (Fitbit). They found that this monitor has the potential to be used to assess the PA levels of people with lower-limb amputation. However, commercially available activity monitors have not been specifically validated in individuals with amputation, which is a concern for using such multi-sensor devices in this population.

The Actiheart (AHR) is a research-grade multi-sensor device which incorporates heart rate (HR) and accelerometry measurements to predict PAEE [26]. It has been widely used to measure free-living PA in able-bodied individuals but further research in diverse populations, such as individuals with amputation, is warranted. It is unknown whether the proprietary predictive algorithms of the AHR can accurately predict ambulatory PAEE in persons who have experienced amputation. It is also unknown whether the combination of Actigraph GT3X+ accelerometer and HR data (GT3X+HR) could be used to derive a predictive algorithm with comparable or superior accuracy for the estimation of PAEE. This study aims to test the hypothesis that a bespoke algorithm (GT3X+HR) would demonstrate greater validity and lower random error in predicting PAEE in persons with lower-limb amputations, compared with the proprietary predictive algorithms of the AHR device.

Materials and methods

Research ethics approval

Ethical approval was granted by the United Kingdom Ministry of Defence Research Ethics Committee (MODREC) and written informed consent was obtained from each participant.

Sample size

An a priori power calculation was performed based on data from a previous study in spinal cord injured humans [27]. It was estimated that a minimum of 8 participants would be required to detect a statistically significant difference in mean absolute error between the ActiheartTM propietry predictive algorithms (mean absolute error 51.4±38.9%) and a bespoke individually calibrated algorithm (mean absolute error 16.8±15.8%), giving an estimated effect size of (Cohen d) of 1.0. The power was set at 0.8 and the alpha at 0.05. Given the distinct challenges in recruiting and retaining participants from unique clinical populations, we anticipated a ~20% drop-out rate and aimed to recruit 10 participants per group to achieve a final sample of at least 8.

Participants

A final sample of UK military personnel with traumatic unilateral (n = 9) and bilateral (n = 10) lower-limb amputation/s and nine non-injured healthy male controls volunteered to participate in this study. All participants were male and visited the Military Performance and Rehabilitation Laboratory (MPARL) at the Defence Medical Rehabilitation Centre (DMRC), Headley Court, one morning after a 10 hour overnight fast (including abstinence from caffeine and physical activity). Inclusion criteria included all injured participants having experienced traumatic amputation and had previously received at least three 4-week admissions of intensive exercise rehabilitation at DMRC Headley Court from an interdisciplinary team of health professionals [28]. All patients received a prosthetic fitting prior to commencing the trial and had been given clearance to ambulate on a treadmill by their physiotherapist. Exclusion criteria were based upon the participant's medical history (screened by their physician). This includes severe traumatic brain injury, medication that alters heart rate variability, and any mobility restricting conditions, such as painful heterotopic ossification or insufficient wound healing around the stump. The control group are non-injured physically active men (civilian and military who engage in aerobic or resistance based training at least three times per week). The clinical population being tested are all UK military personnel with traumatic lower-limb amputation/s who (pre-injury) would have been active non-injured adults. By using an age-matched active male adult population as a control we are able to comment on the impact of losing a limb and the ability of proprietary algorithms ability to detect such a change against normative activity data from their non-injured peers.

Indirect calorimetry

Participants wore a sealed face mask and expired gases were analysed using a portable metabolic system (Metamax 3B, Cortex, Leipzig, Germany), which has good accuracy compared to other portable metabolic systems [29]. Expired gases passed through a flow meter and are channelled down a sampling line into the analyser unit where the fractions of O2 and CO2 in expired gases are measured. Metabolic data were retrieved and analysed using the Metamax software. steady state can be achieved within 3 minutes [30]. Oxygen uptake () and carbon dioxide production (CO2) were used to estimate energy expenditure (kcal·min-1) during the final two minute of each five minute activity. The Metamax was calibrated according to manufacturer’s instructions prior to use.

Activity monitors.

Participants wore an AHR monitor (Actiheart, Cambridge Neurotechnology Ltd, UK), which integrates accelerometer and HR signals to derive PAEE. The unit was fitted using two adhesive ECG chest electrodes, according to the manufacturer’s instructions. The AHR unit has been described previously [26]. AHR devices were initialised to long-term recording with 30 second epochs at a sampling frequency of 32 Hz. PAEE was calculated using Branched Model equations [31].

An Actigraph GT3X+ tri-axial accelerometer (Actigraph, Pensacola, FL, USA) was worn around the waist, above the hip (along the anterior axillary line) on the side of the shortest residual limb, as recommended by Ladlow et al. [19], using an elasticated belt. Following the Nyquist principle, the devices were initialised with a sampling frequency of 30 Hz, thereby allowing the capture of general human movement [32] and a similar sampling frequency to the AHR monitor. The componentry and capabilities of the Actigraph GT3X+ are described elsewhere. [33] A Polar T31 HR monitor (Polar Electro Inc., Lake Success, NY, USA) was firmly secured on the chest using an elastic strap and ultrasound gel was applied to the electrodes to improve the connection. HR transmitted by the Polar T31 was captured by a wireless receiver module connected to the Metamax 3B.

Testing protocol.

The testing protocol is described in more detail elsewhere [19]. The Metamax 3B and the two activity monitors were synchronised before use and a Polar HR monitor was worn throughout the protocol. Resting metabolic rate (RMR; kcal·day-1) was measured between 08–00 to 09:00 in a semi-recumbent position in accordance with best practice guidelines [34]. Following the measurement of RMR and anthropometric assessment (i.e. body stature, body mass, waist and hip circumference), participants completed a walking protocol on a treadmill (Woodway Desmo, USA). This protocol consisted of ambulating at 5 progressive velocities 0.48, 0.67, 0.89, 1.12, 1.34 m.s-1 (1, 1.5, 2, 2.5 and 3 mph) and 2 gradients (3% and 5%) at 0.89 m.s-1 (2 mph). Each activity lasted 5-minutes with no recovery between each velocity. Participants were asked to complete the entire protocol without resting their arms on the handrail. Participants were told to stop if they experience residuum pain, prosthetic discomfort or difficulty maintaining the speed of the treadmill belt to a point where they felt they were at risk of falling.

PCI was calculated as the quotient of difference in working and resting heart rates and walking speed respectively self-selected (comfort) walking speed. The PCI value reflects the increased heart rate required for walking and is expressed as heart rate per metre by formula [22]:

PCI = [mean HR at work – mean HR at rest] / walking velocity (m.min-1)

Using the mean HR data from the final 2 minutes of each activity, we have modified this PCI equation using pre-determined velocities on the treadmill as oppose to comfortable self-selected walking speed as recommended by MacGregor [35].

Statistical analyses.

Expired gas data were exported into Microsoft Excel from the Metamax 3B software. PAEE was then calculated using the and CO2 values (L·min-1), averaged over the final 2-min of each activity using the Weir equation [36]. As participants were fasted, dietary-induced thermogenesis was considered negligible and criterion PAEE was calculated by subtracting RMR (kcal·min-1) from total energy expenditure. Predicted PAEE was derived for both methods: GT3X+HR, by combining tri-axial accelerometer counts from the GT3X+ with HR using regression methods and; AHR, from the Actiheart software. Data from both derived methods were compared against criterion PAEE during the final two minutes of each activity (representative of steady-state).

AHR data was ascertained via entering the measured RMR (via indirect calorimetry), age, weight, height and sleeping HR (measured the night before testing) into the Actiheart software (Version 4.0.23), according to the manufacturer’s instructions. The GT3X+ accelerometer unit was downloaded using the ActiLife software (ActiGraph, Pensocola, FL, USA). PAC (counts·min-1) from the GT3X+, Polar HR (bpm) and AHR readings (kcal·min-1) were then averaged over the final two minutes of each activity. PAEE estimation models for the GT3X+HR were developed using corresponding data from each task, using multiple linear regression analyses. The dependent variable was indirect calorimetry PAEE (kcal·min-1). The independent variables were PAC (counts·min-1) from the GT3X+ with HR (bpm). Pearson product moment correlation coefficients (r) and coefficients of determination (R2) statistics were conducted to assess the association between the criterion PAEE and predicted PAEE for GT3X+HR, HR and AHR (AHR data; using proprietary group calibration). Standard Error of the Estimate (SEE) statistics was also calculated for each relationship. Ideally the population specific equation (GT3X+HR) would have been cross-validated using an independent sample. However, this is not always possible in hard to recruit populations, such as individuals with lower-limb amputations. Therefore, we adopted a leave-one-out ‘bootstrapping’ analysis [37], as performed and reported previously by Nightingale et al. (2015) [38].

Error statistics involved calculating the mean absolute error, mean absolute percentage error and mean signed error for each activity (displayed graphically using modified box and whisker plots), Bland-Altman plots with 95% limits of agreement analysis and root mean squared error (RMSE) displayed S1 Table. One-way ANOVA tests by group were performed with post-hoc Bonferroni corrections applied when comparing across 8 activities (rest, five progressive treadmill speeds and 2 gradients). Statistical significance was set a priori of P<0.05. All analyses were performed using IBM SPSS Statistics 21 for Windows (IBM, Armonk, NY, USA).

Results

Demographic and anthropometric characteristics of the participants are described in Table 1. Criterion PAEE (kcal·min-1), GT3X+ accelerometer outputs, HR, AHR, and METs are displayed in Table 2. Mean criterion PAEE, GT3X+ PAC, HR, AHR PAEE, RPE and METs all increased with increasing treadmill velocity in the unilateral and control groups. In the bilateral group, between six and eight participants were unable to complete activities at the higher treadmill velocities and gradients, three individuals in the unilateral group were unable to complete the highest ambulatory velocity (1.34 m.s-1) which influenced the mean criterion values. There was a significant main effect in criterion PAEE, GT3X+ predicted PAEE, Actiheart, HR, METs and PCI in all groups (See Table 2 and S2 Table). In both amputation groups and control participants, the GT3X+HR model demonstrated the strongest relationships, smallest limits of agreement (LoA) (Table 3), mean absolute percentage errors and RMSE, compared to AHR (S1 Table).

thumbnail
Table 1. Demographic and anthropometric characteristics of the participants.

https://doi.org/10.1371/journal.pone.0209249.t001

thumbnail
Table 2. Measured PAEE, accelerometer outputs at each anatomical location, calculated METs, RPE and number of participants for each activity (mean ± SD).

https://doi.org/10.1371/journal.pone.0209249.t002

thumbnail
Table 3. The relationships between the three devices of the Actigraph GT3X+ with HR, HR alone Actiheart against criterion PAEE in all groups.

Limits of agreement (LoA) expressed as mean ± 95% SD.

https://doi.org/10.1371/journal.pone.0209249.t003

Across all treadmill walking tasks, the HR response in individuals with unilateral amputation was 1.3 to 1.5 times greater than the physically active control group. At treadmill speeds between 1 to 2mph and a gradient of 3% at 2 mph, the HR response of individuals with bilateral amputation was 1.5 to 1.7 times greater than control participants. At these same walking speeds the HR of the bilateral amputation group was between 1.1 to 1.3 times greater than the group with unilateral amputation. These differences in HR increase linearly with increases in treadmill intensity (Table 2). The mean PCI across all velocities for each group ranged from 0.67 to 1.01, 1.03 to 1.45 and 0.38 to 0.61 in the unilateral, bilateral and control group, respectively.

The population specific equations (GT3X+HR) to predict ambulatory PAEE are described below:

Unilateral amputation: PAEE = (0.000453*PAC) + (0.045487*HR) - 2.713284

Bilateral amputation: PAEE = (0.000658*PAC) + (0.025308*HR) - 1.795157

Controls: PAEE = (0.000550*PAC) + (0.036472*HR) - 1.797866

The relationships between criterion PAEE and predicted PAEE, derived from GT3X+HR and AHR, are presented as scatter plots in Fig 1. Fig 2 illustrates the mean bias and 95% limits of agreement (LoA) differences, when comparing the criterion PAEE data with estimated PAEE derived from population specific prediction models (GT3X+HR) and the proprietary group calibration algorithm of the AHR. When comparing both methods across all groups the GT3X+HR demonstrates the smallest LoA and the AHR shows the greatest LoA. When comparing populations, the control group demonstrate the smallest LoA and the bilateral group demonstrate the largest LOA for both GT3X+HR and AHR methods (Table 3).

thumbnail
Fig 1. Scatterplots showing the relationship between estimated and criterion PAEE.

Estimated PAEE from GT3X+ with heart rate and criterion PAEE (A, C, E). Estimated PAEE from the Actiheart and criterion PAEE (B, D, F). The scatterplots show the unilateral amputation group (A, B), bilateral amputation group (C, D) and the non-injured control group (E, F). The straight line represents the models best fit, and the dotted line indicates the line of identity.

https://doi.org/10.1371/journal.pone.0209249.g001

thumbnail
Fig 2.

Bland and Altman plots for the criterion and predicted PAEE using the GT3X+ with heart rate estimation models (A, C, E), and criterion and predicted PAEE using the Actiheart (B, D, F). The plots show the unilateral group (A, B), bilateral group (C, D) and non-injured control group (E, F). The straight line demonstrates the mean and the dotted line indicates the 95% Limits of Agreement (LoA).

https://doi.org/10.1371/journal.pone.0209249.g002

Fig 3 demonstrates modified box and whisker plots depicting the mean percentage error of estimation relative to criterion for each treadmill activity using the cross validated, GT3X+HR model against the pre-determined algorithm used in the AHR device. Error statistics between the criterion and predicted PAEE from the GT3X+HR model, HR alone and AHR for each treadmill task are shown in S1 Table.

thumbnail
Fig 3.

Modified box and whisker plots demonstrating the mean percentage error of estimation relative to criterion for each treadmill activity using GT3X+ with heart rate estimation models (A, C, E), and Actiheart (B, D, F). The plots show the unilateral group (A, B), bilateral group (C, D) and control group (E, F).

https://doi.org/10.1371/journal.pone.0209249.g003

Participants were asked to complete 35 minutes of walking in total. Participants reasoning for discontinuing with the trial were not asked. However, a large proportion of participants stated an uncomfortable stump due to repeated impact and friction inside their socket. For individuals with transfemoral bilateral amputation the inability to walk quickly enough in their prosthesis without the risk of falling was also reported. Discontinuing with the trial due to excessive physical exertion or fatigue was less common, as demonstrated by the RPE scores in Table 2. The RER values during the walking tasked range from a mean 0.76 ± 0.04 to 0.86 ± 0.05 and 0.78 ± 0.04 to 0.93 ± 0.02 in the unilateral and bilateral amputation groups respectively. RER values ranged from 0.78 ± 0.03 to 0.84 ± 0.04 in the control group.

Discussion

This study is a controlled laboratory validation study to assess the accuracy of a research grade multi-sensor device (AHR) and a population specific manually derived equation, which incorporated both HR and PAC (GT3X+HR), to predict ambulatory PAEE in individuals lower-limb amputation/s. Furthermore, we were able to assess the validity of these methods on both unilateral and bilateral lower-limb amputation groups, to assess the generalizability of these methods across this specific population. Of the two multi-sensor activity methods considered in this study, these data indicate the GT3X+HR model, integrating accelerometry data from an Actigraph GT3X+ worn at the hip of the shortest residual limb, with HR data, provided the most valid estimation of ambulatory PAEE in both amputation groups. HR signals alone produced superior accuracy for the estimation of PAEE than the AHR device. Therefore, the proprietary group calibration algorithm, intrinsic to the AHR, has lower validity when predicting PAEE in individuals with unilateral or bilateral transtibial and transfemoral amputations, potentially because the algorithms are not optimized for this population. The results of this study also demonstrate that level of amputation impacts on the ability to accurately predict PAEE, with all multi-sensor methods displaying greater LoA and SEE values in unilateral versus control and in bilateral versus unilateral (Table 3).

HR has benefits as a physiological variable as it increases linearly and proportionately with exercise intensity and thus metabolic rate [32]. HR alone in this study explains 79%, 77% and 71% of the variance in the unilateral, bilateral and control group respectively. The reason HR may have performed so well is because it is highly individualised to the groups of interest and the task intensities were linear in nature. As HR at lower exercise intensities is affected by other factors, such as psychological or thermal stress, it would be intuitive to hypothesise that the integration of acceleration values may offer a more reliable estimation of PAEE. The findings of this current study demonstrate evidence of this when combined with the PAC from the GT3X+. However, the AHR, a multi-sensor device which uses proprietary group calibration algorithms intrinsic to the device, explains less of the variance and demonstrates greater error in the estimation of ambulatory PAEE than HR alone. The proprietary equations, derived from Brage et al. (2004) [31] and utilised here were designed to predict EE during ambulation in able-bodied healthy adults, not those with lower-limb impairments or significant gait abnormalities. The AHR uses a uni-axial accelerometer unlike the GT3X+ which is a tri-axial accelerometer, uni-axial accelerometers have been shown to have less sensitivity when predicting PAEE [39]. It is also known that the anatomical location of an accelerometer is important in the accuracy of measuring PAEE [19, 40]. The anatomical locations of the monitors used in this study are not comparable, as the AHR device was worn on the chest whilst the GT3X+ was worn on the hip of the shortest residual limb. It may be that there is reduced sensitivity with accelerometers being worn at the chest compared to hip during ambulatory movements. The activity protocol adopted in this study captured a wide range of walking speeds, which are representative of the exercise intensities for lower-limb amputation groups undergoing in-patient rehabilitation. The relative exercise intensities were consequently much lower for healthy able-bodied controls (Table 2). The weaker correlations in the control group compared to the amputation groups may be an artefact of there being a narrower range of exercise intensities. Although not necessarily an accurate reflection of the general population, they provide normative values for physically active military personnel, thereby allowing us to draw closer comparisons to the groups of individuals with an amputation(s) pre-injury and peer-group PAEE values.

Our previous research identified that wearing a GT3X+ on the hip of the shortest residual limb as the most accurate anatomical position around the pelvis to predict PAEE in individuals with unilateral and bilateral amputation [19]. When activity counts from the GT3X+ were combined with significant covariates this created population specific estimation models, capable of accurately estimating ambulatory PAEE (mean absolute percentage error); unilateral (21±17%), bilateral (16±15%) and controls (15±7%). When compared to our current findings (Table 3), the incorporation of a physiological variable (HR) with the GT3X+ monitor in the unilateral group created stronger correlations, explained greater amounts of variance and displayed lower random error than the GT3X+ with covariates (level of amputation and length of rehabilitation). In the bilateral amputation and control groups the GT3X+HR model and the GT3X+ with covariates models (bilateral amputation group covariates; waist circumference, and control; body mass) were very similar.

Previous research has focused on determining the effects of different prosthetic components and design on the economy of gait in individuals with amputation [18]. Comparing gait, prosthetic fitting and components in a controlled laboratory environment is an important field of study in the development of ambulatory function in individuals with amputation. How these prosthetics function outside of the laboratory however is of great importance to researchers, manufacturers, clinicians and patients. Research in the area of assessing mobility in individuals with amputation has relied on subjective self-reported questionnaires [14, 15]. However, subjective measurements of PA, although low cost, applicable to large populations and practical [41], are commonly found to demonstrate low-moderate predictive validity [42] and lack sensitivity [41] when compared to objective measures of PA. The objective model of estimating PAEE that we have developed for this study and previously [19] could provide insight into the amount of habitual ambulation-related PAEE individuals with amputations engage in, whilst wearing a range of prosthetic devices outside of the laboratory.

Unfavourable body composition changes can occur after amputation [46] and individuals with amputation are at increased risk of developing cardio-metabolic disorders [13] and a number of other secondary physical conditions [43], including osteoporosis, low back pain [44] and osteoarthritis [45]. The models we have developed could allow clinicians and researchers to objectively assess the influence of different environments (e.g. weather and terrain or urban versus rural living conditions) and rehabilitation settings (e.g. in-patient versus home-based) on PAEE. Future investigations may provide insight into different vocational prospects in the community, thus optimising the potential for full integration back into society.

As wearable consumer PA monitors devices become more commonplace there are greater opportunities for people to engage in the self-management of their own care as well as providing lifestyle information to health care providers [46]. As a note of comparison, the absolute percentage error of consumer multisensory devices (e.g. Fitbit, Microsoft Band and Apple Watch) [24] ranged from 24 to 73% during walking tasks in healthy adults. In this study using individuals with amputation, the accuracy of the research grade AHR demonstrated a comparable level of accuracy (20–28%). The GT3X+HR models developed in individuals with lower-limb amputation demonstrate a superior level of accuracy (12–14%). Despite the welcomed potential utility of these commercially available multi-sensor devices, until they have been validated in people with lower limb-loss it would be ill-advised to recommend there use for the accurate measurement and monitoring of PA in these groups. While our PAEE estimation models show promising levels of accuracy, the wider scientific community needs to agree upon a threshold to signify an acceptable level of accuracy when using wearable devices.

A limitation of this study is the relatively small sample size and variations within participants based on the diversity in the severity of lower-limb loss injuries. However, this diversity may be considered beneficial as the range of walking abilities captured improves the external validity of the regression equations, making them more suitable for the wider amputee population. Also, despite the diversity of the population, the amount of unexplained random error is relatively small. The inclusion of a diverse range of participants is in accordance with best practice recommendations for PA validation studies [47]. Although the participants in this study are military personnel, the injuries sustained in our unilateral group are not dissimilar to what might be expected in a road traffic accident or adventure sports. We therefore believe that our findings are applicable to physically active civilian cohorts with lower-limb amputation population. It is important to note that participants were not provided with a familiarisation of treadmill walking prior to starting the trial. However, many would have been exposed to treadmill walking/running as part of their rehabilitation or as their preferred mode of cardiorespiratory exercise whilst at home. We acknowledge that for some individuals (primarily the bilateral ampution group) this may have affected the energy expenditure data due to the lack of familiarity with the exercise task. However, it is likely that the GT3X+ still managed to assess increased movement due to atypical gait, thus increased corresponding GT3X+ and HR outputs. This study did not measure self-selected walking speed over-ground. There may have been differences in the energy cost of walking over-ground compared with treadmill [48], therefore potentially reducing the accuracy of using these generated equations in the assessment of free-living ambulation. It is perhaps unsurprising that a bespoke algorithm, developed for this population specifically, performed better than an algorithm that was generated on a completed independent and physiologically different sample. Nevertheless, if the Actiheart device is to be applicable to various clinical populations with atypical gait patterns and asymmetries, alternative proprietary equations and/or independent HR calibrations appear necessary [49].

The measurement of PAEE has proven inherently difficult to measure, even in humans without mobility-related physical impairments. Commercial and research grade PA sensors/algorithms are unlikely to have been developed with the movement characteristics and energy demands of amputee populations in mind. We feel population specific algorithms are important to account for the numerous mobility or physical barriers individuals with amputation are likely to encounter when engaging in physical activity. An individualised approach would improve accuracy, either from a cut-point [50] or HR and PAEE relationship perspective. This approach is more time consuming and not necessarily feasible for large scale trials.

Future research should consider applying and further developing new data analysis techniques such as artificial neural networks [51, 52], hidden Markov models [53] and classification trees [54] which use the rich information to classify certain activities and derive a more accurate estimate of EE. Future models should consider using additional activities (i.e. not just walking) that better resemble free-living conditions for individuals with amputation and evaluating the performance of EE prediction models during recovery after exercise (which contributes to TDEE). We encourage research groups to work collaboratively to recruit larger sample sizes. Using a large diverse samples of participants and with different aetiologies would provide a more robust model for the assessment of PAEE in individuals with amputations. Future studies should also aim to cross-validate these newly developed population specific equations using a completely independent sample of participants, across a range of activities of daily living or during habitual free-living conditions.

Conclusion

The manually derived model, integrating HR and acceleration data, from a device positioned at the hip of the shortest residual limb (Actgraph GT3X+), has been shown to possess greater validity for estimating ambulatory-related PAEE in persons with traumatic lower-limb amputations, compared to the proprietary group calibrated algorithm intrinsic to the AHR device. Due to the poorer predictive validity of the AHR device, we would recommend using the GT3X+ HR, together with the algorithms presented in this article, which demonstrate lower unexplained variance and lower estimation error.

Supporting information

S1 Table. Mean absolute error ((MAE); kcal·min-1), mean absolute percentage error and root mean squared error (RMSE) of predicted PAEE using the GT3X+ with HR, HR signals alone and Actiheart.

Data expressed as mean ± SD.

https://doi.org/10.1371/journal.pone.0209249.s001

(DOCX)

S2 Table. Results from the one-way ANOVA demonstrating between group differences during each activity for criterion PAEE (Metamax 3b), Actigraph GT3X+, heart rate, Actiheart, METs and physiological cost index (PCI).

Data expressed as mean ± SD.

https://doi.org/10.1371/journal.pone.0209249.s002

(DOCX)

Acknowledgments

We would like to thank the injured military personnel with lower-limb amputation/s receiving rehabilitation at Defence Medical Rehabilitation Centre and the non-injured participants for volunteering their time and energy to engage in this research trial.

References

  1. 1. Foote CE, Kinnon JM, Robbins C, Pessagno R, Portner MD. Long-term health and quality of life experiences of Vietnam veterans with combat-related limb loss. Quality of life research: an international journal of quality of life aspects of treatment, care and rehabilitation. 2015;24(12):2853–61. pmid:26038223.
  2. 2. Robbins CB, Vreeman DJ, Sothmann MS, Wilson SL, Oldridge NB. A review of the long-term health outcomes associated with war-related amputation. Mil Med. 2009;174(6):588–92. Epub 2009/07/10. pmid:19585770.
  3. 3. Stewart IJ, Sosnov JA, Howard JT, Orman JA, Fang R, Morrow BD, et al. Retrospective Analysis of Long-Term Outcomes After Combat Injury: A Hidden Cost of War. Circulation. 2015;132(22):2126–33. pmid:26621637.
  4. 4. Eckard CS, Pruziner AL, Sanchez AD, Andrews AM. Metabolic and body composition changes in first year following traumatic amputation. Journal of rehabilitation research and development. 2015;52(5):553–62. pmid:26436444.
  5. 5. Bouldin ED, Thompson ML, Boyko EJ, Morgenroth DC, Littman AJ. Weight Change Trajectories After Incident Lower-Limb Amputation. Archives of physical medicine and rehabilitation. 2016;97(1):1–7 e1. pmid:26453769.
  6. 6. Kurdibaylo SF. Obesity and metabolic disorders in adults with lower limb amputation. Journal of rehabilitation research and development. 1996;33(4):387–94. pmid:8895133.
  7. 7. Gjovaag T, Starholm IM, Mirtaheri P, Hegge FW, Skjetne K. Assessment of aerobic capacity and walking economy of unilateral transfemoral amputees. Prosthetics and orthotics international. 2014;38(2):140–7. pmid:23798044.
  8. 8. Hoffman MD, Sheldahl LM, Buley KJ, Sandford PR. Physiological comparison of walking among bilateral above-knee amputee and able-bodied subjects, and a model to account for the differences in metabolic cost. Archives of physical medicine and rehabilitation. 1997;78(4):385–92. pmid:9111458.
  9. 9. Ladlow P, Phillip R, Coppack R, Etherington J, Bilzon J, McGuigan MP, et al. Influence of Immediate and Delayed Lower-Limb Amputation Compared with Lower-Limb Salvage on Functional and Mental Health Outcomes Post-Rehabilitation in the U.K. Military. The Journal of bone and joint surgery American volume. 2016;98(23):1996–2005. pmid:27926681.
  10. 10. McCarthy ML, MacKenzie EJ, Edwin D, Bosse MJ, Castillo RC, Starr A, et al. Psychological distress associated with severe lower-limb injury. The Journal of bone and joint surgery American volume. 2003;85-A(9):1689–97. pmid:12954826.
  11. 11. Pedisic Z, Bauman A. Accelerometer-based measures in physical activity surveillance: current practices and issues. British journal of sports medicine. 2015;49(4):219–23. pmid:25370153.
  12. 12. Su PF, Gard SA, Lipschutz RD, Kuiken TA. Gait characteristics of persons with bilateral transtibial amputations. Journal of rehabilitation research and development. 2007;44(4):491–501. pmid:18247246
  13. 13. Sagawa Y Jr., Turcot K, Armand S, Thevenon A, Vuillerme N, Watelain E. Biomechanics and physiological parameters during gait in lower-limb amputees: a systematic review. Gait & posture. 2011;33(4):511–26.
  14. 14. Miller WC, Deathe AB, Speechley M. Lower extremity prosthetic mobility: a comparison of 3 self-report scales. Archives of physical medicine and rehabilitation. 2001;82(10):1432–40. pmid:11588750.
  15. 15. Stepien JM, Cavenett S, Taylor L, Crotty M. Activity levels among lower-limb amputees: self-report versus step activity monitor. Archives of physical medicine and rehabilitation. 2007;88(7):896–900. pmid:17601471.
  16. 16. Sallis JF, Saelens BE. Assessment of physical activity by self-report: status, limitations, and future directions. Research quarterly for exercise and sport. 2000;71(2 Suppl):S1–14. pmid:10925819.
  17. 17. Piazza L, Ferreira EG, Minsky RC, Pires GKW, Silva R. Assesment of physical activity in amputees: A systematic review of the literature. Science & Sports. 2017;32(4):191–202. https://doi.org/10.1016/j.scispo.2017.07.011.
  18. 18. Czerniecki JM, Morgenroth DC. Metabolic energy expenditure of ambulation in lower extremity amputees: what have we learned and what are the next steps? Disability and rehabilitation. 2015:1–9. pmid:26458225.
  19. 19. Ladlow P, Nightingale TE, McGuigan MP, Bennett AN, Phillip R, Bilzon JLJ. Impact of anatomical placement of an accelerometer on prediction of physical activity energy expenditure in lower-limb amputees. PloS one. 2017;12(10):e0185731. pmid:28982199
  20. 20. Lamonte MJ, Ainsworth BE. Quantifying energy expenditure and physical activity in the context of dose response. Medicine and science in sports and exercise. 2001;33(6 Suppl):S370–8; discussion S419–20. pmid:11427762.
  21. 21. Strath SJ, Brage S, Ekelund U. Integration of physiological and accelerometer data to improve physical activity assessment. Medicine and science in sports and exercise. 2005;37(11 Suppl):S563–71. pmid:16294119.
  22. 22. Hagberg K, Tranberg R, Zugner R, Danielsson A. Reproducibility of the physiological cost index among individuals with a lower-limb amputation and healthy adults. Physiother Res Int. 2011;16(2):92–100. pmid:21608088
  23. 23. Vllasolli TO, Orovcanec N, Zafirova B, Krasniqi B, Murtezani A, Krasniqi V, et al. Physiological cost index and comfort walking speed in two level lower limb amputees having no vascular disease. Acta Inform Med. 2015;23(1):12–7. pmid:25870485
  24. 24. Chowdhury EA, Western MJ, Nightingale TE, Peacock OJ, Thompson D. Assessment of laboratory and daily energy expenditure estimates from consumer multi-sensor physical activity monitors. PloS one. 2017;12(2):e0171720. pmid:28234979.
  25. 25. Albert MV, Deeny S, McCarthy C, Valentin J, Jayaraman A. Monitoring daily function in persons with transfemoral amputations using a commercial activity monitor: a feasibility study. PM & R: the journal of injury, function, and rehabilitation. 2014;6(12):1120–7. pmid:24954402.
  26. 26. Brage S, Brage N, Franks PW, Ekelund U, Wareham NJ. Reliability and validity of the combined heart rate and movement sensor Actiheart. European journal of clinical nutrition. 2005;59(4):561–70. pmid:15714212.
  27. 27. Nightingale TE, Walhin JP, Thompson D, Bilzon JLJ. Predicting physical activity energy expenditure in wheelchair users with a multisensor device. BMJ Open Sport & Exerc Med. 2015;1(1). pii: bmjsem-2015-000008.
  28. 28. Ladlow P, Phillip R, Etherington J, Coppack R, Bilzon J, McGuigan MP, et al. Functional and Mental Health Status of United Kingdom Military Amputees Postrehabilitation. Archives of physical medicine and rehabilitation. 2015;96(11):2048–54. pmid:26254949
  29. 29. Vogler AJ, Rice AJ, Gore CJ. Validity and reliability of the Cortex MetaMax3B portable metabolic system. Journal of sports sciences. 2010;28(7):733–42. pmid:20419553.
  30. 30. Whipp BJ, Wasserman K. Oxygen uptake kinetics for various intensities of constant-load work. J Appl Physiol. 1972;33(3):351–6. pmid:5056210
  31. 31. Brage S, Brage N, Franks PW, Ekelund U, Wong MY, Andersen LB, et al. Branched equation modeling of simultaneous accelerometry and heart rate monitoring improves estimate of directly measured physical activity energy expenditure. Journal of applied physiology. 2004;96(1):343–51. pmid:12972441.
  32. 32. Chen KY, Janz KF, Zhu W, Brychta RJ. Redefining the roles of sensors in objective physical activity monitoring. Medicine and science in sports and exercise. 2012;44(1 Suppl 1):S13–23. pmid:22157770
  33. 33. Nightingale TE, Walhim JP, Thompson D, Bilzon JL. Predicting physical activity energy expenditure in manual wheelchair users. Medicine and science in sports and exercise. 2014;46(9):1849–58. pmid:25134004.
  34. 34. Compher C, Frankenfield D, Keim N, Roth-Yousey L, Evidence Analysis Working G. Best practice methods to apply to measurement of resting metabolic rate in adults: a systematic review. Journal of the American Dietetic Association. 2006;106(6):881–903. pmid:16720129.
  35. 35. MacGregor J. The evaluation of patient performance using long-term ambulatory monitoring technique in the domiciliary environment. Physiotherapy. 1981;67(2):30–3. pmid:7312961
  36. 36. Weir JB. New methods for calculating metabolic rate with special reference to protein metabolism. The Journal of physiology. 1949;109(1–2):1–9. pmid:15394301.
  37. 37. Hastie Y, Tibshirani R, Friedman JH. The Elements of Statistical Learning: Data Mining, Inference and Prediction. New York (NY): Springer; 2009.
  38. 38. Nightingale TE, Walhin JP, Thompson D, Bilzon JL. Influence of accelerometer type and placement on physical activity energy expenditure prediction in manual wheelchair users. PloS one. 2015;10(5):e0126086. pmid:25955304.
  39. 39. Van Remoortel H, Giavedoni S, Raste Y, Burtin C, Louvaris Z, Gimeno-Santos E, et al. Validity of activity monitors in health and chronic disease: a systematic review. Int J Behav Nutr Phys Act. 2012;9:84. pmid:22776399.
  40. 40. Horner FE, Slade J, Bilzon JLJ. The effect of anatomical placement and trunk adiposity on the reliability and validity of triaxial accelerometer output during treadmill exercise. J Phys Act Health. 2013;10(8):1193–200. pmid:23223829
  41. 41. Tudor-Locke CE, Myers AM. Challenges and opportunities for measuring physical activity in sedentary adults. Sports medicine. 2001;31(2):91–100. pmid:11227981.
  42. 42. Prince SA, Adamo KB, Hamel ME, Hardt J, Connor Gorber S, Tremblay M. A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review. Int J Behav Nutr Phys Act. 2008;5:56. pmid:18990237.
  43. 43. Gailey R, Allen K, Castles J, Kucharik J, Roeder M. Review of secondary physical conditions associated with lower-limb amputation and long-term prosthesis use. Journal of rehabilitation research and development. 2008;45(1):15–29. pmid:18566923.
  44. 44. Stam HJ, Dommisse AM, Bussmann HJ. Prevalence of low back pain after transfemoral amputation related to physical activity and other prosthesis-related parameters. Disability and rehabilitation. 2004;26(13):794–7. pmid:15371051.
  45. 45. Farrokhi S, Mazzone B, Yoder A, Grant K, Wyatt M. A Narrative Review of the Prevalence and Risk Factors Associated With Development of Knee Osteoarthritis After Traumatic Unilateral Lower Limb Amputation. Military medicine. 2016;181(S4):38–44. pmid:27849460.
  46. 46. Chiauzzi E, Rodarte C, DasMahapatra P. Patient-centered activity monitoring in the self-management of chronic health conditions. BMC Med. 2015;13:77. pmid:25889598.
  47. 47. Bassett DR Jr., Rowlands A, Trost SG. Calibration and validation of wearable monitors. Medicine and science in sports and exercise. 2012;44(1 Suppl 1):S32–8. pmid:22157772;
  48. 48. Traballesi M, Porcacchia P, Averna T, Brunelli S. Energy cost of walking measurements in subjects with lower limb amputations: a comparison study between floor and treadmill test. Gait & posture. 2008;27(1):70–5. pmid:17360186.
  49. 49. Nightingale TE, Rouse PC, Thompson D, Bilzon JLJ. Measurement of Physical Activity and Energy Expenditure in Wheelchair Users: Methods, Considerations and Future Directions. Sports Medicine–Open. 2017;3(1):10. pmid:28251597
  50. 50. McCracken LA, Ma JK, Voss C, Chan FH, Martin Ginis KA, West CR. Wrist Accelerometry for Physical Activity Measurement in Individuals With Spinal Cord Injury-A Need for Individually Calibrated Cut-Points. Archives of physical medicine and rehabilitation. 2018;99(4):684–9. pmid:29222006
  51. 51. Staudenmayer J, Pober D, Crouter S, Bassett D, Freedson P. An artificial neural network to estimate physical activity energy expenditure and identify physical activity type from an accelerometer. Journal of applied physiology. 2009;107(4):1300–7. pmid:19644028
  52. 52. Trost SG, Wong WK, Pfeiffer KA, Zheng Y. Artificial neural networks to predict activity type and energy expenditure in youth. Medicine and science in sports and exercise. 2012;44(9):1801–9. pmid:22525766
  53. 53. Pober DM, Staudenmayer J, Raphael C, Freedson PS. Development of novel techniques to classify physical activity mode using accelerometers. Medicine and science in sports and exercise. 2006;38(9):1626–34. pmid:16960524
  54. 54. Bonomi AG, Plasqui G, Goris AH, Westerterp KR. Improving assessment of daily energy expenditure by identifying types of physical activity with a single accelerometer. Journal of applied physiology. 2009;107(3):655–61. pmid:19556460