Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Validation of the ADAMO Care Watch for step counting in older adults

  • Daniele Magistro ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Validation, Writing – original draft, Writing – review & editing

    d.magistro@lboro.ac.uk

    Affiliations School of Sport, Exercise, and Health Sciences, Loughborough University, Loughborough, United Kingdom, National Centre for Sport and Exercise Medicine (NCSEM), Loughborough, United Kingdom

  • Paolo Riccardo Brustio,

    Roles Investigation, Writing – original draft, Writing – review & editing

    Affiliation NeuroMuscularFunction | Research Group, School of Exercise and Sport Sciences, Department of Medical Sciences, University of Torino, Torino, Italy

  • Marco Ivaldi,

    Roles Conceptualization, Methodology, Project administration, Resources

    Affiliation NeuroMuscularFunction | Research Group, School of Exercise and Sport Sciences, Department of Medical Sciences, University of Torino, Torino, Italy

  • Dale Winfield Esliger,

    Roles Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliations School of Sport, Exercise, and Health Sciences, Loughborough University, Loughborough, United Kingdom, National Centre for Sport and Exercise Medicine (NCSEM), Loughborough, United Kingdom

  • Massimiliano Zecca,

    Roles Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliations National Centre for Sport and Exercise Medicine (NCSEM), Loughborough, United Kingdom, Wolfson School of Mechanical, Electrical and Manufacturing Engineering, Loughborough University, Loughborough, United Kingdom

  • Alberto Rainoldi,

    Roles Conceptualization, Funding acquisition, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation NeuroMuscularFunction | Research Group, School of Exercise and Sport Sciences, Department of Medical Sciences, University of Torino, Torino, Italy

  • Gennaro Boccia

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliations NeuroMuscularFunction | Research Group, School of Exercise and Sport Sciences, Department of Medical Sciences, University of Torino, Torino, Italy, CeRiSM Research Center ‘Sport, Mountain, and Health’, University of Verona, Verona, Italy

Validation of the ADAMO Care Watch for step counting in older adults

  • Daniele Magistro, 
  • Paolo Riccardo Brustio, 
  • Marco Ivaldi, 
  • Dale Winfield Esliger, 
  • Massimiliano Zecca, 
  • Alberto Rainoldi, 
  • Gennaro Boccia
PLOS
x

Abstract

Background

Accurate measurement devices are required to objectively quantify physical activity. Wearable activity monitors, such as pedometers, may serve as affordable and feasible instruments for measuring physical activity levels in older adults during their normal activities of daily living. Currently few available accelerometer-based steps counting devices have been shown to be accurate at slow walking speeds, therefore there is still lacking appropriate devices tailored for slow speed ambulation, typical of older adults.

This study aimed to assess the validity of step counting using the pedometer function of the ADAMO Care Watch, containing an embedded algorithm for measuring physical activity in older adults.

Methods

Twenty older adults aged ≥ 65 years (mean ± SD, 75±7 years; range, 68–91) and 20 young adults (25±5 years, range 20–40), wore a care watch on each wrist and performed a number of randomly ordered tasks: walking at slow, normal and fast self-paced speeds; a Timed Up and Go test (TUG); a step test and ascending/descending stairs. The criterion measure was the actual number of steps observed, counted with a manual tally counter. Absolute percentage error scores, Intraclass Correlation Coefficients (ICC), and Bland–Altman plots were used to assess validity.

Results

ADAMO Care Watch demonstrated high validity during slow and normal speeds (range 0.5–1.5 m/s) showing an absolute error from 1.3% to 1.9% in the older adult group and from 0.7% to 2.7% in the young adult group. The percentage error for the 30-metre walking tasks increased with faster pace in both young adult (17%) and older adult groups (6%). In the TUG test, there was less error in the steps recorded for older adults (1.3% to 2.2%) than the young adults (6.6% to 7.2%). For the total sample, the ICCs for the ADAMO Care Watch for the 30-metre walking tasks at each speed and for the TUG test were ranged between 0.931 to 0.985.

Conclusion

These findings provide evidence that the ADAMO Care Watch demonstrated highly accurate measurements of the steps count in all activities, particularly walking at normal and slow speeds. Therefore, these data support the inclusion of the ADAMO Care Watch in clinical applications for measuring the number of steps taken by older adults at normal, slow walking speeds.

Introduction

Walking is one of the most common and important human movements related to living an active and independent life [1,2]. Moreover, it is considered the primary leisure-time physical activity performed by older adults [3,4]. Furthermore, walking is common even among seniors who report no leisure-time physical activity because many activities of daily living require ambulation [5]. However, during the ageing process there is a general functional decline [6,7] and walking performance starts to decline in terms of a decrease in speed, lower cadence, shorter stride length, and an increase time spent in double-limb support [7]. Consequently, locomotion factors, such as rhythm, variability, phases, pace and base of support, may be also affected [8,9]. Given this, walking speed may act as a marker of general wellbeing whereby slow gait speed might lead to a sub-clinical impairment in health status [10,11].

Accurate instruments are required to monitor physical activity levels and evaluate the effects of lifestyle behaviours and specific interventions in older adults [1215]. Studies of physical activity in older adults have typically assessed behaviours using self-report methods, such as diaries or questionnaires because of their practicality, low cost, low participant burden and wide acceptance [1619]. However, these approaches have limitations because self-report instruments suffer from significant reporting bias attributable to a combination of social-desirability bias and the cognitive challenge associated with the estimation of frequency and duration of physical activity [17]. In fact, unstructured lifestyle-related activities are often encouraged in public health promotion campaigns [4]; however, these light-intensity activities are more difficult to recognise and less likely to be recalled when self-reporting than structured physical activities [20]. Thus, the accurate assessment of these types of daily activities is important. An alternative approach to a self-reported measure is the objective monitoring of physical activity using wearable devices such as accelerometers and pedometers [2123]. Wearable activity monitors, such as pedometers, may serve as affordable and feasible instruments for measuring physical activity levels in older adults during physical activity and their daily routine and to nudge users towards a more active lifestyle.

In fact, the use of step counting devices to quantify physical activity has grown over the past decade. However, there are limited data regarding the accuracy of step counting instruments used by older adults. Commercial step counting devices have been shown to be reliable for individuals who walk faster than 0.9 m/s [21,2426]; however, there are few devices that have been shown to be accurate at walking speeds slower than this [3]. In general, pedometers such as the SC-StepMX (Steps Count, Deep River) and the NL-2000 (New-Lifestyles Inc, Lees Summit, MO, USA) are more accurate at slower walking speeds (0.8 m/s) than accelerometer-based step counting devices [2729]. Accelerometer-based step counting devices are able of detect both static and dynamic accelerations, thus providing more detailed information than pedometers in the form of time-stamped step counts and activity intensity. In this way they can provide more comprehensive and precise information about mobility patterns, postural changes, and physical activity intensity levels over time. As a result, accelerometer-based step counting devices might be ideal for use with populations who typically engage in very light or brief daily activities, such as the older adults. However, popular accelerometer-based step counting devices such as the ActiGraph GT3X+, the de facto standard instrument to measure physical activities, underestimated the step count by approximately 40% at 0.9 m/s, and by 60% at 0.67 m/s [30]. Also, Paul et al [31] showed that ActiGraph accelerometer undercounted steps in older adults while the Fitbit tracker (One or Zip) was sufficiently accurate (<10% error). However, they did not conduct a specific validation over different walking speeds, and therefore it is not clear whether it could work for lower speeds as well. Despite of the widespread use and popularity of different accelerometer-based step counting devices, there is still lacking for appropriate devices tailored for slow speed ambulation, typical of older adults.

The ADAMO system (Caretek S.r.l., Torino, Italy) is an accelerometer-based monitoring system specifically designed for older adults. It is composed by two elements: a base station, installed in the house of the older adult, and a care watch. The base station receives the data recorded by the ADAMO Care Watch via radio and transmits them to the to the service centre. The ADAMO Care Watch is a device with an embedded algorithm for the measurement of physical activity in older people by counting the steps they take. The step detection algorithm is specifically designed to be sensitive to slow speed ambulation, typical of old age. The number of steps taken is included in the algorithm embedded in ADAMO Care Watch to quantify the mobility index of the individuals. This index is an important marker of the older adult’s general health status. It can be transmitted, through the ADAMO Service Centre, to the family of the older adults or to the health care system to remotely provide information about general health status. The development and validation of the ADAMO Care Watch is part of the SPRINTT (Sarcopenia & physical frailty in older people: multi-component treatment strategies) project (9th Call IMI 2013). Indeed, ADAMO Care Watch acted as the physical activity monitoring system for the living labs developed within the SPRINTT project. Therefore, the aim of this current study was to assess the validity and reliability of ADAMO Care Watch in counting the number of steps taken at different walking speeds and under different mobility conditions. It was hypothesised that there would be no statistically significant difference between ADAMO Care Watch and the actual step count (criterion standard) at slow and normal walking speeds and the mobility tasks in the older adults group. Finally, it was hypothesised that the validity and reliability of the ADAMO Care Watch would decrease at faster walking speeds.

Materials and methods

Participants

The participants were recruited through advertisement at Torino University. The participants did not receive incentives (economic or otherwise) for their participation.

The eligibility criteria were: first, being 65 or more years old for the older adult group, and being 20–40 years old for the young adult group; second, all participants were required to walk 100 meters without assistance. Exclusion criteria included a myocardial infarction and/or coronary bypass surgery within the previous year, uncontrolled diabetes or hypertension, orthopaedic impairment or an upper or lower extremity fracture within the past six months, neurological conditions, or current participation in another study. These criteria were intended to ensure that any differences in pedometer validity were primarily due to walking speed and to prevent any potential health and safety issues. Ethical approval for this study was obtained from the local Ethical Review Board of Torino, and all participants were informed that participation in the study was voluntary and confidential. All participants provided their written informed consent in accordance with Italian law.

Step counting device

The step detection algorithm was embedded within the ADAMO Care Watch. The algorithm exploits the features of a 3-axis accelerometer (ADX346, Analog Devices, Norwood, MA, USA) sampling at 50 Hz. The collected samples were filtered and processed in real-time via a dedicated firmware routine. The processing algorithm was based upon a Dynamic Threshold and Dynamic Precision approach. The raw acceleration signals were continuously processed in bursts of 32 samples. First, a 2-tap finite impulse response filter was applied. The accelerometer is mounted on the watch so that the when the arm is alongside the body, that is the most usual position when walking, the x axis is on the vertical direction, the y axis is on the anterior-posterior direction and z axis is in the medio-lateral (frontal) direction. Then the tri-axial signals were combined, giving a greater weight to the vertical axis. This weighting factor is important because the vertical oscillations of the arm during walking act as a surrogate for the rise and fall of the centre of mass and are deemed to be the most costly in terms of energetics (work). The maximum and minimum values of the bursts were retrieved and the average value, (Max + Min)/2, was estimated (the dynamic threshold level). This threshold level, which was dynamically estimated every 32 samples, was used to decide whether steps had been taken. The occurrence of a step was defined as a negative slope of the combined acceleration pattern when the acceleration curve crossed below the dynamic threshold.

Measures

30-metre walking tasks.

A 30 meters indoor straight track was established in a quiet hallway in the facility. After a single, normal-pace practice trial (not wearing the ADAMO Care Watch), the participants performed the walking tasks wearing the devices at three different self-paced speeds. Specifically, participants were instructed to walk the length of the course: 1) at a normal pace, neither fast nor slow (Normal); 2) slow pace (Slow), i.e. walking slower than normal; 3) fast pace (Fast), i.e. walking faster than normal but without overexertion. To avoid performance bias, the order of the speeds for each participant was randomly chosen using a random number generator. This protocol was designed to test each individual on their own self-determined walking speed range. From a static each task began when the ‘go’ signal was given [32,33], and ended when the participant reached the end area of the 30 meter track. Walking speed (in m/s) was calculated by dividing 30 meters by the elapsed time (in seconds) and acceleration and deceleration phases were included in the calculation of the gait speed [32,33].

Timed Up and Go test.

The TUG test was conducted to assess mobility, defined as the ability to move independently around the environment (Shumway-Cook et al 2005). A 3 meter distance was measured out on the floor in front of a fixed, armless chair, and a cone was placed as a marker at the end of this distance. The ICC of the TUG test has previously been assessed as > 0.95 [34]. The participants were instructed to stand up, walk at a comfortable speed towards the cone, walk around the cone, and walk back and sit down again. The test ended when the participants’ buttocks touched the surface of the seat.

Step test.

A single step was placed on the floor and participants were instructed to step up and down alternately with their left and right legs 20 times at a self-determined normal stepping rate. The step reflected the standard dimensions of Italian stairs, with a height of 0.18 m and depth of 0.30 m. The inter-rater reliability (ICC) of the step test has been shown to be 0.98 [35].

Ascending and descending the stairs.

Participants walked up and down stairs (15 steps) at a self-paced normal speed; again, each step was 0.18 m in height and 0.30 m in depth, with a total vertical displacement of 2.70 m. The participants were instructed to step alternately with their left and right leg, and they were not allowed to hang onto a railing when walking up and down the stairs.

Experimental protocol

Participants wore their own comfortable walking or running shoes. Demographic data were self-reported at the beginning of the study visit. Height was assessed by an anthropometer [36] and weight and BMI using a Tanita Body Composition Analyzer BF-350.

The test procedure took approximately 60 minutes for each participant. All participants performed a 30-metre walking task [37] at three different speeds and a Timed Up and Go (TUG) test [38]. The older adults also performed a stair climbing task [16] and a step test [34,35]. Each task was performed three times, and the tasks were performed in a randomised order. During all tasks, the participants wore two ADAMO Care Watches, one on each wrist, to check for differences due to possible dominant arm asymmetry.

The number of steps detected by the ADAMO Care Watch was recorded at the end of each task, and the device was reset to zero before the start of the successive task. Actual steps taken (i.e., the criterion) were directly observed and recorded using a hand-held tally counter. All tasks were video-recorded for offline verification purposes to ensure the steps were counted in a correct way. To determine walking speed and evaluate the TUG test performance, an experienced technician recorded the duration of each task using a stopwatch, with the help of the recorded video if necessary. Before starting each test, the participants received a detailed briefing and demonstration.

Statistical analysis

Validity was measured by the level of agreement between the number of steps counted by the pedometer and the criterion measure (direct observation), the actual number of steps as counted by a researcher with a tally counter [3]. The validity of each task’s trials was determined using absolute percentage error scores calculated for each ADAMO Care Watch as follows:

A positive value indicated an overestimate in the detection of steps (extra steps detected), and a negative value indicated an underestimate (missed steps). Values close to zero were considered to indicate more accurate results. Mean percentage errors for each task at each speed were calculated by averaging the absolute percentage error across all participants. A repeated measures ANOVA was performed between the three speeds, considering the average time of each trial, across the total sample and in both age groups, in order to confirm that the three self-selected speeds resulted in significantly different times. The Bonferroni correction was applied in post-hoc comparisons used to identify specific group differences. Correlation analysis was performed to investigate a possible relationship between the speed of the walking task and the reliability of the ADAMO Care Watch. Following the identification of a significant relationship, polynomial regression analysis was used to establish the best fit model of the effect of speed on reliability of the care watch. The reliability of ADAMO Care Watch was assessed using intraclass correlation analysis. Two-way mixed intraclass correlation (absolute agreement) coefficients (ICC(3,2)) [39] were calculated for each ADAMO Care Watch over all tasks to demonstrate the consistency of measurements. To assess systematic variation between pedometers and direct observation (manual count) of the different walking speed and TUG, Bland–Altman plots [40] were derived for each ADAMO care watch against the criterion. Data are reported as mean ± SD. Differences between estimates are reported as mean (CI 95%). The level of significance was set as p<0.05 in all statistical tests. Statistical Package for Social Sciences (SPSS 20.0 for Windows, IBM, Armonk, NY, USA) was used for all the statistical analyses.

Results

A total of 40 people participated in the study: 20 older adults (10 females) ages 65 years or older (mean ± SD, 75 ± 7 years; range, 68–91) and 20 young adults (10 females, 25 ± 5 years, range 20–40) were recruited for this study. The mean body mass index, in line with Italian normative data [41], was 27.4 ± 5.4 kg m-2 for the older adult group and 22.4 ± 3.2 kg m-2 for the young adult group. The times and speeds for the walking task trials and TUG tests are presented in Table 1. The speed data are reported with two units (m/min and m/s) to facilitate comparison with previous studies [3,20,25,42].

Expandthumbnail
Table 1. 30-meters walking tasks (Normal, Slow, Fast) and TUG performances in times and speeds.

doi:10.1371/journal.pone.0190753.t001

More »

The repeated measures ANOVA showed a significant difference between the three walking speeds (Normal, Slow, Fast) in the whole sample (F = 224.205, p<0.0001, η2 = .922) and in both the older adult (F = 78.424, p<0.0001, η2 = 0.897) and young adult group (F = 246.08, p<0.0001, η2 = 0.965). A post-hoc analysis, with Bonferroni adjustment, revealed significant differences in the whole sample and in both groups separately in Normal versus Slow speed, Normal versus Fast speed and Slow versus Fast speed (all p<0.0001).

Table 2 presents the percentage error scores calculated for the ADAMO Care Watch worn on the right (R) and left (L) arms for each task. The mean percentage error for the 30-metre walking tasks was greater at faster speeds in both the young adult group and the older adult group In the TUG test, the older adult group showed a smaller percentage error than the young adult group. For more details see Table 2.

Expandthumbnail
Table 2. Percent error scores calculated for each side and each task.

doi:10.1371/journal.pone.0190753.t002

More »

The ICCs calculated for each ADAMO Care Watch and each task trial are presented in Table 3. For the whole sample, the ICCs for the ADAMO Care Watch for the 30-metre walking tasks at each speed and for the TUG test showed a range between 0.931 to 0.985 (for more details see Table 3).

Expandthumbnail
Table 3. ICC scores calculated for each ADAMO Care Watch across tasks.

doi:10.1371/journal.pone.0190753.t003

More »

Bland–Altman plots were constructed to assess the agreement between ADAMO Care Watch against the criterion during walking at normal, slow, and fast speeds (Fig 1) and TUG (Fig 2). Limits of agreement were narrow across normal and slow walking pace and TUG in both groups. Wide limits of agreement with larger scatter were observed during the walking at fast speeds, especially in the young adult group where the absolute speeds were higher.

Expandthumbnail
Fig 1. Bland–Altman plots between criterion and ADAMO Care Watch during walk test.

a) Normal speed (a1 Older adults and a2 Young adults); b) Slow speed (b1 Older adults and b2 Young adults); c) Fast speed (c1 Older adults and c2 Young adults). Dashed lines represent mean bias differences; Solid lines represent 95% prediction intervals.

doi:10.1371/journal.pone.0190753.g001

More »
Expandthumbnail
Fig 2. Bland–Altman plots between criterion and ADAMO Care Watch during TUG test.

Dashed lines represent mean bias differences; Solid lines represent 95% prediction intervals; a1 represent Older adults and a2 represent Young adults.

doi:10.1371/journal.pone.0190753.g002

More »

Correlation analysis showed a significant negative relationship between the speed of the walking task and the reliability of the ADAMO Care Watch (r = −0.647, p<0.0001). Polynomial regression analysis showed the best model that could represent the association of the speed on the reliability of the ADAMO Care Watch (r2 = −0.667, p<0.0001, F = 149.70) (Fig 3) and the relationship was clearly nonlinear.

Expandthumbnail
Fig 3. Regression model: Association of speed on reliability of ADAMO Care Watch of the whole sample.

doi:10.1371/journal.pone.0190753.g003

More »

Discussion

The present study examined the validity of the ADAMO Care Watch in measuring steps taken during a 30-metre walking task at different speeds and during various mobility tasks (a TUG test, step test and stair climbing) in groups of older and young adults. The main finding was that the ADAMO Care Watch demonstrated highly accurate measurement of actual steps taken during the walking tasks at slow and normal speeds (range 0.5–1.5 m/s), showing an absolute error from 1.3% to 1.9% in the older adult group and from 0.7% to 2.7% in the young adult group. The results of the walking task at fast speed (1.5–2.3 m/s) showed an absolute error of 6% in the older adults group and 17% in the young adult group.

Although a direct comparison cannot be made between our findings and previously reported data, it is possible to highlight some differences. Given the ADAMO Care Watch was designed for older adults walking at typically slower speeds, only normal and slow speed results in the present study were compared with previous studies that investigated the same speed range. Some previous studies [3,25,43] reported that pedometers showed a percentage error greater than 20% at walking speeds ≤0.9 m/s; in contrast, in the present study the ADAMO Care Watch showed high validity in step detection at slow walking speeds (absolute error of 1.5% at 0.8 m/s), similar to the activPAL accelerometer-based monitor [16,42], which showed a mean percentage error <1% for three speeds in the range 0.7 to 1.6 m/s in older adults. The ADAMO Care Watch showed greater validity than all three devices examined in the study of Storti et al. [20] (mean absolute errors: Yamax, 16.9%; Actigraph, 8.7%; and StepWatch, 5.7%) and speeds (<0.8 m/s, 0.8–1.0 m/s and >1.0 m/s). A similar trend was found by Cyarto et al. [25], who reported mean percentage errors of 25% at 0.95 m/s, 46% at 0.8 m/s, 55% at 0.64 m/s and 74% at 0.4 m/s for the Yamax SW 200 during walking. Recently, Martin et al. [3] reported the performance of five pedometers (Omron HJ 105, Yamax Digiwalker 200, SportLine 330, New-Lifestyles 2000 and the ActiCal Accelerometer) in counting steps at four speeds (0.46, 0.66, 0.85 and 1.31 m/s): the mean percentage errors across all devices were found to be higher (56%, 40%, 19% and 9%, respectively) than those of the ADAMO Care Watch in the present study. Ichnoseki-Sekine et al. [44] showed that the Omron HJ 720-IT pedometer underestimated steps by an average of 53.2% over a range of slow walking speeds (0.28–0.99 m/s) in older adults. Recently, Lee et al. [45] investigated four pedometers using a treadmill at various speeds. Only the Omron HJ-720 T pedometer showed average percentage errors lower than 1.1% at all speeds, with the Actigraph GT3X, Yamax Digiwalker SW-701 and Polar Active accelerometer showing percentage errors greater than 10% at the lowest speeds (0.9 m/s and 1.1 m/s). Moreover, ADAMO Care Watch was shown to be accurate when compared to well-known consumer-based step counters such as the SC-StepMX, the NL-2000 and the Fitbit tracker that demonstrated a good step count accuracy for older adults [2729,31,46]. The high values of ICCs confirmed the consistency of ADAMO Care Watch measurements, highlighting that the differences observed in the test were mainly due to differences among the participants. Comparing the results for normal and slow speeds with the studies described above that investigated a similar range of speeds, we can conclude that ADAMO Care Watch showed a high level of validity at normal and slow speeds. Moreover, considering that our protocol involved the participants self-selecting their pace at the different speeds, it can be assumed that the speeds chosen were those that are the most common in everyday life. The findings of the present study therefore show that ADAMO Care Watch was accurate in detecting steps during normal walking on a short straight course and during the TUG test.

Furthermore, the results of the present study were deemed to be supportive of the stated hypothesis that fast walking speed reduces pedometer reliability. The regression analysis confirmed that a fast walking speed negatively affected the reliability. ADAMO was designed to be sensitive to low speed, indeed during fast speed ADAMO Care Watch Care Watch seems to significantly underestimate the number of steps taken when compared with a criterion method.

In the TUG test, the ADAMO Care Watch showed a high level of validity and reliability in both the older adult and young adult group. Specifically, the ADAMO Care Watch showed a lower percentage error for the older rather than for the young adult group, corresponding with the slower walking speed.

The TUG test reflects important daily physical functions, such as the ability to rise from a chair and walk around the home and has been shown to predict the development of disability related to mobility functions in older people [47]. The relative complexity of the motor sequence involved in the TUG test acts as a representative indicator/marker of actual daily situations [48].

During the step test and the climbing up and down stairs tasks, the ADAMO Care Watch overestimated the actual number of steps, with a slightly higher percentage error (12.4% to 16.6%). This slight inaccuracy could be attributed to the different spatiotemporal parameters of climbing up and down the stairs compared with walking on a level surface (such as a slower velocity, shorter step length and longer step time). In fact, negotiating stairs during the climbing up and down stairs is a complex locomotor task that imposes significant challenges for movement control in older adults [49]. Compared to level walking, stair ambulation demands greater balance control [50], especially in older adults when motor functions are reduced by the ageing process. Again, the ADAMO Care Watch showed high reliability in these tasks (ICC range 0.81–0.96). The decision to include these tasks in the assessment of the validity of ADAMO Care Watch was due to the fact that ascending and descending stairs are daily activities that can take place in many types of natural and built environments.

There were limitations to the present study. First, we studied the validity of the ADAMO Care Watch in a controlled laboratory environment. Further studies should examine how counting steps in a normal-life situation compares in terms of validity and reliability. Second, the participants were healthy and so the results cannot be generalised to specific populations such as older adults living in long-term care facilities, older adults with mild cognitive impairment, or those with diseases which can affect gait. Third, the walking course was relatively short (30m). Further studies should examine the validity and reliability of ADAMO Care Watch in longer walking paths/trails to extend these results.

There are several strengths of this study. First, to our knowledge, ADAMO Care Watch is the first device specifically marketed for use in the older adult population, with a step detection algorithm specifically designed to be sensitive to slow walking speeds. Further, the accordance of our results with previous studies [16,51] emphasize the fact that the ADAMO Care Watch’s validity and reliability specifically tuned for use in slower walking adults. Second, the high reliability values of the ADAMO Care Watch acts to minimize measurement error. Thirdly, these findings are in line with previous study from Tudor-Locke and Rowe [52] and Floegel and colleagues [46] who underline the need for appropriate device for individual monitoring in specific groups.

Conclusion

The findings of this study showed that the ADAMO Care Watch demonstrated a valid measurement of the number of steps performed by older adults during mobility tasks such as walking at different speeds and the TUG test and during ascending and descending stairs. Moreover, these findings support the use of the ADAMO Care Watch for measuring the number of steps taken per day by older adults with slower walking speed. In summary, step counting devices are valuable tools and an accessible way to quantify physical activity in a research setting. The popularity of step counting devices as an objective measure of physical activity originates from their ability to provide direct, objective, and physical activity information. Our findings indicate that the ADAMO Care is both a reliable and valid step counting device.

Supporting information

S1 File. Dataset.

doi:10.1371/journal.pone.0190753.s001

(XLSX)

Acknowledgments

The authors would like to express their gratitude to all the participants of our study and to Caretek S.r.l., Torino, Italy.

References

  1. 1. Magistro D, Liubicich ME, Candela F, Ciairano S. Effect of Ecological Walking Training in Sedentary Elderly People: Act on Aging Study. The Gerontologist. 2014;54:611–23. doi: 10.1093/geront/gnt039. pmid:23682170
  2. 2. Lord S, Galna B, Rochester L. Moving forward on gait measurement: Toward a more refined approach. Mov. Disord. 2013;28:1534–43. doi: 10.1002/mds.25545. pmid:24132841
  3. 3. Martin JB, Krč KM, Mitchell EA, Eng JJ, Noble JW. Pedometer accuracy in slow walking older adults. Int. J. Ther. Rehabil. 2012;19:387. pmid:24795762
  4. 4. Marshall AL. Should All Steps Count When Using a Pedometer as a Measure of Physical Activity in Older Adults? J. Phys. Act. Health JPAH. 2007;4:305–314.
  5. 5. Bergman RJ, Bassett DR, Klein DA. Validity of 2 devices for measuring steps taken by older adults in assisted-living facilities. J. Phys. Act. Health. 2008;5:S166.
  6. 6. Magistro D, Candela F, Liubicich ME, Brustio PR, Rabaglietti E. A Longitudinal Study on the Relationship Between Aerobic Endurance and Lower Body Strength in Italian Sedentary Older Adults. J. Aging Phys. Act. 2015;23:444–51. doi: 10.1123/japa.2013-0215. pmid:25341375
  7. 7. Chodzko-Zajko WJ, Proctor DN, Fiatarone Singh MA, Minson CT, Nigg CR, Salem GJ, et al. Exercise and Physical Activity for Older Adults: Med. Sci. Sports Exerc. 2009;41:1510–30. doi: 10.1249/MSS.0b013e3181a0c95c. pmid:19516148
  8. 8. Hollman JH, McDade EM, Petersen RC. Normative spatiotemporal gait parameters in older adults. Gait Posture. 2011;34:111–8. doi: 10.1016/j.gaitpost.2011.03.024. pmid:21531139
  9. 9. Verlinden VJA, van der Geest JN, Hoogendam YY, Hofman A, Breteler MMB, Ikram MA. Gait patterns in a community-dwelling population aged 50 years and older. Gait Posture. 2013;37:500–5. doi: 10.1016/j.gaitpost.2012.09.005. pmid:23018028
  10. 10. Abellan van Kan G, Rolland Y, Andrieu S, Bauer J, Beauchet O, Bonnefoy M, et al. Gait speed at usual pace as a predictor of adverse outcomes in community-dwelling older people an International Academy on Nutrition and Aging (IANA) Task Force. J. Nutr. Health Aging. 2009;13:881–9. pmid:19924348
  11. 11. Studenski S. Bradypedia: is gait speed ready for clinical use? J. Nutr. Health Aging. 2009;13:878–880. pmid:19924347
  12. 12. Fortune E, Lugade VA, Amin S, Kaufman KR. Step detection using multi- versus single tri-axial accelerometer-based systems. Physiol. Meas. 2015;36:2519. doi: 10.1088/0967-3334/36/12/2519. pmid:26595421
  13. 13. Bassett DR. Device-based monitoring in physical activity and public health research. Physiol. Meas. 2012;33:1769. doi: 10.1088/0967-3334/33/11/1769. pmid:23110847
  14. 14. Tudor-Locke C, Craig CL, Aoyagi Y, Bell RC, Croteau KA, De Bourdeaudhuij I, et al. How many steps/day are enough? For older adults and special populations. Int. J. Behav. Nutr. Phys. Act. 2011;8:80. doi: 10.1186/1479-5868-8-80. pmid:21798044
  15. 15. Dishman RK, Washburn RA, Schoeller DA. Measurement of Physical Activity. Quest. 2001;53:295–309.
  16. 16. Lützner C, Voigt H, Roeder I, Kirschner S, Lützner J. Placement makes a difference: accuracy of an accelerometer in measuring step number and stair climbing. Gait Posture. 2014;39:1126–1132. doi: 10.1016/j.gaitpost.2014.01.022. pmid:24629310
  17. 17. Prince SA, Adamo KB, Hamel ME, Hardt J, Gorber SC, Tremblay M. A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review. Int. J. Behav. Nutr. Phys. Act. 2008;5:56. doi: 10.1186/1479-5868-5-56. pmid:18990237
  18. 18. Troiano RP, Berrigan D, Dodd KW, Masse LC, Tilert T, McDowell M, et al. Physical activity in the United States measured by accelerometer. Med. Sci. Sports Exerc. 2008;40:181. doi: 10.1249/mss.0b013e31815a51b3. pmid:18091006
  19. 19. Strycker LA, Duncan SC, Chaumeton NR, Duncan TE, Toobert DJ. Reliability of pedometer data in samples of youth and older women. Int. J. Behav. Nutr. Phys. Act. 2007;4:4. doi: 10.1186/1479-5868-4-4. pmid:17306031
  20. 20. Storti KL, Pettee KK, Brach JS, Talkowski JB, Richardson CR, Kriska AM. Gait speed and step-count monitor accuracy in community-dwelling older adults. Med. Sci. Sports Exerc. 2008;40:59. doi: 10.1249/mss.0b013e318158b504. pmid:18091020
  21. 21. Bassett Jr DR, John D. Use of pedometers and accelerometers in clinical populations: validity and reliability issues. Phys. Ther. Rev. 2010;15:135–142.
  22. 22. Hasson RE, Haller J, Pober DM, Staudenmayer J, Freedson PS. Validity of the Omron HJ-112 Pedometer during Treadmill Walking: Med. Sci. Sports Exerc. 2009;41:805–9. doi: 10.1249/MSS.0b013e31818d9fc2. pmid:19276853
  23. 23. Copeland JL, Esliger DW. Accelerometer assessment of physical activity in active, healthy older adults. J. Aging Phys. Act. 2009;17:17. pmid:19299836
  24. 24. Dondzila CJ, Swartz AM, Miller NE, Lenz EK, Strath SJ. Accuracy of uploadable pedometers in laboratory, overground, and free-living conditions in young and older adults. Int J Behav Nutr Phys Act. 2012;9:10–1186.
  25. 25. Cyarto EV, Myers A, Tudor-Locke C. Pedometer accuracy in nursing home and community-dwelling older adults. Med. Sci. Sports Exerc. 2004;36:205–209. doi: 10.1249/01.MSS.0000113476.62469.98. pmid:14767241
  26. 26. Schneider PL, Crouter SE, Lukajic O, Bassett DRJ. Validity of 10 electronic pedometers for measuring steps, distance, and energy cost. Med Sci Sports Exerc. 2003;35:1455–60. doi: 10.1249/01.MSS.0000078932.61440.A2. pmid:12900704
  27. 27. Melanson EL, Knoll JR, Bell ML, Donahoo WT, Hill JO, Nysse LJ, et al. Commercially available pedometers: considerations for accurate step counting. Prev. Med. 2004;39:361–368. doi: 10.1016/j.ypmed.2004.01.032. pmid:15226047
  28. 28. Webber SC, Magill SM, Schafer JL, Wilson KC. GT3X+ accelerometer, Yamax pedometer, and SC-StepMX pedometer step count accuracy in community-dwelling older adults. J. Aging Phys. Act. 2014;22:334–341. doi: 10.1123/japa.2013-0002. pmid:23921227
  29. 29. Marsh AP, Vance RM, Frederick TL, Hesselmann SA, Rejeski WJ. Objective assessment of activity in older adults at risk for mobility disability. Med. Sci. Sports Exerc. 2007;39:1020. doi: 10.1249/mss.0b013e3180423ac3. pmid:17545894
  30. 30. Feito Y, Bassett DR, Thompson DL. Evaluation of activity monitors in controlled and free-living environments. Med. Sci. Sports Exerc. 2012;44:733–41. doi: 10.1249/MSS.0b013e3182351913. pmid:21904249
  31. 31. Paul SS, Tiedemann A, Hassett LM, Ramsay E, Kirkham C, Chagpar S, et al. Validity of the Fitbit activity tracker for measuring steps in community-dwelling older adults. BMJ Open Sport Exerc. Med. 2015;1:e000013. doi: 10.1136/bmjsem-2015-000013. pmid:27900119
  32. 32. Graham JE, Ostir GV, Fisher SR, Ottenbacher KJ. Assessing walking speed in clinical research: a systematic review. J. Eval. Clin. Pract. 2008;14:552–62. doi: 10.1111/j.1365-2753.2007.00917.x. pmid:18462283
  33. 33. Peel NM, Kuys SS, Klein K. Gait speed as a measure in geriatric assessment in clinical settings: a systematic review. J. Gerontol. A. Biol. Sci. Med. Sci. 2013;68:39–46. doi: 10.1093/gerona/gls174. pmid:22923430
  34. 34. Rikli RE, Jones CJ. Senior fitness test manual. Human Kinetics; 2013.
  35. 35. Brustio PR, Magistro D, Liubicich ME. Changes in temporal parameters during performance of the Step Test in older adults. Gait Posture. 2015;41:217–221. doi: 10.1016/j.gaitpost.2014.10.006. pmid:25455210
  36. 36. International Standard ISO/TR 7250–2. Basic human body measurements for technological design. Part 2: Statistical summaries of body measurements from individual ISO populations. ISO. Geneva, Switzerland; 2010.
  37. 37. Lundgren-Lindquist B, Aniansson A, Rundgren \AA. Functional studies in 79-year-olds. III. Walking performance and climbing capacity. Scand. J. Rehabil. Med. 1982;15:125–131.
  38. 38. Podsiadlo D, Richardson S. The timed “Up & Go”: a test of basic functional mobility for frail elderly persons. J. Am. Geriatr. Soc. 1991;39:142–148. pmid:1991946
  39. 39. Shrout PE, Fleiss JL. Intraclass correlations: Uses in assessing rater reliability. Psychol. Bull. 1979;86:420–8. pmid:18839484
  40. 40. Bland JM, Altman D. Statistical methods for assessing agreement between two methods of clinical measurement. The lancet. 1986;327:307–310.
  41. 41. National Institute of Statistics. Annuario statistico italiano 2015 [Statistical Italian yearbook—2015]. Roma: ISTAT; 2015.
  42. 42. Grant PM, Dall PM, Mitchell SL, Granat MH. Activity-monitor accuracy in measuring step number and cadence in community-dwelling older adults. J. Aging Phys. Act. 2008;16:201. pmid:18483442
  43. 43. Crouter SE, Schneider PL, Bassett Jr DR. Spring-levered versus piezo-electric pedometer accuracy in overweight and obese adults. Med. Sci. Sports Exerc. 2005;37:1673–1679. pmid:16260966
  44. 44. Ichinoseki-Sekine N, Kuwae Y, Higashi Y, Fujimoto T, Sekine M, Tamura T. Improving the accuracy of pedometer used by the elderly with the FFT algorithm. Med. Sci. Sports Exerc. 2006;38:1674–1681. doi: 10.1249/01.mss.0000227641.68360.c2. pmid:16960530
  45. 45. Lee JA, Williams SM, Brown DD, Laurson KR. Concurrent validation of the Actigraph gt3x+, Polar Active accelerometer, Omron HJ-720 and Yamax Digiwalker SW-701 pedometer step counts in lab-based and free-living settings. J. Sports Sci. 2015;33:991–1000. doi: 10.1080/02640414.2014.981848. pmid:25517396
  46. 46. Floegel TA, Florez-Pregonero A, Hekler EB, Buman MP. Validation of Consumer-Based Hip and Wrist Activity Monitors in Older Adults With Varied Ambulatory Abilities. J. Gerontol. A. Biol. Sci. Med. Sci. 2016;glw098.
  47. 47. Donoghue OA, Savva GM, Cronin H, Kenny RA, Horgan NF. Using Timed Up and Go and Usual Gait Speed to Predict Incident Disability in Daily Activities Among Community-Dwelling Adults Aged 65 and Older. Arch. Phys. Med. Rehabil. 2014;95:1954–61. doi: 10.1016/j.apmr.2014.06.008. pmid:24977931
  48. 48. Brustio PR, Magistro D, Zecca M, Rabaglietti E, Liubicich ME. Age-related decrements in dual-task performance: Comparison of different mobility and cognitive tasks. A cross sectional study. PLOS ONE. 2017;12:e0181698. doi: 10.1371/journal.pone.0181698. pmid:28732080
  49. 49. Bosse I, Oberländer KD, Savelberg HH, Meijer K, Brüggemann G-P, Karamanidis K. Dynamic stability control in younger and older adults during stair descent. Hum. Mov. Sci. 2012;31:1560–70. doi: 10.1016/j.humov.2012.05.003. pmid:22853941
  50. 50. Novak AC, Komisar V, Maki BE, Fernie GR. Age-related differences in dynamic balance control during stair descent and effect of varying step geometry. Appl. Ergon. 2016;52:275–84. doi: 10.1016/j.apergo.2015.07.027. pmid:26360219
  51. 51. Treacy D, Hassett L, Schurr K, Chagpar S, Paul SS, Sherrington C. Validity of Different Activity Monitors to Count Steps in an Inpatient Rehabilitation Setting. Phys. Ther. 2017;97:581–8. doi: 10.1093/ptj/pzx010. pmid:28339904
  52. 52. Tudor-Locke C, Rowe DA. Using cadence to study free-living ambulatory behaviour. Sports Med. Auckl. NZ. 2012;42:381–98.