Figures
Abstract
The use of wrist-worn accelerometers has recently gained tremendous interest among researchers and clinicians as an objective tool to quantify real-world use of the upper limbs during the performance of activities of daily living (ADLs). However, wrist-worn accelerometers have shown a number of limitations that hinder their adoption in the clinic. Among others, the inability of wrist-worn accelerometers to capture hand and finger movements is particularly relevant to monitoring the performance of ADLs. This study investigates the use of finger-worn accelerometers to capture both gross arm and fine hand movements for the assessment of real-world upper-limb use. A system of finger-worn accelerometers was utilized to monitor eighteen neurologically intact young adults while performing nine motor tasks in a laboratory setting. The system was also used to monitor eighteen subjects during the day time of a day in a free-living setting. A novel measure of real-world upper-limb function—comparing the duration of activities of the two limbs—was derived to identify which upper limb subjects predominantly used to perform ADLs. Two validated handedness self-reports, namely the Waterloo Handedness Questionnaire and the Fazio Laterality Inventory, were collected to assess convergent validity. The analysis of the data recorded in the laboratory showed that the proposed measure of upper-limb function is suitable to accurately detect unilateral vs. bilateral use of the upper limbs, including both gross arm movements and fine hand movements. When applied to recordings collected in a free-living setting, the proposed measure showed high correlation with self-reported handedness indices (i.e., ρ = 0.78 with the Waterloo Handedness Questionnaire scores and ρ = 0.77 with the Fazio Laterality Inventory scores). The results herein presented establish face and convergent validity of the proposed measure of real-world upper-limb function derived using data collected by means of finger-worn accelerometers.
Citation: Lee SI, Liu X, Rajan S, Ramasarma N, Choe EK, Bonato P (2019) A novel upper-limb function measure derived from finger-worn sensor data collected in a free-living setting. PLoS ONE 14(3): e0212484. https://doi.org/10.1371/journal.pone.0212484
Editor: Benjamin A. Philip, Washington University in Saint Louis School of Medicine, UNITED STATES
Received: October 9, 2018; Accepted: February 3, 2019; Published: March 20, 2019
Copyright: © 2019 Lee et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data can be found at https://doi.org/10.7910/DVN/BVPUSD.
Funding: This material is partially supported by the Industry Outreach Seed Grant Fund, entitled "Development of a Body Area Networked System with Novel Finger-Worn Sensors", that was received by SIL and NR from the Institute of Applied Life Sciences at the University of Massachusetts, Amherst. Due to the nature of the internal university fund, there is no grant number associated with it. This work was also supported by North Carolina Translational and Clinical Sciences Institute, University of North Carolina at Chapel Hill (US). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. The funding organizations did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors’ salaries and/or research materials.
Competing interests: I have read the journal’s policy and the authors of this manuscript have the following competing interests: NR is affiliated with ArcSecond Inc., San Diego, CA, USA. NR utilized the Industry Outreach Seed Grant Fund jointly received by SIL and NR from the Institute of Applied Life Sciences at the University of Massachusetts Amherst in order to implement and provide the device that were described in the manuscript. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
Upper-limb impairments can significantly limit the ability of individuals to perform essential activities of daily living (ADLs) and negatively impact their quality of life [1–4]. Monitoring real-world upper-limb function in individuals with upper-limb impairments, especially for those undergoing rehabilitation after a neurological event such as a stroke [5, 6], can provide clinically important information. About 75% of the individuals who survive a stroke—one of the leading causes of disability in adults [7]—experience long-term motor impairments of the stroke-affected upper-limb that limit their ability to perform ADLs [8]. Whilst an important goal of rehabilitation interventions in this patient population is to improve motor function of the stroke-affected upper-limb, scientific studies have shown that functional improvements achieved in the clinic do not always translate into an improvement in the amount and quality of upper-limb use in the home and community settings [9]. In other words, stroke survivors may show improvements in their motor abilities (i.e., what they are capable of doing) in the clinic that do not result in an increased use of their stroke-affected limb during the performance of ADLs outside of the clinic (i.e., what they actually do) [9, 10]. This is important because the lack of use of the stroke-affected limb leads to a phenomenon referred to as learned non-use [6, 11] that negatively affects brain plasticity phenomena that are key to maximizing the recovery of motor functions. Therefore, an objective assessment of upper-limb use during the performance of real-world ADLs is of paramount importance as it allows clinicians to estimate the real-world impact of rehabilitation interventions, and it can enable self-management and patient-driven therapy [12].
Over the past decade, wrist-worn accelerometers have gained tremendous interest among researchers and clinicians as a low-cost, objective tool to quantify real-world upper-limb function [12]. Measures of upper-limb function, derived from wrist-worn accelerometers—often placed bilaterally –, can be broadly categorized into: 1) intensity of limb use [9, 10, 12–19], 2) time duration of limb use [19–24], and 3) use ratio of the two limbs [14, 15, 19, 21, 22, 25–28]. The intensity of limb use is computed by integrating the acceleration magnitude time-series derived from the accelerometer data collected during the monitoring period. Several studies have investigated the intensity of unilateral (e.g., stroke-affected side only) as well as bilateral (i.e, both limbs combined) upper-limb activities. The time duration of limb use is a measure of the amount of time during which subjects actively use the stroke-affected limb. Active vs. inactive periods are determined by estimating the time intervals during which the acceleration magnitude exceeds a set threshold value. The use ratio of the two limbs measures the activity of the stroke-affected limb and compares it to the activity of the contralateral limb. The use ratio of the two limbs can be computed for the intensity of limb use as well as the time duration of limb use.
Despite the growing interest for their potential application as a tool to monitor real-world upper-limb movements, wrist-worn accelerometers have shown a number of limitations that hinder their widespread adoption in the clinic [12]. Wrist-worn accelerometers are capable of capturing arm and forearm movements (i.e., gross arm movements) but they do not allow one to accurately monitor movements of the hand and fingers (i.e., fine hand movements), which are of great relevance to monitoring ADLs [12, 17]. Consequently, measures derived from wrist-worn accelerometers have been criticized for underestimating movement intensity and their inability to precisely capture changes in the performance of upper-limb movements that are relevant to the assessment of motor abilities [29]. Furthermore, previous studies relying on measures of upper-limb use derived from wrist-worn accelerometers have not shown significant differences in the use of the dominant vs. the non-dominant limb during the performance of real-world ADLs in neurologically intact individuals [12, 18, 22], despite evidence supporting that subjects indeed use their dominant limb more frequently [30]. We hypothesize that this is because wrist-worn accelerometers only capture gross arm movements, but they do not yield accurate information related to fine hand movements that are of paramount importance in the context of monitoring goal-directed use of the upper limbs.
Previous studies have pursued the development and assessment of various technologies to monitor fine hand movements. Several researchers have developed and tested gloves with embedded sensors. For instance, piezoresistive fabric [31] and inertial sensors mounted on flexible substrates [32] have been knitted on or attached to the dorsal side of gloves to monitor fine hand movements. Unfortunately, wearing a glove negatively affects tactile feedback, which is key to accomplishing a number of ADLs. Others have relied on collecting electromyographic data from extrinsic muscles as a proxy measure of fine hand movements [33, 34]. However, collecting accurate electromyographic data in free-living conditions is challenging, because it is difficult to maintain a stable skin-electrode contact over long periods of time. Besides, data from extrinsic muscles provide only an indirect measure of fine hand movements. Direct measures of hand and finger movements are more desirable. To gather direct measures of fine hand movements, Friedman et al. [35] proposed to use a magnetic ring worn on the index finger and two triaxial magnetometers mounted in a watch-like unit. Unfortunately, this technology is negatively affected when subjects are in the proximity of or manipulate ferromagnetic materials, which is a common instance in everyday life.
In this paper, we investigate the use of finger-worn accelerometers to monitor gross arm and fine hand movements. This technology provides direct measures of upper-limb movements and is not affected by the proximity of ferromagnetic materials. Hence, it is ideally suited to quantify upper-limb function (i.e., herein intended as activity) [36–39] in real-world conditions. Furthermore, we introduce a novel measure of upper-limb function based on comparing the time duration of the (sufficiently intensive) use of the two upper limbs (e.g., dominant vs. non-dominant limb or stroke-affected vs. contralateral limb). Hence, the proposed measure quantifies the difference in the amount of the two limbs during the performance of ADLs (i.e., use ratio of the two limbs). This study examines the validity of the proposed approach by collecting and analyzing data from neurologically intact individuals in a laboratory and a free-living environment as a preliminary step toward developing a system suitable to monitor stroke survivors in the home and community setting.
Materials and methods
Wearable sensors
The miniaturized sensor that we used in the study (Arcus, ArcSecond Inc., USA) consisted of a three-axis accelerometer, a local memory for data storage (i.e., a micro-SD card), a 170 mAh battery, and an ultra-low-power 32-bit microprocessor in a waterproof enclosure (see Fig 1). We placed sensing components on the finger and the wrist using a ring and a wristband, respectively. In the study, the accelerometer data was sampled at 67 Hz and stored in the local memory to be retrieved upon completion of the data collection for offline analyses. We previously validated the sensor’s ability to quantify the amount of fine hand movements in a laboratory setting [36–38]. In this study, we focused on the suitability of the technology to derive a novel measure of upper-limb function based on comparing the amount of use of the two limbs during the performance of ADLs.
The sensor consists of a three-axis accelerometer enclosed in a waterproof case.
Participants
A total of 35 neurologically-intact, able-bodied individuals were recruited by word of mouth from the University of Massachusetts Amherst to participate in two different sets of experiments: 1) in-laboratory and 2) free-living experiments. Eighteen subjects (21.7 ± 2.3 years old; 5 females) participated in the in-laboratory experiments and 18 subjects (23.4 ± 4.2 years old; 4 females) in the free-living experiments; one subject participated in both. Among the subjects who participated in the in-laboratory experiments, one was left-handed, one was ambidextrous, and the remaining subjects were right-handed. Among the subjects who participated in the free-living experiments, five subjects were left-handed and the remaining subjects were right-handed. Subjects were 18 to 40 years of age and had no history of orthopedic, musculoskeletal, neurological, or any other disorder or medical condition that could result in aberrant upper-limb movement patterns or affect subjects’ ability to perform the motor tasks independently. The experimental procedures were approved by the Institutional Review Board (IRB) of the University of Massachusetts Amherst (IRB# 2017-3628). All subjects provided written consent to participate in the study.
In-laboratory experiments
The primary objective of the in-laboratory experiments was to determine the characteristics of data collected using the finger-worn accelerometer data during the performance of a set of motor tasks involving various limb-use intensity and laterality. This data allowed us to develop a measure of real-world upper-limb function that we later applied to the data collected in free-living conditions. Specifically, we used the data collected in the laboratory to investigate 1) the ratio of limb use, a measure to distinguish unilateral vs. bilateral tasks, and 2) limb-use intensity (i.e., acceleration magnitude) during the performance of motor tasks. When subjects arrived in the laboratory, we instructed them to wear the above-mentioned sensors on the wrists and index fingers, as shown in Fig 1. Although we had hypothesized that using the finger-worn sensors would have been sufficient to yield accurate information regarding upper-limb function, we also placed sensors on the wrists to enable a comparative analysis against previous studies that used wrist-worn sensors. Subjects were asked to perform nine different motor tasks listed in Table 1. A similar set of motor tasks was used in previous studies [17, 36, 40]. It is worth emphasizing that limb laterality in Table 1 is meant to highlight whether one upper limb or both upper limbs were used to perform a given task. Motor tasks in the Bilateral category involved the use of both limbs throughout the performance of the entire motor task. Similarly, unilateral motor tasks involved the use of only one limb during the performance of the task. Motor tasks in the Unilateral & Bilateral category involved a mixture of bilateral (e.g., typing keys using both hands) and unilateral (e.g., use the right hand to press the Enter or Backspace keys) movements. Subjects were instructed to clap their hands while straightening the wrists three times before and after the performance of each motor task. The acceleration peaks from the four sensors were used to manually synchronize the time clocks.
Free-living experiments
The free-living experiments were conducted approximately one year after the completion of the in-laboratory experiments. Once subjects arrived in the laboratory (typically around 8 am), they were evaluated to determine their handedness—defined as the upper limb that they preferred to use during the performance of ADLs—based on two validated self-reported handedness indices: the Waterloo Handedness Questionnaire [41–43] and the Fazio Laterality Inventory [44, 45].
These well-established self-reported indices of handedness were used to assess convergent validity of the proposed finger-worn accelerometer based measure of upper-limb function. The proposed approach is similar to previous studies that used the Amount of Use (AOU) scale of the Motor Activity Log (MAL)—a standardized clinical assessment tool meant to capture real-world upper-limb performance in stroke survivors—to validate accelerometer-based measures [15, 26, 46–48]. The MAL-AOU is a self-reported measure based on a six-point ordinal scale (0-5) to evaluate patients’ use of the limbs (i.e., stroke-affected vs. contralateral limb use) in terms of time duration (e.g., always, most of the time, rarely, etc.) for 30 different ADLs (e.g., brushing teeth, using a fork, buttoning a shirt, etc.) [49]. A score of 0 indicates that the subject did not use the stroke-affected limb at all, whereas a score of 5 indicates that the subject used the affected limb as often as before the stroke [50]. The average score over the 30 items of the scale is utilized as a measure of upper-limb use. This is fundamentally the same as what handedness indices aim to measure, i.e., use of the dominant vs. non-dominant limb during the performance of ADLs.
The Waterloo Handedness Questionnaire evaluates individuals’ overall use preference of the right vs. left upper limb. It is based on individuals’ self-report of upper-limb use preference. The self-report of time duration of use of the upper limbs relies on a five-point ordinal scale (-2 to +2) meant to capture upper-limb use during the performance of 36 ADLs. The values of the ordinal scale are meant to represent the following situations: always using the left hand (i.e., 95% or more of the times), usually using the left hand (i.e., between 75% and 95% of the times), equally using the two hands (i.e., use each hand about 50% of the times), usually using the right hand, and always using the right hand. Limb use preference is quantified by adding all the individual item scores. The Fazio Laterality Inventory evaluates individuals’ limb use preference in a similar manner. Namely, it is based on subjects’ self-report of the percentage of times (0% to 100%) they use their right limb to perform 100 different ADLs. The average percentage score is used to represent the overall limb use preference.
After completing the handedness tests, subjects were instructed to wear the sensors on their wrists and fingers bilaterally during the day time of a weekday (i.e., for a period of approximately six to eight hours) and go about their normal daily routines. Prior studies show that a wear time of a day is sufficient to assess the feasibility and validity of capturing real-world limb use by means of wearable sensors [12, 20, 22]. Subjects were also asked to perform the clapping action before they left the laboratory for manual clock synchronization among the four sensors. All subjects were university students and their activities reflected a wide range of ADLs including walking to classes, going to restaurants, socializing, and tasks performed at a desk (e.g., writing and typing). They were reminded every one hour by automatic text messages to self-annotate a summary of their activities during the previous hour. We used this data to assess the face validity of the proposed sensor-based measure. The reminder also contained a message to perform the clapping for time synchronization to minimize the clock drifts among the four sensors. Once subjects completed the experiment and returned to the laboratory, they were asked to clap their hands again to finalize the data collection. Then, the accelerometer data stored in the SD cards was manually transferred to a computer and time-synchronized for analysis.
Objective quantification of real-world upper limb use
In this section, we discuss the analytic methods that we used to quantify real-world upper-limb function based on the accelerometer data obtained from the sensors. We focused on capturing the time duration of unilateral limb activities with sufficient intensity, aiming to determine which limb each subject used more frequently during the performance of real-world ADLs.
The gravity-free acceleration magnitude (i.e., activity intensity) time-series was derived from the sensor data as follows: and for the sensors positioned on the right and left limbs, respectively. In the above equations, g = 9.8 m/s2 represents gravity and the accelerometer data was expressed in units of g. A low-pass filter with a cut-off frequency of 8 Hz was applied to the acceleration magnitude time-series to attenuate potential high-frequency noise components. The acceleration magnitude time-series were then down-sampled by averaging the data over one-second epochs in order to represent the comprehensive intensity of limb use during the performance of ADLs (rather than considering the intensity of every data sample captured at 67 Hz). While various epoch sizes have been used in the literature—ranging from a fraction of a second to a few minutes [12, 51]—one-second epoch is the most widely accepted length for monitoring upper-limb performance [13, 17, 19, 22, 28]. Herein, the down-sampled accelerometer data for the right and left limbs are referred to as |ar[t]| and |al[t]| respectively, where t = 1, 2, 3, ⋯ seconds.
A limb was considered active when the acceleration magnitude time-series exceeded a set threshold. The threshold value was set relative to observations gathered at rest, herein intended as when the sensor was placed stationary on a table. In such conditions, the mean and standard deviation of the acceleration magnitude time-series were 0.016g ± 0.0015g, respectively. Epochs with an average acceleration magnitude greater than the 99.5% confidence interval of the stationary profile (i.e., 0.016g + 2.57 × 0.0015g = 0.020g) were classified as epochs of active upper-limb movements. Otherwise, the epochs were classified as associated with no activity.
When movement was detected, the ratio of activity intensity between the two limbs was computed to assess whether a single limb (either left or right) or both limbs were used during each epoch. This approach is similar to that taken in previous studies to measure upper-limb activity [14, 15, 19, 21, 22, 25–28]. Accordingly, the ratio of activity intensity was defined as: (1) The natural log was applied to the ratio of |ar[t]|/|al[t]| in order to generate equal values in magnitude but opposite in sign for right-hand vs. left-hand activities [15]. When the absolute value of r[t] was smaller than a set threshold δ, we considered the two limbs as equally active (i.e., bilateral limb use). On the other hand, when r[t] > δ, we considered the right limb as used predominantly, and when r[t] < −δ we considered the left limb as used predominantly. Then, real-world upper-limb performance was quantified as follows: (2) where |t ∈ {⋅}| is the number of one-second epochs that satisfied the condition in the bracket, and T is the total monitoring duration in seconds. β represents a parameter identifying upper-limb activities (epochs) with sufficient intensity to be counted towards our measurement M. Optimal values of δ and β were derived as discussed in the following subsection.
M captures the difference in time duration of the activities performed using the two limb. A positive value of M indicates that the subject spent more time using the right upper limb to perform ADLs. Similarly, a negative value of M indicates that the subject spent more time using the left limb. Values of M close to zero indicate that the subject used equally—on average—the two limbs throughout the day (e.g., used the right limb for certain tasks—for instance to brush their teeth—while they used the left limb for other tasks—for instance to open doors).
For a comparative analysis, the proposed measure M was derived independently from 1) the finger-worn sensors, 2) the wrist-worn sensors, and 3) the difference between the acceleration magnitude time-series derived from the finger-worn and the wrist-worn sensors (i.e., the acceleration magnitude time-series of the finger-worn sensor minus that of the wrist-worn sensor for each limb separately). As discussed above, we hypothesized that finger-worn sensors alone could provide sufficient information to monitor gross arm movements and fine hand movements. We derived the difference between the acceleration magnitude time-series collected using the finger-worn and the wrist-worn sensors as an attempt to estimate an acceleration time-series capturing solely the movements of the hand and fingers relative to the wrist.
We assessed convergent validity of the proposed measure M against the two handedness indices chosen for the study (i.e., the Waterloo Handedness Questionnaire index and the Fazio Laterality Inventory index) by performing a Pearson correlation analysis. The proposed measure of upper-limb function was also compared to previously studied accelerometer-based measures including 1) the median of the activity ratio (i.e., r[t]) of the two limbs [17, 19], 2) the ratio of active use duration of the two limbs [20–22, 24, 46], 3) the ratio (between the two limbs) of the sum of the maximum acceleration magnitudes within each one-second epoch [15], 4) the percentage of dominant limb active periods compared to the total monitoring duration [17, 21], and 5) the time duration of bilateral limb activity (i.e., |ar[t]| + |al[t]|) [17].
Optimization of the parameters of the algorithm
Both the datasets collected from the in-laboratory and free-living experiments were used to identify the optimal values of δ and β in(2). The in-laboratory sensor data were used to establish the search space (i.e., the value range in which we assume that the optimal values are located) of the two parameters. More specifically, the search range for an optimal δ value—the parameter to detect unilateral use of the limbs—included the mean values of r[t] for the motor tasks that involved both unilateral and bilateral use of the limbs, i.e., Tasks #4-8 in Table 1. The search range for an optimal β value—the parameter to detect limb activity with sufficient intensity—was set from 0.020g (i.e., the threshold for active arm use) to the average activity intensity of the motor task that only involved unilateral limb use, i.e., Task #9 in Table 1.
Based on this established 2D search space of δ and β, we linearly increased the values within the range (see the Results section for details) and computed the proposed measure of upper-limb performance M for each subject who participated in the free-living experiment. This resulted in different values of M for different value combinations of δ and β (i.e., M was considered as a function of δ and β). We empirically identified the optimal values of the parameters that maximized the Pearson correlation coefficients to the handedness indices.
Results
In-laboratory experiments—Performance of motor tasks
Fig 2 shows a scatter plot similar to plots used in previous studies [12, 17] to demonstrate the relationship between the intensity of bilateral limb activity (|ar[t]| + |ar[t]|) and the magnitude ratio (r[t]) estimated using the accelerometer data collected by means of the finger-worn accelerometers. The mean and standard deviation values of the two measures were computed for each motor task across all subjects participated in the in-laboratory experiments in order to simplify the visualization of the results. The search range to optimally choose the δ parameter value was set to be [0.2, 1.4] and the search used increments of 0.025. The search range to optimally choose the β parameter value was set to be [0.02g, 0.23g] and the search used increments of 0.01g. The shaded area in Fig 2 represents the 2D search space constructed based on the in-laboratory data.
(left) The scatter plot with the mean and standard deviation information computed across the participated subjects for each motor task. (right) The simplified scatter plot with only the mean information. The shaded area indicates the 2D search space used to choose the optimal δ and β values.
Parameter optimization for the proposed measure of upper-limb function using free-living experiment data
Fig 3 shows a 2D color map representation of the Pearson correlation coefficients between the proposed measure M derived from the free-living experiment data and the Waterloo Handedness Questionnaire scores (left) and the Fazio Laterality Inventory scores (right) for the above-described search space used to determine optimal δ and β values. The maximum correlation coefficients for both indices were achieved with δ = 1.05 and β = 0.03g, which are indicated in red in Fig 3.
The red boxes at δ = 1.05 and β = 0.03g indicate where the maximum correlation coefficients were obtained for the two indices considered in the study.
Type and frequency of upper-limb use in free-living settings
Table 2 shows the percentage time of upper-limb use associated with different upper-limb activities (i.e., inactive vs. bilateral vs. unilateral) as obtained from data collected in a free-living environment using the above-mentioned optimal parameter values for δ, β, and the threshold used to determine active vs. inactive epochs. The mean and standard deviation values shown in Table 2 were computed by considering the data for all study participants. On average, subjects performed no upper-limb activities for 19 ± 14% of their time. The majority of the upper-limb activities involved both limbs and accounted for 53 ± 14% of the time, whereas only 28 ± 8% of the activities involved unilateral limb use.
Unilateral limb activities (with sufficient intensity) that contributed to the proposed measure of real-world upper-limb function (i.e., M in(2)) accounted for approximately 22% of the overall data. In Table 2, the overall time percentage of right-limb use (with sufficient intensity) was substantially greater than that of left-limb use because the majority of study participants were right-handed (13 right-handed vs. 5 left-handed subjects). Table 3 shows the time percentage of unilateral limb use for the right-handed and the left-handed subjects separately (i.e., dominant vs. non-dominant limbs). The time percentage of dominant limb use for the right-handed and the left-handed subjects showed no statistically significant difference (p ≈ 0.14, t-test). Similarly, the time percentage of non-dominant limb use showed no significant difference (p ≈ 0.80, t-test) between the two groups. These results indicate similar dominant and non-dominant limb use patterns in real-world settings between right-handed and left-handed subjects. Vice versa, the percentage of dominant vs. non-dominant limb use across all study participants showed statistically significant differences (p < 0.01, paired t-test), thus indicating that subjects made substantially greater use of their dominant upper limb.
Fig 4 shows unilateral limb use data determined by the optimal values of δ and β in(2) for one study participant during the monitoring period (approximately 6 hours). The plot colors in blue the epochs associated with right-limb use and in red the epochs associated with left-limb use. Non-colored (white) time intervals indicate epochs involving insufficient-intensity unilateral limb use, bilateral limb use, or inactivity. The subject whose data is shown in Fig 4 was left-handed. The subject produced dominant (left) limb activity with sufficient intensity for 20.6% of the time and non-dominant (right) limb activity for 10.9% of the time. The subject produced insufficient-intensity unilateral activities for 4.3% of the time, bilateral limb activity for 55.6% of the time, and inactivity for 8.8% of the time. Activities that the subject self-annotated for each hour of the monitoring period are described in the caption of Fig 4. The plot shows that the subject predominately used the dominant limb. The intensity of use of the dominant limb was greater than the intensity of use of the non-dominant limb during the limb activity periods (e.g., A3—A6).
Self-annotated activities (i.e., A1 to A6) for each hour of the monitoring period were as follows: A1—using the smart phone; A2—dressing and walking; A3—riding a moving vehicle, going to a coffee shop, using the smart phone; A4—going to a coffee shop and socializing; A5—walking, eating food, and using a smart phone; A6—writing, typing, and eating.
Quantification of real-world upper-limb function
Fig 5 shows scatter plots of the two handedness indices vs. the proposed sensor-based measure M of the study subjects, derived from the data collected in free-living conditions. The sensor-based measure showed statistically significant agreement with both the Waterloo Handedness Questionnaire scores (p < 0.01 with a Pearson’s correlation coefficient ρ = 0.78) and the Fazio Laterality Inventory scores (p < 0.01 with ρ = 0.77). These results establish the convergent validity of the proposed measure M with existing validated measures of real-world upper-limb function during the performance of ADLs.
The sensor-based measure showed statistically significant agreement with both the Waterloo Handedness Questionnaire scores (left) and the Fazio Laterality Inventory scores (right). The grey solid line represents the linear fit, and the red dotted lines represent the 95% confidence intervals for the estimates.
Table 4 compares the proposed measure M to other sensor-based measures studied in the literature to date. As discussed above, we considered three different datasets to derive these measures: 1) finger-worn sensor data, 2) wrist-worn sensor data, and 3) a dataset obtained by computing the difference between the acceleration magnitude time-series derived from the finger-worn sensors and the wrist-worn sensors. Results in Table 4 show that 1) the proposed measure M outperformed existing measures of real-world upper-limb function and that 2) the results obtained using data collected by means of the finger-worn sensors are better correlated with the handedness indices than the results obtained using data collected by means of the wrist-worn sensors or data derived by combining the finger-worn sensor and the wrist-worn sensor data. In fact, the proposed measure based on the finger-worn sensor data produced the highest correlation with the handedness indices (i.e., ρ of 0.78 and 0.77 with the Waterloo Handedness Questionnaire scores and with the Fazio Laterality Inventory scores, respectively). The proposed measure based on the magnitude difference between the wrist-worn and finger-worn sensors also yielded high correlation with the handedness indices (i.e., ρ of 0.73 and 0.72 with the Waterloo Handedness Questionnaire scores and with the Fazio Laterality Inventory scores, respectively). Other than the proposed measure, there were two measures showing statistically significant correlations (p < 0.01) to the handedness indices: the median activity intensity ratio of the two limbs and the duration of sufficient-intensity dominant limb, both of which were derived from the finger-worn sensors.
In summary, results shown in Table 4 confirm our hypotheses that 1) finger-worn sensors allow one to derive a valid measure of fine hand movements and gross arm movements and 2) the index derived by comparing the time duration of limb use shows a strong agreement with self-reported real-world unilateral limb use indices.
Discussion
This study examined the validity of a novel finger-worn accelerometer-based measure of upper-limb function and showed its suitability to monitor gross arm movements and fine hand movements. The results show that collecting data using finger-worn sensors and deriving the proposed measure of upper-limb use M leads to an accurate quantification of the amount of limb use during the performance of ADLs.
Fig 2 shows the face validity of the index derived from the finger-worn sensors. Higher mean acceleration magnitude values were observed when the data was collected during the performance of activities that required greater upper-limb activity intensity—such as walking, folding a towel, and tying shoelaces—compared to other activities tested in the laboratory. The results show that the finger-worn sensor can capture limb activities that involve both gross arm movements (i.e., walking and folding a towel) and fine hand movements (i.e., tying shoelaces), as we initially hypothesized. The mean magnitude ratio r[t] provided information regarding whether the two limbs were used together (e.g., walking, tying shoelaces, and buttoning a shirt) or a single limb was predominantly used (e.g., flipping magazine pages or opening a screw-top jar) to complete the motor tasks. Note that bilateral typing on a keyboard showed slightly greater involvement of the right limb as subjects often needed to press the Enter or Backspace keys. Folding a towel also mainly involved unilateral limb use as subjects often grabbed a corner of the towel and folded the towel using a single limb (while the other limb was used to stabilize the towel).
Convergent validity of the proposed measure of upper-limb function M was demonstrated based on its correlation with two well-established handedness indices (i.e., capturing self-reported upper-limb use preference during the performance of ADLs): ρ = 0.78 with the Waterloo Handedness Questionnaire scores and ρ = 0.77 with the Fazio Laterality Inventory scores as shown in Fig 5. The values of the two parameters utilized to derive M—i.e., δ and β—were empirically chosen to achieve maximum correlation with the handedness indices. The optimal values were identical for the Waterloo Handedness Questionnaire scores and the Fazio Laterality Inventory scores. It is worth noticing that a strong correlation has been also shown between these two handedness indices [39]. Hence, the fact that the same δ and β values led to maximum correlation with both handedness indices was not an unexpected result.
Categorizing upper-limb activities can provide clinically important information regarding how individuals use their limbs in real-world settings [9, 13, 14, 17, 22]. The values of δ and β used to derive the proposed measure M allowed us to categorize upper-limb activity into bilateral vs. unilateral activities. The average time distribution of upper-limb activities summarized in Table 2 is comparable with the results of a previous study by Kilbreath and Heard [30]. The authors conducted an observational study on the type and frequency of upper-limb activities performed by healthy older adults. The study reported that subjects spent 54 ± 10% of their time engaged in bilateral activities, 29 ± 10% in unilateral activities, and 17 ± 7% in no upper-limb activity. Our results showed a similar statistics: 53 ± 14% for bilateral activities, 28 ± 8% for unilateral activities, and 19 ± 14% for no upper-limb activities.
Table 3 shows that right-handed and left-handed subjects made greater use of their dominant limb during the performance of ADLs in free-living conditions. This finding concurs with previously reported results [52]. To the best of our knowledge, we have reported for the first time that wearable sensors can be used to derive information concerning limb use ratio according to the self-reported limb preference in healthy individuals. Previous studies based on wrist-worn accelerometers reported a roughly equal amount of activity of the dominant and non-dominant limbs [9, 13, 14, 22], which is a counter-intuitive finding in striking contrast with self-reports.
Clinical applications
The proposed index M integrates limb activity intensity and ratio into a single measure by computing the ratio of unilateral activity duration of the two limbs. This measure similarly quantifies what the standardized clinical measure for real-world limb use (i.e., the MAL-AOU) aims to measure, and thus, has great potential for providing an accurate measure of limb use in individuals with hemiparesis (e.g., stroke survivors). We anticipate that the proposed sensor system will be most applicable to individuals with mild impairments and functional limitations of the stroke-affected upper limb with impairments and functional limitations primarily affecting the hand [53, 54]. The sensor system will allow clinicians to evaluate the impact in real-life conditions of the prescribed rehabilitation regimen as it will enable evaluating how patients improve their motor performance—in response to the intervention—for bilateral vs. unilateral tasks and fine hand movements vs. gross arm movements. This characteristic of the proposed system could enable individually-tailored, optimal therapeutic interventions [17, 55].
With its ability to continuously monitor upper-limb performance in a free-living environment, wearable technologies have great potential for providing clinicians with a tool suitable to maintain and possibly improve the motor skills recovered during the initial rehabilitation period by developing data-driven personalized interventions. For example, finger-worn sensors could combined with mobile devices (e.g., smart phones) to provide personalized feedback showing current progress and suggesting appropriate goals to promote high-dosage motor practice [56–58]. Despite the imperative need for such a system, the optimal configuration of the intervention components, the individual tailoring of the intervention goals, the design of optimal feedback components, the most suitable medium and timing to deliver feedback, and ways to share data among the stakeholders (patients and clinicians)—remains unknown and warrants future work.
Limitations
One limitation of this study is that the proposed finger-worn sensor cannot explicitly detect and categorize upper-limb movements into 1) purposeful movements aimed to accomplish a goal-directed task vs. 2) non-purposeful movements that are the byproduct of movements of other body segments (e.g., arm swing activity during gait) or other sources of movements (e.g., acceleration of a moving vehicle when riding it). Categorization of upper-limb movements with respect to purpose can provide clinically meaningful information [12]. The proposed index M categorizes the majority of non-purposeful movements as bilateral movements because they often involve both limbs with similar intensity (e.g., arm swing during gait or during sit-to-stand transitions). Riding a moving vehicle may introduce a non-human-generated acceleration that is captured by the sensor data. Although the proposed index M does not specifically identify if a patient is riding in a moving vehicle, the index can still detect unilateral vs. bilateral limb activities in the vehicle, since 1) r[t] is capable of recognizing activity difference levels between the two limbs and 2) the non-human-generated acceleration from the moving vehicle—for instance—is not reflected in the measure because M compares duration of limb activity rather than intensity.
Another limitation of the study is the relatively small sample size. A total of 18 subjects participated in the in-laboratory experiments and another 18 subjects in the free-living experiments. Despite the small sample size, our results show strong evidence of face and convergent validity. The number of left-handed and right-handed subjects who participated in the free-living experiments was not balanced (i.e., 13 subjects were right-handed and 5 were left-handed). However, considering that only 10% of the general population is left-handed [59], we believe that we collected a sufficient sample of left-handed subjects. Furthermore, the results in Fig 5 show a high correlation between the proposed index of real-world limb use M and the handedness indices. It follows that the proposed index can enable the binary classification of left-handed vs. right-handed subjects with 100% accuracy by drawing a vertical line around M = 0. All together, we expect that the proposed technique will generalize to a larger population. Having demonstrated face and convergent validity in this work, future studies will focus on examining the proposed technology in larger populations of older adults (otherwise healthy) and patient populations (e.g. stroke and traumatic brain injury survivors).
Conclusion
This study demonstrates the validity of a novel approach to assess real-world unilateral upper-limb activities using finger-worn accelerometers. The ability of the proposed technology to quantitatively compare the contributions of the upper limbs to the performance of ADLs has tremendous potential for allowing clinicians to evaluate the impact in real-life conditions of the rehabilitation interventions. This is of paramount interest in individuals with upper-limb hemiparesis. We envision that the system will be most applicable to individuals with mild upper-limb impairments and mild functional limitations, and will be used in the clinic in conjunction with other standardized clinical assessment tools to assess how impairments and functional limitations respond to clinical interventions on a subject-by-subject basis.
Acknowledgments
The authors would like to thank the volunteers who participated in the data collections.
References
- 1. Santisteban L, Térémetz M, Bleton JP, Baron JC, Maier MA, Lindberg PG. Upper limb outcome measures used in stroke rehabilitation studies: a systematic literature review. PloS one. 2016;11(5):e0154792. pmid:27152853
- 2. Faria-Fortini I, Michaelsen SM, Cassiano JG, Teixeira-Salmela LF. Upper extremity function in stroke subjects: relationships between the international classification of functioning, disability, and health domains. Journal of Hand Therapy. 2011;24(3):257–265. pmid:21420279
- 3. Shaw SE, Morris DM, Uswatte G, McKay S, Meythaler JM, Taub E. Constraint-induced movement therapy for recovery of upper-limb function following traumatic brain injury. Journal of Rehabilitation Research & Development. 2005;42(6).
- 4. Raven EE, Haverkamp D, Sierevelt IN, Van Montfoort DO, Pöll RG, Blankevoort L, et al. Construct Validity and Reliability of the Disability ofArm, Shoulder and Hand Questionnaire for Upper Extremity Complaints in Rheumatoid Arthritis. The Journal of rheumatology. 2008;35(12):2334–2338. pmid:19004045
- 5. Wolf SL, Lecraw DE, Barton LA, Jann BB. Forced use of hemiplegic upper extremities to reverse the effect of learned nonuse among chronic stroke and head-injured patients. Experimental neurology. 1989;104(2):125–132. pmid:2707361
- 6. Taub E, Uswatte G, Mark V, Morris D. The learned nonuse phenomenon: implications for rehabilitation. Eura Medicophys. 2006;42:241–55. pmid:17039223
- 7. Benjamin EJ, Blaha MJ, Chiuve SE, Cushman M, Das SR, Deo R, et al. Heart disease and stroke statistics—2017 update: a report from the American Heart Association. Circulation. 2017;135(10):e146–e603. pmid:28122885
- 8. Veerbeek JM, Kwakkel G, van Wegen EE, Ket JC, Heymans MW. Early prediction of outcome of activities of daily living after stroke. Stroke. 2011;42(5):1482–1488. pmid:21474812
- 9. Rand D, Eng JJ. Disparity between functional recovery and daily use of the upper and lower extremities during subacute stroke rehabilitation. Neurorehabilitation and neural repair. 2012;26(1):76–84. pmid:21693771
- 10. Rand D, Eng JJ. Predicting daily use of the affected upper extremity 1 year after stroke. Journal of Stroke and Cerebrovascular Diseases. 2015;24(2):274–283. pmid:25533758
- 11. Kunkel A, Kopp B, Müller G, Villringer K, Villringer A, Taub E, et al. Constraint-induced movement therapy for motor recovery in chronic stroke patients. Archives of physical medicine and rehabilitation. 1999;80(6):624–628. pmid:10378486
- 12. Hayward KS, Eng JJ, Boyd LA, Lakhani B, Bernhardt J, Lang CE. Exploring the role of accelerometers in the measurement of real world upper-limb use after stroke. Brain Impairment. 2016;17(1):16–33.
- 13. Bailey RR, Klaesner JW, Lang CE. Quantifying real-world upper-limb activity in nondisabled adults and adults with chronic stroke. Neurorehabilitation and neural repair. 2015;29(10):969–978. pmid:25896988
- 14. Michielsen ME, Selles RW, Stam HJ, Ribbers GM, Bussmann JB. Quantifying nonuse in chronic stroke patients: a study into paretic, nonparetic, and bimanual upper-limb use in daily life. Archives of physical medicine and rehabilitation. 2012;93(11):1975–1981. pmid:22465403
- 15. van der Pas SC, Verbunt JA, Breukelaar DE, van Woerden R, Seelen HA. Assessment of arm activity using triaxial accelerometry in patients with a stroke. Archives of physical medicine and rehabilitation. 2011;92(9):1437–1442. pmid:21878214
- 16. Wei WX, Fong KN, Chung RC, Myint JM, Cheung HK, Chow ES. Utility of a unilateral accelerometer for monitoring upper extremity use in subacute stroke patients after discharge from hospital. Assistive Technology. 2018;p. 1–6.
- 17. Bailey RR, Klaesner JW, Lang CE. An accelerometry-based methodology for assessment of real-world bilateral upper extremity activity. PloS one. 2014;9(7):e103135. pmid:25068258
- 18. Rand D, Eng JJ. Arm–hand use in healthy older adults. American Journal of Occupational Therapy. 2010;64(6):877–885. pmid:21218678
- 19. Lang CE, Waddell KJ, Klaesner JW, Bland MD. A method for quantifying upper limb performance in daily life using accelerometers. Journal of visualized experiments: JoVE. 2017;(122).
- 20. Lang CE, Wagner JM, Edwards DF, Dromerick AW. Upper extremity use in people with hemiparesis in the first few weeks after stroke. Journal of Neurologic Physical Therapy. 2007;31(2):56–63. pmid:17558358
- 21. Thrane G, Emaus N, Askim T, Anke A. Arm use in patients with subacute stroke monitored by accelerometry: association with motor impairment and influence on self-dependence. Journal of rehabilitation medicine. 2011;43(4):299–304. pmid:21347506
- 22. Bailey RR, Lang CE. Upper extremity activity in adults: referent values using accelerometry. Journal of rehabilitation research and development. 2014;50(9):1213.
- 23. Urbin M, Hong X, Lang CE, Carter AR. Resting-state functional connectivity and its association with multiple domains of upper-extremity function in chronic stroke. Neurorehabilitation and neural repair. 2014;28(8):761–769. pmid:24553104
- 24. Uswatte G, Miltner WH, Foo B, Varma M, Moran S, Taub E. Objective measurement of functional upper-extremity movement using accelerometer recordings transformed with a threshold filter. Stroke. 2000;31(3):662–667. pmid:10700501
- 25. Wang Tn, Lin Kc, Wu Cy, Chung Cy, Pei Yc, Teng Yk. Validity, responsiveness, and clinically important difference of the ABILHAND questionnaire in patients with stroke. Archives of physical medicine and rehabilitation. 2011;92(7):1086–1091. pmid:21704789
- 26. Taub E, Uswatte G, Bowman MH, Mark VW, Delgado A, Bryson C, et al. Constraint-induced movement therapy combined with conventional neurorehabilitation techniques in chronic stroke patients with plegic hands: a case series. Archives of physical medicine and rehabilitation. 2013;94(1):86–94. pmid:22922823
- 27. Liao Ww, Wu Cy, Hsieh Yw, Lin Kc, Chang Wy. Effects of robot-assisted upper limb rehabilitation on daily function and real-world arm activity in patients with chronic stroke: a randomized controlled trial. Clinical Rehabilitation. 2012;26(2):111–120. pmid:21840917
- 28. Urbin M, Bailey RR, Lang CE. Validity of body-worn sensor acceleration metrics to index upper extremity function in hemiparetic stroke. Journal of neurologic physical therapy: JNPT. 2015;39(2):111. pmid:25742378
- 29. Leuenberger K, Gonzenbach R, Wachter S, Luft A, Gassert R. A method to qualitatively assess arm use in stroke survivors in the home environment. Medical & biological engineering & computing. 2017;55(1):141–150.
- 30. Kilbreath SL, Heard RC. Frequency of hand use in healthy older persons. Australian Journal of Physiotherapy. 2005;51(2):119–122. pmid:15924514
- 31. Carbonaro N, Dalle Mura G, Lorussi F, Paradiso R, De Rossi D, Tognetti A. Exploiting wearable goniometer technology for motion sensing gloves. IEEE journal of biomedical and health informatics. 2014;18(6):1788–1795. pmid:24835230
- 32. Lin BS, Hsiao PC, Yang SY, Su CS, Lee IJ. Data Glove System Embedded with Inertial Measurement Units for Hand Function Evaluation in Stroke Patients. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2017;25(11):2204–2213. pmid:28678709
- 33. Repnik E, Puh U, Goljar N, Munih M, Mihelj M. Using Inertial Measurement Units and Electromyography to Quantify Movement during Action Research Arm Test Execution. Sensors. 2018;18(9):2767.
- 34. Yang G, Deng J, Pang G, Zhang H, Li J, Deng B, et al. An IoT-Enabled Stroke Rehabilitation System Based on Smart Wearable Armband and Machine Learning. IEEE journal of translational engineering in health and medicine. 2018;6:1–10.
- 35. Friedman N, Rowe JB, Reinkensmeyer DJ, Bachman M. The manumeter: a wearable device for monitoring daily use of the wrist and fingers. IEEE journal of biomedical and health informatics. 2014;18(6):1804–1812. pmid:25014974
- 36. Liu X, Rajan S, Ramasarma N, Bonato P, Lee SI. The Use of A Finger-Worn Accelerometer for Monitoring of Hand Use in Ambulatory Settings. IEEE Journal of Biomedical and Health Informatics. 2018;p. 1–1.
- 37.
Liu X, Rajan S, Hollander G, Ramasarma N, Bonato P, Lee SI. A Novel Finger-Worn Sensor for Ambulatory Monitoring of Hand Use. In: Connected Health: Applications, Systems and Engineering Technologies (CHASE), 2017 IEEE/ACM International Conference on. IEEE; 2017. p. 276–277.
- 38. Rajan S, Liu X, Ramasarma N, Bonato P, Lee S. A Finger-Worn Ring Sensor to Capture Hand Movements in an Ambulatory Setting. Archives of Physical Medicine and Rehabilitation. 2017;98(10):e26.
- 39.
Liu X, Rajan S, Ramasarma N, Bonato P, Lee SI. Finger-Worn Sensors for Accurate Functional Assessment of the Upper Limbs in Real-World Setting. In: Engineering in Medicine and Biology Society (EMBC), 2018 IEEE 40th Annual International Conference of the. IEEE; 2018.
- 40. Waller SM, Whitall J. Bilateral arm training: why and who benefits? NeuroRehabilitation. 2008;23(1):29–41.
- 41. Obrzut JE, Dalby PR, Boliek CA, Cannon GE. Factorial structure of the Waterloo Handedness Questionnaire for control and learning-disabled adults. Journal of clinical and experimental neuropsychology. 1992;14(6):935–950. pmid:1452639
- 42. Cavill S, Bryden P. Development of handedness: comparison of questionnaire and performance-based measures of preference. Brain and cognition. 2003;53(2):149–151. pmid:14607136
- 43. Alphonso K, Roy EA, Bryden PJ, Balkowski B, Mayer M, Kuehner Z. Preference and performance measures of handedness: The effect of task complexity. Brain and Cognition. 2008;67:11.
- 44. Fazio R, Dunham KJ, Griswold S, Denney RL. An improved measure of handedness: the Fazio laterality inventory. Applied Neuropsychology: Adult. 2013;20(3):197–202.
- 45. Fazio RL, Cantor JM. Factor structure of the Edinburgh Handedness Inventory versus the Fazio Laterality Inventory in a population with established atypical handedness. Applied Neuropsychology: Adult. 2015;22(2):156–160.
- 46. Uswatte G, Giuliani C, Winstein C, Zeringue A, Hobbs L, Wolf SL. Validity of accelerometry for monitoring real-world arm activity in patients with subacute stroke: evidence from the extremity constraint-induced therapy evaluation trial. Archives of physical medicine and rehabilitation. 2006;87(10):1340–1345. pmid:17023243
- 47. Uswatte G, Taub E, Morris D, Light K, Thompson P. The Motor Activity Log-28 assessing daily use of the hemiparetic arm after stroke. Neurology. 2006;67(7):1189–1194. pmid:17030751
- 48. Waddell KJ, Lang CE. Comparison of Self-Report Versus Sensor-Based Methods for Measuring the Amount of Upper Limb Activity Outside the Clinic. Archives of physical medicine and rehabilitation. 2018. pmid:29408483
- 49. Uswatte G, Taub E, Morris D, Vignolo M, McCulloch K. Reliability and validity of the upper-extremity Motor Activity Log-14 for measuring real-world arm use. Stroke. 2005;36(11):2493–2496. pmid:16224078
- 50.
Taub E, McCulloch K, Uswatte G, Morris DM, Bowman M, Crago J, et al. Motor activity log (mal) manual. 2011.
- 51. Noorkõiv M, Rodgers H, Price CI. Accelerometer measurement of upper extremity movement after stroke: a systematic review of clinical studies. Journal of neuroengineering and rehabilitation. 2014;11(1):144. pmid:25297823
- 52. Steenhuis R. The relation between hand preference and hand performance: What you get depends on what you measure. Laterality: Asymmetries of Body, Brain and Cognition. 1999;4(1):3–26.
- 53. Nakashima N, Miyasaka H, Kondo I, Iwata K, Uematsu H, Yamamura C, et al. The relationship between proximal function of the upper extremity on the paralyzed side and upper extremity skills in daily life of subacute stroke patients. Japanese Journal of Comprehensive Rehabilitation Science. 2017;8:44–50.
- 54. Hsieh Yw, Lin Kc, Wu Cy, Shih Ty, Li Mw, Chen Cl. Comparison of proximal versus distal upper-limb robotic rehabilitation on motor performance after stroke: a cluster controlled trial. Scientific reports. 2018;8(1):2091. pmid:29391492
- 55. Lee SI, Adans-Dester CP, Grimaldi M, Dowling AV, Horak PC, Black-Schaffer RM, et al. Enabling Stroke Rehabilitation in Home and Community Settings: A Wearable Sensor-Based Approach for Upper-Limb Motor Training. IEEE Journal of Translational Engineering in Health and Medicine. 2018;6:1–11.
- 56.
Markopoulos P, Timmermans AA, Beursgens L, Van Donselaar R, Seelen HA. Us’ em: The user-centered design of a device for motivating stroke patients to use their impaired arm-hand in daily life activities. In: Engineering in Medicine and Biology Society, EMBC, 2011 Annual International Conference of the IEEE. IEEE; 2011. p. 5182–5187.
- 57.
Luster EL, McDaniel T, Fakhri B, Davis J, Goldberg M, Bala S, et al. Vibrotactile cueing using wearable computers for overcoming learned non-use in chronic stroke. In: Proceedings of the 7th International Conference on Pervasive Computing Technologies for Healthcare. ICST (Institute for Computer Sciences, Social-Informatics and Telecommunications Engineering); 2013. p. 378–381.
- 58. Held JP, Luft AR, Veerbeek JM. Encouragement-induced real-World upper limb use after Stroke by a tracking and Feedback device: a Study Protocol for a Multi-Center, assessor-Blinded, randomized Controlled trial. Frontiers in neurology. 2018;9:13. pmid:29422881
- 59. Hardyck C, Petrinovich LF. Left-handedness. Psychological bulletin. 1977;84(3):385. pmid:859955