Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Force field generalization and the internal representation of motor learning

  • Alireza Rezazadeh ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    arezaz2@uic.edu

    Affiliation Department of Mechanical and Industrial Engineering, University of Illinois at Chicago, Chicago, IL, United States of America

  • Max Berniker

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Supervision, Writing – original draft, Writing – review & editing

    Affiliation Department of Mechanical and Industrial Engineering, University of Illinois at Chicago, Chicago, IL, United States of America

Force field generalization and the internal representation of motor learning

  • Alireza Rezazadeh, 
  • Max Berniker
PLOS
x

Abstract

When learning a new motor behavior, e.g. reaching in a force field, the nervous system builds an internal representation. Examining how subsequent reaches in unpracticed directions generalize reveals this representation. Although often studied, it is not known how this representation changes across training directions, or how changes in reach direction and the corresponding changes in limb impedance, influence these measurements. We ran a force field adaptation experiment using eight groups of subjects each trained on one of eight standard directions and then tested for generalization in the remaining seven directions. Generalization in all directions was local and asymmetric, providing limited and unequal transfer to the left and right side of the trained target. These asymmetries were not consistent in either magnitude or direction, even after correcting for changes in limb impedance. Relying on a standard model for generalization the inferred representations inconsistently shifted to one side or the other of their respective training direction. A second model that accounted for limb impedance and variations in baseline trajectories explained more data and the inferred representations were centered on their respective training directions. Our results highlight the influence of limb mechanics and impedance on psychophysical measurements and their interpretations for motor learning.

Introduction

Learning a new motor behavior entails building an internal model [13]. This internal model, or representation, allows us to perform the learned task now and at future times. Importantly, it also enables us to generalize what we have learned to new, unpracticed circumstances. Experimental studies exploit this ability to measure the internal representation of a motor task. For example, after learning to make a reach in a force field, subjects are asked to reach to new directions [47]. The resulting movements and forces subjects apply in these new directions are used to infer their representation of the learned force field. This standard approach is frequently used to examine the internal representation in a variety of motor tasks including movements with force [810] or visual perturbations [11, 12].

Prior work on velocity-dependent force fields has found narrow generalization curves, indicating adaptation in a single direction is local and only benefits movements made in nearby directions, usually no more than 45° from the trained direction [5, 6, 8, 1315]. Generalization curves are often asymmetric as well, indicating that the representation of a learned force field does not decay symmetrically to the left or right side of the trained direction [7, 10]. Differing explanations have been offered in terms of whether the learned representation is associated with the intended, or actual, reaches made [8], or whether variations in motor errors due to limb stiffness can account for these changes [7]. Still other studies do not find asymmetries [6]. As such, many important questions regarding the learned representation remain unanswered.

Despite the many studies examining generalization, previous work has mostly been limited to a small number of reaching conditions; usually training in a single standard direction. Whether or not the aforementioned findings hold for other reach directions remains unverified. Additionally, how the mechanics of the limb itself influence these generalization measurements has not been examined. Changes in limb impedance, either due to changes in movement direction or due to newly adapted motor commands, will necessarily influence the dynamics of the limb [16, 17]. It is not clear how these changes may influence generalization measurements and in turn our estimates of the internal representation.

We performed a force field adaptation experiment using eight groups of subjects each practicing movement in one of eight directions. After adapting we measured their ability to generalize in the remaining seven directions using error-clamps. Examining adaptation and generalization in all eight directions allowed us to correct for changes in limb impedance across reach directions. We found local and asymmetric generalization curves in all eight directions. However, these asymmetries were not consistent in magnitude, strength, or direction, calling into question previous explanations for how the internal representation is acquired. Using the standard assumption that adapted forces are a "read-out" of the representation (the estimated force field strength), we found that they inconsistently shifted to the left or right side of the training directions. A second model accounting for limb dynamics and the details of unperturbed trajectories was able to explain both baseline and post adaptation forces. The inferred representations were more consistent and centered on the training directions. Our results highlight the influence of limb mechanics on psychophysical measurements, and how these influences can alter interpretations of motor learning.

Methods

Subjects

80 right-handed subjects (25±4.4 years old, 21 females) participated in this experiment. Right handedness was assessed using the Edinburgh inventory [18]. All subjects had normal or corrected-to-normal vision, no history of motor deficits and were naïve to the purpose of the study. All experimental protocols were approved by University of Illinois at Chicago Institutional Review Board. Subjects provided written informed consent before participation and were compensated using a baseline salary and bonus based on performance (for a minimum of $10 and a maximum of $20).

Experiment overview

Subjects held the handle of a robotic manipulandum with their right hand while seated in a height-adjustable chair in front of a vertical LCD display (Fig 1A). The location of the chair was adjusted for each subject such that when their limb was in the center of the workspace it was in a standard configuration (shoulder angle of 45° and a relative elbow angle of 90°). The chair height was adjusted to keep the upper and lower arm approximately in a plane aligned with the robot handle. Their upper and lower arms were suspended from the ceiling using height-adjustable sling to limit the effect of gravity and prevent fatigue.

thumbnail
Fig 1. Experimental Setup and Generalization Curves.

(A) Subjects made reaches in a null field, a curl field or an error-clamp. After landing on target the robot brought their hand back to the center position. (B) Eight standard targets were located 10-cm away from a home target. Each of eight groups practiced reaching in a CW force field towards one of the eight targets (the gray dashed line depicts a reach in the field to the 45° target) and then tested for generalization to all remaining targets using error-clamp trials. (C) A schematic of the internal representation of the learned force field for the 45° target group. The curve depicts a subject's estimated strength of the force field in polar coordinates (green contour). (D) Using this estimate the limb makes a generalization reach. Combining the measurements made from many such reaches after training on the 45° target constitutes an intra-representation generalization curve (green circles). These measurements are influenced by both the force field estimate and changes in limb impedance with reach direction. (E) Schematic of representations from three groups of subjects learning the field for the 0° (blue contour), 45° (green contour), and 90° (red contour) targets. (F) Combining the measurements made across all three groups when reaching to the same 45° target constitutes an intra-representation generalization curve. This curve corrects for the changes in reach direction.

https://doi.org/10.1371/journal.pone.0225002.g001

All trials began with the subject’s hand resting in a center position (the home target), until a target appeared on the screen. Subjects were instructed to reach with one fast, smooth motion to the target as soon as it appeared. Once inside the target and after a small delay the robot smoothly returned their hand back to the center position. After a small random delay, the next trial would begin.

All Targets were 10-mm diameter circles, spaced 45° apart, on a 10-cm radius circle centered on the home position (Fig 1B). Visual feedback of the hand was provided with a 10-mm diameter white cursor accurately depicting the hand’s relative displacement in the workspace. Successful trials landed within the target and within a specified time window (300-450ms). To provide feedback on performance, visual and audio feedback were given after each reach. Targets were initially displayed as yellow circles, but changed to blue, red, or green when the reach was too slow, too fast, or within the desired time, respectively. Once they came to a complete stop (speed<2cm/s) an auditory tone was emitted: 1KHz if too slow, 20KHz if too fast and 10KHz if on time. Successful reaches were awarded a point and their running score was advanced on the screen’s display.

On each trial the robot would provide either a force field or catch trials with either a null field or an error-clamp. The force field was a velocity-dependent clockwise curl field (15Ns/m). The null field attempted to rendered zero forces at the handle of the robot. Error-clamp trials constrained the hand’s motion along a straight channel connecting the home and target locations. In addition to these three force conditions, each trial either provided continuous visual feedback of the hand location, or the hand’s location was extinguished when the target appeared and didn’t appear again until the hand came to a complete stop.

Experimental protocol

Eighty subjects were randomly assigned to eight groups, each practicing reaches in the force field to one of eight training directions (0°, 45°, 90°, 135°, 180°, 225°, 270°, 315°). The experiment was divided into four blocks. The 1st block (baseline) was to familiarize subjects with the task and collect baseline measurements. 208 trials (26/target) to all eight targets were presented in a pseudo-random order. Trials were made under the null field condition with feedback of the hand location, except for a randomly ordered 24 trials (3/target) that were error-clamp trials without visual feedback of the hand.

Next were two identical adaptation blocks (3rd and 4th), where subjects practiced reaching to their assigned training target repeatedly. These were either force field trials or catch trials with an error-clamp to assess adaptation and performance. Each block was 65 trials, 60 of which were force field trials, of which 15 had the feedback extinguished. The remaining 5 trials were error-clamps without visual feedback. By extinguishing feedback randomly during force field and catch trials we eliminated the chance of subjects predicting the error-clamp trials. Subjects had a short rest period (3-5mins) between the two blocks of adaptation.

The 4th block (testing) was used to measure the ability to generalize the learned force field to new reach directions. 210 reaches were made, repeatedly switching from the training target to one of the seven remaining test targets. This allowed us to test a subject’s ability to generalize the learned force field to all directions while preventing washout of the adapted behavior. All 105 reaches (15/target) to test targets were made in error-clamps without visual feedback. Of the remaining 105 trials with the train target, 53 had the field and feedback of the hand, 26 had the field and no feedback, and 26 were error-clamp trials without feedback. As with blocks 2 and 3, by mixing force and feedback conditions we ensured subjects could not distinguish between error clamp and force field trials.

Experimental apparatus

Reaches were made with a two-joint robotic manipulandum (KINARM End-point robot, BKIN Technologies, ON, CA) with custom software written explicitly for this experiment running in real-time at 2KHz. Hand location and end-point forces (using a transducer at the handle) were measured and stored for post-processing at 1KHz.

The curl field was defined as, (1) where Fx and Fy are the x and y-components of the field and vx and vy are the hand’s velocity, and α = 15Ns/m, is the strength of the clockwise force field. The error-clamp was rendered by creating a virtual channel along a straight line between the home position and the target [19]. The width of this channel was 1mm and bounded on either side by stiff walls created with a virtual spring (5KN/m) and damper (5Ns/m), that only pushed the hand inwards towards the channel.

To render an accurate desired force at the handle of the robot, a low-gain force-feedback loop was used to compensate for the manipulandum's inertia. The commanded forces were (2) where K was 0.5 for the null field and 0.75 for the force field.

Data analysis

The velocity of the hand was computed by discretely differentiating the measured hand position and then smoothing with a 50Hz, 2nd order Butterworth filter. Using the hand’s velocity, each trial’s starting time (velocity> 5cm/s) and stopping time (velocity < 2cm/s) were determined. For each trial the maximum perpendicular error (PE) was computed as the maximum deviation of the hand’s path from a straight line connecting the reach starting location and the target location.

Adaptation indices were computed to measure how accurately subjects predicted the force field. For each error-clamp trial, forces applied to the walls of the channel were linearly regressed against the correct forces associated with the hand’s velocity within the trial’s starting and stopping time. The result of this regression was then divided by the field’s actual strength, 15Ns/m. The index is equal to one if the channel forces exactly matched the force field profile, and zero if there were no forces applied to the channel walls.

Using these indices, we computed two generalization curves. The traditional curve depicts how the indices vary as subjects reach to test targets rotated away from the training direction. We refer to these curves as intra-generalization (intra-gen) curves (Fig 1E). To control for changes specific to reach directions, we also present curves that depict how adaptation indices vary as the training direction rotates away from a fixed test target. We refer to these as inter-generalization (inter-gen) curves (Fig 1F).

Modeling the learned representation

As is common, the dynamics of the limb were modeled as a rigid two-link mechanism (Fig 1B), accelerated by self-generated commanded torques (τ), and the experimental forces (Fexp), (3) where q is a vector of shoulder and elbow angles, I(q) is the inertia matrix, C(q, q) is a matrix of Coriolis and centripetal accelerations, and J is the end-point Jacobian. The arm’s parameters were selected based on averages reported in previous work (m1 = 1.93 Kg, m2 = 1.52 Kg, r1 = 0.165 m, r2 = 0.19 m, l1 = 0.33 m, l2 = 0.34 m, [3, 20].

The standard model.

A common assumption in force field generalization studies is that subjects intend to move along straight paths and the forces measured in error-clamp trials are a direct read-out of what subjects have learned; that is, forces are the subject’s estimate of the force field [9, 10, 21]. The same reasoning suggests that channel forces measured in baseline should be close to zero, since the subjects are not yet aware of a field, and any deviations from it are due to noise or some constant offset. Therefore, these baseline measurements (pre-adaptation) are subtracted from those made in error-clamp trials after training (post-adaptation), to measure a subject’s learned representation of the force field.

This representation is often quantified in terms of the measured adaptation index. Since the adaptation index decays as the reaching direction changes relative to the trained direction, the conventional form for modeling this representation is a Gaussian-like function: (4) where θ is the reach direction, and the free parameters of this model are the amplitude (A), the width (σ), and an offset (μ) relative to the training direction (θj). The index, j, varies from one to eight, to account for the eight training groups and their respective targets. Thus, the internal representation is assumed to be an estimate of the force field’s strength, , which varies over changes in reach direction relative to the training direction.

We assume the self-generated torque (τ) in Eq 1 is a feed-forward command that drives the limb along a nominal minimum jerk trajectory while compensating for the estimated field.

(5)

Note that since the desired trajectory is always a straight line, feedback terms would not influence the movement or forces in the error clamps, and are thus not included. Furthermore, according to this model and its assumption of desired straight reaches, the baseline corrected channel forces should be a direct read-out of the estimated force field.

The limb impedance model.

Channel forces measured in the error-clamp trials, while likely containing an estimate of the force field, may also be influenced by the mechanics of the limb itself. If a subject's intended movement is not perfectly straight channel forces are a combination of the forces produced to counter the field and the limb's impedance. Recognizing this, we sought an alternative model to infer the learned representation.

In this second model we assumed the self-generated torque is composed of two components, a feed-forward term to compensate for the limb's own dynamics and the estimated field, and a feed-back term to keep the limb stable when perturbed, τ = τff + τfb where, (6) (7)

The nominal values for the feedback gains were determined from impedance of the arm reported in previous work [3, 20], but scaled by constant terms to account for changes before and after adaptation; stiffness: K = αk [32, 16; 16, 21]Nm/rad, damping: B = αb [5,3; 3,4]Nms/rad.

Importantly, we made two additional assumptions. First, we assumed the representation for the learned field had no offset, but was instead centered on the learning direction, (8)

Second, we did not assume that subjects’ nominal reaches were perfectly straight. Instead, we assumed the average baseline movements were the desired movements, qdesired (t) = qbaseline (t). For this model the free parameters are the amplitude (A), and width (σ) of the representation, and two scaling factors for the stiffness and damping matrices (αk and αb).

With each model, we could simulate reaches and their channel forces in either baseline or generalization trials. The resulting forces could then be regressed to obtain simulated adaptation indices for each training group. Parameters for both models were found by minimizing the negative log-likelihood of the adaptation index data. Model comparisons were made using the corrected Akaike Information Criterion (AICc) and the Root-Mean-Square error (RMSE). Significance levels were set to 0.05 for all statistical tests. All code was custom written in MATLAB.

Results

To probe the underlying representation of a learned force field, subjects were randomly assigned to learn a curl field in one of eight standard directions and then tested for the ability to generalize in the remaining seven directions using error-clamp trials. The results were used to build standard generalization curves and new generalization curves that control for changes in reach direction. These curves were then used to infer the underlying representation of a newly learned force field.

All subjects began by performing a baseline block to characterize their unperturbed trajectories and initial error-clamp forces. Reaches were made in a null field with and without visual feedback, or error-clamp trials without feedback (see Methods). Not surprisingly, reaches made with visual feedback were relatively straight (Fig 2A). Perpendicular errors, though relatively small (ranging from 3.66 to 11.58mm) were not uniform across reach directions (one-way ANOVA, F (7,10923) = 169.7, p < 10E-16, see Fig 2B). Errors were larger in directions of small arm stiffness (45° and 225°) and smaller in directions of large stiffness (135° and 315°). This pattern of errors is consistent with the long-held notion that the limb’s stiffness can assist in producing straight paths [22, 23].

thumbnail
Fig 2. Experiment’s behavioral results.

(A) Baseline reaches in null field made with visual feedback (across-subject averages ± SEM). Reaches slightly deviate from a straight path (gray dashed lines). (B) Baseline perpendicular errors averaged across subjects. (C) Across-subject average perpendicular errors (±SEM) are plotted across all trials of the experiment. Only error-clamp trials are excluded. Subjects practiced reaching in force field during the 2nd and 3rd blocks with a brief rest between. (D) Baseline adaptation index averaged across subjects. Note the qualitatively similar shape to the perpendicular errors in B. (E) Force field learning curve averaged across all subjects and all reach directions. Mean values to the training targets (±SEM) are plotted across error-clamp trials. (F) Early adaptation perpendicular errors (mean ±SEM of first 20 trials) are averaged across subjects and overlaid on a hand stiffness ellipse from [7]. Note the qualitatively similar shapes of errors and hand stiffness.

https://doi.org/10.1371/journal.pone.0225002.g002

Baseline error-clamp trials, measuring endpoint forces before subjects were exposed to the force field served as a point of reference from which to gauge subsequent adaptation. Averaging across the eight groups of subjects we found baseline indices that varied considerably and were significantly different from zero for several directions (e.g. targets 45° and 225°, Fig 2D). Across reach directions, baseline perpendicular errors and adaptation indices were strongly correlated (r = 0.93, p = 7E-4). This finding is likely a direct result of the reach kinematics, since movements with nominal deviations from a straight line should elicit non-zero adaptation indices. Perhaps more interesting, however, was the finding that all the adaptation indices that were significantly different from zero were also positive. That is, despite the fact that subjects were making unperturbed reaches and had not yet been exposed to the field, the adaptation indices indicated that subjects were partially compensating for a, yet to be experienced, clockwise curl field.

After baseline, subjects practiced reaching in the curl field with two blocks of 65 trials (130 trials in total). As expected, early reaches were curved with typical “hook” shaped trajectories, but by the end of the second adaptation block were relatively straight. To quantify these changes in trajectories we compared perpendicular errors. Early errors were significantly larger than baseline (averaged last 20 trials in baseline compared with the averaged first 20 trials in the force field across all subjects: paired t-test, t (79) = 16.32, p < 10E-26). The errors gradually decreased although no clear plateau in this metric was observed (Fig 2C). Late training perpendicular errors were not similar to those made in the late baseline (averaged last 20 trials in the field compared with the averaged last 20 trials in baseline: t (79) = 6.36, p = 1.19E-5). Adaptation indices gradually increased to an average of 0.92 ± 0.05 (Fig 2E). Therefore, despite no clear plateau in perpendicular errors, force profile’s indicated a near complete compensation for the field, somewhat higher than similar adaptation studies [24, 25].

Comparing errors across groups, there was an evident directional difference in the movement curvature during early adaptation (Fig 2F). As has been observed elsewhere, movement errors were lower when the arm was perturbed in the directions of larger limb stiffness [7]. Along with the baseline adaptation indices, this is further evidence of the role limb impedance plays in adapted behavior and the importance of taking this into account when interpreting learning.

Next, subjects performed a test block measuring their ability to generalize. Subjects repeatedly reached to their training target and then one of the seven remaining targets in error-clamp trials. Repeated switching from the test target to the training target allowed subjects to retain their familiarity with the force field throughout this block.

Error-clamp data from these two test blocks was used to compute generalization curves, which ultimately were used to infer subjects' learned representations of the field. To this end, two generalization curves were created. Intra-representation generalization (or intra-generalization for brevity) curves, quantify the extent to which learning generalizes from a trained direction, to new (test target) directions (Fig 3A). Though these are the conventional curves for measuring generalization, combining measurements across changes in reach direction necessarily requires changes in limb posture and impedance. It is not clear if or how these changes in limb impedance influence the resulting force channel measurements. With this in mind a second set of generalization measurements were made, mitigating the influence of changes in limb impedance by only comparing reaches to the same target. Inter-representation generalization (inter-generalization) curves quantify the extent to which learning generalizes to a single test direction, after training in one of any neighboring (train target) directions (Fig 3B). With these two sets of curves we were able to perform a thorough examination of generalization and the possible effects due to limb impedance.

thumbnail
Fig 3. Generalization of the velocity dependent force field.

(A) Intra-generalization curves (across-subject average ±SEM), quantifying the extent that learning the force field in a single training direction generalizes to all neighboring test directions. Each panel displays post-adaptation (PA) indices measured in the test block (green curves) along with baseline corrected (BC) adaptation indices (blue curves) as a function of relative angular distance of test targets relative to the training target. Adaptation indices for ±180° are identical. Asymmetry for each training direction is quantified as the difference between the neighboring adaptation indices (-45° from +45°) for post-adaptation and baseline corrected data (center panel). (B) Inter-generalization curves, quantifying the extent that learning the force field in any single neighboring direction generalizes to a testing direction. Each panel is displays post adaptation (PA) indices measured in the test block (green curves) together with baseline corrected (BC) adaptation indices (blue curves) as a function of the relative angular distance from the test target. Asymmetry for each curve is also shown (center panel). Asterisks indicate significant differences from zero (* = p < 0.5, ** = p < 0.01).

https://doi.org/10.1371/journal.pone.0225002.g003

Intra-generalization curves, less their baseline contributions, were local; adaptation to the force field provided little assistance to movements separated by more than 45° from a training direction (Fig 3A). As has been reported elsewhere [7, 10], these curves were also asymmetric; the ability to generalize a learned force field did not decay equally in the left and right side of the trained direction. We quantified this asymmetry by computing the difference in the neighboring adaptation indices (-45° from +45°) for each training direction (Fig 3A).

The asymmetries for each training direction were different in size and magnitude. That is, although learning the force field in some directions (such as upright, 90°) generalized more to the counter clock-wise neighboring target, learning in other directions (such as the upper left, 135° target) generalized more to the clock-wise adjacent target. The asymmetry was significant for three of the eight training directions in the post-adaptation intra-gen curves (two sample t-test, 135°: t(18) = 2.8850, p = 0.0099, 180°: t(18) = -2.5476, p = 0.0202, 315°: t(18) = 2.1100, p = 0.0174). Baseline corrected intra-gen curves were also significantly asymmetric for three out of eight training directions, two of which were similar to the uncorrected curve’s directions (two-sample t-test, 135°: t(18) = 2.6386, p = 0.0167, 225°: t(18) = 2.6181, p = 0.0057, 315°: t(18) = 2.1100, p = 0.0491). Although we observed an asymmetry similar to that previously reported for the 0° training target [8, 10], in general these asymmetries were not sufficiently consistent for an obvious interpretation.

Inter-generalization curves were also local and asymmetric (Fig 3B). As with the intra-gen curves, the distance over which adaptation benefits movements to new directions fell off sharply after 45°. Inter-generalization asymmetries indicate that adapting to one side of a reach may be more beneficial than adapting to the other side. The asymmetries were inconsistent in size and magnitude (Fig 3B). Post-adaptation inter-gen curves were significantly asymmetric for only two out of eight test directions (two-sample t-test, 180°: t(18) = 3.6035, p = 0.0020, 270°: t(18) = -2.5960, p = 0.0183). Also, baseline corrected intra-gen curves were significantly asymmetric in the same directions (two-sample t-test, 180°: t(18) = 3.0611, p = 0.0067, 270°: t(18) = -3.0808, p = 0.0064). As with the previous intra-gen curves, there was no clear indication as to explain the inter-generalization asymmetries. Despite the differences in the asymmetries, both the intra- and inter-generalization curves were largely similar, suggesting that the uncontrolled changes in limb impedance did not have a qualitative influence on their measurements.

We then used the generalization data to infer the underlying representations subjects obtained through adaptation. First, we used a standard interpretation for the data. Assuming subjects intend to make perfectly straight reaches, and compensate precisely according to their estimate, the channel forces are a direct read-out of a subject's estimate of the force field (though equal and opposite). A model coupling the limb and the subject’s representation could simulate error-clamp trials, the resulting forces and predicted adaptation indices (see Standard Model, Methods). By fitting these predictions to the generalization data, we could then infer each group’s representation of the field. This was done for each of the eight groups by maximizing the log-likelihood of the adaptation index. The resulting representations were subjects’ estimates of the force field strength as a function of reach direction.

This first model accurately fit the baseline corrected generalization data, with low error and a high goodness of fit (see Fig 4B, RMSE = 0.107, AICc = -73.08). Naively we anticipated these representations would be largely the same for each group, since all the subjects adapted to the same force field, and the generalization curves were grossly similar. However, by fitting small variations in the generalization curves the inferred representations had many differences (Fig 4C–4E).

thumbnail
Fig 4. Standard model results.

(A) Experimental and model-predictions for post-adaptation inter- generalization data (blue and cyan respectively). Experimental baseline indices are added to the model’s predictions for comparison. Predicted asymmetries alongside their experimental counterparts (center panel). (B) The inferred representations are shown in polar coordinates for each of eight directions. The representation widths, σ (C) magnitudes, A (D) and offsets, μ (E) for each training direction are shown. Note the inconsistent shift of the representations to the clockwise and counterclockwise side relative to training directions.

https://doi.org/10.1371/journal.pone.0225002.g004

The "width" of the representations varied from group to group (average 33.67°±13.10°), the widest (90° target) being 44.53°, and the narrowest (225° target) being only 3.93°. The center of these representations was similarly variable (average 4.22°±6.92°), and the offsets were both clockwise and counterclockwise. Since the representations were not centered on the training targets, each representation’s amplitude did not coincide with the training target’s measured adaptation index, but instead varied so as to best fit the data. Indeed, some amplitudes were larger (A = 1.39 for the 315° target) and others smaller (A = 0.69 for the 225° target) than unity, while mean of the amplitudes was 0.98±0.25, larger than the mean of the train target adaptation indices (0.92). That is, a best fit to the data found that the inferred representations were often much larger than the actual strength of the field.

As a further test of the standard model, we calculated the model’s prediction for the uncorrected inter-gen curves. To do so, we used the standard model’s premise that post-adaptation force measurements are a superposition of the estimated field and the baseline forces. Therefore, we added the baseline adaptation indices to the standard model’s prediction of baseline corrected data for predictions of uncorrected data (Fig 4A). The standard model made precise predictions for the post-adaptation data (RMSE = 0.109, AICc = -67.44). Next, we calculated asymmetries and compared them with their experimental counterparts in the inter-gen curves. The mean experimental asymmetry was significantly different from only one of the eight standard model predictions (target 0°: t-test, t(9) = 3.46, p = 0.0072). To be clear, the predicted asymmetry in this model was due to the combination of offset and amplitude, so the offset itself was not merely a fit to the experimental asymmetry.

There are a number of assumptions with the standard model that are cause for concern. For example, according to this model subjects should make straight reaches and apply negligible forces in baseline error-clamp trials, whereas we found systematic non-zero baseline perpendicular errors and error-clamp forces (Fig 2D). It is tempting to dismiss this critique, since baseline trajectories are of course not perfectly straight, so non-zero forces should be observed (owing to the limb’s impedance). Yet this calls into question what error-clamp trials are actually measuring. If the intended movement is not perfectly straight, how does the limb’s impedance influence error-clamp forces? And, since the limb’s impedance changes with both posture, and commands, both of which change during testing and adaptation, how will these features influence the measured forces? Questions such as these must be addressed before we can properly infer what subjects learn.

Motivated by these questions, we examined a second model (see Limb Impedance Model, Methods), that did not assume the desired movements were planned to be straight, but in fact the movements observed during baseline. As a direct consequence of this assumption, the model must include limb stiffness and damping to predict channel forces. To allow for the fact that impedance changes with changes in commands, we included two sets of free parameters to scale the stiffness and damping before and after adapting to the field. To limit the number of model assumptions/parameters, the representation of the field was modeled just as before, except each representation was centered on actual the training direction (i.e. offset terms were absent). And as before, the model parameters were fit by maximizing the log likelihood of the generalization data.

In contrast with the standard model, this limb impedance model could predict baseline adaptation indices. We began by fitting the baseline measurements, assuming the amplitude of the representation at this time was zero, since there could be no estimate of the field. The model predicted forces when reaching through the perfectly straight error-clamps (owing to the limb’s impedance), when the intended trajectory was slightly curved. The results accurately estimated the baseline measurements (Fig 5E), and the stiffness and damping of the limb, combined with the slight curvatures of baseline movements, resulted in non-zero error-clamp forces (baseline feedback gains: αk = 0.7278, αb = 0.0723, RMSE = 0.117, AICc = -25.64). Thus, the limb impedance model helped to explain why the baseline measurements indicated subjects were compensating for a non-existent clockwise curl field.

thumbnail
Fig 5. Limb impedance model results.

(A) Experimental and model-predictions for post-adaptation inter- generalization data (blue and cyan respectively). Predicted asymmetries together with their experimental counterparts (center panel). (B) The inferred representations are shown in polar coordinates for each of eight directions. The representation widths, σ (C) magnitudes, A (D). (E) Predicted baseline indices (pink) on top of the experimental baseline indices (blue) for eight directions.

https://doi.org/10.1371/journal.pone.0225002.g005

We then inferred the representations by fitting the generalization data. This model yielded precise fits to the data (Fig 5A, feedback gains: αk = 0.1406, αb = 0.7108, RMSE = 0.146, AICc = -42.26). As with the standard model, the inferred representations did differ across groups (Fig 5C and 5D). The width of the representations varied from 14.65° to 56.26° (average = 38.40°±14.56°), and the amplitudes varied from 0.75 to 1.04 (average = 0.92±0.12). However, relative to the previous model, these parameters were less variable when comparing the coefficient of variation (standard model: 39% for σ, and 24% for A; limb impedance model: 37% for σ and 13% for A).

The predicted asymmetries for the generalization curves were statistically indistinguishable from their experimental counterparts for all eight groups. Importantly, however, the representations were centered on the training targets. That is, while the underlying representation of the field is symmetric, the asymmetries in the generalization data are the natural result of how changes in reach direction and limb dynamics elicit variations in channel forces.

Discussion

Here we presented findings from a force field adaptation and generalization study exploring how systematic changes in limb configuration, and hence limb impedance, affect generalization. With our experiment all eight standard directions were examined for adaptation and generalization. Behavioral results indicated the ability to generalize a learned force field was local relative to the practiced direction for all eight directions. Furthermore, this ability was not symmetric, both with the standard intra-generalization curves, and new inter-generalization curves controlling for reach direction. These asymmetries were not consistent across directions offering no easy explanation. By examining adaptation and generalization across all eight standard directions, our results were well-suited to examine the underlying representations.

Based on a standard interpretation, a model-based analysis inferred the learned representations. Assuming the desired movements were minimum jerk, limb impedance has no effect on force channels and generalization measurements were a read-out of the estimated field. The model accurately fit the generalization curves and their asymmetries using Gaussian-like representations shifted from side to side across training directions. A second model, using subjects’ baseline trajectories as the desired movement and including limb stiffness and damping, also provided good fits to the data, relying on fewer free parameters and using representations centered on the training directions.

The two models differed in their ability to explain the data, and their characterization of the learned representation of the force field. Despite the fact that all subjects adapted to the same field, the standard model found variable representations, centered to the left or right of a training target, having irregular widths, and amplitudes that were at times larger than the actual field strength (and the measured adaptation index). This variability allowed the model to explain the asymmetries in generalization as due to shifts in the representations. The limb impedance model found more consistent representations with less variable parameters. These representations were centered on their training targets, and asymmetries in the generalization data were explained as due to the interactions of the force channel and limb impedance. Overall, the standard model and its representations did provide a superior fit to the data (RMSE = 0.109, AICc = -67.44, versus RMSE = 0.146, AICc = -42.26). Yet the limb impedance model explained more data, accurately fitting baseline when the standard model could not, with fewer parameters (24 versus 18). On the whole, based on these considerations and the more consistent parameters, we suggest the limb impedance model provides a more accurate description of the data and the underlying representations.

A potential issue with our limb impedance model are the stiffness and damping terms. Our nominal values were chosen from the literature [3, 20], but allowed for scaling (via αk and αb). Based on our fit to the data, the damping coefficient increased, and the stiffness coefficient decreased, after adaptation (baseline: αk = 0.7278, αb = 0.0723, post-adaptation: αk = 0.1406, αb = 0.7108). One might expect stiffness and damping to scale together with adaptation. Previous adaptation studies have found that the CNS is able to modify the magnitude, shape and orientation of the stiffness independent of the force needed to compensate for the perturbed dynamics [16]. We can only speculate that if these model parameters are accurately identifying changes in limb impedance, they suggest that stiffness and damping were modified to assist in making reaches in the field.

Limb impedance can influence generalization measurements in multiple ways. The impedance of the limb (e.g. inertia, damping, and stiffness) varies with changes in reach direction. To address this, we presented new inter-generalization curves that corrected for changes in reach direction during generalization. The impedance of the limb is also known to alter with changes in motor commands [16, 17]. Since adapting to a dynamical perturbation to the arm necessarily changes motor commands, our model allowed for changes in stiffness and damping by including scaling coefficients. Relative to the known complexities of musculoskeletal dynamics, these modifications were rudimentary and may not have captured salient features of how limb impedance influences generalization measurements. Future work can explore new experimental paradigms and models to more accurately infer what the brain learns when adapting.

A noteworthy finding was the positive adaptation indices found in baseline. Since all baseline reaches were curved slightly in the counterclockwise direction, this finding had a simple explanation in terms of the limb’s non-zero impedance and the forces subjects should produce in the force channels. These measurements had a significant influence on our subsequent findings, when generalization curves were corrected for baseline. If the baseline measurements had been negative, the overall strength, locality and asymmetries would have been different, yet presumably the underlying representation should have been identical. In future work we hope to explore if adaptation to a counterclockwise field, which after correcting for baseline would effectively strengthen the apparent generalization curves, results in similar representations.

A diverse line of work has found interesting similarities between motor learning and perceptual learning. For example, under a wide variety of tasks (e.g. tone and interval detection and discrimination [2632], while in tactile tasks, subjects may learn to discriminate between vibratory pulses [33], various gratings [34, 35], or finger taps [36], but then display little to no improvements on new tactile tasks. The visual system too, displays a similar general trend and after training on visual tasks, subjects’ performance improves substantially, but the improvements afford limited benefits in new situations (e.g. examining orientation [3740] and size [41]). On the whole the evidence suggests perceptual learning involves changes in primary sensory cortices that likely don’t generalize to new conditions. Thus, like motor learning, learning with the other sensory modalities is often specific to the details of the task with limited generalization.

Although perceptual learning is very different from motor learning, there are some interesting conceptual similarities. Like motor learning, perceptual learning affords no conscious insight into how to improve performance on the task; subjects merely become better (in force field learning studies subjects often are unaware of what the field is doing, or even its existence). Perceptual learning can be described as using low-level sensory afferents to form a conscious percept. Motor learning can be described as a conscious decision eliciting low-level motor efferents. In this sense it is tantalizing to speculate that motor and perceptual learning might be similar behaviors, albeit with information flowing in the opposite directions. If this were the case, then there is every reason to assume that what we learn about motor learning should be inherently informative for perceptual learning as well.

Supporting information

S1 Fig. Individual baseline adaptation indices.

Average adaptation indices (gray) measured in baseline channel trials towards the eight target directions for individual subjects in each of eight groups (10 subjects per group). Across-subject’s average for each group is also displayed (averages ± SEM, blue). Directions on top of each panel refers to the direction of the, yet to be presented, force field for each group later in adaptation trials.

https://doi.org/10.1371/journal.pone.0225002.s001

(TIF)

S2 Fig. Individual post-adaptation intra-generalization curves.

Average adaptation indices (gray) measured in test block channel trials towards the eight target directions for individual subjects in each of eight groups (10 subjects per group). Across-subject’s average for each group is also displayed (averages ± SEM, blue). Directions on top of each panel refers to the direction of the force field for each group in adaptation trials.

https://doi.org/10.1371/journal.pone.0225002.s002

(TIF)

S3 Fig. Individual baseline-corrected intra-generalization curves.

Average adaptation indices (gray) measured in test block channel trials towards the eight target directions for individual subjects in each of eight groups (10 subjects per group) corrected for the baseline indices (See Fig A-1). Across-subject’s average for each group is also displayed (averages ± SEM, blue). Directions on top of each panel refers to the direction of the force field for each group in adaptation trials.

https://doi.org/10.1371/journal.pone.0225002.s003

(TIF)

References

  1. 1. Wolpert DM, Ghahramani Z, Jordan MI. An internal model for sensorimotor integration. Science. 1995;269(5232):1880–2. pmid:7569931
  2. 2. Conditt MA, Gandolfo F, Mussa-Ivaldi FA. The motor system does not learn the dynamics of the arm by rote memorization of past experience. Journal of Neurophysiology. 1997;78(1):554–60. pmid:9242306
  3. 3. Shadmehr R, Mussa-Ivaldi FA. Adaptive representation of dynamics during learning of a motor task. Journal of Neuroscience. 1994;14(5):3208–24.
  4. 4. Thoroughman KA, Shadmehr R. Learning of action through adaptive combination of motor primitives. Nature. 2000;407(6805):742. pmid:11048720
  5. 5. Donchin O, Francis JT, Shadmehr R. Quantifying generalization from trial-by-trial behavior of adaptive systems that learn with basis functions: theory and experiments in human motor control. Journal of Neuroscience. 2003;23(27):9032–45. pmid:14534237
  6. 6. Mattar AA, Ostry DJ. Modifiability of generalization in dynamics learning. J Neurophysiol. 2007;98(6):3321–9. Epub 2007/10/12. pmid:17928561.
  7. 7. Darainy M, Mattar AA, Ostry DJ. Effects of human arm impedance on dynamics learning and generalization. J Neurophysiol. 2009;101(6):3158–68. Epub 2009/04/10. pmid:19357340; PubMed Central PMCID: PMCPMC2694125.
  8. 8. Castro LNG, Wu HG, Smith MA, editors. Adaptation to dynamic environments displays local generalization for voluntary reaching movements. 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society; 2011 30 Aug.-3 Sept. 2011.
  9. 9. Hwang EJ, Smith MA, Shadmehr R. Adaptation and generalization in acceleration-dependent force fields. Experimental brain research. 2006;169(4):496. pmid:16292640
  10. 10. Gonzalez Castro LN, Monsen CB, Smith MA. The binding of learning to action in motor adaptation. PLoS Comput Biol. 2011;7(6):e1002052. Epub 2011/07/07. pmid:21731476; PubMed Central PMCID: PMCPMC3121685.
  11. 11. Krakauer JW, Pine ZM, Ghilardi M-F, Ghez C. Learning of visuomotor transformations for vectorial planning of reaching trajectories. Journal of Neuroscience. 2000;20(23):8916–24. pmid:11102502
  12. 12. Taylor JA, Krakauer JW, Ivry RB. Explicit and implicit contributions to learning in a sensorimotor adaptation task. Journal of Neuroscience. 2014;34(8):3023–32. pmid:24553942
  13. 13. Gandolfo F, Mussa-Ivaldi F, Bizzi E. Motor learning by field approximation. Proceedings of the National Academy of Sciences. 1996;93(9):3843–6.
  14. 14. Huang VS, Shadmehr R. Evolution of motor memory during the seconds after observation of motor error. Journal of neurophysiology. 2007;97(6):3976–85. pmid:17428900
  15. 15. Thoroughman KA, Taylor JA. Rapid reshaping of human motor generalization. Journal of Neuroscience. 2005;25(39):8948–53. pmid:16192385
  16. 16. Burdet E, Osu R, Franklin DW, Milner TE, Kawato M. The central nervous system stabilizes unstable dynamics by learning optimal impedance. Nature. 2001;414(6862):446. pmid:11719805
  17. 17. Franklin DW, Osu R, Burdet E, Kawato M, Milner TE. Adaptation to stable and unstable dynamics achieved by combined impedance control and inverse dynamics model. Journal of neurophysiology. 2003;90(5):3270–82. pmid:14615432
  18. 18. Oldfield RC. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia. 1971;9(1):97–113. pmid:5146491
  19. 19. Scheidt RA, Reinkensmeyer DJ, Conditt MA, Rymer WZ, Mussa-Ivaldi FA. Persistence of motor adaptation during constrained, multi-joint, arm movements. Journal of Neurophysiology. 2000;84(2):853–62. pmid:10938312
  20. 20. Berniker M, Kording K. Estimating the sources of motor errors for adaptation and generalization. Nature neuroscience. 2008;11(12):1454. pmid:19011624
  21. 21. Shadmehr R. Generalization as a behavioral window to the neural mechanisms of learning internal models. Human movement science. 2004;23(5):543–68. pmid:15589621
  22. 22. Flash T. The control of hand equilibrium trajectories in multi-joint arm movements. Biological cybernetics. 1987;57(4–5):257–74. pmid:3689835
  23. 23. Wolpert DM, Ghahramani Z. Computational principles of movement neuroscience. Nature neuroscience. 2000;3(11s):1212.
  24. 24. Shadmehr R, Smith MA, Krakauer JW. Error correction, sensory prediction, and adaptation in motor control. Annual review of neuroscience. 2010;33:89–108. pmid:20367317
  25. 25. Smith MA, Ghazizadeh A, Shadmehr R. Interacting adaptive processes with different timescales underlie short-term motor learning. PLoS biology. 2006;4(6):e179. pmid:16700627
  26. 26. Zwislocki J, Maire F, Feldman A, Rubin H. On the effect of practice and motivation on the threshold of audibility. The Journal of the Acoustical Society of America. 1958;30(4):254–62.
  27. 27. Fitzgerald MB, Wright BA. Perceptual learning and generalization resulting from training on an auditory amplitude-modulation detection task. The Journal of the Acoustical Society of America. 2011;129(2):898–906. pmid:21361447
  28. 28. Demany L, Semal C. Learning to perceive pitch differences. The Journal of the Acoustical Society of America. 2002;111(3):1377–88. pmid:11931315
  29. 29. Wright BA, Buonomano DV, Mahncke HW, Merzenich MM. Learning and generalization of auditory temporal–interval discrimination in humans. Journal of Neuroscience. 1997;17(10):3956–63. pmid:9133413
  30. 30. Karmarkar UR, Buonomano DV. Temporal specificity of perceptual learning in an auditory discrimination task. Learning & Memory. 2003;10(2):141–7.
  31. 31. Linster C, Smith BH. Generalization between binary odor mixtures and their components in the rat. Physiology & behavior. 1999;66(4):701–7.
  32. 32. Linster C, Garcia PA, Hasselmo ME, Baxter MG. Selective loss of cholinergic neurons projecting to the olfactory system increases perceptual generalization between similar, but not dissimilar, odorants. Behavioral neuroscience. 2001;115(4):826. pmid:11508721
  33. 33. Nagarajan SS, Blake DT, Wright BA, Byl N, Merzenich MM. Practice-related improvements in somatosensory interval discrimination are temporally specific but generalize across skin location, hemisphere, and modality. Journal of Neuroscience. 1998;18(4):1559–70. pmid:9454861
  34. 34. Sathian K, Zangaladze A, Green J, Vitek J, DeLong M. Tactile spatial acuity and roughness discrimination: impairments due to aging and Parkinson's disease. Neurology. 1997;49(1):168–77. pmid:9222186
  35. 35. Sathian K, Zangaladze A. Tactile learning is task specific but transfers between fingers. Perception & Psychophysics. 1997;59(1):119–28.
  36. 36. Harrar V, Spence C, Makin TR. Topographic generalization of tactile perceptual learning. Journal of Experimental Psychology: Human Perception and Performance. 2014;40(1):15. pmid:23855526
  37. 37. Karni A, Sagi D. Where practice makes perfect in texture discrimination: evidence for primary visual cortex plasticity. Proceedings of the National Academy of Sciences. 1991;88(11):4966–70.
  38. 38. Schoups AA, Vogels R, Orban GA. Human perceptual learning in identifying the oblique orientation: retinotopy, orientation specificity and monocularity. The Journal of physiology. 1995;483(3):797–810.
  39. 39. Poggio T, Fahle M, Edelman S. Fast perceptual learning in visual hyperacuity. Science. 1992;256(5059):1018–21. pmid:1589770
  40. 40. Fiorentini A, Berardi N. Learning in grating waveform discrimination: Specificity for orientation and spatial frequency. Vision research. 1981;21(7):1149–58. pmid:7314493
  41. 41. Sowden PT, Rose D, Davies IR. Perceptual learning of luminance contrast detection: Specific for spatial frequency and retinal location but not orientation. Vision research. 2002;42(10):1249–58. pmid:12044757