Figures
Abstract
Humans can perform movements in various physical environments and positions (corresponding to different experienced gravity), requiring the interaction of the musculoskeletal system, the neural system and the external environment. The neural system is itself comprised of several interactive components, from the brain mainly conducting motor planning, to the spinal cord (SC) implementing its own motor control centres through sensory reflexes. Nevertheless, it remains unclear whether similar movements in various environmental dynamics necessitate adapting modulation at the brain level, correcting modulation at the spinal level, or both. Here, we addressed this question by focusing on upper limb motor control in various gravity conditions (magnitudes and directions) and using neuromusculoskeletal simulation tools. We integrated supraspinal sinusoidal commands with a modular SC model controlling a musculoskeletal model to reproduce various recorded arm trajectories (kinematics and EMGs) in different contexts. We first studied the role of various spinal pathways (such as stretch reflexes) in movement smoothness and robustness against perturbation. Then, we optimised the supraspinal sinusoidal commands without and with a fixed SC model including stretch reflexes to reproduce a target trajectory in various gravity conditions. Inversely, we fixed the supraspinal commands and optimised the spinal synaptic strengths in the different environments. In the first optimisation context, the presence of SC resulted in easier optimisation of the supraspinal commands (faster convergence, better performance). The main supraspinal commands modulation was found in the flexor sinusoid’s amplitude, resp. frequency, to adapt to different gravity magnitudes, resp. directions. In the second optimisation context, the modulation of the spinal synaptic strengths also remarkably reproduced the target trajectory for the mild gravity changes. We highlighted that both strategies of modulation of the supraspinal commands or spinal stretch pathways can be used to control movements in different gravity environments. Our results thus support that the SC can assist gravity compensation.
Summary
Human movement relies on coordination between the brain, spinal cord, and musculoskeletal system to adapt to various environments and gravity conditions. While the brain plans movements, the spinal cord contributes through reflexes and local control. It remains unclear how these systems adjust, whether primarily at the brain, spinal level, or both. This study explored upper limb control in different gravity conditions using computational models. Simulations integrated brain-driven commands and spinal reflexes to examine their roles in maintaining adaptive movement. The research revealed that both brain and spinal cord play complementary roles in adapting to environmental changes. The spinal cord helps compensate for gravitational differences, reducing the demands on brain-level control. These findings offer insights into the interplay between neural and musculoskeletal systems, advancing our understanding of how humans adapt movement to dynamic physical contexts.
Citation: Bruel A, Bacha L, Boehly E, De Trogoff C, Represa L, Courtine G, et al. (2025) Role and modulation of various spinal pathways for human upper limb control in different gravity conditions. PLoS Comput Biol 21(1): e1012069. https://doi.org/10.1371/journal.pcbi.1012069
Editor: Daniele Marinazzo, Ghent University, BELGIUM
Received: April 11, 2024; Accepted: December 18, 2024; Published: January 6, 2025
Copyright: © 2025 Bruel et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: For reproducibility and comparative purposes, the source code is available on github at https://github.com/AliceBrue/sc_modulation.git.
Funding: This work was supported by the the European Union Human Brain Project Specific Grant Agreement 3 (H2020-RIA. 945539), awarded to AI. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
1 Introduction
Humans can perform movements in various physical environments and various positions (corresponding to different experienced gravity). This is not a trivial achievement as it requires adjusting motor commands to reflect complex changes in body dynamics. The interaction of the musculoskeletal system, the neural system and the external environment is necessary to generate such movements [1]. The neural system is itself comprised of several interactive components, from the brain mainly conducting motor planning [2], to the spinal cord (SC) implementing its own motor control centres through pattern generators and sensory reflexes. Nevertheless, it remains unclear whether similar movements in various environmental dynamics necessitate replanning modulation at the brain level, correcting modulation at the spinal level, or both.
One major hypothesis in control theory postulates the existence of internal model encoded in the brain [3]. The brain would thus solves inverse problems mapping the desired trajectories into motor commands by representations of the sensorimotor system and the environment, allowing for the prediction and compensation of changes in the environment. This hypothesis is supported by manipulandum studies in which the arm performs a reaching task while interacting with a new mechanical environment imposed by a force field. With practice, hand trajectories converged to a path very similar to that observed in free space showing that the CNS compensates for the new dynamics. Moreover, after force field removal, mirror aftereffects support the idea of an update of the internal model.
The SC also supports a major role in motor control. The SC indeed integrates descending motor signals from the brain with its own sensory reflex-based mechanisms to regulate muscle activation, and transmit sensory signals back to the brain. The SC can notably generate rhythmic locomotion movements on its own [4, 5]. Sensory feedback are evoked by muscle spindles and Golgi tendon organs (GTO) that are respectively stretch and tension sensitive. These information are then relayed to the motoneurons through spinal circuits enabling fast reflex responses, including the stretch velocity reflex, static stretch reflex, Golgi tendon reflex, and reciprocal inhibition between antagonist muscles [6]. These pathways can also be modulated by descending signals during movements, especially between gait stance and swing phases [7, 8] and during arm movements [9–11]. Despite their ancient evolutionary origins, about 500 million years ago in the first vertebrates [12], the role of spinal circuits in upper limb control remains unclear. Some experiments highlighted their role in stability and handling perturbations [13, 14], and the presence of activity dependent plasticity mechanisms in the SC in rats, primates and humans [15]. Furthermore, spinal reflex properties adaptation have been reported in hypo and hyper gravity conditions [16], suggesting a role of spinal pathways in gravity compensation. The equilibrium point (EP) hypothesis also states that the CNS can control desired movements by gradually specifying the threshold of the spinal stretch reflexes, and thus shifting equilibrium positions resulting from sets of antagonist muscle forces [17, 18]. In the present study, we address the question of the role of various spinal pathways in upper limb motor control, robustness against perturbation and gravity compensation.
Neuromechanical modeling and simulation serve as powerful tools for studying such complex dynamical mechanisms by integrating body dynamics and physical interactions with the external environment [19]. Previous computational models have investigated various aspects of spinal pathways in upper limb control, from regulatory spinal circuits [20, 21] to reflex modulation and learning at the SC level [22, 23]. Several studies focused on the role of SC in handling perturbation [24–26], arguing for hierarchical levels of feedback and the important contribution of GTO feedbacks. Bruel et al. [27] also showed the role of SC in handling perturbation and facilitating cerebellar motor learning. Other models reproduced the EP hypothesis and captured both the qualitative features and the quantitative kinematic details of human measured movements [28]. Nevertheless, these models present strong limitations including the absence of complex descending signals, or a focus on specific subsets of spinal reflexes. To our knowledge, no model has studied spinal control mechanisms involved in gravity compensation, with different gravity magnitudes and orientations.
To study the role of spinal pathways in upper limb motor control, we implemented a modular spinal cord model integrating supraspinal sinusoidal commands and muscular sensory feedback. The resulting spinal outputs were used to actuate a musculoskeletal upper limb model to reproduce various recorded arm trajectories (kinematics and EMGs). While Bruel et al. [27] focused on how a simple SC interacts with the cerebellum to support motor learning and adapt to perturbations, the current paper aims at exploring a broader range of spinal circuits and their modulation in different contexts. We studied different scenarios evaluating the role of various spinal pathways (such as stretch reflexes) in upper limb motor control, robustness against perturbation and gravity compensation. For this last point, we optimised on one hand, the supraspinal commands, and on the other hand, the spinal synaptic strengths in various gravity conditions (magnitudes and directions) to study supraspinal versus spinal modulation to adapt to different environments. We showed that both strategies of modulation of the supraspinal commands or spinal stretch pathways can be used to control movements in different gravity environments. We optimised motor control parameters within a combined control scheme of supraspinal and SC systems to adapt the model’s behaviour. However, as SC reflexes tend to bring the musculoskeletal system back to its resting position (both physiologically and by model definition), it is not intuitive that modulating SC reflexes would enable gravity compensation. To our knowledge, it is the first model studying and revealing spinal control mechanisms involved in gravity compensation.
2 Results
We implemented a modular spinal cord model receiving supraspinal sinusoidal commands and muscular sensory feedback to control a musculoskeletal upper limb model as depicted on Fig 1A. We first optimised the supraspinal sinusoidal commands to reproduce various recorded arm trajectories (kinematics and EMGs). The trajectory recordings involved a participant performing repetitive planar elbow flexion-extension and circular movements in the vertical plane in standing position at various self-selected speeds and range of motion. These target trajectories are discrete like reaching and return tasks, and we considered one cycle of sinusoidal command per synergistic muscle group to simplify the optimisation problem, while representing the reaching movement and the return to the initial position. Then, we evaluated various spinal pathways (Ia stretch reflex, reciprocal Ia inhibition, Ia heteronymous stretch reflex, II static stretch reflex, Ib autogenic inhibition and Renshaw cell recurrent inhibition detailed in the Methods section) with increasing synaptic strength to study their effect on motor control in terms of kinematics and muscle recruitment (scenario 1, S1). An additional force perturbation was then applied to the hand during the movement to study the role of spinal pathways in robustness against perturbation (scenario 2, S2). Finally, we considered a “minimal SC” model including the pathways that showed the more notable effect in the previous simulations. We optimised on one hand, the supraspinal commands (scenario 3, S3), and on the other hand, the spinal synaptic strengths (scenario 4, S4) in various gravity conditions (magnitudes and directions) to study supraspinal versus spinal modulation to adapt to different environments (Fig 1B).
A) The modular spinal model received supraspinal commands and muscle sensory feedback (length, lm, velocity, and force Fm) from the musculoskeletal model from OpenSim [29]. Here the stretch reflex is represented as example. The spinal model then generated the final muscle excitation signals (um) actuating the musculoskeletal model. In the first scenario (S1), supraspinal commands reproducing recorded trajectories were sent. In the second scenario (S2) an additional force perturbation was applied to the hand during the movement. Various spinal pathways with increasing spinal synaptic strengths (model 1 to N) were then evaluated in terms of movement smoothness and robustness against perturbation. B) In the third and fourth scenarios (S3 and S4), a “minimal SC” model comprising Ia-MN stretch reflex and Ia-INa reciprocal inhibition was considered. The supraspinal commands and spinal synaptic strengths were then optimised to reproduce a trajectory in various gravity conditions (magnitudes and directions, env 1 to N) to study supraspinal versus spinal modulation. C) Modeled spinal pathways: Ia-MN stretch reflex, Ia-INa reciprocal inhibition, Ia-MNs heteronymous stretch reflex, II stretch reflex, Ib Golgi tendon reflex and RN recurrent inhibition. The red stars indicate the connection strength that we explored in this study (the others were fixed).
The following sections present first the behaviour of the integrated model for several target trajectories, and then the results of the 4 scenarios.
2.1 Behaviour of the integrated model for several target trajectories
We first optimised the supraspinal sinusoidal commands for the two scenarios, without and with a “minimal SC”, to reproduce a baseline recorded elbow flexion-extension trajectory of 2.8 seconds long and 78° range of motion (ROM) and a baseline circular trajectory of 1.3 seconds long and 40° of ROM. The shoulder flexion-extension is also unrestricted, so that we consider a double joint control. This way we could check the behaviour of our model for various speeds and ROMs. Our “minimal SC” comprised the Ia-MN stretch reflex and the Ia-INa reciprocal inhibition, this choice is motivated in the next section. We used Covariance Matrix Analysis Evolution Strategy (CMA-ES) optimisation [43]. We repeated each optimisation three times to check the solution space and reproducibility. The resulting loss over optimisation iterations, the final flexor and extensor supraspinal commands, and the resulting shoulder and elbow trajectories compared to the target for the flexion-extension trajectory are depicted on Fig 2A and 2B. The final loss were found to be smaller with SC and the final supraspinal commands were similar over repetitions.
A) CMA optimisation of the supraspinal sinusoidal commands for the flexion-extension trajectory without SC: from left to right the resulting loss over optimisation iterations, the final flexor and extensor supraspinal commands (cmd), and the resulting shoulder and elbow trajectories compared to the target for three optimisation runs. B) Same with our “minimal SC”, highlighted with a red frame. C) Resulting muscle activation: activation time windows are compared with recorded EMG activation time windows for flexor and extensor muscles, for both scenarios. D) Optimisation of the supraspinal sinusoidal commands for the circular trajectory with our “minimal SC”.
We also compared the resulting muscle activation time windows with recorded EMG activation time windows on Fig 2C. The overlap between simulated and EMG activation time windows was found to be better with SC for both flexor and extensor muscles, especially for extensor muscles.
Our model resulted in similar trends for the circular trajectory. The optimisation with our “minimal SC” is highlighted on Fig 2D.
2.2 Scenario 1: Role of various spinal pathways in voluntary movements
We studied the role of six spinal pathways by evaluating their effect on motor control with increasing synaptic strength (scenario 1, S1 on Fig 1A). The six spinal pathways of interest are sketched on Fig 1C. We used the supraspinal commands optimised without SC represented on Fig 2B. We evaluated each spinal pathway individually to facilitate the cause-effect relationship interpretation. For each pathway, we increased the synaptic strength of the last connection to the motoneurons from 0 to 1 (for multi-synaptic pathways, the other synaptic strengths were fixed to 1 as sketched on Fig 1C and detailed in the Methods section). We then quantified the resulting root mean square error (RMSE) to the target, the movement smoothness and the overlap between the simulated and recorded EMG activation time windows. Fig 3A shows the shoulder and elbow trajectories for the Ia-MN stretch reflex with increasing synaptic strength. Fig 3B shows the flexor muscle activation for the maximal Ia-MN synaptic strength and the activation time windows comparison with recorded EMG. The resulting metrics for the six spinal pathways with increasing synaptic strength are depicted on Fig 3C. The Ia-MN stretch reflex and Ia-MNs heteronymous connections similarly smoothen the movement (higher elbow speed arc length, SAL with larger synaptic strength). These two pathways do not limit the ROM (small RMSE), in contrast to the II stretch reflex. The Ia-INa reciprocal inhibition resulted in the smallest RMSE. In terms of muscle recruitment, the Ia-MN stretch reflex leads to more physiological patterns (higher EMG overlap) by inducing extensor activation as highlighted on Fig 3B compared to Fig 2C. The other pathways just slightly shaped the flexor activation signal and resulted thus in similar EMG overlap.
A) Shoulder and elbow kinematics for the flexion-extension trajectory with the Ia-MN stretch reflex with increasing synaptic strength. B) Resulting flexor and extensor muscle activation for the maximal Ia-MN synaptic strength and the activation time windows comparison with recorded EMG. C) Metrics for the six spinal pathways with increasing synaptic strength: root mean square error (RMSE) to the target trajectory, elbow speed arc length (SAL) as smoothness metrics, and EMG time window overlap. D) Perturbation study for the circular trajectory: an additional force perturbation was applied to the hand during the movement. The resulting elbow kinematic is showed for Ia-MN pathway, and the deviation to the initial trajectory is plotted for the six pathways with increasing synaptic strength. E) Ia-MN—Ia-INa pair analysis: the two pathways are combined to study their interaction.
To assess more precisely the effect of our 6 spinal reflexes, we also performed a sensitivity analysis on the RMSE and SAL metrics. The total-order indices were slightly larger than the first-order indices, indicating mainly first-order interactions. Table 1 summarises the resulting first-order indices. Ia-MNs heteronymous pathways and II stretch reflex have a strong effect on both the RMSE and smoothness metric, while the Ia-MN stretch reflex has a strong effect on the smoothness metric only.
2.3 Scenario 2: Role of various spinal pathways in perturbed environment
To study the role of spinal pathways in robustness against perturbation, we then applied an additional force perturbation to the hand during the movement. A 30N force was applied for 30 ms, acting upward during the flexion-extension trajectory and downward during the circular trajectory, when the arm is flexed in both cases as sketched on Fig 3D (scenario 2, S2 on Fig 1B). The resulting elbow kinematics for the Ia-MN pathway show a reduced deviation to the initial trajectory with increasing synaptic strength. We computed the average deviation of the elbow position to the initial trajectory. The Ia-MN stretch reflex, Ia-MNs heteronymous connections and II stretch reflex resulted in decreasing deviation with increasing synaptic strength.
To assess more precisely the effect of our 6 spinal reflexes, we also performed a sensitivity analysis. The total-order indices were slightly larger than the first-order indices, indicating mainly first-order interactions. Table 2 summarises the resulting first-order indices and highlights the strong effect of the Ia-MN stretch reflex and Ia-MNs heteronymous pathways.
We finalised this study by checking the interaction of the Ia-MN stretch reflex and Ia-INa reciprocal inhibition. We chose these two pathways as they implement different reflexes and showed the more notable effects in voluntary and perturbed conditions, while not limiting the ROM. This pair analysis on Fig 3E reveals that strong Ia-MN and Ia-INa pathways together keep the properties of each individual strong pathway; movement smoothness (high SAL), robustness against perturbation (small deviation), while not increasing the RMSE to the target. We thus defined our “minimal SC” including the Ia-MN stretch reflex and Ia-INa reciprocal inhibition with maximal synaptic strength.
2.4 Scenario 3: Modulation of the supraspinal commands in various gravity environments
We then studied the modulation of the supraspinal commands without and with our “minimal SC” model in various gravity conditions (magnitudes and directions) as depicted on Fig 4A (scenario 3, S3 on Fig 1B). A gravity direction rotation of 90° thus correspond to the lying position. Fig 4B first shows the resulting flexion-extension trajectories without optimisation; namely with the supraspinal commands from the scenario with “minimal SC” in normal gravity represented on Fig 2B. The optimisation of the supraspinal commands without and with our “minimal SC” could reproduce the target trajectory in the various gravity conditions as shown on Fig 4C, 4D, 4E and 4F respectively. The presence of SC resulted in easier optimisation of the supraspinal commands (faster convergence and better performance). The main supraspinal commands modulation was found in the flexor sinusoid’s amplitude, resp. frequency, to adapt to different gravity magnitudes, resp. directions.
A) Sketch of the 7 gravity environment applied in this study; 4 different magnitudes and 4 different directions. B) Resulting flexion-extension trajectories without optimisation; namely with the supraspinal commands from the scenario with “minimal SC” in normal gravity represented on Fig 2B. C) Optimisation of the supraspinal commands in various gravity magnitudes without SC: from left to right the resulting loss over optimisation iterations, the final flexor and extensor supraspinal commands (cmd), and the resulting shoulder and elbow trajectories compared to the target. D) Same in various gravity directions. E, F) Same for the scenario with our “minimal SC”, highlighted with a red frame.
Similar observations were made for the circular trajectory.
2.5 Scenario 4: Modulation of the spinal pathways in various gravity environments
Finally, we studied the modulation of the spinal pathways in the same gravity conditions as above (scenario 4, S4 on Fig 1B). Fig 5A first reveals three optimisations of the spinal synaptic strengths for the flexion-extension baseline in normal gravity condition. We considered the supraspinal commands from the scenario with our “minimal SC” corresponding to Fig 2B. The final synaptic strengths end up to be similar over repetitions especially for the flexor connections. Fig 5B and 5C then show the results of the optimisation of the synaptic strengths in various gravity magnitudes and directions. The modulation of the spinal synaptic strengths also remarkably reproduced the target trajectory for the mild gravity changes. The optimisation in the 2 extreme conditions with 2 times the gravity magnitude and with a gravity direction rotation of -45° could indeed not converge to the target trajectory. Nevertheless, the optimisation results showed two main trends: synaptic strengths were overall larger for all flexor connections and lower for all extensor connections with higher gravity magnitudes. Such modulations indeed facilitate the elbow flexion-extension movement. The synaptic strengths for the different gravity direction conditions did not show that clear trend.
A) Optimisation of the spinal synaptic strengths to reproduce the flexion-extension baseline: from left to right the resulting loss over optimisation iterations, the final flexor and extensor spinal synaptic strengths, and the resulting elbow trajectories compared to the target. B) Same for various gravity magnitudes. C) Same for various gravity directions.
The optimisation of spinal synaptic strengths also successfully reproduced the target circular trajectory, even for the mild and more severe gravity changes. This trajectory indeed exhibit a smaller ROM that facilitates the severe gravity magnitude context, and a symmetry to gravity direction that facilitates the gravity direction context.
3 Discussion
We implemented a modular spinal cord model receiving supraspinal sinusoidal commands and muscular sensory feedback to control a musculoskeletal upper limb model to reproduce elbow flexion-extension and circular recorded trajectories. These two movements were respectively 2.8 and 1.3 seconds long, with a range of motion of 78° and 40°. The shoulder flexion-extension is also unrestricted, so that we consider a double joint control. This way we could check the behaviour of our model for various speeds and ROMs. The presence of SC facilitates the reproduction of the trajectories compared to a scenario without SC similarly to [27]. While the previous paper focused on how a simple SC interacts with the cerebellum to support motor learning and adapt to perturbations, the current paper explores a broader range of spinal circuits and their modulation in various scenarios.
We then showed that Ia-MN stretch reflex, Ia-MNs heteronymous connections and II stretch reflex lead to smoother movement with increasing synaptic strength as [13] argued for a role of these pathways in motor stability. Nevertheless, Ia-MNs heteronymous pathways and II stretch reflex strongly limit the range of motion. Ia-MN stretch reflex and Ia-MNs heteronymous connections also lead to robustness against perturbation as supported by [24, 25]. Nevertheless, the Ib autogenic inhibition pathway did not lead to robustness against perturbation, while [26] model highlighted such property. Sensitivity analyses confirmed that the stretch reflexes had the stronger effect on the movement smoothness and robustness against perturbation.
We finally considered a “minimal SC” including the Ia-MN stretch reflex and Ia-INa reciprocal inhibition similarly to [27]. We optimised on one hand the supraspinal commands, and on the other hand the synaptic strength in various gravity conditions. The main supraspinal commands modulation was found in the flexor sinusoid’s amplitude, resp. frequency, to adapt to different gravity magnitudes, resp. directions. The modulation of the spinal synaptic strengths also remarkably reproduced the target flexion-extension trajectory for the mild gravity changes. The target circular trajectory could also be reproduced, even for the mild and more severe gravity changes. This trajectory indeed exhibit a smaller ROM that facilitates the severe gravity magnitude context, and a symmetry to gravity direction that facilitates the gravity direction context. We highlighted that both strategies of modulation of the supraspinal commands or of the spinal pathways can reproduce similar trajectories in different gravity environments. In both cases, we optimised motor control parameters within a combined control scheme of supraspinal and SC systems to adapt the model to different gravity conditions. However, as SC reflexes typically bring the musculoskeletal system back to its resting position (both physiologically and as defined in the model), it is not straightforward that modulating SC reflexes would allow for gravity compensation. To our knowledge, it is the first model studying and revealing spinal control mechanisms involved in gravity compensation.
Our model could still be improved in several directions. First of all, we considered supraspinal sinusoidal commands for simple elbow movements. We could design more sophisticated supraspinal commands for more complex movements. We provided supraspinal sinusoidal commands to the elbow flexor and extensor muscles only to simplify the optimisation problem, that could be extended by additional supraspinal commands to the shoulder flexor and extensor muscles. We could also consider more sophisticated supraspinal commands such as cerebellar learning signals [27]. The SC model also presents some limitations. More pathways could be explored, such as Renshaw cell connections to antagonist interneurons and Renshaw cells. The “minimal SC” could also be extended with additional pathways. We focused our study on synaptic strength, while other neuronal dynamics parameters could also be explored, especially the neuronal activation offset and sensory feedback delay. Additionally, we optimised the supraspinal commands and spinal synaptic strength separately. In the human system, control and modulation are naturally distributed among the two components. While a combined optimisation accompanied by a sensitivity analysis could have provided insights into the primary control roles, we chose to separate the processes to simplify interpretation. This approach allowed us to emphasise that the spinal cord can independently handle gravity compensation.
Overall, the present results are deemed of great interest as they highlight that both strategies of modulation of the supraspinal commands or of the spinal stretch pathways can be used to control movements in different gravity environments. The spinal cord could thus assist gravity compensation. This study could then be extended by investigating the mechanisms of such modulation to understand further these control strategies.
4 Methods
4.1 Ethics
Experiments were approved by the Commission cantonale d’éthique de la recherche sur l’être humain du canton de Vaud (CER-VD) under the license number 2017-02112 and performed in accordance with the Declaration of Helsinki. The participant gave his written consent.
We implemented a modular SC model integrating supraspinal commands and direct muscle sensory feedbacks to control a upper limb musculoskeletal model to study various scenarios. The following subsections describe the different components of our integrated model, the scenarios of interest, and the metrics used to quantify results.
4.2 Musculoskeletal upper limb model
We simulated a two DOF musculoskeletal upper limb model adapted from [30]. The model included two flexion-extension joints, the shoulder and the elbow, actuated by seven Hill-based muscles [31]. The deltoid anterior (Deltant) and biceps long (Biclong) are shoulder flexor muscles, whereas the triceps long (Trilong) is a shoulder extensor. The biceps long and short (Bicshort) and the brachialis (Brach)) are elbow flexors, while the triceps long, lateral and medial (Trilat), Trimed)) are elbow extensors. Note that Biclong) and Trilong) were biarticular muscles, as they actuated both joints. The antagonist and synergistic relation between muscles is depicted in Table 3 [6, 32]. The Hill-based muscle dynamics were the following:
(1)
with fm the muscle force, flv a combination of the force-length and force-velocity curves, fp the passive force-length curve, θ the pennation angle, a the muscle activation (i.e., the concentration of calcium ions within the muscle), and u the muscle excitation (i.e., the firing of the MN) [31]. Both u and a are in [0, 1].
We used OpenSim physics engine to simulate the muscle and skeleton dynamics [29]. We scaled the OpenSim upper limb model to the participant’s morphology to allow using kinematics and EMG from lab recordings. This scaling process was achieved using OpenSim scaling tool and OpenPifPaf Human Pose Estimation algorithm [33] during a static period.
4.3 Spinal cord model
To control these muscles, we built a modular SC model including for each muscle an exhaustive list of pathways that are commonly reported in the literature [6]. We considered the following pathways sketched on Fig 1C:
- Ia stretch reflex (Ia-MN): monosynaptic excitatory pathway from muscle stretch feedback conveyed by Ia fiber
- Reciprocal Ia inhibition between antagonist muscles (Ia-INa): disynaptic inhibitory pathway from antagonist stretch feedback conveyed by antagonist Ia fiber
- Ia heteronymous stretch reflex between synergistic muscles (Ia-MNs): monosynaptic excitatory pathway from synergistic stretch feedback conveyed by synergistic Ia fiber
- II static stretch reflex (II): disynaptic excitatory pathway from static stretch feedback conveyed by II fiber
- Ib autogenic inhibition (Ib): disynaptic inhibitory pathway from muscle tension feedback conveyed by Ib fiber
- Renshaw cell recurrent inhibition (RN): monosynaptic inhibition pathway from motoneuron activity conveyed by Renshaw cell. Other inhibitory connection are reported between Renshaw cells and antagonist Renshaw cells and Ia interneurons. We did not consider them to simplify the analysis.
The SC model thus integrated the supraspinal commands and the muscle sensory feedback (Fig 1A). For each muscle, a motoneuron (MN) received an excitatory connection conveying the supraspinal commands (cF, resp. cE, for flexor, resp. extensor muscle), and excitatory or inhibitory connections from the spinal pathways. For instance for Ia-MN stretch reflex, the MN receives an excitatory connection directly from the Ia afferent fibre of the muscle. Each neuron of these pathways was modeled with leaky dynamics as follow:
(2)
where r stands for the neuron firing rate; τ = 1ms the activation time constant (we considered fast-response large neurons as in [21]);
a steep sigmoid function with an offset x0 of 0.5 and a scaling factor D of 8 mimicking the on-off behaviour of neurons; i the neuron input signals; wi the synaptic strength of the input connection; ri the input activity; and δi = 30ms the sensory response delay in upper limbs [34, 35]. The synaptic strength of each pathway was evaluated between 0 and 1. For multi-synaptic pathways, we varied only the synaptic strength of the last connection to the MN and fixed the other ones to 1. For Ia-MNs heteronymous connections, the synaptic strength of each Ia-MN connection was divided by the number of connections received by the motoneuron to limit saturating input. In the optimisation scenario, the synaptic strengths were optimised between 0 and 2.
The sensory signals from the Ia, II and Ib fibers were modeled using Prochazka’s fiber rate models [36], with a mean firing rate of 10Hz [21, 37, 38]:
(3)
where lm and
describes the muscle fibre length and velocity in mm and mm/s; |x|+ = max(|x|, 0.01); and Fm(t) and Fmax,m are the muscle force and maximal isometric force. The output rates were scaled by their maximum to get a normalised value in [0, 1].
The MN output rates were finally provided as muscle excitation signals to the musculoskeletal model. We used FARMS Python library, developed at the BioRobotics laboratory [39] to model this modular SC.
4.4 Supraspinal commands
We defined supraspinal sinusoidal commands to reproduce various recorded elbow trajectories. These target trajectories are discrete like reaching and return tasks, and we considered one cycle of sinusoidal signals per elbow synergistic muscle group, namely the elbow flexor (cF) and extensor (cE) muscles, to simplify the optimisation problem, while representing the reaching movement and the return to the initial position. A motor control hypothesis indeed states that the motor system simplifies the production of movements by combining a small number of muscle synergies, or motor primitives. Several studies thus characterized the spatiotemporal organization of the phasic patterns of shoulder and arm muscles during reaching movements [40–42].
(4)
where aF and aE describe the sinusoids’ amplitudes; fF and fE the frequencies; ϕF and ϕE the phases; and dF and dE the offsets. Depending on the scenario, these parameters were optimised or fixed in the range of values summarised in Table 4. Note that the deltoid muscle does not receive any supraspinal command as it does not actuate the elbow joint.
4.5 Various scenarios
We first investigate the role of various spinal models in voluntary movement and robustness against perturbations. Then, we study the modulation of the supraspinal commands, and of the spinal pathways that showed the more notable effects in the previous scenarios in various gravity environments.
4.5.1 Behaviour of the integrated model for various recorded trajectories.
We first optimised the supraspinal commands without and with a “minimal SC” to reproduce a baseline recorded trajectory 2.8 seconds long for 78° range of motion (ROM) and a baseline circular trajectory of 1.3 seconds long and 40° of ROM. The shoulder flexion-extension is also unrestricted, so that we consider a double joint control. This way we could check the behaviour of our model for various speeds and ROMs. Our “minimal SC” comprised the Ia-MN stretch reflex and the Ia-INa reciprocal inhibition, this choice is motivated from scenarios S1 and S2 results. We repeated each optimisation three times to check the solution space and reproducibility.
The trajectory recordings involved a participant performing repetitive planar elbow flexion-extension and circular movements in the vertical plane in standing position at various self-selected speeds and range of motion. Prior to the experiments, approval was obtained from the Commission cantonale d’éthique de la recherche sur l’être humain du canton de Vaud (CER-VD) under license number 2017-02112. Written consent was obtained from then participant, and the experiments were conducted at NeuroRestore laboratory, Lausanne CHUV, in accordance with the principles outlined in the Declaration of Helsinki.
Kinematic data was captured using an RGB-D camera, and the OpenPifPaf human pose estimation algorithm [33] was used to extract the 2D positions of anatomical joints at a frame rate of 25fps. The 3D pose was then deduced from the camera depth information after correcting for distortion. Specially designed filters were also used to remove occlusions while ensuring consistency in joint anatomy and temporal coherence. We computed inverse kinematics (IK) to derive joint position and velocity from the joint positions. EMG recordings were conducted using the Delsys system and Trigno Avanti and Trigno Quattro sensors with an acquisition frequency of 1259.3Hz. All the muscles of the model were recorded, except the triceps medial that is a profound muscle. Alignment of EMG with kinematics signals was achieved using a trigger that induced a pulse in an additional EMG channel and illuminated an LED within the camera’s frame.
4.5.2 Scenario 1: Voluntary movements.
We optimised supraspinal commands without SC to reproduce recorded elbow trajectories. We then evaluated the effect of various spinal pathways in terms of movement smoothness and muscle recruitment with EMG. To do so, we considered each pathway individually and simulated the resulting trajectory with increasing synaptic strength, from 0 to 1.
4.5.3 Scenario 2: Perturbed environment.
We performed a perturbation study by applying an additional force perturbations during the movement. A perturbation force of 30N was applied during 30ms to the hand, acting upward during the flexion-extension trajectory and downward during the circular trajectory, when the arm is flexed in both case. The robustness against perturbation of the various spinal pathways was evaluated by comparing the deviation to the position without perturbation. As the previous scenario, we considered each pathway individually and simulated the resulting trajectory with various pathway synaptic strength, from 0 to 1.
4.5.4 Scenario 3: Modulation of the supraspinal commands in various gravity environments.
We considered a “minimal SC” model including the pathways that showed the more notable effects in the previous scenarios, namely the Ia-MN stretch reflex and Ia-INa reciprocal inhibition. Then, we optimised the supraspinal commands to reproduce the target trajectory in various gravity magnitude and direction conditions (magnitude from 0.5 to 2 times g, and direction rotation from -45° to 90° corresponding to the lying position).
4.5.5 Scenario 4: Modulation of the spinal pathways in various gravity environments.
We finally considered the “minimal SC” model with modular synaptic strength, and the supraspinal commands optimised in S3 in normal gravity condition. We optimised the synaptic strengths of the SC model between 0 and 2 in the same gravity conditions as above. With these various scenarios, we could investigate the role of various spinal pathways in voluntary movement and robustness against perturbation. We then study the modulation of supraspinal commands and spinal pathways in various gravity environments.
4.6 Optimisation framework
To optimize the supraspinal command parameters or the spinal synaptic strengths depending on the scenario, we use the Covariance Matrix Analysis Evolution Strategy (CMA-ES) [43]. We considered a loss function including the root mean square error (RMSE) between the simulated and the target trajectories, and a term penalising high muscle activation at the beginning and end of the movement as follow:
(5)
where N stands for the number of time steps; θsh,s and θelb,s the simulated shoulder and elbow positions; and θsh,t and θelb,t the target shoulder and elbow positions. Regarding the penalty on the muscle activation, we considered the specific time frames of the simulation T in the first and last 0.1s of the simulation. M is the number of muscles, and the penalty weight wpen was set by trial and error to 5.
4.7 Performance metrics
4.7.1 Measuring kinematics performance.
To evaluate the kinematic performance of the models, we defined the root mean square error (RMSE) between the simulated and the target trajectories as follow:
(6)
where N stands for the number of time steps; θsh,s and θelb,s the simulated shoulder and elbow positions; and θsh,t and θelb,t the target shoulder and elbow positions.
We evaluated the smoothness of the simulated movement by computing the elbow speed arc length (SAL, negative metrics, closer to 0 for smoother movements) [44, 45]:
(7)
We also performed a sensitivity analysis on these two metrics to asses the effect of our 6 spinal reflexes. We used SALib python library to run a Sobol’ sensitivity analysis [46]. We generated 7168 samples with a Saltelli sampler to compute second-order indices (N*(2*D + 2) with N = 512 and D = 6 our 6 spinal reflex weight variables).
4.7.2 Measuring robustness against perturbations.
To assess the robustness against perturbations, we computed the average deviation to the trajectory without perturbation:
(8)
where θelb,s, p−1 describes the elbow position one time step before the perturbation.
We also performed a sensitivity analysis on this metric as described above.
4.7.3 Measuring physiological muscle activation.
We also evaluated physiological muscle activation by comparing the simulated muscle activation with recorded EMG. Simulated activation signals are commonly compared to EMG envelopes. Nevertheless, such comparison is not straightforward due to scaling issues, as EMG signals are difficult to normalise and subject to measurement errors [47]. Additionally, our musculoskeletal model accounts for a subset of the numerous human upper limb muscles, which further challenges the direct comparison between recorded EMG and muscle activation signals. To overcome this issue, we adopted a more qualitative approach by comparing their global activation patterns.
We first computed the EMG envelopes by rectifying and low pass filtering the signals using a 5th order Butterworth filter with a cut-off frequency of 5Hz. We also recorded the maximal voluntary contraction (MVC) signals to normalise the EMG signals. We applied the same previous processing steps to the MVC signals, and normalised each EMG signal by the maximum of the corresponding MVC signal. To compare with the simulated activation, we finally interpolated the resulting EMG envelops on the corresponding simulation time points.
We then averaged the elbow flexor and extensor EMG envelops and simulated activation signals. We did not consider the simulated activation signal of the triceps medial as it was not recorded. To detect activation time windows, we set a percentage (perc) of the root mean square (RMS) value of each EMG signal as a threshold above which a muscle was considered activated [48]. The percentages set were based on visual analysis of the obtained EMG curves and on trial and error for each of the flexor and the extensor muscle groups [48]; 85% for flexors and 65% for extensors. We finally computed the overlap between the EMG and simulated activation time windows in percent. More precisely, we considered as positive value when the two signal windows overlapped, and negative value when just one window was present, and summed as follow:
(9)
where Øgp stands for the overlap metric for a certain group of muscles; Noverlap the number of time points where the EMG and simulated activation time windows overlapped; NEMG the number of time points of the EMG activation time windows; NEMG−sim the number of time points where the EMG time window activation is present but not the simulated activation one (Nsim−EMG inversely); and Ntot the number of time points of the full signals.
Acknowledgments
We gratefully thank the participant for his patience and willingness to collaborate in the recording sessions.
References
- 1. Rossignol S, Dubuc R, Gossard JP. Dynamic Sensorimotor Interactions in Locomotion. Physiological Reviews. 2006;86(1):89–154. pmid:16371596
- 2. Ebbesen CL, Brecht M. Motor cortex—to act or not to act? Nature Reviews Neuroscience. 2017;18(11):694–705. pmid:29042690
- 3. Shadmehr R, Mussa-Ivaldi F. Adaptive representation of dynamics during learning of a motor task. The Journal of Neuroscience. 1994;14(5):3208–3224. pmid:8182467
- 4. Brown TG. The intrinsic factors in the act of progression in the mammal. Proceedings of the Royal Society of London Series B, containing papers of a biological character. 1911;84(572):308–319.
- 5. Grillner S. Evolution of the vertebrate motor system—from forebrain to spinal cord. Current Opinion in Neurobiology. 2021;71:11–18. pmid:34450468
- 6.
Pierrot-Deseilligny E, Burke D. The circuitry of the human spinal cord: its role in motor control and movement disorders. Cambridge university press; 2005.
- 7. Prochazka A. Sensorimotor gain control: A basic strategy of motor systems? Progress in Neurobiology. 1989;33(4):281–307. pmid:2682784
- 8. Büschges A, Manira AE. Sensory pathways and their modulation in the control of locomotion. Current Opinion in Neurobiology. 1998;8(6):733–739. pmid:9914236
- 9. Shemmell J, Krutky MA, Perreault EJ. Stretch sensitive reflexes as an adaptive mechanism for maintaining limb stability. Clinical Neurophysiology. 2010;121(10):1680–1689. pmid:20434396
- 10. Fink AJP, Croce KR, Huang ZJ, Abbott LF, Jessell TM, Azim E. Presynaptic inhibition of spinal sensory feedback ensures smooth movement. Nature. 2014;509(7498):43–48. pmid:24784215
- 11. Bennett DJ. Stretch reflex responses in the human elbow joint during a voluntary movement. The Journal of Physiology. 1994;474(2):339–351. pmid:8006819
- 12. Sherman SM, Usrey WM. Cortical control of behavior and attention from an evolutionary perspective. Neuron. 2021;109(19):3048–3054. pmid:34297915
- 13. Cavallari P, Katz R. Pattern of projections of group I afferents from forearm muscles to motoneurones supplying biceps and triceps muscles in man. Experimental Brain Research. 1989;78:465–478. pmid:2612592
- 14. Weiler J, Gribble PL, Pruszynski JA. Spinal stretch reflexes support efficient hand control. Nature Neuroscience. 2019;22(4):529–533. pmid:30742115
- 15. Wolpaw JR. What Can the Spinal Cord Teach Us about Learning and Memory? The Neuroscientist. 2010;16(5):532–549. pmid:20889964
- 16. Ritzmann R, Krause A, Freyler K, Gollhofer A. Gravity and Neuronal Adaptation. Microgravity Science and Technology. 2016;29(1-2):9–18.
- 17. Feldman AG. Once more on the equilibrium-point hypothesis (λ model) for motor control. Journal of motor behavior. 1986;18(1):17–54. pmid:15136283
- 18. Latash ML. Motor synergies and the equilibrium-point hypothesis. Motor control. 2010;14(3):294–322. pmid:20702893
- 19.
Edwards. Neuromechanical simulation. Frontiers in Behavioral Neuroscience. 2010;.
- 20. Tsianos GA, Goodner J, Loeb GE. Useful properties of spinal circuits for learning and performing planar reaches. Journal of Neural Engineering. 2014;11(5):056006. pmid:25082652
- 21. Sreenivasa M, Ayusawa K, Nakamura Y. Modeling and Identification of a Realistic Spiking Neural Network and Musculoskeletal Model of the Human Arm, and an Application to the Stretch Reflex. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 2016;24(5):591–602. pmid:26394432
- 22. Stienen AHA, Schouten AC, Schuurmans J, van der Helm FCT. Analysis of reflex modulation with a biologically realistic neural network. Journal of Computational Neuroscience. 2007;23(3). pmid:17503169
- 23. Verduzco-Flores SO, de Schutter E. Self-configuring feedback loops for sensorimotor control. eLife. 2022;11. pmid:36373657
- 24. Stollenmaier K, Ilg W, Haeufle DFB. Predicting Perturbed Human Arm Movements in a Neuro-Musculoskeletal Model to Investigate the Muscular Force Response. Frontiers in Bioengineering and Biotechnology. 2020;8. pmid:32373601
- 25. Kistemaker DA, Soest AJKV, Wong JD, Kurtzer I, Gribble PL. Control of position and movement is simplified by combined muscle spindle and Golgi tendon organ feedback. Journal of Neurophysiology. 2013;109(4):1126–1139. pmid:23100138
- 26. Burdet E, Tee KP, Mareels I, Milner TE, Chew CM, Franklin DW, Osu R, Kawato M Stability and motor adaptation in human arm movements. Biological Cybernetics. 2006;94(1). pmid:16283374
- 27. Bruel A, Abadía I, Collin T, Sakr I, Lorach H, Luque NR, et al. The spinal cord facilitates cerebellar upper limb motor learning and control; inputs from neuromusculoskeletal simulation. PLOS Computational Biology. 2024;20(1):e1011008. pmid:38166093
- 28. Flash T. The control of hand equilibrium trajectories in multi-joint arm movements. Biological Cybernetics. 1987;57(4):257–274. pmid:3689835
- 29. Seth A, Hicks JL, Uchida TK, Habib A, Dembia CL, Dunne JJ, et al. OpenSim: Simulating musculoskeletal dynamics and neuromuscular control to study human and animal movement. PLoS computational biology. 2018;14(7):e1006223. pmid:30048444
- 30. Saul KR, Hu X, Goehler CM, Vidt ME, Daly M, Velisar A, et al. Benchmarking of dynamic simulation predictions in two software platforms using an upper limb musculoskeletal model. Computer Methods in Biomechanics and Biomedical Engineering. 2014;18(13):1445–1458. pmid:24995410
- 31. Millard M, Uchida T, Seth A, Delp SL. Flexing Computational Muscle: Modeling and Simulation of Musculotendon Dynamics. Journal of Biomechanical Engineering. 2013;135(2). pmid:23445050
- 32. McClelland V, Miller S, Eyre J. Short latency heteronymous excitatory and inhibitory reflexes between antagonist and heteronymous muscles of the human shoulder and upper limb. Brain research. 2001;899(1-2):82–93. pmid:11311868
- 33. Kreiss S, Bertoni L, Alahi A. OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association. IEEE Transactions on Intelligent Transportation Systems. 2022;23(8):13498–13511.
- 34. Wolf SL, Segal RL. Reducing human biceps brachii spinal stretch reflex magnitude. Journal of Neurophysiology. 1996;75(4):1637–1646. pmid:8727402
- 35. Matthews PB. The simple frequency response of human stretch reflexes in which either short- or long-latency components predominate. The Journal of Physiology. 1994;481(3):777–798. pmid:7707243
- 36. Prochazka A. Chapter 11 Quantifying Proprioception. Progress in brain research. 1999;123:133–142. pmid:10635710
- 37. Al-Falahe NA, Nagaoka M, VALLBO AB. Response profiles of human muscle: afferents during active finger movements. Brain. 1990;113(2):325–346. pmid:2139351
- 38. Malik P, Jabakhanji N, Jones KE. An Assessment of Six Muscle Spindle Models for Predicting Sensory Information during Human Wrist Movements. Frontiers in Computational Neuroscience. 2016;9. pmid:26834618
- 39. Arreguit J, Tata Ramalingasetty S, Ijspeert AJ. FARMS: Framework for Animal and Robot Modeling and Simulation. bioRxiv. 2023; p. 2023–09.
- 40. d’Avella A, Portone A, Fernandez L, Lacquaniti F. Control of Fast-Reaching Movements by Muscle Synergy Combinations. Journal of Neuroscience. 2006;26(30):7791–7810. pmid:16870725
- 41. d’Avella A, Fernandez L, Portone A, Lacquaniti F. Modulation of Phasic and Tonic Muscle Synergies With Reaching Direction and Speed. Journal of Neurophysiology. 2008;100(3):1433–1454. pmid:18596190
- 42. d’Avella A, Portone A, Lacquaniti F. Superposition and modulation of muscle synergies for reaching in response to a change in target location. Journal of Neurophysiology. 2011;106(6):2796–2812. pmid:21880939
- 43. Hansen N, Müller SD, Koumoutsakos P. Reducing the time complexity of the derandomized evolution strategy with covariance matrix adaptation (CMA-ES). Evolutionary computation. 2003;11(1):1–18. pmid:12804094
- 44. Balasubramanian S, Melendez-Calderon A, Roby-Brami A, Burdet E. On the analysis of movement smoothness. Journal of neuroengineering and rehabilitation. 2015;12(1):1–11. pmid:26651329
- 45. Gulde P, Hermsdörfer J. Smoothness metrics in complex movement tasks. Frontiers in neurology. 2018;9:615. pmid:30258393
- 46. Iwanaga T and Usher W, Herman J. Toward SALib 2.0: Advancing the accessibility and interpretability of global sensitivity analyses. Socio-Environmental Systems Modelling 2022;4:18155–18155.
- 47. Hicks JL, Uchida TK, Seth A, Rajagopal A, Delp SL. Is my model good enough? Best practices for verification and validation of musculoskeletal models and simulations of movement. Journal of biomechanical engineering. 2015;137(2):020905. pmid:25474098
- 48. Özgünen KT, Çelik U, Kurdak SS. Determination of an optimal threshold value for muscle activity detection in EMG analysis. Journal of sports science & medicine. 2010;9(4):620. pmid:24149789