Skip to main content
Advertisement
  • Loading metrics

A neurocomputational theory of action regulation predicts motor behavior in neurotypical individuals and patients with Parkinson’s disease

  • Shan Zhong,

    Roles Data curation, Formal analysis, Software, Writing – original draft, Writing – review & editing

    Affiliation Neuroscience graduate program, University of California Riverside, Riverside, California, United States of America

  • Jeong Woo Choi,

    Roles Data curation, Formal analysis, Software, Writing – review & editing

    Affiliation Department of Neurological Surgery, UT Southwestern Medical Center, Dallas, Texas, United States of America

  • Nadia G. Hashoush,

    Roles Data curation

    Affiliation David Geffen Sch. of Med., University of California Los Angeles, Los Angeles, California, United States of America

  • Diana Babayan,

    Roles Data curation

    Affiliation David Geffen Sch. of Med., University of California Los Angeles, Los Angeles, California, United States of America

  • Mahsa Malekmohammadi,

    Roles Data curation

    Affiliation David Geffen Sch. of Med., University of California Los Angeles, Los Angeles, California, United States of America

  • Nader Pouratian ,

    Roles Conceptualization, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Writing – original draft, Writing – review & editing

    Nader.pouratian@utsouthwestern.edu (NP); vchristo@engr.ucr.edu (VC)

    ‡These authors jointly supervised this work (Correspondence).

    Affiliation Department of Neurological Surgery, UT Southwestern Medical Center, Dallas, Texas, United States of America

  • Vassilios Christopoulos

    Roles Conceptualization, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Writing – original draft, Writing – review & editing

    Nader.pouratian@utsouthwestern.edu (NP); vchristo@engr.ucr.edu (VC)

    ‡These authors jointly supervised this work (Correspondence).

    Affiliations Neuroscience graduate program, University of California Riverside, Riverside, California, United States of America, Department of Bioengineering, University of California Riverside, Riverside, California, United States of America

Abstract

Surviving in an uncertain environment requires not only the ability to select the best action, but also the flexibility to withhold inappropriate actions when the environmental conditions change. Although selecting and withholding actions have been extensively studied in both human and animals, there is still lack of consensus on the mechanism underlying these action regulation functions, and more importantly, how they inter-relate. A critical gap impeding progress is the lack of a computational theory that will integrate the mechanisms of action regulation into a unified framework. The current study aims to advance our understanding by developing a neurodynamical computational theory that models the mechanism of action regulation that involves suppressing responses, and predicts how disruption of this mechanism can lead to motor deficits in Parkinson’s disease (PD) patients. We tested the model predictions in neurotypical individuals and PD patients in three behavioral tasks that involve free action selection between two opposed directions, action selection in the presence of conflicting information and abandoning an ongoing action when a stop signal is presented. Our results and theory suggest an integrated mechanism of action regulation that affects both action initiation and inhibition. When this mechanism is disrupted, motor behavior is affected, leading to longer reaction times and higher error rates in action inhibition.

Author summary

Humans can rapidly regulate actions according to updated demands of the environment. A key component of action regulation is action inhibition, the failure of which contributes to various neuropsychiatric disorders. Despite extensive efforts to understand how the brain selects, pauses, and abandons actions, the mechanisms underlying these functions and how they inter-relate remain elusive. The current study introduces a large-scale model that characterizes the computations of action regulation functions, how they are implemented within brain networks and how disruption of these circuits can lead to deficits in motor behavior seen in Parkinson’s disease (PD). The model was developed by studying the motor behavior of healthy individuals and PD patients in three motor tasks that involve action inhibition. Overall, the model explains many aspects on motor behavior when people select between multiple actions, make decisions when conflicting information is present, and stop ongoing actions. It explains many key features of PD patients, including longer responses in generating movements even without competing actions and conflicting information, and lower probability to stop an action. Our neurocomputational theory provides significant insights on the circuit computations underlying action regulation, opening new avenues for improving and developing therapeutic interventions for diseases that may involve this circuit.

Introduction

Surviving in an uncertain environment requires not only the ability to accurately and rapidly select the best action, but also the flexibility to abandon obsolete actions when they are rendered unwanted or inappropriate. How actions are initiated and regulated is a fundamental neurobiological question that is of high impact for understanding how the human brain functions. A key component of action regulation is action inhibition, which when abnormal contributes to neuropsychiatric diseases, such as Parkinson’s disease (PD), obsessive-compulsive disorder (OCD), and others [15]. Action inhibition occurs in at least 3 ways: (a) action selection—selecting one action requires suppressing alternative motor plans, (b) decision conflict—choosing in the presence of conflicting information requires suppressing alternative actions to buy more time to make a correct decision and (c) outright stopping—inhibiting a response when it is rendered inappropriate.

Over the past years, a number of studies attempted to characterize the mechanism of action regulation in motor decisions with competing alternatives. Recent cognitive theories suggest that in situations affording more than one alternative options, the brain plans in parallel multiple actions that compete for selection before choosing one of them to execute [610]. This affordance competition theory received empirical support from neurophysiological investigations in the sensorimotor areas of non-human primates (NHPs) showing that the brain encodes parallel reach, grasp and saccade plans before the animals select between them [1113]. It is consistent with the continuous flow model of perception, which suggests that response preparation can begin even before the goal is fully identified and a decision is made [1416]. In addition, psychophysical support for this theory comes from the “go-before-you-know” experiments, in which individuals had to initiate reaching or saccade movements towards multiple potential targets, without knowing the actual location of the goal [1719]. The individuals compensate for the goal location uncertainty by aiming towards an intermediate location, a strategy consistent with averaging of multiple competing action plans. The affordance competition hypothesis challenges a normative family of theories which suggest that the brain deals with multiple competing alternatives by first deciding where to aim and then generating a single flexible action to implement the choice [20]. According to this theory, the intermediate movements in tasks with multiple potential actions reflect a single, deliberate motor plan that seeks to optimize performance under goal uncertainty [2124]. Although there is still no consensus on what intermediate movements reflect, we recently provided strong evidence in favor of the affordance competition hypothesis [19].

Flexibility in action regulation includes not only being fast and accurate when selecting between competing options, but also being flexible enough to pause or abandon obsolete actions in response to environmental changes. Recent studies explored the mechanisms underlying pausing or abandoning actions using functional MRI [25, 26], local field potential (LFP) recordings [27, 28], electroencephalography (EEG) recordings [29, 30], as well as single-unit recordings in humans [31, 32], NHPs [33, 34] and rodents [35]. The basal ganglia (BG), and in particular the subthalamic nucleus (STN), has been functionally implicated in action regulation functions, but in association with distinct frontal areas, such as the primary motor cortex (M1), the premotor cortex (preMC), the pre-supplementary motor area (preSMA) and the right inferior frontal gyrus (rIFG) [3639]. In a sense STN seems to act as a “brake” to rapidly suppress ongoing (or planned) actions when motor inhibition is required [4042].

Despite the significant contribution of these studies on understanding how the brain selects between competing options, deals with conflicting information, and stops planned or ongoing actions during decisions, the mechanisms of these action regulation functions and their inter-relations remain elusive. Part of this challenge lies in the fact that previous studies rarely explore these functions together, making it difficult to develop a unified and integrated theory of action regulation. The current study aims to advance our understanding on the mechanism underlying action regulation and how disruption of this mechanism can lead to deficits in motor behavior exhibited in PD. To address these questions, we trained neurotypical individuals and PD patients to perform three motor tasks that involve motor decision between two opposed directions, action selection in the presence of conflicting information and suppression of unwanted motor responses when a stop signal is presented. To elucidate the action regulation mechanism in healthy and disease state, we modeled the tasks within a neurodynamical computational framework that combines dynamic neural field (DNF) theory [43, 44] with stochastic optimal control theory [45, 46], and simulates the processes underlying selection, planning, initiation and suppression of actions [47, 48]. The computational framework is an extension of our recent study for modeling planning and execution of reaching movements in motor decisions tasks with goal location uncertainty [19].

Our study presents the first unified theory on action regulation that involves action inhibition, providing important predictions on how the disruption of major nodes, such as STN, can deteriorate motor performance leading to longer reaction times in motor decisions and higher error rates when stopping ongoing actions. Additionally, the neurodynamical theory provides a potential explanation on why PD patients exhibit longer reaction times than neurotypical individuals even in the lack of competing alternatives or conflicting information in motor decisions. Overall, our findings shed light on how the brain regulates actions that involve inhibitory processes, opening new avenues for improving and developing therapeutic interventions for diseases that may involve this circuit.

Results

Experimental paradigms

Participants were instructed to perform reaching movements using a 2-dimensional joystick under three experimental paradigms: i) decision-making task (action selection), ii) Eriksen flanker task (decision conflict) and iii) stop-signal task (outright stopping) (Fig 1). In the decision-making task, participants had to respond to arrow stimuli presented on a computer screen by freely moving the joystick towards the left or right direction. Choice trials were interleaved with instructed trials in which all arrows pointed to the same direction. In the Eriksen flanker task, flanking arrows were presented on the screen, all pointing to the same direction. A target arrow was then presented to indicate the direction to move, either in the same (no conflict, congruent trials) or opposite (conflict, incongruent trials) direction as the flanking arrows. Finally, in the stop signal task, the participants were instructed to reach towards the direction of the arrows. In a minority of trials, the color of the arrows turned red after a short delay (stop signal delay, SSD), and the action had to be abandoned immediately. If the participants successfully inhibited their actions, the SSD increased by 50ms, making the next stopping trial more challenging. If the participants failed to inhibit their actions, the SSD decreased by 50ms, making the next stopping trial easier.

thumbnail
Fig 1. Experimental setup for action regulation tasks that require action inhibition.

A: Decision-making task, including instructed and choice trials. B: An arrow version of the Eriksen flanker task, including congruent (the flanker arrows point to the same direction as the central arrow) and incongruent (the flanker arrows point to the opposite direction from the central arrow) trials. C: A stop signal task with instructed trials. Individuals are prompted to stop the action when the arrows turn red.

https://doi.org/10.1371/journal.pcbi.1010111.g001

Motor behavior of neurotypical individuals and PD patients in action regulation tasks

We computed the reaction time (RT) for initiating an action as an index of motor preparation/programming of reaching actions. RT was computed as the time interval between the presentation of the target arrows on the screen and the initiation of the reaching movement. We computed the RT distribution across all participants in each group in the decision-making task (S1 Fig) and found that choice trials had longer RT on average than instructed trials in both populations (Fig 2A) (two-way ANOVA, p<0.001). However, although the neurotypical individuals responded faster than the PD patients in the instructed trials (two-way ANOVA, p<0.001), we found no significant difference in RT between the two groups in the choice trials (two-way ANOVA, p = 0.878), (Fig 2A). Additionally, we evaluated the performance of the participants by measuring the success rate of the instructed and choice trials. We found that both groups performed equally well on both conditions—i.e., the percentage of correct trials for neurotypical individuals was 98.80% ± 3.58% (mean ± SD) in the instructed trials and 94.65% ± 18.04% in the choice trials. The percentage of correct trials for PD patients was 98.33% ± 4.98% in the instructed trials and 97.69% ± 6% in the choice trials (two-tailed t-test comparing success rate between neurotypical individuals and PD patients; p = 0.7167 in instructed trials and p = 0.5297 in choice trials). Furthermore, we explored how often participants changed their initial choice and corrected their movement to the opposite direction. We found that both groups rarely changed their mind after initiating an action in the choice trials—i.e., the percentage of “change of mind” trials was 1.11% ± 1.88% for neurotypical individuals and 1.67% ± 3.07% for PD patients (two-tailed t-test comparing percentage of change of mind trials between neurotypical individuals and PD patients, p = 0.4733).

thumbnail
Fig 2. Behavioral findings from the decision-making task, the Eriksen flanker task and the stop signal task.

A: Bar plots of the mean RT for neurotypical individuals (Neurotypical) and PD patients (PD) across all participants in each group, in the instructed and choice trials of the decision-making task. B: Bar plots of the mean RT for neurotypical individuals (Neurotypical) and PD patients (PD) across all participants in each group, in the congruent and incongruent trials of the Eriksen flanker task. C: Bar plots of the mean RT for neurotypical individuals (Neurotypical) and PD patients (PD) across all participants in each group, in the go trials of the stop signal task. Error bars correspond to standard error (SE) across all participants in each group. White dots represent mean RT for each participant.

https://doi.org/10.1371/journal.pcbi.1010111.g002

In the Eriksen flanker task, we computed the RT distribution across all participants in each group (S1 Fig) and found that both groups exhibited shorter RT on average in the congruent trials than in the incongruent trials (Fig 2B) (two-way ANOVA, p<0.001 for both neurotypical individuals and PD patients). However, PD patients had slower responses than neurotypical individuals in both congruent and incongruent trials (two-way ANOVA, p<0.01 for congruent trials, p<0.05 for incongruent trials). We also found no significant difference on the success rate between the two populations in congruent trials and incongruent trials. The average percentage of correct trials in the neurotypical population was 98.98% ± 2.07% (mean ± SD) in congruent trials and 96.39% ± 4.85% in incongruent trials, whereas in the PD patient population was 99.49% ± 1.14% in congruent trials and 98.72% ± 2.59% in incongruent trials (two-tailed t-test comparing success rate between neurotypical individuals and PD patients; p = 0.3799 for congruent trials and p = 0.0895 for incongruent trials). Finally, we found no significant differences between the two populations regarding changing of mind in the incongruent trials. The neurotypical individuals switched actions to the opposite direction 9.01% ± 12.22% of the time (mean ± SD) whereas the PD patients changed their minds 9.23% ± 7.73% of the time (two-tailed t-test comparing percentage of change of mind trials between neurotypical individuals and PD patients, p = 0.9502).

We also computed the RT distribution in the go trials across all participants in the stop signal task (S1 Fig). Interestingly, the results showed that neurotypical individuals had slower responses than PD patients (Fig 2C) (two-tailed t-test, p<0.001). In particular, the neurotypical population seems to have strategically slowed down their responses in the go trials by 233 ms on average in order to be more successful in inhibiting their response once a stop signal is presented (two-tailed t-test on RT between instructed trials and go trials for the neurotypical population, p<0.001). On the other hand, PD patients exhibited much subtler modification of their response between instructed trials (decision-making task) and go trials (stop signal task)—the RT for go trials increased only by 47 ms on average compared to instructed trials (two-tailed t-test, p<0.001), suggesting that the anticipation of the stop signal had smaller effect on their motor planning behavior.

These findings predict that PD patients will perform worse in stop trials than neurotypical individuals, since a lower probability of stopping has often been associated with faster responses in go trials [4951]. To test this hypothesis, we computed the probability to stop an action for different SSD values across all participants in each group. The results showed that the probability to successfully stop an action was inversely correlated with SSD, and consistent with the hypothesis, PD patients exhibited lower probability of stopping an action compared to neurotypical individuals (Fig 3).

thumbnail
Fig 3. Probability to successfully stop an action as a function of the SSD.

The probability to successfully stop an action as a function of the SSD for neurotypical individuals (Neurotypical, blue) and PD patients (PD, red).

https://doi.org/10.1371/journal.pcbi.1010111.g003

An integrated neurodynamical theory of action regulation predicts motor behavior

Our findings require a computational theory that could explain the mechanism of action regulation that involves motor inhibition and predicts how disruption of this mechanism can lead to motor impairments in PD patients. Building on our previous successful work in modeling visuomotor tasks [47, 48], we developed a neurodynamical theory to unify the action regulation mechanism that involves motor inhibition. The theory builds on the affordance competition hypothesis, according to which multiple actions are formed concurrently and compete over time until one has sufficient evidence to win the competition [6, 7, 12]. It combines dynamic neural field theory with stochastic optimal control theory and its architectural organization is illustrated in Fig 4. The basic architecture of this theory consists of a set of DNFs. Each DNF simulates the dynamic evolution of firing rate activity of a network of neurons over a continuous space with local excitation and surround inhibition. It consists of 181 neurons—with exception of the context signal field and the pause field—and each of them has a preferred direction between 0° and 180°. The “spatial sensory input” field encodes the angular representation of the competing actions (i.e., left vs. right movements in our study). The “expected outcome” field encodes the expected reward for reaching to a particular direction. The outputs of these two fields send excitatory projections (green arrows) to the “reach planning” field in a topological manner.

thumbnail
Fig 4. Model architecture.

The architectural organization of the neurodynamical theory to model tasks that involve action inhibition, such as decisions between competing options, decisions in the presence of conflicting information and outright stopping of actions.

https://doi.org/10.1371/journal.pcbi.1010111.g004

We also added to the model architecture a Basal Ganglia (BG)-type mechanism for implementing the inhibitory process. This mechanism consists of three DNF platforms: (a) two context signal fields (stop and conflict) that represent information related to the contextual requirement of the tasks; (b) a pause field that suppresses the activity of the reach planning field to inhibit planned or ongoing actions. Each of the context fields consist of 100 neurons which project to the corresponding sub-population of the pause field via one-to-all excitatory connections. The stop signal field and the conflict signal field are activated when they detect a stop cue and conflict cue, respectively. Regarding the action selection function, the model does not need a context field to signal the decision task, since it can collect this information from the spatial sensory input field. In particular, the spatial sensory input field projects to the corresponding sub-population on the pause field with one-to-all excitatory connections. If more than one targets is encoded in the spatial sensory input field, the corresponding population on the pause field is triggered. Notably, this architecture is consistent with experimental studies which suggest dissociable frontal-BG circuits for different action suppression functions [39]. The pause field consists of 3 sub-populations of 75 neurons, each of them associated with one of the action regulation functions (i.e., action decisions between multiple options, action selection in the presence of conflicting information and outright stopping of actions). Once the pause field is triggered, the activity of the reach planning field is suppressed to delay a decision when more time is needed (i.e. during action selection or decision with conflicting information), or to completely suppress an action when it is no longer wanted or rendered inappropriate (i.e., outright stopping).

Each neuron in the reach planning field is connected with a stochastic optimal controller. Once the activity of a reach neuron j exceeds the action initiation threshold (cyan discontinuous line in Fig 4) at the current time and state xt, the corresponding controller initiates an optimal policy πj(xt) to move the joystick towards the preferred direction of that neuron (see Materials and methods section for more details). Reaching movements are generated as a mixture of active policies (i.e., policies in which the associated neuronal activity in the reach planning field is above the action initiation threshold) weighted by the normalized activity of the corresponding reaching neurons. The normalized activity is called relative desirability since it reflects the attractiveness of a policy with respect to alternatives (for more details see [19, 47]).

Modeling the computations of motor decision-making.

We modeled the decision-making task within the neurocomputational framework to simulate reaching behavior in instructed and choice trials. Fig 5A illustrates the activity of the reach planning field as a function of time for a representative instructed (top panel) and choice (bottom panel) trial. Initially, the field activity is in the resting state. After the target onset in the choice trial, two neuronal populations selective for the targets are formed and compete through mutual inhibitory interactions. The activity of the pause field also increased to further inhibit the reach planning field to delay the initiation of the action (Fig 6A blue trace shows the mean activity of the pause field across time in a choice trial). Once the activity of a neuronal population exceeds an action initiation threshold, the corresponding target is selected, the activity of the non-selected target is inhibited by the “winning” population, and a reaching movement is initiated. Under conditions when the competition between action plans is not resolved after movement onset, the activity of the unselected action is not completely suppressed, leading occasionally to “change-of-mind” that reverses the initial choice. When only one target is presented (Fig 5A top panel), the activity of the corresponding neuronal population exceeds the action initiation threshold faster due to the lack of inhibitory competition from an alternative option and the non-activation of the pause field (Fig 6A cyan trace shows that pause field activity remains on baseline). To get better insight on the model computations, consider two neurons from the reach planning field in the choice trial, one from each population, centered at the target locations (Fig 5D). The neuron that exceeds the action initiation threshold first (red continuous traces) dictates the RT and the selected target (i.e., the selected direction of movement). In the absence of action competition (instructed trial), the activity of the reach neuron (blue trace) exceeds the action initiation threshold faster than when two actions compete for selection (red traces). Hence, we predict that simulated instructed reaches have shorter RT than reaches in the choice trials. To test this prediction, we simulated 200 decision-making trials in which 50% of them involve choices between two competing options and the rest of them were instructed trials. Consistent with the prediction, we found that free choice movements have longer RT than instructed movements, as is shown in Fig 7A.

thumbnail
Fig 5. Simulated reach planning field neuronal activity changes in the decision making task, Eriksen flanker task and stop signal task.

A-C: Activity changes of the 181 neurons in the reach planning field during the decision making task (instructed trial and choice trial)(A), the Eriksen flanker task (incongruent trial and congruent trial)(B), and the stop signal task (go trial and stop trial)(C). D-F: Activity changes of single neurons in the reach planning field during the decision making task(D), the Eriksen flanker task(E), and the stop signal task(F).

https://doi.org/10.1371/journal.pcbi.1010111.g005

thumbnail
Fig 6. Simulated pause field activity changes during the three tasks.

A: Activity changes of single neuron in the pause field during the decision making-task. Cyan trace, simulated pause field activity during an instructed trial for a neurotypical individual. Magenta trace, simulated pause field activity during an instructed trial for a PD patient. Blue trace, simulated pause field activity during a choice trial for a neurotypical individual. Red trace, simulated pause field activity during a choice trial for a PD patient. B: Activity changes of single neuron in the pause field during the Eriksen flanker task. Cyan trace, simulated pause field activity during a congruent trial for a neurotypical individual. Magenta trace, simulated pause field activity during a congruent trial for a PD patient. Blue trace, simulated pause field activity during an incongruent trial for a neurotypical individual. Red trace, simulated pause field activity during an incongruent trial for a PD patient. C: Activity changes of single neuron in the pause field during the stop signal task. Blue trace, simulated pause field activity during a stop trial for a neurotypical individual. Red trace, simulated pause field activity during a stop trial for a PD patient.

https://doi.org/10.1371/journal.pcbi.1010111.g006

thumbnail
Fig 7. Simulated reaction times for the decision-making tasks, the Eriksen flanker task and the stop signal task.

A: Bar plots of the simulated RT for neurotypical individuals (Neurotypical) and PD patients (PD) in the instructed and choice trials of the decision-making task. B: Bar plots of the simulated RT for neurotypical individuals (Neurotypical) and PD patients (PD) in the congruent and incongruent trials of the Eriksen flanker task. C: Bar plots of the simulated RT for neurotypical individuals (Neurotypical) and PD patients (PD) in the go trials of the stop signal task. Error bars correspond to SE.

https://doi.org/10.1371/journal.pcbi.1010111.g007

Modeling the computations of conflicting information in motor decisions.

In the Eriksen flanker task, a “flanker” (i.e., distractor) appears 100 ms before the target. Once the flanker is presented and detected by the spatial sensory input field, a reach neuronal population tuned to the flanker direction is formed—i.e., the model prepares an action towards the direction of the flanker. If the upcoming target coincides with the flanker direction (congruent trial), the pause field will not be activated (Fig 6B cyan trace) and the activity of the reach neuronal population will be further increased, leading to fast reaching movements towards the target direction (Fig 5B top panel). On the other hand, if the target points to the opposite direction from the flanker (incongruent trial), a new reach neuronal population is formed and competes with the reach neuronal population of the flanker (Fig 5B bottom panel). The conflict signal field detects the “conflicting information” and activates the pause field (Fig 6B blue trace) to suppress the reach planning field so that the target population will have time to further increase its activity and win the competition. The expected outcome field, which encodes the correct movement direction, biases the competition towards the target direction. To better understand the mechanism of action regulation in the Eriksen flanker task, we consider two neurons centered at the location of the target and the distractor (Fig 5E). The neuronal activity of the distractor (red discontinuous trace) increases before the neuronal activity of the target (red continuous trace), since distractor precedes target presentation. Once the target is cued, the two neurons compete through inhibitory interactions. This competition, as well as the inhibition of the reaching neuronal population from the pause field, delay the action initiation, leading to longer RT. On the other hand, the lack of action competition and the non-activation of the pause field in the congruent trials (Fig 6B cyan trace) lead to shorter RT. To test this prediction, we simulated 200 Eriksen flanker task trials with 50% of them to be incongruent trials. Consistent with the prediction, we found that reaching movements in incongruent trials have longer RT than in congruent trials as illustrated in Fig 7B.

Modeling the computations of outright stopping of actions.

Regarding the stop signal task, the model needs to generate actions while anticipating a stop signal. The experimental results showed that when people anticipate a stop signal, they have longer RT as compared to when they do not anticipate a stop signal (i.e., instructed trials). This suggests that the pause field is active even in the go trials to increase the chances of being able to abandon an action in case stopping is required. The reach planning field activity in the go task resembles that of an instructed trial in the decision-making task (Fig 5C top panel), the only difference being that in the go trials the pause field is continuously active (Fig 6C blue trace). Hence, the activity of the reach planning field increases slower compared to the instructed trial, resulting in longer RT. In a go trial, the reach neuronal population tuned to the target direction is formed preparing an action. Once the activity of the population exceeds an action initiation threshold, the action is performed. However, in some trials, a stop signal is cued and the pause field activity is further increased, which subsequently inhibits the activity of the reach planning field to completely stop the planned or the ongoing action (Fig 5C bottom panel). To better understand the mechanism for stopping actions, consider one neuron from the population centered at the location of the target. The activity of the neuron increases once the target is cued and an action is initiated when the activity exceeds the action initiation threshold (Fig 5F blue trace). However, if a stop signal is cued, the pause field inhibits the activity of the neuron to stop the ongoing action (Fig 5F black trace). The stop signal is given with some delay (stop signal delay, SSD) in each trial. The longer the SSD is, the harder it is for the pause field to suppress the activity of the reach neuron increasing the chance to fail to stop the action. To test the model prediction, we simulated 100 go trials, as well as 250 stop trials, in which a stop stimulus appeared at different SSDs, signaling the model to abandon the action. Consistent with the model predictions, we found that go trials have longer RTs than instructed trials (two-tailed t-test, p<0.001, comparison made between the mean RT on instructed trials in the decision-making task and mean RT on go trials in the stop signal task), and the probability to successfully stop a response reduces with increased SSD—i.e., the longer the stop signal delay, the harder it is for the model to stop an action (Fig 8 blue trace).

thumbnail
Fig 8. Simulated probability to successfully stop an action as a function of the SSD.

The (simulated) probability to successfully stop an action as a function of the SSD for neurotypical individuals (Neurotypical, blue) and PD patients (PD, red).

https://doi.org/10.1371/journal.pcbi.1010111.g008

Dysfunction of the pause mechanism predicts motor impairment in PD patients

So far the neurodynamical theory is capable of capturing the action regulation behavior of the neurotypical individuals in the 3 action regulation tasks. However, one of the main findings in our study is that PD patients exhibit overall slower responses in nearly all tasks compared to neurotypical individuals. This motor impairment can be explained within the neurodynamical theory as a deficit on the pause mechanism. That is, the pause field is active even in the absence of conflicting information (congruent trials in the Eriksen flanker task) or competition between multiple actions (instructed trials in the decision-making task). To get a better understanding on how dysfunction of the pause mechanism affects motor behavior, Fig 6 shows the activity of the pause field as a function of time for a single trial across all tasks when modeling the motor behavior of neurotypical individuals and PD patients. In the decision-making task, the pause field is activated even when no action competition is presented (i.e., instructed trials) to capture the RT of the PD patient (Fig 6A magenta trace). This explains the slower response on initiating an action on instructed trials from PD patients. Also, the lack of difference on RT between neurotypical individuals and PD patients in free choice trials suggests that the pause field exhibits similar activation levels when deciding between competing options after targets onset in both groups (Fig 6A). We need to point out here that although the pause field exhibits the same activation level in instructed and free choice trials in PD patients, the slower response in choice trials compared to instructed trials is due to the inhibitory action competition between the two alternative movement directions. Regarding the Eriksen flanker task, the pause field is active before the target onset in PD patients, explaining the slower response in both congruent and incongruent trials compared to neurotypical individuals (Fig 6B red and magenta traces).

Additionally, another important finding in our study is that PD patients have shorter RT in go trials than neurotypical individuals in the stop signal task. By comparing the RT of movements between go trials in the stop signal task and instructed trials in the decision-making task, we found that neurotypical individuals delayed their responses in the go trials because they anticipated a stop signal as compared to when they did not anticipate a stop signal (i.e., instructed trials). This response delay effect (RDE) has been reported in previous studies [5255] and has been associated with an “active braking mechanism” that increases the chance of abandoning a response in case stopping is required [56]. Note that PD patients also exhibited this active braking mechanism, but the difference in RT between go trials with anticipation of stopping signal and instructed trials was much smaller compared to neurotypical individuals. Overall, these findings suggest that the pause field is active in the go trials for predicting the motor behavior in both groups of participants. In fact, the pause field activity is higher in neurotypical individuals than PD patients, before a stop signal is detected, to explain the slower response of the first group compared to the latter group (Fig 6C, blue and red traces). We also simulated 100 go trials and 250 stop trials for PD patients. Consistent with the behavioral findings, the go trials have longer RT in the simulated neurotypical individuals than PD patients (Fig 7C) (two-tailed t-test, p<0.001). Additionally, the model predicts that PD patients also have longer RTs in the go trials compared to instructed trials (two-tailed t-test, p<0.05), and that the probability to successfully stop a response is lower in PD patients than in neurotypical individuals (Fig 8) due to the faster response of PD patients.

Discussion

General

Operating effectively in an ever-changing environment requires not only the ability to select the best action, but also the flexibility to re-program actions in response to environmental changes. This includes delaying actions in the presence of conflicting information and completely abandoning obsolete actions when they are rendered inappropriate [5760]. Series of studies have explored how different brain regions contribute to programming, re-programming and stopping of actions using neural recordings and functional neuroimaging techniques [25, 26, 29, 30, 33, 34, 61, 62]. Furthermore, various computational theories including the drift-diffusion model (DDM), urgency-gating model (UGM), evidence accumulation model (EAM), race models and mutual inhibition models, have been constructed to explain how the brain selects between competing options, inhibits actions in the presence of conflicting information and abandons planned or ongoing actions when they are rendered inappropriate [6366]. Although these theories provide significant insights into the action regulation mechanisms that involve inhibitory control, a major limitation is that they explored separately each of these three motor functions, making it challenging to develop a unified theory of action regulation. A computational theory that can simulate the mechanisms underlying selecting, inhibiting and outright stopping of actions is needed to unify and integrate these distinctly studied actions and mechanisms.

Our research focuses exactly on what has been missing from previous studies—to design a large scale computational theory that can predict: 1) how the brain selects between competing actions, delays actions in the presence of conflicting information and stops actions when they are rendered inappropriate, 2) how neuropsychiatric diseases, such as PD, affect the action regulation circuitry and lead to motor deficits. Building on our previous work [47, 48], we developed a neurodynamical framework to integrate the three action regulation functions into a unified computational theory. This computational theory is based on the affordance competition hypothesis, in which multiple actions are formed concurrently and compete over time until one has sufficient evidence to win the competition [6]. It is analogous to the DDM in perceptual decisions in which two accumulators integrate sensory evidence in favor of two alternative options [67, 68]. The accumulator that exceeds its upper bound faster dictates the RT and the choice between the two options (more details about the difference between our neurocomputational framework and the DDM framework in modeling action selection tasks can be found in [19]—Discussion section: 3.2 From signal-detection theory to evidence accumulation to desirability competition. We replace evidence accumulation with desirability—a continuously evolving quantity that integrates all sources of information about the relative value of an action with respect to alternatives. The winning action determines the RT and the direction of movement. The computational theory includes a BG-type mechanism of inhibiting actions in the presence of competing options, conflicting information and stopping signals. The framework includes circuitry for perception, expected outcome, context signal, pause, action planning and execution. Among which the reach planning field, the spatial sensory input field, the expected outcome field and the pause field are sufficient to explain most of the behavioral findings. However, the context signal fields are necessary for detecting the conflicting/stop signal, as they ensure that the pause field receives appropriate input. The stochastic optimal controllers are required for generating motor behavior (i.e., reaching movements) with biologically plausible properties, such as velocities, direct movements to the target locations and so on. They are also needed to determine whether a successful stop is made within a certain distance in the stop signal task. In our previous work, we included a “reach cost field” which encodes the effort required to move in a particular direction [19]. However, despite its significance in action execution when more than one targets are available, it does not contribute to the current study, therefore was removed from the computational framework.

We tested the computational model in a series of tasks that involve action selection, decision conflict and outright stopping using neurotypical individuals and PD patients. Our findings showed that the model captures many aspects on human behavior, such as the longer RT in the presence of competing actions and conflicting information, as well as the inverse relationship between the probability to successfully stop an action and stop signal delay (SSD). It also predicts the motor impairment on PD patients when performing these three motor tasks as a deficit in the pause mechanism. In particular, the model explains the longer responses in generating actions even without the presence of competing action and conflicting information in PD patients compared to neurotypical individuals as a consequence of hyperactivity on the pause field. This is consistent with experimental evidence showing that STN is overacting in PD patients [69] leading to longer responses in visuomotor tasks. Overall, to the best of our knowledge, our study presents the first neurocomputational theory that integrates the mechanisms of three action regulation functions and predicts how disruption of these mechanisms can lead to motor deficits reported in neurological diseases such as PD.

Mapping to neurophysiology

The computational theory presented in the current study is a systems-level framework aimed to qualitatively predict response patterns of neuronal activities in ensembles of neurons, as well as motor behavior, in action regulation tasks. It captures many key features of the functional properties of the cortical-subcortical network involved in action regulation. The spatial sensory input field mimics the organization level of the posterior parietal cortex (PPC) [70, 71]. The expected reward field can be associated with the ventromedial prefrontal cortex (vmPFC) and orbitofrontal cortex (OFC), two frontal areas with important role in computation of expected outcome [72, 73]. The reach planning field can be associated with the parietal reach region (PRR) [74, 75] and the premotor dorsal cortex (PMd) [76, 77], two cortical areas involved in planning of reaching movements. The stop signal field can be equated with rIFG, which is recruited when cues associated with response inhibition are detected [78, 79]. Regarding the conflict signal field, the popular view is that preSMA detects the co-activation of different but conflicted responses (e.g., naming the color of the word red written with green color) and activates STN to temporarily suppress a response [80, 81]. Finally, the pause field can be equated to STN,which is activated in tasks that require stopping or pausing behavioral outputs to suppress actions [28, 32, 35, 40].

Computational modeling of action inhibition deficits in PD patients

PD is a progressive neurodegenerative disease associated with progressive loss of dopaminergic neurons in the substantia nigra of the BG [69]. The disruption of frontal-BG circuitry is responsible for the development of major symptoms of PD, including rigidity, tremor, bradykinesia, and postural instability [82, 83]. In particular, impairment of response inhibition abilities, which greatly affects the life quality of PD patients, is considered to be a sensitive measure to the progression of PD [84]. As a key player in the frontal-BG circuit, STN is suggested to mediate a “pause” function by rapidly inhibiting the BG activity. Therefore, it is considered to have a prominent role in the pathology of PD [85]. An increase in the neuronal activity of STN has been demonstrated in electrophysiological and behavioral studies in non-human primate models of PD [86] as well as PD patients [87]. Our findings suggest that an increase in the STN-mediated “pause” signal is responsible for the impairment of action inhibition abilities in PD patients. In our model, we assigned higher baseline activation level of the pause field in the decision-making task and Eriksen flanker task in PD patients compared with neurotypical individuals. Consistent with the model predictions, PD patients exhibited longer RT than healthy individuals in the instructed trials of the decision-making task, as well as in both incongruent trials and congruent trials of the Eriksen flanker task. Notably, RT in the free choice trials of the decision-making task wasn’t significantly different between PD patients and neurotypical individuals. This suggests that the pause field, which is already highly active in instructed trials, is not further activated in the choice trials.

An interesting finding in our study was that neurotypical individuals had slower response than PD patients to initiate an action in the stop signal task. This is somewhat counter-intuitive since STN is overactive in PD patients and therefore we would expect that they would have slower response than neurotypical individuals. However, when we compared RT between instructed trials (decision-making task) and go trials (stop signal task) of the neurotypical individuals, we found that they responded slower when they anticipated a stop signal. On the other hand, we found much subtler difference in RT between instructed trials and go trials in PD patients. This suggests that the pause mechanism is activated in the stop signal task in neurotypical individuals even before a stop signal is presented. By activating the pause field to simulate the motor behavior of the neurotypical individuals, the model predicts that PD patients will have faster responses and lower probability to stop planned or ongoing actions compared to neurotypical individuals. In other words, the model explains the slower responses of the neurotypical individuals as a cognitive strategy adapted to minimize the probability to fail to stop an action if a stop signal is detected.

Activity suppression or increase of action initiation threshold?

In our theory, the pause field delays motor decisions by suppressing the activity of the reach planning field. However, an alternative hypothesis is that the pause field mediates the action inhibition function by increasing the action initiation threshold. Previous studies suggest that STN low-frequency oscillatory activity and medial prefrontal cortex (mPFC)-STN coupling are involved in determining the amount of evidence (i.e., action initiation threshold) needed before making a decision [8891]. Additionally, clinical studies showed that deep brain stimulation (DBS) targeting STN in PD patients can modulate the amount of evidence, and therefore the action initiation threshold, required to initiate an action [89]. Hence, it is also likely that STN delays motor decisions in the presence of competing actions and/or conflicting information by increasing the action initiation threshold, instead of suppressing the activity of the motor areas that generate actions. Our computational theory is capable of modeling this hypothesis by adjusting the action initiation threshold in the reach planning field. However, it cannot dissociate between the two hypotheses on how STN pauses actions when needed. To do so, future neurophysiological or neuroimaging studies need to record activity from STN and motor areas during decision tasks with multiple options and/or conflicting information.

Hyperactive pause mechanism or altered cost/reward ratio in PD patients?

Although our study suggests that deficits in movement preparation in PD patients, such as slow RTs, are related to hyperactivity in STN that inhibits planned actions, other studies have associated motor impairments with motivational deficits [92]. In particular, motivational deficits seem to significantly contribute to bradykinesia in PD patients and lead to alternation in the amount of effort required to perform a movement at normal speed, as well as the perceived reward for successfully completing the action [93].

Motor decisions are frequently made based on expected reward and the associated effort cost required to obtain the reward. The cost has been considered to be detrimental, since we tend to choose the less costly actions especially when they are associated with similar expected rewards [94, 95]. The dopaminergic neurons seem to be critically involved in the process of cost versus reward (i.e., cost/reward ratio) evaluation. Dopamine depletion from rat results in decreased tolerance for effort cost, whereas enhanced dopamine levels have the opposite effect [94, 96]. Loss of dopaminergic neurons and their projections is a major pathological hallmark in PD patients. Clinical studies have shown that PD patients, regardless of medication status, tend to engage less effort for the lowest reward compared with neurotypical individuals in a hand-squeezing task [93]. However, dopamine medication motivates PD patients to engage more effort for a given reward, comparing to their off-medication state. In addition, DBS of STN establishes a reliable congruency between action and reward in PD patients and remarkably enhances it over the level observed in neurotypical individuals [97].

Overall, these studies provide evidence that impairment of movement preparation in PD patients can also be related to deficits in the mechanism that evaluates reward and effort cost associated with actions—i.e., alternation of the cost/reward ratio. Notably, this can be also modeled within our neurodynamical framework by increasing the amount of effort required to perform actions towards the cued directions. Additionally, the alternation of the cost/reward ratio in PD patients could be also related to the hyperactivity of STN—more effort is required to increase the activity of the motor population, which is continuously inhibited by STN, to initiate an action. Today, the mechanism for motor and information processing deficits in PD patients is still under extensive study. PD is considered not only a disease caused by degeneration of substantia nigra dopaminergic neurons, but also a system-level disease caused by dysfunction of the cortical-BG circuit [69]. Therefore, both the hyperactivity of STN and the altered cost/reward ratio could be considered parts of PD pathophysiology and contribute to the motor deficits in PD patients. In order to further dissociate between these two competing hypotheses, we have to design experiment paradigms that involve less “costly” motor actions, such as finger-tapping or saccadic movements. If altered cost/reward ratio, instead of hyperactive pause mechanism, is the major factor that contributes to the motor deficits in PD patients, it should have less impact on RT in actions that are associated with low effort cost. Such experimental paradigms combined with simultaneous recordings from multiple regions in the cortical-BG circuit, including STN, vmPFC and OFC during DBS surgeries, could further elucidate the mechanism of motor deficits in PD patients.

Limitations and theory-driven hypotheses

One limitation in our study is that full neuropsychological characterization of the PD patients (e.g., level of impulsivity) is not available. Furthermore, the age difference between the neurotypical and PD groups makes it challenging to disentangle the effects of age vs. PD. However, the overall behavioral performance of PD patients is consistent with previous studies, including slower movements [98] and prolonged RTs [2, 99]. Therefore, despite the fact that future work with age-matched controls and more detailed neuropsychological characterization of PD patients could provide more insights on how PD affects motor behavior, our study has significantly enhanced our understanding of the computational mechanisms of action regulation deficits in PD patients. In addition, although the neurodynamical theory introduced in the current study can predict many key features of motor behavior in neurotypical individuals and PD patients in action regulation tasks that involve action inhibition, it also has the same limitations as any computational theory on what it can predict and whether it can dissociate between alternative and competing hypotheses. For instance, as we discussed above, an alternative scenario on how STN contributes in motor inhibition is that it increases the action initiation threshold when the brain deals with competing options and conflicting information. Whether STN increases the action initiation threshold or suppresses the activity of motor areas cannot be dissociated in the current study, since both hypotheses predict comparable motor behavior—i.e., longer RTs. Similarly, we cannot exclude the hypothesis that inhibitory control is mediated by a global network, rather than dissociable brain networks that mediate the three action regulation functions. However, the current architecture can be easily modified to include a global pause function (i.e., one pause DNF) that mediates all the action regulation functions. Furthermore, we cannot exclude a hypothesis that the pause mechanism is involved only in outright stopping of actions. Selecting and switching actions in tasks with competing options (i.e., choice task) and conflicting information (i.e., Eriksen flanker task), respectively, could be made through a competition within the same circuit that guides the actions themselves (i.e., the reach planning field) without engaging the stopping circuitry. According to this hypothesis, action selection occurs only through an inhibitory competition between the alternative actions—i.e., the winning action determines the movement direction and RT. Similarly, switching actions in the incongruent trials may occur through an inhibitory competition between the action associated with the flanker stimuli, which appear earlier on the screen, and the action associated with the target—stopping circuitry is not involved in this scenario. These different hypotheses described above generate comparable motor outputs and therefore it is challenging, or even impossible, to dissociate them using the behavioral findings of the current study. However, we can easily refine the architecture of the computational theory as new evidence becomes available. In fact, this is one the roles of the proposed neurodynamical theory: to generate theory-driven hypotheses that can be tested in future experimental studies. For instance, neurophysiological studies that involve neural recordings and stimulation technologies in PD patients who undergo DBS implantation surgery can provide significant insights about the role of STN and other cortical regions in action inhibition.

Another challenge in our computational framework is the high degrees of freedom—i.e., the large number of parameters that need to be tuned to generate motor behavior and the underpinning neural activity. However, brain circuits are characterized by a high degree of structural and dynamic complexity in support of information processing. This biological reality is almost always reflected in the large number of free parameters in neurocomputational models [100]. Nevertheless, large-scale neurocomputational models, as the one proposed in the current study, are frequently over-parameterized resulting in more than one potential architectures that produce comparable behavioral outputs. Although this flexibility can make it difficult to falsify alternative architectures of the model, it could be argued that it is an advantage since the model builds multiple hypotheses that can be tested in future experimental studies.

We also need to point out that the model parameters have not been optimized so that the simulated motor behavior fits with the human behavioral data. This is common in systems-level models, since they aim to provide only qualitative predictions about the behavior and the neural mechanisms associated with visuomotor tasks. However, we can fit the model parameters to behavioral data using optimization methods, such as Genetic Algorithms (GAs) as presented in [101, 102]. In particular, the parameters that determine the DNF activity are the strength and the width of the interaction kernel, the resting level, the slope of the sigmoidal functions, and the strength of interactions with other DNFs. We can tune/optimize these parameters using GAs with appropriate cost functions to obtain the desired motor behavior that quantitatively predicts the human behavioral data.

Finally, although our model successfully predicts the RT of neurotypical participants and PD patients in the three action regulation tasks, it fails to predict the right-skewed distribution of the RTs. RTs, as many other quantities in neuroscience and psychology, are skewed to the right. Although there is no strong consensus yet, the right-skewed distribution of RT in tasks that people have to react to external stimuli has been associated with lapse of attention and/or tiredness and/or eye blink that cause some lengthy RTs [103]. Since our model does not involve mechanisms to simulate lapse of attention, fatigue, and eye blink, it cannot predict the right-skewed distribution of the RT.

Conclusion

In conclusion, the current study aims to advance our understanding on the computations underlying action regulations in tasks that involve action inhibition, the failure of which contributes to various neuropsychiatric diseases. We proposed a large scale neurodynamical computational framework that combines dynamic neural field theory with stochastic optimal control theory to simulate the mechanism of action regulation and to predict how disruption of this mechanism lead to motor deficits in PD patients. We evaluated the model predictions by comparing the motor behavior of neurotypical individuals and PD patients in three tasks that require action inhibition. To the best of our knowledge, our results revealed for the first time an integrated mechanism of action regulation that affects both action planning and action inhibition. When this mechanism is disrupted (as in PD patients), motor behavior is affected, leading to longer reaction times and higher error rates in decisions and actions. Overall, our findings provide significant insight on how the brain regulates actions that involve inhibition, and open new avenues for improving and developing therapeutic interventions for diseases that may involve this circuit.

Materials and methods

Ethics statement

The study was approved by the University of California, Los Angeles Review Board and all individuals signed a written informed consent before participating.

Participants

A sample of 15 adults with PD (all males) and 32 neurologically healthy adults (13 females) participated in the study. The ages at the time of the experiment were 65.5 ± 8.6 (mean ± SD) years old for PD patients and 33.8 ± 6.4 years old for neurotypical individuals. The Hoehn and Yahr (H&Y) Scale for PD patients at the time of the experiment was 1.53 ± 0.64 (mean ± SD). All PD patients performed the experiments when they were on medications. The Levodopa equivalent dosing for PD patients was 610.5 ± 367.5 (mean ± SD) mg per day.

Stimuli and procedure

Decision-making task.

All experiments were programmed using Psychtoolbox 3 for Matlab. Experimental setup is shown in Fig 1. In the decision-making task, participants sat in a dark room in front of a 22-inch Dell LED monitor where stimuli would be presented on. The screen was approximately 50 cm away from the participant. A two-dimensional joystick (Thrustmaster T.16000M FCS, maximum range of axis value is -32,000 +32,000) was placed in front of the monitor. During the task, the participants were instructed to move the joystick towards the left or right direction using their right hand in reaction to the corresponding stimulus. Each trial started with the screen turning black. After 1.0–1.1 s, a white fixation cross appeared in the center of the black screen for 1.0–1.1 s, then the white fixation cross disappeared, and four white arrows appear in the center of the black screen. In 50% of the trials (choice trials), two of the arrows pointed to the left, and the other two to the right (e.g. < < > >), in which case the participant needed to freely decide whether they would move the joystick to the left or right. In the other 50% of the trials (instructed trials), the four arrows were pointing to the same direction (left or right) (e.g. < < < <), in which case the participant needed to move the joystick towards the direction the arrows were pointing to. The arrows remained on the screen for up to 1.5 s before they disappear, then the screen turned black for 0.5 s. If the participant responded to the stimulus by moving the joystick to the left or right (axis value threshold for response: -25000 to the left/+25000 to the right) when the arrows were presented on the screen, after 10ms, the screen would turn black for the remaining of the 1.5 s plus 0.5 s, after which the screen would remain black and the next trial would start. If the joystick did not return to the baseline (axis value between -2500 and +2500), the next trial would not start until the joystick returned to the baseline. Every participant performed 2 blocks of trials, with 52 trials in each block. In each block of trials, there are 26 choice trials and 26 instructed trials. The trial type (choice or instructed) were randomized. Before each trial, the participant did not know whether the next trial would be a choice trial or an instructed trial. The RT for each trial was recorded as the time interval between the appearance of the arrows on the screen and the participant’s response.

Eriksen flanker task.

An arrow version of the Eriksen flanker task [104] with arrows pointing to the left and right was performed in our study. During the Eriksen flanker task, the same equipment as described in 3.2.1 were used, the major difference being that in each trial, the target stimulus was flanked by stimuli which were pointing to the opposite direction of the target arrow (incongruent trial) or to the same direction as the target arrow (congruent trial), and every participant was told to move the joystick towards the same direction as the target arrow using his/her right hand. In each trial, the screen first turned black for 1.0–1.1 s, then a white fixation cross appeared in the center of the screen for 1.0–1.1 s. After this interval, four white flanker arrows pointing to one direction (left or right) appeared in the center of the screen, leaving a blank space in the middle (e.g. < < < <). After 100 ms, a white target arrow appeared in the blank space, pointing either to the opposite direction of the flankers (incongruent trial) or the same direction (congruent trial). The target arrow and the flankers remained on the screen for up to 1.5 s, then disappeared, and the screen turned black for 0.5 s. If the participant responded to the target arrow by moving the joystick to the left or right, after 10ms, the screen would turn black for the remaining of the 1.5 s plus 0.5 s, after which if the joystick returned to baseline, the screen would remain black and start the next trial. Each participant performed two blocks of trials, with 52 trials in each block, making a total of 104 trials. In each block of trials, there are 26 incongruent trials and 26 congruent trials. The direction of the target arrows and the type of flanker (incongruent or congruent) were randomized. The RT for each trial was recorded as the time interval between the appearance of the target arrow and the participant’s response.

Stop signal task.

A trial in a stop signal task is either a go trial or a stop trial. In each trial, arrows pointing to the left or right direction were presented on the screen as a stimulus. In a go trial (no stop signal is presented), the participant should respond as fast as possible by moving the joystick towards the direction the arrows were pointing to. In a stop trial, the participant should try to inhibit their response after the stop signal was cued. Participants were told that stop was not always possible, and that stop trials and go trials are equally important. Before the experiment, each participant performed 24 training trials, including 16 go trials and 8 stop trials. At the beginning of a trial, the screen turned black. After 1.0–1.1 s, a white fixation cross appeared in the center of the screen for 1.0–1.1 s, then the fixation cross disappeared, and four white arrows pointing to the left or right appeared in the center of the screen. In a go trial, the arrows remained on the screen for up to 1.5 s before they disappeared, then the screen turned black for 0.5 s. If the participant responded to the stimulus by moving the joystick when the arrows were presented on the screen, after 10ms, the screen turned black for the remaining of the 1.5 s plus 0.5 s, after which if the joystick returned to baseline, the screen remained black and the next trial was started. A stop trial is nearly identical to a go trial, except that the arrows turned red after an interval termed “stop signal delay” (SSD) indicating that the participant should abandon any response immediately. If the participant inhibited their actions, the arrows remained on the screen for the rest of 1.5 s, and in the subsequent stop trial, the SSD would increase by 50 ms, making inhibition more challenging. If the participant failed to inhibit their actions, after 10 ms, the arrows disappeared, and the screen turned black for the remaining of the 1.5 s plus 0.5 s, after which if the joystick returned to the baseline, the screen remained black and the next trial would start. In this case, the SSD would decrease by 50 ms, making it easier to inhibit actions. Each participant performed 3 blocks of trials, with 60 trials in each block. In each block of trials, there were 40 go trials and 20 stop trials. The direction of the arrows and the type of trial (go or stop) were randomized. The RT for each go trial and failed stop trial were recorded as the time interval between the appearance of white arrows and the participant’s response.

Statistical analysis

Cubic interpolating splines were used to smooth the reach trajectories and compute the velocity of the movements. RT was defined as the time between the target appearance and the time that reach velocity exceeded 10% of the maximum velocity. RTs faster than 100ms were removed because anticipation is considered to be involved prior to actions, as well as RTs longer than 1500 ms. RT outliers (RTs >3 standard deviations below or above the mean RT) were also excluded from the analysis. The trials in which the participant changed their mind (moving towards one direction past 5% of the maximum range, and then changed their mind to move towards the other direction) were also excluded from further analysis. RTs across all participants were pooled together, and for the decision making task and the Eriksen flanker task, two-way ANOVA analysis was performed to determine the group differences in RTs. For the stop signal task, two-tailed t-test was performed to determine the group differences in go trial RTs.

Computational model architecture

We developed a neurodynamical framework based on our previous studies [47, 48] to model the three action regulation functions. The computational framework combines dynamic neural field theory with stochastic optimal control theory, and includes circuitry for perception, expected outcome, context signal, pause, action planning and execution. Each DNF simulates the dynamic evolution of firing rate activity of a network of neurons over a continuous space with local excitation and surround inhibition. The functional properties of each DNF are determined by the lateral inhibition within the field and the connections with other fields in the architecture. The projections between the fields can be topologically organized—i.e., each neuron i in the field drives the activation at the corresponding neuron i in the other field (one-to-one connections), or unordered—i.e., each neuron in one field is connected with all neurons on the other field (one-to-all connections). The activity of a field j evolves over time under the influence of external inputs, local excitation and lateral inhibition interactions within the field, as well as interactions with other k fields, as described by Eq (1): (1) where u(x, t) is the local activity of the DNF at the position x and time t, and is the rate of change of the activity over time scale by a time constant τ. If there is no external input S(x, t), the field converges over time to the resting state h from the current level of activation. The first convolution term models interactions between the simulated neurons at different locations within the field j, and is shaped by the interaction kernel of Eq (2), which consists of both excitatory and inhibitory components: (2) where Cexc, Cinh, σexc and σinh describe the amplitude and the width of the excitatory and the inhibitory components, respectively. We convolved the kernel function with a sigmoidal transformation of the field so that the neurons with activity above a threshold participate in the intra-field interactions: (3) in which the steepness of the sigmoid function was controlled by β.

The function wkj describes the connectivity kernel between fields uj and uk showing the contribution of field uk to the dynamics of field uj. The sigmoid fk(uk) and wjk are convolved to determine the full contribution from field uk to uj.

The architectural organization of the framework is shown in Fig 4. The “reach planning” field encodes the potential movement directions, and is responsible for initiating the reaching movements. The “spatial sensory input” field encodes the angular representations of the competing targets. The “expected outcome” field encodes the expected reward for reaching to a particular direction centered on the hand position. The outputs of these two fields send excitatory projections (green arrows) to the reach planning field in a topological manner. The “pause” field suppresses the activity of the reach planning field to inhibit planned or ongoing actions via inhibitory projections to the reach planning field. The stop signal field and the conflict signal field encode information related to the contextual requirement of the task (i.e., stopping cue or flanker distractor), and send one-to-all excitatory projections to the corresponding population of the pause field. In particular, the stop signal field projects to the neuronal population of the pause field which is responsible for outright stopping of action, whereas the conflict signal field projects to the neuronal population of the pause field, which is responsible for delaying decisions when conflicting information is detected. Each of the context signal fields (stop signal field and conflict signal field) consists of 100 neurons, whereas the pause field consists of 3 neuronal sub-populations, each consists of 75 neurons. The rest of the fields consist of 181 neurons with a preferred direction between 0 to 180 degrees. The activity of the reach planning field Saction is given as the sum of the outputs of the fields encoding the position of the target vpos, the expected reward vreward, and the activity from the pause field vpau, at any given time and state, corrupted by a Gaussian distributed additive noise ξ. (4) where ηpos, ηreward and ηpau are scalar values that weigh the influence of the spatial sensory input field, the expected outcome field and the pause field, respectively, to the activity of the reach planning field. The values of the model parameters are given in S1 Table. The normalized activity of the reach planning field describes the relative desirability di of each “reach neuron” with respect to the alternative options at time t—i.e., the higher the activity of a reach neuron j, the higher the desirability to move towards the preferred direction φj of this neuron with respect to the alternatives at a given time t. Each neuron j in the reach planning field is connected with a control scheme that generates reaching trajectories. Once the activity of that neuron exceeds the action initiation threshold γ, the controller is triggered and generates an optimal policy πj, a sequence of motor actions towards the preferred direction of the neuron j. The optimal policy is given by minimization of the cost function: (5) where πj(xt) is the policy from the time t = 1 to t = TJ to reach towards the preferred direction φj; Tj is the time required to arrive at position pj; pj is the position planned to arrive (goal position) at the end of the reaching movement, given by pj = [rcos(φj), rsin(φj)], in which r is the distance between the current location of the hand and the location of the stimulus encoded by the neuron j. is the state vector at the end of the reaching movement, and matrix S selects the actual position of the hand and the goal position at the end of the reaching movement from the state vector. Matrices and R define the cost dependent on precision and control, respectively. More details about the optimal control model are described in [47, 48]. Consequently, a action is initiated once a neuronal population exceeds the action initiation threshold and the executed action πmix(xt) is given as a mixture of the active policies (i.e., policies with active neurons) weighted by relative desirability values of the corresponding neurons at any given time and state. (6) where xt is the state of the system at time t (i.e., position, velocity, orientation of the trajectory), dj is the normalized activity of the neuron j (i.e., relative desirability value of the neuron j), and πj is the optimal policy generated by the controller connected with neuron j. Because desirability is time- and state-dependent, the weighted mixture of the individual policies can change/correct the current trajectory in the presence of new incoming information—e.g., a stop signal cued while acting. In order to handle contingencies during the movement, the “receding horizon control” (RHC) [105, 106] technique, also known as model predictive control (MPC), which is widely used in stochastic optimal control models, was implemented in the framework. According to RHC, the framework would only execute the initial portion of the sequence of actions for a short period of time τ (τ = 9 in our framework), after which the framework would recompute the optimal policy πmix(xt + τ) from time t+τ to t+τ+Ti, and this approach would continue until the hand reaches one of the targets.

Supporting information

S1 Fig. RT distribution in the decision-making task, the Eriksen flanker task and the stop signal task.

A-E: RT distribution of neurotypical individuals (Neurotypical) and PD patients (PD) in the instructed trials (A) and choice trials (B) of the decision-making task; in the congruent trials (C) and incongruent trials (D) of the Eriksen flanker task; and in the go trials of the stop signal task (E).

https://doi.org/10.1371/journal.pcbi.1010111.s001

(EPS)

S2 Fig. Maximum reaching velocity in the decision-making task, the Eriksen flanker task and the stop signal task.

A: Bar plots of the mean maximum reaching velocity (axis value/s) for neurotypical individuals (Neurotypical) and PD patients (PD) across all participants in each group, in the instructed and choice trials of the decision-making task. B: Bar plots of the mean maximum reaching velocity for neurotypical individuals (Neurotypical) and PD patients (PD) across all participants in each group, in the congruent and incongruent trials of the Eriksen flanker task. C: Bar plots of the mean maximum reaching velocity for neurotypical individuals (Neurotypical) and PD patients (PD) across all participants in each group, in the go trials of the stop signal task. Error bars correspond to standard error (SE). White dots represent the mean of maximum reaching velocity for each participant.

https://doi.org/10.1371/journal.pcbi.1010111.s002

(EPS)

S1 Text. Reaction time distribution.

Reaction time distribution for the three action regulation tasks.

https://doi.org/10.1371/journal.pcbi.1010111.s003

(DOCX)

S2 Text. Velocity of reaching movements.

We analyzed the reaching velocities in the three action regulation tasks.

https://doi.org/10.1371/journal.pcbi.1010111.s004

(DOCX)

S1 Table. Model parameters.

The values of the parameters of the neurodynamical framework.

https://doi.org/10.1371/journal.pcbi.1010111.s005

(PDF)

References

  1. 1. Gauggel S, Rieger M, Feghoff TA. Inhibition of ongoing responses in patients with parkinson’s disease. Journal of Neurology, Neurosurgery & Psychiatry. 2004;75(4):539–544. pmid:15026491
  2. 2. Wylie SA, van den Wildenberg WPM, Ridderinkhof KR, Bashore TR, Powell VD, Manning CA, et al. The effect of parkinson’s disease on interference control during action selection. Neuropsychologia. 2009;47(1):145–157. pmid:18761363
  3. 3. Yaniv A, Benaroya-Milshtein N, Steinberg T, Ruhrrman D, Apter A, Lavidor M. Specific executive control impairments in tourette syndrome: The role of response inhibition. Research in developmental disabilities. 2017;61:1–10. pmid:28039814
  4. 4. Morein-Zamir S, Fineberg NA, Robbins TW, Sahakian BJ. Inhibition of thoughts and actions in obsessive-compulsive disorder: extending the endophenotype? Psychological medicine. 2010;40(2):263–272. pmid:19573261
  5. 5. van Velzen LS, Vriend C, de Wit SJ, van den Heuvel OA. Response inhibition and interference control in obsessive–compulsive spectrum disorders. Frontiers in human neuroscience. 2014;8:419. pmid:24966828
  6. 6. Cisek P. Cortical mechanisms of action selection: the affordance competition hypothesis. Philosophical Transactions of the Royal Society B: Biological Sciences. 2007;362(1485):1585–1599. pmid:17428779
  7. 7. Cisek P, Kalaska JF. Neural mechanisms for interacting with a world full of action choices. Annual review of neuroscience. 2010;33:269–298. pmid:20345247
  8. 8. Gallivan JP, Barton KS, Chapman CS, Wolpert DM, Flanagan JR. Action plan co-optimization reveals the parallel encoding of competing reach movements. Nature communications. 2015;6(1):1–9. pmid:26130029
  9. 9. Gallivan JP, Logan L, Wolpert DM, Flanagan JR. Parallel specification of competing sensorimotor control policies for alternative action options. Nature neuroscience. 2016;19(2):320. pmid:26752159
  10. 10. Gallivan JP, Chapman CS, Wolpert DM, Flanagan JR. Decision-making in sensorimotor control. Nature Reviews Neuroscience. 2018;19(9):519–534. pmid:30089888
  11. 11. McPeek RM, Han JH, Keller EL. Competition between saccade goals in the superior colliculus produces saccade curvature. Journal of neurophysiology. 2003;89(5):2577–2590. pmid:12611995
  12. 12. Cisek P, Kalaska JF. Neural correlates of reaching decisions in dorsal premotor cortex: specification of multiple direction choices and final selection of action. Neuron. 2005;45(5):801–814. pmid:15748854
  13. 13. Baumann MA, Fluet MC, Scherberger H. Context-specific grasp movement representation in the macaque anterior intraparietal area. Journal of Neuroscience. 2009;29(20):6436–6448. pmid:19458215
  14. 14. Eriksen CW, Schultz DW. Information processing in visual search: A continuous flow conception and experimental results. Perception & psychophysics. 1979;25(4):249–263. pmid:461085
  15. 15. Miller J. Discrete versus continuous stage models of human information processing: in search of partial output. Journal of Experimental Psychology: Human Perception and Performance. 1982;8(2):273. pmid:6461722
  16. 16. Gratton G, Coles MG, Sirevaag EJ, Eriksen CW, Donchin E. Pre-and poststimulus activation of response channels: a psychophysiological analysis. Journal of Experimental Psychology: Human perception and performance. 1988;14(3):331. pmid:2971764
  17. 17. Chapman CS, Gallivan JP, Wood DK, Milne JL, Culham JC, Goodale MA. Reaching for the unknown: multiple target encoding and real-time decision-making in a rapid reach task. Cognition. 2010;116(2):168–176. pmid:20471007
  18. 18. Chou IH, Sommer MA, Schiller PH. Express averaging saccades in monkeys. Vision research. 1999;39(25):4200–4216. pmid:10755158
  19. 19. Enachescu V, Schrater P, Schaal S, Christopoulos V. Action planning and control under uncertainty emerge through a desirability-driven competition between parallel encoding motor plans. PLoS computational biology. 2021;17(10):e1009429. pmid:34597294
  20. 20. Tversky A, Kahneman D. The framing of decisions and the psychology of choice. Science. 1981;211(4481):453–458. pmid:7455683
  21. 21. Haith AM, Huberdeau DM, Krakauer JW. Hedging your bets: intermediate movements as optimal behavior in the context of an incomplete decision. PLoS computational biology. 2015;11(3):e1004171. pmid:25821964
  22. 22. Wong AL, Haith AM. Motor planning flexibly optimizes performance under uncertainty about task goals. Nature communications. 2017;8(1):1–10. pmid:28256513
  23. 23. Nashed JY, Diamond JS, Gallivan JP, Wolpert DM, Flanagan JR. Grip force when reaching with target uncertainty provides evidence for motor optimization over averaging. Scientific reports. 2017;7(1):1–8. pmid:28916824
  24. 24. Alhussein L and Smith MA. Motor planning under uncertainty. Elife. 2021;10:e67019. pmid:34486520
  25. 25. Mars RB, Piekema C, Coles MG, Hulstijn W, Toni I. On the programming and reprogramming of actions. Cerebral Cortex. 2007;17(12):2972–2979. pmid:17389629
  26. 26. Li CS, Huang C, Constable RT, Sinha R. Imaging response inhibition in a stop-signal task: neural correlates independent of signal monitoring and post-response processing. Journal of Neuroscience. 2006;26(1):186–192. pmid:16399686
  27. 27. Ray NJ, Brittain JS, Holland P, Joundi RA, Stein JF, Aziz TZ, et al. The role of the subthalamic nucleus in response inhibition: evidence from local field potential recordings in the human subthalamic nucleus. Neuroimage. 2012;60(1):271–278. pmid:22209815
  28. 28. Wessel JR, Jenkinson N, Brittain JS, Voets SH, Aziz TZ, Aron AR. Surprise disrupts cognition via a fronto-basal ganglia suppressive mechanism. Nat Commun. 2016;7. pmid:27088156
  29. 29. González-Villar AJ, Bonilla FM, Carrillo de-la Peña MT. When the brain simulates stopping: neural activity recorded during real and imagined stop-signal tasks. Cognitive, Affective, & Behavioral Neuroscience. 2016; 16(5):825–835. pmid:27160368
  30. 30. Wagner J, Wessel JR, Ghahremani A, Aron AR. Establishing a right frontal beta signature for stopping action in scalp eeg: implications for testing inhibitory control in other task contexts. Journal of cognitive neuroscience. 2018;30(1):107–118. pmid:28880766
  31. 31. Bastin J, Polosan M, Benis D, Goetz L, Bhattacharjee M, Piallat B, et al. Inhibitory control and error monitoring by human subthalamic neurons. Transl Psychiatry. 2014; 4(9). pmid:25203170
  32. 32. Benis D, David O, Piallat B, Kibleur A, Goetz L, Bhattacharjee M, et al. Response inhibition rapidly increases single-neuron responses in the subthalamic nucleus of patients with parkinson’s disease. Cortex. 2016; 84:111–123. pmid:27745848
  33. 33. Chen X, Scangos KW, Stuphorn V. Supplementary motor area exerts proactive and reactive control of arm movements. Journal of Neuroscience. 2010;30(44):14657–14675. pmid:21048123
  34. 34. Pani P, Giarrocco F, Giamundo M, Montanari R, Brunamonti E, Ferraina S. Visual salience of the stop signal affects the neuronal dynamics of controlled inhibition. Scientific reports. 2018;8(1):1–13. pmid:30250230
  35. 35. Schmidt R, Leventhal DK, Mallet N, Chen F, Berke JD. Canceling actions involves a race between basal ganglia pathways. Nat Neurosci. 2013;16(8):1118–1124. pmid:23852117
  36. 36. Parent A, Hazrati LN. Functional anatomy of the basal ganglia. i. the cortico-basal ganglia-thalamo-cortical loop. Brain research reviews. 1995;20(1):91–127. pmid:7711769
  37. 37. Aron AR, Fletcher PC, Bullmore ET, Sahakian BJ, Robbins TW. Stop-signal inhibition disrupted by damage to right inferior frontal gyrus in humans. Nature neuroscience. 2003;6(2):115–116. pmid:12536210
  38. 38. Chambers CD, Bellgrove MA, Stokes MG, Henderson TR, Garavan H, Robertson IH, et al. Executive “brake failure” following deactivation of human frontal lobe. Journal of cognitive neuroscience. 2006;18(3):444–455. pmid:16513008
  39. 39. Haynes WI, Haber SN. The organization of prefrontal-subthalamic inputs in primates provides an anatomical substrate for both functional specificity and integration: implications for basal ganglia models and deep brain stimulation. Journal of Neuroscience. 2013;33(11):4804–4814. pmid:23486951
  40. 40. Aron AR, Poldrack RA. Cortical and subcortical contributions to stop signal response inhibition: role of the subthalamic nucleus. Journal of Neuroscience. 2006;26(9):2424–2433. pmid:16510720
  41. 41. Aron AR, Behrens TE, Smith S, Frank MJ, Poldrack RA. Triangulating a cognitive control network using diffusion-weighted magnetic resonance imaging (mri) and functional mri. Journal of Neuroscience. 2007;27(14):3743–3752. pmid:17409238
  42. 42. Rae CL, Hughes LE, Anderson MC, Rowe JB. The prefrontal cortex achieves inhibitory control by facilitating subcortical motor pathway connectivity. Journal of neuroscience. 2015;35(2):786–794. pmid:25589771
  43. 43. Sandamirskaya Y. Dynamic neural fields as a step toward cognitive neuromorphic architectures. Frontiers in Neuroscience. 2014;7(276). pmid:24478620
  44. 44. Knips G, Zibner SK, Reimann H, Schöner G. A neural dynamics architecture for grasping that integrates perception and movement generation and enables on-line updating. Frontiers in neurorobotics. 2017;11(9). pmid:28303100
  45. 45. Todorov E. Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system. Neural computation. 2005;17(5):1084–1108. pmid:15829101
  46. 46. Diedrichsen J, Shadmehr R, Ivry RB. The coordination of movement: optimal feedback control and beyond. Trends Cogn Sci. 2010;14(1):31–39. pmid:20005767
  47. 47. Christopoulos V, Bonaiuto J, Andersen RA. A biologically plausible computational theory for value integration and action selection in decisions with competing alternatives. PLoS Comput Biol. 2015;11(3):e1004104. pmid:25803729
  48. 48. Christopoulos V, Schrater PR. Dynamic integration of value information into a common probability currency as a theory for flexible decision making. PLoS Comput Biol. 2015;11(9):e1004402. pmid:26394299
  49. 49. Luce RD. Response times: Their role in inferring elementary mental organization. Number 8. Oxford University Press on Demand, 1986.
  50. 50. Ramautar JR, Kok A, Ridderinkhof KR. Effects of stop-signal probability in the stop-signal paradigm: The n2/p3 complex further validated. brain and cognition. Brain Cogn. 2004;56(2):234–252. pmid:15518938
  51. 51. Van de Laar MC, Wildenberg WP, Boxtel GJ, MW Molen. Processing of global and selective stop signals: Application of donders’ subtraction method to stop-signal task performance. Exp Psychol. 2010;57(2):149–159. pmid:20178958
  52. 52. Verbruggen F, Logan GD. Response inhibition in the stop-signal paradigm. Trends in cognitive sciences. 2008;12(11):418–424. pmid:18799345
  53. 53. Verbruggen F, Logan GD. Proactive adjustments of response strategies in the stop-signal paradigm. J Exp Psychol Hum Percept Perform. 2009;35(3):835–854. pmid:19485695
  54. 54. Zandbelt BB, Bloemendaal M, Neggers SF, Kahn RS, Vink M. Expectations and violations: delineating the neural network of proactive inhibitory control. Hum Brain Mapp. 2013;34(9):2015–2024. pmid:22359406
  55. 55. Verbruggen F, Aron AR, Band GP, Beste C, Bissett PG, Brockett AT, et al. A consensus guide to capturing the ability to inhibit actions and impulsive behaviors in the stop-signal task. Elife. 2019;8(e46323). pmid:31033438
  56. 56. Jahfari S, Stinear CM, Claffey M, Verbruggen F, Aron AR. Responding with restraint: what are the neurocognitive mechanisms? J Cogn Neurosci. 2010;22(7):1479–1492. pmid:19583473
  57. 57. Archambault PS, Ferrari-Toniolo S, Battaglia-Mayer A. Online control of hand trajectory and evolution of motor intention in the parietofrontal system. Journal of Neuroscience. 2011;31(2):742–752. pmid:21228183
  58. 58. Boucher L, Palmeri TJ, Logan GD, Schall JD. Inhibitory control in mind and brain: an interactive race model of countermanding saccades. Psychological review. 2007;114(2):376. pmid:17500631
  59. 59. Orban de Xivry JJ, Lefèvre P. A switching cost for motor planning. Journal of neurophysiology. 2016;116(6):2857–2868. pmid:27655964
  60. 60. Logan GD, Cowan WB. On the ability to inhibit thought and action: A theory of an act of control. Psychological review. 1984;91(3):295.
  61. 61. Swann N, Tandon N, Canolty R, Ellmore TM, McEvoy LK, Dreyer S, et al. Intracranial eeg reveals a time-and frequency-specific role for the right inferior frontal gyrus and primary motor cortex in stopping initiated responses. Journal of Neuroscience. 2009;29(40):12675–12685. pmid:19812342
  62. 62. Wessel JR, Conner CR, Aron AR, Tandon N. Chronometric electrical stimulation of right inferior frontal cortex increases motor braking. Journal of Neuroscience. 2013;33(50):19611–19619. pmid:24336725
  63. 63. Thura D, Beauregard-Racine J, Fradet CW, Cisek P. Decision making by urgency gating: theory and experimental support. Journal of neurophysiology. 2012;108(11):2912–2930. pmid:22993260
  64. 64. Krajbich I, Rangel A. Multialternative drift-diffusion model predicts the relationship between visual fixations and choice in value-based decisions. Proceedings of the National Academy of Sciences. 2011;108(33):13852–13857. pmid:21808009
  65. 65. Vickers D, Smith P. Accumulator and random-walk models of psychophysical discrimination: a counter-evaluation. Perception. 1985;14(4):471–497. pmid:3834388
  66. 66. Edwards DH. Mutual inhibition among neural command systems as a possible mechanism for behavioral choice in crayfish. Journal of Neuroscience. 1991;11(5):1210–1223. pmid:2027043
  67. 67. Vickers Douglas, Packer Jeanette. Effects of alternating set for speed or accuracy on response time, accuracy and confidence in a unidimensional discrimination task. Acta psychologica. 1982;50(2):179–197.
  68. 68. Kiani Roozbeh, Corthell Leah, Shadlen Michael N. Choice certainty is informed by both evidence and decision time. Neuron. 2014;84(6):1329–1342.
  69. 69. Alexander GE. Biology of parkinson’s disease: pathogenesis and pathophysiology of a multisystem neurodegenerative disorder. Dialogues in clinical neuroscience. 2004;6(3):259. pmid:22033559
  70. 70. Andersen RA, Cui H. Intention, action planning, and decision making in parietal-frontal circuits. Neuron. 2009;63(5):568–583. pmid:19755101
  71. 71. Hadjidimitrakis K, Bakola S, Wong YT, Hagan MA. Mixed spatial and movement representations in the primate posterior parietal cortex. Front Neural Circuits. 2019;13(15). pmid:30914925
  72. 72. Padoa-Schioppa C, Assad JA. Neurons in the orbitofrontal cortex encode economic value. Nature. 2006;441(7090):223–226. pmid:16633341
  73. 73. O’Doherty JP. Contributions of the ventromedial prefrontal cortex to goal-directed action selection. Annals of the New York Academy of Sciences. 2011;1239(1):118–129. pmid:22145881
  74. 74. Snyder LH, Batista AP, Andersen RA. Coding of intention in the posterior parietal cortex. Curr Opin Neurobiol. 1997;386(6621):167–70. pmid:9062187
  75. 75. Batista AP, Buneo CA, Snyder LH, Andersen RA. Reach plans in eye-centered coordinates. Science. 1999;285(5425):257–260. pmid:10398603
  76. 76. Pastor-Bernier A, Cisek P. Neural correlates of biased competition in premotor cortex. J Neurosci. 2011;31(19):7083–7088. pmid:21562270
  77. 77. Pastor-Bernier A, Tremblay E, Cisek P. Dorsal premotor cortex is involved in switching motor plans. Front. Neuroeng. 2012;5(5). pmid:22493577
  78. 78. Aron AR, Robbins TW, Poldrack RA. Inhibition and the right inferior frontal cortex. Trends Cogn Sci. 2004;8(4):170–177. pmid:15050513
  79. 79. Hampshire A, Chamberlain SR, Monti MM, Duncan J, Owen AM. The role of the right inferior frontal gyrus: inhibition and attentional control. NeuroImage. 2010;50(3):1313–9. pmid:20056157
  80. 80. Wiecki TV, Frank MJ. A computational model of inhibitory control in frontal cortex and basal ganglia. Psychological review. 2013; 120(2):329. pmid:23586447
  81. 81. Zavala B, Zaghloul K, Brown P. The subthalamic nucleus, oscillations, and conflict. Mov Disord. 2015;30(3):328–338. pmid:25688872
  82. 82. Hess CW, Hallett M. The phenomenology of parkinson’s disease. In Seminars in neurology, volume 37, page 109. NIH Public Access, 2017.
  83. 83. Borrione P, Tranchita E, Sansone P, Parisi A. Effects of physical activity in parkinson’s disease: A new tool for rehabilitation. World Journal of Methodology. 2014;4(3):133. pmid:25332912
  84. 84. Harrington DL, Shen Q, Theilmann RJ, Castillo GN, Litvan I, Filoteo JV, et al. Altered functional interactions of inhibition regions in cognitively normal parkinson’s disease. Frontiers in aging neuroscience. 2018;10:331. pmid:30405399
  85. 85. Brittain JS, Watkins KE, Joundi RA, Ray NJ, Holland P, Green AL, et al. A role for the subthalamic nucleus in response inhibition during conflict. Journal of Neuroscience. 2012;32(39):13396–13401. pmid:23015430
  86. 86. Miller WC, DeLong MR. Altered tonic activity of neurons in the globus pallidus and subthalamic nucleus in the primate mptp model of parkinsonism. In The basal ganglia II, pages 415–427. Springer, 1987.
  87. 87. Remple MS, Bradenham CH, Kao CC, Charles PD, Neimat JS, Konrad PE. Subthalamic nucleus neuronal firing rate increases with parkinson’s disease progression. Movement Disorders. 2011;26(9):1657–1662. pmid:21542021
  88. 88. Bogacz R, Brown E, Moehlis J, Holmes P, Cohen JD. The physics of optimal decision making: a formal analysis of models of performance in two-alternative forced-choice tasks. Psychological review. 2006; 113(4):700. pmid:17014301
  89. 89. Frank MJ. Hold your horses: a dynamic computational role for the subthalamic nucleus in decision making. Neural networks. 2006;19(8):1120–1136. pmid:16945502
  90. 90. Cavanagh JF, Wiecki TV, Cohen MX, Figueroa CM, Samanta J, Sherman SJ, et al. Subthalamic nucleus stimulation reverses mediofrontal influence over decision threshold. Nature neuroscience. 2011;14(11):1462–1467. pmid:21946325
  91. 91. Herz DM, Zavala BA, Bogacz R, Brown P. Neural correlates of decision thresholds in the human subthalamic nucleus. Current Biology. 2016;26(7):916–920. pmid:26996501
  92. 92. Mazzoni P, Hristova A, Krakauer JW. Why don’t we move faster? parkinson’s disease, movement vigor, and implicit motivation. Journal of neuroscience. 2007;27(27):7105–7116. pmid:17611263
  93. 93. Chong TT, Bonnelle V, Manohar S, Veromann KR, Muhammed K, Tofaris GK, et al. Dopamine enhances willingness to exert effort for reward in parkinson’s disease. cortex. 2015;69:40–46. pmid:25967086
  94. 94. Salamone JD, Correa M, Farrar A, Mingote SM. Effort-related functions of nucleus accumbens dopamine and associated forebrain circuits. Psychopharmacology. 2007;191(3):461–482. pmid:17225164
  95. 95. Walton ME, Kennerley SW, Bannerman DM, Phillips PE, Rushworth MF. Weighing up the benefits of work: behavioral and neural analyses of effort-related decision making. Neural networks. 2006;19(8):1302–1314. pmid:16949252
  96. 96. Salamone JD, Correa M. Motivational views of reinforcement: implications for understanding the behavioral functions of nucleus accumbens dopamine. Behavioural brain research. 2002;137(1-2):3–25. pmid:12445713
  97. 97. Wagenbreth C, Zaehle T, Galazky I, Voges J, Guitart-Masip M, Heinze HJ, et al. Deep brain stimulation of the subthalamic nucleus modulates reward processing and action selection in parkinson patients. Journal of Neurology. 2015;262(6):1541–1547. pmid:25929662
  98. 98. Mazzoni P, Shabbott B, Cortés JC. Motor control abnormalities in parkinson’s disease. Cold Spring Harbor perspectives in medicine. 2012;2(6):a009282. pmid:22675667
  99. 99. Evarts EV, Teräväinen H, Calne DB. Reaction time in parkinson’s disease. Brain: a journal of neurology. 1981; 104(Pt 1):167–186. pmid:7470841
  100. 100. Xiao ZC, Lin KK, Young LS. A data-informed mean-field approach to mapping of cortical parameter landscapes. PLoS computational biology. 2021;17(12):e1009718.
  101. 101. Igel C, Erlhagen W, Jancke D. Optimization of dynamic neural fields. Neurocomputing. 2001; 36(1-4):225–233.
  102. 102. JC Quinton. Exploring and optimizing dynamic neural fields parameters using genetic algorithms. In The 2010 International Joint Conference on Neural Networks (IJCNN). 2010;pages 1–7. IEEE.
  103. 103. Hervey AS, Epstein JN, Curry JF, Tonev S, Arnold LE, Conners CK, et al. Reaction time distribution analysis of neuropsychological performance in an adhd sample. Child Neuropsychology. 2006;12(2):125–140. pmid:16754533
  104. 104. Eriksen BA, Eriksen CW. Effects of noise letters upon the identification of a target letter in a nonsearch task. Perception & psychophysics. 1974;16(1):143–149.
  105. 105. Mayne DQ, Rawlings JB, Rao CV, Scokaert POM. Constrained model predictive control: Stability and optimality. Automatica. 2000;36(6):789–814.
  106. 106. Goodwin G, Seron MM, De Doná JA. Constrained control and estimation: an optimisation approach. Springer Science & Business Media, 2006.