Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Analysis of motor control strategy for frontal and sagittal planes of circular tracking movements using visual feedback noise from velocity change and depth information

  • Geonhui Lee,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Resources, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Mechanical and Control Engineering, Handong Global University, Pohang, Republic of Korea

  • Woong Choi ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Resources, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    wchoi@ice.gunma-ct.ac.jp (WC); jhkim@handong.edu (JK)

    Affiliation Department of Information and Computer Engineering, National Institute of Technology, Gunma College, Maebashi, Japan

  • Hanjin Jo,

    Roles Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Mechanical and Control Engineering, Handong Global University, Pohang, Republic of Korea

  • Wookhyun Park,

    Roles Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Mechanical and Control Engineering, Handong Global University, Pohang, Republic of Korea

  • Jaehyo Kim

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Validation, Writing – original draft, Writing – review & editing

    wchoi@ice.gunma-ct.ac.jp (WC); jhkim@handong.edu (JK)

    Affiliation Department of Mechanical and Control Engineering, Handong Global University, Pohang, Republic of Korea

Abstract

We aim to investigate a control strategy for the circular tracking movement in a three-dimensional (3D) space based on the accuracy of the visual information. After setting the circular orbits for the frontal and sagittal planes in the 3D virtual space, the subjects track a target moving at a constant velocity. The analysis is applied to two parameters of the polar coordinates, namely, ΔR (the difference in the distance from the center of a circular orbit) and Δω (the difference in the angular velocity). The movement in the sagittal plane provides different depth information depending on the position of the target in orbit, unlike the task of the frontal plane. Therefore, the circular orbit is divided into four quadrants for a statistical analysis of ΔR. In the sagittal plane, the error was two to three times larger in quadrants 1 and 4 than in quadrants 2 and 3 close to the subject. Here, Δω is estimated using a frequency analysis; the lower the accuracy of the visual information, the greater the periodicity. When comparing two different planes, the periodicity in the sagittal plane was approximately 1.7 to 2 times larger than that of the frontal plane. In addition, the average angular velocity of the target and tracer was within 0.6% during a single cycle. We found that if the amount of visual information is reduced, an optimal feedback control strategy can be used to reduce the positional error within a specific area.

Introduction

Imitation movement based on visual information is important in motor learning tasks, such as daily movements, sports, and working with tools [15], and there have been various studies on human movements utilizing visual information guides [614]. Most of the research on tracking motion using visual guidance has been performed on a one-dimensional (1D) linear trajectory [12, 13] and two-dimensional (2D) circular trajectory [611, 14]. During these experiments, visual feedback regarding the positions and velocities of a target and a tracer was provided [614].

However, human motion is performed in a three-dimensional (3D) space, and includes movement in the sagittal plane, unlike tracking movements of 1D or 2D trajectories on the frontal plane. Depth information is required in order to determine the position of the target on the sagittal plane [15]. When performing a tracking movement that includes depth information, visual feedback on the position of the target is not sufficient [1518]. Most of the previous studies analyzed the tracking motion from the frontal plane, and accordingly, the tracking motion analysis reflecting depth information was insufficient [614].

With the recent development of virtual reality (VR) technology, it was possible to implement various human movement experiments in a 3D virtual space. Some previous studies analyzed circular tracking motion in a 3D space, including depth information, using these VR devices [1619]. In these studies, the tracking movement with constant velocity was conducted on the frontal and sagittal planes. One study analyzed positional errors in Cartesian coordinates [16]. Another study analyzed the three parameters ΔR (the difference in the distance from the fixed pole), Δθ (the difference in the position angle), and Δω (the difference in the angular velocity) in terms of the polar coordinates [17]. It was reported that the positional error is influenced by the depth information, and the phase error(Δθ) is proportional to the target velocity.

In circular tracking movement, there is no difference in depth information between each target position on the frontal plane. However, in the case of the sagittal plane, there is a difference in depth information depending on each position of the target, which causes a difference in the visual information where the target exists in the orbit. In the previous studies using VR, the average value of the parameters measured were analyzed without considering the difference in depth information according to the position of the target [16, 17]. For this reason, the previous studies were insufficient for analyzing the difference in visual feedback information [16, 17].

In this study, we analyzed the difference according to the depth information of a circular orbit divided into four quadrants in a circular tracking movement. The tracking movement along with the circular orbit has a constant periodicity on the frontal and sagittal planes. On the sagittal plane, the change in depth information varies with a constant periodicity. The experiment was conducted under four different velocity conditions in order to compare the difference according to the target velocity. The ΔR parameter was statistically analyzed in each quadrant. In addition, to confirm the periodicity, a frequency analysis was conducted on the fast Fourier transform (FFT) of the Δω parameter. We also investigated the visuo-motor control strategy according to the accuracy of the visual information from the viewpoint of the optimal feedback control (OFC).

Materials and methods

Subject

The subjects of the experiment were 26 adult men and women with an average age of 24.88 ± 3.18 years (Table 1). All subjects had normal or corrected-to-normal vision. None of the subjects had previously participated in a similar study. Four of the subjects were left-handed, and 22 subjects were right-handed (Table 1). All subjects received sufficient explanation regarding the experimental procedure and gave their written informed consent prior to the experiment. The protocol was approved by the ethics committee of the National Institute of Technology, Gunma College.

thumbnail
Table 1. Subject information: Age, sex, and dominant hand.

https://doi.org/10.1371/journal.pone.0241138.t001

Experiment setup

We implemented a 3D VR environment using the Unity 3D program. An HTC VIVE Headset and a handheld controller were used as the interfaces [16]. The subjects were asked to conduct a circular tracking movement with visual guidance in a VR space, and used a tracer to track a target (Fig 1), namely, a red ball with a radius of 1.5 cm. The tracer was a yellow ball with a radius of 1 cm and a 20-cm-long stick. The position of the tracer was synchronized using the handheld controller, as shown in Fig 1. The upper limbs of the subjects were not displayed in the VR space. Therefore, the subjects received visual feedback of their hand position and direction through the tracer. Circular orbits were presented on the frontal and sagittal planes with a 15-cm radius. The moving pathway of the target was invisible to the subjects. In previous studies about tracking movement, the target velocities were set to 0.05~1.8Hz (Table 2). Accordingly, these studies inspired us to select target speeds of four target speeds: V1 = 0.125, V2 = 0.25, V3 = 0.5, and V4 = 0.75 Hz.

thumbnail
Fig 1. Experimental procedure.

(A) Typical example of experimental setup and x-, y-, and z-axis data in the frontal plane. (B) Typical example of experimental setup and x-, y-, and z-axis data in the sagittal plane. The diagrams to the right of (A) and (B) show the plane position, subject’s rotational direction along the target, and the radius of the trajectory. The movement of the target was only shown to the subject during the experiment, and the pathway was invisible. The green line indicates the target’s movement, and the black solid line shows the tracking data of the subject.

https://doi.org/10.1371/journal.pone.0241138.g001

In this study, the target was moved clockwise in the circular orbit when the right-handed subjects were performing the experiment, and counterclockwise in the circular orbit when the left-handed subjects were performing the experiment. The reason for using the counterclockwise direction with the left-handed subjects is to allow them to perform the same movement based on the human internal coordinate system.

The subjects wore a VIVE headset and held a controller with their dominant hand while sitting on a chair. The distance between the eye and the screen of the VIVE headset was adjusted according to the criteria of each subject. The upper body of the subject was fastened using a belt to limit shoulder movement.

We applied a method for calibrating the initial position of the target optimized for the subject’s arm length and height to minimize the effect of the different anthropometric parameters on the experimental results. The initial position of the target was calibrated before the experiments because the height and arm length of each subject were different.

P(px,py,pz) is the coordinate of the target, and px,py,pz indicates the coordinates for the x-axis [m], y-axis [m], and z-axis [m] of the target. The chin position of the subject was measured, and the initial Px position was set based on this (Fig 2A). The system measured the stretched position of the subject’s arm length and initialized Py, Pz (Fig 2B). Px was taken as the initial position on the same line as the chin. The initial Py position was set to 15 cm above the center of the circle (Fig 2B). Pz was determined considering the case where the subject performed a tracking motion on the sagittal plane. Using the stated calibration process, feasible ranges of motion of individual subjects were determined in order to practice the tracking movements without the need to fully stretch the multi-joint upper limb. Moreover, a virtual trajectory of the target could be generated at an appropriate distance from the head-mounted display (HMD) to prevent any potential contact or penetration of the target on the subject’s body. Accordingly, the target was positioned 20% closer to the body from the position of the subject's stretched arm (Fig 2B). The two constants (15 cm, 20%) were set according to a preliminary test to ensure that the subject had a safe and comfortable working space.

thumbnail
Fig 2. Calibration procedure.

(A) Initialization of target x-axis position (B) Initialization of target y-axis, z-axis position. Process (A) is performed first, and then process (B) is performed to set the initial position of the x, y, and z axes of the target.

https://doi.org/10.1371/journal.pone.0241138.g002

Before starting the main experiment, the subject was familiarized with the VR space using a pre-experiment. The experiment was started by providing an auditory signal to the subject after a 3-s countdown. One trial consisted of five revolutions of the circle. All subjects continuously conducted five trials of the circular tracking movement at the same velocity, and were given a break for 5 min before the next five trials. Therefore, a total of 40 experimental trials were conducted (five trials with 4 velocities × 2 planes) for each subject. To avoid the subjects’ learning effects, the experiment was executed using a random counterbalance for both the planes and velocity of the target.

Data analysis

The positional data based on the Cartesian coordinates from the tracer and the target were measured during each task. For the data analysis, the x, y, and z data were converted into the radial and angular velocities of the polar coordinates, and were designated as R and ω, respectively. In addition, the difference in each parameter was calculated to compare the differences in movements between the tracer and the target. The experiment was performed using five trials under each condition; however, the first and last trials were excluded from the analysis, because they were considered to be transient sections.

(1)(2)(3)(4)(5)

ΔR is defined as the difference in the absolute radial distance from the origin between the target and the tracer. This can be confirmed using Eq (1). The values of ΔR were classified into four quadrants, and were calculated as the average value for all subjects in the same quadrant for each trial. Eqs (2) to (5) represent the definitions of the average values of ΔR in each quadrant. The constant n represents the total time of the three trials at each target velocity. We calculated the mean (M) and standard deviation (SD) of the normalized ΔR for the 26 subjects.

(6)(7)

In Eq (6), Δω is defined as the absolute difference in the angular velocity between the target and the tracer. This parameter was calculated as the mean value for 26 subjects, where m represents the total number of subjects.

In this study, we investigated the relationship between the velocity of the target and the quadrant position during 3D target tracking movements. Therefore, the data on ΔR were statistically analyzed using a two-way repeated analysis of variance (ANOVA) for the quadrants (with four levels, i.e., quadrant 1, Q1, quadrant 2, Q2, quadrant 3, Q3, and quadrant 4, Q4), and velocity (with four levels of V1 = 0.125, V2 = 0.25, V3 = 0.5, and V4 = 0.75 Hz) factors. Statistical analyses and data visualization were conducted using SPSS Statistics V26 (IBM) and MATLAB (MathWorks).

In this study, the subjects repeatedly conducted circular tracking movements. In particular, it is necessary to check the periodicity on the sagittal plane because the depth information of the target changes periodically. To do this, Δω was analyzed using the FFT, which is shown in Eq (8), where n represents the total time for three trials at each target velocity.

The FFT analysis of Δω was conducted after pre-processing with a low-pass filter (LPF). The cutoff frequency was determined to be 5 Hz, which can sufficiently measure the movement of the human body [26, 27].

(8)

Results

We compared the average trajectories of the target and tracer on each plane. Comparing the average orbit of the tracer with the orbit of the target on the frontal plane, we noticed that the orbits are mostly similar in all quadrants (Fig 3), with the difference being independent of the velocity of the target.

thumbnail
Fig 3. Average circular tracking movement in the frontal plane.

(A) The movement trajectory of the target and controller at (A) V1 (0.125 Hz), (B) V2 (0.25 Hz), (C) V3 (0.5 Hz), and (D) V4 (0.75 Hz). The order of the moving target is the Q1, Q4, Q3, and Q2.

https://doi.org/10.1371/journal.pone.0241138.g003

When comparing the trajectories of the tracer and target on the sagittal plane, there is a large ΔR in the fourth quadrant, regardless of the velocity (Fig 4). This indicates that errors in the tracer and target trajectory varied depending on the quadrant in which the tracer was located.

thumbnail
Fig 4. Average circular tracking movement in the sagittal plane.

(A) The movement trajectory of the target and controller at (A) V1 (0.125 Hz), (B) V2 (0.25 Hz), (C) V3 (0.5 Hz), and (D) V4 (0.75 Hz). The order of the moving target is the Q1, Q4, Q3, and Q2.

https://doi.org/10.1371/journal.pone.0241138.g004

Analysis of ΔR between frontal and sagittal planes

The magnitude of ΔR increased as the velocity of the target increased, regardless of the plane of the task (Figs 58). Comparing the frontal and sagittal planes at the same velocity, a larger ΔR was shown on the sagittal plane (Figs 58). In addition, the ΔR value of the target and the tracer on the sagittal plane was noticeable at certain points, indicating that the size of ΔR varies depending on the trajectory position of the tracer and target.

thumbnail
Fig 5. Average circular tracking movement at 0.125 Hz.

The R value for three trials on the (A1) frontal plane (A1) and (A2) sagittal plane. Absolute value of ΔR on the (B1) frontal plane (B1) and (B2) sagittal plane, ω value for three trials on the (C1) frontal plane (C1) and (C2) sagittal plane, and absolute value of Δω on the (D1) frontal plane (D1) and (D2) sagittal plane.

https://doi.org/10.1371/journal.pone.0241138.g005

thumbnail
Fig 6. Average circular tracking movement at 0.25 Hz.

R value for three trials on the (A1) frontal plane (A1) and (A2) sagittal plane. Absolute value of ΔR on the (B1) frontal plane (B1) and (B2) sagittal plane. ω value for three trials on the (C1) frontal plane (C1) and (C2) sagittal plane. Absolute value of Δω on the (D1) frontal plane (D1) and (D2) sagittal plane.

https://doi.org/10.1371/journal.pone.0241138.g006

thumbnail
Fig 7. Average circular tracking movement at 0.5 Hz.

R value for three trials on the (A1) frontal plane (A1) and (A2) sagittal plane. Absolute value of ΔR on the (B1) frontal plane (B1) and (B2) sagittal plane. ω value for three trials on the (C1) frontal plane (C1) and (C2) sagittal plane. Absolute value of Δω on the (D1) frontal plane (D1) and (D2) sagittal plane.

https://doi.org/10.1371/journal.pone.0241138.g007

thumbnail
Fig 8. Average circular tracking movement at 0.75 Hz.

R value for three trials on the (A1) frontal plane (A1) and (A2) sagittal plane. Absolute value of ΔR on the (B1) frontal plane (B1) and (B2) sagittal plane. ω value for three trials on the (C1) frontal plane (C1) and (C2) sagittal plane. Absolute value of Δω on the (D1) frontal plane (D1) and (D2) sagittal plane.

https://doi.org/10.1371/journal.pone.0241138.g008

On the frontal plane, there was a significant difference between the velocity of the target (F (1.776, 44.399) = 48.675, p = 0, partial η2 = 0.661, item A in S1 Table) and the quadrant of the orbit (F (2.166, 54.143) = 9.658, p = 0, partial η2 = 0.279, item A in S1 Table). On the sagittal plane, there were significant differences between the velocity of the target (F (3, 75) = 34.941, p = 0, partial η2 = 0.583, item A in S2 Table) and quadrants of the orbit (F (2.092, 52.288) = 56.260, p = 0, partial η2 = 0.692, item A in S2 Table). These results indicate that the quadrant and velocity factors affect the value of ΔR during the circular tracking movement. In particular, the significant difference in each quadrant indicates that there is a difference in the control of the ΔR value according to the track position on the same plane.

Next, a pairwise comparison was conducted to analyze the control performance between quadrants. As shown in Fig 9A, there was a significant difference in ΔR in the quadrant of the frontal plane at V1 and V4. There was no significant difference between quadrants at V2 and V3, when comparing the quadrants for each velocity. At V1, there was a significant difference between quadrant 4 and the other quadrants. For a velocity of 4, there was a significant difference between quadrants 4 and 2 (items B–E in S1 Table). On the frontal plane, the difference between the fourth quadrant with the largest ΔR and the second quadrant with the smallest ΔR averaged approximately 3.38 mm (Table 3). However, on the sagittal plane, the ΔR value between the second and fourth quadrants was 10.32 mm on average (Table 3), which was approximately three times higher than on the frontal plane. This implies that there is some difference in ΔR between the four quadrants on the frontal plane; however, it is not noticeable when compared to that on the sagittal plane.

thumbnail
Fig 9. Evaluation of ΔR in circular tracking movement.

(A) Pairwise comparisons are shown for ΔR between four quadrants on the frontal plane. (B) Pairwise comparisons are indicated for ΔR between four quadrants on the sagittal plane.

https://doi.org/10.1371/journal.pone.0241138.g009

As shown in Fig 9B, a significant difference in ΔR in the quadrant is shown for V1, V2, V3, and V4 on the sagittal plane. There were significant differences between the fourth quadrant and the other quadrants, regardless of the velocity, when comparing the quadrants at each velocity. In addition, in the first and fourth quadrants, the errors in the radius tend to be larger than those in the second and third quadrants. According to the statistical analysis, the ΔR value in the fourth quadrant was significantly different from that in the other quadrants, and as aforementioned, the ΔR value of the sagittal plane was approximately three times higher than that of the frontal plane. We found that the difference in ΔR between the quadrants on the sagittal plane was more noticeable than that of the frontal plane, and the ΔR value tended to increase as the distance between the subject and the target increased.

thumbnail
Table 3. Average ΔR values between the target and the tracer, and standard deviation of ΔR.

https://doi.org/10.1371/journal.pone.0241138.t003

Analysis of Δω between frontal and sagittal planes

The values of Δω increased as the velocity increased, regardless of the plane in which the task was performed (Figs 58). At the same velocity, the values of Δω were larger on the sagittal plane than on the frontal plane (Figs 58). During the three trials, the ω values of the tracer were maintained at substantially constant values at V1 and V2, and at V3 and V4, it was observed that the ω values of the tracer changed to a sinusoidal shape over time, and periodicity was observed in the variation (Figs 58). This shows that the ω values change with periodicity when the target moves fast (V ≥ 0.5 Hz).

Fig 10 shows the ω values for each velocity on the frontal and sagittal planes in the frequency domain. At V1 (Fig 10A) and V2 (Fig 10B), the amplitude spectrum is between 0 and 2.5 Hz, and the area of the amplitude spectrum (1.37 Hz∙deg/s (V1) and 2.74 Hz∙deg/s (V2) on the frontal plane, and 2.13 Hz∙deg/s (V1) and 4.53 Hz∙deg/s (V2) on the sagittal plane) is smaller than the amplitude spectrum area (8.15 Hz∙deg/s (V3) and 22.84 Hz∙deg/s (V4) on the frontal plane, and 14.03 Hz∙deg/s (V3) and 39.97 Hz∙deg/s (V2) on the sagittal plane) at V3 and V4. At V3 (Fig 10C) and V4 (Fig 10D), the amplitude spectrum appears between 0 and 5 Hz, which is relatively large compared to the values at V1 and V2. In addition, it can be seen that the amplitude spectrum area of the sagittal plane is larger than the amplitude spectrum area of the frontal plane regardless of the velocity. We found that the periodicity features were stronger on the sagittal plane than on the frontal plane. We propose that depth information affects the periodicity of ω.

thumbnail
Fig 10. Frequency analysis of ω.

Analysis of the ω values of the frontal and sagittal planes within the frequency domain at (A) V1, (B) V2, (C) V3, and (D) V4.

https://doi.org/10.1371/journal.pone.0241138.g010

Table 4 compares the average ω values of the target and tracer during each trial on the frontal and sagittal planes. Regardless of the velocity and plane, the average ω values of the target and multiple tracers were almost the same, and the error was within 0.5%. The maximum standard deviation was 3.2 deg/s, and there was no significant difference in the average ω among the subjects. This means that the time of one trial is almost the same for both the tracer and target. Therefore, the period of one trial is a more important control parameter than the instantaneous ω value of the tracer in orbit during a repeated circular tracking movement.

thumbnail
Table 4. Average ω value of target and tracer, and standard deviation of tracer ω value.

https://doi.org/10.1371/journal.pone.0241138.t004

Discussion

This research aims to examine motor control strategies based on the reliability of visual information on the frontal and sagittal planes for circular tracking movements. The results demonstrated that the subjects performed the tracking movements to reduce position errors between the target and the tracer when the reliability of visual information was superior. This was shown by a minor ΔR during performances on the frontal plane and the velocity of the target is slow. In contrast, the reduced reliability of visual information led to periodic motor performance based on a particular location being the purpose of motor control. This can be confirmed by the value of ΔR, which depends on the quadrant of the trajectory, and by the frequency analysis of Δω.

The following topics are discussed in the following sections: (1) identification of optimal feedback control for circular tracking movement, (2) relationship between visual information and rhythmic movement, and (3) future work.

Identification of optimal feedback control for circular tracking movement

A plane is 2D space consisting of two orthogonal coordinate axes, and it is essential to identify the relevant axes in order to accurately comprehend the position of an object on a certain plane. For instance, the x- and y-axes are dominant factors in movements on the frontal plane. Both axes are parallel to the subjects, and any positional changes of the target and the tracer can be spotted on the x- and y-axes. Therefore, visual information obtained from the frontal plane is highly accurate [1618]. However, on the sagittal plane, the y- and z-axes are dominant components. Positional changes on the y-axis can be easily detected because the axis is parallel to the subjects; however, for the z-axis, it is difficult to observe its positional changes, because it contains depth information in the orthogonal direction from the subject’s view. The axis can only be estimated by varying the sizes of the target and the tracer. This indicates that obtaining accurate visual feedback is relatively challenging on the sagittal plane [1618].

Motor uncertainty increases when the accuracy of sensory information decreases or is hindered by the presence of noise in human movements [28]. According to the study by Yuille and Kersten, visuo-motor uncertainty is derived from the ambiguity of projecting 3D information on a 2D retina [29]. Moreover, our previous studies illustrated that the accuracy of visual information was reduced when the target and the tracer became distant from the subjects [1618]. These discoveries indicate that insufficiency of visual information increased the motor uncertainty and consequently allowed larger ΔR between the target and the tracer on the sagittal plane than on the frontal plane. In fact, ΔR increased when the target velocity increased, irrespective of the planes. Meaning, the growth in ΔR, observed with the increased target velocity, could be explained by an increase in motor uncertainty due to ambiguity related to the sensory information. Potential causes of motor uncertainty may also be muscular fatigue or the fact that different muscles are utilized in different planar movements. The reasons will be investigated in detail in future studies.

The results of the circular tracking movements can be interpreted as multisensory integration based on Bayesian decision theory [3032]. The most dominant sensory feedbacks in the given experimental setup were visual and proprioceptive information. Neural weights of the feedback are determined by their sensory reliabilities and transfer information with respect to on motor performance [3032]. Van Beers and Wolpert discovered that the weight of the visual information is larger on the frontal plane, whereas the proprioceptive information retains more weight in accordance with depth on the sagittal plane [15]. However, this study analyzed the reaching movement, and the purpose location of the movement was one point. On the other hand, in the circular tracking movement performed in our study, the purpose location of movement is the number of points on the trajectory. Through this, we inferred that there would be a difference between the sensory information acquired at each target position in the tracking movement. In particular, on the sagittal plane, the reliability of visual information appears to vary depending on the depth difference. If this is applied to the Bayesian decision theory, it can be inferred that the weights of visual information and proprioception information change during the tracking exercise. To confirm this, we divided the trajectory into four quadrants and checked the value of ΔR.

The characteristics of motor performance in each plane were analyzed to obtain a planar comparison of the control strategies. By dividing one orbit of the target’s trajectory into four quadrants, the changes in ΔR throughout all quadrants of the frontal plane could be considered trivial (Figs 3 and 9A). The weight of the visual information did not change because the distance between the subject and the target on the z-axis remains identical for all quadrants [15]. On the sagittal plane, the second quadrant had the smallest value of ΔR, while the fourth quadrant had the greatest ΔR (Figs 4 and 9B). The second quadrant can be considered as the section where the visual information contains the most sensory weight because the quadrant is the closest to the subject’s eye compared to other quadrants. In contrast, the fourth quadrant is located at the farthest distance from the eye, and is examined to cause a decrease in the weight of the visual information and the rise of the proprioceptive weight [15]. In general, proprioceptive information provides less accurate feedback than visual information [32, 33]. This infers that the accuracy of the tracking movement is increased in the second quadrant and reduced in the fourth quadrant. However, when a change in direction occurs from downward movement to upward movement affected by the direction of gravity, a change in contraction of the muscles may occur. This may be the cause of the difference in ΔR depending on the quadrant in which the target and tracer are located. Since measurements have not been made in the present study, it is necessary to confirm this in future studies.

Inoue and Sakaguchi investigated target tracking movements by manipulating a vertically movable slider [12]. The target was repeatedly moved in a sinusoidal waveform on a 1D line by adjusting its velocity and direction, and the subject was to control the slider to move the cursor displayed on a screen. The experiment was designed to be performed under five different conditions: target visible at full trajectory, target removal at the top turning point, at the center with upward, at the bottom turning point, and at the center with downward. In summary, the condition of the visual feedback during the tracking movement was periodically modified. From the results of Inoue and Sakaguchi’s study, it can be inferred that the area with the visible target allowed movements with high weight on the visual-feedback control, whereas the subjects executed movements with high weight on feedforward control within the target-removed area.

The subjects could only detect y-axis displacements, and hardly noticed z-axis displacements of both the target and the tracer visually when they conducted the tracking movement on the sagittal plane. Furthermore, the visual condition of the circular tracking movement on the sagittal plane periodically changed with the difference in depth information. This would make the main use of information only in one axis, and would lead to repeated adjustment of visual information’s weight, which indicates some similarity to visual conditions from Inoue and Sakaguchi’s experiment. According to their study, the position error of the tracer on the 1D trajectory tended to be minimized in a particular section, although the location of the section differed depending on the provided visual condition [12]. This indicates that the brain does not continuously monitor ongoing motor performance but rather executes movements with the aim of having high accuracy on certain points, implying that the visual condition is a dominant factor that influences movements [12].

The result of the circular tracking movement in the sagittal plane retained the least ΔR in the second quadrant, irrespective of the target velocity (Fig 9). Similar to Yasuyuki and Yutaka’s study, our results of the tracking movement were examined to minimize ΔR at certain points. This could be considered similar to the experimental results obtained by the periodic weight change of similar visual information. This inference may be controversial because particular arm kinematics may be the cause of the minimization of ΔR at certain points. Aspects of the arm kinematics could be different if the subjects conduct the tracking movement in the opposite direction, so differences in motor performance in counterclockwise circular tracking movements will be examined in future studies.

The OFC is a control method that integrates feedforward-based optimization and feedback control to ensure the accuracy of a movement goal [34]. In other words, humans actively utilize feedback for an area related to the given movement goal, and feedforward control is performed to reduce the cost in a less relevant area [34]. Van Beers and Wolpert observed that the distance of target decreases, the weight of visual information is relatively high, and the subject performs active feedback control [15]. On the other hand, the weight of the proprioceptive information is high and feed-forward control is performed further with increment of target distances [15]. In this study, it can also be inferred that the subjects performed active visual feedback control in the second quadrant where the distance to the target is close, compared with the results on the sagittal plane, minimizing ΔR in the second quadrant could be interpreted as a goal of the tracking movement. Other quadrants can be considered as areas where feedforward control is more dominant when moving the tracer along the predicted trajectory than actively utilizing feedback. In these areas, ΔR is believed to increase owing to the absence of active feedback for optimized movements. Thus, motor control is optimized by actively applying feedback control to aspects directly related to accomplishing the movement goal, and by minimizing interference for irrelevant tasks [3438].

The circular tracking movement on the sagittal plane was analyzed in order to determine limitations in position feedback control because of the weight change of the visual information. As a result, the circular tracking movement appeared to minimize the ΔR through feedback control in the second quadrant, where the weight of the visual information is the largest. However, in the other quadrants, the OFC was applied to the tracking movement by optimally adopting feedforward control. On the frontal plane, the ΔR throughout all four quadrants was trivial, and the deviation of ΔR was approximately three times greater on the sagittal plane than on the frontal plane. This clearly indicates that the tracking movement on the frontal plane utilizes feedback control as a primary control mechanism for all areas because the frontal plane provides high accuracy of the visual information on the target through the entire trajectory.

Relationship between visual information and rhythmic movement

If the target is moving at a relatively slow velocity (V1 or V2), the ω value of the tracer is less than that of the target at all points in time, regardless of the planes. In contrast, Δω increases if the target moves at a relatively high velocity (V3 or V4). The extent of the increase was greater on the sagittal plane than on the frontal plane, and all increases showed a rhythmic change (Figs 58).

The prediction control is suppressed under the conditions of an error correction function, which can be operated during a slow or tracking motion with sufficient visual information within the entire trajectory [26]. However, if the error correction function does not work because of insufficient information from the surrounding environment, the prediction function is more likely to operate, and while the prediction function is performed, the rhythm acquired from the surrounding environment is used for prediction control. In other words, the degree of involvement of the predictive control depends on the reliability of the visual information, and it can be confirmed based on the rhythmic degree of ω [26].

An FFT analysis was conducted on ω to obtain a more quantitative comparison of the rhythmic degree. The amplitude spectrum was compared within the low-frequency range of 0–5 Hz at each velocity. Based on the result, the amplitude spectrum is larger than that of the frontal plane when the circular tracking movement is applied on the sagittal plane.

In addition, the amplitude spectrum was larger during the fast motion than during the slow motion of the target. This is similar to the frequency analysis of visible and invisible movements [26]. Hence, if the visual information is uncertain during a circular tracking movement, the rhythmic tendency increases.

The analysis of ω can be considered to be related to the OFC. When the target moves at V3 and V4, the ω values of the tracer and target indicate errors according to each quadrant position. The average values of ω were almost identical between the target and tracer during one complete cycle (Table 4). Therefore, the rapid tracking movement of the sagittal plane minimizes the ΔR of a specific location (quadrant 2). We confirmed the tendency to control the rotation period of the tracer to match the rotation period of the target based on quadrant 2. Even along the frontal plane, a similar tendency was observed when the target moved at V3 and V4. In previous studies by Yoshikatsu and Yurie, there was a control tendency that subject matched the periodicity of the target and the tracer based on a specific area when performing a periodic tracking movement [26]. Similarly, the goal of the tracking movement in this study can be interpreted as matching the periodicity of the target and the tracer. The specific area in this experiment can be deduced as the second quadrant where ΔR becomes the smallest, as discussed previously. Therefore, the goal of the circular tracking movement is to match the periodicity of the target and the tracer, and the area as the reference can be considered as the second quadrant in OFC theory. The second quadrant is a position related to the goal of the movement, and the other quadrants can be viewed as less related areas.

Future work: Confirmation of learning effect, noise impact reduction, and application to rehabilitation

In this study, the subjects were asked to exercise within the first environment they experienced. In this case, we found that the weight of the visual information was larger than the weight of the proprioceptive information. In the future, the subjects will be sufficiently trained and then asked to conduct the same exercise. It is expected that the weight of the proprioceptive information will increase and that the weight of the visual information will decrease.

During this experiment, the controller was held in the subject’s hand, and the target was traced with the end point of the controller. This required control of the position and state of the controller, which means that precise control is difficult to achieve and that a time delay may occur. This situation may have caused noise in the experimental results. If the subject traces the target by hand without holding the controller, the subject will be able to reduce the effects of noise before the pre-processing of the analysis results.

There have been various cases involving controlling visual feedback and applying it to rehabilitation. However, the effects of rehabilitation under various visual feedback situations were not analyzed; therefore, quantitative evaluation was limited [3942]. We were able to compare the differences in the control strategy according to the accuracy of the visual information. If the same study is conducted on hemiplegic patients, it will be possible to identify changes in the patient’s control strategy after a brain injury. In addition, the parameters measured in normal persons and those measured in patients with an ailment can be compared and applied to a quantitative assessment of the patient’s condition, and may be applicable as a standard for establishing an appropriate visual feedback environment when conducting rehabilitation treatment.

Conclusions

In this study, we analyzed the control strategy of a circular tracking movement in 3D space according to the accuracy of the visual information. The value of ΔR was shown to be two to three times greater in quadrants 1 and 4 than in quadrants 2 and 3 near the subject. We also found that the value of ΔR increased as the velocity of the target increased. This indicates that the spatial information of the visuo-motor control is significantly influenced by the accuracy of the visual information owing to the depth and target velocity. When ω was analyzed within the frequency domain, the periodicity was shown to be approximately 1.7 to 2 times stronger on the sagittal plane than on the frontal plane, and as the velocity of the target increased, the periodicity also increased. This means that the periodicity of movement is also affected by the accuracy of the visual information based on the depth and target velocity. However, the average ω value of the tracer was similar to that of the target (i.e., within 0.6%) during one trial. In other words, the ω values of the tracer and the target are not the same at all positions, although the same time is required to perform a single trial.

From the characteristics of the aforementioned two parameters (R, ω), it can be inferred that the subject performs a periodic circular tracking motion in the sagittal plane and matching the periodicity in the second quadrant for the purpose of exercise.

Based on the characteristics of the two aforementioned parameters (R, ω), it can be inferred that the subject performs a periodic circular tracking movement on the sagittal plane and matching the periodicity in the second quadrant for the goal of tracking. If this is applied to OFC control, the second quadrant with high reliability of visual information can be thought as an area that is highly related to the goal of tracking, and the other quadrants can be thought as areas those are not related to the goal of tracking. Accordingly, we can infer that the subjects have a high weight of the visual feedback control in the second quadrant, and that the movement with a high weight of the feed forward control performs in the other quadrant where the reliability of visual information is low. However, since the movement characteristics of the arm structure may be reflected, further research is required.

Supporting information

S1 Table. Summary of the statistical analysis of ΔR in the frontal plane.

https://doi.org/10.1371/journal.pone.0241138.s001

(DOCX)

S2 Table. Summary of the statistical analysis of ΔR in the sagittal plane.

https://doi.org/10.1371/journal.pone.0241138.s002

(DOCX)

References

  1. 1. Georgopoulos A, Grillner S. Visuomotor coordination in reaching and locomotion. Sci. 1998;245(4923): 1209–1210.
  2. 2. Steinberg F, Pixa NH, Doppelmayr M. Mirror visual feedback training improves intermanual transfer in a sport-specific task: A comparison between different skill levels. Neural Plast. 2016; 1–11.
  3. 3. Yokota H, Naito M, Mizuno N, Ohshima S. Framework for visual feedback training based on a modified self organizing map to imitate complex motion. Proc. of the Inst. of Mech. Eng. and Technol. 2019;
  4. 4. Beggs WDA, Howarth CI. Movement control in a repetitive motor task. Nature. 1970;225(5234): 752–753. pmid:5412785
  5. 5. Van den Dobbelsteen J, Brenner E, Smeets J. Endpoints of arm movements to visual targets. Exp. Brain Res. 2001;138(3): 279–287. pmid:11460766
  6. 6. Roitman AV, Pasalar S, Ebner TJ, Single trial coupling of Purkinje cell activity to speed and error signals during circular manual tracking. Exp. Brain Res. 2008;192(2): 241–251. pmid:18839159
  7. 7. Roitman AV, Pasalar S, Johnson MT, Ebner TJ, Position, direction of movement, and speed tuning of cerebellar Purkinje cells during circular manual tracking in monkey. J. Neurosci. 25(40): 9244–9257. pmid:16207884
  8. 8. Miall R, Weir D, Stein J. Planning of movement parameters in a visuo-motor tracking task. Behav. Brain Res. 1988;27(1): 1–8. pmid:3342112
  9. 9. Miall R, Weir D, Stein J. Manual tracking of visual targets by trained monkeys. Behav. Brain Res. 1986;20(2): 185–201. pmid:3730133
  10. 10. Kim J, Lee J, Kakei S, Kim J. Motor control characteristics for circular tracking movements of human wrist. Adv. Robot. 2017;31(1): 29–39.
  11. 11. Hayashi Y, Sawada Y. Transition from an antiphase error-correction mode to a synchronization mode in mutual hand tracking. Phys. Rev. E. 2013;88(2): 022704 pmid:24032861
  12. 12. Yasuyuki I, Yutaka S. Periodic change in phase relationship between target and hand motion during visuo-manual tracking task: Behavioral evidence for intermittent control. Hum. Mov. Sci. 2014;33: 211–226. pmid:24355067
  13. 13. Miall R, Weir D, Stein J. Intermittency in human manual tracking tasks. J. of Mot. Behav. 1993;25(1): 53–63.
  14. 14. Engel KC, Soechting JF. Manual tracking in two dimensions. J. of Neurophysiol. 2000;83(6): 3483–3496.
  15. 15. van Beers RJ, Wolpert DM, Patrick H, When feeling is more important than seeing in sensorimotor adaptation. Curr. Biol. 2002;12(10): 834–837, pmid:12015120
  16. 16. Woong C, Jongho L, Naoki Y, Liang L, Jaehyo K, et al. Development of quantitative evaluation system for visuo-motor control in three-dimension virtual reality space. Sci. Rep. 2018;8:13439.
  17. 17. Woong C, Liang L, Jongho L. Characteristic of motor control in three-dimensional circular tracking movements during monocular vision. Hindawi BioMed Res. Int. 2019;2019(3867138): 1–16, https://doi.org/10.1155/2019/3867138.
  18. 18. Woong C, Liang L, Jongho L. Analysis of three-dimensional circular tracking movements based on temporo-spatial parameters in polar coordinates. Appl. Sci. 2020; 10(2), 621,
  19. 19. Wookhyun P, Woong C, Hanjin J, Geonhui L, Jaehyo Kim. Analysis of control characteristics between dominant and non-dominant hands by transient responses of circular tracking movements in 3D virtual reality space, Sens. 2020;20(12), 3477, pmid:32575627
  20. 20. Miall R. C., Weir D. J., Stein J. F., Manual tracking of visual targets by trained monkeys, Behav Brain Res, 1986;20(2), 185–201. pmid:3730133
  21. 21. Miall R.C., Weir D.J., Stein J. F., Planning of movement parameters in a visuo-motor tracking task, Behav Brain Res, 1988;27(1), 1–8. pmid:3342112
  22. 22. Miall R.C., Weir D.J., Stein J. F., Intermittency in human manual tracking tasks, J Mot Behav, 1993;25(1), 53–63. pmid:12730041
  23. 23. Ishida F., & Sawada Y. E., Human Hand Moves Proactively to the External Stimulus: An Evolutional Strategy for Minimizing Transient Error. Physical Review Letters, 2004; 93(16), pmid:15525039
  24. 24. Sakaguchi Y., Tanaka M., & Inoue Y., Adaptive intermittent control: A computational model explaining motor intermittency observed in human behavior. Neural Networks, 2015;67, 92–109. pmid:25897510
  25. 25. Hayashi Y., Tamura Y., Sugawara K., & Sawada Y., Roll of the rhythmic component in the proactive control of a human hand. Artificial Life and Robotics, 2009;14(2), 164–167.
  26. 26. Yoshikatsu H, Yurie T, Kazuya S, Ken S, Yasuji S. Intermittently-visual tracking experiments reveal the roles of error-correction and predictive mechanisms in the human visual-motor control system. Proc. of the Soc. of Instrum. and Control Eng. 2010;46(7): 391–400.
  27. 27. Hansong Z, Yi Z. Sensing movement: Microsensors for body motion measurement. Sens. (Basel). 2011;11(1): 638–660.
  28. 28. Faisal A.A., Selen L.P., and Wolpert D.M. Noise in the nervous system. Nat. Rev. Neurosci. 2008;9, 292–303. pmid:18319728
  29. 29. Yuille A, Kersten D. Vision as Bayesian inference: Analysis by synthesis? Trends Cogn. Sci. (Regul. Ed.). 2006;10: 301–308. pmid:16784882
  30. 30. Kording KP, Wolpert DM. Bayesian integration in sensorimotor learning. Nat. 2004;427(6971): 244–247. pmid:14724638
  31. 31. Kording KP, Wolpert DM. Bayesian decision theory in sensorimotor control. Trends in Cogn. Sci. 2006;10(7): 319–326. pmid:16807063
  32. 32. Kaneko Y., Nakano E., Osu R., Wada Y., Kawato M., Trajectory formation based on the minimum commanded torque change model using the Euler-Poisson Equation, Systems and Computers in Japan. 2005;36(2), 92–103.
  33. 33. Flash T., Hogan N., The Coordination of arm movements: An experimentally confirmed mathematical model, The J. of Neurosci., 1985;5(7), 1688–1703.
  34. 34. Todorov E, Jordan MI. Optimal feedback control as a theory of motor coordination. Nat. Neurosci. 2002;5(11): 1226–1235. pmid:12404008
  35. 35. Sober SJ, Sabes PN. Flexible strategies for sensory integration during motor planning. Nat. Neurosci. 2005;8(4): 490–497. pmid:15793578
  36. 36. Fine JM, Word KL, Amazeen EL. Manual coordination with intermittent targets: Velocity information for prospective control. Acta Psycholgica. 2014;149: 24–31, pmid:24657827
  37. 37. Karniel A, Inbar GF. A model for learning human reaching movements. Biol. Cybern. 1997;77(3): 173–183. pmid:9352631
  38. 38. Haruno M, Wolpert DM. Optimal control redundant muscles in step-tracking wrist movements. J. of Neurophysiol. 2005;94(6): 4244–4255. pmid:16079196
  39. 39. Kwan-Sub L, Han-Seong C, Jae-Hong L, Influence of visual feedback training on the balance and walking in stroke patients. The J. of Kor. Phys. Ther. 2015;27(6): 407–412.
  40. 40. Semblantes PA, Andaluz VH, Lagla J, Chicaiza FA, Acurio A. Visual feedback framework for rehabilitation of stroke patients. Inform. in Med. Unlocked. 2018,
  41. 41. Yang TR, Chen YH, Chang HC, Chan RC, Wei SH, Wang RY. Effects of interactive visual feedback training on post-stroke pusher syndrome: A pilot randomized controlled study. Clin. Rehabil. 2014;29(10): 987–993, pmid:25547112
  42. 42. Nicole L, Loren O, Visual feedback for mixed reality stroke rehabilitation. Virtual Rehabil. Int. Conf. 2009, f.1109/ICVR.2009.5174232.