Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Virtual Reality as a Tool for Evaluation of Repetitive Rhythmic Movements in the Elderly and Parkinson's Disease Patients

  • Pablo Arias,

    Affiliation Neuroscience and Motor Control Group (NEUROcom), Department of Medicine-INEF Galicia, University of A Coruña, A Coruña, Spain

  • Verónica Robles-García,

    Affiliation Neuroscience and Motor Control Group (NEUROcom), Department of Medicine-INEF Galicia, University of A Coruña, A Coruña, Spain

  • Gabriel Sanmartín,

    Affiliation Instituto de Investigacións Tecnolóxicas, University of Santiago de Compostela, Santiago de Compostela, Spain

  • Julian Flores,

    Affiliation Instituto de Investigacións Tecnolóxicas, University of Santiago de Compostela, Santiago de Compostela, Spain

  • Javier Cudeiro

    jcud@udc.es

    Affiliation Neuroscience and Motor Control Group (NEUROcom), Department of Medicine-INEF Galicia, University of A Coruña, A Coruña, Spain

Virtual Reality as a Tool for Evaluation of Repetitive Rhythmic Movements in the Elderly and Parkinson's Disease Patients

  • Pablo Arias, 
  • Verónica Robles-García, 
  • Gabriel Sanmartín, 
  • Julian Flores, 
  • Javier Cudeiro
PLOS
x

Abstract

This work presents an immersive Virtual Reality (VR) system to evaluate, and potentially treat, the alterations in rhythmic hand movements seen in Parkinson's disease (PD) and the elderly (EC), by comparison with healthy young controls (YC). The system integrates the subjects into a VR environment by means of a Head Mounted Display, such that subjects perceive themselves in a virtual world consisting of a table within a room. In this experiment, subjects are presented in 1st person perspective, so that the avatar reproduces finger tapping movements performed by the subjects. The task, known as the finger tapping test (FT), was performed by all three subject groups, PD, EC and YC. FT was carried out by each subject on two different days (sessions), one week apart. In each FT session all subjects performed FT in the real world (FTREAL) and in the VR (FTVR); each mode was repeated three times in randomized order. During FT both the tapping frequency and the coefficient of variation of inter-tap interval were registered. FTVR was a valid test to detect differences in rhythm formation between the three groups. Intra-class correlation coefficients (ICC) and mean difference between days for FTVR (for each group) showed reliable results. Finally, the analysis of ICC and mean difference between FTVR vs FTREAL, for each variable and group, also showed high reliability. This shows that FT evaluation in VR environments is valid as real world alternative, as VR evaluation did not distort movement execution and detects alteration in rhythm formation. These results support the use of VR as a promising tool to study alterations and the control of movement in different subject groups in unusual environments, such as during fMRI or other imaging studies.

Introduction

Virtual Reality (VR) is a technique by which a person interacts with an artificial reality, which can be totally controlled by the experimenter, so that responses of the subject can be perfectly monitored and evaluated [1]. VR technology emulates the real world in an environment where characteristics are controlled, measurable and modifiable [2], permitting the isolation of subjects from non-natural research environments like fMRI scans, or complex laboratory settings [3][5].

This is acquired by means of creating a virtual environment (VE), so that the experimental subject is integrated into the VE by providing virtual information through appropriate sensory channels; eyes (head-mounted-displays (HMD); skin (haptic devices) [6]; or hearing (aural devices). This technique is being used both as a research tool and to treat several non-motor disorders [7] and is becoming a promising tool for the treatment of anxiety [8], claustrophobia [9], fear of flying [10], arachnophobia [11] or post-traumatic stress symptoms [12], besides its use in more basic science to study the basis of decision making [13].

The relationship between VR and the human motor system is undoubtedly complex. However, it has been used to study the cognitive basis of complex movements such as navigation during locomotion [14], [15] and the interactions of execution/observation combined with fMRI [3]. Moreover, motor system pathologies can be evaluated through VR [16]. For example, the kinematics of hand movement in visual neglect patients [17], parkinsonian bradykinesia [18], or fractal analysis in physiological or pathological conditions [19], [20] have all been evaluated during VR immersion [21].

Several clinical studies have shown that arrhythmokinesis during finger tapping [22][24] is associated with un-steadiness of rhythm in complex movements like gait [25]. Arrhythmokinesis is characteristic of the elderly and of several pathologies like Parkinson's disease (PD) [24], and the typical alterations are present not only in the temporal but also in the spatial domain, such as movement amplitude. Interaction between visual and proprioceptive systems seems altered in pathological conditions; for instance, the integration of proprioceptive and visual information required to coordinate movements is impaired in PD [26]. In this sense, VR allows the researcher to control and modify the weight of the different sensory information resources to understand better the role of each in their current situation. VR is also considered to be a potential therapeutic tool in gait disorders after stroke [27] or phantom limb pain [28]; roles reinforced by evidence of neuroplasticity after VR therapy in cerebral palsy [29], [30] and pain relief [31].

With this background, we present an immersive HMD VR system by which the subject can be integrated in 1st perspective (although 3rd person perspective is also allowed), capturing their movements (finger taps) on-line, and placing them into the virtual world, aiming to shed some light on the following question: Virtual reality and physical rehabilitation: a new toy or a new research and rehabilitation tool? [32]. For this, it is of utmost importance to show that any VR system induces physiological responses in the same way that the real world does. This is a fundamental issue which needs to be dealt with prior to further presentation of more complex protocols to produce lasting physiological adaptations, or to use VR systems in experimental protocols including brain image evaluation [33], [34]. Since finger tapping in the real world is able to detect alterations in rhythm formation due to aging and PD [22][24], our aim is to understand if finger tapping in VR can reproduce such results. Our research hypothesis states that execution in a VR environment is reproducible across time and is capable of detecting alteration in movement features between the three different groups of subjects evaluated, PD patients, elderly healthy subjects, and young healthy subjects (as controls for the effect of aging).

Materials and Methods

Virtual Reality System

The subjects were seated on a chair, in a comfortable, relaxed posture, with their hands and forearms leaning on a table. The subject wore the HMD, which provided him with a first person view of a virtual environment which is similar to his actual environment: He sees a virtual room with a table in front of him and a virtual, generic depiction of himself (avatar) (Fig. 1). The frame may be zoomed in or out such that size of the avatar's hand can be adjusted to the real size of the subject's hand, enhancing immersion. The system tracks finger, hand and arm movements, and translates them realistically into the virtual character. To develop this realistic virtual environment, enhancing the sense of presence, we have chosen the Ogre3D engine (http://www.ogre3d.org), an open-source, scene-oriented, flexible 3D engine written in the C++ language. The main element in the 3D rendering program is the virtual avatar; a generic human-like 3D model was created using Maya and exported to Ogre format, with a significant level of detail ensuring the realistic look of the scene and preventing subjective disbelief.

thumbnail
Figure 1. Virtual Reality System.

Representation of the different elements in the system: movement of reflective markers at the Patient/Subject's anatomical points (1.1) are captured by IR cameras (1.2, 1.3, 1.4) and the cameras send information to the main computer, which integrates subjects movements into the virtual experience. An acquisition module (1.5) connects reciprocally to the main computer, so that different analogue and digital input/outputs can be controlled. The Subject wears the HMD, and the display is also shown on the main computer for experimenter to supervise the experience. The figure represents the virtual environment and the avatar's forearms in 1st person perspective. The HMD is provided with tri-axial accelerometer tracking head movements and has been modified with black foam in order to isolate subjects completely from the real environment. The foam adapts to the subjects' face thereby “removing” the subject from the real world environment.

https://doi.org/10.1371/journal.pone.0030021.g001

The tracking system provides rotational and positional information from a series of markers placed on anatomical points (Fig. 11.1). For tracking we have used 3 infra-red (IR) cameras, TrackIR 4:PRO from NaturalPoint, designed to track positional data from reflecting markers with a frequency of 120 frames/s, and a resolution of 320×288 pixels. The three cameras are specifically arranged to provide for a full three degree tracking for the X,Y,Z spatial positions of each tracking element (Fig. 11.2,1.3,1.4).

The system directly registers the positional information returned by IR cameras, whereas rotational information is created from pairs of markers to obtain the value of each angle for the three axes. A special case-based interpolation algorithm based on statistic filtering was constructed in order to validate the stability of the system in situations where one of the hands may overlap. No markers are needed for the arms, since the specific spatial position of the hand is enough to interpolate rotation and position of arm, forearm or shoulder by using Inverse Kinematics techniques [35].

Software architecture

Three separate modules were constructed for the system: The 3D rendering program, the control application and the camera control software. The former two are in the subject station, the latter on a second computer managed by the expert supervising the tests. To ensure proper communication among the three modules, a special communication system was also developed.

The supervision program uses a Graphical User Interface (GUI) based application which provides control over the whole system. Camera software, at the same time, communicates directly with the 3D program to supply the tracking information needed for motion capture. The 3D rendering software sends its state to the supervising program at all times so the expert can control the flow of the test. All three modules are connected through UDP non-blocking sockets using different application ports. The network can be laid out as a simple LAN Ethernet connection.

Head Mounted Display

For a realistic, immersive experience, the subject wears the HMD. This is a pair of Vuzix iWear VR920 glasses which includes motion tracking, so that the virtual environment displayed is congruent with head movements (Fig. 1). Maximal resolution is 1024×768, which, along with AA filtering through GPU hardware, provides enough visual quality to ensure immersion. Tracking allows for yaw, pitch and roll of the head from an initial calibration stage. The HMD provides information by means of two screens, one for each of the eyes creating a stereoscopic 3-D vision. HMD Frame rate is 150 frames/s, exceeding the frame rate necessary to allow the visual system to perceive a continuous movement [36].

Acquisition module

The system allows communication with any recording or stimulation external device. This is done by the acquisition module (Fig. 1 1.5, Advantech USB-4711A) which allows for 16 analog and digital inputs, and 8 analog and digital outputs. Information is gathered at real time thanks to the API provided.

Experimental Design

Our goal was to examine if execution in the VR environment is a valid method to detect impairment in rhythm formation in the different groups (validity), and if the execution in the VR can be reproduced under the same conditions on different days (reliability). Further, consistency between VR and Real world data was assessed.

Subjects performed the same procedure twice, one week apart, under the same conditions. We included three different sets of subjects: Young healthy controls (YC), elderly healthy controls (EC), and Parkinson's disease (PD) patients. It has been shown that FT provides distinctive results in each of those groups [37].

Subjects

Ethics Statement.

All experimental subjects signed consent forms. The protocol conformed to the declaration of Helsinki and was approved by the Ethics Committee of the University of A Coruña (Spain) (CE-UDC 23/09-2009).

Young Subjects

12 healthy subjects (based on medical history and personal interview; 7 men, 5 women) (mean age 24.3 yrs; SD: 4.9; range 18–35) were recruited from staff and students of our institution.

Elderly Controls

12 EC (5 men, 7 women; mean age 66.6 yrs; SD: 10.1; range 51–85) healthy subjects (based on medical history and personal interview) were recruited from relatives of staff working in our institution.

Parkinson's disease patients

10 (5 men, 5 women; mean age 69.9 yrs; SD: 11.2; range 51–89) idiopathic PD patients [38] were recruited. Participants belonged to the Parkinson's Disease Association in Bueu (Spain).

All participants were screened for dementia using MMSE [39] and Edinburgh Handedness Inventory (EHI) [40]. Subjects were excluded if they scored <24 in the MMSE or if they had any musculoskeletal impairment or disease apart from PD which might interfere with their ability to undertake the task.

PD patients were evaluated during OFF-periods (at least 12 h since their last anti-parkinsonian medication intake) and in the case of subjects taking controlled-released drugs the dose immediately before evaluation was withheld.

Materials

Besides the VR system, n event detector, consisting of a conductive plate and a flexible conductive ring attached to the subject's distal phalanx, allowed recording of the tapping cycle, the calculation of the duration of the cycle (tapping frequency), and its Coefficient of Variation (CV). Information was sampled at 1 kHz.

Procedure

Subjects performed the FT test in two different conditions: FT in the real environment (FTREAL) and FT in the VR environment (FTVR). FTREAL and FTVR were performed at each subjects preferred (comfort) tapping rate.

During the FT test subjects were comfortably seated with forearms pronated on a table in front of them, so that both elbows were flexed at about 90–100°. Seat height was adapted so that subjects were in an optimal comfort position to perform the test. Subjects were asked to perform FT with their index finger by flexing-extending the metacarpo-phalangeal joint while staring at the hand executing the task.

The same position was adopted by the avatar in the VR condition in the 1st person perspective (egocentric perspective) [15], [41]. This allowed the avatar's forearms to be perceived as if they were the subjects own forearms (Fig. 1). Before starting the VR protocol the VR environment was zoomed in and out until each subject judged the avatar's hand size to be their own hand size.

Subjects performed the task with their dominant hand. In the case of PD patients all questions belonging to EHI were related to the period before the onset of symptoms, and they also performed with their dominant hand regardless the laterality of their signs. Subjects were instructed to look at the executing hand, whether in the virtual or real environment. For VR, correcting lenses (Bobes, Inc, Madrid) were attached to each of the two screens of the HMD if necessary. Three randomized sets of 50 cycles of FTREAL and FTVR (each) were performed, with resting periods of 3 minutes. None of the subjects reported fatigue. To allow subjects to reach a steady finger rate 3 taps were performed prior to acquiring the 50 to be analyzed.

Data for each variable, condition and day was obtained from the mean of the three repetitions performed during each session; work by Wu et al., evaluating intra-session variability during tapping in PD recommended a minimum of two sets [42].

Variables analyzed

The variables analyzed were tapping frequency and Coefficient of Variation (CV) of inter-tap interval. The tapping frequency was calculated from the tapping events (expressed in Hz), and the CV of inter-tap interval was defined as follows:

Statistical Analysis

The statistical analysis included both tests of validity and reliability.

Validity.

To evaluate the validity of FTVR for detecting differences in rhythm formation between groups an ANOVA with repeated measures was used. Factor Group (between subjects factor) included three levels (each of the groups, PD, EC, YC). Testing was performed on two different days, so a factor DAY with two levels was included (DAY1 and DAY2).

Reliability.

The reliability test compared the results obtained in VR on the first day of evaluation (D1) with those obtained on a second day (D2), one week later and under the same conditions; this was done for each variable and for each group.

We analyzed consistency in the execution in VR between the two days by means of Intra-class Correlation Coefficient (ICC), for each variable and group independently. The mean difference between days was also analyzed, (Day 1 minus Day 2 for each subject). This was evaluated by means of a one sample t-test and was evaluated for each group separately.

Further, we decided to compare consistency in execution in the VR vs. the Real world. This was done because Real world testing is the gold-standard in clinical practice. ICC and the mean difference between conditions (Real and VR world) were obtained for each group and variable independently and for each condition the average performance of the two days was used. Normality of distributions was assessed by means of one sample Kolmogorov-Smirnov test; if violated, a log transformation was applied. When using ANOVA, a univariate approach was used to analyze within subject effects, for this the Greenhouse-Geisser coefficient was used in order to correct the degrees of freedom in case of sphericity violation. Significance was set to 0.05. When subsequent pair-wise comparisons after ANOVA were performed, the Bonferroni correction was applied. Results were presented as Mean and Standard Deviation (SD).

Results

Virtual Reality System Validity and Reliability

Validity.

Execution in the VR was valid to detect differences in rhythm formation between groups. For the CV, Factor GROUP showed a significantly different ability to maintain tapping rhythm F(2,31) = 7.468 p = 0.002; Bonferroni correction for subsequent pair-wise comparisons showed larger variability in the PD vs. EC (p = 0.017), and PD vs. YC (p = 0.003); despite the EC showed larger variability that the YC the difference was not significant (p = 1.000). Factor DAY and DAY X GROUP interaction were not significant; this reflects that the groups' different ability to maintain a tapping rhythm was observed in both days (Fig. 2). Specifically, CV for the PD group was 15.20% (±14.10) on the first day, and 13.46% (±9.05) on the second. CV's for the EC group were smaller, 6.69% (±3.43) on the first and 6.44% (±2.74) on the second day. Finally, the smallest of the CVs were those of the YC, at 4.82% (±1.07) and 4.46% (±1.01) on days one and two, respectively.

thumbnail
Figure 2. Motor behavior in the different days during VR testing.

The figure represents the motor behavior on the first and second days of evaluation (blue and green respectively) for the different variables. Pair-wise comparisons after Bonferroni correction show that PD had larger variability that EC and YC on both days.

https://doi.org/10.1371/journal.pone.0030021.g002

Factor GROUP showed tapping frequencies were not significantly different between groups F(2,31) = 2.408 p = 0.107. Again, Factor DAY and the DAY X GROUP interaction were not significant (Fig. 2). PD patients tapped at an average of 2.53 Hz (±1.71) on the first day and at 2.85 Hz (±1.40) on the second; EC tapped at 1.95 Hz (±0.85) and at 1.89 Hz (±0.85) on the first and seconds days respectively; and the YC at 1.70 Hz (±0.79) and at 1.73 Hz (±0.93).

Reliability.

Consistency in execution in the VR between day 1 and day 2 was evaluated by ICC and its 95% Confidence Interval. For CV, ICC was 0.87 with CI of [0.74; 0.93]; for the Tapping Frequency, ICC was 0.94 and CI [0.88; 0.97] (Fig. 3). ICC for the Frequency and CV for each group are shown in Table 1. The mean differences between days (MDD1–D2) were not significantly different from 0; this was observed for the CV, MDD1–D2 = 0.73% [−1.09; 2.54], and also for the Tapping Frequency, MDD1–D2 = −0.09 Hz [−0.27; 0.11] (Table 2).

thumbnail
Figure 3. Scatter plot comparing execution between days in the VR environment.

The figure illustrates the motor behavior on the first and second days of evaluation for each group and for both variables (Tapping Frequency left panel, CV right panel). ICC values between days, and 95% CI for the mean difference between days for each group and variable, are presented in tables.

https://doi.org/10.1371/journal.pone.0030021.g003

thumbnail
Table 2. Mean difference between days for both the tapping frequency and the CV during VR testing.

https://doi.org/10.1371/journal.pone.0030021.t002

Finally, we evaluated the consistency between execution in the Real world and VR, taking the average of day1 and day2 for each condition. This was done by means of ICC and its [95% CI]. It showed excellent results for the CV ICC = 0.96 [0.92; 0.98]; and for the Tapping Frequency ICC = 0.98 [0.97; 0.99] (Fig. 4; Table 3). The similarity between results obtained in the VR and the gold-standard reference Real world is reinforced by the fact that the mean differences between conditions were not significantly different from 0, this was observed either for the CV, MDREAL-VR = −0.44% [−1.39; 0.51], and also for the Tapping Frequency MDREAL-VR = −0.02 Hz [−0.10; 0.05] (Table 4).

thumbnail
Figure 4. Scatter plot comparing execution in Real and VR environments.

The figure shows the behavior in both conditions for each group and for both variables (Tapping Frequency left panel, CV right panel). ICC values and 95% CI for the mean difference between conditions (VR and Real), for each group and variable, are presented in tables.

https://doi.org/10.1371/journal.pone.0030021.g004

thumbnail
Table 4. Mean difference Real and VR for both the tapping frequency and the CV.

https://doi.org/10.1371/journal.pone.0030021.t004

Discussion

This study presents a VR system aimed at evaluating repetitive finger movements in healthy individuals and in subjects with neurological disturbances. A main outcome we have obtained here is that the system is reliable. This is important, since a basic requirement of any VR system to be useful in motor system research and potentially treat patients, is to provide stable responses under the same conditions. Further, evaluation in the VR environment was shown to be able to detect differences in behavior between groups. This is also relevant given that the task used is a basic test in human motor control, with clinical importance for the characterization of different pathological rhythmic patterns [37], [43][48]. In these conditions, FT in the VR mode can be used in complex research protocols to isolate subjects from non-natural environments (such as fMRI or PET scans; or complex neurophysiological laboratory settings). Finally, one basic criterion to be fulfilled in VR intervention is the sense of “presence” [7], [49], [50]. This was supported in our work by the fact the performance in the VR is consistent with that in the real world. Behavior of all three groups in VR displayed the same usual features reported in Real world. PD were prone to hasten during tapping [22], [24], and the characteristic differences in rhythm formation between groups [23] were revealed on both days during VR testing.

Although the system has allowed us to analyze the characteristics of a motor act, our ultimate goal is to modify the performance of a movement, especially in cases where movement is already pathologically altered. This may introduce motor adaptations, based on several sessions of VR, which might improve the typical motor disturbances observed in the elderly and in PD (e.g. arrhythmokinesis or hipometry). This is why the system permits modification of parameters of the movement performed by the avatar (amplitude, speed, frequency, etc..) which, hopefully, will improve motor impairments after imitation training [51], [52]. This hypothesis, which is ready be confirmed in the near future, seems to be supported by the excellent level of immersion observed (some subjects referred to the avatar's hand as “their own” hand as also by the fact that results in the real and the VR were identical and reproducible.

This system complements other approaches using VR for the study of different movements [52], [53], such as Haptic devices [54]. It matches the virtually recreated environment with the somatosensory information perceived by the subjects. When the avatar taps on the table the sense of touching is real since the subject is actually performing the task in synchrony. The sense of presence is also enhanced by scaling the size of the avatar's hand to match in size that of the experimental subject. Presence is reinforced by other features of the visual environment such as perspective or shades, and the high degree of isolation from the real world. The system is provided with a pair of glasses to which a foam-adapting edge was attached so that stray light and any other distractors from the real world are completely removed.

Here we have focused on a well known deterioration of the motor control due to aging and disease, the impairment in rhythm formation. As a marker we have used finger tapping at the preferred rate since tapping as fast as possible might increase variability due to fatigue [55], not reflecting impairment in rhythm formation. We acknowledge that this is a simple task (although with high value from the clinical point of view), and we also recognize that our work will be considered exploratory in nature and, in future, the use of larger sample sizes should confirm the results from this novel pilot study. Also, the inclusion of other variables (e.g. neurophysiological measurements) will increase the strength of our work and reinforce the utility of VR both to study and to treat motor disorders.

In conclusion, systems based on VR seem useful to study motor behavior. Specifically, the system presented here allows the evaluation of alteration in rhythm formation in PD and in the elderly. VR is sensitive in order to characterize different movement patterns. This allows inclusion of more complex virtual elements to interact either with the physiological and damaged motor system and its use in non-naturalistic environments such as brain image scans.

Acknowledgments

We are indebted to Dr Kenneth L. Grieve for his helpful advice and corrections in the manuscript.

Author Contributions

Conceived and designed the experiments: PA VRG GS JF JC. Performed the experiments: PA VRG. Analyzed the data: PA VRG. Contributed reagents/materials/analysis tools: JC. Wrote the paper: PA VRG JC. Revised the manuscript critically for important intellectual content: PA VRG GS JF JC. Final approval of the version to be published: PA VRG GS JF JC.

References

  1. 1. Riva G (1998) From toys to brain: Virtual Reality applications in Neuroscience. Virtual Reality 3: 259–266.G. Riva1998From toys to brain: Virtual Reality applications in Neuroscience.Virtual Reality3259266
  2. 2. Keshner EA, Kenyon RV (2004) Using immersive technology for postural research and rehabilitation. Assistive Technology 16: 54–62.EA KeshnerRV Kenyon2004Using immersive technology for postural research and rehabilitation.Assistive Technology165462
  3. 3. Adamovich SV, August K, Merians A, Tunik E (2009) A virtual reality-based system integrated with fmri to study neural mechanisms of action observation-execution: a proof of concept study. Restor Neurol Neurosci 27: 209–223.SV AdamovichK. AugustA. MeriansE. Tunik2009A virtual reality-based system integrated with fmri to study neural mechanisms of action observation-execution: a proof of concept study.Restor Neurol Neurosci27209223
  4. 4. Merians AS, Tunik E, Adamovich SV (2009) Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms. Stud Health Technol Inform 145: 109–125.AS MeriansE. TunikSV Adamovich2009Virtual reality to maximize function for hand and arm rehabilitation: exploration of neural mechanisms.Stud Health Technol Inform145109125
  5. 5. August K, Lewis JA, Chandar G, Merians A, Biswal B, et al. (2006) FMRI analysis of neural mechanisms underlying rehabilitation in virtual reality: activating secondary motor areas. Conf Proc IEEE Eng Med Biol Soc 1: 3692–3695.K. AugustJA LewisG. ChandarA. MeriansB. Biswal2006FMRI analysis of neural mechanisms underlying rehabilitation in virtual reality: activating secondary motor areas.Conf Proc IEEE Eng Med Biol Soc136923695
  6. 6. Hamilton EC, Scott DJ, Fleming JB, Rege RV, Laycock R, et al. (2002) Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills. Surgical Endoscopy and Other Interventional Techniques 16: 406–411.EC HamiltonDJ ScottJB FlemingRV RegeR. Laycock2002Comparison of video trainer and virtual reality training systems on acquisition of laparoscopic skills.Surgical Endoscopy and Other Interventional Techniques16406411
  7. 7. Sanchez-Vives MV, Slater M (2005) From presence to consciousness through virtual reality. pp. 332–339.MV Sanchez-VivesM. Slater2005From presence to consciousness through virtual reality.332339Nat Rev Neurosci. England. Nat Rev Neurosci. England.
  8. 8. Wallach HS, Safir MP, Bar-Zvi M (2009) Virtual reality cognitive behavior therapy for public speaking anxiety: a randomized clinical trial. Behav Modif 33: 314–338.HS WallachMP SafirM. Bar-Zvi2009Virtual reality cognitive behavior therapy for public speaking anxiety: a randomized clinical trial.Behav Modif33314338
  9. 9. Malbos E, Mestre DR, Note ID, Gellato C (2008) Virtual reality and claustrophobia: multiple components therapy involving game editor virtual environments exposure. Cyberpsychol Behav 11: 695–697.E. MalbosDR MestreID NoteC. Gellato2008Virtual reality and claustrophobia: multiple components therapy involving game editor virtual environments exposure.Cyberpsychol Behav11695697
  10. 10. Rothbaum BO, Hodges L, Smith S, Lee JH, Price L (2000) A controlled study of virtual reality exposure therapy for the fear of flying. J Consult Clin Psychol 68: 1020–1026.BO RothbaumL. HodgesS. SmithJH LeeL. Price2000A controlled study of virtual reality exposure therapy for the fear of flying.J Consult Clin Psychol6810201026
  11. 11. Garcia-Palacios A, Hoffman H, Carlin A, Furness TA, Botella C (2002) Virtual reality in the treatment of spider phobia: a controlled study. Behaviour Research and Therapy 40: 983–993.A. Garcia-PalaciosH. HoffmanA. CarlinTA FurnessC. Botella2002Virtual reality in the treatment of spider phobia: a controlled study.Behaviour Research and Therapy40983993
  12. 12. Difede J, Hoffman HG (2002) Virtual reality exposure therapy for World Trade Center post-traumatic Stress Disorder: A case report. Cyberpsychology & Behavior 5: 529–535.J. DifedeHG Hoffman2002Virtual reality exposure therapy for World Trade Center post-traumatic Stress Disorder: A case report.Cyberpsychology & Behavior5529535
  13. 13. Albani G, Raspelli S, Carelli L, Morganti F, Weiss PL, et al. (2010) Executive functions in a virtual world: a study in Parkinson's disease. Stud Health Technol Inform 154: 92–96.G. AlbaniS. RaspelliL. CarelliF. MorgantiPL Weiss2010Executive functions in a virtual world: a study in Parkinson's disease.Stud Health Technol Inform1549296
  14. 14. Grasso R, Ivanenko YP, McIntyre J, Viaud-Delmon I, Berthoz A (2000) Spatial, not temporal cues drive predictive orienting movements during navigation: a virtual reality study. Neuroreport 11: 775–778.R. GrassoYP IvanenkoJ. McIntyreI. Viaud-DelmonA. Berthoz2000Spatial, not temporal cues drive predictive orienting movements during navigation: a virtual reality study.Neuroreport11775778
  15. 15. Vidal M, Amorim MA, Berthoz A (2004) Navigating in a virtual three-dimensional maze: how do egocentric and allocentric reference frames interact? pp. 244–258.M. VidalMA AmorimA. Berthoz2004Navigating in a virtual three-dimensional maze: how do egocentric and allocentric reference frames interact?244258Brain Res Cogn Brain Res. Netherlands. Brain Res Cogn Brain Res. Netherlands.
  16. 16. Henderson A, Korner-Bitensky N, Levin M (2007) Virtual reality in stroke rehabilitation: A systematic review of its effectiveness for upper limb motor recovery. Topics in Stroke Rehabilitation 14: 52–61.A. HendersonN. Korner-BitenskyM. Levin2007Virtual reality in stroke rehabilitation: A systematic review of its effectiveness for upper limb motor recovery.Topics in Stroke Rehabilitation145261
  17. 17. Broeren J, Samuelsson H, Stibrant-Sunnerhagen K, Blomstrand C, Rydmark M (2007) Neglect assessment as an application of virtual reality. Acta Neurol Scand 116: 157–163.J. BroerenH. SamuelssonK. Stibrant-SunnerhagenC. BlomstrandM. Rydmark2007Neglect assessment as an application of virtual reality.Acta Neurol Scand116157163
  18. 18. Albani G, Pignatti R, Bertella L, Priano L, Semenza C, et al. (2002) Common daily activities in the virtual environment: a preliminary study in parkinsonian patients. Neurological Sciences 23: S49–S50.G. AlbaniR. PignattiL. BertellaL. PrianoC. Semenza2002Common daily activities in the virtual environment: a preliminary study in parkinsonian patients.Neurological Sciences23S49S50
  19. 19. Hausdorff JM, Ashkenazy Y, Peng CK, Ivanov PC, Stanley HE, et al. (2001) When human walking becomes random walking: fractal analysis and modeling of gait rhythm fluctuations. Physica A 302: 138–147.JM HausdorffY. AshkenazyCK PengPC IvanovHE Stanley2001When human walking becomes random walking: fractal analysis and modeling of gait rhythm fluctuations.Physica A302138147
  20. 20. Goldberger AL, Amaral LA, Hausdorff JM, Ivanov P, Peng CK, et al. (2002) Fractal dynamics in physiology: alterations with disease and aging. pp. 2466–2472.AL GoldbergerLA AmaralJM HausdorffP. IvanovCK Peng2002Fractal dynamics in physiology: alterations with disease and aging.24662472Proc Natl Acad Sci U S A. United States. Proc Natl Acad Sci U S A. United States.
  21. 21. Yambe T, Yoshizawa M, Tanaka A, Abe K, Tabayashi K, et al. (2002) Non-linear dynamic analysis of hemodynamic behavior during virtual reality immersion. Biomed Pharmacother 56: Suppl 2367s–369s.T. YambeM. YoshizawaA. TanakaK. AbeK. Tabayashi2002Non-linear dynamic analysis of hemodynamic behavior during virtual reality immersion.Biomed Pharmacother56Suppl 2367s369s
  22. 22. Nakamura R, Nagasaki H, Narabayashi H (1976) Arrhythmokinesia in parkinsonism. In: Birkmayer W, O H, editors. pp. 258–268.R. NakamuraH. NagasakiH. Narabayashi1976Arrhythmokinesia in parkinsonism.W. BirkmayerH. O258268Advances in Parkinsonism: Hoffmann-La Roche. Advances in Parkinsonism: Hoffmann-La Roche.
  23. 23. Nakamura R, Nagasaki H, Narabayashi H (1978) Disturbances of rhythm formation in patients with Parkinson's disease: part I. Characteristics of tapping response to the periodic signals. Percept Mot Skills 46(1): 63–75.R. NakamuraH. NagasakiH. Narabayashi1978Disturbances of rhythm formation in patients with Parkinson's disease: part I. Characteristics of tapping response to the periodic signals.Percept Mot Skills4616375
  24. 24. Shimoyama I, Ninchoji T, Uemura K (1990) The finger-tapping test. A quantitative analysis. Arch Neurol 47: 681–684.I. ShimoyamaT. NinchojiK. Uemura1990The finger-tapping test. A quantitative analysis.Arch Neurol47681684
  25. 25. Nakamura R, Nagasaki H, Narabayashi H (1978) Walking patterns and finger rhythm of older adults. Percept Mot Skills 46(1): 63–75.R. NakamuraH. NagasakiH. Narabayashi1978Walking patterns and finger rhythm of older adults.Percept Mot Skills4616375
  26. 26. Schettino LF, Adamovich SV, Hening W, Tunik E, Sage J, et al. (2006) Hand preshaping in Parkinson's disease: effects of visual feedback and medication state. Exp Brain Res 168: 186–202.LF SchettinoSV AdamovichW. HeningE. TunikJ. Sage2006Hand preshaping in Parkinson's disease: effects of visual feedback and medication state.Exp Brain Res168186202
  27. 27. Broeren J, Rydmark M, Bjorkdahl A, Sunnerhagen KS (2007) Assessment and training in a 3-dimensional virtual environment with haptics: a report on 5 cases of motor rehabilitation in the chronic stage after stroke. Neurorehabil Neural Repair 21: 180–189.J. BroerenM. RydmarkA. BjorkdahlKS Sunnerhagen2007Assessment and training in a 3-dimensional virtual environment with haptics: a report on 5 cases of motor rehabilitation in the chronic stage after stroke.Neurorehabil Neural Repair21180189
  28. 28. Murray CD, Pettifer S, Howard T, Patchick EL, Caillete F, et al. (2007) The treatment of phantom limb pain using immersive virtual reality: Three case studies. Disability and Rehabilitation 29: 1465–1469.CD MurrayS. PettiferT. HowardEL PatchickF. Caillete2007The treatment of phantom limb pain using immersive virtual reality: Three case studies.Disability and Rehabilitation2914651469
  29. 29. You SH, Jang SH, Kim YH, Hallett M, Ahn SH, et al. (2005) Virtual reality-induced cortical reorganization and associated locomotor recovery in chronic stroke: an experimenter-blind randomized study. Stroke 36: 1166–1171.SH YouSH JangYH KimM. HallettSH Ahn2005Virtual reality-induced cortical reorganization and associated locomotor recovery in chronic stroke: an experimenter-blind randomized study.Stroke3611661171
  30. 30. Jang SH, You SH, Hallett M, Cho YW, Park CM, et al. (2005) Cortical reorganization and associated functional motor recovery after virtual reality in patients with chronic stroke: an experimenter-blind preliminary study. Arch Phys Med Rehabil 86: 2218–2223.SH JangSH YouM. HallettYW ChoCM Park2005Cortical reorganization and associated functional motor recovery after virtual reality in patients with chronic stroke: an experimenter-blind preliminary study.Arch Phys Med Rehabil8622182223
  31. 31. Steele E, Grimmer K, Thomas B, Mulley B, Fulton I, et al. (2003) Virtual reality as a pediatric pain modulation technique: A case study. Cyberpsychology & Behavior 6: 633–638.E. SteeleK. GrimmerB. ThomasB. MulleyI. Fulton2003Virtual reality as a pediatric pain modulation technique: A case study.Cyberpsychology & Behavior6633638
  32. 32. Keshner E (2004) Virtual reality and physical rehabilitation: a new toy or a new research and rehabilitation tool? Journal of NeuroEngineering and Rehabilitation 1: 1–2.E. Keshner2004Virtual reality and physical rehabilitation: a new toy or a new research and rehabilitation tool?Journal of NeuroEngineering and Rehabilitation112
  33. 33. Horlings CGC, Carpenter MG, Kung UM, Honegger F, Wiederhold B, et al. (2009) Influence of virtual reality on postural stability during movements of quiet stance. Neuroscience Letters 451: 227–231.CGC HorlingsMG CarpenterUM KungF. HoneggerB. Wiederhold2009Influence of virtual reality on postural stability during movements of quiet stance.Neuroscience Letters451227231
  34. 34. Perani D, Fazio F, Borghese NA, Tettamanti M, Ferrari S, et al. (2001) Different Brain Correlates for Watching Real and Virtual Hand Actions. Neuroimage 14: 749–758.D. PeraniF. FazioNA BorgheseM. TettamantiS. Ferrari2001Different Brain Correlates for Watching Real and Virtual Hand Actions.Neuroimage14749758
  35. 35. Wang LCT, Chen CC (1991) A combined optimization method for solving the inverse kinematics problems of mechanical manipulators. IEEE Transactions on Robotics and Automation 7(4): 489–499.LCT WangCC Chen1991A combined optimization method for solving the inverse kinematics problems of mechanical manipulators.IEEE Transactions on Robotics and Automation74489499
  36. 36. Holcombe AO (2009) Seeing slow and seeing fast: two limits on perception. Trends Cogn Sci 13: 216–221.AO Holcombe2009Seeing slow and seeing fast: two limits on perception.Trends Cogn Sci13216221
  37. 37. Shimoyama I, Ninchoji T, U K (1990) The finger-tapping test. A quantitative analysis. Arch Neurol 47: 681–684.I. ShimoyamaT. NinchojiK. U1990The finger-tapping test. A quantitative analysis.Arch Neurol47681684
  38. 38. Hughes AJ, Daniel SE, Kilford L, Lees AJ (1992) Accuracy of clinical-diagnosis of idiopathic Parkinon's disease- A clinicopathological study of 100 cases. Journal of Neurology Neurosurgery and Psychiatry 55: 181–184.AJ HughesSE DanielL. KilfordAJ Lees1992Accuracy of clinical-diagnosis of idiopathic Parkinon's disease- A clinicopathological study of 100 cases.Journal of Neurology Neurosurgery and Psychiatry55181184
  39. 39. Folstein MF, Folstein SE, McHugh PR (1975) “Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res 12: 189–198.MF FolsteinSE FolsteinPR McHugh1975“Mini-mental state”. A practical method for grading the cognitive state of patients for the clinician.J Psychiatr Res12189198
  40. 40. Oldfield RC (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9: 97–113.RC Oldfield1971The assessment and analysis of handedness: the Edinburgh inventory.Neuropsychologia997113
  41. 41. Galati G, Lobel E, Vallar G, Berthoz A, Pizzamiglio L, et al. (2000) The neural basis of egocentric and allocentric coding of space in humans: a functional magnetic resonance study. Exp Brain Res 133: 156–164.G. GalatiE. LobelG. VallarA. BerthozL. Pizzamiglio2000The neural basis of egocentric and allocentric coding of space in humans: a functional magnetic resonance study.Exp Brain Res133156164
  42. 42. Wu G, Baraldo M, Furlanut M (1999) Inter-patient and intra-patient variations in the baseline tapping test in patients with Parkinson's disease. Acta Neurol Belg 99: 182–184.G. WuM. BaraldoM. Furlanut1999Inter-patient and intra-patient variations in the baseline tapping test in patients with Parkinson's disease.Acta Neurol Belg99182184
  43. 43. Astolfi L, Babiloni F, Babiloni C, Carducci F, Cincotti F, et al. (2004) Time-varying cortical connectivity by high resolution EEG and directed transfer function: simulations and application to finger tapping data. Conf Proc IEEE Eng Med Biol Soc 6: 4405–4408.L. AstolfiF. BabiloniC. BabiloniF. CarducciF. Cincotti2004Time-varying cortical connectivity by high resolution EEG and directed transfer function: simulations and application to finger tapping data.Conf Proc IEEE Eng Med Biol Soc644054408
  44. 44. Foki T, Pirker W, Klinger N, Geissler A, Rath J, et al. (2010) FMRI correlates of apraxia in Parkinson's disease patients OFF medication. Exp Neurol 225: 416–422.T. FokiW. PirkerN. KlingerA. GeisslerJ. Rath2010FMRI correlates of apraxia in Parkinson's disease patients OFF medication.Exp Neurol225416422
  45. 45. Leijnse JN, Campbell-Kyureghyan NH, Spektor D, Quesada PM (2008) Assessment of individual finger muscle activity in the extensor digitorum communis by surface EMG. J Neurophysiol 100: 3225–3235.JN LeijnseNH Campbell-KyureghyanD. SpektorPM Quesada2008Assessment of individual finger muscle activity in the extensor digitorum communis by surface EMG.J Neurophysiol10032253235
  46. 46. Nakamura R, Nagasaki H, Narabayashi H (1978) Disturbances of rhythm formation in patients with Parkinson's disease: part I. Characteristics of tapping response to the periodic signals. Percept Mot Skills 46(1): 63–75.R. NakamuraH. NagasakiH. Narabayashi1978Disturbances of rhythm formation in patients with Parkinson's disease: part I. Characteristics of tapping response to the periodic signals.Percept Mot Skills4616375
  47. 47. Stavrinou ML, Moraru L, Cimponeriu L, Della Penna S, Bezerianos A (2007) Evaluation of cortical connectivity during real and imagined rhythmic finger tapping. Brain Topogr 19: 137–145.ML StavrinouL. MoraruL. CimponeriuS. Della PennaA. Bezerianos2007Evaluation of cortical connectivity during real and imagined rhythmic finger tapping.Brain Topogr19137145
  48. 48. Wertham F (1929) A new sign of cerebellar diseases. J Nerv Ment Dis 69: 486–493.F. Wertham1929A new sign of cerebellar diseases.J Nerv Ment Dis69486493
  49. 49. Aymerich-Franch L (2010) Presence and emotions in playing a group game in a virtual environment: the influence of body participation. Cyberpsychol Behav Soc Netw 13: 649–654.L. Aymerich-Franch2010Presence and emotions in playing a group game in a virtual environment: the influence of body participation.Cyberpsychol Behav Soc Netw13649654
  50. 50. Slater M, Steed A, McCarthy J, Maringelli F (1998) The influence of body movement on subjective presence in virtual environments. Hum Factors 40: 469–477.M. SlaterA. SteedJ. McCarthyF. Maringelli1998The influence of body movement on subjective presence in virtual environments.Hum Factors40469477
  51. 51. Iacoboni M, Woods RP, Brass M, Bekkering H, Mazziotta JC, et al. (1999) Cortical mechanisms of human imitation. Science 286: 2526–2528.M. IacoboniRP WoodsM. BrassH. BekkeringJC Mazziotta1999Cortical mechanisms of human imitation.Science28625262528
  52. 52. Mirelman A, Maidan I, Herman T, Deutsch JE, Giladi N, et al. (2010) Virtual Reality for Gait Training: Can It Induce Motor Learning to Enhance Complex Walking and Reduce Fall Risk in Patients With Parkinson's Disease? J Gerontol A Biol Sci Med Sci. A. MirelmanI. MaidanT. HermanJE DeutschN. Giladi2010Virtual Reality for Gait Training: Can It Induce Motor Learning to Enhance Complex Walking and Reduce Fall Risk in Patients With Parkinson's Disease?J Gerontol A Biol Sci Med Sci
  53. 53. Mirelman A, Maidan I, Mirelman D, Brozgol M, Giladi N, et al. (2010) Virtual reality for gait training in Parkinson's disease. Movement Disorders 25: 361.A. MirelmanI. MaidanD. MirelmanM. BrozgolN. Giladi2010Virtual reality for gait training in Parkinson's disease.Movement Disorders25361
  54. 54. Stredney D, Wiet GJ, Yagel R, Sessanna D, Kurzion Y, et al. (1998) A comparative analysis of integrating visual representations with haptic displays. Stud Health Technol Inform 50: 20–26.D. StredneyGJ WietR. YagelD. SessannaY. Kurzion1998A comparative analysis of integrating visual representations with haptic displays.Stud Health Technol Inform502026
  55. 55. Aoki T, Francis PR, Kinoshita H (2003) Differences in the abilities of individual fingers during the performance of fast, repetitive tapping movements. Exp Brain Res 152: 270–280.T. AokiPR FrancisH. Kinoshita2003Differences in the abilities of individual fingers during the performance of fast, repetitive tapping movements.Exp Brain Res152270280