Figures
Abstract
Training in action video games can increase the speed of perceptual processing. However, it is unknown whether video-game training can lead to broad-based changes in higher-level competencies such as cognitive flexibility, a core and neurally distributed component of cognition. To determine whether video gaming can enhance cognitive flexibility and, if so, why these changes occur, the current study compares two versions of a real-time strategy (RTS) game. Using a meta-analytic Bayes factor approach, we found that the gaming condition that emphasized maintenance and rapid switching between multiple information and action sources led to a large increase in cognitive flexibility as measured by a wide array of non-video gaming tasks. Theoretically, the results suggest that the distributed brain networks supporting cognitive flexibility can be tuned by engrossing video game experience that stresses maintenance and rapid manipulation of multiple information sources. Practically, these results suggest avenues for increasing cognitive function.
Citation: Glass BD, Maddox WT, Love BC (2013) Real-Time Strategy Game Training: Emergence of a Cognitive Flexibility Trait. PLoS ONE 8(8): e70350. https://doi.org/10.1371/journal.pone.0070350
Editor: Nicole Wenderoth, Katholieke Universiteit Leuveņ Belgium
Received: March 6, 2013; Accepted: June 18, 2013; Published: August 7, 2013
Copyright: © 2013 Glass et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by Air Force Office of Scientific Research (www.afosr.af.mil) grant FA9550-10-1-0268, Army Research Laboratory (www.arl.army.mil) grant W911NF-09-2-0038, and National Institutes of Health (www.nih.gov) grants MH091523 to BCL and DA032457 to WTM. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Neuroplasticity is the ability of the adult brain to not only learn new behaviors and form new memories but to alter the underlying neural structures responsible for such learning [1]. This capability can allow for effective compensation against cognitive impairments that coincide with systemic neural changes such as aging or the onset of schizophrenia [2], [3]. One question is whether activities novel to the modern lifestyle can lead to changes in core cognitive functioning. Video gaming represents an immersive and oftentimes intensive activity that is unique to modern humans and is rapidly increasing in popularity. Given the ubiquity of video gaming in modern culture, one important question is whether video games can shape core components of human cognition.
In 2008, 72% of the general population and 97% of teenagers aged 12–17 reported playing video games [4]. Video games are being played more frequently and in more locations: 50% of all teens reported playing “yesterday”, and 60% of all teens play video games on portable devices [5]. Many studies have focused on cognitive differences of video game players, as a group, in comparison to non-gamers [6]–[9]. Although observational studies are essential for studying individual differences, it is also important to examine video game training itself, and the potential causal influences of video gaming on novice players' cognition.
Prior experimental investigation of the cognitive consequences of video gaming provides evidence that cognitive and perceptual changes occur in those who transition from non-gamers to gamers. Specifically, training on action games (e.g., first-person, fast paced, kill-or-be-killed situations) has been linked to enhanced core perceptual processing [10], [11]. Action video game novices assigned to action video game training experience a number of benefits, including higher contrast sensitivity [12], faster visual information processing [13], expanded useful field of view [14], and logical comprehension [15].
One key question is whether video game play can alter aspects of higher-level cognition [16]. In other words, is video game training limited to promoting “fast perception” or can it also promote “fast thinking”? Current findings are promising, but not conclusive. Jaeggi, Buschkuehl, Jonides, and Perrig [17] demonstrated that extended training (8 to 19 days) on an n-back test led to higher scores of fluid intelligence (Gf) relative to controls. This is evidence that certain forms of specific training can lead to generalized improvements in higher-level cognition as measured by a test which was entirely different than the training task. In a study of video game training in older adults, Basak, Boot, Voss, and Kramer [18], found that 23.5 hours of training on real-time strategy game led to enhanced executive control and visuospatial skills relative to a non-playing control group. In training studies involving action games, Green et al. [19] and Strobach, French, and Schubert [20] demonstrated a causal link between video game play and improvement in certain executive and cognitive tasks. Oei and Patterson [21] find positive transfer between the skills emphasized by certain types of games and performance in closely related laboratory tasks.
This array of studies is a promising indication that video game training can lead to improvements in cognitive test performance. However, another video game training study carried out on younger adults with little gaming experience did not find improved performance on cognitive testing after 23.5 video game training on either a real-time strategy game, an action video game, or a puzzle game [22]. Overall, previous work indicates video game play can lead to improvements in both perceptual and cognitive performance. The majority of prior research involves action gaming and or games that closely mirror testing conditions. In contrast, we seek to affect broad-based changes in higher-level cognitive ability by emphasizing certain cognitive operations within a single (non-action) video game.
In the present study, we add to an emerging body of literature suggesting video gaming can alter higher-level competencies by devising a gaming intervention and specifying diagnostic measures that are optimized to assess the effects of gaming on cognitive flexibility. Cognitive flexibility is the essential ability to assess and adapt ongoing psychological operations and to coordinate the allocation of cognitive processes appropriately in dynamic decision making environments [23]. Cognitive flexibility is a core aspect of cognition that involves the coordination of cognitive resources in both lower-level perceptual switching and higher-level rule switching [24], and has been associated with fluid intelligence [25] and overall psychological well-being [26]. Cognitive flexibility is likely not subserved by a single neural area, but rather is representative of a broad functional network involving the prefrontal cortex and right superior parietal cortex [27]. One possibility is that broad-based training that engages multiple processes related to cognitive flexibility is required to tune this distributed network. Certain types of video game experience, as opposed to narrow training on a laboratory task, may be well suited for inducing plasticity in the neural systems supporting cognitive flexibility.
Real-time strategy (RTS) game training is an excellent candidate for tuning these cortical networks due to sustained maintenance and rapid switching across multiple information sources at a high workload for long periods of time over several weeks. Our main prediction is that our RTS gaming manipulation will complement previous work in action video games by promoting “fast thinking”, while not strongly affecting “fast perception.” To assess whether video game training can alter cognitive flexibility, the current study utilizes an RTS game, StarCraft (published by Blizzard Entertainment, Inc. in 1998). RTS gaming involves the creation, organization, and command of an army against an enemy army in a real-time map-based setting (see Text S1 for more information on the game). To be successful, the player must cope with simultaneous and rapidly evolving game situations and sub-situations occurring in real-time while managing funds, resources, and information regarding the opponent. Furthermore, we altered the stock StarCraft game program by disabling mini-map alerts, requiring the player to rely on memory for events occurring outside the screen window. In short, while previous work relied on action video games which highlight “fast perception”, RTS gaming highlights “fast thinking” and has been used previously as a successful training regimen. Thus, we predict RTS game training to enhance cognitive flexibility in a general manner.
To further elucidate the role of video gaming on cognitive flexibility, gaming is examined with a within-game and between-game comparison. A life-simulator game is used as a control gaming condition against two versions of the RTS game: a full-map version and a half-map version. The full-map version (SC-2) involves two friendly bases and two enemy bases, whereas the half-map version (SC-1) involves one friendly and one enemy base and half the available gaming space. In the SC-2 version, the player is commanding and controlling two separate bases in multiple battles against two separate opponent bases. For this reason, the SC-2 subcondition promotes more switching and coordination of cognitive resources, hallmarks of cognitive flexibility. Both versions were also modified with a reactive difficulty level in order to maintain a win rate near 50%. Thus, the SC-1 version was designed to be as engrossing and difficult as the SC-2 version, but did not emphasize maintaining awareness of and switching between two spatially separated (out of view) bases. Importantly, game feature and behavior recording within the RTS game allowed for verification of the amount of attended information between the two versions. The life-simulator video game, The Sims 2 (published by Electronic Arts, Inc. in 2004), has been shown to be a useful control for experimental video game research [12]. Together, this is an effort to delineate not only the behavioral characteristics that change in the course of initial video game training, but also the characteristics of the games themselves that lead to change.
To determine changes in cognitive flexibility that occurred as a result of video gaming, participants completed a battery of psychological tasks at pre-test and post-test (at 40 hours of gaming). The battery included measures that address cognitive flexibility as well as measures of unrelated constructs. Measures of flexibility included the Attention Network Test (ANT) [28], Stroop task [29], task switching [30], a novel multi-location memory task, and test of Operating Span (Ospan; distinct from simple counting memory span) [31], [32]. These are classic measures of cognitive flexibility in that they require the switching or coordination of cognitive processes in order to successfully navigate the task at hand. For example, the task switching paradigm involves switching between two different stimulus identification tasks. All the measures in the cognitive flexibility task group assess the ability to coordinate attentional processes between two or more concurrent or alternating operations. Measures of predicted unrelated constructs included the balloon analogue risk task (BART) [33], visual search task [14], information filtering task [34], and WAIS-IV digit span memory task [35], [36]. These tasks were chosen to help delineate the specific hypothesis that RTS training would lead specifically to cognitive flexibility enhancements given that RTS game play stresses fast-paced switching and coordination of decisional processing. The visual search task and the information filtering task were chosen due to their use in previous action video game research [12], in order to differentiate RTS training from action video game training. BART and the digit span memory task were chosen due to further delineate cognitive flexibility from the broad domains of risk sensitivity and general memory. Participant groups were equated on the Multimedia Multitasking Index (MMI), a measure of the amount of time an individual spends simultaneously engaged in more than one form of media [37]. Consistent with best scientific practices and openness, the task grouping and analysis strategy were determined and publically disclosed [38] prior to data collection.
Methods
Undergraduate participants were recruited from the University of Texas at Austin. Respondents to an advertisement were screened and selected for inclusion on the basis of reported video game use. Participants were randomly assigned to one of the three experimental conditions. Those who reported <2 hours per week of video game use were included (SC-1, n = 26; SC-2, n = 20; Sims, n = 26). Mean age was 20.3 years (SD = 1.1) for SC-1, 20.4 years (SD = 1.1) for SC-2, and 19.9 years (SD = 0.8) for the Sims condition. All participants were female due to the small number of non-gaming males (see Text S1). Primary cognitive testing occurred before video game assignment (pre-test) and after 40 hours of gaming (post-test). Figure 1 illustrates the experimental time-course for all three groups (SC-1, SC-2, and The Sims). Testing occurred over a two day span in a laboratory setting (Table S1). The cognitive battery included standard methodology for all tasks involved. For the multi-location memory task, methodology is available in Text S1. For further information regarding alterations made to the StarCraft game program and downloadable data sets, visit http://brianglass.net.
The experimental procedure included the completion of a pre-test task battery, followed by gaming condition assignment (SC-1, SC-2, or The Sims). Each participant engaged in 40 total hours of video gaming. This video game play occurred outside the lab on the participants' own laptops. Psychological testing occurred over sessions in the laboratory.
The video game software along with experiment running software was installed on each participant's laptop. The software provided a portal which controlled the settings for each gaming session and prevented the participant from playing more than 40 hours before post-test. Players were instructed to play for roughly one hour per day. For the SC subconditions, gaming sessions alternated between two StarCraft map formats that differed by terrain theme and layout. Additionally, a titration procedure raised or lowered the difficulty of the following game in response to whether the previous game was won or lost. Difficulty varied between 15 levels and was defined as the amount of production resources available to the opponent entity in the game. This procedure successfully honed win rate (42.6%, SD = 8.8% for SC-1; 43.0%, SD = 8.7% for SC-2). For the Sims condition, participants controlled and developed a single “family household” in a virtual neighborhood. Participants were given 7 weeks (49 days) to complete the study, with the average completion occurring after 43.7 days (SD = 6.24). Further information on materials and methods is available in the Text S1.
Results
Behavioral Modeling of Assessed Cognitive Flexibility
To compare across the various cognitive tasks, and account for the effects of re-test learning, we contrasted post-test enhancements in the RTS subconditions against the control life-simulator condition using diffusion modeling when appropriate, and applying a meta-analytical Bayesian technique [39], [40]. The technique involves a critical second step that is often ignored in null hypothesis significance testing, namely the direct comparison of the likelihood of the null hypothesis to the likelihood of the alternative hypothesis. The Bayes factor technique performs this type of ratio test, resulting in a numeric value representing the likelihood of the alternative hypothesis versus the likelihood of the null hypothesis given the collected data set.
To achieve a meta-analytical Bayes factor approach, we computed a single performance metric for each task. For tasks in which there is accuracy and response time measures, we use diffusion modeling to combine these two measures into a single measure of performance. Diffusion modeling is an established modeling technique for tasks which permit a speed/accuracy tradeoff [41], [42]. For tasks such as the BART, for which diffusion modeling is not possible, we use standardized scoring procedures. Detailed information for each task is available in the Text S1. For each task, performance change was defined as the pre-test to post-test performance difference scores. Importantly, we accounted for repeated exposure learning by comparing both of the RTS subconditions (SC-1 and SC-2) against the Control condition (The Sims 2) performance. In this way, the simple effect of learning from repeated exposure to the tasks was accounted for by making performance change relative to the Control gaming condition. Tables S2, S3, S4, S5, S6, S7, S8, S9, S10 provide detailed task results and subscores.
Using a meta-analytical Bayesian technique that aggregated across multiple t-test statistics, we consolidated evidence for or against performance enhancement for the cognitive flexibility tasks and the unrelated tasks. For both SC subconditions, task performance was compared against Control gaming performance using a t-test. This comparison accounts for re-test learning that may have occurred from pre-test to post-test. The meta-analytical Bayesian framework combines evidence in an appropriate manner to make a collective assessment regarding evidence for or against the null hypothesis that no performance change has occurred relative to the Control group. The conventional interpretation of the Bayes factor [43] deems ratios greater than 1∶1 as evidence for the alternative hypothesis, with ratios greater than 3∶1 signifying substantial evidence, greater than 10∶1 signifying strong evidence, greater than 30∶1 signifying very strong evidence, and greater than 100∶1 signifying decisive evidence.
The t-values used to calculate the meta-analytical Bayes factors and associated effect sizes of the individual tests, as well as means and standard error for pre- and post-test scores, are listed in Tables 1 and 2. Due to the low power of any individual test and the danger of false discovery when performing multiple tests, we refrain from drawing conclusions about the individual tasks and focus on the a priori determined meta-analytical Bayesian analyses.
All main predictions held. For the cognitive flexibility task grouping, the Bayes factor for RTS game play (StarCraft) versus the control game (The Sims) was 40.76. As predicted, benefits for RTS gaming only held for the cognitive flexibility task grouping. For the other tasks, the Bayes factor for RTS game play (StarCraft) versus the control game (The Sims) was 0.02, which signifies very strong evidence for the null hypothesis. When comparing the SC-1 and SC-2 subconditions directly, no strong evidence for differences was found. However, when considering the cognitive flexibility task grouping, the SC-2 subcondition did differ from the Sims control game (Bayes factor of 6.77), whereas the evidence for SC-1 subcondition differing from the Sims control game was inconsequential (Bayes factor of 1.17). Overall, these results are highly supportive of our predictions – RTS gaming selectively promotes cognitive flexibility, particularly under conditions in which players must rapidly switch between contexts while maintaining memory for both contexts.
Principal Component Analysis of a Cognitive Flexibility Dimension
One key question is whether an underlying dimension of cognitive flexibility emerges or strengthens as a result of video game experience. A principal component analysis (PCA) on the absolute cognitive task scores (as opposed to post-test minus pre-test difference scores as compared to the Sims control condition) revealed the main underlying performance components within each game group. At pre-test, neither the Sims nor the SC group (SC-1 and SC-2) had a pattern of primary principle components, which aligned with the hypothesized cognitive flexibility task distinction. However, at post-test, the SC group's first principle component organized along the hypothesized cognitive flexibility task distinction. To demonstrate the emergence of this pattern of focused improvement on cognitive flexibility, the vector of PCA component contributions for each task were correlated with the hypothesized contribution factor vector (1 for cognitive flexibility tasks, 0 for unrelated tasks). For pre-test, the correlations for the Sims and SC conditions were not significant, r = −0.06, p = 0.88 and r = 0.14, p = 0.73, respectively (with no significant distinction between the two correlations, z = 0.35, p = 0.73). However, at post-test, the SC group correlated significantly, r = 0.94, p<0.001, whereas for the Sims condition the correlation with the cognitive flexibility component remained non-significant, r = −0.44, p = 0.24 (with the distinction between the two correlations statistically significant, z = 3.83, p<0.001). Thus, after 40 hours of RTS video gaming, those in the SC group exhibited a performance component that is aligned with cognitive flexibility.
Taken together, the PCA and meta-analytical BF results reveal that the RTS video game training paradigm successfully enhanced and aligned the cognitive performance of the group along a new and unified dimension of cognitive flexibility. Forty hours of RTS video game training was sufficient to create dramatic changes in players' cognitive flexibility.
RTS Game State Feature Analysis
Our previous analyses indicate that those in the SC-2 subcondition, but not necessarily those in the SC-1 subcondition, benefited from enhanced cognitive flexibility as a result of RTS training. We originally hypothesized that RTS gaming involved the practice of maintaining, assessing, and coordinating between multiple information and action sources simultaneously. In order to verify that the SC-2 subcondition stresses these operations more than the SC-1 subcondition, we analyzed players' behavior within the RTS game. In particular, we examined players' use of game features to test the hypotheses that SC-2 players simultaneously process more within game information than SC-1 players. See the Text S1 for further details on the modification of the StarCraft gaming engine and for behavioral data.
During RTS game play, game state features and user behavior were recorded every 250 milliseconds. Game features (e.g., whether a unit is being attacked) are used to predict which unit is selected by the player. By constructing the selection/feature analysis for time step lags into the past, it became possible to determine which features in the near past drove user selection in the present. In this way, we implement Bayesian model selection to determine how many features a player entertains.
Figure 2 illustrates the number of significant game state features for the SC subconditions at various time lags. Those in the SC-2 subcondition utilized more game state features than those in the SC-1 subcondition. This result supports the notion that the within-StarCraft gaming manipulation led SC-2 participants to manage more information sources during game play, thus leading to enhancements in cognitive flexibility.
As time progresses, fewer gaming features from the past influence current game play behavior. The SC-2 group attended to more features and at post-test exhibited enhanced cognitive flexibility performance relative to the Sims group.
Discussion
The present study finds that cognitive flexibility is a trainable skill. Forty hours of training within an RTS game that stresses rapid and simultaneous maintenance, assessment, and coordination between multiple information and action sources was sufficient to affect change. As a result of RTS game experience, an underlying dimension of cognitive flexibility emerged and characterized individual differences in performance on a variety of laboratory tasks.
Secondary analyses involved comparing SC-1 and SC-2 subconditions. Comparing the SC-1 and SC-2 individually to the baseline control game, SC-2, which involved maintaining awareness of and switching between two spatially separated (out of view) bases, was particularly effective in boosting players' cognitive flexibility. By recording real-time gaming data, we were able to compare the two StarCraft groups in terms of the number of significant features attended during game play. This has revealed that in fact the SC-2 gaming setup led to more attended features overall than SC-1.
This delineation of gaming environment and the resulting gaming behavior is a novel demonstration that begins to clarify which gaming attributes are important for meaningful cognitive change. We have shown that training with a sufficient level of simultaneous information and action coordination in a real-time video game leads to the specific enhancement of higher-level cognition along a clear unified component. With the ability to control and quantify specific video game parameters and behavior, we have shown that it is possible to alter cognitive flexibility, a core component with broad influence on the psychological abilities and well-being of an individual. We have also shown that only one version of RTS gaming led to cognitive flexibility enhancements while another did not. The SC-2 subcondition was designed to require even more switching and maintenance of information. Modeling of the gaming behavior indicated that those in the SC-2 subcondition were attending to more gaming features. These aspects of RTS gaming may have been the critical elements of the video gaming training regimen required to elicit a cognitive flexibility enhancement.
One key direction for future research is to detail the brain basis for these dramatic changes in behavior. Promising avenues include structural magnetic resonance imaging (MRI) to explore volumetric changes to brain regions following video game experience, as well as diffusion tensor imaging (DTI) to explore changes in connectivity between brain regions as a result of training. Given the nature of cognitive flexibility, we expect that changes will not be localized to one region. Understanding the brain basis for the behavior change may suggest how to best pair varieties of game experience with populations seeking to improve cognitive flexibility. Applications of this innovation include the development of clinical regimens to target deficits in populations with specific cognitive flexibility or executive functioning dysfunction. These include attention deficit hyperactivity disorder (ADHD) [44], complications with normal aging [45], and traumatic brain injury [46].
Supporting Information
Figure S1.
Difficulty level reached by map type for SC-2 and SC-1. Error bars represent standard error. This reflects similar game difficulty and engagement between SC-2 and SC-1.
https://doi.org/10.1371/journal.pone.0070350.s002
(TIF)
Table S1.
Latin square task counterbalancing (MMI = Multimedia Multitasking Index, BART = Balloon Analog Risk Taking, TS = Task Switching, DS = WAIS-IV Digit Span, ANT = Attention Network Test, Ospan = Operating Span, IF = Information Filtering, VS = Visual Search, MLM = Multi-location Memory).
https://doi.org/10.1371/journal.pone.0070350.s003
(DOCX)
Table S2.
Task Switching task, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s004
(DOCX)
Table S3.
Stroop test, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s005
(DOCX)
Table S4.
ANT, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s006
(DOCX)
Table S5.
Multi-location memory task, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s007
(DOCX)
Table S6.
Ospan test, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s008
(DOCX)
Table S7.
Visual search task, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s009
(DOCX)
Table S8.
WAIS-IV digit span test, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s010
(DOCX)
Table S9.
Information filtering task, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s011
(DOCX)
Table S10.
Balloon Analog Risk Taking, post-test minus pre-test, with standard error in parentheses.
https://doi.org/10.1371/journal.pone.0070350.s012
(DOCX)
Acknowledgments
The authors thank Marc Tomlinson, Devon Greer, Rusty Gomez, Reid Tissing, and Kristen Crabtree for their help in making this project possible.
Author Contributions
Conceived and designed the experiments: BDG WTM BCL. Performed the experiments: BDG. Analyzed the data: BDG. Contributed reagents/materials/analysis tools: BDG BCL. Wrote the paper: BDG WTM BCL.
References
- 1. Lillard AS, Erisir A (2011) Old dogs learning new tricks: Neuroplasticity before and after critical periods. Developmental Review 31: 207–239.
- 2. Fisher M, Holland C, Merzenich MM, Vinogradov S (2009) Using neuroplasticity-based auditory training to improve verbal memory in schizophrenia. American Journal of Psychiatry 166: 805–811.
- 3. Goh JO, Park DC (2009) Neuroplasticity and cognitive aging: The scaffolding theory of aging and cognition. Restorative Neurology and Neuroscience 27: 391–403.
- 4. Entertainment Software Association (2010) Essential facts about the computer and video game industry: sales, demographic, and usage data.
- 5. Rideout VJ, Roberts DF, Foehr UG (2005) Generation M: Media in the lives of 8–18 year olds: Executive summary.
- 6. Cain MS, Landau AN, Shimamura AP (2012) Action video game experience reduces the cost of switching tasks. Attention, Perception, & Psychophysics 1–7.
- 7. Colzato LS, Van Leeuwen PJ, Van Den Wildenberg WP, Hommel B (2010) DOOM'd to switch: superior cognitive flexibility in players of first person shooter games. Frontiers in Psychology 1.
- 8. Irons JL, Remington RW, McLean JP (2011) Not so fast: Rethinking the effects of action video games on attentional capacity. Australian Journal of Psychology 63: 224–231.
- 9. Karle JW, Watter S, Shedden JM (2010) Task switching in video game players: Benefits of selective attention but not resistance to proactive interference. Acta Psychologica 134: 70.
- 10. Dye MWG, Green CS, Bavelier D (2009) Increasing speed of processing with action video games. Current Directions in Psychological Science 18: 312–326.
- 11. Green CS, Bavelier D (2003) Action video-game modify selective visual attention. Nature 423: 534–537.
- 12. Li R, Polat U, Makous W, Bavelier D (2009) Enhancing the contrast sensitivity function through action video game training. Nature Neuroscience 12: 549–551.
- 13. Castel AD, Pratt J, Drummond E (2005) The effect of action video game experience on time course of inhibition of return and efficiency of visual search. Acta Psychologica 119: 217–230.
- 14. Feng J, Spence I, Pratt J (2007) Playing an action game reduces gender differences in spatial cognition. Psychological Science 18: 850–855.
- 15. Sanchez CA (2012) Enhancing visuospatial performance through video game training to increase learning in visuospatial science domains. Psychonomic Bulletin & Review 19: 58–65.
- 16. Bavelier D, Green CS, Pouget A, Schrater P (2012) Brain plasticity through the life span: Learning to learn and action video games. Neuroscience 35: 391–416.
- 17. Jaeggi SM, Buschkuehl M, Jonides J, Perrig WJ (2008) Improving fluid intelligence with training on working memory. Proceedings of National Academy of Sciences 105: 6829–6833.
- 18. Basak C, Boot WR, Voss MW, Kramer AF (2008) Can training in a real-time strategy video game attenuate cognitive decline in older adults? Psychology and Aging 23: 765–777.
- 19. Green CS, Sugarman MA, Medford K, Klobusicky E, Bavelier D (2012) The effect of action video game experience on task-switching. Computers in Human Behavior 26: 984–994.
- 20. Strobach T, Liepelt R, Schubert T, Kiesel A (2012) Task switching: effects of practice on switch and mixing costs. Psychological Research 76: 74–83.
- 21. Oei AC, Patterson MD (2013) Enhancing Cognition with Video Games: A Multiple Game Training Study. PLOS ONE 8: e58546.
- 22. Boot WR, Kramer AF, Simons DJ, Fabiani M, Gratton G (2008) The effects of video game playing on attention, memory, and executive control. Acta Psychologica 129: 387–398.
- 23. Crone EA, Ridderinkhof KR, Worm M, Somsen RJM, van der Molen MW (2004) Switching between spatial stimulus- response mappings: a developmental study of cognitive flexibility. Developmental Science 7: 443–455.
- 24. Ravizza SM, Carter CS (2008) Shifting set about task switching: Behavioral and neural evidence for distinct forms of cognitive flexibility. Neuropsychologia 46: 2924–2935.
- 25. Colzato LS, van Wouwe NC, Lavender TJ, Hommel B (2006) Intelligence and cognitive flexibility: Fluid intelligence correlates with feature “unbinding” across perception and action. Psychonomic Bulletin & Review 13: 1043–1048.
- 26. Moore A, Malinowski P (2009) Meditation, mindfulness and cognitive flexibility. Consciousness and Cognition 18: 176–186.
- 27. Duncan J (2001) An adaptive coding model of neural function in prefrontal cortex. Nature Reviews Neuroscience 2: 820–829.
- 28. Posner MI, Sheese B, Odludas Y, Tang Y (2006) Analyzing and shaping neural networks of attention. Neural Network 19: 1422–1429.
- 29.
Howison DB, Lezak MD, Loring DW (2004) “Orientation and attention”. Neuropsychological Assessment Oxford [Oxfordshire]: Oxford University Press: 365–367.
- 30. Monsell S (2003) Task switching. Trends in Cognitive Science 134–140.
- 31. Conway ARA, Kane MJ, Bunting MF, Hambrick DZ, Wilhelm O, Engle RW (2005) Working memory span tasks: A methodological review and user's guide. Psychonomic Bulletin and Review 12: 769–786.
- 32. Turner ML, Engle RW (1989) Is working memory capacicy cask dependenc? Journal of Memory and Language 28: 127–154.
- 33. Lejuez CW, Read JP, Kahler CW, Richards JB, Ramsey SE, et al. (2002) Evaluation of a behavioral measure of risk-taking: The Balloon Analogue Risk Task (BART). Journal of Experimental Psychology: Applied 8: 75–84.
- 34. Vogel EK, Luck AW, Makizawa MG (2005) Neural measures of individual differences in controlling access to visual working memory. Nature 483: 500–503.
- 35. Olesen P, Westerberg H, Klingberg T (2004) Increased prefrontal and parietal brain activity after training of working memory. Nature Neuroscience 7: 75–79.
- 36.
Wechsler D (2008) Wechsler Adult Intelligence Scale – 4th Edition (WAIS-IV®). San Antonio, Tx: Harcourt Assessment. .
- 37. Ophir E, Nass C, Wagner AD (2009) Cognitive control in media multi-taskers. 15583–15587.
- 38.
Glass BD (2011) Becoming a gamer: Cognitive effects of real-time strategy gaming (Doctoral dissertation proposal). University of Texas at Austin, Austin, Tx.
- 39. Good IJ (1992) The Bayes/Non-Bayes compromise: A brief review. Journal of the American Statistical Association 87: 597–606.
- 40. Rouder JN, Morey RD (2011) A Bayes-factor meta-analysis of Bem's ESP claim. Psychonomic Bulletin & Review 18: 682–689.
- 41. Ratcliff R, Rouder JN (1998) Modeling response times for two-choice decisions. Psychological Science 9: 347–356.
- 42. Wagenmakers EJ, van der Maas H, Grasman R (2007) An EZ-diffusion model for response time and accuracy. Psychonomic Bulletin & Review 14: 3–22.
- 43. Aitkin M (1991) Posterior Bayes factors. Journal of the Royal Statistical Society 53: 111–142.
- 44. Prins PJM, Sebastiaan D, Ponsioen A, ten Brink E, van der Oord S (2011) Does computerized working memory training with game elements enhance motivation and training efficacy in children with ADHD? Cyberpsychology, Behavior, and Social Networking 14: 115–122.
- 45. Grieve SM, Williams LM, Paul RH, Clark CR, Gordon E (2007) Cognitive aging, executive function, and fractional anisotropy: A diffusion tensor MR imaging study. American Journal of Neuroradiology 28: 226–235.
- 46. Milders M, Fuchs S, Crawford JR (2003) Neuropsychological impairments and changes in emotional and social behaviour following severe traumatic brain injury. Journal of Clinical and Experimental Neuropsychology 25: 157–172.