Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

An Electroencephalography Network and Connectivity Analysis for Deception in Instructed Lying Tasks

  • Yue Wang,

    Affiliation Neuroengineering Lab, Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

  • Wu Chun Ng,

    Affiliation Neuroengineering Lab, Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

  • Khoon Siong Ng,

    Affiliation Neuroengineering Lab, Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

  • Ke Yu,

    Affiliation Neuroengineering Lab, Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

  • Tiecheng Wu,

    Affiliation Neuroengineering Lab, Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

  • Xiaoping Li

    mpelixp@nus.edu.sg

    Affiliation Neuroengineering Lab, Mechanical Engineering Department, National University of Singapore, Singapore, Singapore

Abstract

Deception is an impactful social event that has been the focus of an abundance of researches over recent decades. In this paper, an electroencephalography (EEG) study is presented regarding the cognitive processes of an instructed liar/truth-teller during the time window of stimulus (question) delivery period (SDP) prior to their deceptive/truthful responses towards questions related to authentic (WE: with prior experience) and fictional experience (NE: no prior experience). To investigate deception in non-experienced events, the subjects were given stimuli in a mock interview scenario that induced them to fabricate lies. To analyze the data, frequency domain network and connectivity analysis was performed in the source space in order to provide a more systematic level understanding of deception during SDP. This study reveals several groups of neuronal generators underlying both the instructed lying (IL) and the instructed truth-telling (IT) conditions for both tasks during the SDP. Despite the similarities existed in these group components, significant differences were found in the intra- and inter-group connectivity between the IL and IT conditions in either task. Additionally, the response time was found to be positively correlated with the clustering coefficient of the inferior frontal gyrus (44R) in the WE-IL condition and positively correlated with the clustering coefficient of the precuneus (7L) and the angular gyrus (39R) in the WE-IT condition. However, the response time was found to be marginally negatively correlated with the clustering coefficient of the secondary auditory cortex (42L) in the NE-IL condition and negatively correlated with the clustering coefficient of the somatosensory association cortex (5L, R) in the NE-IT condition. Therefore, these results provide complementary and intuitive evidence for the differences between the IL and IT conditions in SDP for two types of deception tasks, thus elucidating the electrophysiological mechanisms underlying SDP of deception from regional, inter-regional, network, and inter-network scale analyses.

Introduction

Deception, a complex human behavioral manifestation, is impactful when causing serious safety threats and economic harm to the society. To counteract these potential threats, lie detection has been used in criminal investigations, employee honesty pre-screenings and forensic settings. Unfortunately, existing methods lack sensitivity and specificity mainly due to the fact that the underlying deception mechanism is poorly understood. In contrast to the polygraph [1] that measures deception’s peripheral manifestation, EEG and fMRI directly measure the organ that generates the deceptive activities. Most previous studies have been investigating whether there are generic neuronal finger-prints for liars. The previous fMRI studies have shown important roles of prefrontal and anterior cingulated cortex (ACC) in deception [25], highlighting ‘executive control’ as a core component of deception. Apart from this, the modulation effect of deception on the EEG power spectrum has been observed on the scalp level in previous studies [6, 7], specific EEG frequency band (i.e. alpha) was associated with lying, demonstrating that risk monitoring/expectation and increased cognitive load play important roles in deception. In addition, some previous EEG studies focused on a frequently used ERP-based paradigm [8], i.e. to detect concealed information in the ‘guilty knowledge test’(GKT) [9] that depends on the detection of a well-known P300 ‘oddball’ response [10] which basically detect liars’ response to salient targets. Although quite a few regions of interest/frequency band/ERP peak have been identified, the complete underlying of deception mechanism remains obscure. Unfortunately, no attempt has been taken before to unveil the functional networks underlying deception related processes, given the fact that deception is such a complicated cognitive process. Despite the challenge, in theory, neuronal communication should play an important role in deception related processes which involves coordination between different brain areas that belong to particular functional networks. Hence, it is interesting to take an attempt to investigate the network activities in the same frequency band from which distinct event related synchronization (ERS) was found (i.e., upper alpha band) in our previous study [11].

In contrast to previous studies that focused on the time window during which deceptive response is being generated, this study investigated the window prior to that period (i.e. stimulus delivery period (SDP)). The underlying hypothesis is that before the subjects giving any deceptive/truthful responses, their corresponding neuronal activities may already start to differentiate from each other, which possibly indicates the existence of a prediction sign of deception. Understanding the networks underlying deception during this time window possibly enables us to convert this whole complicated process into more easily understood cognitive processes, and to explore the potential earlier deception sign that has never been discussed before.

In this study, commonalities and differences between two types of instructed lying tasks during SDP were investigated. Interestingly, compared with the ‘with prior-experience’ lying task (WE), the ‘non-experience’ lying task (NE) remains largely uninvestigated. Previous deception studies have focused on comparisons between deception types such as instructed/spontaneous lying [7], self-referential/other-referential lying [12], and memorized/created lying [2]. Limited work has been carried out on comparisons between deception in experienced and non-experienced events. Among the fMRI studies, one study [3] instructed subjects to tell lies/the truth concerning 20 old stimuli and 20 new stimuli by answering ‘I know’ and ‘I don’t know’. This fMRI study considered both experienced and non-experienced events in the deception tasks without requiring fabrication of lies to the unfamiliar objects and the neural circuits underlying the processing were dominated by recognition memory and inhibition control. However, real-life deception for non-experienced events often involves fabricating lies while being asked questions that require semantic processing especially in the interview scenario. In general, this fMRI study remains distinct from the NE task that induces subjects to cheat with extra efforts in semantic processing. The motivation to study these two tasks is based on the further hypothesis that, features that can distinguish the IL and IT during the SDP may be different in varying tasks and when features of lying during the SDP is being discussed, it could be task-dependent.

In summary, this study is aimed to develop a new EEG-based approach to explore the potential neural mechanism of instructed lying during SDP that could potentially provide a basis for future applications. Additionally, previous EEG-based studies did not provide a neuro-anatomy basis for deception, and previous protocol designs for instructed lying may have only considered limited possibilities and therefore were not sufficiently comprehensive to cover possible real-life instructed lying scenarios. To address these issues, this study employed a i) frequency domain network and connectivity analysis in the source space and ii) an original paradigm to induce subjects to fabricate lies about non-experienced events.

Materials and Methods

2.1 Participants

Sixteen right-handed undergraduate students (8 males, 8 females) with a mean age of 22.5 years (SD = 4.5) were recruited as the subjects for this study. All of the subjects filled out a detailed health questionnaire, and their hearing ability and English proficiency were evaluated to ensure their suitability for participation. Only health-eligible subjects with satisfactory English proficiency were selected to participate. Each subject was given a detailed explanation of the experimental procedure, and each signed a consent form prior to the experiment. The study was approved by the NUS Institutional Review Board.

2.2 Deception task

The experiment contained four blocks, among which two belong to the WE task (instructed lying: IL, instructed truth: IT), which are related to autobiographic declarative/episode questions. The other two blocks belong to the NE task, which require subjects to fabricate lies for non-experienced events (refer to S1 Table and S2 Table for examples of stimulus). The four blocks were separated by 10-min breaks. The sequences of the four blocks were randomized across all of the subjects, and the sequences of the questions were randomized within the block. The question pool with 50 questions/condition were pre-screened by 15 volunteers (non-subject undergraduate students with similar population characteristic as the subjects) to score the understandability of each question into 4 levels (i.e. very easy-1, easy-3, moderate-difficult-5, very difficult-7). Understandability is a subjective score that measures how difficult it is for the volunteers to understand a particular question by asking the question once with the same speech rate. Examples were provided in advance as a customized calibration for each subject to know which level a particular question should fall into. After ranking the questions according to the understandability score, 25 questions with the lowest mean score were selected for each condition. In fact, the selected questions have been tested non-significantly different between the IL and IT in understandability (paired t-test: p = 0.75 for WE, and p = 0.82 for NE) and question length (paired t-test: p = 0.78 for WE, and p = 0.76 for NE) with the short-listed questions sharing a similar load between 2.2s-2.7s. In addition, prior to the experiment, subjects were instructed to give up the trial during the experiment by pressing a specific button if they cannot understand the question correctly. Truthful answers for all of the questions in the WE task were acquired in a pre-experiment investigation one week prior to the experiment for monitoring purposes during the experiment. The NE task mimics an interview scenario in which the questions are related to working experience in a target field (i.e., oil exploration) where none of the participants had prior experience. A pre-experiment survey was conducted on the spot to ensure that all subjects knew the terms that would be covered during the ‘mock interview’, and the subjects were instructed to pretend to be an experienced job candidate in the instructed lying condition when answering the questions for which they had no experiential knowledge.

The procedure in each block followed the same sequence (see Fig. 1). Each trial was initiated with a fixation period (3 s), after which an auditory stimulus was delivered to the subjects for 2.2–2.7s. After the subjects provided an answer to the questions, a ‘mentalization’ phase lasting for 5 s was added. This was triggered manually in the experiment by attending to the subjects’ verbalizations indicating the completion of an answer. The brain activities during this phase are not within the scope of this paper. After this phase, an auditory judgmental sentence with a varying degree of trust (i.e., believe/don’t believe/suspicious) was delivered to the subject and was simultaneously accompanied by a visual image of an interrogator in order to enhance the subject’s sense of reality in the experimental environment. The judgment was converted to an accumulated score with a deduction of 10 points for a judgment of lying, a deduction of 5 points for a judgment of a suspicious answer, and an addition of 10 points for the judgment of a lie as the truth. All updates were presented at the end of each trial, but the accumulated score was not reported to the subjects until the end of the experiment to avoid direct emotional interference imposed by the current score during the experiment. The ISI (inter-stimulus interval) varied from 3000 ms to 3500 ms; this length was used to avoid emotional effects caused by the procedure of the previous trial [13].

thumbnail
Figure 1. The WE and NE task for both the IL and IT conditions share the same schematic procedures.

(I) fixation phase; (II) attending to the auditory question; (III) answering phase; (IV) mentalization phase; and (V) feedback phase, with differences in the visual images accompanying the auditory feedback for the two tasks to match the specific contexts, i.e. WE/NE.

https://doi.org/10.1371/journal.pone.0116522.g001

2.3 Instruction protocol

The subjects were informed prior to the experiment that they would be given a maximum of $50 once they successfully finished all of the blocks and that the actual reward would be adjusted based on the score achieved. However, if the frequency of the detected lies reached a pre-determined value in the lying block, they would receive only $25. This financial punishment helps to prevent low attention levels and effortless lying by the subjects. The subjects were required to answer as quickly and concisely as possible, but not to compromise the quality of the answer. To further engage the subjects’ attention, they were informed that each answer was judged by an experienced interrogator who did not know if they would tell lie or truth beforehand and monitored the answers in another room by receiving video and audio information from the experiment room. However, the actual judgment was manipulated based on a decision made by the experiment operator in the experiment room who knew the truthful answers and was monitoring the experiment via video and the verbal responses from the subjects. Additionally, the decision strategy for the judgment was integrated with a random effect to produce a 40% to 50% (true positive) chance of detection when the subjects were lying, and the misjudgment of truthful answers as lies was maintained below 20% (false positive). Feedback being used in this experiment is mainly because that the type of lying tasks (instructed lying) we are investigating intrinsically involves incentives and potential risk. Without such feedbacks, subjects’ perception of their ongoing behavior (i.e. lying/telling-truth) and the relevant awareness of being a liar/innocent would be weakened since their action is not associated with any consequence. The numbers picked up for chance of detection and false positive rate mainly serve the purpose to make the interrogator ‘appears’ with reasonably overall accuracy, and therefore helps maintain subject’s realistic feeling with the role of the interrogator and maintain their attention focus on the ongoing task. Despite this specific purpose, these figures are not critical parameters in this study due to the fact that EEG data within only the first 2s during the SDP were analyzed. Furthermore, this detection rule was not informed to the subject. Instead, subjects were informed that each feedback was given based on the information captured (e.g. video and verbal response) during the particular trial. To familiarize the subjects with the experiment procedure, they were provided with a training session with 10 sample questions for each condition, and they were required to repeat the rules to the operator to ensure that they fully understood all of the instructions.

2.4 Data acquisition and pre-processing

EEG signals were collected with an EEProbe recording system (Advanced Neuro Technology (ANT) Enschede, The Netherlands). The EEG cap with 64 Ag/AgCl electrodes was placed on each participant’s scalp according to the 10/10 system of electrode placement. Impedances for over 98% of the electrodes were guaranteed below 20 kOhm for each subject [14]. The sampling frequency was 250 Hz, and the common average served as the recording reference [15]. Presentation software (Neurobehavioral Systems, Inc., Albany, CA) was used to control the timing of the events in each trial. The auditory stimuli were prepared prior to the experiment using Ivona Reader software (IVONA Software, Poland), which transforms text information to standard auditory stimuli that were delivered to the participants through an earphone. To minimize the variation between the stimuli, the speed and intensity of the auditory stimuli were constant for all of the questions. During the experiment, the participants were comfortably seated in a quiet room with a controlled temperature of 25°C. A computer screen was displayed in front of the subject with a fixed viewing distance of 80 cm. A webcam was mounted on the top of the computer screen for online video recording, which enabled the experiment operator to provide a trial-based decision to the trial. This operation could not be detected by the participants. An electromyography (EMG) signal was simultaneously recorded with an electrode that was attached to the subject’s face, and the location was found not to interfere with speaking. This signal was used to determine the onset time of the verbal response. An electrooculography (EOG) signal was simultaneously recorded using two Ag/AgCl electrodes placed on the vertical midline of the right eye above the eyebrow and approximately 1 cm below the lower lid. In the off-line analysis, the EEG signals were band-pass filtered at 1–30 Hz. The EOG and EMG artifacts of the collected EEG data were removed using open-source artifact removal software [16], with the application of independent component analysis (ICA) algorithms, i.e. canonical correlation analysis(CCA) as a blind source separation technique for EMG removal [17] and sobi for EOG removal [18] for each individual trial. Since band pass filtering, EOG and EMG removal were applied simultaneously to de-noise the data, only a few trials still produce noisy data after de-noising (might be caused by subject’s body motion at some trials) and have to be discarded. Thus, a minimum of 22 and a maximum of 25 valid trials were collected for each condition (condition WE-IL: mean: 24.43, variance: 1.06; condition WE-IT: mean: 24.50, variance: 0.80; condition NE-IL: mean:24.44, variance: 0.80; condition NE-IT: mean: 24.50, variance: 0.53), which approximates the starting trial number (i.e. 25) for time-frequency analysis as suggested by [19]. Moreover, this study adopted frequency domain connectivity analysis, with 2s per trial altogether providing 44–50s data length per subject, which should render reasonably accurate estimation with the employed estimator given the fair SNR after the de-noising procedures [20].

2.5 Data analysis

The experimental modulation effects on the inter-regional neural activities were analyzed through frequency domain connectivity analysis [2124]. A network analysis was performed based on the connectivity computation and dendrogram analysis, which enables the identification of common sub-networks underlying various experimental conditions [25]. The dendrogram clustering analysis used average linkage clustering based on correlation distance [26]. Among the various types of connectivity measurements, phase-lagged index (PLI) [27], lagged-phase synchronization (LPS) [28], partial-directed coherence (PDC) [29], and granger causality (GC) [30] are frequently employed. In this study, LPS was applied for connectivity measurements because this method provides zero-lag removal connectivity, which largely mitigates the contamination issue caused by volume conduction that is intrinsically present in EEG recordings either on the scalp or at the source level. Moreover, we were interested in the connectivity changes that were modulated by the experimental effects irrespective of the exact interactive direction. In the connectivity analysis, the absolute and event-related connectivity were calculated for the first 2s time window during the phase of SDP on the cerebral cortex, which is segmented into 84 Brodmann (BA) areas (i.e. 42 BAs each hemisphere) based on the cytoarchitectonics of neurons [31], and the LPS is defined according to Pascual-Marqui RD et al. [28]. Additionally, the clustering coefficient was computed based on the definition according to Chu CJ et al. [32], which generally characterizes the node’s interaction with the rest of the brain. Normalization procedure was performed on connectivity and clustering coefficient measurement with respect to those measured from the baseline window (i.e. the last 2s of the baseline segment) to remove the different baseline effects for different conditions. As such, the connectivity/clustering coefficient derived after normalization is called event-related connectivity/clustering coefficient. Standardized low-resolution brain electromagnetic tomography (sLORETA) [33] was used to compute the connectivity in selected frequency bands (i.e., the upper alpha band) with a source solution space consisting of 6,239 voxels (voxel dimensions 5×5×5 mm) that was restricted to the cortical gray matter and hippocampi as defined according to the MNI atlas [34]. As recommended by sLORETA, single voxel at the ROI centroid was selected for connectivity calculation for two reasons: (1) The calculation of source by sLORETA is based on the assumption that the smoothest of all possible activation distributions is the most plausible one, and this is supported by neuro-physiological data demonstrating that neighbouring neuronal populations present highly correlated activity [35]. Due to this assumption, signals of spatially adjacent voxels of neighbouring ROIs are highly correlated, inducing larger connectivity, which might not be physiological in nature. By taking this single centre voxel of each ROI, such contamination for connectivity estimation could be minimized, since information of the centroid voxel is an accurate representative for activity within the ROIs [36]. (2) If you define a large ROI, then the average sLORETA activity spanning a large volume might not be very meaningful. Therefore, given the low spatial resolution of sLORETA, computation for the centroid voxel was chosen and as a result, the network analysis is not refined but mainly captures the dominant features of connection. The cortical connectivity estimation is then based on the electrical current source time series estimated by sLORETA [36]. In the network analysis, a dendrogram that consisted of mirrored C-shape lines was employed to classify the 84 ROIs into a hierarchical cluster tree according to their proximity. Based on the distance calculation for all of the paired nodes (ROIs), which is defined as ‘1-connectivity’ and is opposite the trend of connectivity, a dendrogram was created that enables the clustering of nodes into a sub-network sharing a similar connection pattern [25] with respect to the remaining brain regions. The dendrogram analysis was performed based on the averaged connectivity matrix across the subjects that provides a group-wise connectivity matrix for each condition [25, 36], and the average procedure is assumed to improve the SNR for the estimation of the connectivity matrix and helps facilitating the identification of the most common and stable network patterns across subjects. Possible concerns regarding the connectivity/functional network analysis are 1) deception is a complicated process which involves multiple known or unknown cognitive/sensory processes, and 2) the analysis window where talking is involved or too significant time variation is involved (i.e. between the offset of stimuli and the onset of the answering) does not provide reliable and consistent EEG signal due to too much EMG artifact. Luckily, the dendrogram analysis was only performed for a narrow window (i.e. the first 2s of stimuli delivery) bearing more or less predictable underlying sub-processes. Finally, behavior data (response time) were extracted based on the filtered EMG signal (band-pass: 1–25 Hz), which was recorded from a separate EMG channel for correlation analysis with network-scale neuronal activities. In this study, multiple comparison permutation tests were widely employed for all the statistical comparisons on the analyzed index between conditions or correlation analysis based on [37] and [38]. The multiple comparison permutation paired test employs a ‘tmax’ method for paired comparisons which adjusts the p-values of each variable for multiple comparisons among all the 84 ROIs (corrected p<0.05). The multiple comparison permutation correlation tests is based on Spearman’s rank correlation coefficient (ρ).When applying the test to multiple variables, the ‘max statistic’ method is used for adjusting the p-values of each variable for multiple comparisons among all the 84 ROIs (corrected p<0.05). Like Bonferroni correction, this method adjusts p-values in a way that controls the family-wise error rate. However, the permutation method will be more powerful than Bonferroni correction when different variables in the test are correlated. Technically, all the multiple comparison corrected t-tests in this study were performed based on open-source Matlab codes [39, 40]. The steps of analysis from input EEG data to output network have been illustrated in Fig. 2.

thumbnail
Figure 2. The descriptive steps of analysis from input EEG raw signal to the output network.

The ‘EEG-signal’ segment dealt with band-pass filtering (1–30Hz) as well as artifact (EOG & EMG) removal of raw EEG data (output ‘clean’ EEG data); the ‘EEG inverse calculation for ROI’ mainly mapped the ‘clean’ EEG into source space on centroid voxel that is most representative of the 84 ROIs to retrieve source time series; the pair-wise connectivity was calculated based on the 84 ROI’s time series into a 84×84 matrix, and then a group-wise connectivity matrix underwent dendrogram analysis that clusters 84 nodes into groups of sources, among which 4 common networks for the IL and IT conditions were identified and mapped onto a generic cortex model.

https://doi.org/10.1371/journal.pone.0116522.g002

Results

3.1 Network analysis

In the functional network analysis, the connectivity between regions was calculated based on the un-normalized LPS index because components of the network during the first 2s time window of SDP is independent of the baseline window. A data-driven dendrogram analysis was performed based on the connectivity matrix which represents all nodes’ connection pattern with the rest of the brain for both the IL and IT conditions in either task. From these components, four groups were qualitatively selected based on the dendrogram and visual inspection and this method has been applied in a previous study [25]; additionally, the sub-networks are required to potentially depict functionally related groups in both the IL and IT conditions.

Interestingly, several sub-networks were identified that were shared by both the IL and IT conditions in both tasks. The dendrogram analysis results are depicted in Fig. 3 and Fig. 4 for the WE and the NE tasks, respectively, where Fig. 3 and Fig. 4 summarize the information of the connectivity matrix for all of the cortical areas in each condition into a dendrogram by clustering nodes that share similar connection patterns into sub-networks. In Fig. 3 and Fig. 4, different colors are used to indicate different types of sub-networks. Corresponding sources for each sub-network are plotted on a cortical brain surface (as shown in Fig. 5 and Fig. 6) with the corresponding color used in Fig. 3 and Fig. 4. The detailed sub-network source anatomical information is described in Table 1 and Table 2 for the WE and the NE tasks, respectively.

thumbnail
Figure 3. The hierarchy structures based on the dendrogram analysis for the WE-IL (A) and the WE-IT (B) conditions, respectively.

The x-axis: leaf number, with each leaf representing a cluster of BAs. The y-axis represents leaf distance calculated using average linkage clustering based on correlation distance. The orange color indicates group A, the blue color indicates group B, the pink color indicates group C, and the green color indicates group D.

https://doi.org/10.1371/journal.pone.0116522.g003

thumbnail
Figure 4. The hierarchy structures based on the dendrogram analysis for the NE-IL (A) and the NE-IT (B) conditions, respectively.

The x-axis: leaf number, with each leaf representing a cluster of BAs. The y-axis represents leaf distance calculated using average linkage clustering based on correlation distance. The orange color indicates group A, the blue color indicates group B, the pink color indicates group C, and the green color indicates group D.

https://doi.org/10.1371/journal.pone.0116522.g004

thumbnail
Figure 5. The four common sub-networks (functional clusters) for the WE-IL and the WE-IT conditions.

(A)-(D) are hypothetical networks for executing higher-order function, comprehension/memory processing, and speech perception, respectively. The dotted circle indicates a medial surface source, while the solid circle indicates a lateral surface source. The label for each anatomical region includes the Brodmann area name and the laterality information.

https://doi.org/10.1371/journal.pone.0116522.g005

thumbnail
Figure 6. The four common sub-networks (functional clusters) for the NE-IL and the NE-IT conditions.

(A)-(D) are hypothetical networks for executing higher-order function, comprehension/memory processing, and speech perception, respectively. The dotted circle indicates a medial surface source, while the solid circle indicates a lateral surface source. The label for each anatomical region includes the Brodmann area name and the laterality information.

https://doi.org/10.1371/journal.pone.0116522.g006

thumbnail
Table 1. Results from the dendrogram analysis for the WE task; four groups of sources were found to be common to the WE-IL and the WE-IT conditions in the upper alpha band.

https://doi.org/10.1371/journal.pone.0116522.t001

thumbnail
Table 2. Results from dendrogram analysis for the NE task; four groups of sources were found to be common to the NE-IL and the NE-IT conditions in the upper alpha band.

https://doi.org/10.1371/journal.pone.0116522.t002

Despite the similarities in sub-network components shared by the two conditions in the WE task, differences were found via further analyses. In Table 3, the inter- and intra-group connectivities were compared between the WE-IL and the WE-IT conditions. The intra-group connectivity/inter-group connectivity was calculated based on the summation of all of the non-repeated paired connectivity values between regions that belonged to the two inspected groups, respectively. During the calculation, two indexes that could potentially represent the inter- and intra-group connectivities were calculated for the first 2s window of the auditory stimuli. The first index, c1, is a normalized connectivity value that indicates the percentage of change for connectivity in the SDP relative to that of the baseline period, i.e., the last two seconds of the ‘fixation’ phase. To some extent, this measurement helps to exclude spurious connection at a statistical level based on how relevant the connection is to the task (i.e. the lower the absolute value, the more irrelevant to the task, and hence less likely to present significant differences between conditions). As a result, the c1 index measures the degree of event related modulation on within- and between- network connectivity by the event (tasks during the SDP window). The other index, c2, is an un-normalized absolute connectivity value for the first 2s during the SDP window. As referenced in Table 2, the intra-group connectivity does not show any significant difference between the IL and the IT conditions, while the inter-group connectivity shows a significant increase in the IL condition relative to the IT condition in multiple group pairs, i.e., group A↔B, group A↔C, group A↔D, group B↔D, and group C↔D by c1 index after multiple comparison permutation tests (corrected p<0.05) for inter- comparisons (four networks’ comparisons) and intra- comparisons (six pairs’ comparisons) separately. In addition, as predicted, c1 is more sensitive than c2 for representation of significant differences in inter-group connectivity between the IL and IT conditions.

thumbnail
Table 3. The difference in the intra- and inter-group connectivity among sub-networks in the upper alpha band between the WE-IL and the WE-IT conditions.

https://doi.org/10.1371/journal.pone.0116522.t003

Correspondingly, in Table 4, the inter- and intra-group connectivities were compared between the NE-IL and the NE-IT conditions with multiple comparison permutation tests (corrected p<0.05) for inter- comparisons (four networks’ comparisons) and intra- comparisons (six pairs’ comparisons) separately. Interestingly, group A showed decreased intra-group connectivity by c2 index, while group C showed increased intra-group connectivity by c1 index. The inter-group connectivity increased in two group pairs, i.e., group A↔D and group B↔C by c1 index.

thumbnail
Table 4. The difference in the intra- and inter-group connectivity among sub-networks in the upper alpha band between the NE-IL and the NE-IT conditions.

https://doi.org/10.1371/journal.pone.0116522.t004

3.2 Connectivity analysis

A connectivity analysis was performed for all possible pairs of 84 Brodmann areas which give rise to a connectivity matrix. Based on which, event-related clustering coefficient was derived for each node that characterizes the node’s interaction with the rest of the brain under modulation by the stimulus. Table 5 and Table 6 show the ROIs whose event-related clustering coefficients significantly increased in the upper alpha band in the WE-IL compared with the WE-IT condition (Table 5) and in the NE-IL compared with the NE-IT condition (Table 6) after multiple comparison permutation test among all the 84 ROIs with corrected p<0.05.

thumbnail
Table 5. Source level clustering coefficients increase in the upper alpha band in the WE-IL relative to the WE-IT condition (after multiple comparison permutation tests with corrected p<0.05).

https://doi.org/10.1371/journal.pone.0116522.t005

thumbnail
Table 6. Source level clustering coefficients increase in the upper alpha band in the NE-IL relative to the NE-IT condition (after multiple comparison permutation tests with corrected p<0.05).

https://doi.org/10.1371/journal.pone.0116522.t006

3.3 Response time (correlation) analysis

Because the response time of the subject’s answer to each question is closely related to the overall processing time spent by all of the involved sub-networks and the key processing nodes in the brain, it can be hypothesized that there may be a quantitative relationship (i.e., linear/non-linear) between the response time and the activity of the sub-networks or key nodes that contributed dominantly to the variation in processing time. To study this possible relationship, a correlation analysis was performed between the response time and the clustering coefficient of each cortical area which characterizes the node’s interaction with the rest of the brain (Fig. 7). The rationale for this is two-fold: i) correlation is a method to study linear relation, while nonlinear relation is more sophisticated and less easily clarified, and ii) as mentioned earlier, all nodes in a specific sub-network share a similar connection pattern with the rest of the brain. Therefore, each node can to some degree be representative of its affiliated sub-network’s connection pattern. Although the second consideration has not excluded the correlated behavior of all of the nodes affiliated with the same sub-network, it is sufficient to help identify the potential correlation between response time and the underlying sub-network activity. However, the second consideration is not an issue for the key processing node, which may not be affiliated with a specific network.

thumbnail
Figure 7. Several regions’ normalized event-related clustering coefficients were found positively correlated with the normalized response time in different conditions.

The event-related clustering coefficient (normalized) of the inferior frontal gyrus (a) was found to be positively correlated with the response time (normalized) in the WE-IL condition (corrected p<0.05). The event-related clustering coefficients of the angular gyrus (b) and precuneus (c) were found to be positively correlated with the response time (normalized) in the WE-IT condition (corrected p<0.05). The event-related clustering coefficient (normalized) of the secondary auditory cortex (42L) (d) was found to be marginally negatively correlated with the response time (normalized) in the NE-IL condition (corrected p = 0.058). The event-related clustering coefficient of the somatosensory association cortex (L, R) (e, f) was found to be negatively correlated with the response time (normalized) in the NE-IT condition (corrected p<0.05). All the significance reports are based on multiple comparison permutation correlation test with corrected p<0.05.

https://doi.org/10.1371/journal.pone.0116522.g007

A correlation analysis was performed via linear regression analysis, which tests the significance of the positive/negative correlation and produces a linear correlation coefficient. Two types of data set were used in the linear regression analysis, i.e., the normalized average response time for each subject in each condition and the normalized average clustering coefficient for each subject in each condition. Averaging was performed across the trials in each condition for the response time and the clustering coefficient to minimize the noise level for the correlation analysis. Normalization was performed for the averaged response time and the event-related clustering coefficient to fall in [0,1] which makes the linear correlation coefficients fall between 0 and 1 as a standard range. As referenced in the results (Fig. 7), several regions were found to be positively/negatively correlated with the normalized response time. Specifically, the normalized event-related clustering coefficient for the inferior frontal gyrus (44R) was found positively correlated with the normalized response time in the WE-IL condition (p<0.05, with multiple comparison correction [38]), and the normalized event-related clustering coefficient of the angular gyrus (39R) and precuneus (7L) was found to be correlated with the normalized response time in the WE-IT condition (p<0.05, with multiple comparison correction [38]). However, the normalized event-related clustering coefficient of the secondary auditory cortex (42L) was found to be marginally negatively correlated with the normalized response time in the NE-IL condition (p = 0.058), while that of the somatosensory association cortex (5L, R) was found to be negatively correlated with the normalized response time in the NE-IT condition (p<0.05, with multiple comparison correction [38]).

Discussion

4.1 Network analysis

The results of the network analysis are presented in Figs. 36 and Tables 14. It should be noted that the identified sub-networks may be part of a larger hierarchical network. However, because the focus is to identify the common networks shared among the IL and the IT conditions during the SDP, our discussion may not cover the complete network involved in each condition. Due to the limited length of window analyzed, i.e. the first 2s during SDP, in general, it is most likely that the neuropsychological processes involved are confined to those related with auditory stimulus perception, comprehension of the question, memory recall based on the question being asked, and overall executive control over multiple simultaneous processes. It is no doubt that auditory stimulus perception is a sentinel and must-have component throughout the whole time window. Upon which, comprehension is established through interaction of processing on the perceptual input and retrieval of stored memories, i.e. declarative memory and episodic memory. As such, higher-order executive control unit must be recruited in order to monitor the ongoing processes by integration of input information and navigating the response (i.e. deceptive/truthful) to the question. Most importantly, these are the networks shared by both the IL and the IT conditions. Although the analyzed window has not covered the deception window directly, this analysis provides a unique perspective from stimulus delivery phase during which there may exist commonalities and differences between conditions as potential features. This narrow window chosen for network analysis bearing more or less predictable underlying sub-processes may potentially initiate an exciting research direction seeking for systematic level of understanding beyond the component-based perspective (i.e. inhibition control, saliency detection, risk monitoring) to complement the deception insights.

Among the sub-networks identified for the WE task (Fig. 3, 5; Tables 1, 3), it can be postulated that group A may serve as a higher-order executive control network as inferred from the network’s neuro-anatomy. Due to the fact that dorsolateral prefrontal cortex (DLPFC), anterior prefrontal cortex (APFC), orbitofrontal area and entorhinal areas are undisputed cortical regions with higher-order functions [41, 42], it is most likely they synergistically contribute to manage and support other simultaneous cognitive and sensory functions during the time window analyzed. Dorsolateral prefrontal cortex (DLPFC) has been implicated in many higher-order functions, including holding spatial information ‘on-line’, response selection, verification and evaluation of representations that have been retrieved from long-term memory, monitoring and manipulation with working memory [41]. In addition, Anterior prefrontal cortex (APFC) has been engaged with a unified role in coordination of information processing and information transfer between multiple operations across supramodal cortex when problems involve more than one discrete cognitive process [41]. Orbitofrontal area has been implicated in processes that involve motivational/emotional value of incoming information [43], the representation of learnt relationships between arbitrary stimuli and reward/punishment, and integration of these information to guide response, decision making [41]. Entorhinal area has been considered as a hub functioning in a widespread network for memory and navigation [44]. This cortex, in conjunction with the hippocampal formation, appears to specifically deal with the translation of neocortical exteroceptive information into higher order complex representations that, when combined with motivational and interoceptive representations, serves cognitive functions, in particular conscious memory and relational organization of memory [45]. Compared with the above regions, subgenual cingulated has less higher order role but has been demonstrated to play an integral role in both normal and pathological shifts in mood [46] and processing of positively or negatively valenced stimuli [47]. As such, it can be seen that most of the above regions are well postulated to underlie a network executing ‘higher-order’ functions that support and manage multiple simultaneous processes during the task.

Given the neuro-anatomy of group B, it can be inferred that this group may contribute to multi-modal contextual association and object recognition in support of comprehension and memory processing. The neuro-anatomy seems to infer the involvement of the ventral stream pathway. This processing pathway usually begins purely with visual information in the primary visual cortex (occipital lobe), and then this information is transferred to the temporal lobe. This pathway is mainly involved in object recognition (i.e. the ‘what’ pathway), and is connected to the medial temporal lobe (which is involved in the storage of long-term memories) [48]. Although no visual stimulus has been used in the experiment, visual cortex can be activated by visual imagery of the objects contained in the stimulus [49] considering the fact that most of the stimulus tend to induce declarative and episodic memory with requirement to recall specific objects. Not surprisingly, temporal regions such as rostral parahippocampal gyrus and perirhinal cortex (PC) involve in this network. Previous studies have shown perirhinal cortex plays an important role in recognition memory by facilitating the recognition and identification of the stimuli through stimulus-stimulus (i.e., word-object) associations [50]. Rostral parahippocampal gyrus as a portion of parahippocampal gyrus, located at the medial temporal lobe, is a key structure in declarative and episodic memory processing [51, 52]. Recently, a broad synthesis of literature has unified the various functions of this area by the theory of ‘contextual association’, i.e. to define, represent items by bringing meaning to the environment and establish links between these contextual items [51]. The granular retrosplenial cortex and agranular retrolimbic area have also been linked with cross-modal object recognition by observing rats with lesions in these regions performing cross-modal object recognition task [53], hence suggesting their role in mediating the integration of information across multiple cue types.

Similar to group B, group C is inferred to be participating as a portion of network to support the comprehension and memory-processing processes. It has been suggested in previous studies that the anterior medial parietal/posterior cingulate cortex is concerned with linking information with prior knowledge [54], and has repeatedly been associated with episodic memory retrieval [55]. Previous studies have found that precuneus is involved in a wide spectrum of highly integrated tasks, including visuo-spatial imagery, episodic memory retrieval and self-processing operations, namely first-person perspective taking and an experience of agency [56]. Studies have also shown that occipitotemporal area plays an important role in constructing scenes from objects by supporting recognition of real-world visual scenes through parallel analysis of within-scene objects [57]. Moreover, the angular gyrus has been considered as a cross-modal hub where converging multisensory information is combined and integrated to comprehend and give sense to events, manipulate mental representations, and reorient attention to relevant information [58]. It can be inferred further that these above regions play a central role to facilitate recognition of real-world visual scenes/events and give sense to these scenes/events through a first-person perspective. Compared with group C, group B seems to be more associated with function in establishing contextual association (i.e. word-object) and object recognition, and both contribute as part of a network that support comprehension and memory processing. Nevertheless, group B seems to be associated more with ventral stream pathway, and group C is more associated with dorsal stream pathway.

Different from the former three groups, group D involves mostly perception related regions, and it is most likely a network contributing to auditory and language processing. Auditory cortex is a classic highly organized region that perceives sound, and this cortex area is the neural crux of hearing for humans in language and music [59]. Superior temporal gyrus has been associated with various functions, among which, the most likely function in this experiment is the auditory processing as a key sensory structure contributing to comprehension of language [60, 61]. The superior temporal gyrus known as Wernicke’s area is one of the human speech areas involved in the understanding of written and spoken language [62]. The Wernicke’s area in the non-dominant hemisphere is involved in processing and resolution of subordinate meanings of ambiguous words, while the counterpart in the dominant hemisphere is associated with processing dominant word meanings. In addition, previous fMRI study has found subcentral area’s involvement in semantic processing, and it is activated when participants are asked to complete tasks which involved the selection of a verbal response from many possible responses [63]. As an intrinsic and implicit requirement of our experiment, when subjects listen to the questions, their brains are engaged in looking for possible verbal response simultaneously. Involvement of the somatosensory system in the perceptual processing in speech is not clearly known until recent studies have shown that somatosensory input has modulation effect on speech perception [64, 65]. Similarly, involvement of motor areas such as primary motor cortex and premotor cortex in speech perception can be linked to the concept that perception and production are mediated by common mechanisms originates in the motor theory of speech [66, 67], evidence to date for the link between perception and production comes from demonstrations of cortical motor activation in conjunction with speech perception [6870], and is related to articulating speaker’s gesture [70] or mapping articulatory features of speech sounds [71]. According to the neuro-anatomy for language/speech perception, part of parietal region is also involved. Specifically, supramarginal gyrus is thought to be probably involved with language perception and processing (e.g. in phonemic perception and the processing of speech sounds), since lesions in it may cause receptive aphasia [72, 73]. Primary somatosensory cortex and ventral anterior cingulated area are not typical regions associated with semantic processing; however, ventral anterior cingulated area has been related to self-referential processing of negative stimuli in semantic processing [74] and primary somatosensory cortex (postcentral gyrus) is involved in attentional and linguistic interactions in speech perception [75].

Although there is no nominal reference to a specific source and its definitive network category or vice versa, the data-driven functional network results obtained in this study are reasonably justifiable. It is not surprising that the sub-networks identified are neuro-psychological processes that appear to be necessarily involved during the analyzed window. Therefore, the top-down perspective of network analysis appears to match well with the data-driven networks.

In within- and between- network analysis, the results from Table 3 show that p1 has a greater significant difference compared with p2 while nearly maintaining the same trend of p2, which means that a normalized connectivity is potentially more sensitive than an un-normalized connectivity in distinguishing the two conditions in the WE task. An increased trend for inter-group connectivities was found for groups A; this increase is marginally significant (p<0.1) and could be interpreted as increased communicative activity within the higher-order executive control group that was induced by the cognitive load of deception. Significant increases were found among several pairs of groups in inter-group connectivity; connections significantly increased between i) group A↔group B, ii) group A↔group C, iii) group A↔group D, iv) group B↔group D and v) group C↔group D. As inferred on each network’s most likely functional role, group A as a higher-order executive area represents an extensive increased communicative activity with the parallel memory processing, comprehension, speech perception processes. This further implies the higher-order role of group A in the IL condition, and that the IL condition in the WE task potentially induces enhanced executive control activities, even during the stimulus delivery phase. Furthermore, increased connectivities between B and D, C and D imply that speech perception more closely interacts with comprehension and memory processing to facilitate the deception process.

A functional network analysis was also applied for the NE-IL and NE-IT conditions. The results are shown in Fig. 4, 6 and Table 2, 4. Again, four groups were identified as sub-networks. Interestingly, these functional networks are the exact sub-networks that were identified for the WE task with minor variation in the network component. As shown in Table 4, a significant decrease of intra-network connectivity has been observed based on the p2 index for group A in the NE-IL condition relative to the NE-IT condition. This is most likely because this group’s higher-order function could be less efficiently executed when the subjects had no prior experience related to the questions. But since this index is not normalized, this result is still arguable. In contrast, intra-network connectivity increased in group C for the p1 index possibly due to the increased load in comprehension and memory-recall of questions non-experienced by the subjects. However, significant increases in the inter-group connectivity based on the p1 index have been observed i) between group A↔group D and ii) group B↔group C. This means the interaction within network possibly responsible for memory processing and relevant comprehension processes increased, since group B and C both partially contribute as sub-network. In addition, connectivity between networks possibly related to executive control and speech perception increased, which implies speech perception for unfamiliar items may need increased cognitive input from executive network in order to make sure the auditory information can be stored well in short-term memory for accurate comprehension.

In summary, the application of dendrogram analysis enables us to identify the most likely fundamental common processing units shared by the WE and NE tasks. It can be observed that the formation of all of the groups in the NE task are very similar to the corresponding groups in the WE task, indicating the potential role of these sub-networks as fundamental building blocks for the instructed lying/truth-telling tasks that involve the processing of auditory questions; the robustness of this result has been cross-validated by the two tasks. However, this result does not exclude the possibility for additional sub-networks to participate in each of these tasks due to the fact that only the first 2s during the SDP window was analyzed. The network derivation has not yet been cross-validated in other studies; thus, it is important to re-affirm the interpretation of the functional role of these sub-networks via cross-validation with fMRI studies in the future.

4.2 Connectivity analysis

In a further analysis as shown in Table 5, multiple memory processing regions were found with an increased overall clustering coefficient in the IL with respect to the IT condition. Because the clustering coefficient summarizes a particular ROI node’s overall connection strength to the remaining regions, an increased clustering coefficient for these ‘heat nodes’ further corroborates the dominant role of higher-order processing in the WE deception task. The corresponding result for the NE task is shown in Table 6, significantly increased clustering coefficients were found for several higher-order execution areas, memory processing/comprehension areas and speech perception areas. This increase in higher-order execution areas does not violate the observed decreased intra-network connectivity in the corresponding network. Different from inter-group connectivity; the clustering coefficient for a node is a more general evaluation of connectivity with respect to the rest of the brain. The trend between them does not necessarily correlate. Among all nodes, the visual cortex (19L), perirhinal area (35L) and entorhinal cortex (34L) are common heat nodes with increased clustering coefficients for both tasks (WE vs. NE). This finding implies that deception involves memory processing unit with higher-order level of activities and this is likely to be a universal rule for various types of instructed lying.

4.3 Response time (correlation) analysis

Interestingly, the normalized event-related clustering coefficient for the inferior frontal gyrus (44R, Broca’s area) is positively correlated with the normalized response time in the WE-IL condition; this implies an increased amount of effort in executive control (as required in the IL condition), which leads to a delayed response time. Recent neuroimaging studies show BA44’s involvement in selective response suppression in a go/no-go task; BA44 is therefore believed to play an important role in the suppression of response tendency [76]. The normalized event-related clustering coefficients for precuneus (7L) and angular gyrus (39R), which are associated with comprehension/memory-processing in this study, show positive correlations with the normalized response time in the IT condition, indicating that comprehension/memory-processing could be processes that primarily contribute to the response time in this condition. However, a reverse trend of correlation was found for the NE task. The normalized event-related clustering coefficient of the secondary auditory cortex (42L) was found to be marginally negatively correlated with the response time in the NE-IL condition. Additionally, the normalized event-related clustering coefficients of the somatosensory association cortex (5L, 5R) were found to be negatively correlated with the response time in the NE-IT condition. It is known that both the secondary auditory cortex (42L) and the somatosensory association cortex (5L, 5R) are involved in sensory-level speech perception. For both regions, increased clustering coefficients in the IL condition imply their role in facilitating the semantic processing of stimuli. This largely explains the variation of response times between the NE-IL and the NE-IT conditions. The dominancy by speech perception in both conditions may be due to the subjects’ not having experiential knowledge of the stimuli, which requires them to spend even more time on speech perception. This also implies that well-designed probe stimuli (i.e., questions) play an important role in inducing neuronal features regarding the semantic processing during the lying task.

Conclusion

The results of this study have provided intuitive evidence for distinguishable features of instructed lying with respect to instructed truth-telling conditions in network scale from EEG signals analysis in both the WE and the NE tasks during the stimulus delivery phase (SDP). The data analyzed with connectivity analysis/network analysis in the source space indicated contrastive network connection and nodal clustering coefficient patterns between the IL and IT conditions. Importantly, this study identified several fundamental processing units during the SDP that are common to all of the conditions. However, the involvement of these networks should be thoroughly investigated in the future with more instructed lying/truth-telling tasks and imaging modalities. As predicted, the major differences between the IL and IT conditions exist within the intra- and inter- group connectivity patterns. In addition, response time has been correlated with several key nodes’ clustering coefficients. As such, this study has provided a systematic level of understanding of the neural mechanisms underlying the IL and IT tasks based on a unique time window (SDP) with network analysis, and the results may be of great importance for future lie detection related researches and applications.

Supporting Information

S1 Table. Example questions for the instructed lying and truth-telling conditions in the WE task.

https://doi.org/10.1371/journal.pone.0116522.s001

(DOCX)

S2 Table. Example questions for the instructed lying and truth-telling conditions in the NE task.

https://doi.org/10.1371/journal.pone.0116522.s002

(DOCX)

Author Contributions

Conceived and designed the experiments: YW WN XL. Performed the experiments: YW KN XL. Analyzed the data: YW. Contributed reagents/materials/analysis tools: YW. Wrote the paper: YW KN WN KY TW

References

  1. 1. Council NR (2003) The polygraph and lie detection: The National Academies Press.
  2. 2. Ganis G, Kosslyn SM, Stose S, Thompson WL, Yurgelun-Todd DA (2003) Neural correlates of different types of deception: an fMRI investigation. Cerebral Cortex 13: 830–836. pmid:12853369
  3. 3. Abe N, Suzuki M, Tsukiura T, Mori E, Yamaguchi K, et al. (2006) Dissociable roles of prefrontal and anterior cingulate cortices in deception. Cerebral Cortex 16: 192–199. pmid:15858160
  4. 4. Greene JD, Paxton JM (2009) Patterns of neural activity associated with honest and dishonest moral decisions. Proceedings of the National Academy of Sciences 106: 12506–12511. pmid:19622733
  5. 5. Langleben DD, Schroeder L, Maldjian JA, Gur RC, McDonald S, et al. (2002) Brain activity during simulated deception: an Event-Related Functional Magnetic Resonance study. NeuroImage 15: 727–732. pmid:11848716
  6. 6. Seth AK, Iversen JR, Edelman GM (2006) Single-trial discrimination of truthful from deceptive responses during a game of financial risk using alpha-band MEG signals. Neuroimage 32: 465–476. pmid:16678444
  7. 7. Kim S, Jung KH, Lee JH (2012) Characteristics of alpha power event-related desynchronization in the discrimination of spontaneous deceptive responses. Int J Psychophysiol 85: 230–235. pmid:22554580
  8. 8. Abootalebi V, Moradi MH, Khalilzadeh MA (2009) A new approach for EEG feature extraction in P300-based lie detection. Computer Methods and Programs in Biomedicine 94: 48–57. pmid:19041154
  9. 9. Carmel D, Dayan E, Naveh A, Raveh O, Ben-Shakhar G (2003) Estimating the validity of the guilty knowledge test from simulated experiments: the external validity of mock crime studies. J Exp Psychol Appl 9: 261–269. pmid:14664677
  10. 10. Farwell LA, Richardson DC, Richardson GM (2013) Brain fingerprinting field studies comparing P300-MERMER and P300 brainwave responses in the detection of concealed information. Cognitive Neurodynamics 7: 37. pmid:23869200
  11. 11. Wang Y, Ng WC, Ng KS, Wu T, Li X (2013) An EEG source localization and connectivity study on deception of autobiography memories. Neural Engineering (NER), 2013 6th International IEEE/EMBS Conference on. pp. 468–471.
  12. 12. Ganis G, Morris RR, Kosslyn SM (2009) Neural processes underlying self- and other-related lies: an individual difference approach using fMRI. Soc Neurosci 4: 539–553. pmid:18925536
  13. 13. Asma L (2008) Emotional pain modulation: an effect of emotion, attention or empathy for pain. Psychology M.Sc. Thesis, University of twente. Available: http://purl.utwente.nl/essays/58873. Accessed 2013 October 6.
  14. 14. Brodbeck V, Spinelli L, Lascano AM, Wissmeier M, Vargas M-I, et al. (2011) Electroencephalographic source imaging: a prospective study of 152 operated epileptic patients. Brain 134: 2887–2897. pmid:21975586
  15. 15. Ludwig KA, Miriani RM, Langhals NB, Joseph MD, Anderson DJ, et al. (2009) Using a common average reference to improve cortical neuron recordings from microelectrode arrays. J Neurophysiol 101: 1679–1689. pmid:19109453
  16. 16. German G-H, (2008) Automatic Artifact Removal (AAR) toolbox for MATLAB. Available: http://www.germangh.com/eeglab_plugin_aar/index.html. Accessed 2014 May 2.
  17. 17. De Clercq W, Vergult A, Vanrumste B, Van Hees J, Palmini A, et al. (2005) A new muscle artifact removal technique to improve the interpretation of the ictal scalp electroencephalogram. Conf Proc IEEE Eng Med Biol Soc 1: 944–947. pmid:17282340
  18. 18. Gomez-Herrero G, De Clercq W, Anwar H, Kara O, Egiazarian K, et al. (2006) Automatic removal of ocular artifacts in the EEG without an EOG reference channel. Signal Processing Symposium, 2006 NORSIG 2006 Proceedings of the 7th Nordic. pp. 130–133.
  19. 19. Thakor NV, Tong S (2009) Quantitative EEG analysis methods and clinical applications: Artech House.
  20. 20. Astolfi L, Cincotti F, Mattia D, Marciani MG, Baccala LA, et al. (2007) Comparison of different cortical connectivity estimators for high-resolution EEG recordings. Hum Brain Mapp 28: 143–157. pmid:16761264
  21. 21. Dressler O, Schneider G, Stockmanns G, Kochs EF (2004) Awareness and the EEG power spectrum: analysis of frequencies. Br J Anaesth 93: 806–809. pmid:15377585
  22. 22. Campbell IG (2009) EEG recording and analysis for sleep research. Curr Protoc Neurosci Chapter 10: Unit10 12. https://doi.org/10.1002/0471142301.ns1002s49 pmid:19802813
  23. 23. Canuet L, Ishii R, Pascual-Marqui RD, Iwase M, Kurimoto R, et al. (2011) Resting-state EEG source localization and functional connectivity in schizophrenia-like psychosis of epilepsy. PLoS ONE 6: e27863. pmid:22125634
  24. 24. Shafi MM, Brandon Westover M, Oberman L, Cash SS, Pascual-Leone A (2014) Modulation of EEG functional connectivity networks in subjects undergoing repetitive transcranial magnetic stimulation. Brain Topogr 27: 172–191. pmid:23471637
  25. 25. Chen JL, Ros T, Gruzelier JH (2013) Dynamic changes of ICA-derived EEG functional connectivity in the resting state. Hum Brain Mapp 34: 852–868. pmid:22344782
  26. 26. Kumar V, Chhabra J, Kumar D (2014) Impact of distance measures on the performance of clustering algorithms. In: Mohapatra DP, Patnaik S, editors. Intelligent Computing, Networking, and Informatics: Springer India. pp. 183–190. https://doi.org/10.1007/978-81-322-1665-0_17
  27. 27. Stam CJ, Nolte G, Daffertshofer A (2007) Phase lag index: assessment of functional connectivity from multi channel EEG and MEG with diminished bias from common sources. Hum Brain Mapp 28: 1178–1193. pmid:17266107
  28. 28. Pascual-Marqui RD (2007) Instantaneous and lagged measurements of linear and nonlinear dependence between groups of multivariate time series: frequency decomposition. Available: http://arxiv.org/abs/0711.1455. Accessed 2014 May 20.
  29. 29. Baccala LA, Sameshima K (2001) Partial directed coherence: a new concept in neural structure determination. Biol Cybern 84: 463–474. pmid:11417058
  30. 30. Barrett AB, Murphy M, Bruno M-A, Noirhomme Q, Boly M, et al. (2012) Granger causality analysis of steady-state electroencephalographic signals during propofol-induced anaesthesia. PLoS ONE 7: e29072. pmid:22242156
  31. 31. Brodmann K (2006) Brodmann’s localisation in the cerebral cortex: New York: Springer.
  32. 32. Chu CJ, Kramer MA, Pathmanathan J, Bianchi MT, Westover MB, et al. (2012) Emergence of stable functional networks in long-term human electroencephalography. The Journal of Neuroscience 32: 2703–2713. pmid:22357854
  33. 33. Pascual-Marqui RD (2002) Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. Methods Find Exp Clin Pharmacol 24 Suppl D: 5–12. pmid:12575463
  34. 34. Mazziotta J, Toga A, Evans A, Fox P, Lancaster J, et al. (2001) A probabilistic atlas and reference system for the human brain: International Consortium for Brain Mapping (ICBM). Philos Trans R Soc Lond B Biol Sci 356: 1293–1322. pmid:11545704
  35. 35. Michel CM, Koenig T, Brandeis D, Gianotti LRR, Wackermann J (2009) Electrical neuroimaging: Cambridge University Press. https://doi.org/10.1017/CBO9780511596889
  36. 36. Jancke L, Langer N (2011) A strong parietal hub in the small-world network of coloured-hearing synaesthetes during resting state EEG. J Neuropsychol 5: 178–202. pmid:21923785
  37. 37. Blair RC, Karniski W (1993) An alternative method for significance testing of waveform difference potentials. Psychophysiology 30: 518–524. pmid:8416078
  38. 38. Groppe DM, Urbach TP, Kutas M (2011) Mass univariate analysis of event-related brain potentials/fields I: A critical tutorial review. Psychophysiology 48: 1711–1725. pmid:21895683
  39. 39. Groppe DM (2010) One sample/paired samples permutation t-test with correction for multiple comparisons. Available: http://www.mathworks.com/matlabcentral/fileexchange/29782-one-sample-paired-samples-permutation-t-test-with-correction-for-multiple-comparisons/content/mult_comp_perm_t1.m. Accessed 2013 October 15.
  40. 40. Groppe DM (2012) Correlation permutation test with correction for multiple comparisons. Available: http://www.mathworks.com/matlabcentral/fileexchange/34920-correlation-permutation-test-with-correction-for-multiple-comparisons/content/mult_comp_perm_corr.m. Accessed 2013 October 20.
  41. 41. Ramnani N, Owen AM (2004) Anterior prefrontal cortex: insights into function from anatomy and neuroimaging. Nat Rev Neurosci 5: 184–194. pmid:14976518
  42. 42. Canto CB, Wouterlood FG, Witter MP (2008) What does the anatomical organization of the entorhinal cortex tell us? Neural Plasticity 2008: 381243. pmid:18769556
  43. 43. Schutter DJ, van Honk J (2006) Increased positive emotional memory after repetitive transcranial magnetic stimulation over the orbitofrontal cortex. J Psychiatry Neurosci 31: 101–104. pmid:16575425
  44. 44. Hafting T, Fyhn M, Molden S, Moser M-B, Moser EI (2005) Microstructure of a spatial map in the entorhinal cortex. Nature 436: 801–806. pmid:15965463
  45. 45. Eichenbaum H, Yonelinas AP, Ranganath C (2007) The medial temporal lobe and recognition memory. Annu Rev Neurosci 30: 123–152. pmid:17417939
  46. 46. Gotlib IH, Sivers H, Gabrieli JD, Whitfield-Gabrieli S, Goldin P, et al. (2005) Subgenual anterior cingulate activation to valenced emotional stimuli in major depression. Neuroreport 16: 1731–1734. pmid:16237317
  47. 47. Hamilton JP, Glover GH, Hsu JJ, Johnson RF, Gotlib IH (2011) Modulation of subgenual anterior cingulate cortex activity with real-time neurofeedback. Hum Brain Mapp 32: 22–31. pmid:21157877
  48. 48. Hebart MN, Hesselmann G (2012) What visual information is processed in the human dorsal stream? The Journal of Neuroscience 32: 8107–8109. pmid:22699890
  49. 49. Bridge H, Harrold S, Holmes EA, Stokes M, Kennard C (2012) Vivid visual mental imagery in the absence of the primary visual cortex. J Neurol 259: 1062–1070. pmid:22064977
  50. 50. Murray EA, Bussey TJ, Saksida LM (2007) Visual perception and memory: a new view of medial temporal lobe function in primates and rodents. Annu Rev Neurosci 30: 99–122. pmid:17417938
  51. 51. Aminoff EM, Kveraga K, Bar M (2013) The role of the parahippocampal cortex in cognition. Trends Cogn Sci 17: 379–390. pmid:23850264
  52. 52. Blaizot X, Martinez-Marcos A, Arroyo-Jimenez Md Mdel M, Marcos P, Artacho-Perula E, et al. (2004) The parahippocampal gyrus in the baboon: anatomical, cytoarchitectonic and magnetic resonance imaging (MRI) studies. Cereb Cortex 14: 231–246. pmid:14754864
  53. 53. Hindley EL, Nelson AJD, Aggleton JP, Vann SD (2014) Dysgranular retrosplenial cortex lesions in rats disrupt cross-modal object recognition. Learning & Memory 21: 171–179. pmid:24554671
  54. 54. Lou HC, Luber B, Crupain M, Keenan JP, Nowak M, et al. (2004) Parietal cortex and representation of the mental Self. Proceedings of the National Academy of Sciences of the United States of America 101: 6827–6832. pmid:15096584
  55. 55. Cabeza R, Nyberg L (2000) Imaging cognition II: An empirical review of 275 PET and fMRI studies. J Cogn Neurosci 12: 1–47. pmid:10769304
  56. 56. Cavanna AE, Trimble MR (2006) The precuneus: a review of its functional anatomy and behavioural correlates. Brain 129: 564–583. pmid:16399806
  57. 57. MacEvoy SP, Epstein RA (2011) Constructing scenes from objects in human occipitotemporal cortex. Nat Neurosci 14: 1323–1329. pmid:21892156
  58. 58. Seghier ML (2013) The angular gyrus: multiple functions and multiple subdivisions. Neuroscientist 19: 43–61. pmid:22547530
  59. 59. Purves D, Augustine GJ, Fitzpatrick D, Katz LC, LaMantia A-S, et al. (2001) Neuroscience. Sunderland (MA): Sinauer Associates. https://doi.org/10.4249/scholarpedia.7204
  60. 60. Leff AP, Schofield TM, Crinion JT, Seghier ML, Grogan A, et al. (2009) The left superior temporal gyrus is a shared substrate for auditory short-term memory and speech comprehension: evidence from 210 patients with stroke. Brain 132: 3401–3410. pmid:19892765
  61. 61. Friederici AD, Rüschemeyer S-A, Hahne A, Fiebach CJ (2003) The role of left inferior frontal and superior temporal cortex in sentence comprehension: localizing syntactic and semantic processes. Cerebral Cortex 13: 170–177. pmid:12507948
  62. 62. Wise RJ, Scott SK, Blank SC, Mummery CJ, Murphy K, et al. (2001) Separate neural subsystems within ‘Wernicke’s area’. Brain 124: 83–95. pmid:11133789
  63. 63. Gabrieli JD, Poldrack RA, Desmond JE (1998) The role of left prefrontal cortex in language and memory. Proc Natl Acad Sci U S A 95: 906–913. pmid:9448258
  64. 64. Ito T, Tiede M, Ostry DJ (2009) Somatosensory function in speech perception. Proceedings of the National Academy of Sciences 106: 1245–1248. pmid:19164569
  65. 65. Champoux F, Shiller DM, Zatorre RJ (2011) Feel what you say: an auditory effect on somatosensory perception. PLoS ONE 6: e22829. pmid:21857955
  66. 66. Liberman AM, Mattingly IG (1985) The motor theory of speech perception revised. Cognition 21: 1–36. pmid:4075760
  67. 67. Liberman AM, Cooper FS, Shankweiler DP, Studdert-Kennedy M (1967) Perception of the speech code. Psychol Rev 74: 431–461. pmid:4170865
  68. 68. Fadiga L, Craighero L, Buccino G, Rizzolatti G (2002) Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur J Neurosci 15: 399–402. pmid:11849307
  69. 69. Watkins KE, Strafella AP, Paus T (2003) Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 41: 989–994. pmid:12667534
  70. 70. Meister IG, Wilson SM, Deblieck C, Wu AD, Iacoboni M (2007) The essential role of premotor cortex in speech perception. Curr Biol 17: 1692–1696. pmid:17900904
  71. 71. Friedemann P, Martina H, Ferath K, Fermin MdPM, Olaf H, et al. (2006) Motor cortex maps articulatory features of speech sounds. Proceedings of the National Academy of Sciences 103: 7865–7870. pmid:16682637
  72. 72. Michael SG, Richard BI, George RM (2009) Cognitive neuroscience the biology of the mind. third edition ed: Norton W.W.. pp. 395–401.
  73. 73. Dehaene-Lambertz G, Pallier C, Serniclaes W, Sprenger-Charolles L, Jobert A, et al. (2005) Neural correlates of switching from auditory to speech perception. Neuroimage 24: 21–33. pmid:15588593
  74. 74. Yoshimura S, Ueda K, Suzuki S, Onoda K, Okamoto Y, et al. (2009) Self-referential processing of negative stimuli within the ventral anterior cingulate gyrus and right amygdala. Brain Cogn 69: 218–225. pmid:18723260
  75. 75. Sabri M, Binder JR, Desai R, Medler DA, Leitl MD, et al. (2008) Attentional and linguistic interactions in speech perception. Neuroimage 39: 1444–1456. pmid:17996463
  76. 76. Forstmann BU, van den Wildenberg WP, Ridderinkhof KR (2008) Neural mechanisms, temporal dynamics, and individual differences in interference control. J Cogn Neurosci 20: 1854–1865. pmid:18370596