Recent research with face-to-face groups found that a measure of general group effectiveness (called “collective intelligence”) predicted a group’s performance on a wide range of different tasks. The same research also found that collective intelligence was correlated with the individual group members’ ability to reason about the mental states of others (an ability called “Theory of Mind” or “ToM”). Since ToM was measured in this work by a test that requires participants to “read” the mental states of others from looking at their eyes (the “Reading the Mind in the Eyes” test), it is uncertain whether the same results would emerge in online groups where these visual cues are not available. Here we find that: (1) a collective intelligence factor characterizes group performance approximately as well for online groups as for face-to-face groups; and (2) surprisingly, the ToM measure is equally predictive of collective intelligence in both face-to-face and online groups, even though the online groups communicate only via text and never see each other at all. This provides strong evidence that ToM abilities are just as important to group performance in online environments with limited nonverbal cues as they are face-to-face. It also suggests that the Reading the Mind in the Eyes test measures a deeper, domain-independent aspect of social reasoning, not merely the ability to recognize facial expressions of mental states.
Citation: Engel D, Woolley AW, Jing LX, Chabris CF, Malone TW (2014) Reading the Mind in the Eyes or Reading between the Lines? Theory of Mind Predicts Collective Intelligence Equally Well Online and Face-To-Face. PLoS ONE 9(12): e115212. doi:10.1371/journal.pone.0115212
Editor: Marina A. Pavlova, University of Tuebingen Medical School, Germany
Received: August 5, 2014; Accepted: November 19, 2014; Published: December 16, 2014
Copyright: © 2014 Engel et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors confirm that all data underlying the findings are fully available without restriction. All relevant data are within the paper and its Supporting Information files.
Funding: This work was made possible by financial support from the National Science Foundation (grant numbers IIS-0963285, ACI-1322254, and IIS-0963451), the U.S. Army Research Office (grant numbers 56692-MA and 64079-NS) and Cisco Systems, Inc. through their sponsorship of the MIT Center for Collective Intelligence. The funding was awarded to TM, AW and CC. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors received funding for the research described in this article from Cisco Systems, Inc. through their sponsorship of the MIT Center for Collective Intelligence. There are no patents, products in development or marketed products to declare. This does not alter the authors' adherence to all the PLOS ONE policies on sharing data and materials.
A growing body of research has been focused on the importance of individuals' ability to make inferences about others' mental states, termed “theory of mind” (ToM) or “mentalizing” –. A common assumption in much of this research is that people with greater ToM abilities will be more competent at various kinds of social interaction. But only a few studies have tested this in limited ways with children –, and fewer still have tested it with adults –.
One exception is a recent study by Woolley et al. , which found that groups of adults with higher average ToM scores also had significantly higher “collective intelligence,” as measured by the group’s ability to perform well across a wide range of different group tasks. Indeed, average ToM scores were the only significant predictor of collective intelligence in a regression that included other group composition and process variables.
However, it is unknown how rich interpersonal cues need to be in order for collective intelligence to emerge at all, or for individual members to engage in the mentalizing necessary to facilitate social interaction. Essentially all of the studies exploring the relationship between ToM and effective social interaction, including the Woolley et al.  study, have been conducted using face-to-face interactions. At the same time, an increasing proportion of social interactions today take place in online environments. According to the Pew Research Center, 73% of adults regularly use social networking sites of some kind, and 54% of American teenagers text their friends at least once a day, but only 33% talk to their friends face-to-face on a daily basis . In addition to our social relationships, we increasingly work in online teams and rely on the collective intelligence of other groups whose collaboration is largely online , . Online, many of the interpersonal cues that are important in face-to-face interactions (such as reading facial expressions and body language, or judging tone of voice) are not available, potentially impairing our ability to communicate effectively –.
With this reduced communication bandwidth, it is to be expected that the ability to reason about the mental states of other group members should be impaired. This could reduce the predictive value of ToM for group performance in environments lacking in interpersonal cues; that is, ToM skills could be expected to play a much smaller role in online environments. On the other hand, one might also argue that ToM-related ability should be even more important in online interaction because the cues provided are so subtle that a lot of “reading between the lines” is necessary.
To help determine which of these views is correct, we compare the importance of ToM skills for predicting group performance in face-to-face and online groups. In so doing, we also test a new, web-based measure of collective intelligence that enables its measurement in both settings, allowing us to examine whether a collective intelligence emerges in online groups, and to replicate and extend previous findings .
Collective Intelligence in Groups
Researchers have repeatedly demonstrated that a single statistical factor–often called “general intelligence” or “g”– emerges from the correlations among how well different people do a wide variety of different cognitive tasks (e.g., , ). This single factor can then be used to differentiate the characteristic performance levels of different individuals and to predict which individuals are likely to perform well on other tasks in the future.
In recent studies, Woolley et al  used the same statistical techniques used in individual intelligence research to see whether a similar collective intelligence factor exists for groups. In other words, they tried to determine the degree to which some groups are characteristically “smarter” than others across a wide range of tasks. To do this, they first gave different groups a variety of tasks that required qualitatively different collaboration processes , . Then they used factor analysis to determine whether there was a single factor for a group–as there is for an individual–that predicts the group’s performance on all the different tasks.
They found that the first factor accounted for 43% of the variance in performance on all the different tasks. This is consistent with the 30–50% of variance typically explained by the first factor in a battery of individual cognitive tasks . In individuals, this factor is called “intelligence” or “g.” For groups, Woolley et al.  called it “collective intelligence” or “c,” and it is a measure of the general effectiveness of a group on a wide range of tasks. The c factor was also shown to predict how well the groups performed more complex tasks at a later time, above and beyond the predictive ability of the average individual intelligence of group members.
They also found several factors that were significant predictors of c. First, the average and maximum intelligence of individual group members were correlated with c, but only moderately so. In other words, having a lot of smart people in a group did not necessarily make a smart group. Second, there was a significant correlation between c and the average ToM scores of group members, as measured by the “Reading the Mind in the Eyes” test . Third, c was negatively correlated with the variance in the number of speaking turns by group members. In other words, groups where a few people dominated the conversation were less collectively intelligent than those with a more equal distribution of conversational turn taking. Finally, c was significantly correlated with the proportion of females in the group, with groups having more females being more collectively intelligent.
In addition, the researchers found that the effects of proportion of females were largely mediated by ToM scores since, consistent with previous research, women in the sample scored better on this measure than men. In a regression analysis including proportion of women, ToM scores, and conversational turn-taking, ToM scores remained the only significant predictor of collective intelligence.
Taken together, this research on collective intelligence suggests that the ToM abilities of group members play a large role facilitating group social interaction. What the existing research does not tell us is the degree to which these findings would apply in situations with highly impoverished communication channels such as many online environments. We do not even know, for instance, whether a single collective intelligence factor will emerge in online groups with limited communication, nor whether mentalizing ability will play as much of a role in that setting, due to the constraints on communication ability and the lack of interpersonal cues.
On the one hand, for example, previous research on collaboration in teams has found that the effect of using online tools for group tasks depends strongly on the type of tasks being performed –. If this effect dominates, we may see more variance in how the same group performs different tasks, and the factor analysis might result in several approximately equal factors for different types of tasks rather than a single dominant collective intelligence factor. On the other hand, if the most important determinants of group performance are the abilities of the members to work together, then we would expect a single important factor to emerge in online groups as was true with those working face-to-face.
Theory of Mind and Emotional Intelligence
As mentioned previously, a large and growing body of research has focused on the importance of individuals' ability to make inferences about others' mental states, termed “theory of mind” (ToM), “mentalizing” –, or, more recently, “mind reading” . Such abilities are thought to be distinctly human, and fundamental to our ability to function in social settings. Indeed, severe impairment in ToM is a core characteristic of the developmental disorder of autism , .
Theory of mind is viewed by some as a subset of a broader array of skills and abilities associated with the more general concept of emotional intelligence (i.e., ). A growing body of work demonstrates the importance of emotional intelligence and related abilities to team performance –. Thus its connection with collective intelligence is consistent with existing work demonstrating the importance of the abilities of group members to recognize one another’s nonverbal emotional expression for group effectiveness , . The broader construct of emotional intelligence not only encompasses social awareness (an ability closely associated with theory of mind) but also self-awareness, self-management, and relationship management . Emotional intelligence has been empirically demonstrated to operate statistically as a second-stratum factor of cognitive ability, marking the expression of intelligence in the emotion domain . However, little consensus exists regarding the best ways to measure the self-awareness and relationship management components of emotional intelligence, and when they are measured in reliable ways they tend to be highly correlated with one another , . Theory of mind is, thus, among the small group of abilities within the broad category of emotional intelligence that can be most reliably measured. However, as discussed above, it remains unknown how much interpersonal information is needed for mentalizing to occur, or for such abilities to be relevant to facilitating social interaction. For instance, almost all previous studies of ToM and social interaction were conducted in settings permitting full face-to-face or verbal interaction –. Thus, the goal of this research is to explore the degree to which a collective intelligence factor arises even in temporary, online groups with highly constrained communication, and the degree to which ToM ability plays a role in facilitating collective intelligence in these settings.
A total of 272 participants were recruited from the general population via Internet advertisements in the Boston area and were invited to the laboratory and randomly assigned to a four-person team for a ninety-minute session. The Institutional Review Board at the Massachusetts Institute of Technology has reviewed and approved the study under COUHES protocol number 0801002578. The study was carried out in accordance with the declaration of Helsinki. All participants were paid for their participation and their written informed consent was obtained before the start of the session. Fifty-two percent of the participants were male.
We determined a priori that a minimum of 60 groups were needed to achieve at least 80% power to detect a medium to strong effect size, which we expected based on previous research . During the time period that the facilities and participants were available to conduct the study, we were able to recruit enough participants for 68 groups. Each of the 68 groups was randomly assigned to one of two conditions: face-to-face or online. All participants were seated in front of personal laptop computers and worked with their group members in a shared online system to complete the tasks described below. Each face-to-face group was seated in a private room around a small table and was allowed to communicate freely. Members in the online groups were randomly seated in a large room with members of other groups. They did not know who else was in their group, and they only communicated with their group members via text chat in the shared online system. The entire group task battery was completed in just under an hour. Then all subjects completed individual tests, including the “Reading the Mind in the Eyes” (RME) test and individual personality scales.
Measure of collective intelligence
Our measure of collective intelligence was an online (and significantly expanded) version of the approach used by Woolley et al . The shared online system used to administer the test battery moved the group members through the tasks together, ensuring that all members of a group worked on the same tasks at the same time. Each task had a fixed duration of between 2 and 10 minutes, after which the next task would automatically begin. The entire battery took 64 minutes for a group to complete. Fig. 1 shows how a sample task in the test battery appeared on the screens of team members.
The right-hand chat window allows the group to communicate. The middle task panel is where the group enters its answers. The left-hand instructions panel contains instructions and other stimulus materials for the task.
Our goal in task selection was to include a comprehensive sample of many different kinds of tasks that groups do. Accordingly, our initial selection was based on established taxonomies of team tasks ,  and on the tasks used in prior studies of collective intelligence .
Generating tasks required the generation of new information and ideas. These included three brainstorming tasks (such as generating uses for a brick).
Choosing tasks required choosing among specified alternatives in two ways. In “intellective” tasks there was an objectively correct answer. These included an 18-item subset of the Raven’s Advanced Progressive Matrices test (a nonverbal test of abstract reasoning), a Sudoku puzzle task, a word unscrambling task, and a task of estimating quantities based on pictures. In “judgment” tasks, choosing among the alternatives was based on subjective judgments. These included predicting how a larger group of Americans would rate a series of slogans and images for quality on a ten-point scale.
Executing tasks required coordinated psychomotor performance across group members. These included typing tasks in which the group had to accurately transcribe into a shared online document as much as possible of a nonfiction text passage or a long list of numbers.
Remembering tasks required groups to collectively store and retrieve information, similar to those evaluated in work on transactive memory systems , . These included two memory tasks that tested memory for features from a video or a complex image.
Sensing tasks required groups to collectively detect patterns in an otherwise noisy environment. These included two detection tasks that presented grids of words or images in which the groups had to answer questions about the elements, e.g. finding the most frequent object.
We included at least one task from each category, as well as “verbal” and “nonverbal” variants of each category of tasks (see full descriptions of the tasks and additional descriptive statistics in the following Supplementary Materials available online: Task Descriptions; Tables S2, S3, S4a, and S4b in S1 Text).
Following Woolley et al. , we performed a factor analysis on all the groups’ scores on all the tasks. We call the first factor that emerges from this analysis the groups’ collective intelligence. Mathematically, scores on this collective intelligence factor represent weighted averages of the different task scores, with the weights derived from the correlations between the tasks and the first factor. Collective intelligence scores determined in this way have been shown to be strong predictors of the general effectiveness of a group on a range of more complex tasks .
Group communication measures
We measured communication differently for face-to-face groups and online groups. For the face-to-face groups, we recorded each member’s spoken communication with individual microphones. Then we ran an automated script on these four audio tracks to determine who, if anyone, was speaking at each point in time. The total amount of communication was the total amount of time during which anyone was speaking. We also calculated the distribution of communication as the standard deviation in the amount of speaking time for different group members. For online groups, we calculated the total amount of communication as the total number of words in the online chat transcripts. We also calculated the distribution of communication as the standard deviation in the number of words chatted by different group members.
Group member work contribution
Several of the tasks required groups to work together in a synchronized text editing environment (similar to that of Google Docs). For these tasks, we recorded how much text each member contributed to the final product and calculated the standard deviation of the members’ contributions.
Reading the Mind in the Eyes (RME)
All participants completed the Reading the Mind in the Eyes test . The test consists of 36 images of only the eyes of individuals, and participants are asked to choose among four possible mental states to describe the person whose eyes are pictured. The options are all complex mental states (e.g., shame, guilt, curiosity, desire) rather than simple emotions (e.g., happiness, anger). Our sample was similar in mean and variability on this test to the original general population sample in Baron-Cohen et al.  (ours: M = 24.85, SD = 5.24; original: M = 26.2, SD = 3.6). Individual scores of the group members were averaged for each group.
Individual Personality Traits
Participants completed a Five Factor Personality Inventory , one of the most widely used personality tests. This test measures the five primary dimensions of adult personality: Extraversion, Agreeableness, Conscientiousness, Openness to Experience, and Neuroticism. Sixty items are responded to on a 1 to 5 scale; the mean for each scale was calculated for each participant. These scales were entered into a factor analysis to calculate a general factor of personality for each participant and aggregated to the group level, which was analyzed for its relationship with collective intelligence and RME .
First, replicating the results from Woolley et al.  using a new task battery and manipulating team member co-location, we found that the first factor in the factor analysis of group scores explained 49% of the variance in face-to-face and 41% in online groups, and the second factor explained less than half this amount (see Fig. 2). This provides additional support for the basic result from prior research that there is a single dominant collective intelligence factor for human groups, and that the existence of collective intelligence does not depend on groups being able to communicate face to face, but generalizes to online groups who communicate only by text. It also strengthens the evidence for collective intelligence by generalizing the finding from the test batteries used by Woolley et al. to the new battery developed here.
The first factor (collective intelligence) explains over 40% of the variance in all cases, while the second factor accounts for less than half of this amount, and the remaining factors account for much less.
Surprisingly, we also found that not only did the average RME abilities of group members predict collective intelligence in the face-to-face condition (replicating the finding of Woolley et al. ), but they did so equally strongly in the online condition (Table 1; Fig. 3; r = .53, p = .002 for face-to-face groups; r = .55, p<.001 for online groups). In other words, the scores of group members on the RME measure were a strong predictor of how well the groups could perform a wide range of tasks together, even when participants were only collaborating online via text chat and could not see each other’s eyes or facial expressions at all. This suggests that scores on the RME test must be correlated with a broader set of ToM abilities and that these broader abilities are critical to group performance even when the subtle nonverbal cues available face-to-face (and operationalized in the RME test) are not available.
The correlations are significant and almost identical for both groups. Similar results are obtained when the two potential outlier groups with the lowest average RME scores are removed (r = .47, p<0.01 and r = .48, p<0.01 for face-to-face and online groups, respectively).
These abilities also appear to be separate from traditional personality factors. We found no significant correlation between a general factor of personality  and collective intelligence or RME (p>.05 in both face-to-face and online conditions; see Table S4 in S1 Text).
In addition, we found that online groups were similar to face-to-face groups in other ways. First, we found that the proportion of women in the online groups was a strong predictor of collective intelligence (Table 1; r = .41, p = .01) and that the average RME ability in a group mediated the effects of the proportion of women in the group on collective intelligence (Sobel z = 1.95, p = .05), the same pattern we found in our previous study .
Next, we found that, in both face-to-face and online groups, the total amount of communication was positively correlated with collective intelligence, and the standard deviations of communication and work contribution were negatively correlated with collective intelligence (Table 1). In other words, groups that communicated more were more collectively intelligent, but groups in which one or two people dominated the discussion and activity were less collectively intelligent, whether the groups were online or face-to-face.
Finally, when we regressed collective intelligence onto the RME measure and the amount and distribution of communication within the group, we found these two factors have similar levels of influence on group performance in both the online and face-to-face conditions (see Table 2, models 1 and 4). This suggests that the theory of mind abilities associated with RME scores are facilitating group collaboration in ways beyond what is solely captured by the amount of verbal communication.
Taken together, these results provide strong empirical support for the emergence of collective intelligence in online groups, and the conclusion that theory of mind abilities are a significant determinant of group collective intelligence even when, as in many online groups, the group has extremely limited communication channels.
This study underscores the importance of continuing to develop our understanding of the factors contributing to collective intelligence in groups. Only recently have we come to understand collective intelligence as a unique quality of groups, indicative of their ability to perform a variety of different tasks . Traditionally, a team’s potential has been conceptualized as the “resources” that are available to the group in the form of the information, intelligence, or other abilities of individual team members ,  typically measured as the aggregate of individual members’ g or general intelligence – or the special expertise or task-specific cognitive abilities of team members , , .
The relationship between team cognitive ability and performance has been shown to vary with the way that cognitive ability is represented in the team and the type of task the team is performing. In particular, the performance of teams working on a task that requires a high degree of cooperation and communication is most influenced by the member with the lowest cognitive ability, because that person tends to slow the rest of the group . In contrast, on tasks for which the optimal strategy is to select the best member (e.g., running a race, or answering a factual question), the cognitive ability of the highest scoring member predicts performance , . Finally, more complex, multi-faceted tasks that require each member of the team to perform a subtask and then combine inputs into a team product are most influenced by the average ability of team members, because higher average cognitive ability is associated with greater propensity to adapt to a changing environment, as well as to learn from new information discovered in the course of work (e.g., , ).
However, it is also telling that the correlation of team average cognitive ability and performance drops to r = .14 in field settings, which is probably due to the fact that teams need to execute a range of functions that go beyond those that are predicted by aggregate cognitive ability , . One probable explanation for the lack of explanatory power is the attempt to conceptualize team ability by aggregating individual-level measurements, which loses information in generalizing across levels of analysis . This suggests that an index of a group's ability, such as the collective intelligence metric developed and tested here, utilizing uniquely group level information, should provide a better mechanism for predicting which groups will perform well in the future.
These results also demonstrate that teams comprised of members with a broader range of ability for perceiving subtle interpersonal cues will be better-equipped to develop higher levels of collective intelligence, especially in less rich, online chat-based environments. Here we used the RME test to measure theory of mind, but theory of mind ability can, in principle, be measured in many ways. The RME test is not the only measure of the construct; other tests include the Strange Stories test , the Faux Pas Recognition test , the Reading the Mind in the Voice test , and the Social Reasoning Wason Selection Test . But the RME test is among the most widely accepted  and most well-validated in adult populations, having been shown to have adequate test-retest reliability  and to consistently differentiate control subjects from autism-spectrum individuals, who are below-average in social perceptiveness .
The RME test is also sensitive to differences between men and women and to differences among people who choose different educational fields . The RME test has been shown to be sensitive in children to levels of prenatal testosterone  and in adults to administration of oxytocin . All this suggests that the RME test is measuring a robust property of individual brain function; if performance on the test were completely determined by contextual factors then we would not expect to see such correlations or experimental effects. Crucially, unlike the other established ToM measures, which are designed for assessing children’s development, brain damage, or autism-spectrum conditions, the RME test has substantial variance in the general adult population, and it taps into both verbal and nonverbal aspects of interpretation in social situations.
The degree to which ToM, as measured by RME or otherwise, can be altered by training or experience remains an open question. Recent studies  suggest that theory of mind abilities as measured by RME can be, at least temporarily, improved by reading literary fiction, which implies a new and interesting avenue of research for improving group performance.
In summary, our results provide strong empirical support for the conclusion that even the collaboration of teams working online can be characterized by a single collective intelligence factor, and that theory of mind abilities are just as important to group effectiveness in these online environments where many kinds of non-verbal communication are not possible. In other words, it appears that the Reading the Mind in the Eyes test does not just measure the ability to read emotions in eyes but also the ability to “read between the lines” of text-based online interactions.
Dataset and glossary of the team-level scores for all tasks and metrics used in analyses.
Detailed descriptions of the tasks used in the collective intelligence battery. Table S1, Task categories and verbal vs. non-verbal dimensions in the Collective Intelligence task battery. Table S2, Descriptive statistics of the task scores, group metrics, and the average scores for the individual metrics. Please refer to the text for a description of how the tasks are computed. Table S3, Correlations among the average Big 5 personality traits, the General Personality Factor , RME, the percent of Females in the group (% Female), and collective intelligence (CI). Table S4a, Correlations among collective intelligence (CI), task scores, RME, and interaction metrics for face-to-face groups. Table S4b, Correlations between collective intelligence (CI), task scores, RME, and interaction metrics for online groups.
Conceived and designed the experiments: DE AW LJ CC TM. Performed the experiments: DE LJ. Analyzed the data: DE AW LJ CC TM. Contributed to the writing of the manuscript: DE AW CC TM.
- 1. Apperly IA (2012) What is “theory of mind”? Concepts, cognitive processes and individual differences. Q J Exp Psychol 65:825–839. doi: 10.1080/17470218.2012.676055
- 2. Baron-Cohen S, Leslie AM, Frith U (1985) Does the autistic child have a “theory of mind”? Cognition 21:37–46. doi: 10.1016/0010-0277(85)90022-8
- 3. Flavell JH (1999) Cognitive development: Children’s knowledge about the mind. Annu Rev Psychol 50:21–45. doi: 10.1146/annurev.psych.50.1.21
- 4. Premack D, Woodruff G (1978) Does the chimpanzee have a theory of mind? Behav Brain Sci 1:515–526. doi: 10.1017/s0140525x00076512
- 5. Saxe R, Powell LJ (2006) It’s the thought that counts specific brain regions for one component of theory of mind. Psychol Sci 17:692–699 doi:10.1111/j.1467-9280.2006.01768.x.
- 6. Watson AC, Nixon CL, Wilson A, Capage L (1999) Social interaction skills and theory of mind in young children. Dev Psychol 35:386. doi: 10.1037//0012-16184.108.40.2066
- 7. Peterson CC, Slaughter VP, Paynter J (2007) Social maturity and theory of mind in typically developing children and those on the autism spectrum. J Child Psychol Psychiatry 48:1243–1250. doi: 10.1111/j.1469-7610.2007.01810.x
- 8. Begeer S, Malle BF, Nieuwland MS, Keysar B (2010) Using theory of mind to represent and take part in social interactions: Comparing individuals with high-functioning autism and typically developing controls. Eur J Dev Psychol 7:104–122. doi: 10.1080/17405620903024263
- 9. Bender L, Walia G, Kambhampaty K, Nygard KE, Nygard TE (2012) Social sensitivity and classroom team projects: an empirical investigation. Proceedings of the 43rd ACM technical symposium on Computer Science Education. 403–408. Available: http://dl.acm.org/citation.cfm?id=2157258. Accessed 2013 April 18.
- 10. Krych-Appelbaum M, Law JB, Barnacz A, Johnson A, Keenan JP (2007) The role of theory of mind in communication. J Interact Stud.
- 11. Woolley AW, Chabris CF, Pentland A, Hashmi N, Malone TW (2010) Evidence for a collective intelligence factor in the performance of human groups. Science 330:686–688. doi: 10.1126/science.1193147
- 12. Brenner J (2013) Social Networking. Available: http://pewinternet.org/Commentary/2012/March/Pew-Internet-Social-Networking-full-detail.aspx#. Accessed 2014 November 26.
- 13. Cummings JN, Kiesler S (2007) Coordination costs and project outcomes in multi-university collaborations. Res Policy 36:1620–1634. doi: 10.1016/j.respol.2007.09.001
- 14. O’Leary MB, Cummings JN (2007) The spatial, temporal, and configurational characteristics of geographic dispersion in work teams. MIS Q 31.
- 15. Byron K (2008) Carrying too heavy a load? The communication and miscommunication of emotion by email. Acad Manage Rev 33:309. doi: 10.5465/amr.2008.31193163
- 16. Kruger J, Epley N, Parker J, Ng Z-W (2005) Egocentrism over e-mail: Can we communicate as well as we think? J Pers Soc Psychol 89:925. doi: 10.1037/0022-35220.127.116.115
- 17. Sproull L, Kiesler S (1986) Reducing Social Context Cues: Electronic Mail in Organizational Communication. Manag Sci 32:1492–1512. doi: 10.1287/mnsc.32.11.1492
- 18. Deary IJ (2000) Looking down on human intelligence: From psychometrics to the brain. New York: Oxford University Press.
- 19. Spearman C (1904) “General Intelligence,” Objectively Determined and Measured. Am J Psychol 15:201–292. doi: 10.2307/1412107
- 20. Larson JR (2009) In search of synergy in small group performance. New York, NY: Psychology Press.
- 21. McGrath JE (1984) Groups: Interaction and Performance. Englewood Cliffs, NJ: Prentice-Hall.
- 22. Baron-Cohen S, Wheelwright S, Hill J, Raste Y, Plumb I (2001) The “Reading the Mind in the Eyes” Test revised version: a study with normal adults, and adults with Asperger syndrome or high-functioning autism. J Child Psychol Psychiatry 42:241–251. doi: 10.1111/1469-7610.00715
- 23. Goodhue DL, Thompson RL (1995) Task-technology fit and individual performance. MIS Q: 213–236.
- 24. Majchrzak A, Rice RE, Malhotra A, King N, Ba S (2000) Technology adaptation: The case of a computer-supported inter-organizational virtual team. MIS Q 24:569–600. doi: 10.2307/3250948
- 25. Sharda R, Barr SH, McDonnell JC (1988) Decision support system effectiveness: a review and an empirical test. Manag Sci 34:139–159. doi: 10.1287/mnsc.34.2.139
- 26. Heyes CM, Frith CD (2014) The cultural evolution of mind reading. Science 344:1243091 doi:10.1126/science.1243091.
- 27. Yip JA, Côté S (2013) The emotionally intelligent decision maker: Emotion-understanding ability reduces the effect of incidental anxiety on risk taking. Psychol Sci 24:48–55 doi:10.1177/0956797612450031.
- 28. Feyerherm AE, Rice CL (2002) Emotional intelligence and team performance: The good, the bad and the ugly. Int J Organ Anal 1993–2002 10:343. doi: 10.1108/eb028957
- 29. Jordan PJ, Ashkanasy NM, Härtel CEJ, Hooper GS (2002) Workgroup emotional intelligence: Scale development and relationship to team process effectiveness and goal focus. Hum Resour Manag Rev 12:195–214 doi:10.1016/S1053-4822(02)00046-3.
- 30. Barsade SG, Gibson DE (2007) Why does affect matter in organizations? Acad Manag Perspect 21:36–59. doi: 10.5465/amp.2007.24286163
- 31. Elfenbein HA (2005) Team emotional intelligence: What it can mean and how it can impact intelligence. In: V D, Sala F, Mount G, editors. The link between emotional intelligence and effective performance.
- 32. Elfenbein HA, Polzer JT, Ambady N (2007) Team emotion recognition accuracy and team performance. Res Emot Organ 3:87–119. doi: 10.1016/s1746-9791(07)03004-0
- 33. Mayer, Salovey P (1993) The intelligence of emotional intelligence. Intelligence 17:433–442. doi: 10.1016/0160-2896(93)90010-3
- 34. MacCann C, Joseph DL, Newman DA, Roberts RD (2014) Emotional intelligence is a second-stratum factor of intelligence: Evidence from hierarchical and bifactor models. Emotion 14:358. doi: 10.1037/a0034755
- 35. Elfenbein HA, Foo MD, Mandal M, Biswal R, Eisenkraft N, et al. (2010) Individual differences in the accuracy of expressing and perceiving nonverbal cues: New data on an old question. J Res Personal 44:199–206. doi: 10.1016/j.jrp.2010.01.001
- 36. Mayer JD, Roberts RD, Barsade SG (2008) Human abilities: Emotional intelligence. Annu Rev Psychol 59:507–536. doi: 10.1146/annurev.psych.59.103006.093646
- 37. Nye JL, Brower AM, editors (1996) What’s social about social cognition? Research on socially shared cognition in small groups. Thousand Oaks, CA: Sage Publications.
- 38. Russell SJ (2010) Artificial intelligence: a modern approach. 3rd ed. Upper Saddle River: Prentice Hall. 1132 p.
- 39. Smith EE (2007) Cognitive psychology: mind and brain. Upper Saddle River, N.J: Pearson/Prentice Hall. 610 p.
- 40. Ren Y, Argote L (2011) Transactive memory systems 1985–2010: An integrative framework of key dimensions, antecedents, and consequences. Acad Manag Ann 5:189–229. doi: 10.1080/19416520.2011.590300
- 41. Wegner DM (1987) Transactive memory: A contemporary analysis of the group mind. In: Mullen B, Goethals GR, editors. Theories of group behavior. New York: Springer-Verlag. 185–208.
- 42. McCrae RR, Costa PT (1987) Validation of the five-factor model of personality across instruments and observers. J Pers Soc Psychol 52:81–90. doi: 10.1037//0022-3518.104.22.168
- 43. Woodley MA, Bell E (2011) Is collective intelligence (mostly) the general factor of personality? A comment on Woolley, Chabris, Pentland, Hashmi and Malone (2010). Intelligence 39:79–81. doi: 10.1016/j.intell.2011.01.004
- 44. Devine DJ, Philips JL (2001) Do smarter teams do better: A meta-analysis of cognitive ability and team performance. Small Group Res 32:507. doi: 10.1177/104649640103200501
- 45. Lepine JA, Hollenbeck JR, Ilgen DR, Hedlund J (1997) Effects of individual differences on the performance of hierarchical decision-making teams: Much more than g. J Appl Psychol 82:803–811. doi: 10.1037//0021-9010.82.5.803
- 46. LePine JA (2005) Adaptation of teams in response to unforeseen change: Effects of goal difficulty and team composition in terms of cognitive ability and goal orientation. J Appl Psychol 90:1153–1167. doi: 10.1037/0021-9010.90.6.1153
- 47. Neuman GA, Wagner SH, Christiansen ND (1999) The relationship between work-team personality composition and the job performance of teams. Group Organ Manag 24:28–45. doi: 10.1177/1059601199241003
- 48. Tziner A, Eden D (1985) Effects of crew composition on crew performance: Does the whole equal the sum of its parts? J Appl Psychol 70:85–93. doi: 10.1037//0021-9010.70.1.85
- 49. Woolley AW, Gerbasi ME, Chabris CF, Kosslyn SM, Hackman JR (2008) Bringing in the experts: How team composition and work strategy jointly shape analytic effectiveness. Small Group Res 39:352–371. doi: 10.1177/1046496408317792
- 50. Woolley AW, Hackman JR, Jerde TJ, Chabris CF, Bennett SL, et al. (2007) Using brain-based measures to compose teams: How individual capabilities and team collaboration strategies jointly shape performance. Soc Neurosci 2:96–105. doi: 10.1080/17470910701363041
- 51. O’Brien G, Owens A (1969) Effects of organizational structure on correlations between member abilities and group productivity. J Appl Psychol 53:525–530. doi: 10.1037/h0028659
- 52. Volmer J (2006) Individual Expertise and Team Performance: Results of Three Empirical Studies [Unpublished doctoral dissertation]. Braunschweig, Germany: Technischen Universität Carolo-Wilhelmina.
- 53. Ellis APJ, Hollenbeck JR, Ilgen DR, Porter COLH, West BJ, et al. (2003) Team Learning: Collectively connecting the dots. J Appl Psychol 88:821–835. doi: 10.1037/0021-9010.88.5.821
- 54. Rousseau DM (1985) Issues of level in organizational research: Multi-level and cross-level perspectives. In: Cummings LL, Staw B, editors. Research in Organizational Behavior. Greenwich, CT: JAI, Vol. 7:1–37.
- 55. Happé FG (1994) An advanced test of theory of mind: Understanding of story characters’ thoughts and feelings by able autistic, mentally handicapped, and normal children and adults. J Autism Dev Disord 24:129–154. doi: 10.1007/bf02172093
- 56. Stone VE, Baron-Cohen S, Knight RT (1998) Frontal lobe contributions to theory of mind. J Cogn Neurosci 10:640–656. doi: 10.1162/089892998562942
- 57. Rutherford MD, Baron-Cohen S, Wheelwright S (2002) Reading the mind in the voice: A study with normal adults and adults with Asperger syndrome and high functioning autism. J Autism Dev Disord 32:189–194. doi: 10.1023/b:jadd.0000022607.19833.00
- 58. Stone VE, Cosmides L, Tooby J, Kroll N, Knight RT (2002) Selective impairment of reasoning about social exchange in a patient with bilateral limbic system damage. Proc Natl Acad Sci 99:11531–11536. doi: 10.1073/pnas.122352699
- 59. Pinkham AE, Penn DL, Green MF, Buck B, Healey K, et al. (2013) The Social Cognition Psychometric Evaluation Study: Results of the Expert Survey and RAND Panel. Schizophr Bull. Available: http://schizophreniabulletin.oxfordjournals.org/cgi/doi/10.1093/schbul/sbt081. Accessed 2013 November 5.
- 60. Hallerback MU, Lugnegard T, Hjarthag F, Gillberg C (2009) The Reading the Mind in the Eyes Test: Test-retest reliability of a Swedish version. Cognit Neuropsychiatry 14:127–143. doi: 10.1080/13546800902901518
- 61. Chapman E, Baron-Cohen S, Auyeung B, Knickmeyer R, Taylor K, et al. (2006) Fetal testosterone and empathy: Evidence from the Empathy Quotient (EQ) and the “Reading the Mind in the Eyes” Test. Soc Neurosci 1:135–148. doi: 10.1080/17470910600992239
- 62. Domes G, Heinrichs M, Michel A, Berger C, Herpertz SC (2007) Oxytocin improves “mind-reading” in humans. Biol Psychiatry 61:731–733. doi: 10.1016/j.biopsych.2006.07.015
- 63. Kidd DC, Castano E (2013) Reading literary fiction improves theory of mind. Science 342:377–380. doi: 10.1126/science.1239918