Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Development of a measure to evaluate competence perceptions of natural and social science

  • Caitlin K. Kirby ,

    Roles Conceptualization, Data curation, Formal analysis, Writing – original draft, Writing – review & editing

    kirbycai@msu.edu

    Affiliation Earth and Environmental Sciences Department, Michigan State University, East Lansing, Michigan, United States of America

  • Patricia Jaimes ,

    Contributed equally to this work with: Patricia Jaimes, Amanda R. Lorenz-Reaves, Julie C. Libarkin

    Roles Conceptualization, Data curation, Formal analysis, Writing – review & editing

    Affiliation Earth and Environmental Sciences Department, Michigan State University, East Lansing, Michigan, United States of America

  • Amanda R. Lorenz-Reaves ,

    Contributed equally to this work with: Patricia Jaimes, Amanda R. Lorenz-Reaves, Julie C. Libarkin

    Roles Conceptualization, Data curation, Formal analysis, Writing – review & editing

    Affiliation Department of Entomology, Michigan State University, East Lansing, Michigan, United States of America

  • Julie C. Libarkin

    Contributed equally to this work with: Patricia Jaimes, Amanda R. Lorenz-Reaves, Julie C. Libarkin

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Writing – review & editing

    Affiliation Earth and Environmental Sciences Department, Michigan State University, East Lansing, Michigan, United States of America

Development of a measure to evaluate competence perceptions of natural and social science

  • Caitlin K. Kirby, 
  • Patricia Jaimes, 
  • Amanda R. Lorenz-Reaves, 
  • Julie C. Libarkin
PLOS
x

Abstract

Interdisciplinary scientific research teams are essential for responding to society’s complex scientific and social issues. Perceptual barriers to collaboration can inhibit the productivity of teams crossing traditional disciplinary boundaries. To explore these perceptual barriers, survey measures related to perceived competence were developed and validated with a population of earth scientists (n = 449) ranging from undergraduates through professionals. Resulting competence scales included three factors that we labeled as Perceived Respect (PR), Perceived Methodological Rigor (PM), and Perceived Intelligence (Pi). A Mann-Whitney U test revealed that earth scientists perceived social science/scientists as significantly less competent than natural science/scientists. A multivariate multilevel analysis indicated that women perceived scientists as more intelligent than did men. Working with social scientists and holding an earth science PhD changed earth scientists’ perceptions of social science on multiple scales. Our study indicates that competence in scientific disciplines is a multidimensional construct. Our results from earth scientists also indicate that perceptual barriers towards other scientific disciplines should be studied further as interdisciplinarity in scientific research continues to be encouraged as a solution to many socio-scientific problems.

Introduction

The complex scientific problems facing today’s world are not easily solved by scholars housed within a single discipline. Environmental and public health problems in particular require an interdisciplinary approach that considers the human context in which problems occur [1, 2, 3]. For example, urban planning requires the incorporation of ecology, sociology, earth sciences, economics, and anthropology to address the biophysical and societal processes that promote the sustainable use of resources [4, 5]. Funding agencies such as the National Science Foundation and National Institutes of Health have increasingly called for interdisciplinarity as a facet of grant-winning proposals in recognition of the need for input from many scientific disciplines in impactful research [6].

Perhaps the largest disciplinary divide among scientists is that between the natural sciences (examining biological, physical, and chemical processes) and the social sciences (examining human dimensions of the world). In discussing the differences between social and natural science, it is important to note that both professions consist of a wide range of disciplines, each with their own methodology, jargon, and culture. Nevertheless, the terms “social science” and “natural science” are used to demarcate funding opportunities, colleges within universities, and categories of research journals. Because the terms natural science and social science are so widely used, they represent meaningful distinctions within the scientific profession.

Natural and social scientists alike have reported benefits from interdisciplinary collaboration with colleagues, including the formation of new perspectives in relation to their own disciplines, the creation of knowledge, and increased relevance of their research in solving environmental problems [6, 7]. However, interdisciplinary research presents many challenges [1, 8]. Methodological and language differences, as well as differences in scales of measurement, are some of the technical issues that interdisciplinary teams face [1, 2, 9, 10]. External factors such as funding and institutional support may be unavailable for interdisciplinary projects since they are perceived to take longer than disciplinary research [1, 11].

Among collaboration participants themselves, perceptual barriers such as a lack of respect also prevent researchers from engaging in projects with colleagues from other disciplines. Perceptual barriers have been well documented over time, especially in the divide between natural sciences and social sciences [1, 8, 9, 1216]. For example, participants in the 1984 International Geosphere-Biosphere Program, one of the earliest interdisciplinary earth system science programs, noted that both social and natural scientists lacked a mutual respect for each other’s fields [15]. In another study, most social science researchers working in medical research settings felt the need to alter their research practices in order to be viewed as legitimate by their medical research colleagues [17]. In both of these examples, the social sciences were considered necessary for shedding light on human behaviors and their impacts on the environment and personal health, respectively [15,17].

In examining successful interdisciplinary collaborations, Stokols et al. developed a framework of necessary components for interdisciplinary work, including intrapersonal and social factors that foster willingness to engage in interdisciplinary research [18]. However, exactly what personal attributes and perceptions may contribute to the success of interdisciplinary work is not clear [18]. A deeper understanding of perceptual barriers and their prevalence among different scientific disciplines may help promote interdisciplinary collaboration.

Components of attitudinal barriers

In determining constructs that are important in the formation of attitudes towards a discipline, we draw on research from boundary science, team science, and social psychology. Research in social psychology suggests that warmth and competence are the two primary dimensions across which individuals judge others [19]. Warmth judgements focus on interpersonal characteristics (e.g., trustworthiness, friendliness, empathy, kindness) while competence addresses professional characteristics (e.g., intelligence, power, efficacy, skill) [20]. Here, we focus on competence in considering perceptual barriers towards engaging in collaborations with scientists from other disciplines.

Components of competence within scientific professions include overall respect and other perceptions such as those related to intelligence, objectiveness, methodological rigor, skill, and value to society. Here we discuss these concepts and how they relate to competence in scientific professions. Respect is a multi-dimensional concept encompassing factors such as admiration, listening, sharing, and trust, and is important for the success of any personal or professional relationship [9, 2123]. Feeling respected as a member of a group is important in forming a sense of group identity and commitment to a group, in this case the scientific profession [24]. Within and outside of the scientific profession, there persists the perception that scientists require high intelligence as measured by IQ in order to succeed [25, 26]. These perceptions may persist despite research that shows many factors beyond intelligence contribute to job success in the sciences [27]. There may also be a perception that social scientists have lower intelligence than natural scientists, supported by discussions on the hierarchy of the sciences, with natural sciences considered more methodologically rigorous than social sciences [28]. Methodological differences are one of the most important distinctions between scientific fields. Many scientists consider methods that are more quantitative and conducted across larger scales to be more rigorous and objective than qualitative and individual-level methods, which are more often used in social sciences [2, 7, 12, 28]. In interdisciplinary projects that span the boundaries between natural sciences and social sciences, social scientists are often required to fit their methodology and results to the theories and expectations of the natural scientists [29]. Natural scientists may be reluctant to acknowledge the presence of subjective value judgements within their research [8], but those who are more critical of their own methodology and recognize subjectivity in their research tend to be more receptive to social science research [12]. These findings emphasize the importance of methodology and objectivity considerations in competence perceptions among scientific disciplines.

The value of science to society can be thought of as an intrinsic sense of worth as demonstrated in monetary or non-monetary ways [30]. A profession has value if it is considered worthwhile to engage in and fund [31]. Value can be added to a profession through external acknowledgments of that profession’s rigor or worth, such as through accreditation processes [32]. The value of the social and natural sciences to society has differed historically, with natural sciences often receiving more federal funding than social sciences [31, 33]. Part of this funding gap could be explained by the need for expensive facilities and equipment in natural science research. For example, all of the $185 million in major research equipment and facilities instruction awards given by the National Science Foundation in 2018 went to natural science fields [34]. However, the Social, Behavioral, and Economic Sciences are also awarded the fewest number of grants of any research area by the National Science Foundation [34].

An international research program examining global environmental change called Future Earth provides an interesting example of value differences. The program included natural and social scientists in order to develop research connected to public policy. Future Earth research proposals for the natural sciences have received more funding than those for the social sciences and publications from the program emphasized goals related to natural science [35]. This funding disparity continued despite the explicit recognition by the program that social sciences could contribute action-oriented research that would allow societal transformations toward sustainability [35]. In this case, natural science research was valued more than social science research when allocating resources and developing publications.

Perceptions of competence may also be influenced by experiential and demographic factors such as gender. For example, when estimating others’ IQs, women give higher estimates and men give lower estimates for the same individuals. Women also give lower self-estimates of IQ than men do [36]. Thus, women may have higher competence perceptions of scientists. Having experience with different disciplines in an educational or workplace setting also impacts individuals’ perceptions. A lack of understanding of science can contribute to a negative attitude towards science on the part of students [37, 38]. Working across disciplinary boundaries with other researchers can promote respect between social and natural scientists for each other’s disciplines, especially when these relationships are durable over multiple years [16, 18]. Interdisciplinary research teams with members experienced in interdisciplinary work are better able to address the differences in their values and methods and proceed towards a common research goal than inexperienced teams [39]. Thus, exposure to and understanding of different scientific disciplines may promote competence perceptions of those disciplines. A similar but opposite effect may be possible, wherein further experience in one’s own field through education or research experience might lessen perceived competence of other disciplines. Competence perceptions should be examined with an understanding of exposure to other disciplines and education in one’s own discipline.

Current study

The competence perceptions of scientists towards their own discipline or other disciplines has not previously been measured through a validated survey instrument. Documentation of views held by scientists about their own and other disciplines is a necessary first step in understanding barriers to inclusive and interdisciplinary scholarship. The overarching purpose of this study is to develop and validate a measure that can be used to understand perceptions of competence within and between scientific disciplines.

With these challenges in mind, we designed a survey to capture the competence-related perceptions that earth scientists have towards natural and social science, and we validated sub-dimensions of competence measured by this survey. Validating these scales allowed initial exploration of the presence of perceptual barriers towards working across disciplinary boundaries. Since natural scientists have been shown to hold differing views of social and natural science [1216], we chose members of a natural science discipline (earth scientists) as our sample population for our validation work.

Research questions

  1. Can a valid and reliable measure of competence be developed for use with scientists in the investigation of cross-disciplinary perceptions?
  2. What perceptions do earth scientists from a range of career experiences hold about the competence of the social and the natural sciences?
  3. What impact do gender, exposure to social science disciplines, and education level have on how earth scientists perceive the social and natural sciences?

To investigate these research questions, we develop and validate scales to measure competence, utilize a Mann-Whitney U test to compare earth scientists’ perceptions of social and natural science, and conduct multilevel multivariate analysis to evaluate the impact of gender and social science exposure on competence perceptions.

Methods

This human subjects research was approved by Michigan State University IRB #x11-949e.

Survey development

This study utilized a between-groups experimental design wherein a sample was randomly split. We developed two versions of a survey to measure earth scientists’ competence perceptions of natural and social science. The first survey version solicited competence perceptions of social science/scientists, and the second version solicited competence perceptions of natural science/scientists. The between-groups design was chosen to prevent respondents from modifying their perceptions to reduce any perceived biases about natural or social science.

Each survey version contained a definition of the corresponding type of science for participants to review before beginning the survey. The definition used for social science was adapted from Merriam-Webster [40]: “Social Science can be defined as those disciplines that deal with the scientific study of human aspects of the world.” A similar phrase was used to define natural science [41]: “Natural Science can be defined as those disciplines that deal with the scientific study of the physical and biological aspects of the world.” These definitions were broad enough to encourage respondents to consider overarching disciplines rather than specific fields. Apart from these definitions, the two survey versions contained identical items and phrasing, altered only by specific reference to social or natural science.

Surveys were designed to measure competence, with recognition that competence is a multi-dimensional construct. We conducted a broad search of scales for related constructs, including perceptions of intelligence, value to society, methodological rigor, objectivity, respect, and skill. Measures that we included were gathered from previously validated measures [42], modified from items of related measures [21] to accommodate best practices for writing Likert-type items [43], or developed based on published qualitative studies [12] and descriptions of competence. Where measures were previously validated, which was the case only for a measure of perceived intelligence (Pi) [42], we maintained the 5-point Likert scale from the original measure. In constructing scales, we elected to use a 4-point scale to force agreement [44]. The use of odd and even scales should not have an impact on our findings [45].

To investigate the impacts of exposure to social sciences on perceptions, participants reported how often and how recently they had worked with social scientists. They also reported whether or not they had completed coursework in the social sciences. In order to ensure consistent understanding across surveys, the social science definition was included on the natural science surveys preceding these demographic questions. Participants were also asked to report their gender, age, natural science degrees held, and ethnicity. See S1 and S2 Surveys for full wording of all survey items.

Participants

We distributed surveys to individuals attending a professional meeting for earth scientists in 2015. Participants were selected by convenience as they passed by an exhibit hall booth and offered a snack as an incentive to complete the survey. Before participating in the survey, participants were informed that the survey would take about ten minutes and asked to read a document of informed consent as approved by Michigan State University’s IRB #x11-949e. After reading the consent document, individuals’ participation in the survey was considered written consent.

Statistical analysis

Items from the previously validated intelligence scale Pi were recorded on a scale from one to five, with one representing low perceived intelligence and five representing high perceived intelligence. Remaining items were coded from 1–4 indicating strongly disagree (1), disagree (2), agree (3) or strongly agree (4). In the few instances where participants indicated that their level of agreement was in between two points on the scale, the response was coded at the higher level of agreement. One Likert-type question was removed prior to analysis due to multiple possible interpretations of its wording (“Natural/Social science research has few sources of potential bias.”).

Factor analyses were conducted to determine the extent to which items measured unique constructs. The resulting scales failed normality tests, so we utilized a Mann-Whitney U test to examine differences between perceptions related to social sciences and natural sciences. These tests were performed using SPSS version 22 [46].

To test research question three on the impact of gender, exposure to social science, and education level on earth scientists’ competence perceptions, we completed a multilevel multivariate analysis in R using the lme4 package [47]. The mixed-effects model tested for fixed and random effects of gender and social science exposure on natural scientists’ perceptions of social sciences. Gender was input into the model at the first hierarchical level, followed by the social science exposure score. Social science exposure was included as a binary variable that indicated whether respondents had never worked with a social scientist (0) or had worked with a social scientist at some point (1). Involvement in a social science course and working with a social scientist were highly correlated items and could not both be included in the multivariate model. Finally, respondents’ education level was measured as whether they had earned a PhD (1) or not (0) in earth science.

Results

A total of 518 surveys were collected and are available in the S1 Dataset (social science = 257 and natural science = 261). Respondents who skipped one or more survey questions were excluded from analysis (listwise deletion), with sixty-nine cases of missing data resulting in an analysis of 449 surveys (social science = 216 and natural science = 233). This indicates that complete data were analyzed for 86.7% of all participants, which is above the recommended threshold of 85% for listwise deletion of missing data [48]. Given this result, we felt confident to proceed with our analysis.

Demographics did not differ significantly between the two surveys (Table 1). Respondents were evenly split between male and female, with two individuals reporting their gender as both female and genderqueer. The majority of respondents were white (84.2%). The remaining reported ethnicities for the sample were Asian (6.6%), Latino (6.4%), other (3.6%), Black (3.1%), American Indian (2.1%), and Native Hawaiian (0.4%). Based on these demographics, we conclude this sample is very similar to the larger population of earth scientists [49]. The age range of our sample was 18–83, with an average of 31.5±13.9 years. Roughly even percentages of individuals were undergraduate students (35.6%), graduate students (35.4%), and non-student professionals (29%). Undergraduate students are included as scientists in our sample because students in earth and environmental sciences are likely to engage in research as undergraduates [50], and thus are actively participating in the scientific process. The fact that these students were attending a professional conference demonstrates engagement in the earth science profession. In addition, Bachelor’s degrees are sufficient for obtaining employment in the environmental science field [51]. Nearly half of the sample held a Bachelor’s degree in natural science, with about 1 in 5 individuals holding a PhD. Of individuals who reported their education levels, a majority were pursuing or held a degree in earth science, with 2.4% of respondents holding or pursuing a natural science degree in another concentration such as biology or chemistry. Finally, 78.0% and 61.3% of respondents indicated prior work with social scientists and prior coursework in social science, respectively.

thumbnail
Table 1. Demographics of survey respondents.

Respondents (n = 449) were earth scientists attending a 2015 professional conference. Approximately half of the respondents (n = 233) reported their perceptions of natural science and the other half (n = 216) reported their perceptions of social science.

https://doi.org/10.1371/journal.pone.0209311.t001

Scale validation

A simple confirmatory factor analysis with maximum likelihood extraction was used to validate the Perceived Intelligence (Pi) scale for our sample. As expected from Bartnek et al. [42], the five intelligence items correlated with each other with Pearson coefficients >0.3, suggesting that a factor pattern was present in the data [52]. Anti-image correlation diagonals were all >0.5, which also indicates that factor analysis is appropriate to use on the items [52]. The Kaiser-Meyer-Olkin measure was 0.858, well above the recommended value of 0.6 [52]. Based on eigenvalues >1.0 and scree plot analysis, a single factor emerged for the intelligence scale that explained 58.7% of the variance (Table 2) [53]. Cronbach’s alpha, a commonly used measure of internal consistency, for the Pi scale was 0.874. Values above 0.8 are widely considered adequate, with values above 0.5 appropriate for psychological constructs and initial development of scales [52].

thumbnail
Table 2. Factor loadings for intelligence survey items.

Results are for a simple confirmatory factor analysis with no rotation. Factor loadings >0.32 indicate each item loads onto the intelligence factor [54] Intelligence items were taken from Bartneck et al. [42].

https://doi.org/10.1371/journal.pone.0209311.t002

An exploratory factor analysis with maximum likelihood extraction and varimax rotation was conducted on all other survey items. A bivariate correlation indicated a factor pattern was present, as each item correlated significantly with at least one other item at >0.3 [52]. All survey items exhibited diagonals >0.5 in the anti-image correlation matrix, also indicating that all of our questions should be included in the analysis. The Kaiser-Meyer-Olkin measure of sampling adequacy was above the 0.6 minimum value at 0.941 [52].

Factor analysis for our developed survey items resulted in the emergence of two separate factors interpreted as Perceived Respect (PR) and Perceived Methodological Rigor (PM) based on eigenvalues >1.0 and scree plot analysis [53]. The first factor explained 38.8% of the variance and the second factor explained 11.0% of the variance for a total of 49.8% (Table 3). The PR scale had a Cronbach’s alpha of 0.932. The Cronbach’s alpha of the PM scale was 0.646.

thumbnail
Table 3. Factor loadings and sources for survey items.

Exploratory factor analysis with varimax rotation resulted in a Perceived Respect scale, PR, and a Perceived Methodological Rigor scale, PM. Factor loadings <0.32 are suppressed [54].

https://doi.org/10.1371/journal.pone.0209311.t003

Earth scientists’ perceptions of social and natural science

Scores for each of the three measures (Pi, PM, PR) were computed by summing the scores from each individual. Negatively worded items were reversed such that higher scores on each scale indicated a more favorable perception of Pi, PM, or PR. Perceived Respect PR and Perceived Methodological Rigor PM were each created on a 4-point Likert scale, with Perceived Intelligence Pi retaining the 5-point Likert scale with which it was created and validated [42]. When reversing items, we scaled them from 0 to 3. Each scale also had a different number of items. Thus, each scale had a different range of possible scores. PM scores ranged from 0–15. Possible PR scores ranged from 10–40 and Pi scores ranged from 5–25.

Mean scores across NS and SS participants were calculated for each measure. Across both the social science (SS) and natural science (NS) surveys, PR scores had the highest relative value (overall 87% of maximum; Table 4). Pi scores were also relatively high overall (overall 84% of maximum). This indicates that our sample respects science/scientists, regardless of discipline, and believes scientists to be intelligent. The PM scale scores were the lowest relative to their scale range (overall 45% of maximum), indicating that our sample feels that scientific methodology in general is not perfectly objective or without flaws.

thumbnail
Table 4. Means of factor scores displaying standard deviation and Mann-Whitney U test showing the difference between SS and NS scale scores.

Higher values indicate more favorable perceptions of respect (PR), methodological rigor (PM), or intelligence (Pi).

https://doi.org/10.1371/journal.pone.0209311.t004

Scores failed tests of normality, so a non-parametric test was chosen to analyze differences between SS and NS scale scores. We utilized a Mann-Whitney U test to compare participants’ scores for all three scales across the groups of NS and SS (Table 4). To avoid type 1 error, a critical value of 0.017 was used to achieve the 0.05 significance level according to the Bonferroni correction; each scale surpassed this significance level. For all three scales, social science/scientists were perceived as less competent than natural science/scientists (Table 4). The difference in the average PR score was 5.1 points out of 30, representing the largest disparity between perceptions of SS and NS.

In examining our third research question about the impact of gender, social science exposure, and education level on competence perceptions, we examined the scale scores across these groups on the SS survey (Table 5). Individuals who reported having worked with a social scientist had the highest average scores on the Perceived Respect scale PR and Perceived Methodological Rigor scale PM. Female respondents reported the highest average scale scores for Perceived Intelligence Pi. The lowest average scores on all three scales were from respondents with PhDs in earth science.

thumbnail
Table 5. Social science scores across gender, social science exposure, and education level.

Higher values indicate more favorable perceptions of respect (PR), methodological rigor (PM), or intelligence (Pi). Standard deviation is given with the average scale scores. Items with superscripts of the same letter are significantly different from one another (p<0.05).

https://doi.org/10.1371/journal.pone.0209311.t005

In the multilevel multivariate analysis, gender, social science exposure, and education level had a significant impact on at least one of the scale scores (Table 5). Male earth scientists rated social scientists as less intelligent (β = -1.081, SE = 0.473, p<0.05) than did female earth scientists by an estimated 1.08 points on the 20-point Pi scale. However, the scales of PR (β = -0.521, SE = 0.490, p = 0.29) and PM (β = -0.332, SE = 0.480, p = 0.49) were not impacted by individuals’ genders. Respondents who had worked with social scientists rated them as more intelligent (β = 1.096, SE = 0.479, p <0.05) by an estimate of 1.10 on the 20-point Pi scale. Respondents who worked with social scientists also had higher PR scores (β = 2.094, SE = 0.497, p < .001) by an estimate of 2.09 on the 30-point PR scale. Respondents with earth science PhDs perceived social scientists as less intelligent (β = -1.879, SE = 0.625, p < .01) and less methodologically rigorous (β = -1.854, SE = 0.650, p < .01) than respondents without PhDs. Model goodness of fit was increased with the inclusion of gender, social science exposure, and education level (χ2(6) = 23.51, p<0.001).

A multilevel multivariate analysis was carried out for the results of the natural science survey as well, with social science exposure resulting in no significant difference for any of the scales. However, female earth scientists again perceived natural scientists as more intelligent (β = -0.906, SE = 0.359, p < .05) than did male scientists and also reported higher PR scale scores (β = -0.753, SE = 0.363, p < .05). Respondents who held a PhD in earth sciences perceived natural scientists as more intelligent (β = 0.988, SE = 0.432, p < .05) than did non-PhD holders. While statistically significant, the average differences for competence perceptions of natural science were smaller than those for social science. A goodness of fit test for the model indicated that adding gender, social science exposure, and PhD degree did not significantly improve model fit (χ2(9) = 15.742, p = 0.08).

Discussion

Among increasing calls for interdisciplinary work to solve today’s most complex scientific issues [55, 56], this study seeks to create a measure for understanding scientists’ perceptions of natural and social science/scientists. Investigation of Perceived Respect (PR), Perceived Intelligence (Pi), and Perceived Methodological Rigor (PM) as components of competence indicates that earth scientists perceive social science/scientists as less competent than natural science/scientists. Scales generated in this study can be used to measure the extent and pervasiveness of potential perceptual barriers to interdisciplinary collaboration across different scientific disciplines. This work also improves our understanding of different dimensions of perceived competence in the workplace by creating and validating scales of competence constructs. Because of the importance of competence in professional and collaborative group settings [20, 22], there is value in understanding these perceptions within scientific disciplines towards other disciplines.

Earth scientists’ competence perceptions of natural science and social science were significantly different, suggesting important implications for collaboration potential. Earth scientists’ scores on the three scales of Perceived Respect (PR), Perceived Methodological Rigor (PM), and Perceived Intelligence (Pi) of social science and social scientists were significantly lower than those for natural science and natural scientists. These survey results provide a quantitative confirmation of the challenges of affording the same value to methods and findings in the social sciences as are often found in the natural sciences [8, 12, 31, 33, 35]. The competence scales also provide a more detailed understanding of the social and attitudinal barriers described in the formation of interdisciplinary teams [15, 17, 18].

In our study, female respondents viewed both social and natural scientists as significantly more intelligent than did male respondents. Females are more likely than males to trust the expertise of scientists [57], with our results indicating that this may include those from disciplines other than their own. While not studied extensively, there is evidence outside of our study to suggest that females are more drawn to interdisciplinary fields and projects than are males [58]. Given these prior results and our current study, the impact of gender on interdisciplinary work merits additional exploration.

Earth scientists with experience working with social scientists perceived social science/scientists as more competent than did respondents lacking such experience. However, these scale scores were still lower than those for natural science/scientists, suggesting that there may still be some perceptual barriers to working across disciplines. Developing respect for others’ disciplines may require ongoing involvement in a multidisciplinary project over several years [16], and even then individuals tend to exhibit more positive attitudes towards subject matter that they are more familiar with. This is known as the mere exposure effect and is a consistent and well-studied phenomenon where increased familiarity with a certain stimulus improves one’s attitude towards that stimulus [59, 60]. The mere exposure effect has been shown to have an impact on attitudes towards scientific constructs such as journal rankings [61].

The mere exposure effect contextualizes earth scientists’ competence perceptions of social science compared to natural science. Natural science is more familiar to earth scientists than social science and that familiarity alone may alter earth scientists’ competence perceptions of each field. More familiarity in natural science, as indicated in this study by having attained a PhD, is also linked to perceiving social science as less competent. The mere exposure effect also predicts the improvement of competence perceptions via working with social scientists, and suggests that one way to alter perceptions of social science by natural scientists is to foster interdisciplinary collaborations. This can and is being achieved via funding opportunities for interdisciplinary projects [55]. Engagement in social science courses is another avenue through which natural scientists may gain exposure to the social sciences. Although not included in the multivariate model because of its correlation with working with a social scientist, having taken a social science course was highly correlated with the PR scale on the SS survey. Universities should promote interdisciplinary coursework to produce scientists who are willing and prepared to work across traditional disciplinary lines [39, 62].

Further work in understanding relations between scientific professions might also consider perceptions of warmth, a measure of friendliness, trustworthiness, empathy, and kindness [20]. Capturing measures of warmth in relation to disciplines may build on our scales that explore constructs related to competence. Warmth contributes to building social capital and maintaining professional relationships [20] and impacts affective and behavioral reactions important for group work [23]. Warmth is also important in interpersonal relationships, such as a working professional relationship. Expanding future work to include measures of warmth may offer a deeper understanding of interdisciplinary collaborations and point to additional potential avenues for improving such relationships.

In a scientific world with increasing calls for interdisciplinary work, competence perceptions have important potential impacts on effective collaboration across disciplines. A precursor to successful collaboration is a basic level of respect for the individual performing that work and the research that they will perform. In fostering interdisciplinary collaborations, institutions and funding agencies should be aware of perceptual barriers related to competence and its sub-dimensions of intelligence, methodological rigor, and respect. Interdisciplinary team leaders could also utilize team members’ competence perceptions in planning team-building exercises, which are important to the success of diverse research teams [63, 64]. Competence perceptions might also be considered in integrating social science coursework into natural science degree requirements. Examining these perceptions provides opportunities to improve willingness to work across disciplinary boundaries, allowing researchers to find solutions for society’s most complex, interdisciplinary problems.

Limitations and future work

Our study population consisted primarily of early-career earth scientists, and earth scientists represent only one small discipline of the natural sciences. Future studies that expand the experience level and discipline of respondents will be better able to make conclusions about competence perceptions of other disciplines. It was also outside the scope of this study to survey social scientists’ perceptions of natural scientists. In the creation of our scales, the items that scaled onto the PM (Perceived Methodological Rigor) scale were all reverse coded due to their wording suggesting low methodological rigor. Future studies that utilize, expand upon, or otherwise improve this scale might consider mixing positively and negatively worded items within both the PM and the PR (Perceived Respect) scales.

This paper is not concluding that natural scientists such as earth scientists are responsible for the majority of perceptual barriers between natural and social sciences, nor that natural scientists are inherently more likely to have less favorable perceptions of other disciplines. Social scientists might also have more favorable attitudes towards social science than natural science because of their familiarity with their own field. Within either silo of science, scientists from different sub-disciplines, such as chemistry and ecology or history and sociology, may also exhibit these relatively less favorable attitudes towards other disciplines. Future work should consider competence perceptions across more disciplines to more fully understand how these perceptual barriers might impact interdisciplinary projects of all types. Because this study was designed to create and validate scales, it was outside of the scope to survey across many groups and is both a limitation of the present study and an opportunity for future work.

Supporting information

S1 Survey. Social science competence survey.

The full social science version of the survey and given to participants.

https://doi.org/10.1371/journal.pone.0209311.s001

(DOCX)

S2 Survey. Natural science competence survey.

The full natural science version of the survey and given to participants.

https://doi.org/10.1371/journal.pone.0209311.s002

(DOCX)

S1 Dataset. Natural and social science dataset.

Coded dataset with responses from both the natural and social science surveys.

https://doi.org/10.1371/journal.pone.0209311.s003

(XLSX)

Acknowledgments

The authors wish to thank all of our survey participants. The authors also wish to thank the Geocognition Research Laboratory, Nadia Langworthy, and the PLoS One reviewers for their manuscript reviews.

References

  1. 1. Brewer GD. The challenges of interdisciplinarity. Policy Sci. 1999;32(4):327–37.
  2. 2. Whiteside M. The challenge of interdisciplinary collaboration in addressing the social determinants. Aust Soc Work. 2004;57(4):381–93.
  3. 3. Earth system science for global sustainability: the grand challenges. Paris (FR): International Council for Science; 2010 Oct. ISBN: 978-0-930357-73-3
  4. 4. Palmer MA, Bernhardt ES, Chornesky EA, Collins SL, Dobson AP, Duke CS, et al. Ecological science and sustainability for the 21st century. Front Ecol Environ. 2005;3(1):4–11.
  5. 5. Slocombe DS. Environmental planning, ecosystem science, and ecosystem approaches for integrating environment and development. Environ Manag. 1993;17(3):289–303
  6. 6. Roy ED, Morzillo AT, Seijo F, Reddy SMW, Rhemtulla JM, Milder JC, et al. The elusive pursuit of interdisciplinarity at the human—environment interface. Biosci. 2013;63(9):745–53.
  7. 7. Marzano M, Carss DN, Bell S. Working to make interdisciplinarity work: Investing in communication and interpersonal relationships. J Agric Econ. 2006;57(2):185–97.
  8. 8. Lélé S, Norgaard B. Practicing interdisciplinarity. Biosci. 2005;55(11):967–75.
  9. 9. Eigenbrode SD, O’Rourke M, Wulfhorst JD, Althoff DM, Goldberg CS, Merrill K, et al. Employing philosophical dialogue in collaborative science. Biosci. 2007;57(1):55–64.
  10. 10. Nielsen-Pincus M, Morse W, Force J, Wulfhorst J. Bridges and barriers to developing and conducting interdisciplinary graduate-student team research. Ecol Soc. 2007;12(2):8.
  11. 11. Younglove-Webb J, Abdalla CW, Thurow AP, Gray B. The dynamics of multidisciplinary research teams in academia. Rev High Ed. 1999;22(4):425–40.
  12. 12. Albert M, Laberge S, Hodges BD, Regehr G, Lingard L. Biomedical scientists’ perception of the social sciences in health research. Soc Sci Med. 2008;66(12):2520–31. pmid:18336978
  13. 13. Faigman DL. To have and have not: Assessing the value of social science to the law as science and policy. Emory Law J. 1989;38:1005–59.
  14. 14. Napolitano DA, Jones COH. Who needs “pukka anthropologists”? A study of the perceptions of the use of anthropology in tropical public health research. Trop Med Int Health. 2006;11(8):1264–75. pmid:16903889
  15. 15. Mooney HA, Duraiappah A, Larigauderie A. Evolution of natural and social science interactions in global change research programs. Proc Natl Acad of Sci U S A. 2013;110(Supplement 1):3665–72.
  16. 16. Pohl C. Transdisciplinary collaboration in environmental research. Futures. 2005;37(10):1159–78.
  17. 17. Albert M, Paradis E, Kuper A. Interdisciplinary promises versus practices in medicine: the decoupled experiences of social sciences and humanities scholars. Soc Sci Med. 2015;126:17–25. pmid:25500163
  18. 18. Stokols D, Harvey R, Gress J, Fuqua J, Phillips K. In vivo studies of transdisciplinary scientific collaboration: Lessons learned and implications for active living research. Am J Prev Med. 2005;28(2):202–13.
  19. 19. Fiske ST, Cuddy AJC, Glick P, Xu J. A model of (often mixed) stereotype content: competence and warmth respectively follow from perceived status and competition. J Pers Soc Psychol. 2002;82(6), 878–902. pmid:12051578
  20. 20. Cuddy AJC, Glick P, Beninger A. The dynamics of warmth and competence judgments, and their outcomes in organizations. Res Organ Behav. 2011;31:73–98.
  21. 21. Frei JR, Shaver PR. Respect in close relationships: prototype definition, self-report assessment, and initial correlates. Pers Relatsh. 2002;9(2):121–39.
  22. 22. Wojciszke B, Abele AE, Baryla W. Two dimensions of interpersonal attitudes: Liking depends on communion, respect depends on agency. Eur J Soc Psychol. 2009;39(6): 973–90.
  23. 23. Fiske ST, Cuddy AJC, Glick P. Universal dimensions of social cognition: warmth and competence. Trends Cogn Sci. 2007;11(2):77–83. pmid:17188552
  24. 24. Tyler TR, Blader SL. (2003). The group engagement model: procedural justice, social identity, and cooperative behavior. Pers Soc Psychol Rev. 2003;7(4):349–61. pmid:14633471
  25. 25. Charlton BG. Why are modern scientists so dull? How science selects for perseverance and sociability at the expense of intelligence and creativity. Med Hypotheses, 2009;72(3):237–43. pmid:19070437
  26. 26. Gibson J, Light P. Intelligence among university scientists. Nat. 1967; 213:441–3.
  27. 27. Mulder M. Conceptions of professional competence. In Billet S, Harteis C, Gruber H, editors. International handbook of research in professional and practice-based learning. Dordrecht: Springer Netherlands; 2014. pp. 107–37.
  28. 28. Fanelli D. “Positive” results increase down the hierarchy of the sciences. PLoS One. 2010;5(4): e10068. pmid:20383332
  29. 29. Strang V. Integrating the social and natural sciences in environmental research: a discussion paper. Environ Devel Sustain. 2009;11(1): 1–18.
  30. 30. Nunes PALD, van den Bergh JCJM. Economic valuation of biodiversity: sense or nonsense? Ecol Econ. 2001;39(2):203–22.
  31. 31. Lupia A. (2014). What is the value of social science? Challenges for researchers and government funders. PS Polit Sci Polit. 2014;47(1):1–7.
  32. 32. Redelsheimer CL, Boldenow R, Marshall P. Adding value to the profession: the role of accreditation. J For. 2015;113(6):566–570.
  33. 33. Gieryn TF. The U.S. congress demarcates natural science and social science (twice). In: Cultural boundaries of science: credibility on the line. Chicago: University of Chicago Press; 1999. pp. 65–114.
  34. 34. Award summary; 2018 [cited 19 November 2018]. Database: National Science Foundation [Internet]. Available from: https://dellweb.bfa.nsf.gov/AwdLst2/default.asp
  35. 35. Lahsen M. Toward a sustainable future earth: challenges for a research agenda. Sci Technol Human Values. 2016;41(5):876–98.
  36. 36. Furnham A. Self-estimates of intelligence: culture and gender difference in self and other estimates of both general (g) and multiple intelligences. Pers Individ Dif. 2001;31(8):1381–1405.
  37. 37. Osborne J, Simon S, Collins S. Attitudes towards science: a review of the literature and its implications. Int J Sci Educ. 2003;25(9):1049–79.
  38. 38. Kahle JB, Lakes MK. (2003). The myth of equality in science classrooms. J Res Sci Teach. 1983;20(2):131–40.
  39. 39. Norris PE, O’Rourke M, Mayer AS, Halvorsen KE. Managing the wicked problem of transdisciplinary team formation in socio-ecological systems. Landsc Urban Plan. 2016;154:115–22.
  40. 40. Social science. Merriam-Webster. 2015. Available from: https://www.merriam-webster.com/dictionary/social_science
  41. 41. Natural science. Merriam-Webster. 2015. Available from: https://www.merriam-webster.com/dictionary/natural_science
  42. 42. Bartneck C, Kulić D, Croft E, Zoghbi S. Measurement instruments for the anthropomorphism, animacy, likeability, perceived intelligence, and perceived safety of robots. Int J Soc Robot. 2009;1(1):71–81.
  43. 43. Furr RM. Response formats and item writing. In: Scale construction and psychometrics for social and personality psychology. London: SAGE Publications Ltd; 2011. pp. 16–24.
  44. 44. Garland R. The MidPoint on a Rating Scale: Is it Desirable? Marketing Bulletin. 1991;2.
  45. 45. Leung SO. A comparison of psychometric properties and normality in 4-, 5-, 6-, and 11-Point Likert scales. J Soc Serv Res. 2011;37(4):412–21.
  46. 46. SPSS Inc. Version 22 [software]. IBM Corp. 2013 [cited 2016 April 7]. Available from: https://www.ibm.com/analytics/us/en/technology/spss/
  47. 47. Bates D, Mächler M, Bolker BM, Walker SC. Fitting linear mixed-effects models using lme4. J Stat Softw. 2015;67(1).
  48. 48. Vaske JJ, Shelby LB. Missing data, response patterns, and outliers. In: Survey research and analysis: Applications in parks, recreation, and human dimensions. State College, PA: Venture Publishing, Inc; 2008.
  49. 49. Women, minorities, and persons with disabilities in science and engineering; 2014 [cited 21 September 2017]. Database: National Science Foundation [Internet]. Available from: https://www.nsf.gov/statistics/2017/nsf17310/static/data/tab5-7.pdf
  50. 50. Russell SH, Hancock MP, McCullough J. Benefits of undergraduate research experiences. Science. 2007;316(5824):548–49 pmid:17463273
  51. 51. National Association of Colleges and Employers. Projected Top-Paid Math and Science Bachelor’s, Master’s Grads. NACE. 22 March 2017. Available from: http://www.naceweb.org/job-market/compensation/projected-top-paid-math-and-sciences-bachelors-masters-grads/
  52. 52. Field A. Discovering statistics using IBM SPSS statistics. 4th ed. Los Angeles:SAGE Publications, Inc.; 2013.
  53. 53. Cattell RB. The scree test for the number of factors. Multivariate Behav Res.1966;1(2):245–76. pmid:26828106
  54. 54. Tabachnick BG, Fidell LS. Using Multivariate Statistics. Boston:Allyn and Bacon.; 2001.
  55. 55. Smart and connected communities (S&CC). Program solicitation. Arlington (VA): National Science Foundation; 2016. Solicitation no.16–610.
  56. 56. Hinrichs MM, Seager TP, Tracy SJ, Hannah MA. Innovation in the knowledge age: implications for collaborative science. Environ Syst Decis. 2017;37:144–55.
  57. 57. Anderson AA, Scheufele DA, Brossard D, Corley EA. The role of media and deference to scientific authority in cultivating trust in sources of information about emerging technologies. Int J Public Opin R. 2011;24(2):225–37.
  58. 58. Rhoten D, Pfirman S. Women in interdisciplinary science: exploring preferences and consequences. Res Policy. 2007;36(1):56–75.
  59. 59. Bornstein RF. Exposure and affect: overview and meta-analysis of research, 1968–1987. Psychol Bull. 1989;106(2):265–89.
  60. 60. Zajonic RB. Attitudinal effects of mere exposure. J Pers Soc Psychol. 1968;9(2):1–27.
  61. 61. Serenko A, Bontis N. What’s familiar is excellent: the impact of exposure effect on perceived journal quality. J Informetr. 2011;5(1):219–223.
  62. 62. Stokols D. Training the next generation of transdisciplinarians. In O’Rourke M, Crowley S, Eigenbrode SD, Wulfhorst JD, editors. Enhancing communication & collaboration in interdisciplinary research. Thousand Oaks, CA: SAGE Publications, Inc.; 2014. p. 58–61.
  63. 63. Halvorsen KE, Knowlton JL, Mayer AS, Phifer CC, Martins T, Pischke EC, et al. A case study of strategies for fostering international, interdisciplinary research. J Environ Stud Sci. 2016;6:313–23.
  64. 64. Cheruvelil KS, Soranno PA, Weathers KC, Hanson PC, Goring SJ, Filstrup CT. Creating and maintaining high-performing collaborative research teams: the importance of diversity and interpersonal skills. Front Ecol Environ. 2014;12(1):31–8.