Scientific research in the 21st century is more data intensive and collaborative than in the past. It is important to study the data practices of researchers – data accessibility, discovery, re-use, preservation and, particularly, data sharing. Data sharing is a valuable part of the scientific method allowing for verification of results and extending research from prior results.
A total of 1329 scientists participated in this survey exploring current data sharing practices and perceptions of the barriers and enablers of data sharing. Scientists do not make their data electronically available to others for various reasons, including insufficient time and lack of funding. Most respondents are satisfied with their current processes for the initial and short-term parts of the data or research lifecycle (collecting their research data; searching for, describing or cataloging, analyzing, and short-term storage of their data) but are not satisfied with long-term data preservation. Many organizations do not provide support to their researchers for data management both in the short- and long-term. If certain conditions are met (such as formal citation and sharing reprints) respondents agree they are willing to share their data. There are also significant differences and approaches in data management practices based on primary funding agency, subject discipline, age, work focus, and world region.
Barriers to effective data sharing and preservation are deeply rooted in the practices and culture of the research process as well as the researchers themselves. New mandates for data management plans from NSF and other federal agencies and world-wide attention to the need to share and preserve data could lead to changes. Large scale programs, such as the NSF-sponsored DataNET (including projects like DataONE) will both bring attention and resources to the issue and make it easier for scientists to apply sound data management principles.
Citation: Tenopir C, Allard S, Douglass K, Aydinoglu AU, Wu L, Read E, et al. (2011) Data Sharing by Scientists: Practices and Perceptions. PLoS ONE 6(6): e21101. doi:10.1371/journal.pone.0021101
Editor: Cameron Neylon, Science and Technology Facilities Council, United Kingdom
Received: January 3, 2011; Accepted: May 20, 2011; Published: June 29, 2011
Copyright: © 2011 Tenopir et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: The project was funded as part of the National Science Foundation, Division of Cyberinfrastructure, Data Observation Network for Earth (DataONE) NSF award #0830944 under a Cooperative Agreement. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Data are the infrastructure of science. Sound data are critical as they form the basis for good scientific decisions, wise management and use of resources, and informed decision-making. Moreover, “science is becoming data intensive and collaborative” . The amount of data collected, analyzed, re-analyzed, and stored has increased enormously due to developments in computational simulation and modeling, automated data acquisition, and communication technologies . Following the previous research paradigms (experimental, theoretical, and computational), this new era has been called “the fourth paradigm: data-intensive scientific discovery” where “all of the science literature is online, all of the science data is online, and they interoperate with each other” . Digital data are not only the outputs of research but provide inputs to new hypotheses, enabling new scientific insights and driving innovation .
As science becomes more data intensive and collaborative, data sharing becomes more important. Data sharing includes the deposition and preservation of data; however, it is primarily associated with providing access for use and reuse of data. Data sharing has many advantages, including:
- re-analysis of data helps verify results data, which is a key part of the scientific process;
- different interpretations or approaches to existing data contribute to scientific progress –especially in an interdisciplinary setting;
- well-managed, long-term preservation helps retain data integrity;
- when data is available, (re-)collection of data is minimized; thus, use of resources is optimized;
- data availability provides safeguards against misconduct related to data fabrication and falsification;
- replication studies serve as training tools for new generations of researchers ,,
Additionally, researchers, data managers and publishers in the PARSE survey overwhelmingly agreed that public funding was the most important reason for data preservation. Nearly all (98%) of participants agreed that if research is publicly funded, the results should become public property and therefore properly preserved .
This article reports the results of a survey of scientists' current data sharing practices and their perceptions of the barriers and enablers of data sharing. The survey was conducted by the research team of the National Science Foundation-funded DataONE project. DataNet supports short- and long-term data management and open access to data. DataONE is one of the initially funded NSF DataNet partners. DataONE is a large scale collaboration to develop an organization that supports the full information lifecycle of biological, ecological, and environmental data and tools to be used by researchers, educators, students, decision-makers and the general public. DataONE “will ensure the preservation and access to multi-scale, multi-discipline, and multi-national science data”  by developing a strong cyberinfrastructure and community engagement programs.
DataONE will (i) provide coordinated access to current data collections; (ii) create a new global cyberinfrastructure that contains both biological and environmental data coming from different resources (research networks, environmental observatories, individual scientists, and citizen scientists); and (iii) change the science culture and institutions by providing education and training, engaging citizens in science, and building global communities of practice. In order to facilitate change of the science culture through cyberinfrastructure for data, it is necessary to first understand the culture of modern science and the role of data in it.
Encouraging data sharing and reuse begins with good data practices in all phases of the data lifecycle such as generating and collecting the data, managing the data, analyzing the data, and sharing it. However, the data lifecycle cannot be considered independently from research lifecycle , as data are an indispensible element of scientific research. (See Figure 1.)
The specific costs of handling supplementary materials such as datasets are not well documented. In a recent survey, only author fees and journal subscription fees were mentioned as current funding sources for supplementary materials in journals. Participants in the survey suggested other potential sources for funding, in particular government funding, support from learned societies, and publishers .
Data Sharing/Withholding Practices
Data sharing is important. According to a study done by Publishing Research Consortium (PRC) in 2010 with 3823 respondents, access to datasets, data models, and algorithms & programs was ranked important or highly important; however, only 38% of them felt that they were easily accessible . In addition, it was the lowest among the other information types (some of them were research articles in journals, reference works, technical information, patent information, etc.). Several previous surveys have explored the benefits and barriers of sharing data  and the extent to which researchers share or withhold data. Results seem to suggest that current sharing practices are minimal, although the amount of data sharing varies among different fields. Some journals have specific guidelines which require authors to share their data with other researchers. However, the extent to which these guidelines are carried out remains largely untested. Savage and Vickers requested data from ten researchers who had published articles in PLoS journals, which have specific data sharing policies. Only one author sent an original dataset . Although drawn from a small sample of researchers, these results strongly suggest that journal policies which require data sharing do not necessarily lead authors to make their datasets readily available to other researchers. The amount of data sharing or data hoarding also appears to vary according to the researcher's subject discipline.
Researchers who choose to withhold datasets often have specific reasons for doing so. Savage and Vickers noted reasons that include concerns about patient privacy (for medical fields), concerns about future publishing opportunities, and the desire to retain exclusive rights to data that had taken many years to produce . In Campbell's study of data sharing in genetics, the top reasons cited for withholding data were the amount of effort involved in accessing and sharing datasets and the protection of a colleague's or their own ability to publish . The decision to share or withhold data is often dependent upon the point of time in the publishing process at which the request is made. Campbell (2003) reported that nearly all (98.7%) of the technology transfer officers surveyed agreed that academic scientists should freely share data with other scientists after publication, while only 30.5% agreed that scientists should share data and materials before publication. The vast majority also believed that scientists should be more careful when sharing data with industry than with other academics . The PARSE Insight survey indicated that researchers who are reluctant to share data with others reported major concerns with legal issues, misuse of data, and incompatible data types . In a survey of geneticists and other life scientists, Campbell et al., found that withholding data may be more common in genetics and related fields. Reasons may include the increased scientific competitiveness of the field, as well as the opportunities for commercial applications. Respondents of the survey estimated that ten percent of their requests for information from other researchers in the field were denied . These results do not include other data practices which may also negatively affect the progress of science, such as significant delays in the fulfillment of requests, refusals to publicly present research findings, and the failure to discuss research with others . Disciplines or subdisciplines have their own culture of data-sharing. Some do better (geophysics, biodiversity, and astronomy) than others .
Individual Choice vs. Institutional Policies
The extent to which researchers share or withhold data is not primarily an individual choice. Underlying policies and practices have great influence on encouraging or inhibiting data sharing. Several researchers who failed to share their data in the study by Savage and Vickers, et al., claimed that it would take too much work to provide raw data. The authors came to the conclusion that researchers often fail to develop clear, well-annotated datasets to accompany their research (i.e., metadata), and may lose access and understanding of the original dataset over time. Vickers, et al. believe that a policy that would require authors to submit datasets to journals or public repositories at the time of publication would help to prevent this occurrence . PARSE Insight, a project concerned with the preservation of digital information in research, reported from a survey of data managers that 64% claimed their organizations had policies and procedures in place to determine what kinds of data are accepted for storage and preservation, with specific policies for the time frame and method of submission. Though this number constitutes a majority, 32% reported a lack of such policies or procedures .
Policies and procedures sometimes serve as an active rather than passive barrier to data sharing. Campbell et al. (2003) reported that government agencies often have strict policies about secrecy for some publicly funded research. In a survey of 79 technology transfer officers in American universities, 93% reported that their institution had a formal policy that required researchers to file an invention disclosure before seeking to commercialize research results. About one-half of the participants reported institutional policies that prohibited the dissemination of biomaterials without a material transfer agreement, which have become so complex and demanding that they inhibit sharing .
Increasing the efficiency of current data practices in a world of increased data challenges requires a new comprehensive approach to data policy and practice. This approach would seek to avoid data loss, data deluge, poor data practices, scattered data, etc., and thus make better use of (public) funds and resources. NSF recently took action by announcing that all proposals to NSF involving data collection must include a data management plan  so that “digital data are routinely deposited in well-documented form, are regularly and easily consulted and analyzed by specialist and non-specialist alike, are openly accessible while suitably protected, and are reliably preserved” . Similarly, the European Commission invited its member states to develop policies to implement access, dissemination, and preservation for scientific knowledge and data  .
Data Sharing Tools
The life sciences and other fields rely on observational data and the situation is growing increasingly complex as data is used for advanced modeling which also creates new datasets. Paton, in an analysis of the management of experimental data in the life sciences, noted that several standards bodies are beginning to make use of common foundation models, most notably the FuGE (Functional Genomics Experiment), which provides consistency in practice among scientific communities. Also, minimum information guidelines already exist in the systems biology community. For example, the widely used Systems Biology Markup Language provides a format by which models can be shared. In addition, a Systems Biology Ontology is under development. These standards have received consistent support from software tools, public repositories, and journals. Information guidelines for other disciplines are not yet as structured. Many disciplines, particularly experimentally-based disciplines, lack accepted standards for their research activities . The Dryad project, a digital repository for the publication of scientific data, reported in a 2010 survey that of 12 journal publishers, several journals require authors to deposit some form of data into existing databases. However, few policies specifically address metadata, long-term preservation, or access for supplementary materials .
The development of cyberinfrastructure will play a major role in the future sharing of data. Participants in the PARSE survey named lack of sustainable hardware, software, and support of computer environment as the most important threats to digital preservation. The majority of researchers, data managers, and publishers who participated in the survey believed that an international infrastructure for data preservation should be built . Data needs to be stored and organized in a way that will allow researchers to access, share, and analyze the material. The Dryad Repository is attempting to address this need by providing users with the ability to access supplementary materials using search engines and perform advanced searches within datasets. Participants in their survey reported that the possibility of assigning Digital Object Identifiers (DOI's) to data in order to cite material was particularly appealing . Paton notes that few well established data integration infrastructures exist in the life sciences, and significant software development or tailoring activities are often carried out in-house in individual laboratories. The development of data standards may provide a foundation for cross-community collaboration in format and ontology development, making it much easier for laboratories to manage, integrate, and analyze data .
This international survey of scientists' data practices and perceptions has identified what scientists in many fields are doing now in terms of data collection, data use, storage, and reuse. In addition, the survey addresses questions related to perceptions of barriers that may hinder data sharing and reuse. The solutions to increased data sharing will be the result of overcoming these barriers, including those relating to perceptions and motivations of scientists, availability of appropriate tools, and a cyberinfrastructure that makes sharing possible. DataONE hopes to eventually help provide viable solutions.
The University of Tennessee Human Subjects Institutional Review Board approved this study as an online survey with the anonymity of respondents protected. No identifying questions were asked and this paper reports the findings in the aggregate. The survey was open for responses from October 27, 2009 to July 31, 2010. Initially, the investigators used a snowball sampling method. Investigators sent an email cover letter to DataONE team members (about 35 individuals throughout the world, but primarily in the United States). The letter contained a survey link that members distributed to others who could champion the effort to distribute the link inside academic and research organizations. Federal agencies that manage and produce large amounts of research data were also targeted for participation. In an academic setting, this champion could be a dean or department-chairperson who would circulate the link to faculty, lecturers, post doctoral research associates, graduate students, and undergraduate students. At a research facility, this champion could be a research director who would circulate the link to researchers in the organization. A number of DataONE team members acted as champions inside their respective organizations.
In March 2010 investigators began targeting the survey to universities in states with the lowest number of responses to date. This helped increase the breadth of the sample. To increase international response, surveys were sent by an academic publisher to its database of over 7,000 previous authors. Given the electronic distribution method, there is no way of knowing the total number of survey link recipients. Ultimately, 1329 respondents answered at least one question. It is not unreasonable to estimate that the survey instrument reached 15,000 people, in which case the response rate is approximately 9%.
The survey instrument consisted of two sections: questions about demographics and questions about scientists' relationship with data. A complete version is found in the Appendix S1.
Subjects were asked their age and gender, the sector they work in, their subject discipline, their professional position, their primary funding agency, and their primary country of employment. If employed in the U.S., respondents were also asked to indicate their state. In order to measure differences in data practices between respondents who focus most of their work time on research and those who spend more time on teaching, administration, or other duties, respondents were asked to estimate the percent of their work time spent on various activities.
To discover respondents' data practices, perceptions, and attitudes, several different types of questions were asked. Respondents were asked to what degree they agree or disagree with a series of statements, in addition to some yes/no and open-ended questions. Each question or statement explored a different aspect of data issues: the type of data used; whether they are available to others (if yes, how and if no, why); collection and use of research data; the relationship between their organization and their data; the use of data across their respective research field; views on data sharing and fair exchange of data; responsibility for their data; and the relationship between their funding agency and their data. Yes/No questions were about the conditions for a fair exchange for the use of data (respondents using other people's data and other people using respondents' data). Such conditions include receiving co-authorship, having the opportunity to collaborate, recovering costs of data acquisition, retrieval or provision, obtaining legal permission, etc. There were two open-ended questions. One was about additional approvals for others to access data the provider's data and the other asked for additional comments, questions, or suggestions about use of data. Also, when the choices that were provided in the answer did not accurately represent the respondent's condition, the respondent was asked to describe the condition in an “other” category.
Results and Discussion
This findings section begins by providing an overview of respondent characteristics. It then provides a detailed look at several key data practice concepts addressed in the study – data use, data practices, data management support and policies, data reuse and, most importantly, data sharing. The final section of the findings looks at two key concepts, data reuse and data sharing by different demographic groups, including primary funding source, subject discipline, age of researcher, primary activity of researcher, and location of researcher.
Demographics of Respondents
Seventy-nine percent (79%) of respondents indicated they spend 50% or more of their time on research which were designated as “research intensive” respondents. Twenty-one percent spend 50% or more of their time on teaching which were designated as “teaching intensive” respondents. Most respondents are academics who split their time between research, teaching, administration, and other activities. The majority of respondents (80%) work in academic institutions, 13% work in government, and the rest work in commercial, non-profit or other settings (see Table 1).
Since most of the respondents come from academic institutions, it is not surprising that 47% of respondents hold the academic titles (or equivalent) of assistant professor (10.5%, n = 137), associate professor (14.3%, n = 187) or professor (22.2%, n = 291). The next most common position is researcher (21.1%, n = 276) or student (graduate student 13.5%, n = 177).
Respondents represent a variety of science and social science subject disciplines, with most from the DataONE target disciplines, environmental sciences and ecology (36%, n = 475). The breakdown of respondents by disciplines is provided in Table 2.
Nearly three quarters (73%, n = 930) of the respondents are from North America, 15% (n = 188) are from Europe, and 7.3% (n = 94) are from Asia/Oceania. Of the U.S. respondents, 36% (n = 301) are from the South, 26% (n = 220) are from the Midwest, 25% (n = 207) are from the West, and 14% (n = 121) are from the Northeast.
Of the respondents who provided their ages, 38% (n = 453) are between 20 and 39 years old, 30% (n = 359) are between 40 and 50 years old, and 33% (n = 393) are over 50, for a mean age of 44.8 Two thirds of the respondents are male and one third are female.
Current Data Practices
It is important to note that the survey predated NSF's requirement for data management plans. Beginning on January 18, 2011 proposals submitted to NSF must include a data management plan. At the time of the survey, NSF did not require such plans for its funded projects. When respondents were asked whether their primary funding agency requires them to provide a data management plan, more than half (55%) reported no, 29% yes, and 16% said they do not know.
Some respondents currently access data from local, national or international networks. The most commonly used are organization-specific systems (39%) and the Long-term Ecological Research Network (LTER) (32%). Respondents could select more than one source (see Table 3).
Respondents reported that they use various types of data in their research, including experimental data, observational data, data models, abiotic surveys, and biotic surveys. Many respondents use more than one data type. The responses for the various types of data used are presented in Table 4.
A majority of the respondents are satisfied with their current processes for most of the initial and short-term parts of the research and data lifecycle, including collecting their research data, searching for their data, analyzing their data, and short-term storage of their data. A smaller majority say they are satisfied with cataloging or describing their data (59.8% agree strongly or somewhat). However, the satisfaction rate for the process of storing their data beyond the life of the project (long-term) is much lower than the short-term, only 45% versus 73%. More than a third (35%) of the respondents stated that they are dissatisfied with the long-term storage process (see Table 5).
Effective data management and use relies on effective tools. A series of questions about satisfaction with tools for all aspects of the data lifecycle reveal some variation in satisfaction (see Table 6). Only about a quarter (26%) of the respondents is satisfied with the tools for preparing metadata, while over 32% are dissatisfied. The large number of respondents who replied that they neither agree nor disagree (42%) could be interpreted in two ways: either they truly are indifferent or they are unsure about what metadata means. There is some reason to believe that the latter is true as nearly half (46%) of the respondents answered “none” to the question “What metadata do you currently use to describe your data?” Forty two percent reported that they are satisfied with the tools for preparing their documentation; however, 31% indicated that they neither agree nor disagree. Clearly, there is room for more effective tools and education as it applies to metadata concepts and principles as a component of data management.
Data management support and policies.
Institutions can help or hinder good data management. Policies and assistance with data management across the data lifecycle vary among institutions. While 43% of the respondents agreed that their organization or project has a formal established process for managing data during the life of the project, almost half (47%) of the respondents disagreed with the statement that their organization or project has a formal established process for storing data beyond the life of the project. Only 38% of the respondents reported that they have a formal established process for storing data long-term, while 45% of the respondents replied that their organization provides, to a degree, the necessary tools and technical support for data management during the life of the project (short-term). Only one third (35%) of the respondents are provided with the necessary tools and technical support for long-term data management.
Nearly half (48%) of the respondents reported that their organization or project does not provide the necessary funds to support data management during the life of a research project. More than half (59%) indicated that their organization or the project does not provide training on best practices for data management. Also, 59% of the respondents replied that their organization or project does not provide the necessary funds to support data management beyond the life of the project (see Table 7). Institution and Agency initiatives, including efforts like DataONE, can greatly improve these results.
We asked respondents about their views on the use of data across their research field. Note that this measures their perceptions or opinions and does not necessarily completely reflect actual practice. Still, the level of agreement or disagreement with these statements reveals many psychological barriers to good data sharing practice.
Respondents were asked their agreement on a five-point scale to a series of statements (see Table 8). Nearly two thirds (67%) of the respondents agreed that lack of access to data generated by other researchers or institutions is a major impediment to progress in science. Half (50%) of the respondents reported that lack of access to data generated by other researcher or institution has restricted their ability to answer scientific questions. Three quarters (75%) of the respondents replied that data may be misinterpreted due to complexity of the data across their research field and 71% of the respondents agree that data may be misinterpreted due to poor quality of data across their research field. Nearly three quarters (74%) of the respondents believe that data may be used in other ways than intended across their research field.
Respondents were asked to indicate whether they have the sole responsibility for approving access to their data. Of those who answered this question, 43% (n = 545) have the sole responsibility for all their datasets, 37% (n = 466) have for some of their datasets, and 21% (n = 266) do not have the sole responsibility.
Adding descriptive metadata to datasets helps makes the dataset more accessible by others and into the future. Respondents were asked to indicate all metadata standards they currently use to describe their data. More than half of the respondents (56%) reported that they did not use any metadata standard and about 22% of respondents indicated they used their own lab metadata standard. This could be interpreted that over 78% of survey respondents either use no metadata or a local home grown metadata approach. Clearly, educational programs including workshops and providing easy tools for metadata training could improve this situation. Awareness of why metadata improves access to data and guidance on standards would both be beneficial. The metadata standards that are used by the participants are presented in Table 9.
Nearly one third of the respondents chose not to answer whether they make their data available to others. Of those who did respond, 46% reported they do not make their data electronically available to others. Almost as many reported that at least some of their data are available somehow, either on their organization's website, their own website, a national network, a global network, a personal website, or other (see Table 10). The high percentage of non-respondents to this question most likely indicates that data sharing is even lower than the numbers indicate. Furthermore, the less than 6% of scientists who are making “All” of their data available via some mechanism, tends to re-enforce the lack of data sharing within the communities surveyed.
Only about a third (36%) of the respondents agree that others can access their data easily, although three-quarters share their data with others (see Table 11). This shows there is a willingness to share data, but it is difficult to achieve or is done only on request.
Researchers cite many reasons why their data are not available electronically to others (see Table 12). The leading reason is insufficient time (54%), followed by lack of funding (40%). These problems are difficult to solve, but systems that make it quick and easy to share data without additional cost may help. Other reasons such as having no place to put the data (24%), lack of standards (20%), and “sponsor does not require” (17%) may be easier to resolve by subject or government initiatives or large scale projects such as DataONE and other DataNet partners. It is also important to note that only 14% of respondents stated that their data “Should not be Available”, which may bode well for the future of data sharing if logistics are resolved.
Regarding their attitudes towards data sharing, most of the respondents (85%) are interested in using other researchers' datasets, if those datasets are easily accessible. Of course, since only half of the respondents report that they make some of their data available to others and only about a third of them (36%) report their data is easily accessible, there is a major gap evident between desire and current possibility. Seventy-eight percent of the respondents said they are willing to place at least some their data into a central data repository with no restrictions.
Data repositories need to make accommodations for varying levels of security or access restrictions. When asked whether they were willing to place all of their data into a central data repository with no restrictions, 41% of the respondents were not willing to place all of their data. Nearly two thirds of the respondents (65%) reported that they would be more likely to make their data available if they could place conditions on access.
Less than half (45%) of the respondents are satisfied with their ability to integrate data from disparate sources to address research questions, yet 81% of them are willing to share data across a broad group of researchers who use data in different ways.
Along with the ability to place some restrictions on sharing for some of their data, the most important condition for sharing their data is to receive proper citation credit when others use their data. For 92% of the respondents, it is important that their data are cited when used by other researchers. Eighty-six percent of survey respondents also noted that it is appropriate to create new datasets from shared data. Most likely, this response relates directly to the overwhelming response for citing other researchers' data. The breakdown of this section is presented in Table 13.
The participants were asked a series of questions about whether they find it a fair condition for the use of their data when these conditions are met. Afterwards, they were presented with the same conditions and asked whether they find each a fair condition for the use of other people's data. Respondents do not differentiate much between what they consider fair conditions for use of others' data and fair conditions for use of their own data (see Table 14). Sixty-one percent of the respondents find it fair to use other people's data if they give them co-authorship on publications resulting from use of the data. A vast majority (93%) find it a fair condition to use other people's data if there is formal acknowledgement of the data providers and/or funding agencies in all disseminated work making use of the data and 95% of the respondents reported that they find it fair to use other people's data if there is formal citation of the data providers and/or funding agencies in all disseminated work making use of the data. Also, 81% percent of the respondents reported that it is fair to use other people's data if the provider has the opportunity to collaborate on the project (including, for example, consultation on analytic methods, interpretation of results, dissemination of research results, etc.).
A little more than the half (52%) of the respondents believe it is fair to disseminate results based (at least in part) on data without the data provider's approval. The respondents were asked whether it is a fair condition to use other people's data if at least part of the costs of data acquisition, retrieval or provision are recovered. Over two-thirds (69%) of them replied no, either indicating that paying for the costs of data does not include the right to use that data or that they do not believe that data users should be required to pay data creators.
Reviewing derivative works is important to many; 63% agree it is a fair condition to use other people's data if results based (at least in part) on the data are disseminated with the data provider having the opportunity to review, but not approve, the results and make suggestions or comments. In addition, 70% agree it is a fair condition to use other people's data if reprints of articles that make use of the data are provided to the data provider. Sixty-nine percent of the respondents find it fair to use other people's data if the data provider is given a complete list of all products that make use of the data, including articles, presentations, educational materials, etc. Nearly three quarters (72%) of the respondents find it fair to use other people's data if there is mutual agreement on reciprocal sharing of data.
Respondents were asked whether it is fair to use other people's data if legal permission for data use is obtained. This question is perhaps more important for researchers in corporate or other settings, where legal rights to data may be important. Slightly over half (54%) said no, indicating they feel it is not necessary or desirable to obtain legal permission. In another question, approximately two-thirds (67%) find it fair to use other people's data if the data provider is given and agrees to a statement of uses to which the data will be put.
Demographic Groups in Relation to Data Reuse and Sharing
Not all scientists share data equally or have the same perceptions of data sharing and reuse. We found significant differences based on subject discipline, age, work focus (whether scientists are more research-focused or teaching-focused), and world region (U.S., Europe, and rest of world).
Subject disciplines make a difference in respondents' data sharing and management practices and perceptions. Although the majority of the respondents to this survey came from the target areas of environmental, physical, or life sciences, responses also came from social sciences, engineering, medicine, and other disciplines.
Data use by subject discipline.
A majority of all respondents report they share their data with others, but respondents from the medical fields and social sciences are less likely to make their data electronically available to others (see Table 15). Conversely, atmospheric scientists report their data is the most available to others. Of the respondents from atmospheric science, 90% report they share their data with others and 85% of biologists report they share their data. Medicine (65%), computer science/engineering (64%), and social sciences (58%) report the least amount of sharing.
Nearly three quarters (76%) of the total respondents report they share their data on their organization's website, or the PI's website or on a global network. For medicine it is around one quarter (20% to 27%) and for social sciences around one third (30% to 37%). Regional networks are the least preferred method to make data electronically available to others by all subject disciplines.
With regard to making data available, differences across disciplines in willingness to share data is part of the picture; satisfaction with current practices that make integrating other people's data is another part. Atmospheric scientists (57%) are the most satisfied with their ability to integrate data from disparate sources to address research questions, while those in medicine are the least satisfied (37%). (These results should be interpreted cautiously due to fewer respondents in these fields.)
Although a majority of respondents in every discipline report that they share their data in some way with others, most do not believe that others can access their data easily (see Table 16). Atmospheric scientists agree with the statement “others can access my data easily” in the greatest numbers (49%).
Data practices by subject discipline.
A majority of all respondents are satisfied with the process for collecting research data, with respondents from biology (86%) and environment science & ecology (81%) reporting the most satisfaction with the process for collecting research data. Although there are some differences, over two-thirds of the respondents in every discipline are satisfied with the process for collecting data (see Table 17).
Many respondents neither agreed nor disagreed to questions about satisfaction with various tools. This is particularly true for metadata tools. The responses may indicate unfamiliarly with a function or tools for a function more than it indicates a moderate level of satisfaction. There is a statistically significant response based on subject discipline to satisfaction with two categories of tools–metadata and documentation tools. Less than half of the respondents are satisfied with the tools for preparing their documentation in all fields except medicine (58%) and computer science/engineering (50%).
Data management support and policies by subject discipline.
There is a significant difference based on subject discipline for how respondents' organizations are involved with data. In terms of having a formal established process for managing data during the life of the project, respondents from atmospheric science (54%) and environmental sciences & ecology (48%) report the most involvement, whereas social sciences (38%) report the least.
One-half of the respondents from atmospheric science agree the most that their organizations have a formal established process for managing data beyond the life of the project. As with short-term data management during the life of the project, social sciences respondents report the lowest percentage (33%) of those who have formal, established processes for managing data beyond the life of a project. The computer science/engineering (34%), biology (35%), and medical respondents (35.5%) are also on the lower end.
Although the responses from the medical disciplines were few, a larger percent of medical respondents (55%) agree that their organization or project provides the necessary tools and technical support for data management during the life of the project, closely followed by atmospheric science (53%). Medical respondents are also more likely to agree they have the necessary tools and technical support for data management in the long-term (42% agree).
In terms of being provided the necessary funds to support data management during the life of a research project, the fewest social scientists agree (23%), with the most agreement among atmospheric scientists (42%). A vast majority of respondents in all fields say they lack the necessary funds to support data management in the long term, with only 15% of social scientists reporting sufficient funds, and the rest of the disciplines clustering between 22% and 27%.
Data reuse by subject discipline.
Most respondents (at least 60% across disciplines) agree that lack of access to data generated by other researchers or institutions is a major impediment to progress in science. Social scientists (80%) agree at a higher rate than other respondents. Most environmental scientists & ecologists (78%) agree with the statement that data may be used in other ways than intended. The responses for data reuse by subject discipline are provided in Table 18.
Data sharing by subject discipline.
Approximately 60% to 90% of respondents in all disciplines agree with the statement that “they would use other researchers' datasets if their datasets were easily accessible” (see Table 19). Again, a majority of respondents in almost all disciplines, (72% to 92%) “would be willing to place at least some of their data into a central data repository with no restrictions”(except medicine respondents with just 47%).
Fewer “would be willing to place all of their data into a central data repository with no restrictions”. Only 41% to 52% respondents in most disciplines agree with this statement, with medicine (17%) and social sciences (32%) even less likely to agree. These disciplines are likely to have data that may be sensitive to human subject or ethical guidelines. If respondents could place conditions on access, they are more likely to make their data available. Including respondents from medicine, all values increased (between 58% and 71%). Clearly, systems for data deposit need to accommodate conditions and restrictions.
Other opinions on data sharing and data use also vary with subject discipline. Nearly all respondents in atmospheric science (94%) and environmental science & ecology (87%) say they are willing to share data across a broad group of researchers who use data in different ways. A majority of other disciplines are also willing to share, although there is a significant difference in willingness. The least willing to share among disciplines are respondents from computer science (68%) and medicine (70%).
Respondents from all disciplines (86%–100%) think it is important that their data are cited when used by other researchers. A majority of respondents (57%–83%) believe it is appropriate to create new datasets from shared data. The responses are presented in Table 20.
A majority of respondents in every discipline (52%–83%) think it is a fair exchange for others to use their data if it results in co-authorship on publications resulting from use of the data (see Table 21). Most of the respondents from medicine (93%) find it a fair exchange for others to use their data if there is opportunity to collaborate on the project. For the rest of the disciplines the values are between 72% and 85%.
A majority of medical respondents also agree that it is a fair exchange for others to use their data if results based (at least in part) on the data could not be disseminated in any format without the data provider's approval; it a fair exchange for others to use their data if at least part of the costs of data acquisition, retrieval or provision must be recovered; and it a fair exchange for others to use their data if legal permission for data use is obtained. Respondents in other disciplines are less likely to agree.
A majority of respondents from all fields find it a fair exchange for others to use their data if reprints of articles that make use of the data are provided to the data provider.
Results were similar for what is considered fair use of other's data (see Table 22).
Although there are significant differences in both practices and opinions about data sharing across disciplines, it is clear that data systems must accommodate restrictions or conditions for use and re-use. Most respondents are willing to share at least some of their data, if such conditions exist. Respondents in the sciences are generally more satisfied with current situations and willing to share than those in disciplines such as medicine or social sciences where human subjects or other restrictions may come into play with some datasets.
Data management support and policies by age.
There are some differences in responses based on age of respondent. Younger people are less likely to make their data available to others (either through their organization's website, PI's website, national site, or other sites.). People over 50 showed more interest in sharing data.
There are also some differences based on the respondents' ages, in perceptions of how their organization supports data management (see Table 23). Respondents age 40–50 are less likely to agree than other age groups that their organizations have processes for managing data during the life of the project and that their organizations provide the necessary tools and technical support for data management beyond the life of the project. Younger people (ages 20–39) indicate, more than people over 40, that their organizations provide the necessary funds to support data management during and beyond the life of a research project.
Data reuse by age.
Younger people were more likely to think lack of access to data is a major impediment to progress in science and has restricted their ability to answer scientific questions (see Table 24).
Data sharing by age.
A majority of all respondents indicate they are not willing to place all of their data in central repositories with no restrictions, but respondents over 50 (46%) are more willing to do so than 20–39 year olds (39%) and 40–50 year olds (38%). About three-fourths of the respondents from all age groups believe it is appropriate to create new datasets from shared data. On the other hand, 20–39 year olds (69%) are slightly more likely to agree to make their data available if they could place conditions on access than 40–50 year olds (66%) and respondents over 50 (59%). The responses are provided in Table 25.
The 20–39 year old respondents are more likely to consider as fair exchange for the use of their data the provision that the data provider is given a complete list of all products that make use of the data; and legal permission for data use is obtained (see Table 26).
Younger respondents are also more likely to consider certain conditions as fair exchange for the use of other people's data, including data provider is given a complete list of all products that make use of the data (74%); legal permission for data use is obtained (72%); and data provider is given and agrees to a statement of uses to which the data will be put (72%) (see Table 27).
Older respondents tend to have more responsibility for giving approval of data (52%). χ2 = 38.912, p = .000.
Younger respondents are less likely to agree to share all of their data without restrictions, but are more likely to agree they would share some as long as restrictions are in place. Some conditions for sharing are also desirable by all age groups, but more so by those in the 20–39 age group. Receiving a complete list of products making use of their data or agreeing to that use are just some of the enticements to sharing data. Since a majority of younger scholars agree that scientific progress is inhibited by lack of access to data, providing motivations and systems for sharing may help change behavior in the future.
Respondents were asked to report what percent of their time they spend on teaching, research, and other activities. Those who spend 50% or more of their time on teaching are recorded here as “teaching-intensive” (174 respondents), while those who spend 50% or more of their time on research are recoded as “research-intensive” (663 respondents). There are some differences between these groups in data sharing perceptions and practices.
Data sharing by activity.
Research-intensive respondents report they are more likely to make their data available to others on organization's websites and global network than teaching-intensive respondents (see Table 28). Both research-intensive respondents (74%) and teaching-intensive respondents (79%) showed a willingness to place at least some of their data into a central data repository with no restrictions and a willingness to share data across a broad group of researchers who use data in different ways, 77% and 83% respectively. This could be attributed to data management requirements by the funding organizations.
Research-intensive respondents (38%) agree more with the statement that “others can access my data easily” than were teaching-intensive respondents (26%) (see Table 29).
Data management support and policies by activity.
Research-intensive respondents, compared to teaching-intensive people, are more likely to work for organizations that have processes for managing data during the life of the project (47% compared to 27%), store data beyond the life of the project (43% compared to 20%), provide the necessary tools and technical support for data management during the life of the project (49% compared to 34%), provide the necessary tools and technical support for data management beyond the life of the project (40% compared to 24%), provide training on best practices for data management (24% compared to 14%), provide the necessary funds to support data management during the life of a research project (34% compared to 18%), and provide the necessary funds to support data management beyond the life of the project (26% compared to 11%) (see Table 30).
Although there are fewer significant differences in practices and opinions between research-intensive and teaching-intensive respondents than there are by discipline or age, some differences exist. Research-intensive respondents are more likely to share their data and are more likely to work in organizations that support a full range of data management processes. This may be due to the type of institution they work for (a research university versus a teaching college, for example) or to the perception of those who are more focused on research or both.
Although the majority of respondents are in North America (mostly the United States, with some also from Canada), about 15% are from Europe and 12.5% from other parts of the world. There are some significant differences in some perceptions and practices among these broad regions of the world.
Data practices by geographic location.
Researchers in North America report the most satisfaction in the process for collecting research data (82%) and storing data during the life of the project (short-term) (75%) (see Table 31).
Although a majority of respondents in all regions are dissatisfied with data management processes and tools, researchers in North America showed least satisfaction with the process for storing their data beyond the life of the project (long-term) and the tools for preparing metadata, whereas researchers in Europe showed least satisfaction with the tools for preparing their documentation. Researchers in other parts of the world (non-North America) are the most satisfied with the process for storing their data beyond the life of the project (long-term), the tools for preparing metadata; and the tools for preparing their documentation (see Table 32).
Data management support and policies by geographic location.
Researchers in other (non-North America/non-Europe) parts of the world agree more than the North American respondents and European respondents that their organizations provide a formal established process for managing the data during the life of the project (Other = 51%, North American = 43%, and European = 34%); storing data beyond the life of the project (47%, 39%, and 31%); training on best practices for data management (31%, 21%, and 16%); the necessary funds to support data management during the life of a research project (39%, 31%, and 24%); and the necessary funds to support data management beyond the life of the project (32%, 22%, and 13%). Researchers in Europe showed least agreement with these statements (see Table 33).
Data reuse by geographical location.
Researchers in other parts (non-North America/non-Europe) of the world are more likely to think that lack of access to data is a major impediment to progress in science (Other = 79%, Europe = 72%, and North America = 64%) and has restricted their ability to answer scientific questions (Other = 63%, Europe = 55%, and North America 47%. Researchers in North America were least likely to think so (see Table 34).
Researchers in North America showed most agreement that data may be misinterpreted due to complexity of the data (North America = 78%, Europe = 73%, and Other = 65%) and data may be used in other ways than intended (North America = 76%, Other = 68%, Europe = 67%).
Researchers in North America (84%) and Europe (84%), and other parts of the world (82%) all agree that they would use other researchers' datasets if their datasets were easily accessible.
Data sharing by geographic location.
Researchers in other parts of the world are most willing to place all of their data into a central data repository with no restrictions (53%); more likely to make their data available if they could place conditions on access (73%); and the most satisfied with their ability to integrate data from disparate sources to address research questions (58%). Researchers in Europe (36%) showed the least support for being willing to place all of their data in a central repository with no restrictions, whereas researchers in North American are least able to integrate data from disparate sources (42%) (see Table 35).
Non-North American/non-European, European, and North American respondents, are listed from most likely to least likely to consider certain conditions as fair exchange for the use of their data, regarding co-authorship on publications resulting from use of the data; opportunity to collaborate on the project; disseminating results based on the data with data provider's approval; recovering at least part of the costs of data acquisition, retrieval or provision; providing to the data provider the reprints of articles that make use of the data; obtaining legal permission for data use and mutual agreement on reciprocal sharing of data.
Researchers in other parts of the world, in North America, and in Europe, are from most likely to least likely to consider certain conditions as fair exchange for the use of their data, regarding formal acknowledgement of the data providers and/or funding agencies; with the data provider having the opportunity to review the results and make suggestions; giving data provider a complete list of all products that make use of the data, and giving data provider a statement of uses to which the data will be put (see Table 36).
Researchers in other parts of the world, Europe, and North America, are from most likely to least likely to consider certain conditions as fair exchange for the use of their data, regarding co-authorship on publications resulting from use of the data; formal citation of the data providers and/or funding agencies; opportunity to collaborate on the project; disseminating results based on the data with data provider's approval; providing to the data provider the reprints of articles that make use of the data; obtaining legal permission for data use, and mutual agreement on reciprocal sharing of data (see Table 37).
Researchers in North America are more likely to have sole responsibility for approving access to their data than those in Europe or other parts of the world, χ2 = 13.285, p = .010. Researchers in Other parts of the world report at the time (before NSF's data management plan requirement) that they are more likely to be required to provide a data management plan than were those in North America or in Europe, χ2 = 17.389, p = .002.
Geographic location summary.
The majority of the respondents to this survey were from North America (U.S. and Canada), but results suggest some differences based on geographic location of respondents. North American respondents are the most satisfied with short-term data storage, but least satisfied with long-term data storage. Respondents outside North America and Europe report more support from their organizations for data management. All agree (to varying degrees) that there should be some conditions for sharing and re-using data. Data management is a global issue and solutions must take into account the perceptions and practices of researchers world-wide.
A majority of respondents to this international survey of data practices are willing to share at least some of their data and re-use others' data pending certain conditions or restrictions on use. Getting credit through formal citation, obtaining copies of articles that use the data, and learning of products or publications that use the data are just some of the conditions that will help encourage data sharing.
Initiatives such as the DataNet partners in the United States and similar projects in other parts of the world can help build the infrastructure, policies, and best practices that will encourage data sharing. Providing a secure but flexible cyberinfrastructure while promulgating best practices such as data citation and metadata use, will help to build confidence in data sharing.
Although there is currently some satisfaction with tools for data collection and analysis, there is less awareness and satisfaction with tools for metadata creation and preservation. Most scientists do not believe their organization is doing a sufficient job in helping them achieve long-term data preservation and many researchers are not currently using international metadata standards. In addition, the results imply that there is a lack of awareness about the importance of metadata among the scientific community –at least in practice– which is a serious problem as their involvement is quite crucial in dealing with problems regarding data management. Input and training modules must be a part of systems to assist scientists with preparing their data and datasets to be retrievable into the future. Adherence to formal metadata standards is crucial to retrieval effectiveness. Moreover, the problem of easy conversion between different metadata standards needs to be addressed. Systems must support a variety of metadata standards, so the appropriate standards for different subject disciplines or types of data are addressed, but adherence to these standards needs to be easily accomplished by users who have little time to learn the specifics of metadata standards. Systems must prompt users at the time of data deposition and convert input into required standards.
The findings from this survey are both similar to and different from the PARSE Insight study done in 2009. Both studies have similar sample size (∼1300); however half of the respondents for PARSE Insight were from EU countries whereas in our study 75% of were from North America . In both studies, various subject disciplines were represented, although physical sciences were the most represented in the PARSE Insight study and environmental sciences and ecology were most represented in the current study.
This study found the reasons scientists cite for not making their data electronically available to others were insufficient time and lack of funding, which is quite different from the PARSE Insight study, which found that legal issues and misuse of their data was labeled as their barrier for sharing. By packaging suites of services, perhaps efforts such as DataONE can reduce the time it takes researchers and the costs to organizations to post data.
In both our study and the PARSE Insight study, researchers reported that their ability to answer scientific questions was restricted because they could not access data generated by others. This is a serious concern since this reason is a major motivation for building a culture of data sharing, preservation, and use. Major scientific challenges of today, such as climate change and global warming can be better understood if datasets from across the sciences can be accessed and reused. Making it convenient for scientists to describe, deposit, and share their data and to access data from others, plus promulgating best data practices through education and awareness will help the future of science as well as the future of data preservation.
DataONE and similar efforts should pay close attention to organizational policies and resources. Respondents indicate satisfaction with those parts of the data lifecycle over which they can exert greater, individual control such as data collection, data description, data searching, and data documentation. These results suggest that organizations currently promote an individualized approach to science by neglecting critical practices and tools such as metadata.
Solutions and changing practices are not just a matter of time. The survey results suggest that younger scientists have special interests in protecting their data. One possible explanation may be their concerns about tenure and professional development.
Building a sound infrastructure for data sharing, preservation, and use is a challenge, but is in some ways easier than changing a culture. Subject discipline differences actually show that we are faced with multiple cultures. Researchers report many reasons why their data is not available electronically to others. The leading reasons were insufficient time and lack of funding. These are difficult to solve, but systems that make it quick and easy to share data without cost may help. Other reasons such as no place to put data, lack of standards, and sponsor does not require data sharing may be easier to resolve by federal initiatives or large scale projects such as DataONE and other DataNet partners.
Bill Michener, PI for DataONE, University of New Mexico; Patricia Cruse, California Digital Library; DataONE Baseline Assessment Ad Hoc Working Group. Also we would like to thank Dr. Jeff Houlahan of the University of New Brunswick for sharing his survey instrument which helped in the development of our survey.
Conceived and designed the experiments: CT SA KLD AUA LW ER MM MF. Performed the experiments: CT SA KLD AUA LW ER MM MF. Analyzed the data: CT SA KLD AUA LW ER MM MF. Wrote the paper: CT SA KLD AUA LW ER MM MF.
- 1. National Science Foundation. Press release 10-077 (2010) Scientists seeking NSF funding will soon be required to submit data management plans. Available: http://www.nsf.gov/news/news_summ.jsp?cntn_id=116928. Accessed 2010 Oct 2.
- 2. National Academies of Science,Committee on Ensuring the Utility and Integrity of Research Data in a Digital Age (2009) Ensuring the integrity, accessibility, and stewardship of research data in the digital age. Available: http://www.nap.edu/catalog.php?record_id=12615. Accessed 2010 Oct 5.
- 3. Hey T, Tansley S, Tole K (2009) The fourth paradigm: Data-intensive scientific discovery. s.l. Microsoft Cooperation. Available: http://research.microsoft.com/en-us/collaboration/fourthparadigm/4th_paradigm_book_complete_lr.pdf. Accessed 2010 Sep 20.
- 4. National Science Foundation, Office of Cyberinfrastructure Directorate for Computer & Information Science & Engineering (2008) Sustainable digital data preservation and access network partners (DataNet) program solicitation - NSF 07-601. Available: http://www.nsf.gov/funding/pgm_summ.jsp?pims_id=503141. Accessed 2010 Sep 22.
- 5. European Science Foundation (2007) Shared responsibilities in sharing research data: Policies and partnerships. Available: http://www.esf.org/index.php?eID=tx_nawsecuredl&u=0&file=fileadmin/be_user/CEO_Unit/Science_Policy/Sharing_Data/ESF_DOC_SHARINGDATA_V01ppp.pdf&t=1287487773&hash=89d4ad56d3544ba3edb68c1683369ed4. Accessed 2010 Oct 12.
- 6. Sieber JE (1991) Openness in the social sciences: Sharing data. Ethics & Behavior 1: 69–86.
- 7. Inter-University Consortium for Political and Social Research (2009) Guide to social science data preparation and archiving: Best practice throughout the data life cycle. Ann Arbor : University of Michigan. Available: http://www.icpsr.umich.edu/files/ICPSR/access/dataprep.pdf. Accessed 2010 Oct 10.
- 8. PARSE Insight (2009) Available: http://www.parse-insight.eu/downloads/PARSE-Insight_D3-4_SurveyReport_final_hq.pdf. Accessed 2010 Oct 12.
- 9. DataONE (2010) About. Available: http://www.dataone.org/about. Accessed 2010 Oct 28.
- 10. Joint Information Systems Committee (2010) How JISC is helping researchers. Available: http://www.jisc.ac.uk/whatwedo/campaigns/res3/jischelp.aspx. Accessed 2010 Oct 16.
- 11. Dryad. (2010) Dryad Sustainability Plan. Nescent. Available: https://nescent.org/wg/dryad/images/b/bf/Beagrie_suppdata_report_apr10.pdf. Accessed 2010 Oct 15.
- 12. Publishing Research Consortium (2010) Access vs. importance. Available: http://www.publishingresearch.net/documents/PRCAccessvsImportanceGlobalNov2010_000.pdf Accessed 2010 Dec 9.
- 13. Arzberger P, Schroeder P, Beaulieu A, Bowker G, Casey K, et al. (2004) Promoting access to public research data for scientific, economic, and social development. Data Sci J 3: 135–153.
- 14. Savage CJ, Vickers AJ (2009) Empirical study of data sharing by authors publishing in PLoS journals. PLoS ONE 4: e7078. doi:10.1371/journal.pone.0007078.
- 15. Campbell EG, Bendavid E (2003) Data-sharing and data-withholding in genetics and the life sciences: Results of a national survey of technology transfer officers. J of Health Care Law Policy 6: 241–255.
- 16. Campbell EG, Clarridge BR, Gokhale M, Birenbaum L, Hilgartner S, et al. (2002) Data withholding in academic genetics: evidence from a national survey. The J of the Am Med Assoc 287: 473–480.
- 17. Nelson B (2009) Empty archives. Nature 461: 160–163.
- 18. National Science Foundation (2007) NSF 07-28, Cyberinfrastructure Vision for 21st Century Discovery. National Science Foundation. Available: http://www.nsf.gov/pubs/2007/nsf0728/index.jsp. Accessed 2010 Sep 30.
- 19. Commission of the European Communities (2007) Available: http://ec.europa.eu/research/science-society/document_library/pdf_06/communication-022007_en.pdf. Accessed 2010 Oct 3.
- 20. Paton NW (2008) Managing and sharing experimental data: standards, tools and pitfalls. Biochem Soc Trans 36: 33–36.
- 21. Smit E, Van der Hoeven J, Giaretta D (2011) Avoiding a digital dark age for data: Why publishers should care about digital preservation. J of Learned Publishing 24: 35–49.