Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Factors influencing open government data post-adoption in the public sector: The perspective of data providers

  • Mimi Nurakmal Mustapa ,

    Contributed equally to this work with: Mimi Nurakmal Mustapa, Suraya Hamid, Fariza Hanum Md Nasaruddin

    Roles Conceptualization, Investigation, Writing – original draft

    Affiliation Faculty of Computer Science and Information Technology, Department of Information Systems, Universiti Malaya, Kuala Lumpur, Malaysia

  • Suraya Hamid ,

    Contributed equally to this work with: Mimi Nurakmal Mustapa, Suraya Hamid, Fariza Hanum Md Nasaruddin

    Roles Supervision, Validation

    suraya_hamid@um.edu.my

    Affiliation Faculty of Computer Science and Information Technology, Department of Information Systems, Universiti Malaya, Kuala Lumpur, Malaysia

  • Fariza Hanum Md Nasaruddin

    Contributed equally to this work with: Mimi Nurakmal Mustapa, Suraya Hamid, Fariza Hanum Md Nasaruddin

    Roles Supervision, Validation

    Affiliation Faculty of Computer Science and Information Technology, Department of Information Systems, Universiti Malaya, Kuala Lumpur, Malaysia

Abstract

Providing access to non-confidential government data to the public is one of the initiatives adopted by many governments today to embrace government transparency practices. The initiative of publishing non-confidential government data for the public to use and re-use without restrictions is known as Open Government Data (OGD). Nevertheless, after several years after its inception, the direction of OGD implementation remains uncertain. The extant literature on OGD adoption concentrates primarily on identifying factors influencing adoption decisions. Yet, studies on the underlying factors influencing OGD after the adoption phase are scarce. Based on these issues, this study investigated the post-adoption of OGD in the public sector, particularly the data provider agencies. The OGD post-adoption framework is crafted by anchoring the Technology–Organization–Environment (TOE) framework and the innovation adoption process theory. The data was collected from 266 government agencies in the Malaysian public sector. This study employed the partial least square-structural equation modeling as the statistical technique for factor analysis. The results indicate that two factors from the organizational context (top management support, organizational culture) and two from the technological context (complexity, relative advantage) have a significant contribution to the post-adoption of OGD in the public sector. The contribution of this study is threefold: theoretical, conceptual, and practical. This study contributed theoretically by introducing the post-adoption framework of OGD that comprises the acceptance, routinization, and infusion stages. As the majority of OGD adoption studies conclude their analysis at the adoption (decisions) phase, this study gives novel insight to extend the analysis into unexplored territory, specifically the post-adoption phase. Conceptually, this study presents two new factors in the environmental context to be explored in the OGD adoption study, namely, the data demand and incentives. The fact that data providers are not influenced by data requests from the agency’s external environment and incentive offerings is something that needs further investigation. In practicality, the findings of this study are anticipated to assist policymakers in strategizing for long-term OGD implementation from the data provider’s perspective. This effort is crucial to ensure that the OGD initiatives will be incorporated into the public sector’s service thrust and become one of the digital government services provided to the citizen.

1. Introduction

Over the past few decades, a growing number of nations across the globe have placed a significant emphasis on open government data (OGD), in part because of the benefits and potential value of OGD [1]. In this work, OGD can be defined as the non-confidential government data published in a machine-readable format on an online platform for the public to use, re-use, and dissemination without limitations or legal attachment [25]. There are countless benefits when government data and information are freely accessible. One of the highlight benefits from the political and social perspective of OGD is to increase the government’s transparency by allowing crucial data such as government spending and contracts to be scrutinized by the public [2,6,7]. From the economic perspective, OGD stimulates technology enthusiasts to develop innovation from the many types of available data, such as traffic, weather forecast, and consumer price index, among others [2,3,6,8]. These products indirectly benefit the public at large as the OGD beneficiaries. While from the operational perspective, OGD improves government service delivery by enabling the data to be re-used for integration between public and private data [8].

Nevertheless, OGD is not just about data per se, but it is regarded as an information system (IS) / information technology (IT) innovation that is new to the government [9,10]. The newness concept includes shifting the government’s openness culture and inadvertently changing the relationship between government and citizens to be more collaborative [9,11,12]. The government has invested a substantial amount of funds in IS/IT projects with the intention to improve government service delivery to the public. Like many others IS/IT innovations introduced in government, how the IS/IT innovation is governed plays a crucial role in determining the direction of innovation implementation. Some of these innovations are underutilized, misused, and neglected after a while. Such a situation can lead to failure to generate the desired benefits for the citizen and the government itself [13,14]. For instance, Ahmad and Othman [15] found that the response to e-Government implementation among government agencies slowly deteriorated after its adoption. Ramamurthy, et al. [16], in the same tone, advocated that more than half of data warehousing projects in major United States companies were plagued with many issues, although data warehousing has been prevalent for a long time.

In regard to OGD, there has not been much research on progress of OGD after its adoption. Only a handful of studies have demonstrated that the implementation of OGD was not nearly as successful as some individuals had hoped it would be. For example, Hossain, et al. [5] discovered that several government agencies struggled to show high performance in OGD initiatives due to a shortage of competent personnel, IT infrastructure, political commitment, and external influence. Simultaneously, Zuiderwijk and de Reuver [17] observed that OGD implementation in most countries did not achieve the intended objectives because of institutional barriers and lack of sustainability features. Furthermore, Huang, et al. [18] discovered that OGD implementation was still at the initiation stage compared to the success stories disseminated by the mass media. The study attributed the situation to the lack of effort in fostering the OGD culture in the government through its adoption. Hassandoust, et al. [19] suggested that one of the main reasons why organizations fail to fully reap the advantages of their investments in IS/IT is the under-utilization of the technology. This is due to, in many cases, opening up data began as part of a politically motivated effort rather than focusing on the main objective of OGD implementation [20,21]. In a similar case, Zhu [22] revealed that one of the earliest open data initiatives in the United States, JURIS, failed to achieve its goals due to a lack of social-political support. Another instance of undesirable consequences of OGD adoption was noted in Oliveira and Santos [23], when 43.2% of the Federal District Government of Brazil’s stakeholders believed OGD would have unfavorable effects. According to the most recent Open Data Barometer (ODB) report, the pioneer countries leading the OGD movement have lost traction in their contribution to the OGD initiative [24]. The report was aligned with the study from Luna-Reyes and Najafabadi [25] when the researchers mentioned that the OGD program in the United States had experienced a period of stagnation in the last couple of years. Moreover, the long-term success of OGD implementation is not a top priority for several government agencies [26]. These situations raise concerns about the sustainability of OGD implementation in the future. OGD sustainability denotes that government data continue to be routinely supplied and utilized at the same level as before [20].

Following the aforementioned issues, it is important to understand what factors contribute to OGD implementation after its adoption. In this study, the mentioned situation is referred to as post-adoption of OGD. The post-adoption of OGD is significant in order to ensure its long-term viability from the perspective of the data providers, which in this case are the government agencies. Since OGD has been widely adopted in various nations over the past few years, researchers shouldn’t stop at studying its widespread adoption; instead, they should also extensively analyse the repercussions of OGD. Moreover, with the global spread of the COVID-19 pandemic, the role of OGD in assisting policymakers to make decisions based on data has been increasingly significant. This study was conducted with the aim to identify the significant factors that influence OGD in the post-adoption phase. Specifically, this study attempted to answer the following research questions: (i) What are the factors that influence the post-adoption of OGD in the public sector? (ii) How is the readiness of the public sector to sustain the OGD implementation in their existing work system?

This paper is organized as follows. Section 2 overviews the literature pertaining to OGD, followed by the theoretical foundation for this study in Section 3. Thereafter, the research model and hypotheses construction are explained in Section 4. In Section 5, the methodology of the study is explicated, while the data analysis and results of this study are discussed in detail in Section 6. Section 7 presents the discussion of the study, accompanied by the managerial implication in Section 8. To further complement this study, the shortcomings and future studies of the research are outlined in Section 9. Finally, Section 10 concludes this study.

2. Open government data

The Open Data initiatives became a prominent interest among the government in early 2009 as the 44th President of the United States of America, Barack Obama, with his administration, initiated the idea of publishing government data to increase public trust in the government [27]. Scholars have been using the definition of “open data” as data that are freely accessible, used, re-used, and shared by anyone for any reason without restrictions [2,3,28]. Thereafter, the concept of open data was extended to government data to become the widely used term ‘Open Government Data’. Open Government Data (OGD) is the dissemination of data by government agencies via a specialized data portal; this data represents various government-related operations such as weather forecasts, real-time traffic updates, budget allocation, national statistics [3,29,30], and many more. The advancement of research in OGD has triggered scholars to characterize OGD initiatives as ‘ecosystems’ because OGD implementation should be a cyclical process rather just than a one-way initiative [8]. There are three main actors in the OGD ecosystem: the OGD provider, OGD user, and OGD beneficiaries. OGD providers refer to the stakeholders, particularly government bodies, who publish OGD on the online platform [31]. In comparison, OGD users could be independent individuals or organizations interested in accessing, manipulating, analyzing, re-using, and re-publishing open data [8]. In some situations, the OGD users and OGD providers could be the same entity, such as government agencies. This situation is because the government agency that publishes data also re-uses data from other agencies to produce more useful details. This study examined the latter role which is the OGD provider or, specifically, the government agency.

The adoption of OGD has been explored in various contexts, for instance, from the perspective of data users [32,33], citizen’s perception toward a data portal [34], a private business using OGD for innovation creation [35], or even from both the data user’s and data provider’s viewpoint [36]. It is undeniable that the research on OGD adoption from data providers’ view has been steadily growing, yet the majority of the research only focused on the adoption decision phase. The research on the phase following OGD adoption decisions, referred to as the post-adoption phase, is extremely scarce.

Centered on the innovation adoption process, the studies encapsulated in Table 1 mostly concentrated on the adoption decision phase of OGD in various adopting units. The initiation phase was not presented except in Maccani, et al. [37], partly because these studies were conducted in a developed nation with high IT-literate citizens, and thus, OGD initiation and creating awareness among government agencies were less crucial. Four studies highlighted the post-adoption phase of OGD [5,23,37,38]. Though the term these studies refer to is not specifically mentioned post-adoption, the objective of these studies was to investigate the OGD implementation or performance beyond adoption. It can be observed from Table 1 that most studies adopted the Diffusion of Innovation (DOI) and Technology-Organization-Environment (TOE) theory for organizational and country-level analysis. The DOI theory was introduced by Everett Rogers, a professor in rural sociology, in 1962 to describe how innovations propagate over time across participants in a social system [39]. At the same time, there are also some popular theories used by researchers in OGD adoption studies, such as the Technology Acceptance Model (TAM) and the Theory of Planned Behaviour (TPB). TAM has been extensively used to predict human behavior toward accepting the usage of IT [40]. While TPB asserts that an individual’s desire to engage in a particular activity is the primary factor in determining the individual’s actual execution of that behavior [41]. The Unified Theory of Acceptance and Use Technology (UTAUT) was introduced by Venkatesh, et al. [42] in which the researcher integrates eight significant models from the user acceptance field into a single unified model. In Table 1, UTAUT, TAM, and TPB were found in studies about individuals, such as data user’s behavior or intention in OGD adoption.

Although the studies in Table 1 have shed light on exploring OGD adoption, there is a lack of investigation into OGD in the post-adoption phase from the data provider’s perspective. It is possible to deduce from Table 1 that these studies conclude the OGD analysis once the adoption stage has been reached; nevertheless, it is not clear how OGD will be implemented in the longer term by most government agencies as the data providers. The situation is crucial because similar to data providers, government agencies must find a way to sustain OGD publications. Without new and updated OGD published online, data consumers may feel demotivated to innovate using OGD, and worse the existing data products utilizing OGD may face difficulties in sustaining.

3. Theoretical foundation

The organizational innovation research provides the ground for this study. The process for IT innovation adoption concerns a series of actions that an organization undertakes before introducing a new technology [54]. Over the years, the IT innovation adoption process has been studied in diverse stages or phases. The innovation adoption phase literature has been found describing the phases in terms of just two phases [55,56] to as many as eight phases [57]. It can be asserted that there is no consensus among innovation theorists on the number of phases for a technology-based innovation lifecycle to be spanned. Considering the dynamic attributes that the IT innovation possesses and the adopter’s perceived behavior, research on IT innovation adoption process has evolved implicitly through the body of knowledge from other disciplines. The next sub-sections describe the theoretical foundation of this study.

3.1 Innovation adoption process

The technologically oriented organizational innovation and adoption literature is based on the early paradigm of social change proposed by Lewin [58]. The process of change, according to Lewin’s model, is essentially a sequence of three steps: i) unfreezing, ii) moving (or changing), and iii) refreezing. The “unfreezing” phase trains the system for transition, learning new behavior trends in the movement of the organization or unit or agency, and assimilating the consequences of change. The moving or changing step refers to shifting a group or unit to learn newly acquired trends, and the outcome of the transition is assimilated [58]. The refreezing step allows certain behavioral habits to endure and become a lasting feature of the system [58].

In accordance with the evolution of the innovation adoption process, the innovation theorists have further discussed various stages of innovation adoption that lead to categorizing the innovation adoption process into multi-phases such as pre-adoption and post-adoption (continued usage) [59], initiation, adoption, and implementation [60], and initiation, adoption, implementation, and evaluation [61]. Studies by Kwon and Zmud [62] and Cooper and Zmud [63] suggested a six-stage IT implementation model, as presented in Table 2. Followingly, Damanpour and Schneider [64] suggested that the six-stage IT implementation model can be grouped into three broad phases, namely pre-adoption (initiation), adoption decisions (adoption, adaptation), and post-adoption (acceptance, routinization, infusion). The first phase is known as the pre-adoption or initiation phase, in which activities such as getting familiar with the innovation, planning to acquire the innovation, and proposing the innovation to be adopted take place [54,59]. The second adoption phase is the adoption (decision) phase, a mechanism that shifts from pre-adoption to defined adoption. In this phase, the personnel of an organization becomes conscious of an innovation and accesses knowledge that can help draw a decision on whether to accept or reject the innovation [59,64,65]. The third and final phase in the innovation adoption process is the post-adoption phase [59,64]. In the post-adoption phase, the adopter acquires the innovation and is set to be implemented or established until it becomes a regular feature in the adopter’s environment [54,56,64]. This indicates that implementation is one of the post-adoption activities, while post-adoption is the phase that happens after an innovation has been decided to adopt during the adoption (decision) phase [54,57,64]. After a certain period, an innovation that is considered new at the time of adoption loses its identity as it has been embedded in the organization’s task routine [54].

Following the innovation adoption process, this study resorted to using the post-adoption term to identify the consequences of OGD in data providers’ environments. The question raised by [39], “Why Haven’t Consequences Been Studied More?”, suggested that post-adoption is a pro-found area of study. The fact that there are various desirable or undesirable effects on adopters or the social system, thus widens the post-adoption study perspective. The undesirable consequences that could happen in the post-adoption phase include decommissioning, stagnant, discontinuation of innovation, and the like that goes beyond pro-innovation bias [39].

This study focuses on the post-adoption phase of the innovation adoption process. The model from Cooper and Zmud [63] helped establish a more profound knowledge of IT and operational problems throughout the implementation process. The model also forms the mechanism of IT-enabled organizational change and is relevant to the kind of IT innovation (OGD) and implementation background (public sector organization) in this research. Given that there is a relatively wide gap in OGD post-adoption studies, this study stands on the premise that OGD implementation is yet to be examined as a dependent variable in the post-adoption phase. With this notion, this study assessed whether the OGD implementation is progressing toward embedding the OGD in the public sector working system. Successful and beneficial adoption of an innovation is acknowledged when the innovation is put into practice and integrated into the organization [54,65,66].

3.2 Technology–Organization–Environment (TOE) framework

The theory of innovation adoption in an organization consists of a compilation of theories taken from several investigation fields that underlie much of the study of mechanisms of growth and technical progress [67]. Various studies have attempted to classify diverse influences as possible determinants of IT adoption in organizations. Wejnert [68] developed a system in which innovation adoption determinants were clustered into three key components: innovation characteristics, innovator characteristics, and environmental background. Similarly, Iacovou [69] structured the organizational readiness, benefits of the innovations, and external pressure in his framework for Electronic Data Interchange (EDI) in small businesses. However, Tornatzky, et al. [70] had the most recognized attempt to identify and categorize the determinants of technological innovation adoption in organizations in their book, The Process of Technological Innovation. Tornatzky, et al. [70] presented a framework for clustering the determinants of technological innovation adoption into three structural contexts that influence organizational innovation adoption and implementation decisions, namely the technology, organization, and environment (TOE). As a result, the TOE framework has become a prevalent theoretical perspective on IS/IT adoption [71]. This statement holds true in the OGD context, where a study conducted by Khurshid, et al. [72] has indicated that the TOE is the most utilized theory in OGD adoption research at the organizational level. In other studies, Hossain, et al. [5] posits that the TOE framework does not define explicit constructs making it adaptable across several IS/IT innovations thus receiving considerable attention in OGD adoption studies.

Additionally, the TOE framework addresses the requirement for more socioeconomic advancements and has received more substantial theoretical and empirical support in the IS domain [73] than many other adoption models [74]. According to Zhu, et al.’s [75] theoretical evaluation, the TOE framework is more important than Rogers’s [39] Innovation Diffusion Theory (IDT). The TOE framework’s technological and organizational environment mirrors that of IDT’s own, however, the TOE framework is is deemed more adequate for explaining technology adoption because it also incorporates environmental aspect as additional constructs [76].

The technology context represents the availability and characteristics of a particular technology. The organization context includes structured and informal systems of connections, coordination methods, scale, and slack of the organization. Lastly, the environmental context consists of business features and market structure, resources for technological support, and government regulation [70]. It may also contain an agency external to the company with relevant experience to assist in IS/IT adoption [77]. Nevertheless, the ability to modify the variables or measurements within each construct renders the TOE configuration highly flexible in a wide variety of IS/IT innovation [5,78]. Scholars have also found no reason for the principle itself to be modified. As the TOE paradigm contains variables and has great analytical influence in a broader sense, to expand and enrich theoretical lenses, Tornatzky, et al. [70] did not implement a fixed model and instead suggested combining the TOE framework with other theories [66,74,79]. Previous scholars have consistently focused on the variables within the TOE’s framework to improve its theoretical ground and empirical compliance.

In brief, TOE presents a viable method for researching organizational IS/IT implementation through a range of technologies. Various forms of innovations have diverse influences that affect their adoption. Likewise, different socioeconomic, geopolitical, or cultural backgrounds would often have varying influences [78]. The TOE framework extends the debate on implementation beyond a technical narrative and combines organizational and external viewpoints. Nevertheless, the framework’s technology, organization, and environment contexts raise both limitations and potential for innovation adoption in an organization [70].

The innovation adoption process theory provides advantages in understanding the dynamics of influences and adoption patterns in an organization. At the same time, the Technology-Organisation-Environment (TOE) shows equal strengths in a heterogeneity of use across organizations. However, the TOE framework has a low ability to explain the process of change (explanatory power) of innovation adoption. Considering the strengths and limitations of both models, the innovation adoption process and the TOE framework complement each other in presenting a comprehensive evaluation framework for OGD post-adoption in the Malaysian public sector.

4. Research model and hypothesis

OGD is regarded as new government innovation and can be conceptualized using the innovation adoption process [9]. Driven by the past literature, document analysis, and consultations with field experts, this study resorted to the TOE framework to model the OGD post-adoption framework attentively. Researchers have combined the DOI and innovation adoption process with different contextual frameworks to address OGD post-adoption in the public sector. This study employed a deductive approach in developing the theoretical framework. Deductive research is concerned with developing a hypothesis on existing theory and thus relies heavily on the theoretical framework to validate the hypothesis [80]. Although there is a less prescribed procedure for constructing a theoretical system proposed by deductive scholars, this study reflects most of the literature’s general measures.

There are numerous factors that can influence OGD post-adoption, but this study has identified eight factors as the independent constructs of OGD post-adoption. These constructs were gathered during the preliminary study through a series of semi-structured interview sessions with OGD stakeholders and were consolidated according to the TOE framework. The independent constructs are compatibility, complexity, relative advantage, organizational culture, top management support, IT competency, data demand, and incentives. On the other hand, three dependent constructs (acceptance, routinization, and infusion) were derived from the post-adoption phase of the innovation adoption process theory. The research model of this study is presented in Fig 1.

thumbnail
Fig 1. The research model for the OGD post-adoption framework in the public sector.

https://doi.org/10.1371/journal.pone.0276860.g001

4.1 Compatibility

Compatibility is described as the degree to which an invention is consistent with its business process, belief system, and culture [54,81]. Rogers [54] also stressed the importance of an innovation’s compatibility with an individual’s work responsibilities and value system in increasing the likelihood of its adoption. While Tornatzky and Klein [82] view compatibility as a multidimensional notion that includes normative or cognitive compatibility (i.e., how adopters perceive an innovation) as well as operational or practical compatibility (i.e., compatibility with what adopters do). In this study, compatibility is viewed as whether the OGD is aligned with the government agency’s norms in data management and sharing. For instance, Elixmann and Jarke [83] observed in their research that the OGD produces problems with the data management done by the public administration. Government agencies may lose authority and sovereignty over their data, which could lead to the data being incorrectly interpreted or utilized for harmful purposes. This relates to the idea that the person or organizational unit that collected the data is the exclusive owner of the information and has the right to use it in any way they see fit.

Moreover, government agencies do not have a culture that places a strong emphasis on errors; as a result, members of the administrative staff are motivated to take precautions to minimize the likelihood of making mistakes [83]. Additionally, the spirit of openness and disclosure that OGD promotes will prevail over the confidentiality practices employed by government agencies [83]. Government agencies perceived that the OGD policy is not aligned with the agency’s business procedure as all data are treated as classified data. However, some of the created data are crucial and should be shared with the public, such as facts relating to consumerism, the environment, or criminal activity, to mention a few. The combined understanding of OGD compatibility by these data providers is thus a very important aspect to be further investigated. Hence, the next hypothesis is suggested:

  1. H1: Compatibility positively influences OGD post-adoption in the public sector.

4.2 Complexity

Complexity may be referred to as the degree to which innovation is viewed as difficult to use and comprehend [54]. Innovations that are more challenging to implement are less likely to be taken up by organizations. Diffusion of complex innovations is common in organizations with low levels of expertise. As a result, the company is unable to fully benefit from the new innovation. In addition, the complexity of innovations results in increased resistance to change among users because of a lack of knowledge and skills on their part [84]. For example, in Kleiman, et al. [85], the civil servants perceived that data disclosure might be alarming if they believed that opening government is too complicated and convoluted or if they lack an understanding of the fundamental processes required to make data available to the public. In a similar vein, Elixmann and Jarke [83] discovered that the level of complexity of OGD implementation was one of the variables that contributed to the resistance to adhere to the open data policy in the German Public Administration. While the local study by Mustapa, et al. [86] highlighted the government agencies’ perceived complexity of OGD because of the certain processes before the data can be released, thus, publishing OGD is viewed as tediously complicated. The process mentioned includes the data required to be in a high granularity, anonymous, and readily in a machine-readable format. Choosing the appropriate data as an OGD is already a complex challenge for certain data providers because of the fear of releasing incorrect data. Hence, the next hypothesis is proposed:

  1. H2: The complexity of OGD negatively influences OGD post-adoption in the public sector.

4.3 Relative advantage

Relative advantage has been established as a major factor in multiple innovation adoption research at the organizational level [87]. By definition, the relative advantage is the degree to which innovation is considered beneficial and may offer advantages to the organization [39]. The relative advantage is generally expressed as the degree of perceived usefulness that innovation may bring to the organization, and thus, the relative advantage and perceived usefulness are used synonymously in the literature on innovation adoption [69,76]. Despite the fact that perceived usefulness and relative advantage seem to be pertinent to this study, researchers have pointed out their parallels [40,88]. Furthermore, Moore [88] contends that an innovation is often generated with the intention of serving a certain goal, and in order for it to be accepted, it must be viewed as serving this purpose to a greater degree than its predecessors did. As a result of its high generalizability, the idea of relative advantage carries with it an allure that is reminiscent of common sense. Given the instinctive enticement of Roger’s [39] concept and its frequent recurrence in the IT adoption’s body of research, the term relative advantage is chosen in this study.

Many studies have identified the benefits of OGD to society; however, little is known about whether OGD provides the same benefits to data provider organizations. For example, in Yang and Wu [89], the researchers found that the government agencies perceived that the OGD would give an advantage to the agency’s governance performance. With effective governance in place, the government agency would be able to prioritize which datasets can be made public and plan the next steps. The analysis by Yang and Wu [89] also revealed that the government agencies were concerned about whether the published datasets would attract the public to use them because unused datasets undermine the government agencies’ commitment to OGD. In order to find the equilibrium, it will therefore be anticipated that data providers perceived OGD post-adoption would provide benefits to the organization in the long term. Thus, the next hypothesis is formulated:

  1. H3: Relative advantage of OGD positively influences OGD post-adoption in the public sector.

4.4 Organizational culture

Organizational culture can be defined as a group of individuals who have the same convictions and awareness of challenges inside and beyond the organization [90]. The organizational culture in this research refers to the openness culture of data providers, which focuses on how they react to managing and sharing data openly. As Ke and Wei [91] described, the relationship between organizational culture and IS acceptance is extremely vital as it can lead to either resistance or modification of the IS to suit the organization’s culture. The organizational culture and OGD have a strong relationship as the former directly influences OGD publication [46]. Studies by Ruijer and Huff [92] and Yang and Wu [12] suggested that the government’s openness culture would be easier to encourage once the government agencies are prepared to exchange knowledge and data outside the agency itself. Additionally, Zhao and Fan [10] considered organizational culture an intangible asset because it may affect an agency’s awareness. In particular, scholars opine that a culture of openness should be fostered for open data to become the default standard for working procedures within the public sector [12,93]. However, there are cases where data providers seemed to be receptive to OGD but implicitly disregarded the initiative owing to the long-standing risk-avoidance culture instilled in the organization [2,94,95]. Study by Zhao, et al. [96] also denotes that organizational culture affect OGD implementation which stunted OGD performance in China. Such a scenario triggers the organizational culture to be investigated in the OGD post-adoption phase. Hence, the following hypothesis is posited:

  1. H4: Organizational culture positively influences OGD post-adoption in the public sector.

4.5 Top management support

A number of studies have shown that top management support is one of the most critical factors contributing to the effective introduction of IS/IT innovation in all adoption phases [97,98]. The top management support factor is essential in OGD post-adoption for three main reasons. First, top management support is vital to increase the effort and resources to build an atmosphere more favorable for the adoption of OGD [99,100]. A lack of resources is a common issue for the deployment of any innovation in the government agency, and this is where the top management roles are crucial for making important decisions on allocating the necessary resources [77]. Second, top management has the authority to circumvent subordinate resistance to OGD initiatives during the change management process. Third, top management is responsible for constructing an effective communication mechanism in promoting innovation adoption in the organization [78]. Weak coordination regarding the strategic advantages of innovation also contribute to resistance within the stakeholders of the organization to consider the adoption of innovation [101]. Additionally, the management level has the authority to decide which data sets can be published [5]. A study Wang and Lo [11] explored the top management factor as the most influential factor in the OGD adoption phase. Similarly, Hossain, et al. [5] examined management leadership as one of the positive factors in OGD initiative performance. It is essential to investigate if this factor continues to provide the same contribution in the post-adoption of OGD. The following hypothesis is thus suggested:

  1. H5: Top management support positively influences OGD post-adoption in the public sector.

4.6 Information technology competency

Information technology (IT) competency construct is an integrative concept that combines the organization’s human capital and physical resources [102]. In this regard, the human capital dimension describes the organization’s members’ experience, skills, and knowledge [97]. Simultaneously, the physical resources refer to the IT infrastructure used to implement OGD, such as a personal computer, servers, internet connection, and whatnot. The human capital and physical resource dimensions complement each other to portray the organization’s capacity to adopt innovation. Other terms used to reflect the same meaning of IT competency that has been adopted by other studies are IT expertise [103], technical competence [81,101], technical capacity [10], technological competence [104], and IT sophistication [98]. Previous research suggests that IT competency which is normally related to the infrastructure and human capability seems to be a significant factor in the adoption of innovation in an organization [97,105].

Handling OGD initiatives need a substantial amount of data processing effort, starting from collecting, cleaning, harmonizing, and formatting before the data can be published [5]. Hence, it is essential for the government staff in post-adoption of OGD to be IT competent to continuously support OGD. The IT competency factor has been highlighted as part of the key characteristics of a successful OGD implementation [5,25]. Furthermore, as posited by Janssen, et al. [2], insufficient knowledge and skills and unsuitable data infrastructure can cause many datasets to continue to be out of sight. The IT competency in this study aims to assess the government agency’s capability in IT infrastructure readiness and the technical skills, experiences, and knowledge of data providers personnel in running OGD initiatives. In accordance with the foregoing, the following hypothesis is proposed:

  1. H6: IT competency of the government staff positively influences OGD post-adoption in the public sector.

4.7 Data demand

Data demand is a new element learned during the meeting with government agency representatives. Data demand carries the meaning of data requests by the public for particular datasets that are related to the organization. Provided that the data are non-confidential, the public can request datasets through the government data portal by submitting a data request form. If a data consumer already knows which government agency provides the data they want, an email for data request is sent directly to the government agency. A study from [89], observed that data demand did play the role as the external driver for government agencies to publish data. In their study, Yang and Wu [89] assert that government agencies received pressure from various parties, including academia, non-profit organizations, and the public on social media, requesting the government to release data. Some social communities even put forward innovative ideas for using open data, which encourages government organizations to release more datasets [89]. This is corroborated by a study by Li and Chen [106], who discovered that the lack of external pressure on government bodies demotivated them from pursuing OGD initiatives. However, the OGD ecosystem in Malaysia’s public sector is highly supply-driven [107]. Undoubtedly, meeting the data demand from the interested parties can be quite challenging. Although occasionally, the requested data are categorized as open, the process of aligning the data to the OGD requirements is tiresome, thus hampering the government agency in fulfilling the request. However, a different narrative is manifested if data providers feel that releasing their data will benefit them. The data demand is seen as having a favorable impact on the post-adoption of OGD, but this is not yet supported by empirical studies. Consequently, the following hypothesis is proposed:

  1. H7: Demand for OGD from the public positively influences OGD post-adoption in the public sector.

4.8 Incentives

Incentives can be defined as any kind of recognition provided to a person or social system to encourage an explicit shift in behavior [39,108]. The “incentives” factor has been identified by Rogers [39] and Kulkarni, et al. [108] as a positive antecedent on influencing the adoption of innovation in the organization and increasing the rate of innovation adoption. In one of the findings by Rogers [39], providing incentives was also one of the organization’s strategies to secure adoption at a specific rate, but once the desired adoption rate was achieved, the incentives were discontinued. In addition, Kulkarni, et al. [108] indicated that incentives or any nonmonetary rewards are essential to encourage the successful implementation of knowledge management in an organization.

While in the OGD area, Shkabatur and Peled [38] asserted that a lack of incentives has led to a poor institutionalization of OGD in four developing countries, namely, the Philippines, Morocco, Moldova, and Kenya. The findings convey the impression that when prizes such as cash money, national recognition, or awards are offered as an appreciation for their involvement, government agencies appear to be more driven to OGD. The same sentiment was expressed by Devriendt, et al. [109] and Elixmann and Jarke [83], who suggested that the data owners were discouraged from sharing their data due to limited rewards. A study by Zhang, et al. [110] further underlined the importance of incentives, claiming that rewards for government officials may help to reduce resistance to OGD.

In this study, the incentives factor may come from the organization’s internal or external environment. The incentives include monetary or non-monetary rewards such as training opportunities, compliments, or recognition from the organization’s management to bring about a desired behavioral shift [39,111]. Furthermore, the involvement of government agencies in OGD initiatives was mostly voluntary; therefore, acknowledging their contributions is justified [112]. The incentives factor aims to investigate whether the incentives positively influence the post-adoption of OGD. Therefore, the following hypothesis is formulated:

  1. H8: Incentives positively influence OGD post-adoption in the public sector.

4.9 Acceptance

Acceptance is defined as the effort to bring the organization’s members to use or practice an IT/IS innovation [113]. In this study, OGD adoption is a decision made by the federal government system from the higher management level; hence, the OGD initiative is eventually expected to be adopted by government agencies at all levels. The OGD acceptance implies that the government agencies must be convinced to commit to OGD by considering the influence factors of organization, technology, and environmental characteristics. Numerous studies were discovered examining OGD acceptance from the OGD users’ perspective among various user groups such as academics, the public, journalists, app developers, and civil servants [30,32,33,114]. However, study on OGD acceptance among government agencies in the post-adoption phase is limited. The acceptance of OGD among government agencies in the post-adoption phase is important because it determines how OGD can be induced in the government agencies’ work norms.

Many researchers thought the adoption of a particular innovation would result in nothing but positive outcomes for its adopters. According to Rogers [39], the mentioned scenario is called pro-innovation bias. The truth is that not all innovation adoption in an organization reaches the desirable state [39]. This situation is perceptible for OGD as a handful of studies denote the resistance to OGD adoption from the data providers’ perspective [23,83,106]. At the same time, the barriers to OGD implementation by various government agencies [17,115,116] reflect that OGD has not fully been accepted by the data providers. The acceptability of OGD policies is significant as it defines the conduct of the government agencies in the next post-adoption phase. OGD acceptance within organizations is crucial as the desired results cannot be realized without functional support and commitment from the data providers [17]. Therefore, the following hypothesis is formulated:

  1. H9: OGD acceptance positively influences OGD routinization in the public sector.

4.10 Routinization

Routinization is referred to as the extent to which the innovation has been established and become part of the organization’s work systems [39,63]. Routinization is pursued after the acceptance stage in the post-adoption phase, which implies that the OGD cannot be in the normal practice of the public sector task function if it is not well received. At this stage, the innovation will also lose its identity and become a regular activity in the organization [39]. Some of the activities in routinization stage includes publishing OGD in a regular basis and has become a normal operation in government agency. Numerous obstacles can delay or halt the implementation of an innovation within an organization, and one of them is starting the innovation with overly large aims [39]. An organization that rushes to complete the implementation of an innovation may overlook critical stages in the innovation adoption process [39]. For instance, if the acceptance stage is rushed, the routinization stage might never occur because of the potential difficulties with the acceptance stage that might ensue. Nevertheless, in order to avoid a significant risk, the innovation adoption process must be implemented sequentially [39].

To the author’s knowledge, there has not yet been a study on the routinization of OGD from the point of view of data providers. A study by Dawes, et al. [8] has exhibited a strong commitment to OGD publication as a significant factor for a well-developed OGD ecosystem in the city of New York. Another work by Zuiderwijk, et al. [117] discussed and associated the consistent data dissemination practices in day-to-day activities as a success factor in open data implementation, but the study does not profoundly investigate routinizing OGD publication. By adhering to routinization activities, the publishing process of OGD across departments or agencies may be standardized, giving each government agency a consistent baseline to infuse OGD in their work’s norm. Hence, the next hypothesis is suggested:

  1. H10: OGD routinization positively influences OGD infusion in the public sector.

4.11 Infusion

Infusion is the process of embedding IS/IT into an adopter’s work system and leveraging its complete and fullest potential [118]. A few researchers have employed infusion as the highest degree stage in the implementation of IS/IT at the individual or organizational level. The majority of the studies in the literature have investigated infusion at the individual level [13,119,120], while only a few focused on infusion at the organizational level [16,19,121]. At an individual level, the infusion stage is keen to explore the extent of individuals’ use of technological innovation. In contrast, the infusion stage at the organizational level investigated how the IS/IT can be fully leveraged in order to gain benefits and positive impact. The infusion stage of IS/IT at an organizational level is crucial to ensure the long-term use and sustainability of the IS/IT. In addition, the infusion stage would prevent the IS/IT from becoming underutilized and obsolete. Furthermore, a number of studies accord that underutilization of IS/IT beyond adoption has been identified as one of the factors in organization failure to realize the full value of their IT investment [16,81,122].

In the context of this study, the infusion of OGD is viewed as embedding the OGD publication in the data providers’ work system. The OGD infusion is intended to ensure that OGD publishing occurs on a continual basis rather than as a one-time activity for data providers. This is because OGD must be sustained over an extended period of time in order to gain benefits and generate more value for the citizen [20,21]. Moreover, Zuiderwijk and de Reuver [17] found that lack of sustainability appears as the new concern to achieving OGD’s intended objective. However, no studies on the infusion of OGD from the standpoint of data providers have been conducted. Thus, this study views infusion as a crucial stage in OGD post-adoption toward sustainable and long-term implementation of OGD among data providers.

5. Methodology

The research framework for this study is dissected in two main phases. The first phase is called “exploration,” in which the initial factors of OGD in the post-adoption phase were gathered in a preliminary study. The second phase is referred to as the “development” phase, where the researcher develops the OGD post-adoption framework and the research instrument. The main works of the study were performed throughout the second phase. Fig 2 illustrates the research framework for this study.

During the exploration phase, a preliminary study was conducted by employing a semi-structured interview method with three high-ranked government officials from the central agency as the interview participants. Each of the interview sessions lasted about one hour and was voice-recorded for transcription. The interview participants were given a consent form and subject information sheet prior to the interview session. The participant was deemed to agree to give consent for the researcher to collect their personal data (Name, designation, signature, and date of signature) once the consent form was signed. In the subject information sheet, the participant was given a brief overview of the study, including an introduction and purpose of the study, study procedure, participant’s right in the study, and confidentiality of the participant’s details and answer. There was no privacy laws infringement as all personal details of the participants were not published elsewhere. The interview transcriptions were later analyzed using thematic analysis to extract meaningful information from each interviewee. The semi-structured interview goals were to explore the current state of OGD implementation and gather the initial factors of OGD implementation in Malaysia’s public sector. The output of this phase is the confirmation phase of OGD implementation in the Malaysian public sector and the initial factors that influence OGD post-adoption in Malaysia’s public sector. The interview scripts can be referred at S2 Appendix.

In the second phase, the critical work included designing two essential components of this study, namely, the research model and the research instrument. The former is essential to provide a descriptive representation of the theory use and the relationship between variables in the research model. It also provides a context for examining a problem or phenomenon, therefore constructing the rationale for developing the hypothesis [80]. Some scholars postulated that it is essential to combine more than one theoretical model to comprehend the phenomenon of IT adoption from a different viewpoint [76,123]. In addition, innovation theorists have suggested that the creation of a unifying innovation theory might not be feasible owing to the intrinsic variations across innovation types [124]. The innovation adoption in organization research has thus integrated adoption and implementation theories with frameworks from various contexts to assess innovation’s adoption.

In the second phase, development, the research instrument was developed. The measurement items or the constructs were gathered during the preliminary study in the exploration phase. The constructs were compared with previous studies that used the same TOE framework in investigating innovation adoption in an organization. A content validity procedure was performed with eight panels to ensure the validity of the research instrument. However, given its lengthy steps and results, the content validity procedure will not be explained in this paper. Data collection was performed after the research instrument was refined according to the content validity results. Following the data cleaning procedure, the partial least square-structure equation modeling (PLS-SEM) analysis was conducted using SmartPLS 3.0 [125] software.

5.1 Context of study

The main subjects of this study can be defined as the government agencies in the Malaysian public sector that have implemented OGD initiatives. The government of Malaysia adopted the OGD program in 2014 and has been actively pursuing it ever since. A central agency called the Malaysia Administration Modernization, and Management Planning Unit (MAMPU) is authorized by the federal government’s high-level management to spearhead the country’s OGD implementation. MAMPU is responsible for supervising the country’s policies and strategizing the OGD implementation nationally and globally. Subsequently, this mandate provides a clear path for the central agency to deploy OGD initiatives at the government agency from all levels. Among the task of MAMPU in OGD implementation is hosting the government open data web portal that can be accessed at www.data.gov.my. During the early phase of OGD adoption, less than two hundred datasets were published in the government open data portal. Some of the datasets were not in a machine-readable format, and to add to the setback, they could hardly be re-used using computer applications. As of today, there are more than 12,000 datasets from 18 different clusters have published their datasets. However, in recent years the publication rate of datasets in the government open data portal has dropped. This situation certainly raises questions about the direction of OGD in the post-adoption phase in Malaysia.

The population of the study is defined as the government agencies that play the role of data providers and are registered in the government open data portal, data.gov.my. Hence, simple random sampling was employed as the sampling technique for this study. In the simple random sampling technique, each of the population members has an equal chance of being selected to ensure that the sample is representative of the population [126]. The reason for choosing a simple random sampling technique was due to every single agency in the defined population having an equal probability of being chosen as the respondent. As a result, a government agency that has already adopted OGD was deemed appropriate as the respondent. A total of 671 data providers from all types of government agencies were listed as the user and furnished with full names and email addresses. The government data portal users were the respondent for this study as the person responsible for OGD implementation in their respective agencies. The representative should ideally be a senior officer such as a Chief Information Officer (CIO), Manager or Head of IT units, or a member of the IT Steering/Implementation committee or appointed open data champion or open data agent or person in charge that possess the knowledge of their agency’s practice and routine of OGD initiatives. Some agencies appoint an open data champion to be the corresponding personnel for matters pertaining to OGD initiatives. The type of government agency involved in this population includes the federal and state government, local authorities, statutory bodies from federal and state levels, and government link companies. According to Taherdoost [127], for the population around 600 to 700, the estimated sample size is 234 to 248, with a 95% confidence level and a 5% margin of error.

5.2 Data collection

Prior to the collection of primary data, the research instrument completed a content validity procedure and a pilot study. However, the content validity procedure and the pilot study scope were not included in this paper. The online research instrument was developed in a paid survey tool called Survey Monkey. The online research instrument was built in two language versions (Malay and English) to allow the respondents to choose the language they prefer the most.

Owing to the widespread use of the internet in everyday life, an online survey is the most convenient method for respondents to reply at their convenient location and time [128]. Conversely, the online survey enables the researcher to gather responses with less effort and more immediately. Furthermore, being a user of the government data portal requires the respondents to be computer-literate and use the internet most of the time at work. Therefore, there should be a minimal concern for the respondent to volunteer to answer the online survey. The respondents were invited to respond to the online survey through an email invitation. The respondents’ consent to participate in the online survey was obtained once the respondent answered the survey. The respondents were allowed to ignore the email invitation if they did not agree to participate. The respondents were also permitted to abandon the survey if they did not feel comfortable answering all questions. Personal details that were captured in the online survey form include respondents’ position in the agency, job title, gender, age, and service term. The respondents’ information was not used and shared for any other purpose except for this study; therefore, this study met the personal data and privacy laws. A cover letter was attached to explain the purpose of the study. The questionnaire of this study was developed in the close-ended type of questions and self-administered by the respondents. The final item measurement is shown in Table 3. The complete survey questionnaire is presented in the S1 Appendix.

Data collection was conducted for a period of two months. After the first four weeks, the first email reminder was sent to the respondents who had partially or had not been totally responsive to the survey. At the end of the survey period, a total of 294 (44%) government agencies responded to the online survey. However, after a data screening process, a total of 28 respondents did not complete the survey, making the total number of data that can be considered complete and eligible for further analysis to 266, or equal to 40% of the total number of the targeted government agency. Therefore, a valid N number for this study is 266 (N = 266). According to Sekaran and Bougie [80], the rules of thumb from Roscoe, et al. [130] can be applied to determine the appropriate sample size for a population under study. The researchers advocate the minimum sample size of 30% for a population larger than 30 and less than 500. Thus, the study hit a minimum of 40% of the population for a sample size of 251. This result justifies the rationale to perform the data analysis as the following procedure.

6. Data analysis and results

The primary data analysis was conducted by applying the Partial Least Square-Structured Equation Modeling (PLS-SEM) analysis technique using SMART-PLS software [125]. The PLS-SEM techniques are known as second-generation data analysis techniques that allow for modeling and testing of the relationship among multiple independent and dependent constructs, all at once [131]. Researchers who employ PLS-SEM analysis typically present their visual hypotheses and variables in a path model diagram [132]. The PLS-SEM path model is formed by two sub-models, namely, the measurement and structural models. The next sub-section explains both models.

6.1 Measurement model assessment

The measurement model or the outer model represents the relationship between latent variables (unobserved variables) and the indicators (observable variables). The measurement model specifies how the latent variables are measured. There are two different ways to measure latent variables, i.e., reflective or formative measurement. In the former, paths connecting constructs to indicators are directed toward the indicators [131]. The associations between the reflective construct and measured indicator variables are referred to as outer loadings [133]. In the formative constructs, paths connecting constructs to indicators are directed toward the constructs. The relationship between the formative constructs and measured indicator variables is referred to as weights [133].

Although the specification of constructs is based on construct conceptualization and the study’s objective, they are not always reflective or formative [134]. Instead, researchers may supply the theoretical reasoning with an empirical test called Confirmatory Tetrad Analysis (CTA) to determine the mode of the measurement model [135]. In order to use CTA, the constructs must at least have four indicators; otherwise, the CTA would not be evaluated [132]. This study assessed the CTA using the SmartPLS [125] software. Constructs with a significant p-value (p < 0.05) indicate that the construct should be modeled as formative, while constructs with a non-significant p-value suggest that the construct should be modeled as reflective. Table 4 provides the result of CTA for the measurement model.

As shown in Table 4, four constructs (Complexity, Data demand, IT Competency, and Routinization) have a significant p-value (p < 0.05), and there was a 0 value straddle between the confidence interval low adjustment and up adjustment [132]. However, given that this is the earliest study that explores the constructs specifically for OGD post-adoption, all constructs were modeled as reflective. In order to model constructs as formative, a thorough set of indicators that accurately reflect the construct’s domain is required and must be supported by prior research [131,132]. A crucial feature of formative indicators is that they cannot be substituted for one another, which is not the case for reflective indicators [132]. Important components of the structure would be omitted if the preceding observations were disregarded [131]. Fig 3 illustrates the constructs modeling in SmartPLS software. This study presents four different types of measurement model assessments in the following sub-section.

thumbnail
Fig 3. The formative and reflective constructs modeling in SmartPLS software.

https://doi.org/10.1371/journal.pone.0276860.g003

6.1.1 Internal consistency.

The internal reliability consistency measures whether all the indicators of a construct measure the same element. There are two tests for the internal consistency reliability test: Cronbach’s alpha and composite reliability (CR). Numerous studies have traditionally used Cronbach’s alpha (α) to measure the data’s internal consistency and reliability. However, many scholars suggest refraining from using Cronbach’s alpha test as it tends to provide a conservative measurement [136]. The alternative measurement of internal consistency reliability to Cronbach’s alpha is the CR test [137]. This is because Cronbach’s alpha’s limitations underestimate the true reliability of the constructs. The acceptable value of CR must be 0.7 or higher [137]. The result from Table 5 has indicated that the internal consistency reliability of all reflective latent variables has been established.

thumbnail
Table 5. Composite reality index and cronbach’s alpha in internal consistency assessment.

https://doi.org/10.1371/journal.pone.0276860.t005

6.1.2 Indicator reliability.

The indicator reliability refers to the size of the outer loading and demonstrates the proportion of indicator variance that is explained by the latent variable [138]. The aim of the indicator reliability test is to evaluate how an indicator or group of indicators is compatible with what is being measured [139]. As a basic rule of thumb, the uniform outer loading for an indicator should be 0.708 or higher to be retained in the PLS model [132]. The reason for the standard value of 0.708 is that the square of the indicator’s outer loading should contribute to the variance of the latent variable by at least 50%. Calculation of a squared 0.708 will result in 0.50 (50%), and for that reason, the outer loading should be higher than 0.708 to get more significant reliability. On the other hand, indicators are suggested to be eliminated from measurements models if their outer loadings within the PLS model are smaller than 0.4 [132,140]. The final iteration results for indicator reliability for this study are encapsulated in Table 5. As part of the measurement model evaluation, two items, DAD3 and OGC4, were removed after two iterations of the PLS algorithm analysis owing to low factor loadings (< 0.7). The rationale behind the retained items is to ensure that the average variance extracted (AVE) value exceeds the threshold value of 0.5. According to Hair Jr, et al. [132], although the rule of thumb suggests removing an item lower than the threshold value, nonetheless, if removing an item will cause the AVE value to drop below 0.5, then the item can be retained. Removing too many items should be followed by some consideration as it could also trigger some effects on the content validity of the constructs [132]. The results for indicator reliability assessment are presented in Table 6.

thumbnail
Table 6. Indicator loading index in indicator reliability assessment.

https://doi.org/10.1371/journal.pone.0276860.t006

6.1.3 Convergent validity.

Convergent validity quantifies the extent to which an indicator is positively correlated with other indicators from the same construct [139]. In updated works by Hair, et al. [134], the convergent validity is known as “average variance extracted,” which refers to the mean of all squared loadings from all indicators or items from a construct. In other words, AVE signifies whether indicators that are supposed to measure the same thing are highly correlated. Convergent validity is a necessary component of developing a valid construct. It is helpful in determining or finding the intensity of the relationship between two measures. One general thumb rule recommended that a latent variable should illustrate at least 50% of the variance of each indicator [131,132]. The rule means that the outer loading of an item from each construct should be above 0.708 as the squared number (0.7082) is equal to 0.50. The results for convergent validity and the factor loadings for each construct are presented in Table 7. All constructs achieved convergent validity with AVE above 0.5 after the low factor loading was removed in the indicator reliability assessment.

6.1.4 Discriminant validity.

Discriminant validity is an essential assessment as it examines whether the investigated constructs are genuinely distinct from one another [131]. There are three forms of standards techniques to determine discriminant validity, namely i) cross-loading criterion, ii) Fornell and Larcker’s (1981) criterion, and iii) Heterotrait-Monotrait ratio of correlations (HTMT).

The loadings for indicators for allocated latent variables should be greater than the loadings for all other latent variables under the cross-loading criterion. Chin [141] asserted that there must be no less than 0.1 variations in loading between latent variables. If each loading indicator is higher than the other constructs for its assigned construct, it can be claimed that the indicators are not replaceable with other constructs [131]. The results for the cross-loading criterion are presented in S1A Table in S1 Table. All the diagonal values of cross-loading for each block of the indicator are higher than other indicators. Hence, the data comply with the first discriminant validity assessment.

The second discriminant validity assessment is called Fornell–Larcker’s criterion [142]. In this assessment, a latent variable explains more of the variance in its own indicators than other latent variables. The Fornell–Larcker’s criterion can be analyzed by looking at the diagonal value of each latent variable. The results are depicted in S1B Table in S1 Table. The result indicates that the square root of AVE for each construct is greater than the inter-construct correlation. Thence, the result adds to the discriminant validity evidence of this study.

To further evaluate the discriminant validity using the HTMT criterion, a bootstrapping technique was performed. It is a resampling technique of original data in which the data are selected randomly to perform a calculation [143]. The result produces a slightly different value as the procedure is repeated to create a substantial number of samples. The typical bootstrapping iteration creates about 5,000 subsamples to estimate the standard error. The purpose of conducting the HTMT bootstrapping technique is to check whether the confidence interval’s lower and upper bound contains the value of 1. If the confidence interval’s range is found to stand between 1, it indicates that the data lack discriminant validity [131]. Likewise, if the confidence interval’s range stands beyond 1, the two constructs are regarded as empirically distinct [132]. The results for the HTMT criterion are presented in S1C Table in S1 Table. The results of the HTMT bootstrapping indicate both the lower and upper bound of the confidence interval’s range include a value of 1. As such, the discriminant validity of the data is established in accordance with the liberal criterion of HTMT inference.

6.2 Structural model assessment

Before assessing the structural model, it is critical to confirm that there are no issues with lateral collinearity [131]. This is because lateral collinearity (predictor-criterion collinearity) occasionally deceives the results covertly, even when discriminant validity (vertical collinearity) is fulfilled [144]. Additionally, lateral collinearity problems may obscure the model’s clear causal influence. This condition normally occurs when two variables that are believed to be causally connected evaluate the same construct. The collinearity (vertical) and lateral collinearity assessments are explained next.

In PLS-SEM analysis, a variance inflation factor (VIF) is used to demonstrate the existence of multicollinearity issues. A tolerance value of 0.20 or less and a VIF value of 5 or greater suggest the possibility of collinearity [145,146]. More precisely, the VIF level of an indicator of 5 suggests that the remaining formative indicators associated with the same construct account for 80% of its variance [132]. If the degree of collinearity is extremely strong, as shown by a VIF value of 5 or greater, it might be necessary to exclude one of the corresponding indicators [132]. However, the rest of the metrics must also correctly capture the content of the construct from a theoretical standpoint. The first VIF assessment revealed that no remaining indicator had violated the tolerance value, as Hair Jr, et al. [132] suggested, which is any score more than value 5.

The inner VIF values (compatibility, complexity, culture, data demand, IT competency, incentive, relative advantage, top management support) for all of the other independent variables that need to be tested for lateral multicollinearity were found to be less than 5, suggesting that lateral multicollinearity is not a problem in the analysis [132]. Table 8 summarizes the results for lateral collinearity assessment.

6.2.1 Path coefficient.

The path coefficient for the relationship among latent variables is obtained through the SmartPLS [125] software bootstrapping technique. Inferential statistics (t-values) are obtained with bootstrap standard error. The t-values used for the significance was 1.645 for a one-tailed test and 1.96 for two-tailed tests [132]. In this study, one-tailed test was used, as suggested by Ramayah, et al. [131], because the hypotheses are directional.

In this study, 10 direct hypotheses, defined as H1 to H10, were developed. Results presented in Table 9 indicate that all relationships are significant with t-values above 1.645 at the 5% level (α = 0.05; one-tailed test) except for relationships between Compatibility → Acceptance, IT Competency → Acceptance, Incentives → Acceptance, and Data demand → Acceptance, which were found to be nonsignificant. The results also showed that complexity (β = −0.018, p = .007), relative advantage (β = 0.184, p < .005), organizational culture (β = 0.144, p = 0.021), and top management support (β = 0.28, p < .001) are positively related to acceptance, which explains 45.2% of variances. Thus, H2, H3, H4, and H5, are supported.

Fig 4 illustrates the bootstrapping function’s results with 5,000 iterations and using a one-tailed t-test with a significance level of 0.05. The R2 value for acceptance is 0.452, indicating a substantial model, as suggested by Cohen (1988). The effect of acceptance on routinization indicates that the former (β = 0.656, p < .001) is positively related to the latter, explaining 43% of the variance of the latter. Simultaneously, the effect of routinization on infusion indicates that the former (β = 0.711, p < .001) is also positively related to the latter, explaining 50.5% of the variance of the latter. These results for endogenous constructs support this study’s hypotheses H9 and H10.

7. Discussion

This research integrated three theoretical perspectives based on innovation adoption in organization literature: the innovation adoption process, post-adoption of innovation, and the TOE framework to build the OGD post-adoption framework in the public sector.

The first factor tested significantly to the OGD post-adoption is complexity (Hypothesis 1). Complexity was hypothesized to have a negative influence on OGD post-adoption. This notion implies that the data providers acknowledged the complexity of OGD publication. The finding is consistent with the literature, which states that the higher complexity of technology innovation will decrease the chance of its acceptance [129,147], thereby undermining OGD post-adoption. However, previous research by Yang and Wu [12] found that perceived effort, which has similar characteristics to complexity, was nonsignificant to government agencies’ intention of OGD adoption. Yang and Wu [12] noted that the outcome was a result of adequate assistance from higher authorities to government entities in implementing OGD. Additionally, data providers frequently chose “low-hanging fruit” data in order to minimize publication complexity. Regardless, with the advent of high-intensity data technologies such as the blockchain, data providers may face complexity with OGD post-adoption in the near future. By that time, data providers need to be equipped with the requisite skills and knowledge to operate OGD with more challenging data structures. Hence, the stakeholders should pay attention to building the technical capacity to reduce the OGD publication complexity.

The second factor tested significantly to OGD post-adoption is the relative advantage (Hypothesis 3). Relative advantage is the extent to which an innovation is seen as superior to an idea and has the potential to benefit an organization [54]. In this study, the data providers argued that OGDs provide advantages and add value to organizations. OGD implementation has become one of the important components in most digital government strategic plans. Providing access to OGD means that as data providers, government agencies are strengthening the digital government strategic plans.

Organizational culture is the third-factor supporting OGD post-adoption (Hypothesis 4). In this study, the organizational culture refers to the government agencies’ openness culture, which revolves around how data providers respond to managing and publicly sharing data [12]. Data providers agree that embedding data openness as an organizational culture will enhance OGD post-adoption. These days, the importance of OGD publication as organizational culture is more discernible as the government is striving to empower OGD as part of the digital government aspiration. Numerous government services and daily tasks are turning into the digital space, thereby allowing information and data to be managed with computer applications or ISs. Indirectly, the availability of non-confidential data in a machine-readable format sparks the data providers to make OGD publication an organizational culture.

The results suggest that the strongest antecedent for OGD post-adoption is the top management support represented by Hypothesis 5. Top management support has been recognized in many studies as a highly influential factor in innovation adoption in an organization [148]. Given that the OGD initiative was a mandated decision from a higher executive level in the federal government hierarchy, top management support, in this case, is apparent. This result is consistent with previous studies on OGD adoption in which top management support was observed as the most prominent factor [50].

As pointed out in Hypothesis 1, the relationship between compatibility and acceptance was shown to be insignificant. The findings suggest that the data’s compatibility, operating practices, IT infrastructure, and agencies’ values and beliefs do not influence OGD implementation in the post-adoption phase among government agencies. Centered on the source of authority given, the adoption of OGD in the public sector has been regarded as an obligation rather than a voluntary basis. The nationwide deployment has made the OGD a well-known initiative at various levels of government services. A lot of national ICT strategic planning has delineated OGD as one of the long-term initiatives to be focused on. Based on these reasons, it can be understood why compatibility is not a concern among government agencies because responding to the national agenda is more necessary. Within the same tones, Amade, et al. [149] and Junior, et al. [129] asserted that the compatibility of innovation is not statistically significant in the post-adoption phase. Amade, et al. [149] confirmed whether compatibility influences Mozambican institutions in an effort to continue using geographical information technologies. In contrast, Junior, et al. [129] emphasized that compatibility has no positive influence on enterprise resource planning diffusion among farmers in Brazil.

The second antecedent that is not supported by OGD post-adoption is IT competency (Hypothesis 6). It refers to the organization’s technical capabilities, which include infrastructure and human resource capabilities in IT [150]. The findings suggest that government agencies have insufficient knowledge and technological resources to manage OGD post-adoption. Zhao and Fan [10] observed similar findings in which technical competency is a mandatory basis for managing OGD capacity. However, the data providers’ IT competency level in operating OGD is still low and requires improvement. It is foreseen that more advanced skills are needed if the government agency intends to increase the OGD potential. Several scholars have suggested that public servants, regardless of their position and job title, should not just possess IT-related skills but instead build the ability to cope with emerging technologies [3,151]. In addition, Luna-Reyes and Najafabadi [25] posited that OGD management involving the combination of technology and data analysis expertise is still sparse. In order to strengthen the OGD implementation in public sector entities, highly skilled technical personnel and training are necessary [10].

Environmental aspects have outlined two measurements of factors that can influence the OGD post-adoption, namely the data demand and incentives. The relationship between data demand and OGD acceptance was tested through Hypothesis 7. The former refers to the request for certain datasets from the data provider’s internal or external environs. It is a newly introduced factor in the OGD post-adoption framework to seek government agencies’ feedback in responding to the external environment. The results indicate data providers’ standpoint on data demand in which serving the needs of data consumers does not influence OGD post-adoption. Without data demand, OGD is merely supply-driven with less potential to be exploited into useful data products. A strong argument was highlighted in Ubaldi [3] when the researcher observed that the public sector spends more time on strategies rather than knowing the value creation of OGD by fulfilling the demand first. It is feared that disregarding the data demand will stifle the development of future inventions.

The final antecedent that is not supported OGD infusion is the incentives factor (Hypothesis 8). The findings indicate that incentive is not positively influenced by OGD infusion among government agencies. The incentives have the potential to be a positive factor in the future, but they need to be re-modeled. This is because the lack of motivation from the environment makes the OGD implementation highly supply-driven. In contrast, Ubaldi (2013) stated that providing incentives will foster full commitment among government agencies to sustain OGD implementation. However, from a different perspective, it is a great sign that the data providers are committed to the OGD post-adoption and regard OGD publishing as part of their scope of operation without expecting anything in return.

This study’s main research questions sought to answer: What are the factors that influence OGD post-adoption among the data providers? This research question was resolved by applying a quantitative method with the PLS-SEM as the factor analysis technique. Five factors from all three contexts (technology, organizational, environment) significantly influenced the post-adoption of OGD in the public sector. The factors are compatibility, relative advantage, top management support, culture, and data demand. The second research question this study tried to answer is how the data provider’s readiness is to sustain the OGD implementation in their existing work structure. Based on the relatively significant associations among the independent variables and the post-adoption phase, it can be inferred that data providers are ready to accept, routinize, and infuse OGD into their existing work system. The data providers’ readiness indicates that the OGD innovation will have a solid trajectory to be sustained and expanded in the future.

8. Managerial implication

This study’s contributions are presented from three different perspectives, namely theoretical, conceptual, and practical. From a theoretical standpoint, this study contributes to the IT innovation adoption theory, particularly in the post-adoption phase, by experimenting with OGD initiatives. While most IT innovation adoption studies focused on adoption, this study promoted the post-adoption phase, namely the acceptance, routinization, and infusion stage. The post-adoption phase is important because the inability to secure profound use of IT innovation beyond the adoption phase could cause its abandonment [81]. To the best of the authors’ knowledge, this study is the first to explore the post-adoption phase of OGD, particularly the routinization and infusion stage. Hence, this study presents empirical and practical evidence of OGD acceptance, routinization, and infusion in the post-adoption phase through ongoing experience and efforts in the Malaysian public sector. An important implication that this study tries to portray is that the lack of a post-adoption framework may hinder the government from planning the subsequent OGD implementation actions.

This study introduces new factors into the research model from the conceptual perspective, namely the incentives and data demand for the environmental context. However, the incentives and data demand factors show a nonsignificant contribution to the OGD post-adoption. Perhaps the environmental context can be tested in diverse socioeconomic or geopolitical statuses to see contrasting repercussions. Finally, from the practicality perspective, this study’s outcome is anticipated to guide the policymakers in the government administration to use the assessments to sustain OGD implementation in the post-adoption phase from the data provider’s perspective. The significant factors identified in this study can act as a catalyst to foster more seamless OGD acceptance, routinization, and infusion.

9. Limitations and future works

Like any other research, this study suffers from a few limitations, which indirectly offer some room for future research opportunities. First, the eight post-adoption factors within the TOE context covered all factors for innovation adoption in an organization. However, there is another context that is not covered in TOE, such as the human context. Therefore, the opportunity to explore other contributing factors for the post-adoption of OGD in an organization is in need. Additionally, replicating the study in different socioeconomic or geopolitical statuses would further enrich the findings. Secondly, a cross-sectional study was employed in this study in which the data were collected in a specific timeframe. Hence, employing a longitudinal study would extend the direction of OGD in the post-adoption phase. Third, this study centered on the Malaysian public sector and its surrounding nature. The existence of the private sector or non-government organizations as OGD providers is yet to be explored. The individual factor is ignored intentionally because this study’s objective was to explore OGD at an organizational level of analysis. Finally, all the factors were measured using a self-administered instrument, which may be exposed to self-reported bias. Hence, using multiple measurement methods may avoid such potential occurrences in the future. In light of such a study, subsequent research must draw on the essential outcomes of this research.

For future studies, the developed OGD post-adoption framework can be extended to other IS/IT innovation research to enrich post-adoption research. OGD users and OGD beneficiaries have a vital role in making OGD sustainable in the OGD ecosystem. It is conceivable that research from the view of these roles can be performed to understand how OGD is being used and impacted their life. In this way, government agencies can improve the OGD publication in terms of data quality.

10. Conclusions

This study intended to investigate the OGD post-adoption among data providers in the public sector. Guided by the TOE framework and innovation adoption theory, the OGD post-adoption framework in the public sector was realized. The innovation adoption theory is the basic foundation for understanding the phases involved in innovation diffusion in an organization. It can be inferred that the post-adoption phase is the highest phase for innovation adoption in an organization. As posited by many scholars, failure to reach the post-adoption phase will result in the adoption of innovations reaching an impasse. A comprehensive theory or framework that can be used to describe the entire process of open data is limited; this includes the goal of OGD, the innovation process, and the results or impacts of OGD. In that sense, research on OGD post-adoption is essential to enrich the OGD body of knowledge. Ergo, it is imperative to assess an innovation’s acceptance, routinization, and infusion stage to chart a better path forward. Deliberately, this study also highlights the need for more post-adoption innovation research in determining the next steps subsequent to adoption. Following the aforementioned cues, OGD innovation must take alternative and practical measures to ensure its implementation within the government. The post-adoption phase appears to justify the current OGD implementation in the Malaysian public sector and indirectly signifies OGD implementation maturity among data providers. Three general contexts (technology, organization, environment) were investigated to determine whether the factors significantly influence OGD post-adoption among data providers. The investigation was conducted through a survey instrument disseminated among the data providers in the Malaysian public sector. The data collected were analyzed using established research methods in a quantitative study. The results exhibit that top management support, organizational culture, relative advantage, and complexity are the factors that influence OGD in the post-adoption phase. Consequently, the data providers are expected to support sustaining OGD with the factors emphasized by the stakeholders. In this way, the OGD implementation way forward can be determined and remain pertinent in the years to come.

Supporting information

S1 Table. The results for measurement model assessment.

https://doi.org/10.1371/journal.pone.0276860.s001

(DOCX)

S1 Appendix. Survey questionnaire for open government data post-adoption factors among data providers.

https://doi.org/10.1371/journal.pone.0276860.s002

(DOCX)

S2 Appendix. Interview scripts for Semi-structured interview during preliminary study.

https://doi.org/10.1371/journal.pone.0276860.s003

(DOCX)

Acknowledgments

The author would like to acknowledge the support from the Digital Government Division of the Malaysian Administrative Modernization and Management Planning Unit (MAMPU) through various insights and feedback given towards completing this study.

References

  1. 1. Zhao Y, Fan B. Effect of an agency’s resources on the implementation of open government data. Information & Management. 2021;58(4):103465.
  2. 2. Janssen M, Charalabidis Y, Zuiderwijk A. Benefits, adoption barriers and myths of open data and open government. Information Systems Management. 2012;29(4):258–68. https://doi.org/10.1080/10580530.2012.716740.
  3. 3. Ubaldi B. Open government data: Towards empirical analysis of open government data initiatives. OECD Working Papers on Public Governance, No 22, OECD Publishing. 2013. http://dx.doi.org/10.1787/5k46bj4f03s7-en.
  4. 4. Barry E, Bannister F. Barriers to open data release: A view from the top. Information Polity. 2014;19(1, 2):129–52. https://doi.org/10.3233/ip-140327.
  5. 5. Hossain MA, Rahman S, Quaddus M, Hooi E, Olanrewaju A-S. Factors Affecting Performance of Open Government Data Initiatives: A Multi-Method Approach Using Sem and FSQCA. Journal of Organizational Computing and Electronic Commerce. 2021;31(4):300–19.
  6. 6. Kucera J, Dusan C. Benefits and risks of open government data. Journal of Systems Integration. 2014;5(1):30. https://doi.org/10.20470/jsi.v5i1.185.
  7. 7. Alexopoulos C, Loukis E, Mouzakitis S, Petychakis M, Charalabidis Y. Analysing the Characteristics of Open Government Data Sources in Greece. Journal of the Knowledge Economy. 2015:1–33. https://doi.org/10.1007/s13132-015-0298-8.
  8. 8. Dawes SS, Vidiasova L, Parkhimovich O. Planning and designing open government data programs: An ecosystem approach. Government Information Quarterly. 2016;33(1):15–27. http://dx.doi.org/10.1016/j.giq.2016.01.003.
  9. 9. Ruijer E, Meijer A. Open Government Data as an Innovation Process: Lessons from a Living Lab Experiment. Public Performance & Management Review. 2019:1–23. https://doi.org/10.1080/15309576.2019.1568884.
  10. 10. Zhao Y, Fan B. Exploring open government data capacity of government agency: Based on the resource-based theory. Government Information Quarterly. 2018;35(1):1–12. https://doi.org/10.1016/j.giq.2018.01.002.
  11. 11. Wang H-J, Lo J. Adoption of open government data among government agencies. Government Information Quarterly. 2016;33(1):80–8. http://dx.doi.org/10.1016/j.giq.2015.11.004.
  12. 12. Yang T-M, Wu Y-J. Examining the socio-technical determinants influencing government agencies’ open data publication: A study in Taiwan. Government Information Quarterly. 2016;33(3):378–92. http://dx.doi.org/10.1016/j.giq.2016.05.003.
  13. 13. Fadel KJ. User adaptation and infusion of information systems. Journal of Computer Information Systems. 2012;52(3):1–10.
  14. 14. Jasperson JS, Carter PE, Zmud RW. A comprehensive conceptualization of post-adoptive behaviors associated with information technology enabled work systems. MIS Quarterly. 2005;29(3):525–57. https://doi.org/10.2307/25148694.
  15. 15. Ahmad M, Othman R. Implementation of electronic government in Malaysia: The status and potential for better service to the public. Public Sector ICT Management Review. 2007;1(1):2–10.
  16. 16. Ramamurthy K, Sen A, Sinha AP. Data warehousing infusion and organizational effectiveness. IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans. 2008;38(4):976–94.
  17. 17. Zuiderwijk A, de Reuver M. Why open government data initiatives fail to achieve their objectives: categorizing and prioritizing barriers through a global survey. Transforming Government: People, Process and Policy. 2021.
  18. 18. Huang R, Lai T, Zhou L. “The Great Data Revolution”: Breaking Barriers to Opening Government Data in China. iConference 2018 Proceedings. 2018.
  19. 19. Hassandoust F, Techatassanasoontorn AA, Tan FB. Factors influencing the infusion of information systems: A literature review. Pacific Asia Journal of the Association for Information Systems. 2016;8(1).
  20. 20. Gao Y, Janssen M, Zhang C. Understanding the evolution of open government data research: towards open data sustainability and smartness. International Review of Administrative Sciences. 2021:00208523211009955.
  21. 21. Sánchez-Nielsen E, Morales A, Mendo O, Chávez-Gutiérrez F. SuDaMa: Sustainable Open Government Data Management Framework for Long-term Publishing and Consumption. IEEE Access. 2021.
  22. 22. Zhu X. The failure of an early episode in the open government data movement: A historical case study. Government Information Quarterly. 2017.
  23. 23. d Oliveira LF d Santos CD. INTENDED AND UNINTENDED CONSEQUENCES OF INNOVATION ADOPTION: OPEN GOVERNMENT DATA ADOPTION BY THE FEDERAL DISTRICT OF BRAZIL. REAd: Revista Eletrônica de Administração. 2019;25(1):1–25. https://doi.org/10.1590/1413-2311.214.80559.
  24. 24. World Wide Web Foundation. Open Data Barometer- Leaders Edition. Washington DC: 2018 Contract No.: July 21, 2019.
  25. 25. Luna-Reyes LF, Najafabadi MM. The US open data initiative: The road ahead. Information Polity. 2019;24(2):163–82. https://doi.org/10.3233/ip-180106.
  26. 26. Martin EG, Begany GM. Opening government health data to the public: benefits, challenges, and lessons learned from early innovators. Journal of the American Medical Informatics Association. 2017;24(2):345–51. pmid:27497796
  27. 27. O’Reilly T. Government as a Platform. innovations. 2011;6(1):13–40.
  28. 28. Geiger CP, von Lucke J. Open government and (linked)(open)(government)(data). JeDEM-eJournal of eDemocracy and Open Government. 2012;4(2):265–78. https://doi.org/10.29379/jedem.v4i2.143.
  29. 29. Schrier B. Government open data: Benefits, strategies, and use. The Evans School Review. 2014;4(1):12–27.
  30. 30. Talukder MS, Shen L, Talukder MFH, Bao Y. Determinants of user acceptance and use of open government data (OGD): An empirical investigation in Bangladesh. Technology in Society. 2019;56:147–56.
  31. 31. Heimstädt MS, Fredric; Heath, Tom, editor Conceptualizing Open Data ecosystems: A timeline analysis of Open Data development in the UK. Conference for E-Democracy and Open Governement; 2014.
  32. 32. Zuiderwijk A, Janssen M, Dwivedi YK. Acceptance and use predictors of open data technologies: Drawing upon the unified theory of acceptance and use of technology. Government Information Quarterly. 2015;32(4):429–40. https://doi.org/10.1016/j.giq.2015.09.005.
  33. 33. Saxena S, Janssen M. Examining open government data (OGD) usage in India through UTAUT framework. Foresight. 2017;19(4):421–36. https://doi.org/10.1108/fs-02-2017-0003.
  34. 34. Fitriani WR, Hidayanto AN, Sandhyaduhita PI, Purwandari B, Kosandi M. Determinants of Continuance Intention to Use Open Data Website: An Insight from Indonesia. Pacific Asia Journal of the Association for Information Systems. 2019;11(2). https://doi.org/10.17705/1pais.11205.
  35. 35. Susha I, Grönlund Å, Janssen M. Driving factors of service innovation using open government data: An exploratory study of entrepreneurs in two countries. Information Polity. 2015;20(1):19–34. https://doi.org/10.3233/ip-150353.
  36. 36. Albano CS, Reinhard N, editors. Open government data: Facilitating and motivating factors for coping with potential barriers in the Brazilian context. International Conference on Electronic Government; 2014: Springer.
  37. 37. Maccani G, Donnellan B, Helfert M, editors. Exploring the factors that influence the diffusion of open data for new service development: an interpretive case study2015: Association for Information Systems.
  38. 38. Shkabatur J, Peled A, editors. Sustaining the open government data movement worldwide: Insights from developing countries. 2016 Conference for E-Democracy and Open Government (CeDEM); 2016: IEEE.
  39. 39. Rogers EM. Diffusion of innovations. Third ed. New York: Free Press; 1983. 453 p.
  40. 40. Davis FD. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS quarterly. 1989:319–40.
  41. 41. Ajzen I. The theory of planned behavior. Organizational behavior and human decision processes. 1991;50(2):179–211.
  42. 42. Venkatesh V, Morris MG, Davis GB, Davis FD. User acceptance of information technology: Toward a unified view. MIS Quarterly. 2003:425–78.
  43. 43. Subedi R, Nyamasvisva TE, Pokharel M. An Integrated-Based Framework For Open Government Data Adoption In Kathmandu. Webology (ISSN: 1735-188X). 2022;19(2).
  44. 44. Zhenbin Y, Kankanhalli A, Ha S, Tayi GK. What drives public agencies to participate in open government data initiatives? an innovation resource perspective. Information & Management. 2020:103179. https://doi.org/10.1016/j.im.2019.103179.
  45. 45. Wang H-J, Lo J. Factors influencing the adoption of open government data at the firm level. IEEE Transactions on Engineering Management. 2019;67(3):670–82.
  46. 46. Çaldağ MT, Gökalp E, Alkış N, editors. Analyzing Determinants of Open Government Based Technologies and Applications Adoption in the Context of Organizations. Proceedings of the International Conference on e-Learning, e-Business, Enterprise Information Systems, and e-Government (EEE); 2019: The Steering Committee of The World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2019.
  47. 47. Haini SI, Rahim NZA, Zainuddin NMM, editors. Adoption of Open Government Data in Local Government Context: Conceptual Model Development. Proceedings of the 2019 5th International Conference on Computer and Technology Applications; 2019: ACM.
  48. 48. Altayar MS. Motivations for open data adoption: An institutional theory perspective. Government Information Quarterly. 2018;35(4):633–43. https://doi.org/10.1016/j.giq.2018.09.006.
  49. 49. Maccani G, Donnellan B, Helfert M. Adoption of Open Government Data for Commercial Service Innovation: An Inductive Case Study on Parking Open Data Services. 2018.
  50. 50. Hossain MA, Chan C, editors. Open data adoption in Australian government agencies: an exploratory study. Australasian Conference on Information Systems; 2015.
  51. 51. Yang T-M, Wu Y-J, editors. Exploring the information behaviors of government officials in open data initiatives. ACM International Conference Proceeding Series; 2016 08-10-June-2016.
  52. 52. Kaasenbrood M, Zuiderwijk A, Janssen M, de Jong M, Bharosa N. Exploring the factors influencing the adoption of open government data by private organisations. Standards and Standardization: Concepts, Methodologies, Tools, and Applications: IGI Global; 2015. p. 921–38.
  53. 53. Estermann B. Diffusion of open data and crowdsourcing among heritage institutions: results of a pilot survey in Switzerland. Journal of theoretical and applied electronic commerce research. 2014;9(3):15–31. https://doi.org/10.4067/s0718-18762014000300003.
  54. 54. Rogers EM. Diffusion of Innovations: New York: The Free Press; 1995.
  55. 55. Fidock J. Understanding information technology appropriation in organisations: RMIT University; 2011.
  56. 56. Zaltman G, Duncan R, Holbek J. Innovations and Organizations: Wiley New York; 1973.
  57. 57. Kamal MM. IT innovation adoption in the government sector: identifying the critical success factors. Journal of Enterprise Information Management. 2006;19(2):192–222. https://doi.org/10.1108/17410390610645085.
  58. 58. Lewin K. Group Decision and Social Change. Readings in Social Psychology. 1952;3(1):197–211.
  59. 59. Karahanna E, Straub DW, Chervany NL. Information technology adoption across time: A cross-sectional comparison of pre-adoption and post-adoption beliefs. MIS Quarterly. 1999;23(2):183–213. https://doi.org/10.2307/249751.
  60. 60. Pierce JL, Delbecq AL. Organization structure, individual attitudes and innovation. Academy of Management Review. 1977;2(1):27–37. https://doi.org/10.5465/amr.1977.4409154.
  61. 61. Darmawan IGN. Adoption and implementation of information technology in Bali’s local government: A comparison between single level path analyses using PLSPATH 3.01 and AMOS 4 and Multilevel Path Analyses using MPLUS 2.01. International Education Journal. 2001;2(4):100–25.
  62. 62. Kwon TH, Zmud RW. Unifying the fragmented models of information systems implementation. In: R. J. Boland, Jr., Hirschheim RA, editors. Critical issues in information systems research: John Wiley & Sons, Inc.; 1987. p. 227–51.
  63. 63. Cooper RB, Zmud RW. Information technology implementation research: a technological diffusion approach. Management science. 1990;36(2):123–39. https://doi.org/10.1287/mnsc.36.2.123.
  64. 64. Damanpour F, Schneider M. Phases of the adoption of innovation in organizations: Effects of environment, organization and top managers. British Journal of Management. 2006;17(3):215–36. https://doi.org/10.1111/j.1467-8551.2006.00498.x.
  65. 65. Frambach RT, Schillewaert N. Organizational innovation adoption: A multi-level framework of determinants and opportunities for future research. Journal of Business Research. 2002;55(2):163–76. https://doi.org/10.1016/s0148-2963(00)00152-1.
  66. 66. Hameed MA, Counsell S, Swift S. A conceptual model for the process of IT innovation adoption in organizations. Journal of Engineering and Technology Management. 2012;29(3):358–90. https://doi.org/10.1016/j.jengtecman.2012.03.007.
  67. 67. Tornatzky L, Eveland JD, Boylan MG, Hetzner WA, Johnson EC, Roitman D, et al. The process of technological innovation: Reviewing the literature. 1983.
  68. 68. Wejnert B. Integrating models of diffusion of innovations: A conceptual framework. Annual review of sociology. 2002;28(1):297–326. https://doi.org/10.1146/annurev.soc.28.110601.141051.
  69. 69. Iacovou CLB, Izak; Dexter, Albert S. Electronic data interchange and small organizations: Adoption and impact of technology. MIS Quarterly. 1995:465–85. https://doi.org/10.2307/249629.
  70. 70. Tornatzky LG, Fleischer M, Chakrabarti AK. Processes of Technological Innovation. Lexington, MA.: Lexington Books; 1990.
  71. 71. Gangwar H, Date H, Raoot A. Review on IT adoption: insights from recent technologies. Journal of Enterprise Information Management. 2014.
  72. 72. Khurshid MM, Zakaria NH, Rashid A, Ahmad MN, Arfeen MI, Faisal Shehzad HM, editors. Modeling of open government data for public sector organizations using the potential theories and determinants—a systematic review. Informatics; 2020: MDPI.
  73. 73. Yoon TE, George JF. Why aren’t organizations adopting virtual worlds? Computers in Human Behavior. 2013;29(3):772–90.
  74. 74. Awa HO, Ojiabo OU, Orokor LE. Integrated technology-organization-environment (TOE) taxonomies for technology adoption. Journal of Enterprise Information Management. 2017. https://doi.org/10.1108/jeim-03-2016-0079.
  75. 75. Zhu K, Kraemer K, Xu S. Electronic business adoption by European firms: a cross-country assessment of the facilitators and inhibitors. European journal of information systems. 2003;12(4):251–68.
  76. 76. Oliveira TM, Maria Fraga. Literature review of information technology adoption models at firm level. The Electronic Journal Information Systems Evaluation. 2011;14(1):110–21.
  77. 77. Zhu Y, Li Y, Wang W, Chen J. What leads to post-implementation success of ERP? An empirical study of the Chinese retail industry. International Journal of Information Management. 2010;30(3):265–76. https://doi.org/10.1016/j.ijinfomgt.2009.09.007.
  78. 78. Baker J. The technology–organization–environment framework. Information Systems Theory: Springer; 2012. p. 231–45.
  79. 79. Thong JY. An integrated model of information systems adoption in small businesses. Journal of management information systems. 1999;15(4):187–214. https://doi.org/10.1080/07421222.1999.11518227.
  80. 80. Sekaran U, Bougie R. Research Methods for Business2013.
  81. 81. Zhu K, Dong S, Xu SX, Kraemer KL. Innovation diffusion in global contexts: determinants of post-adoption digital transformation of European companies. European journal of information systems. 2006;15(6):601–16. https://doi.org/10.1057/palgrave.ejis.3000650.
  82. 82. Tornatzky LG, Klein KJ. Innovation characteristics and innovation adoption-implementation: A meta-analysis of findings. IEEE Transactions on engineering management. 1982;(1):28–45. https://doi.org/10.1109/tem.1982.6447463.
  83. 83. Elixmann Y, Jarke J. Considering the Reluctance to Adopt Open Data in German Public Administration: An Exploration of Individual Innovation-Decisions. JeDEM-eJournal of eDemocracy and Open Government. 2022;14(1):50–71.
  84. 84. Rogers EM. Diffusion of innovations. Free Press, New York. 2003;(5th Edition).
  85. 85. Kleiman F, Meijer S, Janssen M, editors. Behavioral factors influencing the opening of government data by civil servants: initial findings from the literature. Proceedings of the 13th International Conference on Theory and Practice of Electronic Governance; 2020.
  86. 86. Mustapa MN, Hamid S, Nasaruddin FHM. Exploring the Issues of Open Government Data Implementation in Malaysian Public Sectors. International Journal on Advanced Science, Engineering and Information Technology. 2019;9(4):1466–73. http://dx.doi.org/10.18517/ijaseit.9.4.8850.
  87. 87. Zhu K, Kraemer KL, Xu S. The process of innovation assimilation by firms in different countries: a technology diffusion perspective on e-business. Management science. 2006;52(10):1557–76. https://doi.org/10.1287/mnsc.1050.0487.
  88. 88. Moore GCB, Izak. Development of an instrument to measure the perceptions of adopting an information technology innovation. Information systems research. 1991;2(3):192–222.
  89. 89. Yang T-M, Wu Y-J. Looking for datasets to open: An exploration of government officials’ information behaviors in open data policy implementation. Government Information Quarterly. 2021;38(2):101574.
  90. 90. Schein EH. Organizational culture and leadership: John Wiley & Sons; 2010.
  91. 91. Ke W, Wei KK. Organizational culture and leadership in ERP implementation. Decision support systems. 2008;45(2):208–18. https://doi.org/10.1016/j.dss.2007.02.002.
  92. 92. Ruijer EH, Huff RF. Breaking through barriers: the impact of organizational culture on open government reform. Transforming Government: People, Process and Policy. 2016;10(2):335–50. https://doi.org/10.1108/tg-07-2015-0028.
  93. 93. Zuiderwijk A, Janssen M. Open data policies, their implementation and impact: A framework for comparison. Government Information Quarterly. 2014;31(1):17–29. http://dx.doi.org/10.1016/j.giq.2013.04.003.
  94. 94. Zuiderwijk A, Janssen M, Choenni S, Meijer R, Alibaks RS, Sheikh_Alibaks R. Socio-technical impediments of open data. Electronic Journal of eGovernment. 2012;10(2):156–72.
  95. 95. Peled A. When Transparency and Collaboration Collide: The USA Open Data Program. J Am Soc Inf Sci Technol. 2011;62(11):2085–94. https://doi.org/10.1002/asi.21622
  96. 96. Zhao Y, Liang Y, Yao C, Han X. Key factors and generation mechanisms of open government data performance: A mixed methods study in the case of China. Government Information Quarterly. 2022:101717.
  97. 97. Hameed MA, Counsell S, Swift S. A meta-analysis of relationships between organizational characteristics and IT innovation adoption in organizations. Information & management. 2012;49(5):218–32. https://doi.org/10.1016/j.im.2012.05.002.
  98. 98. Rai A, Brown P, Tang X. Organizational assimilation of electronic procurement innovations. Journal of Management Information Systems. 2009;26(1):257–96. https://doi.org/10.2753/mis0742-1222260110.
  99. 99. Hwang MI. Top management support and information systems implementation success: a meta-analytical replication. International Journal of Information Technology and Management. 2019;18(4):347–61. https://doi.org/10.1504/ijitm.2019.10024388.
  100. 100. Thong JY, Yap C-S, Raman K. Top management support, external expertise and information systems implementation in small businesses. Information systems research. 1996;7(2):248–67. https://doi.org/10.1287/isre.7.2.248.
  101. 101. Chandra S, Kumar KN. Exploring Factors Influencing Organizational Adoption Of Augmented Reality In E-Commerce: Empirical Analysis Using Technology-Organization-Environment Model. Journal of Electronic Commerce Research. 2018;19(3).
  102. 102. Mata FJ, Fuerst WL, Barney JB. Information technology and sustained competitive advantage: A resource-based analysis. MIS quarterly. 1995:487–505. https://doi.org/10.2307/249630.
  103. 103. Nguyen T. Technology Adoption in Norway: Organizational Assimilation of Big Data. Bergen, Norway: Norwegian School of Economics; 2017.
  104. 104. Wang Y-S, Li H-T, Li C-R, Zhang D-Z. Factors affecting hotels’ adoption of mobile reservation systems: A technology-organization-environment framework. Tourism Management. 2016;53:163–72. https://doi.org/10.1016/j.tourman.2015.09.021.
  105. 105. Li X, Troutt MD, Brandyberry A, Wang T. Decision factors for the adoption and continued use of online direct sales channels among SMEs. Journal of the Association for Information Systems. 2011;12(1):4. https://doi.org/10.17705/1jais.00255.
  106. 106. Li S, Chen Y. Explaining the resistance of data providers to open government data. Aslib Journal of Information Management. 2021.
  107. 107. World Bank Group. Open Data Readiness Assessment: Malaysia. Malaysia: Global Knowledge & Research Hub in Malaysia, 2017.
  108. 108. Kulkarni UR, Ravindran S, Freeze R. A knowledge management success model: Theoretical development and empirical validation. Journal of management information systems. 2006;23(3):309–47. https://doi.org/10.2753/mis0742-1222230311.
  109. 109. Devriendt T, Shabani M, Borry P. Data sharing in biomedical sciences: a systematic review of incentives. Biopreservation and Biobanking. 2021;19(3):219–27. pmid:33926229
  110. 110. Zhang H, Bi Y, Kang F, Wang Z. Incentive mechanisms for government officials’ implementing open government data in China. Online Inf Rev. 2021.
  111. 111. Morrell DL. Employee perceptions and the motivation of nonmonetary incentives. Compensation & Benefits Review. 2011;43(5):318–23.
  112. 112. Mustapa MN, Nasaruddin FHM, Hamid S, editors. Towards a Research Model of Post-adoption of Open Government Data in Malaysia’s Public Sector. 2020 6th International Conference on Information Management (ICIM); 2020: IEEE.
  113. 113. Saga VL, Zmud RW, editors. The nature and determinants of IT acceptance, routinization, and infusion. Proceedings of the IFIP TC8 working conference on diffusion, transfer and implementation of information technology; 1993: Elsevier Science Inc.
  114. 114. Zainal NZ, Hussin H, Rahim NHA, Nazri MNM, Suhaimi MA. Intention to Use Open Government Data among Academics-Empirical Findings. Global Business & Management Research. 2022;14(1).
  115. 115. Wang V, Shepherd D, Button M. The barriers to the opening of government data in the UK: A view from the bottom. Information Polity. 2019;24(1):59–74.
  116. 116. Sandoval-Almazan R, Valle Gonzalez L, Millan Vargas A, editors. Barriers for Open Government Implementation at Municipal Level: The Case of the State of Mexico. DG O2021: The 22nd Annual International Conference on Digital Government Research; 2021.
  117. 117. Zuiderwijk A, Janssen M, Choenni S, Meijer R. Design principles for improving the process of publishing open data. Transforming government: people, process and policy. 2014.
  118. 118. Fichman RG. The diffusion and assimilation of information technology innovations. Framing the domains of IT management: Projecting the future through the past. 2000;105127.
  119. 119. Afonso CM, Schwarz A, Roldán JL, Sánchez-Franco MJ. EDMS use in local E-government: An analysis of the path from extent of use to overall performance. International Journal of Electronic Government Research (IJEGR). 2015;11(2):18–34.
  120. 120. Kim H-W, Gupta S. A user empowerment approach to information systems infusion. IEEE Transactions on Engineering Management. 2014;61(4):656–68.
  121. 121. Kim H-W, Gupta S, Lee S-H. Examining Information Systems Infusion over the Routinization.
  122. 122. Bhattacherjee A. Understanding information systems continuance: an expectation-confirmation model. MIS Quarterly. 2001:351–70.
  123. 123. Van de Ven AH, Poole MS. Explaining development and change in organizations. Academy of management review. 1995;20(3):510–40.
  124. 124. Thong JYY, Chee-Sing . CEO characteristics, organizational characteristics and information technology adoption in small businesses. Omega. 1995;23(4):429–42.
  125. 125. Ringle C, Wende S, Becker J-M. "SmartPLS 3." Boenningstedt: SmartPLS GmbH, http://www.smartpls.com. 2015.
  126. 126. Creswell JW. Research design: Qualitative, quantitative, and mixed methods approaches: Sage publications; 2013.
  127. 127. Taherdoost H. Determining sample size; how to calculate survey sample size. International Journal of Economics and Management Systems. 2017;2.
  128. 128. Dillman DA, Smyth JD, Christian LM. Internet, phone, mail, and mixed-mode surveys: the tailored design method: John Wiley & Sons; 2014.
  129. 129. Junior CH, Oliveira T, Yanaze M. The adoption stages (Evaluation, Adoption, and Routinisation) of ERP systems with business analytics functionality in the context of farms. Computers and Electronics in Agriculture. 2019;156:334–48.
  130. 130. Roscoe AM, Lang D, Sheth JN. Follow-up Methods, Questionnaire Length, and Market Differences in Mail Surveys. Journal of Marketing. 1975;39(2):20–7. https://doi.org/10.2307/1250111.
  131. 131. Ramayah T, Cheah J, Chuah F, Ting H, Memon MA. Partial Least Squares Structural Equation Modeling (PLS-SEM) using SmartPLS 3.0. Second Edition ed. Malaysia: Pearson Malaysia Sdn Bhd; 2018.
  132. 132. Hair Jr JF, Hult GTM, Ringle C, Sarstedt M. A primer on partial least squares structural equation modeling (PLS-SEM): Sage publications; 2017.
  133. 133. Sarstedt M, Ringle CM, Hair JF. Partial least squares structural equation modeling. Handbook of market research. 2017:1–40.
  134. 134. Hair JF, Gabriel M, Patel V. AMOS covariance-based structural equation modeling (CB-SEM): Guidelines on its application as a marketing research tool. Brazilian Journal of Marketing. 2014;13(2).
  135. 135. Gudergan SP, Ringle CM, Wende S, Will A. Confirmatory tetrad analysis in PLS path modeling. Journal of business research. 2008;61(12):1238–49.
  136. 136. McNeish D. Thanks coefficient alpha, we’ll take it from here. Psychological Methods. 2018;23(3):412. https://doi.org/10.1037/met0000144 pmid:28557467
  137. 137. Bagozzi RP, Yi Y. On the evaluation of structural equation models. Journal of the academy of marketing science. 1988;16(1):74–94.
  138. 138. Vinzi VE, Chin WW, Henseler J, Wang H. Handbook of partial least squares: Springer; 2010.
  139. 139. Urbach N, Ahlemann F. Structural equation modeling in information systems research using partial least squares. Journal of Information technology theory and application. 2010;11(2):5–40.
  140. 140. Hulland J. Use of partial least squares (PLS) in strategic management research: A review of four recent studies. Strategic management journal. 1999;20(2):195–204. https://doi.org/10.1002/(sici)1097-0266(199902)20:2<195::aid-smj13>3.0.co;2-7.
  141. 141. Chin WW. Commentary: Issues and opinion on structural equation modeling. JSTOR; 1998.
  142. 142. Fornell C, Larcker DF. Evaluating structural equation models with unobservable variables and measurement error. Journal of marketing research. 1981;18(1):39–50. https://doi.org/10.1177/002224378101800104.
  143. 143. Henseler J, Ringle CM, Sarstedt M. A new criterion for assessing discriminant validity in variance-based structural equation modeling. Journal of the academy of marketing science. 2015;43(1):115–35. https://doi.org/10.1007/s11747-014-0403-8.
  144. 144. Kock N, Lynn G. Lateral collinearity and misleading results in variance-based SEM: An illustration and recommendations. Journal of the Association for information Systems. 2012;13(7). https://doi.org/10.17705/1jais.00302.
  145. 145. Hair JF, Ringle CM, Sarstedt M. PLS-SEM: Indeed a silver bullet. Journal of Marketing theory and Practice. 2011;19(2):139–52. https://doi.org/10.2753/mtp1069-6679190202.
  146. 146. Tabachnick BG, Fidell LS. Using Multivariate Statistics: Pearson Boston, MA; 2012.
  147. 147. Lin H-F, Lin S-M. Determinants of e-business diffusion: A test of the technology diffusion perspective. Technovation. 2008;28(3):135–45.
  148. 148. Garcia-Ortega B, López-Navarro MÁ, Galan-Cubillo J. Top Management Support in the Implementation of Industry 4.0 and Business Digitization: The Case of Companies in the Main European Stock Indices. IEEE Access. 2021;9:139994–40007.
  149. 149. Amade N, Oliveira T, Painho M. Understanding the determinants of GIT post-adoption: perspectives from Mozambican institutions. Heliyon. 2020;6(5):e03879. pmid:32395656
  150. 150. Zhu K, Kraemer KL. Post-adoption variations in usage and value of e-business by organizations: cross-country evidence from the retail industry. Information systems research. 2005;16(1):61–84.
  151. 151. Chu PYT, H. L., editor A theoretical framework for evaluating government open data platform. ACM International Conference Proceeding Series; 2016.