Figures
Abstract
This study aims to investigate the supply chain challenges of public sector agriculture development projects in Bangladesh using the modified Delphi, Best Worst Method (BWM), and Interpretive Structural Modelling (ISM) methods. Based on these three widely acclaimed statistical techniques, the study identified, ranked, and identified interrelationships among the challenges. The study is unique not only in terms of research findings, but also in terms of methodology, as it is the first to use the three MCDM (Multicriteria Decision Making) tools to examine supply chain issues in public sector agriculture development projects in a developing country context. A literature review and two modified Delphi rounds with 15 industry experts’ opinions were applied to identify and validate a list of 11 key supply chain challenges. To determine the priority of the challenges, a panel of eight industry experts was consulted, and their responses were analysed using the BWM. Then, another group of 10 experts was consulted using ISM to investigate the contextual relationships among the challenges, resulting in a five-layered Interpretive Structural Model (ISM) and MICMAC (cross-impact matrix multiplication applied to classification) analysis of the challenges. According to relative importance (global weights), "improper procurement planning (0.213), "delay in project initiation (0.177), "demand forecasting error (0.146)", "lack of contract monitoring mechanism (0.097)", and "lack of competent staff (0.095)" are the top five ranked key challenges that have a significant impact on the project supply chain. Regarding contextual relationships, the ISM model and ISM-MICMAC analysis identified the "political influence" challenge as the most influential, and also independent of the other challenges. The findings are critical for project managers in managing challenges because understanding both relative importance and contextual relationships are required to address the challenges holistically. Additionally, these findings will benefit policymakers, academics, and future researchers.
Citation: Khan MR, Alam MJ, Tabassum N, Burton M, Khan NA (2022) Investigating supply chain challenges of public sector agriculture development projects in Bangladesh: An application of modified Delphi-BWM-ISM approach. PLoS ONE 17(6): e0270254. https://doi.org/10.1371/journal.pone.0270254
Editor: Mehdi Keshavarz-Ghorabaee, Gonbad Kavous University, ISLAMIC REPUBLIC OF IRAN
Received: January 20, 2022; Accepted: June 7, 2022; Published: June 22, 2022
Copyright: © 2022 Khan et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are available in the paper and it's Supporting information files.
Funding: This study was a part of PhD research of the first author financially supported by the World Bank funded National Agricultural Technology Program, Phase- II (NATP-2) Project (ID: P149553) in Bangladesh. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Public sector project professionals in developing countries need to address the project supply chain challenges judiciously to ensure that scarce resources are used efficiently and productively. Supply chain management is critical for resource optimization since the chain exists and pervades all phases of a project (Fig 1) [1–3]. Notwithstanding this fact, however, the importance of the supply chain remains neglected and inadequately recognised in the context of project management [1, 4]. Due to its inherent complexity, the functioning of the supply chain encounters several challenges, and these complexities highlight the importance and necessity for project-based organisations to manage the total supply chain in a more efficient way [1].
In the context of developing countries, public sector development projects pose a particularly complex scenario, and these projects commonly face a number of idiosyncratic challenges [5, 6]. Often, natural, social, and political factors create a range of difficulties in the project environment which include, but are not limited to, imperfect project design, ambiguous project objectives, and delays in initiating the projects after their identification [7]. Consequently, the professionals implementing the projects need to retain as much flexibility as possible to cope with any changes to the overall design while managing and implementing projects. In addition, they have to focus on the long-term effect of the project beyond the project phases and project life cycles to create lasting and beneficial assets for the community [5]. If the project’s management is focused only on the individual corporate or department level, instead of focusing on the total project supply chain, optimisation in value cannot be achieved [1].
In Bangladesh, there have lately been growing concerns about the challenges of development project implementation, especially relating to supply chain and procurement. Such concerns, officially dubbed as “objections”, were raised by a number of international development partners that support development projects in the country [8]. Consequently, the Bangladesh government responded by initiating several measures to improve the delivery of projects. Under the Annual Development Program (ADP) of the country, all public sector development projects are designed, implemented, monitored, and evaluated by the guidelines of the Ministry of Planning, Planning Commission, and respective ministries and implementing agencies [9]. In one of the public sector agriculture project completion reports, almost 80% of the projects were over budget and took more time to complete. The most common reasons for this were delays in the project start, staffing problems, natural disasters, poor budgeting and forecasting etc [10].
Agricultural development projects are intended to increase productivity or increase the returns on investment in agriculture, and in general, are designed to address specific challenges confronting a sector. These challenges for agricultural projects can be broadly classified into three categories: natural resource issues, market issues, and policy issues [11]. The projects may contribute significantly to effective agricultural development, which is critical not only for economic development but also for food security and agricultural sustainability [12]. Effective agricultural development has a significant role in ensuring sustainable supply chain management of agricultural commodities, which would be helpful in reducing waste from the system [13, 14].
Since developing countries experience a lack of resources and different types of adverse environments while managing their project supply chain [8–10, 15], it is highly recommended to identify and prioritise the key challenges to the project supply chain based on their importance and inter-relationships, so that the project professionals might address those challenges more effectively and judiciously to ensure value for money with the project deliverables. Public sector agriculture projects face some different types of challenges (i.e., environmental hazards) compared to other projects (i.e., construction projects) because most of the agriculture projects are being implemented with the common goal of increasing crop productivity, which is entirely or partially dependent on environmental factors. However, although the challenges of public sector development project supply chains are crucial for economic development in developing countries, no substantial research has been found on this topic, particularly in the case of any public sector agriculture project in a developing country. We therefore attempt to answer the following two research questions:
- RQ1. What are the most important challenges to the project supply chain in public-sector agricultural development projects in Bangladesh?
- RQ2. What are the contextual relationships among the challenges?
The paper has been organised as follows: Section 2 represents the theoretical background and literature review. Section 3 describes the research methodology. Section 4, Case Study and Results, provides a summary of the case organization, data collection, and analysis results, while Section 5 contains a detailed discussion with two sub-sections: 5.1 discussion on the identification and ranking of the challenges; and 5.2 discussion on the contextual relationship of the challenges. The study implications have been discussed in Section 6. Conclusions, research limitations, and future directions are drawn up in Section 7. They are based on the flaws that were found in this study.
Theoretical background
Project supply chain
A supply chain is a network of organizations, people, activities, information, and resources that facilitate the movement of goods and services from supplier to customer. The supply chain’s most commonly used concepts are vendor, buyer, supplier, and retailer. In today’s socioeconomic environment, the supply chain is the most important method of distributing vital items to clients [16]. Project supply chain management refers to a collection of approaches that are used to efficiently and fully integrate all of the relevant organizations’ networks and their activities in order to complete and deliver a specific product, service, or project, so that the system wide costs are minimized while exceeding or maintaining the service level expectations of the customers. The project supply chain (Fig 2) consists of nine components, and these blocks are applicable to all types and strategies of supply chains, which include but are not limited to pulling or pushing processes and agile or lean supply chains; moreover, they are applicable in any of the sectors (i.e., service, manufacturing, etc.) [1, 2]. The project supply chain is more complex than other supply chains since it has to deliver all of the project deliverables within a fixed time frame and scope. Moreover, being a part of the project, every project supply chain involves unique activities, so the project supply chain professionals have to face new challenges at every step while managing the project supply chain.
Public-sector agriculture project supply chain challenges
Due to the dearth of literature on project supply chain management, particularly in public-sector agriculture projects in developing countries, the study considered project, procurement, and/or supply-chain management issues from both developed and developing country perspectives to identify the challenges. Given the correlation between project management approaches, project supply strategies, and supply chain strategies [17], it is assumed that challenges to project and/or procurement management will have a similar impact on project supply chain management.
The study chose a systematic review approach for the literature review because it minimizes bias and ensures replicability, ensuring a rigorous grasp of the existing literature [18]. The approach used by [19, 20] is adapted in the current study. The following search strings are used to find the necessary articles: string 1- (“Procurement” OR “supply chain”) AND (“challenge” OR “barrier”) AND ("agriculture”) AND (“development project” OR “public project”) AND (“developing countries”); string 2- (“Procurement” OR “purchase”) AND (“challenge” OR “barrier”) AND ("agriculture”) AND (“development project” OR “public project”); string 3- (“Procurement” OR “supply chain”) AND (“challenge” OR “barrier”) AND ("agriculture”); and string 4- (“Procurement” OR “supply chain” OR “logistics) AND (“challenge” OR “barrier” OR “factor”) AND (“developing countries” OR “emerging economies”). To ensure comprehensiveness and quality, the current study searches Web of Science, Scopus, and Google Scholar, as the search databases. The search includes journal articles and other forms of published publications such as conference papers, book chapters, and dissertations. The current research spans the years 2000 through December 2019. Based on the criteria, the study selected the relevant articles, and it applied forward snowball and backward snowball techniques [20, 21] to get the final set of articles for the review. The shortlisted articles found in the review were used to develop the primary challenge framework including thirteen challenges, as well as four challenge categories as mentioned in subsequent sub-sections.
Project management issues.
Generally, project management in developing countries is often difficult due to a lack of resources and poor infrastructure, which makes the management of projects more complex [10, 32]. Similarly, public sector projects in Bangladesh suffer due to definite inadequacies and challenges in planning and managing procedures [9]. The study finds the following challenges, which might be considered under the project management challenge category:
- Improper procurement planning: Lack of detailed and realistic plans on schedule, budget, and procurement methodologies may act as roadblocks to maximizing project value [8, 22].
- Delay in project initiation: Delays between the identification of a project and its commencement may impair the project’s ability to deliver its deliverables on schedule [8].
- Scope creep/frequent design change: Most projects in developing countries need to be revised, reshaped, or replotted at the implementation stage, which leads to changes in project scope [23, 24].
Supply-chain issues.
The challenges that belong to this category limit the normal or expected flow of materials and components throughout the supply-chain network of a project, so they need to be considered throughout the project lifecycle. The study considered the following challenges within the supply-chain issue:
- Demand forecasting: Demand unpredictability can be aggravated by errors in demand forecasting [25, 26], so it can be considered as one of the important challenges to the project supply chain.
- Lack of contract monitoring mechanism: Contract monitoring is the key element that drives true value throughout the supply chain. The lack of a contract monitoring mechanism results in contractors taking longer to deliver the deliverables. Sometimes the entity fails to deal with non-performing contractors due to the ineffective penalty provisions in the existing procurement legislation [22–27].
- Lack of logistical support: Lack of logistical support can manifest itself in a variety of ways, including changes to the transportation system, a lack of infrastructure, physical destruction and conflict, and labour disputes affecting transportation, communications, and services [23, 24].
Contextual issues.
It is very common that developing countries experience a range of problems, that can include natural, demographic, political, and/or social issues [8, 28]. As a result, the following challenges were considered in this study as contextual issues that may impede not only the project but also the project supply chain:
- Political influence: As a developing country, political influence is critical in managing public projects in Bangladesh since it influences not only the project initiation but also the procurement execution [8, 27]. Procurement in development projects in Bangladesh faces a number of issues stemming from political influence, such as politically biased advertisements, short bidding periods, disadvantaged specifications, rebidding without adequate grounds, and so on [9].
- Social and cultural grievances: Social and cultural grievances may hamper supply chain management [26, 28]. As developing countries face unique challenges due to their different cultural identities [8], it is presumed that the project supply chain might also experience such challenges related to social and cultural grievances.
- Natural disasters and weather change: Sometimes, projects face a number of challenges related to natural disasters and weather change, i.e., storms and strong winds, floods and droughts, hurricanes, typhoons, earthquakes, volcanic activity, higher or lower rainfall or change in temperature, etc [29, 30]. As the agricultural projects are dependent on the natural environment, we included this challenge in the framework.
- Biological disease and pests: In the case of agriculture, different types of biological-diseases and pests may impact production. We considered crop and livestock pests and related diseases, contamination due to poor sanitation and hygiene, human soiling, disease and illnesses affecting food safety, degradation of natural resources, etc. [24, 29, 31].
Institutional factors.
The institutional factors deal with the factors which have an influence on insufficient implementation capacity to deliver projects. Thus, we considered the following challenges in the framework:
- Lack of competent staff: Due to a lack of adequate institutional capacity and competent staff, projects suffer in managing project activities in developing countries [8, 27].
- Government bureaucracy: Bureaucracy causes delays to the project approval, key staff deployment, and fund release. Sometimes it makes the project and procurement approval process lengthier and more complex [28]. The project planning and formulation programs in Bangladesh are bureaucratically conceived, bureaucratically implemented, and bureaucratically evaluated [9].
- Lack of institutional ethics: Institutions in developing countries suffer from corruption, biases, unfairness, and undue practices in project implementation [8, 27].
Methodology
The study applies a three-phase multi-case methodology (Fig 3) [33–35] to identify and evaluate the key supply-chain challenges (SCCs) of the public sector agriculture projects in Bangladesh. In the first phase, the study applies the modified Delphi method [36, 37] to identify the key SCCs and challenge framework. The method employed a short closed question questionnaire, which made such research work move more smoothly, saved time, and allowed the participating experts to focus on the research issue without the guesses inherent in an open questionnaire. It does not require a large sample, and it also boosts the rate of questionnaire recovery and helps the experts reach a consensus [1, 7, 38, 39]. The second phase involves the Best Worst Method (BWM) to evaluate and rank the challenges since the method has been found as an effective tool for making decisions regarding practical problems and defining criteria weight coefficients [33, 40, 41]. In BWM, an integer scale of 1–9 is used, which reduces the complexity of comparison, and this method has better performance compared to other MCDMs (i.e., AHP) since it solves the inconsistency issues [21, 33, 40, 41]. Therefore, many studies have applied the BWM in analysing supply chain issues (41). In the third phase, the study applied the Interpretive Structural Modelling (ISM) [42–44] method to analyse the contextual relationships between the challenges because the method is widely applicable in different fields of supply chain management, such as green supply chain management, sustainable supply chain management, humanitarian supply chain management, reverse logistics, and supplier selection to analyse the contextual relationships between the attributes [33, 45, 46]. Given the effectiveness of multi-criteria decision-making (MCDM) approaches in resolving complex problems involving a large number of variables [45], and given that the approach chosen is dependent on the nature of the problem and the output required by the researchers [47], this study justified the use of the modified Delphi-BWM-ISM approach.
Note: BWM- Best Worst Method, ISM- Interpretive Structural Modeling, MICMAC- cross-impact matrix multiplication applied to classification.
The modified Delphi method is derived from the Delphi method [48, 49]. Generally, the Delphi method is applied to generate an expert consensus on complex, ambiguous, and contentious topics. The method consists of five steps [48]: (1) selection of experts; (2) conducting the first round of the survey; (3) performing the second round of the survey, including feedback from the previous round; (4) conducting the third round of a survey (if required); and (5) synthesizing expert opinions to reach a consensus. During data collection, the anonymous experts are interviewed until a consensus is reached. Unlike the Delphi method, the modified Delphi does not use an open questionnaire. Alternatively, it applies reference literature to produce a structured questionnaire for the first round. As a result, the modified method generally requires fewer rounds to conduct the survey and reach a consensus.
The BWM is to evaluate and rank the decision criteria based on their optimized relative importance weights, with some basic procedures for solving the BWM outlined below [33, 40, 41, 50]:
- Step 1: Identify a relevant list of decision criteria
- Step 2: Choose best criteria (i.e., most important) and the worst criteria (i.e., least important) for main and sub-criteria.
- Step 3: Respondents are asked to elicit pairwise comparison between the best criterion over all the other criteria using a scale of 1 to 9. The scale 1 indicates that this criterion is equally important to the other criterion; whereas point 9 denotes that the identified criterion has much higher importance than another criterion. The resulting best-to-others (BO) vector for the mth respondent is defined as:
. In this matrix, the notation
presents the importance of the best criterion B compared to criterion j. Therefore, the value of
is equal to 1.
- Step IV- Similarly, the respondents are again asked to elicit pairwise comparison ratings of all other criteria with the worst criteria, which results in vector
.
Where, the notation represents the importance of criterion j over the worst (least important) criterion W, and the value of
would be 1.
- Step V- Here the optimal weights
for all the criteria are determined. The optimised criteria weighting is determined so that the maximum absolute difference for all j is minimised for the following set:
The problem is converted and formulated as follows:
Eq (1) can be formulated as a problem of linear programming, and can be written as follows:
(2)
The optimal weights are calculated while minimizing the value of
. The
value can be used to determine whether the obtained results are consistent or not. If the value is close to zero, it indicates the system is more consistent, and hence, the comparison is reliable. In addition, the consistency ratio threshold table can be used to see the level of reliability [40, 51].
The ISM method is used to collect experts`opinions using different techniques (i.e., brainstorming sessions) in order to evaluate the contextual relationship between the attributes and structure them into a systemic model [42–44]. The method follows the steps that are mentioned in Fig 4 [33, 34, 43]: select a list of criteria, assess the pair-wise contextual relationship among the criteria, develop a Structured Self Interaction Matrix (SSIM), construct a Reachability Matrix (RM), partition the RM into different levels, establish a diagram, remove the transitivity from the diagram, and establish an ISM. Additionally, the ISM-MICMAC (cross-impact matrix multiplication applied to classification) analysis involves the development of a graph to classify the attributes based on their driving and the dependence power derived from the canonical matrix of ISM analysis, and both these powers are used to classify the criteria into four clusters [45]: independent cluster, linkage cluster, dependent cluster, and autonomous cluster.
Case study and results
Selection of a case study public organisation
In this current work, one of the largest public-sector agricultural organisations in Bangladesh, the Department of Agricultural Extension (DAE) has been selected as a case study in order to consider the practical implications of this study and to analyse the SCCs. The organisation is involved in disseminating agricultural technologies through a number of projects at field level throughout the country. These projects consist of different types of activities related to the dissemination of the technologies: extension of new crop varieties, extension of farming technologies and equipment, infrastructure, providing logistic support, training and so on. Consequently, all of the participants have been selected from this organization and are professionally experienced in managing agricultural project supply chains.
Identification and finalization for key challenges
In phase I, an initial challenge framework having thirteen key SCCs and four categories (Table 1) is identified through the systematic literature review as mentioned in Section 2.2. Then, fifteen industry experts (S1 Table) from the case organisation having 4 to 10 years of practical experience in managing project supply-chain activities, aided in the refinement and further development of the challenges through the modified Delphi method. The experts were selected based on snowball and purposive techniques [8]. Although there is no fixed number of experts needed for the Delphi method, it is suggested to have 10 to 30 experts with special knowledge or experience to ensure the best output [39, 48, 52, 53]. A questionnaire with the challenge framework was sent to the experts for their opinions since the modified method proposes a single mental model that is then upgraded or modified until a consensus is reached [35, 54]. Since consensus was not met in the second round, the experts were asked to vote on each of the challenges indicating “Yes/Acceptance” and “No/Rejection” in the third round, as well. Finally, based on the consensus of the majority (>50%) of the experts’ opinions [55–57], eleven key SCCs (Table 2) along with their four major categories have been identified.
Evaluation of the SCCs based on their optimal weights
To rank the eleven SCCs, the BWM was conducted. We used snowball and purposive interviewing techniques to select eight industry experts (S2 Table) with five to ten years of experience managing public-sector agriculture projects. Primarily, the experts identified the best (most important) and worst (least important) SCCs, as well as constructed the best-to-other and other-to-worst matrices using the 1–9 rating scale presented in the previous section. Then the experts’ feedback was considered to identify the most significant SCCs following the BWM methodology. The optimal weight (Table 3) for each of the categories was obtained with the help of the sequential procedures and Eq 2. Similarly, the weights of the SCCs under specific major categories and the global values of the SCCs were also obtained [41]. Then, the SCCs were ranked based on their global weights, as shown in Table 3.
As an MCDM, the BWM requires sensitivity analysis to determine the robustness of the SCCs’ ultimate rank [58]. For the analysis, the values of preference weights of the top-ranked challenges category, project management issues (ASCC), were varied from 0.1 to 0.9, and the impact of such changes on the ranking of SCCs was noted [33, 50, 59]. According to the analysis, the final ranking of SCCs was found robust and stable at the variation of weights of the top ranked SCC from 0.3 to 0.9. While at the weights of 0.1 and 0.2 of the top ranked SCC
, minor changes were observed (S4 Table and Table 4). The consistency ratios (CR) obtained in the study, on the other hand, were determined to be below their threshold values based on the input and output-based consistency measurement approach [51], indicating that the judgements were consistent and acceptable.
Evaluation of SCCs based on their contextual relationships
Following the ISM methodology, a brainstorming session with ten industry experts (S3 Table), who specialise in public-sector agriculture project supply chain management and have 5–20 years of experience, was conducted to produce an SSIM (S5 Table) based on the experts’ opinions on the contextual relationship between the respective SCCs [33, 42, 43, 60]. The experts were selected using purposive and snowball techniques. In addition to the expert panel, one academic expert who has 10 years of experience in the relevant field was involved in verifying the ISM analysis. Then the Final Reachability Matrix (S6 Table), partitioning of the levels (S7 Table) and the ISM model (Fig 5) were constructed following the steps outlined in the methodology section. Additionally, based on the driving and dependence power for each SCC found from the final reachability matrix was used in the MICMAC analysis as shown in Fig 6.
Research discussion
Discussion on the identification and ranking of the challenges
Through a literature review and modified Delphi method, the study identified and finalized a challenge framework (Table 2) having eleven key challenges and four challenge categories for the project supply chain of public-sector agriculture projects in Bangladesh. The challenges were then analysed with BWM to rank them based on their optimal weights, as shown in Table 3. The highest weight was given to the challenge (‘improper procurement planning’), indicating that it is the most important challenge. Similarly, another study also identifies “improper procurement planning” as the most critical challenge in public sector procurement management of international development projects in Bangladesh [8]. According to the respondents, the projects are designed with a lack of detail and realistic budget and procurement plan, as well as poor or no analysis of critical risk factors and contingency planning. Likewise, due to due to a lack of transparency in procurement planning in other developing countries, such an attribute has been identified as one of the major risk factors for project procurement in public sector projects [61]. Furthermore, because procurement is a part of the project supply chain’s planning chain (see Fig 2), it is very likely to be critical for not only procurement performance but also project supply-chain success.
On the other hand, (‘biological- disease and pest’) has been reported as the least important challenge due to its lowest weighting (Table 3). Although, diseases and pests are considered as significant threat to crop production in some areas of Bangladesh [62], the study considers the challenge to be minor because the projects always incorporate additional preventive measures in their plans to mitigate the challenge. While the “
delay in project initiation” challenge was ranked second (see Table 3), development projects are frequently late in Bangladesh, not due to a lengthy approval process, but due to a delay in recruiting key project personnel [61]. It is self-evident that if any agricultural projects are late, they will require additional cropping seasons to complete the project activities, as the majority of the agriculture projects are season based. Additionally, because these projects are unique in comparison to other type of projects (i.e., construction projects), the project team may be unable to crash and fast-track techniques to complete the project in a shorter project period of time. As a result, the delay has a significant negative impact on project procurement and supply-chain management. The third significant challenge is “demand forecasting error
”. The challenges- “
lack of contract monitoring mechanism”, “
lack of competent staff”, “
political influence”, “
Natural disasters and weather change”, “
government bureaucracy”, “
lack of logistical support”, and “
lack of institutional ethics” are ranked fourth, fifth, sixth, seventh, eighth, ninth, and tenth positions, respectively (Table 3). Most of the public-sector development projects in Bangladesh may face these critical challenges as the institutions in developing countries suffer from a lack of competent staff, logistic support, administrative competencies, and technologies [8, 9, 24, 61, 63].
Discussion on the contextual relationships of the challenges
The study also examined the contextual relationships between the challenges using the ISM and ISM-MICMAC approaches, as it is critical to understand not only the relative importance of the challenges, but also their inter-relationships in order to address them effectively. After analyzing the feedback of the industry experts, who are experienced in managing public-sector agriculture projects in Bangladesh, the study proposed an Interpretive Structural Model (ISM) (Fig 5) and a graph (Fig 6) showing the inter-relationships among the challenges. Based on the contextual relationship and dependency among the challenges, the model reveals the challenge “-political influence” received the highest driving but the lowest dependence power (S6 Table); therefore, the challenge has been placed at the bottom (level V) of the ISM model (Fig 5). The challenge is an independent one, while it influences most of the other challenges directly or indirectly. Practically, it is evident that political involvement exists through various types of corruption, and the project team has to face political pressure from the trade unions in their development activities in Bangladesh [9]. Moreover, it has both positive and negative influences on the project performance in public sector projects; the ruling political party influences positively to initiate and implement some particular projects in a timely and efficient manner since these projects were involved in their political manifesto that they committed to the people; on the other hand, the projects may suffer due to some illegal political influences not only during the procurement stages but also in other stages of the project life-cycles at field level [8, 9, 61, 63]. At level IV, there are three SCCs that have strong driving power and low to moderate dependence power: “
natural disasters and weather change”, “
government bureaucracy”, and “
‘lack of institutional ethics”. As the agricultural crops are seasonally based, and the country faces a number of natural disasters such as floods, lengthy flash floods, droughts, the projects at field level might be delayed in starting their project activities in the affected areas, and sometimes the projects might start after one or two seasons. In the case of “government bureaucracy” and “lack of institutional ethics”, these challenges are directly influenced by political powers; while they influence each other directly (Fig 5), as well. Similarly, it is argued that in developing countries, week institutional culture (ethics, norms, regulation, shared understanding) leads to poor enforcement of rules and codes of conduct, resulting in lengthy bureaucracy [8].
On the other hand, the challenge “-natural disasters and weather change” has no relationship with the level V challenge- “political influence” and other challenges at level IV: “government bureaucracy”, and “lack of component staff” as shown in Fig 5. In level III, there are five challenges (
-delay in project initiation;
-improper procurement planning;
-demand forecasting error;
-lack of logistical support; and
-lack of competent staff) that are influenced directly or indirectly by level IV and V challenges; furthermore, they are influenced by each other directly and/or indirectly. For example, according to Fig 5, one of the level III challenges-
(improper procurement planning) is influenced indirectly by the level V challenge (
political influence), since the level IV challenges (“government bureaucracy”, and “lack of institutional ethics”) are influenced by “
-political influence”. Additionally, the challenge “
-improper procurement planning” is influenced by “
-delay in project initiation” and “
-lack of competent staff”, simultaneously. As the “delayed project initiation (
)” reduces the project period, it might significantly affect the project procurement cycle, which leads to a weak and improper procurement plan during the procurement phase. Similarly, it is also logical that the lack of competent staff (
) also affects procurement planning. The ISM model depicts that the ultimate influence of level V, level IV, and level III challenges is on level II (
-lack of contract monitoring mechanism) and level I (
-biological disease and pest) challenges, respectively (see Fig 5).
According to the ISM-MICMAC analysis (Fig 6), most of the BWM top ranked challenges (“-improper procurement planning”, “
-delay in project initiation”, “
-demand forecasting error”, and “
-lack of competent staff”) are placed in cluster II (linkage SCCs) since they have strong driving and dependence power. These challenges are unstable, and any action on these challenges would have an effect on others. The results show that the challenges found in level V and level IV are in cluster I (Independent SCCs) as they have strong driving power but weak dependence power (S6 Table and Fig 6). Since it is recommended that the challenges that belong to clusters I and II need to be addressed on a priority basis due to their dependence power and ability, the top-ranked challenges that belong to these two clusters need more attention to be addressed in a holistic approach.
Implications of this study
This study has several implications for practitioners, policymakers, and researchers working on public-sector agriculture development projects in developing countries, which are discussed further below.
Professionals involved in the planning and management of similar types of projects would benefit greatly from the challenge framework and challenge ranking in addressing those challenges. To begin, they must consider the most significant challenges because they have the greatest negative impact on the project’s outcome when compared to less significant challenges, which would ensure not only value for money but also effective utilization of the limited resources. Because the model shows direct linkage among the SCCs, the five-layered hierarchical model of the challenges (Fig 5) could be another tool for professionals in their decision-making process prior to mitigating the challenges. For example, it has been found that the "demand forecasting error" challenge is directly influenced by some other challenges (e.g., "improper procurement plan," "delay in project initiation," "lack of competent staff," "government bureaucracy," and so on), so project professionals should carefully consider all of these influential challenges when addressing the "demand forecasting error" challenge.
To address the challenges, professionals should also think about the challenges’ influence powers (i.e., driving and dependent power) in addition to how important they are. For instance, because the MICMAC analysis suggests that the cluster I and II challenges require special attention due to their strong driving power, professionals should place a greater emphasis on independent SCCs (i.e., ‘political influence’, ‘natural disasters and weather change’, ‘government bureaucracy’, and ‘lack of institutional ethics’) as well as the linkage SCCs (i.e., ‘improper procurement planning’, ‘delay in project initiation’, ‘lack of contract monitoring mechanism’, ‘lack of logistical support’, and ‘lack of competent staff’), respectively.
Policymakers who are involved in formulating policies, rules, and/or guidelines for managing public-sector agriculture projects in Bangladesh may find the findings to be useful tools in their future policy formulation. Furthermore, because agricultural projects in developing countries are frequently designed as joint ventures, it may be beneficial to international development partners who provide funding for agricultural projects in the developing world as well. Because there has been no previous study on this topic, the modified Delphi-BWM-ISM approach makes a significant unique methodological contribution to the existing literature in analyzing public sector agriculture project supply-chain challenges in a developing country context. The approach has two advantages for practitioners and researchers. The tool can be used by professionals to obtain more specific results from an individual project investigation. Future researchers, on the other hand, may use such tools to analyze public sector agriculture project supply chain issues in developing countries where there is a scarcity of experts who can be enlisted as study participants.
Conclusion, limitation, and future directions
Developing countries are involved in public-sector development projects that aim to improve people’s lives by strengthening the capabilities of government institutions. While these projects are complex in nature, this is due to the fact that they are embedded in complex environments. As a result, the majority of the development projects fail to be completed successfully within the project timeframe and budget. In particular, the project-supply chains are critically hampered, which means they fail to ensure value for money with their deliverables. In the context of the paucity of literature, this paper analyses the supply chain challenges in public-sector agricultural development projects in Bangladesh using a modified Delphi-BWM-ISM approach. The modified Delphi method was used to identify eleven key supply chain challenges, which were then analysed using BWM to rank them based on their relative importance and ISM to evaluate their inter-relationships. The study uniquely develops a five-layered structural model and a classification of the challenges. It is highly recommended that the professionals consider both importance and inter-relationships of the challenges, so that they can address these challenges in a holistic approach.
In terms of relative importance, the top five key challenges that seriously impede the project supply chain are “improper procurement planning”, “delay in project initiation”, “demand forecasting error”, “lack of contract monitoring mechanism”, and “lack of competent staff”. On the other hand, based on the structural model of the challenges, “political influence” has been identified as the most dominant challenge based on the contextual relationships found in the ISM model. It indicates that the challenge has either direct or indirect influence over the other challenges. The model also depicts the interrelations among the challenges, an understanding of which is critical for the practitioners when addressing the challenges. The majority of the highly ranked challenges (i.e., improper procurement planning, delay in project initiation, demand forecasting error, lack of competent staff, and political influence) have been designated as dominant challenges since they have an influence on the other challenges. As a result, it is recommended that project professionals focus not only on the ranking of the challenges, but also on their hierarchy and interrelationship according to the ISM model, in order to address these challenges more efficiently. The findings would be especially useful for practitioners and policymakers involved in public sector agriculture projects in developing countries. Furthermore, because no research work on this topic has been found, the findings as well as the use of a hybrid analytical approach (modified Delphi-BWM-ISM) would be a useful reference for future researchers for further investigation in this domain.
However, this study does possess a couple of limitations. Firstly, as no directly relevant research had been found on the subject (i.e., supply chain challenges of public sector projects in a developing country context), the study considered literature beyond the project supply chain, public sector projects, and developing country domains to develop the initial challenge framework. This might have diluted the focus of the study. Secondly, the BWM and ISM techniques depend on the feedback of experts, which can potentially be biased and may lead to unbalanced results if the experts are not carefully selected based on relevant knowledge and experience, and the data collection is not meticulously conducted. Thus, researchers who want to adopt these analytical tools should be very careful before they select the sample. Researchers can use the modified Delphi-BWM-ISM approach to test its applicability across sub-domains of the project supply chain (e.g., procurement, logistics, vendor selection, contract management, etc.) based on expert inputs and industry priorities. During the study, other project stakeholders’ (i.e., vendors’) perspectives should also be considered.
Supporting information
S1 Table. Respondents participated in the modified Delphi round.
https://doi.org/10.1371/journal.pone.0270254.s001
(DOCX)
S2 Table. Respondents participated in the BWM interview.
https://doi.org/10.1371/journal.pone.0270254.s002
(DOCX)
S3 Table. Respondents participated in the ISM brainstorming session.
https://doi.org/10.1371/journal.pone.0270254.s003
(DOCX)
S4 Table. Average weights of the SCCs of GoB funded projects obtained from BWM, and weights during sensitivity analysis.
https://doi.org/10.1371/journal.pone.0270254.s004
(DOCX)
S5 Table. Structured self interaction matrix.
https://doi.org/10.1371/journal.pone.0270254.s005
(DOCX)
S6 Table. Final reachability matrix with transitivity links followed by the modified process.
https://doi.org/10.1371/journal.pone.0270254.s006
(DOCX)
References
- 1. Morris P, Pinto J. The Wiley guide to project technology, supply chain, and procurement management [Internet]. 2007 [cited 2022 Apr 16]. Available from: https://books.google.com/books?hl=en&lr=&id=qeB74aHjSfQC&oi=fnd&pg=PT21&dq=2.%09Morris+PW,+Pinto+JK,+editors.+The+Wiley+guide+to+project+technology,+supply+chain,+and+procurement+management.+John+Wiley+%26+Sons%3B+2010+Sep+29.&ots=Cq5xCQ1rCn&sig=HdVxfUOt7
- 2.
Basu R, Wright JN. Managing global supply chains: Second edition. Manag Glob Supply Chain. 2016 Jan 1;1–469.
- 3.
PMI. PMBOK Guide | Project Management Institute [Internet]. PMBOK Guide. 2017 [cited 2022 Apr 16]. p. Sixth Edition. Available from: https://www.pmi.org/pmbok-guide-standards/foundational/PMBOK
- 4.
Basu R. Managing project supply chains. 2011;144.
- 5. Cusworth JW, Franks TR. Managing Projects in Developing Countries. Manag Proj Dev Ctries. 2013 Dec 16.
- 6. Gasik S. Are Public Projects Different than Projects in other Sectors? Preliminary Results of Empirical Research. Procedia Comput Sci. 2016 Jan 1;100:399–406.
- 7. Golini R, Kalchschmidt M, Landoni P. Adoption of project management practices: The impact on international development projects of non-governmental organizations. Int J Proj Manag [Internet]. 2015 [cited 2022 Apr 16];33(3):650–63. Available from: https://www.sciencedirect.com/science/article/pii/S0263786314001434
- 8. Ahsan K, Paul SK. Procurement Issues in Donor-Funded International Development Projects. J Manag Eng. 2018 Nov;34(6):04018041.
- 9. Hamiduzzaman M. Planning and Managing of Development Projects in Bangladesh: Future Challenges for Government and Private Organizations. J Public Adm Policy Res [Internet]. 2014 Aug 31 [cited 2022 Apr 16];6(2):16–24. Available from: https://academicjournals.org/journal/JPAPR/article-abstract/7EFD2D046789
- 10.
IMED. Project Completion Report Indonesia [Internet]. Implementation Monitoring and Evaluation Division (IMED), Bangladesh. 2020 [cited 2020 Aug 29]. Available from: https://imed.portal.gov.bd/sites/default/files/files/imed.portal.gov.bd/page/315d64be_c080_478a_8b14_fddea2e03f02/Minof Agriculture_23_5_20191.docx
- 11. Winters P, Maffioli A, Salazar L. Introduction to the Special Feature: Evaluating the Impact of Agricultural Projects in Developing Countries. J Agric Econ. 2011 Jun;62(2):393–402.
- 12. Gil JDB, Reidsma P, Giller K, Todman L, Whitmore A, van Ittersum M. Sustainable development goal 2: Improved targets and indicators for agriculture and food security. Ambio [Internet]. 2019;48(7):685–98. Available from: pmid:30267284
- 13. Sarkar B, Debnath A, Chiu ASF, Ahmed W. Circular economy-driven two-stage supply chain management for nullifying waste. J Clean Prod [Internet]. 2022;339(June 2021):130513. Available from: https://doi.org/10.1016/j.jclepro.2022.130513
- 14. Syahruddin N, Kalchschmidt M. Sustainable supply chain management in the agricultural sector: a literature review. Int J Eng Manag Econ. 2012;3(3):237.
- 15.
PD. The ADP 2020–21 [Internet]. Planning Division, Bangladesh. 2020 [cited 2020 Sep 3]. Available from: https://plandiv.gov.bd/site/files/ed1482c1-b9af-4b1e-93f9-5b60f1b82613/এডিপি-২০২০-২১-
- 16. Bhuniya S, Pareek S, Sarkar B. A supply chain model with service level constraints and strategies under uncertainty. Alexandria Eng J. 2021 Dec 1;60(6):6035–52.
- 17. PARI L, Persichilli D. Project management methodologies: a tailored approach to supply chain strategies [Internet]. Politecnico di Milano. 2019 [cited 2022 Apr 16]. Available from: http://hdl.handle.net/10589/151820
- 18. Pereira CR, Christopher M, Lago Da Silva A. Achieving supply chain resilience: the role of procurement. Supply Chain Manag. 2014 Sep 2;19:626–42.
- 19. Tranfield D, Denyer D, Smart P. Towards a Methodology for Developing Evidence-Informed Management Knowledge by Means of Systematic Review *. 2003;14:207–22.
- 20. Yadav G, Luthra S, Jakhar SK, Mangla SK, Rai DP. A framework to overcome sustainable supply chain challenges through solution measures of industry 4.0 and circular economy: An automotive case. J Clean Prod. 2020 May 1;254:120112.
- 21. Yadav G, Mangla S, … SL-IJ undefined. Hybrid BWM-ELECTRE-based decision framework for effective offshore outsourcing adoption: a case study. Taylor Fr [Internet]. 2018 Sep 17 [cited 2022 Apr 18];56(18):6259–78. Available from: https://www.tandfonline.com/doi/abs/10.1080/00207543.2018.1472406
- 22. Dzuke A, Naude MJA. Problems affecting the operational procurement process: A study of the Zimbabwean public sector. J Transp Supply Chain Manag. 2017 Feb 24;11.
- 23. Handayati Y, Simatupang TM, Perdana T. Agri-food supply chain coordination: the state-of-the-art and recent developments. Logist Res [Internet]. 2015 Dec 1 [cited 2022 Apr 16];8(1):1–15. Available from: https://link.springer.com/article/10.1007/s12159-015-0125-4
- 24. Yazdani M, Gonzalez EDRS, Chatterjee P. A multi-criteria decision-making framework for agriculture supply chain risk management under a circular economy context. Manag Decis. 2019;59(8):1801–26.
- 25. Moktadir MA, Ali SM, Mangla SK, Sharmy TA, Luthra S, Mishra N, et al. Decision modeling of risks in pharmaceutical supply chains. Ind Manag Data Syst. 2018 Sep 28;118(7):1388–412.
- 26. Samvedi A, Jain V, Chan FTS. Quantifying risks in a supply chain through integration of fuzzy AHP and fuzzy TOPSIS. Int J Prod Res. 2013;51(8):2433–42.
- 27.
Arifeen N, Zakaria SM. Issues and Challenges in Public Procurement Bidding: Bangladesh’s Experience—BRAC Institute of Governance and Development [Internet]. Brac Institute of governance & development, Bangladesh. 2013 [cited 2022 Apr 16]. Available from: https://bigd.bracu.ac.bd/study/issues-and-challenges-in-public-procurement-bidding-bangladeshs-experience/
- 28. Ika LA, Donnelly J. Success conditions for international development capacity building projects. Int J Proj Manag [Internet]. 2017 [cited 2022 Apr 16];35(1):44–63. Available from: https://www.sciencedirect.com/science/article/pii/S0263786316301855
- 29. Ge H, Gray RS, Nolan JF, Gray R, Nolan J. Agricultural supply chain optimization and complexity: A comparison of analytic vs simulated solutions and policies. Elsevier [Internet]. 2014 [cited 2022 Apr 16]; Available from: https://www.sciencedirect.com/science/article/pii/S0925527314003016
- 30. Singh KK, Baxla AK, Singh P, Singh PK. Weather based information on risk management in agriculture. Clim Chang Agric India Impact Adapt. 2018 Jan 1;206–16.
- 31. Alam MM, Morshed G, Siwar C, Murad MW. Initiatives and Challenges of Agricultural Crop Sector in East Coast Economic Region (ECER) Development Projects in Malaysia. papers.ssrn.com [Internet]. 2012 [cited 2022 Apr 16]; Available from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2942578
- 32. Landoni P, Corti B. The management of international development projects: Moving toward a standard approach or differentiation? Proj Manag J. 2011 Apr;42(3):45–61.
- 33. Moktadir MA, Ali SM, Jabbour CJC, Paul A, Ahmed S, Sultana R, et al. Key factors for energy-efficient supply chains: Implications for energy policy in emerging economies. Energy [Internet]. 2019 [cited 2022 Apr 16];189:116129. Available from: https://www.sciencedirect.com/science/article/pii/S0360544219318249
- 34. Sharma YK, Mangla SK, Patil PP, Liu S. When challenges impede the process: For circular economy-driven sustainability practices in food supply chain. Manag Decis. 2019 Apr 8;57(4):995–1017.
- 35. Gupta H, Kusi-Sarpong S, Rezaei J. Barriers and overcoming strategies to supply chain sustainability innovation. Resour Conserv Recycl [Internet]. 2020 [cited 2022 Apr 16];161. Available from: https://www.sciencedirect.com/science/article/pii/S0921344920301403
- 36. Murry JW, Hammons JO. Delphi: A Versatile Methodology for Conducting Qualitative Research. Rev High Educ. 1995;18(4):423–36.
- 37. Ko WH, Lu MY. Evaluation of the Professional Competence of Kitchen Staff to Avoid Food Waste Using the Modified Delphi Method. Sustain 2020, Vol 12, Page 8078 [Internet]. 2020 Sep 30 [cited 2022 Apr 20];12(19):8078. Available from: https://www.mdpi.com/2071-1050/12/19/8078/htm
- 38. Hsu IC, Shih YJ, Pai FY. Applying the Modified Delphi Method and DANP to Determine the Critical Selection Criteria for Local Middle and Top Management in Multinational Enterprises. Math 2020, Vol 8, Page 1396 [Internet]. 2020 Aug 20 [cited 2022 Apr 20];8(9):1396. Available from: https://www.mdpi.com/2227-7390/8/9/1396/htm
- 39. Ameyaw E, Hu Y, Shan M, … AC-J undefined. Application of Delphi method in construction engineering and management research: a quantitative perspective. Taylor Fr [Internet]. 2016 Nov 16 [cited 2022 Apr 16];22(8):991–1000. Available from: https://www.tandfonline.com/doi/abs/10.3846/13923730.2014.945953
- 40.
Rezaei J. Best-worst multi-criteria decision-making method. Elsevier [Internet]. 2015 [cited 2022 Apr 16];53:49–57. Available from: https://www.sciencedirect.com/science/article/pii/S0305048314001480
- 41. Rezaei J, Nispeling T, Sarkis J, Tavasszy L. A supplier selection life cycle approach integrating traditional and environmental criteria using the best worst method. J Clean Prod [Internet]. 2016 [cited 2022 Apr 16];135:577–88. Available from: https://www.sciencedirect.com/science/article/pii/S0959652616308022
- 42. John L, Ramesh A. Modeling the Barriers of Humanitarian Supply Chain Management in India. Springer Proc Bus Econ [Internet]. 2016 [cited 2022 Apr 16];61–82. Available from: https://link.springer.com/chapter/10.1007/978-81-322-2416-7_5
- 43. Luthra S, Garg D, Haleem A. An analysis of interactions among critical success factors to implement green supply chain management towards sustainability: An Indian perspective. Resour Policy [Internet]. 2015 [cited 2022 Apr 16];46:37–50. Available from: https://www.sciencedirect.com/science/article/pii/S0301420715000057
- 44. Mangla S, Madaan J, Sarma PRS, Gupta MP. Multi-objective decision modelling using interpretive structural modelling for green supply chains. Int J Logist Syst Manag. 2014;17(2):125–42.
- 45. Yadav G, Mangla SK, Luthra S, Rai DP. Developing a sustainable smart city framework for developing economies: An Indian context. Sustain Cities Soc [Internet]. 2019 [cited 2022 Apr 20];47. Available from: https://www.sciencedirect.com/science/article/pii/S2210670718314069
- 46. Gopal PRC, Thakkar J. Analysing critical success factors to implement sustainable supply chain practices in Indian automobile industry: a case study. Prod Plan Control. 2016 Sep 9;27(12):1005–18.
- 47. Yadav G, Desai TN. A fuzzy AHP approach to prioritize the barriers of integrated Lean Six Sigma. Int J Qual Reliab Manag. 2017;34(8):1167–85.
- 48. Hsu P, Lin F. Developing a decision model for brand naming using Delphi method and analytic hierarchy process. emerald.com [Internet]. 2013 [cited 2022 Apr 25]; Available from: https://www.emerald.com/insight/content/doi/10.1108/13555851311314013/full/html?casa_token=ryspAEbhC64AAAAA:vdK3751Nw2DxGNKLm7v9YyUD9PSk4I2qU2pS5Wdg5zOQctEJXUQNAKTXB8aqb_mGmXhzKGBkkAeICx4k4W9y8-rSt6PCCMTxWgS2aAiRGt9uI9IXJOf_WQ
- 49.
Twose P, Jones U, Cornell G. Minimum standards of clinical practice for physiotherapists working in critical care settings in the United Kingdom: A modified Delphi technique: https://doi.org/101177/1751143718807019 [Internet]. 2018 Nov 20 [cited 2022 Apr 16];20(2):118–31. Available from: https://journals.sagepub.com/doi/full/10.1177/1751143718807019
- 50. Gupta P, Anand S, Gupta H. Developing a roadmap to overcome barriers to energy efficiency in buildings using best worst method. Sustain Cities Soc [Internet]. 2017 [cited 2022 Apr 16];31:244–59. Available from: https://www.sciencedirect.com/science/article/pii/S2210670716304620
- 51. Liang F, Brunelli M, Rezaei J. Consistency issues in the best worst method: Measurements and thresholds. Omega. 2020 Oct 1;96:102175.
- 52. Okoli C, Pawlowski SD. The Delphi method as a research tool: An example, design considerations and applications. Inf Manag [Internet]. 2004 [cited 2022 Apr 16];42(1):15–29. Available from: https://www.sciencedirect.com/science/article/pii/S0378720603001794
- 53. Bouzon M, Govindan K, Rodriguez CMT, Campos LMS. Identification and analysis of reverse logistics barriers using fuzzy Delphi method and AHP. Resour Conserv Recycl [Internet]. 2016 [cited 2022 Apr 16];108:182–97. Available from: https://www.sciencedirect.com/science/article/pii/S0921344915300173
- 54. Fernández-Viñé MB, Gómez-Navarro T, Capuz-Rizo SF. Eco-efficiency in the SMEs of Venezuela. Current status and future perspectives. J Clean Prod [Internet]. 2010 [cited 2022 Apr 16];18(8):736–46. Available from: https://www.sciencedirect.com/science/article/pii/S0959652609003990
- 55. Dajani JS, Sincoff MZ, Talley WK. Stability and agreement criteria for the termination of Delphi studies. Technol Forecast Soc Change [Internet]. 1979 [cited 2022 Apr 16];13(1):83–90. Available from: https://www.sciencedirect.com/science/article/pii/0040162579900076
- 56. Loughlin KG, Moore LF. Using delphi to achieve congruent objectives and activities in a pediatrics department. Acad Med [Internet]. 1979 [cited 2022 Apr 16];54(2):101–6. Available from: https://europepmc.org/article/med/762686
- 57. Heiko A von der G. Consensus measurement in Delphi studies. Review and implications for future quality assurance. Technol Forecast Soc Change [Internet]. 2012 [cited 2022 Apr 16];79(8):1525–36. Available from: https://www.sciencedirect.com/science/article/pii/S0040162512001023
- 58. Moktadir MA, Ali SM, Kusi-Sarpong S, Shaikh MAA. Assessing challenges for implementing Industry 4.0: Implications for process safety and environmental protection. Process Saf Environ Prot [Internet]. 2018 [cited 2022 Apr 21];117:730–41. Available from: https://www.sciencedirect.com/science/article/pii/S0957582018301344
- 59. Mangla SK, Kumar P, Barua MK. Risk analysis in green supply chain using fuzzy AHP approach: A case study. Resour Conserv Recycl [Internet]. 2015 [cited 2022 Apr 25];104:375–90. Available from: https://www.sciencedirect.com/science/article/pii/S0921344915000026
- 60. Sivaprakasam R, Selladurai V, Sasikumar P. Implementation of interpretive structural modelling methodology as a strategic decision making tool in a Green Supply Chain Context. Ann Oper Res. 2015 Oct 26;233(1):423–48.
- 61. Aliza AH, Stephen K, Bambang T. The Importance of Project Governance Framework in Project Procurement Planning. Procedia Eng. 2011 Jan 1;14:1929–37.
- 62. Mondal MH. Crop Agriculture of Bangladesh: Challenges and Opportunities. Bangladesh J Agric Res [Internet]. 2010 [cited 2022 Apr 16];35(2):235–45. Available from: https://www.banglajol.info/index.php/BJAR/article/view/5886
- 63. Ahsan K. Determinants of the Performance of Public Sector Development Projects. Int J Manag [Internet]. 2012 [cited 2022 Apr 16];29(1). Available from: www.PMI.org