As decolonisation awareness and activism amplifies in the mainstream masses and within academic realms across a variety of fields, the time is right to converge parallel movements to decolonise the fields of global health and evaluation by restructuring relations of dependency and domination reified through the “foreign gaze”1 or “white gaze.” We conducted a review of relevant records with the following inclusion criteria–they define or advocate for the decolonisation of global health evaluation or explicate methods, policies or interventions to decolonise global health evaluation published by advocates of the decolonisation movement from both fields. These records were derived following a systematic article search by the lead autthor on Google, Google Scholar, NewsBank, and PubMed using the following keywords: “decolonising” and “global health,” “evaluation,” or “global health evaluation” replicating a digital search strategy utilized by scoping reviews across a variety of topics. Because the topic of interest is nascent and still emerging, the date range was not restricted. The lead author screened abstracts retrieved from the search. In total, 57 records, ranging in publication date from 1994 to 2020, were selected and charted for this review. We reviewed these records to identify socio-ecological factors that influence the decolonisation of global health evaluation, such as decolonising minds; reorienting funders and reforming funding mechanisms; and investing in sustainable capacity exchange. In doing so, we reflected on our positionality as well as our internalisation and potential reinforcement of colonial relations in the process of reporting our results. In the context of turmoil and transition due to the COVID-19 pandemic, our scoping review offers a starting point to embark on a journey first to transform and decolonise global health evaluation and then to achieve the greater goal of equity and justice.
Citation: Pant I, Khosla S, Lama JT, Shanker V, AlKhaldi M, El-Basuoni A, et al. (2022) Decolonising global health evaluation: Synthesis from a scoping review. PLOS Glob Public Health 2(11): e0000306. https://doi.org/10.1371/journal.pgph.0000306
Editor: Jose Ignacio Nazif-Munoz, Université de Sherbrooke: Universite de Sherbrooke, CANADA
Received: August 16, 2021; Accepted: October 14, 2022; Published: November 16, 2022
Copyright: © 2022 Pant et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data are in the manuscript and/or supporting information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
The concept of the “foreign gaze”  or “white gaze”  of development assumes whiteness as the primary reference of power, prestige, and progress across the world. The prevailing foreign or white gaze of development measures the political, socio-economic, and cultural processes of the Global South against the expectations of Northern saviourism and standard of Northern supremacy.The same applies to scientific scholarship and practice. Among many sectors, two fields that the foreign or white gaze has plagued are global health and evaluation . While the fields of global health and evaluation have called out the importance of cultural competence (see Mews, Schuster & Vadja, et al., 2018  to gain a nuanced and thorough understanding of the influence of cultural competence on global health evaluation), their failure to integrate curricula that acknowledge and repair damage from both fields’ colonial roots is telling [5, 6]. Emerging scholars are now explicitly naming the “depoliticized, un-critical, and ahistorical” disciplinary lens maintained within these fields, whose obliviousness to unequal economic, social, and power relations steeped in historical and ongoing injustice feels wilful to those who are disadvantaged by those relations .
Colonial legacy of Global Health
Despite the rising prominence and proliferation of Global Health efforts since World War II, Global Health trudges forward without a universally agreed upon established definition [8, 9]. Of the many proposed definitions for Global Health, this review will adopt the definitional lens offered by Beaglehole and Bonita (2010)  which centres transnational collaboration, research, and action to promote health for all. Collaborative co-creation of an evidence-base and its application through actions such as interventions, policies, or other constructive public health strategies to improve health equity and ensure health for all aligns with the ethos guiding this review. While all definitions of Global Health signal transnational perspectives, a phrase that implies lateral rather than colonial relationships, they are remiss in their omission of the health status of approximately four hundred million indigenous people. Drawing from postcolonial frameworks, we consider Indigenous Health an integral component of Global Health. Additionally, disparities in the health outcomes between racially otherized peoples and whites worldwide can largely be attributed to the detrimental effects of colonization and enslavement, exacerbated by the colonial legacy, capitalist economy and present propensities of Global Health as a field . Drawing from critical theories more generally, we similarly centre colonized and enslaved peoples as a whole.
The official narrative of the history of the field of global health proclaims that its origins lie in colonial efforts to protect colonial settlers and administrators from acquiring infectious diseases prevalent within colonies in the tropics. Perhaps a decolonised perspective would revise this historical account by offering a counter-narrative—for example, indigenous efforts to protect the peoples of Turtle Island (now called North America) from infectious diseases that were prevalent among colonisers precedes contemporary global health . While territorial colonialism might have ended decades ago in many but not all parts of the world, the colonisation of minds, cultures, politics, and economies continues and reparations are yet to be realised [11, 12]. Over the last few decades, global health scholars have called to improve health justice universally. A recently developed ethical framework titled Research for Health Justice was developed that provides guidance on meaningfully promoting global health equity through metrics such as, what research populations and questions ought to be selected, what research capacity strengthening ought to be performed and what post-study benefits ought to be provided . Despite the broadened scope of global health justice, colonial knowledge and practices still dictate policies and decision making in the field. Those from the Global South are largely relegated to token positions—for example, primarily as enumerators and implementation, research or evaluation partners and rarely as principal investigators—in global health discussions rather than inhabiting powerful roles in policy and decision making . The current global health ecosystem and its governance structure are not equipped to address contextual disadvantage in the Global South as a determinant of health . As it became evident during the COVID-19 pandemic, many strategies implemented by Western structures such as lockdown and social distancing are impossible privileges that communities living in slums in the Global South cannot avail, triggering a high prevalence of diseases among such communities . These points suggest that decolonising global health involves much more than merely adding seats for members of the Global South at the proverbial table. Diverse composition of authority does not automatically translate into changed values or reformed structures. We suspect that decolonizing the field of global health may require transforming the way in which we think about global health overall, understand the “winners” and “losers” of systems of oppression, and demonstrate awareness of who has the final say in decision making. Decolonising the field of global health likely further requires redefining its purpose, reimagining the system, and reformulating its policies and rules accordingly.
Colonial influence in the field of evaluation
As donor assistance in the form of Global Health investments has increased in the past two decades, the Global Health community is embracing the evaluation of Global Health efforts with resolve . There is consensus on the need to determine the effectiveness of Global Health investments to enhance evidence building, support decision making and capacity building . The United States Agency for International Development (USAID) frames evaluation of Global Health programs as a systematic endeavour which generates insight on programmatic processes and outcomes to enhance accountability, incorporate learning to improve developmental outcomes, and guide strategic planning of future investments .
Not unlike the global health field, evaluation theory, policies, and practices derive from and have historically been dictated by Western frameworks that fail to recognise and that systematically exclude ontologies and epistemologies that are culturally distinct from those of the European Enlightenment [19, 20]. Although the field of evaluation is intended to garner effective interventions while mitigating iatrogenic effects , it is grappling with its own colonial legacy and epistemological limitations . Evaluation as a field is embedded in the contested power relations that plague international development as a whole and it has until recently articulated no need to fundamentally transform the power relations in which it is embedded. Among other groups, indigenous peoples and researchers have made entirely clear that they want evaluations that are “of, for, by and with us” and research that does not “plan about us, without us” [23, 24]. Evaluators increasingly voice that evaluations should honour local beliefs, manners, and customs and act with integrity and honesty in their relations with all stakeholders, prioritising the most marginalised groups . Although the field of evaluation considers cultural competence, the field has yet to develop a critical body of literature or guidelines for practice that interrogate understanding of difference and inequality, including its own role therein .
Call to decolonise global health evaluation
As decolonisation awareness and activism amplifies in the mainstream masses and within academic realms across a variety of fields, the time is ripe to converge parallel movements of decolonising global health and decolonising evaluation (hereafter collectively referred to as Global Health Evaluation) by rethinking the existing models and restructuring relations of dependency and domination reified through the foreign or white gaze [1, 2]. Under the backdrop of rising social inequality and injustice, there is an awakening of social consciousness tying limitations in the meaningful advancements of these fields to lack of true diversity with respect to ways of knowing and being [20, 26].
The American Evaluation Association is centering the decolonisation of evaluation in its annual conference in 2022. Similarly, in recent years, there have been innumerous conferences and workshops in the field of global heath to fuel the demand for this subject matter worldwide.
Aims and objectives
This paper offers a description of the decolonisation of global health evaluation as specified by professionals advocating for decolosniation in their respective fields. Furthermomre, we offer a socio-ecological lens to decolonise global health along with, and by, materially decolonising evaluation.
This paper begins to answer the following research questions: 1) How do the advocates of the decolonisation global health evaluation movement describe the decolonisation of global health evaluation? 2) What socio-ecological factors do advocates of the decolonisation of global health evaluation associate with the decolonisation of global health evaluation? It draws on critical theories, particularly postcolonialism, which raises questions about the power of the gaze in defining the other relative to Europe/ European settler states . To a lesser degree, this study also draws on critical whiteness studies, which names whiteness as the unmarked standard of normativity [28, 29].
This scoping reviewutilises Arksey and O’Malley’s (2005) scoping methodology  and Bronfenbrenner’s (1979) socio-ecological model  as a conceptual framework to synthesise peer-reviewed and grey literature published on topics related to the decolonisation of global health, evaluation, or global health evaluation. Bronfenbrenner’s systems-oriented socio-ecological model  theorises that factors at various levels of individuals’ environment shape their development, health, and well-being, both independently and interactively. Our study adapts this conceptual framework to produce a socio-ecological perspective on factors that are associated in the literature with the decolonisation of global health, evaluation, or both specialties collectively.
A scoping methodology offers rigor, structure, and transparency to synthesise studies that are 1) focused on nascent topics to identify key concepts associated with them, or 2) conducted using disparate methodologies and tools to foster reliability and replicability of study findings [32, 33]. Both apply to the topics of decolonisation of global health and evaluation. Research activities were conducted between September 2020 and January of 2021. Inadequate resources and linguistic capacity within the authorship team limited the scope of selection to records published in English (Fig 1). This scoping review did not warrant institutional ethical approval because it did not involve primary research with human subjects.
Search strategy and eligibility criteria
The lead author (IP) conducted a systematic article search on Google, Google Scholar, NewsBank, and PubMed using the following keywords: “decolonising” and “global health,” “evaluation,” or “global health evaluation” replicating a digital search strategy utilized by scoping reviews across a variety of topics [32, 33]. Because the topic of interest is nascent and still emerging, the date range was not restricted (see Table 1 for details on full search strategy). These databases were selected to account for and incorporate both grey and scholarly literature in our search strategy. The lead author screened abstracts retrieved from the search. Records were selected if they included one of the following six criteria:
- a call to decolonise global health evaluation;
- a conceptualisation of theories or frameworks to decolonise global health evaluation;
- a definition of decolonisation of global health evaluation;
- an explication of methods to decolonise global health evaluation;
- detailed interventions or curricula to decolonise global health evaluation; and
- a description or demonstration of capacity to decolonise global health evaluation.
Data charting process
The lead researcher (IP) reviewed all selected records (N = 57) and developed, collaboratively with the research team, a structured charting framework which includes descriptive information for all records and emerging themes identified during the preliminary reading of included records (See S1 Table to review our charting template). Then, each research team member charted randomly-assigned records using the structured charting framework. Through this process, relevant data were extracted from records and put into the following categories: article title; number of pages; publisher; geographic location of authors’ affiliated institutions (city, state, country); applicable inclusion criteria (assigned researchers selected one out of the six listed above); definition for decolonising global health, evaluation, or global health evaluation (assigned researchers selected one); methods utilized or proposed; theoretical framework proposed or applied; barriers and facilitators; curricula proposed or applied; role of self-determination, empowerment, or sovereignty; role of cultural, spiritual, holistic, or social justice philosophy and values; role of funding and funders; any legislation, policies, or structural programs mentioned or implemented; role of knowledge generation, mobilization, and mutually beneficial reciprocity; key actors or activists; role of community support, participation, and consent; role of positionality and gaze with respect to the community (insider, outsider, insider-outsider); role of domination and control vis-à-vis liberation or transformation; efforts to build capacity and south-to-south collaborations; role of trust or mistrust; role of solidarity; role of collectivism and inter-connectedness; role of power and privilege; any additional factors/themes unlisted in the charting framework; and general notes.
Synthesis of results
Following the charting of data, the research team used Bronfenbrenner’s socio-ecological model (1979)  to collate and summarise their results in a template developed by the lead researcher. Based on the results summary template, researchers clustered the factors that advocates for decolonisation of global health evaluation who authored the selected records associated with the decolonisation of their respective fields into each level of the socio-ecological model: micro, meso, exo, and macro (see Table 2). The next step in synthesizing our results involved one researcher reviewing the results summaries submitted by all co-authors and developing an initial analytical framework [32–34]. They coded all applicable factors within the initial analytical framework for each record and incorporated new factors into the framework as they emerged. This analytical framework was shared with the entire authorship team and finalized with their feedback. Previously coded records were re-coded using the finalized analytical framework. All remaining records were then coded for applicable themes using the finalized analytical framework. Afterwards, the lead author validated all coded records with a second round of coding followed by a third round of review by research team members for the group of records assigned to them.
One researcher subsequently computed frequencies of records published on each topic by publication year, publication type, and geographic location. Additionally, collaboratively written records were coded into three categories: North X North collaboration, defined as a collaborative effort in which all authors were affiliated with an institution located in the Global North; North X South collaboration, defined as a collaborative effort in which one or more authors affiliated with an institution located in the Global North collaborated with at least one co-author affiliated with an institution located in the Global South or vice-versa; and South X South collaboration, defined as a collaborative effort in which all authors were affiliated with an institution located in the Global South. Figs 2 and 3 and Tab 2 present these frequencies along with the factors present within each article included in our study respectively. As a final step, a member of the research team conducted two rounds of thematic analysis of the summarised results, with feedback from the entire research team. Preliminary findings were drafted in narrative and visual form.
Statement on researcher positionality, reflexivity, and gaze
As noted above with respect to the authors of records included in our study, positionality is layered, fluid, intersectional, and sometimes conflicting rather than unidimensional, fixed, or static even within an individual author, let alone within a team. While our own authorship team members all share the experience of settler or franchise colonization and colonial educations—reflected in part by our study’s delimitation to the colonial language of English—we diverge with respect to classifications of gender, religion, class, and caste (as applicable), among other dimensions of difference—both those of our upbringings and those of our current situations. Some are still experiencing occupation or minoritisation. Others may enjoy political independence or numerical majority status, even as they live with the ongoing legacy of colonization and neo-colonization. Some represent the first generation in their family to gain access to internationally-recognized educational credentials. Others continue to benefit from the intergenerationally compounded access and opportunity that arises from their ancestral community or caste’s socio-economic and spiritual exclusion, exploitation, and violation of other groups, which colonial powers often take advantage of and exacerbate, even as they experience the effects of the racialized and gendered economy of global health and evaluation. These nuances and tensions complicate any uniformly authentic or subaltern voice that we may want or try to claim, and that others may attribute to us based on the geographic location of our institutional affiliations.
These nuances and tensions further complicate our own gaze, as our colonial educations derive from European languages and knowledge systems that were refined during, and for purposes of, imperial and capitalist expansion. As tied as we may be to our ancestral systems of knowledge and values, the lens through which we interpret the experiences of those we consider our people is inevitably colonially influenced . This manifests in our struggle to name patterns that global health evaluation widely observes—even if it disavows—in ways that are accurate and that acknowledge both the experience of victimisation from structures of exclusion, marginalisation, infantilisation, and violence  as well as the individual and collective agency involved in survival and resistance. Additionally, the colonial gaze is evident in the choices that we made regarding capitalisation, terminology, and comparisons as part of our analysis and reporting. Examples include decisions about whether and when to capitalise the first letter of words like “indigenous”: When do we do so intentionally to honour diasporic political identity and solidarity, and when do we do so reluctantly to facilitate legibility and recognisability for a disproportionately white, colonially educated readership who is accustomed to artificial, racialized categories? The latter amplifies the ongoing flattening of within-group difference—the essentialisation of analytical categories—at the expense of more specific references to sovereign peoples or ancestral names for culturally, politically, or linguistically distinct groups or micro-nations. Third, as raised earlier, the lens of our gaze shows up in our tendency to conflate culture, nationality, and geography. Fourth, the gaze materialises in our distinction and potential otherisation of ways of knowing that are indigenous to the Americas, Asia, and Africa, including South/ West/ Central Asia and North Africa, as well as even Europe itself—as inherently spiritual and relational. Those of us schooled in colonial academic traditions often fail to acknowledge how similar forces also shaped and continue to shape contemporary knowledge systems derived from the court-supported and church-supported European Enlightenment, which was under-girded by religious doctrine and state power. Shaping of the latter, however, continues to happen in ways that scientific and positivistic narratives of rationality and individual merit shroud.
Lastly and perhaps most importantly, micro level internalisation of the colonial gaze is reflected in our use of terminology that relies on dichotomies like “First World/ Third World,” “developed/ developing,” “Global South/ Global North,” “Eastern/ Western,” “insider/ outsider/ insider-outsider,” “low-income/ high income,” as well as “power and privilege,” all of which heighten between-group difference. The dialectical nature of identity development notwithstanding, these dichotomous constructions of categorical difference treat “have nots” and “haves” as pre-social, fixed, and presumably mutually exclusive groups. This construction of difference contrasts with one which acknowledges how groups are continuously differentiated from each other—and from whiteness—through socio-economic processes, namely, the asymmetrically structured exchange of multiple types of capital, resources, power, or energy more generally. With respect to global health evaluation, neither “North/ South” nor “East/ West” maps onto hemispheric boundaries, after all, but both correspond closely to patterns of colonisation and racialisation. In a similar way, “high-/ low-income” and “power and privilege” fail to account for the source of income, power, and privilege, and direction of their flow, wherein exploitative, extractive relations systematically devalue the labour, land, and knowledge of many individual and collective bodies even as they produce great value for a few other individual and collective bodies. Migration patterns and brain-drain heavily influenced by colonisation and enslavement further complicate these categorical distinctions—especially “insider/ outsider/ insider-outsider” . Referring to them in ways that obscure the material conditions and socio-economic relations that continuously (re)produce the observed difference allows such relations to persist, unchecked.
This section provides a descriptive summary of the research sample, summarizes how the advocates of the decolonisation of global health evaluation describe the decolonisation of global health evaluation, and adapts the socio-ecological framework to categorize the factors that sampled records associated with the decolonisation of global health evaluation. Within each level, factors are organized by theme, and their implications are elaborated upon in the Discussion section.
Descriptive summary of sampled papers
In total, 57 records, ranging in publication date from 1994 to 2020, were selected and charted for this review. Table 2 details descriptive characteristics, inclusion criteria, and factors coded for the reviewed records. Records published on the decolonisation of global health, of evaluation, or of global health evaluation have steadily increased over time, reaching their peak in 2020. The majority of reviewed records were peer-reviewed journal articles (63.16%) followed by peer-reviewed or non-peer reviewed academic documents (33.33%) such as book chapters, commentaries, research briefs, reports, seminar papers, dissertations, editorials, etc. A small percentage of reviewed papers consisted of grey literature such as blog posts and news articles (Fig 2). Authors reporting institutional affiliations in the Global North published the majority of the reviewed papers (65.0%), with just a handful of reviewed papers reporting authors from African (12.28%), Asian (5.26%), or South American (3.51%) countries, or a North-South collaboration (10.53%; Fig 3) .
RQ1. How do advocates of the decolonisation of global health evaluation describe the decolonisation of global health evaluation?
To derive an understanding of how the decolonisation of global health evaluation movement advocates describe decolonisation of global health evaluation, we relied on sampled records which included definitions as an inclusion criterion (8.7% or 5 out of 57 records) as well as the summary results documents prepared by research team members with a sub-section collating definitions provided within their assigned group of records. A research team member identified key words (e.g., “cultures,” “slavery,” “colonial”) and phrases from the definitions of global health evaluation that these two sources offered (See Fig 4 for a visual representation of recurring words and phrases associated with definitions of the decolonisation of global health evaluation in the reviewed records). Based on a thematic analysis of definitions for the decolonisation of global health evaluation available and descriptions listed within sampled records, advocates of the decolonisation of global health evaluation describe it as:
A transformative and liberatory movement that considers the effects of imperialism, slavery, racism, and colonialism on directly or indirectly colonised populations, and aims to restructure power imbalances within the fields of global health and evaluation to establish equitable, mutually beneficial, and reciprocal partnerships between those who continue to profit from the above forces of oppression and those who continue to lose from them.
RQ2. What socio-ecological factors do advocates of the decolonisation of global health evaluation associate with the decolonisation of global health evaluation?
Following the scoping review, we used Bronfenbrenner’s socio-ecological model  to identify, co-develop, and organise themes (Tab 2). Factors that influence decolonising global health evaluation include micro level themes (individuals’ and groups’ perceptions, views, stances, and attitudes); meso level themes (largely related to community, organisations, and systems); exo level themes (mainly national); and macro level themes (including collective cultural values and wider economic conditions) (Fig 5). Analyses of sub-themes are grouped under each level below. All reviewed records included factors from multiple, and typically at least three, levels of the Bronfenbrenner’s model as opposed to just one. Reviewed records tended to emphasize the meso and exo levels relative to the micro level, in particular.
According to advocates of the decolonisation of global health evaluation movement, at the micro-level, the decolonisation of global health evaluation involves self-determination of individuals, sovereignty of individuals, and decolonisation of individual minds. 14.03% or 8 out of 57 sampled records associated these micro-level factors as being integral to the decolonisation of global health evaluation (Refer to Table 2 for a listing of these records).
Self-determination and sovereignty of individuals. Sarmiento and colleagues (2020)  denote how the fields of global health and evaluation currently adopt a deficit-based and damage-centred mindset, projecting native and non-western spheres and individuals as at-risk, vulnerable, unaware, and lacking knowledge to function with sovereignty and self-determination . Self-determination of social problems and solutions by local individuals contests this hegemony of oppressive physical or mental constructs that default to external saviours introducing reform and development, resisting proxy colonising forces’ direct and indirect structural influence. As Abimbola (2018)  explains:
We can begin to truly decolonise global health by being aware of what we do not know, that people understand their own lives better than we could ever do, that they
And only they can truly improve their own circumstances and that those of us who work in global health are only, at best, enablers .
Robertson and colleagues (2004)  advise that when recipients of global health evaluation efforts are empowered and sovereign at the individual level, they are no longer performing the role of passive objects of research and interventions. Rather, individuals with self-determination and sovereignty are self-actualised, active participants and contributors to global health evaluation efforts—generating data, interpreting data, and shaping dissemination and translation of outputs for community needs and transformation. Respecting and acknowledging the self-determination and sovereignty of the recipients of global health evaluation efforts requires global health evaluation professionals to reframe their mental models first and foremost. It requires them to be intentional in allowing the recipients to lead efforts and to serve as followers recognizing their own privilege, power, positionality and gaze to counter racist an oppressive mindsets and actions  Several advocates of the decolonisation of global health evaluation successfully demonstrate these principles in practice. Bennie and colleagues (2019)  applied the four domains of an Aboriginal Ngaa-bi-nya health and social evaluation framework to co-create and deliver a “culturally respectful, meaningful, and beneficial health education and promotion coaching workshop program with, and for, Aboriginal peoples” . Similarly, Flicker and colleagues (2014)  co-designed and co-implemented an arts-based research approach to collaboratively respond to rising rates of HIV within Indigenous communities with community-based researchers and Indigenous youth. Their approach was intentional in affirming and building upon the sovereignty and self-determination of Indigenous youth by adopting a strengths and resilience-based mindset while acknowledging historical colonial and structural oppression. Indigenous youth invested in the arts-based research program shared that they felt empowered to be “living in this world too”  with self-determination and sovereignty.
Advocates of the decolonisation of global health evaluation movement cite concerns that in the absence of such intentional decolonisation efforts, deliverers and recipients of global health evaluation efforts may not consciously awaken to the beneficial impact derived from affirming and asserting the sovereignty and self-determination of individuals  For recipients and deliverers of global health evaluation efforts to consciously awaken to these realities, they require an internal paradigm shift to transform one’s minds and critically reflect on current norms and practices within the fields of global health and evaluation state scholars such as Büyüm (2020) , Guimarães (2020)  and Eichbaum (2020) .
Decolonisation of individual minds. Richardson et al. (2020)  and Sarmiento et al. (2020)  elaborate on how colonialism destroys peoples’ economies, cultures, values, religion, and much more—unravelling the social fabric and safety net of indigenous societies. Colonised peoples subsequently often doubt their own abilities and competencies, distrusting and undervaluing the ability of their nations to define the way that governance, global health, or evaluation should be conceptualised and approached .
Many Aboriginal people are suffering not simply from specific diseases and social problems, but also from a depression of spirit resulting from 200 or more years of damage to their cultures, languages, identities and self-respect .
The decolonisation of individual minds refers to repairing and reversing those internalised effects of colonization—specifically addressing how the internalisation of colonial mindsets affects global health partnerships and influences decision making and policy formulation [11, 44]. Decolonisation systematically liberates colonised minds and ways of thinking, culturally, politically, and mentally . Decolonisation of the self must therefore facilitate critical examination of mental and normative models through creative and therapeutic arts-based approaches  or religious and spiritual mediums42 which facilitate a shift in “how individuals relate to the world, respond to their internal desires, and as a result, transform into a more holistic version of themselves” [14, 41].
At the meso-level, advocates of the decolonisation of global health evaluation movement recommend reorienting funders and reforming funding mechanisms; enabling legislation and policies; resisting the co-option of knowledge generation, production, translation, and mobilisation; investing in sustainable capacity exchange; and engaging in the co-production of curricula, methods, and theoretical frameworks. 94.73% or 54 of 57 sampled records associated these meso-level factors as being integral to the decolonisation of global health evaluation (Refer to Table 2 for a listing of these records).
Reorientation of funders and reform of funding mechanisms. Decolonisation of the global health evaluation movement advocates consistently pose the question: is it possible to decolonise global health evaluation if “he who pays the piper calls the tune,” and funders and funding institutions disproportionately represent western countries and institutions? [6, 39, 47–49] The preponderance of external funding, specifically from former colonial powers, means that funding agendas and streams typically reflect imperial interests [see Levich (2015)  and Waitzkin & Jasso-Aguilar (2015)  for a definition of imperialism and explication of its historical and continuing influence on global health evaluation]. Several scholars such as Chi (2016) , Hopson (2012) , Sarmiento (2020)  and Robertson (2004)  highlight how programming is formulated based on inflexible funds, fixed timelines and shifts in the internal dynamics of donors—centring their priorities, often to the detriment of local communities. Chilisa (2015)  and Horton (2019)  caution that a skewed source of funding constitutes a hazard to global health evaluation because foreign governments, multi-lateral agencies, and international non-profit/non-governmental organizations make decisions about what to fund and how to deploy funding—at best based on national, regional, or supra-national economic and developmental goals—with little or no input from the groups on whom the global health and evaluation efforts would be directed . Lessons on how to veer away from dependence on external funding and international aid (e.g., how to increase individual and collective self-determination and sovereignty; how to enhance capacity to pivot, increase, and leverage local financial, technical, and other resource pools) can be drawn from countries now transitioning from low to middle-income status, which render them ineligible to receive donor aid .
Enabling legislation and policies. Decolonised global health interventions and evaluations prioritize the host country, local authorities, and stakeholders in addition to respecting local cultures, values, laws, and sovereignty assert Saha and colleagues (2019) . While it the current norm for global health interventions and evaluations to require prior Institutional Board Reviews or ethical clearances, reviews and clearances from foreign schools and governments alone are insufficient. Beyond engaging with and abiding by appropriate ethical bodies and codes of ethics, decolonisation involves scrutinizing legislation and policies, replacing them as necessary with those that enable local control. Failure to prioritise local or indigenous languages and cultural and social contexts during policy making and enforcement presents a barrier to health care for local and indigenous populations, actively harming them.
In Guatemala, for example, participation in research trials or community-based global health often requires fluency in Spanish, despite national-level policies stating that health care must be accessible in ones’ language of choice according to Flood and Rohloff (2018) . Similarly, Sarmiento (2020)  denotes that despite a preference among expectant mothers in Mexico for indigenous birthing rituals, practices, and traditional midwifery—especially in rural settings with few skilled healthcare providers—local health systems instated sanctions on those who chose these rather than institutionalised hospital births, denying them access to birth registration and state-provided child support. In the process, they displaced the knowledge, leadership, and livelihood of indigenous midwives, ultimately harming pregnant indigenous women. Without services in their language and providers familiar with their traditions during delivery, they were unable to choose and advocate for indigenous birthing positions. Being caught between two health systems that are at odds with each other increased their risk for birth complications.
Co-option of knowledge generation, production, translation, and mobilisation. Colonisation not only occurs by hijacking and debilitating spirits and minds, enforcing pro-colonial legislation that actively oppresses, and policy-making that erases, regulates, or criminalizes local cultures, languages, and norms . It is thought provoking that our results point to scholars in the Global North domineering presence as advocates for the decolonisation of global health evaluation movement. This points to the potential co-option or take-over of the movement where exclusively Global North scholars have a dominant presence and voice while exclusively Global South scholars appear to be entirely absent. Colonisation in global health evaluation has perhaps always occurred insidiously, such as through “safari” and “helicopter” initiatives that are tourist products masked as practicums for students in Europe and European settler states. Van Wees and colleagues (2020)  raise objections to the framing global health as health problems that take place “somewhere else but specifically in low-income countries,” global health programs and curricula offer trips to the Global South for global health missions. Caciki (2016)  and Smith (1999)  exemplify this predilection with the quote below:
This overall essentialist tone in Western research and its cognate field of evaluation: Research “through imperial eyes” describes an approach which assumes that Western ideas about the most fundamental things are the only ideas possible to hold, certainly the only rational ideas, and the only ideas which can make sense of the world, of reality, of social life, and of human beings. It is an approach to Indigenous peoples which still conveys a sense of innate superiority and an overabundance of desire to bring progress into the lives of Indigenous peoples—spiritually, intellectually, socially, and economically [55, 56].
Because such engagements operate for a limited period and engage minimally with local leaders and structures, they offer the communities whose data they extract and lives they entangle with little that is of substantial use value or that is sustainable. Instead, they offer participating institutions and individuals’ opportunities for their own advancement and edification . Entrenched in neo-colonial mindsets, such practices wield a heavy price in terms of their carbon, economic, and energy footprint.
Global health and evaluation programs compound such asymmetries in knowledge production, generation, and mobilisation by generally taking place in English and other colonial languages, particularly of Europe. International journals disproportionately publish scholarship in English and other colonial languages [57, 58] and ostracize publications in local or predatory journals, which many local researchers resort to because of the exclusive and exclusionary practices of high-impact journalsc [1, 58]. Global health evaluation professionals in high-income countries lead, manage, and attend academic and organisational centres that are headquartered in high-income countries. They hold key conferences with fees, travel costs, and visa restrictions that are inaccessible for the majority of the Global South . The circulation of ideas and citations among a global minority steeped in colonial knowledge systems has contributed to fixed epistemological positions that centre the foreign or white gaze within which “a certain global distribution has consolidated expertise (in the ‘north’) and need (in the ‘south’)” [21, 60].
Sustainable exchange of capacity. The United Nation’s Sustainable Development Goals (SDG 17) embed capacity building through North-South and South-South cooperation as a strategic priority for research partnerships in science and technology to foster innovation [23, 57]. Yet such cooperative exchange mostly remains performative and lopsided, with North-South paradigmatic, academic, and experiential rifts fuelled by historical and structural co-option of knowledge generation, production, and mobilisation and with conflation of research partnerships and capacity building efforts [55, 57]. Advocates of the decolonisation of global health evaluation movement such as Carvalho (2019)  and Hudib (2016)  recommend the following as potential pathways toward establishing sustainable capacity exchange: adopting cross-cultural humility ; suspending epistemological authority ; and developing symmetric methodologies , fair access to technologies and resources , and systems to exchange (as opposed to build) capacity . Learning and growth for all parties is both the goal and outcome of capacity exchange.
Co-production of curricula, methods, and theoretical frameworks. Local communities’ priorities, principles, and methods guide frameworks in decolonised global health evaluation. A randomised control trial conducted by Sarmiento and colleagues  in Mexico to examine the effects of inter-cultural dialogue on maternal health highlights the potential benefit of engaging in co-production with local communities as well as the potential harm that can result from not doing so. This study found that birth complications significantly decreased among indigenous women in the treatment arm compared to the control arm. It also demonstrates the effects of more than ten years of co-production alongside the local community.
The responsibility for co-producing curricula, methods, and theoretical frameworks rests squarely on those seeking to engage with communities whose cultural and historical heritages continue to be subjugated. Among the Māori of New Zealand, tikanga—which refers to customary practices or behaviours—decrees that evaluation is only authoritative when practitioners sustain Kawa whakaruruhau (cultural safety and appropriateness) in all stages of the research . Similarly, in the African context, Chilisa and colleagues suggest that the ideal community development evaluation framework is based on five interrelated and complementary principles rooted in ubuntu . While they propose that such a relational framework is indigenous to and pervasive across all of Africa, others caution against totalising and potentially essentialising characterizations of a monolithic or universal “African” culture or society [see Ram and Affun-Adebulu (2020)  for a more nuanced take on this matter].
At the exo level, decolonisation of global health evaluation prioritises community support, consent, and engagement or involvement in addition to the cultivation of collective awareness and understanding of the micro level internalisation of power and privilege, positionality, and gaze [1, 22]. 84.21% or 48 out of 57 sampled records associated these exo-level factors as being integral to the decolonisation of global health evaluation (Refer to Table 2 for a listing of these records).
Prioritising community support, engagement, and consent. Any sincere effort to decolonise global health evaluation garners community support, involvement, and consent as demonstrated by the Oglala Sioux CIRCLE Project evaluation researchers . This principle was upheld from conceptualisation through design and implementation. Pledges followed by action demonstrated that data offered by the community for research and evaluation purposes can be used responsibly and shared transparently with the community; both to avoid exploiting them and to equip them with critical information that can empower them to successfully navigate and transform the systems and stakeholders they engage with in their day-to-day lives. This project highlights how to avoid extractive relations and decentre global health evaluators’ intentions by centering local communities. Though such depth of community participation can signal altruistic intentions, asymmetrical power dynamics at institutional and structural, even if not individual, levels can lead participatory approaches to play out as a new form of tyranny (see Dorman edited by Cooke and Kothari 2001 ). Decolonizing global health evaluation distinguishes between participation and collaboration. It involves collaborating with local communities as equals—as self-determined, sovereign agents of change who are capable of prioritising and strategizing —beyond simply creating opportunities for them to participate within structures established by outsiders.
Power and privilege. The leadership of global health organisations is concentrated among those classified as white and as men, who are products of and still tied to elite institutions within the Global North, reflecting the hegemony of the field . The 2020 Global Health 50/50 report shows that high-income countries make up only 17% of the global population but are responsible for 83% of global health organisations; 50% of such organisations are based in the U.S.A. and U.K . Control over more than three-quarters of the industry by a single, small group portends an unrestrained ability to wield power and unearned privilege to decide what merits evaluation, who should conduct it, and how. Decolonising global health evaluation requires shared decision-making power between the Global North and Global South. Balanced leadership can provide the necessary check on the preponderance of racist and colonial ideologies .
Positionality and gaze. Positionality is an inherently relational term. As opposed to the idea of coming to be in relation with, relationality could be considered the original state of being and development of personal and collective identity, like many indigenous knowledge and value systems proffer, because all human beings begin life in relation, in utero and then as infants still attached to their mothers . Positionality’s inherently relational nature lies in its reference to the researcher’s location in relation to the subject matter, populations, and context . Additionally, however, positionality is an inherently structural term—unlike essentialised notions of culture—that draws from standpoint theory in that it requires that researchers situate themselves in space and time—not just geographically but also historically and in terms of social location, including economically, politically, linguistically, spiritually, etc. Researcher positionality does not exist on a bipolar continuum as “insider, outsider, insider-outsider” might suggest [1, 22]. Rather, it is multidimensional, because researchers are human beings and human beings are multidimensional. Their identities are formed in part through the systems of oppression that human beings have constructed and continue to navigate.
Gaze is the viewpoint of the knowledge producer, which is inevitably shaped by their positionality. The knowledge producer’s orientation to and perspective on the subject matter, population, and context affect every phase of the evaluation process . Gaze is largely not a matter of individual choice, but the biases inherent in any individual gaze can be balanced by mitigating the influence of individuals in the evaluation process through the relational, collaborative production of knowledge. The “insider, outsider, insider-outsider” construction of positionality and gaze are themselves reductive if not false in that even locals—certainly those with global health evaluation and decision-making power—likely gained their internationally recognisable understanding of and credentials in global health evaluation through a foreign language and curriculum, even if that foreignness is defined by classifications and experiences of caste, class, or spirituality in addition to or instead of geography or race.
Still, Cram (2016)  emphasises the positionality (whether outsider, insider, outsider-insider or multidimensional viewpoint is rooted in social and economic location ultimately influencing relationality) adopted by a researcher affects all phases of research and evaluation efforts. Being blind to ones’ positionality and gaze can lead to adverse outcomes has been detailed by Moodley (2020) . University of Kent researchers fielded a survey seeking to research views of South African healthcare practitioners on abortion access and provision of services across a variety of sectors without local ethical approvals or meaningful local engagement. When these researchers were alerted to the absence of South African researchers on the project as well as their lack of ethical approval, their response was to publish a letter in a local medical brief titled ‘University of Kent wants South African input on abortion project’. Moodley (2020)  objects to the colonialist tones and raises concerns about harms produced by such research conducted exclusively with colonialist positionality and gaze without meaningful local context and input.
At the macro level, the decolonisation of global health evaluation movement advocates advise facilitating the decolonisation of global health evaluation necessitates an emphasis on holistic understandings of safety and liberation that encompass spirituality and culture. It involves acknowledging a historical backdrop of mistrust and repairing or restoring trust (noting that “repairing” and “restoring” suggest that there was trust originally). Fostering the decolonisation of global health evaluation’s collective mind—or mental model—requires articulating its collective purpose as transformative, liberatory, and focused on restructuring power imbalances within the fields of global health and evaluation to establish equitable, mutually beneficial, and reciprocal partnerships. 70.17% or 40 out of 57 sampled records associated these macro-level factors as being integral to the decolonisation of global health evaluation (Refer to Table 2 for a listing of these records).
Emphasising safety and liberty that holistically encompass spiritual and cultural values. Culture refers to shared meaning . Culture distinguishes one community from another by embodying their history, lived experiences, knowledge, values, learned behaviours, beliefs, social hierarchies, ways of communicating, intergenerational traditions, and collective programming of the mind . Sarmiento (2020)  and Robertson (2004)  underscore that aligning health with their spiritual, ancestral, and cultural values matters to all groups [6, 39]. Similarly, Iseke (2013)  explains:
Decolonising and spirituality are inextricably linked: the outer and inner selves are connected through understandings of spirituality .
While spiritual beliefs and practices shape how all communities live and access knowledge, it is more explicit and perceptible among groups associated with otherized and minoritized spiritual traditions. The normativity of whiteness and Christianity, however, conceal their influence within scientism, and positivism. Colonial authorities view local traditions, cultures, and holistic health systems as backward or devilish and the people as savages suggest Sarmiento (2020)  and Mundel (2010) . Advocates of the decolonisation of global health evaluation movement recommend global health efforts [69–71] recognise the sacred, especially in relation to health, which is tied to some of the most intimate dimensions of life. They elaborate on how value systems in Indigenous and other formerly or currently colonised populations are built around a sense of community and togetherness between the living and ancestors with guidance from elders in the community. These values are often grounded in collective and fair responsibilities, cooperation, interdependence, and interpersonal relationships among people [69–71]. And such, they recommend that decolonised global health evaluation require policy makers, funders, evaluators, and global health practitioners to embody and enact the values of local residents with whom they collaborate. For example, Wumkes (2020)  elaborates within their dissertation how the Jamaican biomedical healthcare system has been entirely divorced from the indigenous Afro-Jamaican healing practices resulting in a failure to serve the majority of the population. They advocate for a decolonised integrative healthcare model reconciling the differential approach to culture, spirituality, and holism adopted by biomedicine and indigenous Afro-Jamaican medicine. Along the same vein, Bowman-Farrell’s (2018)  Culturally Responsive Indigenous Evaluation (CRIE) evaluation model explicates how Western global health evaluation efforts can connect to and emphasise safety and liberty for cultural and spiritual values by incorporating the multidimensional “physical, mental, spiritual, and emotional” aspects of evaluation.
Repairing and regaining trust against a historical backdrop of mistrust. Addressing the decolonisation of global health evaluation is impossible without acknowledging the history of colonialism and its tremendous ramifications according to advocates of the decolonisation of global health evaluation movement such as Bennie (2019) , Bowman-Farrell (2018) , Horton (2019)  and McKegg (2019)  among several others. Decolonised global health explicitly must recognize and repairs the pain of the past and engages in present and future practice through the lens of social justice [40, 41, 49, 71].
Any western medical institution more than a century old and which claims to stand for peace and justice has to confront a painful truth–that its success was built on the savage legacy of colonialism. Perhaps we deal with uncomfortable pasts by burying them, excusing them, or atoning for them. The Lancet, for example, is a colonial era institution 
Horton’s (2019)  quote above acknowledges the “painful truth” of the colonial origins of global health evaluation. Some of the first schools of public health were established as part of colonial occupation and meant to protect the health of colonial authorities, the local labour and productivity that they relied upon, and their overarching imperialist aims [50, 51]. For instance, the Liverpool School of Tropical Medicine is the first school of tropical medicine in the world, having been established in November 1898. According to its website, the school’s founder was Sir Alfred Lewis, “an influential shipping magnate who made significant profits from various European countries’ colonial exploitations, mainly in Africa” . The association between scientific enterprise and oppressive colonial regimes is also illustrated by rural Palestinians’ mistrust of and resistance against smallpox vaccination during British colonisation as indicated by Dadidovitch and colleagues (2007) . Although we invoke historical colonisation here, colonisation continues via other agendas and means, including through the imperialistic monopolization of global health decision making and evaluation processes [refer to Levich (2015)  and Waitzkin & Jasso-Aguilar (2015)  for a thorough definition of imperialism and explication of its historical and continuing influence on global health evaluation].
Collective self-determination and sovereignty. The current colonial form of global health evaluation compromises collective self-determination and sovereignty and relegates local people to second-class citizenship within their own land (e.g., Palestinians in Occupied Palestinian Territories). Collective self-determination with respect to decolonised global health evaluation means that local stakeholders, people, officials, and leaders hold the power to decide how, what, and when to implement and evaluate efforts assert Cram (2016) , McKegg (2019) , Chilisa (2015) , Bowman-Farrell (2015) , Wumkes , among several other decolonisation of global health evaluation advocates. Similarly, collective sovereignty connotes political authority . It means supreme authority within a territory over matters such as governance, policy making, resource utilisation and allocation, negotiation of borders and advocacy for inalienable rights to liberty, freedom of expression, housing, health, and human rights, etc. Collective sovereignty shapes decision making, leadership, governance, and regulations defining how to do things within a community .
For example, “nation building” is a term increasingly found in the literature, used particularly by leaders in Indian Country (any of the many self-governing Native American communities throughout the United States—all federal trust lands held for Native American tribes ). It refers to the process of constructing effective institutions of self-governance that can provide a foundation for sustainable social development, including health and education; judiciary and legal institutions; and successfully democratised political systems, advocacy, and actions. In other words, nation-building is the process of promoting individual and collective self-determination, self-governance, and sovereignty [77, 78]—ultimately improving tribal citizens’ social and economic situations through the creation of more capable, culturally legitimate institutions of governance and stewardship . Translating the “nation building” ethos into praxis, advocates of the decolonisation of global health evaluation movement such as Chi and colleagues (2017)  challenge mainstream global health evaluation efforts while proposing the Critical International Health Program Evaluation framework which uphold the principles of collective self-determination and sovereignty. The following quote illustrates their motivations for challenging the mainstream global health evaluation efforts by developing an alternative framework to uphold collective self-determination and sovereignty during global health evaluation efforts.
A vital tenet of our framework is that a community possesses the right to determine the path of its health development. A prerequisite of success, regardless of technical outcomes, is that programs must address communities’ high priority concerns. Current participatory methods still seldom practice community ownership of program selection because they are vulnerable to funding agencies’ predetermined priorities .
Mutual benefit and reciprocity. The Kaupapa Māori theory-based evaluation framework emphasises transformation as a core principle through the concept of koha or reciprocity . Reciprocity must be inherent in all collaborative effort to facilitate collective transformation and achieve useful outcomes for the collective good . Cavino (2013)  adds that privileging the principle of achieving mutual benefit and reciprocity in an equitable way paves the path for local communities to own and protect the knowledge that is generated. Pai (2020)  acknowledges the importance of centering mutual benefit and reciprocity to decolonise global health evaluation efforts. They outline ten recommendations on how global health evaluation efforts can apply the principle of mutual benefit and reciprocity which includes measuring and tracking reciprocity. Measuring and tracking reciprocity has the potential to lay bare the normatively extractive and transactional nature of global health evaluation efforts [49, 81].
Decolonising collective minds. The effects of colonialism are devastating and can last for generations, entrenched in colonial or neo-colonial structures and mental constructs.
Decolonisation reaches beyond removal of colonial power and dismantling of colonial structures to include decolonisation of the mind that made the coloniser feel superior and the colonised feel inferior by enforcing structural drivers of discrimination and barriers to self-determination .
Decolonising collective minds involves removing colonial powers and conditions and dismantling colonial structures to decolonise individual and collective minds—which are mutually reinforcing .
Decolonisation, therefore, is a systematic way of research and evaluation that attempts to liberate the colonized mind (individual) so that formally colonized people (collective) are not only politically emancipated, but also mentally emancipated .
Mundel (2010)  details that decolonising collective minds has revolutionary potential for decolonising global health evaluation efforts and society-at-large. Doing so begins with an individual paradigm shift leading to the dismantling of the dominant colonial mental models influencing the collective. This requires both the non-Indigenous and Indigenous to transform their inner selves. The non-Indigenous must then collectively mobilize to respect, engage with, and immerse in the decolonisation movement such as privileging Indigenous self-determination and sovereignty. Similarly, the Indigenous must experience an inner transformation as well such that they can collectively mobilize and advocate for decolonised global health evaluation as illustrated by Chilisa (2015)  with the following quote:
Along with the African renaissance concept is the Africanisation concept which refers to ‘a process of placing the African worldview at the centre of analysis’. It can be viewed as an empowerment tool directed towards the mental decolonisation, liberation and emancipation of Africans, so that they do not see themselves only as objects of research and consumers or borrowers of knowledge, but also as producers of knowledge capable of theorising about the production of knowledge in ways embedded in the cultures and experiences of the African peoples .
Intended to re-imagine global health evaluation by considering its decolonisation, this study sought to define and provide a socio-ecological understanding of factors associated with the decolonisation of global health evaluation through a scoping review of papers published on the decolonisation of global health, of evaluation, or of global health evaluation. It defines the decolonisation of global health evaluation more as a means for the advocates of the movement than an end. Representing a commitment to a process—a transformative and liberatory movement that aims to restructure relations—the definition resists the product-oriented exhortations of positivism and scientism. Understanding the factors associated with decolonisation in a socio-ecological context provides practitioners and scholars in the field of global health evaluation with micro, meso, exo, and macro level mechanisms through which the experiences, perspectives, and interests of displaced and dispossessed communities can shape the evaluation of global health interventions. In the remainder of this section, we summarize the findings and interpret the meaning of our review’s results in the context of prevailing research and theory in global health evaluation; consider their implications and significance for theory and practice; and share recommendations for future practice and scholarship on its decolonisation.
Summary & interpretation
Results of this scoping review offer global health evaluation practitioners, educators, and researchers a socio-ecological framework through which to understand the interactive, mutually-causal factors involved in decolonisation. Such an understanding allows practitioners and scholars alike to act within their spheres of influence, regardless of their personal and professional positionality or social and geographical location, with the aim of effecting change at multiple socio-ecological levels (as in micro, meso, exo, and macro). That nearly every article addressing global health, evaluation, or global health evaluation that was reviewed proferred multi-level decolonizing factors contrasts with de facto institutional understanding and approaches that rest entirely on individual level factors such as: 1) the “diversity” of individual contributors, without considering institutional and structural mechanisms that enable (or prevent) diverse perspectives to shape policy and practise; 2) the “cultural competence” of individual members of dominant groups; or 3) the benevolence of dominant institutions to “include” members of the indigenous and colonized groups whose lives their work affects . Instead, the literature on decolonizing global health evaluation offers everyone engaged in global health evaluation multiple avenues to act in decolonizing ways, regardless of their identity or positional power, and the socio-ecological model articulates those avenues explicitly.
Implications & significance
The consistency of factors identified within and across fields points to the need for intentionality among the relevant fields to act on them. In other words, while this review’s collation and organisation of decolonising factors into socio-ecological levels adds value to the relevant fields by validating the factors against each other and starting to build a conceptual framework among them—thus making them more accessible and actionable—the individual factors themselves have been documented across fields, in some cases repeatedly, for nearly 30 years, with little movement toward decolonisation as this paper defines it. The global health evaluation system’s homeostatic resistance to change and tendency toward isomorphism can be partially explained through concepts from natural and social systems that undergird the socio-ecological model employed in this paper . Similarly, the system’s more specific entrenchment of inequality along pervasive, persistent, and predictable patterns can be partially explained through concepts about power offered by critical theories of systemic oppression, which this paper also employs. In the spirit of both disciplinary traditions and the results of our review, we interrogate our process and findings below.
This study is rare in its employment of Arksey & O’Malley’s scoping methodology  and in its application of Bronfenbrenner’s socio-ecological model  not to research subjects or program participants “out there” but rather to researchers, program staff, and program evaluators “in here”, by critically reflecting on the fields of global health and evaluation themselves. It addresses global health and evaluation separately and together, identifying factors related to decolonisation of each at multiple levels. The length and nature of the research period—during a global pandemic and international uprising with respect to multiple forms of systemic oppression including direct and indirect forms of colonisation—necessarily shaped the scope and type of engagement with the literature. Still, the overwhelming consistency and synergy across reviewed records and, indeed, fields—captured systematically through a scoping methodology and conceptual framework—allows global health evaluation to move toward a theory of transformation and an associated research agenda to support its decolonisation.
Our search strategy was limited to records in the English language and to a handful of databases that associated with academic and grey literature archives. Delimiting this review to English-language literature ironically re-centres the colonial powers of Europe and European settler states. Indeed, the word “decolonise” itself was coined by colonial powers, in reference to the independence of what is now the USA from Britain  and later in reference to independence from European colonial powers in the mid-20th century . Another limitation lies in its potential reification of the artificial boundaries between levels of the socio-ecological model—not unlike other artificial boundaries, between groups, that we described in our section on positionality and gaze. The micro level factors of self-determination, individual sovereignty, and decolonisation of individual minds that were identified through this review require macro and exo level interventions as much as the exo and macro level changes listed in the results require individual agency and interpersonal relationships at the micro and meso levels. The process of decolonisation of global health evaluation is thus interactive among levels and could be characterised as “inter-level” beyond simply being “multi-level.” Lastly, the results of this study reflect the literature identified through the databases specified which may produce a selection bias as it is possible we did not capture all available documents available on this topic. The study was also conducted during a global pandemic and related series of uprisings against oppression and the results have yet to be validated by practitioners or tested empirically—steps that were beyond the scope of this study but form the basis of a research agenda focused on the decolonisation of global health evaluation. Finally, with respect to positionality, the geographic location of authors’ affiliated institutions does not necessarily correspond with their individual nationality, country of current residence, upbringing, or training, nor can it be assumed to reflect any particular cultural or political identity, experience, or perspective even when it does correspond—especially when considering displaced and diasporic communities. Geographic location of authors’ affiliated institution also does not necessarily correspond with the authors’ institutional perspective, privilege, or power, especially when considering institutions serving minoritised populations in settler colonial states (such as Asian American and Native American Pacific Islander serving institutions, historically Black colleges and universities, Hispanic serving institutions, and tribal colleges). This is particularly so in cases of team authorship. Categorizing collaboratively written records by geographic location of affiliated institution only provides some insight into the system of structural opportunities, incentives, and constraints available to authors in relation to the international political economy and authors’ efforts to work within and across disparities therein.
Because the publishing industry and academia privilege colonial languages and especially English, as described earlier, collaborating across language—colonial and indigenous—would mitigate but not resolve the limitations of focusing on English-language items for review. Additionally, future studies can intentionally and explicitly question and seek to further complicate taken-for-granted boundaries and associated perspectives, constructed along artificial binaries, through the research process and decisions. Finally, future research and practice can focus on the iterative application of and reflection on the factors identified through this review in various contexts. For global health evaluation to transform itself—to decolonise—it must sustain the praxis of interrogating everyday decisions and processes, asking how each channel multiple types of power: To what extent and in what ways do we continue to feed—and alternatively, do we starve—the ongoing (re)production of difference in the form of artificially constructed disparities, disproportionalities, and distinctions?
In sum, decolonisation is now at the risk of becoming a comfortable, trendy but misused, exploited, performative—and most worrisome of all—commercial buzzword [7, 87, 88]. An irony Khan (2021)  points out is that a corresponding word does not exist within many non-European languages. Moreover, many in the Global South are unable to relate to or agree with the terminology considering its Eurocentric origin and central focus on the Global North. For some, decolonisation can only occur when colonising institutions are shuttered and cease to influence the Global South or settler-colonial contexts [7, 87]. For others, decolonisation is simply a principle under which those interested in furthering the cause can organise .
Our paper demonstrates that scholars and practitioners have identified a myriad of socio-ecological factors that are associated with the practice of decolonisation. We have also summarised their collective wisdom and perspectives on how to define decolonisation. Despite advancing the discourse and critical assessment of the decolonisation of global health evaluation and factors associated with the term through this review, gaps exist and obstacles remain. Echoing Khan (2015) , the origin of the papers we have reviewed in this study highlights how the scholarship centred on decolonising global health evaluation primarily emerges from the Global North (specifically the U.S.A., Australia, Canada, and New Zealand) (Fig 4). The ideas and knowledge we have collated thus represent the viewpoint of scholars and practitioners residing in or affiliated with institutions in these countries. We can surely concede that it is entirely feasible that the origins of many of the authors of the reviewed papers mirror the co-authors of this reviewing paper—those who have ancestral origins or national affiliation within the Global South or Indian Country but whose current or former residence or training is in the Global North. Therefore, one could argue that the gaze this paper offers is from a third perspective, between the foreign or white gaze and the local gaze, because its co-authors—and the authors of many of the reviewed papers—experience and traverse these two orthogonal spheres.
The pandemic has highlighted the social, economic, financial, and political inequities faced by the marginalised majority (82% of the world’s population)—Black, Indigenous, Peoples of Colour (BIPOC). It also lays bare a concept that was previously intangible—global interconnectedness tying together our shared destiny and threats . The pandemic has also exposed and reversed the perception of the Global North’s superiority in upholding aspirational public governance, health, and well-being, as Asian and African countries effectively flattened the spread’s curve and returned to normalcy while European and North American countries continue to face the pandemic unabated during the first wave [89, 90]. On the darker side, there are now real risks of exacerbating existing apartheid (vaccine or financial) and rising inequities [91, 92]. Yet, there is also an unprecedented and urgent window of opportunity to transform and decolonise global health evaluation . What might decolonisation look like under these unchartered territories? Our review offers a starting point towards framing this discussion. In revisiting whether decolonisation is a product, checklist, badge, outcome, or journey: we lean heavily towards viewing decolonisation as a journey that exacts a process of transformation towards the greater goal of achieving equity and justice.
S1 Checklist. Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) checklist.
S1 Table. Charting framework template.
- 1. Abimbola S. The foreign gaze: authorship in academic global health BMJ Global Health. 2019;4: e002068. pmid:31750005
- 2. Pailey RJ. De-centering the ‘White Gaze’ of Development. Development and Change, 2019;51(3):729–745. Corrected and republished from Development and Change 2021;52(2):425–425.
- 3. Chilisa B, 2007, Responsible Research Ethics in African Contexts, Mosenodi, Volume 15, Number 1 & 2 https://journals.co.za/doi/pdf/10.10520/AJA1021559X_18&ved=2ahUKEwiKmc25hKD2AhXhk2oFHcJpDJgQFnoECAQQAQ&usg=AOvVaw2p_PwjAN9VcdageR51o115
- 4. Mews C, Shuster S, Vajda C, Lindtner-Rudolph H, Schmidt LE, Bosner S, et al. Cultural Competence and Global Health: Perspective for Medical Education–Position Paper of the GMA Committee on Cultural Competence and Global Health. 2018;35(3):Doc 28. pmid:30186938
- 5. Neghandi H, Neghandi P, Zodpey SP, Kulatilaka H, Dayal R, Grewe M. How Do Masters of Public Health Programs Teach Monitoring and Evaluation? Frontiers in Public Health: Curriculum, Instruction, and Pedagogy, 2017; l5(136). pmid:28691002
- 6. Sarmeinto I, Zuluaga G, Paredes-Solis S, Chomat AM, Loutfi D, Cockcroft A, et al. Bridging Western and Indigenous knowledge through intercultural dialogue: lessons from participatory research in Mexico. BMJ Global Health, 2020;5: e002488. pmid:32994227
- 7. Saha S, Kavattur P, Goheer A. Health Systems Global [Internet] The C-Word: Tackling the enduring legacy of colonialism in global health: Sudipta Saha, Purvaja Kavattur, Ameena Goheer. 2019, Apr 26. Available from: https://healthsystemsglobal.org/news/the-c-word-tackling-the-enduring-legacy-of-colonialism-in-global-health/.
- 8. Beaglehole R, Bonita R. What is Global Health? Global Health Action, 3: 51442. pmid:20386617
- 9. Koplan JP, Bond C, Merson MH, Reddy SK, Rodriguez MH, Sewankambo NK, et al. Towards a common definition of global health, Lancet 2009;373:1993–95. pmid:19493564
- 10. Stephens C, Nettleton C, Porter J, Willis R, Clark S. Indigenous People’s Health-Why Are They Behind Everyone, Everywhere? The Lancet. 2005; 366:9479.
- 11. Richardson L, Crawford A. COVID-19 and the decolonisation of Indigenous public health. CMAJ, 2020;21:192: E1098-1100. pmid:32958575
- 12. Guinto R. Your Weekly Update on International Health Policies [Internet]. #DecoloniseGlobalHealth: Rewriting the narrative of global health: Renzo Guinto. 2019 Feb 11 [cited 2020 Sept 15]. Available from: https://www.internationalhealthpolicies.org/blogs/decoloniseglobalhealth-rewriting-the-narrative-of-global-health/.
- 13. Pratt B. Research for Health Justice: an ethical framework linking global health research to health equity. BMJ Global Health. 2021. 6(2): e002921. pmid:33589418
- 14. Büyüm AM, Kenney C, Koris A, Mkumba L, Raveendran Y. Decolonising global health: if not now, when? BMJ Global Health. 2020. 5(8): e003394. pmid:32759186
- 15. Molina-Betancur JC, Martínez-Herrera E, Pericàs JM., & Benach J. Coronavirus disease 2019 and slums in the Global South: lessons from Medellín (Colombia). Global health promotion. 2021; 28(1), 65–69. Available from: pmid:33054562
- 16. Mookherji S, Meck K. How Can We Better Evaluate Complex Global Health Initiatives? Reflections from the January 2014 Institute of Medicine Workshop, Global health: Science and Practice. 2015;3(2):174–79 http://dx.doi.org/10.9745/GHSP-D-14-00184.
- 17. Editorial Horton R. Evaluation: The Top Priority for Global Health. Lancet (London, England). 2010;375: 526. pmid:20079530
USAID. USAID Evaluation Policy: Evaluation Learning from Experience. 2016.
- 19. Masters-Awatere B, Nikora LW. Indigenous programmes and evaluation: An excluded worldview. Evaluation Matters—He Take Tō Te Aromatawai, 2017;3, 1–27 10.18296/em.0020.
Shanker S. Definitional Tension: The Construction of Race in and Through Evaluation [dissertation]. University of Minnesota; 2019.
- 21. Chi C, Tuepker A, Schoon R, Mondaca AN. Critical evaluation of international health programs: Reframing global health and evaluation. Int J Health Plann Mgmt. 2018;33: 511–513. pmid:29314258
- 22. Cram F. Lessons on Decolonizing Evaluation from Kaupapa Māori Evaluation, Canadian Journal of Program Evaluation. 2016;30(3): 296–312,
Kawakami A, Aton K, Cram F, Lai M, & Porima L. (2007). Improving the practice of evaluation through Indigenous values and methods: Decolonizing evaluation practice—returning the gaze from Hawai’i and Aotearoa. In Brandon P.& Smith P.(Eds.), Fundamental issues in evaluation (pp. 219–242). New York: Guilford.
Walters KL, Stately A, Evans-Campbell T, Simoni J, Duran B, Schultz K, et al. 2008. “Indigenist” Collaborative Research Efforts in Native American Communities. In Stiffman A.(Ed.), The nitty-gritty of managing field research. Oxford University Press.
United Nations Evaluation Group. Integrating human rights and gender equality in evaluation. United Nations (UN) Sustainable Development Goal 17. 2017.
Global Health. (2020). Power, privilege, and priorities.
Said EW, 1978 Orientalism (1st ed.), New York, NY, Pantheon Books.
- 28. Ahmed S, 2007, A Phenomenology of Whiteness, Feminist Theory, 8(2):149–68.
Doane AW & Bonilla-Silva E, (Eds.), 2003, White Out: The Continuing Significance of Racism (1st ed.), Routledge https://doi.org/10.4324/9780203412107.
- 30. Arksey H, O’Malley L. Scoping studies: towards a methodological framework.” International Journal of Social Research Methodology: Theory & Practice. 2005;8(1): 19–32.
Bronfenbrenner U. The ecology of human development: Experiments by nature and design. 1979. Cambridge, MA: Harvard University Press.
- 32. Ahmed T, Lucas H, Khan AS, Islan R, Bhuiya A, Iqbal M. eHealth and mHealth initiatives in Bangladesh: A scoping study. BMC Health Services Research. 2014;4(1): 260–260. pmid:24934164
- 33. Pant I, Poudyal A. #Ringingthealarm: Chronic “Pilotitis” Stunts Digital Health in Nepal. 2019 ITU Kaleidoscope: ICT for Health: Networks, Standards and Innovation (ITU K). 2019;1–9 https://doi.org/10.23919/ITUK48006.2019.8996139
Ritchie J, Spencer L. Qualitative data analysis for applied policy research. In: Bryman A, Burgess RG, editors. Analyzing Qualitative Data. London: Routledge; 1994. p. 173–94.
Young IM, 2011, The five faces of oppression, in Young I M& Allen D S(Eds.), Justice and the Politics of Difference (Paperback reissue ed., pp. 39–65), Princeton, NJ, Princeton University Press.
- 36. Serour GI. Healthcare workers and the brain drain. International Journal of Gynecology & Obstetrics, 2019;106(2):175–178.
Wikemedia Commons. World Map Grayscale. Accessed here: - https://commons.wikimedia.org/wiki/File:World_Map_Grayscale.png
- 38. Abimbola S. On the meaning of global health and the role of global health journals. Int Health. 2018;10(2): 63–65. pmid:29528402
- 39. Robertson P, Jorgensen M, Garrow C. Indigenizing Evaluation Research: How Lakota Methodologies Are Helping “Raise the Tipi” in the Oglala Sioux Nation. American Indian Quarterly, 2004;28(3):499–526.
- 40. McKegg K. White Privilege and the Decolonisation Work Needed in Evaluation to Support Indigenous Sovereignty and Self-Determination. Canadian Journal of Program Evaluation. 2019;34(2).
- 41. Bennie A, Marlin D, Apoifis N. & White RL. (2019). ‘We were made to feel comfortable and …safe’: co-creating delivering, and evaluating coach education and health promotion workshops with Aboriginal Australia peoples. Annals of Leisure Research, https://doi.org/10.1080/11745398.2019.1622430
- 42. Flicker S, Danforth JY, Wilson C, Oliver V, Larkin J, Restoule JP, et al. “Because we have really unique art”: Decolonizing Research with Indigenous Youth Using the Arts. International Journal of Indigenous Health. 2014;10(1): 16–34.
- 43. Guimarãesa MB, Nunes JA, Velloso M, Bezerra A, de Sousa MI. Integrative and complementary practices in the health field: towards a decolonisation of knowledge and practices. Saúde Soc, 2020, v.29, n.1, e190297.
- 44. Eichbaum QG, Adams LV, Evert J, Ho MJ, Semali IA, van Schalkwyk SC. Decolonizing Global Health Education: Rethinking Institutional Partnerships and Approaches. Academic Medicine: Journal of the Association of American Medical Colleges. 2002.
- 45. Mundel E, Chapman GE. A decolonizing approach to health promotion in Canada: the case of the Urban Aboriginal Community Kitchen Garden Project. Health Promotion International, 2010;25(2):166–173. pmid:20197359
- 46. Gaotlhobogwe M, Major TE, Koloi‐Keaikitse S, Chilisa B. Conceptualizing evaluation in African contexts. New Directions for Evaluation, 2018(59):47–62.
- 47. Hopson RK, Kirkhart KE, Bledsoe KL. Decolonizing evaluation in a developing world. Implications and cautions for equity-focused evaluation. Evaluation for equitable development results. 2012.
- 48. Chilisa B, Major TE, Gaotlhobogwe M, Mokgolodi H. Decolonizing and indigenizing evaluation practice in Africa: toward African relational evaluation approaches. Canadian Journal of Program Evaluation. 2015;30(3).
- 49. Horton R. Offline: Transcending the guilt of global health. Lancet (London, England), 2019;394(10203): 996–6736. pmid:31544752
- 50. Levich J. The Gates Foundation, Ebola, and Global Health Imperialism. American Journal of Economics and Sociology. 2015;74(4): 704.
- 51. Waitzkin H, Jasso-Aguilar R. Imperialism’s Health Component. Monthly Review. 2015 Jul 1;67(3).
- 52. Mao W, McDade KK, Huffstetler HE, Dodoo J, Abankwah DNY, Coleman N, et al. Transitioning from donor aid for health: Perspectives of National Stakeholders in Ghana. BMJ Global Health. 2021;6: e003886. pmid:33441335
- 53. Flood D & Rohloff P. Indigenous languages and global health. Lancet Global Health, 2018;6(2): E134–135. pmid:29389530
- 54. van Wees SH, Holmer H. Global health beyond geographical boundaries: reflections from global health education. BMJ Global Health. 2020;5:e002583. pmid:32381655
- 55. Cakici H. Getting to the Roots of Evaluation Capacity Building in the Global South: Multiple Streams Model to Frame the Agenda Status of Evaluation in Turkey, Canadian Journal of Program Evaluation. 2016. 30(3):277–295.
Smith LT. Decolonizing methodologies: Research and indigenous peoples. London: Zed Books; 1999.
- 57. Carvalho A, Ferrinho P, & Craveiro I. Towards post coloniality capacity-building methodologies–some remarks on the experiences of health researchers from Mozambique and Angola. Ciencia & Saude Coletiva. 2019;24(5): 1617–1626.
- 58. Forbes Pai M. [Internet]. How prestige journals remain elite, exclusive, and exclusionary: Madhukar Pai. 2020, Nov 30. Available from: https://www.forbes.com/sites/madhukarpai/2020/11/30/how-prestige-journals-remain-elite-exclusive-and-exclusionary/?sh=62fa94984d48
- 59. Svadzian A, Vasquez NA, Abimbola S, Pai MGlobal health degrees: at what cost? BMJ Global Health. 2020;5(8) pmid:32759185
- 60. Montenegro CR, Bernales M, Gonzalez-Aguero M. Teaching global health from the south: challenges and proposals. Critical Public Health. 2020; 30:2:127–129.
- 61. Hudib A, Cousins BJ, Oza J, Lakshminarayana U, Bhat VD. Canadian Journal of Program Evaluation. 2016;30(3):329–343.
- 62. Ram R, Affun-Adegbulu C. International Health Policies [Internet]. Decolonizing HSPR–the Africa Convening: Ravi Ram, Clara Affun-Adegbulu. 2020 Oct 9. Available from: https://www.internationalhealthpolicies.org/featured-article/decolonizing-hpsr-the-africa-convening/
Dorman W. Participation: The new Tyranny? Edited by Cooke Bill and Kothari Uma. London: Zed Books. 2001. ISBN 1-85649-794-1.
Hollway W, 2010 Relationality: The intersubjective foundations of identity, in Wetherell M.& Talpade Mohanty C.(Eds.), The SAGE Handbook of Identities (pp. 216–232), London, Sage Publications Ltd.
- 65. Moodley K. (2020). Research imperialism resurfaces in South Africa in the midst of the COVID-19 pandemic–this time, via a digital portal. S Afr Med J 2020, 110(11). https://doi.org/10.7196/SAMJ.2020.v110i11.15285.
Hall S. “The work of representation” in Representation: Cultural Representations and Signifying Practices, 1997. London, Sage Publications & Open University.
- 67. Li J, Karakowsky L. Do we see eye-to-eye? Implications of cultural differences for cross-cultural management research and practice. The Journal of psychology. 2001;135(5): 501–517. pmid:11804004
- 68. Iseke J. Spirituality as decolonizing: Elders Albert Desjarlais, George McDermott, and Tom McCallum share understandings of life in healing practices. Decolonisation: Indigeneity, Education & Society, 2(1):35–54.
Coghlan D, Bryndon-Miller M. The Sage encyclopedia of action research. Thousand Oaks. 2014. CA: SAGE.
- 70. Wumkes J. Mystic Medicine: Afro-Jamaican Religio-Cultural Epistemology and the Decolonisation of Health. (2020). Graduate Theses and Dissertations. https://scholarcommons.usf.edu/etd/8311Liverpool School of Tropical Medicine. History. 2019. https://www.lstmed.ac.uk/history
- 71. Waapalaneexkweew (Nicole R. Bowman-Farrell, Mohican/Lunaape). Looking backward but moving forward: Honoring the sacred and asserting the sovereign in Indigenous evaluation. American Journal of Evaluation. 2018;39(4): 543–568.
Liverpool School of Tropical Medicine. History. 2019.
- 73. Dadidovitch N, Greenberg Z. Public Health, Culture, and Colonial Medicine: Smallpox and Variolation in Palestine During the British Mandate. Public Health Chronicles. 2007;122: 398–405.
Philpott D. Sovereignty [Internet]. The Stanford Encyclopedia of Philosophy Archive Fall 2020 Edition. 2020. Available from: https://plato.stanford.edu/archives/fall2020/entries/sovereignty/.
- 75. Slattery B. Aboriginal sovereignty and imperial claims. Osgoode Hall Law Journal. 1991;29(4): 681–704.
Wikipedia.org [Internet]. Indian Country; c2020 [cited 2020 Dec 15] Available from: https://en.wikipedia.org/wiki/Indian_country#cite_note-1
Moore M. The right of Indigenous Peoples to Collective Self-Determination. In Macedo S.and Buchanan A.(eds). Self-Determination and Secession. 2002 (pp 89–118). New York: New York University Press, XLV.
- 78. Thomas EF, Amiot CE, Winnifred RL, Goddard A. Collective Self-Determination: How the Agent of Help Promotes Pride, Well-Being and Support for Intergroup Help. Personality and Social Psychology Bulletin, 2017;4(3): 662–677. pmid:28903633
- 79. Kerr S. Kaupapa Māori theory-based evaluation. Evaluation Journal of Australasia, 2012;12(1): 5–18.
- 80. Cavino HM. Across the colonial divide: Conversations about evaluation in Indigenous contexts. American Journal of Evaluation. 2013. 34(3):339–355.
Pai M. Forbes [Internet]. Reciprocity in Global Health: Here’s how we can do better. 2020 Mar 6. Available from: https://www.forbes.com/sites/madhukarpai/2020/03/06/reciprocity-in-global-health-here-is-how-we-can-do-better/?sh=2ace53a577a9
- 82. Chilisa B. (2015). A synthesis paper on the Made in Africa evaluation concept. African Evaluation Association. Retrieved February 4, 2020, from https://afrea.org/wp-content/uploads/2018/06/MAE2-Final-31st-august.pdf
- 83. Opara IN. It’s Time to Decolonize the Decoonization Movement. Speaking of Medicine and Health. PLOS Blogs. 2021 July. Available from: https://speakingofmedicine.plos.org/2021/07/29/its-time-to-decolonize-the-decolonization-movement/.
Williams B, Hummelbrunner R. Systems Concepts in Action: A Practioner’s Toolkit. Stanford University Press, Stanford CA. 2010.
- 85. Bancroft F. (1898). Seward’s Ideas of Territorial Expansion. The North American Review, 167(500): 79–89. http://www.jstor.org/stable/25119035.
- 86. Betts RF. (2012). Decolonisation: A brief history of the word. In Beyond Empire and Nation (p. 23–). BRILL. https://doi.org/10.1163/j.ctt1w8h2zm.5
- 87. Khan T. Decolonisation is a comfortable buzzword for the aid sector. Open Democracy. 2021 Jan 15.
- 88. Shringapure B. Africa is a Country. [Internet] Notes on fake decolonisation: Bhakti Shringapure. 2020 Dec 18. Available from: https://africasacountry.com/2020/12/notes-on-fake-decolonisation
- 89. Penn M. Duke Global Health Institute [Internet]. How Some Asian Countries Beat Back COVID-19: Michael Penn. 2020 Aug. Available from: https://globalhealth.duke.edu/news/how-some-asian-countries-beat-back-covid-19
- 90. Stancati M, Yoon D. COVID-19’s Global Divide: As West Reels, Asia Keeps Virus at Bay. The Wall Street Journal. 2020 Oct 20.
- 91. Hickle J. Apartheid in the World Bank and the IMF. Al Jazeera. 2020 Nov 26.
- 92. Holmes O. Palestinians excluded from Israeli Covid Vaccine Rollout as Jabs Go to Settlers. The Guardian. 2021 Jan 3.