Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

How Are Health Research Priorities Set in Low and Middle Income Countries? A Systematic Review of Published Reports

How Are Health Research Priorities Set in Low and Middle Income Countries? A Systematic Review of Published Reports

  • Skye McGregor, 
  • Klara J. Henderson, 
  • John M. Kaldor
PLOS
x

Abstract

Background

Priority setting is increasingly recognised as essential for directing finite resources to support research that maximizes public health benefits and drives health equity. Priority setting processes have been undertaken in a number of low- and middle-income country (LMIC) settings, using a variety of methods. We undertook a critical review of reports of these processes.

Methods and Findings

We searched electronic databases and online for peer reviewed and non-peer reviewed literature. We found 91 initiatives that met inclusion criteria. The majority took place at the global level (46%). For regional or national initiatives, most focused on Sub Saharan Africa (49%), followed by East Asia and Pacific (20%) and Latin America and the Caribbean (18%). A quarter of initiatives aimed to cover all areas of health research, with a further 20% covering communicable diseases. The most frequently used process was a conference or workshop to determine priorities (24%), followed by the Child Health and Nutrition Initiative (CHNRI) method (18%). The majority were initiated by an international organization or collaboration (46%). Researchers and government were the most frequently represented stakeholders. There was limited evidence of any implementation or follow-up strategies. Challenges in priority setting included engagement with stakeholders, data availability, and capacity constraints.

Conclusions

Health research priority setting (HRPS) has been undertaken in a variety of LMIC settings. While not consistently used, the application of established methods provides a means of identifying health research priorities in a repeatable and transparent manner. In the absence of published information on implementation or evaluation, it is not possible to assess what the impact and effectiveness of health research priority setting may have been.

Introduction

Health research is an essential tool for improving health and health equity in low- and middle-income countries (LMICs) [1], [2]. Research has the potential to deliver widespread population health changes that respond to critical needs and contribute to sustainable development outcomes in the world's poorest [1]. The 2013 World Health Report highlights the essential role health research plays in progressing the Millennium Development Goals and universal health coverage [2]. In resource rich settings, a high proportion of available research funds go to investigator driven initiatives, but in LMICs there is an expectation that research must respond more directly to community health needs, and therefore be conducted according to recognised priorities.

In the absence of priority setting, there is a risk that research conducted in LMICs will follow topics determined by funders for their own purposes [3] or fail to respond to explicit health needs. Alignment with donor policies can distort national priorities and undermine the role of national research in LMICs [4]. In an essay by Sridhar, developing country health ministers have argued that research priority setting in LMCs is also affected by ‘multi-bi financing’, which is the practice whereby donors choose to route earmarked funding through multilateral agencies and new multistakeholder initiatives (such as the Global Fund to Fight AIDS, Tuberculosis and Malaria). ‘Multi-bi financing’ risks imposing the priorities of powerful states on poorer countries weakening the opportunity for national priority-setting [3].

In 1990 the Commission on Health Research and Development drew attention to the need for Essential National Health Research for LMICs [5]. Over the last three decades methods of health research priority setting (HRPS) have evolved in response, with numerous approaches being taken. The publication in 2000 of the 10/90 Report on Health Research [6], highlighting the gap in expenditure on diseases that affect the world's poorest, provided further impetus to strengthen health research priority setting in LMICs.

There are several different established methodologies that have been employed for health research priority setting [2]. Comprehensive approaches [7] include the 3-Dimensional Combined Approach Matrix [8][11] (3D CAM), the Essential National Health Research (ENHR) method [10], [12], the Child Health and Nutrition Research Initiative (CHNRI) method [9], [10], [13] and the Council on Health Research and Development (COHRED) method [10]. Other approaches used include the Delphi method [14] where stakeholders develop an initial list, which is recirculated for further consideration, and the nominal group technique whereby consensus is reached through discussion [15]. Other, more informal methodologies have included a stepwise process, which may consist of an initial literature review, qualitative collection of data through interviews and focus groups, and prioritisation process through a workshop or further consultation with stakeholders; and national or regional workshops/conferences without any explicit specification of a pre-defined HRPS strategy. A number of articles provide detailed analysis of the different methods and approaches [7], [10], [16].

Previous reviews of research priority setting methodology have been restricted to geographic areas [17], [18]; specific areas of health research, such as child and maternal health [19][21], tuberculosis [20], mental health [22], and health systems research [23], [24]; national level exercises [25], [26] or the activities of the World Health Organization [27]. As none of these reviews addressed the entire, complex landscape, we undertook a systematic review of all reported health research priority setting initiatives involving LMICs, with a particular focus on methodologies.

Methods

For peer reviewed articles, the electronic databases PubMed, EMBASE and CINHAL were searched (time period March 2014 or earlier). Reference lists of included articles and review articles were also examined for relevant reports. The following search term combinations were used:

  1. “priority setting” [all fields] OR “research priorities [All fields] OR “research priority” [all fields] OR “priority research” [all fields] OR “research agenda” [all fields] OR “resource allocation” [all fields] OR “priorities’ [all fields]
    AND
  2. “global” [key word, MESH] OR “developing country/ies” [keyword, MESH], OR ‘low income countr*” [keyword) OR “middle income countr*” [keyword], OR the name of the 2012 World Bank listed low- and middle-income countries and regions [keyword, MESH] [28]

An initial review of titles and abstracts was undertaken. Articles with a title/abstract that made no mention of health research priority setting, or an activity or outcome that could be described as such were excluded. If insufficient information was provided in the abstract/title to make a determination, the full text was reviewed. Reports were determined to relate to LMICs either if the work was conducted in a low- or middle-income country or region, as defined by the World Bank [28] or the report specified research priorities for LMICs or regions. Articles that reported on priority setting within an organisation were excluded as were reports that described research priorities but provided insufficient detail to determine what process had been used.

A Google search was conducted for non-peer reviewed literature, using the search string ‘health research priority setting’ with the name of each of the World Bank listed LMICs and regions. A search was also undertaken of key websites, including those of the Council on Health Research and Development, Health Research Web, ERA Watch, and the Alliance for Health Policy and Systems Research.

Reports were analysed according to a quality assessment framework, modified from criteria used by the World Health Organization in an earlier review [27], and taking account of the principles of health research priority setting described by Viergever et al [7]. Criteria included who instigated the initiative; what strategy was used; what stakeholders were involved in the process; the outcome of the process; and any evidence of an implementation or follow-up strategy. In initiatives with prioritized outcomes and using classifications used elsewhere [13], [29], [30] the top ten research priorities, for initiatives covering areas other than health systems research, were categorized as either:

  1. Description (epidemiology or evaluation of existing interventions)
  2. Discovery (new interventions)
  3. Development (improving existing interventions)
  4. Delivery (health policy systems, including cost-effectiveness)

Results

There were 126 reports on priority setting initiatives that met inclusion criteria (Figure 1, see Table S1 for report details). There were 13 initiatives that were reported on multiples times (together the subject of 48 reports), resulting in a total of 91 separate health research priority setting activities. The number of initiatives per year increased over time, with the highest number in 2013 (Figure 2). As shown in Table 1, initiatives most often described activities at either the global level (46%) or the national level (43%), with a smaller proportion (11%) at the regional level.

thumbnail
Figure 1. Identification of reports of health research priority setting initiatives from (a) peer reviewed and (b) non peer reviewed sources.

https://doi.org/10.1371/journal.pone.0108787.g001

thumbnail
Figure 2. Number of HRPS initiatives per year, peer review and non-peer reviewed.

https://doi.org/10.1371/journal.pone.0108787.g002

thumbnail
Table 1. Characteristics of reviewed health research priority setting initiatives with a focus on LMICs.

https://doi.org/10.1371/journal.pone.0108787.t001

For initiatives at the regional or national setting the largest proportion was from Sub Saharan Africa (49%), followed by East Asia and the Pacific (20%) and Latin America and the Caribbean (18%). Of the 39 national level priority setting initiatives 44% were in lower middle income countries, 33% in upper middle income countries and 23% in low income countries. Research priorities were assessed across all areas of health in 25% of initiatives, communicable diseases in 20%, health systems in 12%, and child health in 10% (Table 1). The number of research priorities identified ranged from 5 to 588, with a median of 29 (IQR 12-55).

The majority of initiatives were instigated by an international organisation or collaboration (46%), by a LMIC government (32%) or LMIC academics (15%). The most common process to elicit priorities was a workshop/conference without any explicit specification of established HRPS methods (24%), followed by CHNRI (18%) and a stepwise process including a literature review, in-depth interviews and consultation (18%). Initial discussions were informed by burden of disease data or literature reviews of existing research in a third of initiatives. All initiatives engaged researchers in the process, with 74% engaging government (including policy makers) and 55% practitioners. The opinions of patients and/or community were formally considered in 29% of initiatives. Research was prioritized (as against just listed) in over half of the initiatives (54%). Of the priority setting initiatives reviewed 42% resulted in specific research topics, 35% in broad research areas, and 23% in specific questions. A small number (8%) provided broad research themes, as well as more specific topics, and in some cases example research questions. The majority of initiatives reviewed (78%) did not provide any evidence of an implementation or follow-up strategy. Of the initiatives covering areas of health other than health systems, 24 provided sufficient information to enable a classification of each research priority. Of the remaining 67 initiatives, 11 covered health systems research, 41 listed research without any indication of priority, and 15 provided research topics with insufficient detail to categorise. Among the top ten priorities in each initiative the median proportion of descriptive research per initiative was 25% (IQR 10–50), discovery 0% (IQR 0–14), development 17% (IQR 5–30) and delivery 35% (IQR 16–64) (Table 1).

The application of criteria to determine research priorities was used in 67% of reports. While not mutually exclusive, the different types of criteria fit into three broad categories (Table 2), criteria at the population level (including burden of disease, equity and efficacy and effectiveness), health systems level (workforce, political context and delivery), and research process and feasibility (knowledge generation, ethics, relevance, funding). Table 2 provides examples of the different criteria used in the initiatives reviewed.

thumbnail
Table 2. Type of criteria used for determining health research priorities.

https://doi.org/10.1371/journal.pone.0108787.t002

A number of common challenges emerged in the initiatives including stakeholder engagement, data limitations through limited published information available through literature reviews, and limited capacity to implement research priorities.

Discussion

This review provides a comprehensive global assessment of published health research priority setting initiatives in LMICs. The majority of priority-setting exercises were conducted at the global level with a LAMIC focus, initiated by international organisations, employed a workshop methodology and focused on prioritised, and specified research topics determined using criteria in the areas of description and delivery across all health research areas. Most did not have any evidence of implementation or follow-up. Earlier reviews have been limited to specific areas of research [19] or geographical areas [17], considered only national initiatives [25], or were restricted to initiatives led by WHO [27]. We found that while the number of health research priority setting initiatives has been increasing over time; there is inconsistent application of methods and outcomes generated and limited evidence, at least in terms of published reporting, of implementation strategies or outcomes. A number of challenges impede research priority setting in LMICs, including appropriate stakeholder engagement as well as data and capacity constraints.

Our review only included initiatives that were reported in English, excluding a number from non-English speaking LMICs. We were also limited by the information provided in the reviewed documents. In some reports only brief information was provided on the strategy used and stakeholders engaged, suggesting a possible lack of transparency of the process. Some reports did note that participant confidentiality was essential to ensure unbiased opinions were provided. Beyond the reports reviewed here, we found indirect or secondary evidence of other priority setting activities in LMICs for which we were unable to locate a publicly available report, or links to which were disabled. It is also likely that we missed information on other activities with no published information available that were therefore not searchable.

The increase over time in the number of initiatives may be due to a greater focus on health research more generally in LMIC settings. While the 10/90 gap may have closed somewhat since 2000, the concept continues to provide motivation for increased health research in LMICs. The 2005 Paris Declaration [31] to guide more effective aid and development programs has also encouraged alignment with national priorities and processes. It is increasingly acknowledged that health research priority setting facilitates targeted research that has the potential for the greatest impact [7] as well as building national capacity in a number of respects. With finite resources and increasing demands on health systems due to the double burden of disease in LMICs [32], it is understandable that there is a heightened sense of urgency about identifying health research priorities.

One of the critical aspects of priority setting is achieving the right level of detail in the research priorities, too broad and they fail to provide guidance, too detailed and they risk being too prescriptive. Global level exercises pose the additional challenge of the application of priorities to a variety of contexts, as noted by Kosek [33]. Some of the initiatives reviewed provided broad research themes, with sub-themes providing more detail, and examples of specific questions, which may facilitate implementation. Whether research options are prioritized or just listed is another important feature of research priority setting. Our review demonstrated that over half of the outcomes were prioritized, with the majority resulting in research topics or specific research questions. Lack of prioritization risks preferential selection of research that is easier to implement, or more closely aligned with current activities, rather than the research that is most urgent.

It has been asserted that existing interventions have the potential to provide many of the tools required to address poor health outcomes in LMICs [34], and the knowledge gap is in implementation research rather than in discovery of new technologies. Our review provides evidence that this perspective is being recognized in priorisation processes, with a median of 0% per initiative falling into the category of discovering new interventions and 35% related to delivery research.

The earlier analysis by Rudan et al highlighted the importance of defined criteria for priority setting, stakeholder input, and the translation of research into policy as well as emphasising the need for greatly strengthening capacity to drive and implement research in LMICs [19]. It is therefore encouraging that of the initiatives covered in our review the majority used criteria to determine research priorities (67%). While recognising the limitations of the available tools for health research priority setting, Rudan et al also emphasized the importance of their use [19]. Our review indicates an inconsistent application of available established methods of HRPS, potentially hindering repeatability and transparency of the process. The review of selected national health research priority setting initiatives by Tomlinson et al highlighted similar concerns regarding limited evidence of implementation and engagement with stakeholders, as well as how audiences were targeted [25]. Likewise our review demonstrates a high level of engagement with researchers and government, but less involvement of other key stakeholders. The WHO review noted that the use of any established strategy was rare, with similar results reflected here, with less than half of the initiatives using an established strategy. While it is unlikely that there will ever be a ‘gold standard’ method for health research priority setting, the application of one of the recognised strategies provides a framework for carrying out the process that ensures inclusiveness, defined criteria for determining priorities, and transparency of process [7], [27].

There are challenges in the process of research priority setting regardless of the approach used, demonstrated through this review. A number of the initiatives noted that initial literature reviews to determine burden of disease and current research activities, were of limited use due to the lack of country specific information. Regional and global estimates are often used as an alternative, but do not take into account the unique situations of individual countries [35]. There is a large body of evidence that demonstrates that data gaps are an inherent part of health systems in LMICs and highlight the need for country level research on burden of disease [8], [36]. The priority given to epidemiological research in the initiatives analysed also highlights a need to better understand the burden of disease in LMICs. Limited health research capacity is an ongoing issue for LMICs and reduces the ability to implement research priorities. Capacity constraints have been reinforced by a legacy of research being undertaken by high income country academics [36], and brain-drain eroding national research capacity [37]. Multi-bi financing may also be further contributing to reduced research capacity, as activities are narrowed and may target short-term outcomes rather than long-term public health sustainability [3]. Focused attention on capacity constraints and opportunities for capacity building at both the individual and institutional level, will contribute to improved implementation of priority research and overall health improvements [36], [38].

Involvement of a wide range of stakeholders in the health research priority setting process has been identified as a way of both ensuring legitimacy and inclusiveness of the approach [7], [39] and of driving health equity [7]. Poor stakeholder engagement may lead to opinion bias, noted in a number of initiatives reviewed, relating to health experts consciously or unconsciously preferencing research fields that are familiar to them [4]. Kapriri has documented the difficulties in engaging with a wide range of stakeholders but also stresses how important it is [39]. Challenges with engagement also link to research capacity, with required engagement of technical experts often limiting involvement to experienced developed country researchers, potentially resulting in bias away from national health priorities [4]. While researchers and government were well represented in the initiatives reviewed, affected populations (patients and civil society) had far less involvement. The increased participation of donors (only 16% in reviewed initiatives) may also strengthen links between prioritised research and funding opportunities.

An implementation strategy is essential for ensuring that the outcomes of health research priority setting exercises are translated into research projects that ultimately improve the health of LMIC populations. Without evidence of implementation or health outcomes it is difficult to assess the quality of research priority setting exercises [40]. While the initiatives reviewed drew attention to the issue of implementation and follow-up, expressing optimism that their analysis would inform research agendas, few reports described concrete strategies for achieving this goal, let alone attempted to measure whether it had been achieved. This indicates a need for improved dialogue among instigators of research priority setting, governments, research institutions, and funding bodies. Improved documenting of priority setting would also enhance assessment of health outcomes, while enabling LMICs to draw on the experiences of others. What is still missing is critical review of the output and implementation of health research priorities, and the way in which they address the criteria under which they were set.

Conclusion

While a focus on global health initiatives, such as those to eradicate specific diseases, has provided momentum and financial support, it should not be at the expense of national health priorities [3], [4]. Health research priority setting in LMICs is aimed at directing limited resources to areas of greatest need and impact. While workshops with no explicit application of established health research priority setting methods was the most common approach, the use of established strategies to determine priorities currently provide the most useful tools to ensure conduct in a transparent and repeatable manner. Despite most initiatives highlighting the importance of dissemination and implementation of priorities, there was limited evidence of strategies to do so. Without evidence of implementation and ultimately health outcomes, it remains challenging to assess the quality and impact of health research priority setting strategies in LMICs.

Supporting Information

Table S1.

Details of health research initiatives.

https://doi.org/10.1371/journal.pone.0108787.s001

(XLSX)

Author Contributions

Conceived and designed the experiments: SM KH JK. Analyzed the data: SM. Contributed reagents/materials/analysis tools: SM KH JK. Wrote the paper: SM KH JK. Reviewed the manuscript: SM KH JK.

References

  1. 1. Council on Health Research for Development (COHRED) (2007) Are international health research programmes doing enough to develop research systems and skills in low and middle incomes countries? Available: http://www.cohred.org/wp-content/uploads/2013/08/4.ResponsibleVerticalProgrammingLOWRES.pdf. Accessed 2014 June 17.
  2. 2. Dye C, Boerman T, Evans D, Harries AD, Lienhardt C, et al. (2013) The World Health Report 2013: Research for Universal Health Coverage. Geneva, Switzerland: World Health Organization.
  3. 3. Sridhar D (2012) Who sets the global health research agenda? The challenge of multi-bi financing. PLoS Med 9: e1001312.
  4. 4. Ali N, Hill C, Kennedy A, IJIsselmuiden C (2006) What factors influence health research agendas in developing countries? Council on Health Research for Development (COHRED)
  5. 5. Commission on Health Research for Development (1990) Health Research: Essential Link to Equity in Development. Available: http://www.cohred.org/publications/open-archive/1990-commission-report/. Accessed 2014 June 17.
  6. 6. Global Forum for Health Research (2000) The 10/90 Report on Health Research.
  7. 7. Viergever RF, Olifson S, Ghaffar A, Terry RF (2010) A checklist for health research priority setting: nine common themes of good practice. Health Res Policy Syst 8: 36.
  8. 8. Global Forum for Health Research (2004) The Combined Matrix Approach: A priority-setting tool for health research. Available: http://whqlibdoc.who.int/hq/2004/GFHR_CAM_eng.pdf. Accessed 2014 September 14.
  9. 9. World Health Organization (2008) Priority Setting Methodologies in Health Research. Geneva, Switzerland: World Health Organization.
  10. 10. Montorzi G, de Haan S, IJIsselmuiden C (2010) Priority setting for research for health: A management process for countries. Council on Health Research for Development (COHRED)
  11. 11. Global Forum for Health Research (2009) The 3D Combined Approach Matrix: An improved tool for setting priorities in research for health. Global Forum for Health Research
  12. 12. Okello D, Chongtrakul D, The COHRED Working Group on Priority Setting (2000) A Manual for Research Priority Setting using the ENHR Strategy. Geneva: The Council on Health Research and Development.
  13. 13. Rudan I, Shams EA, Robert EB (2006) A Systematic Methodology for Setting Priorities in Child Health Research Investments. Dhaka: Child Health and Nutrition Research Initiative. 1–11 p.
  14. 14. Okoli C, Pawlowski SD (2004) The Delphi method as a research tool: an example, design considerations and applications. Information & Management 42: 15–29.
  15. 15. Dalkey N, Helmer O (1963) The nominal group as a research instrument for exploratory health studies. Management Science 9: 458–467.
  16. 16. Anuglo A, Freij L, de Haan S, de los Rios R, Ghaffar A, et al. (2006) COHRED Working Paper 1: Priority Setting for Health Research: Toward a management process for low and middle income countries. Geneva: Council on Health Research for Development.
  17. 17. Reveiz L, Elias V, Terry RF, Alger J, Becerra-Posada F (2013) Comparison of national health research priority-setting methods and characteristics in Latin America and the Caribbean, 2002–2012. Rev Panam Salud Publica 34: 1–13.
  18. 18. Swingler GH, Irlam JH, Macharia WM, Tietche F, Meremikwu MM (2005) A systematic review of existing national priorities for child health research in sub-Saharan Africa. Health Research Policy and Systems 3.
  19. 19. Rudan I, Kapiriri L, Tomlinson M, Balliet M, Cohen B, et al. (2010) Evidence-based priority setting for health care and research: tools to support policy in maternal, neonatal, and child health in Africa. PLoS Med 7: e1000308.
  20. 20. Rylance J, Pai M, Lienhardt C, Garner P (2010) Priorities for tuberculosis research: A systematic review. The Lancet Infectious Diseases 10: 886–892.
  21. 21. Rudan I (2012) Global health research priorities: Mobilizing the developing world. Public Health 126: 237–240.
  22. 22. Yasamy MT, Maulik PK, Tomlinson M, Lund C, van Ommeren M, et al. (2011) Responsible governance for mental health research in low resource countries. PLoS Medicine 8.
  23. 23. Gonzalez-Block MA (2004) Health policy and systems research agendas in developing countries. Health Research Policy and Systems 2.
  24. 24. Ranson MK, Bennett SC (2009) Priority setting and health policy and systems research. Health Research Policy and Systems 7.
  25. 25. Tomlinson M, Chopra M, Hoosain N, Rudan I (2011) A review of selected research priority setting processes at national level in low and middle income countries: towards fair and legitimate priority setting. Health Res Policy Syst 9: 19.
  26. 26. Figueroa JP, Baris E, Chandiwana S, Kvaale E (2002) A survey of Essential National Health Research in nine developing countries. West Indian Medical Journal 51: 97–101.
  27. 27. Viergever RF (2010) Health research prioritization at WHO: An overview of methodology and high level analysis of WHO led health research priority setting exercises. Geneva: World Health Organization.
  28. 28. (2012) Country and Lending Groups. The World Bank.
  29. 29. Wazny K, Zipursky A, Black R, Curtis V, Duggan C, et al. (2013) Setting research priorities to reduce mortality and morbidity of childhood diarrhoeal disease in the next 15 years. PLoS Med 10: e1001446.
  30. 30. Rudan I, Chopra M, Kapiriri L, Gibson J, Lansang MA, et al. (2008) Setting priorities in global child health research investments: Universal challenges and conceptual framework. Croatian Medical Journal 49: 307–317.
  31. 31. Organisation for Economic Co-operation and Development. (2005) The Paris Declaration on Aid Effectiveness: Five principles for smart aid. Available: http://effectivecooperation.org/files/resources/Paris%20Declaration%20in%20Brief%20ENGLISH.pdf. Accessed 2014 June 17.
  32. 32. Boutayeb A (2006) The double burden of communicable and non-communicable diseases in developing countries. Trans R Soc Trop Med Hyg 100: 191–199.
  33. 33. Kosek M, Lanata CF, Black RE, Walker DG, Snyder JD, et al. (2009) Directing diarrhoeal disease research towards disease-burden reduction. Journal of health, population, and nutrition 27: 319–331.
  34. 34. Travis P, Bennett S, Haines A, Pang T, Bhutta Z, et al. (2004) Overcoming health-systems constraints to achieve the Millennium Development Goals. Lancet 364: 900–906.
  35. 35. Boerma JT, Stansfield SK (2007) Health statistics now: are we making the right investments? Lancet 369: 779–786.
  36. 36. Nuyens Y (2005) No Development Without Research: A challenge for capacity strengthening. Geneva: Global Forum for Health Research.
  37. 37. Sitthi-Amorn C, Somrongthong R (2000) Strengthening health research capacity in developing countries: a critical element for achieving health equity. BMJ 321: 813–817.
  38. 38. The Working Group on Priority Setting (2000) Priority setting for health research: lessons from developing countries. Health Policy Plan 15: 130–136.
  39. 39. Kapiriri L, Tomlinson M, Chopra M, El Arifeen S, Black RE, et al. (2007) Setting priorities in global child health research investments: addressing values of stakeholders. Croat Med J 48: 618–627.
  40. 40. Viergever RF (2013) Medical research: Analyse impact of health priorities. Nature 502: 171.
  41. 41. Brown KH, Hess SY, Boy E, Gibson RS, Horton S, et al. (2009) Setting priorities for zinc-related health research to reduce children's disease burden worldwide: an application of the Child Health and Nutrition Research Initiative's research priority-setting method. Public Health Nutrition 12: 389–396.
  42. 42. Viergever RF, Chan G, Morgan C (2013) The development of the Papua New Guinea National Health and HIV Research Agenda 2013–2018. Port Moresby: Government of Papua New Guinea.
  43. 43. Cresswell KM, Panesar SS, Salvilla SA, Carson-Stevens A, Larizgoitia I, et al. (2013) Global Research Priorities to Better Understand the Burden of Iatrogenic Harm in Primary Care: An International Delphi Exercise. Plos Medicine 10.
  44. 44. TDR Disease Reference Group on Chagas Disease, Human African Trypanosomiasis and Leishmaniasis. (2013) Research Priorities for Chagas Disease, Human African Trypanosomiasis and Leishmaniasis: Technical Report of the TDR Disease Reference Group on Chagas Disease, Human African Trypanosomiasis and Leishmaniasis. Geneva: World Health Organization. Available: http://apps.who.int/iris/bitstream/10665/77472/1/WHO_TRS_975_eng.pdf?ua=1. Accessed 2014 September 14.
  45. 45. Bahl R, Martines J, Bhandari N, Biloglav Z, Edmond K, et al. (2012) Setting research priorities to reduce global mortality from preterm birth and low birth weight by 2015. J Glob Health 2: 010403.
  46. 46. Collins PY, Patel V, Joestl SS, March D, Insel TR, et al. (2011) Grand challenges in global mental health. Nature 475: 27–30.
  47. 47. Kosek M, Lanata CF, Black RE, Walker DG, Snyder JD, et al. (2009) Directing Diarrhoeal Disease Research towards Disease-burden Reduction. Journal of Health Population and Nutrition 27: 319–331.
  48. 48. Meremikwu M, Udoh E, Nwagbara B, Effa E, Oringanje C, et al. (2011) Priority setting for systematic review of health care interventions in Nigeria. Health Policy 99: 244–249.
  49. 49. Ministry of Health (2012) National Health Research Agenda 2012–2016. Lilongwe: Ministry of Health.
  50. 50. Directorate Research Coordination and Management Department of National Health. (1996) Proceedings of the First Essential National Health Research Congress on Priority Setting. Pretoria. Available: http://www.cohred.org/downloads/552.pdf. Accessed 2014 June 16.
  51. 51. National Institute of Public Health. (2007) Four Five Year Health Research Master Plan (2007–2011). Vientiane.
  52. 52. TDR Thematic Reference Group on Environment, Agriculture and Infectious Diseases of Poverty (2013) Research priorities for the environment, agriculture and infectious diseases of poverty: technical report of the TDR Thematic Reference Group on Environment, Agriculture and Infectious Diseases of Poverty. Geneva: World Health Organization. Available: http://apps.who.int/iris/bitstream/10665/78129/1/WHO_TRS_976_eng.pdf. Accessed 2014 June 16.
  53. 53. Kitua AY, Mashalla YJS, Shija JK (2000) Coordinating health research to promote action: the Tanzanian experience. British Medical Journal 321: 821–823.
  54. 54. National Research Council of Kosovon. (2010) The National Research Programme of the Republic of Kosovo. Available: http://www.masht-gov.net/advCms/documents/NRP_%28Draft%29_English.pdf. Accessed 2014 June 16.
  55. 55. Tomlinson M, Rudan I, Saxena S, Swartz L, Tsai AC, et al. (2009) Setting priorities for global mental health research. Bulletin of the World Health Organization 87: 438–446.
  56. 56. Ministry of Health (2006) National Agenda of Priorities in Health Research - Brazil.
  57. 57. Bates DW, Larizgoitia I, Prasopa-Plaizier N, Jha AK, Safety WWAP (2009) Global priorities for patient safety research. British Medical Journal 338.
  58. 58. Doyle J, Waters E, Yach D, McQueen D, De Francisco A, et al. (2005) Global priority setting for Cochrane systematic reviews of health promotion and public health research. Journal of Epidemiology and Community Health 59: 193–197.
  59. 59. Bigdeli M, Javadi D, Hoebert J, Laing R, Ranson K, et al. (2013) Health policy and systems research in access to medicines: a prioritized agenda for low- and middle-income countries. Health Research Policy and Systems 11.
  60. 60. Ranson K, Law TJ, Bennett S (2010) Establishing health systems financing research priorities in developing countries using a participatory methodology. Social Science & Medicine 70: 1933–1942.
  61. 61. Sharan P, Gallo C, Gureje O, Lamberte E, Mari JJ, et al. (2009) Mental health research priorities in low- and middle-income countries of Africa, Asia, Latin America and the Caribbean. Br J Psychiatry 195: 354–363.
  62. 62. Lachat C, Nago E, Roberfroid D, Holdsworth M, Smit K, et al. (2014) Developing a Sustainable Nutrition Research Agenda in Sub-Saharan Africa-Findings from the SUNRAY Project. PLoS Medicine 11.