Skip to main content
Browse Subject Areas

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

The Global Research Collaboration of Network Meta-Analysis: A Social Network Analysis

  • Lun Li ,

    Affiliations Department of General Surgery, The Second Xiangya Hospital, Central South University, Changsha, Hunan, China, Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

  • Ferrán Catalá-López,

    Affiliations Department of Medicine, University of Valencia/ INCLIVA Health Research Institute and CIBERSAM, Valencia, Spain, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, ON, Canada

  • Adolfo Alonso-Arroyo,

    Affiliation Department of History of Science and Documentation, University of Valencia, Valencia, Spain

  • Jinhui Tian,

    Affiliation Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

  • Rafael Aleixandre-Benavent,

    Affiliation Ingenio-Spanish National Research Council (CSIC) and UISYS-University of Valencia, Valencia, Spain

  • Dawid Pieper,

    Affiliation Institute for Research in Operative Medicine, Department for Evidence-Based Health Services Research, Witten/Herdecke University, Cologne, Germany

  • Long Ge,

    Affiliation Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

  • Liang Yao,

    Affiliation Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China

  • Quan Wang,

    Affiliation Department of Gastrointestinal Surgery, Xijing Hospital of Digestive Diseases, Xijing Hospital, Four Military Medical University, Xi'an, Shaanxi, China

  • Kehu Yang

    Affiliation Evidence-Based Medicine Center, School of Basic Medical Sciences, Lanzhou University, Lanzhou, Gansu, China


Background and Objective

Research collaborations in biomedical research have evolved over time. No studies have addressed research collaboration in network meta-analysis (NMA). In this study, we used social network analysis methods to characterize global collaboration patterns of published NMAs over the past decades.


PubMed, EMBASE, Web of Science and the Cochrane Library were searched (at 9th July, 2015) to include systematic reviews incorporating NMA. Two reviewers independently selected studies and cross-checked the standardized data. Data was analyzed using Ucinet 6.0 and SPSS 17.0. NetDraw software was used to draw social networks.


771 NMAs published in 336 journals from 3459 authors and 1258 institutions in 49 countries through the period 1997–2015 were included. More than three-quarters (n = 625; 81.06%) of the NMAs were published in the last 5-years. The BMJ (4.93%), Current Medical Research and Opinion (4.67%) and PLOS One (4.02%) were the journals that published the greatest number of NMAs. The UK and the USA (followed by Canada, China, the Netherlands, Italy and Germany) headed the absolute global productivity ranking in number of NMAs. The top 20 authors and institutions with the highest publication rates were identified. Overall, 43 clusters of authors (four major groups: one with 37 members, one with 12 members, one with 11 members and one with 10 members) and 21 clusters of institutions (two major groups: one with 62 members and one with 20 members) were identified. The most prolific authors were affiliated with academic institutions and private consulting firms. 181 consulting firms and pharmaceutical industries (14.39% of institutions) were involved in 199 NMAs (25.81% of total publications). Although there were increases in international and inter-institution collaborations, the research collaboration by authors, institutions and countries were still weak and most collaboration groups were small sizes.


Scientific production on NMA is increasing worldwide with research leadership of Western countries (most notably, the UK, the USA and Canada). More authors, institutions and nations are becoming involved in research collaborations, but frequently with limited international collaborations.


The current landscape of biomedical research is faced with complex challenges which require collaboration among scientists and institutions all over the world. Research collaborations occur when scientists and investigators work together to move their research forward, which contributes to the advancement of knowledge by exploiting the results of scientific efforts more cost-effectively and also makes resources sharing and knowledge stocking possible internationally [1]. Systematic reviews and meta-analyses are the backbone of evidence based medicine which requires conscientious, explicit, and judicious use of current best evidence in making decisions about the care of individual patients [2].

In the last decade, network meta-analysis (NMA) has been introduced as a generalization of pairwise meta-analysis, enabling simultaneous assessment of the relative effectiveness of several interventions across a network of randomized clinical trials (RCTs) [35]. The value of NMAs for health-care decision making has been recognized and accepted by different health technology assessment and funding agencies worldwide [6]. NMA requires more complex meta-analytic techniques (that are associated with additional assumptions) when evaluating large numbers of trials, participants and treatment alternatives [7].

Research collaborations in clinical research have evolved over the last decades. For example, a recent social network study showed that there have been an increasing number of research collaborations in the science of meta-analysis published in high-impact journals worldwide [8]. To the best of our knowledge, there has been no specific study focusing on the characterization of global research collaborations on published NMAs. Social network analysis is grounded in the assessment of empirical data and may provide an appropriate approach to identify scientists, groups and institutions [8, 9]. It also offers highly interesting information to understand the nature and structure of relationships and interactions within a scientific community. One frequently used approach for studying research collaboration involves co-authorship networks which are a class of social networks illustrating collaboration based on presence as co-authors in a research publication. Publication data can also be used to explore and visualize research collaboration among institutions and countries [10, 11]. Therefore, we used social network analysis methods to characterize global collaboration patterns of published NMAs over the past decades.


Literature searching

PubMed, EMBASE, Web of Science and the Cochrane Library were searched without publication date restrictions. The search strategy was developed based on two publications [12, 13] and reported in a previous study [14]. The search strategy was peer-reviewed prior to execution by BS (20 years of experience as information specialist) and KY (20 years of experience as information specialist) using peer review of electronic search strategies (PRESS) [15] (S1 Appendix). All searches were conducted at 9th July, 2015.

Inclusion and exclusion criteria

Systematic reviews incorporating NMA were included, no matter what kinds of names they used, such as mixed treatment comparison, indirect comparison meta-analysis, multiple treatment meta-analysis. We considered NMA as any meta-analysis which are analyzing, simultaneously, three or more different interventions in one meta-analysis [16]. A NMA includes adjusted indirect treatment comparison of open-loop networks and mixed treatment comparison of at least one closed loop in the evidence network [6, 7]. We also included full economic evaluations where both costs and health outcomes have been measured if they conducted a NMA for the clinical effectiveness instead of citing a previous NMA. Single technology appraisals or diagnostic accuracy test meta-analyses were excluded. Methodological studies, protocols, letters, comments, editorials, and naive indirect comparison meta-analysis which only used the raw data from included primary studies [17] were also excluded. If a NMA was found repeated in several publications, that latest was included.

Study selection

Two reviewers (MP, LL and/or LG) independently screened the titles and abstracts to select the potential articles. Then the full-texts were retrieved and read to judge. Disagreements were discussed among the two reviewers.

Data preparation

We created a bibliometric database in order to prepare the information, including publication titles, the year of publication, the journal title, author’s names, institutional names, country of origin, the number of authors, institutions and countries. For each included paper, one author (LL) abstracted the data based on the full-texts and all information was checked by a second author (LY, JT, QW, or DP).

A process of standardization was carried out to bring together the various different names of a specific author or institution. The criterion followed in the case of the authors was the occurrence of the institutional signature associated with the variations of names and surnames. In the case of institutions, it is important to point out that, in many bibliographic registers, two or more institutions are included under the same institutional address (for example, in the cases of research institutes and/or hospitals attached to universities). In such cases, these institutions were kept apart, giving each bibliographic register as many institutional signatures as macro-institutions can be identified [8]. If there were different forms for the names of the same person or institutions, and the information will be checked based on the publications, information from official websites and PubMed searching.

Bibliometric indicators and social network analysis

We used the term co-authorship to refer to joint authorship of a scientific paper by 2 individual authors, and institutional collaboration to refer to joint relationship by different institutions and international collaboration to refer to joint relationship by different countries. Threshold of collaboration refers to the figure used to form clusters of authors, institutions and countries (the frequency of co-authorship between pairs of authors or of collaboration between institutions or countries), and reflects a criterion to label identifiable clusters as research groups. A higher threshold of collaboration would guarantee a clear view of the research collaboration networks, and thus center the analyses on the more intense collaboration relationships. We applied an a posteriori threshold of three or more papers signed in co-authorship for the main analyses.

We used BICOMS (Bibliographic Item Co-Occurrence Mining System) software to automatically abstract information from the TXT file, and constructed binary matrix of relationships between authors, institutions, and countries. Then it was imported to Ucinet 6.0 program (version 6.198, Analytic Technologies, USA) to construct network data.

We calculated degree of centrality, closeness, betweenness for author, institution and country networks using Ucinet 6.0. Centrality measures help the researcher to determine which nodes are important to be kept in the network [1820]. Degree of centrality of a node is characterized as the number of ties or edges close to a given node, that is, degree of centrality equals the number of coauthors of a given author [19, 20]. In connected graphs there is a natural distance metric between all pairs of nodes, defined by the length of their shortest paths. The farness of a node is defined as the sum of its distances to all other nodes, and its closeness is defined as the inverse of the farness. Thus, the more central a node is the lower its total distance to all other nodes. Closeness can be regarded as a measure of how long it will take to spread information to all other nodes sequentially. Closeness of centrality deals with the structural position of nodes in the whole network [19]. Betweenness is a centrality measure of a vertex within a graph. This indicator is defined as the number of shortest paths crossing through a node [20]. Betweenness centrality refers to the extent that a person lies in-between two other people that would otherwise not be connected. Betweenness centrality quantifies the number of times a node acts as a bridge along the shortest path between two other nodes. A high ‘betweenness’ score would indicate a person’s potential to act as a gatekeeper of information/resources between the people they connect within a particular network. Individual betweenness centrality scores were generated for ‘provision of information’ relationships to understand whether key individuals were central to this information [21].

We presented network diagrams or 'sociograms' to represent the structure of scientific collaboration within the groups and across groups. A sociogram is a graphic representation of social connections and relationships among members of a scientific community and may be helpful in presenting networks of collaborations as well as the influence of scientists, institutions and countries in the field of NMA. Sociograms are generally composed of two fundamental components: vertices (authors, institutions or countries) and edges (number of papers or collaborations). Specialized software NetDraw was used to draw social networks.

Data analysis for the basic information

All continuous variables were presented as mean ± SD and median (inter-quartile range, IQR), and categorical variables were expressed using frequencies and percentages. All data was analyzed using SPSS software 17.0.


Search results

After literature search, 6168 citations were retrieved. Of them, 3639 citations were duplicates, so 2547 citations were sent for further screening. Based on titles and abstracts, 1615 citations were excluded, as they were traditional meta-analysis (n = 1173), methodological studies (n = 245), or other (n = 197). Then 161 articles were excluded based on reading full-texts, because of traditional meta-analysis (n = 64), methodological studies (n = 28), naive indirect comparison (n = 15), economic studies (n = 26) and other (n = 28). Finally, 771 NMAs were included (Fig 1, S2 Appendix).

Global publication trend

The trend of annual papers from 1997 to 2015 is shown in Fig 2. More than three-quarters (n = 625; 81.06%) of the NMAs were published in the last 5-years. The first NMA was an adjusted indirect comparison and published in 1997 [22], and the first mixed treatment comparison was published in 2003 [23]. The number of published NMAs increased slowly until 2010. The year that published most NMAs was 2014 (175/771; 22.70%). Both the number of NMAs conducted by two or more institutions and by international collaboration among different countries also increased in the study period (Fig A in S3 Appendix).

Fig 2. The number of published NMAs from 1997 to 2015.

In blue, observed values (number of publications). In black, expected values (prediction line).


336 journals published 771 papers, 211 (62.80%) journals published only one NMA, 56 (16.67%) journals published two, 28 (8.33%) journals published three, and 41 (12.20%) published more than three papers. The BMJ published the largest number of papers (n = 38; 4.93%), followed by Current Medical Research & Opinion (n = 36; 4.67%), Health Technology Assessment (n = 21; 4.0%), and PLOS One (n = 31; 4.02%) (Table 1).


The average author number per NMA was 6.52 (SD 3.68, range 1–32, median 6, IQR 4–8) and increased from 1997 to 2014 (Fig B in S3 Appendix). The four-author NMAs were most (113, 14.66%) followed by five-author NMAs (111, 14.40%) and six-author NMAs (105, 13.62%) (Fig C in S3 Appendix).

A total of 3459 authors were retrieved. 2684 (77.59%) authors were involved in only one NMA, 483 (13.96%) authors were involved in two, 129 (3.73%) authors were involved in three, and only 163 (4.71%) authors contributed more than three NMAs. We identified 21 authors who published nine or more papers (Table 2). The most prolific authors were Jeroen P Jansen with 24, Edward J Mills with 21, Giuseppe Biondi-Zoccai with 18, Kristian Thorlund, Yukang Tu, Georgia Salanti, Jos Kleijnen with 13 each. One third of the 22 most prolific authors were affiliated with consulting firms and/or the pharmaceutical and medical technology industries.

Table 2. Ranking of most prolific authors (9 or more papers), their affiliations and centrality measures.

Among 775 authors who published two NMAs or more, 556 (71.74%) authors collaborated with others twice at most and only 219 (28.26%) authors collaborated with others at least three times (Fig D in S3 Appendix). Only 66 authors (8.52%) collaborated with others at least five times (Fig E in S3 Appendix). The average collaboration times per people they collaborated with was 1.76 (SD 0.57, median 1.75, IQR 1.36–2.00, range 1–5.25). Gregg W Stone (with 54 collaborators) and Giuseppe Biondi Zoccai (with 49) collaborated with most people, followed by Hyo Soo Kim (with 45), Peter Jüni (with 36), Tullio Palmerini (with 34) and Diego Della Riva (with 34) (Table 2). Applying a threshold of three or more papers published as co-authors (Figs 3 and 4), we identified 43 clusters. Of them, four major groups (37, 12, 11 and 10 members for each group) were identified. The top 20 highest degree, closeness, betweenness were listed in Table A in S4 Appendix.

Fig 3. Main clusters of authors (two-eight members) applying a threshold of three or more papers signed in co-authorship.

Fig 4. Main clusters of authors (10–37 members) applying a threshold of three or more papers signed in co-authorship.


The average institution number per NMA was 3.63 (SD 2.60, range 1–26, median 3, IQR 2–5). The average institution number per NMA fluctuated around three before 2007, and around four after 2007 (Fig B in S3 Appendix). The three-institution NMAs were most (170, 22.05%) followed by two-institution NMAs (154, 19.97%) and four- institution NMAs (129, 16.73%) (Fig C in S3 Appendix).

1258 institutions were involved. 833 (66.22%) institutions were involved in only one paper, 173 (13.75%) institutions were involved in two, 87 (6.92%) institutions were involved in three, and 13.12% authors contributed more than three articles. We identified 21 institutions which published 15 or more NMAs (Table 3). The most prolific institutions were McMaster University with 33, University of Ottawa with 30, University of Birmingham with 27, University of Bristol and University of Toronto with 25 each, Sapienza University of Rome and Mapi Values, USA with 22 each, and Mapi Values, Netherlands with 20.

Table 3. Ranking of most prolific institutions (15 or more papers), their country and centrality measures.

Among 425 institutions which published two NMAs or more, 290 (68.24%) institutions collaborated with others twice at most and 135 (31.76%) institutions collaborated with others at least three times (Fig F in S3 Appendix). Only 57 institutions (13.41%) collaborated with others at least five times (Fig G in S3 Appendix). The average collaboration times per institution they collaborated with was 1.46 (SD 0.56, median 1.33, IQR 1.00–1.71, range 1–5). Columbia University (with 69 institutional collaborators) had the most collaborated institutions, followed by Harvard University (with 57), Technische Universität München (with 54), Sapienza University of Rome (with 52) and McMaster University (with 50) (Table 3). Applying a threshold of three or more NMAs published (Figs 5 and 6), we identified 21 clusters. Of them, two major groups (62 and 20 members for each group) were identified. The top 20 highest degree, closeness, betweenness were listed in Table B in S4 Appendix.

Fig 5. Main clusters of institutions (2–20 members) applying a threshold of three or more papers signed.

Fig 6. Main clusters of institutions (62 members) applying a threshold of three or more papers signed.


The average country number per NMA was 1.84 (SD 1.36, range 1–13, median 1, IQR 1–2). The average country number per NMA fluctuated around one before 2007, and around two after 2007 (Fig B in S3 Appendix). The one-country NMAs were most (423, 54.86%) followed by two-country NMAs (185, 23.99%) and three-country NMAs (78, 10.12%) (Fig C in S3 Appendix).

49 countries were involved in conducting and publishing NMA. Twelve (24.49%) countries were involved in only one NMA, five (10.20%) countries were involved in two NMAs, three (6.12%) countries were involved in three NMAs, and 59.12% countries contributed more than three articles. We identified 12 countries which published 30 or more papers (Table 4). The UK (with 289 publications; 37.48%) and USA (with 281; 36.45%) published the most NMAs, followed by Canada (with 110; 14.27%) and China (with 87; 11.28%). The top 20 highest degree, closeness, betweenness were listed in Table C in S4 Appendix.

Table 4. Ranking of most prolific countries (10 or more papers) and their centrality measures.

Applying a threshold of three or more papers published (Fig 7), we identified one cluster of countries with research leadership of Western countries (most notably, from Europe and North America). The USA and the UK published the largest number of international collaboration publications (182 and 181, respectively), followed by the Netherlands (with 79) and Canada (with 74). Among the most prolific countries, China had the largest number of single country papers (Table 4).

Fig 7. Global collaboration.

Main clusters of countries applying a threshold of three or more papers signed.

Consulting firm or pharmaceutical industry involvement

Many consulting firms or pharmaceutical industries were involved in conducting and publishing NMAs. There were 181 sub-companies (106 patient companies) accounting for 14.39% of all institutions, and they conducted or involved in 25.68% NMAs (Table 5).

Table 5. The ranking of consulting firm or pharmaceutical industry.


This study summarized some significant collaborations and research trends in published NMAs worldwide. In particular, the social network analysis methodology allowed us to identify the most productive authors and institutions, as well as the identification of the clusters or groups of authors with intense collaboration and the relationships established between the institutions that have published papers in the main biomedical journals through the period 1997–2015. In our study, the UK and the USA headed the absolute productivity ranking (number of papers) followed by Canada, China and other European countries. Although these countries lead in the number of published NMAs, the efforts during the period of study were global, with 771 publications from more than 3400 authors and 1200 institutions in almost 50 different countries.

Research collaboration simply put, is the working together of scientists and researchers to achieve a common goal of producing scientific knowledge [24]. Nonetheless, technology development weakened link between location and scientific research [25] and make global research collaboration possible, and then authors from different locations (institutions or countries) could work together to address particular scientific problems in innovative and effective ways. A NMA has been considered as the next generation of evidence synthesis methods, and research collaboration in NMA has many benefits. First, the number and types of roles and responsibilities in a NMA project are determined by the complexity, purpose and scope of the research question. NMA involves a research protocol, literature searching, study selection, critical appraisal and advanced evidence synthesis methods. This means in order to conduct a rigorous and replicable NMA, at least a methodologist responsible for study design, a librarian responsible for developing search strategy and conducting searching and an experienced analyst responsible for quantitative data synthesis and interpretation of results are needed in the collaboration team. It is rare that one person could do all work related to NMA. In our study, only 1.30% NMAs were conducted by one author. Second, research collaboration can increase value and reduce the waste in research [2628], also in NMA. The research and medical resources are limited, which requires scientists and researchers all over the world to work together to resolve important clinical and research questions and to establish research priorities. Multidisciplinary teams of experienced researchers can help to enhance the design, conduct, and reporting of NMA that is needed to provide reliable results. Third, collaboration among different institutions or countries also increases the visibility and impact of research. This is obvious when research collaboration occurs among different countries and regions. Systematic reviews with NMA can be crucial for helping scientists, clinicians and other users make sense of vast numbers of new and often conflicting studies comparing multiple interventions that are published in the literature. Research collaboration could prompt NMA to include relevant studies from different countries and overcome the language obstacle, and further to conclude based on much more comprehensive and complete data. Although most time, we make decisions for local use, we need to gather and summarize all available evidence on a particular question globally.

The fact that geographical proximity, as well as language and cultural similarities between countries, international mobility of human capital, may have impact on the way scientists and researchers in different countries collaborate [8, 29]. The analysis of the social structure of the collaborations allowed us to observe a ‘same country or institution phenomenon’, which might be because that scientists and researchers in same country or institution have the quickest and easiest ways to communicate, and further form collaboration relationship. The authors from same institutions tend to have more collaboration times than those authors from different institutions. For example, a ten-member group from China that involved scientists from Peking University, Tianjin Fifth Central Hospital, Capital Medical University an eight-member group from University of Leicester, UK. To our knowledge, this is not occasional, and we could find examples of other groups from same institution or country (a six-author group from University of Liverpool, UK; a five-author group from University of Sheffield, UK, and from Newcastle University, UK). The reasons for ‘same country or institution phenomenon’ are complex. Some countries, particularly China in the last years, have developed a research culture that places a strong emphasis on the production of systematic reviews and meta-analyses [30]. However, it was said cultural history holds back Chinese research collaboration [31]. Other reasons include finance problems, communications, strong competitions, etc. For the UK, the USA and Canada, we could also find same phenomenon, but of a different nature. This might be explained, at least in part, by current research funding opportunities for scientists, research teams and national networks of excellence developing and applying NMA methodologies, but also the strong commitment by some funding agencies and decision makers (for example, the Health Technology Assessment program of the UK National Institute for Health Research, the Evidence-based Practice Center program of the US Agency for Healthcare Research and Quality and the Drug Safety and Effectiveness Network of the Canadian Institutes of Health Research).

A recent paper examined the global collaborative patterns on meta-analyses of randomized trials published in high impact factor medical journals [8]. Although not directly comparable with the present analysis, we have observed similar patterns in terms of size and numbers of clusters for authors, institutions and countries, with the USA, the UK and Canada taking leadership, and a clear under-representation of scientists and institutions based in low and middle income countries (for example, Central and South America, South and East Asia, and Africa). Remarkably, the scientific community captured by that network analysis was centered on a nucleus of prolific authors from prestigious academic centers and affiliated hospitals (for example, the University of Oxford in the UK, McMaster University in Canada, and the University of Bern in Switzerland). Unlike previous research [8], in our study we observed a significant involvement of consulting firms and/or pharmaceutical industry in conducting and publishing NMAs. In particular, an important number of the most prolific authors were affiliated with consulting firms. Similarly, the scientific community captured by the social network analysis identified clusters of authors from private-for-profit companies (consulting firms and the pharmaceutical industry) and affiliated collaborators from academia and hospitals. There are several possible explanations for these findings. Industry funds an increasing proportion of medical research [32]. NMA is the next generation of evidence synthesis methods and an important tool in comparative effectiveness research, which aims to assist consumers, clinicians, purchasers, and policy makers to make informed decisions by providing improved evidence [33]. NMA provides a global estimate of treatment effects for a set of multiple competing interventions, and are becoming increasingly attractive as they offer a comprehensive framework for decision-making [5, 34]. Therefore, industry-funded NMAs may be part of promotional strategies aimed at demonstrating that new products are more effective and at enhancing market access activities. Additionally, a growing body of literature has been drawing attention to the fact that industry-sponsored studies are more likely to report results and conclusions favoring the sponsor’s product or to report more favorable results than non-industry sponsored studies [3538].

To our knowledge, this study is the first one that aimed to characterize global patterns of collaboration in NMA applying techniques from social network analysis. The present study has identified collaborations between authors and institutions from different countries (which can therefore be considered the scientists and researchers in the vanguard of scientific development within the area), and provides considerable information on the structure that can be put to various purposes, such as: 1) designing and evaluating strategies to promote the efficient use of existing guidelines and methodological standards [6, 7, 39, 40] to improve the methodological quality, transparency, and consistency of study conduct and reporting of NMAs, 2) promoting educational and training activities, 3) sharing knowledge for developing innovative methodologies, and 4) encouraging coordinated research programs for perceived high-priority topics to reduce the burden of diseases and risk factors worldwide [27, 41, 42]. Similarly, we identified an important number of consulting firms or pharmaceutical industries that were involved in publishing NMAs. Whether sponsorship affects or not research collaboration, but also the reporting quality of methods and results, should be considered and explored further in future evaluations of potential sponsorship bias in the field of NMA.

There are also some limitations to our study. First, only English literatures were included, this might introduce potential selection bias for this study and, therefore, findings may not generalizable to NMAs published in a language other than English. Second, we restricted our analysis to NMAs applied to the evaluation of three or more healthcare interventions, but excluded other important publications that also merit consideration in the field (for example, protocols, conceptual and methodological papers). Therefore, there may be researchers and scientists (or institutions) who do not appear or they might be underrepresented. Third, previous research [12, 13, 4345] has pointed out that important deficiencies in the current reporting of methods and results of published NMAs, but we did not analyze how research collaboration affect the conduct and the reporting quality of NMAs. Fourth, as in many bibliometric analyses using publication data [8], the importance of normalizing the names of authors and their institutions is fundamental for avoiding potential errors. For authors affiliated with two or more different institutions and countries, we opted to assign as many names to the macro-institutions as could be identified. Although this resulted in the problem of multiplying the number of institutions in the recount, it was necessary in order to avoid losing information concerning the macro-institutions occurring in second place or later in the list of names, but it might result in an overrepresentation of inter-institutional collaboration.


Scientific production on NMA is increasing worldwide with research leadership of Western countries (most notably, European countries, the USA and Canada) and China. More authors, institutions and countries are becoming involved in research collaborations, but frequently with limited international collaborations. The information presented in this study might be helpful for researchers to understand the collaboration networks, identify leading authors and institutions that might promote future global research collaboration practices in NMA and defining a high-priority scientific agenda for comparative effectiveness research.


We thank Ms. Becky Skidmore who peer-reviewed the search strategy for us, Brian Hutton and David Moher who were involved in study design, Misty Pratt who was involved in study selection. We also thank the peer-reviewers who contributed to this article. Ferrán Catalá-López is partially supported by the Generalitat Valenciana (PROMETEOII/2015/021), which has nothing to do with this research.

Author Contributions

  1. Conceptualization: LL FC-L AA-A JT RAB DP.
  2. Data curation: LL FC-L AA-A JT RA-B DP KY.
  3. Formal analysis: LL FC-L AA-A JT RA-B DP KY.
  4. Investigation: LL FC-L AA-A JT RA-B DP KY.
  5. Methodology: LL FC-L AA-A JT DP KY.
  6. Project administration: LL FC-L AA-A JT RA-B DP LY LG QW KY.
  7. Resources: LL FC-L AA-A JT RA-B DP KY.
  8. Software: LL FC-L AA-A JT DP KY.
  9. Supervision: KY.
  10. Validation: LL FC-L AA-A LG QW LY.
  11. Visualization: LL FC-L AA-A JT DP KY.
  12. Writing – original draft: LL FC-L AA-A JT RA-B DP LY LG QW KY.
  13. Writing – review & editing: LL FC-L AA-A JT RA-B DP LY LG QW KY.


  1. 1. Zhang C, Yu Q, Fan Q, Duan Z. Research collaboration in health management research communities. BMC medical informatics and decision making. 2013;13:52 pmid:23617236
  2. 2. Sackett DL, Rosenberg WM, Gray JA, Haynes RB, Richardson WS. Evidence based medicine: what it is and what it isn't. BMJ. 1996;312(7023):71–2 pmid:8555924
  3. 3. Cipriani A, Higgins JP, Geddes JR, Salanti G. Conceptual and technical challenges in network meta-analysis. Ann Intern Med. 2013;159(2):130–7 pmid:23856683
  4. 4. Lumley T. Network meta-analysis for indirect treatment comparisons. Statistics in Medicine. 2002;21(16):2313–24 pmid:12210616
  5. 5. Li T, Puhan MA, Vedula SS, Singh S, Dickersin K. Network meta-analysis-highly attractive but more methodological research is needed. Bmc Medicine. 2011;9(1):79 pmid:21707969
  6. 6. Jansen JP, Fleurence R, Devine B, Itzler R, Barrett A, Hawkins N, et al. Interpreting Indirect Treatment Comparisons and Network Meta-Analysis for Health-Care Decision Making: Report of the ISPOR Task Force on Indirect Treatment Comparisons Good Research Practices: Part 1. Value in Health. 2011;14(4):417–28 pmid:21669366
  7. 7. Hutton B, Salanti G, Caldwell DM, Chaimani A, Schmid CH, Cameron C, et al. The PRISMA Extension Statement for Reporting of Systematic Reviews Incorporating Network Meta-analyses of Health Care Interventions: Checklist and Explanations. Annals of internal medicine. 2015;162(11):777–84 pmid:26030634
  8. 8. Catala-Lopez F, Alonso-Arroyo A, Hutton B, Aleixandre-Benavent R, Moher D. Global collaborative networks on meta-analyses of randomized trials published in high impact factor medical journals: a social network analysis. BMC medicine. 2014;12:15 pmid:24476131
  9. 9. Newman ME. Coauthorship networks and patterns of scientific collaboration. Proceedings of the National Academy of Sciences of the United States of America. 2004;101 Suppl 1:5200–5 pmid:14745042
  10. 10. Ettarh RR. Institution-level collaboration in cardiovascular research in sub-Saharan Africa. Cardiovascular diagnosis and therapy. 2015;5(4):311–5 pmid:26331114
  11. 11. Glänzel W, Schubert A. Analysing scientific networks through co-authorship. Handbook of quantitative science and technology research: Springer; 2004. p. 257–76.
  12. 12. Bafeta A, Trinquart L, Seror R, Ravaud P. Analysis of the systematic reviews process in reports of network meta-analyses: methodological systematic review. BMJ. 2013;347:f3675 pmid:23818558
  13. 13. Coleman CI, Phung OJ, Cappelleri JC, Baker WL, Kluger J, White CM, et al. Use of Mixed Treatment Comparisons in Systematic Reviews. Rockville MD2012 Aug.
  14. 14. Li L, Tian J, Tian H, Moher D, Liang F, Jiang T, et al. Network meta-analyses could be improved by searching more sources and by involving a librarian. Journal of clinical epidemiology. 2014;67:1001–7 pmid:24841794
  15. 15. Sampson M, McGowan J, Cogo E, Grimshaw J, Moher D, Lefebvre C. An evidence-based practice guideline for the peer review of electronic search strategies. Journal of clinical epidemiology. 2009;62(9):944–52 pmid:19230612
  16. 16. Higgins J, Green S. Cochrane handbook for systematic reviews of interventions version 5.1. 0 [updated March 2011]. The Cochrane Collaboration Available from 2011;
  17. 17. Donegan S, Williamson P, Gamble C, Tudur-Smith C. Indirect comparisons: a review of reporting and methodological quality. PloS one. 2010;5(11):e11054 pmid:21085712
  18. 18. Bozdogan H, Akbilgic O. Social network analysis of scientific collaborations across different subject fields. Information Services and Use. 2013;33(3–4):219–33
  19. 19. Bakkalbasi N, Krichel T. Patterns of research collaboration in a digital library for Economics. Proceedings of the American Society for Information Science and Technology. 2006;43(1):1–15
  20. 20. Borgatti SP. Centrality and network flow. Social Networks. 2005;27(1):55–71
  21. 21. Marks J, Barnett LM, Foulkes C, Hawe P, Allender S. Using social network analysis to identify key child care center staff for obesity prevention interventions: a pilot study. Journal of obesity. 2013;2013:919287 pmid:23986867
  22. 22. Bucher HC, Guyatt GH, Griffith LE, Walter SD. The results of direct and indirect treatment comparisons in meta-analysis of randomized controlled trials. J Clin Epidemiol. 1997;50(6):683–91 pmid:9250266
  23. 23. Psaty BM, Lumley T, Furberg CD, Schellenbaum G, Pahor M, Alderman MH, et al. Health outcomes associated with various antihypertensive therapies used as first-line agents: a network meta-analysis. JAMA: the journal of the American Medical Association. 2003;289(19):2534–44 pmid:12759325
  24. 24. Emanuel EJ, Wendler D, Killen J, Grady C. What makes clinical research in developing countries ethical? The benchmarks of ethical research. The Journal of infectious diseases. 2004;189(5):930–7 pmid:14976611
  25. 25. Jones BF, Wuchty S, Uzzi B. Multi-university research teams: shifting impact, geography, and stratification in science. Science. 2008;322(5905):1259–62 pmid:18845711
  26. 26. Moher D, Glasziou P, Chalmers I, Nasser M, Bossuyt PM, Korevaar DA, et al. Increasing value and reducing waste in biomedical research: who's listening? Lancet. 2016;387(10027):1573–86 pmid:26423180
  27. 27. Chalmers I, Bracken MB, Djulbegovic B, Garattini S, Grant J, Gülmezoglu AM, et al. How to increase value and reduce waste when research priorities are set. Lancet. 2014;383(9912):156–65 pmid:24411644
  28. 28. Ioannidis JPA, Greenland S, Hlatky MA, Khoury MJ, Macleod MR, Moher D, et al. Increasing value and reducing waste in research design, conduct, and analysis. Lancet. 2014;383(9912):166–75 pmid:24411645
  29. 29. Penders B, Vermeulen N, Parker JN. Collaboration across health research and medical care. Healthy collaboration: Ashgate,2015.
  30. 30. Page MJ, Shamseer L, Altman DG, Tetzlaff J, Sampson M, Tricco AC, et al. Epidemiology and Reporting Characteristics of Systematic Reviews of Biomedical Research: A Cross-Sectional Study. PLoS medicine. 2016;13(5):e1002028 pmid:27218655
  31. 31. Gong P. Cultural history holds back Chinese research. Nature. 2012;481(7382):411 pmid:22281557
  32. 32. Patsopoulos NA, Ioannidis JP, Analatos AA. Origin and funding of the most frequently cited papers in medicine: database analysis. BMJ. 2006;332(7549):1061–4 pmid:16547014
  33. 33. Price A, Chatterjee P, Biswas R. comparative effectiveness research collaboration and precision medicine. Annals of neurosciences. 2015;22(3):127–9 pmid:26130919
  34. 34. Greco T, Biondi-Zoccai G, Saleh O, Pasin L, Cabrini L, Zangrillo A, et al. The attractiveness of network meta-analysis: a comprehensive systematic and narrative review. Heart, lung and vessels. 2015;7(2):133–42 pmid:26157739
  35. 35. Sismondo S. How pharmaceutical industry funding affects trial outcomes: causal structures and responses. Social Science & Medicine. 2008;66(9):1909–14 pmid:18299169
  36. 36. Sismondo S. Pharmaceutical company funding and its consequences: a qualitative systematic review. Contemporary Clinical Trials. 2008;29(2):109–13 pmid:17919992
  37. 37. Lexchin J, Bero LA, Djulbegovic B, Clark O. Pharmaceutical industry sponsorship and research outcome and quality: systematic review. Bmj. 2003;326(7400):1167–70 pmid:12775614
  38. 38. Jorgensen AW, Hilden J, Gotzsche PC. Cochrane reviews compared with industry supported meta-analyses and other meta-analyses of the same drugs: systematic review. BMJ. 2006;333(7572):782 pmid:17028106
  39. 39. Dias S, Sutton AJ, Ades AE, Welton NJ. Evidence Synthesis for Decision Making 2: A Generalized Linear Modeling Framework for Pairwise and Network Meta-analysis of Randomized Controlled Trials. Medical Decision Making An International Journal of the Society for Medical Decision Making. 2013;33(5):607–17 pmid:23104435
  40. 40. Ades AE, Caldwell DM, Reken S, Welton NJ, Sutton AJ, Dias S. Evidence Synthesis for Decision Making 7 A Reviewer’s Checklist. Medical Decision Making. 2013;33(5):597–606 pmid:23804511
  41. 41. G. B. D. Risk Factors Collaborators, Forouzanfar MH, Alexander L, Anderson HR, Bachman VF, Biryukov S, et al. Global, regional, and national comparative risk assessment of 79 behavioural, environmental and occupational, and metabolic risks or clusters of risks in 188 countries, 1990–2013: a systematic analysis for the Global Burden of Disease Study 2013. Lancet. 2015;386(10010):2287–323 pmid:26364544
  42. 42. GBD 2013 DALYs and HALE Collaborators, Murray CJ, Barber RM, Foreman KJ, Abbasoglu Ozgoren A, Abd-Allah F, et al. Global, regional, and national disability-adjusted life years (DALYs) for 306 diseases and injuries and healthy life expectancy (HALE) for 188 countries, 1990–2013: quantifying the epidemiological transition. Lancet. 2015;386(10009):2145–91 pmid:26321261
  43. 43. Hutton B, Salanti G, Chaimani A, Caldwell DM, Schmid C, Thorlund K, et al. The Quality of Reporting Methods and Results in Network Meta-Analyses: An Overview of Reviews and Suggestions for Improvement. PloS one. 2014;9(3):e92508 pmid:24671099
  44. 44. Chambers JD, Naci H, Wouters OJ, Pyo J, Gunjal S, Kennedy IR, et al. An assessment of the methodological quality of published network meta-analyses: a systematic review. PloS one. 2015;10(4):e0121715 pmid:25923737
  45. 45. Bafeta A, Trinquart L, Seror R, Ravaud P. Reporting of results from network meta-analyses: methodological systematic review. BMJ. 2014;348:g1741 pmid:24618053