Figures
Abstract
Introduction
Research productivity has been linked to a country’s intellectual and economic wealth. Further analysis is needed to assess the association between the distribution of research across disciplines and the economic status of countries.
Methods
By using 55 years of data, spanning 1962 to 2017, of Elsevier publications across a large set of research disciplines and countries globally, this manuscript explores the relationship and evolution of relative research productivity across different disciplines through a network analysis. It also explores the associations of those with economic productivity categories, as measured by the World Bank economic classification. Additional analysis of discipline similarities is possible by exploring the cross-country evolution of those disciplines.
Results
Results show similarities in the relative importance of research disciplines among most high-income countries, with larger idiosyncrasies appearing among the remaining countries. This group of high-income countries shows similarities in the dynamics of the relative distribution of research productivity over time, forming a stable research productivity cluster. Lower income countries form smaller, more independent and evolving clusters, and differ significantly from each other and from higher income countries in the relative importance of their research emphases. Country-based similarities in research productivity profiles also appear to be influenced by geographical proximity.
Conclusions
This new form of analyses of research productivity, and its relation to economic status, reveals novel insights to the dynamics of the economic and research structure of countries. This allows for a deeper understanding of the role a country’s research structure may play in shaping its economy, and also identification of benchmark resource allocations across disciplines for developing countries.
Citation: Jaffe K, ter Horst E, Gunn LH, Zambrano JD, Molina G (2020) A network analysis of research productivity by country, discipline, and wealth. PLoS ONE 15(5): e0232458. https://doi.org/10.1371/journal.pone.0232458
Editor: Baogui Xin, Shandong University of Science and Technology, CHINA
Received: August 5, 2019; Accepted: April 15, 2020; Published: May 13, 2020
Copyright: © 2020 Jaffe et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data has been deposited in an open data repository, and the link has been provided in the manuscript: doi.org/10.3886/E118746V1.
Funding: The authors received no specific funding for this work. German Molina co-owned a private firm called Idalion Capital Group, but nobody else in that company worked on this manuscript. He was part of the project as an independent researcher during his free time, and this work was not performed as part of his work at said company. Idalion Capital Group did not provide financial support to German Molina, and did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific role of this author is articulated in the ‘author contributions’ section.
Competing interests: German Molina owns a private firm called Idalion Capital Group, but nobody else in that company worked on this manuscript. He was part of the project as an independent researcher during his free time, and this work was not performed as part of his work at said company. There are no patents, products in development or marketed products to declare. This does not alter our adherence to all the PLOS ONE policies on sharing data and materials.
Introduction
Research and economic progress are intertwined concepts. This relationship has a long history in the literature [1–4]. However, the nature of the inner workings of this relationship in the modern world is still controversial regarding the relative importance of different fields of research in the economic development of nations [5–9]. The traditional view is that research advancement is required for technological expansion, which affects the productive apparatus of a country explaining a high correlation between research and technological advances [10,11]. This, in turn, explains why research advancement and the wealth of countries are closely linked [12]. A significant contribution to the debate was the modeling of the network structure and connectedness from a purely economic standpoint [13]. However, economic diversification is not the only relevant factor, and not all knowledge is equal. Different types of knowledge might be relevant for different techno-economic expansions. Previous work [9,14] showed that research productivity of middle income countries correlates stronger with present and future wealth than indices reflecting its financial, social, economic, or technological sophistication.
Many approaches to the assessment of relationships between research productivity and economic advancement do not disaggregate this linkage by discipline, by country, or both, with narrow but deep analysis of particular linkages, yet lacking a global, comprehensive view [15–20].
This manuscript builds and expands on previous work [9,21], which identified the contribution (or association) of the relative productivity across different disciplines in predicting the future economic growth of a country, showing that wealthy and poor countries differ in the relative proportion of their research output in the different disciplines. Countries with higher relative productivity in basic sciences, such as physics and chemistry, had the highest economic growth in the following five years compared to countries with a higher relative productivity in applied sciences such as medicine and pharmacy [9]. The results of this prior study also indicated that middle income countries that focused their research efforts in selected disciplines grew slower than countries which invested in general basic sciences. This study analyzed correlations between successive time periods, suggesting probable (Granger) causation among certain variables, but not demonstrating it. Their approach was also limited geographically, temporally, and in terms of the disaggregation across research disciplines.
By using a more extensive information set and building on a novel network approach in the field of comparative research, this manuscript provides a deeper insight into aspects of the relationships among disciplines, and between those disciplines and countries’ economic development. Note, however, that those associations can be linked to, or driven by, other latent factors not described in this analysis.
This manuscript introduces a method for assessing relationships that relies on the extraction of the relative research backbone network [22]. The method is robust to both total research productivity and country size, providing a normalized approach to research productivity analysis and its relationship to a country’s economic status. This approach explores the structure of a country’s research ecosystem, characterized by the relative productivity of the diverse research disciplines, across a wide set of countries of different wealth status. Relationships are assessed across time, discipline, and countries. Data-driven constructs (clusters) are extracted, which group countries with similar research productivity profiles (irrespectively of whether the countries’ researchers collaborate with each other), as well as group disciplines with similar profiles among countries. This novel approach provides an insight to the evolution of discipline clusters as well as how country clusters relate to the underlying economic income status of the country. The objectives of this manuscript are: (1) Explore the similarities and clusters in research profiles between different countries; (2) Assess whether those similarities are associated with country income status; (3) Explore the relationships among disciplines based on similarities between them in country-based research profiles; and (4) Describe the evolution over time of country-based research profiles and clusters where those countries belong, given their different political and economic paths.
Methods
Study inclusion and exclusion criteria
Data for the number of peer-reviewed research publications between 1963 and 2017 across countries was gathered using Elsevier Developer Application Programming Interface (API) with an HTTP connection to the Scopus database. The data was downloaded using an Elsevier API (dev.elsevier.com) together with code written in Python using the Python library script found at github.com/ElsevierDev/elsapy.
The classification for each publication in its respective discipline was grouped according to the subjects defined by Elsevier's SciVerse Scopus All Science Journals Classification (ASJC), which is based on the article abstract, scope, and similar contents that the journal publishes. Each of these ASJC codes was used to filter the number of publications in the queries to the API.
Only articles and conference papers were included in the dataset. Reviews, book chapters, viewpoint articles, and letters were excluded from the analysis. All of the listed journals in the Scopus database were selected. However, journals that stopped publishing during the sample periods were not included, since full information was not available.
Countries for which the data was incomplete or unreliable for any year or discipline at the time of data extraction, such as Brazil or Argentina, were excluded from the study. Countries which underwent significant transformations, such as Russia or Germany were also excluded from the study to avoid artificial sharp changes at the time of their geographical or geopolitical redefinitions (integration or disintegration). This led to a study universe comprising 62 countries.
Regarding the country classification of wealth, World Bank classifications [23] were used to map countries to low, low-medium, high-medium, and high income for the purpose of sub-group analyses. The only political entity explicitly excluded was Taiwan, since the World Bank gross domestic product (GDP) report [23], used in this manuscript for income classification, did not include Taiwan in their database. Tables 1 and 2 provide lists of research disciplines and countries, respectively, included in this study. While the scope is not comprehensive, it includes all countries with full history across all time periods.
Research products are assigned to each of the host countries of the contributing authors. By assigning in full each article to each researcher’s host country, the research contribution and productivity per country is more fairly reflected. Assigning a manuscript to a single country (e.g., that of the first author) could penalize work by researchers in lower-productivity countries who may disproportionately rely on joint research with colleagues in higher-productivity countries. Splitting the weight of each manuscript (evenly or otherwise) among countries of the co-authors would also be inadequately reflecting the contributions of each country or unevenly assessing the research efforts per discipline. For example, medical manuscripts oftentimes have a dozen or more co-authors in multiple countries, while mathematical articles tend to have much fewer (oftentimes in a single country). A split of the weight of articles per author/host country could unfairly over-estimate the research productivity in the mathematical discipline relative to the medical discipline. The raw data used in this manuscript is available at https://doi.org/10.3886/E118746V1.
Analysis
The number of publications per country and discipline over the period of analysis is likely upward trending and non-stationary, with growing numbers of publications per year for most countries and disciplines. This is likely to be especially prevalent for incipient research disciplines, growing with increased maturity of the disciplines and penetration within higher education institutions (e.g., computer sciences), as well as country’s population and wealth [24]. To remove the effect on the analysis of this uptrend, we define Pt,c,f as the share of publications for country c relating to research field f in year t, where publications are normalized so that 1TPt,⦁,f = 1 for each vector of country publication shares Pt,⦁,f (where ⦁ denotes all possible categories of a given index–in this example, all possible countries).
Country shares of publications for each research field evolve over time, not only depending on the absolute level of research produced by the country, but also in relative terms to the rest of the world’s research in that discipline. If two research fields, f1 and f2, are similar, they are expected to define similar vectors of country shares , as a reflection that research productivity in one discipline does not occur in isolation from research in the other.
Let d(Ω, Ϛ, f1, f2) be a distance measure between research fields f1 and f2 over a given period Ω (which can be single or multi-year) for a subset of countries Ϛ. The distance function d is defined in Euclidean Distance Matrix form [25,26] and is cumulative over the period Ω, with non-diagonal elements:
Research field f1 is closer to field f2 than to field f3 during period Ω for the subset of countries Ϛ when d(Ω, Ϛ, f1, f2) < d(Ω, Ϛ, f1, f3). Therefore, a weight function of linkages between research fields can be defined as w(Ω, Ϛ, f1, f2) = d(Ω, Ϛ, f1, f2)−1. An undirected graph representing the relationships between research fields for a subset of countries Ϛ, during period Ω is composed of pairs of fields f1 and f2 (vertices in the graph) connected through edges with weights w(Ω, Ϛ, f1, f2). This is performed using the graph.adjacency routine within the igraph package in R.
Since all pairs of vertices are connected through edges with non-zero weight, all graphs are effectively complete. However, most edges may have low (relative) weights, indicating lower levels of relative connectedness between research fields. In order to extract the backbone structure (set of relationships that remain after a statistical network reduction approach is implemented), we follow [22] and apply their proposed disparity filter using the disparityfilter package in R. This approach extracts the network with edges that are statistically significantly (α = 0.05) away from the null model (complete network), without penalizing research fields that may be proportionally smaller or less connected. This approach produces significantly more sparse graphs that represent only statistically significant edges between connected vertices. Note that the value of the significance level (α = 0.05) is pre-specified ahead of the analysis to avoid data snooping. Higher values of α provide more dense networks, while smaller values will result in more sparse networks. As with most statistical approaches, the value of α = 0.05 is both conventional and arbitrary.
Upon constructing the backbone network, a fast greedy algorithm [27] is used to define the optimal community structure of the graph using the cluster_fast_greedy algorithm also within the igraph package in R. These communities allow for dense groups of vertices that share commonalities to be grouped together, forming natural clusters of research fields based on their relationships with other fields. This is represented graphically by splitting the edges into intra-cluster edges (black) and inter-cluster edges (red). Intuitively, nodes connected through black edges belong to a cluster that shares similar features, while those linked through a red edge represent vertices that, while belonging to different clusters, are still similar. For the purpose of graph simplicity, only vertices with at least one connecting edge upon performing the disparity filter are included as part of the resulting graph.
Graphical representations of countries based on their similarities across research disciplines are also possible through the adaptation of the distance function to measure the distance between pairs of countries across research discipline productivity shares. This denotes countries that are similar in both absolute and relative research productivity across all fields (though subsets of fields are also possible). For any given pair of countries c1 and c2, the distance is defined across fields as follows: and the corresponding weights w* are defined as the inverses of the non-diagonal components of the new Euclidean Distance Matrix. While other distance measures were possible (e.g., Manhattan, Cosine, etc.), we chose the Euclidean distance for interpretability.
Finally, country research productivity shares are expected to be largely driven by country size. A measure that further normalizes the research productivity shares (scaling them to add to one across disciplines for each country) is needed for country size-adjusted comparisons of inter-disciplinary shares across countries when using the Euclidean distance. This can be achieved by normalizing the research productivity shares P over all possible countries c. This leads to the final, normalized version of the networks, introduced in this study, where countries of differing sizes are compared.
Note that, while the study is cross-sectional for each 5-year period defining each of the aforementioned probability vectors, there is an inter-temporal component in the analysis of the differences of those analyses over time.
Results
Results are represented graphically in Figs 1 and 2. The graphs in Figs 1 and 2 represent relationships (networks) between different research disciplines by income across countries (Fig 1), as well as networks between different countries across disciplines (Fig 2), in both cases over multiple 5-year periods. The distributions of log-weights and log-distances corresponding to most graphs within Figs 1 and 2 are relatively uniform.
Edges represent closeness in research productivity shares across countries. Vertices colors aid visualization of relationships: (1) light blue for Biochemistry and Medicine; (2) green for Economics and Business; (3) grey for Computer Sciences and Mathematics; (4) dark orange for Engineering and Physics; (5) light orange for Materials; (6) yellow for Agriculture; (7) pink for Chemistry; (8) dark blue for Sociology; and (9) no color for the remainder (see Table 1 for the full scope of the aforementioned disciplines).
Color-coding was based on the country classification by income produced by the World Bank [23]: (1) yellow for high income countries; (2) green for medium-high income countries; (3) blue for medium-low income countries; and (4) orange for low income countries.
In Fig 1, the color associated with each research discipline was selected (subjectively) to visually enhance key disciplines and expected relationships a priori. These a priori color choices did not exert any influence on the methods of analysis or results.
A visual inspection of the distribution of the clusters in Fig 1 shows the following stylized features: (1) Health Sciences and Mathematics tend to share different clusters than those of Social Sciences; (2) the network structure shows several consistent patterns over time for both low-income and high-income countries; (3) Business and Economics are very close in half of the clusters, but they seem to become more isolated from other disciplines more recently in high-income countries; (4) Engineering, Physics, and other STEM-related sciences are often clustered or are related through inter-cluster links, demonstrating their commonalities; (5) for low-income countries, the associations between Agricultural, Veterinary, and Immunology are strong and consistent; and (6) Mathematics and Computer Sciences form a strong inter- or intra-cluster link in all but one sub-period and income cluster, forming one of the most consistent linkages among all pairs of disciplines.
While most of the same features remain across income levels, the networks appear to show greater dynamics in the middle-income clusters.
Fig 2 allows for analysis of the relative productivity of the different countries. Color-coding was used solely for visual representation of research disciplines and countries considered similar a priori, and was not used in the actual analysis (the expected outcome being that disciplines or countries with similarities would be linked), except when performing cluster-specific analysis by country income classification. Black edges represent intra-cluster linkages, while red edges represent inter-cluster linkages.
These graphs unveil that different income countries differ in the structure of the relative importance of research disciplines. The large number of high-income countries (yellow circles) linked either through intra-cluster or inter-cluster edges, indicates that they are not only intertwined economically, but also in terms of their research productivity profiles. This over-representation of high-income countries also indicates that the relative distribution across disciplines of the research productivity can serve as a predictor of the economic status of the country. Since these results are normalized by total research productivity, the network inputs are not dependent on the size or availability of resources dedicated to research in the country, and only conditioned on how those resources are distributed and the corresponding relative outcomes in research productivity across disciplines.
Fig 3 displays results of the cluster analysis of different countries, grouped according to the similarities of their research systems and processes, which are assessed by the distribution of research disciplines according to their research productivity in each country. Cluster 0 represents countries which do not have strong productivity research profile similarities with any other country. This does not mean that their research is not connected, but instead that the productivity research profile distribution across disciplines is more heterogeneous than that of the countries that appear in non-zero clusters. The majority of countries belong to this ‘zero’ cluster since higher similarities are found among higher income countries. There seems to be an Anglophone cluster (cluster 1), where some countries with strong ties to Anglophone countries (e.g., Netherlands and Norway more recently) are grouped in the research profile defined by the cluster of English-speaking countries (e.g., Canada, US, UK, Australia, New Zealand). Japan has closer ties to research profiles of Central and Southern Europe (in most periods this is represented by cluster 2) than to that of Anglophone countries.
Membership to a cluster does not indicate importance of the cluster or the country's research, but instead similarities in relative productivity across disciplines for those countries. Cluster identifiers do not follow any particular ordering.
There is strong cluster stability over time: countries rarely move from one cluster to another. On average, countries remain in the same cluster as the previous period in approximately 75% of cases. Spain consistently joined the Mediterranean cluster in the late 70s, when democracy was introduced, there were large investments in education, and stronger links to Europe were politically sought. Despite the geographical proximity, Netherlands and Belgium have markedly different ties, with the latter belonging more to the central-to-southern European cluster. Geopolitical ties matter: for example, Hong Kong and Singapore have very similar paths of cluster membership. Similar features are found more recently for Uganda and Kenya. Glimpses of a commonwealth effect can be seen between South Africa and New Zealand, though those have been less relevant since the turn of the century. Among larger economies, China shows greater variability in cluster membership, probably a feature of its larger-than-average economic dynamics over time, as well as their historically extreme contrasts between the times of the Cultural Revolution and the more recent era of scientific advancements. Interestingly, China and Japan, which share a history of conflict, have more recently (2013–2017) developed a strong level of similarity in their research profiles, which coincides with larger commercial exchanges between the two countries. Algeria’s link to China could be spurious, though Algeria shares strong commercial ties with China, Algeria’s largest supplier by a large margin, and has maintained strong historical relations. Israel used to belong to the Anglophone cluster, but that relationship broke at the turn of the century.
Table 3 provides a ranking of each discipline by income cluster. This ranking identifies, for each income cluster, the disciplines with larger relative share of research publications compared to other income clusters. For example, Psychology has the largest relative share of publications within high-income countries compared to the other income clusters for that discipline, while Arts has the second largest relative share of research publications among high-income countries versus the rest of the clusters for that discipline. Veterinary, Immunology, Agriculture, and Medicine are disciplines where low-income countries have a larger relative share, which aligns with their needs. Similarly for high-income, advanced economies, leisure and health (mental and physical) account for the top five disciplines. Again, these rankings are not built in terms of absolute numbers of publications, but relative proportions as a percentage of the total research compared to other income clusters. Therefore, they are not influenced by total research productivity or country/cluster size.
Conclusions
Discussion
The nature of scientific contributions in the form of published research offers a window into the relationships among the disciplines, as well as their association with the economic status of a country. Among some of the key features unveiled in this manuscript are: (1) countries with high (per capita) income have similar structures of their research productivity in relative terms, forming a strong network with identifiable geographical, linguistic, commercial, and geopolitical links; (2) some disciplines have strong relationships that remain across all country income levels (such as Computer Sciences and Mathematics), while others are more dependent on the income level of the country and their reliance on the primary sector (Agriculture and Veterinary); (3) China appears more recently within the network with similar research productivity profiles to high-income Asian countries, though it shows a history of swings that aligns with an erratic view of their research community; (4) countries outside the high-income group tend to form small isolated clusters mostly driven by geographical proximity, rather than income status; (5) middle-income countries show more dynamics in the discipline network than countries in lower and higher income brackets. This could be due to either funding deficiencies hindering dynamics (low income countries) or consolidation of relative importance of research disciplines for high-income countries and rigidities to modify the status quo (e.g., politics around budgets and departmental expansions); and (6) disciplines such as Psychology and Arts are over-weighted (in relative terms) in high-income countries, while disciplines such as Agriculture and Immunology are more relevant and remain over-weighted for low-income countries. This is reflective of the different concerns that wealthier countries face (mental health, leisure) versus those of lower income countries (food security, survival) [28]. Diminishing interdisciplinary relations, such as those mentioned regarding Economics and Business, can be concerning given the need to tackle ever more complex problems [29].
Higher dynamics in middle-income clusters could be due to those countries exposed to less pressure to maintain the status quo than other income clusters. Low-income clusters could be more bounded in their evolution by their constraints (scientific and financial) to shift resources between disciplines. High-income clusters could be more bounded in their evolution by structural constraints (e.g., inter-departmental budget fights and shared governance may induce a higher propensity to maintain the inter-disciplinary status quo).
The method used in this manuscript allows for identification of clusters of countries that may be considered ‘aspirational’ for developing countries for economic or geopolitical purposes, allowing for identification of long-term distributions of resources among disciplines to match those in targeted clusters. The present work did not assume any clusters of scientific fields a priori, but identified the clusters based on the data. This is different from studies which assume a priori a particular clustering of disciplines [30], which may explain why those studies found that national wealth was not associated with tradeoffs between altruistic and economic motives. While finer methods for clustering areas of research based on publication data have been performed [31,32], the work presented in this manuscript focused on a more course approach to extract more robust relationships and their dynamics over time.
This study does not engage in causality arguments. The causal relationship between research productivity and economic advancement has largely been discussed in the literature [6–11]. On that basis, this study provides a benchmark for developing countries to define their research ecosystem, as a means to pursue economic advancement. Hence, this study broadens the window on the dynamics of the research ecosystem among countries. It helps pinpoint critical aspects of this ecosystem in each country and helps to plan for future developments.
Study limitations and future research
The scope of this study is bounded by the number of countries for which the data was: (1) complete and reliable across years and disciplines; (2) not affected by country expansions/territorial redefinitions; and (3) available from the World Bank with regards to GDP per capita country classification. This led to a universe comprised of 62 countries with complete history, and has the potential to affect some regions more than others. While the study largely expands work done in this area, it is not comprehensive and does not cover all countries throughout the world. Countries that experienced major geographical integration or disintegration processes (e.g., Germany or Russia) were not included, to avoid artificial jumps mostly driven by geopolitical events rather than scientific dynamics. However, while partial in nature, this study expands the literature on relationships among research disciplines and their relationship with economic clusters over time.
Expanded or sub-group analyses are feasible for a larger list of countries if constrained solely to more recent periods. This would allow for geographical or geopolitical sub-analyses. For example, data for all countries in South America would be available for more recent years, and a network comprising only these countries could be constructed to explore in more depth the intra-region relationships. Such networks would be less affected by the strength of the similarities found within higher income countries, which dominate the analyses in this manuscript. However, while possible through the methodology introduced in this manuscript, this type of more granular analysis is out of the scope of this study.
Throughout this manuscript, a link between country wealth and research profile is explored. When those associations exist, causation cannot be claimed within the scope of this manuscript. Also, there is no evidence that those associations are not driven by a set of other common/latent factors (e.g., political factors, geographical factors, individualism, level of penetration of capitalism, access to national/transnational public/private funding of research, perceptions regarding the relevance of higher education, etc.).
Finally, the mapping of the research literature to countries or disciplines is arbitrary and does not follow any validated or commonly-agreed structure. There are multiple ways in which each piece of research can be assigned to countries and disciplines, all of which would show different angles to the same questions. A comparison of all those forms, while interesting, remains outside the scope of this manuscript.
References
- 1.
Bacon F. (1620). Novum Organum Scientiarum. Oxford. Oxford University Press.
- 2. Condorcet M.J.A. (1794). Sketch for a Historical Picture of the Progress of the Human Mind: Tenth Epoch. Daedalus, 133 (3), 65–82.
- 3.
Spencer H. (1875). Progress: Its Law and Cause. Illustrations of Universal Progress: A Series of Discussions. 1–60. New York, NY, US: D Appleton & Company, XXV.
- 4.
Marshall A. (1890). Principles of Economics. Amazon Kindle edition.
- 5. Salter A.J., Martin B.R. (2001). The Economic Benefits of Publicly Funded Basic Research: A Critical Review. Research Policy, 30, 509–532.
- 6. Nelson RR. (1959). The Simple Economics of Basic Scientific Research. Journal of Political Economy, 67, 297–306.
- 7. King D.A. (2004). The Scientific Impact of Nations. Nature, 430, 311–316. pmid:15254529
- 8.
The Royal Society (2011). Knowledge, Networks and Nations: Global Scientific Collaboration in the 21st Century. Royal Society Policy document 03/11. London, UK. Retrieved on 2019-05-24 from https://royalsociety.org/-/media/Royal_Society_Content/policy/publications/2011/4294976134.pdf
- 9. Jaffe K., Caicedo M., Manzanares M., Gil M., Rios A., Florez A., et al. (2013). Productivity in Physical and Chemical Science Predicts the Future Economic Growth of Developing Countries Better than other Popular Indices. PloS One, pmid:23776640
- 10. Teitel S. (1994). Scientific Publications, R&D Expenditures, Country Size, and Per Capita Income: A Cross Section Analysis. Technological Forecasting and Social Change, 46, 175–187.
- 11. Wang E.C. (2007). R&D Efficiency and Economic Performance: A Cross-country Analysis using the Stochastic Frontier Approach. Journal of Policy Modeling, 29, 345–360.
- 12.
Sachs J.D. (2005). The End of Poverty. Penguin Books, New York, New York.
- 13. Hidalgo C.A., Klinger B., Barabási A.l., and Hausmann R. (2007). The Product Space Conditions the Development of Nations. Science, 317, 482–487. pmid:17656717
- 14. Laverde-Rojas H., and Correa J.C. (2019). Can Scientific Productivity Impact the Economic Complexity of Countries? Scientometrics,
- 15.
Bruchey S. (2015). Roots of American Economic Growth 1607–1861: An Essay on Social Causation. Routledge, Oxon, United Kingdom.
- 16. Weinberg B.A., Owen-Smith J., Rosen R.F., Schwarz L., Allen B.M., Weiss R.E., et al. (2014). Science Funding and Short-Term Economic Activity, Science, 344(6179), 41–43. pmid:24700844
- 17.
Dunleavy P. (1991). Democracy, Bureaucracy and Public Choice. Routledge, 2014, London.
- 18.
Stephan P. (2012). How Economics Shapes Science. Harvard University Press, Cambridge, MA.
- 19. Sener S., and Saridogan E. (2011). The Effects of Science-Technology-Innovation on Competitiveness and Economic Growth. Procedia—Social and Behavioral Sciences, 24, 815–828.
- 20.
Breznitz D., and Murphree M. (2012). Run of the Red Queen: Government, Innovation, Globalization, and Economic Growth in China. Yale University Press, New Haven, CT.
- 21.
Jaffe K. (2009). What is Science? An Interdisciplinary Perspective. University Press of America. New York, NY.
- 22. Serrano M.A., Boguna M. and Vespignani A. (2009). Extracting the Multiscale Backbone of Complex Weighted Networks. Proceedings of the National Academy of Sciences, 106, 6483–6488.
- 23.
World Bank (2018). Retrieved from https://datacatalog.worldbank.org/dataset/gdp-ranking
- 24. May R.M. (2007). The Scientific Wealth of Nations. Science, 275(5301), 793–796
- 25. Schoenberg I.J. (1938). Metric Spaces and Positive Definite Functions. Transactions of the American Mathematical Society, 44(3), 522–536.
- 26. Alfakih A.Y. (2000). Graph Rigidity via Euclidean Distance Matrices. Linear Algebra and its Applications, 310, 149–155.
- 27. Clauset A., Newman M.E.J., and Moore C. (2004). Finding Community Structure in Very Large Networks. Physical Review E, 70, 066111.
- 28. Baer-Nawrocka A, Sadowski A (2019) Food security and food self-sufficiency around the world: A typology of countries. PLOS ONE 14(3): e0213448. https://doi.org/10.1371/journal.pone.0213448 pmid:30845273
- 29.
Jaffe K. (2014). The Wealth of Nations: Complexity Science for an Interdisciplinary Approach in Economics. Amazon Books.
- 30. Klavans R., & Boyack K. W. (2017). The research focus of nations: Economic vs. altruistic motivations. PloS one, 12(1).
- 31.
Garfield, G., Small, H., Klavans, D., Börner, K., & Hook, P. Historical Perspectives and Recent Advances in Mapping the Sciences.
- 32. Rafols I., Porter A. L., & Leydesdorff L. (2010). Science overlay maps: A new tool for research policy and library management. Journal of the American Society for information Science and Technology, 61(9), 1871–1887.