Wikipedia is a huge global repository of human knowledge that can be leveraged to investigate interwinements between cultures. With this aim, we apply methods of Markov chains and Google matrix for the analysis of the hyperlink networks of 24 Wikipedia language editions, and rank all their articles by PageRank, 2DRank and CheiRank algorithms. Using automatic extraction of people names, we obtain the top 100 historical figures, for each edition and for each algorithm. We investigate their spatial, temporal, and gender distributions in dependence of their cultural origins. Our study demonstrates not only the existence of skewness with local figures, mainly recognized only in their own cultures, but also the existence of global historical figures appearing in a large number of editions. By determining the birth time and place of these persons, we perform an analysis of the evolution of such figures through 35 centuries of human history for each language, thus recovering interactions and entanglement of cultures over time. We also obtain the distributions of historical figures over world countries, highlighting geographical aspects of cross-cultural links. Considering historical figures who appear in multiple editions as interactions between cultures, we construct a network of cultures and identify the most influential cultures according to this network.
Citation: Eom Y-H, Aragón P, Laniado D, Kaltenbrunner A, Vigna S, Shepelyansky DL (2015) Interactions of Cultures and Top People of Wikipedia from Ranking of 24 Language Editions. PLoS ONE 10(3): e0114825. https://doi.org/10.1371/journal.pone.0114825
Academic Editor: Zhong-Ke Gao, Tianjin University, CHINA
Received: May 30, 2014; Accepted: November 14, 2014; Published: March 4, 2015
Copyright: © 2015 Eom et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited
Data Availability: All used computational data are publicly available at http://dumps.wikimedia.org/. All the raw data necessary to replicate the findings and conclusion of this study are within the paper, supporting information files and this Wikimedia web site.
Funding: This research is supported in part by the EC FET Open project “New tools and algorithms for directed network analysis” (NADINE number 288956). No additional external or internal funding was received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The influence of digital media on collective opinions, social relationships, and information dynamics is growing significantly with the advances of information technology. On the other hand, understanding how collective opinions are reflected in digital media has crucial importance. Among such a medium, Wikipedia, the open, free, and online encyclopedia, has crucial importance since it is not only the largest global knowledge repository but also the biggest collaborative knowledge platform on the Web. Thanks to its huge size, broad coverage and ease of use, Wikipedia is currently one of the most widely used knowledge references. However, since its beginning, there have been constant concerns about the reliability of Wikipedia because of its openness. Although professional scholars may not be affected by a possible skewness or bias of Wikipedia, students and the public can be affected significantly [1, 2]. Extensive studies have examined the reliability of contents [1–3], topic coverage , vandalism , and conflict [6–8] in Wikipedia.
Wikipedia is available in different language editions; 287 language editions are currently active. This indicates that the same topic can be described in hundreds of articles written by different language user groups. Since language is one of the primary elements of culture , collective cultural biases may be reflected on the contents and organization of each Wikipedia edition. Although Wikipedia adopts a “neutral point of view” policy for the description of contents, aiming to provide unbiased information to the public , it is natural that each language edition presents reality from a different angle. To investigate differences and relationships among different language editions, we develop mathematical and statistical methods which treat the huge amount of information in Wikipedia, excluding cultural preferences of the investigators.
Cultural bias or differences across Wikipedia editions have been investigated in previous research [11–17]. A special emphasis was devoted to persons described in Wikipedia articles  and their ranking [18, 19]. Indeed, human knowledge, as well as Wikipedia itself, was created by people who are the main actors of its development. Thus it is rather natural to analyze a ranking of people according to the Wikipedia hyper-link network of citations between articles (see network data description below). A cross-cultural study of biographical articles was presented in , by building a network of interlinked biographies. Another approach was proposed recently in : the difference in importance of historical figures across Wikipedia language editions is assessed on the basis of the global ranking of Wikipedia articles about persons. This study, motivated by the question “Is an important person in a given culture also important in other cultures?”, showed that there are strong entanglements and local biases of historical figures in Wikipedia. Indeed, the results of the study show that each Wikipedia edition favors persons belonging to the same culture (language), but also that there are cross-Wikipedia top ranked persons, who can be signs of entanglement between cultures. These cross-language historical figures can be used to generate inter-culture networks demonstrating interactions between cultures . Such an approach provides us novel insights on cross-cultural differences across Wikipedia editions. However, in  only 9 Wikipedia editions, mainly languages spoken in European, have been considered. Thus a broader set of language editions is needed to offer a more complete view on a global scale.
We note that the analysis of persons’ importance via Wikipedia becomes more and more popular. This is well visible from the appearance of new recent studies for the English Wikipedia  and for multiple languages . The analysis of coverage of researchers and academics via Wikipedia is reported in .
Here we investigate interactions and skewness of cultures with a broader perspective, using global ranking of articles about persons in 24 Wikipedia language editions. According to Wikipedia  these 24 languages cover 59 percent of world population. Moreover, according to Wikipedia , our selection of 24 language editions covers the 68 percent of the total number of 30.9 millions of Wikipedia articles in all 287 languages. These 24 editions also cover languages which played an important role in human history including Western, Asian and Arabic cultures.
On the basis of this data set we analyze spatial, temporal, and gender skewness in Wikipedia by analyzing birth place, birth date, and gender of the top ranked historical figures in Wikipedia. We identified overall Western, modern, and male skewness of important historical figures across Wikipedia editions, a tendency towards local preference (i.e. each Wikipedia edition favors historical figures born in countries speaking that edition’s language), and the existence of global historical figures who are highly ranked in most of Wikipedia editions. We also constructed networks of cultures based on cross-cultural historical figures to represent interactions between cultures according to Wikipedia.
To obtain a unified ranking of historical figures for all 24 Wikipedia editions, we introduce an average ranking which gives us the top 100 persons of human history. To assess the alignment of our ranking with previous work by historians, we compare it with the Hart’s list of the top 100 people who, according to him, most influenced human history . We note that Hart “ranked these 100 persons in order of importance: that is, according to the total amount of influence that each of them had on human history and on the everyday lives of other human beings”.
In this research, we consider each Wikipedia edition as a network of articles. Each article corresponds to a node of the network and hyperlinks between articles correspond to links of the network. For a given network, we can define an adjacency matrix Aij. If there is a link (one or more) from node (article) j to node (article) i then Aij = 1, otherwise, Aij = 0. The out-degree kout(j) is the number of links from node j to other nodes and the in-degree kin(j) is the number of links to node j from other nodes. The links between articles are considered only inside a given Wikipedia edition, there are no links counted between editions. Thus each language edition is analyzed independently from others by the Google matrix methods described below. The transcriptions of names from English to the other 23 selected languages are harvested from WikiData (http://dumps.wikimedia.org/wikidatawiki) and not directly from the text of articles.
To rank the articles of a Wikipedia edition, we use two ranking algorithms based on the articles network structure. Detailed descriptions of these algorithms and their use for Wikipedia editions are given in [18, 19, 28, 29]. The methods used here are described in ; we keep the same notations.
First we construct the matrix Sij of Markov transitions by normalizing the sum of the elements in each column of A to unity (Sij = Aij/∑i Aij, ∑i Sij = 1) and replacing columns with zero elements by elements 1/N with N being the matrix size. Then the Google matrix is given by the relation Gij = αSij + (1 − α)/N, where α is the damping factor . As in  we use the conventional value α = 0.85. It is known that the variation of α in a range 0.5 ≤ α < 0.95 does not significantly affect the probability distribution of ranks discussed below (see e.g. [18, 19, 30]).
PageRank is a widely used algorithm to rank nodes in a directed network. It was originally introduced for Google web search engine to rank web pages of the World Wide Web based on the idea of academic citations . Currently PageRank is used to rank nodes of network systems from scientific papers  to social network services , world trade  and biological systems . Here we briefly outline the iteration method of PageRank computation. The PageRank vector P(i, t) of a node i at iteration t in a network with N nodes is given by (1)
The stationary state P(i) of P(i, t) is the PageRank of node i. More detailed information about the PageRank algorithm is described in . Ordering all nodes by their decreasing probability P(i), we obtain the PageRank ranking index K(i). In qualitative terms, the PageRank probability of a node is proportional to the number of incoming links weighted according to their own probability. A random network surfer spends on a given node a time given on average by the PageRank probability.
In a directed network, outgoing links can be as important as ingoing links. In this sense, as a complementary to PageRank, the CheiRank algorithm is defined and used in [18, 28, 36]. The CheiRank vector P*(i, t) of a node at iteration time t is given by (2)
Same as the case of PageRank, we consider the stationary state P*(i) of P*(i, t) as the CheiRank probability of node i with α = 0.85. High CheiRank nodes in the network have large out-degree. Ordering all nodes by their decreasing probability P*(i), we obtain the CheiRank ranking index K*(i). The PageRank probability of an article is proportional to the number of incoming links, while the CheiRank probability of an article is proportional to the number of outgoing links. Thus a top PageRank article is important since other articles refer to it, while a top CheiRank article is highly connected because it refers to other articles.
PageRank and CheiRank algorithms focus only on in-degree and out-degree of nodes, respectively. The 2DRank algorithm considers both types of information simultaneously to rank nodes with a balanced point of view in a directed network. Briefly speaking, nodes with both high PageRank and CheiRank get high 2DRank ranking. Consider a node i which is Ki-th ranked by PageRank and K*i ranked by CheiRank. Then we can assign a secondary ranking to the node. If , then node j has lower 2DRank and vice versa. A detailed illustration and description of this algorithm is given in .
We note that the studies reported in  show that the overlap between top CheiRank persons of different editions is rather small and due to that the statistical accuracy of this data is not sufficient for determining interactions between different cultures for the CheiRank list. Moreover, CheiRank, based on outgoing links only, selects mainly persons from such activity fields like sports and arts where the historical trace is not so important. Due to these reasons we restrict our study to PageRank and 2DRank. It can be also interesting to use other algorithms of ranking, e.g. LeaderRank , but here we restrict ourselves to the methods which we already tested, leaving investigation of other raking methods for further studies.
We consider 24 different language editions of Wikipedia: English (EN), Dutch (NL), German (DE), French (FR), Spanish (ES), Italian (IT), Portuguese (PT), Greek (EL), Danish (DA), Swedish (SV), Polish (PL), Hungarian (HU), Russian (RU), Hebrew (HE), Turkish (TR), Arabic (AR), Persian (FA), Hindi (HI), Malaysian (MS), Thai (TH), Vietnamese (VI), Chinese (ZH), Korean (KO), and Japanese (JA). The Wikipedia data were collected in middle February 2013. The overview summary of each Wikipedia is represented in Table 1.
Here Na is the number of articles. Wikipedia data were collected in middle February 2013.
We understand that our selection of Wikipedia editions does not represent a complete view of all the 287 languages of Wikipedia editions. However, this selection covers most of the largest language editions and allows us to perform quantitative and statistical analysis of important historical figures. Among the 20 largest editions (counted by their size, taken at the middle of 2014) we have not considered the following editions: Waray-Waray, Cebuano, Ukrainian, Catalan, Bokmal-Riksmal, and Finish.
First we ranked all the articles in a given Wikipedia edition by PageRank and 2DRank algorithms, and selected biographical articles about historical figures. To identify biographical articles, we considered all articles belonging to “Category:living people”, or to “Category:Deaths by year” or “Category:Birth by year” or their subcategories in the English Wikipedia. In this way, we obtained a list of about 1.1 million biographical articles. We identified birth place, birth date, and gender of each selected historical figure based on DBpedia  or a manual inspection of the corresponding Wikipedia biographical article, when for the considered historical figure no DBpedia data were available. We then started from the list of persons with their biographical article’s title on the English Wikipedia, and found the corresponding titles in other language editions using the inter-language links provided by WikiData. Using the corresponding articles, identified by the inter-languages links in different language editions, we extracted the top 100 persons from the rankings of all Wikipedia articles of each edition. At the end, for each Wikipedia edition and for each ranking algorithm, we have information about the top 100 historical figures with their corresponding name in the English Wikipedia, their birth place and date, and their gender. All 48 lists of the top 100 historical figures in PageRank and 2DRank for the 24 Wikipedia editions and for the two ranking algorithms are represented in  and Supporting Information (SI). The original network data for each edition are available at . The automatic extraction of persons from PageRank and 2DRank listings of articles of each edition is performed by using the above whole list of person names in all 24 editions. This method implies a significantly higher recall compared to the manual selection of persons from the ranking list of articles for each edition used in .
We attribute each of the 100 historical figures to a birth place at the country level (actual country borders), to a birth date in year, to a gender, and to a cultural group. Historical figures are assigned to the countries currently at the locations where they were born. The cultural group of historical figures is assigned by the most spoken language of their birth place at the current country level. For example, if someone was born in “Constantinople” in the ancient Roman era, since the place is now Istanbul, Turkey, we assign her/his birth place as “Turkey” and since Turkish is the most spoken language in Turkey, we assign this person to the Turkish cultural group. If the birth country does not belong to any of the 24 cultures (languages) which we consider, we assign WR (world) as the culture of this person. We would like to point out that although a culture can not be defined only by language, we think that language is a suitable first-approximation of culture. All lists of top 100 historical figures with their birth place, birth date, gender, and cultural group for each Wikipedia edition and for each ranking algorithm are represented in . A part of this information is also reported in SI.
To apply PageRank and 2DRank methods, we consider each edition as the network of articles of the given edition connected by hyper-links among the articles (see the details of ranking algorithms in Section Methods). The full list of considered Wikipedia language editions is given in Table 1. Table 2 represents the top 10 historical figures by PageRank and 2DRank in the English Wikipedia. Roughly speaking, top PageRank articles imply highly cited articles in Wikipedia and top 2DRank articles imply articles which are both highly cited and highly citing in Wikipedia. In total, we identified 2400 top historical figures for each ranking algorithm. However, since some historical figures such as Jesus, Aristotle, or Napoleon appear in multiple Wikipedia editions, we have 1045 unique top PageRank historical figures and 1616 unique top 2Drank historical figures.
All names are represented by article titles in the English Wikipedia.
We should note that the extraction of persons and their information from a Wikipedia edition is not an easy task even for the English edition, and much more complicated for certain other language editions. Therefore, the above automatic method based on 1.1 million English names and their corresponding names seems to us to be the most adequate approach. Of course, it will miss people who do not have a biographical article on the English Wikipedia. Cross-checking investigation is done for Korean and Russian Wikipedia, which are native languages for two authors, by manually selecting top 100 persons from top lists of all articles ordered by PageRank and 2DRank in both Wikipedia editions. We find that our automatic search misses on average only 2 persons from 100 top persons for these two editions (the missed names are given in SI). The errors appear due to transcription changes of names or missing cases in our name-database based on English Wikipedia. For Western languages the number of errors is presumably reduced since transcription remains close to English. Based on the manual inspection for the Korean and the Russian Wikipedia, we expect that the errors of our automatic recovery of the top people from the whole articles ordered by PageRank and 2DRank are on a level of two percent.
We also note that our study is in compliance with Wikipedia’s Terms and Conditions.
Above we described the methods used for the extraction of the top 100 persons in the ranking list of each edition. Below we present the obtained results describing the spatial, temporal and gender distributions of top ranked historical figures. We also determine the global and local persons and obtain the network of cultures based on the ranking of persons from a given language by other language editions of Wikipedia.
The birth places of historical figures are attributed to the country containing their geographical location of birth according to the present geographical territories of all world countries. The list of countries appeared for the top 100 persons in all editions is given in Table 3. We also attribute each country to one of the 24 languages of the considered editions. This attribution is done according to the language spoken by the largest part of population in the given country. Thus e.g. Belgium is attributed to Dutch (NL) since the majority of the population speaks Dutch. If the main language of a country is not among our 24 languages, then this country is attributed to an additional section WR corresponding to the remaining world (e.g. Ukraine, Norway are attributed to WR). If the birth place of a person is not known, then it is also attributed to WR. The choice of attribution of a person to a given country in its current geographic territory, and as a result to a certain language, may have some fluctuations due to historical variations of country borders (e.g. Immanuel Kant was born in the current territory of Russia and hence is attributed to Russian language). However, the number of such cases is small, being on a level of 3.5 percent (see Section “Network of cultures” below). We think that the way in which a link between person, language and country is fixed by the birth place avoids much larger ambiguity of attribution of a person according to the native language which is not so easy to fix in an automatic manner.
LC is determined by the most spoken language in the given country. Country codes are based on country codes of Internet top-level domains and language codes are based on language edition codes of Wikipedia; WR represents all languages other than the considered 24 languages.
The obtained spatial distribution of historical figures of Wikipedia over countries is shown in Fig. 1. This averaged distribution gives the average number of top 100 persons born in a specific country as birth place, with averaging done over our 24 Wikipedia editions. Thus an average over the 24 editions gives for Germany (DE) approximately 9.7 persons in the top 100 of PageRank, being at the first position, followed by USA with approximately 9.5 persons. For 2DRank we have USA at the first position with an average of 9.8 persons and Germany at the second with an average of 8.0 persons.
Two letter country codes are represented in Table 3.
Western (Europe and USA) skewed patterns are observed in both top PageRank historical figures (Fig. 1. (A)) and top 2DRank historical figures (Fig. 1. (B)). This Western skewed pattern is remarkable since 11 Wikipedia editions of the 24 considered editions are not European language editions. Germany, USA, Italy, UK and France are the top five birth places of top PageRank historical figures among 71 countries. On the other hand, USA, Germany, UK, Italy and Japan are top five birth places of the top 2DRank historical figures among 91 countries.
In Fig. 2 we show the world map of countries, where color indicates the number of persons from a given country among the 24 × 100 top persons for PageRank and 2DRank. Additional figures showing these distributions for different centuries are available at .
Color changes from zero (white) to maximum (black). Maximal values are 233 appearances for Germany (top) and 236 for USA (bottom). Values are proportional to the averages per country shown in Fig. 1.
We also observed local skewness in the spatial distribution of the top historical figures for the PageRank (2DRank) ranking algorithm as shown in Fig. 3A (in Fig. 3B). For example, 47 percent of the top PageRank historical figures in the English Wikipedia were born in USA (25 percent) and UK (22 percent) and 56 percent of the top historical figures in the Hindi Wikipedia were born in India. A similar strong locality pattern of the top historical figures was observed in our previous research . However it should be noted that in the previous study we considered the native language of the top historical figure as a criterion of locality, while in the current study we considered ‘birth place’ as criterion of locality.
Panels: (A) distributions of PageRank historical figures over 71 countries for each Wikipedia edition; (B) distributions of 2DRank historical figures over 91 countries for each Wikipedia edition; (C) column normalized birth place distributions of PageRank historical figures of panel (A); (D) column normalized birth place distributions of 2DRank historical figures of panel (B).
Regional skewness, the preferences of Wikipedia editions for historical figures who were born in geographically or culturally related countries, is also observed. For example, 18 (5) of the top 100 PageRank historical figures in the Korean (Japanese) Wikipedia were born in China. Also 9 of the top 100 PageRank historical figures in the Persian Wikipedia were born in Saudi Arabia. The distribution of top persons from each Wikipedia edition over world countries is shown in Fig. 3A and Fig. 3B. The countries on a horizontal axis are grouped by clusters of corresponding language so that the links inside a given culture (or language) become well visible.
To observe patterns in a better way at low numbers of historical figures, we normalized each column of Fig. 3A and Fig. 3B corresponding to a given country. In this way we obtain a rescaled distribution with better visibility for each birth country level as shown in Fig. 3C and Fig. 3D, respectively. We can observe a clear birth pattern of top PageRank historical figures born in Lebanon, Libya, Oman, and Tunisia in the case of the Arabic Wikipedia, and historical figures born in N. Korea appearing not only in the Korean but also in the Japanese Wikipedia.
In the case of the top 2DRank historical figures shown in Fig. 3B and Fig. 3D, we observe overall patterns of locality and regions being similar to the case of PageRank, but the locality is stronger.
In short, we observed that most of the top historical figures in Wikipedia were born in Western countries, but also that each edition shows its own preference to the historical figures born in countries which are closely related to the corresponding language edition.
The analysis of the temporal distribution of top historical figures is done based on their birth dates. As shown in Fig. 4A for PageRank, most of historical figures were born after the 17th century on average, which shows similar pattern with world population growth . However, there are some distinctive peaks around BC 5th century and BC 1st century for the case of PageRank because of Greek scholars (Socrates, Plato, and Herodotus), Roman politicians (Julius Caesar, Augustus) and Christianity leaders (Jesus, Paul the Apostle, and Mary (mother of Jesus)). We also observe that the Arabic and the Persian Wikipedia have more historical figures than Western language Wikipedia editions from AD 6th century to AD 12th century. For the case of 2DRank in Fig. 4B, there is only one small peak around BC 1C, which is also smaller than the peak in the case of PageRank, and all the distribution is dominated by a strong growth on the 20th century.
(A) Birth date distribution of PageRank historical figures averaged over 24 Wikipedia editions (B) Birth date distribution of 2DRank historical figures averaged over 24 Wikipedia editions (C) Birth date distributions of PageRank historical figures for each Wikipedia edition. (D) Birth date distributions of 2DRank historical figures for each Wikipedia edition. (E) Column normalized birth date distributions of PageRank historical figures for each Wikipedia edition. (F) Column normalized birth date distributions of 2DRank historical figures for each Wikipedia edition.
The distributions of the top PageRank historical figures over the 24 Wikipedia editions for each century are shown in Fig. 4C. The same distribution, but normalized to unity over all editions for each century, is shown in Fig. 4E. The Persian (FA) and the Arabic (AR) Wikipedia have more historical figures than other language editions (in particular European language editions) from the 6th to the 12th century due to Islamic leaders and scholars. On the other hand, the Greek Wikipedia has more historical figures in BC 5th century because of Greek philosophers. Also most of western-southern European language editions, including English, Dutch, German, French, Spanish, Italian, Portuguese, and Greek, have more top historical figures because they have Augustine the Hippo and Justinian I in common. Similar distributions obtained from 2DRank are shown in Fig. 4D and Fig. 4F respectively.
The data of Figs. 4E, F clearly show well pronounced patterns, corresponding to strong interactions between cultures: from BC 5th century to AD 15th century for JA, KO, ZH, VI; from AD 6th century to AD 12th century for FA, AR; and a common birth pattern in EN, EL, PT, IT, ES, DE, NL (Western European languages) from BC 5th century to AD 6th century. In supporting Figure S1 we show distributions of historical figures over languages according to their birth place. In this case the above patterns become even more pronounced.
At a first glance from Figs. 4E, F we observe for persons born in AD 20th century a significantly more homogeneous distribution over cultures compared to early centuries. However, as noted in , each Wikipedia edition favors historical figures speaking the corresponding language. We investigate how this preference to same-language historical figures changes in time. For this analysis, we define two variables ML, C and NL, C for a given language edition L and a given century C. Here ML, C is the number of historical figures born in all countries being attributed to a given language L, and NL, C is the total number of historical figures for a given century C and a given language edition L. For example, among the 21 top PageRank historical figures from the English Wikipedia, who were born in AD 20th century, two historical figures (Pope John Paul II and Pope Benedict XVI) were not born in English speaking countries. Thus in this case NEN, 20 = 21 and MEN, 20 = 19. Fig. 5 represents the ratio rL, C = ML, C/NL, C for each edition and each century. In ancient times (i.e. before AD 5th century), most historical figures for each Wikipedia edition are not born in the same language region except for the Greek, Italian, Hebrew, and Chinese Wikipedia. However, after AD 5th century, the ratio of same language historical figures is rising. Thus, in AD 20th century, most Wikipedia editions have significant numbers of historical figures born in countries speaking the corresponding language. For PageRank persons and AD 20th century, we find that the English edition has the largest fraction of its own language, followed by Arabic and Persian editions while other editions have significantly large connections with other cultures. For the English edition this is related to a significant number of USA presidents appearing in the top 100 list (see [18, 19]). For 2DRank persons the largest fractions were found for Greek, Arabic, Chinese and Japanese cultures. These data show that even in age of globalization there is a significant dominance of local historical figures for certain cultures.
Here ML, C is the number of historical figures born in countries attributed to a given language edition L at century C and NL, C is the total number of historical figures in a given edition at a given century, regardless of language of their birth countries. Black color (-0.2 in the color bars) shows that there is no historical figure at all for a given edition and century; blue (0 in the color bars) shows there there are some historical figures but no same language historical figures. Here (A) panel shows PageRank historical figures, and (B) panel shows 2DRank historical figures.
From the gender distributions of historical figures, we observe a strong male-skewed pattern across many Wikipedia editions regardless of the ranking algorithm. On average, 5.2(10.1) female historical figures are observed among the 100 top PageRank (2DRank) persons for each Wikipedia edition. Fig. 6 shows the number of top female historical figures for each Wikipedia edition. Thai, Hindi, Swedish, and Hebrew have more female historical figures than the average over our 24 editions in the case of PageRank. On the other hand, the Greek and the Korean versions have a lower number of females than the average. In the case of 2DRank, English, Hindi, Thai, and Hungarian Wikipedia have more females than the average while German, Chinese, Korean, and Persian Wikipedia have less females than the average. In short, the top historical figures in Wikipedia are quite male-skewed. This is not surprising since females had little chance to be historical figures for most of human history. We compare the gender skewness to other cases such as the number of female editors in Wikipedia (9 percent) in 2011  and the share of women in parliaments, which was 18.7 percent in 2012 by UN Statistics and indicators on women and men , the male skewness for the PageRank list is stronger in the contents of Wikipedia . However, the ratio of females among the top historical figures is growing by time as shown in Fig. 6 C. It is notable that the peak in Fig. 6C at BC 1st is due to “Mary (mother of Jesus)”. In the 20th century 2DRank gives a larger percentage of women compared to PageRank. This is due to the fact that 2DRank has a larger fraction of singers and artists comparing to PageRank (see [18, 19]) and that the fraction of women in these fields of activity is larger.
Global historical figures
Above we analyzed how top historical figures in Wikipedia are distributed in terms of space, time, and gender. Now we identify how these top historical figures are distributed in each Wikipedia edition and which are global historical figures. According to previous research , there are some global historical figures who are recognized as important historical figures across Wikipedia editions. We identify global historical figures based on the ranking score for a given person determined by her number of appearances and ranking index over our 24 Wikipedia editions.
Following , the ranking score ΘP, A of a historical figure P is given by (3)
Here RP, E, A is the ranking of a historical figure P in Wikipedia edition E by ranking algorithm A. According to this definition, a historical figure who appears more often in the lists of top historical figures for the given 24 Wikipedia editions or has higher ranking in the lists gets a higher ranking score. Table 4 represents the top 10 global historical figures for PageRank and 2DRank. Carl Linnaeus is the 1st global historical figure by PageRank followed by Jesus, Aristotle. Adolf Hitler is the 1st global historical figure by 2DRank followed by Michael Jackson, Madonna (entertainer). On the other hand, the lists of the top 10 local historical figures ordered by our ranking score for each language are represented in supporting Tables S1–S25 and .
All names are represented by the corresponding article titles in the English Wikipedia. Here, ΘA is the ranking score of algorithm A (3); NA is the number of appearances of a given person in the top 100 rank for all editions.
The reason for a somewhat unexpected PageRank leader Carl Linnaeus is related to the fact that he laid the foundations for the modern biological naming scheme so that plenty of articles about animals, insects and plants point to the Wikipedia article about him, which strongly increases the PageRank probability. This happens for all 24 languages where Carl Linnaeus always appears on high positions since articles about animals and plants are an important fraction of Wikipedia. Even if in a given language the top persons are often politicians (e.g. Napoleon, Barak Obama at K = 1, 2 in EN), these politicians have mainly local importance and are not highly ranked in other languages (e.g. in ZH Carl Linnaeus is at K = 1, Napoleon at K = 3 and Barak Obama is at K = 24). As a result when the global contribution is counted over all 24 languages Carl Linnaeus appears on the top PageRank position.
Our analysis suggests that there might be three groups of historical figures. Fig. 7 shows these three groups of top PageRank historical figures in Wikipedia: (i) global historical figures who appear in most of Wikipedia editions (NA ≥ 18) and are highly ranked (⟨K⟩ ≤ 50) for each Wikipedia such as Carl Linnaeus, Plato, Jesus, and Napoleon (Right-Top of the Fig. 7A); (ii) local-highly ranked historical figures who appear in a few Wikipedia editions (NA < 18) but are highly ranked (⟨K⟩ ≤ 50) in the Wikipedia editions in which they appear, such as Tycho Brahe, Sejong the Great, and Sun Yat-sen (Left-Top of the Fig. 7A); (iii) locally-low ranked historical figures who appear in a few Wikipedia editions (NA < 18) and who are not highly ranked (⟨K⟩ > 50). Here NA is the number of appearances in different Wikipedia editions for a given person and ⟨K⟩ is the average ranking of the given persons across Wikipedia editions for each ranking algorithm. In the case of 2DRank historical figures, due to the absence of global historical figures, most of them belong to two types of local historical figures (i.e. local-highly ranked or local-lowly ranked).
Following ranking of persons via ΘP, A we determine also the top global female historical figures, presented in Table 5 for PageRank and 2DRank persons. The full lists of global female figures are available at  (63 and 165 names for PageRank and 2DRank).
All names are represented by article titles in the English Wikipedia. Here, ΘA is the ranking score of the algorithm A (Eq.3); NA is the number of appearances of a given person in the top 100 rank for all editions. Here CC is the birth country code and LC is the language code of the given historical figure.
The comparison of our 100 global historical figures with the top 100 from Hart’s list  gives an overlap of 43 persons for PageRank and 26 persons for 2DRank. We note that for the top 100 from the English Wikipedia we obtain a lower overlap of 37 (PageRank) and 4 (2DRank) persons. Among all editions the highest overlaps with the Hart list are 42 (VI), 37 (EN, ES, PT, TR) and 33 (IT), 32 (DE), 31 (FR) for PageRank; while for 2DRank we find 18 (EL) and 17 (VI). We give the overlap numbers for all editions at . This shows that the consideration of 24 editions provides us the global list of the top 100 persons with a more balanced selection of top historical figures. Our overlap of the top 100 global historical figures by PageRank with the top 100 people from Pantheon MIT ranking list  is 44 percent, while the overlap of this Pantheon list with Hart’s list is 43 percent. We note that the Pantheon method is significantly based on a number of page views while our approach is based on the network structure of the whole Wikipedia network. The top 100 persons from  are not publicly available but nevertheless we present the overlaps between the top 100 persons from the lists of Hart, Pantheon, Stony-Brook and our global PageRank and 2DRank lists in Figures S2, S3 (we received the Stony-Brook list as a private message from the authors of ). We have an average overlap between the 4 methods on a level of 40 percent (2DRank is on average lower by a few percent), we find a larger overlap between our PageRank list and the Stony-Brook list since the Stony-Brook method, applied only for the English Wikipedia, is significantly based on PageRank.
We also compared the distributions of our global top 100 persons of PageRank and 2DRank with the distribution of Hart’s top 100 over centuries and over 24 languages with the additional WR category (see Figure S4). We find that these 3 distributions have very similar shapes. Thus the largest number of persons appears in centuries AD 18th, 19th, 20th for the 3 distributions. Among languages, the main peaks for the 3 distributions appear for EN, DE, IT, EL, AR, ZH. The deviations from Hart’s distribution are larger for the 2DRank list. Thus the comparison of distributions over centuries and languages shows that the PageRank list has not only a strong overlap with the Hart list in the number of persons but that they also have very similar statistical distributions of the top 100 persons over centuries and languages.
The overlap of the top 100 global persons found here with the previous study  gives 54 and 47 percent for PageRank and 2DRank lists, respectively. However, we note that the global list in  was obtained from the top 30 persons in each edition while here we use the top 100 persons.
It is interesting to note that for the top 100 PageRank universities from the English Wikipedia edition the overlap with Shanghai top 100 list of universities is on a even higher level of 75 percent .
Finally, we note that the ranking of historical figures using the whole PageRank (or 2DRank) list of all Wikipedia articles of a given edition provides a more stable approach compared to the network of biographical articles used in . Indeed, the number of nodes and links in such a biographical network is significantly smaller compared to the whole network of Wikipedia articles and thus the fluctuations become rather large. For example, from the biographical network of the Russian edition one finds as the top person Napoleon III (and even not Napoleon I) , who has a rather low importance for Russia. In contrast to that the present study gives us the top PageRank historical figure of the Russian edition to be Peter the Great, that has much more historical grounds. In a similar way for FR the results of  give at the first position Adolf Hitler, that is rather strange for the French culture, while we find a natural result Napoleon.
Network of cultures
We consider the selected top persons from each Wikipedia edition as important historical figures recognized by people who speak the language of that Wikipedia edition. Therefore, if a top person from a language edition A appears in another edition B, then we can consider this as a ‘cultural’ influence from culture A to B. Here we consider each language as a proxy for a cultural group and assign each historical figure to one of these cultural groups based on the most spoken language of her/his birth place at the country level. For example, Adolf Hitler was born in modern Austria and since German language is the most spoken language in Austria, he is considered as a German historical figure in our analysis. This method may lead to some misguiding results due to discrepancy between territories of country and cultures, e.g. Jesus was born in the modern State of Palestine (Bethlehem), which is an Arabic speaking country. Thus Jesus is from the Arabic culture in our analysis while usually one would say that he belongs to the Hebrew culture. Other similar examples we find are: Charlemagne (Belgium—Dutch), Immanuel Kant (Russia—Russian, while usually he is attributed to DE), Moses (Egypt—Arabic), Catherine the Great (Poland—Polish, while usually she would be attributed to DE or RU).
In total there are such 36 cases from the global PageRank list of 1045 names (these 36 names are given in SI). However, in our knowledge, the birth place is the best way to assign a given historical figure to a certain cultural background computationally and systematically and with the data we have available. In total we have only about 3.4 percent of cases which can be discussed and where a native speaking language can be a better indicator of belonging to a given culture. For the global 2DRank list of 1616 names we identified 53 similar cases where an attribution to a culture via a native language or a birth place could be discussed (about 3.3 percent). These 53 names are given in SI. About half of such cases are linked with birth places in ancient Russian Empire where people from Belarus, Litvania and Ukraine moved to RU, IL, PL, WR. However, the percentage of such cases is small and the corresponding errors also remain small.
Based on the above assumption and following the approach developed in , we construct two weighted networks of cultures (or language groups) based on the top PageRank historical figures and top 2DRank historical figures respectively. Each culture (i.e. language) is represented as a node of the network, and the weight of a directed link from culture A to culture B is given by the number of historical figures belonging to culture B (e.g. French) appearing in the list of top 100 historical figures for a given culture A (e.g. English). The persons in a given edition, belonging to the language of the edition, are not taken into account since they do not create links between cultures. In Table 6 we give the number of such persons for each language. This table also gives the number of persons of a given language among the top 100 persons of the global PageRank and 2DRank listings.
For example, there are 5 French historical figures among the top 100 PageRank historical figures of the English Wikipedia, so we can assign weight 5 to the link from English to French. Fig. 8A and Fig. 8B represent the constructed networks of cultures defined by appearances of the top PageRank historical figures and top 2DRank historical figures, respectively. In total we have two networks with 25 nodes which include our 24 editions and an additional node WR for all the other world cultures.
The link width and darkness are proportional to a number of foreign historical figures quoted in top 100 of a given culture, the link direction goes from a given culture to cultures of quoted foreign historical figures, links inside cultures are not considered. The size of nodes is proportional to their PageRank.
The Google matrix Gij for each network is constructed following the standard rules described in  and in the Methods Section. In a standard way we determine the PageRank index K and the CheiRank index K* that order all cultures according to decreasing PageRank and CheiRank probabilities (see Methods and Figure S5). The structure of matrix elements GKK′ is shown in Fig. 9.
The matrix elements Gij are shown by color with damping factor α = 0.85.
To identify which cultures (or language groups) are more influential than others, we calculated PageRank and CheiRank of the constructed networks of cultures by considering link weights. Briefly speaking, a culture has high PageRank (CheiRank) if it has many ingoing (outgoing) links from (to) other cultures (see Methods). The distribution of cultures on a PageRank-CheiRank plane is shown in Fig. 10. In both cases of PageRank and 2DRank historical figures, historical figures of English culture (i.e. born in English language spoken countries) are the most influential (highest PageRank) and German culture is the second one (Fig. 10A, B). Here we consider the historical figures for the whole range of centuries. Fig. 10 represents the detailed features of how each culture is located on the plane of PageRank ranking K and CheiRank ranking K* based on the top PageRank historical figures (Fig. 10A) and top 2DRank historical figures (Fig. 10B). Here K indicates the ranking of a given culture ordered by how many of its own top historical figures appear in other Wikipedia editions, and K* indicates the ranking of a given culture according to how many of the top historical figures in the considered culture are from other cultures. As described above, English is on (K = 1, K* = 19) and German is on (K = 2, K* = 21) in the case of PageRank historical figures (Fig. 10A). In the case of 2DRank historical figures, English is on (K = 1, K* = 14) and German is on (K = 2, K* = 9).
It is important to note that there is a significant difference compared to the previous study : there, only 9 editions had been considered and the top positions were attributed to the world node WR which captured a significant fraction of the top persons. This indicated that 9 editions are not sufficient to cover the whole world. Now for 24 editions we see that the importance of the world node WR is much lower (it moves from K = 1 for 9 editions  to K = 4 and 3 in Fig. 10A and Fig. 10B). Thus our 24 editions cover the majority the world. Still it would be desirable to add a few additional editions (e.g. Ukraine, Baltic Republics, Serbia etc.) to fill certain gaps.
It is interesting to note that the ranking plane of cultures (K, K*) changes significantly in time. Indeed, if we take into account only persons born before the 19th century then the ranking is modified with EN going to 4th (Fig. 10C for PageRank figures) and 6th position (Fig. 10C for 2DRank figures) while the top positions are taken by IT, DE, FR and DE, IT, AR, respectively.
At the same time, we may also argue that for cultures it is important not only to be cited but also to be communicative with other cultures. To characterize communicative properties of nodes on the network of cultures shown in Fig. 8 we use again the concepts of PageRank, CheiRank and 2DRank for these networks as described in Methods and . Thus, for the network of cultures of Fig. 8, the 2DRank index of cultures highlights their influence in a more balanced way taking into account their importance (incoming links) and communicative (outgoing links) properties in a balanced manner.
Thus we find for all centuries at the top positions Greek, Turkish and Arabic (for PageRank persons) and French, Russian and Arabic (for 2DRank persons). For historical figures before the 19th century, we find respectively Arabic, Turkish and Greek (for PageRank) and Arabic, Greek and Hebrew (for 2DRank). The high position of Turkish is due to its close links both with Greek culture in ancient times and with Arabic culture in more recent times. We see also that with time the positions of Greek in 2DRank improves due to a global improved ranking of Western cultures closely connected with Greece.
By investigating birth place, birth date, and gender of important historical figures determined by the network structure of Wikipedia, we identified spatial, temporal, and gender skewness in Wikipedia. Our analysis shows that the most important historical figures across Wikipedia language editions were born in Western countries after the 17th century, and are male. Also, each Wikipedia edition highlights local figures so that most of its own historical figures are born in the countries which use the language of the edition. The emergence of such pronounced accent to local figures seems to be natural since there are more links and interactions within one culture. This is also visible from to the fact that in many editions the main country for the given language is at the first PageRank position among all articles (e.g. Russia in RU edition) . Despite such a locality feature, there are also global historical figures who appear in most of the considered Wikipedia editions with very high rankings. Based on the cross-cultural historical figures, who appear in multiple editions, we can construct a network of cultures which describes interactions and entanglement between cultures.
It is very difficult to describe history in an objective way and due to that it was argued that history is “an unending dialogue between the past and present” . In a similar way we can say that history is an unending dialogue between different cultural groups.
We use a computational and data mining approach, based on rank vectors of the Google matrix of Wikipedia, to perform a statistical analysis of interactions and entanglement of cultures. We find that this approach can be used for selecting the most influential historical figures through an analysis of collectively generated links between articles on Wikipedia. Our results are coherent with studies conducted by historians , with an overlap of 43% of important historical figures. Thus, such a mathematical analysis of local and global historical figures can be a useful step towards the understanding of local and global history and interactions of world cultures. Our approach has some limitations, mainly caused by the data source and by the difficulty of defining culture boundaries across centuries. The ongoing improvement of structured content in Wikipedia through the WikiData project, eventually in conjunction with additional manual annotation, should allow to deal with these limitations. Furthermore, it would be useful to perform comparisons with other approaches to measure the interactions of cultures, such as the analysis of language crossings of multilingual users .
Influence of digital media on information dissemination and social collective opinions among the public is growing fast. Our research across Wikipedia language editions suggests a rigorous mathematical way, based on Markov chains and Google matrix, for the identification of important historical figures and for the analysis of interactions of cultures at different historical periods and in different world regions. We think that a further extension of this approach to a larger number of Wikipedia editions will provide a more detailed and balanced analysis of interactions of world cultures.
S1 File. Supporting Information file S1 presents Figures S1–S5 with additional information discussed above in the main part of the paper, lists of top 100 global PageRank and 2DRank names; Tables S1–S25 of top 10 names of given language and remained world from the global PageRank and 2DRank ranking lists of persons ordered by the score ΘP, A of Eq.(3).
For a reader convenience the lists of all 100 ranked names for all 24 Wikipedia editions and corresponding network link data for each edition are also given at  in addition to Supporting Information file. All used computational data are publicly available at http://dumps.wikimedia.org/. All the raw data necessary to replicate the findings and conclusion of this study are within the paper, supporting information files and this Wikimedia web site.
This research is supported in part by the EC FET Open project “New tools and algorithms for directed network analysis” (NADINE $No$ 288956)
Conceived and designed the experiments: YHE DLS. Performed the experiments: YHE PA DL AK SV. Analyzed the data: YHE PA DLS. Contributed reagents/materials/analysis tools: YHE PA DL AK SV. Wrote the paper: YHE DLS.
- 1. Rosenzweig R (2006) Can history be open source? Wikipedia and the future and the past, Journal of American History 93(1): 117
- 2. Lavsa SM, Corman SL, Culley CM, Pummer TL (2011) Reliability of Wikipedia as a medication information source for pharmacy students, Currents in Pharmacy Teaching and Learning 3(2): 154–158
- 3. Giles J (2005) Internet encylopedia go head to head, Nature, 438: 900 pmid:16355180
- 4. Kittur A, Chi EH, Suh B (2009) What’s in Wikipedia?: mapping topics and conflict using socially annotated category structure, In Proc. of SIGCHI Conference on Human Factors in Computing Systems, CHI’09, ACM, New York
- 5. Priedhorsky R, Chen J, Lam STK, Panciera K, Terveen L et al. (2007). Creating, Destroying, and Restoring Value in Wikipedia, In Proceedings of the Intl. Conf. on Supporting Group Work, 295, ACM, New York
- 6. Yasseri T, Sumi R, Rung A, Kornai A, Kertész J (2012) Dynamics of Conflicts in Wikipedia, PLoS ONE 7(6): e38869 pmid:22745683
- 7. Yasseri T, Spoerri A, Graham M, Kertész J (2013) The most controversial topics in Wikipedia: a multilingual and geographical analysis arXiv:1305.5566 [physics.soc-ph]
- 8. Laniado D, Tasso R, Volkovich Y. Kaltenbrunner A (2011) When the wikipedians talk: Network and tree structure of Wikipedia discussion pages, Proc. ICWSM 2011: 177–184
- 9. UNESCO World Report (2009) Investing in cultural diversity and intercultural dialogue, Available: http://www.unesco.org/new/en/culture/resources/report/the-unesco-world-report-on-cultural-diversity
- 10. Wikipedia: Neutral point of view. Retrived May 12, 2014 from http://en.wikipedia.org/wiki/Wikipedia:Neutral_point_of_view
- 11. Pfeil U, Zaphiris P, Ang C A, (2006) Cultural Differences in Collaborative Authoring of Wikipedia, J. Computer-Mediated Comm. 12(1): 88
- 12. Callahan ES, Herriing SC (2011) Cultural bias in Wikipedia content on famous persons, Journal of the American society for information science and technology 62: 1899
- 13. Hecht B, Gergle D (2009) Measuring self-focus bias in community-maintained knowledge repositories, Proc. of the Fourth Intl Conf. Communities and technologies, ACM, New York 2009: 11
- 14. Hecht B, Gergle D (2010) The Tower of Babel Meets Web 2.0: User-Generated Content and Its Applications in a Multilingual Context, Proc. of SIGCHI Conference on Human Factors in Computing Systems, CHI’10, Atlanta, ACM, New York 291–300p
- 15. Nemoto K, Gloor PA (2011) Analyzing cultural differences in collaborative innovation networks by analyzing editing behavior in different-language Wikipedias, Procedia—Social and Behavioral Sciences 26: 180
- 16. Warncke-Wang M, Uduwage A, Dong Z, Riedl J (2012) In search of the ur-Wikipedia: universality, similarity, and translation in the Wikipedia inter-language link network, Proceedings of the 8th Intl. Symposium on Wikis and Open Collaboration (WikiSym 2012), ACM, New York
- 17. Massa P, Scrinzi F (2012) Manypedia: Comparing language points of view of Wikipedia communities, Proceedings of the 8th Intl. Symposium on Wikis and Open Collaboration (WikiSym 2012), ACM, New York
- 18. Zhirov AO, Zhirov OV, Shepelyansky DL (2010) Two-dimensional ranking of Wikipedia articles, Eur. Phys. J. B 77: 523
- 19. Eom YH, Frahm KM, Bencźur A, Shepelyansky DL (2013) Time evolution of Wikipedia network ranking, Eur. Phys. J. B, 86:482
- 20. Aragón P, Laniado D, Kaltenbrunner A, Volkovich Y (2012) Biographical social networks on Wikipedia: a cross-cultural study of links that made history, Proc. of the 8th Intl. Symposium on Wikis and Open Collaboration (WikiSym 2012), ACM, New York No. 19
- 21. Eom YH, Shepelyansky DL (2013) Highlighting Entanglement of Cultures via Ranking of Multilingual Wikipedia Articles, PLoS ONE, 8(10): e74554 pmid:24098338
- 22. Skiena S, Ward CB (2013) Who is Bigger?: Where Historical Figures Really Rank, Cambridge University Press, Cambridge UK
- 23. MIT Pantheon project. Available: http://pantheon.media.mit.edu. Accessed 2014 May 12.
- 24. Samoilenko A, Yasseri T (2014) The distorted mirror of Wikipedia: a quantitative analysis of Wikipedia coverage of academics, EPJ Data Sci. 3: 1
- 25. Wikipedia: List of languages by number of native speakers. Retrived May 12, 2014 from http://en.wikipedia.org/wiki/List_of_languages_by_number_of_native_speakers
- 26. Wikipedia: Wikipedia. Retrived May 12, 2014 from http://en.wikipedia.org/wiki/Wikipedia
- 27. Hart MH (1992) The 100: ranking of the most influential persons in history, Citadel Press, N.Y.
- 28. Ermann L, Chepelianskii AD, Shepelyansky DL (2012) Toward two-dimensional search engines, J. Phys. A: Math. Theor. 45: 275101
- 29. Ermann L, Frahm KM, Shepelyansky DL (2013) Spectral properties of Google matrix of Wikipedia and other networks, Eur. Phys. J. D 86: 193
- 30. Langville AM, Meyer CD (2006) Google’s PageRank and Beyond: The Science of Search Engine Rankings, Princeton University Press, Princeton
- 31. Brin S, Page L (1998) The anatomy of a large-scale hypertextual Web search engine, Computer Networks and ISDN Systems 30: 107
- 32. Chen P, Xie H, Maslov S, Redner S (2007) Finding scientific gems with Googleś PageRank algorithm, Jour. Informetrics, 1: 8
- 33. Kwak H, Lee C, Park H, Moon S (2010) What is Twitter, a social network or a news media?, Proc. 19th Int. Conf. WWW2010, ACM, New York 591p
- 34. Ermann L, Shepelyansky DL (2011) Google matrix of the world trade network, Acta Physica Polonica A 120(6A), A158
- 35. Kandiah V, Shepelyansky DL (2013) Google matrix analysis of DNA sequences, PLoS ONE 8(5): e61519 pmid:23671568
- 36. Chepelianskii AD (2010) Towards physical laws for software architecture, arXiv:1003.5455 [cs.SE]
- 37. Lü L, Zhang Y-C, Yeung CH, Zhou T (2011) Leaders in social networks, the delicious case, PLoS ONE 6(6): e21202 pmid:21738620
- 38. http://dbpedia.org. Accessed 2014 May 12
- 39. Top wikipeople. Available: http://www.quantware.ups-tlse.fr/QWLIB/topwikipeople/. Accessed 2014 May 12.
- 40. United States Census Bureau. Retrieved May 12, 2014 from http://www.census.gov/population/international/data/worldpop/table_history.php
- 41. Wikipedia: Wikipedians. Retrived May 12, 2014 from http://en.wikipedia.org/wiki/Wikipedia:Wikipedians
- 42. Statistics and indicators on women and men by United Nation. http://unstats.un.org/unsd/Demographic/products/indwm/ (accesible May 12, 2014)
- 43. Lam STK, Uduwage A, Dong Z, Sen S (2011) WP:clubhouse?: an exploration of Wikipedia’s gender imbalance, Proc. of the 7th Intl. Symposium on Wikis and Open Collaboration, WikiSym’11, Moutain View 1–10p
- 44. Carr EH (1961) What is History?, Vintage Books, New York
- 45. Hale SA (2014) Multilinguals and Wikipedia editing, Proc. 6th Annual ACM Web Science Conf. ACM New York 1, 99