Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Virtual World Currency Value Fluctuation Prediction System Based on User Sentiment Analysis

  • Young Bin Kim,

    Affiliation Interdisciplinary Program in Visual Information Processing, Korea University, Seoul, Korea

  • Sang Hyeok Lee,

    Affiliation Department of Computer and Radio Communications Engineering, Korea University, Seoul, Korea

  • Shin Jin Kang,

    Affiliation School of Games, Hongik University, Seoul, Korea

  • Myung Jin Choi,

    Affiliation Department of Computer and Radio Communications Engineering, Korea University, Seoul, Korea

  • Jung Lee,

    Affiliation Department of Computer and Radio Communications Engineering, Korea University, Seoul, Korea

  • Chang Hun Kim

    chkim@korea.ac.kr

    Affiliation Department of Computer and Radio Communications Engineering, Korea University, Seoul, Korea

Abstract

In this paper, we present a method for predicting the value of virtual currencies used in virtual gaming environments that support multiple users, such as massively multiplayer online role-playing games (MMORPGs). Predicting virtual currency values in a virtual gaming environment has rarely been explored; it is difficult to apply real-world methods for predicting fluctuating currency values or shares to the virtual gaming world on account of differences in domains between the two worlds. To address this issue, we herein predict virtual currency value fluctuations by collecting user opinion data from a virtual community and analyzing user sentiments or emotions from the opinion data. The proposed method is straightforward and applicable to predicting virtual currencies as well as to gaming environments, including MMORPGs. We test the proposed method using large-scale MMORPGs and demonstrate that virtual currencies can be effectively and efficiently predicted with it.

Introduction

Virtual economies have emerged through interactions among users in virtual worlds. A virtual economy is primarily intended to foster users’ increased enjoyment of the virtual environment. In some cases, the virtual economy lends itself to real economic purposes [1, 2]. Virtual economies have been evident in virtual reality social services or generally in multiplayer virtual reality games in which multiple users interact with one another. For example, in the virtual world of Second Life, a virtual currency called Linden Dollars is used. This currency is used within the virtual environment for buying and selling of houses, clothes, and other items made by users. In the gaming environment of World of Warcraft, which is a massively multiplayer online role-playing game (MMORPG), the virtual currency referred to as Gold is used to buy items for gaming and for other transactions among users.

In addition, the trend of exchanging real money for virtual currencies has been increasing [3]. Several users in Second Life have been trading Linden Dollars for real money or the Bitcoin virtual currency [4]. On eBay, some users have been selling for cash the virtual currencies used in MMORPGs, such as World of Warcraft and EVE Online. The percentage of such users has been steadily growing [5, 6]. Moreover, the size of this market has been increasing and is expected to grow further [4]. In this context, diverse research on the relevant market is underway [1, 3, 511]. Nevertheless, previous studies primarily focus on the market formed by virtual currencies with minimal consideration of the values of virtual currencies used in the market. Hence, a means of predicting the values of virtual currencies and acquiring insights into general market trends is needed.

Many studies have been conducted for real economic purposes. Particularly, studies on stock price prediction techniques date to the beginnings of stock trading [1218]. Since then, some researchers have predicted stock prices based on neural networks [12, 14], while others have applied learning through support vector machines (SVMs) [15]. Data used for predictions is predominantly grounded in financial news [13, 17]. Recently, web-based data has been used to analyze the stock market [16, 18]. Bollen et al. [16] analyzed tweets on Twitter to deduce the mood of users and to thereby predict the stock market. Nevertheless, few studies have evaluated and predicted virtual market trends. Numerous users have engaged in virtual currency transactions and have formed a large market; therefore, predicting the values of virtual currencies has proved to be increasingly important in connection with transactions of real goods. Predicting the values of virtual currencies can help traders engage in rational transactions, while enabling developers who control virtual worlds to identify and rectify the problems of the respective virtual economies [19, 20].

The virtual world is gradually expanding and becoming increasingly more complex. The existence of big data from such an environment can be used for research on social theories in large-scale virtual populations [21, 22] from different perspectives [2327]. Research on the structure and dynamic evolution of social networks in virtual worlds has been based on various methods and produced significant results [2833]. Our present objective is based on the assumption that the virtual currency used among users in mutual interactions fluctuates. In our study, we reference the properties of virtual worlds as well as data on the voluntarily provided opinions of the users.

Analysis of online user opinion data has been underway in many fields. Users express their opinions and sentiments and review products in online social networks [3436]. Thus, user data has become a valuable resource for research [3437]. Recently, real-time user data on Twitter has been used to predict events, such as earthquakes [38, 39]. Many researchers refer to Twitter as well as to social networking sites, such as Facebook and LinkedIn [40, 41]. In addition, deducing the emotions or sentiments from postings on social networking sites has been valuable in many aspects [4246]. For example, some researchers have developed and used common sentiment lexicons for analyzing general emotions [47, 48], while others have employed target-specific approaches to film blogs or wine reviews for sentiment analysis or opinion mining [49, 50]. Users’ reactions and comments on social networking sites serve as significant indicators of the users’ momentary sentiments, thereby exerting significant effects on virtual environments [51]. In various online communities, including social networking sites, discussions of virtual worlds and the revealing of users’ states of mind have been evident [35, 52].

In this paper, we analyze user sentiments in popular virtual communities on the Internet to predict the fluctuations and values of virtual currencies. The proposed method for analyzing online communities is based on the Bollen et al. [16] analysis of tweets on Twitter to deduce the mood of users and to thereby predict the stock market. Datasets are selected for a virtual environment or larger virtual world. Moreover, the proposed sentiment analysis model is not dependent on a specific market as conventional models are; rather, it is easy to use and fits the features of a virtual world.

Virtual currencies in virtual worlds, such as those in online gaming, differ from real money because the former operate on a specific economic system that supports an environment for perfect market competition [53]. In such a system, multiple producers and consumers exist, while consumers do not affect price fluctuations—considering that all items are replaceable, no limitations exist in altering the production of goods, all economic subjects have perfect information, and no asymmetry of information exists [54]. Accordingly, fewer variables for currency value fluctuations exist compared to a real currency system; value fluctuations are clear and intuitive. Thus, instead of an integrated collection of data, selecting datasets from the most prominent online community in a virtual world facilitates more accurate prediction of currency value fluctuations. Furthermore, most suppliers and consumers of virtual currencies are not rational profit maximizers; instead, they are sentimental/emotional game players seeking enjoyment, and analysis of their sentiments is therefore important. The proposed method is designed to meet the characteristics of virtual worlds. It efficiently predicts virtual currencies with a simple sentiment analysis model and narrow data extraction.

The proposed method is general and thus applicable to predicting a range of virtual currencies. The proposed system is basically divided into two parts: learning and evaluation. First, for the learning stage, community data that is relevant to the virtual world under analysis is crawled and classified based on dates. Next, based on user reactions that are collected daily, the sentiment analysis is performed. From that point, machine learning is performed by connecting users’ states of mind (sentiments), numbers of postings, and positive reactions to postings on a specific date with virtual currency fluctuations. In the evaluation stage, the values of the virtual currencies are predicted based on the model learned in the previous stage. This method is proven to predict the values of currencies used in several virtual worlds.

Methods

System Overview

The proposed system is comprised of two basic parts, as mentioned above. One part involves learning the rise or fall of currencies based on user data from social networks or communities. The other part involves an evaluation based on the user data and learned model (see Fig 1).

The system learning component follows the steps below to generate the learning model.

  1. Crawl user opinion data that is relevant to the virtual world for analysis of a given period of time.
  2. Analyze user sentiments based on the obtained user opinion data.
  3. The Granger causality test is based on the preselection of sentiments that are highly relevant to value fluctuation.
  4. Perform learning based on the obtained opinion data with the evaluation of user sentiments and virtual currency fluctuation data.

The system evaluation component follows the steps below to predict virtual currency value fluctuations and to evaluate the model.

  1. Crawl user opinion data that is relevant to the virtual world for use in the evaluation.
  2. Analyze user sentiments based on the obtained user opinion data.
  3. Evaluate the precision of forecasting the following day’s virtual currency fluctuations based on the learning model constructed in the learning part.

In the next section, the data and algorithm used in each of the two system components are described.

Data Crawling and Refinement

Any data that is randomly extracted from the virtual world of interest is minimally significant. Therefore, it is necessary to sort the data for collection. For the opinion data, a community with the largest number of daily discussion postings is chosen from online communities associated with the given virtual world. For the market data, a service for collecting the values of virtual worlds and providing the statistics is chosen. To ensure the precision of the market data itself, the data should come from the internal systems of the respective virtual worlds (auction houses or bazaars) or from any sellers dealing in virtual currencies in actual cash. The data chosen for the present study fulfills these two conditions.

Crawling is intended to collect user opinions. Here, an HTML crawler is customized for the web structures of the given online community and the service that provides the market data; it extracts user opinion data for each set period. The extracted opinions and market data are grouped into sets based on the period of choice (normally a 24-hour period). As per the sets, the topics, contents, points of time for posting, comment counts, and view counts of the opinion data are saved. The current market value and fluctuation compared with those of the previous day are saved as the market data.

Upon completion of crawling, the collected data requires refinements because it still contains considerable garbage or redundant information and is not sufficiently uniform. To delete the garbage or redundant data, many spam filtering techniques have been explored [5559]. Here, any opinion data with more than three repetitions of content per day is handled as garbage. In addition, comment and view counts for a topic are normalized with the counts of discussion postings on the same day.

Sentiment Analysis of User Opinion Data

The collected user opinion data is used for sentiment analysis. First, user opinion data is extracted based on the significant parts of speech. To this end, in English-speaking regions, the Stanford Parser [60] is used to extract the part of speech for each word, whereas the tools of Monroe et al. [61], and Tseng et al. [62] or Chang et al. [63], are used in Arabic- and Chinese-speaking worlds, respectively, to extract words of desired parts of speech. To note, parsers vary with the language used for data extraction. Here, to analyze the parts of speech in English sentences, the Stanford Log-linear Part-Of-Speech Tagger [64] is used to sort out words of significant parts of speech—i.e., verbs, adjectives, and adverbs—for sentiment analysis. The words of these parts of speech are saved for sentiment analysis. Modifiers, nouns, and postpositions that enrich the meaning of a sentence are not sorted out because they are most likely neutral words; accordingly, this approach provides the precision of analysis. Moreover, sentences in Internet community postings are often marked by incorrect punctuation, spelling, or word order. Thus, including too many parts of speech in the analysis can cause adverse effects and consequently obscure the real meanings of sentences.

In this paper, we present a straightforward method for sentiment analysis. Human emotions are too complicated to sort out. Hence, Plutchik’s research on human emotions [65] is used. Specifically, the Plutchik wheel of emotions [65] used here is a reasonable model that represents combinations of solid, relative, and complementary aspects of human emotions. Eight primary emotions—joy, trust, fear, surprise, sadness, disgust, anger, and anticipation—are applied as the criteria for the present analysis. The wheel of emotions is employed as criteria because it is composed of four pairs of ambivalent emotions with contrary concepts; moreover, the combinations of these eight emotions can help deduce more complicated emotions. In other words, instead of a dichotomic analysis of emotions as positive or negative ones, it is possible to build a profound and scalable model for sentiment analysis. Plutchik’s model has been used for sentiment analysis [66, 67], artificial neural networks [68], decision making models [69], and multi-modal convergence [70].

In terms of the criteria for parts of speech and emotions, a search engine is used for the sentiment analysis. The sentiment analysis consists of four phases in total. In the first phase, the opinion data (Opi) are split into words using the part-of-speech tagger [64]; each word is matched to an appropriate part of speech (Pos). When a word’s part of speech corresponds to ‘a desired part of speech (Pos: verb, adjective and adverb defined above),’ the word is transferred to the second phase. In the second phase, the target word that has passed the first phase undergoes a search query together with ‘emotive words (Emo: eight emotions above defined).’ For example, if the target word is ‘greedy’ and the emotive word is ‘joy,’ the query becomes ‘greedy joy.’ To compare each word with the eight emotive words, a total of eight queries are performed. In the third phase, the findings from the query analysis are used to yield a ‘Word_R,’ which is a set of relevance figures between the target and emotive words. Word_R is defined as the mean of minimum values of numbers of blanks between the target word and emotive word within the result pages.

In the fourth phase, the Word_Rs representing the relevance between the target and emotive words collectively comprise the ‘Sentence_R’ set, which represents the relations between a given sentence and its emotive words. Among the eight emotion values stored in Sentence_R, emotion, which has the smallest value, is defined as the primary emotion of the opinion data. This is because the defined emotion values—the mean distance between the target word and emotion word—are highly associated if the emotion value decreases. If the number of blanks is zero in all eight emotions, the opinion data is defined as ‘neutral.’ If this type of four-phase emotion analysis is completed, the major emotions of the target opinion data can be designated as one of nine emotions. Fig 2 summarizes this process.

thumbnail
Fig 2. Algorithm of the search engine sentiment analysis method.

https://doi.org/10.1371/journal.pone.0132944.g002

The strength of the proposed sentiment analysis method using search engines is that it is optimized for mood analysis in multiple virtual worlds. Users in virtual world communities can share their current opinions online; therefore, the collection of countless online documents by search engines provides an efficient means of viewing the statuses of virtual worlds. Indeed, notices of virtual world developers, updates, user information sharing, and socializing are all online and can be collected by search engines. The present analysis of documents found by search engines enables a simple numeric analysis of emotions. Furthermore, a sentiment lexicon can be implemented by repeating the aforementioned process while saving data.

Use of search engines for sentiment analysis minimally differs from that of ordinary search engines. That is, the relevance between the search terms and emotive words is analyzed by combining these words and sending a query to obtain the search results. Hence, it is possible to freely analyze the relevance between countless topics and emotions with nothing but word combinations in queries. It is additionally possible to extract sentiment data for specific topics by adding search words, and to use search engines for general purposes in diverse languages by simply using different languages in the queries (see the sentiment analysis example in Table 1).

To compare the mutual interactions between the sentimental analysis results and events happening in the virtual world, we normalized values to z-scores on the basis of a local mean and standard deviation to the degree of the sliding window of k days before and after a particular date. Such normalization was established so that all time series fluctuate around a zero mean and are expressed on a scale of one standard deviation. We executed sentimental analysis for the month-long data throughout December 2014 for the EVE Online community[71] and normalized the result value as a z-score. We examined the relevance with the date when the actual update occurred. We identified the occurrence of general sentiment changes in the community for events that occurred in the virtual world, such as game update notices, major updates, and virtual world server-down notifications (see Fig 3.).

thumbnail
Fig 3. Tracking emotional relevance with the EVE Online actual update.

https://doi.org/10.1371/journal.pone.0132944.g003

Configuration and Evaluation of the Prediction Model via Support Vector Machine Learning.

User sentiment values change in significance according to the occurrence of particular events. However, the association between the sentiment values and market value fluctuation must be observed; moreover, appropriate emotions must be used in the prediction model to produce positive results. We therefore applied the econometric technique of Granger causality analysis [72]. In this paper, the daily time series produced by sentiment analysis was normalized to the z-score. In addition, linear interpolation was executed so there would be no day for which the market value was missing in terms of the virtual world currency value. Moreover, a different market value on the previous day was normalized to the z-score for executing the Granger causality test. We did not test the actual causation; rather, we examined whether one time series had predictive information about the other.

Data in Tables 24 and Fig 4 enable the Granger causality test results to be compared across virtual worlds. We identified differences in high sentiments for virtual currencies and Granger causality results across virtual worlds. This approach was based on the study in [73], which preselected data groups with high causality for learning while excluding the data group with a small amount of causality. That study utilized the Granger causality test to execute learning based on sentiment data that displays high causality.

thumbnail
Fig 4. Bottom graph shows the overlap of z-scores of price fluctuation and emotion data.

https://doi.org/10.1371/journal.pone.0132944.g004

thumbnail
Table 2. Statistical significance (p-values) of bivariate Granger causality correlation for the Bitcoin experiment.

https://doi.org/10.1371/journal.pone.0132944.t002

thumbnail
Table 3. Statistical significance (p-values) of bivariate Granger causality correlation for the EVE Online experiment.

https://doi.org/10.1371/journal.pone.0132944.t003

thumbnail
Table 4. Statistical significance (p-values) of bivariate Granger causality correlation for the World of Warcraft experiment.

https://doi.org/10.1371/journal.pone.0132944.t004

The machine learning performed in this study is based on the aforementioned database. For the machine learning, it is necessary to sort out date-specific user sentiment data sets. The following are used as input data: each emotion value of the data-specific opinion data previously obtained and the respective number of user posts, inquiries, and comments. In the case of emotion values, as the formula (1), normalized emotion values to z-scores are used on the basis of a mean and standard deviation. In certain date t, z-score of emotion data , denoted , is defined as: (1) where and represent the mean and standard deviation of the emotion data for every date. In terms of the respective numbers of user posts, inquiries, and comments, the absolute values are not used as they currently exist; rather, the number of posts on the previous day, number of inquiries, and the relative change value from the number of comments are used. This is simply compared with the number of posts, inquiries, and comments on the previous day to obtain the variance value. An example of applicable input data is shown in Table 5.

With regard to the classification value for learning, the fluctuation in the market price is used for predicting the market price. Compared to the market price data on the previous day, the price data are divided into two classes: one for when the market price increases; the other for when the market price decreases. It is then used as the classification value. The relation between the input data and fluctuation in the market price is sometimes immediately influential; at other times, it is influential after a specific amount of time has passed. In this study, we therefore create models at intervals from one day through seven days in terms of the relation between the input data and market price fluctuation. In case of the emotion value, the number of posts relating to the nine emotions is divided by the total number of posts for sentiments with high causality.

Through the Granger causality test conducted above, we determined that the lag with a high relevance with sentiment data and the market value is between one to seven days. Instead of trying to make assumptions by searching for one accurate model, we strived to execute learning or dates with a high relevance and to confirm the result. Therefore, we selected a model that shows good results among those seven models; discovery of the exact point of such a relation is not the focus. The differences among the results from using the applicable model are discussed in the next section. Moreover, the SVM [74], used for learning and evaluation, is adapted for the present system using a Library for Support Vector Machines (LIBSVM) [75].

Upon completion of the model through learning for evaluating the virtual currency fluctuations based on current user opinion data, the virtual currency fluctuations are predicted using the model. In the following section, we present our analysis of the currencies in existing virtual worlds and application of several methods for evaluation. Accordingly, we account for how the system predicts the results.

Results

Experimental Design

We performed the experiment in two ways. First, the proposed method was applied to two well-known virtual currencies for games to predict their values based on real money. Second, the value of Bitcoin, which is a major virtual currency used in everyday life, is predicted in values of real money.

The experimental process was the same as the system process described earlier. First, each virtual world’s opinion data and market data were collected. Then, the sentiment analysis using search engines was performed with the opinion data. The analysis findings were gathered to generate a learning model using the SVM based on the fluctuating market prices of gaming currencies traded in cash. From that point, the prediction system was validated.

In the first experiment, virtual currencies used in two MMORPGs—EVE Online, released in 2002 by CCP Games, and World of Warcraft, released in 2004 by Blizzard Entertainment—were selected for the target currencies for analysis. Both games are popular and have large-scale virtual economies, which many researchers have used for analyzing virtual economies in the gaming world [5, 6]. Of all MMORPGs and virtual worlds, World of Warcraft has the largest subscriber base (more than 10 million) as of November 2014 [76]. Of virtual currency fluctuations, both games show the largest scales; therefore, in this study, we predict the values of virtual currencies in these games.

The other experiment that we conducted addressed the prediction of fluctuations of Bitcoin. This virtual currency is comparable to those analyzed herein; however, it is not used in virtual worlds. Consequently, it is more relevant to real currencies than to virtual gaming currencies. The cash transaction market for Bitcoin outweighs that for World of Warcraft. Here, we applied to Bitcoin the same algorithm that we applied to Virtual World currencies for prediction. It was assumed that Bitcoin is significant for analysis because transactions with actual money are more frequent than those with virtual money within a game. Table 6 outlines the arrangement of market data and opinion data that were gathered.

Experiment 1: EVE Online.

The virtual currency unit in EVE Online is called InterStellar Kredit (ISK). The cash transaction of virtual money is based on 2,000,000,000 ISK. In this study, we intended to predict changes in the market price of cash against the applicable reference amount. In the US, many cash transaction services exist for trading ISK currency in US dollars (USD). For data crawling, a tool for integrating and observing those services [77] is used. Specifically, the market prices of ISK from July 22, 2014 through January 22, 2015 (77 data items at an interval of 1~3 days) were analyzed. To collect and analyze opinion data, crawling was performed in the official game forum for EVE Online provided by CPP Games. That is, the forum had 4,587 postings on all discussion topics for 184 days from July 22, 2014 through January 22, 2015. In addition, each topic’s title, posted dates, comment counts, and view counts were likewise saved. We performed the search-engine sentiment analysis, learning, and testing on the crawled opinion data. The result of the Granger casualty test was followed as the relevant virtual world learning that applied sadness and anticipation. The topic examples of the relevant sentiments are as follows in Table 7.

thumbnail
Table 7. Sentiment analysis example of EVE Online community.

https://doi.org/10.1371/journal.pone.0132944.t007

Using the model created above, fluctuation value for 183 days was verified through ten-fold cross-validation (see the results in Table 8; the most accurate model is indicated in bold). To verify the model, the time gap between the opinion data and market price data was set with five combinations from the third day to the seventh day. Given the prediction of fluctuation based on the applicable model, the predictive weighted average precision when the time gap was four days with the anticipation mood was 77.6%, which was the highest value.

thumbnail
Table 8. Weighted average precision for EVE Online fluctuation prediction (%).

https://doi.org/10.1371/journal.pone.0132944.t008

Experiment 2: World of Warcraft.

In World of Warcraft, the virtual gaming currency units are called Gold, Silver, and Copper. Gold is the most valuable unit and is traded in cash. A typical Gold cash transaction is based on 50,000 Gold units. As in the EVE Online experiment, we employed a tool [77] for market data crawling. The collected data was the market prices of Gold from July 22, 2014 through January 19, 2015 (74 data items at an interval of 1~3 days). To collect and analyze the opinion data, Blizzard Entertainment’s official game forum [78] was used for crawling. The forum had a total of 115,035 postings on all discussion topics from July 22, 2014 through January 19, 2015 (181 days). In addition, each topic’s title, posted date, comment counts, and view counts were saved. We performed search-engine sentiment analysis, learning, and an evaluation of the crawled opinion data. The result of the Granger casualty test was followed as the relevant virtual world learning applied joy, sadness, and anticipation. The topic examples of the relevant sentiments are as follows in Table 9.

thumbnail
Table 9. Sentiment analysis example of World of Warcraft community.

https://doi.org/10.1371/journal.pone.0132944.t009

By using the created model, 181 days of market fluctuation data was examined through ten-fold cross-validation (see the results in Table 10; the most accurate model is indicated in bold). Opinion data and market price data were combined based on the time gap. To verify the model, five combinations from the first day to the fifth day were made. As a result, given the prediction of fluctuation based on the applicable model, the weighted average precision when the time gap was two days with the anticipation mood was 69.1%, which was the highest value.

thumbnail
Table 10. Weighted average precision for World of Warcraft fluctuation prediction (%).

https://doi.org/10.1371/journal.pone.0132944.t010

The other experiment that we conducted addressed the prediction of fluctuations of Bitcoin. This virtual currency is comparable to those analyzed herein; however, it is not used in virtual worlds. Consequently, it is more relevant to real currencies than to virtual gaming currencies. The cash transaction market for Bitcoin outweighs that for World of Warcraft. Here, we applied to Bitcoin the same algorithm that we applied to Virtual World currencies for prediction. It was assumed that Bitcoin is significant for analysis because transactions with actual money are more frequent than those with virtual money within a game.

Experiment 3: Bitcoin.

For collection and analysis of Bitcoin-related market data, a service that collects and provides information about worldwide Bitcoin exchanges was used for crawling [79]. Among the many Bitcoin exchanges, Bitstamp, one of the most renowned US Bitcoin exchange markets, was selected. The market data included daily prices from September 13, 2011 through January 28, 2015 (1,233 days). The opinion data about Bitcoin was collected from the largest forum from which the US Bitcoin market trends can be easily accessed [80]. The opinion data included 16,621 postings on all discussion topics during the same period (September 13, 2011 through January 28, 2015). In addition, each topic’s title, posted date, comment counts, and view counts were saved. We performed search-engine sentiment analysis, learning, and testing on the crawled opinion data. The result of the Granger casualty test was followed as the relevant virtual world learning applied trust, fear, and surprise. The topic examples of the relevant sentiments are as follows in Table 11.

thumbnail
Table 11. Sentiment analysis example of BitCoin community.

https://doi.org/10.1371/journal.pone.0132944.t011

By applying the model created above, we performed validation to verify the fluctuating value data for 1,095 days (see the results in Table 12; the most accurate model is indicated in bold). The first 85% of the data (1,048 days of observation) were used for model training, while the last 15% (185 days of observation) were used for out-of-sample forecasting. To verify the model, the time gap between the opinion data and market price data was set with seven combinations from the first day to the seventh day. When the time gap was six days with the trust and surprise moods, which produced the best results, the predictive weighted average precision of fluctuation was 76.1% based on the applicable model.

thumbnail
Table 12. Weighted average precision for Bitcoin fluctuation prediction (%).

https://doi.org/10.1371/journal.pone.0132944.t012

Discussion and Conclusion

In this paper, we introduced an analysis system for predicting the value fluctuations of virtual currencies used in virtual worlds based on user opinion data in select online communities. In the proposed method, data of user opinions on a predominant community are collected by employing a simple algorithm and guaranteeing a stable prediction of value fluctuations of more than one virtual currency. With the ever increasing size of the virtual world market size, the proposed prediction of virtual currencies is likely to help developers and users in virtual worlds. In addition, the proposed method was proven to efficiently predict the value of other virtual currencies, including Bitcoin, a non-virtual-world currency; accordingly, the method may be used for purposes beyond the scope of virtual realms. The proposed prediction system provides information on market trends to developers, who can thus numerically and stochastically identify several effects that are expected in planning but difficult to grasp (e.g., user enjoyment, the vitalizing of a virtual economy, easing inflation and deflation, etc.). The proposed prediction system provides virtual currency users with the potential to seek profits by predicting the value fluctuations of virtual currencies, while enabling them broader insights into overall opinions or trends of virtual currencies of interest.

In addition, the proposed sentiment analysis model offers applicability for both developers and users. In this study, the analysis of online communities proved that users’ emotions influence the contents in actual games. This finding suggests that the proposed model enables developers who administer virtual currencies to more easily manage the virtual economy of their own design and to efficiently oversee the interactions among users and virtual currencies by observing the content shifts within games. Furthermore, the proposed sentiment analysis method can be used to grasp overall opinions of internal users in virtual worlds. In short, the proposed method can facilitate virtual world developers’ understandings of user opinions and guide their development activities.

The proposed method needs improvement in a few aspects. First, if investment strategies [73] used for stock forecasting apply the increasing virtual currency assumption, then improved results can be produced. To enhance the precision of sentiment analysis, it is necessary to optimize the analysis in line with virtual world systems. For example, the frequency of words in a virtual community can be investigated, a learning data set for the given virtual world can be developed, and a customized prediction model can be built. In addition, such a data set must not necessarily rely on the opinion data; rather, it should be diversified by adding the components that influence the virtual currency system. For example, virtual currency system updates and changing trends of virtual currency users can be analyzed and added to the data. By improving the system in these ways, the universality and efficiency of the method can be increased.

In sum, we proposed in this paper a simple and universal system for predicting virtual currencies. This system was validated with different virtual currencies to prove its effectiveness in extensively predicting virtual currency fluctuations. In addition, our evaluation of the analysis results shows that the proposed system is significant for both virtual currency developers and users. Because the system was designed for the internal analysis of virtual worlds for general purposes, it is applicable to predicting the values of internal contents of virtual worlds as well as virtual currencies. For example, through the shifts of content values, it is possible to predict the transactions of gaming contents (in-app payments) purchased inside games, not transactions in cash between users. As the influence of virtual currencies on real economies increases, the overall importance of virtual currencies will likewise increase. Hence, the analysis and prediction of virtual currencies may transcend research on a target virtual economy to achieve diversified outcomes in multiple fields, including spot economies and opinion mining. In the near future, the proposed method will likely prove more significant to many fields with more extensive targets and enhanced sentiment analysis.

Supporting Information

S1 Table. Table that displays the result of implementing sentiment analysis from the user opinion data of official game forum for EVE Online provided by CPP Games (https://forums.eveonline.com).

https://doi.org/10.1371/journal.pone.0132944.s001

(CSV)

S2 Table. Table that displays the result of implementing sentiment analysis from the user opinion data of Blizzard Entertainment’s official game forum (http://us.battle.net/wow/en).

https://doi.org/10.1371/journal.pone.0132944.s002

(CSV)

S3 Table. Table that displays the result of implementing sentiment analysis from the user opinion data of the Bitcoin Forum (https://bitcointalk.org).

https://doi.org/10.1371/journal.pone.0132944.s003

(CSV)

Author Contributions

Conceived and designed the experiments: YBK SJK MJC CHK. Performed the experiments: YBK SHL. Analyzed the data: YBK SHL. Contributed reagents/materials/analysis tools: SHL. Wrote the paper: YBK SHL SJK CHK.

References

  1. 1. Shin DH. Understanding purchasing behaviors in a virtual economy: Consumer behavior involving virtual currency in Web 2.0 communities. Interact Comput. 2008;20(4):433–46.
  2. 2. O'reilly T. What is Web 2.0: Design patterns and business models for the next generation of software. Communications & strategies. 2007;(1):17.
  3. 3. Papagiannidis S, Bourlakis M, Li F. Making real money in virtual worlds: MMORPGs and emerging business opportunities, challenges and ethical implications in metaverses. Technological Forecasting and Social Change. 2008;75(5):610–22.
  4. 4. Scarle S, Arnab S, Dunwell I, Petridis P, Protopsaltis A, de Freitas S. E-commerce transactions in a virtual environment: virtual transactions. Electronic Commerce Research. 2012;12(3):379–407.
  5. 5. Wohn DY, editor Spending real money: purchasing patterns of virtual goods in an online social game. Proceedings of the 32nd annual ACM conference on Human factors in computing systems; 2014: ACM.
  6. 6. Guo Y, Barnes S. Why people buy virtual items in virtual worlds with real money. ACM SIGMIS Database. 2007;38(4):69–76.
  7. 7. Holland LHM. Making Real Money In Virtual Worlds [Internet]: Forbes.com LLC. 2006 Aug 7. [cited 2015 Jan 10]. Available from: http://www.forbes.com/2006/08/07/virtual-world-jobs_cx_de_0807virtualjobs.html.
  8. 8. Linden T. 2009 End of Year Second Life Economy Wrap up (including Q4 Economy in Detail) [Internet]: Linden Research,. Inc. 2010 Jan 19. [cited 2014 Oct 23]. Available from: http://community.secondlife.com/t5/Features/2009-End-of-Year-Second-Life-Economy-Wrap-up-including-Q4/ba-p/653078.
  9. 9. Kondor D, Pósfai M, Csabai I, Vattay G. Do the rich get richer? An empirical analysis of the Bitcoin transaction network. PLoS One. 2014;9(2):e86197. pmid:24505257
  10. 10. Lehdonvirta V. Virtual item sales as a revenue model: identifying attributes that drive purchase decisions. Electronic Commerce Research. 2009;9(1–2):97–113.
  11. 11. MacInnes I, editor Virtual Worlds in Asia: Business Models and Legal Issues. Digital Games Research Association Conference; 2005.
  12. 12. Kimoto T, Asakawa K, Yoda M, Takeoka M, editors. Stock market prediction system with modular neural networks. Neural Networks, 1990, 1990 IJCNN International Joint Conference on; 1990: IEEE.
  13. 13. Schumaker RP, Chen H. Textual analysis of stock market prediction using breaking financial news: The AZFin text system. ACM Trans Manag Inf Syst. 2009;27(2):12.
  14. 14. Zhang Y, Wu L. Stock market prediction of S&P 500 via combination of improved BCO approach and BP neural network. Expert systems with applications. 2009;36(5):8849–54.
  15. 15. Yang H, Chan L, King I. Support vector machine regression for volatile stock market prediction. Intelligent Data Engineering and Automated Learning—IDEAL 2002: Springer; 2002. p. 391–6.
  16. 16. Bollen J, Mao H, Zeng X. Twitter mood predicts the stock market. J Comput Sci. 2011;2(1):1–8.
  17. 17. Cohen-Charash Y, Scherbaum CA, Kammeyer-Mueller JD, Staw BM. Mood and the market: can press reports of investors' mood predict stock prices? PLoS One. 2013;8(8):e72031. pmid:24015202
  18. 18. Bordino I, Battiston S, Caldarelli G, Cristelli M, Ukkonen A, Weber I. Web search queries can predict stock market volumes. PLoS One. 2012;7(7):e40014. pmid:22829871
  19. 19. Wang Q-H, Mayer-Schonberger V, editors. The monetary value of virtual goods: An exploratory study in MMORPGs. System Sciences (HICSS), 2010 43rd Hawaii International Conference on; 2010: IEEE.
  20. 20. Wang Q-H, Mayer-Schönberger V, Yang X. The determinants of monetary value of virtual goods: An empirical study for a cross-section of MMORPGs. Information Systems Frontiers. 2013;15(3):481–95.
  21. 21. Bainbridge WS. The scientific research potential of virtual worlds. science. 2007;317(5837):472–6. pmid:17656715
  22. 22. Messinger PR, Stroulia E, Lyons K, Bone M, Niu RH, Smirnov K, et al. Virtual worlds—past, present, and future: New directions in social computing. Decis Support Syst. 2009;47(3):204–28.
  23. 23. Jiang Z-Q, Zhou W-X, Tan Q-Z. Online-offline activities and game-playing behaviors of avatars in a massive multiplayer online role-playing game. Europhys Lett. 2009;88(4):48007.
  24. 24. Thurner S, Szell M, Sinatra R. Emergence of good conduct, scaling and Zipf laws in human behavioral sequences in an online world. PloS one. 2012;7(1):e29796. pmid:22253784
  25. 25. Szell M, Sinatra R, Petri G, Thurner S, Latora V. Understanding mobility in a social petri dish. Sci Rep. 2012;2.
  26. 26. Szell M, Thurner S. How women organize social networks different from men. Sci Rep. 2013;3.
  27. 27. Corominas-Murtra B, Fuchs B, Thurner S. Detection of the elite structure in a virtual multiplex social system by means of a generalised K-core. PloS one. 2014;9(12):e112606. pmid:25541957
  28. 28. Szell M, Lambiotte R, Thurner S. Multirelational organization of large-scale social networks in an online world. Proc Natl Acad Sci U S A. 2010;107(31):13636–41. pmid:20643965
  29. 29. Szell M, Thurner S. Measuring social dynamics in a massive multiplayer online game. Soc Networks. 2010;32(4):313–29.
  30. 30. Szell M, Thurner S. Social dynamics in a large-scale online game. Adv Complex Syst. 2012;15(06):1250064.
  31. 31. Klimek P, Thurner S. Triadic closure dynamics drives scaling laws in social multiplex networks. New J Phys. 2013;15(6):063008.
  32. 32. Xie W-J, Li M-X, Jiang Z-Q, Zhou W-X. Triadic motifs in the dependence networks of virtual societies. Sci Rep. 2014;4.
  33. 33. Fuchs B, Thurner S. Behavioral and network origins of wealth inequality: Insights from a virtual world. PloS one. 2014;9(8):e103503. pmid:25153072
  34. 34. Ellison NB. Social network sites: Definition, history, and scholarship. J Comput Mediat Commun. 2007;13(1):210–30.
  35. 35. Knoke D, Yang S. Social network analysis: Sage; 2008.
  36. 36. Ediger D, Jiang K, Riedy J, Bader DA, Corley C, Farber R, et al., editors. Massive social network analysis: Mining twitter for social good. Parallel Processing (ICPP), 2010 39th International Conference on; 2010: IEEE.
  37. 37. Cheong F, Cheong C. Social Media Data Mining: A Social Network Analysis Of Tweets During The 2010–2011 Australian Floods. 15th Pacific Asia Conference on Information Systems (PACIS)2011. p. 46-.
  38. 38. Sakaki T, Okazaki M, Matsuo Y, editors. Earthquake shakes Twitter users: real-time event detection by social sensors. Proceedings of the 19th international conference on World wide web; 2010: ACM.
  39. 39. Cheng T, Wicks T. Event Detection using Twitter: A Spatio-Temporal Approach. PLoS One. 2014;9(6):e97807. pmid:24893168
  40. 40. Catanese SA, De Meo P, Ferrara E, Fiumara G, Provetti A, editors. Crawling facebook for social network analysis purposes. Proceedings of the international conference on web intelligence, mining and semantics; 2011: ACM.
  41. 41. Russell MA. Mining the Social Web: Data Mining Facebook, Twitter, LinkedIn, Google+, GitHub, and More: " O'Reilly Media, Inc."; 2013.
  42. 42. Pak A, Paroubek P, editors. Twitter as a Corpus for Sentiment Analysis and Opinion Mining. Proceedings of the Seventh conference on International Language Resources and Evaluation (LREC'10) 2010.
  43. 43. Agarwal A, Xie B, Vovsha I, Rambow O, Passonneau R, editors. Sentiment analysis of twitter data. Proceedings of the Workshop on Languages in Social Media; 2011: Association for Computational Linguistics.
  44. 44. Kouloumpis E, Wilson T, Moore J. Twitter sentiment analysis: The good the bad and the omg! The Fifth International AAAI Conference on Weblogs and Social Media2011. p. 538–41.
  45. 45. Bifet A, Frank E, editors. Sentiment knowledge discovery in twitter streaming data. DS'10 Proceedings of the 13th international conference on Discovery science; 2010: Springer.
  46. 46. Thelwall M, Buckley K, Paltoglou G. Sentiment strength detection for the social web. J Am Soc Inf Sci Technol. 2012;63(1):163–73.
  47. 47. Alm CO, Roth D, Sproat R, editors. Emotions from text: machine learning for text-based emotion prediction. Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing; 2005: Association for Computational Linguistics.
  48. 48. Baccianella S, Esuli A, Sebastiani F, editors. SentiWordNet 3.0: An Enhanced Lexical Resource for Sentiment Analysis and Opinion Mining. Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10); 2010.
  49. 49. Annett M, Kondrak G. A comparison of sentiment analysis techniques: Polarizing movie blogs. Advances in artificial intelligence: Springer; 2008. p. 25–35.
  50. 50. Fahrni A, Klenner M, editors. Old wine or warm beer: Target-specific sentiment analysis of adjectives. Proc of the Symposium on Affective Language in Human and Machine, AISB; 2008.
  51. 51. Gargiulo F, Ramasco JJ. Influence of opinion dynamics on the evolution of games. PLoS One. 2012;7(11):e48916. pmid:23166600
  52. 52. Hau YS, Kim Y-G. Why would online gamers share their innovation-conducive knowledge in the online game user community? Integrating individual motivations and social capital perspectives. Comput Human Behav. 2011;27(2):956–70.
  53. 53. Kosminsky E. World of Warcraft: The Viability of Massively Multiplayer Online Role-Playing Games as Platforms for Modeling and Evaluating Perfect Competition. Journal For Virtual Worlds Research. 2009;2(4).
  54. 54. Stigler GJ. Perfect competition, historically contemplated. The Journal of Political Economy. 1957;65(1):1–17.
  55. 55. Thomas K, Grier C, Song D, Paxson V, editors. Suspended accounts in retrospect: an analysis of twitter spam. Proceedings of the 2011 ACM SIGCOMM conference on Internet measurement conference; 2011: ACM.
  56. 56. Song J, Lee S, Kim J, editors. Spam filtering in twitter using sender-receiver relationship. Recent Advances in Intrusion Detection; 2011: Springer.
  57. 57. McCord M, Chuah M. Spam detection on twitter using traditional classifiers. Autonomic and trusted computing: Springer; 2011. p. 175–86.
  58. 58. Yardi S, Romero D, Schoenebeck G. Detecting spam in a twitter network. First Monday. 2009;15(1).
  59. 59. Wang AH, editor Don't follow me: Spam detection in twitter. Security and Cryptography (SECRYPT), Proceedings of the 2010 International Conference on; 2010: IEEE.
  60. 60. Klein D, Manning CD, editors. Accurate unlexicalized parsing. Proceedings of the 41st Annual Meeting on Association for Computational Linguistics-Volume 1; 2003: Association for Computational Linguistics.
  61. 61. Monroe W, Green S, Manning DC, editors. Word Segmentation of Informal Arabic with Domain Adaptation. Proceedings of the 52nd Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers); 2014: Association for Computational Linguistics.
  62. 62. Tseng H, Chang P, Andrew G, Jurafsky D, Manning C, editors. A conditional random field word segmenter for sighan bakeoff 2005. Proceedings of the fourth SIGHAN workshop on Chinese language Processing; 2005.
  63. 63. Chang P-C, Galley M, Manning CD, editors. Optimizing Chinese word segmentation for machine translation performance. Proceedings of the Third Workshop on Statistical Machine Translation; 2008: Association for Computational Linguistics.
  64. 64. Toutanova K, Klein D, Manning CD, Singer Y, editors. Feature-rich part-of-speech tagging with a cyclic dependency network. Proceedings of the 2003 Conference of the North American Chapter of the Association for Computational Linguistics on Human Language Technology-Volume 1; 2003: Association for Computational Linguistics.
  65. 65. Plutchik R. The Nature of Emotions Human emotions have deep evolutionary roots, a fact that may explain their complexity and provide tools for clinical practice. American Scientist. 2001;89(4):344–50.
  66. 66. Bravo-Marquez F, Mendoza M, Poblete B, editors. Combining strengths, emotions and polarities for boosting twitter sentiment analysis. Proceedings of the Second International Workshop on Issues of Sentiment Discovery and Opinion Mining; 2013: ACM.
  67. 67. Mohammad SM, Turney PD. Crowdsourcing a word–emotion association lexicon. Computational Intelligence. 2013;29(3):436–65.
  68. 68. Cambria E, Mazzocco T, Hussain A. Application of multi-dimensional scaling and artificial neural networks for biologically inspired opinion mining. Biologically Inspired Cognitive Architectures. 2013;4:41–53.
  69. 69. Guerrero Rázuri JF, Sundgren D, Rahmani R, Larsson A. Effect of emotional feedback in a decision-making system for an autonomous agent. IBERAMIA 2014 14th edition of the Ibero-American Conference on Artificial Intelligence2014. p. 613–24.
  70. 70. Cambria E, Howard N, Hsu J, Hussain A, editors. Sentic blending: Scalable multimodal fusion for the continuous interpretation of semantics and sentics. Computational Intelligence for Human-like Intelligence (CIHLI), 2013 IEEE Symposium on; 2013: IEEE.
  71. 71. EVE Online Forums [Internet]. CCP; c1997-2015 [updated 2015 Jan 27; cited 2015 Jan 27]. Available from: http://forums.eveonline.com.
  72. 72. Granger CW, Huangb B- N, Yang C-W. A bivariate causality between stock prices and exchange rates: evidence from recent Asianflu. Q Rev Econ Finance. 2000;40(3):337–54.
  73. 73. Lahmiri S. A comparison of PNN and SVM for stock market trend prediction using economic and technical information. Int J Comput Appl. 2011;29(3):24–30.
  74. 74. Suykens JA, Vandewalle J. Least squares support vector machine classifiers. Neural processing letters. 1999;9(3):293–300.
  75. 75. Chang C-C, Lin C-J. LIBSVM: a library for support vector machines. ACM Trans Intell Syst Technol. 2011;2(3):27.
  76. 76. Kollar P. World of Warcraft hits over 10 million subscribers as Warlords of Draenor launches [Internet]: VOX MEDIA Inc. 2014 Nov 19. [cited 2015 Jan 5]. Available from: http://www.polygon.com/2014/11/19/7250737/world-of-warcraft-warlords-draenor-10-million-subscribers.
  77. 77. Compare MMOG currency prices [Internet]. mmobux; c2006-15 [updated 2015 Jan 19; cited 2015 Jan 20]. Available from: http://www.mmobux.com.
  78. 78. World of Warcraft [Internet]. BLIZZARD ENTERTAINMENT; c2015 [updated 2015 Jan 20; cited 2015 Jan 20]. Available from: http://us.battle.net/wow/en.
  79. 79. Bitcoin Charts [Internet]. bitchoincharts.com; c2011-15 [updated 2015 Jan 26; cited 2015 Jan 26]. Available from: http://www.bitcoincharts.com.
  80. 80. Bitcoin Forum [Internet]. Simple Machines; c2006-9 [updated 2015 Jan 26; cited 2015 Jan 26]. Available from: https://bitcointalk.org.