Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Developing forecasting model for future pandemic applications based on COVID-19 data 2020–2022

  • Wan Imanul Aisyah Wan Mohamad Nawi,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Validation, Visualization, Writing – original draft

    Affiliation Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Abdul Aziz K. Abdul Hamid,

    Roles Funding acquisition, Software, Visualization

    Affiliations Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia, Special Interest Group on Applied Informatics and Intelligent Applications (AINIA) Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Muhamad Safiih Lola ,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    safiihmd@umt.edu.my

    Affiliations Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia, Special Interest Group on Modeling and Data Analytics (SIGMDA), Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Syerrina Zakaria,

    Roles Formal analysis, Funding acquisition, Methodology

    Affiliations Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia, Special Interest Group on Modeling and Data Analytics (SIGMDA), Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Elayaraja Aruchunan,

    Roles Formal analysis, Funding acquisition, Methodology, Resources, Validation

    Affiliation Faculty of Science, Institute of Mathematical Sciences, Universiti Malaya, Kuala Lumpur, Kuala Lumpur Federal Territory, Malaysia

  • R. U. Gobithaasan,

    Roles Conceptualization, Funding acquisition, Methodology, Software

    Affiliations Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia, Special Interest Group on Modeling and Data Analytics (SIGMDA), Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Nurul Hila Zainuddin,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Validation

    Affiliation Mathematics Department, Faculty of Science and Mathematics, Universiti Pendidikan Sultan Idris, Tanjong Malim, Perak Darul Ridzuan, Malaysia

  • Wan Azani Mustafa,

    Roles Funding acquisition, Software, Visualization

    Affiliations Faculty of Electrical Engineering & Technology, Universiti Malaysia Perlis, UniCITI Alam Campus, Sungai Chuchuh, Padang Besar, Perlis, Malaysia, Advanced Computing (AdvCOMP), Centre of Excellence, Universiti Malaysia Perlis (UniMAP), Arau, Perlis, Malaysia

  • Mohd Lazim Abdullah,

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Writing – review & editing

    Affiliations Faculty of Ocean Engineering Technology and Informatics, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia, Special Interest Group on Modeling and Data Analytics (SIGMDA), Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Nor Aieni Mokhtar,

    Roles Conceptualization, Data curation, Funding acquisition, Writing – review & editing

    Affiliation Institute of Oceanography and Environment, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia

  • Mohd Tajuddin Abdullah

    Roles Conceptualization, Funding acquisition, Investigation, Validation, Writing – review & editing

    Affiliations Faculty of Fisheries and Food Science, Universiti Malaysia Terengganu, Kuala Nerus, Terengganu, Malaysia, Fellow Academy of Sciences Malaysia, Kuala Lumpur, Kuala Lumpur Federal Territory, Malaysia

Abstract

Improving forecasting particularly time series forecasting accuracy, efficiency and precisely become crucial for the authorities to forecast, monitor, and prevent the COVID-19 cases so that its spread can be controlled more effectively. However, the results obtained from prediction models are inaccurate, imprecise as well as inefficient due to linear and non-linear patterns exist in the data set, respectively. Therefore, to produce more accurate and efficient COVID-19 prediction value that is closer to the true COVID-19 value, a hybrid approach has been implemented. Thus, aims of this study is (1) to propose a hybrid ARIMA-SVM model to produce better forecasting results. (2) to investigate in terms of the performance of the proposed models and percentage improvement against ARIMA and SVM models. statistical measurements such as MSE, RMSE, MAE, and MAPE then conducted to verify that the proposed models are better than ARIMA and SVM models. Empirical results with three real datasets of well-known cases of COVID-19 in Malaysia show that, compared to the ARIMA and SVM models, the proposed model generates the smallest MSE, RMSE, MAE and MAPE values for the training and testing datasets, means that the predicted value from the proposed model is closer to the actual value. These results prove that the proposed model can generate estimated values more accurately and efficiently. As compared to ARIMA and SVM, our proposed models perform much better in terms of error reduction percentages for all datasets. This is demonstrated by the maximum scores of 73.12%, 74.6%, 90.38%, and 68.99% in the MAE, MAPE, MSE, and RMSE, respectively. Therefore, the proposed model can be the best and effective way to improve prediction performance with a higher level of accuracy and efficiency in predicting cases of COVID-19.

Introduction

The city of Wuhan in the province of Hubei, China is etched in the folds of history for being the first place of the spread of the Coronavirus disease (COVID-19), due to severe acute respiratory syndrome. The World Health Organisation (WHO) on 31st January was firstly declared that COVID-19 as a “Public Health Emergency of International Concern” [1]. Originally, it was thought that the virus has been derived from a seafood market in Wuhan. However, on 11 January 2020 the genetic sequence of which was overtly shared by China through human-to-human contacts have driven its rapid spread with a total of 9,129,146 confirmed cases, including 473,797 deaths across the globe until June 24, 2020 [2]. Nonetheless, the COVID-19 pandemic has infected more than 151 million of the humans all over the world and caused 3 million deaths as of May 1, 2021. The countries like USA, Brazil, Russia, Spain, UK, Italy, France, Germany, China, India, Iran, and Pakistan become the most affected from COVID-19. The first few COVID-19 cases were reported in Malaysia on 24th January 2020 were detected from Chinese tourists entering the country from Singapore [3]. In the early stage, only in single digit of daily cases were reported, however it had increased to 235 by 26th March [4]. The number of daily cases in Malaysia were continued to rise exponentially hitting around 20,000 by August 2021. The Malaysian government was declared the implementation of the Movement Control Order (MCO), Conditional MCO (CMCO) and Recovery MCO (RMCO) from 18th March to 12th May 2020, 13th May to 9th June, and 9th June to 31st December, respectively. All travelling and socio-economic activities (gatherings for religious and cultural occasions were not allowed) were restricted nationwide to keep new infections at bay and avoid overloading the country’s healthcare system during this period. All government and private offices, and education institutions including transport hubs were closed and instructing citizens to stay at home and interstate travelling was banned with fines of up to RM10,000 for violators.

Since WHO declared as the outbreak of COVID-19 as a pandemic, a lot of effort have been attempts not only from government worldwide but effort also from medical institution are committed to finding vaccines and treatments to control the spread of the virus, statistical modelling particularly forecasting on the COVID-19 cases also have been extensively carried out by statisticians and health scientists to support the health system to inhibit the disaster of infection as well. In this scenario, the capability to pinpoint the growth rate more effectively at which the epidemic is spreading is very crucial to fight back and assist the governments mindfulness concerning society planning and policymaking to accurately deal with the consequences of the infection. Thus, the motivation behind this research compared to the existing research work, namely, (i) to develop the forecasting model that more accurate and efficient regarding the spread of COVID-19 in Malaysia, and (ii) to compare the performance of this novel model with ARIMAS and SVM. This model can assist the public health authorities for pre-emptive and preventive planning to curtail the impact of future pandemics.

During pandemic many studies have been carried out through different mathematical and statistical models to predict the spread of the COVID-19 pandemic. One of the most popular and widely time series forecasting models used to analyse and predict the spread of the disease is the ARIMA (p,d, q) model [57]. Forecasting daily new cases of COVID-19 was a difficult undertaking because the cases were growing daily. In the first wave, the cases of COVID-19 pattern has been continuously increasing for some period then decline. However, for the second wave it seen to be increased again and some of the COVID-19 cases are difficult to predict. In this scenario, a few researchers predict COVID-19 pattern using ARIMA [815]. However, ARIMA model have a limitation where it’s normally only can handle a linear time series data structure [16]. However, approximations by ARIMA models are inadequate in representing a barrier in time series forecasting for researchers particularly for nonlinear pattern [17]. Despite its superior performance, Support Vector Machines (SVM’s) classification performance and classifier’s generalisation ability are frequently impacted by the dimension or quantity of feature variables as mentioned by Lee [18] is used. As a sequence of the development of Vector Machines model, this process will be able to provide the accurate and efficient result in any case of prediction. The SVMs, which were first introduced by Vladimir Vapnik in 1995 [19] in the domain of statistical learning theory and structural risk minimization, have been shown to operate well on a variety of forecasting and classification issues. The SVMs could also cope with or address difficulties like nonlinearity, local minimum, and high dimension in which ARIMA model [16, 2022]. SVMs models have recently been used to handle issues such as nonlinear, local minimum, and high dimension. SVMs can ensure higher accuracy for a long-term prediction compared to other computational approaches even in many practical applications. However, single SVM model as single ARIMA model also have some limitation where SVM model only can handle nonlinear data, instead of linear data. With the constrains of a single ARIMA and SVM models as well, in-dept analysis of time series forecasting, hybrid approaches become the best approach to overcome both limitations and it’s a very significant impact in numerous fields due to their dynamic nature and capability to predict at a higher level of accuracy, efficiency, and precision. This approach is crucial due to issues that arise in time series forecasting where almost all real-world time series contain both linear and nonlinear correlation patterns between the data. Recently, the hybridization of forecasting methods has been used with great achievement to reach enhanced forecasting accuracy [16, 17, 2026].

In terms the spread of COVID-19, the hybrid time series model approach is crucial in predicting the impact of COVID-19 outbreak and it has been shown to be successful in predicting COVID-19 [2730]. Thus. this study aims (a) to propose the hybrid ARIMA -SVM models approach for produce better forecasting results where its capability to produce the best estimator, i.e., generating small error terms; (b) to investigate the performance of the proposed models by comparing with the ARIMA and SVM models using three daily cases of COVID-19 data in Malaysia which are daily new positive cases, daily new fatalities cases, and daily new recovered cases. In spite of recent advances in time series and in particular in COVID-19, the model building process does not include cases of COVID-19 specifically in Malaysia to assist the authorities in dealing with the spread of this outbreak by producing more efficient, accurate and precise forecast results in the future. Therefore, in this study rather than rely on conventional approaches to deal with the COVID-19 data, this study relies on intelligent-based prediction methods to better predict the future pandemic. According to Moore [31], the scenario for the next likely new pandemic of strain of bird influenza H7N9 virus, or a novel coronavirus. Despite the fact that future outbreaks are inevitable, however, this intelligent-based prediction methods can produce more efficient, accurate and precise forecasts for pre-emptive prevention medicinal procedures by the local health care authorities [32, 33]. The model can also be used to predict Coronavirus or bird flu in the future, especially in tropical rainforest countries like Malaysia. Additionally, the intelligent-based prediction methods will produce prediction models that are more accurate, precise, and efficient in predicting the dynamic spread of the virus in the future. Although, the vaccine is currently available and the number of deaths worldwide is low, this model will be useful for making very accurate predictions if similar outbreaks occur in the future. As a result, the spread of COVID-19 can be predicted earlier so that better health facilities can be built, legislative measures can be taken, and economic losses, especially human losses, can be avoided.

The rest of this paper is organized as follows. Details of the method we used to develop our proposed model are discussed in materials and methods. Followed by a brief formulation of the hybrid ARIMA-SVM model used in this study. The performance of our proposed model based on three well-known COVID-19 case datasets is presented in the results and discussion. Finally, we conclude the paper and provide recommendations for further work.

Materials and methods

The ARIMA modelling.

The Autoregressive Integrated Moving Average, The ARIMA (p,d,q) model is one of the families in time series forecasting that is commonly used for time series forecasting because of its flexibility with various categories of time series datasets [17]. It also expressly caters to a set of standard patterns in time series analysis, enabling an easy-to-use yet powerful way for creating accurate time series predictions However, limitations may occur with pre-assumptions due to the existence of a linear form that is a linear relationship between the future value of the time series with the current value, past and white noise in the model [1618, 22, 34]. In the ARIMA model, let p and q be the numbers of autoregressive and moving average terms and they are always mentioned in the order of the model while, d be the integer representative of the differential order. The type of ARIMA model with mean, μ is represented mathematically as follows. (1) where, yt and εt are the actual value and the random error at time t, respectively. Both are assumed to be independently and identically distributed (iid) with mean 0 and constant variance of σ2, ∅i(i = 1,2,…,q) and θj(j = 0,1,2,…,q) are the model parameters that need to be predicted.

Support vector machines model

The support vector machine (SVM) introduced by Vladimir Vapnik [19] which involves statistical learning theory can better handle larger dimensional data, even with a small number of training examples, and has excellent generalization. Because the models choose limit support vectors from input data, they process data quickly. The SVM regression function is written as follows.

For linear and regressive data set {xi, yi} the function is formulated as follows (2)

The coefficient w and b are estimated by minimizing (3) where Lε is called the ε-intensive loss function and is formulated as follows: (4)

By introducing positive slack variable ξ and , Eq (3) can be transformed to the following constrained formulation: (5)

When solving the above formula, we always utilize dual theory to convert it into a convex quadratic programming problem. Introducing the Lagrange Eq(5) change into the following term: (6) subject to

When the data set cannot be regressed linearly, we also map them to a high dimension feature space and make linear regress. Then the formulation is as follows: (7) subject to

Let is the inner product of feature space and is called kernel function. Any symmetric function that satisfies Mercer condition can be used as Kernel Function [19]. The Gaussian kernel function is specified in this study.

(8)

The SVMs were employed to estimate the nonlinear behaviour of the forecasting data set as Gaussian kernels tend to give good performance under general smoothness assumptions [23].

Proposed hybrid models

Despite various time series models presented, the accuracy, effectively as well as precisely of time series forecasting at this time become the fundamental to many decision-making processes. However, those factors do not occur in the ARIMA and SVM models. This also become the most reason why time series forecasting model is crucial, most challenging, and dynamic as well as active research in many fields of studies. ARIMA and SVM models also have achieved success in their linear or nonlinear areas [16, 25, 26]. However, none of these are generic principles that can be generalized to all situations. Hence, a hybrid strategy that employs both linear and nonlinear modelling skills is recommended. This approach is suggested mainly for improving overall prediction effectiveness. Therefore, there is no research on how to improve the effectiveness of forecasting models conducted especially in the case of COVID-19 in Malaysia.

In this study two motivation for hybrid models. First, a single model of ARIMA and SVM may not be sufficient to identify all the characteristics of the time series. Second, the assumption that either one or both cannot recognize the actual data generating process. Building the hybrid models of this study involved of two parts. Part I about linear autocorrelation composition and follow with nonlinear component in part II. Thus, (9)

Where Lt and Nt signifies the linear composition and the nonlinear component, respectively. These two parts must be approximated based on the data. In the part I, linear modelling become the focus using ARIMA model to model the linear composition. The model from the first model involved the residuals which is the nonlinear interactions, and it cannot be model by linear model, and maybe linear relationship as well. Thus, (10)

Let ei signify the residual from the linear model at time t, then where is the predicted value for time t from the estimated relationship in (1) with et is the residual at time t from the linear model. According to Aisyah, et al., [16] the residual data set after ARIMA fitting will only contain non-linear relationships and can be properly represented by a linear model. Results of first stage which contains the forecast values and residuals of linear modelling then used in Part II.

In Part II, the focus is for nonlinear modelling which SVM used to model the nonlinear (maybe linear) relationship occurring in residuals of linear modelling and original data as well. Then, the residual can be calculated using SVM by modelling various configurations as follows: (11) (12) (13) (14) where f is a nonlinear function determined by the SVMs model and εt is the random errors.

Thus, the combined forecast is (15)

Eqs (11) and (12) can be identified as , therefore the forecasted values can be achieved by summation of linear and nonlinear components Fig 1 shows the functional flowchart of hybrid models

In short, the proposed methodology of the hybrid process consists of two parts. In the part I, the ARIMA model is employed to analyse the problem of linear composition. In the part II, a SVM model is developed to model the residuals from part I. Since the ARIMA model in part I cannot handle the nonlinear component of the data, the residuals of linear model will include information about the nonlinearity. The results from the SVM can be treated as forecasts of the error terms for the ARIMA model. The hybrid model utilizes the distinctive feature and strength of ARIMA and SVM model as well in defining various patterns. Therefore, it is more effective to model linear and non-linear patterns separately by using two different models and re-hybridize the forecast results obtained to improve overall modelling and forecasting performance.

Proposed algorithm

Step 1: Three selected time series of COVID-19 cases datasets (1st of October 2020-4th of November 2022), namely daily new positive cases, daily new deaths cases and daily new recovered cases are generated in R programming Language

Step 2: Every of the generated datasets is defined as , and for daily new positive cases, daily new deaths cases and, daily new recovered cases, respectively. Then, selected the best ARIMA (p,d,q) after checking the autocorrelation function (ACF) plot of ARIMA (p,d,q) residuals. The best fitted value for daily new positive cases is ARIMA (2,1,2), while ARIMA (1,1,2) and ARIMA (0,1,1) for daily new fatalities cases, and daily new recovered cases of COVID-19, respectively.

Step 3: The fitted value, and the residuals

Step 4: Combine the values in step 3 as a set of input variables to get the output yt

Step 5: The ARIMA (p,d,q) is defined by the order of q. According to the information in step 4, Vector Machines is carried out to examine the residuals to get the output Lt using R-programming Language.

Step 6: A fitted value of ARIMA with the hybridization of Vector Machines model is obtained for each sample data. Then, the residuals εt is generated to obtain the forecasting result,

Step 7: The framing data split randomly into training data and testing data for further Vector Machines model. Run the Vector Machines procedure using the ‘e1071’ package in R-Programming Language

Step 8: Assume the split data as the processing data and the order q as in Step 5. Therefore, the combine forecast as in Eq (15):

Step 9: Estimate the model performance using the statistical measurement which are MSE, RMSE, MAE and MAPE.

Forecasting evaluation criteria

In order to evaluate the performance of the proposed hybrid models, the different statistical measurements criteria which followed by [16, 17, 32], such as MAE (Mean Absolute Error), MAPE (Mean Absolute Percentage Error), MSE (Mean Squared Error), and RMSE (Root Mean Squared Error) are used.

For ARIMA model, normally, the measurement tools such as Akaike’s information Criterion (AIC) and the Bayesian information criterion (BIC) have been widely used in time series analysis to determine the appropriate length for distributed lag [16, 17]. Therefore, model selection is made based on the model with the smallest value of AIC and BIC to provide measures of model performance which gives the selection of the best ARIMA model. Meanwhile, for the SVMs models, three parameters such as γ, C and ε are used as the measurement tools to determine the best fitted model. Inappropriate selection of SVM model parameters can result in either over or under fitting the training data. As with the ARIMA model, the parameter sets of the SVMs model with the lowest MSE value will be selected for use in the best fitting model. Thus, for the hybrid models, first the ARIMA worked as a pre-processor to filter the linear pattern of data sets. Then, the error term generated from the ARIMA model will be fed into the SVM in the hybrid models. The SVMs were performed to reduce the error function from the ARIMA.

Results and discussion

Application of the hybrid model to daily cases of COVID-19 in Malaysia

This section analysed the performance of the proposed model in respect to two aspects: (1) the performance of the proposed models against ARIMA and SVM models, and (2) the percentage improvement of the proposed models against ARIMA and SVM models. Since the World Health Organisation (WHO) was declared that COVID-19 is pandemic worldwide, the COVID-19 time series data sets have been widely studied. Next, the predictive capability of the developed novel models was compared using three well-known data sets of daily cases of COVID-19 in Malaysia- daily new positive cases data, daily new fatalities cases data and daily new recovered cases data–used to demonstrate the performance of the proposed model in terms of accuracy, effectively and accurately. All these data are reported from the 1st of October 2020 to 4th of November 2022 and retrieved from the COVIDNOW website at https://covidnow.moh.gov.my/

In the Table 1, the minimum value of the new death, new cases and new recovered are zero, 2600 and 1.8, respectively, while the maximum value of new cases, death and recovered cases are 33872.0, 592 and 33406 respectively. Similarly, the mean and median for the number of new cases, death and recovered cases are 6322.7, 47.51, 6415.5, where the parenthesis indicates the median in (3471, 11, 3447.0). While the first quartile value of daily new cases, death and recover cases are 1922, 4 and 1843 respectively. The third quartile value of number of daily new cases, death and recover cases are 6824, 58 and 6775 respectively. Moreover, the standard deviation of new cases, death and recover cases are 7097.8, 81.12 and 7058.3 respectively.

thumbnail
Table 1. Descriptive statistics of COVID-19 daily new cases, death and recovered cases of Malaysia.

https://doi.org/10.1371/journal.pone.0285407.t001

Part I (Linear Modelling)–the best ARIMA model for the daily new positive case dataset is derived from ARIMA (2,1,2). The best fitting ARIMA model for the daily new death case data set is ARIMA (1,1,2). Meanwhile, in the case of the daily new recovered cases dataset, the best ARIMA model is reported as ARIMA (0,1,1). The results of this ARIMA (p,d,q) model are summarized in Table 2. The estimates of all parameters are shown in Table 3. From this table, it can be observed that the p-values of all parameters are small. Therefore, the models were statistically significant for confirmed, recovered, and death cases, and could be used to forecast the future [33, 35].

thumbnail
Table 3. Parameter estimates of ARIMA (p,d,q) models and their p-values.

https://doi.org/10.1371/journal.pone.0285407.t003

Part II (Nonlinear Modelling)–In order to obtain an optimal machine learning algorithm, based on the concepts of support vector machine design and using pruning algorithms in R-programming software. For the daily new positive COVID-19 cases datasets, parameters γ = 2, C = 256, ε = 0.2 shows the smallest values of MSE i.e., 10321275 (see Table 4). Therefore, this parameters value was selected for use in the best-fitting model for the datasets of daily new positive COVID-19 cases. Whereas the smallest value of MSE is 1431.732 and 9885746 (Table 4), with parameters γ = 2, C = 256, ε = 0.2 are selected as the best-fitting model for daily new death cases of COVID-19 and daily new recovered cases of COVID-19, respectively.

thumbnail
Table 4. SVMs model parameters for the daily new COVID-19 cases datasets.

https://doi.org/10.1371/journal.pone.0285407.t004

New positive cases data forecasts

The daily new positive cases datasets series is recoded from the 1st of October 2020 to 4th of November 2022 (see Fig 2) contains 765 data points. The number of daily new positive cases of COVID-19 in Malaysia continued to show a significant increase starting in July 2021 dropped below 5,000 new cases. However, it’s continued an increased again around March-April 2022 to the maximum of 33,406.00. But this number showed a drastic decrease until November 4, 2022. The daily new positive cases of COVID-19 datasets, which is consider in this investigation and the COVID-19 datasets also have been extensively used with a vast variety of linear and nonlinear time series models including ARIMA, ANN and machine learning methods [810, 12, 14, 17, 2026, 34]. The study of the daily new positive cases of COVID-19 has crucial as an indication of the effectiveness of preventive measures that have been, are being and will be taken by the authorities in controlling the spread of this epidemic more effectively.

thumbnail
Fig 2. Malaysian daily new positive COVID-19 cases (1st of October 2020 to 4th of November 2022).

https://doi.org/10.1371/journal.pone.0285407.g002

Therefore, to investigate the performance of the proposal models on daily new positive cases of COVID-19 datasets, which is similar approach by Aisyah et al., [16] is used where the dataset is divided into two samples, known as training sample and testing sample. According to Aisyah et al., [16] and Nurul Hila et al., [17], the datasets should be divided into two (2) which are 70–80% the data for training and the remaining 20–30% for testing yields the greatest outcomes [36, 37]. The training data are used to assemble the models while testing data is used to evaluate based on the statistical measurement the forecasting performances of the models. Thus, in this study the daily new positive cases of COVID-19 data set are divided into two samples which the training data set and test data set. For training data sets consists of 612 observations from day 1 to day 612, which is 80% of the data sets from October 1st, 2020, to June 4th, 2022, exclusively used to formulate. The test sample data sets used about 153 observations from days 613–765 (20%) for the period of 5th June 2022- 4th November 2022 in order to evaluate the forecasting performance of proposed models.

The performance of the proposed model of the daily new positive COVID-19 cases datasets are shown in Table 5. The results were obtained from the proposed models in terms of measurement error terms, namely MSE and MAE have the smaller values of 42552.7137 and 90.34845 Similar results were also obtained from the testing datasets with values of 61223.474, 0.05633, 247.4337 and 146.9841 for MSE, MAPE, RMSE and MAE, respectively. Based on these numerical results, the findings are examined in more detail using figures as illustrated in Fig 3. This figure, illustrates the estimated values for the proposed model (test sample) of daily new positive COVID-19 cases. As can be seen from this figure, the proposed model line closely matches the actual data. As a further example, Figs 46 provide estimated values of our model for test data and ARIMA, SVM, and SVM models for COVID-19 cases. A comparison of the proposed model’s lines for the test sample (Fig 6) with ARIMA and SVM models clearly shows that the proposed model’s lines are somewhat similar to actual data. Comparing the performance of our proposal models with that of ARIMA and SVM models, this indicated that our proposal models are efficient, accurate, and precise. In addition, as in Fig 7, the number of daily new positive COVID-19 cases is plotted. From this figure, the daily new positive cases of COVID-19 for Malaysia are forecasted for the forthcoming three weeks.

thumbnail
Fig 3. Results obtained from the proposed model for daily new positive COVID-19 cases dataset.

https://doi.org/10.1371/journal.pone.0285407.g003

thumbnail
Fig 4. ARIMA model prediction of daily new positive COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g004

thumbnail
Fig 5. SVM model prediction of daily new positive COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g005

thumbnail
Fig 6. Proposed models prediction of daily new positive COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g006

thumbnail
Fig 7. Actual and three weeks ahead forecasted values of ARIMA, SVM and ARIMA SVM models for new cases of COVID-19 of the 80% training and 20% testing set.

https://doi.org/10.1371/journal.pone.0285407.g007

thumbnail
Table 5. Performance measures of the proposed model for daily new positive COVID-19 cases datasets.

https://doi.org/10.1371/journal.pone.0285407.t005

Based on Table 6, we further analysed the performance of the proposed models for the daily newly positive COVID-19 cases dataset by comparing at the percentage of MSE, MAPE, RMSE and MAE. The study hypothesis investigates assumptions of the proposed hybrid model (ARIMA-SVM) approach to single ARIMA and SVM models. The proposed model achieved a higher percentage of improvement in MAE, MAPE, MSE and RMSE compared to the ARIMA model with improvements of 63.03%, 62.86%, 79.52%, 54.74%, where the parenthesis indicates the SVM model that results in (62.34%, 63.47%, 77.70%, 52.78%). Therefore, based on these results (Tables 46 and Figs 37), it can be concluded that the proposed model that has been developed has produced higher accuracy as well as efficiency compared to results achieved by ARIMA and SVM

thumbnail
Table 6. Percentage improvement of the proposed models with other forecasting models (The COVID-19 cases of daily new positive cases).

https://doi.org/10.1371/journal.pone.0285407.t006

New deaths cases data forecasts

Besides the Malaysian daily new positive COVID-19 cases datasets, the Malaysian daily new deaths cases datasets are also considered and used to analyse the performance of the proposed models. Similar to the daily new positive data set as well as the daily new death case data set, the recording period of this data set from 1st of October 2020 to 4th of November 2022 (see Fig 8) contains 765 data points and is divided into two samples. As a result of the increase in the number of daily positive cases of COVID-19 reported, this also shows that there is a significant increase in the number of deaths around 600. In order to formulate the model, the training data set involves 612 observations (80%) from October 1, 2020- June 4, 2022, the test sample uses approximately 153 observations (20%) for the period June 5, 2022- November 4, 2022, to evaluate the prediction performance of the proposed model.

thumbnail
Fig 8. Malaysian daily new deaths COVID-19 cases (1st of October 2020 to 4th of November 2022).

https://doi.org/10.1371/journal.pone.0285407.g008

A similar approach to the daily new positive cases of the COVID-19 dataset was used to study the performance of the proposed model on the daily new death cases of the COVID-19 dataset, the dataset was divided into two samples, namely, training sample and testing sample. For the training sample, it represents approximately 80% of the daily new death cases for the COVID-19 dataset (involving 612 observations with the period October 1, 2020, until June 4, 2022). The remaining 20% is for the test sample, involving approximately 153 observations starting from June 5, 2022- November 4, 2022.

The performance of the proposed models using the daily new deaths COVID-19 cases datasets is first characterized by statistical measurement such as the MSE, MAPE, RMSE and MAE as shown in Table 7. The results for the training data from this table show that the proposed model gives the smallest values of 49.4459 and 3.53812 for MSE and MAE values, respectively, compared to ARIMA and SVM for MSE and MAE values, respectively, compared to ARIMA and SVM. The same trend also occurs on the test data where all the values of the statistical measures used show the smallest values compared to the ARIMA and SVM models.

thumbnail
Table 7. Performance measures of the proposed model for daily new deaths COVID-19 cases datasets.

https://doi.org/10.1371/journal.pone.0285407.t007

The study continues by investigating the estimated value of the proposed model for the daily new death COVID-19 case data set as illustrated in Fig 8. This figure clearly indicates that the proposed model line is almost no difference with the actual data. In addition, the estimated values of ARIMA, SVM and proposed models for test sample are plotted in Figs 911, respectively. Again, it clearly shows that our proposed model’s lines (Fig 12) for test sample are relatively closed to actual data compared to ARIMA and SVM models. This shows that the results of our proposed model are consistent with previous findings, which are efficient, accurate and precise compared to ARIMA and SVM models. In addition, as in Fig 12, the number of daily COVID-19 death cases is plotted. As a result of this figure, the daily new death cases of COVID-19 in Malaysia for the next three weeks are forecast to decrease, showing a downward trend in the next few weeks.

thumbnail
Fig 9. ARIMA model prediction of daily new deaths COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g009

thumbnail
Fig 10. SVMs model prediction of daily new deaths COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g010

thumbnail
Fig 11. Proposed models prediction of daily new deaths COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g011

thumbnail
Fig 12. Actual and three weeks ahead forecasted values of ARIMA, SVM and ARIMA SVM models for daily new deaths COVID-19 cases of the 80% training and 20% testing set.

https://doi.org/10.1371/journal.pone.0285407.g012

Here, a similar approach as in the daily new positive COVID-19 case dataset is used to investigate the performance of the proposed model for the daily new death COVID-19 case dataset through percentage MSE, MAPE, RMSE and MAE, as reported in the Table 8. Again, the percentage of improvement reveals that our proposed model produces better improvement for all statistical measures than the ARIMA and SVM models with results of 60.46%, 66.42%, 84.73%, 60.90%; improvement (58.93%, 64.45%, 82.81%, 58.52%) for MAE, MAPE, MSE and RMSE, respectively. The SVM model results reported in the parenthesis. The presented results (see Tables 7,8 and Figs 911, 13) clearly conclude that our proposed model has produced efficiently and accurately as well compared to ARIMA and ASV models.

thumbnail
Fig 13. Proposed models prediction of daily new deaths COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g013

thumbnail
Table 8. Percentage improvement of the proposed models with other forecasting models (The COVID-19 cases of daily new deaths cases).

https://doi.org/10.1371/journal.pone.0285407.t008

New recovered cases data forecasts

The last dataset considered in this investigation to study the performance of the proposed model, is the dataset of new daily recovered cases of COVID-19 in Malaysia. Predicting Malaysia’s daily new recovered COVID-19 cases is equally important as the two datasets discussed earlier. The data used in this paper contain daily observation from the 1st of October 2020 to 4th of November 2022, giving 765 data points in the time series. The same trend is also shown by the number of patients recovered from COVID-19 where there is a significant increase twice. Starting in July 2021, the number of recovered patients also shows an exponential increase until it reaches over 22,500.00 in August 2021 (the time series plot is given in Fig 14) and drop. However, around March—April 2022, the number of recovered COVID-19 cases increased again until a maximum of 33,872.00 and then decreased and it showed a relatively stable movement after that. This dataset also divided into two samples, i.e., the training data set and test data set. Like the previous datasets, training data set is implemented in order to formulate the model, which involved 612 observations (80%) from 1st October 2020-4th October 2022. Whereas, to evaluate the forecasting performance of the proposed model, the test sample uses approximately 153 observations (20%) for the period 5 June 2022- November 2022.

thumbnail
Fig 14. Malaysian daily new recovered COVID-19 cases (1st of October 2020 to 5th of November 2022).

https://doi.org/10.1371/journal.pone.0285407.g014

Table 9 presented the performance of the proposed model of the daily new recovered COVID-19 cases datasets based on training sample and test sample. The results in Table 9 clearly show that the proposed training sample model produces the smallest MSE and MAE values with 99205.699 and 136.8519, respectively compared to the MSE and MAE models of the ARIMA model and the SVM model. For the test sample also revealed that the same scenario as the training sample ie, produced the smallest MSE, MAPE, RMSE and MAE with values of 26108.02, 0.0396, 161.5797 and 104.1002, respectively compared to ARIMA and SVM as well.

thumbnail
Table 9. Performance measures of the proposed model for daily new recovered COVID-19 cases datasets.

https://doi.org/10.1371/journal.pone.0285407.t009

Meanwhile, the estimated value for the test sample of the proposed model for the dataset of daily new COVID-19 cases is depicted in Fig 15. Again, this figure clearly shows that the predicted value from the proposed models appear to be close to the actual values. A further investigation of the proposed model’s results is displayed in Figs 1618. These three figures (Figs 1618) reveal that the predicted values extracted from ARIMA, SVM, and the proposed model for the test samples seem to be close to the actual values. However, as we will see in Fig 8, these models are dominated by the proposed model i.e., they are closed to the true value. The number of daily new recovered COVID-19 cases is plotted as in Fig 19. In this figure, it’s clearly shown that the proposed model follows the original sharpness of the data. From this figure, the daily new recovered cases of COVID-19 for Malaysia are forecasted for the forthcoming three weeks and indicates that daily new recovered COVID-19 cases would increase in the upcoming days in Malaysia.

thumbnail
Fig 15. Results obtained from the proposed model for daily new recovered COVID-19 cases dataset.

https://doi.org/10.1371/journal.pone.0285407.g015

thumbnail
Fig 16. ARIMA model prediction of daily new recovered COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g016

thumbnail
Fig 17. SVM model prediction of daily new recovered COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g017

thumbnail
Fig 18. Proposed model prediction of daily new recovered COVID-19 cases dataset (test sample).

https://doi.org/10.1371/journal.pone.0285407.g018

thumbnail
Fig 19. Actual and three weeks ahead forecasted values of ARIMA, SVM and ARIMA SVM models for daily new recovered COVID-19 cases of the 80% training and 20% testing set.

https://doi.org/10.1371/journal.pone.0285407.g019

The performance of the proposed models for the daily new recovered COVID-19 cases datasets was further investigated for MSE, MAPE, RMSE and MAE in terms of the percentage, as reported in Table 10. By looking at the percentage of improvement for statistical measurements such as MSE, MAPE, RMSE and MAE, the results observed for the proposed model show a better improvement compared to ARIMA and SVM, respectively, with results of 73.12%, 74.62%, 90.38% and 68.99% improvement (71.99%, 73.67%, 89.11% and 66.99%) (where the results reported in the parenthesis are the SVM model). Therefore, based on the results, it can be concluded that the proposed model that has been developed has produced higher accuracy and efficiency compared to the results achieved by ARIMA and SVM models.

thumbnail
Table 10. Percentage improvement of the proposed models with other forecasting models (The COVID-19 cases of daily new recovered cases).

https://doi.org/10.1371/journal.pone.0285407.t010

Conclusion

Accuracy and efficiency in predicting the spread of COVID-19 is crucial but often difficult for decision makers, especially the frontline and authorities. Although the spread of COVID-19 seems to be endless, but many efforts in the development of time series models, research to improve the effectiveness of forecasting models has never stopped. Among them is the hybrid approach and one of the most popular categories of hybrid models that decompose time series into linear and non-linear forms. in this study, a hybrid model as a combination of predictions produced by linear and some non-linear is proposed. The proposed model was investigated using three well-known COVID-19 data sets, namely, daily new positive cases, daily new death cases and daily new recovered cases based on (1) performance of the proposed model and (2) percentage improvement compared to ARIMA and SVM models. The proposed model with cross-validation check based on MSE, RMSE, MAE and MAPE is the most accurate prediction compared to ARIMA and SVM models. The performance of the proposed models produces the smallest values of MSE, RMSE, MAE and MAPE for both training and testing datasets. This means, the predicted value from the proposed model is closer to the actual value. In other words, the proposed model can generate estimated values more accurately and efficiently. In addition, percentage improvement of the proposed models against the ARIMA and SVM models (where the results reported in the parenthesis is SVM model) are 63.03%, 62.86%, 79.52%, 54.74% improvement, (62.34%, 63.47%, 77.70%, 52.78%); 60.46%, 66.42%, 84.73%, 60.90% improvement (58.93%, 64.45%, 82.81%, 58.52%) and 73.12%, 74.62%, 90.38% and 68.99% improvement (71.99%, 73.67%, 89.11% and 66.99%) for daily new positive cases, daily new deaths cases and daily new recovered cases, respectively. Therefore, our proposed models showed higher degree of precision and could be recommended for forecasting COVID-19. It can be concluded that the proposed model can be the best and effective way to improve the prediction accuracy performance, especially to predict and prevent the infection of COVID-19 cases is a priority.

Limitations and future recommendation

An effort was made in this research study to forecast the total number of confirmed cases, fatalities, and recoveries of COVID-19 in Malaysia. Nowadays, the change in daily numbers of COVID-19 is affected by a very large number of factors, such as the population’s adherence to prevention measures, vaccination, social isolation, and new variants of the virus. As such, in order to improve future predictions and forecasts, it is imperative that the study of COVID-19 be taken into consideration in terms of (i) the clinical and behavioural aspects, and (ii) the possibility of underreporting cases, deaths, or delays in notifying as part of the study of COVID-19 in the future. Besides that, to improve the accuracy of the forecast in future work, investigation in SVM performance with different kernel functions and optimal hyper parameters of SVM forecasting model can be developed. Next, multi-step forecasts can be centralized in the future work since only one-step- ahead forecasting is considered in this paper. It is proven that multi-step forecasts can make the trading system much more realistic [38]. Finally, another approach, such as bootstrapping, can also be added as a hybridization of ARIMA and SVM [39]. Bootstrap is a reliable method given the lack of researchers adding this method in daily cases of COVID-19 forecasting. Many studies have shown that the bootstrap resampling technique provides a more accurate estimation [17, 4042].

Acknowledgments

The authors would like to express his gratitude to the Research Management Centre, Universiti Malaysia Terengganu (UMT) for partially grant of the journal publication fee as well as to the editors and the referees for careful reading and for comments which greatly improved the paper.

References

  1. 1. Mohd Tajuddin A., Muhamad Safiih L., Hisham AE, Sabreena S, Nor Fazila CM, Idham K, et al. Framework of Measures for COVID-19 Pandemic in Malaysia: Threats, Initiatives and Opportunities. Journal of Sustainability Science and Management. 2022; 17(3):8–18.3
  2. 2. Ali M, Khan DM, Aamir M, Khalil U, Khan Z. Forecasting COVID-19 in Pakistan. PLoS One. 2020;15(11): e0242762. pmid:33253248
  3. 3. WHO. (2020). Coronavirus disease (COVID-19) in Malaysia. Accessed on 23 May 2020, from https://www.who.int/malaysia/emergencies/coronavirus-disease-(covid-19)-in-Malaysia.
  4. 4. KKM. (2020b). COVID-19 Malaysia: Situasi Terkini 25 Oktober 2020. Accessed on 25 June 2022, from covid-19.moh. gov.my/archive:June_2022.
  5. 5. Gecili E, Ziady A, Szczesniak RD Forecasting COVID-19 confirmed cases, deaths and recoveries: Revisiting established time series modeling through novel applications for the USA and Italy. PLoS ONE, 2021;16(1): e0244173. https://doi.org/10.1371/journal.pone.0244173
  6. 6. Awwad FA, Mohamoud MA, Abonazel MR Estimating COVID-19 cases in Makkah region of Saudi Arabia: Space-time ARIMA modeling. PLoS ONE, 2021; 16(4): e0250149. https://doi.org/10.1371/journal.pone.0250149
  7. 7. Sahai AK., Rath N., Sood V., Singh MP. ARIMA modelling & forecasting of COVID-19 in top five affected countries. Diabetes & Metabolic Syndrome: Clinical Research & Reviews. 2020; 14(5), 1419–1427. pmid:32755845
  8. 8. Alzahrani SI., Aljamaan IA., Al-Fakih EA. Forecasting the Spread of The COVID-19 Pandemic In Saudi Arabia Using ARIMA Prediction Model Under Current Public Health Interventions. J Infect Public Health. 2020; 13: 914–919. pmid:32546438
  9. 9. Benvenuto D., Giovanetti M., Vassallo L., Angeletti S., Ciccozzi M. Application of the ARIMA model on the COVID-2019 epidemic dataset. Data in Brief. 2020; 105340. pmid:32181302
  10. 10. Ceylan Z. Estimation of COVID-19 prevalence in Italy, Spain, and France. Science of The Total Environment. 2020; 138817. pmid:32360907
  11. 11. Hernandez-Matamoros A., Fujita H., Hayashi T., Perez-Meana H. Forecasting of COVID19 per regions using ARIMA models and polynomial functions. Applied Soft Computing. 2020; 106610. pmid:32834798
  12. 12. Khan FM., Gupta R. ARIMA and NAR based prediction model for time series analysis of COVID-19 cases in India. Journal of Safety Science and Resilience. 2020; 1, 12–18.
  13. 13. Kayode O., Fahimah A., Mustapha R., Jacques D. Data Analysis and Forecasting of COVID-19 Pandemic in Kuwait Based on Daily Observation and Basic Reproduction Number Dynamics. Kuwait J. Sci. Special Issue. 2021; 1–28.
  14. 14. Rahman MS, Chowdhury AH., Amrin M. Accuracy comparison of ARIMA and XGBoost forecasting models in predicting the incidence of COVID-19 in Bangladesh. PLOS Glob Public Health. 2022; 2(5): e0000495. pmid:36962227
  15. 15. Singh S, Murali Sundram B, Rajendran K, Boon Law K, Aris T, Ibrahim H, et al. Forecasting daily confirmed COVID-19 cases in Malaysia using ARIMA models. J Infect Dev Ctries. 2020 Sep 30;14(9):971–976. pmid:33031083.
  16. 16. Aisyah WI WMN, Muhamad Safiih L, Razak Z, Nurul Hila Z, Abd . Aziz KAH, Elayaraja A, et al. Improved of Forecasting Sea Surface Temperature based on Hybrid ARIMA and Vector Machines Model. Malaysian Journal of Fundamental and Applied Sciences. 2021; 17:609–620.
  17. 17. Nurul Hila Z., Muhamad Safiih L., Maman Abdurachman D., Fadhilah Y., Mohd Noor Afiq R., Aziz D., et al. Improvement of Time Forecasting Models using A Novel Hybridization of Bootstrap and Double Bootstrap Artificial Neural Networks. Applied Soft Computing Journal. 2019; 105676.
  18. 18. Lee MC. Using support vector machine with a hybrid feature selection method to the stock trend prediction. Journal of Expert Systems with Applications. 2009; 36(8): 10896–10904.
  19. 19. Vapnik VN. The Nature of Statistical Learning Theory. 1st Edn., Springer-Verlag, New York, USA; 1995.
  20. 20. Sudheer C., Maheswaran R., Panigrahi BK Mathur S. A hybrid SVM-PSO model for forecasting monthly streamflow. Neural Computing and Applications. 2013; 24(6), 1381–1389.
  21. 21. Chakraborty T., Chakraborty AK., Biswas M., Banerjee S. & Bhattacharya S. Unemployment Rate Forecasting: A Hybrid Approach. Computational Economics. 2020; 57:183–201
  22. 22. Zhang GP. Time series forecasting using a hybrid ARIMA and Neural Network Model.Neurocomputing. 2003; 50: 159–175.
  23. 23. Terui N., Van Dijk H. Combined forecasts from linear and nonlinear time series models. International Journal of Forecasting. 2002; 18(3): 421–438.
  24. 24. Wang X., Meng M. A Hybrid Neural Network and ARIMA Model for Energy Consumption Forecasting. Journal Of Computers. 2012; 7(5): 1184–1190.
  25. 25. Pai PF. Lin C.-S. A hybrid ARIMA and Support Vector Machines Model in Stock Price Forecasting. International Journal of Management Science. 2005; 3(3): 497–505.
  26. 26. Lee N-U., Shim J-S., Ju Y-W. Park S-C. Design and Implementation of the SARIMA–SVM time series analysis algorithm for the improvement of atmospheric environment forecast accuracy. Soft Computing. 2017; 22(13): 4275–4281.
  27. 27. Hao Y, Xu T, Hu H, Wang P, Bai Y Prediction and analysis of Corona Virus Disease 2019. PLoS ONE. 2020; 15(10): e0239960. https://doi.org/10.1371/journal.pone.0239960
  28. 28. Roy S, Ghosh P Factors affecting COVID-19 infected and death rates inform lockdown- related policymaking. PLoS ONE. 2020; 15(10): e0241165. https://doi.org/10.1371/journal.pone.0241165
  29. 29. Mahdavi M, Choubdar H, Zabeh E, Rieder M, Safavi-Naeini S, Jobbagy Z, et al. A machine learning based exploration of COVID-19 mortality risk. PLoS ONE. 2021;16(7): e0252384. pmid:34214101
  30. 30. Singhal T. A Review of Coronavirus Disease-2019 (COVID-19). Indian J Pediatr. 2020; 87, 281–286. pmid:32166607
  31. 31. Moore Sarah. (2022, January 17). The Future of Pandemics. News-Medical. Retrieved on November 05, 2022 from https://www.news-medical.net/health/The-Future-of-Pandemics.aspx.
  32. 32. Naeem M, Yu J, Aamir M, Khan SA, Adeleye O, Khan Z. Comparative analysis of machine learning approaches to analyse and predict the COVID-19 outbreak. Peer J Comput. Sci. 2021; 17: e746 pmid:35036527
  33. 33. Qiang X, Aamir M, Naeem M, Ali S, Aslam A, Shao Z., Analysis and Forecasting COVID-19 Outbreak in Pakistan Using Decomposition and Ensemble Model. Computers, Materials & Continua. 2021; 68(1): 842–856.
  34. 34. Muhamad Safiih L., Nurul Hila Z., Mohd Tajuddin A., Vigneswary P., Mohd Noor Afiq R., Razak Z., et al. Improving the Performance of ANN-ARIMA Models for Predicting Water Quality in The Offshore Area of Kuala Terengganu, Terengganu, Malaysia. Journal of Sustainability Science and Management. 2018; 13(1): 27–37
  35. 35. Adhikari SP., Meng ., Wu Y-U., Mao Y-P., Ye R-X., Wang Q-Z., et al. Epidemiology, causes, clinical manifestation and diagnosis, prevention and control of coronavirus disease (COVID-19) during the early outbreak period: a scoping review. Infectious Diseases of Poverty. 2020; 9(1): 29 pmid:32183901
  36. 36. Ahmadini AAH, Naeem M, Aamir M, Dewan R, Alshqaq SSA and Mashwani WK Analysis and Forecast of the Number of Deaths, Recovered Cases, and Confirmed Cases From COVID-19 for the Top Four Affected Countries Using Kalman Filter. Front. Phys. 2021; 9:629320.
  37. 37. Alessa AA., Alotaibie TM., Elmoez Z., Alhamad HE. Impact of COVID-19 on Entrepreneurship and Consumer Behaviour: A Case Study in Saudi Arabia. The Journal of Asian Finance, Economics and Business. 2021; 8(5), 201–210.
  38. 38. Huck N. Pairs trading and outranking: The multi-step-ahead forecasting case. European Journal of Operational Research. 2010; 207(3): 1702–1716.
  39. 39. Nurul Hila Z Muhamad Safiih. The Performance of BB-MCEWMA Model: Case Study on Sukuk Rantau Abang Capital Berhad, Malaysia. International Journal of Applied, Business and Economic Research. 2016; 14(2): 63–77
  40. 40. Nurul Hila Z., Muhamad Safiih L. Nur Shazrahanim K. Modelling Moving Centreline Exponentially Weighted Moving Average (MCEWMA) with bootstrap approach: Case study on sukuk musyarakah of Rantau Abang Capital Berhad, Malaysia. International Journal of Applied, Business and Economic Research. 2016; 14(2): 621–638.
  41. 41. Muhamad Safiih L., Nurul Hila Z., Mohd Noor Afiq R., Hizir S. Double Bootstrap Control Chart for Monitoring SUKUK Volatility at Bursa Malaysia. Jurnal Teknologi. 2017; 79 (6):149–157.
  42. 42. Nisbet R., Elder J. Miner G. Chapter 11—Model Evaluation and Enhancement. In: Handbook of Statistical Analysis and Data Mining Applications. 2018; pp. 215–233. https://doi.org/10.1016/B978-0-12-374765-5.00013–9