Figures
Abstract
Although Kolmogorov-Smirnov (KS) statistic is a widely used method, some weaknesses exist in investigating abrupt Change Point (CP) problems, e.g. it is time-consuming and invalid sometimes. To detect abrupt change from time series fast, a novel method is proposed based on Haar Wavelet (HW) and KS statistic (HWKS). First, the two Binary Search Trees (BSTs), termed TcA and TcD, are constructed by multi-level HW from a diagnosed time series; the framework of HWKS method is implemented by introducing a modified KS statistic and two search rules based on the two BSTs; and then fast CP detection is implemented by two HWKS-based algorithms. Second, the performance of HWKS is evaluated by simulated time series dataset. The simulations show that HWKS is faster, more sensitive and efficient than KS, HW, and T methods. Last, HWKS is applied to analyze the electrocardiogram (ECG) time series, the experiment results show that the proposed method can find abrupt change from ECG segment with maximal data fluctuation more quickly and efficiently, and it is very helpful to inspect and diagnose the different state of health from a patient's ECG signal.
Citation: Qi J-P, Zhang Q, Zhu Y, Qi J (2014) A Novel Method for Fast Change-Point Detection on Simulated Time Series and Electrocardiogram Data. PLoS ONE 9(4): e93365. https://doi.org/10.1371/journal.pone.0093365
Editor: Daniele Marinazzo, Universiteit Gent, Belgium
Received: October 31, 2013; Accepted: March 5, 2014; Published: April 1, 2014
Copyright: © 2014 Qi et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This paper is supported by National Natural Science Foundation of China (No.61104154), and the Fundamental Research Funds for the Central Universities. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Detecting abrupt change from time series, called CP detection, has attracted considerable attention in the fields of data mining and statistics. CP detection [1], [2], [3], [4], [5] has been widely studied in many real-world problems, such as atmospheric and financial analysis [1], intrusion detection in computer networks [2], signal segmentation in data stream [3], as well as fault detection in engineering systems [4], [5]. A good method of CP detection is by comparing probability distributions of time series samples over past and present intervals [6], [7], in which a typical strategy is to trigger an alarm for a CP as two distributions are becoming significantly different. Various methods of change detection follow this statistical framework, including the CUSUM (cumulative sum) [7], the GLR (generalized likelihood ratio) [8], [9] and the change finder [4]. Generally, these approaches are limited by relying on pre-specified parametric models such as probability density models, autoregressive models, and state-space models. Therefore, these methods tend to be less flexible in real-world CP detection problems.
In community of statistics, some non-parametric approaches for CP detection have been explored, in which non-parametric density estimation is used for calculating the likelihood ratio [10], [11]. However, this kind of estimation is a hard problem [12], [13], and may not be promising in practice. As a nonparametric method, the KS statistic quantifies a distance between the empirical distribution function of the sample and the cumulative distribution function of the reference distribution, or between the empirical distribution functions of two samples [14], [15]. Moreover, the KS test is for the equality of continuous, one-dimensional probability distributions that can be used to compare a sample with a reference probability distribution, or to compare two samples. The null distribution of this statistic is calculated under the null hypothesis that the samples are drawn from the same distribution or that the sample is drawn from the reference distribution. The two-sample KS test is one of the most useful and general nonparametric methods for comparing two samples, as it is sensitive to differences in both location and shape of the empirical cumulative distribution functions of the two samples. Recently, non-parametric KS statistic and its modified version are broadly investigated on several of application fields. For example, the use of the KS statistic for testing hypotheses regarding activation in blood oxygenation level-dependent functional MRI data [16]; modeling the cumulative distribution function of rub-induced AE signals and quantifying the goodness of fit with the KS statistic, to offer a suitable signal feature for diagnosis [17]; abrupt change point (CP) detection from electroencephalography signal (EEG) [18], and gene expression time series database [19].
On the other hand, Wavelet Transform (WT) is another promising approach for CP detection. In the past decade, WT approach has emerged as an important mathematical tool for analyzing time series [20], [21], [22], [23], [24]. It has found applications in anomaly detection, time series prediction, image processing, and noise reduction [20], [24], [25], [26]. In particular, wavelets can represent general functions at different scales and positions in a versatile and sophisticated manner, so the data distribution features can be easily extracted from different time or space scales [26], [27]. The heart of wavelet analysis is Multi-Resolution Analysis (MRA), by which a signal can be decomposed into sub-signals of different size resolution levels [7], [27], [28]. The properties of wavelets such as localization, orthogonality, multi-rate filtering, are essential for analysis of non-stationary and transient signals. WT can represent a general function in terms of simple, fixed building blocks at different scales and positions. These building blocks are generated from a single fixed function called mother wavelet by translation and dilation operations [29], [30]. In addition, Haar Wavelet (HW), as a simpler WT, owns some attracting features including fast for implementation and ability to analyze the local feature. HW is a very useful to find discontinuities and high frequency changes in time series, and a potential candidate in modern electrical and computer engineering applications, such as signal and image compression, as well as abnormality detection from time series [7], [28].
However, most of these methods above are time-consuming, and not scalable to large-scale datasets due to their time complexity. Moreover, some of them, e.g., KS, is occasionally insensitive even invalid for less significant data fluctuation, especially when abrupt change occurs near two endpoint areas. To detect abrupt change from time series quickly and efficiently, a novel non-parametric method is proposed based on multi-level HW and a modified KS statistic. In this method, we combine superiorities of both KS statistic and HW methods, and try to find an abrupt change in terms of maximal data fluctuation existing between two adjacent segments of a diagnosed time series. This paper is organized as follows. Section II implements the integrated HWKS method in detail. First, the two BSTs termed TcA and TcD, are constructed by means of multi-level HW from a diagnosed time series. Then, the framework of HWKS method is implemented by introducing a modified KS statistic and two search criteria based on TcA and TcD. Last, two HWKS-based algorithms are designed to implement CP detection from the diagnosed time series. Section III evaluates the performance of HWKS by comparing KS, HW, and T methods, via simulated time series and real ECG datasets. Section IV gives conclusion from previous sections.
Method
The flow diagram of the integrated HWKS framework (Fig. 1) is composed of three parts. First, the two BSTs, TcA and TcD are constructed from a diagnosed time series. Second, abrupt CP is detected from root to leaf nodes of TcA in terms of a modified KS statistic and two search rules. Last, the performance of HWKS is evaluated by comparing with KS, HW, and T methods.
A. Construction of TcA and TcD
Like all wavelet transforms, multi-level HW decomposes a discrete signal into two sub-signals with half its length. One sub-signal is a running average or trend; the other sub-signal is a running difference or fluctuation. HW is performed in several stages or levels [28]. It can be described using scalar products with scaling signals and wavelets. The discrete signals are synthesized by beginning with a very low-resolution signal, successively adding on details to create higher resolution versions, and ending with a complete synthesis of the signal at the finest resolution. Generally, by using k-level HW, a discrete time series signal Z = {z1, z2,…, zN}, can be decomposed into the kth-level trend cAk, and k level fluctuations, i.e.,cD1, cD2,…, cDk, k = 1, 2, .., . As shown in Fig. 2, the k-level HW is the mapping Hk defined by [8],
(1)
The multi-resolution analysis (MRA) is the heart of waveletanalysis [23], [29], in terms of MRA, we can conceptualize the process of HW as a projection of time series with sizeN to total N different vectors vi and wi, termed as scalingsignals and wavelet basis vectors, respectively. Thediscrete signal Z, average and detail signals are expressible as:(2)
(3)
(4)Thereafter, the following equations can be obtained,
(5)
(6)
(7)where
is k-level Haar scaling signals,
is k-level Haar wavelets, |
| = |
| = N.
In addition, we can represent HW with k-level approximation and detail coefficient vectors by the following matrices, namely McA and McD:(8)where
,
. Suppose the size of a diagnosed sample Z is divisible k times by 2, we can further denote the jth element in cAk and corresponding averaged signal in Ak, as well as the jth element in cDk and corresponding detail signal in Dk as follows:
(9)
(10)
(11)
(12)where
, and
;
,
, and
. Therefore, a diagnosed Z can be decomposed into cA and cD matrices by means of k-level HW. Thereafter, as shown in Fig. 3, TcA and TcD are built in terms of McA and McD, as well as original elements in Z = {z1, z2,…, zN}. In TcA, and TcD, non-leaf nodes in different level are constructed from McA, and McD, respectively; and then leaf nodes are derived directly from the elements in Z. The constructions of TcA and TcD are implemented by Algorithm 1 in detail.
Algorithm 1.
Input: Z = {zi : 1 ≤ i ≤ N},a diagnosed time series
Output: two BSTs, TcA and TcD
Initiate the level of HW, k, (1 ≤ k ≤ log2(N));
Declare two matrices, McA and McD;
For i = 1 to k do
[cAi, cDi] = Call HW(Z, i);
McA(i) = cAi; McD(i) = cDi;
end
Construct TcA and TcD from McA and McD, as well as Z.
Output TcA and TcD
B. HWKS method based on a modified KS statistic
KS test is one of the most useful and general non-parametric methods for comparing two samples, because it is sensitive to those differences in both location and shape of the empirical cumulative distribution functions (e.c.d.f) of two samples [31], [32]. Suppose is a time series, we observe,
where
are discrete and centred i.i.d. random variables, and
is a noisy signal with unknown distribution. Thereafter, we can deal X as a normal time series with distribution function
, and Y as an abnormal time series with distribution function
. Then, we can assemble a diagnosed time series Z, and define it as below:
(13)To detect an abrupt CP from Z, a modified KS statistic is defined to evaluate the distribution distance between X and Z [15], [33], [34]:
(14)if a change point c occurs in Z, there exists a value zc satisfies
, and
, zc
[z1, zn],
.
As hypothesized and
are not available, but instead, the e.c.d.f of
and
can be derived from two time series X and Z. Then,
and
are defined by,
(15)
(16)where
and
count the proportion of the sample points below level x. For any fixed point
, the law of large numbers implies that
(17)
(18)where
and
are true underlying distribution of two time series X and Z, i.e. the proportion of the sample in the set
approximates the probability of this set. It is easy to say that this approximation holds uniformly over all
, i.e., the largest difference between
and
goes to 0 in probability. The key observation in KS test is that the distribution of this supremum does not depend on the ‘unknown’ distribution P in diagnosed Z, if P is continuous distribution. In addition, we have,
(19)where
is the c.d.f. of KS distribution [35].
In terms of the definition of non-leaf nodes in TcA in equations (9), we can denote the jth element of Z and define a new element
used in HWKS method as,
(20)
(21)where
is a non-leaf node of TcA,
is a new element defined in terms of
, and
,
;
, and
. Then, a revised KS statistic for HWKS is defined as:
(22)where
measures the distribution distance between X and Z at a selected node
in TcA, and larger value of
means that more significant change occurs in Z.
Thereafter, we define a KS test for X and Z as,(23)if null hypothesis is true then, the distribution of
can be tabulated as it depends only on n. Moreover, if n is large enough then the distribution of
is approximated by KS distribution. On the other hand, suppose
, since
and
are the true c.d.f. of X and Z, bylaw of large numbers the e.c.d.f,
will converge to
, and for large n we will have,
(24)If
fails then,
(25)Therefore, to test
we make a detection rule,
(26)where c depends on the level of significance
, and can be found by using KS distribution when n is large.
(27)If
, H0 is true i.e., no change point occurs. On the other hand, if
, then hypothesis H1 is true i.e., an abrupt change is detected.
C. HWKS-based CP Detection
To detect abrupt change from diagnosed Z, an optimal path needs to be obtained from root to leaf nodes in TcA accurately and quickly. Therefore, as shown in Fig. 4, two search criteria are introduced in terms of TcA and TcD. The first search criterion is defined based on TcA as follows:
(a) Criterion1 based on TcA, and (b) Criterion 2 based on TcD ensure that an optimal path of abrupt CP can be detected from root to leaf nodes in TcA.
Criterion 1.
Suppose the current non-leaf node in TcA we selected is , and its left-child and right-child nodes are
and
, respectively,
- if
and
hold true, then the left-child node
is selected to be involved into the current search path in TcA;
- if
and
hold true, then the right-child node
is selected to be involved into the current search path in TcA.
Proof.
In terms of the definitions of and
in equation (21) and (22),
, and
can be written as
(28)
(29)where
and
are two diagnosed points in accordance with cAk-1,2j-1 and cAk-1,2j in TcA. In terms of Criterion 1, if
holds true, as plotted in Fig. 5, it indicates that more significant distribution distance exists in the left sub-tree covered by
, than in the right one covered by
, and vice versa. That is, abrupt CP occurs in the left segment of Z with more probability than in the right one. On the other hand, If
is satisfied, it means that the distribution distance overtakes a critical value given in an identical data distribution.
The dotted red line refers to a supposed CP, namely Zc, the solid black line, and green one stands for the points of zk-1,2j, and zk-1,2j-1, respectively.
Criterion 1 guarantees that if abrupt CP occurs in Z, the left or the right sub-tree with bigger distribution distance is selected to be involved into the current search path, and then the other half part is discarded. Thereafter, an optimal search path can be detected from root to leaf nodes in TcA after about log2 (n) search steps. Unfortunately, if or
are true, then Criterion 1 is invalid for CP detection. Therefore, another search criterion is introduced based on TcD, and defined as below.
Criterion 2.
Suppose or
is satisfied, the non-leaf node
in TcD is selected, in accordance with the current non-leaf node
in TcA, with its left-child node
and right-child node
, respectively,
- if
holds true, then the left-child node
is selected to be involved into the current search path in TcA;
- if
holds true, then the right-child node
is selected to be involved into the current search path in TcA.
Proof.
In accordance with the definition of in equation (11),
and
can be written by
(30)
(31)where
,
,
;
,
,
, and
. In terms of equation (30), and (31),
, and
can reflect data fluctuation of two segments, namely ZL and ZR in Z covered by
and
, respectively. None loses of generalization, if
is true, it means that bigger data fluctuation exists in Z.L than in Z.R. That is, a potential abrupt change exists in ZL covered by
with more probability than in ZR covered by
. Therefore, in terms of criterion 2, left-child node
is selected to be involved into current search path in TcA, and vice versa.
In terms of two search criteria above, two HWKS-based algorithms are implemented to detect abrupt change from a diagnosed time series Z. In Algorithm 2, the distribution distance between X and Z is calculated in terms of a selected non-leaf node in TcA. In this function, the confidence interval is set by
, and
. For simplicity, we only output the nodes that the value of
overtakes
, otherwise output zero. In Algorithm 3, an optimal path is detected from root to leaf nodes in TcA in terms of two search criteria, and then an estimated CP is obtained from a diagnosed Z. The pseudocodes can be found in Algorithm 2 and 3 in detail.
D. Evaluation of HWKS
Many methods have been proposed for CP detection. In this part, the following typical methods are used to evaluate and verify the performance of the proposed HWKS method.
KS statistic [15].
In KS method, firstly, we divide a diagnosed sample data Z into two segments, namely, Zm = {z1, z2,…, zm}, and zN-m = {zm+1, zm+2,…, zN-m}. Then, KS statistic for these two segments is defined by,(32)where N is the size of the diagnosed sample Z; m is the size of segments Zm, that is the current diagnosed position in Z.
HW [28], [33].
In this method, the fluctuation coefficient vector is calculated by one-level HW from a diagnosed time series Z, and then an estimated CP can be found by comparing the values of elements in vector cD1. The elements in cD1 is defined as,
(33)where
. To find an abrupt change, a critical value
is given in terms of an identical data distribution. If
holds true, then an abrupt CP occurs in a diagnosed sample Z.
T-statistic[36].
T, also known as Welch'st-test, is used only when two population variances are assumed different (the two sample sizes may or may not be equal) and hence must be estimated separately. A diagnosed sample Z is divided into Zm = {z1, z2,…, zm} and ZN-m = {zm+1, zm+2,…, zN-m}. Then, T statistic is calculated as,(34)where
, and
are the sample mean of two segments in diagnosed Z, S* is unbiased estimator of standard deviation, and m, n is the size of two segments in Z.
Results and Discussion
First, we evaluate the performance of HWKS on the simulated time series datasets, the sensitivity, efficiency, and accuracy of HWKS is analyzed by comparing KS, HW, and T methods. Then, we apply HWKS, and other three methods, to distinguish normal and abnormal ECG segments from the assembled ECG time series samples, and diagnose the different states of health from a patient's abnormal ECG time series segments.
A. Analysis on simulated time series
In our simulations, the artificial time series are generated randomly in terms of normal distribution N(0,1), i.e., N(mean, u = 0, standard deviation, sd = 1), and then the normally distributed datasets is used for abrupt change detection. Specifically, each diagnosed time series sample of size N is composed of both a normal segment of size k, and an abnormal segment of size N-k, in which a designed abrupt change is contained by adding constant variation v to the normal random numbers of size N-k.
Single simulation on single CP test position.
First, CP detection is performed on single time series sample with single CP test position. The simulation results of CP detection are illustrated in Fig. 6, and the summarized analysis of error, and accuracy is shown in Table 1. For the proposed HWKS, it can detect the designed CP from samples of different sizes and CP test positions, with smaller error, and higher accuracy than HW, and T methods. For KS, it has the smallest averaged error in all four methods, but it has lower accuracy than HWKS, especially when sample size N is small. On the contrary, both of HW and T are worse, due to bigger error and lower accuracy than HWKS and KS. These simulation results indicate that HWKS has the best sensitivity and performance in four methods, especially HWKS is better than KS, due to smaller error and higher accuracy when abrupt change is located near the left or right boundary of samples with smaller size.
(A1) The estimated CP from diagnosed sample Z1, with N = 32, k = 5. (A2) The estimated CP from diagnosed sample Z2, with N = 64, k = 9. (A3) The estimated CP from diagnosed sample Z3, with N = 128, k = 113. (A4) The estimated CP from diagnosed sample Z4, with N = 256, k = 225.
Multiple simulations on single CP test position.
Second, we test HWKS and other three methods by multiple 600 simulations on single CP test position, with different N, and k. The representative results of CP detection are illustrated in Fig. 7, and the analysis of computation time, hit rate, error, and accuracy is summarized in Table 2. For the proposed HWKS, most of e-CPs are located near the designed CP position, with the shortest computation time, and the highest hit rate in all four methods, as well as smaller error, and higher accuracy than HW and T. For KS, to some extent, it is better than HWKS and HW for higher accuracy and smaller error; however, it needs much more computation time, and has lower hit rate than HWKS when abrupt change occurs near the left or right boundaries of samples with smaller size N. As for HW, it needs more computation time than HWKS and KS, and has the lowest hit rate and the biggest error in four methods. T is a method with the longest computation time in all four methods, and lower hit rate than HWKS and KS, although it has relatively higher accuracy than HWKS. These simulations show that, the proposed HWKS is a fast and efficient method, due to the shortest computation time and the highest hit rate in all four methods, as well as smaller error and higher accuracy than HW and T. In addition, HWKS has better sensitivity to less significant data fluctuation in sample with small size N, than KS, HW, and T, especially when CP is located near the left or right boundary.
For samples with N = 32, k = 5; N = 64, k = 9; N = 128, k = 113; and N = 256, k = 225, (A1)–(A4) the distribution of e-CP, (B1)–(B4) the PDF of e-CP, and (C1)–(C4) the averaged e-CP, by HWKS, KS, HW, and T, respectively.
Multiple simulations on different CP test positions.
Third, for each diagnosed sample group, multiple 100 simulations on different CP test positions are performed by the proposed HWKS and other three methods. In our simulations, for each N, we select different 16 CP test positions from the different parts of diagnosed samples, i.e., the CP test position is designed by ,
. The selected results of simulations on single CP with different test positions are shown in Fig. 8, including e-CP, hit rate, error, and accuracy. In addition, the simulation results for different samples of size from 23 to 210 are summarized in Table 3. In terms of computation time, hit rate, error, and accuracy, the trend analysis for different sample size N, as well as the histogram of the averaged analysis for different methods are plotted in Fig. 9.
(A) The results of multiple samples Z1, with N = 16; (B) the results of multiple samples Z2, with N = 32; (C) the results of multiple samples Z3, with N = 64; (D) the results of multiple samples Z4, with N = 128.
(A) The trend analysis for different sample size from N = 23 to 210, and (B) the histogram analysis for the averaged computation time, hit rate, error and accuracy. In (B), ‘1’ stands for HWKS, ‘2’ stands for KS, ‘3’ stands for HW, and ‘4’ stands for T.
For the proposed HWKS, it has the best performance for CP detection from samples Z of size N from 23 to 27, because of the shortest computation time, the highest hit rate, the smallest error, and the highest accuracy in all four methods. Meanwhile, HWKS is better than KS, HW, and T methods for samples Z of size N from 28 to 210, due to the shortest computation time, the smallest error, and the highest accuracy in all four methods, except that hit rate is slightly lower than KS and T. For KS, in general, it has shorter computation time, bigger hit rate, smaller error and higher accuracy than HW. However, KS has the lowest hit rate, the biggest error, and the lowest accuracy as N is below 25 in all four methods, which means that KS has worse sensitivity and performance for less significant data fluctuation, especially when N is smaller. For HW, it generally takes shorter computation time than T, whereas, it has the smallest hit rate, the biggest error and lowest accuracy in all four methods. For T, it takes the longest computation time, although bigger hit rate, smaller error and higher accuracy than KS and T. These results show that HWKS has better performance and sensitivity to less significant data fluctuation near the left and right boundary of samples with smaller size N and HWKS is an encouraging method for CP detection on simulated time series, due to shorter computation time, higher hit rate, smaller error, and higher accuracy than KS, HW, and T methods.
B. Analysis on ECG time series
To verify the performance of the proposed method further, we apply HWKS, and KS, HW, and T methods, to detect abrupt change from ECG time series provided by PhysioBank. In ECG experiments, we design the diagnosed ECG samples from different ECG datasets, including the MIT-BIH Normal Sinus Rhythm Database (NSRDB) [37], MIT-BIH Noise Stress Test Database (NSTDB) [38], and MIT-BIH Malignant Ventricular Arrhythmia Database (MVADB) [39], [40].
CP detection from assembled ECG samples.
First, we select a normal ECG dataset, 16265m from the NSRDB, and an abnormal ECG dataset, 118e00m from the NSTDB, and then assemble the diagnosed ECG samples from different segments in the 16265m and 118e00m. Specifically, we take the normal ECG segment of size m as Xm, and the abnormal segment of size n as Yn, respectively, and then assemble the diagnosed ECG sample Z = {Xm , Yn} = {x1,…, xm, y1,…, yn}. Meanwhile, we design another normal ECG segment from 16265m, i.e., X = {x1,…, xm+n}, as normal time series input.
In this ECG experiment, a single CP test position is arranged near the left and right boundary of the assembled ECG sample. For the assembled ECG sample of size from N = 29 to 214 with different CP position k, the results of CP detection from Z1–Z6 are illustrated in Fig. 10, and then the analysis of computation time, error, and accuracy are summarized in Table 4. Comparing with KS, HW, and T methods, the results show that the proposed HWKS can estimate CP position more quickly, and distinguish the normal and abnormal segments from the assembled ECG samples more efficiently, with smaller error and higher accuracy. For KS, it has smaller error and higher accuracy than HW and T, whereas, it takes much more computation time than HWKS, HW, and T, especially when sample size N gets bigger, meanwhile, KS is less sensitive for less significant statistic fluctuation, with bigger error near the right boundary. For HW, it is inefficient, because of the biggest error and lowest accuracy in all four methods. For T, it is also discouraging for longer computation time, bigger error and lower accuracy than HWKS and KS. Therefore, the proposed HWKS has the best performance in this ECG experiment out of all four methods.
(A1)–(A6) the assembled ECG sample Z1–Z6; (B1)–(B6),(C1)–(C6) ,(D1)–(D6) ,(E1)–(E6) the e-CP detected from Z1–Z6, by HWKS, KS, HW, and T, respectively; (F1)–(F6) the diagram analysis for the computation time, (G1)–(G6) the error of e-CP, and (H1)–(H6) the accuracy for Z1–Z6, respectively. In (F)-(H), ‘1’ stands for HWKS, ‘2’ stands for KS, ‘3’ stands for HW, and ‘4’ stands for T.
CP detection from abnormal ECG samples.
To verify the performance of CP detection further, we apply the proposed HWKS, and KS, HW and T to analyze the abnormal ECG time series directly. In this part, we select the abnormal ECG segment from 118e00m in the NSTDB, i.e., Z = {y1,…, yn}, as a diagnosed ECG sample. Then, we take another normal ECG segment from 16265m in the NSRDB, i.e., Z = {Xn } = {x1,…, xn }, as normal input signal. To some extent, the distance of e.c.d.f can partly reflect the statistical fluctuation. Therefore, we take this variable as an indicator of the data fluctuation between two ECG segments divided by e-CP position. The results of CP detection, including the e-CP position, distance of e.c.d.f, and computation time, are plotted in Fig. 11, and summarized in Table 5.
(A1)–(A6) the abnormal ECG sample Z1–Z6; (B1)–(B6), (C1)–(C6), (D1)–(D6), (E1)–(E6) the e.c.d.f derived from two segments of Z1–Z6, by HWKS, KS, HW, and T, respectively; (F1)–(F6) the diagram analysis of the distance of e.c.d.f, and (G1)–(G6) the computation time of HWKS, KS, HW, and T in Z1–Z6, respectively. In (F)–(G), ‘1’ stands for HWKS, ‘2’ stands for KS, ‘3’ stands for HW, and ‘4’ stands for T.
For abnormal ECG samples Z1–Z6 with different size N from 210 to 215, HWKS can detect abrupt change position, and then divide the original ECG sample into two parts, with the shortest computation time out of four methods, and bigger distance of e.c.d.f than HW and T methods. For KS, it can detect CP with the maximal distance of e.c.d.f; however, it needs longer computation time than HWKS, HW and T, especially for ECG sample with big size N. On the other hand, for HW, it is inefficient, due to smaller distance of e.c.d.f than HWKS and KS. T is also inefficient, because of longer computation time than HWKS, HW, the smallest distance of e.c.d.f, and the invalid e-CP position for most of the abnormal ECG samples.
Especially, the results of CP detection from Z1–Z3 plausibly indicate that, a patient seems recovering from abnormal state of health, after overtaking the critical e-CP position detected by HWKS. On the contrary, the results from Z4–Z6 suggest that, a patient is encountering a risky situation from the former state of health, after going through the vital e-CP position. These results indicate that HWKS can capture abrupt change position from a diagnosed ECG sample quickly and efficiently, and the detected CP is very useful to find a critical time from ECG time series, where a patient might encounter an important conversion between two different states of health. Therefore, HWKS is an efficient and encouraging method for detecting abrupt change from abnormal ECG time series, and it is very meaningful in inspecting and diagnosing different states of health from diagnosed ECG time series more quickly and efficiently.
Conclusion
In this paper, based on HW and a modified KS statistic, a novel HWKS method is proposed for CP detection from large-scale time series. First, two BSTs are constructed from a diagnosed time series by means of multi-level HW method, the framework of HWKS method is implemented by introducing a revised KS statistic and two search criteria based on TcA and TcD; and then two HWKS-based algorithms are designed to detect an optimal path from TcA in terms of two search criteria. Second, the performance of HWKS is analyzed on simulated time series; the simulations show that HWKS is more sensitive and efficient than KS, HW, and T methods, especially when CP occurs near the left or right boundary with less significant data fluctuation in time series of small size. Last, HWKS is applied to analyze abrupt change on both assembled and abnormal ECG datasets. The results indicate that HWKS can successfully detect abrupt change, and distinguish normal and abnormal ECG segments from assembled ECG samples. In addition, HWKS can estimate an abrupt CP from abnormal ECG segments with different time-scale, and then divide it into two adjacent parts with maximal data fluctuation; therefore, it is very useful to diagnose a patient's different states of health from an abnormal ECG segment more quickly and efficiently. In conclusion, HWKS is a novel and efficient method for fast CP detection; it is a very powerful and promising tool to find useful information from large-scale time series databases.
Acknowledgments
I would like to thank my supervisor Prof. Qing.Zhang in the Australia E-Health Research Centre, CSIRO for his assistance, support and advice on this paper. Meanwhile, I would like thank Prof. Mohan.Karunanithi in the Australia E-Health Research Centre, CSIRO for helps to revise this paper.
Author Contributions
Conceived and designed the experiments: Jin-peng Qi. Performed the experiments: Jin-peng Qi YZ. Analyzed the data: YZ Jie Qi. Contributed reagents/materials/analysis tools: Jie Qi. Wrote the paper: Jin-peng Qi QZ YZ Jie Qi.
References
- 1. Bolton RJ, Hand DJ (2002) Statistical fraud detection: A review. Statistical Science 235–249.
- 2.
Ide T, Kashima H (2004) Eigenspace-based anomaly detection in computer systems. Proceedings of the 10th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM.
- 3.
Kawahara Y, Yairi T, et al. (2007) Change-point detection in time-series data based on subspace identification. Data Mining, 2007. ICDM 2007. Seventh IEEE International Conference on, IEEE.
- 4. Yamanishi K, Takeuchi J-I, Williams G, Milne P (2004) On-line unsupervised outlier detection using finite mixtures with discounting learning algorithms. Data Mining and Knowledge Discovery 8: 275–300.
- 5. Murad U, Pinkas G (1999) Unsupervised profiling for identifying superimposed fraud. Principles of Data Mining and Knowledge Discovery: Springer 251–261.
- 6.
Basseville ME, Nikiforov IV (1993) Detection of abrupt changes: theory and application.
- 7. Darkhovski BS (1994) Nonparametric methods in change-point problems: A general approach and some concrete algorithms. Lecture Notes-Monograph Series 99–107.
- 8.
Gustafsson F (2000) Adaptive filtering and change detection: Wiley New York.
- 9. Gustafsson F (1996) The marginalized likelihood ratio test for detecting abrupt changes. Automatic Control, IEEE Transactions on 41: 66–78.
- 10. Sharifzadeh M, Azmoodeh F, Shahabi C (2005) Change detection in time series data using wavelet footprints. Advances in Spatial and Temporal Databases: Springer 127–144.
- 11.
Brodsky BE, Darkhovsky BS (1993) Nonparametric methods in change point problems: Springer.
- 12. Huang J, Smola A-J, Gretton A, Borgwardt KM, Schölkopf B, et al. (2007) Correcting sample selection bias by unlabeled data. Advances in neural information processing systems 19: 601–608.
- 13.
Hardle W (2004) Nonparametric and semiparametric models: Springer Verlag.
- 14. Lin H-D (2007) Automated visual inspection of ripple defects using wavelet characteristic based multivariate statistical approach. Image and Vision Computing 25: 1785–1801.
- 15. Simard R, L'Ecuyer P (2011) Computing the two-sided Kolmogorov-Smirnov distribution. Journal of Statistical Software 39: 1–18.
- 16. Aguirre GK, Zarahn E (1998) A critique of the use of the Kolmogorov-Smirnov (KS) statistic for the analysis of BOLD fMRI data. Magnetic Resonance in Medicine 39: 500–505.
- 17. Hall L, Mba D (2004) Acoustic emissions diagnosis of rotor-stator rubs using the KS statistic. Mechanical Systems and Signal Processing 18: 849–868.
- 18. Fell J, Kaplan A, Darkhovsky B, Röschke J (2000) EEG analysis with nonlinear deterministic and stochastic methods: a combined strategy. Acta Neurobiologiae Experimentalis 60: 87.
- 19. Wang Y, Wu C, Ji Z, Wang B, Liang Y (2011) Non-parametric change-point method for differential gene expression detection. PloS one 6: e20060.
- 20. Alarcon-Aquino V, Barria JA (2001) Anomaly detection in communication networks using wavelets. IEE Proceedings-Communications 148: 355–362.
- 21. Khalil M, Duchêne J (1999) Detection and classification of multiple events in piecewise stationary signals: comparison between autoregressive and multiscale approaches. Signal processing 75: 239–251.
- 22. Kobayashi M (2001) Wavelets and their applications in industry. Nonlinear Analysis: Theory, Methods & Applications 47: 1749–1760.
- 23.
Percival DB, Walden AT (2006) Wavelet methods for time series analysis: Cambridge University Press.
- 24. Salam M, Mohamad D (2008) Segmentation of Malay Syllables in connected digit speech using statistical approach. International Journal of Computer Science and Security 2: 23–33.
- 25. Qi J, Ding Y, Zhu Y, Wu Y (2011) Kinetic theory approach to modeling of cellular repair mechanisms under genome stress. PloS one 6: e22228.
- 26.
Tseng VS, CH Chen, Chen CH, Hong TP (2006) Segmentation of time series by the clustering and genetic algorithms. Data Mining Workshops, 2006. ICDM Workshops 2006. Sixth IEEE International Conference on, IEEE.
- 27. Alarcon-Aquino V, Barria J (2009) Change detection in time series using the maximal overlap discrete wavelet transform. Latin American applied research 39: 145–152.
- 28.
Walker JS (2002) A primer on wavelets and their scientific applications: CRC press.
- 29. Percival DB (2008) Analysis of geophysical time series using discrete wavelet transforms: An overview. Nonlinear Time Series Analysis in the Geosciences: Springer 61–79.
- 30.
Yamanishi K, Takeuchi J-i (2002) A unifying framework for detecting outliers and change points from non-stationary time series data. Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining, ACM.
- 31. Brown JR, Harvey ME (2008) Rational Arithmetic Mathematical Functions to Evaluate the Two-Sided One sample K-S Cumulative Sample Distribution. Journal of Statistical Software 26: 1–40.
- 32. Wang J, Tsang WW, Marsaglia G (2003) Evaluating Kolmogorov's distribution. Journal of Statistical Software 8: 1–4.
- 33. Raimondo M, Tajvidi N (2004) A peaks over threshold model for change-point detection by wavelets. Statistica Sinica 14: 395–412.
- 34. Stephens MA (1974) EDF statistics for goodness of fit and some comparisons. Journal of the American statistical Association 69: 730–737.
- 35. Kifer D, Ben-David S, Gehrke J (2004) Detecting change in data streams. Proceedings of the Thirtieth international conference on Very large data bases-Volume 30, VLDB Endowment 180–191.
- 36. Sørlie T, Tibshirani R, Parker J, Hastie T, Marron J, et al. (2003) Repeated observation of breast tumor subtypes in independent gene expression data sets. Proceedings of the National Academy of Sciences 100: 8418–8423.
- 37. Goldberger AL, Amaral LA, Glass L, Hausdorff JM, Ivanov PC, et al. (2000) Physiobank, physiotoolkit, and physionet components of a new research resource for complex physiologic signals. Circulation 101: e215–e220.
- 38. Moody GB, Muldrow W, Mark RG (1984) A noise stress test for arrhythmia detectors. Computers in Cardiology 11: 381–384.
- 39.
Greenwald SD (1986) The development and analysis of a ventricular fibrillation detector, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science.
- 40. Hodges A, Strand AD, Aragaki AK, Kuhn A, Sengstag T, et al. (2006) Regional and cellular gene expression changes in human Huntington's disease brain. Human molecular genetics 15: 965–977.