Figures
Abstract
Source number estimation methods for single channel signal have been investigated and the improvements for each method are suggested in this work. Firstly, the single channel data is converted to multi-channel form by delay process. Then, algorithms used in the array signal processing, such as Gerschgorin’s disk estimation (GDE) and minimum description length (MDL), are introduced to estimate the source number of the received signal. The previous results have shown that the MDL based on information theoretic criteria (ITC) obtains a superior performance than GDE at low SNR. However it has no ability to handle the signals containing colored noise. On the contrary, the GDE method can eliminate the influence of colored noise. Nevertheless, its performance at low SNR is not satisfactory. In order to solve these problems and contradictions, the work makes remarkable improvements on these two methods on account of the above consideration. A diagonal loading technique is employed to ameliorate the MDL method and a jackknife technique is referenced to optimize the data covariance matrix in order to improve the performance of the GDE method. The results of simulation have illustrated that the performance of original methods have been promoted largely.
Citation: Dong Z, Hu J, Du B, He Y (2016) Improvement of Source Number Estimation Method for Single Channel Signal. PLoS ONE 11(10): e0164654. https://doi.org/10.1371/journal.pone.0164654
Editor: Houbing Song, West Virginia University, UNITED STATES
Received: April 25, 2016; Accepted: September 28, 2016; Published: October 13, 2016
Copyright: © 2016 Dong et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The problem of single channel source number estimation (SCSNE) is being widely investigated in many fields, e.g., image processing, fiber communication [1–3], nondestructive testing [4] and single channel blind signal separation (SCBSS). In recent years, SCBSS has been considered as one of the most challenging research topics in these areas [5–8]. Numerous algorithms have been carried out to solve the SCBSS problem, such as multiple signal classification (MUSIC)[9], estimating signal parameters via rotational invariance techniques (ESPRIT)[10], and independent component analysis (ICA)[11]. However, the performance of these blind source separation (BSS) algorithms and signal spectrum estimation methods could be significantly deteriorated with inaccurate estimation of source number.
In order to process the single channel signals, it is acceptable to expand the data dimensions and convert the single channel data to a multi-channel form. Then many long-tested array signal processing algorithms can be used for references. Nowadays, multiple sampling method[12], the signal sparse representation[13], delay process [14] and many other methods can be used to extend the size of the data. Among them, the multiple sampling method needs cooperation of the data sample front end. Sparse decomposition method costs a high computational complexity, and not all signals are provided with sparse characteristics. Delay process is relatively simple and low complexity; however it needs relatively more snapshots.
Many excellent algorithms of source number estimation have been found in the literatures, such as the methods based on hypothesis testing method [15, 16], information theoretic criteria (ITC) based approaches [17] and Gerschgorin’s disk estimation (GDE) method [18]. The hypothesis testing based method has to set an artificial threshold, which does not constitute an easy decision under some circumstances. Methods based on ITC are established upon the differences between eigenvalues of signal and noise, mainly represented by Akaike information criteria (AIC) [17] and minimum description length (MDL) [19]. Although the computational complexity is relatively low, they can not work with colored noise. GDE method can deal with the colored noise, but its performance exacerbates at low SNR condition.
In addition to the above methods, Keyong Han proposed a method which is based on jackknife technique for array signal source number estimation [20]. The jackknife technique was introduced to reduce the estimator bias in the general context by Quenouile [21]. It is a resampling method that is most frequently used [22]. It has received widely researched in many applications because of its simplicity [22–25]. A method has been proposed which exploits eigenvectors instead of sample eigenvalues to detect the source number in array signal processing [26]. Nonetheless, it is not quite appropriate for the single channel application. Jayme G. A. Barbedo presented a two-stage procedure to determine the number of sources present in a single-channel music signal [27]. Lei Huang proposed a MMSE-Based MDL source number estimator with the prior knowledge of training sequence [28].
Although the AIC method achieves high detection performance at low SNR, it is not consistent. Owing to its properties of simplicity and consistency, the MDL estimator has become the standard tool for estimating the number of sources [29]. This paper detailed the application of MDL and GDE methods to estimate the source number of single channel received signal. The single channel data is converted into a multi-channel form by delay process. Simulation results indicate that the MDL method cannot estimate the source number effectively when the received signal is contained with colored noise. The GDE method underperformance at low SNR, though it can manage with colored noise. To improve the detection performance of these methods, a diagonal loading technique is introduced for the MDL method and the jackknife technique is used to optimize the data covariance matrix for the GDE. The simulation results show that the method put forward in this paper can effectively get the source number of the single-channel received signal and the betterment presented in this paper obtains a remarkable progress.
The remainder of this paper is structured as follows: Section 2 introduces the model of the single channel received signal. Section 3 shows the single channel dimension expansion method. Section 4 describes the source number estimation algorithms and the improvement approaches proposed by this paper. Section 5 shows the experimental results to verify the performance of the improved methods, which is followed with the conclusions in Section 6.
Signal Model
A multi-channel received signal model with p channels and q source signals is outlined as follow [30–33].
(1)
x(t) = [x1(t), …, xp (t)]T is the observed data. A = [a(θ1), …, a(θq)], s(t) = [s1(t), …, sq (t)]T and n(t) = [n1(t), …, np (t)]T are the steering matrix, q × 1 source waveform vector and noise vector, respectively. The noise covariance is expressed as
.
is an unknown scalar and I is an identity matrix.
While in the single channel condition, only one data can be observed at every time point. The signal model becomes as[34, 35]
(2)
where X(t) = [x(1), x(2), …, x(m)] represents the observed data, t indicating the observation time. A = [a1, a2, …, am] is the mixing matrix. S(t) = [s1(t), s2(t), …, sm(t)]T is a source signal matrix. Noise and signal are independent. The parameter estimation of single channel signal is an underdetermined problem. It is difficult to process the single channel signal directly.
On the other hand, the estimation of source number in array signal processing is relatively simple and convenient. Therefore, it is a considerable approach to convert the single channel signal to an array signal processing problem.
Construction of Multi-Channel
The single channel received data is a one dimensional matrix. In order to make use of the multi-channel source number estimation algorithms, it is essential to expand the dimension of the data matrix. This paper uses delay process to construct the multi-channel data matrix from the single channel received data. Assuming that the single-channel data are denoted as y(n), n = 1, 2, …, L, the received signal can be expressed as follow with delay process.
Therefore, a N channels received data is formed.
(4)
where d describes the delay length of each channel. N is the total number of channels, which could not be less than the number of sources.
The data of each constructed channel should be passed through a filter which intends to have a more realistic respond of received channel. Set the frequency response of each filter as
(5)
where, |H0 (ejω0)| represents the amplitude frequency response of a prototype FIR filter. And φi(ω) denotes phase frequency response of each channel. Therefore, the final multi-channel data matrix can be expressed as follow.
(6)
where, hi, i = 1, 2, …, l are the impulse response functions of the filters for each channel. With the process mentioned above, a single channel received signal with 1 × L received data is transformed to a multi-channel signal with N × (d + l– 1) dimensions.
Source Number Estimation Algorithms
MDL method
Assume that the noise and source signals are mutually independent and unrelated. Then the covariance matrix of the observed signal can be rewritten as follow.
(7)
where, Rs = E{S(t)ST (t)} is the signal covariance matrix and σ2I represents the covariance matrix of the noise. Transform RX by eigenvalue decomposition (EVD) to obtain its eigenvalues.
(8)
where, λi, i = 1, …, p are the eigenvalues and ui, i = 1, …, p are the corresponding eigenvectors.
On account of the noise and signal are independent, the eigenvalues of RX can be decomposed as λ1 = μ1 + σ2, λ2 = μ2 + σ2, …, λn = μn + σ2, λn+1 = λn+2 = ⋯ = λm = σ2. Ideally, the eigenvalues of signal are far greater than that of noise. The source number is equal to the amount of the eigenvalues which are larger than a preset threshold.
However, due to the limited number of snapshots and the impact of multipath propagation, the eigenvalues of noise and signal are promiscuous. Some criteria have to be introduced to estimate the number of sources precisely. MDL is utilized to select the model depending on the concept of the shortest code length, proposed by Rissanen [19, 36]. The estimation function of MDL can be show as follow.
(9)
where,
represents the maximum likelihood estimation of the parameters Θ and k is freedom degrees of the parameter vector Θ. N is the number of samples and
indicates the joint probability density of X. The first term of the right end denotes model parameter estimation function. The second term represents the penalty function. When MDL are applied as source number estimates criteria, the model is expressed as follows[37]
(10)
where
(11)
And the number of the source can be yielded by minimizing the function of MDL.
The method of MDL estimates the source number by the difference of eigenvalues between the signal and the noise. Its computational complexity is relatively low, but it cannot process the signal with colored noise.
This paper brings in the diagonal loading technique to overcome the influence of the colored noise [38–40].
(13)
where, λi, i = 1, 2, …, p are the original eigenvalues of RX, and λDL is the loading value. βi is the final eigenvalues with diagonal loading. Diagonal loading process produces little effect to the bigger eigenvalues, which are corresponding to source signals. And the smaller eigenvalues corresponding to the noise will converge to near the loading value λDL. Therefore, by diagonal loading process, the noise eigenvalues are approximately equal and the effect of this process is equivalent to whitening the colored noise.
The choice of loading value λDL has a great influence on this method. A small value of λDL plays little improvement to the estimation and an oversize λDL may destroy the difference of eigenvalues between noise and signal.
Therefore, the loading value λDL should satisfy the follow equations.
(14)
where λN relates to the noise eigenvalue, and λS represents to the signal eigenvalue. To meet this condition, a feasible selection of λDL is described as[38]
(15)
Then the eigenvalues of RX are transformed to follow by diagonal loading.
GDE method
For a p × p matrix R, rij is the element of row i and column j. The sum of the other elements in the i row except the i element is defined as
(17)
The ith disk represents the circle with center of rij and radius of Ci in the complex plane.
Gerschgorin has proven that eigenvalues of matrix R are included in the region of disk Oi, i = 1, …, p. So that the eigenvalues of R satisfying at least one of the following inequality.
The signal covariance matrix is expressed as follow by EVD.
(20)
Where U is a p–order unitary matrix constructed by eigenvectors of the covariance matrix R, U = [u1, u2, …, up], UUH = I. Λ is a p-order diagonal matrix whose diagonal elements are the eigenvalues of matrix R, Λ = diag [λ1, …, λp]. R can be rewrote in the form of block matrix.
Among them, R1 is a p– 1 order submatrix obtained by deleting the last row and column of R; r is a column vector constructing by the former p– 1 elements in the p column of R, that is r = [r1p,…, r(p-1)p]T. R1 can be transformed as follow by EVD.
(22)
where, U1 is a p–1 order unitary matrix composed by the eigenvectors of R1,
. Λ1 is a diagonal matrix with eigenvalues of R1 being the diagonal elements,
, where the eigenvalues are sorted in descending order. The relationship between the eigenvalues of R1 and R can be written as follow.
(23)
Then a p order matrix Ud is constructed.
Transformed covariance matrix R with Ud.
From the above equation, the radius of the former p– 1 Gerschgorin’s disk of matrix S can be written as
(26)
The noise eigenvectors of matrix R1 are orthogonal with the column vectors of A1, so Ci = 0, i = q +1, …, p − 1. But the signal eigenvectors are not orthogonal with A1 and the Rs is full rank matrix, so Ci ≠ 0, i = 1, …, q. Therefore, the covariance matrix S can be further simplified.
The Gerschgorin disks of S are split into two groups. The one with nonzero radius and larger center point is belong to the actual signal and the others is corresponding to the noise. Therefore, the number of nonzero Gerschgorin disk radius in S is equal to the estimated source number. In practical applications, due to the limited number of snapshots, there will be some bias and the disk radiuses of noise are not always zero. So GDE method is put in place to determine the number of sources.
(28)
where, D(N) is the adjustment factor with a value between 0 and 1. Calculating Eq (27) from k = 1 to k = p, when GDE(k) come up with negative value first time, the calculation will be stopped and the estimated number of sources is k − 1.
The GDE method gets the source number by utilizing the size of the radius of the transformed covariance matrix. Comparing with methods that based on ITC, it has certain superiority of keeping a well-behaved in the condition of colored noise.
However, the GDE method is restricted by its poor performance at low SNR. This paper introduced jackknife technique to optimize the data covariance matrix. Then the influence of noise can be reduced to enhance the performance of GDE at low SNR.
Jackknife technique is an effective strategy utilized in the statistical area. It can take full advantage of the received data to achieve more accurate detection and estimation [20]. For jackknife, the data structure is reconstructed by deleting a part of data every time and it can reduce the bias of the estimator.
A N × d data matrix has been obtained from a 1 × L single-channel data by delay process.
(29)
where, Y is regarded as a set with N elements, Y = [Y1, Y2, …, YN]T. M elements are chosen randomly from Y to form a subset X.
(30)
Where X ⊂ Y, Xj ∈ Y, j = 1, 2, …, M, and M = rN, 0.5 ≤ r < 1.
is the covariance matrix of X.
Repeating the above process K times, a series of covariance matrixes are obtained, Rj, j = 1, 2, …, K. Calculate the average of these matrices.
(32)
where,
is the optimized covariance matrix, which will be used to estimate the source number by GDE.
Experimental Studies
This section gives some experimental results to evaluate the performance of each source number estimation method mentioned above.
The first experiment compares the estimation performance of MDL and GDE when the received signal is contained with white Gaussian noise. Assuming that the single channel received signal appears with 3 independent source signals, which are constructed in Matlab environment. The observation data length is set to be L = 5000, and the delay is d = 600. Through the use of delay process, the number of virtual channel is M = 8. Consequently, the single-channel data is expanded to a 8×600 data matrix. The SNR of the received signal is changed from -20dB to 20dB, with 2dB increments. The experiment with each condition is repeated with 500 times. The first experiment result is shown in Fig 1.
It can be inferred from Fig 1 that both MDL and GDE methods achieve a good estimation performance with white Gaussian noise. However, due to the fact that the Gerschgorin disk radius are influenced by noise relatively easy, the performance of GDE method is slightly worse than that of MDL at low SNR.
The second experiment compared the estimation performance of MDL and GDE with colored noise. The condition of this experiment is the same as the first one, except that the white noise is replaced with colored noise. The 500 experimental results of Monte Carlo are provided in Fig 2. It shows that the method of MDL has lost its estimation ability with colored noise, but GDE method still keeps a good performance.
The third experiment compared the estimation performance of MDL, improved MDL, GDE and improved GDE with colored noise. The experimental condition is set the same as the first and second ones. Fig 3 shows the detection probability of these methods under different SNR.
It can come to conclusion that the boosting put forward by this paper makes the performance of MDL and GDE methods get improvement largely. The improved MDL method proposed by this paper can eliminate the effect of colored noise. The GDE method keeps a superior performance at low SNR.
Conclusion
It is a widespread and challengeable problem to enumerate the source number of single channel received data in many fields. For example, source number means the number of defects in material under testing in nondestructive testing such as the multi fatigue cracks in rail [41]. Therefore it should be estimated accurately for further defect quantification [42]. This paper investigates the MDL and GDE methods to solve this problem. In order to effectively utilize the algorithms used in array signal processing, the single channel received data is transformed into multi-dimension form by delay process and the data covariance matrix is constructed. The main contribution of this paper is that diagonal loading technique referenced to optimize the MDL method. Therefore, it can eliminate the influence of colored noise. Another achievement of this paper is employing the jackknife technique to optimize the performance of the GDE method at low SNR. The experimental results proved that the improved MDL method can eliminate the effect of colored noise. Furthermore, the improved GDE method obtains a superior performance than the original one.
Acknowledgments
The authors would like to thank the anonymous reviewers and the Editors for their valuable comments and suggestions, which enhanced the quality of this paper to a larger extent.
Author Contributions
- Conceptualization: ZD JH.
- Data curation: ZD JH.
- Formal analysis: BD.
- Funding acquisition: BD YH.
- Investigation: ZD JH.
- Methodology: ZD.
- Project administration: JH.
- Resources: ZD JH.
- Software: JH.
- Supervision: BD YH.
- Validation: YH.
- Visualization: ZD JH.
- Writing – original draft: ZD YH.
- Writing – review & editing: BD YH.
References
- 1. Song H, Brandt-Pearce M. A 2-d discrete-time model of physical impairments in wavelength-division multiplexing systems. JOURNAL OF LIGHTWAVE TECHNOLOGY. 2012;30(5):713–726.
- 2. Song H, Brandt-Pearce M. Range of influence and impact of physical impairments in long-haul dwdm systems. JOURNAL OF LIGHTWAVE TECHNOLOGY. 2013;31(6):846–854.
- 3.
Song H, Brandt-Pearce M, editors. Model-centric nonlinear equalizer for coherent long-haul fiber-optic communication systems Proceedings of IEEE Global Communications Conference (GLOBECOM); 2013; Atlanta, GA.
- 4. Gao B, He Y, Woo WL, Tian GY, Liu J, Hu Y. Multi-dimensional tensor-based inductive thermography with multiple physical fields for offshore wind turbine gear inspection. IEEE Transactions on Industrial Electronics. 2016:1–11.
- 5. Cheng W, Zhang ZS, Cao HR, He ZJ, Zhu GW. A comparative study of information-based source number estimation methods and experimental validations on mechanical systems. Sensors. 2014 May;14(5):7625–7646. pmid:24776935
- 6. Gao B, Woo WL, Dlay SS. Unsupervised single-channel separation of nonstationary signals using gammatone filterbank and itakura–saito nonnegative matrix two-dimensional factorizations. IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS. 2013;60(3):662–675.
- 7. Reddy AM, Raj B. Soft mask methods for single-channel speaker separation. IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING. 2007;15(6):1766–1776.
- 8. King BJ, Atlas L. Single-channel source separation using complex matrix factorization. IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING. 2011;19(8):2591–2597.
- 9. Schmidt R. Multiple emitter location and signal parameter estimation. IEEE Trans Antennas Propag. 1986;34(3):276–280.
- 10. Roy R, Kailath T. Esprit-estimation of signal parameters via rotational invariance techniques. IEEE Trans Acoust Speech Signal Process. 1989;37(7):984–995.
- 11. Davies ME, James CJ. Source separation using single channel ica. Signal Processing. 2007;87:1819–1832.
- 12. Warner ES, Proudler IK. Single-channel blind signal separation of filtered mpsk signals. IEE Proceedings of Radar, Sonar&Navigation. 2003;150(6):396–402.
- 13. SZU H, Chanyagorn P, Kopriva I. Sparse coding blind source separation through powerline. Neurocomputing. 2002;48(1):1015–1020.
- 14.
James CJ, Lowe D, editors. Single channel analysis of electromagnetic brain signals through ica in a dynamical systems framework. EMBS 2001; 2001; Istanbul, Turkey.
- 15. B R.F., Z A.M., P P.. Detection of sources using bootstrap techniques. IEEE Trans Signal Process. 2002;50(2):20–215.
- 16. Xiao M, Wei P, Tai H-M. Estimation of the number of sources based on hypothesis testing. journal of communications and networks. 2012;14(5).
- 17. A H.. A new look at the statistical model identification. IEEE Trans on Automatic Control. 1974;19(6):716–723.
- 18. Wu HT, Yang JF, Chen FK. Source number estimator using gerschgorin disks. IEEE Trans on Acoustics Speech Signal Processing. 1994;4(4):261–264.
- 19. Rissanen J. Modeling by shortest data description. Automatica. 1978;14:465–471.
- 20. Han KY, Nehorai A. Improved source number detection and direction estimation with nested arrays and ulas using jackknifing. IEEE Transactions on Signal Processing. 2013 Dec;61(23):6118–6128.
- 21. MH Q. Problems in plane sampling. Ann Math Stat. 1949;20:355–375.
- 22. Román-Montoya Y, Rueda M, Arcos A. Confidence intervals for quantile estimation using jackknife techniques. Comput Stat. 2008;23:573–585.
- 23. JIANG JIMING, LAHIRI P, WAN S-M. A unified jackknife theory for empirical best prediction with m-estimation. The Annals of Statistics. 2002;30(6):1782–1810.
- 24. Chambers MJ, Kyriacou M. Jackknife estimation with a unit root. Statistics and Probability Letters. 2013;83:1677–1682.
- 25. Chambers MJ. Jackknife estimation of stationary autoregressive models. Journal of Econometrics. 2013;172:142–157.
- 26. Gu J-F, Wei P., Tai H-M. Detection of the number of sources at low signal-to-noise ratio. IET Signal Process. 2007;1(1):2–8.
- 27. Barbedo JGA, Lopes A, Wolfe PJ. Empirical methods to determine the number of sources in single-channel musical signals. IEEE TRANSACTIONS ON AUDIO, SPEECH, AND LANGUAGE PROCESSING. 2009;17(7):1435–1444.
- 28. Huang L, Long T, Mao E, So HC. Mmse-based mdl method for accurate source number estimation. IEEE Signal Processing Letters. 2009;16(9):798–801.
- 29. Xiao ML, Wei P, Tai HM. Estimation of the number of sources based on hypothesis testing. Journal of Communications and Networks. 2012 Oct;14(5):481–486.
- 30. Huang L, Long T, Mao E, So HC. Mmse-based mdl method for robust estimation of number of sources without eigendecomposition. Ieee Transactions on Signal Processing. 2009;57(10):4135–4142.
- 31. Cordeschi N, Amendola D, Shojafar M, Baccarelli E. Distributed and adaptive resource management in cloud-assisted cognitive radio vehicular networks with hard reliability guarantees. Vehicular Communications. 2015:1–12.
- 32. Shojafar M, Abolfazli S, Mostafaei H, Singhal M. Improving channel assignment in multi-radio wireless mesh networks with learning automata. Wireless Personal Communications. 2015;82(1):61–80.
- 33. Shojafar M, Cordeschi N, Baccarelli E. Energy-efficient adaptive resource management for real-time vehicular cloud services. IEEE transactions on Cloud Computing. 2016:1–14.
- 34.
Song H, Brandt-Pearce M, editors. Range of influence of physical impairments in wavelength-division multiplexed systems. Proceedings of IEEE Global Communications Conference (GLOBECOM); 2011; Houston, TX.
- 35.
Song H, Brandt-Pearce M, editors. A discrete-time polynomial model of single channel long-haul fiber-optic communication systems. Proceedings of IEEE International Conference on Communications (ICC); 2011; Kyoto, Japan.
- 36. Cheng W, Lee S, Zhang ZS, He ZJ. Independent component analysis based source number estimation and its comparison for mechanical systems. Journal of Sound and Vibration. 2012 Nov;331(23):5153–5167.
- 37. Wax M, Kailath T. Detection of signals by information criteria. IEEE TRANS Acoustic, Speech, and Signal Process. 1985;ASSP-33(April):387–392.
- 38. Jiling X, Xicai S. Determing the number of sources based on diagonal loading to the covariance matrix. Systems Engineering and Electronics. 2008;30(1):46–49.
- 39. CB D.. Covariance matrix estimation errors and diagonal loading in adaptive arrays. IEEE Transactions on Aerospace and Electronic Systems. 1988;24(7):397–401.
- 40. Ma N, Goh JT. Efficient method to determine diagonal loading value. Acoustics Speech and Signal Processing. 2003;15(4):341–344.
- 41. Yang R, He Y, Gao B, Tian GY, Peng J. Lateral heat conduction based eddy current thermography for detection of parallel cracks and rail tread oblique cracks. Measurement. 2015;66(1/2):54–61.
- 42. He Y, Tian G, Zhang H, Alamin M, Simm A, Jackson P. Steel corrosion characterization using pulsed eddy current systems. IEEE Sensors Journal. 2012;12(6):2113–2120.