Figures
Abstract
Bayesian Control charts are emerging as the most efficient statistical tools for monitoring manufacturing processes and providing effective control over process variability. The Bayesian approach is particularly suitable for addressing parametric uncertainty in the manufacturing industry. In this study, we determine the monitoring threshold for the shape parameter of the Inverse Gaussian distribution (IGD) and design different exponentially-weighted-moving-average (EWMA) control charts based on different loss functions (LFs). The impact of hyperparameters is investigated on Bayes estimates (BEs) and posterior risks (PRs). The performance measures such as average run length (ARL), standard deviation of run length (SDRL), and median of run length (MRL) are employed to evaluate the suggested approach. The designed Bayesian charts are evaluated for different settings of smoothing constant of the EWMA chart, different sample sizes, and pre-specified false alarm rates. The simulative study demonstrates the effectiveness of the suggested Bayesian method-based EWMA charts as compared to the conventional classical setup-based EWMA charts. The proposed techniques of EWMA charts are highly efficient in detecting shifts in the shape parameter and outperform their classical counterpart in detecting faults quickly. The proposed technique is also applied to real-data case studies from the aerospace manufacturing industry. The quality characteristic of interest was selected as the monthly industrial production index of aircraft from January 1980 to December 2022. The real-data-based findings also validate the conclusions based on the simulative results.
Citation: Javed A, Abbas T, Abbas N (2024) Developing Bayesian EWMA chart for change detection in the shape parameter of Inverse Gaussian process. PLoS ONE 19(5): e0301259. https://doi.org/10.1371/journal.pone.0301259
Editor: Praveen Kumar Donta, TU Wien: Technische Universitat Wien, AUSTRIA
Received: October 27, 2023; Accepted: March 13, 2024; Published: May 6, 2024
Copyright: © 2024 Javed et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
1 Introduction
A control chart is a vital graphical tool for monitoring and minimizing process variation in statistical process control (SPC). Shewhart [1] initially designed memory-less control chart based on current sample information for process monitoring and used it to identify large process shifts. Later, Roberts [2] designed an EWMA memory-based control chart specifically for small shift detection while giving more weights to the most recent observations. Over the period of time, EWMA is designed for process mean monitoring by [3–5] and for process variation monitoring by [6–8]. Saghir et al. [9] investigated how the estimates affected the geometric-poisson EWMA chart used to monitor the number of defects in the process. EWMA and double-exponentially-weighted-moving-average (DEWMA) were investigated in [10] for the censored data of type-I.
The control charts are designed with respect to the underlying probability of the quality characteristic of interest. Process monitoring relies heavily on the use of waiting time distributions as an important statistical tool. It can be used to analyze and optimize systems that involve waiting times, such as queues, transportation and manufacturing. This helps to improve customer satisfaction, reduce costs, and increase productivity. The applications of waiting time distributions are frequent in the field of manufacturing and industrial engineering. These include serving as a versatile tool for the process analysis and optimization, inventory management, quality control, capacity planning, supply chain management and predictive maintenance. The waiting time distribution has diverse applications in science, such as [11] analyzed and examined the definition, measurement and available data regarding waiting times in healthcare. Waiting time distribution was used by [12] to develop a novel model called the customer-centric two-product split delivery vehicle routing problem for manufacturing system.
In several applications of statistical distributions such as IGD, weibull distribution, and gamma distribution, the shape parameter is a crucial parameter, particularly when it comes to quality control. The monitoring of shape parameter is essential for detecting any changes in the process and ensuring the production of a high-quality product. The literature provides some studies on the monitoring of shape parameter under classical method in manufacturing industry. Such as [13] developed and compared the Shewhart and EWMA charts. The memory-less and memory-type charts were constructed for the weighted power function distribution (WPFD) by [14]. Huberts et al [15] investigated that how well performed the memory-less and memory-type control chart for cautious updating scheme and suggested simple methods. Kinat et al.[16] introduced control charts based on GLM specifically designed for scenarios where the response variable adheres to an IG distribution. Amin et al. [17] constructed Phase II Generalized Linear Models (GLM) based memory type control charts by utilizing deviance residuals and Pearson residuals derived from an IG regression model.
The control charting structures are proposed under classical and Bayesian frameworks with respect to the nature and objective of process evaluation. The Bayesian method is a modern inferential technique which combines the prior information with the sample data to handle uncertainty regarding the parameters of interest. These charts leverage prior knowledge to minimize uncertainty about the process parameters. Unlike the traditional classical control chart, the Bayesian control chart updates the parameters with new data availability and hence providing more precise and timely identification of process errors. The Bayesian EWMA charts are established to handle the parametric uncertainty and to detect small shifts in process parameters [18]. The Bayesian control charting scheme also incorporates various loss functions (LFs) under symmetric and asymmetric scenarios for uncertain process parameters and design different Bayesian EWMA charts such as [19–22]. Aunali and Venkatesan [23] proposed a Bayesian estimator for the quick detection of small shifts in the process mean. Ali [24] introduced Bayesian predictive monitoring of time between events. The Bayesian setup has also been studied in [22,25–35]. Jones et al.[36] reconfigured the CUSUM and EWMA CCs to monitor the process under the Bayesian approach. Seirani et al. [37] presented an economic–statistical design for the Bayesian control chart.
In control charting, the parameters of data distributions are desired to be monitored to assess the shifts occurring in the manufacturing processes. Change / shift in parameters changes the behavior of the process. So, the study of change / shift in parameters is of utmost importance. Therefore, we have attempted to study the process in classical and Bayesian setups of the shape parameter of the waiting time inverse Gaussian distribution. The literature suggested articles on the monitoring of shape parameter of various waiting time distributions that define the manufacturing process. However, there are certain scenarios within the manufacturing industry in which uncertainty of the shape parameter is unavoidable. This study considers the case of parametric uncertainty in manufacturing process and design novel Bayesian EWMA structures for shape parameter when underlying distribution of quality characteristic of interest follows IGD. The Bayesian EWMA charts are based on the Bayes estimates of the posterior distribution of the shape parameter. The posterior distribution is derived after incorporating the prior distribution of the shape parameter with the likelihood function of the sampling distribution of IGD. Then the BEs, PRs and UCLs are derived using various symmetric and asymmetric LFs, such as squared-error loss function (SELF), DeGroot loss function (DLF), modified squared-error loss function (MSELF), K loss function (KLF), weighted squared-error loss function (WSELF) and precautionary loss function (PLF). This study aims to develop Bayesian EWMA control charts using BEs constructed under various LFs and then assess the efficiency of the proposed charts. The new settings of Bayesian EWMA charts are evaluated for possible effect of hyperparameter values, different sample sizes and different values of smoothing constant. As far as the significance of the study related to the real-life data is concerned, we frequently come across the situations when the manufacturing process data follow the waiting time distributions. In such situations, it becomes necessary to monitor the parameters of the distribution. As we have considered the waiting time following the IGD so, we have endeavored to establish the Bayesian EWMA charts based on the shape parameter of the IGD.
The following sections outline the structure of the study: Section 2 covers the Bayesian approach. Section 3 discusses the proposed control charting structures. Performance assessments and elicitation of hyperparameters are explored in Sections 4 and 5 respectively. Section 6 provides a comparative study and a computing algorithm. Numerical study is discussed in Section 7. Section 8 examines the real data application of the method. Section 9 concludes the entire study.
2 Bayesian method
Bayesian method effectively handles the parametric uncertainty after using the prior knowledge of the parameters to find the posterior estimates of the unknown process parameters. To determine the posterior distribution of the model parameters given the data, prior knowledge is combined with the current data set. This distribution acts as a foundation for further analysis. This section will give a brief overview of the terminology commonly used in Bayesian methods, derive posterior distribution of the shape parameter of IGD under-study and outline the different loss functions utilized in this context.
2.1 Sampling distribution
As elaborated in Section 1, we have used the positively skewed waiting time distribution, i.e., the IGD. Suppose that x1, x2, …, xn denote a random sample of size n from the IGD (μ,θ) Its pdf is as follows:
(1)
Where μ and θ are the location and shape parameters.
2.2 Prior and posterior distributions
Bayesian method is utilized to estimate the parameters of a distribution. The concept of a prior distribution refers to the distribution of the parameters. Priors can be divided in to two major groups: informative and uninformative. An informative prior represents prior knowledge about the unknown parameter, and when there is no prior knowledge available, uninformative prior is used. Seirani et al [38] used these types of priors for the Bayesian evaluation. We have assumed gamma prior for the shape parameter θ, represented by p(θ) which is expressed as
(2)
Where a and b are the hyperparameters. As we know that a change in the values of the hyperparameters may lead to different nature of the distribution. So, the effect of different combinations of the values of the hyperparameters on the prior gamma is depicted in Fig 1.
The figure exhibits that the prior gamma distribution is of skewed nature in general. However, if the value of hyperparameter a is increased and those of b are decreased, the shape of the prior distribution becomes symmetric. By combining the prior distribution with sample data, the resulting posterior distribution p(θ|x) is obtained. It includes all information about the unknown parameter and may be expressed as
Which may in proportional form be expressed as
(3)
as the divisor defines the total probability and is independent of the parameter of interest θ. The likelihood function p(x|μ,θ) based on the sampling distribution is expressed as
(4)
So, the posterior distribution of θ is defined as
(5)
This means that For simplicity, we denote
and
The effect of hyperparameters on the posterior distribution is visualized in Fig 2.
The posterior distribution as shown in Fig 2, has a skewed shape in general. However, by increasing the values of the hyperparameter a and decreasing those for b, the shape of the posterior distribution approaches symmetry.
2.3 Loss function
Loss functions are fundamental in Bayesian estimation as they provide a principled way to quantify the cost of estimation errors and guide decision-making. The use of loss functions in Bayesian analysis helps ensure that the estimated parameters align with the objectives and consequences of the decision-making process in a given context. A loss function (LF), defined by plays a fundamental role in the Bayesian inference by quantifying the loss or cost involved in estimating the parameter. It minimizes the risk, which is defined as the expected loss and denoted by
in Bayesian setup. Wald [39] introduced the term LF. In decision theory, the LF is employed to determine the optimal estimator. Various LFs were employed in [19]. There are several loss functions that exist in Bayesian inference such as weighted balanced, Linex, Quadratic, General entropy, Mean absolute error, Mean squared error, Zero one loss functions, etc. This study also includes a variety of LFs that are used for the process monitoring of the shape parameter of IGD and are described in the following subsections.
2.3.1 Squared-error loss function (SELF).
The SELF is a measure that quantifies the accuracy of predictions by squaring the difference between predicted and actual values of the parameter of interest. It highlights larger errors and is widely used in regression analysis, machine learning and control chart evaluation. It is mathematically convenient. The squaring operation ensures a smooth and differentiable function, making it easy to work with in mathematical calculations. In the context of statistics, minimizing the squared differences between observed and predicted values corresponds to maximizing the likelihood under the assumption of normal (Gaussian) distribution of errors. This is often a reasonable assumption in many real-world scenarios. In developing the least square theory, [40,41] suggested the SELF. This LF was used in [33] which is of symmetrical type and is expressed as . Here
denotes the estimator which minimizes the posterior risk. The posterior mean which is represented by
is the BE under SELF.
2.3.2 Weighted SELF (WSELF).
The WSELF is a modified version of SELF. It involves multiplying each prediction error by a weight which allows us to give more importance to specific errors. By adjusting these weights, we can prioritize certain errors over others when evaluating how well a prediction model performs. This asymmetrical LF was used by [42] and expressed as where
denotes an estimator of the unknown parameter θ. BE under WSELF is expressed as
2.3.3 Modified SELF (MSELF).
The MSELF is a modified version of the SELF that is adjusted or changed to fit the specific needs of a specific problem or situation. These adjustments can involve altering how the squared difference of the predicted and actual values is calculated, adding extra terms or penalties, or using custom weights. This non-symmetrical LF is defined by [43] as . The BE under MSELF is represented as
. Here
is an estimator of the parameter θ. The goal of this LF is to create a measurement of prediction accuracy that is customized to handle unique factors.
2.3.4 K Loss Function (KLF).
The KLF is utilized as a cost or loss function in specific applications, especially in machine learning and optimization problems. By minimizing this LF through various optimization techniques, it aids in optimizing model parameters or estimating parameters in statistical models. Its use can contribute to enhancing the performance and accuracy of the models in these domains. This LF was utilized by (cf. [42,44]) and explained as The representation of BE under KLF is as
2.3.5 DeGroot Error Loss Function (DLF).
The DLF is typically defined as ratio of the squared difference between the estimated and true values to the square of the estimated value. The specific form of this LF depends on the problem being addressed. The main purpose of DLF is to evaluate the accuracy of decision making and estimation procedures by assigning penalties for incorrect decisions or the estimates. By minimizing the DLF, the optimal decision rules or estimators can be selected that can lead to improved performance and minimized expected loss. The DLF, was introduced by [45] and was later utilized by [46] to obtain BEs. The estimator
, which minimizes the PR, is used for parameter θ. The BE for DLF can be calculated as
2.3.6 Precautionary Loss Function (PLF).
Loss functions like the precautionary loss function are designed to create conservative estimators that prioritize avoiding underestimation. These estimators are particularly valuable in situations where underestimation could lead to severe consequences. The PLF is a straightforward and valuable asymmetric LF that helps to address this concern. This LF is presented by [47,48]. It is frequently used in the fields of risk management, decision making and financial planning. PLF is represented as and its BE under PLF is given as
This study evaluates the performance of these LFs in terms of BEs and PRs. Table 1 provides a summary of the LFs under investigation along with their expressions, associated BEs and PRs. The findings of this study will contribute to improve the efficiency of different loss functions in the Bayesian framework.
3 The proposed control charting structures
This section presents the detailed structures of the Bayesian and classical EWMA control chart of the shape parameter of IGD. The EWMA control chart exhibit higher sensitivity in detecting small process shifts as compared to the Shewhart type control chart [49]. It is important to note that in numerous practical applications, there is a practical interest in detecting one-sided changes, which can be either increases or decreases as reported in [50]. For example, in certain situations, it is crucial to ensure that leakage remains below a specific threshold, while breaking strength must meet or exceed a fixed nominal value. As the sampling and the posterior distribution of the shape parameter are positively skewed, so in this study, we have constructed only the UCLs under different settings of BEs and PRs. The following subsections first describe the EWMA charting structure for the shape parameter under classical setup and then the Bayesian EWMA charts based on different LFs.
3.1 The classical EWMA control chart
Let x1, x2, …, xn form a random sample from IGD, i.e., X~IGD(μ, θ) where θ is the unknown shape parameter. For the ith sample, the estimated statistic of the shape parameter θ is used to obtain the EWMA statistic zi under classical setup and is given as
(6)
where λ stands for the smoothing constant, and z0 = θ0 is the value of the shape parameter in the in-control process. The classical estimator of θ along with its mean and variance are given as
(7)
(8)
(9)
3.2 The Bayesian EWMA control chart
This subsection describes the Bayesian EWMA control chart based on the BEs of the shape parameter under the LFs under study. The Bayesian EWMA plotting statistic under any LF is defined as
(11)
Where denotes the BE of the shape parameter for any specific loss function and the ith sample, and rest of the notations are defined earlier. The BE under SELF, its expected value, PR, and the corresponding UCL based on the Bayesian EWMA chart is designed as follows:
(12)
The mean and variance of the estimator θ are derived as:
(13)
(14)
The similar quantities based on the other LFs under study are derived and reported in Table 1. The general form of UCL of Bayesian EWMA for any specific LF is
(15)
And the corresponding UCL of Bayesian EWMA chart under SELF is defined as
(16)
The UCLs for the Bayesian EWMA chart based on all the other LFs can similarly be evaluated using the information contained in Table 1.
4 Performance measures
The control charting structures under classical and Bayesian frameworks designed in Section 3 are further assessed using different performance measures, such as ARL, SDRL and MRL. These measures are well-known for evaluating the efficiency of a control chart at a certain shift value. The ARL values are widely employed performance measures for the evaluation of the control chart [50,51]. It shows how many samples are usually taken before a signal is detected. A lower ARL suggests that process changes are detected more quickly, whereas a greater ARL indicates a slower response (cf. [52–55]).
The SDRL is another statistical performance measure which quantifies the dispersion of the lengths of runs in a set of data. This technique is frequently used to assess a system’s consistency and stability over time and provides information on the reliability of run length behavior. The MRL is an essential measure used to assess individual control charts and determine the level of skewness in the run length (RL) performance. The MRL value is obtained by selecting the ((m+1)/2)th value from the ordered RLs. In addition to ARL values, the SDRL (for spread) and MRL (for skewness) are also computed as supplemental indicators. The control chart that yields smaller ARL, SDRL, and MRL values is the most effective chart (cf. [56–59]).
5 Elicitation of hyperparameters values
Bayes estimates are significantly dependent on the prior distribution which is further dependent on the hyperparameters. So, it is not out of the context to say that the Bayes estimates also depend on the hyperparameters. It is the earnest need of applying Bayesian approach to elicit the values of the hyperparameters in accordance with the experts’ opinions. When a large amount of information about the parameter(s) is available, it is important to quantify this knowledge in the form of a prior and subsequently utilize it in the Bayesian analysis. Elicitation involves the precise measurement of prior information through a systematic process and various elicitation techniques were developed by (cf. [60–66]). To see the impact of the hyper parametric values on the BEs and PRs, these quantities are evaluated across a range of hyperparameters a and b, and the resulting estimates are displayed in figures (cf. Figs 3–8). These figures reflect the effect of the values of hyperparameters a and b varying from 0 to 10 on Bayes estimates and posterior risk under different loss functions under study. The values of the hyperparameters a and b vary from 0 to 10.
Effect of hyperparameters on the (a) BE and (b) PR under SELF.
Effect of hyperparameters on the (a) BE and (b) PR under WSELF.
Effect of hyperparameters on the (a) BE and (b) PR under MSELF.
Effect of hyperparameters on the (a) BE and (b) PR under KLF.
Effect of hyperparameters on the (a) BE and (b) PR under DLF.
Effect of hyperparameters on the (a) BE and (b) PR under PLF.
Figs 3–8 are three-dimensional figures plotted among a, b, and BEs (or PRs) with values of all of these quantities reported on three axes of the figures. These present a study on the impact of change in the hyperparameters a, b on BEs and PRs using the loss functions under study. The values of hyperparameters vary from zero to infinity. In the study, it is found that as the hyperparameter a increases and b decreases, the values of BE increase across all the LFs. For SELF, WSELF, KLF, and PLF, the values of PR increase as the hyperparameter a increases and b decreases and the vice versa. But for any fixed value of b for MSELF and DLF, the PR values decrease by increasing the values of a and the vice versa. These results highlight the importance of selecting appropriate hyperparameters for a given loss function to optimize the Bayesian EWMA chart performance.
In cases where there is insufficient information about the hyperparameters, it is common to adopt a mild information approach, as proposed by [50]. By following [50], we have used the values of a = 3.0 and b = 0.1466 for the hyperparameters of the gamma prior. These values will be used throughout the upcoming Bayesian analysis in this study.
6 Comparative study
This section presents a comparative analysis of control chart for monitoring the shape parameter using both classical and Bayesian approaches. The study aims to assess the effectiveness of various Bayesian charts and compare them to their classical counterparts. To conduct the analysis, many researchers utilized the Monte Carlo simulation method and developed an algorithm. Shift values are incorporated into the shape parameter and the resulting measures of run lengths including ARL, SDRL, and MRL values are evaluated. These values are employed to assess the efficiency of the suggested control chart. The control chart is supposed to be the best if the value of ARL1 for a particular shift is small. The values of ARL0 have been fixed by adjusting the values of L under various LFs. The ARL0 is specified at 370. Performance of the designed chart is assessed at λ = 0.1 and 0.2. The following algorithm is proposed to monitor the process using Bayesian method with different loss functions
- Step 1: Establishing the control limits
- Fix the value of L and λ and estimate the control limits.
- Generate random sample from IGD for the in-control process.
- For the specified loss functions, compute the EWMA statistic Zi for the classical and Bayesian control chart.
- Repeat steps 1–3 if the plotted statistic falls within the control limits.
- When the plotted statistic falls outside the limits, record the number of generated samples.
- Compute ARL1 after repeating the steps 3–5 for 100000 times.
- Step 2: Examine the ARL that is out-of-control.
- Generate the random sample from the IGD for the shifted process.
- Compute the EWMA statistic Zi.
- If plotting statistic is within the specified limits, proceed to repeat steps 1–2. Otherwise, make a note of the number of generated points.
- To obtain the ARL1, SDRL1 and MDRL1 values, the steps (1–3) are repeated 50,000 times.
In this study, we calculated the ARL, SDRL, and MRL using both frequentist and Bayesian setups with various loss functions for sample sizes of n = 5, 10, 15. The ARL values were determined for in-control situations with ARL0 set at 370 and for shifts of different magnitudes ranging from 1.2–3.0 (i.e., δ = 1.2, 1.4, 1.6, 1.8, 2.0, 2.2, 2.6, 3.0). Furthermore, ARL1, SDRL1, and MRL1 values are computed for each shift.
The results were summarized in Tables 2–7 and visually presented in Figs 9–14. When the shape parameter (θ) deviates from its in-control state, the manufacturing process is considered unstable. In the in-control state where δ = 1, it signifies the absence of any shift in the shape parameter, indicating a stable state of the process while δ>1 represents an increase in the process shape parameter. A comprehensive simulation study is conducted to examine the performance of control chart designed with different loss functions in comparison to classical control chart. The results presented in Tables 2–7 indicates that the control charts designed using different loss functions outperformed their classical counterparts. The simulation study yielded several key findings, which are summarized below at λ = 0.1 and 0.2.
- In this study, it was observed that the ARL1 values tend to decrease as the shift (δ) values increase. As an example, when n = 5 and δ = 1.2, ARL1 was found to be 212.97, whereas at δ = 1.4, the ARL1 decreased to 127.29 at L = 2.26 under classical setup (cf. Table 2).
- The ARL1 values were found to exhibit noteworthy improvement for various shift (δ) values and control chart under various LFs. For example, when n = 5, δ = 1.2, ARL1 = 90.76 at L = 3.13 whereas at δ = 1.4 under SELF, the ARL1 value decreased to 40.37 (cf. Table 2).
- When sample sizes are increased, the ARL1 values decrease. For instance, for n = 5 and δ = 1.2, the ARL1 value is 91.46 at L = 3.13, whereas for n = 10 and δ = 1.2, the ARL1 value is 55.62 at L = 2.95 for WSELF. (cf. Tables 2 and 3). This indicates that increasing the sample size can lead to improved performance in terms of ARL1 values.
- ARL1 values for different loss functions also exhibit improvement. For example, with δ = 1.2 and n = 5, the ARL1 values are 90.76 for SELF, 91.46 for WSELF, 88.29 for MSELF, 91.11 for KLF, 93.01 for DLF, and 91.89 for PLF. Interestingly, all the loss functions exhibit the same value of L = 3.13, indicating that they perform similarly in this regard. (cf. Table 2).
- At large sample sizes (n), the control chart using the MSELF loss function outperforms than other loss functions. For instance, with δ = 1.2 and n = 15, the ARL1 value for SELF is 38.28 at L = 2.83, for WSELF it is 38.15 at L = 2.85, for MSELF it is 35.88 at L = 2.85, for KLF it is 38.73 at L = 2.83, for DLF it is 39.87 at L = 2.84, for PLF it is 38.91 at L = 2.83, and for the classical setup it is 40.61 at L = 2.88 (cf. Table 4). These results conclude that the MSELF demonstrate the superior performance in detecting shifts in large sample sizes as compared to the other LFs.
- The control chart based on the classical setup demonstrates inferior performance compared to the charts using the Bayesian setup. For example, with δ = 1.2 and n = 10, the classical setup gives an ARL1 value of 72.28, while the SELF gives an ARL1 value of 56.91 at L = 2.96, WSELF gives an ARL1 value of 55.62 at L = 2.95, MSELF gives an ARL1 value of 53.38 at L = 2.95, KLF gives an ARL1 value of 55.47 at L = 2.95, DLF chart gives an ARL1 value of 57.79 at L = 2.94 and PLF gives an ARL1 value of 57.20 at L = 2.95. (cf. Table 3). This indicates that the Bayesian setup can lead to better performance in control charts than the classical setup.
- As the sample size increases from 10 to 15, the magnitude of difference in ARL1 values for control chart under MSELF is superior to other charts SELF, WSELF, KLF, DLF and PLF. Specifically, with δ = 1.2, there are 32.74%, 31.41%, 32.78%, 30.18%, 31.01% and 31.97% decreases in ARL1 values for SELF, WSELF, MSELF, KLF, DLF and PLF respectively (cf. Tables 3 and 4). The results suggested that MSELF is superior choice for control charts when dealing with large sample sizes.
- Additionally, it has been observed that the ARL1 at λ = 0.1 is smaller than ARL1 at λ = 0.2. It means that the efficiency of the designed control chart is improved at λ = 0.1 as compared to that at λ = 0.2 for all sample sizes (cf. 2–7). This implies that the efficiency of the proposed control chart is increased by decreasing the values of λ.
Tables 2–7 and Figs 9–14 reveals that the Bayes estimates exhibit superior performance as compared to the classical estimates when it comes to ARL values for detecting shifts in the process for samples of size n = 5, 10 and 15. It is also revealed that EWMA control chart performs best for the Bayes estimates evaluated using MSELF as compares to those produced using the other LFs. Moreover, the performance of the chart improves further in detecting the shift by increasing the sample size. From Figs 9–14, it shows that the values of ARL1 decrease by increasing the shift. Moreover, the values of ARL1 under Bayesian approach for all the loss functions are less as compared to those for the classical case. It shows that Bayes estimates are more efficient in detecting the small shift than their classical counterparts.
7 Numerical study
To monitor the shape parameter θ of the IGD using Bayesian technique under different loss functions, the following algorithm will be followed:
- Generate k samples each of size n = 5 from the IGD (1, 1).
- Construct classical and Bayesian control limits for all the LFs under study.
- Plot Zi, i = 1,2, …, k against the corresponding UCL for all the loss functions under study.
- Declare the process to be out of control if Zi falls beyond the respective UCL.
To numerically illustrate the above-cited study, 50 samples each of size 5 were generated and the values of Zi, i = 1,2, …, 50 and the corresponding UCLs were computed. The graphical presentation of the resulting information is made in Figs 15 and 16.
Figs 15 and 16 illustrates the application of Bayesian process monitoring for the shape parameter of IGD across all the loss functions using the posterior distribution. The figure provides visual representation of sample number for which the EWMA statistic of θ falls outside the UCL and marked out-of-control alarm. The simulation results revealed that the Bayesian control chart with various loss functions resulted in a higher number of out-of-control alarms for the shape parameter as compared to classical control charts. Furthermore, the Bayesian approach outperforms the classical approach in detecting shifts in the process.
8 Real data application
This study illustrates how EWMA control chart can be employed for the detection of prospective changes in the IP of aerospace under frequentist and Bayesian approaches. This section demonstrates a practical application of the Bayesian control chart to monitor the shape parameter of IGD. To show the importance of the suggested methodology, its application is illustrated by real life data. Manufacturing data from the aerospace industry have been used for this purpose, (cf. industrial10.pdf (federalreserve.gov)). Khaliq et al. [67] also considered the data of aerospace industry from January 1997 to January 2015. As shown on this webpage, a brief description of the data/variables of interest has been provided related to the objectives of the study. Aerospace manufacturing includes the design, construction, testing, sale, and maintenance of airplanes, aircraft parts, missiles, rockets and spacecraft. There are several commercial and military applications for aerospace activity. This industry manufactures thousands of aircraft engine mounts, exhaust systems, landing gears and other components. There are numerous variables to consider. Industrial production (IP) index has been chosen as the quality characteristic of interest for this study. It evaluates the actual output of the manufacturing, mining, utility, and electric sectors. Data from January 1980 to December 2022 have been considered.
Prior to proceed with the Bayesian EWMA monitoring of the shape parameter of the IGD based on the real data, it is of prime importance to assess the goodness of fit of the model to the observed data. We may use the model selection criteria to evaluate the goodness of fit of the model to the observed data and compare different models, [68]. So we may use Akaike information criterion (AIC), [69] and Bayesian information criterion (BIC, also known as Schwarz criterion), which are respectively defined as
and
Here ln[L(μ, θ)] denotes the log-likelihood, n denotes the number of observations and k denotes the number of parameters of the distribution under consideration. The smaller the values of these criteria are, the better the fit is. We have assumed the real-life data to follow the IGD and weibull distribution. So, we have evaluated the AIC and BIC for the data based on IGD and weibull model and their model selection criteria are reported in Table 8.
Here we have observed that the values of AIC and BIC for the IGD are very small as compared to those for the weibull distribution. Therefore, it can be concluded that the IGD gives a better fit to the real-life aerospace data and we can monitor the shape parameter of IGD based on the underlying real-life aerospace data.
To numerically illustrate the above-cited study based on real data of 43 samples each of size 12, the values of Zi, i = 1,2, …, 43 and the corresponding UCLs were evaluated. The graphical presentation of the resulting information is made in Figs 17and 18.
Figs 17 and 18 illustrate the monitoring of the EWMA statistic of θ based on UCL computed for classical estimates and Bayes estimates obtained using the loss functions under study. Here we observed the similar pattern of shift detection by the control chart under study across all the estimation methods, i.e., the classical approach as well as the Bayesian approach for all the loss functions under study. Moreover, it is also noted that the Bayesian approach is more competent than classical approach in fault detection of the process.
9 Conclusion
The aim of this research is to design EWMA control charts under frequentist and Bayesian approaches to monitor the shape parameter of IGD. It is investigated that with increasing sample size, the recommended control charting method becomes increasingly effective in detecting process shifts. This study evaluates the impact of hyperparameter values on the Bayes estimates and posterior risks. Results showed that as hyperparameter a increases and b decreases, the values of BE increase across all loss functions. However, the values of PR decreases for SELF, WSELF, KLF and PLF. The simulation study reveals that the Bayes estimates are more efficient than classical estimates in detecting process shifts for all sample sizes. However, there is no significant difference in the performance of control chart for the loss functions under study. The study also reveals that the classical approach is unable to detect the out-of-control process, while the Bayesian approach is found to be more sensitive. It is further noted that the Bayesian EWMA control chart using MSELF outperforms all its competitors, and its performance is further improved by increasing sample size. The results of the entire study are based on the skewed waiting time distribution, namely the IGD. However, they may vary for other skewed distributions or symmetric distributions.
It is further recommended that the values of the hyperparameters may be elicited based on the experts’ opinion and the Bayes estimates may be evaluated using these values of the hyperparameters. We may extend this study for other competing distributions and competing charts.
References
- 1. Shewhart W.A., Economic quality control of manufactured product 1. Bell System Technical Journal, 1930. 9(2): p. 364–389.
- 2. Roberts S., Control chart tests based on geometric moving averages. Technometrics, 1959. 42(1): p. 97–101.
- 3. Crowder S.V., Design of exponentially weighted moving average schemes. Journal of Quality technology, 1989. 21(3): p. 155–162.
- 4. Lucas J.M. and Saccucci M.S., Exponentially weighted moving average control schemes: properties and enhancements. Technometrics, 1990. 32(1): p. 1–12.
- 5. Steiner S.H., EWMA control charts with time-varying control limits and fast initial response. Journal of Quality Technology, 1999. 31(1): p. 75–86.
- 6. Castagliola P., A R-EWMA control chart for monitoring the process range. International Journal of Reliability, Quality and Safety Engineering, 2005. 12(01): p. 31–49.
- 7. Knoth S., Accurate ARL computation for EWMA-S2 control charts. Statistics and Computing, 2005. 15(4): p. 341–352.
- 8. Maravelakis P.E. and Castagliola P., An EWMA chart for monitoring the process standard deviation when parameters are estimated. Computational statistics & data analysis, 2009. 53(7): p. 2653–2664.
- 9. Saghir A., Lin Z., and Chen C.-W., The properties of the geometric-Poisson exponentially weighted moving control chart with estimated parameters. Cogent Mathematics, 2015. 2(1): p. 992381.
- 10. Raza S.M.M., Riaz M., and Ali S., On the performance of EWMA and DEWMA control charts for censored data. Journal of the Chinese Institute of Engineers, 2015. 38(6): p. 714–722.
- 11. McIntyre D. and Chow C.K., Waiting time as an indicator for health services under strain: a narrative review. INQUIRY: The Journal of Health Care Organization, Provision, and Financing, 2020. 57: p. 0046958020910305. pmid:32349581
- 12. Ma X., et al., Customer-Centric, Two-Product Split Delivery Vehicle Routing Problem under Consideration of Weighted Customer Waiting Time in Power Industry. Energies, 2022. 15(10): p. 3546.
- 13. Zaka A., et al., Control charts for the shape parameter of reflected power function distribution under classical estimators. Quality and Reliability Engineering International, 2021. 37(6): p. 2458–2477.
- 14. Jabeen R. and Zaka A., The modified control charts for monitoring the shape parameter of weighted power function distribution under classical estimator. Quality and Reliability Engineering International, 2021. 37(8): p. 3417–3430.
- 15. Huberts L.C., Goedhart R., and Does R.J., Improved control chart performance using cautious parameter learning. Computers & Industrial Engineering, 2022. 169: p. 108185.
- 16. Kinat S., Amin M., and Mahmood T., GLM‐based control charts for the inverse Gaussian distributed response variable. Quality and Reliability Engineering International, 2020. 36(2): p. 765–783.
- 17. Amin M., Mahmood T., and Kinat S., Memory type control charts with inverse-Gaussian response: An application to yarn manufacturing industry. Transactions of the Institute of Measurement and Control, 2021. 43(3): p. 656–678.
- 18. Riaz S., et al., On Bayesian EWMA control charts under different loss functions. Quality and Reliability Engineering International, 2017. 33(8): p. 2653–2665.
- 19. Noor‐ul‐Amin M. and Noor S., An adaptive EWMA control chart for monitoring the process mean in Bayesian theory under different loss functions. Quality and Reliability Engineering International, 2021. 37(2): p. 804–819.
- 20. Noor‐ul‐Amin M., Noor S., and Feroze N., A parameter free Bayesian adaptive EWMA mean chart under different loss functions. Quality and Reliability Engineering International, 2022. 38(4): p. 2156–2169.
- 21. Khan I., et al., Hybrid EWMA Control Chart under Bayesian Approach Using Ranked Set Sampling Schemes with Applications to Hard-Bake Process. Applied Sciences, 2023. 13(5): p. 2837.
- 22. Khan I., et al., Adaptive EWMA control chart using Bayesian approach under ranked set sampling schemes with application to Hard Bake process. Scientific Reports, 2023. 13(1): p. 9463. pmid:37301897
- 23. Aunali A.S. and Venkatesan D., Comparison of Bayesian Method and Classical Charts in Detection of Small Shifts in the Control Charts. International Journal, 2017. 6(2): p. 101–114.
- 24. Ali S., A predictive Bayesian approach to EWMA and CUSUM charts for time-between-events monitoring. Journal of Statistical Computation and Simulation, 2020. 90(16): p. 3025–3050.
- 25. Wang Y., et al., Performance of Bayesian EWMA control chart with measurement error under ranked set sampling schemes with application in industrial engineering. Scientific Reports, 2023. 13(1): p. 14042. pmid:37640724
- 26. Khan I., et al., Monitoring the process mean under the Bayesian approach with application to hard bake process. Scientific Reports, 2023. 13(1): p. 20723. pmid:38007541
- 27. Khan I., et al., Monitoring of manufacturing process using bayesian EWMA control chart under ranked based sampling designs. Scientific Reports, 2023. 13(1): p. 18240. pmid:37880337
- 28. Iqbal J., et al., A novel Bayesian Max-EWMA control chart for jointly monitoring the process mean and variance: an application to hard bake process. Scientific Reports, 2023. 13(1): p. 21224. pmid:38040862
- 29. Wang K. and Tsung F., Bayesian cross-product quality control via transfer learning. International Journal of Production Research, 2022. 60(3): p. 847–865.
- 30. Noor S., et al., Hybrid exponentially weighted moving average control chart using Bayesian approach. Communications in Statistics-Theory and Methods, 2022. 51(12): p. 3960–3984.
- 31. Noor‐ul‐Amin M. and Noor S., Bayesian EWMA control chart with measurement error under different loss functions. Quality and Reliability Engineering International, 2021. 37(8): p. 3362–3380.
- 32. Noor‐ul‐Amin M. and Noor S., Homogeneously weighted moving average control chart based on Bayesian theory. Quality and Reliability Engineering International, 2021. 37(8): p. 3617–3637.
- 33. Noor S., Noor‐ul‐Amin M., and Abbasi S.A., Bayesian EWMA control charts based on Exponential and transformed Exponential distributions. Quality and Reliability Engineering International, 2021. 37(4): p. 1678–1698.
- 34. Ahmadini A.A.H., et al., Robust assessing the lifetime performance of products with inverse Gaussian distribution in Bayesian and classical setup. Mathematical Problems in Engineering, 2021. 2021: p. 1–9.
- 35. Riaz M. and Ali S., On process monitoring using location control charts under different loss functions. Transactions of the Institute of Measurement and Control, 2016. 38(9): p. 1107–1119.
- 36. Jones C.L., Abdel‐Salam A.S.G., and Mays D.A., Novel Bayesian CUSUM and EWMA control charts via various loss functions for monitoring processes. Quality and Reliability Engineering International, 2023. 39(1): p. 164–189.
- 37. Seirani R., et al., Economic–statistical design of Bayesian X‾ control chart based on the predictive distribution. International Journal of Quality & Reliability Management, 2023.
- 38. Seirani R., et al., Economic–statistical design of Bayesian X‾ control chart based on the predictive distribution. International Journal of Quality & Reliability Management, 2023(ahead-of-print).
- 39. Wald A., Contributions to the theory of statistical estimation and testing hypotheses. The Annals of Mathematical Statistics, 1939. 10(4): p. 299–326.
- 40. Legendre A.M., Nouvelles méthodes pour la détermination des orbites des comètes; par AM Legendre. 1806: chez Firmin Didot, libraire pour lew mathematiques, la marine, l ….
- 41. Gauss C., Method des Moindres Carres Memoire sur la Combination des Observations, 1810 Translated by J. 1955, Bertrand.
- 42. Tinochai K. and Jampachaisri K., The Performance of Empirical Bayes Based on Weighted Squared Error Loss and K-Loss Functions in Skip Lot Sampling Plan with Resampling. Engineering Letters, 2022. 30(2).
- 43. Abdullah H. and Aref R., Bayesian inference for parameter and reliability function of Inverse Rayleigh distribution under modified squared error loss function. Australian Journal of Basic and Applied Sciences, 2016. 10(16): p. 241–248.
- 44. Zhang Y.-Y., The Bayesian Posterior Estimators under Six Loss Functions for Unrestricted and Restricted Parameter Spaces. Bayesian Inference on Complicated Data, 2019.
- 45. DeGroot M.H., Optimal statistical decisions. 2005: John Wiley & Sons.
- 46. Njomen D.A.N., Donfack T., and Tanguep D.W., Bayesian estimation under different loss functions in competitive risks. Global Journal of Pure and Applied Mathematics, 2021. 17(2): p. 113–139.
- 47. Norstrom J.G., The use of precautionary loss functions in risk analysis. IEEE Transactions on reliability, 1996. 45(3): p. 400–403.
- 48. Mozgunov P., Jaki T., and Gasparini M., Loss functions in restricted parameter spaces and their Bayesian applications. Journal of Applied Statistics, 2019. 46(13): p. 2314–2337. pmid:32256183
- 49. Aslam M. and Anwar S.M., An improved Bayesian Modified-EWMA location chart and its applications in mechanical and sport industry. PLoS One, 2020. 15(2): p. e0229422. pmid:32101566
- 50. Ali S. and Riaz M., On designing a new Bayesian dispersion chart for process monitoring. Arabian Journal for Science and Engineering, 2020. 45(3): p. 2093–2111.
- 51. Liang W., et al., A new nonparametric adaptive EWMA procedures for monitoring location and scale shifts via weighted Cucconi statistic. Computers & Industrial Engineering, 2022. 170: p. 108321.
- 52. Noorossana R., Fatemi S., and Zerehsaz Y., Phase II monitoring of simple linear profiles with random explanatory variables. The International Journal of Advanced Manufacturing Technology, 2015. 76: p. 779–787.
- 53. Wang Y.-H.T. and Huang W.-H., Phase II monitoring and diagnosis of autocorrelated simple linear profiles. Computers & Industrial Engineering, 2017. 112: p. 57–70.
- 54. Abbasi S.A., Abbas T., and Adegoke N.A., Efficient CV control charts based on ranked set sampling. IEEE Access, 2019. 7: p. 78050–78062.
- 55. Abbas T., et al., Phase II monitoring of linear profiles with random explanatory variable under Bayesian framework. Computers & Industrial Engineering, 2019. 127: p. 1115–1129.
- 56. Khoo M.B., et al., Standard deviation of the run length (SDRL) and average run length (ARL) performances of EWMA and synthetic charts. International Journal of Engineering and Technology, 2015. 7(6): p. 513–516.
- 57. Teoh W.L., et al., The exact run length distribution and design of the Shewhart chart with estimated parameters based on median run length. Communications in Statistics-Simulation and Computation, 2016. 45(6): p. 2081–2103.
- 58. Khan M.Z., et al., A study on average run length of fuzzy EWMA control chart. Soft Computing, 2022. 26(18): p. 9117–9124.
- 59. Abbas T., et al., On improved dispersion control charts under ranked set schemes for normal and non‐normal processes. Quality and Reliability Engineering International, 2019. 35(5): p. 1313–1341.
- 60. Kadane J.B., Predictive and structural methods for eliciting prior distributions. Bayesian analysis in econometrics and statistics, 1980. 18.
- 61. Winkler R.L., Prior information, predictive distributions, and Bayesian model-building. Bayesian Analysis in Econometrics and Statistics: Essays in honor of Harold Jeffreys, Zellner A(ed.), 1980: p. 95–109.
- 62. Berger J.O. and Berger J.O., Prior information and subjective probability. Statistical Decision Theory and Bayesian Analysis, 1985: p. 74–117.
- 63. Kadane J. and Wolfson L.J., Experiences in elicitation: [Read before The Royal Statistical Society at a meeting on’Elicitation ‘on Wednesday, April 16th, 1997, the President, Professor AFM Smith in the Chair]. Journal of the Royal Statistical Society: Series D (The Statistician), 1998. 47(1): p. 3–19.
- 64. Aslam M., An application of prior predictive distribution to elicit the prior density. Journal of Statistical Theory and applications, 2003. 2(1): p. 70–83.
- 65. Garthwaite P.H., Kadane J.B., and O’Hagan A., Statistical methods for eliciting probability distributions. Journal of the American statistical Association, 2005. 100(470): p. 680–701.
- 66. Gill J., Bayesian methods: A social and behavioral sciences approach. Vol. 20. 2014: CRC press.
- 67. Khaliq Q.-U.-A., Riaz M., and Ahmad S., On designing a new Tukey-EWMA control chart for process monitoring. The International Journal of Advanced Manufacturing Technology, 2016. 82: p. 1–23.
- 68. Jebeli M. and Deiri E., Estimation methods for the probability density function and the cumulative distribution function of the Pareto-Rayleigh distribution. Statistics, 2020. 54(1): p. 135–151.
- 69. Akaike H., A new look at the statistical model identification. IEEE transactions on automatic control, 1974. 19(6): p. 716–723.