Figures
Abstract
Recent attention has increasingly focused on the significance of Definitive Screening Designs (DSDs), originally introduced by Jones and Nachtsheim (2011), as a compelling alternative to traditional designs bib Response Surface Methodology (RSM). This paper introduces two novel composite techniques aimed at enhancing design efficiency and elevating D-values. By utilizing orthogonal matrices and integrating axial components from either simple orthogonal designs or the block orthogonal designs detailed in the work of Alrweili et al. (2020), new design matrices are constructed based on established composite design principles. Notably, the novel designs presented in this manuscript surpass previously documented designs in the existing literature in terms of design efficiency and robustness.
Citation: Athanasaki DE, Georgiou SD, Stylianou S (2024) New approaches on composite designs for Response Surface Methodology. PLoS ONE 19(4): e0301049. https://doi.org/10.1371/journal.pone.0301049
Editor: Bohui Wang, Xi’an Jiaotong University, CHINA
Received: December 6, 2023; Accepted: March 10, 2024; Published: April 2, 2024
Copyright: © 2024 Athanasaki et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are in the manuscript.
Funding: The author(s) received no specific funding for this work.;
Competing interests: The authors have declared that no competing interests exist.
1 Introduction
The main objective of Response Surface Methodology (RSM) is to streamline and enhance the optimization of processes and systems. This is achieved through the construction of sophisticated models that capture the intricate interplay between input factors and output responses. Experimental designs within Response Surface Methodology (RSM) are intricately designed frameworks aimed at systematically exploring and understanding the relationships between input variables and corresponding output responses. These designs are meticulously crafted to efficiently collect data points, allowing for the accurate construction of response surfaces and the derivation of predictive models. By strategically selecting factor levels and configurations, experimental designs in RSM enable researchers to extract maximum information from a minimal number of experiments, facilitating the process of optimization and decision-making.
The response surface methodology process can be outlined as follows. Begin by identifying the critical factors that influence a response variable. Determine the specific levels at which these factors need to be investigated. Select an appropriate experimental design and conduct the experiments according to the plan. Thoroughly document the data and responses obtained from the experiments. Develop a response model by employing regression analysis on the collected data. Assess the significance and fitness of the model. Utilize the established model to identify the factor levels that lead to the desired outcomes. Verify these conclusions through additional supplementary experiments to ensure their validity. Evaluate the impact of variations on the outcomes and apply the optimized settings to improve the process. Maintain continuous vigilance over the ongoing performance to sustain the desired results.
Several key questions must be addressed to optimize the necessary experimentation process. These questions may include the following: What design is best suited for specific factors and research hypotheses? Particularly, which design is effective in accommodating a second-order model while minimizing the necessary number of experimental runs? Throughout time, statisticians and computer scientists have introduced numerous designs. An ambitious goal is to create a full second-order model without employing a full factorial design. In Response Surface Methodology (RSM), practitioners frequently face the challenge of balancing the desire for higher D-values (as outlined in Eq (3)) to indicate informative and robust designs with the need for economical run sizes and other constraints present in actual experimental conditions. Strategically optimizing the D-value, along with other factors such as the number of experimental runs, enables the development of a practical experimental design that provides valuable insights and improves the investigated process or system.
One of the classical designs found in the literature is the Central Composite Design (CCD), which was originally proposed by Box [1]. The CCD serves as a prime example of a composite design, encompassing three sets of runs identified as F, A, and C, and laid out in the subsequent matrix arrangement:
(1)
In this configuration, the component F represents the factorial part of the design, incorporating two levels for each factor involved in the experiment. These levels are commonly denoted as High/Low, + /−, 0/1, or + 1/−1. The number of runs in the factorial part is denoted by nf. The axial component of the design, A, adopts the format of a diagonal matrix where an unspecified value a is placed along the diagonal, while the remaining matrix elements are set to 0. The experimenter is responsible for determining the optimal value of a, with the goal of maximizing the potential efficiency of this specific segment within the design. Then number of runs in the axial part is denoted by na. Lastly, the C part encompasses the center points of the design. Replicating a central point multiple times contributes to enhancing experimental precision, and these repetitions constitute the C part. The number of runs in the centre points part is denoted by nc. The total number of non-centre points in the design is given by nr = nf + na. Enhancements and variations of these designs have been detailed in numerous scholarly articles. For instance, Georgiou et al. [2] introduced modifications aimed at boosting the efficiency of the resulting designs. In their initial study, the authors made adjustments to the axial points by substituting them with points situated within a hypercube that encompasses a sphere with a radius equivalent to the parameter a. This innovative approach allowed them to decrease the required number of experimental runs, while simultaneously elevating the D-value of the design concerning the complete second-order model. For more recent research in this direction, interested readers are encouraged to explore the work by Liu et al. [3], Ares and Goos [4], Jones et. al. [5], and the references therein. In this research paper, the authors not only delve into the augmentation of the generated designs but also delve into the concept of projectivity, establishing noteworthy findings regarding the efficiency of the designs.
Considerable attention has been directed toward the widely acclaimed Definitive Screening Designs (DSD) developed by Jones and Nachtsheim [6]. DSDs call for an analytical approach that differs from the norm applied to other designs. The term “screening” in their name indicates their purpose of identifying variables with significant linear impacts. DSDs are constructed with three levels for all the continuous factors in the design and can be used to obtain a cost-effective approximation of the actual response surface. The rationale behind screening lies in the recognition that fitting an entire quadratic polynomial model would demand an excessive number of runs due to the presence of numerous intriguing factors. Instead, a model encompassing linear terms, some two-factor interactions, and possibly quadratic terms (a second-order model) is employed, as elaborated by Jones and Nachtsheim [7]. A distinguishing attribute of this design is its utilization of 2k + 1 runs, with k representing the number of factors. Consequently, k signifies both the count of main effects and the count of quadratic effects. By employing a Definitive Screening Design (DSD), it becomes possible to scrutinize the effects of numerous variables through a compact experiment. In essence, DSDs represent an advancement over conventional screening designs, such as the Plackett-Burman design, allowing for the detection of non-linear responses and the avoidance of factor confounding, as noted by Yu et al. [8].
Screening designs are aimed at pinpointing the significant main effects from a vast number of potentially influential effects while minimizing costs. These designs traditionally employ two levels and the minimum number of runs. DSD takes this objective even further by enabling the estimation of quadratic effects and even the complete second-order model without requiring additional experimental runs, albeit in cases where the screening process identifies only three active main effects. Liu et al. [3] propose a novel composite design strategy. They suggest replacing the factorial part of the Central Composite Design (CCD) with DSD. They extensively discuss the design, particularly focusing on the axial part that employs classical diagonal matrices A and −A, as previously discussed. This approach allows for the addition of runs, often leading to a significant reduction in the average prediction variance. Their design construction takes the form of Eq (1) with matrix F being the desirable DSD.
In scenarios involving an odd number of factors, Alrweili et al. [9] presented the idea of a modified axial part structure that comprises blocks of pre-existing orthogonal designs. This necessitates the addition of an extra column and rows to maintain orthogonality. The proposed designs in their work incorporated a composite design matrix X as in Eq (1) but with the part A in matrix X being an axial part of a different structure. Some fundamental criteria that it is desirable to be maintained in all the constructed designs for response surface methodology include: a) Orthogonality of the main effects (and other effects in the model, if feasible), b) Minimum total number of experimental runs, and c) High D-value (see Eq (3)) for the complete second-order model.
2 Evaluation criteria
This study aims to explore innovative approaches for developing designs for a second-order Response Surface Methodology (RSM). The proposed methodologies blend established techniques, enhancing both the factorial and axial components of composite designs. When examining the behavior of the response variable, in the presence of k potentially influential factors, the conventional RSM approach initiates with an experimenter conducting a screening design and fitting a first-order (linear) model to the obtained data. Subsequent experiments are then required to fit a more suitable model. As we have discussed in the previous session, several research papers have introduced and employed new designs for RSM, second-order models, and even higher-order polynomial designs. In this context, we will employ the following second-order model:
(2)
where y signifies the response vector, while xi represents the column within the model matrix that pertain to the main effect of factor i. Additionally, xi2 designates the column in the model matrix specifically associated with the pure-quadratic effect of variable i, while xi xj denotes the column in the model matrix that correspond to the two-factor interaction effect of variables i and j. β0 represents the unknown constant intercept, βi corresponds to coefficient of the main effect xi, βii characterizes the quadratic effects, and βij signifies the coefficient of the two-factor interaction effect of xixj. The presence of the error vector ε accounts for variability in the model.
D-optimal design is a versatile and efficient approach to optimal experimental design, aiming to maximize the determinant of the information matrix associated with a particular model. This method excels in selecting the most informative experimental runs from a given set, accommodating any combination of factors, factor levels, and model complexities. Despite its flexibility and advantages, D-optimal design has certain limitations. It necessitates an accurate initial model estimation and a reasonable understanding of the factor ranges, making it sensitive to inadequate model assumptions and outliers in the data. Therefore, while powerful, D-optimal design requires careful consideration and data preparation to harness its full potential in experimental design and optimization.
In this paper, the D-efficiency of the information matrix of the full second-order model matrix is used to evaluate the design. A function of the determinant of the information matrix is often used for this evaluation. The D-value criterion that will be implemented here is as described by Nguyen and Lin [10]. We denote the information matrix , where Xp denotes the model matrix, n is the run size in the design (and model) matrix, and p denotes the model’s parameters. Note that p = 1 + 2k + k(k − 1)/2 in the case of the full second-order model. We are looking for the greatest possible D − values using the following variation from the literature:
(3)
We chose to use the D-efficiency form mentioned in Eq (3) so that readers can easily compare our results with those in existing literature. This helps create a common basis for understanding and discussing our findings in relation to other studies. Our goal is to contribute to the ongoing scientific conversation and make it simpler for everyone to interpret and compare results.
3 Design components
In this section, we provide a summary of the essential components of the composite designs that are required for implementing the suggested methodologies in constructing the new designs we proposed.
3.1 Orthogonal designs (ODs)
An orthogonal design of order n is denoted OD(n; a1, a2, …, am), having the variables (±x1, ±x2, …, ±xm), is a square matrix of order n with entries ±xk. An orthogonal design has its rows and columns pairwise orthogonal. This means that any two columns (or rows) have their dot product equal to zero and thus the design matrix D = OD(n; a1, a2, …, am) satisfies
where ±x1, ±x2…, ±xm are commuting variables, and In is the identity matrix of order n.
An orthogonal design D = OD(n; a1, a2, …, am), can have at most m = ρ(n) variables, where
(4)
For more in-depth information on orthogonal designs, interested readers are encouraged to consult Seberry [11].
Example 1 Presented below are orthogonal designs of orders 2, 4, 6, and 8, which will be employed in crafting the required axial components within the methodologies outlined in this paper:
3.2 Weighing matrices
A weighting matrix, denoted as W = W(n, w), is a square matrix of order n, with entries exclusively from the set −1, 0, + 1. The rows (and columns) are pairwise orthogonal, thus it satisfies W′W = WW′ = wIn, where w signifies the count of non-zero elements present in each row (or column) of the matrix, and In denotes the identity matrix of order n. The parameter w is referred to as the weight of W. Conceptually, one can view W as an orthogonal design where all the variables have been substituted with either ±1 or zero values, facilitating various applications in experimental design and statistical analysis, Koukouvinos and Seberry [12].
Example 2 An example of a weighing matrix of order 4 and weight 3 is
Specifically, circulant weighing matrices are of high significance due to the simplicity provided by their structure. A square matrix is classified as a circulant matrix when each row vector is made up by rotating the previous row vector one element to the right. An example of a circulant Weighing matrix of order 6 and weight 4 is
In circulant weighing matrices, the whole matrix can be defined by providing the first row vector called as generator vector. Similarly, a circulant weighing matrix W(7;4) of order 7 and weight 4 can be constructed by the generator vector (−1, 1, 1, 0, 1, 0, 0).
Two special cases, of a weighting matrix, that are of particular interest are the Hadamard matrices and the Conference matrices.
3.3 Hadamard matrices
A weighing matrix Hn is called a Hadamard matrix if Hn = W(n, n). It is easy to show that a Hadamard matrix Hn is a square matrix of order n, it has all entries ±1 (is a 2-level matrix), and any two of its rows (or columns) are orthogonal to each other (i.e. their dot product equals to zero).
Hadamard matrices have several important properties, which make them useful in our application. Their determinant is equal to the square root of its size. According to Brenner and Cummings [13], a Hadamard matrix of order n is a solution to the Hadamard’s maximum determinant issue because it gives the maximum determinant among any n complex matrices with components |ai, j|≤1. Obviously, . There are several methods for constructing Hadamard matrices, including Sylvester’s construction, Paley construction, and the Walsh–Hadamard transform (see Hennacy [14]).
Example 3 A 2 × 2 Hadamard matrix is:
Using Sylvester’s construction method a 4 × 4 Hadamard could be:
Similarly, the 8 × 8 Hadamard matrix can be constructed using a 4 × 4 Hadamard, and so forth.
3.4 Conference matrices
Conference matrices Cn can be considered as a special case of the weighing matrices. These matrices can be defined as Cn = W(n, n−1). Conference matrices are a particularly important class of 3-level matrices (Xiao et al. [15]). From the definition of weighing matrices, we can conclude that a conference matrix would have only one zero element per row (or column) while the rest are ±1. The dot product of any two distinct columns (or rows) of Cm is 0 thus the matrix satisfies . For more details we refer the reader to Goethals and Seidel [16].
3.5 Definitive screening designs
Definitive Screening Designs (DSDs), as introduced by Jones and Nachtsheim [6], is a type of experimental design used for studying quantitative factors. Definitive Screening Designs have many advantages compared to Standard Screening Designs as these were introduced by Plackett and Burman [17].
DSDs are designed in such a way that they exhibit mean orthogonality. This means the design allows for precise estimation of main effects and interactions while minimizing bias due to confounding factors. DSDs have a specific number of runs n, which is given by the formula n = 2m + 1, where m is the number of quantitative factors being studied. This design is saturated, meaning it allows for the estimation of the intercept, main effects, and quadratic effects without redundancy. Unlike some other experimental designs of Resolution III, DSDs ensure that all main effects are orthogonal to all two-factor interactions. This orthogonality property simplifies the analysis and interpretation of experimental results; see, for example, Anderson and Whitcomb [18]. In DSDs, two-factor interactions are designed in such a way that they are not fully aliased with each other. This means that the interactions are designed to be distinguishable from each other, making it possible to identify some of the significant interaction effects, see for example Vanaja and Shobha Rani [19]. Quadratic effects are independent of main effects and are distinguishable from two-factor interactions, allowing for the separate estimation of quadratic terms without interference. More details can be found in Goos and Jones [20].
Definitive Screening Designs can be implemented directly by using conference matrices, see the work of Xiao et al. [15]. The DSD design, based on the application of Conference Matrices Cm, could be of the form
with Cm satisfying the equation
Example 5 An example of a Definitive Screening Design of order 4 is:
where C4 is the Conference matrix of order 4.
In their work, Nguyen and Stylianou [21] highlight that employing a Conference matrix Cm of order m, which corresponds to a weighing matrix Wm of the same order and weight m−1, results in a Definitive Screening Design (DSD) that maintains orthogonality among its main effects. They also present an algorithm that allows for the generation of Definitive Screening Designs (DSDs) even when the number of factors is odd. This ensures that DSDs can be created for both even and odd values of m. One significant recent paper, see Ares and Goos [22], that deals with the blocking of DSDs appear in the literature. The reader who is interested in more details in DSDs may also consider the paper Ares and Goos [22] and the references therein.
3.6 Orthogonal matrices in block structure TOD
Using the approach outlined in the section on block structure of Orthogonal matrices by Alrweili et al. [9], we have generated new composed Orthogonal designs. Those designs consist of the blocks of known OD that are combined in such a way that they maintain their orthogonality. The following example illustrates this methodology and generated orthogonal designs that will be used as building blocks in composite designs.
Example 6 Consider the familiar orthogonal designs OD2, OD4, and OD6 as described in the Orthogonal Designs section. New block orthogonal designs of order 12 can be constructed by using a combination of those designs and filling the missing entries with zeros. These include the following three block orthogonal designs of order 12 that are of a completely different structure.
Note that the block orthogonal design has 8 distinct variables,
has 12 distinct variables and
has 4 distinct variables.
The same methodology can also be applied in cases where we have an odd number of factors, we can add an extra variable a and fill the missing value with 0s.
Example 7 Suppose we want to create a block orthogonal design with 7 factors, denoted as . We can achieve this by starting with a block orthogonal design of order 6, such as OD6(4+2), composed of OD4 and OD2. Next, we introduce a new variable, let’s call it a, in the (7, 7) entry, filling the positions (i, 7) and (7, i) with zeros for all i = 1…, 6. The resulting block orthogonal design will be:
These block orthogonal designs will be referred to as matrices , with k representing the number of rows. This nomenclature helps differentiate them from the traditional orthogonal designs outlined in section 3.1. These matrices can serve as the axial components in certain composite designs.
4 Construction methodology
In this section, we’ll explore four distinct design methods resulting from the combination of well-defined factorial and axial components. These methods draw from established experimental design literature. The selection of both the factorial and axial parts involves different approaches, aiming to create a derived design with enhanced efficiency. The first two methods are grounded in the framework initially discussed by Georgiou et al. [2].
The variations in building composite designs stem from specific choices made for the factorial and axial components. For instance, in the first and third methods, which we’ll discuss later, the axial part comprises known orthogonal designs, primarily outlined in Seberry and Yamada [23]. In contrast, the second and fourth methods incorporate axial parts consisting of block-structured orthogonal designs mentioned earlier. Below, we provide a more in-depth exploration of each of the four approaches and an illustration for each.
4.1 Method 1
This method was first introduced and used in the work of Georgiou et al. [2]. The design matrix is
The Factorial part F is a 2-level matrix, usually defined by a number of columns of a Hadamard matrix. The axial part A is a 3-level design, established by substituting the variables in the classic orthogonal designs ODs from section 3.1 with 0, 1, −1. These differ from the conventional axial part of a CCD, as explained in Montgomery [24]. The orthogonality property is maintained in the design matrix Xm. Some new designs with larger D-values are presented in coded form in Table 1. To demonstrate this methodology, consider the following example.
Example 8 The design matrix X is denoted by X = DH16A8a, and it is composed by the factorial part F, which consists of four columns of a Hadamard of order 16, and the axial part A, which consists of four columns of the orthogonal design OD of order 8. So, the design matrix X will include all these components as X = [FT, AT, −AT]T. The design Matrix X has k = 4 factors and nr = 32 runs, hence it has the coded name DH16A8a. Keep in mind that the experimenter has the flexibility to add any desired number of center points to this matrix.
4.2 Method 2
Similarly to the first method, in this construction, we opt for the factorial part to consist of selected columns from a Hadamard matrix, following the description in Method 1. The resulting design matrix is given by:
In contrast to Method 1, the key difference here is the utilization of TOD as the axial part of the design matrix. These structures follow a block orthogonal pattern, as explained in section 3.6. The design matrices produced through this method, leading to enhanced efficiency, are displayed in coded format in Table 2.
Example 9 The design matrix DH12A5(3+2) consists of four columns from a Hadamard matrix of order 12 as the factorial part and four columns from a block orthogonal structure TOD(3+2) of order 5 as the axial part. The parameters of TOD(3+2) indicate that its block structure is formed by employing a block orthogonal matrix of order 3 and a classical orthogonal design of order 2.
The composite design matrix X features k = 4 factors, nr = 22 runs, and was created using a Hadamard matrix of order 12 and a block orthogonal matrix of order 5 with type (3 + 2). Consequently, it has been assigned the coded label DH12A5(3+2).
4.3 Method 3
In the third method, we propose a novel composition for a composite design, comprising a factorial part, a Definitive Screening Design (DSD) part, and an axial part. The added DSD is built from a conference matrix Cm of order m without central points. In essence, our design takes the form:
Though there may seem to be a considerable number of runs, this innovative design demonstrates situations where it achieves a notably higher D-value while keeping run sizes comparable to those documented in the literature. Furthermore, these designs allow for the direct implementation of large-scale experiments without the need for a computer search, ensuring high efficiency, especially in cost-effective experimental settings.
Example 10 The design matrix DH8A4DSD4 is a composite design created with four columns from a Hadamard matrix of order 8, four columns from a Definitive Screening Design (DSD) with 4 factors generated from a conference matrix , and an axial part A generated from four columns of the classic orthogonal design of order 4. The resulting design matrix is as follows:
The Table 3 below demonstrates such new design matrices in coded form.
4.4 Method 4
The fourth method involves a novel construction that combines aspects of methods two and three. This innovative structure introduces new design matrices with larger D-values than those found in the existing literature. The design comprises a Factorial part, a Definitive Screening Design (DSD) matrix, and an Axial part. Like the third method, this approach incorporates a DSD constructed from a conference matrix Cm without central points. Additionally, the Axial part can be generated as a block orthogonal matrix, similar to the implementation in the third method. The orthogonality property of the factors is preserved in this method as well. The structure of the suggested design is given below:
Example 11 The design matrix, denoted as DH16A8(6b+2)DSD4, is constructed by combining three components. These components include four columns from a Hadamard matrix of order 16, four columns from a definitive screening design created using a conference matrix Cm4, and four columns from a block orthogonal matrix TOD = TOD(6+2) of order 8. The parameters in TOD(6+2) signify the use of orthogonal designs of order 6 and 2 in forming the block structure, as detailed in section 3.6.
The label for the final design matrix X in this example, which incorporates k = 4 factors and nr = 40 runs, is designated as DH16A8(6+2)DSD4. This label reflects the components employed in constructing the matrix, including a Hadamard matrix of order 16, a definitive screening design of 4 factors, and a block orthogonal matrix of order 8 and type (6 + 2).
Table 4 displays the design matrices in coded form. Utilizing the recommended methods, we generate alternative composite designs suitable for response surface methodology. Details on these constructed designs and their associated D-values are presented in the following section.
5 Composite designs comparison
In this section, we display the outcomes in Tables 1–4. The initial column in these tables signifies the name (label) of the design. This name comprises parameters describing the components of the specific design matrix. Specifically, the design matrix named denotes construction using some columns of the Hadamard matrix of order n, an equal number of columns from an orthogonal design of order k as its axial part, and the same number of columns from a Definitive Screening Design of order l.
The parameters in the subsequent three columns of the tables k, nr, and nc represent the number of factors, the number of runs (excluding center points), and the number of center points in the design matrix, respectively. The succeeding columns present the factorial (F), axial (A), and/or block Orthogonal Design (TOD) in coded form. In Table 3, the column Conf.Matrix(Cm) presents the conference matrix in coded form, crucial for constructing the required Definitive Screening Design.
The coded form of a design is derived by replacing 1s with 2s, 0s with 1s, and −1s with 0s, creating a number in the Ternary numeric system for each run of the design. Subsequently, the ternary value for each run is converted into the decimal numeric system, with missing digits replaced by 0s in the ternary representation.
The concluding columns of the tables furnish the calculated D-values of the model matrix for each design using the formula (3), as provided by Nguyen and Lin [10].
Example 12 The deconstruction method is elucidated below. Suppose we aim to reconstruct the DH16Cm5T5 design, as illustrated in Table 4. This design comprises the factorial part (F), the conference matrix (Cm), and the block orthogonal design matrix (TOD). It is a five-factor design (k = 5) with a total of 38 runs (nr = 38) and no center points (nc = 0). Each decimal number corresponds to a specific run in the design matrix. To decode, simply convert the decimal numbers into ternary numbers; for example, 17010 = 200223. Then, subtract one from each ternary digit to obtain the corresponding run in the design matrix. In this instance, 200223 results in the design’s run + 1, −1, −1, + 1, + 1.
For conference matrices, other axial points, or block orthogonal designs, the notation −Cm, −A, or −TOD denotes the negative of the matrix that is constructed by converting all + 1s to −1s while leaving the 0s unchanged.
6 Discussion
Creating composite designs is generally considered a manageable task, but the selection of columns in the design matrix becomes more intricate, especially when dealing with a larger number of factors and runs. The strategy proposed in this study not only proves to be easy to implement but also highly adaptable, allowing for the generation of designs tailored to the specific requirements of the experiment. A critical evaluation criterion for composite designs is the D-value, where higher values signify a more reliable and efficient model.
In the context of implementing 2nd order designs while maintaining orthogonality among main effects, four distinct methods were introduced. The first two methods, drawn from existing literature, have been applied in this paper, leading to the discovery of new designs that exhibit higher D-values than those reported in the existing literature.
Methods 3 and 4 introduce two entirely new techniques in experimental design. Although these approaches may necessitate more runs in some cases, they consistently yield much higher D-values than those found in the literature. An effort is consistently made to minimize the number of runs while ensuring the effectiveness of the design.
Tables 1–4 provide detailed insights into all the designs developed in this study. Further comparisons are presented in Table 5, where these designs are juxtaposed with existing composite designs from the literature. The table includes the authors’ names, the parameter k denoting the number of factors, and rounded D-values, along with the total run sizes of the composite designs in parentheses.
In the last row of Table 5, our newly proposed designs are highlighted, showcasing either significantly higher D-values or a reduced number of runs compared to the designs listed above. This suggests that the results presented in this paper have the potential to effectively reduce the cost of experiments while still achieving desired outcomes within a satisfactory time frame. All four methods are capable of producing designs with the same (or similar) number of runs as existing composite designs but are more efficient in terms of D-value, using the same design parameters outlined in the literature.
The ideas and methods shared in this paper offer possibilities for future research in experimental design. One important area is testing the proposed methods with more factors, going beyond the current limit of eight. Exploring how well these methods work with a higher number of factors will help us understand their adaptability and effectiveness in more complex experimental situations. Additionally, studying designs with more than eight factors in greater detail can give us more insights into the practical benefits and limits of the proposed approaches.
Another interesting direction is to continue improving and adjusting the methods based on real-world applications and feedback. Ongoing research could focus on using advanced statistical and computational techniques to refine design matrices, possibly reducing the number of runs while improving overall performance. This ongoing process of improvement, along with further exploration of the methods, will contribute to advancing and making experimental design methods more practical.
Building on what we have learned in this paper, there are more ways to explore and improve experimental design methods. We could try different versions of the proposed methods, maybe using different statistical models or adjusting them for specific experiments. Testing how well these methods work in various types of experiments and different conditions can help us understand their usefulness more broadly. Also, comparing them with other design strategies or getting feedback from people using them in real situations can give us more insights. These additional research paths aim to make our understanding of experimental design better and keep making improvements.
Acknowledgments
The authors would like to thank the two anonymous referees and the associate editor for their valuable comments and suggestions that improved the results and the appearance of the paper.
References
- 1. Box G.E.P., and Wilson K.B. On the Experimental Attainment of Optimum Conditions. Journal of the Royal Statistical Society. Series B (Methodological), vol. 13, no. 1, 1951.
- 2. Georgiou S.D., Stylianou S., and Aggarwal M. A class of composite designs for response surface methodology. Computational statistics and data analysis, 71:1124–1133, 2014.
- 3. Liu M., Mee R.W., and Zhou Y. ugmenting definitive screening designs: Going outside the box. Journal of Quality Technology, pages 1–13, 2022.
- 4. Ares J.N. and Goos P. Enumeration and Multicriteria Selection of Orthogonal Minimally Aliased Response Surface Designs. Technometrics, 62:1, 21–36, 2020.
- 5. Jones B., Lekivetz R. and Nachtsheim Christopher. A family of orthogonal main effects screening designs for mixed-level factors. Journal of Quality Technology. 55:5, 527–534, 2023.
- 6. Jones B. and Nachtsheim C.J. A class of three-level designs for definitive screening in the presence of second-order effects. Journal of Quality Technology, 43(1):1–15, 2011.
- 7. Jones B. and Nachtsheim C.J. Definitive screening designs with added two-level categorical factors. Journal of Quality Technology, 45(2):121–129, 2013.
- 8. Yu X., Hallett S., Sheppard J., and Watson A. pplication of the plackett-burman experimen- tal design to evaluate nutritional requirements for the production of colletotrichum coccodes spores. Applied Microbiology and Biotechnology, 47:301–305, 1997.
- 9. Alrweili H., Georgiou S., and Stylianou S. A new class of second-order response surface designs. IEEE Access, 8:115123–115132, 2020.
- 10. Nguyen N.-K. and Lin D.K. note on small composite designs for sequential experimentation. Journal of Statistical Theory and Practice, 5:109–117, 2011.
- 11.
J. Seberry. Orthogonal designs. In Orthogonal Designs: Hadamard Matrices, Quadratic Forms and Algebras, pages 1–5. Springer, 2017.
- 12. Koukouvinos C. and Seberry J. Weighing matrices and their applications. Journal of Statistical planning and inference, 62(1):91–101, 1997.
- 13. Brenner J. and Cummings L. The hadamard maximum determinant problem. The American Mathematical Monthly, 79(6):626–630, 1972.
- 14. Hennacy K. Wolfram’s new science: a new start?. Artificial Intelligence, 169(2):150–164, 2005.
- 15. Xiao L., Lin D.K., and Bai F. Constructing definitive screening designs using conference matrices. Journal of Quality Technology, 44(1):2–8, 2012.
- 16. Goethals J. and Seidel J.J. Orthogonal matrices with zero diagonal. Canadian Journal of Mathematics, 19:1001–1010, 1967.
- 17. Plackett R.L. and Burman J.P. The design of optimum multifactorial experiments. Biometrika, 33(4):305–325, 1946.
- 18. Anderson M.J. and Whitcomb P.J. Design of experiments. Kirk-Othmer Encyclopedia of Chemical Technology, pages 1–22, 2000.
- 19. Vanaja K. and Shobha Rani R.. Design of experiments: concept and applications of plackett burman design. Clinical research and regulatory affairs, 24(1):1–23, 2007.
- 20.
P. Goos and B. Jones. Optimal design of experiments: a case study approach. John Wiley and Sons, 2011.
- 21. Nguyen N.-K. and Stylianou S. Constructing definitive screening designs using cyclic generators. Journal of Statistical Theory and Practice, 7:713–724, 2013.
- 22. Ares J.N. and Goos P. Blocking omars designs and definitive screening designs. Journal of Quality Technology, 55(4):489–509, 2023.
- 23.
J. Seberry and M. Yamada. Hadamard matrices, sequences, and block designs, contemporary design theory: A collection of surveys, jh dinitz and dr stinson, eds. Wiley-Intersci. Ser.Discrete Math. Optim., Wiley, New York, pages 431–560, 1992.
- 24.
D.C. Montgomery. Design and analysis of experiments. John wiley and sons, 2017.