2.1. PCB image restoration model based on PIT

TV model is commonly used in image preprocessing for PCB-DD, which recovers the image by filtering and regularization [14]. Among them, filtering mainly removes the noise in the image by using a specific filter function. Whereas, regularization is used for noise removal and detail recovery by constructing a model [15]. The regularization expression formula for the TV model is shown in Eq (1).

(1)

In Eq (1), p denotes the image to be recovered and ∂ denotes the damaged image. denotes the fidelity term and B denotes the observation matrix. γ denotes the regularity term parameter and ‖Ap‖₁ denotes the TV regularity term. A denotes the discrete gradient operator. When the observation matrix B is irreversible, it leads to poor detail recovery of the image. In addition, a single TV regular term cannot take into account the balance between noise removal and detail preservation. Therefore, the study improves the TV and proposes a TV-ST bi-regularized image restoration (TSBRIR) method. Firstly, the study improves the TV regularization using ST to construct a PCB-IR model. The specific objective function (OF) expression is shown in Eq (2).

(2)

In Eq (2), f(p) is the OF of the PCB-IR model. γ₁ and γ₂ are the parameters of the TV regular term and ST regular term, respectively. N denotes the total number of ST subbands at p non-downsampling. r denotes the number of ST subbands at p non-downsampling. C_r denotes a block cyclic matrix. denotes an ST regular term. Moreover, PIT is introduced to improve the TV fidelity term to obtain the expression formula of the PCB-IR model. In mathematics, if a matrix with the same number of rows and columns is reversible, it has an inverse matrix. Therefore, the result of multiplying the matrix with its inverse matrix is the identity matrix. However, for non-square matrices or irreversible square matrices (such as singular matrices), the inverse cannot be obtained directly. At present, PIT can be used to solve this problem. PIT is not only applicable to irreversible matrices, but also to invertible matrices. Specifically, it is shown in Eq (3).

(3)

In Eq (3), denotes an auxiliary variable and B^† denotes the pseudo-inverse of the observation matrix B. a denotes a vector of Gaussian random variables with mean 0, and ϑ_a denotes the standard deviation. ℘ denotes a parameter that avoids a standard deviation of 0. denotes the pseudo-inverse fidelity term. For solving the constrained minimum optimization Eq (3), the study solves the OF of the PCB image restoration model based on the framework of the split Bregman (SB) algorithm and uses the adaptive threshold function to compute the sub-problems corresponding to the TV regular terms in the solution process. As an optimization algorithm, the SB algorithm is commonly used to solve sparse problems with global convergence property and desirable convergence speed [16,17]. The auxiliary variables b and ω_r are first introduced to improve Eq (3) such that b = Ap, ω_r = C_rp. Specifically as shown in Eq (4).

(4)

Next, the Bregman distances d_k and (d_r)_k are introduced to convert Eq (4) to what is shown in Eq (5).

(5)

In Eq (5), ℘₁ and ℘₂ denote the parameters that prevent the standard deviation from being zero. k is the images. Solving Eq (5) in the framework of the SB algorithm transforms the optimization problem of minimizing the OF of the improved model into four subproblems, as shown in Eq (6).

(6)

In Eq (6), p_k+1 denotes the transformed subproblem 1. (ω_r)_k+1 denotes the transformed subproblem 2. b_k+1 denotes the transformed subproblem 3. denotes the transformed subproblem 4. Based on the four subproblems obtained from the transformation, a step-by-step solution is performed. First, subproblem 1 p_k+1 is solved by taking the derivative of the right-hand side of the equation and making it equal to 0, as shown in Eq (7).

(7)

In Eq (7), the matrix transpose is denoted by T and the unit matrix is denoted by I. The study utilizes the conjugate gradient method to solve Eq (7), and the solution is the value of subproblem 1 p_k+1. Next, subproblem 2 (ω_r)_k+1 is solved using the soft threshold function. The specific expression is shown in Eq (8).

(8)

In Eq (8), shrink(·) denotes the soft threshold function. On this basis, solve subproblem 3 b_k+1. Since subproblem 3 is a subproblem about denoising the TV regular term, and the soft threshold function processed values will produce errors with the original values, it is investigated to introduce a nonlinear function for asymptotic compression of the threshold value to remove the errors [18]. The specific formula is shown in Eq (9).

(9)

In Eq (9), λ denotes the regulating factor and (*)_i denotes a definite element in *. Ψ(·) denotes the nonlinear function, and and w denote the two input vectors in the nonlinear function. sign(·) denotes the symbolic function. To achieve better denoising effect, the dynamic adjustment of the threshold function value can be realized by adjusting λ. At the same time, the subproblem 4 is solved. The specific expression formula is shown in Eq (10).

(10)

After solving all the subproblems, the Bregman distance is updated and the cutoff condition is set. The specific expression formula is shown in Eq (11).

(11)

In Eq (8), θ denotes the cutoff condition. Combining the above, when the TV regular term is anisotropic TV or isotropic TV, the computational flow is shown in Fig 1.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 1. Pseudo-inverse transform-based PCB image restoration model solving process.

https://doi.org/10.1371/journal.pone.0315424.g001

In Fig 1, the SB algorithm is first initialized and the parameters, conditioning factors, and cutoff conditions for model solving are set. Secondly, it solves the four subproblems of the transformation and updates the Bregman distance. When the solved subproblems satisfy the cutoff condition, the output of PCB recovery image is performed. On the contrary, the 4 sub-problems solving is repeated in order to find the optimal solution. It is worth mentioning that when the TV regular term is anisotropic TV or isotropic TV, the expression of subproblem 1 is updated as shown in Eq (12).

(12)

In Eq (12), A^odenotes the horizontal gradient and A^q denotes the vertical gradient. o and q denote the conjugate gradient, respectively. In addition, when the TV regular term is isotropic TV, subproblem 3 also needs to be further updated as shown in Eq (13).

(13)

In Eq (13), κ denotes the square root of the sum of squares of the conjugate gradients. Although Fourier transform and wavelet based methods are very effective in image processing, they usually need to make a global assumption about the image degradation process, such as assuming that the image degradation is linear and shift invariant. PIT can be directly adapted to specific degradation models, such as fuzzy kernel, making it more effective in dealing with specific types of degradation. The degradation characteristics of PCB images vary due to differences in manufacturing processes and conditions. PIT is capable of adapting to these changes because it is not based on a fixed transformation basis but rather on the specific information of images and the degradation process itself. Consequently, the application of PIT to enhance the fidelity term of the TV model ensures the preservation of image details and texture information, while simultaneously facilitating the removal of noise during the restoration process. This method demonstrates significant advantages in enhancing IR speed and quality.

2.2. PCB-DD model based on PIT and YOLOV5

According to the PCB-IR model based on PIT proposed in the previous section, the study further carries out the improvement of YOLOv5, which leads to the establishment of PCB-DD model based on PIT and YOLOv5. It is found that the YOLOv5 model in the process of DD of PCB images, the input image (II) will be resized to 640×640 size and downsampled by Fcous module and Conv layer into C1 (size: 320×320, channel: 64), C2 (size: 160×160, channels: 128), C3 (size: 80×80, channel: 256), C4 (size: 40×40, channel: 512) and C5 (size: 20×20, channel: 1024) five feature maps [19–21]. However, multiple downsampling operations result in PCB defect features in the C5 feature map being ignored, which reduces the PCB-DD accuracy. Therefore, the study utilizes the encoder module of Transformer to replace the Bottleneck module of YOLOv5 to improve the YOLOv5 model. Transformer’s self-attention mechanism can operate on the whole image and capture the global context information. This is particularly beneficial for elucidating the interrelationships and interactions between disparate objects within a PCB image, thereby facilitating more accurate identification of the relationships between different defects. In addition, multiple downsampling in YOLOv5 can lead to the loss of important information in the high-level feature map. Transformer can supplement this information, and through its encoder-decoder architecture, it can reintegrate the low-level detailed information with the high-level semantic information. The Transformer network layer structure used in the study is shown in Fig 2.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 2. Schematic diagram of transformer network layer structure.

https://doi.org/10.1371/journal.pone.0315424.g002

In Fig 2, the dimension of the input feature map matrix X is [g,e,H,J]. g, e, H, and J denote the input feature images, the channels, and the size, respectively. , and denote the trainable linear variation matrix. Q_i, K_i and V_i denote the corresponding matrices of the linear variation matrix, respectively. W^out denotes the linear transformation matrix. The feature image is reconstructed from the matrix consisting of dimensions height and width to obtain the [H×J,g,e] form to comply with the input feature image requirements of multi-head self-attention (MHSA) [22,23]. Second, the feature matrix is combined with the pixel-by-pixel positional coding information of the feature image to obtain a new input vector. The new input vectors are subjected to multi-head self-attentive perception in MHSA, and the reconstructed 2D image is output by the multilayer perceptron, resulting in a feature map containing more global and contextual information. The self-attention potential of MHSA enables the incorporation of more global and contextual information into the flat output feature maps. This results in the input vectors in the MHSA, after multiplication by the trainable linear variation matrix, having the corresponding matrix formulae as shown in Eq (14).

(14)

In Eq (14), U denotes the input vector. According to the obtained matrix formula, the study utilizes the scaled dot product attention operation to process the matrix and introduces the Softmax function to constrain the calculation results, so as to obtain the attention score of the corresponding attention head. The specific expression formula is shown in Eq (15).

(15)

In Eq (15), head_i denotes the attention head of YOLOv5. MultiHead(·) denotes the result of MHSA processing. Attention(·) denotes the attention score. β_k denotes the resultant limiting parameter of the Softmax function, and softmax(·) denotes the Softmax function. Concat(·) denotes extended fusion. Therefore, the C3 structure of the Transformer encoder after improving the Bottleneck module of YOLOv5 is shown in Fig 3.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 3. Schematic of the C3 structure of T-YOLOv5.

https://doi.org/10.1371/journal.pone.0315424.g003

In Fig 3, in improved C3 (IC3), the input feature image first passes through a 1×1 convolutional layer for channel number compression. The output feature image of the previous layer directly passes through a 3×3 convolutional layer for channel number adjustment and is converted into serialized data to be summed with the position code. After summation, the output feature image is transferred as input to the MHSA for residual concatenation and spliced with the input feature image again to obtain the final output of IC3. In YOLOv5, it has 8 C3 modules and 4 are in Backbone module and 4 are in Preiction module [24]. Therefore, the schematic diagram of YOLOv5 backbone network after improving the C3 modules is shown in Fig 4.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 4. Schematic diagram of T-YOLOv5 backbone network.

https://doi.org/10.1371/journal.pone.0315424.g004

In Fig 4, the study does not replace the shallow C3 module in the T-YOLOv5 backbone network, and only replaces the deeper C3 module with IC3. Since the BN normalization process relies heavily on the mean and method within each batch during the conventional YOLOv5 network training process and ignores the differences in each sample [25,26]. Therefore, the study improves the BN of the network by adding centering and scaling calibration to the beginning and ending parts of the Normalization layer of the network. This is shown in Eq (16).

(16)

In Eq (16), X_cm denotes the X centering calibration result. w_m denotes the weight vector that can be used for training. ⊙ denotes the dot product operator. s∈S denotes the input batch size (BS). denotes the mean value of X_cm. X_m denotes the centering feature. The centered features are subjected to a scaling process after the centering calibration is performed and a constant is introduced to avoid the denominator to be 0. Based on this, the Tanh function is utilized to limit the range of extreme values to be taken [27]. Therefore, after the scaling process and training, the final BN results are expressed as shown in Eq (17).

(17)

In Eq (17), X_s denotes the centered feature after performing the scaling process. Var(X_m) denotes the X_cm variance value. c denotes the constant that avoids Var(X_m) to be 0. X_cs denotes the original features obtained after scaling calibration. R denotes the image dimension. w_v and w_g both denote weight vectors that can be used for training. K_s denotes the statistics of X_s and Y denotes the final BN result. φ and μ denote the scaling parameter and the translation parameter, respectively. In addition, the loss function as an important influence on the model performance, the conventional YOLOv5 loss function is mainly composed of three losses: bounding box regression, classification and confidence [28,29]. The specific expression formula is shown in Eq (18).

(18)

In Eq (18), Loss denotes the loss function and l_obj denotes the confidence loss. l_cis denotes classification loss and l_box denotes bounding box regression loss. In l_box, generalized IoU (GIoU) is able to distinguish between different real frames and prediction frames. However, when the prediction frame is in the true frame, it degrades to an IoU, which prevents accurate prediction [30]. Therefore, the study utilizes α-IoU loss to replace GIoU as the model training loss function of T-YOLOv5. The specific expression formula is shown in Eq (19).

(19)

In Eq (19), l_α−IoU denotes the α-IoU Loss function. α denotes the adjustable parameter. υ denotes the predicted frame area. υ^gt denotes the real frame area and ρ denotes the predicted frame. Combining the above, the flow of the PCB-DD model based on PIT and YOLOv5 proposed in the study is shown in Fig 5.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 5. PCB-DD model flow based on pseudo-inverse transformation and YOLOv5.

https://doi.org/10.1371/journal.pone.0315424.g005

In Fig 5, the study firstly utilizes PIT to improve the TV model and constructs the IR model for PCB-DD in order to improve the clarity of PCB images. ST and biregularization strategies are introduced to perform the image recovery process in the framework of SB algorithm. The OF is transformed into a subproblem that can be solved in steps by introducing auxiliary variables and Bregman distance to output the recovered PCB image. Secondly, Transformer is introduced to improve YOLOv5, and the BN and loss function of YOLOv5 are optimized. The recovered image is input into T-YOLOv5 for DD and the results are output.

2.3. Self-built PCB-DD dataset

Since PCB-DD mainly analyzes the image data of PCBs in order to determine their defects, the criteria for defining PCB defects are not clearly defined. Therefore, the study uses the Institute of Printed Circuit (IPC) standard as the principle of PCB-DD, and uses the PCB open dataset released by Peking University as the basis for data enhancement and other techniques to expand the number of PCB dataset samples. The PCB-DD dataset contains 1386 images, covering 6 different types of defects, including pin holes, mouse bites, open circuits, short circuits, dispersion, and miscellaneous copper. These images can be used for image detection, classification, and registration tasks. The images in the dataset are captured by industrial cameras with a resolution of 1920×1080, and the dataset is divided into training, validation, and testing sets in a ratio of 6:2:2. The format of the dataset follows the PASCAL VOC format. The IPC standards are shown in Table 1.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Table 1. PCB defect types.

https://doi.org/10.1371/journal.pone.0315424.t001

According to the PCB defect types shown in Table 1, the study flipped, randomly cropped, and added Gaussian white noise to 693 PCB images to obtain 12890 PCB images. The images contain 23464 defects of different types. It mainly includes 3919 hole defects, 3987 rat tear defects, 3855 open circuit defects, 3801 short circuit defects, 3913 burr defects, and 3989 residual copper type defects. For the purpose of training models and validating their performance, the dataset is split 9:1 into training and test sets. The visual analysis of PCB data set is shown in Fig 6.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 6. Analysis chart of PCB number series.

https://doi.org/10.1371/journal.pone.0315424.g006

Fig 6a and 6b show the sample distribution of the PCB dataset and the position of the center of the object. There are 11,601 images in the training set and 1,289 images in the test set. There are 11,601 images in the training set and 1,289 images in the test set.

3.1. PIT-based PCB image restoration model validation

Both PCB and natural light images are used in the study in order to confirm the validity of the PCB-IR model based on PIT. 1.28 and 0.001 are the regularization parameters that are set, respectively. The adjustment factor is set to 1 and the cutoff condition is 0.0001. Meanwhile, two-step iterative shrinkage/thresholding (TwIST) algorithmic framework is introduced to compare with SB algorithmic framework. Moreover, the anisotropic TV calculation under TwIST solution is defined as TwIST-1 and isotropic TV is defined as TwIST-2. The anisotropic TV under SB algorithmic framework solution is defined as SB-1 and isotropic TV is defined as SB-2. To assess the performance of the PCB-IR model under the two solution frameworks, the various methods are applied to four natural light photos with varying values of blur kernel, peak signal-to-noise ratio (PSNR), and image processing time. The study firstly compares the PSNR of the four calculation methods under different values of the fuzzy kernel (FK), as shown in Fig 7.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 7. Comparison of PSNR of different methods with different fuzzy kernels.

https://doi.org/10.1371/journal.pone.0315424.g007

It can be seen from Fig 7A that the research proposed algorithm has the highest PSNR value among the four images when the value of FK is taken as 1. Fig 7B–7D also show the reasonableness and effectiveness of the research proposed using the SB algorithm as a PCB image restoration model solving algorithm. The research proposed method has the highest PSNR value in all natural light image processing. The average increase in PSNR obtained by SB algorithm for restoration of 4 images is 0.68% when FK is 1. The average increase in PSNR obtained by restoration of 4 images when FK is 2 is 2.43% compared to TwIST. When FK was 4, SB increased PSNR by an average of 1.35% over TwIST. When FK was 6, SB showed an average increase of 1.46%. Among them, the PSNR value of SB-2 is optimal among the four methods, while the PSNR value of TwIST-2 is also significantly better than TwIST-1. This may be due to the fact that isotropic TV can greatly preserve the details of the image and reduce its distortion when restoring the image, thus obtaining a better image quality for restoring the PCB image. TwIST converges slower, often requires more iterations when dealing with large-scale datasets, and it is more sensitive to noise, which may be the reason why TwIST performs inferior to SB. The recovery times of the four methods with different FKs are shown in Fig 8.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 8. Comparison of time of different methods with different fuzzy kernels.

https://doi.org/10.1371/journal.pone.0315424.g008

From Fig 8A–8D, it can be seen that the time overhead required for the PCB image restoration model proposed in the study is significantly lower than that of TwIST. when FK is 1, the time overhead required for SB is reduced by an average of 39.89% compared to that of TwIST; when FK is 2, the time overhead of SB is reduced by an average of 39.88% compared to that of TwIST; and when FK is 4 and 6, respectively, the time overhead required for SB to in 4 image The time overhead for performing the recovery process is reduced by 38.78% and 40.95% compared to TwIST, respectively. Combining anisotropic TV and isotropic TV also shows that the time overhead of anisotropic TV in performing image restoration is generally lower than that of isotropic TV under the framework of both algorithms, which may be attributed to the fact that the computational complexity required in solving anisotropic TV is lower, and thus the time it requires is reduced accordingly. However, on the whole, the study proposes that the proposed PCB image restoration model is reasonable and effective using the SB algorithm to solve the proposed PCB image restoration model. At the same time, the study further analyses the iterative change of PSMR values when the four methods perform the restoration process by taking image 3 as an example, as shown in Fig 9.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 9. Iterative change of PSNR value during image 3 restoration process.

https://doi.org/10.1371/journal.pone.0315424.g009

The study’s suggested method’s iterative convergence is fastest in Fig 9A during image 3 recovery, whereas the TwIST approach has the slowest convergence and a substantially lower PSNR value than the SB algorithm. Combined with the iteration step size of different methods in Fig 9B, it can be concluded that the SB algorithm is superior. Meanwhile, the study further utilized the acquired PCB degradation images to verify the IR results, which are shown in Fig 10.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 10. Pseudo-inverse transform based PCB image restoration model restoration results.

https://doi.org/10.1371/journal.pone.0315424.g010

Comparison of the PCB degradation image in Fig 10A with the anisotropic TV recovered image in Fig 10B shows that the PCB image is clearer after the recovery. Additionally, the anisotropic TV recovered image in Fig 10C can demonstrate the efficacy of the study’s suggested strategy. Therefore, the PCB image recovery model proposed by the study on the basis of PIT can effectively remove the noise and retain the detail information of the PCB image, while the model solving in the framework of the SB algorithm is able to obtain a superior PCB recovery image. And in order to further illustrate the applicability of the model in a wider range of scenarios, the study introduces the publicly available PCB-DD (D1) and the self-constructed PCB-DD (D2) from Peking University for the comparison of the model training effect. The details are shown in Table 2.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Table 2. Performance comparison of different dataset models.

https://doi.org/10.1371/journal.pone.0315424.t002

As can be seen from Table 2, the proposed model has superior training results in the self-built dataset D2, while the model accuracy and F1 score in the unimproved public dataset D1 are above 93%. This indicates that the model is better adapted to the specific features of PCB defect detection and has strong generalisation ability.

3.2. PCB-DD model validation based on PIT and YOLOV5

After the proposed PCB dataset is preprocessed by the PIT-based PCB-IR model, the study uses the pre-training weights published by the YOLOv5 developers to train T-YOLOv5. Moreover, the study utilizes stochastic gradient descent (SGD) to update the model parameters. The BS is set to 16, the weight decay is 0.0005, the learning rate is 0.01, the hyperparameter is 0.9, the II size is set to 640×640, and the training rounds is 200. To effectively illustrate the rationality and superiority of the study’s improvement of YOLOv5, the study firstly conducts ablation experiments to systematically analyze the system with three parts, namely, IC3, modified BN and α-IoU. Table 3 displays the specific outcomes.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Table 3. Results of ablation experiments.

https://doi.org/10.1371/journal.pone.0315424.t003

The results of the ablation experiments obtained with IC3, BN and α-IoU when the value of IoU is taken as 0.5 are shown in Table 3. Comparing Experiments 1 and 2, it can be noticed that the improvement of IC3 increased the model mAP value by 1.47%, while the FPS decreased by 3 FPS. The model mAP value of Experiment 3, which only modified the BN, increased by 0.89% compared to Experiment 1. Moreover, the mAP value of the Experiment 4 model with only improved α-IoU increased by 0.50% compared to Experiment 1. This indicates that either improving IC3, BN or α-IoU can improve the performance of the YOLOv5 model. The combination of Experiment 5, Experiment 6 and Experiment 7 further shows that the model mAP value is significantly increased compared to a single improvement. Whereas the combined mAP value of the three improved strategies in Experiment 8 is as high as 99.14%, the mAP values of the other seven experiments increased by 0.32%-2.79%. This demonstrates that the study’s revised YOLOv5 technique can increase the model’s performance. Combining the different methods of improvement shows that IC3 is the main variable that determines the performance of the model. The introduction of MHSA into the IC3 module may be responsible for this improvement. MHSA expands the receptive field of the T-YOLOv5 model, allowing it to capture more global information about the PCB image. Additionally, it addresses the deficiency of T-YOLOv5, which previously resulted in the loss of shallow information when performing continuous downsampling operations. Moreover, the BN modification mainly enhances the feature expression of the T-YOLOv5 model and improves the stability of the image feature distribution. Furthermore, by using α-IoU as the loss function, the degrading faults of GIoU are also eliminated, and the prediction frame is brought closer to the actual frame, improving the accuracy of the loss function’s bounding box regression to the target. Based on this, the study goes on to examine the T-YOLOv5 model’s performance as well as the findings of its detection of the six PCB dataset fault types. The details are shown in Fig 11.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 11. Validation results of T-YOLOv5 on PCB dataset.

https://doi.org/10.1371/journal.pone.0315424.g011

In Fig 11A, the proposed T0YOLOv5 model of the study has an accuracy of 98.37%, a recall of 99.24%, and a mAP/IoU = 0.5 of 99.15% after 200 rounds of iterations in the PCB dataset. It is evident that it is more successful in identifying the six types of faults when combined with the T-YOLOv5 model in Fig 11B for the six types of PCB-DD confusion matrices. To further illustrate the effectiveness of the PCB-DD model proposed in the study, the study introduces faster region-based convolutional network (Faster R-CNN) [31]. Single shot multibox detector (SSD), YOLOv3, YOLOv4, and the unimproved YOLOv5 are compared with the performance of the proposed T-YOLOv5 [32–34]. Among them, the AP for six defect types of PCB dataset is shown in Fig 12.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 12. Absence detection results of different models for each type of absence in the test set of PCB dataset.

https://doi.org/10.1371/journal.pone.0315424.g012

In Fig 12, the research proposed T-YOLOv5 has the highest detection results in five types of defects. The AP values in the hole defect types increased by 1.60%-39.19% over the other models. In the rat-bite defect type, the T-YOLOv5 model have an AP value of 98.81%, which is an average increase of 16.28% over the other models. Moreover, the AP value of T-YOLOv5 in the three types of DD, namely open circuit, burr and residual copper, is still 98.52% and above. This indicates the reliability of the study proposing improvements to the YOLOv5 model. The AP value in short-circuit type defects is reduced by 0.11% compared to Faster R-CNN. There may be fewer examples for short-circuit type problems as a result of the training set’s unequal sample distribution. Faster R-CNN usually requires higher computational resources and a longer training process, which contributes to the degradation of its DA. And SSD is similar to Faster R-CNN in that its detection results usually need to remove overlapping detection frames through post-processing steps such as non-great value suppression, which increases the complexity of the algorithm. Comparatively speaking, among the six models, the T-YOLOv5 model is more advantageous for PCB-DD. In the meantime, Table 4 presents the precise findings of the study’s comparison of the six models’ performances in the PCB dataset.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Table 4. Comparison of detection results of different models in PCB dataset.

https://doi.org/10.1371/journal.pone.0315424.t004

In Table 4, the proposed T-YOLOv5 model of the study has a detection recall of 99.7% in the PCB dataset, which is an average increase of 10.90% compared to the other five models. In terms of mAP value, the T-YOLOv5 model has a mAP of 99.1%, which is an average increase of 12.87% over the other models. The Faster R-CNN model needs to pre-generate candidate ports during the PCB-DD process and then perform sliding window operation with convolutional computation, which may be the reason for its poor FPS and weight. While SSD is mainly recognized by the generated multi-scale feature images, it is weak in recognizing shallow feature maps, which may be the reason for its poorer effect on PCB-DD. Further comparing the study’s proposed T-YOLOv5 with the YOLO series model, it can be noticed that after IC3, BN, and the loss function, T-YOLOv5 has been significantly improved in terms of detection speed, accuracy, and weight. On this basis, the study further compares the effect of YOLOv5 and T-YOLOv5 in PCB-DD. Fig 13 displays the specific visualization findings.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Fig 13. Comparison of the detection results of the two models for PCB defects "short" and "open circuit".

https://doi.org/10.1371/journal.pone.0315424.g013

Comparing the detection results of YOLOv5 in Fig 13A with those of T-YOLOv5 in Fig 13B, it can be observed that the T-YOLOv5 model PCB is more accurate in the detection of open-circuit defects. The combination of the previous validation results provides further evidence of the effectiveness of the PCB-DD model based on PIT and YOLOv5, as proposed by the study. Additionally, the study’s improvement of YOLOv5 has been demonstrated to enhance the DA of the PCB-DD model. Finally, the DNN-based PCB-DD method proposed in reference [4] and the CNN-based PCB-DD method proposed in reference [6] are presented and compared with T-YOLOv5. Based on these literatures, the study proposes optimal parameters. The performance is compared and the test is repeated five times to get the t-test results as shown in Table 5.

Download:

• PPT
  PowerPoint slide
• PNG
  larger image
• TIFF
  original image

Table 5. Performance comparison of different methods.

https://doi.org/10.1371/journal.pone.0315424.t005

In Table 5, the t-values between the proposed method and other methods are all above 1.96 (at 95% confidence level, two-tailed test). It shows that the differences between different methods are statistically significant. Concurrently, the results illustrate the efficacy and superiority of the proposed method.